Support raw input data in apps/pkeyutl

This PR kicks #8030 away. This PR follows what was discussed in #8030 , and adds the ability to apps/pkeyutl to accept raw input data rather than pre-hashed data.
The original SM2 ID string support is also squashed into the only one commit, which I think that could be separated later.

Checklist

[x] documentation is added or updated
[x] tests are added or updated

Changed to stream reading for raw input and tests are added as well.

WIP prefix is removed in the title

Squashed and pushed to master (a7cef52f9 and e766f4a053) and cherry-picked the SM2 default digest fix to 1.1.1 (9c6d536f53).
Thanks!


[Bug?] Machines can get achivements

Something rather minor, not sure if this is intentional or not. The screenshot pretty much says it all, loaded up my (single player) world to that bit of amusement.

This is a Forge bug, not an Industrial Foregoing bug. MinecraftForge/MinecraftForge#4255


The stun when you exit a container applies when you get regurgitated out of a xeno

Not sure if this is intended
You'll have a 4 second stun instead of the 1 second devour stun

It effects auto regurgitate stun when it shouldn't, the normal regurgitate happens to match up exactly. Should be an easy fix.


Password rule for WAS Admin user (wsadmin) should allow more special chars

When I used a password with special chars like $ ! _ / the deploy/login failed
Rule was updated in CreateUIDefinition.json to restrict special chars:

Password must be at least 12 characters long and not contain any of the following characters: !#$&*/?^

We need to allow most of these special chars

@git4rk @edburns
As we just agreed in the Slack channel, let's use the same regex used in WebLogic administrator password:
{
                        "name": "wlsPassword",
                        "type": "Microsoft.Common.PasswordBox",
                        "label": {
                            "password": "Password for WebLogic Administrator",
                            "confirmPassword": "Confirm password"
                        },
                        "toolTip": "Password for WebLogic Administrator",
                        "constraints": {
                            "required": true,
                            "regex": "^(?=.*[A-Z])(?=.*[a-z])(?=.*\\d)[A-Za-z\\d]{12,}$",
                            "validationMessage": "The password must contain at least 12 characters, with at least 1 uppercase letter, 1 lowercase letter and 1 number, and special characters are not allowed."
                        },
                        "options": {
                            "hideConfirmation": false
                        },
                        "visible": true
                    }

As you can see, special characters are not allowed. So let's follow the same pattern to quickly fix the issue.

The plan of record is to fix it using the simple regex shown by @majguo  in this comment but resolve it after MVP release.


URL to PDF - Enable Javascript

When trying to convert a URL to PDF, i get to download a file with the only text being this:

I haven't been able to find other issues regarding this or documentation on how to enable Javascript.
Any help here would be appreciated.

Unfortunately, WeasyPrint doesn't support JS so that's not currently possible.

We could really use this feature as well.


Add write back support for unmount option and copy to support for mount option

Add a -c, --copy-back option for the unmount operation.
Achieved by using cp instead of std::fs::copy, because cargo uses the file timestamps to determine if a file has changed.

Also add copy to ramdisk option for the mount operation, using c, --copy-to option

Hi @PauMAVA
I'm sorry for not getting back to you sooner. I've resolved the logging problem and added a test for copying to and back.
https://github.com/PauMAVA/cargo-ramdisk/blob/af865ab21eb16a53cbe9587be5e0913ce940c4d4/src/main.rs#L287

Hey!
No problem. Almost there, please run cargo fmt and commit the changes so that the workflow doesn't fail.
Thanks!

Everything good!
Thanks a lot for your interest and contribution to cargo-ramdisk @psdzzm 😄

Available in crates.io as from 0.2.0.

If possible, you can add the copy to and back option in README. Both mount and remount use -c option for enabling, like cargo ramdisk mount -c.

Yep. Just updated the README and also the workflow as the tests were failing sometimes due to test parallelism.


[ERROR] apiRequest failed. URLError: [Errno -2] Name or service not known

Hi,
I'm running ff4d for the very first time and maybe I forgot to do something along the way.
Here is what I get :
$ mkdir ~/testDropBox
$ ./ff4d.py -d ~/testDropBox/
********************************************************
* FUSE Filesystem 4 Dropbox                            *
*                                                      *
* Copyright 2014                                       *
* Sascha Schmidt<EMAIL_ADDRESS>                 *
*                                                      *
* https://github.com/realriot/ff4d/blob/master/LICENSE *
********************************************************

[INFO] No accesstoken available. Fetching a new one.

Please choose which permission this application will request:
Enter 'd' - This application will have access to your whole
            Dropbox.
Enter 's' - This application will just have access to its
            own application folder.

Please enter permission key: d
[DEBUG] Initialzed apiAuth
[DEBUG] Trying to fetch apiAuth code: dropbox fg7v60fm9f5ud7n
[ERROR] apiRequest failed. URLError: [Errno -2] Name or service not known
[DEBUG] Failed to fetch apiAuth code (Traceback (most recent call last):
  File "./ff4d.py", line 598, in getCode
    result = self.apiRequest.get("https://tools.schmidt.ps/authApp", args)
  File "./ff4d.py", line 536, in get
    raise Exception, 'apiRequest failed. URLError: ' + str(e.reason)
Exception: apiRequest failed. URLError: [Errno -2] Name or service not known
)
Failed to start authorization process
[DEBUG] Got accesstoken from user input: False
[ERROR] No valid accesstoken available. Exiting.
$ echo $?
255

Can you help ?

It's trying to access a webservice that isn't available anymore (https://tools.schmidt.ps/authApp). See #14 for more info.
You'll have to create an access token using getDropboxAccessToken.py, this doesn't require the webservice.

Rewritten code. Pls test again.


Updates so it runs on Umbraco 7.7.x (no more user types but these hav…

…e been migrated to groups)

I see the alias as "admin" rather than "administrators" on a deafult 7.7.4 site??

I can confirm that this PR makes the package compatible with my current Umbraco v7.12.3 - Thanks @TimGeyssens


HTML Mixed Mode Support

I'm looking at having DustJS files syntax highlighted. It's just like PHP/ASP/etc, where it's an HTML file, with another language mixed in.
Is this supported? I'm not getting any highlighting for HTML in my file. There are no errors in the console either.
I created an extension using yo code and selecting New Language Support. I then used this URL as the tmLanguage file. https://raw.githubusercontent.com/jimmyhchan/Dustjs.tmbundle/master/Syntaxes/DustJS.tmLanguage This language has an include for text.html.basic.
When doing a search in this repo for text.html.basic I get several other syntaxes that reference it. If I try using those languages with an html or dust file, it doesn't highlight the html. If I change the language to html, everything highlights as expected.
This is my package.json file. The tmLanguage file is the one referenced above.
{
	"name": "dustjs",
	"displayName": "dustjs",
	"description": "dustjs language support",
	"version": "0.0.1",
	"publisher": "anonymous",
	"engines": {
		"vscode": "^0.10.1"
	},
	"categories": [
		"Languages"
	],
	"contributes": {
		"languages": [{
			"id": "dustjs",
			"aliases": ["DustJS", "dustjs"],
			"extensions": [".dust",".tl",".dustjs"],
			"configuration": "./dustjs.configuration.json"
		}],
		"grammars": [{
			"language": "dustjs",
			"scopeName": "text.html.dustjs",
			"path": "./syntaxes/dustjs.tmLanguage"
		}]
	}
}

I also saw this. https://github.com/Microsoft/vscode/issues/543

#543 fixes this.


Upgrading to TypeScript 3.7 yields vue-router type error with composition-api

Version
3.1.3
Reproduction link
https://github.com/aaf-ww/vue-router-typescript-bug
Steps to reproduce
Scaffold a new project with CLI (TypeScript/Babel/vue-router/etc), install @vue/composition-api then upgrade to TypeScript 3.7.2
vue create project-name (select all options)
npm install @vue/composition-api
npm update typescript@latest -D

What is expected?
No type errors.
What is actually happening?
ERROR in C:/Users/x/Desktop/source/vue-router-typescript-bug/src/router/index.ts(24,30):
24:30 Argument of type '{ mode: "history"; base: any; routes: ({ path: string; name: string; component: VueProxy<ComponentPropsOptions, Data>; } | { path: string; name: string; component: () => Promise<...>; })[]; }' is not assignable to parameter of type 'RouterOptions'.
Types of property 'routes' are incompatible.
Type '({ path: string; name: string; component: VueProxy<ComponentPropsOptions, Data>; } | { path: string; name: string; component: () => Promise<typeof import("C:/Users/x/Desktop/source/vue-router-typescript-bug/src/views/About.vue")>; })[]' is not assignable to type 'RouteConfig[]'.
Type '{ path: string; name: string; component: VueProxy<ComponentPropsOptions, Data>; } | { path: string; name: string; component: () => Promise<typeof import("C:/Users/x/Desktop/source/vue-router-typescript-bug/src/views/About.vue")>; }' is not assignable to type 'RouteConfig'.
Type '{ path: string; name: string; component: VueProxy<ComponentPropsOptions, Data>; }' is not assignable to type 'RouteConfig'.
Types of property 'component' are incompatible.
Type 'VueProxy<ComponentPropsOptions, Data>' is not assignable to type 'VueConstructor | ComponentOptions<Vue, DefaultData, DefaultMethods, DefaultComputed, PropsDefinition<...>, Record<...>> | AsyncComponentPromise<...> | AsyncComponentFactory<...> | undefined'.
Type 'ComponentOptions<Vue, { [x: string]: unknown; }, never, never, ComponentPropsOptions, ExtractPropTypes<ComponentPropsOptions, false>> & VueConstructorProxy<...>' is missing the following properties from type 'VueConstructor': extend, nextTick, set, delete, and 9 more.
22 | ];
23 |

24 | const router = new VueRouter({
|                              ^
25 |   mode: "history",
26 |   base: process.env.BASE_URL,
27 |   routes
Version: typescript 3.7.2

I have the same issue. Any news?

This issue looks the same as https://github.com/vuejs/composition-api/issues/185
The same problem occurred, but it was solved by defining an empty “props”.
export default createComponent({
  props: {}
})

An alternative until this is fixed is:
// @ts-ignore <- ignore it
const router = new VueRouter({
  routes,
  mode: 'history'
})

This may seem hacky, but I think it's better than adding empty props key to every component (did not work for me).

This may seem hacky, but I think it's better than adding empty props key to every component (did not work for me).

@lmiller1990  did you try the suggestion from the post above yours to add props:{} ?  seemed to work for me

I did, but then I need to add an empty props key to a large number of components. I'm happy to just ts-ignore for now. Wonder what the fix is for this? Might take a look and try and make a PR.

typecasting the imported component also works as a workaround:
{
  path: '/users',
  component: Users as VueConstructor<Vue>
}

@posva I noticed you added the contribution welcome tag! I am interested in working on TypeScript/Vue 3 compatibility - will have time to get started in the next week.

Hey Kristin, awesome! Just to make sure: this issue is about compatibility with the Vue 2 plugin, not Vue 3.
But you're welcome to contribute to both :)

It may be that the problem is at https://github.com/vuejs/composition-api/issues/185 too, ending up in no contribution here

I believe it's fixed in @vue/composition-api v0.4

I 'm new to TypeScript and came here because think this is related.
export default function ({ store }) {
  const Router = new VueRouter({
    scrollBehavior: () => ({ x: 0, y: 0 }),
    routes,

    // Leave these as they are and change in quasar.conf.js instead!
    // quasar.conf.js -> build -> vueRouterMode
    // quasar.conf.js -> build -> publicPath
    mode: process.env.VUE_ROUTER_MODE,
    base: process.env.VUE_ROUTER_BASE
  })

The mode is underlined saying

What is the correct way to avoid this error?


how to configure ambassador to route to the service in different namespace based on header value

Please describe your use case / problem.
We use one namespace per tenant to handle the multiple tenancy.  so the service running on each namespace per tenant. tenantId is in http header.
We would like to configure ambassador to route the request to the service in specific namespace based on the value of tenantId.
Some Configuration like this:
apiVersion: ambassador/v0
kind:  Mapping
name:  qotm_mode_mapping
prefix: /qotm/
headers:
key: value
service: qotm-mode.${tenantId}

It's not possible to do it dynamically like that. A solution is to create a mapping per tenant where key could be tenant-id and the value bigtenant01. Then if you route an http request into Ambassador it will match only that mapping. The service field would be something like qotm-mode.bigtenant01.


Change the log type of the default config writing message

I thought this seemed strange as an error because this part of it isn't really an error.

Whoops - I was going to use this for screenshots but I forgot this repo doesn't have the changeset bot. It's probably a good change though anyway.


fix: Oudjaarsdag is not a public holiday

Oudjaarsdag is not a public holiday and therefor should be removed.
https://www.rijksoverheid.nl/onderwerpen/arbeidsovereenkomst-en-cao/vraag-en-antwoord/officiele-feestdagen

Thanks! I used https://www.wettelijke-feestdagen.nl/wettelijke-feestdagen-nederland-2024.aspx, which said it's an official one in NL

Thanks! I used https://www.wettelijke-feestdagen.nl/wettelijke-feestdagen-nederland-2024.aspx, which said it's an official one in NL

No worries! Most stores are open on the 31st, however some of them are also closed.
Nonetheless, it's not a public holiday here.


Parameter support in tasks file

It would be nice to declare parameters in a tasks file, overwrite these parameters on the command line and pass parameters down to included task files.
I think it makes sense to keep syntax the same as CloudFormation.
e.g:
Parameters:
  resourcePrefix: # can be overwritten by cli
    Type: String
    Default: My

  required: # no Default means error if not provided by cli
    Type: String

OrganizationUpdate:
  Type: update-organization
  Template: ./organization.yml

CfnTemplate:
  Type: update-stacks
  Template: ./my-template.yml
  StackName: my-stack
  Parameters:
    Param: !Ref resourcePrefix

MyInclude:
  Type: include
  Path: ./another-orgformation-tasks.yml
  Parameters:
    Param: !Ref resourcePrefix

and on the CLI:
\> org-fromation perform-tasks my-tasks --parameters resourcePrefix=XYZ required=ABC
or if you are into typing a lot:
\> org-fromation perform-tasks my-tasks --parameters ParameterKey=resourcePrefix,ParameterValue=XYZ ParameterKey=required,ParameterValue=ABC

released as part of v0.9.5


Check the subuniverse relation when proving x : U' >> x in U.

Weakness discovered in #444.

This should wait for #457.

Magically this was already done.


Fix output-module-groups failing if terragrunt.hcl file not found in working dir

Description
Fixes #2685
After a quick look, it seems like the changes introduced from 73d2c83 added (seemingly unnecessary?) code in the Run func for output-module-groups which treated it as if it were a terraform command, which would of course need to find the root configuration in order to build the temp dir in which to run terraform.
I updated the relevant test to move the terragrunt.hcl file out of the root of the working directory in the context of the test, which indeed caused it to fail as described in the issue. Removing the terraform invocation from the action matches the documented behavior and all relevant tests pass.
This is my first contribution to this repo and I've only dug through enough code to identify the root cause at a high level, so please let me know if I've misunderstood the intent of the code I removed.
TODOs
Read the Gruntwork contribution guidelines.

[x] Update the docs.
[x] Run the relevant tests successfully, including pre-commit checks.
[x] Include release notes. If this PR is backward incompatible, include a migration guide.

Release Notes (draft)
Updated output-module-groups to no longer require a terragrunt.hcl file in the working directory.

Hello,
It would be helpful to add an integration test that will track whether this issue will not occur again.
Examples in: https://github.com/gruntwork-io/terragrunt/tree/master/test

Hello, It would be helpful to add an integration test that will track whether this issue will not occur again.
Examples in: https://github.com/gruntwork-io/terragrunt/tree/master/test

There was already an integration test around this functionality, but it seemed like it was only passing because the test fixture itself already had a terragrunt.hcl file in the root (which I simply removed -- I'm not familiar with the reasoning behind setting up that fixture as such to test this func). Given that, is there anything else necessary?
Additionally, there are changes over in #2769 that builds additional functionality on top of this function that looks interesting, and @bt-macole has suggested cherry picking these changes into that, so perhaps we can continue improving upon this function in that PR.

Closed to track in #2769


Image read through Photos is truncated

I'm currently evaluating Dokan with the .Net adaptor as a solution for implementing a virtual file system.
When I create a virtual file system in my application, and then open a .png file in Photos, (Windows 10, double-clicked via explorer,) the image displayed is truncated.
In contrast, I can successfully open the same .png file from a virtual file system from the sample Mirror.cs.
This leads me to believe that the problem is my application.
Any suggestions? I assume I'm making a silly mistake.

File System requests you to download parts of your image. At the end the whole image should be complete. In your case you are missing some bytes.
Run your code in the way the operating system does the requests and write the file to the local disk. Compare the final file size with the original image and you should be able to figure out where the bug comes from.

I followed your suggestion.
Basically, in my implementation of ReadFile, I wrote out the exact same bytes to a file on disk. In this case, the file that I wrote out to disk is exactly what it should be.
(Furthermore, I can copy the image from my virtual drive to drive C, and then open it from drive C and it is correct.)
This leads me to believe that my ReadFile is correct; but that the problem is elsewhere in my IDokanOperations object.
(FYI, when I open the image in Photos, it looks similar to the corrupted image shown in https://github.com/dokan-dev/dokany/issues/154.)
Any ideas? Or, should I assume that I'm hitting the above-described issue and just move on?

In your case you are not talking about the thumbnail? You have the problem when you open the image? What happens when when you open the image with different photo viewer? Do you face this problem with all images or with a specific one?
Von Samsung Mobile gesendet
-------- Ursprüngliche Nachricht --------
Von: Andrew Rondeau
Datum:31.03.2016 17:32 (GMT+01:00)
An: dokan-dev/dokan-dotnet
Cc: Babic Marinko
Betreff: Re: [dokan-dev/dokan-dotnet] Image read through Photos is truncated (#75)
I followed your suggestion.
Basically, in my implementation of ReadFile, I wrote out the exact same bytes to a file on disk. In this case, the file that I wrote out to disk is exactly what it should be.
(Furthermore, I can copy the image from my virtual drive to drive C, and then open it from drive C and it is correct.)
This leads me to believe that my ReadFile is correct; but that the problem is elsewhere in my IDokanOperations object.
(FYI, when I open the image in Photos, it looks similar to the corrupted image shown in dokan-dev/dokany#154https://github.com/dokan-dev/dokany/issues/154)
Any ideas? Or, should I assume that I'm hitting the above-described issue and just move on?

You are receiving this because you commented.
Reply to this email directly or view it on GitHubhttps://github.com/dokan-dev/dokan-dotnet/issues/75#issuecomment-203987928

I tried opening in Paint... It tries to load the wrong file.
I uploaded 3 images.
confluence-logo.jpg: The original image file that I'm trying to open.
Screen Shot 2016-03-31 at 1.38.39 PM.png: Shows how the photos application doesn't show the image correctly.
Screen Shot 2016-03-31 at 1.38.54 PM.png: Shows how paint is opening the wrong file. (See the wrong filename in the window's title.)
Thanks so much!

There is something wrong in your code when the wrong file is opened.
Please can you modify your proxy to open and read files from local drive instead from the original remote source. Just for testing purposes to see if it makes any difference.
If it makes no difference so replace the read code using the original mirror read code and check if it then works properly.
Do you have this issue with all images?
Thanks
Marinko
Von Samsung Mobile gesendet

When I look at the picture it seems to me that you are reporting wrong file information resp. size to dokan driver. If you report to small size the os will just read a part of the file and we will get the output you have.
Please check the reported file size in your proxy.

The file length information listed in explorer is correct. Is there any other way to return the wrong length, other than via GetFileInformation?
I also tried reading directly from disk, but that didn't fix it. Here's what I did:
    public NtStatus ReadFile(string fileName, byte[] buffer, out int bytesRead, long offset, DokanFileInfo info)
    {
        // Uncomment to diagnose issues reading a particular file
        if (fileName.EndsWith(Path.DirectorySeparatorChar + "Screen Shot 2016-02-26 at 5.50.24 PM.png"))
        {
            using (var readStream = File.OpenRead("C:\\Users\\GWBasic\\Syncplicity_Dev\\Screen Shot 2016-02-26 at 5.50.24 PM.png"))
            {
                readStream.Position = offset;
                bytesRead = readStream.Read(buffer, 0, buffer.Length);
            }

            return NtStatus.Success;
        }

...

The code looks fine. Please do the same hack in GetFileInformation so that it works like in mirror sample. If it still does not work so please do the hack in all other methods as well. At the end it must work because the mirror works properly.
What I would do is to create a temp folder with just this one file and only work with this folder to get it work like in mirror. At the end you will figure out where  the issue comes from. If not you can create a console application with the hacked example and we will look into the details.

Thanks, that's wonderful guidance. I'm going to close this for now and follow your suggestion!
Thanks so much!

Finally got time to look into this again. Looks like my problem was in FindFilesWithPattern. I needed to put . and .. at the end of the results, not at the beginning.
Thanks for all your help.

Before somebody else has the same issue, the problem should be solved in .net, user library or even inside of the driver.

You are right marinkokabic, I am going add it in the library :)


Allow a custom encoder to use when performing a find query

Can you add a test to show what you're trying to achieve here?

The reason for this is to use the encoder to insert operation.  At the insert operation driver accept custom encoder. DBObject query may contain custom DBObject on the tree and I prefer to control their BSON serialization stream to achieve the best performance.
For example. I can put custom object into update operation:
DBObjectCheat documentKey = new DBObjectCheat(key);
                DBObjectCheat document = new DBObjectCheat(value);
                coll.update(documentKey, document, true, false);

Then i can catch documentKey object at custom encoder
        if (!(o instanceof DBObjectCheat)) {
            return false;
        }

        Object obj = ((DBObjectCheat) o).getObject();
        if (obj == null) {
            throw new IllegalArgumentException("DBObjectCheathas no (null) object to encode");
        }

        StreamBSerializer streamBSerializer = bSerializationService.getSerializer(obj.getClass());

        final int sizePos = _buf.getPosition();
        _buf.writeInt(0); // leaving space for this.  set it at the end

        streamBSerializer.write(this, obj);

        _buf.write(EOO);
        _buf.writeInt(sizePos, _buf.getPosition() - sizePos);

        return true;

And then use fastest serializer for particular object
public class RootPojoStreamBSerializer implements StreamBSerializer<RootPojo> {

    public static final CString I = new CString("i");
    public static final CString STR = new CString("str");
    public static final CString DATE = new CString("date");
    public static final CString UUID = new CString("uuid");
    public static final CString HOUSE = new CString("house");
    public static final CString LONG_ARRAY = new CString("longArray");

    InnerPojoStreamBSerializer innerSerializer = new InnerPojoStreamBSerializer();

    @Override
    public Class<RootPojo> getObjectClass() {
        return RootPojo.class;
    }

    @Override
    public void write(BDataOutput out, RootPojo rootObj) {

        out.writeInt(_ID, rootObj.getI());
        out.writeString(STR, rootObj.getStr());
        out.writeDate(DATE, rootObj.getDate());
        out.writeUUID(UUID, rootObj.getUuid());

        InnerPojo house = rootObj.getHouse();

        if (house != null) {
            final int label = out.writeObject(HOUSE);
            innerSerializer.write(out, rootObj.getHouse());
            out.writeObjectStop(label);
        }

        long[] longs = rootObj.getLongArray();

        if (longs != null) {
            final int label = out.writeArray(LONG_ARRAY);
            for (int i = 0; i < longs.length; i++) {
                out.writeLong(i, longs[i]);
            }
            out.writeArrayStop(label);
        }

    }

    @Override
    public RootPojo read(BDataInput in) {

        RootPojo obj = new RootPojo();
        obj.setI(in.readInt(_ID));

        obj.setDate(in.readDate(DATE));

        int label = in.readObject(HOUSE);
        if (label != -1) {
            obj.setHouse(innerSerializer.read(in));
            in.readObjectStop(label);
        }

        obj.setUuid(in.readUUID(UUID));

        label = in.readArray(LONG_ARRAY);
        if (label != -1) {
            int arraySize = in.readArraySize();
            long[] longs = new long[arraySize];

            for (int i = 0; i < arraySize; i++) {
                longs[i] = in.readLong(i);
            }

            obj.setLongArray(longs);

            in.readArrayStop(label);
        }

        obj.setStr(in.readString(STR));

        return obj;
    }
}

The mine goal s to give the opportunity to avoid costly conversion to POJO DBObject map structure and vice versa. I can do this on simple queries, but can not when try to request an update of a particular object.

This is an example of plugin to mongo driver
https://github.com/taskurotta/taskurotta/tree/develop/mongodb/src/main/java/ru/taskurotta/mongodb/driver
There is a perfomence test:
https://github.com/taskurotta/taskurotta/blob/develop/hazelcast/src/test/java/ru/taskurotta/mongodb/driver/MongoSerializationTest.java
Sometimes plugin forced to use deprecated driver API.Please do not pay attention to it We are waiting the third version of driver to avoid this.

Also you could check our compare test with custom serialization to BSON https://github.com/taskurotta/taskurotta/blob/develop/services-hz/src/test/java/ru/taskurotta/hz/test/SerializationCompareTest.java
FYI: Test measures only stage of serialization without real write-read operation to mongo
Test Results
Our custom serialization for MongoDB driver
BSON: Serialization took 680 ms, object size 1354 bytes
BSON: Deserialization took 1580 ms object size 1350 bytes
Default serialization by MongoDB driver
DBObject: Serialization took 8158 ms, object size 1350 bytes
DBObject: Deserialization took 16969 ms, object size 1678 bytes
Custom serialization to Hazelcast
HZ: Serialization took 459 ms, object size 792 bytes
HZ: Deserialization took 672 ms object size 792 bytes

Thanks for providing the extensive context.  Can you open an issue in Jira that we can link this to as well as add a test case?

I have created this one https://jira.mongodb.org/browse/JAVA-1647
What kind of test case do you want to see? As you see above we have already provided our test.

Hi @tkgreg the test case should be submitted as part of the pull request - this way we can see intent, keep the test coverage up and ensure there is a regression test as part of the codebase.

I'm closing this pull request, as the related jira ticket has been closed as "fixed" - thanks to the changes in  the 3.0. series.


Update project to ng2 final?

Apologies if this is a silly question but in order to update the angular2-materialize project from rc5 to angular 2 final, is it simply a matter of updating the dependencies in package.json then running an npm install?
Would appreciate some input before I invest time working on this...

Yes, I think so. Look at the example project in the repository. It's all using the final version.

@rubyboy wasn't straightforward but I got there in the end. I basically used the angular starter as the base and then applied the latest angular2-materialize release on the top. All updated from RC5 to 2.0.1.
Thanks!


MFA Server - EOL?

Can we get some confirmation on any expected EOL date for "MFA Server"
Specifically the downloaded component that is intended to be run as a VM on-premises

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 042912e8-9a79-02b6-fc12-fd20ff0ee4d1
Version Independent ID: d7d3fcec-4e05-d2c1-bf9d-c8f8f6ade8a2
Content: Azure MFA Server or Service, On-premises or in the cloud?
Content Source: articles/active-directory/authentication/concept-mfa-whichversion.md
Service: active-directory
GitHub Login: @MicrosoftGuyJFlo
Microsoft Alias: joflore

Pending feedback from the product group. #in-progress

MFA Server is still fully supported and is supported on Virtual Machines.

#please-close

And by the "foreseeable" future you mean one, two or four year or something more specific? You know, we recommend cloud deployment, but customers already in asking how to speed up migration projects (and some CxO just rely on dates).


installed swag version is v1.3.2 instead of v1.4.0

I use go get -u github.com/swaggo/swag/cmd/swag.
go: finding github.com/swaggo/swag/cmd/swag latest
go: finding github.com/swaggo/swag/cmd latest
go: extracting github.com/swaggo/swag v1.4.0

Then the swag --version is still swag version v1.3.2.
I'm using go version go1.11.1 windows/amd64

I don't have windows can reproduce. Needs someone help.

Hi,
I have downloaded this https://github.com/swaggo/swag/archive/v1.4.0.zip and
the version.go file says const Version = "v1.3.2"
Is the tag correct?
Thanks

@stefano-salmaso It's not correct. I will bump v.1.4.1 to fix this issue.

please using latest https://github.com/swaggo/swag/releases/tag/v1.4.1 version.

Hi again,
there is something strange/wrong... this what I made:
I have run
go clean -i github.com/swaggo/swag/cmd/swag
and then
go get -u github.com/swaggo/swag/cmd/swag
swag binary has been re-created in ~/go/bin but, if I run it, I have:
mac:~/go/bin$ ./swag --version
swag version v1.4.0

Any clue?

@stefano-salmaso you can run $ go env to check if $GOPARH is correct.


MoreEnumerable.From does not check null arguments?

Is there any reason for this?

See the review/conversation in #333 for background and reasoning. I'm closing this assuming that answers your  question.

That answered my question. Thanks.


[Accessibility]A11y_AzureDataStudio_OperatorTab_ ScreenReader: Narrator does not read any information regarding the blank cell values in the table.

Check out Keros! - Identify accessibility bugs before check-in and make bug fixing faster and easier.
GitHubTags:#A11yMAS; #A11yTCS; #MAS4.2.3; #MAS1.3.1; #A11y_AzureDataStudio; #Win32; #DesktopApp
Environment Details:
Application name: Azure Data Studio (Agent, Create External Data, Notebooks)
Version: 1.8.0-insider (user setup)
Electron: 3.1.8
Node.js: 10.2.0
V8: 6.6.346.32
NVDA Version: 2019.1
JAWS version:2019
OS: Windows_NT x64 10.0.17763
Additional Details
Tool name: NVDA
MAS Reference:MAS1.3.1,MAS4.2.3
Repro Steps:
1.Launch Visual Studio code desktop application.
2. Connect to the Database -> Go to the  SQL server agent tab->Select operator tab
3.Start Screen reader as NVDA.
4.Navigate to table.
5.Observe that Screen reader is unnecessarily announcing column for the table.
Actual:
Narrator does not read any information regarding the blank cell values in the table. Narrator is only reading out the information about the cell row and column number not the empty value.
Similar issue has been found under below pages:-
1.CSVPreviewData- Connect to database->navigate to the Data services folder->HDFS Folder-> navigate to CSV files folder->Right click on the files->Select option Create external table from CSV->Click on the "Next" button.
Same issue observed with JAWS.
Expected:
Narrator should read some information about the blank cell values in the table.
User Impact:
Screen Reader user may not get information about the blank cell values.
Recommendation:
Please refer the following snippet link for fixes:
https://microsoft.sharepoint.com/teams/msenable/mas/Pages/browse-fixes.aspx
MAS Reference:
MAS1.3.1-
https://microsoft.sharepoint.com/:w:/r/teams/msenable/_layouts/15/WopiFrame.aspx?sourcedoc={54f28d1f-a2d1-4dcd-84e1-5c9b87e8aba4}
MAS4.2.3-
https://microsoft.sharepoint.com/:w:/r/teams/msenable/_layouts/15/WopiFrame.aspx?sourcedoc={30e4fb40-dcc1-45b4-b714-5e2c28b23ae8}
Attachment for Reference:
5720_[Accessibility]A11y_AzureDataStudio_OperatorTab_ ScreenReader.pptx
Does this issue occur when all extensions are disabled?: Yes

Should be the same kind of fix as https://github.com/microsoft/azuredatastudio/issues/6152


Hi, I have encountered some questions and I also have some details to confirm with you.

When I try to make dataset in the first step, there is an error occured:
'
Traceback (most recent call last):
File "make_dataset.py", line 1, in
from face_utils import FaceDetector, norm_crop
File "/mnt/mnt/users/lanyuyang/rk4kaggle-dfdc-master/face_utils.py", line 7, in
from data import cfg_re50
ModuleNotFoundError: No module named 'data'
'
And I don't know where the data folder or file comes from. Then I put the retina-face repo and efficientnet-pytorch repo in the external folder, and downloaded some weights you required, but the error is still there. Can you please help me a bit? Thanks

Hi, you can download data from
 these file within on kaggle website https://www.kaggle.com/cuihaoleo/dfdc-private-lb-4th-place-submission/comments#data
Then, you should have error like something missing utils. You can download it from:
https://github.com/biubug6/Pytorch_Retinaface/tree/master/utils
Hope this will help.

Ideally, you should initialize code dependencies with git submodule init and git submodule update as said in README.
RetinaFace-Resnet50-fixed.pth is the pretrained RetinaFace weight file. Put it at the current working directory.
If you run make_dataset.sh, PYTHONPATH environment variable is set in the script to make python find RetinaFace. But if you want to run make_dataset.py directly, you should set PYTHONPATH yourself.

Sorry to bother you further, Which files should I modify if I want to add some new data to train further? I find some possible required changings: 1. 'dfdc-data.csv' and 2.'dfdc.json'. And in 3. 'wsdan-conf/xception.py' the datapath is the image path generated by make_dataset.sh? Is there something I missed? The training procedure failed and I guess it's for path reasons

For Xception training:

Use dfdc-data.csv to list all video files and specify which set a video belongs to.
Set data_root in xception_conf.py as the root path of extracted video frames.

For WS-DAN:

Use dfdc.json to list all video files.
Set datapath in wsdan-conf/xception.py (or wsdan-conf/efb3.py for the efficientnet variant) as the root path of extracted video frames.

The inconsistency is because our members has been working in parallel at the early stage of the competition and implemented different dataset loaders.
We didn't take time to unify the code. Instead, we just left the messy code as-is. If you want to re-use the code, I would suggest you to replace the dataset loader with a unified one.

Thanks, but after generating the json file and csv, and train wsdan-xception, the backward seems to fail and throws the following error:
"RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.cuda.FloatTensor [8]] is at version 4; expected version 3 instead. Hint: the backtrace further above shows the operation that failed to compute its gradient. The variable in question was changed in there or anywhere later. Good luck!"
I searched for some solutions but it still didn't work.


Implement basic touch support

Hi guys, first proper pull request!
This implements touch motion and finger pressing using winit API - see bug #300
I couldn't decide on finger vs touch in struct names, I am happy to refactor code if anyone has better ideas for names
Is it worth storing last finger positions so we can give delta in finger motion events like we do in mouse motion events?

IMO I think going with struct names based on "Touch" makes more sense than "Finger." Because touch input can include things like stylus and pen tablets, it would be strange to call them fingers.

I don't know, but could you use #59 Axis API for the finger position? Or is it too different?

+1 on calling it touch. Btw I didn't realise this PR exists and duplicated some efforts here https://github.com/bevyengine/bevy/issues/87#issuecomment-683432609 Perhaps it may be of interest. I actually implemented an alternative to Input to keep track of current touch state including distance moved from start position. I think we should land raw events first and we can build plugins on top with various abstractions and see what sticks.

I don't know, but could you use #59 Axis API for the finger position? Or is it too different?

Perhaps is what I did in my link closer to what you're looking for? Rather than a raw event stream.

Closed in favor of #696


FIX: Allow eyetrack channels to be used with plot_compare_evoked

Per this discussion post:
https://mne.discourse.group/t/mne-viz-plot-compare-evokeds-for-eyetracking/7816
It seems that eyetrack channels are not an accepted channel type for plot_compare_evokeds. Off the top of my head I can't think of a good reason for why they shouldn't be accepted, so I've gone ahead and implemented a quick fix. I wouldn't mind a moment to really think about this or discuss it with others, but I'm defending my PhD tomorrow so this thinking won't happen for me until next week 😃
A MWE, which is just a proof of concept (in this example the evokeds aren't informative at all). (requires mne 1.6):
import mne
fpath = mne.datasets.eyelink.data_path() /  "freeviewing"
fname = fpath / "sub-01_task-freeview_eyetrack.asc"
raw = mne.io.read_raw_eyelink(fname)

mne.preprocessing.eyetracking.interpolate_blinks(raw, interpolate_gaze=True)
raw.annotations.rename({"dvns": "natural", "dvss": "scrambled"})  # more intuitive
event_ids = {"natural": 1, "scrambled": 2}
events, event_dict = mne.events_from_annotations(raw, event_id=event_ids)

epochs = mne.Epochs(raw, events =events, event_id=event_dict, tmin=0, tmax=20, baseline=None)

evokeds = dict()

evokeds["natural"] = epochs["natural"].average()
evokeds["scrambled"] = epochs["scrambled"].average()

mne.viz.plot_compare_evokeds(evokeds)

For the pupil size, that opens another question when comparing evoked/signals from different subjects/recordings. As it's in AU, and the camera distance/illumination/lens can differ + the subject eye size/shape differ, is it actually comparable?

For the pupil size, that opens another question when comparing evoked/signals from different subjects/recordings. As it's in AU, and the camera distance/illumination/lens can differ + the subject eye size/shape differ, is it actually comparable?

zscoring within subject is a typical answer to this worry. Though researchers also do try to control distance to camera/screen (e.g. with a chinrest and forehead bar)

The real question to me is: should eyegaze and pupil channels be considered as data channels?

I would say no, they are not "ephys data from the brain" which is what we mean by "data"
https://mne.tools/dev/documentation/glossary.html#term-data-channels

Can you ad a tiny test that it plots? So add to mne/viz/tests/test_evoked.py that creates an Evoked from eyelink data and calls plot_compare_evokeds. Doesn't matter if the comparison is meaningful.
Also on main did you get a reasonable error /ike that no acceptable channels types were found, or was it cryptic? If it was cryptic we should also improve it to say "no plottable channel types found, plot_compare_evokeds doesn't support plotting channel types found in data: {inst.get_channel_types(unique=True)} or similar.

Can you ad a tiny test that it plots? So add to mne/viz/tests/test_evoked.py that creates an Evoked from eyelink data and calls plot_compare_evokeds.

Sure can do.

Also on main did you get a reasonable error /ike that no acceptable channels types were found, or was it cryptic?

Actually it was an assert error.. I can amend it use an if not clause and raise a more informative error

Actually it was an assert error.. I can amend it use an if not clause and raise a more informative error

That would be great. I would use inst.set_channel_types(...) to change the channel types to something that can't be plotted. From the looks of it EOG might work for now. Or if you want to pick something more esoteric that we probably never care to plot with plot_compare_evokeds you could go with ias which is internal active shielding information for Neuromag/MEGIN systems.

... and actually you even could use this set_channel_types approach to pretend the EEG or MEG sensor data are eyetracking pupi/gaze data for the purposes of the test that should now pass that currently fails on main. Reading actual data would be more lines of code but also more relevant. Up to you :)

Update. I added a more informative error and a few more lines to test_plot_compare_evokeds, to test that plotting eye-tracking data works, and that an informative error is thrown if the evoked instance only contains channel types that are not accepted by plot_compare_evokeds (i.e. an evoked instance with only EOG channels`).

Oh yes thanks for reminding me!

Thanks @scott-huberty !


Where to place / How to reference SVGs for Phonegap use

I am running into issues using SVGs, during development I had placed svg files in www/assets/subdirs/files.svg - this was working fine.
When I then did a phonegap run android, I found that one of the hooks wiped out everything in www/
I then tried to place the svgs in:
src/assets/static/images/svg/subdirs/files.svg
and
src/static/images/svg/subdirs/files.svg
Neither seem to give me any joy, any hints?

You need to import your svg file. You can do this like:
import mySvgImage from './../static/images/svg/subdirs/files.svg'
it returns compiled dynamic address to mySvgImage.
You need to add variable in vue:
new Vue({
  data: {
    images: {
      mySvgImage: require('./../static/images/svg/subdirs/files.svg')
    }
  }
}

...

<img :src="images.mySvgImage">

Thank you for the insight
I hate to say it, but this seems like a pretty heavy approach - is there really no 'static' folder support?
Would I have to do the same for say sound files?
How would I end up dealing with run-time changes to which svg to show ( as a simple example I have hazard_default.svg, hazard_fast.svg and hazard_slow.svg - which are swapped depending on state). Some widgets have 10 different state based svgs, am I really forced to enumerate them all as data properties and pass them around?
Thanks for your time, in creating the template and also for pointing me in the right direction in this.

You are right. I'll add static folder soon.

Hello @joedeveloper
I added static folder to project also it will automatically sync with www/static on live-reload. Please check latest version.
Have a great day!

Thank you so much, will check it out shortly

Any updates?

I closing the issue, it seems fixed.

Sorry for the late response, just cycled back to this project and thank you, it works for me.


Community Discord

I think it would be nice to have a community Discord for better communication or cooperation in future

Thank you for the suggestion. I made one just now and I'll put the link in the README as well. https://discord.gg/8DgaxWf2Jr


Unable to get jest working with route

Ziggy version
1.3.1
Laravel version
8.65
Description
I don't seem to be able to get the route helper to work in any with jest. I have tried numerous and various ways of trying to achieve the route helper to work but have been unsuccessful
I have tried using this as a "guide" on how to get the rout help in jest but just doesn't work.
https://github.com/tighten/ziggy/issues/264
I have tried using global mixins in jest - https://test-utils.vuejs.org/api/#global . To which again I haven't been able to resolve the error(below)
TypeError: _ctx.route is not a function
If you could maybe guide me to something that explains how to achieve the route helper in the jest tests?
import SidebarNavigation from '../../../resources/js/Components/SidebarNavigation/SidebarNavigation.vue';
import sidebarNavigationLinks from '../../../resources/js/Helpers/SidebarNavigationLinks';
import { mount } from '@vue/test-utils';
import route from '../../../vendor/tightenco/ziggy/dist';

describe('SidebarNavigation.vue', () => {
    const wrapper = mount(SidebarNavigation, {
        global: {
            mixins: [route],
        }
    })
    test('links are mounting', async () => {
        await wrapper.setData({ sidebarNavigationLinks })
    })
});

This is just one example I have tried but with no luck. I have undone and redone the code so many times that I don't have any more examples I have tried.
I would greatly appreciate the help if you could please? I am using laravel breeze with inertia.
Ziggy call and context
Jest tests and failing on the route helper.

Ziggy configuration
No able to print this.

Route definition
Its not a route issue.

I think you'll have to do at least 2 things to get this working:

Make sure the route function is being included/mixed in correctly. In your example above you're passing Ziggy's route() function to the component as if it's a Vue mixin, but it's not. You could either do mixins: { route: route } or import and use the Vue plugin that Ziggy provides.
Provide a configuration object with all your routes. If you already have a generated ziggy.js file somewhere, import it and pass it in when you're setting up the mixin or plugin. If you're just using the @routes Blade directive, you will have to use the php artisan ziggy:generate command to generate a file containing all your routes and configuration, import that in your tests too, and pass it to Ziggy. If you don't want to keep this file up to date you could build your own stub config object inside your tests.

Let me know if that works, and if it doesn't please include the entire output of any error messages or logs you see so that we can help debug.

Why not just use localVue and install the vue plugin on localVue
import SidebarNavigation from '../../../resources/js/Components/SidebarNavigation/SidebarNavigation.vue';
import sidebarNavigationLinks from '../../../resources/js/Helpers/SidebarNavigationLinks';
import { createLocalVue, mount } from '@vue/test-utils';
import {ZiggyVue} from '../../../vendor/tightenco/ziggy/dist/vue';

const localVue = createLocalVue()
localVue.use(ZiggyVue)

describe('SidebarNavigation.vue', () => {
    const wrapper = mount(SidebarNavigation, { localVue ))
    test('links are mounting', async () => {
        await wrapper.setData({ sidebarNavigationLinks })
    })
});

Hey
I really appreciate you trying to help. I am not sure where I am going wrong. This is my first time using jest with vue and I am having a nightmare with this.
import SidebarNavigation from '../../../resources/js/Components/SidebarNavigation/SidebarNavigation.vue';
import sidebarNavigationLinks from '../../../resources/js/Helpers/SidebarNavigationLinks';
import { mount } from '@vue/test-utils';
import route  from '../../../vendor/tightenco/ziggy/dist/index';
import {Ziggy} from '../../../resources/js/ziggy'

describe('SidebarNavigation.vue', () => {
    const wrapper = mount(SidebarNavigation, {
        global: {
            plugin: [[route, Ziggy]]
        }
    })
    test('links are mounting', async () => {
        await wrapper.setData({ sidebarNavigationLinks })
    })
});

I have tried what you suggested by using it via plugin and passing the routes in and I still get the same error that route is not defined.
TypeError: _ctx.route is not a function

      78 |
      79 | <script>
    > 80 | import { Link } from '@inertiajs/inertia-vue3';
         |                ^
      81 | import sidebarNavigationLinks from '../../Helpers/SidebarNavigationLinks';
      82 |
      83 | export default {

Any more help would be greatly appreciated.

@bakerkretzmar The mixin is mixins: { methods: { route } } but then you need to declare a global with your routes list
Why not just use localVue and install the vue plugin on localVue
But in any case you'll need to use the php artisan ziggy:generate command if you want to use your routes in jest
import SidebarNavigation from '../../../resources/js/Components/SidebarNavigation/SidebarNavigation.vue';
import sidebarNavigationLinks from '../../../resources/js/Helpers/SidebarNavigationLinks';
import { createLocalVue, mount } from '@vue/test-utils';
import {ZiggyVue} from '../../../vendor/tightenco/ziggy/dist/vue';
import routes from '../../../resources/js/ziggy.js';

const localVue = createLocalVue()
localVue.use(ZiggyVue, routes)

describe('SidebarNavigation.vue', () => {
    const wrapper = mount(SidebarNavigation, { localVue ))
    test('links are mounting', async () => {
        await wrapper.setData({ sidebarNavigationLinks })
    })
});

This is a pretty basic way to setup your test environnement with plugins and doesn't have much to do with ziggy
You should use the same in your app setup which is in the documentation in the vue section

Vue 3 doesn't use local vue app in the test utils.

@jamesh-purr Indeed but you didn't say which version you were using 😉
Your code Is the correct way to install the plugin in vue3 tests, except you are missing an s in plugin
const wrapper = mount(SidebarNavigation, {
        global: {
            plugins: [[route, Ziggy]]
        }
    })

@jamesh-purr Indeed but you didn't say which version you were using 😉
Your code Is the correct way to install the plugin in vue3 tests, except you are missing an s in plugin
const wrapper = mount(SidebarNavigation, {
    global: {
        plugins: [[route, Ziggy]]
    }
})

Thanks for helping out :) and good catch with the typo. That did help however I did need to make a change to my code. This is the final test that got jest working correctly with the route help :)
import SidebarNavigation from '../../../resources/js/Components/SidebarNavigation/SidebarNavigation.vue';
import sidebarNavigationLinks from '../../../resources/js/Helpers/SidebarNavigationLinks';
import { mount } from '@vue/test-utils';
import { ZiggyVue }  from 'ziggy-js/dist/vue'
import {Ziggy} from '../../../resources/js/ziggy'

describe('SidebarNavigation.vue', () => {
    const wrapper = mount(SidebarNavigation, {
        global: {
            plugins: [[ZiggyVue, Ziggy]]
        }
    })
    test('links are mounting', async () => {
        await wrapper.setData({ sidebarNavigationLinks })
    })
});

@Tofandel @bakerkretzmar thank you for taking your time to help out with this 👍


Nothing changes after plugin installation

Env
$ uname -a
Linux device 5.0.17-300.fc30.x86_64 #1 SMP Mon May 20 15:36:26 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

idea ultimate version: 191.6707.61 or, shortly, 2019.1.2
native terminal version: 0.3.5
os: Fedora 30 with
$ gnome-shell --version
GNOME Shell 3.32.2

Problem
After plugin installation, nothing changes. Even with manual shell path setup.

Hi @Sammers21,
zsh is not supported yet. I will add it in the future release.
Thanks!

Hi @Sammers21,
Could you please share more information about how you run zsh shell outside IDE?
Is it your default shell?

@sburlyaev, Yes, it is.

what terminal do you use?

Hey @Sammers21 !
Have you already tried the latest version with ${project.dir} in your command? Does it work for you?

@sburlyaev, it does work well


Update dnd5e

Updated dnd5e mapping that works.

This is removing a lot more than it's adding. Does this give the same output or better as the previous version? I don't have time to test immediately, but if not maybe leave the old code in and comment it out so that someone can get it working in the future.

Now this should be working, also see #68 for improved proficiencies


Paver: Delete Hive Destination REST API

As a DH developer
I want to support DELETE /paver/v1/roads/roadName/destinations/hive
So that users can delete hive destination

Issue has been resolved with delete Hive Destination API added


[Bug]: Can no longer edit dashboard

Requirements

[X] I checked the troubleshooting section in the README to verify that I have the latest Mushroom version.
[X] I did a search to see if there is a similar issue or if a pull request is open.
[X] I have read the state of card mod support (in pin issues) and understand card mod support is not provided in this repository.

Current Behavior
Since updating to Mushroom 3.6.0 yesterday, I can no longer edit my dashboard in the UI. The three dots in the upper right are missing.
Expected Behavior
All the Mushroom cards should be configured using Dashboard UI editor, as described below. Since I do not have 3 dots in the top right corner, I cannot edit in the UI.

In Dashboard UI, click 3 dots in top right corner.
Click Edit Dashboard.
Click Plus button to add a new card.
Find one of the Custom: Mushroom card in the list.

Steps To Reproduce
Unclear what is causing this.
Context
YAML state

Environment
- Browser: Chrome
- HA Version: 2024.5.5
- Mushroom: 3.6.0

Anything else?
Image attached.

Disregard. My theme was changed inadvertently. This is no longer an issue.


Enhance cookie consent functions with versioning system

Depends on https://github.com/alphagov/govuk-design-system/issues/1614
What
Add a versioning system to the cookie consent functions that we added to the design system.
Example from NHS: https://github.com/nhsuk/cookie-consent/blob/master/src/cookieconsent.js#L11
We should be ok to merge these changes as we're adding a set of functions without using them, so they won't have any effect on users yet.
Why
If we are likely to move to a sub-domain consent approach in the future, we will need to 'reset' the cookie banner and consent cookie for users who have previously consented as what they have consented to has now changed. This also applies if in the future we add a new cookie category or important new cookie.
Who needs to know about this
Developers; Technical Writer
Done when

[ ] It's possible to bump the version and 'reset' the cookie banner for users
[ ] Tests added for versioning functionality
[ ] Technical documentation for developers

There's a couple of specific scenarios around sub-domain consent which need thinking about/testing. If a user has previously consented to cookies on the design system domain only, and then visits the site after we have introduced sub-domain consent, then the version in their existing cookie (design system domain only) should be out of date. At this point, I think we'd need the old cookie to be deleted so that they can consent to sub-domain cookies.
The alternative scenario is we don't delete the old cookie, but because the version number is out of date we know to show the banner. However, I think this will lead to the user getting two consent cookies: the existing 'old' design-system domain only cookie, and a new sub-domain consent cookie.
Something to keep an eye out for when we're testing.

In the NHS version, if the user has an outdated consent cookie then all cookies are deleted on page load... is this the behaviour we want? @vanitabarrett
https://github.com/nhsuk/cookie-consent/blob/master/src/cookieconsent.js#L243-L246

If we're versioning the banner, that means we want the cookie banner to re-appear and users to re-submit consent even if they have done previously. ... the banner re-appearing implies that they haven't already consented (i.e: we haven't set any cookies yet) ...

From @vanitabarrett

@vanitabarrett additional question, are there any scenarios you can imagine where the user might have a consent cookie with a version number higher than what our code expects? How do you think we should handle that situation?


[docs] add StatsD setup instructions

Coverage remained the same at 71.445% when pulling 4c6ecab53c50308768137fdd03101d16c6a3a11b on mistercrunch:docs_statsd into cbcc00c9290faf4d98c562df2a0f802d63669c77 on apache:master.

Coverage remained the same at 71.445% when pulling 4c6ecab53c50308768137fdd03101d16c6a3a11b on mistercrunch:docs_statsd into cbcc00c9290faf4d98c562df2a0f802d63669c77 on apache:master.

Coverage remained the same at 71.445% when pulling 4c6ecab53c50308768137fdd03101d16c6a3a11b on mistercrunch:docs_statsd into cbcc00c9290faf4d98c562df2a0f802d63669c77 on apache:master.

Coverage remained the same at 71.457% when pulling 6ca11b6d8b5a021b62146b398e9a67466f0da21b on mistercrunch:docs_statsd into 35810ce2bf45a9ea00a740f35ba6eeea0660de5f on apache:master.

👀 @john-bodley

LGTM


Only warn about dynamic module workers

This removes the "new Worker() will only be bundled if passed a String" warning in cases where new Worker() is not called with {type:'module'}. It's possible this will result in folks not realizing their Worker is being left unbundled when type:module isn't used.
This should fix #12.

@developit hi, any progress on this?

@developit thank you :)

@developit do you have a plan to release any time soon?

Can a new release be created so we can get this fix? Thanks!


Create new cpp and modify launch file for new function

you could check the new function from cpp.
Add a++ arightrom to acceraltie 50% speed.

Under testing


delete unuse preferences

Summary
This is multi cluster feature, we need delete it.

PR Checklist
~- Is this a multi-tenancy feature/bug?
- [ ] Yes, the relevant RBAC changes are at:~
~- Do we need to backport changes to the old Rancher UI, such as RKE1?
- [ ] Yes, the relevant PR is at:~
~- Are backend engineers aware of UI changes?
- [ ] Yes, the backend owner is:~
Fixes #

Occurred changes and/or fixed issues

Technical notes summary

Areas or cases that should be tested

Areas which could experience regressions

Screenshot/Video

@mergify backport release-harvester-v1.2


Ship arm64 wheels

As the number of users on arm64-backed linux/macos grows, we need to start building arm64 wheels for our binary packages.

Unfortunately, CircleCI currently does not support custom docker images (e.g. manylinux2014_aarch64) on ARM hosts. Not even with on-prem runners configuration.

One option would be to use cibuildwheel, but that would require a significant change to our CircleCI flow. Some examples use a VM to emulate arm64 machine, but on CircleCI we would probably be able to use the new arm resource class running ubuntu.

We build arm64 (linux/macos) binary wheels for a while now.


Failing partway through | sandboxed

These may be two separate issues, but tippecanoe is getting 15-20% of the way through a task before failing without an error message.
Digital-Aurora-MacBook-Pro:amtrak scarndp$ cat USRailNetwork.geojson | tippecanoe -o USRailNetwork2.mbtiles -z4 -Z4 -d6 -g2 -pf -pl -f
using layer 0 name USRailNetwork2
Sorting 172983 features
172983 features, 20913187 bytes of geometry, 69280157 bytes of metadata
  19.9%  0/0/0
Digital-Aurora-MacBook-Pro:amtrak scarndp$

Over on the console, it appears to begetting sandboxed:
mdworker(5162) deny file-write-data /Users/scarndp/Github/amtrak/USRailNetwork2.mbtiles (import fstype:hfs fsflag:480D000 flags:240000005E diag:0 isXCode:0 uti:com.mapbox.mbtiles plugin:/TileMill.app/Contents/Library/Spotlight/MBTiles.mdimporter - find suspect file using: sudo mdutil -t 25152825)

Model Identifier: MacBookPro11,1
Intel(R) Core(TM) i5-4258U CPU @ 2.40GHz
2 GB RAM
Yosemite

Thanks for the report @scarnecchia. I've never seen that error myself. Is the file you're trying to encode public so I could try it out myself?

@ericfischer It's looking to be user error.
I'd created a geojson file from the Railway Network shapefile at the National Transportation Atlas Database using QGIS, and when I exported it, accidentally saved it as a different projection. When I corrected this, everything worked. The Spotlight issue that sandbox is killing still appears, but doesn't appear to be effecting output.

I'm glad there is a reasonable explanation! I should add an error message when all the features get clipped away so that it is clearer what is happening in cases like this.

Warning message added in https://github.com/mapbox/tippecanoe/commit/448617e0a7467b1e5055510c2c4fc3c667a52dfd. Thanks!


scripts:Make stats script work with python3

Just needed parens around the single print so that the
vk_validation_stats.py script will run with python3.
@mark-lunarg this should allow #1242 to run on Windows systems w/ python3 default.

👍! Sweet!  Thanks Tobin.

replaced by #1248


How to find the number of elements in the tree

This seems like a really simple question, but I can't find which part of the API to use :sweat_smile:
I tried this code:
fn merk_len(merk: &Merk) -> usize {
    let mut count = 0;
    let mut iter = merk.raw_iter();
    loop {
        iter.next();
        match iter.key() {
            None => return count,
            Some(_) => {
                count += 1;
                continue;
            }
        }
    }
}

but unfortunately this segfaults.
Is there a simple way to count how many keys are present in the tree?

This is using the RocksDB raw iterator API, where you must first check if the entry is valid before trying to access the key. You should be able to do this instead:
fn merk_len(merk: &Merk) -> usize {
    let mut count = 0;
    let mut iter = merk.raw_iter();
    iter.seek_to_first();
    while iter.valid() {
        count += 1;
        iter.next();
    }
    count
}

Closing due to inactivity.


Uncomment and fix following failing tests

org.oscm.subscriptionservice.dao.SubscriptionDaoCustomerIT.getSubscriptionsWithDefaultUdaValuesAndVendor
SubscriptionsServiceBeanIT  - whole class. The test is hanging.

Issue closed.


[Enhancement]: End to end (bvt) test for operator's capability

Is there an existing issue for enhancement?

[X] I have checked the existing issues.

What would you like to be added ?
Since we are going to release the first serious version of mo-operator (`v0.1`), e2e test is must to have.

Why is this needed ?
No response
Additional information
No response

The sub-tasks should be further specified.


⚠ Jenkins Plugins Artifactory has degraded performance

In c3e84bd, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 2493 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 2ad255b after 6 hours, 9 minutes.


Newest Version does not Work

Tool does not return any results. And when selecting "Connect to Power Automate API", a deprecated connection error is returned.
Plus it only seems to return Flows contained within solutions.

I tried with both connection types that are supported and it's working just fine.
Can you please check if you are suing the right connection types shown below.


Automate tRNA finding

MiGA doesn't currently include tRNA finding, so it must be independently implemented

MiGA include tRNA finding since v1.2.13, so independent implementation is no longer necessary


some minor fixes

last night I updated the qiita server to have the latest code and realized that there was a small bug with the new filtering per tag functionality so decided to fix directly so it wasn't broken, here the fix and adding an ignore file to codecov as it was also expecting tests for the patches ...

Codecov Report

Merging #2204 into master will increase coverage by 1.23%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #2204      +/-   ##
==========================================
+ Coverage   92.04%   93.28%   +1.23%
==========================================
  Files         191      162      -29
  Lines       19515    18327    -1188
==========================================
- Hits        17963    17096     -867
+ Misses       1552     1231     -321

Impacted Files
Coverage Δ

...iita_db/support_files/patches/python_patches/23.py

qiita_core/testing.py

qiita_db/support_files/patches/python_patches/6.py

qiita_core/tests/test_util.py

...iita_db/support_files/patches/python_patches/36.py

...iita_db/support_files/patches/python_patches/31.py

qiita_core/util.py

...iita_db/support_files/patches/python_patches/55.py

...iita_db/support_files/patches/python_patches/48.py

...iita_db/support_files/patches/python_patches/51.py

... and 20 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a058102...a6143e3. Read the comment docs.


Haneld the situation that Azure Datalake Gen1 returns filename

contains special sub-string
AzureDatalakeFileSystem.ls has special mechanism for type and length.
But the above special mechanism should only applicable when call ls
with detail=True and ls returns a list of dictionary.
When call ls with detail=False, it returns a list of str. Keyword in
for str has the meaning of check if one str is substring of another.
That is not what the mechanism should acting on.
Closes #227

Thanks!


Add reference to ARM Deployment Insights extension

@tarikkaric : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@tfitzmac
Can you review the proposed changes? IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"

@tarikkaric - thanks for adding that link.
#sign-off


Clarification of results

Hi in both the table in the readme and paper you mention a column for image captioning as C could someone verify if it's CIDER or CIDER-D.

The caption evaluation scores are calculated by the official COCO evaluation code, which is a submodule in this repo. You may check the evaluation code for details of CIDEr.

Thank you so based on the last lines of:

Above mentioned code https://github.com/LuoweiZhou/coco-caption/blob/master/pycocoevalcap/cider/cider.py
Official CIDEr implementation https://github.com/vrama91/cider/blob/master/pyciderevalcap/cider/cider.py
*Ofiicial CIDEr-D implementarion https://github.com/vrama91/cider/blob/master/pyciderevalcap/ciderD/ciderD.py

I assume it was CIDEr. But I assume it would be better if an official author could comment on what was intended in the paper.

Based on the table 1 from the paper it mentions AoANet (citation 11) and in its official paper (https://arxiv.org/pdf/2002.12204.pdf) in table 1 the score can be concluded as CIDEr-D. I have made a PR to add the score names to the README file(#137).


[bug]: Can't find variable React

Description
I've imported '@web3modal/wagmi-react-native' and included  in the the react native app. I get this error which says can't find variable React
Web3Modal SDK version
1.0.1
Output of npx react-native info
System:
OS: macOS 13.5.2
CPU: (10) arm64 Apple M1 Pro
Memory: 98.06 MB / 16.00 GB
Shell:
version: "5.9"
path: /bin/zsh
Binaries:
Node:
version: 16.15.0
path: ~/.nvm/versions/node/v16.15.0/bin/node
Yarn:
version: 1.22.19
path: /opt/homebrew/bin/yarn
npm:
version: 8.19.4
path: ~/mobile-app-old/mobile-app/node_modules/.bin/npm
Watchman:
version: 2<IP_ADDRESS>
path: /opt/homebrew/bin/watchman
Managers:
CocoaPods:
version: 1.12.0
path: /Users/shanthan/.rvm/gems/ruby-2.7.6/bin/pod
SDKs:
iOS SDK:
Platforms:
- DriverKit 23.0
- iOS 17.0
- macOS 14.0
- tvOS 17.0
- watchOS 10.0
Android SDK: Not Found
IDEs:
Android Studio: 2021.3 AI-213.7172.25.2113.9014738
Xcode:
version: 15.0/15A240d
path: /usr/bin/xcodebuild
Languages:
Java:
version: <IP_ADDRESS>
path: /usr/bin/javac
Ruby:
version: 2.7.6
path: /Users/shanthan/.rvm/rubies/ruby-2.7.6/bin/ruby
npmPackages:
"@react-native-community/cli": Not Found
react:
installed: 18.2.0
wanted: ^18.2.0
react-native:
installed: 0.72.8
wanted: ^0.72.4
react-native-macos: Not Found
npmGlobalPackages:
"react-native": Not Found
Android:
hermesEnabled: true
newArchEnabled: false
iOS:
hermesEnabled: false
newArchEnabled: false
Expo Version (if applies)
No response
Steps to reproduce
Import the package into a react native project running on react-native ~ 0.72.4
Snack, code example, screenshot, or link to a repository

@xav @arein @chris13524 @0xAsimetriq

@ignaciosantise cc

Hi @shan-c  👋 can you check if this solution works for you? https://github.com/WalletConnect/modal-react-native/issues/30#issuecomment-1631083948

also check this: https://github.com/WalletConnect/web3modal-react-native/issues/58

closing as this is related to WalletConnectModal and not Web3Modal 🙏


FEDX-970: Disallow (ignore) trailing options, as it inhibits ability to pass args to subcommand

I removed the allowTrailingOptions: false in a recent PR, only to remember that it was supposed to be disabled. When trailing options are allowed, it becomes impossible to pass options/flags as args to the subcommand that dpx runs since the top-level dpx arg parser will try to parse them.
For example:
> dpx dependency_validator --help

This should run dependency_validator --help and display the help output for that executable, but it actually displays the help output for dpx. Similarly, if you tried to use a CLI flag or option of the subcommand, dpx would fail to parse args altogether.
While it's possible to workaround this by using an arg separator...
> dpx dependency_validator -- --help

... it's awkward and unintuitive. dpx is supposed to make it as easy to run other package executables, so we should aim to make the dpx CLI get out of the way whenever possible and favor the underlying package executable.
This PR makes that change by disallowing (ignoring) trailing options.
Note: the only real downside is that if you want to make dpx run in verbose mode, you have to add the --verbose flag first, like so:
> dpx --verbose dependency_validator

This is a minor inconvenience and an acceptable trade off.

Security Insights
No security relevant content was detected by automated scans.
Action Items

Review PR for security impact; comment "security review required" if needed or unsure
Verify aviary.yaml coverage of security relevant code

Questions or Comments? Reach out on Slack: #support-infosec.

QA +1

[x] Verified that this makes it possible to pass trailing args to the command run by dpx without using an arg separator

@Workiva/release-management-p


Edit issues directly from org-mode

Like org-trello allows you to.

That would be really nice to have indeed.
Unfortunately, I'm not good at elisp so I can't help with this one :\


Remove light mode e2e tests

[x] I have removed light-mode e2e tests and related bits

Comments

Issue Number
ADP-2316

:expressionless:


Fix Axis label size

Hi,
at the moment, I have two graphs, one on the top of the other, and I'm having a problem with size occupied by the chart, if the size of the scale label is different.
In the image attached, the area for the canvas is the same:
<canvas id="myChart" width="400" height="200"></canvas>      <canvas id="myChart2" width="400" height="200"></canvas>
but according to the size of label, it will change the area of the chart, and what I want is to have a fixed width value for the chart independently of the size of the label.
Is there any way of resolving this?

Thank you,
João Ribeiro

var options = { scales: {      display: false,      xAxes: [{           ticks: {                display: true,                fontColor: "#8D8D8D",                fontSize: 12           }      }],      yAxes: [{            stacked: true,           ticks: {                fontColor: "#182539",                fontSize: 12           },      }] } };

@joaoluisribeiro here's how to do it
options: {
  scales: {
    xAxes: [{
      afterFit: function(scale) {
        scale.width = newWidth;
      }
    }]
  }
}


Deploy Kitsune in production

eta: 2023Q1
description:
Unlock horizontal scaling for preload nodes to maximize the utilized current instances. Bring more reliable service such as js-ipfs who is using the preload nodes.

https://blog.ipfs.tech/state-of-ipfs-in-js/#pl-delegate-and-preload-nodes-will-be-shutting-down
should we remove it instead scaling it

A plan hasn't been made just for shutting down the preload nodes, but here's the tracking issue: https://github.com/ipfs/ipfs/issues/499


Can this be used for an offline Flutter app?

I am looking to convert my Flutter app to be offline first, which means migrating from my GraphQL API(using Prisma) to a local DB Flutter solution. This Prisma-Dart package would be perfect for me if it means a user can have their own DB records stored on their phone. So I am trying to see if that is possible with this package.
My requirements are to have a persistant local DB and handle CRUD operations using this prisma-dart package.
Is this something that is possible with this package?
Thanks so much!

This is in the support plan. I am in the official Prisma discussion group. It is expected that the dynamic library support will be standardized in the future, then this function will become a reality.

It would be very helpful if this was explicitly mentioned as a limitation to this package. I have spent the last week developing around this because I thought it was a complete port of the JavaScript Prisma, allowing for local databases, but as I have just found out the hard way, this is not implemented. Here is the error I received before looking this up:
[ERROR:flutter/runtime/dart_vm_initializer.cc(41)] Unhandled Exception: PrismaInitializationException: Cannot find the query engine binary (Basename: D:\GitHub\flutter-ws-test\node_modules\prisma\query-engine-windows.exe)
E/flutter (10903): #0      BinaryEngine.resolvedExecutable (package:orm/binary_engine.dart:79:5)
E/flutter (10903): #1      BinaryEngine._createProcess (package:orm/binary_engine.dart:178:7)
E/flutter (10903): #2      BinaryEngine.start (package:orm/binary_engine.dart:148:23)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #3      UniversalEngine.request (package:orm/universal_engine.dart:59:5)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #4      ModelDelegate._execute (package:orm/src/client/model_delegate.dart:40:20)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #5      PrismaFluent.queryBuilder.<anonymous closure> (package:orm/src/client/prisma_fluent.dart:37:22)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #6      PrismaFluent.queryBuilder.<anonymous closure> (package:orm/src/client/prisma_fluent.dart:37:22)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #7      PrismaFluent.queryBuilder.<anonymous closure> (package:orm/src/client/prisma_fluent.dart:37:22)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #8      PrismaProvider.preferencesExists (package:flutter_ws/platform/io/prisma/prisma_provider.dart:74:12)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #9      PrismaProvider.ensurePreferences (package:flutter_ws/platform/io/prisma/prisma_provider.dart:78:10)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #10     PrismaProvider.init (package:flutter_ws/platform/io/prisma/prisma_provider.dart:109:5)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #11     AppImpl.main (package:flutter_ws/platform/io/platform_io.dart:114:5)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #12     PlatformApp.startApp (package:flutter_ws/platform_app.dart:12:5)
E/flutter (10903): <asynchronous suspension>
E/flutter (10903): #13     main (package:flutter_ws/main.dart:7:3)
E/flutter (10903): <asynchronous suspension>

I'm still looking for a decent ORM for local databases. I'll be switching to Drift in the mean time.

@BradyEdgar94 @SpongeManiac
Currently Flutter only supports Data Proxy, please use --data-proxy when generating the client
Docs: npx prisma generate --data-proxy -> https://www.prisma.io/docs/data-platform/about
Unfortunately, Library has not been developed yet because I am new to Rust.

I was curious what the current status of this is? The Engine Binary being supported on Flutter Native, that is. Is there any documentation or prior examples of this being done in other languages? I'd love to help.

I was curious what the current status of this is? The Engine Binary being supported on Flutter Native, that is. Is there any documentation or prior examples of this being done in other languages? I'd love to help.

Flutter does not support binary engine files, and Prisma engines https://github.com/prisma/prisma-engines are not ready to be built for CAPI. In other words, if I want to provide an offline local database for Prisma Support, I have to write a CAPI engine whose output target is a dynamic library (so/dll), which is cumbersome, but I'm working on it, I'm building the new Prisma client API, and when it's finished, I can start building the engine part .

One reason, as mentioned above, is that I am new to Rust. This was a big challenge for me, as I needed to learn the Rust language and develop it at the same time.

I'm actually doing a similar thing with Mercury, I've never worked with C++ before, but I had to for the project. I wouldn't mind having to do that again for this project, I'd love to know how/if I could help!

https://pub.dev/packages/flutter_rust_bridge maybe can help

https://pub.dev/packages/flutter_rust_bridge maybe can help

After I communicated with the Prisma Team, they have started working on the experimental C ABI engine 👉 https://github.com/prisma/prisma-engines/tree/osp/rn/query-engine/query-engine-rn They have already made it Added to this quarter’s roadmap!

Please wait patiently, 4.0 will finally use the C ABI engine officially produced by Prisma, so that it can run in Flutter.

In addition, I am making a temporary replacement version https://github.com/medz/prisma-dart/tree/main/packages/engine_ffi until the C ABI engine is officially released. Since I am new to Rust, my progress may be slow.

An alternative is to wait for the Dart team to implement https://github.com/dart-lang/sdk/issues/51383 this feature. At that time, I will make a Dart NAPI compatible program that can run in Dart using the Node API's dylib. However, it is obvious that Prisma Team will implement the C ABI engine faster.

#328


Estimater of ODE parameters does not perform parallel jobs

Summary:
Estimator.run(n_jobs=-1) does not perform paralle jobs. This may be caused by threading method of Optuna package.
CovsirPhy version 2.3.2
Related classes:

covsirphy.Estimator
covsirphy.Scenario

Environment:
Python 3.8, pipenv, WSL.

I'm considering the following changes.

n_jobs' argument of Estimator.run()` will be deprecated.
Scenario.estimate() will use multiprocessing of Estimator.run() of some phases

This will be fixed in #63


Merge scylla_install_(ami|image|azure) to single script

Deduplicate almost similar script for each cloud, and make it easier to
maintain.

Checked current scylla_install_azure implementation (https://github.com/scylladb/scylla-machine-image/blob/f587619a7a8686c03bf565fd07fbd5b318e1cf32/azure/image/files/scylla_install_azure), almost all difference comes from dropping CentOS image support, I think we can easily merge it to unified scylla_install_image script.

ping

Rebased with latest next, ping

Merged Azure support and rebased with latest next.

@syuu1228 Is this patch ready?  if it is , let me modify PKG side before merging

@yaronkaikov yes it's ready

rebased with latest next.

@syuu1228 I think you forgot to edit aws/ami/build_deb_ami.sh

@syuu1228 Can we go ahead with this?
I'm waiting for it to do something else.

@yaronkaikov @hagitsegev Dropped python variable changes, reverted to current code.

Rebased with latest next, since it conflicted with 8915e3e40b377e3937c65fdcf773012fcf5cdb91

Rebased with latest next.

@syuu1228 AMI is now passing
Azure failed - https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/azure-image/87/console

Hmm, when I tested by myself, it just succeeded:
https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/azure-image/91/console

GCE failed as well - https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/gce-image/400/console

Able to reproduce the issue on GCE and I'm guessing it is python path problem (the script starts with #!/usr/bin/python but there is no /usr/bin/python).
It is caused when we dropped {{user `python`}} on GCE.
To fix it we need to revert it or specify #!/usr/bin/python3.
I will add it again and update PR soon.

@yaronkaikov pushed fixed version.
Here's changes on new version:
diff --git a/azure/image/build_azure_image.sh b/azure/image/build_azure_image.sh
index 7525326..c70f74a 100755
--- a/azure/image/build_azure_image.sh
+++ b/azure/image/build_azure_image.sh
@@ -208,8 +208,7 @@ echo "Calling Packer..."
   -var client_secret="$AZURE_CLIENT_SECRET" \
   -var tenant_id="$AZURE_TENANT_ID" \
   -var subscription_id="$AZURE_SUBSCRIPTION_ID" \
-  -var scylla_build_id="$BUILD_ID" \
-  -var python="/usr/bin/python3" scylla_azure.json
+  -var scylla_build_id="$BUILD_ID" scylla_azure.json

   # For some errors packer gives a success status even if fails.
   # Search log for errors
diff --git a/azure/image/scylla_azure.json b/azure/image/scylla_azure.json
index f6d4c2b..44aaa13 100644
--- a/azure/image/scylla_azure.json
+++ b/azure/image/scylla_azure.json
@@ -40,7 +40,7 @@
     },
     {
       "inline": [
-        "sudo {{user `python`}} /home/{{user `ssh_username`}}/scylla_install_image --target-cloud azure {{ user `install_args` }}"
+        "sudo /usr/bin/python3 /home/{{user `ssh_username`}}/scylla_install_image --target-cloud azure {{ user `install_args` }}"
       ],
       "type": "shell"
     }
diff --git a/gce/image/build_deb_image.sh b/gce/image/build_deb_image.sh
index 796455c..84d31f4 100755
--- a/gce/image/build_deb_image.sh
+++ b/gce/image/build_deb_image.sh
@@ -206,6 +206,7 @@ echo "Calling Packer..."
   -var scylla_tools_version="$SCYLLA_TOOLS_VERSION" \
   -var scylla_python3_version="$SCYLLA_PYTHON3_VERSION" \
   -var scylla_build_id="$BUILD_ID" \
+  -var python=/usr/bin/python3 \
   scylla_gce.json

 # For some errors packer gives a success status even if fails.
diff --git a/gce/image/build_image.sh b/gce/image/build_image.sh
index 3bb5dd1..fb45e1f 100755
--- a/gce/image/build_image.sh
+++ b/gce/image/build_image.sh
@@ -195,6 +195,7 @@ echo "Calling Packer..."
   -var scylla_tools_version="$SCYLLA_TOOLS_VERSION" \
   -var scylla_python3_version="$SCYLLA_PYTHON3_VERSION" \
   -var scylla_build_id="$BUILD_ID" \
+  -var python=/usr/bin/python3 \
   scylla_gce.json

 # For some errors packer gives a success status even if fails.
diff --git a/gce/image/scylla_gce.json b/gce/image/scylla_gce.json
index 519ff51..5eafd6f 100644
--- a/gce/image/scylla_gce.json
+++ b/gce/image/scylla_gce.json
@@ -44,7 +44,7 @@
     },
     {
       "inline": [
-        "sudo /home/{{user `ssh_username`}}/scylla_install_image --target-cloud gce {{ user `install_args` }}"
+        "sudo {{user `python`}} /home/{{user `ssh_username`}}/scylla_install_image --target-cloud gce {{ user `install_args` }}"
       ],
       "type": "shell"
     }
@@ -57,6 +57,7 @@
     "image_storage_location": "",
     "instance_type": "",
     "ssh_username": "",
-    "source_image_family": ""
+    "source_image_family": "",
+    "python": ""
   }
 }

I found a better way to handle python path, run  update-alternatives prior to scylla_install_image, only when it's debian variants (= Ubuntu 20.04 on this script).
We don't need to use -var python on this way.
I will send new version of the PR after tested this.
diff --git a/aws/ami/scylla.json b/aws/ami/scylla.json
index 5315df1..d049a23 100644
--- a/aws/ami/scylla.json
+++ b/aws/ami/scylla.json
@@ -83,7 +83,8 @@
     {
       "inline": [
         "sudo /usr/bin/cloud-init status --wait",
-        "sudo {{user `python`}} /home/{{user `ssh_username`}}/scylla_install_image --target-cloud aws {{ user `install_args` }}"
+        "if [ -f /etc/debian_version ]; then sudo update-alternatives --install /usr/bin/python python /usr/bin/python3.8 1; fi",
+        "sudo /home/{{user `ssh_username`}}/scylla_install_image --target-cloud aws {{ user `install_args` }}"
       ],
       "type": "shell"
     }
@@ -99,8 +100,7 @@
     "security_group_id": "",
     "source_ami": "",
     "ssh_username": "",
-    "subnet_id": "",
-    "python": ""
+    "subnet_id": ""
   }
 }

00:08:23  �[1;31m==> azure-arm: userdel: user 'ubuntu' does not exist�[0m
00:08:23  �[1;31m==> azure-arm: Traceback (most recent call last):�[0m
00:08:23  �[1;31m==> azure-arm:   File "/home/azureuser/scylla_install_image", line 191, in <module>�[0m
00:08:23  �[1;31m==> azure-arm:     run('userdel -r -f {}'.format(distro))�[0m

I able to reproduced this error, will try to fix this too (seems like last time I tested wrong branch).

00:08:23  �[1;31m==> azure-arm: userdel: user 'ubuntu' does not exist�[0m
00:08:23  �[1;31m==> azure-arm: Traceback (most recent call last):�[0m
00:08:23  �[1;31m==> azure-arm:   File "/home/azureuser/scylla_install_image", line 191, in <module>�[0m
00:08:23  �[1;31m==> azure-arm:     run('userdel -r -f {}'.format(distro))�[0m

I able to reproduced this error, will try to fix this too (seems like last time I tested wrong branch).

@syuu1228 Looks like AMI and GCE are now good. ping me when you fix the Azure so we can get it in

@yaronkaikov Pushed new version, changes are:

Fixed userdel error on Azure (stop running username configuration for Azure, since login user is not static just like GCE)
Applied update-alternatives to create /usr/bin/python symlink, dropped -var python

@syuu1228 Azure still failing with the following error
08:23:51  ==> azure-arm: Traceback (most recent call last):
08:23:51  ==> azure-arm:   File "/usr/lib/cnf-update-db", line 26, in <module>
08:23:51  ==> azure-arm:     col.create(db)
08:23:51  ==> azure-arm:   File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 94, in create
08:23:51  ==> azure-arm:     self._fill_commands(con)
08:23:51  ==> azure-arm:   File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 137, in _fill_commands
08:23:51  ==> azure-arm:     with open(f) as fp:
08:23:51  ==> azure-arm: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_focal_restricted_cnf_Commands-amd64'
08:23:51      azure-arm: Fetched 19.8 MB in 3s (6238 kB/s)
08:23:51      azure-arm: Reading package lists...
08:23:51  ==> azure-arm: E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/lib/command-not-found/ -a -e /usr/lib/cnf-update-db; then /usr/lib/cnf-update-db > /dev/null; fi'
08:23:51  ==> azure-arm: E: Sub-process returned an error code
08:23:51  ==> azure-arm: Traceback (most recent call last):
08:23:51  ==> azure-arm:   File "/home/azureuser/scylla_install_image", line 107, in <module>
08:23:51  ==> azure-arm:     run('apt-get update --allow-insecure-repositories -y')
08:23:51  ==> azure-arm:   File "/home/azureuser/scylla_install_image", line 39, in run
08:23:51  ==> azure-arm:     return subprocess.check_call(cmd, shell=shell, env=my_env)
08:23:51  ==> azure-arm:   File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
08:23:51  ==> azure-arm:     raise CalledProcessError(retcode, cmd)
08:23:51  ==> azure-arm: subprocess.CalledProcessError: Command '['apt-get', 'update', '--allow-insecure-repositories', '-y']' returned non-zero exit status 100.
08:23:51  ==> azure-arm: Script exited with non-zero exit status: 1.Allowed exit codes are: [0]
08:23:51  ==> azure-arm: Step "StepProvision" failed, aborting...
08:23:51  ==> azure-arm: aborted: skipping cleanup of step "StepConnectSSH"
08:23:51  ==> azure-arm: aborted: skipping cleanup of step "StepGetIPAddress"
08:23:51  ==> azure-arm: aborted: skipping cleanup of step "StepDeployTemplate"
08:23:51  ==> azure-arm: aborted: skipping cleanup of step "StepValidateTemplate"
08:23:51  ==> azure-arm: aborted: skipping cleanup of step "StepCreateResourceGroup"
08:23:51  Build 'azure-arm' errored after 1 minute 24 seconds: Script exited with non-zero exit status: 1.Allowed exit codes are: [0]

https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/azure-image/98/console

Both AMI and GCE are passing :
https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/gce-image/421/ - GCE
https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/ami/665/ - AMI
@syuu1228

@syuu1228 Azure still failing with the following error
08:23:51  �[1;31m==> azure-arm: Traceback (most recent call last):�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/cnf-update-db", line 26, in <module>�[0m
08:23:51  �[1;31m==> azure-arm:     col.create(db)�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 94, in create�[0m
08:23:51  �[1;31m==> azure-arm:     self._fill_commands(con)�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 137, in _fill_commands�[0m
08:23:51  �[1;31m==> azure-arm:     with open(f) as fp:�[0m
08:23:51  �[1;31m==> azure-arm: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_focal_restricted_cnf_Commands-amd64'�[0m
08:23:51  �[0;32m    azure-arm: Fetched 19.8 MB in 3s (6238 kB/s)�[0m
08:23:51  �[0;32m    azure-arm: Reading package lists...�[0m
08:23:51  �[1;31m==> azure-arm: E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/lib/command-not-found/ -a -e /usr/lib/cnf-update-db; then /usr/lib/cnf-update-db > /dev/null; fi'�[0m
08:23:51  �[1;31m==> azure-arm: E: Sub-process returned an error code�[0m
08:23:51  �[1;31m==> azure-arm: Traceback (most recent call last):�[0m
08:23:51  �[1;31m==> azure-arm:   File "/home/azureuser/scylla_install_image", line 107, in <module>�[0m
08:23:51  �[1;31m==> azure-arm:     run('apt-get update --allow-insecure-repositories -y')�[0m
08:23:51  �[1;31m==> azure-arm:   File "/home/azureuser/scylla_install_image", line 39, in run�[0m
08:23:51  �[1;31m==> azure-arm:     return subprocess.check_call(cmd, shell=shell, env=my_env)�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/python3.8/subprocess.py", line 364, in check_call�[0m
08:23:51  �[1;31m==> azure-arm:     raise CalledProcessError(retcode, cmd)�[0m
08:23:51  �[1;31m==> azure-arm: subprocess.CalledProcessError: Command '['apt-get', 'update', '--allow-insecure-repositories', '-y']' returned non-zero exit status 100.�[0m
08:23:51  �[1;31m==> azure-arm: Script exited with non-zero exit status: 1.Allowed exit codes are: [0]�[0m
08:23:51  �[1;31m==> azure-arm: Step "StepProvision" failed, aborting...�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepConnectSSH"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepGetIPAddress"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepDeployTemplate"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepValidateTemplate"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepCreateResourceGroup"�[0m
08:23:51  �[1;31mBuild 'azure-arm' errored after 1 minute 24 seconds: Script exited with non-zero exit status: 1.Allowed exit codes are: [0]�[0m

https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/azure-image/98/console

@yaronkaikov This is not reproducible for me, I re-run the job multiple time, it never occurred again.
In fact, the problem is not cloud specific thing, it should also occur on AMI and GCE but we got succeed.
Since FileNotFoundError is happened on apt cache file, it may networking problem on apt-get update, but normally we don't get such error message on networking problem, this can be something different.
Because the error is occurred on plug-in python script on APT::Update::Post-Invoke-Success handler, not at apt-get program itself.
One possible solution is removing command-not-found package, because the script never execute when the package not installed.
But maybe we don't have to remove it if the error never happens again.

@syuu1228 Azure still failing with the following error
08:23:51  �[1;31m==> azure-arm: Traceback (most recent call last):�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/cnf-update-db", line 26, in <module>�[0m
08:23:51  �[1;31m==> azure-arm:     col.create(db)�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 94, in create�[0m
08:23:51  �[1;31m==> azure-arm:     self._fill_commands(con)�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 137, in _fill_commands�[0m
08:23:51  �[1;31m==> azure-arm:     with open(f) as fp:�[0m
08:23:51  �[1;31m==> azure-arm: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_focal_restricted_cnf_Commands-amd64'�[0m
08:23:51  �[0;32m    azure-arm: Fetched 19.8 MB in 3s (6238 kB/s)�[0m
08:23:51  �[0;32m    azure-arm: Reading package lists...�[0m
08:23:51  �[1;31m==> azure-arm: E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/lib/command-not-found/ -a -e /usr/lib/cnf-update-db; then /usr/lib/cnf-update-db > /dev/null; fi'�[0m
08:23:51  �[1;31m==> azure-arm: E: Sub-process returned an error code�[0m
08:23:51  �[1;31m==> azure-arm: Traceback (most recent call last):�[0m
08:23:51  �[1;31m==> azure-arm:   File "/home/azureuser/scylla_install_image", line 107, in <module>�[0m
08:23:51  �[1;31m==> azure-arm:     run('apt-get update --allow-insecure-repositories -y')�[0m
08:23:51  �[1;31m==> azure-arm:   File "/home/azureuser/scylla_install_image", line 39, in run�[0m
08:23:51  �[1;31m==> azure-arm:     return subprocess.check_call(cmd, shell=shell, env=my_env)�[0m
08:23:51  �[1;31m==> azure-arm:   File "/usr/lib/python3.8/subprocess.py", line 364, in check_call�[0m
08:23:51  �[1;31m==> azure-arm:     raise CalledProcessError(retcode, cmd)�[0m
08:23:51  �[1;31m==> azure-arm: subprocess.CalledProcessError: Command '['apt-get', 'update', '--allow-insecure-repositories', '-y']' returned non-zero exit status 100.�[0m
08:23:51  �[1;31m==> azure-arm: Script exited with non-zero exit status: 1.Allowed exit codes are: [0]�[0m
08:23:51  �[1;31m==> azure-arm: Step "StepProvision" failed, aborting...�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepConnectSSH"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepGetIPAddress"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepDeployTemplate"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepValidateTemplate"�[0m
08:23:51  �[1;31m==> azure-arm: aborted: skipping cleanup of step "StepCreateResourceGroup"�[0m
08:23:51  �[1;31mBuild 'azure-arm' errored after 1 minute 24 seconds: Script exited with non-zero exit status: 1.Allowed exit codes are: [0]�[0m

https://jenkins.scylladb.com/view/master/job/scylla-master/job/releng-testing/job/azure-image/98/console

@yaronkaikov This is not reproducible for me, I re-run the job multiple time, it never occurred again.
In fact, the problem is not cloud specific thing, it should also occur on AMI and GCE but we got succeed.
Since FileNotFoundError is happened on apt cache file, it may networking problem on apt-get update, but normally we don't get such error message on networking problem, this can be something different.
Because the error is occurred on plug-in python script on APT::Update::Post-Invoke-Success handler, not at apt-get program itself.
One possible solution is removing command-not-found package, because the script never execute when the package not installed.
But maybe we don't have to remove it if the error never happens again.

@syuu1228 Ok. so maybe it was something temporaty , make sense actually since you rebuild twice and it passed.
Let's merge this


Create private repo for TF describing AWS resources not explicitly part of the platform.

In order to properly document and assign ownership to those resources.

This repo exists!