Is the Output of Retdec Compilable?

I can decompile binaries successfully. Can I check if I can then compile the output from the decompiler? Is the output C or just C-like?

Ok I tried, with no success. Output:
Users-MacBook-Pro:retdec_output user$ gcc -o spray spray.c
spray.c:87:23: warning: implicit declaration of function '_getopt' is invalid in C99
      [-Wimplicit-function-declaration]
        int32_t v10 = _getopt((int32_t)a1, (char **)v6, (char *)v5); // 0x10000097c397416
                      ^
spray.c:104:35: warning: implicit declaration of function '_atoi' is invalid in C99
      [-Wimplicit-function-declaration]
                    int64_t v15 = _atoi((char *)*(int64_t *)v3); // 0x10000095d
                                  ^
spray.c:176:21: warning: implicit declaration of function '_clnt_create' is invalid in C99
      [-Wimplicit-function-declaration]
    int64_t * v25 = _clnt_create((char *)v24, 0x186ac, 1, "udp"); // 0x100000a06
                    ^
spray.c:176:15: warning: incompatible integer to pointer conversion initializing 'int64_t *'
      (aka 'long long *') with an expression of type 'int' [-Wint-conversion]
    int64_t * v25 = _clnt_create((char *)v24, 0x186ac, 1, "udp"); // 0x100000a06
              ^     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
spray.c:179:9: warning: implicit declaration of function '_clnt_pcreateerror' is invalid in
      C99 [-Wimplicit-function-declaration]
        _clnt_pcreateerror((char *)a2);
        ^
spray.c:181:16: warning: incompatible pointer to integer conversion returning 'int32_t *'
      (aka 'int *') from a function with result type 'int64_t' (aka 'long long')
      [-Wint-conversion]
        return &g7;
               ^~~
spray.c:187:9: warning: implicit declaration of function '_printf' is invalid in C99
      [-Wimplicit-function-declaration]
        _printf("sending %d packets of lnth %d to %s ...", a1, v27, (char *)v26);
        ^
spray.c:188:9: warning: implicit declaration of function '_fflush' is invalid in C99
      [-Wimplicit-function-declaration]
        _fflush((struct _IO_FILE *)*(int64_t *)*(int64_t *)0x100001018);
        ^
spray.c:198:21: warning: implicit declaration of function '_usleep' is invalid in C99
      [-Wimplicit-function-declaration]
                    _usleep(v9);
                    ^
spray.c:217:28: warning: implicit declaration of function '__asm_cvtsi2sd' is invalid in C99
      [-Wimplicit-function-declaration]
            int128_t v34 = __asm_cvtsi2sd((int64_t)v33); // 0x100000b3a
                           ^
spray.c:220:28: warning: implicit declaration of function '__asm_addsd' is invalid in C99
      [-Wimplicit-function-declaration]
            int128_t v37 = __asm_addsd(__asm_divsd(v36, g1), v34); // 0x100000b4c
                           ^
spray.c:220:40: warning: implicit declaration of function '__asm_divsd' is invalid in C99
      [-Wimplicit-function-declaration]
            int128_t v37 = __asm_addsd(__asm_divsd(v36, g1), v34); // 0x100000b4c
                                       ^
spray.c:221:27: warning: implicit declaration of function '__asm_movsd' is invalid in C99
      [-Wimplicit-function-declaration]
            int64_t v38 = __asm_movsd(v37); // 0x100000b59
                          ^
spray.c:227:17: warning: implicit declaration of function '__asm_xorps' is invalid in C99
      [-Wimplicit-function-declaration]
                __asm_xorps(v37, v37);
                ^
spray.c:228:32: warning: implicit declaration of function '__asm_cvtsi2sd_1' is invalid in
      C99 [-Wimplicit-function-declaration]
                int128_t v41 = __asm_cvtsi2sd_1(v40); // 0x100000b96
                               ^
spray.c:229:32: warning: implicit declaration of function '__asm_mulsd' is invalid in C99
      [-Wimplicit-function-declaration]
                int128_t v42 = __asm_mulsd(v41, g2); // 0x100000b9a
                               ^
spray.c:232:94: warning: implicit declaration of function '__asm_divsd_2' is invalid in C99
      [-Wimplicit-function-declaration]
  ..._printf("\t%d packets (%.2f%%) dropped\n", (int64_t)v40, (float64_t)(int64_t)__asm_d...
                                                                                ^
spray.c:235:17: warning: implicit declaration of function '_puts' is invalid in C99
      [-Wimplicit-function-declaration]
                _puts("\tno packets dropped");
                ^
spray.c:241:18: warning: implicit declaration of function '__asm_movsd_3' is invalid in C99
      [-Wimplicit-function-declaration]
            g8 = __asm_movsd_3(v44);
                 ^
spray.c:251:5: warning: implicit declaration of function '_clnt_perror' is invalid in C99
      [-Wimplicit-function-declaration]
    _clnt_perror(v25, (char *)a2);
    ^
spray.c:262:5: warning: implicit declaration of function '__asm_movapd' is invalid in C99
      [-Wimplicit-function-declaration]
    __asm_movapd(v2);
    ^
spray.c:265:5: warning: implicit declaration of function '__asm_ucomisd' is invalid in C99
      [-Wimplicit-function-declaration]
    __asm_ucomisd(v5, g3);
    ^
spray.c:279:5: warning: implicit declaration of function '_fwrite' is invalid in C99
      [-Wimplicit-function-declaration]
    _fwrite((int64_t *)"usage: spray [-c count] [-l length] [-d delay] host\n", 52, ...
    ^
spray.c:288:9: warning: implicit declaration of function '_xdr_u_int' is invalid in C99
      [-Wimplicit-function-declaration]
    if (_xdr_u_int((int64_t *)a1, (int32_t *)a2) == 0) {
        ^
spray.c:315:12: warning: implicit declaration of function '_xdr_bytes' is invalid in C99
      [-Wimplicit-function-declaration]
    return _xdr_bytes((int64_t *)a1, (char **)(a2 + 8), (int32_t *)a2, 0x228d) != 0;
           ^
spray.c:327:12: warning: incompatible integer to pointer conversion returning 'int' from a
      function with result type 'int64_t *' (aka 'long long *') [-Wint-conversion]
    return _clnt_create(host, prog, vers, prot);
           ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
spray.c:399:12: warning: implicit declaration of function 'dyld_stub_binder' is invalid in
      C99 [-Wimplicit-function-declaration]
    return dyld_stub_binder();
           ^
27 warnings generated.
Undefined symbols for architecture x86_64:
  "___asm_addsd", referenced from:
      _entry_point in spray-4a3760.o
  "___asm_cvtsi2sd", referenced from:
      _entry_point in spray-4a3760.o
  "___asm_cvtsi2sd_1", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
  "___asm_divsd", referenced from:
      _entry_point in spray-4a3760.o
  "___asm_divsd_2", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
  "___asm_movapd", referenced from:
      _function_100000c1e in spray-4a3760.o
  "___asm_movsd", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
  "___asm_movsd_3", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
  "___asm_mulsd", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
  "___asm_ucomisd", referenced from:
      _function_100000c1e in spray-4a3760.o
  "___asm_xorps", referenced from:
      _entry_point in spray-4a3760.o
  "__atoi", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d4e in spray-4a3760.o
  "__clnt_create", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d54 in spray-4a3760.o
  "__clnt_pcreateerror", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d5a in spray-4a3760.o
  "__clnt_perror", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d60 in spray-4a3760.o
  "__fflush", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d6c in spray-4a3760.o
  "__fwrite", referenced from:
      _function_100000c8f in spray-4a3760.o
      _function_100000d72 in spray-4a3760.o
  "__getopt", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d78 in spray-4a3760.o
  "__printf", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
      _function_100000d7e in spray-4a3760.o
  "__puts", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000c1e in spray-4a3760.o
      _function_100000d84 in spray-4a3760.o
  "__usleep", referenced from:
      _entry_point in spray-4a3760.o
      _function_100000d8a in spray-4a3760.o
  "__xdr_bytes", referenced from:
      _function_100000d2b in spray-4a3760.o
      _function_100000d90 in spray-4a3760.o
  "__xdr_u_int", referenced from:
      _function_100000cbd in spray-4a3760.o
      _function_100000cf4 in spray-4a3760.o
      _function_100000d96 in spray-4a3760.o
  "_dyld_stub_binder", referenced from:
      _function_100000d9c in spray-4a3760.o
  "_main", referenced from:
     implicit entry/start for main executable
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

Hi. This question has already been answered in #529, so please refer to it and to the discussion in #45.

@s3rvac __asm_xorps is two 128bit operands, I got only 32bit in my output...

Missing data.


templateCustomSettings loaded from settings.json file

Does this PR introduce a breaking change?
NO
Other information:
added templateCustomSettings to sink constructor for configurations loaded from settings.json file

I don't know if this is the correct way to do a second PR. I don't understand why it takes the commits that I had already merged

Somewhat confusing PR as it contains code that is already merged. I understand that you want to add the dictionary of optional settings for the template to the ES function? What is the reason to specify it like this? To use it in the appconfig?

Yes. I use the "appsettings.json" file to configure serilog. this is my example configuration:
{   "Serilog": {     "Using": [       "Serilog.Sinks.Elasticsearch"     ],     "WriteTo": [       {         "Name" : "Elasticsearch",         "Args" : {             "nodeUris" : "http://localhost:9200",             "indexFormat" : "test-fields",             "overwriteTemplate": true,             "autoRegisterTemplate": true,             "autoRegisterTemplateVersion": 2,             "numberOfShards" : 1,             "numberOfReplicas" : 0,             "templateCustomSettings": {               "index.mapping.total_fields.limit": "10000000"             }         }       }     ],     "Enrich": [       "FromLogContext",       "WithMachineName",       "WithExceptionDetails",       "WithThreadId"     ],     "Properties": {       "Application": "AppName"     }   } }

Merged to dev, updated readme.md file as well. Please try the alpha package and see if this suits your needs.


Is there a way to define the output directory at configuration time?

I don't want to define the output directory in my template, when I create the environment I would like to define where it should output to.

webassets doesn't have a concept of "output directory", for each bundle, you specify the output file directly on a per-Bundle
level.
It's not quite clear what you goal is - do you object to having specify an output filename in general (as oppposed to some automatically generated filename being used), or do you just want to avoid the directory prefix?
In either case, I don't currently see a way to add this functionality to the core in a way that I would find satisfactory. For example, adding another environment option, so that the final output would be defined as BASE_URL + OUTPUT_DIRECTORY + BUNDLE_FILENAME complicates things too much.
Some ideas:

A custom Bundle subclass could be created which uses some other way to determine the output filename. webassets could support a way to change the Bundle class the template tags use.

If you just want to make the output filename configurable, you should be able to use standard template variables to do so:
{{ assets .... output=output_variable }}

with output_variable being passed in from the view.

When using platform as services such as ep.io the primary deployment file system is read only and they provide an environment variable at startup of a writeable directory.   So for generating files I need to be able to just define an output directory.  I don't care what the file name is since I'm just using the {{ ASSET_URL }} tag anyways, so it'd be more helpful to define where I want the files to be placed than their names

I thought about just compiling before hand but then I would have to change my markup to point directly to the css/js files rather than using the bundle syntax, wouldn't I?

No. You just need to setup the production environment such that the output url generated, based on Environment.url (ASSETS_URL) and the bundle output, is accessible.
You then want to set Environment.updater (ASSETS_UPDATER) to False to disable automatic building.


Relocate RPATH

[X] Have you followed the guidelines in our Contributing document?
[X] Have you checked to ensure there aren't other open Pull Requests for the same change?
[X] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

As suggested in #8

Could you please merge #20 and rebase this PR on top of master after the merge?

Thanks for doing this work, Piotr!

I have trouble installing locally built bottle. What to do when --force-bottle doesn't help? What are the requirements (besides patchelf and glibc) for bottles?

Also:
patchelf --print-rpath ~/.linuxbrew/bin/perl
/home/linuxbrew/.linuxbrew/lib:/home/linuxbrew/.linuxbrew/Cellar/perl/5.22.1_1/lib/5.22.1/x86_64-linux-thread-multi/CORE

patchelf --print-rpath perl/5.22.1_1/bin/perl
@@HOMEBREW_PREFIX@@/lib

Error during bottling?

OK, got it. Trying from another angle ;)

What are the requirements (besides patchelf and glibc) for bottles?

I think this is a bug, but I believe the formula has to have a :x86_64_linux bottle entry (even a blank one) for --force-bottle to work.

It took a bit to test it and come up with something resembling sensible, but here it is.

Exactly how should they be split?

Ah, I see that #20 isn't merged yet. I'll move the discussion over there.

Funny, thought I merged it this morning...

See https://github.com/Linuxbrew/brew/pull/20/files#r62720717
Fix that bug, merge it, then rebase this PR on top of that.

Ah, sure!

select trick breaks the hard links use case. On the first attempt old_prefix is substituted with placeholder, on subsequent ones whole RPATH is dropped as it no longer holds old_prefix. One possible workaround might be to include? old_prefix || include? new_prefix.

Good point. It also would break brew patchelf foo of a formula installed from source. Yes, your workaround works for me.

I also split the .interp fix to #20

Seems Ol Korekt now, but I've been wrong before.

Check my comments in #20 about nil/String/Pathname types, then rebase this PR onto the new #20.

Indeed it could :)

The patch looks great! I'll test it out tomorrow. I've wanted to bottle ghc so that I can bottle pandoc, and bottling ghc requires this PR.

Here's my simple test of the important features:
$ patchelf --print-rpath --print-interpreter `brew --prefix`/bin/hello
/home/sjackman/.linuxbrew/lib/ld.so
/home/sjackman/.linuxbrew/opt/readline/lib:@@HOMEBREW_PREFIX@@/opt/hello/lib:/usr/lib64
sjackman at gphost02 in ~/.linuxbrew on master
$ brew patchelf hello
==> Fixing up hello...
sjackman at gphost02 in ~/.linuxbrew on master
$ patchelf --print-rpath --print-interpreter `brew --prefix`/bin/hello
/home/sjackman/.linuxbrew/lib/ld.so
/home/sjackman/.linuxbrew/opt/readline/lib:/home/sjackman/.linuxbrew/opt/hello/lib:/home/sjackman/.linuxbrew/lib

@@HOMEBREW_PREFIX@@ is changed to $HOMEBREW_PREFIX
Paths within $HOMEBREW_PREFIX are retained
Paths outside of $HOMEBREW_PREFIX are discarded
$HOMEBREW_PREFIX/lib is added if it's not already found

Thanks, Piotr!


truvari: init at 1.3.2

Motivation for this change
Things done

[ x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ x] Ensured that relevant documentation is up to date
[ x] Fits CONTRIBUTING.md.

Notify maintainers
The pyvcf license doesn't exclusively say MIT, but the text is identical as far as I can see.
I've created a specific version of the progressbar, don't know if any of the existing ones could be upgraded.
I upgraded the pysam library version to 0.15.3 to avoid creating a specific version for truvari. The differences of the versions seems to not have any compatibility issues.
Truvari is a much used tools for benchmarking within bioinformatics.

You've used an older version of progressbar2 (note that progressbar and progressbar2 are separate projects, despite the latter being at major release 3.x). Can you try with progressbar2 3.4.2?

You've used an older version of progressbar2 (note that progressbar and progressbar2 are separate projects, despite the latter being at major release 3.x  ). Can you try with the existing progressbar2 3.4.2?

Seems the progressbar2 version 342 wasn't compatible after all. I have to revert this. Will fix it shortly.

@ashgillman , thanks a lot for your help, finally I have been able to test this again locally, and now it works, also with this version of progressbar. Do you have any idea why the metaCheck is failing? I also get this failure in my other PR:
https://github.com/NixOS/nixpkgs/pull/70871

Eval should be fixed by c0d5833156cd32086642207fbb026ab772d16822
@GrahamcOfBorg eval

Looks good to me :)

It was not possible to track what version of pyvcf on pypi matched the github repo, because there where no releases after 0.6.0. I've checked out from the last commit. From what I could see, the last changes are only test enhancements and bug fixes. I've tested truvari locally and it works.
Thanks a lot for helping out! I have learned a lot from this :-)

@GrahamcOfBorg build truvari

@GrahamcOfBorg build truvari


hard linked .env file gets misinterpreted as a shell script

Does this issue occur when all extensions are disabled?: Yes

Steps to Reproduce:

open .env file that is a hard link to other file.
observe that it's incorrectly recognized as a shell script.

I have several environment variables like .env.local, .env.prod, etc, and I make a hard link named '.env' to point to the environment I want to test.
All other .env* files I open get correctly recognized as env file type.
But .env, for a brief moment gets recognized as an env file, but after a second it turns into shell script.
The extension does the correct syntax highlighting for that brief moment but then the shell script highlighting kicks in.
I've tried the 3 most popular .env highlighting extensions and this happens with either and with none at all.
I have this in my settings.json:
	"files.associations": {
		".env": "env",
		".env*": "env"
	},

OS Version:
MacOS 11.5.2

VS Code Version:
Version: 1.60.0
Commit: e7d7e9a9348e6a8cc8c03f877d39cb72e5dfb1ff
Date: 2021-09-01T10:54:53.442Z (2 wks ago)
Electron: 13.1.8
Chrome: 91.0.4472.164
Node.js: 14.16.0
V8: 9.1.269.39-electron.0
OS: Darwin x64 20.6.0

Looks like duplicate of #132173
Is it reproducible in latest stable version 1.60.1? Fix should be in place.
https://code.visualstudio.com/Download

duplicate of #132173

@IllusionMH I seem to have the same issue, but running 1.60.1
Version: 1.60.1
Commit: 83bd43bc519d15e50c4272c6cf5c1479df196a4d
Date: 2021-09-10T17:09:14.403Z (1 wk ago)
Electron: 13.1.8
Chrome: 91.0.4472.164
Node.js: 14.16.0
V8: 9.1.269.39-electron.0
OS: Darwin x64 19.6.0

Running MacOs 10.15.7.
My .env gets recognized as a TS file though.


Log Analytics Pipeline: Unable to deploy cross account lambda pipelines

Describe the bug
All attemtps to setup a Log Pipeline between two AWS accounts in EU-West-1 fails the cloud formation creation with message "(AccessDeniedException) when calling the PutSubscriptionFilter operation".
Expected Behavior
The log pipeline should setup all resources including the permissions and reach a success state in the Centralized Logging with OpenSearch UI
Current Behavior
When using the UI to deploy a cross account Lambda collection the stack ends up in a rollback state with the error being:
Received response status [FAILED] from custom resource. Message returned: Error: An error occurred (AccessDeniedException) when calling the PutSubscriptionFilter operation: User with accountId: #memberAccountID# is not authorized to perform PutSubscriptionFilter on resources arn:aws:logs:eu-west-1:#AccountID#:destination:CL-SvcPipe-a6308ec8-CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackDeliverySt-s9cKxt4GDgIW. Logs: /aws/lambda/CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackcwSubFilt-Y6nTxnoIOTsb at invokeUserFunction (/var/task/framework.js:2:6) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async onEvent (/var/task/framework.js:1:369) at async Runtime.handler (/var/task/cfn-response.js:1:1573) (RequestId: 853b8fcd-641f-41c2-8ce0-14b8c8f26474)
Following the troubleshooting guide for an earlier version for the exact error message indicates the correct values
https://docs.aws.amazon.com/solutions/latest/centralized-logging-on-aws/troubleshooting.html
aws logs describe-destinations --region eu-west-1  {     "destinations": [         {             "destinationName": "CL-SvcPipe-a6308ec8-CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackDeliverySt-s9cKxt4GDgIW",             "targetArn": "arn:aws:firehose:eu-west-1:#AccountID#:deliverystream/CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackDeliverySt-s9cKxt4GDgIW",             "roleArn": "arn:aws:iam::#AccountID#:role/CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackCWDestinat-Zf9fjlcsykyR",             "accessPolicy": "{\"Version\": \"2012-10-17\", \"Statement\": [{\"Sid\": \"\", \"Effect\": \"Allow\", \"Principal\": {\"AWS\": \"#memberAccountID# \"}, \"Action\": \"logs:PutSubscriptionFilter\", \"Resource\": \"arn:aws:logs:eu-west-1:#AccountID#:destination:CL-SvcPipe-a6308ec8-CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackDeliverySt-s9cKxt4GDgIW\"}]}",             "arn": "arn:aws:logs:eu-west-1:#AccountID#:destination:CL-SvcPipe-a6308ec8-CL-SvcPipe-a6308ec8-CWtoFirehosetoS3StackDeliverySt-s9cKxt4GDgIW",             "creationTime":<PHONE_NUMBER>823         }     ] }
(redacted the account IDs in the logs above with #memberAccountID# , #AccountID#)
Reproduction Steps
Setup "Centralized Logging with OpenSearch" in one account togeather with Opensearch and connect a member account via the UI.
Try to create a aws-service-log pipeline for a lambda in the remote account and it should result in an error
Possible Solution
No response
Additional Information/Context
a similar earlier setup has been deployed on two other account with 2.0.0 without the issue
Solution Version
2.1.1
AWS Region. e.g., us-east-1
eu-west-1
Other information
No response

A quick workaround:

Go to member account
Find a role name which looks like CrossAccountRoleFACE29D1
Add an extra resource id ("arn:aws:logs:*:<parent-account-id>:destination:*")as follow:

It seems that AWS services get updated. The above policy is not needed before.

Workaround confirmed, seams to work as expected when adding this resource to the IAM Role

Can confirm. The workaround is working.

Is there any update to this issue? I faced this issue multiple times and had resolve it with help of AWS Support. If we can update the CloudFormation template to be run on member account, then it will resolve it once and for all.

Is there any update to this issue? I faced this issue multiple times and had resolve it with help of AWS Support. If we can update the CloudFormation template to be run on member account, then it will resolve it once and for all.

OK. We will release a patch version as soon as possbile.


TOC format out of date

Look into _toc.yml format. We now get the following error:
=============================================================================== The Table of Contents file is malformed: toc is not a mapping: <class 'list'> You may need to migrate from the old format, using:         jupyter-book toc migrate /Users/cdiaz/riddc-jbook/riddc/_toc.yml -o /Users/cdiaz/riddc-jbook/riddc/_toc.yml ===============================================================================
when building the book. Full traceback:
Running Jupyter-Book v0.13.1 Traceback (most recent call last):   File "/usr/local/lib/python3.9/site-packages/jupyter_book/cli/main.py", line 244, in build     parse_toc_yaml(toc)   File "/usr/local/lib/python3.9/site-packages/sphinx_external_toc/parsing.py", line 89, in parse_toc_yaml     return parse_toc_data(data)   File "/usr/local/lib/python3.9/site-packages/sphinx_external_toc/parsing.py", line 99, in parse_toc_data     raise MalformedError(f"toc is not a mapping: {type(data)}") sphinx_external_toc.parsing.MalformedError: toc is not a mapping: <class 'list'> During handling of the above exception, another exception occurred: Traceback (most recent call last):   File "/usr/local/bin/jupyter-book", line 8, in <module>     sys.exit(main())   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1130, in __call__     return self.main(*args, **kwargs)   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1055, in main     rv = self.invoke(ctx)   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1657, in invoke     return _process_result(sub_ctx.command.invoke(sub_ctx))   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1404, in invoke     return ctx.invoke(self.callback, **ctx.params)   File "/usr/local/lib/python3.9/site-packages/click/core.py", line 760, in invoke     return __callback(*args, **kwargs)   File "/usr/local/lib/python3.9/site-packages/jupyter_book/cli/main.py", line 246, in build     _error(   File "/usr/local/lib/python3.9/site-packages/jupyter_book/utils.py", line 48, in _error     raise kind(box)

closed by #11


Expose a "getTopicMetadata" method on admin instances

Hiya!
Description
We had a need to lookup the partition metadata for a topic but found this method was not exposed in the public API, though the functionality exists on cluster instances. Accordingly I've added a method getTopicMetadata on the admin instance to permit users to lookup topic metadata. Since admin instances are created with the allowAutoTopicCreation  option set to false we should expect this method to throw an error when run against a topic that does not exist. Please let me know if there are changes we should make to bring this up to snuff, or if you have concerns about whether this method should be exposed.
Example
const admin = kafka.admin();
await admin.connect();
const { partitions } = await admin.getTopicMetadata('my-topic');
const numPartitions = partitions.length;

Addendum
As something of an aside, this work came up because we have a need to assign our messages to a partition according to a property other than key, because we are compacting on the key. Currently we plan to accomplish this by adding a custom partitioner, identical to the default, except with the following as the first condition:
if (typeof message.partition === 'string') {
      return toPositive(murmur2(message.partition)) % numPartitions
}

Basically if the partition property is a string we hash on that property instead of the key. Do you think this is a common enough use case that it would be worth porting into the library? Or is it best left outside the library as a custom partitioner for the client to implement?
Thanks!

I think you are making a good use of the partitioner, but I don't think this logic belongs to the library unless we find out that this is some sort of standard.
Thanks again for the PR, we are adding methods to the admin as we need them, so feel free to create new issues or go straight to PRs.

🎉 Thanks @tulios & @Nevon !


Why MediaPlayer and not ExoPlayer for Android?

ExoPlayer is more comparable to the AVPlayer that is used for iOS, especially for streaming video. Why was MediaPlayer chosen and would it be possible to wrap ExoPlayer instead or alongside MediaPlayer as a feature request?

There's already an exoplayer plugin you could try by @NathanaelA
https://github.com/NathanaelA/nativescript-exoplayer

That package would work for just ExoPlayer, but then the consumer would need to be the one to decide when to use what player. I think the value of this nativescript-videoplayer library is that it does this logic.

@avhetman - As the author of the ExoPlayer plugin, I am having a really hard time understanding what you are asking for.
ExoPlayer actually came from this plugin, so the iOS side of the code base is pretty close to identical as what is in this plugin; but on the Android side it uses ExoPlayer instead of MediaPlayer.
So everything should be wrapped up; the reason we split it into two separate plugins is because to run ExoPlayer the underlying code is completely different so it made no sense to keep the plugins as the same one as the flow is different...  But what is exposed to you consuming the plugin should be pretty close to the same...

Hi @NathanaelA I really appreciate your clarification. It looks like your plugin is what I am looking for after all. Thank you very much!


Support HTTPS natively

Is your feature request related to a problem? Please describe.
I always run Adrian behind a Caddy reverse proxy, but not everyone will want to. Only serving HTTP is going to lead to mixed content warnings on HTTPS pages.
Describe the solution you'd like

Support HTTPS.
Add a configuration option to turn it off (like how Caddy does HTTPS by default)

Describe alternatives you've considered
The alternative is to always run Adrian behind a reverse proxy which defeats the purpose of a web font server.

Looks like the Echo library supports Let's Encrypt already. Implementation should be straightforward https://echo.labstack.com/cookbook/auto-tls


Add support for loading less common DDS formats

Follow-up to #81220
Implements support for loading some less common DDS formats, such as:

A8,
DXT2,
DXT4,
B2GR3,
B2GR3A8,
LA4,
RGB32F,
SRGB variants of RGBA8, BC1, BC2, BC3 and BC7

Also changes the loader to now require the DDPF_LUMINANCE flag for grayscale formats, though there is a chance this may break files created by writers which don't set it.
I've marked it as draft in case there are more unsupported formats.
MRP for testing the changes: DDSFormatsUncommon.zip

Thanks!


NetworkResource structure change causing test failure

docker/engine-api is deprecated by Docker. Swarm still using engine-api may have inconsistency with Docker API. In test/integration/api/network.bats. Docker netork inspect has an extra field Attachable which causes test failure.
   >         "Attachable": false,

cc @nishanttotla.

@dongluochen good point. Let's track the vendoring update in #2488, and target to get it done by the next release.


Enhancing Loader to Manage Temporary Link Scenarios

Currently, the loader determines the file type based on the file extension during the loading process. However, it fails to handle temporary links created via URL.createObjectURL. The loader needs to attempt processing these types of files and provide feedback to the user.

done


New IEEE EMBC 2024 paper about heart sound

Exploring Pre-trained General-purpose Audio Representations for Heart Murmur Detection
https://arxiv.org/abs/2404.17107

Thanks, Tam! I added the paper link in the repo.


broken docs page / tilemap block

Here is a broken docs page (2/28/20):
https://arcade.makecode.com/courses/csintro2/arrays/tilemap
My kids were trying to add another level in class today. However, the array of all tiles was missing even after adding the library ‘Color Code Tilemap’
This was the script we were trying to add from last year

@michaelbraunrentonschools - Is this still not working after the fix from #1811? That was put in on 4/1.

Fixed!


Default output folder for docfx changed to _site

Looks like the .NET mapper assumes that the default output folder will be _api_, but it recently go changed to _site. The .NET mapper should probably explicitly specify the output folder when running docfx to make sure it can find the output metadata.

This can be moved to a mapper-specific configuration option, though we should also specify the path with the docfx option -o or --output.

It appears the -o option only prepends to the output path, it never overrides. Forcing -o _api creates an output path -o _api/_api. If there is a dest setting of 'docs/apiin thedocfx.jsonfile, forcing-o _apicreates an output path of_api/docs/api`. So, seems we can't use this to set a path quite yet.
Not sure if this is a docfx-dev vs docfx mainline issue, but I get the output path of _api. Addressing this in a PR, if the path does change to _site we can update again.


Starter Fails To Start

Steps To Replicate: (Replicated Twice)

gatsby new gog https://github.com/muhajirframe/gatsby-starter-firebase
cd gog
yarn develop

error UNHANDLED REJECTION

  Error: Cannot find module 'core-js/features/array/find'

  - loader.js:668 Function.Module._resolveFilename
    internal/modules/cjs/loader.js:668:15

  - loader.js:591 Function.Module._load
    internal/modules/cjs/loader.js:591:27

  - loader.js:723 Module.require
    internal/modules/cjs/loader.js:723:19

  - helpers.js:14 require
    internal/modules/cjs/helpers.js:14:16

  - render-page.js:3 webpackUniversalModuleDefinition
    /gog/public/render-page.js:3:54

  - render-page.js:10 Object.<anonymous>
    /gog/public/render-page.js:10:3

  - loader.js:816 Module._compile
    internal/modules/cjs/loader.js:816:30

  - loader.js:827 Object.Module._extensions..js
    internal/modules/cjs/loader.js:827:10

  - loader.js:685 Module.load
    internal/modules/cjs/loader.js:685:32

  - loader.js:620 Function.Module._load
    internal/modules/cjs/loader.js:620:12

  - loader.js:723 Module.require
    internal/modules/cjs/loader.js:723:19

  - helpers.js:14 require
    internal/modules/cjs/helpers.js:14:16

  - worker.js:32 Promise
    [gog]/[gatsby]/dist/utils/worker.js:32:35

  - debuggability.js:313 Promise._execute
    [gog]/[bluebird]/js/release/debuggability.js:313:9

  - promise.js:483 Promise._resolveFromExecutor
    [gog]/[bluebird]/js/release/promise.js:483:18

  - promise.js:79 new Promise
    [gog]/[bluebird]/js/release/promise.js:79:10

Home:gog Skillz$ node -v
v11.14.0
Home:gog Skillz$ gatsby -v
2.4.13

Hi @Skillz4Killz,
Thanks for submitting the issue. Will take a look

@muhajirdev Hey, Thank you!
I spent a few days debugging this as best as possible. I was able to narrow it down to 2 lines that are causing this. Commenting these lines actually stops all the errors from happening.
I filed some issues on their respective repos but still no response on them yet.
https://github.com/firebase/firebase-js-sdk/issues/1713
https://github.com/firebase/firebaseui-web-react/issues/63
In the layout/index.js
const app = import('firebase/app')

In the containers/SignIn.js
import { StyledFirebaseAuth } from 'react-firebaseui'

Still no fix for this? I see the linked issue is closed on the firebaseui page.

@josephkandi I got it working simply by downgrading the firebase to 5.8.6. I am not sure if there has been a fix since then in firebase or gatsby.

I changed firebase to 5.8.6 but i get a different error regarding core-js, ` ERROR
UNHANDLED REJECTION Cannot find module 'core-js/features/array/find'`
Then i did yarn add core-js as per and now i get a completely different error, `NHANDLED REJECTION Cannot find module 'core-js/modules/es6.array.filter'
Error: Cannot find module 'core-js/modules/es6.array.filter'`.
When you follow the instructions on the README.md of this repo, does it work by just cloning and running gatsby develop?

Finally got it working, it important though that the version needs to be 5.9.0 not ^5.9.0. I have ^5.9.0 and kept failing.

@josephkandi i did the same and it started working here. Thanks a lot!


CaffeineCache doesn't track entry and cache size correctly when unit factor is used

Describe the bug
CaffeineCache calculates the "weight" of individual entries at insertion time, using weigh function:
    private int weigh(Object oKey, Object oValue)
        {
        int cUnits = m_unitCalculator.calculateUnits(oKey, oValue);
        if (cUnits < 0)
            {
            throw new IllegalStateException(String.format(
                    "Negative unit (%s) for %s=%s", cUnits, oKey, oValue));
            }
        return (cUnits / m_nUnitFactor);
        }

This is problematic, because the method above returns 0 if a unit factor is larger than the number of units for a give entry, which is often the case when unit factor is used (typical values for unit factor are 2^10 and 2^20, in order to track and limit cache size in KBs or MBs). Even if the factor is smaller than the entry size, the loss of precision due to integer arithmetic at the single entry level is significant.
To Reproduce

Configure unit factor that is larger than the average entry size
Configure BINARY unit calculator
Add some entries to the cache
Observe that the getUnits method returns zero, even though there are entries in the cache

Expected behavior
getUnits methods should return the actual number of bytes consumed by all entries, divided by the unit factor.
In other words, unit factor should only be applied during final calculation for the backing map as a whole, not at the individual entry level.
Environment (please complete the following information):

Coherence CE 22.06.1
Java 11
OS: any
OS Version: n/a

Change has been merged


[WR] removes type validations from election and localities

Pivotal Card
Removes type checking for Elections and Localities.

Easy. LGTM.


Storage and retention limits for messages hosted in OME portal

What is the storage limit for messages hosted in OME portal and served to users through the browser?
Is there a retention period after which messages hosted in OME portal are not available anymore?

Szczegóły dokumentu
⚠ Nie edytuj tej sekcji. Jest ona wymagana dla docs.microsoft.com ➟ Dołączanie problemu w usłudze GitHub.

ID: d4c75d7b-eec1-720b-bc4d-91d3dfe72889
Version Independent ID: 0382d4b5-3fe2-f353-ce73-5d437d80b7bf
Content: Office 365 Message Encryption FAQ - Microsoft 365 Compliance
Content Source: microsoft-365/compliance/ome-faq.md
Service: o365-seccomp
GitHub Login: @KCCross
Microsoft Alias: krowley

Hello @Larryngolog,
there is no limits for storage, as for retention periods - could be configured only for external recipients, more details here
You can use New-OMEConfiguration/Set-OMEConfiguration commands to set it using PowerShell
Thank you

Hello @MaratMussabekov thanks for answer.  Regarding the retention period this setting is for AME which requires E5. What about customers who only have E3 and only use OME?

Hello @Larryngolog,
for OME there is no retention limit.  Messages are not stored on the portal, they are stored in recipient's mailbox, portal only allows to decrypt the message.
Thank you

Correct me if I'm wrong, but since the OME portal is decrypting and displaying the message it need to have access to the message. And since recipient is an external person it cannot use their mailbox as a store for the message. My customers have experienced expiration of the messages in OME portal after about 2 months, but I have not seen it documented anywhere.

Not sure this is correct.
As far as I know, it uses Azure RMS for encryption, and it uses portal only for decrypting (portal authorizes the recipient), as it described here and here
Thank you

Ok, but for the users not using Outlook.com or Office 365 and Outlook app the portal not only authorizes them with the one time password but it also renders the mail on site https://outlook.office365.com/Encryption. It has to get the contents from somewhere and it's definitelly not recipients mailbox as it's completely out of Office 365 reach.

Yes, I am not sure I am correct, as I have access only to publicly-accessible documentation (which doesn't contain any info about retention). However, a lot of people in the Internet talking about 60 days limit.
Dear @KCCross, could you please assist? Clarification about OME retention limits is required.
Thank you

Forwarding to Samson - I believe the retention limit changed. Getting final #s.

There is no retention limit for E3 or E5 customers.  the mail content are stored inside the sending organization's mailbox.
The E5 feature allows to set access expiration through the OME portal.  The mail is still resides in the organization after expiration.

Hello,
as there are not retention limits, I believe no change is required for the article and the issue could be closed.
Dear @Larryngolog , what do you think?
Thank you

@MaratMussabekov Thank you very much for the contribution and sharing this explanation. @Larryngolog Hope this comment is helpful for you. If you see a documentation update is required, please feel free to open an issue for the same. We proceed here to close it. Thanks for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.


Why is there no noise decomposition in the text2video model?

In the videofusion paper, there is two-step denoising process for every iteration. However, I don't see that in the text2video code here. What's the situation?

https://huggingface.co/docs/diffusers/main/en/api/pipelines/text_to_video
https://modelscope.cn/models/damo/text-to-video-synthesis/summary
Both links to the videofusion paper, but the code has nothing to do with it, just a 3dunet it seems

I have the same question, can anyone explain?

I think so. This model is a temporal extension of the latent diffusion model and has nothing to do with their paper videofusion. Can some developers @zzclynn  help to explain?

Any update on this issue?

I think so. This model is a temporal extension of the latent diffusion model and has nothing to do with their paper videofusion. Can some developers @zzclynn help to explain?

VideoFusion is another work from our team, which is weakly related to this model. This model is called ModelScope Text-to-Video (ModelScopT2V). Please see the 19th page of the following PDF for the implementation detail.
Thank you!
ModelScopeT2V_slides.pdf

Could you please explain what you mean by weakly related to VideoFusion?
If it is not VideoFusion, maybe it is better to add a comment to huggingface and modelscope websites that it is a different architecture?

Could you please explain what you mean by weakly related to VideoFusion?
If it is not VideoFusion, maybe it is better to add a comment to huggingface and modelscope websites that it is a different architecture?

It is not VideoFusion. It is a different architecture. Thank you for your suggestion.

Thanks :)
Are there any plans to release the pre trained VideoFusion model?

Thanks :) Are there any plans to release the pre trained VideoFusion model?

The pre-trained model of ModelScope Text-to-Video (ModelScopeT2V) has been released. And there is no plan to release the pre-trained model of VideoFusion till now.

I think so. This model is a temporal extension of the latent diffusion model and has nothing to do with their paper videofusion. Can some developers @zzclynn help to explain?

VideoFusion is another work from our team, which is weakly related to this model. This model is called ModelScope Text-to-Video (ModelScopeT2V). Please see the 19th page of the following PDF for the implementation detail.
Thank you!
ModelScopeT2V_slides.pdf

Thank you! @WangJiuniu , are there more resources for the implementation details? would like to get a better understanding of the model.

I think a good way is to read the code. Please pay more attention to 'TemporalTransformer' and 'TemporalConvBlock_v2', which is designed by my team.
https://github.com/modelscope/modelscope/blob/master/modelscope/models/multi_modal/video_synthesis/unet_sd.py


Footer of contact page has not been styled

What is the bug*
A clear and concise description of what the bug is.
The footer of contact page has not been styled and is missing other information
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

Allow me to work on this issue under hacktoberfest

Hi! I can work upon this.

sir I am a Front end developer . You give me a chance I will make it very attractive web pages.

@pandeatul27, @tanvigarg264, @heysaiyad  Thank you for your interest
But this issue is already present and has been assigned to someone else.
Plz look for other issues or create new issues
Star the repo 🌟 to showcase your love.


Analyzer changes

This is a refactoring commit to the analyzer code that hopefully makes it easier to understand what the analyzer is doing.
Analyzer::analyze() now instantiates an Analyzer, and all of the data structures containing items have been moved to being members of thatAnalyzer struct, rather than some being on the struct and accessed through self and others being bare variables in the function scope.
The definitions HashMap is moved to being a field on the Analyzer struct, rather than using a closure defined in function scope.
analyze_set is moved to being an associated function so it works the same way as the other analyze_* functions.

Can it be refactored so that the main function takes self? I'd prefer that a little over having a local variable Analyzer in scope named analyzer.

I think this is possible, but that would require going back to the pattern where there's a (public) Analyzer::analyze associated function, that does nothing except creating an instance of Analyzer and then calling an analyzer.justfile(...) method on it. And that would involve having one associated function and one method on Analyzer with basically the same (and rather lengthy) parameter list. So in this case I think it's worthwhile to instantiate a local Analyzer within Analyzer::analyze and avoid the repetition.

I think I prefer having a function and a method, so that we can use self. I don't really mind the parameter duplication, and it's nice to get the syntax highlighting on the self and have it be a method.

Is this ready to look at again? GitHub notifies on pushes, but I don't know if a push means "ready to review".

Is this ready to look at again? GitHub notifies on pushes, but I don't know if a push means "ready to review".

Ah yeah, it is, I think I've addressed everything.

Overall I feel like these changes are kind of a wash. I like moving define into a method, and from_table is certainly better than from_setting_iter, but it's unclear to me that the rest of the changes are that beneficial for clarity, when there are downsides like needing a recipe_names variable to avoid borrowing self, and the declaration of an additional assignments variable.

Overall I feel like these changes are kind of a wash. I like moving define into a method, and from_table is certainly better than from_setting_iter, but it's unclear to me that the rest of the changes are that beneficial for clarity, when there are downsides like needing a recipe_names variable to avoid borrowing self, and the declaration of an additional assignments variable.

Feel free to keep whatever code you think is worth merging out of this PR and get rid of the rest. The main thing that was bugging me was that the initial iteration over the AST items was modifying some variables in local scope and some variables on self with no particular rhyme or reason to them.

Merged! I did a little fiddling and got rid of one of the temporaries.


[SQL] Don't add inferred redundant isnotnull condition from constraints

What changes were proposed in this pull request?
In Optimizer, we will infer additional conditions from Filter's constraints which include IsNotNull. Some inferred IsNotNulls are useful because they can be short circuit for other predicates which refer the same attributes. But for an IsNotNull condition, we also infer other IsNotNull from it. Those IsNotNulls are redundant. We don't need to include them.
E.g., for a condition like IsNotNull(a + Rand()), an additional IsNotNull(a) will be added into Filter's condition. So we need to evaluate IsNotNull(a + Rand()) && IsNotNull(a). Actually we don't need IsNotNull(a) because it is guaranteed by the original IsNotNull(a + Rand()).
How was this patch tested?
Jenkins tests.
Please review https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark before opening a pull request.

This is not a serious issue. And it doesn't affect correctness. I would left this to @cloud-fan or @hvanhovell decide if we want to fix it or not.

Test build #67613 has started for PR 15653 at commit 86443c4.

Test build #67613 has finished for PR 15653 at commit 86443c4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67613/
Test PASSed.

Close it for now since no interest from committers.


[Feature Request] An event handler when the user clicks on a date in DateRangePicker

Is your feature request related to a problem? Please describe.
In DateRangePicker, I wanted to make it possible to select only up to 2 weeks before and after when a user clicks a date inside Calendar UI.
Describe the solution you'd like
When an event handler, say onDateSelected, is called when a user clicks a date inside Calendar, I can dynamically change maxValue and minValue props of DateRangePicker.
Describe alternatives you've considered

Without adding a new handler, add a new possible option for maxValue as number. A positive number can be given to these props only when isMaxValueRelative prop is true. For example, if 30 is set to maxValue, DateRangePicker only permits date from the selected date to "30 days after the selected date". Same for minValue.
(current alternative) Show error message when user selects more than 2 weeks of period.

Screenshots or Videos
No response

@spilist  I think you can use Date-range-picker component for this purpose. You can use useState hook to  set values as per user interaction. I believe it should solve your feature need


add "work" to usable types

"work" is needed. Needs to be added to underlying suggest-service too

Issues on this repository are not observed, so we suggest to contact the developers directly or<EMAIL_ADDRESS>if their contribution is relevant to the issue.


Translations update from Hosted Weblate

Translations update from Hosted Weblate for Fritter/Fritter.
Current translation status:

@jonjomckay I've seen on an emulator, that translations for tab names are gone (on home screen and in settings too):

@Aga-C this should be fixed now in my latest commit. Thanks as always for picking this stuff up when I miss it!

@jonjomckay Can you unlock translating on Weblate?

@Aga-C I've just unlocked it again. I'm not sure why it keeps getting locked...


InMemory Deployer Issue at server startup

Description:
When deploying all the artifacts at the server startup, if there is an issue in a single API deployment, it will skip the rest of other API deployments to gateway as well. So invoking other APIs also fails. Needs to do a redeployment manually.

cannot reproduce in the latest version.


CMAKE_INSTALL_ paths assumed to be relative

Please see: https://github.com/jtojnar/cmake-snips#assuming-cmake_install_dir-is-relative-path
For context: https://github.com/ROCm-Developer-Tools/hipamd/issues/55
Here is an example:
https://github.com/RadeonOpenCompute/rocm-cmake/blob/027404a8326da6e7e9338e0b81f9428660190724/share/rocm/cmake/ROCMInstallTargets.cmake#L87-L96
This assumes that CMAKE_INSTALL_<DIR> is relative, which is definitely not always the case.

The PREFIX option is not used anymore, so the problem is further down. I should talk with @lawruble13 about this, since I don't fully understand the purpose of ROCMInstallTargets vs. the built-in CMake export and install. With the /opt/rocm file reorganization completed, I wonder if we might be able to simplify our build code for this functionality.

I'm looking at my schedule for the next month and I'm not sure when I'm going to get a chance to really dig into this, so I'm marking this as help wanted. The problem is simple enough, but it's not immediately obvious to me how to fix this without breaking existing code.

@Madouura, has this issue been fixed?  Please close the ticket if the issue has been fixed.  Thanks.

@Madouura Closing ticket since there is no response.  Please re-open if you still encounter this issue. Thanks!


[chore] ambient modules and imports

A stepping stone for #2223 and a groundwork for #2249

We can bikeshed ambient-imports.d.ts and ambient-modules.d.ts, but maybe we'll just have it in one file for this PR now to prevent the scrambled diffing on ambient-modules.

Reminder for the next PR to also resolve #625

Updated the comments. For the polka issue we'll just have to ignore them for now, casting the types would make sense if we're actually writing TS, but ignoring them makes more sense here, plus we've also put our reasons for every ignore and expect errors so it's clearer than casting (which we should try to avoid if possible).

Thanks, and yes! Other than having to disable eslint duplicate imports, it seems to be working fine now.


zenbleed "chicken bit" mitigation errata; "modprobe msr"

Referencing @taviso post about ZenBleed at https://lock.cmpxchg8b.com/zenbleed.html :
First, thanks for an excellent explanation. I was able to reproduce the problem on an "AMD EPYC 7402P 24-Core" system.
Second, the "chicken bit" mitigation worked on this system under Ubuntu 22.04 LTS, but required these extra steps
apt install msr-tools
modprobe msr
wrmsr -a 0xc0011029 $(($(rdmsr -c 0xc0011029) | (1<<9)))

Without the modprobe you get a weird error message from the shell when wrmsr tries to
interpret the rdmsr: open: No such file or directory error described in the rdmsr(1)
man page.

Also, if you want to toggle this mitigation, you can do
wrmsr -a 0xc0011029 $(($(rdmsr -c 0xc0011029) ^ (1<<9)))
(replace the | with a ^ in the provided command).

Without the modprobe you get a weird error message from the shell

Hmm thanks, I'll clarify the documentation. I thought module autoload would take care it.

Hi, Is bit 9 of DE_CFG register available only since microcode patch ?

You only need to use it if you cant apply the patch. If you have the update, then you don't need to be concerned.

I have searched among Zen PPR(s) and previous Gen datasheets and found no specification of such bit. Thks

This is normal, they are not usually documented until needed.

Strangely, the performance of the vzeroupper instruction itself seems to be little affected by this chicken bit.
If it is free to disclosure, could you please explain what does MSRC001_1029[9] actually does? Thanks.

Sorry, only AMD can answer that question - you know as much as we do!

Sorry, only AMD can answer that question - you know as much as we do!

I believe Manufacturer answer is MSR_AMD64_DE_CFG_ZEN2_FP_BACKUP_FIX_BIT which seems to be per CPU for an overall effect. But not clear if per logical (SMT) or per physical Core

Hey! I am closing this issue, feel free to re-open if there is anything actionable. Thanks!


Long calico-node recovery time after kube-apiserver was gone

Suppose we have master nodeA and nodeB, each running kubelet, kube-apiserver and calico-node

calico-node pod on nodeA connects to kube-apiserver through local ipvs service <IP_ADDRESS>:443.  The real server for this ipvs connection is nodeB
kubelet connects to apiserver through vip managed by keepalived

Then we make nodeB offline, by powering it off, ip link set xx down, etc.
nodeB becomes NotReady, pods originally on nodeB got migrated to nodeA.  calico cni set up link routes like <IP_ADDRESS> dev cali856adefd1c5 scope link.  Initially proxy_arp of these pods did work.
But then calico-node still thought it was connected to <IP_ADDRESS>:443, and ipvs has no health check against the kube-apiserver on nodeB.  calico-node thought these link routes were stale and after 10s of grace period, they were removed.  Only when calico-node initiates new connection to apiserver will those link routes reinstated and communication recover.  Before that happens, pods may encounter arp resolution error manifesting as no route to host
It seems at the moment we depend on net.ipv4.tcp_retries2, or net.ipv4.tcp_keepalive_xx settings to detect such event.  The default value for tcp_retries2 is 15, which amounts to about 15m.  It's too long in ha settings.
Expected Behavior
calico-node connection to kube-apiserver can recover faster, preferably in less than 10s (the grace period)
Current Behavior
Initially, newly migrated pods did have working network.  After 10s of grace period, link routes on the host sides will be removed by calico-node because it receives no notification from apiserver and as such thought they were stale.
Possible Solution
According to https://github.com/kubernetes/client-go/issues/374 , client-go may eventually have connection health check option available.  At the moment a feature to make such thing available has been upstreamed to golang project and will be available in go1.15...
In the meantime, it seems kubelet alone already does such thing and will close all conns should health check fail.  https://github.com/kubernetes/kubernetes/pull/63492
It would be preferable calico can have such check sooner than later.
Steps to Reproduce (for bugs)

On nodeA

remove all realservers of <IP_ADDRESS>:443, except the one with nodeB's IP
docker rm -f calico-node-id, make sure calico-node connects (indirectly) to nodeB

Plug out nodeB
Schedule new pods to run on nodeA

Context
n/a
Your Environment
calico docker image tag 3.12.1
k8s 1.15.9-beta.0
centos 7.6
Logs
tcpdump of calixx interface of calico-node-kubecontroller migrated to nodeA.  Notice that the initially pod network knows gateway mac address.  Only it cannot do tcp connect and ucast/bcast arp requests fail without response.
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on cali6c5eb979b9c, link-type EN10MB (Ethernet), capture size 262144 bytes
18:37:23.000048 ee:ee:ee:ee:ee:ee > 33:33:00:00:00:02, ethertype IPv6 (0x86dd), length 70: fe80::ecee:eeff:feee:eeee > ff02::2: ICMP6, router solicitation, length 16
18:37:23.704023 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41346 > <IP_ADDRESS>.443: Flags [S], seq 400780869, win 28000, options [mss 1400,sackOK,TS val 84555984 ecr 0,nop,wscale 7], length 0
18:37:25.708034 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41346 > <IP_ADDRESS>.443: Flags [S], seq 400780869, win 28000, options [mss 1400,sackOK,TS val 84557988 ecr 0,nop,wscale 7], length 0
18:37:27.008043 ee:ee:ee:ee:ee:ee > 33:33:00:00:00:02, ethertype IPv6 (0x86dd), length 70: fe80::ecee:eeff:feee:eeee > ff02::2: ICMP6, router solicitation, length 16
18:37:29.720006 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41346 > <IP_ADDRESS>.443: Flags [S], seq 400780869, win 28000, options [mss 1400,sackOK,TS val 84562000 ecr 0,nop,wscale 7], length 0
18:37:33.768175 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41488 > <IP_ADDRESS>.443: Flags [S], seq 462050336, win 28000, options [mss 1400,sackOK,TS val 84566048 ecr 0,nop,wscale 7], length 0
18:37:34.770023 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41488 > <IP_ADDRESS>.443: Flags [S], seq 462050336, win 28000, options [mss 1400,sackOK,TS val 84567050 ecr 0,nop,wscale 7], length 0
18:37:36.776085 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41488 > <IP_ADDRESS>.443: Flags [S], seq 462050336, win 28000, options [mss 1400,sackOK,TS val 84569056 ecr 0,nop,wscale 7], length 0
18:37:40.784140 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.41488 > <IP_ADDRESS>.443: Flags [S], seq 462050336, win 28000, options [mss 1400,sackOK,TS val 84573064 ecr 0,nop,wscale 7], length 0
18:37:45.800020 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:37:46.802000 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:37:47.804003 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:37:58.391148 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:37:59.392042 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:00.394007 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:01.396096 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:02.398006 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:03.400001 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:28.383756 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:29.384064 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:30.386023 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:31.388053 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:32.389998 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:38:33.393003 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:39:14.412818 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:39:15.413989 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:39:16.416015 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:39:17.418107 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:39:18.419997 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:39:19.422005 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:40:42.467435 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:40:43.467991 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:40:44.470007 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:40:45.472064 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:40:46.474003 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:40:47.476004 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:43:29.392333 5e:a6:a9:29:99:9d > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has <IP_ADDRESS> tell <IP_ADDRESS>, length 28
18:43:29.392355 ee:ee:ee:ee:ee:ee > 5e:a6:a9:29:99:9d, ethertype ARP (0x0806), length 42: Reply <IP_ADDRESS> is-at ee:ee:ee:ee:ee:ee, length 28
18:43:29.392359 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.45134 > <IP_ADDRESS>.443: Flags [S], seq<PHONE_NUMBER>, win 28000, options [mss 1400,sackOK,TS val 84921672 ecr 0,nop,wscale 7], length 0
18:43:29.392431 ee:ee:ee:ee:ee:ee > 5e:a6:a9:29:99:9d, ethertype IPv4 (0x0800), length 74: <IP_ADDRESS>.443 > <IP_ADDRESS>.45134: Flags [S.], seq 40071671, ack<PHONE_NUMBER>, win 27760, options [mss 1400,sackOK,TS val 84921672 ecr 84921672,nop,wscale 7], length 0
18:43:29.392452 5e:a6:a9:29:99:9d > ee:ee:ee:ee:ee:ee, ethertype IPv4 (0x0800), length 66: <IP_ADDRESS>.45134 > <IP_ADDRESS>.443: Flags [.], ack 1, win 219, options [nop,nop,TS val 84921672 ecr 84921672], length 0

calico-node logs
2020-07-09 03:58:50.212 [INFO][51] watchercache.go 206: Failed to perform list of current data during resync ListRoot="/calico/resources/v3/projectcalico.org/ippools" error=Get https://<IP_ADDRESS>:443/apis/crd.projectcalico.org/v1/ippools: dial tcp <IP_ADDRESS>:443: connect: connection refused
2020-07-09 03:58:50.220 [INFO][51] watchercache.go 206: Failed to perform list of current data during resync ListRoot="/calico/resources/v3/projectcalico.org/nodes" error=Get https://<IP_ADDRESS>:443/api/v1/nodes: dial tcp <IP_ADDRESS>:443: connect: no route to host

2020-07-08 10:37:17.765 [INFO][50] int_dataplane.go 627: Linux interface addrs changed. addrs=set.mapSet{"fe80::ecee:eeff:feee:eeee":set.empty{}} ifaceName="cali6c5eb979b9c"
2020-07-08 10:37:17.766 [INFO][50] int_dataplane.go 594: Linux interface state changed. ifaceName="cali6c5eb979b9c" state="up"
2020-07-08 10:37:17.766 [INFO][50] int_dataplane.go 858: Received interface addresses update msg=&intdataplane.ifaceAddrsUpdate{Name:"cali6c5eb979b9c", Addrs:set.mapSet{"fe80::ecee:eeff:feee:eeee":set.empty{}}}
2020-07-08 10:37:17.766 [INFO][50] hostip_mgr.go 84: Interface addrs changed. update=&intdataplane.ifaceAddrsUpdate{Name:"cali6c5eb979b9c", Addrs:set.mapSet{"fe80::ecee:eeff:feee:eeee":set.empty{}}}
2020-07-08 10:37:17.766 [INFO][50] int_dataplane.go 840: Received interface update msg=&intdataplane.ifaceUpdate{Name:"cali6c5eb979b9c", State:"up"}
...

2020-07-08 10:37:17.866 [INFO][50] route_table.go 556: Syncing routes: found unexpected route; ignoring due to grace period. dest=<IP_ADDRESS>/32 ifaceName="cali6c5eb979b9c" ipVersion=0x4
2020-07-08 10:37:17.866 [INFO][50] route_table.go 364: Interface in cleanup grace period, will retry after. ifaceName="cali6c5eb979b9c" ipVersion=0x4
...

2020-07-08 10:37:35.177 [INFO][50] route_table.go 561: Syncing routes: removing old route. dest=<IP_ADDRESS>/32 ifaceName="cali6c5eb979b9c" ipVersion=0x4 routeProblems=[]string{"unexpected route"}
2020-07-08 10:37:35.177 [INFO][50] route_table.go 561: Syncing routes: removing old route. dest=<IP_ADDRESS>/32 ifaceName="calid1b89274120" ipVersion=0x4 routeProblems=[]string{"unexpected route"}
2020-07-08 10:37:35.178 [INFO][50] route_table.go 561: Syncing routes: removing old route. dest=<IP_ADDRESS>/32 ifaceName="cali3a4b0e67050" ipVersion=0x4 routeProblems=[]string{"unexpected route"}
2020-07-08 10:37:35.178 [INFO][50] route_table.go 561: Syncing routes: removing old route. dest=<IP_ADDRESS>/32 ifaceName="cali6e8f4a3f2f2" ipVersion=0x4 routeProblems=[]string{"unexpected route"}
2020-07-08 10:37:35.179 [INFO][50] route_table.go 561: Syncing routes: removing old route. dest=<IP_ADDRESS>/32 ifaceName="cali67b64bf27d9" ipVersion=0x4 routeProblems=[]string{"unexpected route"}
2020-07-08 10:37:35.179 [INFO][50] conntrack.go 78: Removing conntrack flows ip=<IP_ADDRESS>
2020-07-08 10:37:35.180 [INFO][50] conntrack.go 78: Removing conntrack flows ip=<IP_ADDRESS>
2020-07-08 10:37:35.180 [INFO][50] conntrack.go 78: Removing conntrack flows ip=<IP_ADDRESS>
2020-07-08 10:37:35.185 [INFO][50] conntrack.go 78: Removing conntrack flows ip=<IP_ADDRESS>
2020-07-08 10:37:35.185 [INFO][50] conntrack.go 78: Removing conntrack flows ip=<IP_ADDRESS>
...

Looks like this PR was merged and will hopefully be in Kubernetes v1.20: https://github.com/kubernetes/kubernetes/pull/95981
Once released, we just need to update our client-go and apimachinery to the patched version and we should automatically get the new timeouts to fix this.


API Key not found

Suddenly I keep receiving the following error. It was working before, but suddenly has stopped, even though I have changed nothing. I wonder if the key is not being being sent across probably.  The problem happens on two different sites (on different servers).
{detail: "Your request did not include an API key."
instance: ""
status: 401
title: "API Key Missing"
type: "http://kb.mailchimp.com/api/error-docs/401-api-key-missing"}

We're getting the same issue

Let me know if the issue still persists after that merge.

Thanks guys for the quick fix, all updated :smile:


Update samsara.md

updated a link

@jonburchel

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

#sign-off

[like]  Jon Burchel reacted to your message:

From: Jak Koke @.>
Sent: Wednesday, May 8, 2024 9:48:22 PM
To: MicrosoftDocs/powerquery-docs @.>
Cc: Jon Burchel @.>; Mention @.>
Subject: Re: [MicrosoftDocs/powerquery-docs] Update samsara.md (PR #539)
@jonburchelhttps://github.com/jonburchel

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-teamhttps://github.com/orgs/MicrosoftDocs/teams/public-repo-pr-review-team
—
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/powerquery-docs/pull/539#issuecomment-2101536740, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABIGFM34IEUSWF5VWHBQZBDZBKMSNAVCNFSM6AAAAABHNUEAN2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBRGUZTMNZUGA.
You are receiving this because you were mentioned.Message ID: @.***>


Problem Simple Data Fetch

I am trying this code in my controller;
'use strict'

const Application = use('App/Model/Application')

class AppController {

  *all (request, response) {
    const applications = yield Application.all();
    response.json(applications.toJSON());
  }

}

module.exports = AppController

There are a lot of record which I have recorded it with Lucid and I can see them in MySQL command line. But the result is empty when I run the code. There is no error, there is no explanation. Just []
mysql> SELECT * FROM applications;
+----+---------+------------------+---------------------+---------------------+---------------------+
| id | user_id | title            | created_at          | updated_at          | deleted_at          |
+----+---------+------------------+---------------------+---------------------+---------------------+
|  1 |       1 | My app. | 2016-02-11 15:14:01 | 2016-02-11 15:14:01 | 2016-02-11 15:14:01 |
|  2 |       1 | My application. | 2016-02-11 15:14:03 | 2016-02-11 15:14:03 | 2016-02-11 15:14:03 |
|  3 |       1 | Ok               | 2016-02-11 15:14:32 | 2016-02-11 15:14:32 | 2016-02-11 15:14:32 |
|  4 |       1 | Ok               | 2016-02-11 15:14:34 | 2016-02-11 15:14:34 | 2016-02-11 15:14:34 |
|  5 |       1 | Ok               | 2016-02-11 15:15:39 | 2016-02-11 15:15:39 | 2016-02-11 15:15:39 |
+----+---------+------------------+---------------------+---------------------+---------------------+

Can you turn debug mode on and check the query that has been generated. In order to set debug mode, add debug: true to your connection config. Example-
mysql: {
 client: 'mysql',
 debug: true
}

There is no error, when I fetch records. Just it is empty. But I have found something interesting. When I create a new record, deleted_at field is not empty. Here is my code;
const application = new Application()
application.user_id = 1;
application.title = "My Application"
yield application.create()

deleted_at field is filled by automatically. When I use application.deleted_at = null, there is nothing change. deleted_at field still has got datetime value.

Sorry, It is my fault. deleted_at field was setted as timestamp.

I believe u were setting something by default on deleted_at

I found a little bit error.
After I call the migration:make, default table structure like this;
'use strict'

const Schema = use('Schema')

class NewSchema extends Schema {

  up () {
    this.create('<table>', function (table) {
      table.increments('id')
      table.timestamps()
      table.timestamp('deleted_at')
    })
  }

  down () {
    this.drop('<table>')
  }

}

module.exports = NewSchema

Look at the deleted_at field, please. That was the my problem.

deleted_at is for softDeletes and if you do not want soft deletes, you can turn them off.
class Application {

  static get softDeletes () {
    return false
  }

}


fclones: 0.26.0 -> 0.27.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/fclones/versions.
meta.description for fclones is: "Efficient Duplicate File Finder and Remover"
meta.homepage for fclones is: "https://github.com/pkolaczk/fclones"
meta.changelog for fclones is: ""
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.27.0 with grep in /nix/store/znhhspndlj1z40xad8j9s164f5x9zjx4-fclones-0.27.0
found 0.27.0 in filename of file in /nix/store/znhhspndlj1z40xad8j9s164f5x9zjx4-fclones-0.27.0

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
fclones

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/znhhspndlj1z40xad8j9s164f5x9zjx4-fclones-0.27.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A fclones https://github.com/r-ryantm/nixpkgs/archive/e8fb2021e92ad8764dcbe57e8842366a4b71abde.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/znhhspndlj1z40xad8j9s164f5x9zjx4-fclones-0.27.0
ls -la /nix/store/znhhspndlj1z40xad8j9s164f5x9zjx4-fclones-0.27.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

fclones

Maintainer pings
cc @cyounkins @msfjarvis for testing.

@ofborg build fclones fclones.passthru.tests


add additional parameters to config file

add the two filter options as parameters to the config file

@helgeerbe do you rather want these PRs to target dev?

Yes please. Dev is our staging branch.

@helgeerbe done.

I also moved the building of filters for the where clause to the model, so everything sits together.
@helgeerbe
I was able to test this today, so I consider this ready for merge.


Broken link

The link https://owncloud.org/blog/owncloud-7-beta-is-out-help-us-test-it is broken despite it being linked to from https://owncloud.com/de/owncloud-7-community-edition-enhances-extends-simplifies-control-sensitive-data-2-2/

fixed.


Make clustering calculations parallel

#190 made performance a lot better. BUT it's still quite slow..
There is no escape from making the clustering calculation parallel.

This makes clustering pretty fast! But it seems that there is still room for improvement. I think it would be helpful to add cores to the server..


Nav2 bringup Can not find odom to bae_link transform and Rviz can not receive the map being published

Please provide the following information:

OS: Ubuntu 22.04
ROS 2 Distro:  Humble
Built from source or installed: Installed
Package version: Package: ros-humble-clearpath-common                                Status: install ok installed                                Priority: optional                                Section: misc                                Installed-Size: 41                                Maintainer: Luis Camero<EMAIL_ADDRESS>                              Architecture: amd64                                Version: 0.1.2-1jammy.20231002.212915                                Depends: ros-humble-clearpath-control, ros-humble-clearpath-description, ros-humble-clearpath-generator-common, ros-humble-clearpath-platform, ros-humble-ros-workspace                                Description: Clearpath Common Metapackage
Real hardware or simulation: Simulation

Expected behaviour
The husky should be able to carry out navigation tasks upon request.
Actual behaviour
After following the required steps presented in the docs, Rviz seems to have trouble reading the robot model and reading the map despite it being displayed as shown in the image below.

The terminal on the top left is gazebo's output. Bottom left is rviz and the bottom right is the localisation package. Appropriate setup_paths and namespaces were used.
To Reproduce
Follow steps laid out in the Navigation Demos:Localization docs
Other notes
A side note with regards to the map, I had noticed after careful inspection of the topics being published that the map topic is /a200_0000/map, however, rviz does not allow a / as the first character of the fixed frame under global options.

Have you started the simulation in Gazebo? i.e. pressing the play button at the bottom left corner in the Gazebo window.

Oh I had not taken that into account my apologies. It does work now. However I am trying to publish poses to the nav stack using the simple commander Nav 2 API but it is still waiting for "amcl/get_state_service" despite the nav bring up running. Do you perhaps know why this is the case?

I just observed the services that are running and state service that is available has the robot's namespace infront of it. I believe that is the reason the basic navigator cannot find it. Do you perhaps know how to point the basic navigator to the correct service

I figured it out! I will close this ticket now. Thanks for the help

I figured it out! I will close this ticket now. Thanks for the help

People would be gratefull for the comments on what was the issue. Mistakes can be repeated 😓


CI fails on FeTS Challenge TaskRunner Test

Test fails due to conflicts while installing packages of different versions
The conflict is caused by:
The user requested torch==1.11.0
timm 0.4.12 depends on torch>=1.4
torchaudio 0.8.2 depends on torch==1.8.2

Fixed by #517


implementation issue for AutoPrompt

I was curious about the result of "AutoPrompt" in the table; it showed that AP and GCG are comparable. In GCG paper, AP and GCG shows a meaningful difference, compared to the numbers in HarmBench paper. I suspect this is because of the implementation detail: in GCG paper, it says that:The method is, in fact, similar to the AutoPrompt [Shin et al., 2020] approach, but with the (we find, practically quite important) difference that we search over all possible tokens to replace at each step, rather than just a single one.
So I looked into the implementation, and found out that the only difference between two is their sampling method (sample_control_autoprompt vs sample_control). But found that the former function produces similar output compared to the latter one, which does not look to be intentional.
Could you check the detail? Thanks!

    # current impl
    new_token_pos = torch.randint(0, len(control_toks), (search_width,), device=grad.device)

    # suggestion
    new_token_pos = torch.randint(0, len(control_toks), (1,), device=grad.device)
    new_token_pos = new_token_pos.repeat(search_width)

I feel this is the right implementation for sample_control_autoprompt?

Hello,
We are looking into this now and will update the repository and paper as soon as we confirm that the numbers with the new implementation match the GCG paper on AdvBench. (We confirmed this for our GCG implementation in preliminary experiments.)

okay, found that the code is updated! https://github.com/centerforaisafety/HarmBench/commit/e2923c3defbbe123e0b13375a6e15d8aee4f9228 let me know when the results are confirmed :)

The results are comparable to those in the GCG paper. We double-checked the fix with the AutoPrompt paper and with Andy Zou (our co-author), and it seems correct.


Too many transitive dependencies from checksum-maven-plugin

MicroRaft claims to be a single lightweight JAR with a few hundred KBs of size and only logging dependency.
However microraft artifact inherits a dependency to checksum-maven-plugin from microraft-root, which brings a lot of other transitive dependencies into compile scope.
https://github.com/MicroRaft/MicroRaft/blob/3cec69df3da4bc0a66c15d9742ae4c2d747a0a31/pom.xml#L152-L156
For instance, consider an application with a single dependency:
<dependency>
    		<groupId>io.microraft</groupId>
    		<artifactId>microraft</artifactId>
    		<version>0.7</version>
</dependency>

The dependency hierarchy includes a lot of stuff.

So if these are compile scope, they should not be in the target jar right? So what is the issue here?


refactor: move prisma to a package

Prisma related code is now moved from apps/api/ folder to packages/prisma folder, so that the prisma client can be shared among different servers.

To use the package in a server app, run pnpm add @codepod/prisma, and use like this:
import prisma from "@codepod/prisma";

prisma.repo.findFirst(...)

If you need to perform prisma migration

Attach the api container shell
run pnpm dlx prisma migrate dev --schema ../../packages/prisma/prisma/schema.prisma

run pnpm dlx prisma migrate dev --schema ../../packages/prisma/prisma/schema.prisma

I would do this instead (looks simpler):
cd ../../packages/prisma
pnpm dlx prisma migrate dev


Some role problems

on join:
  member with id "%{_output::Discord_ID::1}%" doesn't have discord role with id "id":
  member with id "%{_output::Discord_ID::1}%" has discord role with id "id":
  add role with id "id" to role of (member with id "%{_output::Discord_ID::1}%")
  remove role with id "id" from role of (member with id "%{_output::Discord_ID::1}%")

All syntax giving "Can't understand this condition:"

There may have been people who had problems like me, the solution is as follows:
add role with id "id" to roles of member with id "%{_output::Discord_ID::1}%" of guild with id "id"
member with id "%{_output::Discord_ID::1}%" in guild with id "id" has discord role with id "id"


db:migrate command error

Hi,
when I run the command
bin/rake db:migrate RAILS_ENV=development
I receive the following error:
** Running via Spring preloader in process 22
rake aborted!
StandardError: An error has occurred, this and all later migrations canceled:
Directly inheriting from ActiveRecord::Migration is not supported. Please specify the Rails release the migration was written for:
class CreateUsers < ActiveRecord::Migration[4.2]
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:528:in inherited' /opt/genieacs-gui/db/migrate/20160202145722_create_users.rb:1:in <top (required)>'
/usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:287:in require' /usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:287:in block in require'
/usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:253:in load_dependency' /usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:287:in require'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:986:in load_migration' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:982:in migration'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:977:in disable_ddl_transaction' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1350:in use_transaction?'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1342:in ddl_transaction' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1291:in execute_migration_in_transaction'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1263:in block in migrate_without_lock' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1262:in each'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1262:in migrate_without_lock' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1212:in migrate'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1036:in up' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/migration.rb:1011:in migrate'
/usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/tasks/database_tasks.rb:172:in migrate' /usr/local/bundle/gems/activerecord-5.2.1/lib/active_record/railties/databases.rake:60:in block (2 levels) in <top (required)>'
/usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:281:in load' /usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:281:in block in load'
/usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:253:in load_dependency' /usr/local/bundle/gems/activesupport-5.2.1/lib/active_support/dependencies.rb:281:in load'
-e:1:in `' **
I understand the error is because of the versions of project dependencies.
Is there any solution?
Thanks

You have to modify the files in /opt/genieacs-gui/db/migrate/
In all of the files in that folder you need to change:
class CreateUserRoles < ActiveRecord::Migration
to
class CreateUserRoles < ActiveRecord::Migration[4.2]
Once you have done that try doing the migrate command again and it should work

Hello,
I have a similar problem. Now modify the files in the route they indicate. But I run the command
bin / rails db: migrate RAILS_ENV = development
and it gives me the following error::
SyntaxError: /opt/genieacs-gui/db/migrate/20160202145722_create_users.rb:1: syntax error, unexpected [, expecting ';' or '\n'
class CreateUsers <ActiveRecord :: Migration [ 5.2 ] ............................
Could you help me.
This is what is installed:
Red Hat 7.6
ruby -v
ruby 2.3.1p112
nodejs --version
v8.11.4
rails --version
Rails 5.2.1
mongo --version
v3.4.19
redis-server --version
Redis server v=5.0.3

Changing all occurrences of "ActiveRecord::Migration" to "ActiveRecord::Migration[5.2]", then bin/rails "db:migrate RAILS_ENV=development", really makes the job


support for hex literals

Is your feature request related to a problem? Please describe.
Not only but especially in the embedded context, it is common to write integer literals as hex values. This is particularly true for hardware manuals that define register addresses and commands in order to interact with the device. Today, writing hex literals is not supported in Blech. Thus, the user has to "translate" every value, e.g. from a microcontroller manual, into decimal values. This is a error-prone task and makes it difficult to cross-check source code and hardware documentation.
Describe the solution you'd like
I would like to be able to write something like var cmd: uint8 = 0xC3 or var data: [3]uint8 = {0xA4, 0x05, 0xF7} in Blech.

Hex literals now possible. Feature branch is integrated into master.


[C-228] Organizations: remove "# of activities" filter from "new & active" tab

From SyncLinear.com | C-228

@joanreyero shouldnt GitHub issues close automatically? This one is "done" but on GitHub it's still open

They should… You were the one that connected the GitHub integration. Did you get any notifications?


Rate exceeded

This happens during cfncluster
Beginning cluster creation for cluster: 14554
Creating stack named: cfncluster-14554
Status: cfncluster-14554 - CREATE_IN_PROGRESS
Status: cfncluster-14554 - CREATE_IN_PROGRESS
Status: MasterEIP - CREATE_IN_PROGRESS
Status: RootRole - CREATE_COMPLETE
Status: RootInstanceProfile - CREATE_IN_PROGRESS
Status: MasterEIP - CREATE_COMPLETE
Status: SQSPolicy - CREATE_COMPLETE
Status: SQSPolicy - CREATE_COMPLETE
Status: DynamoDBTable - CREATE_COMPLETE
Status: AssociateEIP - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE
Status: CfnClusterPolicies - CREATE_COMPLETE                                    Rate exceeded
And the cfncluster create command exits out. The cluster still creates successfully, but is there a way to suppress this?

This looks like API throttling limit from AWS cloudformation service for your account. How often do you see this issue?
Suggestion: Please file Cloudformation Describe* API limit increase via Support service.

One more improvement that I can think off is to have backoff retries in our clients when there is throttling exception.

Do you know which limit this is hitting?

This is the response from aws I got
"We can increase your limit to a degree, but note that above 10, you might not always be able to achieve the full number of concurrent control plane operations, depending on which combination of operations you are doing at once. CreateTable requests with several Secondary Indexes, especially when each index has a "Projection" with many "NonKeyAttributes". If your systems are going to need to rely on a certain number of concurrent control plane operations (for example, if you are creating time series tables on a schedule), then be sure to test to ensure that your particular combination of table creates and deletes for your particular table configurations work as you expect.


Vector3i usability improvements

Rename org.terasology.math.Vector3i into org.terasology.math.Vector3iUtil and make all its methods static. This leaves all Vector3i code to use only the TeraMath Vector3i and eliminate the casting problems when using results from methods.
The main problem with the current org.terasology.math.Vector3i is that after creating one and you call a method like .add(..) and it returns you a org.terasology.math.geom.Vector3i which no longer is useable if the surrounding code is expecting the original type.
In addition to Vector3iUtil only containing static methods, the old Vector3i.toVector3f() method had to be replaced as well. The toVector3f() functionality is found in Vector3fUtil.
I have a large number of the modules in my working copy as well and will make appropriate PRs on those repos as well in the next day or so.

Great stuff! I think that several methods are still missing in the TeraMath version of Vector3i. There's an open PR that aims to add them:
https://github.com/MovingBlocks/TeraMath/pull/26
How did you tackle the problem of missing methods? Maybe we should merge that PR first, so we can benefit from the additional methods (min, max, div, one, zero, east, west, north, south ... ).
I can help with the modules - maybe we can coordinate that real quick on Slack/IRC?

I encountered similar issues and directly used the TeraMath implementation for my latest PRs. We need to make sure to adapt all methods taking a Vector3i as argument as well (e.g., encompasses() of Region3i, ...).
I'd like to follow (and participate) in the upcoming discussion on Slack/IRC ;)

Looks like the PR from TeraMath should indeed solve some of these Vector3i shortcomings.  Looks like you have even dealt with the .toVector3f().  Sweet.
I'll see if I can get TeraMath on my workstation today so it can continue.
I think the modules will be pretty straightforward.  The refactoring tools in intellij have taken care of most of it already.  I just have to do some git work to get branches created and pushed.

Missing methods I dealt with by turning all the methods static and adding a first parameter that is used instead of "this" keyword.

I'll let you all worry about this one, I don't even dare open the files changed page lest my tab-heavy browser is sure to crash :D
I can check it out and see what modules crash sometime since I have so many locally. Let me know if I should do that sometime or if you all are on top of it :-)

Will reopen with new TeraMath release.


Network isolation support

New features

Support for identity-based file upload
Support for identity-based routing endpoints
Support for private-endpoint-connection and private-link-resource functionality

Note: Still need to finish help files for new commands (private endpoints) and add examples where new parameters were added (routing-endpoint create)


Update to SPFx 1.17.3

What's in this Pull Request?
Update to SPFx 1.17.3

Thank you @MarkusLanger for the PR!


Fix Drawer onRequestClose prop warning

Simple fix for onRequestClose prop warning.

[ ] PR has tests / docs demo, and is linted.
[ ] Commit and PR titles begin with [ComponentName], and are in imperative form: "[Component] Fix leaky abstraction".
[ ] Description explains the issue / use-case resolved, and auto-closes the related issue(s) (http://tr.im/vFqem).

I don't think that we can merge this PR. onRequestClose as well as other properties are useful when the component isn't docked. To make the component change structure obvious to users when docked is true, I think that we should make them not providing extra useless properties.
The documentation probably need to be fixed.


Revising maintainers team

What would you like to see added in this software?
I want to ask @eilidhmacnicol and @esavary to become MAINTAINERS - is that okay with you?
Also, @effigies, do you want to remain a MAINTAINER now that other people are taking in maintenance? (egoistically, I would prefer to keep you as you always have an additive view of things, e.g., https://github.com/nipreps/mriqc/issues/1062#issuecomment-1444865373)
Do you have any interest in helping implement the feature?
Yes
Additional information / screenshots
No response

I'm fine staying a maintainer in that people in distress can call on me. I can't commit to additional time for mriqc.

Sounds great! Thanks!
On Mon, Feb 27, 2023, 18:23 Chris Markiewicz @.***>
wrote:

I'm fine staying a maintainer in that people in distress can call on me. I
can't commit to additional time for mriqc.
—
Reply to this email directly, view it on GitHub
https://github.com/nipreps/mriqc/issues/1065#issuecomment-1446737409,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAESDRSVVBPKFXAKWKLMIKLWZTPJZANCNFSM6AAAAAAVJHQ4FU
.
You are receiving this because you authored the thread.Message ID:
@.***>

@eilidhmacnicol and @esavary - Would you like to become maintainers of MRIQC?
@eilidhmacnicol - if you can't commit resources directly, would you like to be an "Advisory Member" to assist with generalizations of MRIQC over non-human species?
I've been thinking through this, and maybe @ZviBaratz would like to become a maintainer too, WDYT?

Hi! I would be happy to become a maintainer.

@oesteban I'd be happy to help if I can. My availability is somewhat unstable at the moment, but I can definitely try to make time when possible. Perhaps we can schedule a meeting some time to catch up on the current state of things and prioritize goals or sketch a rough roadmap?


Fast loading for cross lingual tasks

This PR implements the changes discussed here https://github.com/embeddings-benchmark/mteb/issues/530
I only implemented the fast loading for Tatoeba for testing purpose, I'll do another PR to convert others datasets
I created a different dataset on HF for testing purpose (will swap to mteb later), but note that this is fully backward compatible, people with old versions of the MTEB package will be able to load fast datasets as it just add a 'lang' column
I checked that the results between the slow and fast version are the same. Data loading goes from ~10min from network to ~30s on Tatoeba which "only" has ~100 subsets

This test is failing because of the mocking I don't exactly understand why
https://github.com/embeddings-benchmark/mteb/blob/28e55225dd2fd4d68f6598fae5f3be43cac7e30b/tests/test_all_abstasks.py#L19

This looks very good @loicmagne:
A main considerations:

I think we should just use this as the new default (no reason to support two methods)

We can make a script to transfer the datasets and re-upload them
There are a few STS tasks that use cross-lingual (we might consider those as well)

I've added documentation for fast loading, and I've made it a mixin instead a specific implementation of CrosslingualTasks. This way we can directly use it with MultilingualTask, as some of these tasks might also benefit it

This looks very good @loicmagne:
A main considerations:
* I think we should just use this as the new default (no reason to support two methods)

  * We can make a script to transfer the datasets and re-upload them
  * There are a few STS tasks that use cross-lingual (we might consider those as well)

Yes I think it would be fair to use this as the default. I'm not really sure how to automate the conversion with a script though, since it also requires changing the config files ? Currently I did it manually depending on the format of each dataset but maybe there's a simpler way
For now I would let "fast loading" as a toggled option until everything is converted

I moved the updated Tatoeba dataset to the MTEB org on HF, I think we can merge now @KennethEnevoldsen if everything's ok
I'll do the PR to update other datasets

@KennethEnevoldsen can we merge this ?

@loicmagne I think we def. can. I will set it to auto-merge