manta SV   bcftools view Error : subset called for sample that does not exist in header

Hi Brad,
I receive this error message at the end of manta SV analysis. all Tumor sample run clean, and this one is a paired normal to multiple tumor samples. Do you have any Idea on what is triggering this?
Thanks!
[2017-05-25T13:23Z] gpu-2-13.local: Run manta SV analysis
[2017-05-25T13:23Z] gpu-2-13.local: Error: subset called for sample that does not exist in header: "FFPEPOOLEDNORMAL_F". Use "--force-samples" to ignore this error.
[2017-05-25T13:23Z] gpu-2-13.local: Uncaught exception occurred
Traceback (most recent call last):
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 22, in run
_do_run(cmd, checks, log_stdout, env=env)
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 102, in _do_run
raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; bcftools view -s FFPEPOOLEDNORMAL_F -O z -o /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/bcbiotx/tmpYnTlaI/somaticSV-FFPEPOOLEDNORMAL_F.vcf.gz /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/AY-testly-023-T/manta/results/variants/somaticSV.vcf.gz
Error: subset called for sample that does not exist in header: "FFPEPOOLEDNORMAL_F". Use "--force-samples" to ignore this error.
' returned non-zero exit status 255
[2017-05-25T13:23Z] gpu-2-13.local: Unexpected error
Traceback (most recent call last):
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/distributed/ipythontasks.py", line 50, in _setup_logging
yield config
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/distributed/ipythontasks.py", line 386, in detect_sv
return ipython.zip_args(apply(structural.detect_sv, *args))
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/init.py", line 191, in detect_sv
for svdata in caller_fn(items):
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/manta.py", line 30, in run
sample_file = _select_sample(data, variant_file, work_dir)
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/manta.py", line 72, in _select_sample
do.run(cmd.format(**locals()), "Run manta SV analysis")
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 22, in run
_do_run(cmd, checks, log_stdout, env=env)
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 102, in _do_run
raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; bcftools view -s FFPEPOOLEDNORMAL_F -O z -o /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/bcbiotx/tmpYnTlaI/somaticSV-FFPEPOOLEDNORMAL_F.vcf.gz /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/AY-testly-023-T/manta/results/variants/somaticSV.vcf.gz
Error: subset called for sample that does not exist in header: "FFPEPOOLEDNORMAL_F". Use "--force-samples" to ignore this error.
' returned non-zero exit status 255

Sorry about the manta issues and thanks for the detailed report. What version of bcbio are you seeing this error with? There were some issues fixed for complicated tumor/normal batching cases in the 1.0.3 release which I hoped addressed these issues. Is it possible you're running with an older version? Hope this helps explain it.

I was  on 1.0.4 and I have repudiate and still got the same error. ( all the tumor normal pair works, but the issue is on normal shared between multiples tumors samples).
Thanks for your support!
bcbio_nextgen.py --version
1.0.4a0

On May 25, 2017, at 20:50, Brad Chapman<EMAIL_ADDRESS>wrote:
Sorry about the manta issues and thanks for the detailed report. What version of bcbio are you seeing this error with? There were some issues fixed for complicated tumor/normal batching cases in the 1.0.3 release which I hoped addressed these issues. Is it possible you're running with an older version? Hope this helps explain it.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/chapmanb/bcbio-nextgen/issues/1954#issuecomment-304162101, or mute the thread https://github.com/notifications/unsubscribe-auth/AGOdNst4ill4Z61bRXm5asRxqb4CePVAks5r9iHDgaJpZM4NnB5z.

Sorry that you're still having issues with the development version. Would you be able to share your sample YAML file (privately via e-mail is fine)? This would help identify the setup and see if I can reproduce the problem with a set of smaller test files. Thanks much for helping debug.

Sure! thanks you so much for your help!

On May 25, 2017, at 21:44, Brad Chapman<EMAIL_ADDRESS>wrote:
Sorry that you're still having issues with the development version. Would you be able to share your sample YAML file (privately via e-mail is fine)? This would help identify the setup and see if I can reproduce the problem with a set of smaller test files. Thanks much for helping debug.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/chapmanb/bcbio-nextgen/issues/1954#issuecomment-304168955, or mute the thread https://github.com/notifications/unsubscribe-auth/AGOdNldwhHJFNuzekRYg21R6Jq_j3ymNks5r9i56gaJpZM4NnB5z.

I have removed manta, and I get get this error message even if the FFPEPOOLEDNORMAL_F-prioritize.tsv was generated
[2017-05-26T01:39Z] gpu-1-15.local: Uncaught exception occurred
Traceback (most recent call last):
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 22, in run
_do_run(cmd, checks, log_stdout, env=env)
File "/cbio/ski/abdelwao/home/pastore/nobackup/bcbio/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 102, in _do_run
raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; { echo 'caller	sample	chrom	start	end	svtype	lof	annotation	split_read_support	paired_support_PE	paired_support_PR'; cat /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/Project_4998/work/structural/FFPEPOOLEDNORMAL_F/prioritize/FFPEPOOLEDNORMAL_F-lumpy-prioritize.tsv | sort -V -k3,3 -k4,4n; } > /cbio/ski/abdelwao/nobackup/pastore/install/bcbio-vm/data/project/christian/YA/bcbiotx/tmpfSp5FY/FFPEPOOLEDNORMAL_F-prioritize.tsv
sort: cannot create temporary file in `/scratch/8585137.hal-sched1.local': No such file or directory
cat: write error: Broken pipe
' returned non-zero exit status 2
FFPEPOOLEDNORMAL_F$ ls
May 23 11:47 cnvkit
May 25 21:05 ..
May 25 21:39 prioritize
May 25 21:50 .
May 25 21:50 validate

On May 25, 2017, at 21:47, Alessandro Pastore<EMAIL_ADDRESS>wrote:
Sure! thanks you so much for your help!
<Project_4988.yaml.zip>

On May 25, 2017, at 21:44, Brad Chapman<EMAIL_ADDRESS><EMAIL_ADDRESS>wrote:
Sorry that you're still having issues with the development version. Would you be able to share your sample YAML file (privately via e-mail is fine)? This would help identify the setup and see if I can reproduce the problem with a set of smaller test files. Thanks much for helping debug.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/chapmanb/bcbio-nextgen/issues/1954#issuecomment-304168955, or mute the thread https://github.com/notifications/unsubscribe-auth/AGOdNldwhHJFNuzekRYg21R6Jq_j3ymNks5r9i56gaJpZM4NnB5z.

For the temporary directory error you're seeing, it appears as if $TMPDIR is set to a non-existant directory on your work machine.  sort uses that by default, which appears to trigger the issue. I pushed a fix to the latest development version to explicitly set the sort temporary directory to the current bcbio temporary directory, which I hope will resolve the issue.

Thanks !
I am submit a job from the head node that at some point invoke bcbio run with ipyhton from this. The $TMPDIR that bcbio was trying to write was the TMPDIR of my initial job and not the one for the bcbio job itself.
I do not know if this is due to some internal configuration of our cluster, but I see this also with other nested job script.
Thanks!
Sent from my iPhone

On May 26, 2017, at 9:21 AM, Brad Chapman<EMAIL_ADDRESS>wrote:
For the temporary directory error you're seeing, it appears as if $TMPDIR is set to a non-existant directory on your work machine. sort uses that by default, which appears to trigger the issue. I pushed a fix to the latest development version to explicitly set the sort temporary directory to the current bcbio temporary directory, which I hope will resolve the issue.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Thanks, looks like this is from a pretty old version of bcbio which might not have this issue anymore since we haven't seen any reports of it recently. Closing. Thanks!


Broken canvas image only in production

Please make sure you are testing with the latest release of html2canvas.
Old versions are not supported and issues reported for them will be closed.
Please follow the general troubleshooting steps first:

[x] You are using the latest version
[x] You are testing using the non-minified version of html2canvas and checked any potential issues reported in the console

Bug reports:
This bug can be reproduced only in production and only when page fully loaded. You can see it in this model example.
Main issue should be in the last loaded library or resource.
html2canvas version 1.0.0-rc.5 provide same result as #1868
html2canvas version 1.0.0-rc.7 fixed the throwing error bug, but provide new issue with strange almost blank image - video example
html2canvas version 1.0.0-alpha.12 also work without throwing error bug, but provide similar to 1.0.0-rc.7 issue with image - video example
Specifications:

html2canvas version tested with: 1.0.0-rc.7, 1.0.0-rc.5, 1.0.0-alpha.12
Browser & version: latest Chrome and Firefox. (in Safari works well)
Operating system: macOS, Ubuntu. (on Windows works well)

This is an example from staging and production - https://share.getcloudapp.com/o0umyeny
We had to hide export button in production because of this issue.
To test it now I have used this simple script:
var script = document.createElement("script");
script.type = "text/javascript";
script.src = "https://html2canvas.hertzen.com/dist/html2canvas.min.js";
document.head.appendChild(script);

script.onload = function() {
    var chart = document.querySelector('[class*="chartActions"] + [class*="verticalAlign"]')
    html2canvas(chart).then(canvas => {
        document.body.appendChild(canvas);
        canvas.setAttribute("style", "position: absolute; top: 20px; left: 20px;")
    });
}

It was Profitwell script tag like here - https://github.com/niklasvh/html2canvas/issues/1593#issuecomment-423390951
Maybe someone faced with similar problem?
What was the solution?

I have this problem too, profitwell.js broke html2canvas :(

I have this problem too, profitwell.js broke html2canvas :(

Profitwell overwrite this method - getComputedStyle, so it not count pseudoEltOptional optional parameter which html2canvas use to get styles of pseudo elements, like ::before and ::after, and start to draw extra elements for each HTML element, even if there was no pseudo elements.
Solution in my case was saving link to original getComputedStyle method before profitwell.js was loaded and overwrite it each time back, before running html2canvas methods.

I return his version back after all, so it should work well.

I return his version back after all, so it should work well.

Ok, I understand. Thanks.

If your code or another library overwrites browser methods like getComputedStyle, the bug is in that code/library


Adding zappy pools and strategies

-Adding zappy pools and strategies
-Fixing decimals for WBTC from 18 to 8
-Added zappy interface to address book
-Updated address book to 0.5.0
-Added APY calculation for zappy

Comments resolved ,merging


SSH permission denied

I am having issues getting this up and running on two computers on the same LAN.
Error on client is
uni-unicloud_client-1  | SSH Connection KO, exit code 255, output<EMAIL_ADDRESS>Permission denied (publickey,password,keyboard-interactive).
I have checked that the server has the pubkey listed and it is there. Not sure what else can be the problem

Hi,
If pubkey is already on server authorized keys means client registration completed successfully.
Did you activate the client from the UI?
Do you have SERVER_DEBUG=True on server?
In that case you should see on server /data/log/sshd.log which should give you some info.
If you can share docker-compose files I can have a look.
This can also happen if data folder is not clean (for example you changed role from server to client without cleaning data folder).

Yes, client activated via server GUI
Last lines of sshd.log:
Authentication refused: bad ownership or modes for directory /data Failed publickey for unison from <IP_ADDRESS> port 41660 ssh2: RSA SHA256:hfMvC9U6t2pU8Zz4Z+jP7/ZBw1u+Hl6bIB+J7QbeaS0 Failed none for unison from <IP_ADDRESS> port 41660 ssh2 Failed password for unison from <IP_ADDRESS> port 41660 ssh2 Failed password for unison from <IP_ADDRESS> port 41660 ssh2 Connection closed by authenticating user unison <IP_ADDRESS> port 41660 [preauth] Connection from <IP_ADDRESS> port 47476 on <IP_ADDRESS> port 22 rdomain "" Authentication refused: bad ownership or modes for directory /data Failed publickey for unison from <IP_ADDRESS> port 47476 ssh2: RSA SHA256:hfMvC9U6t2pU8Zz4Z+jP7/ZBw1u+Hl6bIB+J7QbeaS0 Failed none for unison from <IP_ADDRESS> port 47476 ssh2 Failed password for unison from <IP_ADDRESS> port 47476 ssh2 Failed password for unison from <IP_ADDRESS> port 47476 ssh2 Connection closed by authenticating user unison <IP_ADDRESS> port 47476 [preauth] Connection from <IP_ADDRESS> port 40028 on <IP_ADDRESS> port 22 rdomain ""
`version: "3.3"
services:
SERVER
test_unicloud_server:
image: agarbato1/unison-unicloud
ports:
- 2222:22
- 5002:80
environment:
- USER=unison
- USER_UID=1000
- SERVER_HOSTNAME=unicloud_testing_server
- SERVER_UI_USERNAME=admin
- SERVER_UI_PASSWORD=abcd12345
- SERVER_DEBUG=True
- ROLE=SERVER
volumes:
- type: bind
source: /mnt/user/dockerdata/uni
target: /data
- type: bind
source: /mnt/user/
target: /shares
networks:
unison:
driver: bridge
ipam:
driver: default`
`version: '3.3'
services:
CLIENT
unicloud_client:
image: agarbato1/unison-unicloud
environment:
- CLIENT_HOSTNAME=testing-client1
- ROLE=CLIENT
- USER=unison
- USER_UID=1000
- SERVER_HOSTNAME=<IP_ADDRESS>
- SERVER_PORT=2222
- SERVER_SHARE=TV
- SHARE_IGNORE=.git*|.idea|.unison|.DS_Store
- API_PROTOCOL=http
- API_PORT=5002
- SYNC_INTERVAL=120
restart: on-failure
volumes:
- type: bind
source: /export/Dockerdata/uniclient
target: /data
- type: bind
source: /export/
target: /share
networks:
unison:
networks:
unison:
driver: bridge
ipam:
driver: default
`
Thank you very much for your prompt answer. This project is super slick.

Thank you for sharing compose files.
It seems there's an issue with /data folder permission on server side.
When that happens ssh refuses to accept keys.
Is USER_UID=1000 a valid user on your server?
You can check with id command.
Also make sure /mnt/user/dockerdata/uni permission is not 777
Normally on startup we  check and fix /data permission, you can check on docker-compose logs on server side.
/mnt/user/dockerdata/uni should be owned by user id 1000 on you system.
You can fix manually but it shouldn't be necessary.
My guess is you server uid is not 1000.
chmod go-w /mnt/user/dockerdata/uni
chmod 700 /mnt/user/dockerdata/uni/.ssh
chmod 600 /mnt/user/dockerdata/uni/.ssh/unicloud_authorized_keys

After doing some more digging on my end, this is most definitely a permissions issue due to my host setup for the server. Please close this and I thank you very much for trying to help sort me out.

You're very welcome.


[Bug]: Oauth logo added

Fixes #1

@SrijanShovit I would love to help in the development of the homepage and other pages if it already hasn't been started yet...


solving lsm303dlhc issue using lsm303agr

What does this implement/fix?
This basically use the lsm303agr package instead of lsm303dlhc which run the example of LED compass.

r? @jamesmunns
(rust-highfive has picked a reviewer for you, use r? to override)

Thank you for this proposal. The main problem against it would be that this would break compatibility with older board revisions which do have an LSM303DLHC.

Thank you for this proposal. The main problem against it would be that this would break compatibility with older board revisions which do have an LSM303DLHC.

Thank you for this proposal. The main problem against it would be that this would break compatibility with older board revisions which do have an LSM303DLHC.

can we provide this particular solution for lsm303agr using a link in the doc? This can really help people to get the solution for compass.

That would definitely help people until we have a more comprehensive solution.

That would definitely help people until we have a more comprehensive solution.

Thanks, i will provide my repo link for this particular solution in the doc so that we can help people carry on with lsm303agr


chore: upgrade queue to v0.7 version

Signed-off-by: Bo-Yi Wu<EMAIL_ADDRESS>

Codecov Report

Merging #2 (eaeba3d) into main (5813065) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main       #2   +/-   ##
=======================================
  Coverage   80.68%   80.68%
=======================================
  Files           1        1
  Lines          88       88
=======================================
  Hits           71       71
  Misses         11       11
  Partials        6        6

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5813065...eaeba3d. Read the comment docs.


chore: Analytics file lock stale time

@AnaghHegde - is oktotest not required?

Merging this based on confirmation from channel.


Guids on intersection entity

I have a schema much like your movie tutorial code base i.e. Movies, Genres and MovieGenres (intersection entity).  The only exception is that my primary keys are uniqueidentifiers and are auto generated with newsequentialid() rather than identity specifications.
With that as background then, in exactly the same way I want to be able select multiple genres on the movie form.  After I select my genres and save the form, the platforms throws a SQL error and tells me that the intersection entity's primary key can't be NULL.  Why is serenity trying to save the intersection entity with a NULL value for it's primary key?
How do I get around this?

Do you have Insertable(false) on your Guid primary key?

That fixed it, thanks.


Travis integration for unit tests

/cc @aveshagarwal. This is for travis ci integration. I can include a code coverage badge as well from coversall.io. Let me know what you think about it?

So, after changing to kube-incubator, the travis-ci is failing.
https://travis-ci.org/ravisantoshgudimetla/rescheduler/builds/275203057?utm_source=github_status&utm_medium=notification

@ravisantoshgudimetla could you check if its failing or not?

@aveshagarwal Done. You may need to give Travis CI, access to repository. This is how I did for my fork of this repo.
https://github.com/mbonaci/mbo-storm/wiki/Integrate-Travis-CI-with-your-GitHub-repo


Fixes the time command response.

This should fix #2001 - issue with the TIME command returning a date in 1970.  Also adds an example to show it working:
node-redis $ cd examples
examples $ node get-server-time.js
2022-02-25T12:55:41.000Z { microseconds: 130723 }

Codecov Report

Merging #2008 (89ddb8b) into master (ac7d50c) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master    #2008   +/-   ##
=======================================
  Coverage   94.94%   94.94%
=======================================
  Files         358      358
  Lines        3343     3343
  Branches      409      409
=======================================
  Hits         3174     3174
  Misses         85       85
  Partials       84       84

Impacted Files
Coverage Δ

packages/client/lib/commands/TIME.ts
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ac7d50c...89ddb8b. Read the comment docs.


Which api to use(Choose)

Leaning towards Alpaca.
Pro's and Con's of Each
Alpaca (https://alpaca.markets/): Alpaca is a commission-free stock trading platform that offers a developer-friendly API for algorithmic trading. While they do have a free tier with limited functionality, you may need to upgrade to a paid plan for full trading capabilities.
TD Ameritrade (https://developer.tdameritrade.com/): TD Ameritrade provides a comprehensive API for accessing account data, placing trades, and retrieving market data. While their API is free to use, it requires an active TD Ameritrade brokerage account.
Robinhood API (unofficial): Robinhood is a commission-free brokerage platform, but they do not provide an official API for trading. However, there are unofficial third-party libraries and APIs available that allow limited access to Robinhood's trading functionality.

alpaca it is. SINCE: It is easiest AND it is most friendly to new people


[Infra - Security] MPWG SurveyMoney Data Protection Impact Assessment (DPIA)

Draft https://docs.google.com/document/d/11jRvFHLqRKjaek7e_mP_0ZugIeKqPDLL2i7vOl61XXE/edit#

linked to https://github.com/microprofile/microprofile-wg/wiki/Why,-When-and-How-to-Conduct-Surveys


rpc/chainHead: Fix pruned blocks events from forks

This PR fixes the chainHead::follow edge cases:

The Finalized event reported pruned blocks from soon-to-be-pruned forks without issuing a NewBlock first
Finalized event reported as pruned just the stale heads, not the entire fork

Issue 1
The chainHead::follow method returns the Finalized event containing both finalized hashes and pruned block hashes. The substrate database will perform the pruning of height N at the finalization N + 1.
Considering the following tree structure:
A - A1 - A2 - A3
  - A1 - B2

Initial Condition:

User subscribes after A2 is finalized, but before A3 is finalized
Spec V2 dictates that in-memory blocks must first be reported.

first event: Initialized event containing the finalized hash (A2)
multiple events: NewBlock events for children of finalized (A3)

The NewBlock event contains the hash of the block + the parent hash. Taken from the spec:

parentBlockHash is guaranteed to be equal either to the current finalized block hash, or to a block reported in an earlier newBlock event.

Issues:

When A2 is finalized, we know that the fork [A1 - B2] is stale; however pruning happens for height N - 1
When A3 is finalized, we prune B2 (height 3 prunes stale forks on height 2)
B2 is reported as pruned; however it was never reported by the initial events

Solution:

When generating the initial events for in-memory blocks keep track of stale forks
Ignore stale forks when reporting the finalized event

Issue 2
chainHead::follow method reported just the stale heads when declaring the pruned hashes.

prunedBlockHashes contains, in no particular order, a list of blocks that are not descendants of the latest finalized block. These blocks will never be finalized and can be discarded.

To fix this issue, the tree route is determined from the stale heads to the canonical chain and all blocks are reported.
Additional
Because the complexity of generating the follow events grew, the logic is moved to the chain_head_follow.rs file.
This also helps with code readability and maintenance.
Under intensive testing, it was possible for the Finalized event to be received before the NewBlock that led to flaky scenarios. To close the gap, the Finalized branch can now also generate NewBlock events.
Testing Done

follow_forks_pruned_block and follow_report_multiple_pruned_block cover the issues described above
created a loop of cargo test together with stress-ng --cpu 8 --cpu-load 100 --io 4 to filter out any flakiness

Review Notes
The entry point of the follow logic is moved to a dedicated file. While at it, have also simplified the notification stream logic:
https://github.com/paritytech/substrate/blob/33f5f102062d8e6d96830f93280ad309123417fd/client/rpc-spec-v2/src/chain_head/chain_head_follow.rs#L565-L566
The blocks to ignore as pruned are collected initially here:
https://github.com/paritytech/substrate/blob/33f5f102062d8e6d96830f93280ad309123417fd/client/rpc-spec-v2/src/chain_head/chain_head_follow.rs#L179-L180
Both issues are handled by this method:
https://github.com/paritytech/substrate/blob/33f5f102062d8e6d96830f93280ad309123417fd/client/rpc-spec-v2/src/chain_head/chain_head_follow.rs#L392-L395
Additionally, the finalized stream could also generate the NewBlock events here:
https://github.com/paritytech/substrate/blob/33f5f102062d8e6d96830f93280ad309123417fd/client/rpc-spec-v2/src/chain_head/chain_head_follow.rs#L447-L448
The other logic is moved from the chain_head to the chain_head_follow with minimal additions (mostly better error reporting).
Thanks @skunert and @davxy for the initial feedback and for raising the flakiness of the tests after the fix; plus the stale heads!
// CC: @paritytech/tools-team

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable
Logs: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2385143

Looks like some tests are not passing on this branch but are passing on master (at least "in my machine™")
(also tried with single thread)
The failures are not deterministic... sometime some of the following are passing:
    chain_head::tests::get_body
    chain_head::tests::get_header
    chain_head::tests::get_storage
    chain_head::tests::get_storage_wrong_key
    chain_head::tests::call_runtime

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: cargo-check-benches
Logs: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2452759

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: cargo-check-benches
Logs: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2453402

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable-int
Logs: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2474470

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable
Logs: https://gitlab.parity.io/parity/mirrors/substrate/-/jobs/2474463


Invoke-WebRequest/RestMethod Attached "Expect: 100-continue" on Requests

Support Question
I've been messing around with a project today and noticed that sometimes my requests fail, I couldn't quite nail it down until I installed Fiddler and saw that in the headers my script was requesting Expect: 100-continue, after a bit of digging I also noticed once I login to the web page manually it returns a 200, I just added -Headers to my script to also Expect 200, but I would like to know why this is? I never set it up to expect anything before now.
Official support
PowerShell Support Lifecycle
Community Resources
Slack Community Chat - Interactive chat with other PowerShell enthusiasts
PowerShell.org Forum - Search or post new general PowerShell usage questions

@Arefu
Could you provide some command examples that could replicate the issue?
Also, can you clarify it the the Expect: you saw i fiddler was in the request headers from your client and not in the response headers?
Finally, can you confirm you still have the problem after having disabled all antivirus, firewalls, and local proxies? Sometimes AV and security software can mess with http request payloads.

User-Agent: Mozilla/5.0 (Windows NT; Windows NT 10.0; en-NZ) WindowsPowerShell/5.1.17763.134
Content-Type: application/x-www-form-urlencoded
Host: <IP_ADDRESS>
Cookie: JSESSIONID=2b416af439772b416d60
Content-Length: 43
Expect: 100-continue

Is my header from PowerShell which is my CLIENT header, I can verify this because when I append the Expect 200 into my Headers I get
Expect: 200-ok,100-continue
User-Agent: Mozilla/5.0 (Windows NT; Windows NT 10.0; en-NZ) WindowsPowerShell/5.1.17763.134
Content-Type: application/x-www-form-urlencoded
Host: <IP_ADDRESS>
Content-Length: 43
Connection: Keep-Alive

In Fiddler, I have no extra anti-virus installed but Windows Defender. But I will disable them, and try without a Fiddler capture running it could be that.

It looks like you are experiencing this with Windows PowerShell 5.1. For Windows PowerShell 5.1 issues, suggestions, or feature requests please use the following link instead: Windows PowerShell UserVoice. This repository is for PowerShell Core 6 issues.
Can you see if you have the same trouble with 6.1.1?
https://github.com/PowerShell/PowerShell/releases/tag/v6.1.1


[FEA] Support unix_timestamp for non-DST timezones

Is your feature request related to a problem? Please describe.
Current unix_timestamp doesn't support non-UTC timezone. This issue is to track non-DST timezone support.

Also closes #9606


[No jobs found, skip] But there IS jobs, for some cookie

I used one li_at cookie and got this error for whatever URL it's trying to fetch.
eg. https://www.linkedin.com/jobs/search?keywords=mandarin&location=Canada&sortBy=DD&f_TPR=r604800&f_E=1&start=0
I can open this URL from website, lots of jobs, but when I run the scraper it gave me this [No jobs found, skip] warning.
INFO:li:scraper:('Using strategy AuthenticatedStrategy',) EXP level: 0 Start page 1.0 INFO:li:scraper:('Starting new query', "Query(query=mandarin options=QueryOptions(limit=25 locations=['Canada'] filters=QueryFilters(relevance=RelevanceFilters.RECENT time=TimeFilters.WEEK experience=[<ExperienceLevelFilters.INTERNSHIP: '1'>] start=0) optimize=False apply_link=True))") INFO:li:scraper:('Chrome debugger url', 'http://localhost:50217') INFO:li:scraper:('[mandarin][Canada]', 'Setting authentication cookie') INFO:li:scraper:('[mandarin][Canada]', 'Opening https://www.linkedin.com/jobs/search?keywords=mandarin&location=Canada&sortBy=DD&f_TPR=r604800&f_E=1&start=0') WARNING:li:scraper:('[mandarin][Canada]', 'No jobs found, skip') [ON_END]
Also, I used another linked In account to obtain a li_at cookie, it works. No this warning.

see #38

Hi, should be fixed in the latest version


Column filter modal: Checkbox status leaks across studies/assays

Describe the Bug
When selecting column visibility in the samplesheets app, checkbox status is mirrored across studies/assays, but not the actual column visibility. This smells like unintentional behaviour and is probably confusing to the unsuspecting user.
How to Reproduce

In Sample Sheets, enter a "Toggle Study/Assay Column Visibility" modal.
Change the status of some checkboxes.
Enter the "Toggle Study/Assay Column Visibility" modal of a second study/assay with a similar column layout.
Checkbox status mirrors what was set in the previously opened modal, actual column visibility is not affected.

Expected Behavior
Column filter checkbox status should not be shared across studies/assays.
Screenshots
Assay 1

Assay 2

Good catch, this needs to be fixed.

This is actually very interesting. When we hit getColumnVisibility() and I debug print out the value of this.columnApi.getColumn(header.field).visible, it is the correct value. Yet the UI still displays the wrong state. Either I've made a mistake in my event handler or the bootsrap-vue element does not refresh itself correctly? In the latter case I probably need to force refresh somehow.


Exception handling

Can you add a section to the README on how to properly handle js exceptions?
This does not work if an exception occurs in the js code. An error is thrown but this does not catch it:
                val result = try {
                    wrapper.evaluateJs(jscode)
                }
                catch (e: Exception) {
                    Logger.e { "Javascript error: $e" }
                    null
                }

throws this error:
Exception in thread "DefaultDispatcher-worker-10" java.lang.RuntimeException: Exception while trying to handle coroutine exception
	at kotlinx.coroutines.CoroutineExceptionHandlerKt.handlerException(CoroutineExceptionHandler.kt:33)
	at kotlinx.coroutines.internal.CoroutineExceptionHandlerImpl_commonKt.handleUncaughtCoroutineException(CoroutineExceptionHandlerImpl.common.kt:38)
	at kotlinx.coroutines.CoroutineExceptionHandlerKt.handleCoroutineException(CoroutineExceptionHandler.kt:28)
	at kotlinx.coroutines.StandaloneCoroutine.handleJobException(Builders.common.kt:190)
	at kotlinx.coroutines.JobSupport.finalizeFinishingState(JobSupport.kt:228)
	at kotlinx.coroutines.JobSupport.tryMakeCompletingSlowPath(JobSupport.kt:907)
	at kotlinx.coroutines.JobSupport.tryMakeCompleting(JobSupport.kt:864)
	at kotlinx.coroutines.JobSupport.makeCompletingOnce$kotlinx_coroutines_core(JobSupport.kt:829)
	at kotlinx.coroutines.AbstractCoroutine.resumeWith(AbstractCoroutine.kt:97)
	at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:46)
	at kotlinx.coroutines.internal.ScopeCoroutine.afterResume(Scopes.kt:28)
	at kotlinx.coroutines.AbstractCoroutine.resumeWith(AbstractCoroutine.kt:99)
	at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:46)
	at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:102)
	at kotlinx.coroutines.scheduling.CoroutineScheduler.runSafely(CoroutineScheduler.kt:585)
	at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.executeTask(CoroutineScheduler.kt:802)
	at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.runWorker(CoroutineScheduler.kt:706)
	at kotlinx.coroutines.scheduling.CoroutineScheduler$Worker.run(CoroutineScheduler.kt:693)
	Suppressed: java.lang.Error: Error: test
    at dictionaryapi (main.js:5)
    at <anonymous> (main.js:12)
    at search (main.js)
    at <eval> (main.js:2)

		at com.dokar.quickjs.QuickJs.getEvaluateResult(Native Method)
		at com.dokar.quickjs.QuickJs.evalAndAwait(QuickJs.jni.kt:220)
		at com.dokar.quickjs.QuickJs.evaluateInternal(QuickJs.jni.kt:210)
...

This js code works as expected when I define my own host.log function, but it would be nicer if I could catch the error in kotlin:
                    try {
                      doStuff();
                    }
                    catch (err) {
                      host.log("caught js error: ", err);
                    }

thanks for all your quick updates!

You are welcome.
And this looks weird, try-catch should work in Kotlin like this test, they are basically the same thing, but yours doesn't work.
I have no idea why Coroutines throws this error, can you provide more code or information code to reproduce it?

I see, yes the test looks the same to me. Let me see if I can reproduce in a demo app

Here's a JVM example that demonstrates the same issue (but a different stack trace). I would've thought that my try/catch would catch the thrown Error

fun main() {
    application {
        Window(onCloseRequest = ::exitApplication, title = "jsplayground") {
            App()
        }
    }
}

@Composable
fun App() {
    val scope = rememberCoroutineScope()
    var result by remember { mutableStateOf("") }

    val onRun = fun() {
        scope.launch {
            try {
                quickJs {
                    val js = """
                        throw new Error("test")
                    """.trimIndent()
                    result = evaluate<Any?>(js).toString()
                }
            }
            catch (e: Exception) {
                result = e.toString()
            }
        }
    }

    Column {
        Button(onRun) {
            Text("Click Me")
        }
        Text(result)
    }
}

For more infomation, if I change this code, the exception is thrown and caught properly:
            try {
                throw IOException("test fail from kotlin")
//                quickJs {
//                    val js = """
//                    throw new Error("test")
//                """.trimIndent()
//
//                    result = evaluate<Any?>(js).toString()
//                }
            }
            catch (e: Exception) {
                result = e.toString()
            }

The sample code looks good to me, error propagation should work properly in this case. Anyway, will try this code later to see what I can find.

Thanks!

The new version is out!

confirmed, working well for me!


As bonus it will terser and be update resistant.
The command help is somewhat trickier...
I started do develop this stuff in my fork : kidpixo/fish-docker-machine@413d90b

@kidpixo thats a good method!


Correct date above?

I swear I was just at this page yesterday, and the number of private link resources has increased dramatically, yet the date updated only shows 01/09/2020?  I'm happy there's more listed but I just wanted to make sure this date is correct.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b006a616-2f2f-8ecf-8b80-fd0a3cc62090
Version Independent ID: 92c54dc6-8ddf-b1f7-4a58-d61b8cd7fe25
Content: What is an Azure Private Endpoint?
Content Source: articles/private-link/private-endpoint-overview.md
Service: private-link
GitHub Login: @malopMSFT
Microsoft Alias: allensu

@johnwildes Thanks for your comment. The feedback has been shared with the content owner for further review. Thanks for your patience.

#please-close


Cannot build package on Windows due to lack of rm and cp commands

RxJS version: 5.0.0-beta.5
Code to reproduce:

Clone repo
run npm install

Expected behavior:
Code runs without errors
Actual behavior:
npm ERR! Failed at the<EMAIL_ADDRESS>prepublish script 'rm -rf ./typings && typings install && npm run build_all'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the @reactivex/rxjs package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     rm -rf ./typings && typings install && npm run build_all

Additional information:
Reason: I use Windows so rm -rf command is not available in cmd, I changed it to use rimraf package for rm -rf and ncp package for copying, since both rm and cp commands are not available in cmd.

I know it's painful to deal with scripts on windows machine in general (I am also windows user) and trying to improve this as much. Instead of replacing individual command into modules, planning to introduce cross platform layers for common shell command, such as shx (https://github.com/shelljs/shx / https://github.com/dthree/cash).

Meanwhile in general I recommend to try console emulators if it's ok to install it, such as cmder (http://cmder.net/) or msys2 (http://msys2.github.io/) which provides linux shell environment on windows.

Yeah, I use powershell which has aliases rm for cmdlet Remove-Item and cp for cmdlet Copy-Item. But it seems that npm during build still uses cmd.exe. So I guess the same would happen for cmder,  which I used cmder :smile:
It's not a problem - I just figured that with adding two npm modules and minor changes in package.json would allow for effortless building on Windows. It's just a suggestion.

npm during build still uses cmd.exe.
: that is correct, but not for this case. I'm using msys2, and this command affected by shell you're using.

you could build it as it is on Windows. It's just a suggestion.
: Thanks again, I'm fully aware as I'm windows user (in fact I don't use *nix machine usually :) ) and it's absolutely will be taken care of. Appreciate for suggestion.

I'm using gulp. See my suggestion #1592 with gulpfile published

Assuming your git install is in the default path, just add C:\Program Files\Git\usr\bin to your %PATH% and the issue will disappear.
The only problem I've had on windows is lack of blob support for tslint.

@xmichaelx @Igorbek latest check in enables most frequent npm scripts works with plain windows cmd prompt. Yes, it's not gulp but I believe works in most cases.

Use robocopy to create a build script:
rd /s/q .\dist
mkdir dist
robocopy *.* . .\dist /E /XF *-test.js *.conf.js *.md *.bat *.json /XD e2e* test* node_modules* dist jasmine* nbproject

===
rd /s/q .\dist && mkdir dist && robocopy *.* . .\dist /E /XF *-test.js *.conf.js *.md *.bat *.json /XD e2e* test* node_modules* dist jasmine* nbproject


Content-Length missing with POST

What did you do?
Sending http post or put request with alamofire with JSON body. OR
Sending http post with multi part form data
What did you expect to happen?
Expected to see a Content-Length header added by AF
What happened instead?
This header is missing
I can work around this in case of a JSON body as I can add the header manually when creating the request, but for multipart/form-data I don't know how to get the body length as the UploadRequest.body is always nil.
Alamofire Environment
Alamofire version: 4.7.2
Xcode version: 9.4
Swift version: 4.1
Platform(s) running Alamofire: tvOS, iOS
macOS version running Xcode: 10.13.5
Demo Project

As a wrapper for URLSession, details like this are left up to that API. In the case of POST requests, the Content-Length header should be added by the underlying session when you make the request, it's not something you or Alamofire should need to add directly. If you want a true look at what's being sent over the wire, I suggest an HTTP proxy tool like Charles Proxy to take a look at the actual requests being sent.


#1  Goal setting

As user I want to have goals for my project, so that I can create follow up tickets.
Acceptance criteria:

goal is set

Result:
General goals:

provide generals insights in the data:
-- what type of campaigns
-- what factors drive success - what are their chances of success?
-- assess whether or not Kickstarter is a good funding option for them (categories of funding),
create ML model that predicts wether or not a campaign is successful

Assumptions:

our stakeholder is Kickstarter itself
their goal is to guide users better > have more successful funding, avoid customers that will not have success

Next steps:

find out how to access the tables: python ✅ > Code snippet by @xEgle
SPIKE (HL): understand what kickstarter sees as the "success of a campaign". Suggestion: check goal - actual amount of campaign
SPIKE (FT): understand how tables work: are they daily snapshots?
SPIKE (PS): data dict to know what the table columns mean
SPIKE (EW): find out what needs transformation and how to do it > extract items from dict,  convert unix time

Unix time conversion push
readme file
which columns are useful to use (data dictionary)


Fix homepage icon schema

Summary

Links are broken and this should be separate html elements, not SVG

Please do this soon, it's sending me insane!


[Quetion] Transparent image as backround.

This is not an issue. I just want to know if its possible to have a transparent image (with alpha channel) as lock screen? This way, i can have my desktop in the background and also in the same time i can have a title in the middle of the screen that will say something like "Locked" or something like that.
If this is possible it will be nice with some dimming and maybe some blur to the background.

yes you can but your actual desktop will just shine through

So i create a png with alpha channel and is working... Now how can i blur the background aka (My Desktop) ?
Is this is possible ?

I found blur_passes But i want to blur the Background not the Text...
🤔.

that will not work, as a workaround you can toggle empty special workspace with enabled blur (on Hyprland)

So i use swaylock-effects-git  now. Its works fine for what i do. I have it lock after 15 min and show clock and the backround is behind the clock is nice.
I use a script for wallpaper and this script saves to a file the path of the current wallpaper and i have another script that pass this string to swaylock so.
The code of all this is in my GitLab repo.
So i will close this issue because for me at list i have a solution.


Importing an External Seed as RK (Not generated by Bitcoin Keeper )

Let the user enter an External Seed to create a Keeper app. Changes:

Ensure that if the app image is present, the app can retrieve it reliably (a bug that Utkarsh is facing and more)
When the App Image is not found, you create a new app with the seed provided
Give an option to the user to use 18 or 24 words if needed (during recovery)
Show the same 12/ 18/ 24 words when showing RK, depending on what was used. Currently, only 12 are shown.
TBD: use of passphrase when using an external key.

Completed @AreejKhalid21 please add link here

https://www.figma.com/design/m5eMFTKD391AiJAXaEzgxB/Bitcoin-Keeper?node-id=5-2&t=QMPy7iR6iLxKIVBI-1 - @Deveshshankar

Issue same as #4857 - Completed

Closing


[BUG] Multi-model pattern

Describe the bug
"Never" is not awaitablePylancereportGeneralTypeIssues
Could not bind method "find" because "type[Parent]" is not assignable to parameter "cls"
Type "Parent" cannot be assigned to type "Document"
"Parent" is incompatible with "Document"PylancereportGeneralTypeIssues
(method) find: Never
"Never" is not awaitablePylancereportGeneralTypeIssues
(function) to_list: Never
To Reproduce
from beanie import Document, UnionDoc

class Parent(UnionDoc):  # Union
    class Settings:
        name = "union_doc_collection"  # Collection name
        class_id = "_class_id"  # _class_id is default beanie internal field used to filter children Documents

class One(Document):
    int_field: int = 0
    shared: int = 0

    class Settings:
        name = "One" # Name used to filer union document 'One', default to class name
        union_doc = Parent

class Two(Document):
    str_field: str = "test"
    shared: int = 0

    class Settings:
        union_doc = Parent

async def example():
    db = AsyncIOMotorClient(config._DB_CONNECT, compressors='zstd', tz_aware=True).LOTR
    await init_beanie(database=db, document_models=[Parent, One, Two])  # type: ignore
    data = await Parent.find().to_list()

if __name__ == "__main__":
    asyncio.run(example())

Expected behavior
This bug is very annoying I expect it display a list of Parent but instead its unknown and full of error
Im expecting it display
data: list[Parent] = await Parent.all().to_list() # type: ignore
Additional context

Hi @CAPITAINMARVEL , thank you for the catch.
Sorry for the delay, it was a crazy end of the year for me.
May I ask, why did you close the PRs? They are not working properly?


Glitche in animation

I am using UI Router

But here is what happens.
http://www.screencast.com/t/bO5j8MiF2bl

I know that this has been closed, but I wanted to post this solution, which I've been using with some success for smooth view transitions and ngFx. Please note I haven't cross browser checked thoroughly yet. Also I think it can be optimized somewhat, especially the z-index. I hope it can help someone.
Add the 'animated-view' class to the same element that has the 'fx-' class.
Example

    // Markup for this view

Code
.animated-view {
    position: static;
    width: 100%;

    &.visible {
        position: static;
    }

    &.ng-hide-add, .ng-hide-remove {
    }

    &.ng-hide.add {
        position: absolute;
        z-index: 5;
    }

    &.ng-hide-add-active {
        position: absolute;
    }

    &.ng-hide {
        z-index: 3;
        position: absolute;
    }

    &.ng-hide-remove {
        position: static;
    }
}

this is awesome!
Scott Moss
Software Engineer
closurelog.com
P:<PHONE_NUMBER>
On Fri, Mar 13, 2015 at 4:59 PM, Chris Paynter<EMAIL_ADDRESS>wrote:

I know that this has been closed, but I wanted to post this solution,
which I've been using with some success for smooth view transitions and
ngFx. Please note I haven't cross browser checked thoroughly yet. Also I
think it can be optimized somewhat, especially the z-index. I hope it can
help someone.
Add the 'animated-view' class to the same element that has the 'fx-' class.
Example

    // Markup for this view

Code
.animated-view {
position: static;
width: 100%;
&.visible {
    position: static;
}

&.ng-hide-add, .ng-hide-remove {
}

&.ng-hide.add {
    position: absolute;
    z-index: 5;
}

&.ng-hide-add-active {
    position: absolute;
}

&.ng-hide {
    z-index: 3;
    position: absolute;
}

&.ng-hide-remove {
    position: static;
}

}
—
Reply to this email directly or view it on GitHub
https://github.com/Hendrixer/ngFx/issues/66#issuecomment-79542908.

That is what I thought that position:absolute can fix this issue.

I have the same exact problem with ngRoute, but is there an alternative to currentStep for it? I can't figure out the solution.


Files are still uploaded even if the validation failed

It appears that files are still being uploaded even when the validation process fails. Is there a way to make sure files are deleted after a failed validation?
Thank you.

Hi, what storage are you using?
When loading fails or when validation fails or request success, the delete method is called when autoDeleteFile is enable (enabled by default) , which is declared as abstract in StoredFile to delete a file from temporary storage.
Thus, the files will be deleted after a failed upload.
Also we have test for check auto delete logic.
If this is not happening in your case, could you please create a minimal repository with the problem reproduced so that I understand what exactly is going wrong.

Thank you for your quick reply.
In my case, I want to save files in a specific directory to be accessed later with their paths saved in my database. I am using FileSystemStoredFile with autoDeleteFile: false. Everything works fine, except for the cases when validation goes wrong, unneeded files are still saved.
Is there a way to improve my approach?

@0xmbadr Hi, please check out v1.9.7, there was autoDeleteFile config field separated to two fields: cleanupAfterSuccessHandle and cleanupAfterFailedHandle.
You can use the next configuration for auto delete file when error caused and save when everything is okay:
{
   cleanupAfterSuccessHandle: false,
   cleanupAfterFailedHandle: true // default is true
}

Please reopen issue when your problem wasn't resolved.


[17] - Update Changelog to follow keepachangelog guidelines

Description
Updated all CHANGELOGs to follow standard defined at https://keepachangelog.com/
Issues Resolved
https://github.com/sous-chefs/chef-appveyor-ci/issues/17
Check List

[x] All tests pass. See https://github.com/sous-chefs/apache2/blob/master/TESTING.md
[x] New functionality includes testing.
[x] New functionality has been documented in the README if applicable

Seems good to me, who needs tests :D


create script for generate summary report for caravel-timing for users.

Please create a script generate a summary for timing using openSTA scripts for users.
Report should also provide a clear pass / fail status.

@jeffdi
f-max: max_cap(violated)	max_slew(violated)	hold(met)	setup(met)	spefs(incomplete)
s-max: max_cap(violated)	max_slew(violated)	hold(met)	setup(violated)	spefs(incomplete)
t-max: max_cap(violated)	max_slew(violated)	hold(met)	setup(met)	spefs(incomplete)
f-min: max_cap(violated)	max_slew(violated)	hold(met)	setup(met)	spefs(incomplete)
s-min: max_cap(violated)	max_slew(violated)	hold(met)	setup(violated)	spefs(incomplete)
t-min: max_cap(violated)	max_slew(violated)	hold(met)	setup(met)	spefs(incomplete)
f-nom: max_cap(violated)	max_slew(violated)	hold(met)	setup(met)	spefs(incomplete)
s-nom: max_cap(violated)	max_slew(violated)	hold(met)	setup(violated)	spefs(incomplete)
t-nom: max_cap(violated)	max_slew(violated)	hold(met)	setup(met)	spefs(incomplete)
You can find results for all corners in /media/karim/Elements/work/caravel_user_project/signoff/caravel/openlane-signoff/timing/

would that be an acceptable output

Looks good.  Can you add title and some banners above and below to make the text more visible at the end?

done in PR #9


Housekeeping, code clean up, and use of php 8 features

Housekeeping, code clean up, and use of php 8 features
Note: This issue applies to index.php, and everything in the core/ and Tests/ directories.
Refactor to enhance code readability and organization.
Refactor to take advantage of new php 8.0 and php 8.1 features, such as property promotion, wherever they are not currently being used, but could be.

Note: Commit message for commit c0a3590f31a3440814df3601ae3a0628c9ee6418 incorrectly references issue #299, it should have referenced issue #310.


Add deleted user's workspace delete function

Is your feature request related to a problem? Please describe.
Discussions on how to deal with the deleted user's workspace are required.
Describe the solution you'd like
Add deleted user's workspace delete function
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

 [ADMIN] Workspace - Personal type은 Status 표시 안되며, Inactive 워크스페이스의 삭제 기능 없음


MINOR: Fix for MetadataQuorumCommandErrorTest.testRelativeTimeMs

This change should fix the following error on CI/CD.
org.apache.kafka.common.KafkaException: Error while computing relative time, possible drift in system clock.
Current timestamp is<PHONE_NUMBER>724, test timestamp is<PHONE_NUMBER>724

@dajac @divijvaidya the fix should be ready now. Thanks.
https://ci-builds.apache.org/blue/rest/organizations/jenkins/pipelines/Kafka/pipelines/kafka-pr/branches/PR-13784/runs/3/nodes/13/log/?start=0


Add geometry type to form fields

Status
IN DEVELOPMENT (Need to test syncing)
Description
Adding support for forms to contain multiple field of type geometry
Todos

[ ] Tests

Steps to Test or Reproduce
Outline the steps to test or reproduce the PR here.
git fetch --all
git checkout <feature_branch>
./gradlew connectedCheck

@boundlessgeo/spatial-connect

@georific it looks like form-field-geometry has been merged into develop, should we change the base branch on this? not sure if this still needs to be brought in or not

@joshkendrick this hasn't been merged into develop yet.  It should have been merged into the form-field-geometry branch but it hasn't.  So much has changed since this was done, that we probably may have to start over IF and WHEN we want to add geometry to forms.  I can merge this PR into the form-field-geometry branch just for a record of the changes made.

Hmm I the form-field-geometry branch seems merged in. I just saw this and thought I'd bump it because I was trying to prune some branches so it's easier to know which branch to work from. Sounds like it's good to keep this code someplace; i.e. it still has value. I'm good with whatever you think is best

This is not in develop
https://github.com/georific/spatialconnect-android-sdk/blob/ced022148631bfa7fbf21f3ce50688db0139ea2c/spatialconnect/src/main/java/com/boundlessgeo/spatialconnect/config/SCFormField.java#L256-L257
Yea, I agree, I'll clean up this PR so its not dangling, we can have the from-field-geometry, develop and master until we decided what the verdict is for geometry on forms.

yeah that makes sense to me. i was saying there's no diff between develop and form-field-geometry` right now: https://github.com/boundlessgeo/spatialconnect-android-sdk/compare/develop...form-field-geometry -- but i like your plan. and we'll have this PR to reference when i inevitably forget what we decided lol.


Added event for Meshery design import fail

Notes for Reviewers
This PR fixes #9259
This PR adds a new error event on failing Meshery design import to make sure it gets persisted in the notification center
Signed commits

[ ] Yes, I signed my commits.

Syncing with latest on master.

@Yashsharma1911 Were are we heading on this?

@Yashsharma1911 ping, ping.

puh-ping

I accidentally unsubscribed to this PR 😬 was not getting notifications, I'll pushing the requested changes, thanks for calling on this and giving time

Updated the error message, I also added this link https://docs.meshery.io/concepts/designs for people to understand design better however we are not doing a good job on that page, I'll update the doc there

Created this issue to track https://github.com/meshery/meshery/issues/9751

Thanks for reviewing this, @MUzairS15. Some feedback for @Yashsharma1911

@Yashsharma1911 merge conflict.

@Althaf66 perhaps you could assist with this merge conflict.

@Althaf66 perhaps you could assist with this merge conflict.

@leecalcote merge conflict resolved. ✅

Thank you, @RipulHandoo

@MUzairS15, @RipulHandoo might need additional privileges in order to push the commit for eliminated merge conflict.

Syncing branch with master.

@Yashsharma1911 all good to go?


Merge pull request #2 from MicrosoftDocs/code-headers

Code headers

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Deleting a bank account kills the app

Not sure if a bug in Kresus or in the data-system or the libs communicating with it.

This happens only with the pouchdb backend.

So actually two parts in this bug:

the pouchdb mentioned above
access.destroy() wants a callback, at several places in the code; fixed in the big coffeescript-to-es6 refactoring.

Fixed by https://github.com/bnjbvr/kresus/commit/9eea3d3021da4a743bf639b7236c3219b1be9be2


discovery: generate service name from container tags

What does this PR do?
This PR makes service discovery generate service names of containerised services using the container tags.
Motivation
Describe how to test/QA your changes
Possible Drawbacks / Trade-offs
Additional Notes

/merge


for index makes accepting changes more difficult

Describe the bug
#637 changed to use "#" to delineate index. I think overall this is a good change, however it makes accepting changes via file rename much more difficult, as VS won't accept files with "#" in the name without chucking an error message up.

Perhaps I am in the minority here, but would it be possible to reconsider the approach here and use a different character?

Why would VS be blocking that?

would it be possible to reconsider the approach here and use a different character

what character do u you propose?
(i wish you had raised this during the 2 month beta period of this release)

Honestly not sure why VS is doing that, probably some wacky legacy reason.
I'm fine if the answer is no of course as it's your project.
Perhaps [00]? It is harder to read probably, though it kind of fits with array index notation.

the VS behavior gets weirder
https://developercommunity.visualstudio.com/t/Cant-use--to-create-or-rename-a-file/10180338

@JoshSchreuder have you tried using a different compare tool? VS is chosen last since (even aside from this issue) it has the worst experience
Or using DiffEngineTray

@SimonCropp have been using Beyond Compare but we're doing image comparison which I don't think it copes too well with. As I said, feel free to close this if it's not really a priority for you.
I'll try DiffEngineTray

Perhaps [00]? It is harder to read probably, though it kind of fits with array index notation.
As I said, feel free to close this if it's not really a priority for you.

I want to see this fixed. but [00] would be another breaking change and a reasonable amount of friction for consumers

Beyond Compare but we're doing image comparison which I don't think it copes too well with

BC works fine with image comparison. i have been using it for years

or more specifically: in what way is VS better than BC for comparing images?

Yeah I should clarify, I usually rename received -> verified then compare outside of VS (in the git tool Fork which has swipe comparison)
This renaming part could be done via script or DiffEngineTray or whatever as you note, so it's not a huge blocker.

if u always use your git tooling. perhaps autoverify would work for you?
https://github.com/VerifyTests/Verify/blob/main/docs/verify-options.md#autoverify

Thanks for the advice, I'm going to try that out and see how we go.

given this is a bug in VS, and has been logged, will close this one

Autoverify works quite well for our workflow, thanks for the tip

is that the preference for you whole team? and if so how many people is that?

Team is about 4-5 people so pretty small. We can review on the pull request side also with image comparison quite easily so auto approve works quite well here I think.


Potentially "incorrect" merge (diff?) behavior related to similar code

I tried to merge the following scenario:
base:   {}
left:   {a}
right:  {} {b}

This is what I want to happen:
base:   {}
left:   {a}
right:  {} {b}
merged: {a} {b}
         + ++++

Instead a merge conflict happens because the following two blocks ends up being connected and compared:
 +
{a}
{} {b}
 ++++

The expected outcome would merge cleanly, whereas the second will generate a merge conflict.
I need to see if I can make the diff/merge algorithm less greedy in this case.

The solution for now is to disable the patience optimization when merging as this removes information useful for synchronizing points in the code.


feat(adminsitration area): adding Administration Area

Added Administration area, moved settings and invite user under it, minor CSS changes
fix #491
Pull Request
Thank you for your contribution to the Bulwark. Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes # 491
Type of change

[x] A new feature
[ ] A bug fix
[ ] Documentation only changes
[x] Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
[ ] A code change that neither fixes a bug nor adds a feature
[ ] A code change that improves performance
[ ] Adding missing tests or correcting existing tests
[ ] Changes that affect the build system or external dependencies
[ ] Changes to our CI configuration files and scripts
[ ] Other changes that don't modify src or test files

Add description here
Added administration area menu, area, moved settings and invite under this folder to make it easier to work with, minor CSS changes.

Checklist

[x] My code follows the contributing guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

Awesome, I'll run the changes when I get home today.


Tiled images in gallery invisible on mobile

When clicking on a photo from here https://priorityconstruction.netlify.com/gallery/anthem-house/, the images at the bottom appear all black

Note, this is also an issue on desktop Safari


Can't compile on Mac - 2.)


Apply Black auto-formatting

Note that Black prefers double-quotes to single-quotes, so keep that in mind from now on.
This ensures all files are properly formatted for neatness and ensures any subsequent PRs have the right formatting (to make code reviews go faster since the style issues are already handled by the tooling).

@kuberti did you get a chance to look at this? This will enforce Black formatting on all subsequent PRs.


Returning Dynamic/Union Values

I can't seem to be able to return Dynamic values from methods even though Union is a public type,
I think there should be a method of constructing those to be able to create more powerful functions

You can certainly return Dynamic from methods.
What is the error you got?
fn my_func(x: i64) -> Dynamic {
    (x + 1).into()
}

engine.register("func", my_func);

Amazing! I see, I was trying to convert Option<SomeT> into a dynamic, hmm, I guess Option's are not supported as dynamic values ? In fact I don't think you can construct Dynamic values from custom types even if they support Clone

Hmm, Yeah i've since realised into should be working, but it's not for some reason. Not sure why this isn't working:
    #[derive(Clone)]
    pub struct RhaiTypeRegistration(Arc<TypeRegistration>);

    pub fn get_type_by_name(&mut self, type_name: &str) -> Dynamic {
        let w = self.read();

        let registry: &TypeRegistry = w.get_resource().unwrap();

        let registry = registry.read();

        registry
            .get_with_short_name(type_name)
            .or_else(|| registry.get_with_name(type_name))
            .map(|registration| RhaiTypeRegistration::new(Arc::new(registration.clone())).into())
            .unwrap_or_default()
    }

I've thought maybe the type wasn't send/sync but even if i implement those it doesn't work.
I get a bound error:
the trait bound `bevy_mod_scripting_rhai::rhai::ImmutableString: std::convert::From<rhai::bevy::RhaiTypeRegistration>` is not satisfied
the following other types implement trait `std::convert::From<T>`:
  <bevy_mod_scripting_rhai::rhai::ImmutableString as std::convert::From<&smartstring::SmartString<smartstring::config::LazyCompact>>>
  <bevy_mod_scripting_rhai::rhai::ImmutableString as std::convert::From<&std::string::String>>
  <bevy_mod_scripting_rhai::rhai::ImmutableString as std::convert::From<&str>>
  <bevy_mod_scripting_rhai::rhai::ImmutableString as std::convert::From<smartstring::SmartString<smartstring::config::LazyCompact>>>
  <bevy_mod_scripting_rhai::rhai::ImmutableString as std::convert::From<std::boxed::Box<str>>>
  <bevy_mod_scripting_rhai::rhai::ImmutableString as std::convert::From<std::string::String>>
required because of the requirements on the impl of `std::convert::Into<bevy_mod_scripting_rhai::rhai::ImmutableString>` for `rhai::bevy::RhaiTypeRegistration`
required because of the requirements on the impl of `std::convert::From<rhai::bevy::RhaiTypeRegistration>` for `bevy_mod_scripting_rhai::rhai::Dynamic`
1 redundant requirement hidden
required because of the requirements on the impl of `std::convert::Into<bevy_mod_scripting_rhai::rhai::Dynamic>` for `rhai::bevy::RhaiTypeRegistration`

Ah... switching into into from did the job, i didn't realise one could work without the other

Ah... switching into into from did the job, i didn't realise one could work without the other

Well, Dynamic::from is a special implementation that works with everything, not just pre-defined types.  It is not the same as the From trait (although the name is the same).  It is quite common in Rust to have from implementations that are separate from the From/Into traits pair.
into only works for types that are built into Rhai.

BTW, I just see your repo https://github.com/makspll/bevy_mod_scripting
Since you're supporting mlua and rhai, can you let me know how you feel about the two?
I never anticipated that Rhai can be used for gaming (since Lua is sorta the standard there).

It is not the same as the From trait

that would explain my confusion haha.

Since you're supporting mlua and rhai, can you let me know how you feel about the two?
I never anticipated that Rhai can be used for gaming (since Lua is sorta the standard there).

Sure! The biggest difference between the two would be of course how workable they are with existing types,
mlua, because it is built on Lua, requires a lot of traits/boilerplate to convert between things you don't own and Lua representable types. Rhai on the other hand, because it already supports ANY type, is so much more convenient to plug in.
Since my library deals with creating pass-by-ref wrappers, this interoperability is VERY valuable.
I think both languages have their strong suits, Lua's being performance of course (although the recent benchmarks I saw showed that Rhai is not that far behind!).
Rhai does work much better if you are already familiar with Rust, so having a language similar to Rust is very valuable when making a moddable game (since then your game becomes a mod itself)
I haven't scripted in either language for too long so I cannot comment much on language design and features, but I think Rhai is quite nice especially considering Lua indexing starting at 1 (aaaAAA), and that avoids bug-prone marshalling code (ew).
I think Overall Rhai is a fairly good contender for scripting, I don't know at the time how it would do performance wise, so it may be the case that it could only really be used for things like UI/light (and sparse) logic scripting, but even then I think it's a good option to have as part of a multi-language scripting approach

Lua indexing starting at 1

Yeah, that's always a big trip-up!  Reminds me of Visual Basic days, but in VB you can further confuse everyone by using a global setting to make arrays start from zero.

Indeed, it's my one and biggest quam with Lua
Oh and I forgot but WASM support is REALLY good to have, and Rhai would allow my library to run in the browser I believe!

Rhai would allow my library to run in the browser I believe

This is correct.  You're not the only one who comes to Rhai because of the lack of WASM support for Lua...
BTW, anything that you're frustrated with Rhai when integrating it into your engine?  Any feature that would make your life easier?

BTW, anything that you're frustrated with Rhai when integrating it into your engine? Any feature that would make your life easier?

Hmm, native support for any references :p jk jk,
I think the integration experience is better than with Lua, I haven't encountered any deal-breaker issues yet, or anything stopping me from having the equivalent functionality I implemented in Lua.
The plugin system is quite convenient already, and avoids a lot of boilerplate which is very nice, i'll let you know if anything pops up though!

Actually @schungx, I wonder if it's possible to receive the scope as part of NativeCallContext API? I am making indexers for reflected types, and it's difficult to work around not having access to the globals available in the script

That would be difficult (otherwise it would have already been done).
That's because, for a native function, the &mut parameter can (and usually is) point to a variable in the scope.  That means the whole scope is locked.  Rust won't allow access to the scope within the function as long as that &mut parameter is alive.
Unless we resort to unsafe code, there is no easy way to deal with this.  There is no way to guarantee that you're not gonna read the variable that happens to be passed in via the &mut parameter.
For functions without a &mut parameter, technically speaking you can do it, but Rhai handles both types of functions in the same way, so it is also disallowed.

Ah, yeah I see the problem, alright, I'll just have to store the state in my structs, I guess a possible solution would be having "auto-passed" arguments i.e. the function always has the first n arguments automatically pulled out of the scope by name or something, but that'd be sort of unusual

Hmm, actually constants are accessible from the native context, but there is no way to change them in between script runs, in my case the constants are "constant" per-frame rather than for the lifetime of the script

You can set the default "tag" in the Engine, which is available for native Rust functions.  This "tag" can be changed on the Engine at any time (e.g. between r uns).


cannot publish to pypi with direct HDBET dependency

Upon v0.1.0 release, got the following from our publish action:
ERROR    HTTPError: 400 Bad Request from https://upload.pypi.org/legacy/
         Can't have direct dependency: HD-BET@
         https://github.com/brain-microstructure-exploration-tools/HD-BET/archiv
         e/refs/tags/v1.0.0.zip#sha[25](https://github.com/brain-microstructure-exploration-tools/abcd-microstructure-pipelines/actions/runs/9003846883/job/24735448038#step:4:26)6=d48908854207b839552f2059c9cf2a48819b847bc
         1eb0ea4445d1d589471a1f5. See
         https://packaging.python.org/specifications/core-metadata for more
         information.

Originally posted by @ebrahimebrahim in https://github.com/brain-microstructure-exploration-tools/abcd-microstructure-pipelines/issues/42#issuecomment-2100763789

@allemangD I have an idea and I want to run it by you before trying it. Maybe we can make HD_BET a git submodule in this repo and then declare it to be a package that is to be installed alongside the abcdmicro package within this repo. Then somehow, IDK how yet, we can point to that locally packaged HD_BET as a dependency of abcdmicro... do you think there's any promise for such an idea? I just want your initial thoughts before jumping in. It'd be nice to not have to publish an extra thing to pypi just for this.

A single distribution package (abcd-microstructure-pipelines) can contain multiple top-level import packages (abcdmicro, HD_BET). I don't think there's a way to "include" the HD BET setup.py, though, we'd need to port all that to our own pyproject.toml. See setuptools configuration. I think we'd set:
[tool.setuptools.packages.find]
where = ["src", "vendor/HD_BET"]
include = ["abcdmicro", "HD_BET"]

If we did that we should change the import package name, though, so our HD_BET fork doesn't potentially clash with an upstream HD_BET installation...
I'm generally hesitant to use submodules, especially since we planned to modify parts of HD_BET API for our needs. Editing content of submodules always gets very tricky to coordinate in my experience.
We'll encounter all the same issues with the https://github.com/pnlbwh/conversion dependency.

ah "import package" and "distribution package" ... ty for giving me the more precise words for what I was trying to say
Okay ... I am convinced. I think I still like that idea of publishing our fork better than this.
We can call it HD-BET-abcdmicro-fork. Then for the "conversion" package we can use a similar naming scheme pnlbwl-conversion-abcdmicro-fork. Large and inconvenient names, but ones that exist just for the purpose of our project pointing to them.


Initial implementation of MISE middleware

Which issue this PR addresses:
Part of ARO-5942
What this PR does / why we need it:
A first-pass implementation of the MISE authentication layer.
Test plan for issue:
INT, eventually
Is there any documentation that needs to be updated for this PR?
We need to update docs about auth flow
How do you know this will function as expected in production?
N/A, for initial testing

/azp run ci, e2e


Atomically write cache in its entirety or not at all.

A half-written cache (e.g. by interrupting the surelog
process) can not be read on the next invocation of surelog
and segfaults the process. So make sure only complete cache
files show up with the desired name.
Signed-off-by: Henner Zeller<EMAIL_ADDRESS>

Codecov Report

Merging #2849 (819e6bf) into master (b9298c2) will decrease coverage by 0.00%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master    #2849      +/-   ##
==========================================
- Coverage   27.01%   27.01%   -0.01%
==========================================
  Files          99       99
  Lines       32059    32062       +3
==========================================
  Hits         8660     8660
- Misses      23399    23402       +3

Impacted Files
Coverage Δ

src/Cache/Cache.cpp
0.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b9298c2...819e6bf. Read the comment docs.


remove some gpu jobs from ci

Purpose

Removes some gpu jobs:

gpu_held_suarez_rhoe_hightop and the comparison as we have a comparison for baroclinic wave. Actually, the comparison has been failing, see the broken test in the most recent build. Is it useful to keep the comparison?
gpu_implicit_barowave_wrt_h_elem: it's the same as gpu_implicit_barowave except for dt_save_state_to_disk

These jobs don't seem very useful to me. @charleskawczynski @sriharshakandala What do you think? As a side note, the resolutions for the GPU performance jobs are z_elem: 25 h_elem: 12. Where do we get the resolution from?
To-do

Content

[ ] I have read and checked the items on the review checklist.

gpu_implicit_barowave_wrt_h_elem is what @bloops has been using for analyzing performance. I think we would like to keep that running

Ah ok, I'll keep that. How about the comparison with CPUs? All the comparisons seem broken (which is fine I think, as we shouldn't expect the same results).

How about the comparison with CPUs? All the comparisons seem broken (which is fine I think, as we shouldn't expect the same results).

I guess that's fine 🤷🏻

I guess the relative error can be useful. I'll keep one BW comparison and remove the HS one.


⚠ Slack has degraded performance

In ac6838d, Slack (https://status.slack.com/api/v2.0.0/current) experienced degraded performance:

HTTP code: 200
Response time: 69 ms

Resolved: Slack performance has improved in 9232706.


How accurate is the forecast?

I obviously know it is not 100 percent accurate, but I would like to know approximately what would be the accuracy of the neural network.

Not very accurate at all currently. I am working in the background on improving the forecast but to truly have a an accurate forecast is a million dollar question. I know the NLTK model used for the sentiment analysis has a peak accuracy of 58%.


Bug in the execution lack of a folder

When someone installs the extension and try to run the Vizualise comand this error apears

in my I search that file in the extensions.js
and it apears that it should be a directory named "user_compiled"and a file named "debug_logs.txt"

but when you install the extension and run it they are not created
I created them manualy and then the extension worked

I tested it with only the folder created and first it gives the same error but the second run the file ¨debug_logs.txt¨ is already created and it runs


Struggling to get sum for each edge coming out of given node in a batch

I am struggling to implement this distance normalisation routine for batched data:

My data loading looks like:
for batched_data in test_loader:
    print(gaussianDistanceLayer(batched_data.edge_attr, batched_data.batch))

where edge_attr contains distance (x_i - x_j) between 2 nodes. I then try to pass it through gaussianDistanceLayer:
class GaussianDistanceLayer(nn.Module):
    def __init__(self):
        super().__init__()
        self.scale = torch.nn.Parameter(torch.randn(1))

    def forward(self, batched_ditance, batch):
        result = torch.exp( (-1/2) *batched_ditance.pow(2)/self.scale)
        normalizing_factor = scatter_add(result, index=batch,dim=0)
        return result

However, I don't understand how I should index different nodes in a given graph (which is indexed by batched_data.batch

Solved. I need to use indexes from edge_indeex

Exactly :)


Revert to bulk download for NVD

Per https://groups.google.com/a/list.nist.gov/g/nvd-news/c/aofnAd3HP2g
There will be a bulk download option available some time in the future. In the meantime, the legacy JSON feeds will remain available until then.

I'd like to make sure we have determined the benefits/compelling reasons for doing this?
I think the way the CVE data is expressed via the API is slightly richer than the legacy feeds, for example.


Feat/buildrun support codescan result

Defines the restful data structure of code scanning and the response data structure of third-party tools
Changes

CodeQualityTaskMetrics
CodeQualityTaskMetricsSpec
CodeScanStatusSummary
CodeQualityTaskInfo
CodeQualityTaskOption
common reasons
code scan reasons
restful api /codeQuality/task/{task-id}/summary

Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[x] spec PR link included
[x] Follows the commit message standard
[x] Meets the contributing guidelines (including
functionality, content, code)
[x] Test cases with documentation and functionality works as expected using current and related github repos (MUST deploy and check)
[x] Release notes block below has been filled in or deleted (only if no user facing changes)

Release Notes

建议 把 CodeQuality 相关的， 都放到一个 文件里边。 现在 扩张的有点快。想要找某个工具相关的 公共数据结构也有点麻烦。如果在一个文件里边， 可能会相对好找一些，也能控制文件扩张。

可以把 Reason 和 ReportSync 那些 放到 一个 constant.go 文件里边？


Update README.md

!!!!!!!!!! Please delete the instructions below and replace with PR description
If you have an issue number, please use a syntax of
Fixes #12345 and a brief change description
If you do not have an issue number, please have a good description of
the problem and the fix. Help the reviewer understand what to expect.
Make sure you delete these instructions (to prove you have read them).
!!!!!!!!!! Instructions end

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Please don't create noise PRs.  Next time, this will be reported to GitHub.


Where is array type inference defined?

We need this for stackalloc as well.
Discovered in #238.

Perhaps <IP_ADDRESS>?
https://github.com/dotnet/csharpstandard/blob/draft-v7/standard/expressions.md#126315-finding-the-best-common-type-of-a-set-of-expressions

(Clearing from the 7.x milestone, as I don't think this is any worse than it was before.)


[Feature Request] Handle tasks in the background

Some tasks like activating an account freeze the whole page while in process.
Instead, handle them in the background and show the process in a notification like this:

I think this should be for the rewrite. It would probably be a significant change to implement this in the current codebase and for a limited benefit

I think this should be for the rewrite. It would probably be a significant change to implement this in the current codebase and for a limited benefit

I think this should be for the rewrite. It would probably be a significant change to implement this in the current codebase and for a limited benefit

I agree, added it to the roadmap for 2.0


(PTS)Bluetooth: SM_MAS_PKE_BV-01-C-INCONCLUSIV

Describe the bug
Bonding flag in Pairing Request cannot be set to cleared. Zephyr aplication doesn't support set BTP bondable off command.
To Reproduce
run auto-pts
SM_MAS_PKE_BV-01-C-INCONC.zip

CC @jhedberg @joerchan

Lowering to medium since this is a tester issue.

The test doesn't seem to be using the Bondable command (0x09):
*** Booting Zephyr OS build v2.2.0-rc1-263-gcee1954ac394  **
[00:00:00.000,000] <dbg> bttester.tester_init: Initializing tester
[00:00:00.019,348] <inf> bt_hci_core: HW Platform: Nordic Semiconductor (0x0002)
[00:00:00.019,378] <inf> bt_hci_core: HW Variant: nRF52x (0x0002)
[00:00:00.019,378] <inf> bt_hci_core: Firmware: Standard Bluetooth controller (0x00) Version 2.2 Build 0
[00:00:00.020,568] <inf> bt_hci_core: Identity: e6:37:9e:89:3f:ab (random)
[00:00:00.020,568] <inf> bt_hci_core: HCI: version 5.1 (0x0a) revision 0x0000, manufacturer 0x05f1
[00:00:00.020,599] <inf> bt_hci_core: LMP: version 5.1 (0x0a) subver 0xffff
[00:00:00.025,390] <dbg> bttester_gap.tester_handle_gap: opcode: 0x03
[00:00:00.365,020] <dbg> bttester_gap.tester_handle_gap: opcode: 0x10
[00:00:09.241,973] <dbg> bttester_gap.tester_handle_gap: opcode: 0x0e
[00:00:09.487,121] <dbg> bttester_gap.tester_handle_gap: opcode: 0x11
[00:00:09.499,542] <dbg> bttester_gap.tester_handle_gap: opcode: 0x11


Collapsible headers causes CPU usage to spike (A/B Tested: 15% baseline vs. 120%)

What is happening?
When Collapsible Headers extension is enabled, CPU usage spikes to 100%+. When disabled, the baseline is about 15%.
What should be happening?
The CPU usage should be... more reasonable.
Screenshots (if applicable):
When enabled:

Operating system/browser name & version:
MacOS 12.2.1
notion-enhancer and/or notion-repackaged version:
notion-enhancer v0.11.0-dev (Notion Enhanced dmg downloaded today).
notion-enhancer configuration (enabled/disabled mods and their settings):
outliner, truncated titles, collapsible properties enabled

Yeah... there are a couple of mods that aren't particularly efficient on larger pages, unfortunately. I improve them a bit with each update but there's only so much that can be done.
This mod is obsolete and soon to be removed anyway, though - try Notion's new builtin toggle header blocks.

@dragonwocky I think the collapsable headers mod would be nice, even with the Notion (R) Official {TM} collapsible blocks, as I move a lot between Obsidian and Notion; this saved having to go in and change all the H's in my notes into a different special H after the Obsidian --> Notion MD import.  :p

Yeah. I agree with @chrisdlees, as I also have quite a number of writeups that I don't think want to change to toggle header / collapsible block. coz i want to move to other documents as well. hope dev can consider continue support the mod


[PowerShell] Object initialiser does not work for Label but does for Window

Hi
I'm investigating Terminal.Gui in PowerShell. I found that I can create a Label using the constructor, but not using object initialisation. I get no errors, but the label is not displayed. However, object initialisation works for Window. What am I doing wrong?
Sample code (please excuse the quality, it's my first attempt):
using namespace Terminal.Gui

Add-Type -Path 'C:\Users\<removed>\.nuget\packages\terminal.gui\1.0.0-pre.99.1\lib\net5.0\Terminal.Gui.dll'
Add-Type -Path 'C:\Users\<removed>\.nuget\packages\nstack.core\0.16.0\lib\netstandard2.0\NStack.dll'

[Application]::Init()

$top = [Application]::Top

# This object initialiser works for Window
$mainWindow = [Window] @{
    Title  = 'Testing'
    X      = 0
    Y      = 1
    Width  = [Dim]::Fill()
    Height = [Dim]::Fill()
}

$top.Add($mainWindow)

# Using the constructor works. Label is displayed
$testLabel1 = [Label]::new(0, 0, 'Test1')

# Using object initialiser does not work for Label
# No errors, but the label is not displayed
$testLabel2 = [Label] @{
    X    = 0
    Y    = 1
    Text = 'Test2'
}

$mainWindow.Add($testLabel1)
$mainWindow.Add($testLabel2)

$menu1 = [MenuBar]::new(
    @(
        [MenuBarItem] @{
            Title    = '_File'
            Children = @(
                [MenuItem] @{
                    Title  = '_Quit'
                    Action = {[Application]::RequestStop()}
                }
            )
        }
    )
)

$top.Add($menu1)

[Application]::Run()
[Application]::Shutdown()

That is already fixed. Try the last version on master.

Not sure if this was what you were suggesting, but this is what I did:

Cloned master
Built it using dotnet build -c Release.
In the sample code above, updated the Add-Type to point at the newly built bin\Release\net5.0\Terminal.Gui.dll.
Ran the sample code.

I got a blank screen. If I comment out the last two lines ([Application]::Run() and [Application]::Shutdown()) and run it, I get this error:
Line |
  36 |  $menu1 = [MenuBar]::new(
     |  ~~~~~~~~~~~~~~~~~~~~~~~~
     | Cannot convert the "System.Collections.Hashtable" value of type "System.Collections.Hashtable" to type "Terminal.Gui.MenuItem".

This is slightly misleading as the error is on line 41: [MenuItem @{
This looks like the object initialiser on MenuItem isn't working now (it did with the original dll). I used a constructor and did not get an error. However, regardless of the menu, I'm only getting a blank screen now.
Any ideas on what I'm doing wrong?

I have a project with the ps1 files and configured to "Copy if newer". In the Debug or Release folder where is the Terminal.Gui.dll I run the ps1 file. I can run and see the label's text. At the begin of the file I write the following:
using namespace Terminal.Gui
import-module .\Terminal.Gui.dll

I also having the same error as you on the MenuItem:
Cannot convert the "System.Collections.Hashtable" value of type "System.Collections.Hashtable" to type "Terminal.Gui.MenuItem".
I don't know why.

If I replace:
# Object initialiser
[MenuItem] @{
    Title  = '_Quit'
    Action = {[Application]::RequestStop()}
}

With:
# Constructor
[MenuItem]::new('_Quit', '', {[Application]::RequestStop()})

I don't get an error. That's why I think it's related to object initialisation.
But, as I said, nothing is displayed.
If I revert back to using:
C:\Users\<removed>\.nuget\packages\terminal.gui\1.0.0-pre.99.1\lib\net5.0\Terminal.Gui.dll
Everything, apart from $testLabel2 is displayed OK, and I get no errors.

Ah ok I get it. In the "Windows Terminal" is not displaying nothing and I don't know why. But try with PowerShell 7 and you'll see it work. There is something that I've not already discover why that not working on the Windows Terminal and it could be also a WT issue.

PowerShell 7 and latest master works:

Hopefully there is a solution to it working in Windows Terminal.

If you figure out about the menu please share.

I only could make it working with this code:
$menu1 = [MenuBar]::new(
    @(
        [MenuBarItem]::new('_File',
            @(
                [MenuItem]::new('_Quit', '',
                    {[Application]::RequestStop()}
                )
            )
        )
    )
)

If you don't need this issue open anymore, please close it. Thanks.


Be notified when running applications from command line

I often run training via a command-line interface (e.g. AllenNLP), therefore I extended the decorators to directly wrap a command-line application.
For example, wrapping a command and be notified via Telegram:
knockknock telegram \
    --token <your_api_token> \
    --chat-id <your_messaging_room_id> \
    sleep 10

Looks good to me. Thanks @ChristophAlt for your contribution!


Text shadow is missing in export

Hello Nils,
I am a ui designer from germany and want to use your very nice and helpful plugin „shared text styles“. It works very fine!
But during my tests I noticed, that the shadows in my text styles are not exported (I can not find something in the exported json).
I have to say, that I use the newest sketch version (44). I am not sure if the problem comes from there.
Do you know about that „bug“?
Thank you very much. Have a nice day!

I also got this problem during exporting and re-importing to my other Sketch files.


At shutdown, join threads before destroying Connman

This fixes intermittent shutdown crashes due to mutexes that were being destroyed while locked. Tested:

bitcoin-qt exits cleanly
Previous scenarios showing intermittent crashes crash no longer
Fast shutdown for missing rpc credentials does not crash

LGTM, I'm curious though if https://github.com/bitcoin/bitcoin/pull/9289 (picked in #436) touches this issue.

I certainly hope #436 makes this PR unnecessary since it goes to all kinds of trouble to make it safe to delete CConnman before joining the processing threads.


fix for imprecise time strings

https://github.com/firebase/firebase-functions-python/issues/136

Hello @ekalosak. Could we add some tests for this to ensure no regression in the future?

@exaby73 yes I believe I clicked "allow edits from maintainers" so you should be able to modify freely. But more than that, I think this issue requires coordination with the firebase-tools maintainers. They released a new version which was not backwards compatible with firebase-functions-python, so there's not any testing to be done on the FFP side that will prevent such mistakes in the future. That will have to come from the firebase-tools folks, if they care to make releases backwards compatible with other parts of the FireBase ecosystem.

Could you link the PR which added these non-backwards compatible changes so that I may have a look?

Any updates? What's blocking merge?


nginx not starting in Debian 8 after compiling

Hi. There were no any errors when compiling and configuring. I copired new nginx binary to /usr/sbin and getting that:
root@zabbix:/etc/nginx# systemctl status nginx.service
● nginx.service - A high performance web server and a reverse proxy server
Loaded: loaded (/lib/systemd/system/nginx.service; enabled)
Active: failed (Result: timeout) since Tue 2016-03-01 15:37:43 MSK; 32s ago
Process: 21504 ExecStop=/sbin/start-stop-daemon --quiet --stop --retry QUIT/5 --pidfile /run/nginx.pid (code=exited, status=0/SUCCESS)
Process: 28015 ExecStart=/usr/sbin/nginx -g daemon on; master_process on; (code=exited, status=0/SUCCESS)
Process: 28013 ExecStartPre=/usr/sbin/nginx -t -q -g daemon on; master_process on; (code=exited, status=0/SUCCESS)
Main PID: 18665 (code=exited, status=0/SUCCESS)
Mar 01 15:37:43 zabbix systemd[1]: nginx.service start operation timed out. Terminating.
Mar 01 15:37:43 zabbix systemd[1]: Failed to start A high performance web server and a reverse proxy server.
Mar 01 15:37:43 zabbix systemd[1]: Unit nginx.service entered failed state.

I replaced binary with basic one (installed with apt-get) and its not starting too.


update README.md to reflect actual docs

Ran:
godocdown  github.com/juju/persistent-cookiejar > README.md

to update the README.
Thanks to Komosa in issue #13 for pointing out that it was out of date.

Trivial, so merging without review.


switch arguments for expected and actual in Assert.AreEquals in multiple tests

Description
This PR is to fix some asserts in the TestPlatform.sln solution, the expected and actual are round the wrong way.
e.g.
Assert.AreEqual(aggregator.RunContextAttachments.Count, 1, "RunContextAttachments List must have data.");
should be
Assert.AreEqual(1, aggregator.RunContextAttachments.Count, "RunContextAttachments List must have data.");
Related issue
Fixes #2328

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: HeroMaxPower sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

I think i got all of them, i also converted
convert Assert.AreEqual(true, ... to Assert.IsTrue(
convert Assert.AreEqual(false, ... to Assert.IsFalse(
convert Assert.AreEqual(null, ... to Assert.IsNull(
Ready to review.

Merged, thanks!