[Snyk] Security upgrade @backstage/plugin-techdocs-node from 0.0.0-use.local to 1.12.11

Snyk has created this PR to fix 11 vulnerabilities in the yarn dependencies of this project.
Snyk changed the following file(s):

packages/techdocs-cli/package.json

Note for zero-installs users
If you are using the Yarn feature zero-installs that was introduced in Yarn V2, note that this PR does not update the .yarn/cache/ directory meaning this code cannot be pulled and immediately developed on as one would expect for a zero-install project - you will need to run yarn to update the contents of the ./yarn/cache directory.
If you are not using zero-install you can ignore this as your flow should likely be unchanged.

⚠ Warning
Failed to update the yarn.lock, please update manually before merging.

Vulnerabilities that will be fixed with an upgrade:

Issue
Score

Remote Code Execution (RCE) SNYK-JS-MYSQL2-6591085
  275

Arbitrary Code Injection SNYK-JS-MYSQL2-6670046
  275

Prototype Pollution SNYK-JS-MYSQL2-6861580
  198

Denial of Service (DoS) SNYK-JS-WS-7266574
  169

Uncontrolled Resource Consumption ('Resource Exhaustion') SNYK-JS-TAR-6476909
  142

Prototype Poisoning SNYK-JS-MYSQL2-6591084
  118

Improper Input Validation SNYK-JS-MYSQL2-6591300
  118

Server-side Request Forgery (SSRF) SNYK-JS-REQUEST-3361831
  111

Prototype Pollution SNYK-JS-TOUGHCOOKIE-5672873
  111

Concurrent Execution using Shared Resource with Improper Synchronization ('Race Condition') SNYK-JS-AZUREIDENTITY-7246760
  85

Resource Exhaustion SNYK-JS-JOSE-6419224
  49

[!IMPORTANT]

Check the changes in this PR to ensure they won't cause issues with your project.
Max score is 1000. Note that the real score may have changed since the PR was raised.
This PR was automatically created by Snyk using the credentials of a real user.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
📜 Customise PR templates
🛠 Adjust project settings
📚 Read about Snyk's upgrade logic

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Resource Exhaustion
🦉 Prototype Poisoning
🦉 Remote Code Execution (RCE)
🦉 More lessons are available in Snyk Learn
[//]: # 'snyk:metadata:{"customTemplate":{"variablesUsed":[],"fieldsUsed":[]},"dependencies":[{"name":"@backstage/plugin-techdocs-node","from":"0.0.0-use.local","to":"1.12.11"}],"env":"prod","issuesToFix":[{"exploit_maturity":"No Known Exploit","id":"SNYK-JS-AZUREIDENTITY-7246760","priority_score":85,"priority_score_factors":[{"name":"confidentiality","value":"high"},{"name":"integrity","value":"none"},{"name":"availability","value":"none"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"low"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"local"},{"name":"epss","value":0.00043},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Wed Jun 12 2024 08:05:14 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":5.99},{"name":"likelihood","value":1.41},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Concurrent Execution using Shared Resource with Improper Synchronization ('Race Condition')"},{"exploit_maturity":"No Known Exploit","id":"SNYK-JS-JOSE-6419224","priority_score":49,"priority_score_factors":[{"name":"confidentiality","value":"none"},{"name":"integrity","value":"none"},{"name":"availability","value":"low"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00044},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Fri Mar 08 2024 08:47:34 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":2.35},{"name":"likelihood","value":2.06},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Resource Exhaustion"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-MYSQL2-6591084","priority_score":118,"priority_score_factors":[{"name":"confidentiality","value":"none"},{"name":"integrity","value":"low"},{"name":"availability","value":"low"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00044},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Tue Apr 09 2024 11:26:47 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":4.19},{"name":"likelihood","value":2.81},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Prototype Poisoning"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-MYSQL2-6591085","priority_score":275,"priority_score_factors":[{"name":"confidentiality","value":"high"},{"name":"integrity","value":"high"},{"name":"availability","value":"high"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00044},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Wed Apr 10 2024 09:16:30 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"critical"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":9.79},{"name":"likelihood","value":2.81},{"name":"scoreVersion","value":"V5"}],"severity":"critical","title":"Remote Code Execution (RCE)"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-MYSQL2-6591300","priority_score":118,"priority_score_factors":[{"name":"confidentiality","value":"low"},{"name":"integrity","value":"none"},{"name":"availability","value":"low"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00045},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Tue Apr 09 2024 08:51:17 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":4.19},{"name":"likelihood","value":2.81},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Improper Input Validation"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-MYSQL2-6670046","priority_score":275,"priority_score_factors":[{"name":"confidentiality","value":"high"},{"name":"integrity","value":"high"},{"name":"availability","value":"high"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00045},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Mon Apr 22 2024 10:27:07 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"critical"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":9.79},{"name":"likelihood","value":2.81},{"name":"scoreVersion","value":"V5"}],"severity":"critical","title":"Arbitrary Code Injection"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-MYSQL2-6861580","priority_score":198,"priority_score_factors":[{"name":"confidentiality","value":"none"},{"name":"integrity","value":"high"},{"name":"availability","value":"low"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00045},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Tue May 28 2024 12:02:37 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"high"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":7.03},{"name":"likelihood","value":2.81},{"name":"scoreVersion","value":"V5"}],"severity":"high","title":"Prototype Pollution"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-REQUEST-3361831","priority_score":111,"priority_score_factors":[{"name":"confidentiality","value":"low"},{"name":"integrity","value":"low"},{"name":"availability","value":"none"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00114},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Fri Mar 17 2023 07:46:44 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":4.19},{"name":"likelihood","value":2.64},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Server-side Request Forgery (SSRF)"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-TAR-6476909","priority_score":142,"priority_score_factors":[{"name":"confidentiality","value":"none"},{"name":"integrity","value":"none"},{"name":"availability","value":"high"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"required"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00045},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Fri Mar 22 2024 12:56:33 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":5.99},{"name":"likelihood","value":2.36},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Uncontrolled Resource Consumption ('Resource Exhaustion')"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-TOUGHCOOKIE-5672873","priority_score":111,"priority_score_factors":[{"name":"confidentiality","value":"low"},{"name":"integrity","value":"low"},{"name":"availability","value":"none"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.0015},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Fri Jun 30 2023 11:54:16 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"medium"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":4.19},{"name":"likelihood","value":2.64},{"name":"scoreVersion","value":"V5"}],"severity":"medium","title":"Prototype Pollution"},{"exploit_maturity":"Proof of Concept","id":"SNYK-JS-WS-7266574","priority_score":169,"priority_score_factors":[{"name":"confidentiality","value":"none"},{"name":"integrity","value":"none"},{"name":"availability","value":"high"},{"name":"scope","value":"unchanged"},{"name":"exploitCodeMaturity","value":"proofOfConcept"},{"name":"userInteraction","value":"none"},{"name":"privilegesRequired","value":"none"},{"name":"attackComplexity","value":"low"},{"name":"attackVector","value":"network"},{"name":"epss","value":0.00044},{"name":"isTrending","value":false},{"name":"publicationDate","value":"Mon Jun 17 2024 14:34:03 GMT+0000 (Coordinated Universal Time)"},{"name":"isReachable","value":false},{"name":"isTransitive","value":true},{"name":"isMalicious","value":false},{"name":"businessCriticality","value":"high"},{"name":"relativeImportance","value":"high"},{"name":"relativePopularityRank","value":99},{"name":"impact","value":5.99},{"name":"likelihood","value":2.81},{"name":"scoreVersion","value":"V5"}],"severity":"high","title":"Denial of Service (DoS)"}],"prId":"65db23ba-2184-4abf-9c24-c100f7bcb051","prPublicId":"65db23ba-2184-4abf-9c24-c100f7bcb051","packageManager":"yarn","priorityScoreList":[85,49,118,275,118,275,198,111,142,111,169],"projectPublicId":"a9db0fdc-869b-43e0-97a9-70aae3a31288","projectUrl":"https://app.snyk.io/org/github-app-PWJAudgzXuTyzZ9kmMSnGR/project/a9db0fdc-869b-43e0-97a9-70aae3a31288?utm_source=github-enterprise&utm_medium=referral&page=fix-pr","prType":"fix","templateFieldSources":{"branchName":"default","commitMessage":"default","description":"default","title":"default"},"templateVariants":["updated-fix-title","pr-warning-shown","priorityScore"],"type":"auto","upgrade":["SNYK-JS-AZUREIDENTITY-7246760","SNYK-JS-JOSE-6419224","SNYK-JS-MYSQL2-6591084","SNYK-JS-MYSQL2-6591085","SNYK-JS-MYSQL2-6591300","SNYK-JS-MYSQL2-6670046","SNYK-JS-MYSQL2-6861580","SNYK-JS-REQUEST-3361831","SNYK-JS-TAR-6476909","SNYK-JS-TOUGHCOOKIE-5672873","SNYK-JS-WS-7266574"],"vulns":["SNYK-JS-AZUREIDENTITY-7246760","SNYK-JS-JOSE-6419224","SNYK-JS-MYSQL2-6591084","SNYK-JS-MYSQL2-6591085","SNYK-JS-MYSQL2-6591300","SNYK-JS-MYSQL2-6670046","SNYK-JS-MYSQL2-6861580","SNYK-JS-REQUEST-3361831","SNYK-JS-TAR-6476909","SNYK-JS-TOUGHCOOKIE-5672873","SNYK-JS-WS-7266574"],"patch":[],"isBreakingChange":true,"remediationStrategy":"vuln"}'

🎉 Snyk hasn't found any issues so far.
✅ code/snyk check is completed. No issues were found. (View Details)


kube-bench config files issues

After running kube-bench against a kubermatic cluster it reported some bad file permissions.

[ ] kubelet.conf file permissions are set to 644 or more restrictive
[ ] kubelet.conf file ownership is set to root:root
[ ] kubelet service file permissions are set to 644 or more restrictive
[ ] kubelet service file ownership is set to root:root
[ ] proxy kubeconfig file permissions are set to 644 or more restrictive
[ ] proxy kubeconfig file ownership is set to root:root
[ ] certificate authorities file permissions are set to 644 or more restrictive
[ ] client certificate authorities file ownership is set to root:root

This ticket should focus on fixing the file permissions for which the controller is responsible but not for files kubeadm/kubelet creates.

@mrIncompetent please specify what is kubeadm and what is our job.

Our responsibility:

kubelet service file

cc @alvaroaleman

This got fixed within #268 when moving to package-based installation.


Document MVP gov't actions

When [Situation]?
When the MVP has launched
I want to [Motivation]
Document the gov't actions as they appear on the site using the approved initiative list as a base
So I can [Expected Outcome]
use them in planning updates to these sections

Completed MVP actions documentation. Saved in the Teams space General \ 5. Service Platform \ Ongoing service model \ Content updates \ Initiatives list 2022 MVP (https://bcgov.sharepoint.com/:x:/t/04504/EQwkIaS9-dxOiSyJ4wLUYLUBhC6EzJ7x_94ebRS4p7V3Nw?e=J6dgch)


Performance issues starting at 65.8 GB of data

It seems the meta task gets slower and slower and after about 60GB it starts to come to a hault.
I use a normal HDD and Node.js 10.15.0. In this case I also saw that the node process loads a huge amount of data into the memory which seems to probably be some memory leak.
Is there some issue known?

@DanielRuf Have you tried increasing --max-old-space-size?
E.g. --max-old-space-size=2000 or higher.

What exactly does --max-old-space-size=2000 do? There is no direct info in the readme. Not sure if thus could help. This is the second HDD (different vendor and size) which gets very slow at around 60GB+ which is problematic.
I guess SSD is the only option here.

What exactly does --max-old-space-size=2000 do? There is no direct info in the readme. Not sure if this could help. This is the second HDD (different vendor and size) which gets very slow at around 60GB+ which is problematic.
I guess SSD is the only option here.

@DanielRuf max-old-space-size is a documented v8 option:
$ node --v8-options | grep max-old
  --max-old-space-size (max size of the old space (in Mbytes))

That is under an assumption that the bottleneck is in memory (as it is for some tasks).
For meta task specifically, there should be no memory-related bottleneck, so I don't see why that affect things.
Which operating system and FS do you use?
I did test on SSD only, though.

I could try to make a patch that groups packages by first two letters, that should reduce the number of files per a single dir.

I use macOS 10.14.3 and last time I had thus issue the node process read almost the same size of data on evedy start after this sfarted happening.
I will try the v8 option but I guess this does not solve that the write rate of the disks (1 and 2 TB) is vedy low after this started happening (few KB per second, often no writes).
I tried APFS and exFAT and deactivated spotlight for the whole volume before doing anything.

I will post a few more info later today.

How does the process memory usage look like?

At the end when this happened the "read bytes" of the node process of the meta task grew to the size of the current size of the pool directory (and higher).
Memory usage seemed to be normal afaik.

Probably too many files in one directory for the file systems and disks

This seems to be the main issue.
Could not even format the disk on macOS with too many files in the meta directory.
After manually deleting a few gigabyte data and a few thousand files I could format the disk.

The current disk is formatted with exfat.

I wonder what the suggested hardware setup is. Can you provide some advice @ChALkeR? Specific file system configurations, SSD instead of HDD and so on?


Properly shade + POM heron-api.jar and heron-storm.jar

This PR includes multiple fixes, but its major purposes are:

properly shade heron-api.jar (//heron/api/src/java:heron-api) and heron-storm.jar (//heron/storm/src/java:heron-storm)
Kryo dependency will be specified in POM file, instead of being linked into the fatjar

To verify Kryo is not linked into these two jars, one can use jar tf and grep to verify.
This two fixes make Twitter internal tests pass when we switch to OSS Heron.
Minor fixes include:

Examples now use org.apache.storm instead of backtype. The missing GlobalMetrics is added under heron/storm.
heron-storm.jar will only include org.apache.storm.***
Removed some unused protobuf build targets.

Some other notes:

Guava dependency is not touched at all. It is linked into jars and is shaded. It is trivial that we can remove Guava dependency from heron-api.jar, but this is not the case for heron-storm.jar. heron-storm.jar depends on Simulator, which further depends on lots of libraries that are using Guava. Thus we decide not to remove Guava.

Also attached are heron-api.jar and heron-storm.jar. Please feel free to use jar tf to examine their contents.
heron-api-and-heron-storm.zip

also a general comment: libs (api, common) now have normal and never-link versions, is that possible to keep only one version?

@nlu90
I don't think we can. Many jars in heron-core.tar.gz have the heron/api/src/java:api-java dependencies. This api-java dependency will bring in Kryo.
"//heron/metricsmgr/src/java:metricsmgr-unshaded" -> "//heron/api/src/java:api-java"
"//heron/statemgrs/src/java:localfs-statemgr-unshaded" -> "//heron/api/src/java:api-java"
"//heron/schedulers/src/java:mesos-scheduler-unshaded" -> "//heron/api/src/java:api-java"
"//heron/instance/src/java:instance-java" -> "//heron/api/src/java:api-java"
"//heron/schedulers/src/java:slurm-scheduler-unshaded" -> "//heron/api/src/java:api-java"
"//heron/schedulers/src/java:marathon-scheduler-unshaded" -> "//heron/api/src/java:api-java"
"//heron/packing/src/java:binpacking-packing-unshaded" -> "//heron/api/src/java:api-java"
"//heron/scheduler-core/src/java:scheduler-unshaded" -> "//heron/api/src/java:api-java"
"//heron/metricscachemgr/src/java:metricscachemgr-unshaded" -> "//heron/api/src/java:api-java"
"//heron/metricsmgr/src/java:metricsmgr-java" -> "//heron/api/src/java:api-java"
"//heron/statemgrs/src/java:statemgrs-java" -> "//heron/api/src/java:api-java"
"//heron/schedulers/src/java:local-scheduler-unshaded" -> "//heron/api/src/java:api-java"
"//heron/scheduler-core/src/java:scheduler-java" -> "//heron/api/src/java:api-java"
"//heron/common/src/java:common-java" -> "//heron/api/src/java:api-java"
"//heron/statemgrs/src/java:zookeeper-statemgr-unshaded" -> "//heron/api/src/java:api-java"
"//heron/spi/src/java:heron-spi" -> "//heron/api/src/java:api-java"
"//heron/packing/src/java:roundrobin-packing-unshaded" -> "//heron/api/src/java:api-java"
"//heron/spi/src/java:utils-spi-java" -> "//heron/api/src/java:api-java"
"//heron/spi/src/java:packing-spi-java" -> "//heron/api/src/java:api-java"

This means we have to have both api-java-neverlink and api-java. This difference propagates all the way back so that we have many xxx-neverlink and xxx.

link to #1735

@huijunw what's the reason to link this PR with the class loader issue? They are separate ones.

@nlu90 i think classloader to separate user space and heron space may be an alternative to solve the package conflict.

@billonahill @ttim @nlu90
the "xxx" vs "xxx_nl" craziness is eliminated now. I confirmed that Kryo is not used in heron-core, which means Kryo should not be linked into any fatjar at anywhere. heron-api.jar and heron-storm.jar depends on it, but this Kryo dependency will only be specified via POM.
Let's now talk about whether we should exclude backtype.storm from heron-storm.jar. It seems to me that we have not reached a conclusion. cc @kramasamy

I have cleaned up this PR quite a lot based on our discussion. Please review again.

Good job, thanks!


RDK-27957 Bring up TextToSpeech plugin code from master to main

Signed-off-by: nrajan002c<EMAIL_ADDRESS>

https://jenkins.code.rdkcentral.com/job/github-triggered/3403/ started

https://jenkins.code.rdkcentral.com/job/build-component-rdk-next/20561/ started.

build-rpi-hybrid-wpe-rdk-next Console Log uploaded to Gist URL: https://gist.github.com/79466de4eb9fc4e0af54cd6b0ae9d93c

build-rpi-mc-wpe-rdk-next Console Log uploaded to Gist URL: https://gist.github.com/cdfa5bbab633ff224b912b30ede28286

build-rpi-hybrid-refapp-rdk-next Console Log uploaded to Gist URL: https://gist.github.com/5669597974354786e2a1714b892d3146

https://jenkins.code.rdkcentral.com/job/github-triggered/3432/ started

Smoke tests for ['build-rpi-hybrid-thunder-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62629/

Smoke tests for ['build-qemux86-hyb-rdk-next'/'build-qemux86-mc-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62626/

Smoke tests for ['build-rpi-hybrid-wpe-rdk-next'/'build-rpi-mc-wpe-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62628/

Smoke tests for ['build-rpi-hybrid-refapp-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62627/

https://jenkins.code.rdkcentral.com/job/github-triggered/3450/ started

https://jenkins.code.rdkcentral.com/job/build-component-rdk-next/20631/ started.

build-rpi-mc-wpe-rdk-next Console Log uploaded to Gist URL: https://gist.github.com/c9c5bd6b1b76741ba79d98067f69611e

build-rpi-hybrid-wpe-rdk-next Console Log uploaded to Gist URL: https://gist.github.com/9e83a64828232fea0ab6a9bcd3f1581a

build-rpi-hybrid-refapp-rdk-next Console Log uploaded to Gist URL: https://gist.github.com/b0a8c4f60282453d55c083bee681f446

https://jenkins.code.rdkcentral.com/job/github-triggered/3499/ started

https://jenkins.code.rdkcentral.com/job/build-component-rdk-next/20696/ started.

Smoke tests for ['build-rpi-hybrid-wpe-rdk-next'/'build-rpi-mc-wpe-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62877/

Smoke tests for ['build-rpi-hybrid-thunder-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62878/

Smoke tests for ['build-qemux86-hyb-rdk-next'/'build-qemux86-mc-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62875/

Smoke tests for ['build-rpi-hybrid-refapp-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/62876/


USB - bulktransport and "USB underrun" documentation

This is just to document USB-related info to see if there is any patterns to it.
The first machine is a ASRock BeeBox-S 7100U, the machine has 2 x USB 3.1 Gen1 ports on the back, and 1 x USB 3.1 Gen1 port + 1 x USB 3.1 Gen2 (Type C) port on the front. The machine runs Debian 9.8, with kernel
tingo@kg-bsbox:~$ uname -a
Linux kg-bsbox 4.9.0-8-amd64 #1 SMP Debian 4.9.144-3 (2019-02-02) x86_64 GNU/Linux

I haven't tested the USB type C port (yet) as I don't have a cable or adapter for it.
Tested with FluxEngine firmware and client from the 'hd' branch.
No matter which port I plug the FluxEngine into, it attaches to a (logical) usb 2.0 controller inside the machine. Example:
tingo@kg-bsbox:~$ lsusb -d 1209:6e00
Bus 001 Device 044: ID 1209:6e00 InterBiometrics

tingo@kg-bsbox:~$ lsusb -t
/:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 10000M
/:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 480M
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/6p, 5000M
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/12p, 480M
    |__ Port 1: Dev 44, If 0, Class=Vendor Specific Class, Driver=, 12M
    |__ Port 3: Dev 31, If 0, Class=Hub, Driver=hub/4p, 480M
        |__ Port 1: Dev 32, If 0, Class=Hub, Driver=hub/4p, 12M
            |__ Port 3: Dev 36, If 0, Class=Hub, Driver=hub/4p, 12M
            |__ Port 1: Dev 39, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M
            |__ Port 4: Dev 40, If 1, Class=Human Interface Device, Driver=usbhid, 1.5M
            |__ Port 4: Dev 40, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M
            |__ Port 2: Dev 35, If 0, Class=Hub, Driver=hub/4p, 12M
        |__ Port 4: Dev 33, If 0, Class=Mass Storage, Driver=usb-storage, 480M
        |__ Port 4: Dev 33, If 1, Class=Human Interface Device, Driver=usbhid, 480M
    |__ Port 4: Dev 8, If 1, Class=Wireless, Driver=btusb, 12M
    |__ Port 4: Dev 8, If 0, Class=Wireless, Driver=btusb, 12M

Bulktransport speeds varies a bit.
FluxEngine connected to the bottom usb port on the back of the machine
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1191 (859 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1159 (882 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1146 (893 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1174 (871 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1185 (863 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1165 (878 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1156 (885 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1172 (873 kB/s)

FluxEngine connected to the top usb port on the back of the machine
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1166 (877 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1182 (865 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1173 (872 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1152 (888 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1151 (889 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1185 (864 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1172 (873 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1198 (854 kB/s)

FluxEngine connected to the  usb 3.1 Gen1 port on the front of the machine
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1145 (893 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1145 (894 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1154 (886 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1145 (893 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1142 (896 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1149 (891 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1146 (893 kB/s)
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1140 (897 kB/s)

but still below the required 942 kB/s required for reading a 5.25 inch, 1232 kB disk

Using a Goobay 55554 USB 3.0 SuperSpeed adaptor, I attempted to test the USB 3.0 Gen2 (Type C) port on the ASRockj BeeBox-S 7100U. It is found by lsusb
tingo@kg-bsbox:~$ lsusb -d 1209:6e00
Bus 003 Device 009: ID 1209:6e00 InterBiometrics

tingo@kg-bsbox:~$ lsusb -t
/:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 10000M
/:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 480M
    |__ Port 1: Dev 9, If 0, Class=Vendor Specific Class, Driver=, 12M
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/6p, 5000M
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/12p, 480M
    |__ Port 3: Dev 56, If 0, Class=Hub, Driver=hub/4p, 480M
        |__ Port 1: Dev 57, If 0, Class=Hub, Driver=hub/4p, 12M
            |__ Port 3: Dev 61, If 0, Class=Hub, Driver=hub/4p, 12M
            |__ Port 1: Dev 66, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M
            |__ Port 4: Dev 67, If 1, Class=Human Interface Device, Driver=usbhid, 1.5M
            |__ Port 4: Dev 67, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M
            |__ Port 2: Dev 60, If 0, Class=Hub, Driver=hub/4p, 12M
        |__ Port 4: Dev 58, If 0, Class=Mass Storage, Driver=usb-storage, 480M
        |__ Port 4: Dev 58, If 1, Class=Human Interface Device, Driver=usbhid, 480M
    |__ Port 4: Dev 8, If 1, Class=Wireless, Driver=btusb, 12M
    |__ Port 4: Dev 8, If 0, Class=Wireless, Driver=btusb, 12M

but then
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Error: data transfer failed: No such device (it may have been disconnected)

fe-rpm works
tingo@kg-bsbox:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-rpm
Rotational period is 167 ms (359.281 rpm)

not sure what's going on here

Next up is a Toshiba Satellite Z30-B-10W laptop, running Debian 9.8, with kernel
tingo@z30b:~$ uname -a
Linux z30b 4.9.0-8-amd64 #1 SMP Debian 4.9.144-3.1 (2019-02-19) x86_64 GNU/Linux

The machine has 3 x USB 3.0 ports.
FluxEngine and usb info
tingo@z30b:~$ lsusb -d 1209:6e00
Bus 001 Device 006: ID 1209:6e00 InterBiometrics
tingo@z30b:~$ lsusb -t
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 5000M
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/11p, 480M
    |__ Port 2: Dev 6, If 0, Class=Vendor Specific Class, Driver=, 12M
    |__ Port 5: Dev 2, If 1, Class=Human Interface Device, Driver=usbhid, 1.5M
    |__ Port 5: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M
    |__ Port 6: Dev 3, If 0, Class=Hub, Driver=hub/4p, 480M
    |__ Port 7: Dev 4, If 0, Class=Video, Driver=uvcvideo, 480M
    |__ Port 7: Dev 4, If 1, Class=Video, Driver=uvcvideo, 480M
    |__ Port 8: Dev 5, If 1, Class=Wireless, Driver=btusb, 12M
    |__ Port 8: Dev 5, If 0, Class=Wireless, Driver=btusb, 12M

testbultransport says
tingo@z30b:~/personal/projects/psoc/fluxengine/tmp$ ../.obj/fe-testbulktransport
Transferred 1048576 bytes in 1366 (749 kB/s)

and it doesn't matter which port I connect the Fluxengine to - I get the same bulktransport speed from all three ports.
Note: this is with latest firmware and client, master branch.

Having issues on Linux (AMD Ryzen 1700) with USB underrun (didn't happen on Windows 10 64bit - different machines).
uname -a
Linux ryzentux 5.0.0-25-generic #26~18.04.1-Ubuntu SMP Thu Aug 1 13:51:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
sudo ./fluxengine testbulktransport
Transferred 1048576 bytes in 1647 (621 kB/s)
Error: data transfer corrupted at 0x0 0.0.0.

sudo ./fluxengine read ibm --revolutions 2
Reading from: :d=0:s=0-1:t=0-79
  0.0: Error: bad USB reply 0x 9

Hmm, to me (by no means an expert) this looks like a different problem. IIRC, the actual error message for usb underrun is "usb underrun" or something very like that wording.
Does the logs on the machine say anything about usb problems?
Does this FluxEngine device (with cables) and the same code (ok, compiled from the same source) work on a different machine?

Of course it could be a different problem. Until now used the same FluxEngine with Windows 10 where it works fine (see my other issues here in the issue tracker). Will look at syslog tonight.

'Bad USB reply' is a sign that the client and the device have got out of sync, protocol-wise. This usually happens by killing the client in the middle of a transfer but it could be a sign of dodgy USB transfers here. Either way, it should be handled more cleanly (see #100).

This should be sorted now with the most recent version --- many firmware bugs have been fixed. Many, many firmware bugs.


Use the pre-installed ruby 2.2 to save 20-30 seconds per test suite.

Since we run 8 test suites per PR/merge build, that's roughly 2.5 - 4 minutes savings.
I'd like to use the latest ruby 2.2.x but it might not be worth the cost.
From a recent build on manageiq, it takes ~0.31s to use the pre-built ruby 2.2.0:
$ rvm use 2.2 --install --binary --fuzzy
Using /home/travis/.rvm/gems/ruby-2.2.0

From a recent build on another repo that uses 2.2 as the
.travis.yml version, it takes 21.80 seconds (20-30 average) to
build ruby 2.2.3 since it has to download the source and build it:
$ rvm use 2.2.3 --install --binary --fuzzy
ruby-2.2.3 is not installed - installing.
Searching for binary rubies, this might take some time.
Found remote file https://s3.amazonaws.com/travis-rubies/binaries/ubuntu/12.04/x86_64/ruby-2.2.3.tar.bz2
Checking requirements for ubuntu.
Requirements installation successful.
ruby-2.2.3 - #configure
ruby-2.2.3 - #download
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 21.1M  100 21.1M    0     0  54.7M      0 --:--:-- --:--:-- --:--:-- 55.0M
No checksum for downloaded archive, recording checksum in user configuration.
ruby-2.2.3 - #validate archive
ruby-2.2.3 - #extract
ruby-2.2.3 - #validate binary
ruby-2.2.3 - #setup
ruby-2.2.3 - #gemset created /home/travis/.rvm/gems/ruby-2.2.3@global
ruby-2.2.3 - #importing gemset /home/travis/.rvm/gemsets/global.gems................................................
ruby-2.2.3 - #generating global wrappers........
ruby-2.2.3 - #uninstalling gem rubygems-bundler-1.4.4.
ruby-2.2.3 - #gemset created /home/travis/.rvm/gems/ruby-2.2.3
ruby-2.2.3 - #importing gemset /home/travis/.rvm/gemsets/default.gems....................
ruby-2.2.3 - #generating default wrappers........
chown: changing ownership of `/home/travis/.rvm/user/installs': Operation not permitted
Using /home/travis/.rvm/gems/ruby-2.2.3

:cry:  @matthewd @Fryguy

I'm ok with this...when travis rebuilds their images, we'll get 2.2.3 automatically.


[BUG] Blender output does not create a PNG

Describe the bug
Render Blender PNG is missing. In my yaml file I am using:
outputs:
  - name: 'Blender 3D Image'
    type: 'blender_export'
    dir: 'Generated/render'
    options:
      point_of_view:
        rotate_x: 45
        rotate_y: 45
        rotate_z: 75
      pcb3d:
        download: true
      render_options:
        samples: 100
        transparent_background: true
      outputs:
        type: render

the container I am using is: container: ghcr.io/inti-cmnb/kicad7_auto_full:latest
I have not touched the config since a while and with my commit some time ago it was generating that PNG
This job was running 3 weeks ago and the PNG was created: https://github.com/open-thngs/so-dimm-esp32-cm/actions/runs/5831095589
With this job today it did not generate the PNG: https://github.com/open-thngs/so-dimm-esp32-cm/actions/runs/6047189057/job/16410157210

The 2d7a7395a31fd5e6a5a95c00e3f55a6f93d9c7b9  and 91a84f037ce15db73cc4ad4fb9d6cd2b5f761adf commits patches v1.6.3 to work with pcb2blender 2.6


December21 fails to publish or prepare  in GitHub Actions

Describe the bug
A clear and concise description of what the bug is.
sfpowerscripts December 21 is unable to publish or to prepare scratch orgs in GitHub actions. This could possibly due to the node update in the docker image and missing checkout depth in prepare in the template files. Some screenshots are attached
For eg, artifact repository have this package published,

however

and during publish

This clearly denotes some behaviour with npm has changed in GitHub actions
Expected behavior
A clear and concise description of what you expected to happen.

Prepare and Publish should work as expected

Platform Details (please complete the following information):

OS:  Ubuntu
Version [e.g. CLI Version  eg: 1.6.6]: 10.2.0
Salesforce CLI(sfdx cli) Version:  7.129.0
CI Platform:  GitHub Actions

Additional context
Add any other context about the problem here.
Seems to be localized on GitHub actions

As a workaround, please switch to release-nov21 of the docker image on GitHub Actions, while we investigate

@aly76  this is related to the node update in the docker image. Refer to issue https://github.com/npm/cli/issues/2453

This is already fixed in the latest tag of docker image.


[SUGGESTION]

Suggestion: when the "No Aim Punch" and "No View Punch" options are active, the bullets are significantly harder to track (becuase of the effect, they go much higher)
My suggestion: making a function to draw scan lines for bullets (like line tracers, similar to what BRUTALE has) to track the bullets easier.
Just a QoL suggestion...

Or use recoil crosshair

Or use recoil crosshair

Some people (like me) hate the recoil crosshair as it gets confusing for someone who has been orienting movement around a static one for so long (700ish hours)

I coded in a recoil circle like an fov circle but to see where recoil goes.


"seeked" event does not match HTML5 event

When scrubbing during playback, the "seeked" event is fired multiple times during scrubbing. Compare to http://www.w3.org/2010/05/video/mediaevents.html where "seeked" event fires only when scrubbing stops.
I'm utilizing Adobe SiteCatalyst to track video usage on my site and their documentation suggest sending them a "pause" message when scrubbing begins and a "play" message when scrubbing stops. With this issue unresolved, I'll make a work-around that adds a timeout to sending the "play" message on scrubbing stop, but it'd be nice if I didn't have to do that and seems in line with the project's goal of mirroring the native event and method interface.
I went looking for where in the code this event is triggered but was unable to find it. If you can point me to the correct area, I can work on a fix!

@peterh-capella Closing old issues. If you'd like to reopen this, let us know. Thanks!


[SPARKTA-209][Driver] Hdfs utils changed to allow remote connections.

Description
Hdfs utils changed to allow remote connections. SPARKTA-209
Reviewer
@anistal
Test
All OK

+1

+1


Addition of configuration handling + a couple of targets

I should note that I am new to Make. I wouldn't be surprised if there's best-practices violations. If there are, let me know and I'll fix them before re-submitting.
Major additions
In order to make this already fantastic Makefile more versatile, I added configuration handling. This allows the Makefile itself to be entirely independent of a users configuration. and more easily update the Makefile on the user end if changes to the Makefile are published. All examples have been updated to reflect this change.
Minor additions
I also added two new targets, help & latest. As per my README changes:

Added 'help' target, to list available targets along with a brief description.
Added 'latest' target, for edge-cases where tagging the resulting image as latest, without version, is preferred.

Other various changes
I also decided to tidy the repo a little, as I don't feel files such as .release should be part of the repository under the examples; these files, while essential to run time, are created by the Makefile at runtime.

It would be nice if those changes were indeed merged.

@mvanholsteijn Any thoughts on this?

@Jekotia I used your PR and it is working really well for me.

what @ygworldr  says goes for me too.

@Jekotia thank you for your suggestion. I am sorry to say that I am not going to merge the config.mk setup into the main branch.
When I want to make a configuration change, I just add them to the Makefile of the source file.
For instance in multiple-example/image1 I would add:
include ../make/Makefile

USERNAME=binxio

Or:
include ../make/Makefile
include ../make/config.mk

This would allow you to override any of the defaults, without moving the complexity of the configuration into the generic makefile.


+ Authorization an API Resource button get disabled when Applciation is authorized to around 10 APIs

Describe the issue:

Create an application
Go to API Authorization tab
Authorize around 10 APIs
Try to authorize an API again later
+ Authorization an API Resource button is disabled

Also, when the number of authorized API count is high, need to show APIs in paginated manner

Fix: https://github.com/wso2/identity-apps/pull/4973


leading blank rows in csv files

Is there any way to tell this plugin to ignore the first lines of a CSV?
Trying to Parse a csv with blank rows I get parsing errors
Because I get these files from an external third party url, I can't modify them at their source.
Perhaps adding an extra option "ignorerows=#" could be usefull.

did u solve that one ?


Set payid metrics protocol version and server agent

High Level Overview of Change
Updates the metrics config to set the PayID protocol version and the server agent
Context of Change
This will allow the server and protocol versions for people running the reference implementation to be tracked within the metrics platform
Type of Change

[ ] Bug fix (non-breaking change which fixes an issue)
[ X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Refactor (non-breaking change that only restructures code)
[ ] Tests (You added tests for code that already exists, or your new feature included in this PR)
[ ] Documentation Updates
[ ] Release

Before / After
Just updated the config settings
Test Plan
Run PayID server and verify that the new metrics are set and published to the Xpring metrics infra.

Whoops, I just accidentally re-requested @hbergren for a review on this PR, meant to do it on the original metrics PR.


Add test scripts for examples

This PR adds scripts to test code in the example directory.

The known problem of these two scripts is that we cannot run them simultaneously because they share the same cache directories. Also, these scripts remove cache directory every time they start training with different configuration. That means we do not test if we can use cached datasets.

If we merge this PR, can we run simultaneously? or it might overwrite the npz file which is not expected?
https://github.com/pfnet-research/chainer-chemistry/pull/32

I think this PR won't affect to travis CI result, so let me merge it.


Add PDCurses

PDCurses is the Windows implementation of the popular curses library.  It is an essential component to many cross-platform utilities which draw to the console.

Fixed by #189


请问，课程链接在哪里？

The GLM-130B model weights arepublicly accessible and its code, training logs, related toolkit, and lessons learned
are open-sourced at https://github.com/THUDM/GLM-130B.
请问，课程链接在哪里？

找不到对应课程链接


Add metadata, update documentation.

Pull Request Test Coverage Report for Build 317388531

0 of 42 (100.0%)  changed or added relevant lines in 6 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+12.04%) to 81.423%

Totals

Change from base Build 315698375:
12.04%

Covered Lines:
154

Relevant Lines:
174

💛  - Coveralls

Pull Request Test Coverage Report for Build 317388531
Warning: This coverage report may be inaccurate.
This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

42 of 42 (100.0%)  changed or added relevant lines in 6 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+12.0%) to 81.423%

Totals

Change from base Build 315698375:
12.0%

Covered Lines:
154

Relevant Lines:
174

💛  - Coveralls


Allow overriding environment variable scope

Allows changing the environment variable scope from Process to User/Machine. Also updated Stop-SshAgent and Get-SshAgent to work with win32 openssh.

Yes, I did commit the follow up but looks like I forgot to push it. Will do so when I'm back at my pc.

@dahlbyk @rkeithhill I've pushed up the missing change.
This doesn't change the environment variable scope for the calls to Get-TempEnv in the main module file, I don't think this is a big deal, but do we want to introduce a global variable to control this? My inclination would be no

setenv doesn't understand your third parameter:
https://github.com/dahlbyk/posh-sshell/blob/edcb790de086f245a3a00f5fac2fc3247a0cd134/src/Utils.ps1#L3-L6

This doesn't change the environment variable scope for the calls to Get-TempEnv in the main module file, I don't think this is a big deal, but do we want to introduce a global variable to control this? My inclination would be no

Get-TempEnv is already explicitly user-scoped rather than process-scoped, and it doesn't make sense for it to be machine-scoped, so I think this is fine. In fact, it doesn't seem useful or correct to allow Start-SshAgent -Scope Machine either, as this could leak the current user's credentials to another user. Am I missing a legitimate scenario for that?

@dahlbyk Good point, I'll remove the option for machine scope and leave just process/user.
Not sure why my change to setenv isn't showing up in the PR, it shows in my local repo. I'll force push it up.

@dahlbyk force push seems to have done it, the changes are showing now and I've removed machine scope from the options list.


Flag heroes via click on the ground

Hey,
It seems that we can flag heroes via tb only when we click on a specific location on the map.
It will be helpful if we could click on the ground to flag the heroes and not only on the map.

Already documented in #61.


[test] remove xfail on validation-test/SIL/verify_all_overlays.py

Looks like it started passing:
https://ci.swift.org/job/oss-swift_tools-RA_stdlib-RDA_long-test/3521/

@swift-ci please smoke test

@swift-ci please smoke test OS X Platform


The pruning for the synchronized mirrors is optative

Feature:
The pruning for the synchronized mirrors is a option now. Default value: enable_prune = true
Motivation:
As far as I know, currently the mirroring is being executed with --prune option. This cause the local branches deletion each time the mirror is sync with the remote/origin repository. The idea is to allow mirrors which local branches.
Related Pull Requests

https://github.com/gogits/gogs/pull/3227 (Closed)

Changes:
Executed go fmt
getEngine() not handles DB parameters (#2972) (#2974)
Uses .AllCols() for Update in updateMirror()
Spanish traslation removed
Fixed a wrong way to ommit the --prune option in process.ExecDir() for MirrorUpdate function

Thanks!


Remove monkeypatching of ParentalKey.contribute_to_related_class to set related_accessor_class

Django 1.7 introduced the ability to pass in a custom related_accessor_class to use as the accessor on the related model, instead of hardcoding ForeignRelatedObjectsDescriptor: https://github.com/django/django/commit/fa2e1371cda1e72d82b4133ad0b49a18e43ba411
To provide this facility on Django 1.6, we had to duplicate the Django 1.7 code as a monkeypatch. Now that we've dropped 1.6 support, this monkeypatch can be removed.

merged in ad984d6d3e71ed3e419f2b894f3abdeeb2deffab


Sahar

👷 Deploy Preview for adoring-leavitt-e31a11 processing.

Name
Link

🔨 Latest commit
b891ab952cc370c83ddedf5d6662bfdb2d3eda37

🔍 Latest deploy log
https://app.netlify.com/sites/adoring-leavitt-e31a11/deploys/62a63a4dc354ec00081f29aa


Fix topic deletion

When trying to delete a topic the Kafka configuration ignores the action:
 % kubeless topic delete s3-python
Topic s3-python is marked for deletion.
Note: This will have no impact if delete.topic.enable is not set to true.

For fixing the above we would need to set the parameter KAFKA_DELETE_TOPIC_ENABLE=true. That will mark the topic for deletion during the next garbage collection. Also, it would be necessary to remove the topic from Zookeeper to speed up things zkCli.sh ls /brokers/topics.
cc/ @anguslees @jbianquetti-nami

Note: Adding this to kubeless.jsonnet will enable the topic deletion on Kafka config file:
 {
     name: "KAFKA_DELETE_TOPIC_ENABLE",
    value: "true"
 },

Also, we will need to delete the topic:
# On  Kafka
$ kafka-topic.sh --delete --topic <<topic>> --zookeeper $ZK:2181
# On Zookeeper
$ zkCli.sh rmr /brokers/topics/<<topic>>
$ zkCli.sh rmr /admin/delete_topics/<<topic>>

See this to undertand why the topic deletion doesn't happens in the moment: https://community.hortonworks.com/articles/72622/how-kafka-delete-topic-command-works.html

Do you have any update on this issue @andresmgot ?

Nope, we didn't have time to work on this yet


adding nlp and cv semantic drift samples

Hi,
Great features and post about https://whylabs.ai/blog/posts/detecting-semantic-drift-within-image-data,  However, I have not found any samples from the repository about nlp and cv semantic drift samples. So, I request adding such samples into the repository.
thanks!

Hello!
Thanks for logging an issue! That article was written with v0 which you can still work with. We released v1 which does have image logging capabilities which you can check out in this notebook. The rest is on the roadmap, and we will announce the release, which would include examples, both here and in our slack community: Robust & Responsible AI which you can join here.
Thanks!
Melly

Closing due to it being on our roadmap and answered.


Expose coder for user defined types as program.coder.types.

I've run into a situation recently when I needed to manually deserialize a slice of account data into a type that I have in my IDL, but which is not an account type. Here's like my Rust part looks like:
#[account]
pub struct Mintlist {
    pub mints: Vec<MintInfo>
}

#[derive(AnchorSerialize, AnchorDeserialize, Clone, PartialEq)]
pub struct MintInfo {
    pub minted: bool,           // 1
    pub metadata_url: [u8; 96], // 96
}

On the client I would like to use something like this:
const mintInfo = program.coder.types.decode("MintInfo", dataSlice)

Looking at the codebase it seems like a trivial thing to add and I'm happy to submit a PR if you think it makes sense.

You can also do this with anchor-client-gen btw. This is how you'd decode a single type from encoded data https://github.com/kklas/anchor-client-gen/blob/master/examples/tic-tac-toe/generated-client/accounts/Game.ts#L89.

@kklas thanks for pointing out, this is great. That said, I also believe anchor will benefit from exposing this functionality directly as it already has largely implemented internally, just not exposed publicly.

Of course!


Always serialize Bytes with binary messages

Requires a little extra checking to work on Python 2, due to str being bytes,
but should work well on Python 3.
Based on #231

Thanks min!


NVSHAS-7691, for branch 5.1.2 to segment dlpwlrules to overcome isuse that kv push size > 512k

Hold for 5.1.2 branch


Snap zones like MacOS BetterSnapTool for FancyZones

Description of the new feature / enhancement
Like in the screenshot I put below, one of the best features of BetterSnapTool on MacOS is being able to define unique zones in the screen where the windows would NOT attach to, but serve as a "shortcut" for a specific window's size.
It acts somehow like the canvas model with overlapping zones, but instead of automatically creating these zones with no visual indication, we would be able to say where to put them.

automatically
Scenario when this would be used?
This would prevent needing to make 15 models on FancyZones for every size combination I need, which is kind of slow to change. This way we could set a lot of window size combinations and drag them to the correct spot.
Supporting information
Just like when creating a new model we can choose between 2 types (grid and canvas), and we would be able to select a third option.
Then we would set the size of the window just like when creating a canvas model. Still, instead of needing to drag the windows inside of this zone to trigger the resize, we would also set a shortcut zone anywhere on the screen and when I drag the windows inside that zone, it would resize and move to the correct spot.
This video (from where I took the screenshot) shows how it works.

I second this. Right now overlapping zones aren't as useful as they could be. Ever since Fancy Zones came out I've been trying to make a zone profile that handles all of the positions I like my windows in. Unfortunately this very quickly has zones completely overlapping making many zones inaccessible by dragging.
Having a separation between activation zones and their associated window position would allow for endlessly custom configurations. Arguably the kind of people who want this much customization with window positioning are the same people who would put the effort into additional configuration needed.
This doesn't have to effect any current layout types, It could be a new type that has 2 sets of zones, Window Zones and Activation Zones. Could swap between Zone types with a button or double click on a zone to swap between Zone types and highlight the corresponding Activation/Window Zone.


Fix 32/64 bit links.

The problem was that the 32 bit link pointed to the 64 bit download and vice-versa. This commit fixes that.

This is a duplicate of https://github.com/dotnet/core/pull/343 and https://github.com/dotnet/core/pull/350.

Lol. Why not bring in those fixes?


Add to Jamf Marketplace?

Thank you for making this, love it and have implemented it a couple times.
Would be good to add to the jamf marketplace, then I can send my customers there as well looking for this amazing solution!

This was finally posted to the Jamf Marketplace... not sure what's wrong with the screenshots though... oh well... better late than never!


Fix bugs and add tests

This PR has a bunch of various bug fixes for the code and tests, and many new tests. It's based on #144, so that needs to be merged first.
@robinnorth I cherry-picked your commit from the fix/missing-tests branch (Add tests for lib/util/noop.js - 5e7341d).

@BehindTheMath nice one, that's a substantial PR! I'll take a proper look at it as soon as I have time.

Thanks. I didn't originally plan on it being so big, but I was aiming for as close to 100% coverage as I could, and I kept adding more tests and finding more issues.
If it's too big, I can break it up into smaller PRs.

@robinnorth Do you think you'll have time to look this over, or should I just merge it? I would love to have a second pair of eyes on it, but I know you said you've been busy lately.

Sorry, I've been very tardy in reviewing this for you. I have indeed been busy, but I'll make some time to check it out later and get back to you.

Thank you, I appreciate it.

I deleted the fix/missing-tests branch, since I cherry-picked the only commit from there into this PR, and we're close to 100% coverage.

Cool, thanks!


Missing documentation

Goal
Fill the gaps. There's a lot of undocumented code. We need to make sure that it as the minimum: (a) Title, (b) brief description, (c) Parameters, and (d) Returns (tag).
Context
[Short paragraph describing how the issue arose and constraints imposed by the existing code architecture]
Specifications
Here is the list of currently undocumented functions/modules:

[ ] TBD

Out of scope

Add mathematical equations/definitions. That is needed but won't be approached here.

Related documents

This is now #47


Just a Thank You

@stephentoub
I wasn't sure how to email you to thank you for making this library so I will just post it here. I used the library code to create a web app that generates riff's where you can download the midi file and import it into any Digital Audio Workstation (DAW) or Guitar Pro for that matter. It was a fun little project and I wouldn't have been able to accomplish without your code. So thank you.
If you'd like to check it out it's located at: http://tuneis.ddns.net
I put a reference to your repository in the footer.

Glad it was helpful to you!


util: add from_encoded_slice

Signed-off-by: Connor1996<EMAIL_ADDRESS>What have you changed? (mandatory)

add from_encoded_slice() that reserve capacity for timestamp
call from_encoded_slice() instead of from_encoded(xxx.to_vec()/to_own()) in some code place, but not all cause xxx maybe timestamped key slice and there is no need to reserve more capacity.

What are the type of the changes? (mandatory)

Improvement (non-breaking change which is an improvement to an existing feature)

How has this PR been tested? (mandatory)
No need
Does this PR affect documentation (docs/docs-cn) update? (mandatory)
No need
Does this PR affect tidb-ansible update? (mandatory)
No need

Please approve again @breeswish @MyonKeminta 😅

/run-integration-tests

@MyonKeminta Please help utilize this function in our mvcc refinement.


Fix saving multiple Images. Fixes #3065

There is an error if you save multiple Images without adding new ones. This should Fix #3065

For anyone searching, it's about line 19 where he checks if there are images.

Hello @fletch3555 I reverted the whitespace changes and only changed what is needed. Regards.


docs: improve readme.md

Requirements

Fill out the template below.
The pull request must update the test suite.
After you create the pull request, all status checks must be pass.

Type

[ ] Bug fix
[ ] Feature change
[ ] Refactor
[x] Documentation
[ ] CI/CD
[ ] Test
[ ] Build
[ ] Style
[ ] Chore

Issue (only for type bug fix/feature change)
Description of the Change
improve readme.md
Possible Drawbacks

:tada: This PR is included in version 1.0.3 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release
v1.0.3

Your semantic-release bot :package::rocket:


Define and use DeployTxArgs

Same idea as InvokeTxArgs - will allow easier construction of DeployAccount transactions, and soon we will be able to vary over version

This change is

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (ef5f661) 68.04% compared to head (cd1eea9) 68.04%.
Report is 12 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1194   +/-   ##
=======================================
  Coverage   68.04%   68.04%
=======================================
  Files          54       54
  Lines        6900     6900
  Branches     6900     6900
=======================================
  Hits         4695     4695
  Misses       1790     1790
  Partials      415      415

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


why use forcanvas  show webgl？

why use forcanvas  show webgl？

From the docs:

prevents selection of WebGL renderer, even if such is present, this option only is available when using pixi.js-legacy or @pixi/canvas-renderer modules, otherwise it is ignored.

From the docs:

prevents selection of WebGL renderer, even if such is present, this option only is available when using pixi.js-legacy or @pixi/canvas-renderer modules, otherwise it is ignored.

Are you sure it gets loaded before you call new Application? Please create a reproduction.

Are you sure it gets loaded before you call new Application? Please create a reproduction.

is resolv thank

is resolv thank


NR-17236 make awsautoscaling SM a subset of GM

Make the SM of awsautoscaling type a subset of its GM.

Looks good for the cloud integrations team


Understanding dynamic tree shaking

Hey,
I just finished going over the tutorial - https://github.com/BuilderIO/qwik/tree/main/packages/docs/src/routes/tutorial/understanding/treeshaking
I fail to see a difference in the HTML/Symbols/client bundles when removing the reference to the store in the child component.
Am I missing something? are there other ways to really see the benefit of dynamic tree shaking in that example?
Thank you :)

seems ok now


Additions to Daily Task Indicator

Hey, there are a few daily tasks that were left out, and I thought would be better included.
Free bonemeal/ectoplasm from Robin after Morty Diarys
Free Flax->Bowstring after Cammy Diarys
and Free buckets of Sand after Hand in the Sand quest

#1129


Cannot able to use expanded inside singlechildscrollview

Hii , I cannot able to use expanded widget inside the singlechildscrollview.
My widgets tree is singlechildscorllview -> column -> [ widget1, expanded, wigdet2].
i have google a lot but i can't able to find solution .

Try giving a fixed size to the column.

@AdilMango
Your question is better suited for support channels like StackOverflow. Please see https://flutter.dev/community for resources and if you need help with your code, please see https://www.reddit.com/r/flutterhelp/
Closing, as this isn't an issue with Flutter itself. If you disagree, please write in the comments and I will reopen it.
Thank you


Update bower.json

Include forgotten js/base.js

Hi @amfg, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no Contribution License Agreement is required at this point. Real humans will now evaluate your PR.

TTYL, MSBOT;

@amfg Thanks for the PR. It looks like you may be trying to fix #2.
Can you describe how you are consuming WinJS thru bower that is causing this problem?
According to the bower documentation, there should only be one entry in main per file type. It seems that this PR would be violating this rule.
Note that ui.js declares a dependency on base.js via the module system (both AMD and CommonJS) so we expected that to be sufficient and are interested in hearing more about your problematic scenario.

Yes, this was an attempt to fix #2.
We are using gulp to build/serve our project, winjs has been installed through bower --save.
I can see the declaration in ui.js which, strangely enough, gulp does not see.
We did not have any problem like this with other libraries so I assumed it is this config to blame.
I believe this would be worth looking into someday, until then I will use this patch which solves the issue for me.
.

@amfg What gulp task is not picking up WinJS's base.js? Can you provide a small sample of a gulp file that could repro this bug?

There are multiple libs that does not pick up the base.js, two of them are:
grunt-wiredep (automatically injects .js links into .html file)
and
main-bower-files
The second is a gulp task while the first is grunt. Works fine when manually editing the bower files inside the winjs folder. Do you still need me to make a full repo?

\cc @sindresorhus Do you have any guidance on this?

Nothing other than using npm instead. I don't use Bower.
npm uninstall -g bower && rm bower.json && echo '\o/'

Hmm maybe \cc @sheerun.

// @stephenplusplus

Bower recently changed its spec, but didn't leave the tooling ecosystem (where wiredep lives) any options for packages that do the right thing and conform to it (where winjs-bower lives). See https://github.com/bower/bower.json-spec/issues/47 for attempts at solving the problem.
For wiredep and other tools that support the community-created overrides property, you can consider something like one of these options:
{
  "name": "your-project",
  "dependencies": {
    "winjs": "4.1.0"
  },
  "overrides": {
    "winjs": {
      "main": [
        "js/build.js",
        "js/ui.js",
        "css/ui-dark.css",
        "fonts/Symbols.ttf"
      ]
    }
  }
}

or...
var wiredep = require('wiredep');

wiredep({
  overrides: [
    winjs: {
      main: [
        'js/build.js',
        'js/ui.js',
        'css/ui-dark.css',
        'fonts/Symbols.ttf'
      ]
    }
  ]
});

I'm not too familiar with this project, but as long as files are included in the Bower package that work for your app, you can use overrides to tell us to inject them.
More about wiredep + overrides: https://github.com/taptapship/wiredep#bower-overrides

Thanks @stephenplusplus!
It sounds like WinJS is doing the right thing and there's nothing more for WinJS to do at this time.
You provided a workaround for apps and bower is working on a solution that WinJS can utilize in the future. Is my understanding correct?

I just have to ask, what is the problem with having one additional .js reference in the "main" section of the project's bower file? There is already ui.js, ui-dark.css and Symbols.ttf in there, why can't you simply add base.js as well? Should all project that want to use WinJS, add ~13 lines of infrastructure code simply to include base.js in additional to the other files?
I agree with @sindresorhus on using NPM, but ASP.NET 5 beta uses Bower and if those developers want to continue to use bower, they have to do work-arounds for WinJS that are not required for most other dependencies.
Already told Microsoft to drop using Bower in the default template, though they rely on a few Bower-only packages for their standard ASP.NET 5 website, like this, which they really could put on NPM as well: https://github.com/aspnet/jquery-validation-unobtrusive


Fix priority

I found that this was required for priorities to be updated properly.

Coverage decreased (-0.01%) to 49.164% when pulling 7db95c4381a96cdd5de26c1e6169ef50a432ce1a on p3nt4:patch-1 into 3ca338e8131851d5dc9a907fc84310a2f2499257 on angular-gantt:develop.

This fix is actually not sufficient. I added this line above to ensure priorities were computed correctly, but now tooltips appear under tasks with specific priorities.

I can remember this issue, and didn't found any better solution than the actual codebase. I let this one open for now in case you find a proper solution later.

Thanks for the reply.
What is weird is that priorities worked fine in version 1.2.8. Updating to 1.3.2 is what broke it for me.
Is there a different way to use it in this version?

It would help if you can identify the exact commit that breaks the feature. (you could use git bisect)

I removed the z-index attribute in the task css. It seems to work fine now.

Coverage decreased (-0.01%) to 49.164% when pulling 32be3df76aa50b0e74487cdcbdb5cd2521684e37 on p3nt4:patch-1 into 3ca338e8131851d5dc9a907fc84310a2f2499257 on angular-gantt:develop.

Merged manually, thanks !


XmlLoadDocument load big file too slow

I use XmlLoadDocument to load a big xml file about 464K, it takes a long time. then I use gprof to monitoring what takes the time and find pool_pfree is called many times and takes about 99.68% time of the whole program.
PS:
attachment CPE_000295_0000279768.zip is the big xml file.
gprof_result.zip is the result of using gprof monitoring.
CPE_000295_0000279768.zip
gprof_result.zip

@fjocean
You can change the pool alloc size in libpool/include/cwmp/pool.h
#define POOL_MAX_ALLOC_FROM_POOL  (1024 - 1)
#define POOL_DEFAULT_SIZE    (1024)
to
#define POOL_MAX_ALLOC_FROM_POOL  (102410 - 1)
#define POOL_DEFAULT_SIZE    (102410)

okay, thanks


Error in COCO Dataset

The dataset that you have linked in the project is giving errors. I had to download the original dataset from the official site again to make it work. Please look into this matter.

Thank you for opening this issue, I just tested README-Step 1 to download the coco-data from the reference [3] in README: http://images.cocodataset.org/annotations/annotations_trainval2017.zip. With Google Chrome, download finished with no errors.
Can you please provide me some additional information to reproduce the issue?
Thanks in advance!

Actually when I downloaded it and tried to open with Coco API it was giving error that 'can't load the annotations then I redownloaded the dataset from the Coco website and it was not giving error

Thank you, my documentation in https://tobiassunderdiek.github.io/cartoon-gan/#tc1_3 was very misleading, I just corrected it.
After downloading and unzipping the annotations, please configure in file cartoon-gan/phot_downloader.py the path where the unzipped annotations folder lies, https://github.com/TobiasSunderdiek/cartoon-gan/blob/master/photo_downloader.py#L7

Documentation updated

I hope this helps to solve your issue?

Yeah thanks a lot

Great, thank you for helping me making this repo better by having opened this issue!
I'll close it now, best regards


JsonSegmentMarshaller ctor throws System.IndexOutOfRangeException

Hi, I'm getting this issue running xunit integration tests in parallel

after a quick google search seems like the exception is being thrown because Dictionary is not thread safe on add.
looking at the code seems like the crashing one is in this call
https://github.com/aws/aws-xray-sdk-dotnet/blob/master/sdk/src/Core/ThirdParty/LitJson/JsonMapper.cs#L914
and if we swap the dictionaries used on JsonMapper for ConcurrentDictionary it may resolve the issue, or just adding another lock to avoid this particular case.
https://github.com/aws/aws-xray-sdk-dotnet/blob/master/sdk/src/Core/ThirdParty/LitJson/JsonMapper.cs#L134
let me know if you would take a pull request,
Regards.

Hi @rudygt ,
Thank you for the post.
Could you please help me to reproduce the issue (eg: link to integration tests integrated using xUnit)
Also can you please let me know your motivation behind using xUnit test framework instead of the provided MSTest framework?
Thanks,
Yogi

Hi @yogiraj07 , sorry if I didn't explain myself,
I'm using the xray recorder on a project of mine, in that project I'm using aspnetcore, I'm using xunit to run my integration tests and to speed things up I execute them with the parallel setting enabled.
every now and then I see this exception thrown.
I will try to create an isolated test to reproduce this issue so you can have a better idea.
thanks!

Hi @rudygt ,
Thanks for providing the code to reproduce your issue. However, looking at the DoLoop() method, I am unable to understand the reason for testing the JsonSegmentMarshaller. When testing the JsonSegmentMarshaller directly, it is possible to run into threading issues since the underlying implementation may not be thread-safe. Therefore, JsonSegmentMarshaller should not be used directly, as it is managed by AWSXRayRecorder Instance which itself is thread-safe.
I would request you to update the AWSXRayRecorder package to the latest version. Feel free to re-open this issue and reach to us if you have any trouble with this.
Best,
Prashant.


Forever 0.5.1 with GlusterFS

Hello, my infrastructure need using glusterfs, and distributing my nodejs code, but since using forever v0.5.1 if i edit the file from other server, the forever didn't restart it,
so i still using v0.14.1 , and it's works, maybe some bugs or issue with v0.5.1 ? or this is a feature reduction ? thanks you

<EMAIL_ADDRESS>is no longer supported officially.


Repo key expired.

Updating from your repo,
sudo apt-get update
causes this message.
W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://download.opensuse.org/repositories/home:/kozec/xUbuntu_16.04  Release: The following signatures were invalid: KEYEXPIRED<PHONE_NUMBER> W: Failed to fetch http://download.opensuse.org/repositories/home:/kozec/xUbuntu_16.04/Release.gpg  The following signatures were invalid: KEYEXPIRED<PHONE_NUMBER>

Hi,
It's not me behind this repository you should contact @kozec.
Regards,

Yep, that's my name :)
@salamanderrake , here:
https://github.com/kozec/sc-controller/issues/121#issuecomment-263983124
Correct repository and most likely solution as well.

Sorry, I picked the first sc-controller repo I found, should have been paying attention.


Integration of merge-kit into PEFT

Feature request
Integrate merge-kit functionalities within the PEFT library to enable users to leverage the techniques provided in the library.
This could include additional merging techniques beyond TIES and DARE which are currently natively supported by PEFT.
References:
1)https://github.com/arcee-ai/mergekit
2)https://huggingface.co/docs/peft/main/en/developer_guides/model_merging#model-merging
Motivation
For beginners, especially those new to fine-tuning large language models, integrating merge-kit requires familiarity with multiple merging methods and careful handling of model weights.
PEFT could bridge this gap by providing an easy-to-use, fully integrated solution for merging model weights.
Your contribution
With ample support and guidance, I could help in the integration.

@BenjaminBossan You are correct, I am indeed referring to the methods you have mentioned. Firstly, I think that porting over the entire mergekit package will be better in the long-term?
Secondly, if we can port individual methods like DARE and TIES, would that be simpler to implement and provide a better experience for merging models than merge-kit provides?
I think it depends on how swiftly we could add the merging methods in PEFT. Could you please let me know which of the two methods you have suggest is simpler to implement?

I think it won't be easy to answer the question which of the two approaches is better. This would require a very good understanding of how mergekit is implemented, which I don't have.
To me, it looks like mergekit is more of a framework when looking at classes like this one than a utility package, even though there appear to be some standalone functions. A utility package would be easier to integrate than a framework. As such, I tend towards copying the methods into PEFT instead of relying on mergekit directly.
Before doing that, however, it would be important to figure out how beneficial the integration would be. Your main argument, as I understand it, would be to simplify the usage of mergekit functionality with PEFT. However, this could theoretically also be achieved by documentation and examples, except if mergekit is built in a way that makes it incompatible with PEFT. Do you have some experience with using mergekit with PEFT?

I have a couple of points I'd like to add. After completing a model merge process between 2 models, there is no native support within mergekit to perform finetuning with LoRA or by using the TRL Library to help improve performance after merging.
Secondly, model merging itself is a practice that is being increasingly adopted by companies to help improve model performance, so I think it would be beneficial to add the merging methods to the PEFT library, if integration of mergekit seems to be difficult. Let me know if this makes sense, and how can we proceed further.
References:

Thanks for the additional context. In that light, I think the more promising way forward is to integrate the methods directly into PEFT without reliance on mergekit. Of course, when it makes sense, we can copy, or at least stick very closely to, the mergekit functions that implement the actual merging logic. Of course, we should attribute mergekit in that case.
If you want to give this a go, that would be fantastic. Feel free to ask any question that comes up and to open draft PR to get early feedback. You can check how DARE and TIES are implemented and see if you could add a new method, maybe you have an idea which ones are most popular.
The current implementations live here:
https://github.com/huggingface/peft/blob/214345ee4787b04636947af50ffb2f869c11613b/src/peft/tuners/lora/model.py#L595-L839
The tests can be found here:
https://github.com/huggingface/peft/blob/214345ee4787b04636947af50ffb2f869c11613b/tests/testing_common.py#L1318-L1500
This code is a bit messy and I wouldn't mind refactoring it, but that can be left as an exercise for the future.

there is no native support within mergekit to perform finetuning with LoRA or by using the TRL Library to help improve performance after merging.

Just for my understanding, the practice would be to merge two trained LoRA adapters, then fine-tune this merged adapter further? Interesting, I didn't know this was commonly done.

Thank you for your immediate reply, could you please assign this issue to me, so that this will be easier to ask for help within the HF users and OSS community.
If you want to give this a go, that would be fantastic. Feel free to ask any question that comes up and to open draft PR to get early feedback. You can check how DARE and TIES are implemented and see if you could add a new method, maybe you have an idea which ones are most popular.

This process is done to otherwise improve convergence for a model, model merging can be done for two LLMs as well, not just LoRA adapters.
Just for my understanding, the practice would be to merge two trained LoRA adapters, then fine-tune this merged adapter further? Interesting, I didn't know this was commonly done.

Could you please clarify?
cc: @BenjaminBossan

Sorry, what would you like me to clarify?

Should I implement the merging methods for the LoRA adapters only, right?
Not for entire language models?

I'll do some research on the merging methods and reach out if I need input on specific approaches.
Thanks for the feedback and we'll keep in touch.

not stale

not stale.


Add Support Additional Events

I'm interested in adding support for additional events and looking for feedback. I'd love to see support for:

Comment (Created/Updated/Deleted)
Work Log (Created/Updated/Deleted)

@levb Will #22 cover both of this?

Comments - yes, Work Log - no.
The issue with worklog hooks is that there does not appear to be enough data in the webhook message, so we need to go with Oauth/API to get more details (like the issue key - the message only seems to include the issue ID)

How about changes of the issue priority?
And how about direct messages, if the issue gets assigned to someone?

How about changes of the issue priority?

Yes

And how about direct messages, if the issue gets assigned to someone

The "re-assigned" events are now supported, but no user mapping is performed yet, so the new assignee appears in the post by JIRA name; One could set up notifications to be triggered by that, but may be kind of spammy.

To summarize the conversation

Comment (Created/Updated/Deleted)

This has been added with https://github.com/mattermost/mattermost-plugin-jira/pull/22, and scheduled for Jira v2.0 release.

Work Log (Created/Updated/Deleted)

Not planned, but I've opened a help wanted ticket. We welcome contributions to add support for these events.
https://github.com/mattermost/mattermost-plugin-jira/issues/85

How about changes of the issue priority?

This is planned to be supported by a new Jira subscription feature, scheduled for Jira v2.1 release. The subscription feature was started with https://github.com/mattermost/mattermost-plugin-jira/pull/61, and we have a Jira ticket to include issue priority notifications as part of this feature (see https://mattermost.atlassian.net/browse/MM-15678).

And how about direct messages, if the issue gets assigned to someone?

This has been added with https://github.com/mattermost/mattermost-plugin-jira/pull/62, along with a slash command (/jira settings notifications on/off) to control whether direct messages are received for issue assignments.
The feature is scheduled for Jira v2.1 release

If you are wondering about dates for Jira v2 releases, see the latest timelines here: https://github.com/mattermost/mattermost-plugin-jira#2-jira-plugin-v2-roadmap

Thank you all for the feedback! I'll close the issue based on the response above, and we'll track the outstanding items via

https://github.com/mattermost/mattermost-plugin-jira/issues/85
https://mattermost.atlassian.net/browse/MM-15678

If you have any questions, don't hesitate to let me know!


Implement Windows Services API

In order for Windows to run OpenTakRouter as a service, we need to implement the services api. It might also be a good idea to add the systemd api at the same time.

It appears this may be as simple as adding .UseWindowsService() and .UseSystemd() to the host builder.


Optional flag to set AWS_PROFILE when run

Feature Request
Is your feature request related to a problem? Please describe.
No, just different functionality of the aws cli.
Describe the solution you'd like
setting the AWS_PROFILE environment variable locally in the shell when run to the account that is specified when the -p flag is used.
Describe alternatives you've considered
I often run ssocreds thinking that I will be ready to use whatever aws cli app or tool I am wanting to use, but sometimes it still fails because AWS_PROFILE is not set to the right account, despite having run  ssocreds  for the correct account. When I realize this is the case, I manually have to run export AWS_PROFILE=the account I want, or the equivalent for whatever shell I'm in.
I've considered forking this repo and adding that feature myself, but I'd rather not have to solely maintain my own fork...
Are you willing to resolve this issue by submitting a Pull Request?

[x] Yes, I have the time, and I know how to start.
[ ] Yes, I have the time, but I don't know how to start. I would need guidance.
[ ] No, I don't have the time, although I believe I could do it if I had the time...
[ ] No, I don't have the time and I wouldn't even know how to start.
Not sure exactly when I'll find the time but I can probably pull this together, especially because there is no rush.

Maybe I'm a fool for submitting this feature and maybe it shows that I completely misunderstand the AWS CLI and related topics. If so, I'm willing to accept that haha. I'm new to all of this, but in my specific use case, it seems like a feature like this would be useful. Any comments? If no one says anything I think I'd like to start working on this sometime soon. Working on CLI apps is fun.

I think this would be a great addition, PR welcome!

School just started and its a heavier workload than I anticipated. I've still got this on my todo list but It's lower on the priority right now. I'll get to it eventually!

School just started and its a heavier workload than I anticipated. I've still got this on my todo list but It's lower on the priority right now. I'll get to it eventually!

No worries! We all have our day jobs to tend to :smile:

Unfortunately it looks like this feature is basically impossible by design of modern shells. Setting the environment of the parent shell from a child process is very difficult/annoying for shell scripts, and seemingly impossible from a node app.
If curious, read here. I read a lot of other comments and pages that say the same thing. There are workarounds, but those are not really compatible with how a globally installed npm module running as a CLI app works.
This is a bummer, but makes sense. I'll just keep using the shell-specific export command after running ssocreds when the opportunity calls for it 🥲.


Add support for setting display config to cloned / extended

I am porting an app from Windows to Flutter (for Windows), and would like to be able to set display config on startup to cloned desktop (same on both screen) or extended desktop.
As far as my own research goes, I think it is SetDisplayConfig that must be used. Afaik it is not implemented yet in the win32 pacakge.
Is it possible to do this with the win32 package?

Looks easy enough. Will address when I'm back at a computer (on phone now).


Prompt Templates

Create collection of well known working gpt-3 prompts as shorcuts.
https://github.com/semiosis/prompts
https://github.com/semiosis/prompts/tree/master/prompts
 I had to write down all the reasons why <1>
  This is my list:
  -
engine: OpenAI Davinci
temperature: 0.8
max-generated-tokens: 200
top-p: 1
cache: true
stop-sequences:
- "\n\n"

Awesome! Writing good prompts is so important with GPT3. Looking forward to it!

Added in #70


Add exclude behavior on facets

Codecov Report

Merging #715 into master will decrease coverage by 0.04%.
The diff coverage is 93.02%.

@@            Coverage Diff             @@
##           master     #715      +/-   ##
==========================================
- Coverage   99.72%   99.67%   -0.05%
==========================================
  Files         264      264
  Lines        6802     6826      +24
  Branches     1588     1595       +7
==========================================
+ Hits         6783     6804      +21
- Misses         19       22       +3

Impacted Files
Coverage Δ

src/components/facets/FacetConnected.tsx
100% <100%> (ø)
:arrow_up:

src/components/facets/FacetReducers.ts
100% <100%> (ø)
:arrow_up:

src/components/facets/Facet.tsx
100% <100%> (ø)
:arrow_up:

src/components/facets/FacetRow.tsx
90% <90%> (-5.24%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0e20633...0727849. Read the comment docs.

How do you exclude a row?
You should run npm run lintfix. The EOL changed for the package.json.

To exclude a facet you need to click on hidden button to the full right of the row -> http://nimb.ws/ZaVGzu. Lint fix is already done. If the EOL changed in package.json it's because I merged master and lintfix seems to not affect package.json file.