[Build Failure] Int64 conversion to GethBigInt

Issue:
Unable to build pod due to the below error.
Error: Cannot convert value of type 'Int64' to expected argument type 'GethBigInt!' at buildtime
Installation: CocoaPods v1.5.0
Version: web3swift (0.0.9)
Dependency Versions: CryptoSwift (0.8.1), Geth (1.7.3)
Repro Steps:

Create empty project
Install web3 via CocoaPods
Build (failed)

Screenshot(s)

Solved by updating dependencies with pod update web3swift


feat: Add pydantic config models

To improve typing within the codebase w.r.t. to the config objects, I transitioned the jsonschemas to pydantic models.
Those model will make the supervisor a lot more concise as all the validation logic will be stripped out and arguments will have proper typing. As a result it will be a lot easier to have uniform benchmarking across several pipeline steps without significant code duplication (needed for policy evaluation)

Großartig! Thank you for this pain saver!


Put  Advanced Topics / Shaders into alphabetical order

@PirateJC - for you :-)

LGTM adding @PirateJC to double check and merge ?


update to 0.11 release

with features in the latest release the estimators should be renamed, the code should be:
       var pipeline = mlContext.Transforms.Normalize(
        new NormalizingEstimator.MinMaxColumnOptions(inputColumnName: "Features", outputColumnName: "MinMaxNormalized", fixZero: true),
        new NormalizingEstimator.MeanVarColumnOptions(inputColumnName: "Features", outputColumnName: "MeanVarNormalized", fixZero: true),
        new NormalizingEstimator.BinningColumnOptions(inputColumnName: "Features", outputColumnName: "BinNormalized", numBins: 256));

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9035eb02-911d-e608-28b5-714af6f2fdad
Version Independent ID: 96b429f0-6a04-91fe-bd77-e7a675c3bbd1
Content: Preprocess training data with normalizers to use in data processing - ML.NET
Content Source: docs/machine-learning/how-to-guides/normalizers-preprocess-data-ml-net.md
Product: dotnet-ml
GitHub Login: @JRAlexander
Microsoft Alias: johalex

Addressed as part of #11613


H2O-GPT on AMD GPUs (ROCm)

Hi, How can we run H20-GPT on AMD-GPUs using the AMD ROCm libraries.
One can easily run an inference server on Ollama using ROCm thereby H2O-GPT needs to use this Ollama server for inferencing.
Problem: H2o-GPT install fails as it keeps finding CUDA during install. Some guidance here on editing the install script for ROCm would be helpful,
Method:

LLM runs on an inference server using ROCm
H2o-GPT sends LLM requests to the inference server

Can you share what you mean by it finds CUDA during install and fails?  Maybe logs etc.?
I adjusted one block In docs/linux_install.sh CUDA is mentioned.

Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
/tmp/pip-install-jav98t1i/flash-attn_c0c8ed92b3c147bfa04d7e6ab7c98f49/setup.py:95: UserWarning: flash_attn was requested, but nvcc was not found.  Are you sure your environment has nvcc available?  If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.
warnings.warn(
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "/tmp/pip-install-jav98t1i/flash-attn_c0c8ed92b3c147bfa04d7e6ab7c98f49/setup.py", line 179, in
CUDAExtension(
File "/home/rohit/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1074, in CUDAExtension
library_dirs += library_paths(cuda=True)
File "/home/rohit/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1201, in library_paths
if (not os.path.exists(_join_cuda_home(lib_dir)) and
File "/home/rohit/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2407, in _join_cuda_home
raise OSError('CUDA_HOME environment variable is not set. '
OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.
  torch.__version__  = 2.2.1+cu121

  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
It should not be uninstalling ROCm-Torch
Attempting uninstall: torch
Found existing installation: torch 2.5.0.dev20240822+rocm6.1
Uninstalling torch-2.5.0.dev20240822+rocm6.1:
Successfully uninstalled torch-2.5.0.dev20240822+rocm6.1
Attempting uninstall: sse_starlette
Found existing installation: sse-starlette 0.10.3
Uninstalling sse-starlette-0.10.3:
Successfully uninstalled sse-starlette-0.10.3
Attempting uninstall: torchvision
Found existing installation: torchvision 0.20.0.dev20240823+rocm6.1
Uninstalling torchvision-0.20.0.dev20240823+rocm6.1:
Successfully uninstalled torchvision-0.20.0.dev20240823+rocm6.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
tts 0.22.0 requires numpy==1.22.0; python_version <= "3.10", but you have numpy 1.26.4 which is incompatible.
tts 0.22.0 requires pandas<2.0,>=1.4, but you have pandas 2.2.2 which is incompatible.
awscli 1.34.5 requires docutils<0.17,>=0.10, but you have docutils 0.21.2 which is incompatible.
fiftyone 0.25.0 requires sse-starlette<1,>=0.10.3, but you have sse-starlette 2.1.3 which is incompatible.
torchaudio 2.4.0.dev20240823+rocm6.1 requires torch==2.5.0.dev20240822, but you have torch 2.2.1 which is incompatible.
vllm 0.5.5+rocm614 requires pydantic>=2.8, but you have pydantic 2.7.0 which is incompatible.
Successfully installed docutils-0.21.2 pandas-2.2.2 pydantic-2.7.0 pydantic-core-2.18.1 pypandoc_binary-1.13 sse_starlette-2.1.3 torch-2.2.1 torchvision-0.17.1

Do we have an ROCm Docker image?


Button change effect app

Resolve issue #144
Added the buttons color changing effect project in the repository.
This web app allows a user to select any one color from the options that are being to the user and as the user clicks on the color all the button changes to that particular color.

@RiyaGupta89, please update the description and mention the issue number. Thanks.

@harshita2216  Done. I edited my message. Please have a look.

@harshita2216 Where is index.md?

Can't find index.md, which command should i run?

Can't find index.md, which command should i run?

@RiyaGupta89  do again fetch the upstream of original repo & merge it to ur cloned repo then check again hope u will find that folder ...

@Ayushparikh-code  @harshita2216  Added the project in index.md also added a readme file. Please review my PR.

How can I resolve the issue? Please help.

@RiyaGupta89, update your fork please. Then add your project in the index.md file.

@RiyaGupta89, I have resolved the conflicts. Please check the image only then we'll merge it.

I can see my images here, i don't know why its not visible there. I did the same in survey form website,  there it worked completely fine.

Or else merge this one, i will create a seperate issue for correcting images, if there are any problem with images.

@harshita2216 Oh, okay. Thanks alot.


⚠ Bofrost.at has degraded performance

In 07c6ecc, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2782 ms

Resolved: Bofrost.at performance has improved in 719b23e.


Restore a missing #[test]

@bors: r+

:pushpin: Commit e680bae has been approved by alexcrichton

:hourglass: Testing commit e680bae with merge 6b8ec15...

Appveyor routinely takes 2 hours per build and has no parllelism. Appveyor also tests the PR, the merge commit on auto, and also the merge commit on master. That's 6 hours of testing for one PR, which means 4 PRs can land in one day. With 8 PRs in the queue today alone this will take at least 48 hours to land everything (much less run dist builds on appveyor).
I'm just gonna merge what's green on travis, there's no way we can reasonably block on appveyor right now it's so slow.

We should disable all but one target for PRs and master, and disable builds of the auto branch entirely. It's less thorough but it's better than no testing at all on appveyor.


Franz 5.0 beta 8 doesn't open link in Chrome, it opens a small popup instead

Franz 5.0 beta 8 doesn't open link in Chrome, it opens a small popup instead

Expected Behavior

If I clicked on a link in email/chat from Franz, it should open that link in my default browser (Chrome) instead of open an small popup in Franz itself.
Current Behavior

Franz open an small blank popup
Screenshots (if appropriate):

Possible Solution

n/a
Steps to Reproduce (for bugs)

Add Office 365 to Franz
Receive an email with links.
Click on a link.

Context

Your Environment

Franz Version used: 5.0 beta 8
Operating System and version: Windows 10 64bit EN.

👍
Happens for me too with the following:
Service: Gmail
Version: Version 5.0.0-beta.18 (5.0.0-beta.18.903)

Possible duplicate of #685


MVPoly: improve from_variable and support "next row" in from_expr

I understand you are using a new variable to handle next row columns
shouldn't you use the same variable multiplied by omega ?

I understand you are using a new variable to handle next row columns shouldn't you use the same variable multiplied by omega ?

No. mvpoly contains the evaluation, not the point we evaluate at.

Just discussed with @marcbeunardeau88: we should have something more descriptive than just integers, something like Atoms that contains the description Challenge, Variable (with curr and next row).


Add an Objective-C implementation

Hi,
This PR adds an Objective-C implementation.

Hi @woxtu, thank you very much for the PR! Sent you a maintainer invite to the repo (feel free to push as needed). Looks pretty solid to me, I'll update the website 👍 Is there anything major left to do?

We haven't set up GitHub Actions yet.

Sounds good 👍  I can see you have access now, so let me know if you have any questions or any issues come up.
Site updated. Glad to have Objective-C onboard, thanks for the work! :)

OK, I'll do that and release the first version (just create a tag) later.


add a2c algorithm

🚀 Feature
add A2C algorithm in openrl
Motivation
No response
Pitch
No response
Alternatives
No response
Additional context
No response
Checklist

[X] I have checked that there is no similar issues in the repo
[X] I have read the documentation

added in #226
code example: https://github.com/OpenRL-Lab/openrl/tree/main/examples/cartpole


Update startup-troubleshooting.md

Description
Updated "Known issues" because solution was found.
Fixes 1

Thanks for the suggestion and testing this out! Send you some appreciation on Discord :)


Automated Package Upgrade

:tada: This PR is included in version 7.0.136 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Database synchronization problem for multi-servers.

Hello, still having no answer and solution for the topic #511, I allow myself to relaunch the subject because I also have the same problem of synchronization between my servers. However, my 2 job configurations are configured on the same database but the data does not synchronize at all between the 2 servers. That is, if I join a trade on server A, by going to server B, I do not have it. Similarly if I pass lvl 10 on a job on server A, and I go on server B, I lost my level progress. Currently the plugin is not at all functional for multi-servers and that for months. I am desperately waiting for a fix of this problem that becomes more than URGENT!
I hope you can do some things for it quickly because it really starts to become a pain for the players.
I use the latest build on the github, the latest version of paper in 1.14.4. I want to point out that I have other plugins in databases and they have no problem of synchronization ...

I highly can confirm this issue. We also have the same BIG Problem on our server. Please could montlikadani or Zribs test this strange behaviour and give us a feedback and hopefully a bugfix. This would be very nice. Thanks a lot!!!
We are also using the latest paper version 1.14.4 and the latest version of the jobs-plugin.


Update scala-library to 2.13.6

Updates org.scala-lang:scala-library from 2.13.5 to 2.13.6.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-lang", artifactId = "scala-library" } ]

labels: library-update, semver-patch

https://github.com/scala/scala/releases/tag/v2.13.6


Choose sharding_key for shrading based on IP address

Hi guys, I'm new to clickhouse. I'd like to shard a table based on the IP address field. So I'm gonna use the DIstributed engine. But I'm wondering what shrading_key I should choose. I know clickhouse only support hash and rand(). Which hash function should I choose for the IP address field in this senerio?

If you store IPv4 address in UInt32, intHash64 will suffice,
otherwise use cityHash64.


Update grafana domain and thanos endpoint

Description
Updating grafana domain to fix the grafana's "shorten URL" feature and update the thanos endpoint to the query frontend in order to get better performance thanks to caching and query splitting. ref: https://thanos.io/tip/components/query-frontend.md/#query-frontend
cc: @morenod

Fine with me!


Correct handling of "more" replies

The examples in the documentation show "more" in the response to be a URL, but it shouldn't be treated as such. Rather, it should be passed in opaquely as the "more" parameter in the next request.
Note that I haven't tested this either way; I was simply reviewing some code and docs and noticed that they didn't match.

We're good. Until V2 api comes out.

What you are doing is fine. That note about 'may change without notice' is talking about the value of the 'more' url parameter that you see in that url you posted, not the value of the 'more' property returned in the results.
It's a bit confusing, I admit. We're actually changing it in version 2 of our API that will come out with 2018.1 Engine (v1 of the API will still be there, though). In the new API we will be returning the more token (not the full url) in the response, and then you'd turn around and call the endpoint again passing in that token.
However, in v1 of the API that you are using, you either do what you're doing now (use the more url from the response directly in a second request), or you could parse that 'more' url to pull off only the 'more' token and then use that in a call to the API. That option might make more sense if you were using the client library methods to make the calls.


Clustering - broker/data alone couldn't start

If I set data enabled=false the influxdb couldn't start. Log:
failed to start reporting because not running as a broker and a data node

0.9-rc27

Same if I set a first machine with broker and data node and second one if I set only data enabled
[srvr] 2015/04/27 13:42:15 influxdb started, version 0.9.0-rc27, commit c887dfe2a86ca7dc6a06710b6a787d37734a23b4
[srvr] 2015/04/27 13:42:15 Cluster server listening on [::]:8086
[srvr] 2015/04/27 13:42:15 data node(0) opened at /var/opt/influxdb/db
[messaging] 2015/04/27 13:42:15 connected to broker: http://<IP_ADDRESS>:8086/messaging/messages?index=3&streaming=true&topicID=0
[srvr] 2015/04/27 13:42:16 join: failed to connect data node: http://localhost:8086: unable to join
[srvr] 2015/04/27 13:42:16 join: failed to connect data node to any specified serv

Try adding:
reporting-disabled = true

to your broker config.

ok it is working in disable reporting
but if you dont set hostname in data node, it registered with localhost, Then if you set it, broker continue  to hitting it:
broker cq: error hitting data node: http://localhost:8086: request returned status 307 Temporary Redirect

You'll need to wipe out your data dirs and restart w/ the correct hostname.  #1471 is not implemented yet so there is no way to remove a node yet.

Brokers are no longer part of the design - closing this issue.


push images to opdev

push images to opdev

the l5 bestie repo is https://github.com/makon57/bestie-l5-op


lowdown: 0.8.3 -> 0.8.4

https://github.com/kristapsdz/lowdown/blob/148f9b2f586c41b7e36e73009db43ea68c7a1a4d/versions.xml#L1083-L1097
Enable test suite.

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

@ofborg build lowdown

Result of nixpkgs-review pr 119300 at b5ae82cb run on x86_64-linux 1

1 package failed to build:

dydisnix

8 packages built successfully:

disnix
disnixos
hydra-unstable
lowdown
nix-direnv
nix-update
nixFlakes (nixUnstable)
nixpkgs-review

Note that build failures may predate this PR, and could be nondeterministic or hardware dependent.
Please exercise your independent judgement.


implement a block for the go-http-client User-Agent tool that is over…

…loading pypi backends with /simple requests lacking a trailing slash
This continues... still no idea what it is. This hammer needs to drop to keep us from chasing the blasts, and has the added benefit of relaying a comms address for those who will be impacted.

For reference, comparing baseline backend request volume to when one of these is running:


fix(labs): filter out (group layouts)

Overview

What is it?

[ ] Feature / enhancement
[x] Bug
[ ] Docs / tests / types / typos

Description
The change omits pathless routes aka. group layout segments from the path -> route mapping.
Use cases and why

Actual: /some/(grouped)/route/index.tsx -> /some/(grouped)/route/
Expected: /some/(grouped)/route/index.tsx -> /some/route/
Checklist:

[x] My code follows the developer guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have made corresponding changes to the documentation
[ ] Added new tests to cover the fix / functionality

I cannot get Qwik Repo (neither in Dev Containers nor on my machine) to run ftm without polluting each and every file with invisible (suspected EOL) changes.

I see you are using qwik-types, I would love to get your feedback.

I see there is a linting error, and I can't push a fix to your repo. So I have created a second PR with the change https://github.com/BuilderIO/qwik/pull/5171 and will close this one in favor of that ano. Thanks again...

I see you are using qwik-types, I would love to get your feedback.

I see there is a linting error, and I can't push a fix to your repo. So I have created a second PR with the change #5171 and will close this one in favor of that ano. Thanks again...

Thank you, I am very excited to make some contributions to the project. I previously had experience with a similar feature written for Remix Run, so it naturally makes me a little bit curious.
P.S.: After figuring out of how to ftm on Windows without sideeffects.


[SUPPORT].UnresolvedUnionException: Not in union exception occurred when writing data through spark

Tips before filing an issue

Have you gone through our FAQs?

Join the mailing list to engage in conversations and get faster support at<EMAIL_ADDRESS>

If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced
A clear and concise description of the problem.
To Reproduce
Steps to reproduce the behavior:
Data upsert to hudi through spark
This exception will appear after multiple executions, which seems to trigger the archive operation
Expected behavior
A clear and concise description of what you expected to happen.
Environment Description

Hudi version :0.12.1

Spark version :3.1.1

Hive version :2.7.3

Hadoop version :3.1.2

Storage (HDFS/S3/GCS..) :HDFS

Running on Docker? (yes/no) :no

Additional context
/data/spark3/bin/spark-submit
--master yarn
--name xxxxx
--deploy-mode cluster
--driver-memory 4g
--num-executors 5
--total-executor-cores 6
--executor-memory 12g
--conf spark.memory.fraction=0.85
--conf spark.memory.storageFraction=0.85
--queue default
--class Kudu2Hudi     spark_dependence_jar/hudi/hudi.jar
Stacktrace
23/02/07 02:00:01 ERROR HoodieTimelineArchiver: Failed to archive commits, .commit file:<PHONE_NUMBER>4304071.clean.requested
org.apache.avro.UnresolvedUnionException: Not in union ["null",{"type":"map","values":{"type":"array","items":{"type":"string","avro.java.string":"String"}},"avro.java.string":"String"}]: KEEP_LATEST_FILE_VERSIONS
	at org.apache.avro.generic.GenericData.resolveUnion(GenericData.java:740)
	at org.apache.avro.generic.GenericDatumWriter.resolveUnion(GenericDatumWriter.java:205)
	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:123)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:75)
	at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:166)
	at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:156)
	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:118)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:75)
	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:125)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:75)
	at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:166)
	at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:156)
	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:118)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:75)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:62)
	at org.apache.hudi.common.table.log.block.HoodieAvroDataBlock.serializeRecords(HoodieAvroDataBlock.java:119)
	at org.apache.hudi.common.table.log.block.HoodieDataBlock.getContentBytes(HoodieDataBlock.java:131)
	at org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlocks(HoodieLogFormatWriter.java:158)
	at org.apache.hudi.common.table.log.HoodieLogFormatWriter.appendBlock(HoodieLogFormatWriter.java:135)
	at org.apache.hudi.client.HoodieTimelineArchiver.writeToFile(HoodieTimelineArchiver.java:671)
	at org.apache.hudi.client.HoodieTimelineArchiver.archive(HoodieTimelineArchiver.java:643)
	at org.apache.hudi.client.HoodieTimelineArchiver.archiveIfRequired(HoodieTimelineArchiver.java:171)
	at org.apache.hudi.client.BaseHoodieWriteClient.archive(BaseHoodieWriteClient.java:909)
	at org.apache.hudi.client.BaseHoodieWriteClient.autoArchiveOnCommit(BaseHoodieWriteClient.java:629)
	at org.apache.hudi.client.BaseHoodieWriteClient.postCommit(BaseHoodieWriteClient.java:534)
	at org.apache.hudi.client.BaseHoodieWriteClient.commitStats(BaseHoodieWriteClient.java:237)
	at org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:125)
	at org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:714)
	at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:340)
	at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:144)
	at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:46)
	at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
	at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
	at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:90)
	at org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:180)
	at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:218)
	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
	at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:215)
	at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:176)
	at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:132)
	at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:131)
	at org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:989)
	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
	at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:772)
	at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
	at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:989)
	at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:438)
	at org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:415)
	at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:293)
	at Kudu2Hudi$.main(Kudu2Hudi.scala:120)
	at Kudu2Hudi.main(Kudu2Hudi.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:732)
23/02/07 02:00:01 ERROR HoodieTimelineArchiver: Failed to archive commits, .commit file:<PHONE_NUMBER>4304071.clean.inflight.```

nothing special about this setup so it looks like a data issue. @nbeeee can you share the schema and some sample data to help reproduce? cc @jonvex

sql:
SELECT
trim(compid) company_id
,trim(busno) business_id
,trim(wareid) ware_id
,if(sumqty = '', null, cast(sumqty as decimal(20,4))) as sumqty
,autocomputemaxstore
,autocomputeminstore
,if(maxday = '', null, cast(maxday as decimal(20,4))) as maxday
,if(minday = '', null, cast(minday as decimal(20,4))) as minday
,if(maxstore = '', null, cast(maxstore as decimal(20,4))) as maxstore
,if(minstore = '', null, cast(minstore as decimal(20,4))) as minstore
,if(storepurprice = '', null, cast(storepurprice as decimal(20,4))) as storepurprice
,if(lastmdistqty = '', null, cast(lastmdistqty as decimal(20,4))) as lastmdistqty
,autodistapply
,if(lastm2qty = '', null, cast(lastm2qty as decimal(20,4))) as lastm2qty
,if(lastm3qty = '', null, cast(lastm3qty as decimal(20,4))) as lastm3qty
,if(lastmqty = '', null, cast(lastmqty as decimal(20,4))) as lastmqty
,if(lastyqty = '', null, cast(lastyqty as decimal(20,4))) as lastyqty
,oosdays
,if(sumawaitqty = '', null, cast(sumawaitqty as decimal(20,4))) as sumawaitqty
,if(sumpendingqty = '', null, cast(sumpendingqty as decimal(20,4))) as sumpendingqty
,if(sumawaitqty_nobatch = '', null, cast(sumawaitqty_nobatch as decimal(20,4))) as sumawaitqty_nobatch
,lastsaledate
,if(lastapplyqty = '', null, cast(lastapplyqty as decimal(20,4))) as lastapplyqty
,lastapplydate
,if(lastdistqty = '', null, cast(lastdistqty as decimal(20,4))) as lastdistqty
,lastdistdate
,if(lowestqty = '', null, cast(lowestqty as decimal(20,4))) as lowestqty
,if(onlineextqty = '', null, cast(onlineextqty as decimal(20,4))) as onlineextqty
,if(allocqty = '', null, cast(allocqty as decimal(20,4))) as allocqty
,if(minstroeqty = '', null, cast(minstroeqty as decimal(20,4))) as minstroeqty
,if(enrouteqty = '', null, cast(enrouteqty as decimal(20,4))) as enrouteqty
,if(reserveqty = '', null, cast(reserveqty as decimal(20,4))) as reserveqty
,if(sumdefectqty = '', null, cast(sumdefectqty as decimal(20,4))) as sumdefectqty
,if(shelvesqty = '', null, cast(shelvesqty as decimal(20,4))) as shelvesqty
,if(recallqty = '', null, cast(recallqty as decimal(20,4))) as recallqty
,if(resaleqty = '', null, cast(resaleqty as decimal(20,4))) as resaleqty
,if(sumtestqty = '', null, cast(sumtestqty as decimal(20,4))) as sumtestqty
,if(saledayqty = '', null, cast(saledayqty as decimal(20,4))) as saledayqty
,lastbreakdate
,lastbreakdhdate
,utimeforplat
,transplatstatus
,subitemid
,if(dayavgqty = '', null, cast(dayavgqty as decimal(20,4))) as dayavgqty
-- ,substr(breakstockdate, 1, 10) breakstockdate
,case when sumqty <='0'  and breakstockdate is null then  '2023-02-07'  else  substr(breakstockdate, 1, 10) end  breakstockdate
,time_stamp
,trim(group_id) group_id
FROM
t_store_stock
t_store_stock table data:

group_id
busno
wareid
compid
data_source
time_stamp
sumqty
autocomputemaxstore
autocomputeminstore
maxday
minday
maxstore
minstore
storepurprice
lastmdistqty
autodistapply
lastm2qty
lastm3qty
lastmqty
lastyqty
oosdays
sumawaitqty
sumpendingqty
sumawaitqty_nobatch
lastsaledate
lastapplyqty
lastapplydate
lastdistqty
lastdistdate
lowestqty
onlineextqty
allocqty
minstroeqty
enrouteqty
reserveqty
sumdefectqty
shelvesqty
recallqty
resaleqty
sumtestqty
saledayqty
lastbreakdate
lastbreakdhdate
utimeforplat
transplatstatus
subitemid
dayavgqty
breakstockdate

123456
1013
164083
123456
h1
1,676,360,535,095
0.0
1
1
60.0

7.0
3.0
14.0
1.0
1
2.0
7.0

0.0
0.0
0.0
2023-01-29 00:00:00.0

1.0
2023-01-14 09:53:57.457

0.0
0.0

nothing special about this setup so it looks like a data issue. @nbeeee can you share the schema and some sample data to help reproduce? cc @jonvex

If you take a look at the code for UnresolvedUnionException.java, the ending item is 'unresolvedDatum'. In the exception you provided, that appears to be KEEP_LATEST_FILE_VERSIONS.

If you take a look at the code for UnresolvedUnionException.java, the ending item is 'unresolvedDatum'. In the exception you provided, that appears to be KEEP_LATEST_FILE_VERSIONS.

Yes we should look into about the commit metadata itself of<PHONE_NUMBER>4304071. we can exam the content. serializing it into archived commits had schema issue. @nbeeee would be also helpful to see the complete hoodie write configs you set for this job, and .hoodie/ zip for inspection.


How to prevent 443 port adding to url with proxy environment

Hi, I have simple provider test
@Provider("OpenApi")
@PactFolder("target/pacts")
public class OpenAPIProviderTest {
	public OpenAPIProviderTest() throws MalformedURLException {
	}

	private URL url = new URL("https://jsonplaceholder.typicode.com"); // open API

	@TestTarget
	public final Target target = new HttpTarget(url);

	@State({"OpenApiTest"})
	public void getPacts() {
		System.out.println("OpenApiTest pacts accepted.");
	}`

It`s passed when I test it in environment where is no proxy.
but where is proxy I get next error

java.lang.AssertionError:
0 - Connect to jsonplaceholder.typicode.com:443 [jsonplaceholder.typicode.com/<IP_ADDRESS>, jsonplaceholder.typicode.com/<IP_ADDRESS>] failed: Connection timed out: connect

Full path is https://jsonplaceholder.typicode.com/posts/5
Why the port is added and how to make it not added, or how to run tests with proxy environment?
Thanks.

The port is the default one for HTTPS. The issue is that the HttpTarget does not work with HTTP proxies, it is designed to connect to locally running services.
One way to fix it is to create a new target that supports using proxies. See https://github.com/DiUS/pact-jvm/tree/master/pact-jvm-provider-junit#custom-test-target


Unpin pyarrow as petastorm was updated

Unpin pyarrow as petastorm was updated.

Test failures are unrelated and same on master


Download Link Windows Server Essential log collector

The download link for the Windows Server Essential log collector is not working on the link https://docs.microsoft.com/en-us/windows-server-essentials/support/install-the-windows-server-essentials-log-collector

Thanks for your dedication to our documentation. If we have been unable to review your issue in a timely manner, we sincerely apologize for the delayed response. We have captured the informtion you have provided for review. We are closing this issue for now, but if you feel that it's still a concern, please respond and let us know. If you determine another possible update to our documentation, please don't hesitate to reach out again. #please-close


Fine-tune USE on domain specific corpus

Hi,
Could you please shed some light on how to fine-tune pre-trained USE models on domain specific corpus? Vectors just need to be fine-tuned to a domain-specific context. There is no downstream supervised task or anything.
This here used to work for TF1, but TF2 deprecated hub.Module
https://github.com/helloeve/universal-sentence-encoder-fine-tune
Thanks,

Hi, #600 might be helpful. Also, the fine-tuning in your link seems supervised fine-tuning, since the sentences are classified. If that's your usecase, you can construct a dataset similarly, and concatenate the hub.KerasLayer(...) with a dense layer and train with cross-entropy loss, as shown in the first comment of #600. If you don't have the similarity info of sentences, the latter comments might be more relevant.

@AmmarRashed You should be able to use USE on domain specific corpus. If the domain has lots of vocab that is not commonly observed in typical language data, an adaption training would be better suited.
As mentioned in the above comment ass a dense layer on top of hub.KerasLayer() and it should solve your issue.

Thanks. That was helpful. I was hoping for a more straightforward solution like:
model = hub.load("https://tfhub.dev/google/universal-sentence-encoder-multilingual/3", trainable=True) model.finetune([ "list of sentences"])
Although the model is really good, in production the usage keeps changing, and the embedding scores need to adapt to the style used by the users.

As given here, i am also looking for a way to fine-tune the embeddings for my own domain specific corpus. Is there a way currently ? I dnt have labels, and cannot do Supervised training. Just need to fine-tune the embeddings, as given in the post above. Please update me. Thanks.

@anirbankonar123 This discussion is going on in this issue here. Please take a look at that issue. Thanks!

Thanks. Closing this issue as it is already being discussed in #600


Initial check-in of the Shim layer.

This is an updated PR for putting the Shim layer in a separated repo (originated from opentracing/opentracing-java#221, and tuned as per Yuri's suggestion to only ask for a review of the very Shim layer).
Notes on it overall:

Provides a default TracerShim which wraps a 0.31 Tracer with its ScopeManager, providing no Continuation support out of the box.

Provides also a AutoFinishTracerShim which wraps a 0.31 Tracer using the contained AutoFinishScopeManager, which keeps the thread-local, reference-count based logic to support Continuations.

It still throws IllegalArgumentException on null values of some methods (i.e. SpanBuilder.childOf() - throwing this would prevent a NullReferenceException when casting the wrapped object. Pavol mention we should not throw such Exception - so, what should we throw there instead? Or how should we report such errors? The spec doesn't mention thrown exceptions...

Currently it's a minimalistic approach, and wondering if we this is good enough for Tracer authors who were using their own span propagation and/or using their own Span lifetime handling.

No Travis/CentralSync support yet (will do after we get this properly merged).

Updated PR with only the Shim classes + AutoFinishScopeManager. @pavolloffay @malafeev @yurishkuro. Let me know ;)

Haven't gone through it line by line, but read through a few classes, lgtm.  Is anything in particular of a concern?  Did we try adapting existing instrumentations to use this?

So far only with MockTracer. I think @malafeev wanted to try it out with the Lightstep tracer ;)

Yes, I just tested it with LightStep tracer mixing two instrumentations: JMS with compatibility layer
and RxJava with 0.30. It works for me pretty well.

Merging. I will enable bintray/maven/travis integration and will roll out a release candidate soon. Thanks for the feedback.


Portainer Agent - two way authentication

I have a swarm 2 node swarm warning. The manager was initialized with a static --advertise-addr that is reachable by both nodes and the same with the worker. The daemon on the master is configured with 2 way authentication.
This is the stack file i'm using for portainer and the agents
version: "3.6"

services:
  portainer:
    image: portainer/portainer
    command: -H unix:///var/run/docker.sock
    hostname: manage.${DOCKER_DOMAIN}
    restart: always
    networks:
      - agent_network
    deploy:
      labels:
        - "traefik.http.routers.portainer.rule=Host(`manage.$DOCKER_DOMAIN`)"
        - "traefik.http.services.portainer.loadbalancer.server.port=9000"
      mode: replicated
      replicas: 1
      placement:
        constraints: [node.role == manager]
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - portainer_storage:/data
  agent:
    image: portainer/agent
    environment:
      AGENT_PORT: 9001
      LOG_LEVEL: debug
    ports:
      - target: 9001
        published: 9001
        protocol: tcp
        mode: host
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - /var/lib/docker/volumes:/var/lib/docker/volumes
    networks:
      - agent_network
    deploy:
      mode: global
      placement:
        constraints: [node.platform.os == linux]

volumes:
  portainer_storage:
networks:
  agent_network:
    driver: overlay
    attachable: true

The issue i'm having is both nodes are reporting this error
2019/10/15 23:27:36 [DEBUG] [main,configuration] [Member tags: map[AgentPort:9001 EngineStatus:swarm NodeName:evolution.mydomain.com NodeRole:manager]]
2019/10/15 23:27:36 [INFO] [main] [message: Agent running on a Swarm cluster node. Running in cluster mode]
2019/10/15 23:27:36 [DEBUG] [docker] [ip_address: 10.0.*.*] [network_name: management_agent_network] [message: Retrieving IP address from container network]
2019/10/15 23:27:39 [DEBUG] [main,net] [host: 192.168.*.*] [result: 1] [ip: 192.168.*.*]
2019/10/15 23:27:39 [DEBUG] [cluster,serf] [advertise_address: 10.0.*.*] [join_address: [192.168.*.*]]
2019/10/15 23:27:39 [INFO] serf: EventMemberJoin: evolution.mydomain.com-5z2d8r50cp2y 10.0.*.*
2019/10/15 23:27:39 [DEBUG] [cluster,serf] [message: Unable to join cluster] [error: 1 error occurred:
	* Failed to join 192.168.*.*: Remote state is encrypted and encryption is not configured

The daemon on the master is configured with 2 way authentication.

Can you give us more details about that? What do you mean?
Also do you have any idea where is that 192.168.*.* IP address coming from? Normally the agent should use tasks.<SERVICE_NAME> here (latest version default). Are you somehow overriding this value via the AGENT_CLUSTER_ADDR env variable?

192.168.. is Box A ( Manager node on the local network ).  10.0.. is box B ( working node on the network ).
I've tried everything configuration i could think of from the docks. If i don't override AGENT_CLUSTER_ADDR and it resolves to a docker ip address through disocvery. I am able to manage the agent on the manager node, but the agent on the worker node gives the following log response.
2019/10/16 01:58:01 [DEBUG] [main,configuration] [Member tags: map[AgentPort:9001 EngineStatus:swarm NodeName:docker-swarm-host1 NodeRole:worker]] 2019/10/16 01:58:01 [INFO] [main] [message: Agent running on a Swarm cluster node. Running in cluster mode] 2019/10/16 01:58:01 [DEBUG] [docker] [ip_address: <IP_ADDRESS>] [network_name: wpk-1] [message: Retrieving IP address from container network] 2019/10/16 01:58:04 [DEBUG] [main,net] [host: tasks.management_agent] [result: 1] [ip: <IP_ADDRESS>] 2019/10/16 01:58:04 [DEBUG] [main,net] [host: tasks.management_agent] [result: 2] [ip: <IP_ADDRESS>] 2019/10/16 01:58:04 [DEBUG] [cluster,serf] [advertise_address: <IP_ADDRESS>] [join_address: [<IP_ADDRESS> <IP_ADDRESS>]] 2019/10/16 01:58:04 [INFO] serf: EventMemberJoin: docker-swarm-host1-b4618c8f5313 <IP_ADDRESS> 2019/10/16 01:58:14 [DEBUG] [cluster,serf] [contacted_nodes: 1] 2019/10/16 01:58:14 [DEBUG] [main,configuration] [agent_port: 9001] [cluster_address: tasks.management_agent] [advertise_address: <IP_ADDRESS>] 2019/10/16 01:58:15 [INFO] [http] [server_addr: <IP_ADDRESS>] [server_port: 9001] [secured: true] [api_version: 1.5.0] [message: Starting Agent API server] 2019/10/16 01:58:23 [ERROR] [http,docker,proxy] [request: /info] [message: unable to redirect request to a manager node: no manager node found] 2019/10/16 01:58:23 http error: The agent was unable to contact any other agent located on a manager node (err=Unable to find an agent on any manager node) (code=500)

@dragonpiper can you create a swarm using an IP with --advertise-addr for the worker that is in the same subnet than the one specified with --advertise-addr when creating the manager ?


Added  cogna.com.br domain

The cogna.com.br is a conglomeration of universities, and the teachers don't have more email for specific domain of universities.

@adrianosepe First stage of verification passed, official domain is cogna.com.br as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

@adrianosepe Thank you for your patience while waiting for a review and processing your request. Pull request merged.


[macOS, 4.0] Fix unresponsive redraw during live resizing.

Fixes #59746 for master.

Works with both Vulkan and OpenGL. OpenGL is perfect, Vulkan still have a lagging frame at the resizing edge of the window, but at least the rest of the window is not constantly rescaling.

Thanks!


Prevent renaming JPEG files to JPG

I am trying to bulk convert my images but I realized that CLI converts the JPEG extensions to JPG.
Is there any parameter that I can prevent conversion?
I used below command.
squoosh-cli --mozjpeg \
'{
   "quality":75,
   "baseline":false,
   "arithmetic":false,
   "progressive":true,
   "op timize_coding":true,
   "smoothing":0,
   "color_space":3,
   "quant_table":3,
   "trellis_multipass":false,
   "trel lis_opt_zero":false,
   "trellis_opt_table":false,
   "trellis_loops":1,
   "auto_subsample":true,
   "chroma_sub sample":2,
   "separate_chroma_quality":false,
   "chroma_quality":75
}' \
-d output ./*

Also I used this one to find from all subdirectories and convert them.
find . -name "*.jpeg" -exec bash -c 'file="{}"; squoosh-cli --mozjpeg auto "$file"' \;
Version:

OS w/ version: MacOS Monterey 12.3.1
Node version: 16.15.0
npm version: 8.10.0

@thechiefalone have you been able to find the solution?

Have you tried changing the config for mozJPEG to export .jpeg as the extension instead of .jpg? I don't know if that will resolve your issue, but you can probably test it quickly.
I'd try changing this line export const extension = 'jpg'; first. If that line change doesn't produce your desired outcome, I'd change it back and then try changing this line     extension: 'jpg', next. I think one of these two ought to achieve what you're looking for without much trouble.
If you figure it out and want to help the user community here, you could probably add a config variable with options for .jpg or .jpeg and then sub that variable into whichever line change works. Then you could link it up with the interface EncodeOptions for mozJPEG to make it user-selectable.


environment variables no longer valid in workspace settings.json or tasks.json

VSCode Version: 1.33.0
OS Version: Ubuntu 18.0.4

Steps to Reproduce:

put some variables in EG: ${env:PATH}

    "terminal.integrated.env.linux": {
        "DATA": "${env:PATH};${workspaceFolder}/xtensa-esp32-elf/bin",
    }

echo out that variable in the integrated terminal

echo $DATA
;/home/bird/deako/goat/xtensa-esp32-elf/bin
Does this issue occur when all extensions are disabled?: Yes

i should note that the above example works fine for me on 1.32.3

I can confirm the same experience after upgrading to 1.33.0 on Windows.

Version: 1.33.0 (user setup)
Commit: 0dd516dd412d42323fc3464531b1c715d51c4c1a
Date: 2019-04-04T15:14:46.685Z
Electron: 3.1.6
Chrome: 66.0.3359.181
Node.js: 10.2.0
V8: 6.6.346.32
OS: Windows_NT ia32 10.0.17134

same here in tasks.json.

@sebirdman This issue is happening throughout, ${env:*} is not working anywhere in vs code. May be syntax has changed or something is missing in tasks.json documentation.

Experiencing the same issue here with

Version: 1.33.0 (user setup)
Commit: 0dd516dd412d42323fc3464531b1c715d51c4c1a
Date: 2019-04-04T15:14:28.026Z
Electron: 3.1.6
Chrome: 66.0.3359.181
Node.js: 10.2.0
V8: 6.6.346.32
OS: Windows_NT x64 10.0.17763

My current setup in c:\Users\Ricardo\AppData\Roaming\Code\User\settings.json is
...
    "terminal.integrated.shell.windows": "C:\\Windows\\System32\\cmd.exe",
    "terminal.integrated.env.windows": {
        "PATH": "${env:PATH}"
    },
...

It was working before I updated VSCode this morning.
Will be following this issue, as I couldn't find an answer in the related issues.

Same issue here:
Version: 1.33.0 (user setup)
Commit: 0dd516dd412d42323fc3464531b1c715d51c4c1a
Date: 2019-04-04T15:14:28.026Z
Electron: 3.1.6
Chrome: 66.0.3359.181
Node.js: 10.2.0
V8: 6.6.346.32
OS: Windows_NT x64 10.0.17134

same here in tasks.json. On macOS.
Edit: replacing ${env:HOME} with ${HOME} fixed my problem. It that the new way of doing it ?

I think what you see happening is ${HOME} being interpreted by your shell, not VSCode. For instance, on Windows I have WSL set as the shell for a project, and ${HOME} evaluates to /home/user, and ${LOCALAPPDATA} to nothing. I need to be able to evaluate ${env:LOCALAPPDATA}, but that is no longer possible.

Any fix for windows?

Same issue here on Windows. And I was doing a demo for a client (which failed as a result on this particular point). That was rather awkward. It would be great if the VS Code team could solve this.

Looks like #72029

/duplicate #72029, fyi @alexr00


Can not change the namespace

It should be possible to configure each of these settings:

namespace: "lips",
font: "Arial.ttf",
fontSize: "24px",
fontColor: "000000",
text: false,
fill: "09F",
port: process.env.PORT || 3000,
delay: 0,
contentType: "png",
maxAge: 3153600,
noLog: false,
expiryDate: new Date()

since I've tried to change the namespace to "if-images" it did not respect that and used the default "lips" namespace.

use:
https://github.com/indexzero/nconf


server keyword for calling rpc on server

I have some network code where the clients are the master and the server is but a slave. This is for my primary player controller class.
Now, often I'm finding I still want the server to be in control of a lot of things even though the each client is really the master.
I propose another keyword for gd script "server" which guarantees the rpc will only be called on the server regardless of who the master is.

What do you think about it @Faless ?

@Chaosus I would say either use sub-nodes with network_master=1 (probably best) or use the remote keyword and guard it with if get_tree().get_rpc_sender_id() != 1: return

Closing, there is no much activity in this issue. If there's still interest it should probably go through the godot proposal repository.
In general, I don't like the idea of adding an architecture-dependent keyword to the high level multiplayer API, which as of now can be peer to peer if desidered,


Dropdown on left side of action input with wrong border-radius

The issues can be seen here:
http://jsfiddle.net/2gp655p0/
In an .ui.action.input a .ui.dropdown on the left side will be interpreted as action, so its not possible to combine a dropdown left and a button right and have them rounded correctly on the outside.
A simple fix on the first-child dropdown in an action input would be:
.ui.action.input:not([class*="left action"]) > .dropdown:first-child {
  border-radius: @borderRadius 0px 0px @borderRadius;
}

Thanks for posting  this. Everything looks good.
I've attached a milestone and will be reviewing this as soon as I can.

I've gone a slightly different direction with the fix, but should resolve the issue.

ok


Handle chunk uploaded binary bundle un-bundling

Closes #119
Check bundle tx data_size against last chunk offset - first chunk offset + last chunk length

Thanks @jim-toth for the PR 🙏🏼


Microsoft.CodeAnalysis.Elfie.dll as part of .omnisharp folder of extension marked as infected

Issue Description
Microsoft.CodeAnalysis.Elfie.dll being marked as infected with trojan by BitDefender.

Been using BitDefender as my antivirus for years while also using VSCode with Omnisharp for development. First time it has marked that dll as being infected. Now this could either be on bitdefenders end where they updated the signature for that trojan that is now causing a false positive on that dll or that file might have been updated in a nuget package and some malicious code made its way into it.
Edit: Just as note to test I deleted the extension folder from .vscode\extensions and reinstalled it through vscode and once downloaded and installed by vscode the file was once again marked infected (installed fresh as seen from C# log)
Steps to Reproduce
Load VSCode
Expected Behavior
Not having the Microsoft.CodeAnalysis.Elfie.dll part of .omnisharp folder of VSCode extension marked as infected.
Actual Behavior
Microsoft.CodeAnalysis.Elfie.dll should not be infected (*possibly?)
Logs
OmniSharp log

OmniSharp server started with .NET 6.0.201
.
    Path: c:\Users\\.vscode\extensions\ms-dotnettools.csharp-1.24.1\.omnisharp\1.38.2-beta.40-net6.0\OmniSharp.dll
    PID: 18892
    Starting OmniSharp on Windows 10.0.19044.0 (x64)

    Checking the 'DOTNET_ROOT' environment variable to find a .NET SDK

    Using the 'dotnet' on the PATH.

    DotNetPath set to dotnet

    Located 2 MSBuild instance(s)
        1: .NET Core SDK 6.0.201 17.1.0 - "C:\Program Files\dotnet\sdk\6.0.201\"
        2: .NET Core SDK 6.0.103 17.0.0 - "C:\Program Files\dotnet\sdk\6.0.103\"

    Registered MSBuild instance: .NET Core SDK 6.0.201 17.1.0 - "C:\Program Files\dotnet\sdk\6.0.201\"

System.Reflection.ReflectionTypeLoadException: Unable to load one or more of the requested types.
Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
at System.Reflection.RuntimeModule.GetTypes(RuntimeModule module)
at System.Reflection.RuntimeAssembly.get_DefinedTypes()
at System.Composition.Hosting.ContainerConfiguration.<>c.b__16_0(Assembly a)
at System.Linq.Enumerable.SelectManySingleSelectorIterator2.MoveNext()    at System.Composition.TypedParts.TypedPartExportDescriptorProvider..ctor(IEnumerable1 types, AttributedModelProvider attributeContext)
at System.Composition.Hosting.ContainerConfiguration.CreateContainer()
at Microsoft.CodeAnalysis.Host.Mef.MefHostServices.Create(IEnumerable1 assemblies)    at OmniSharp.OmniSharpWorkspace..ctor(HostServicesAggregator aggregator, ILoggerFactory loggerFactory, IFileSystemWatcher fileSystemWatcher) in D:\a\1\s\src\OmniSharp.Roslyn\OmniSharpWorkspace.cs:line 53    at lambda_method16(Closure , LifetimeContext , CompositionOperation )    at System.Composition.TypedParts.ActivationFeatures.DisposalFeature.<>c__DisplayClass0_0.<RewriteActivator>b__0(LifetimeContext c, CompositionOperation o)    at System.Composition.Hosting.Core.LifetimeContext.GetOrCreate(Int32 sharingId, CompositionOperation operation, CompositeActivator creator)    at System.Composition.TypedParts.ActivationFeatures.LifetimeFeature.<>c__DisplayClass1_0.<RewriteActivator>b__0(LifetimeContext c, CompositionOperation o)    at System.Composition.Hosting.Core.CompositionOperation.Run(LifetimeContext outermostLifetimeContext, CompositeActivator compositionRootActivator)    at System.Composition.Hosting.Core.LifetimeContext.TryGetExport(CompositionContract contract, Object& export)    at System.Composition.Hosting.CompositionHost.TryGetExport(CompositionContract contract, Object& export)    at System.Composition.CompositionContext.GetExport(CompositionContract contract)    at System.Composition.CompositionContext.GetExport[TExport](String contractName)    at System.Composition.CompositionContext.GetExport[TExport]()    at OmniSharp.Stdio.Host.Initialize() in D:\a\1\s\src\OmniSharp.Stdio\Host.cs:line 58    at OmniSharp.Stdio.Host..ctor(TextReader input, ISharedTextWriter writer, IOmniSharpEnvironment environment, IServiceProvider serviceProvider, CompositionHostBuilder compositionHostBuilder, ILoggerFactory loggerFactory, CancellationTokenSource cancellationTokenSource) in D:\a\1\s\src\OmniSharp.Stdio\Host.cs:line 52    at OmniSharp.Stdio.Driver.Program.<>c__DisplayClass0_1.<Main>b__1() in D:\a\1\s\src\OmniSharp.Stdio.Driver\Program.cs:line 70    at OmniSharp.CommandLineApplication.<>c__DisplayClass12_0.<OnExecute>b__0() in D:\a\1\s\src\OmniSharp.Host\CommandLineApplication.cs:line 92    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.<>c__DisplayClass146_0.<OnExecute>b__0(CancellationToken _)    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.ExecuteAsync(String[] args, CancellationToken cancellationToken)    at McMaster.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)    at OmniSharp.CommandLineApplication.Execute(String[] args) in D:\a\1\s\src\OmniSharp.Host\CommandLineApplication.cs:line 65    at OmniSharp.Stdio.Driver.Program.<>c__DisplayClass0_0.<Main>b__0() in D:\a\1\s\src\OmniSharp.Stdio.Driver\Program.cs:line 84    at OmniSharp.HostHelpers.Start(Func1 action) in D:\a\1\s\src\OmniSharp.Host\HostHelpers.cs:line 30
System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
File name: 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'
System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
File name: 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'
System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
File name: 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'
System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
File name: 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'
System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'. The system cannot find the file specified.
File name: 'Microsoft.CodeAnalysis.Elfie, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35'
[ERROR] Error: OmniSharp server load timed out. Use the 'omnisharp.projectLoadTimeout' setting to override the default delay (one minute).

C# log
Installing C# dependencies...
Platform: win32, x86_64
Downloading package 'OmniSharp for Windows (.NET 6 / x64)' (39061 KB).................... Done!
Validating download...
Integrity Check succeeded.
Installing package 'OmniSharp for Windows (.NET 6 / x64)'
Finished
Getting latest OmniSharp version information
Downloading package 'Latest OmniSharp Version Information' (1 KB).................... Done!
Installing OmniSharp Version = 1.38.2-beta.40...
Platform: win32, x86_64
Downloading package 'OmniSharp for Windows (.NET 6 / x64), Version = 1.38.2-beta.40' (40264 KB).................... Done!
Installing package 'OmniSharp for Windows (.NET 6 / x64), Version = 1.38.2-beta.40'
Finished

Environment information
VSCode version: 1.65.2
C# Extension: 1.24.1
Dotnet Information
.NET SDK (reflecting any global.json):
 Version:   6.0.201
 Commit:    ef40e6aa06
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.19044
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\6.0.201\
Host (useful for support):
Version: 6.0.3
Commit:  c24d9a9c91
.NET SDKs installed:
6.0.103 [C:\Program Files\dotnet\sdk]
6.0.201 [C:\Program Files\dotnet\sdk]
.NET runtimes installed:
Microsoft.AspNetCore.App 6.0.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 6.0.3 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 6.0.3 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
To install additional .NET runtimes or SDKs:
https://aka.ms/dotnet-download

Visual Studio Code Extensions

Extension
Author
Version

angular-schematics
cyrilletuzi
5.1.2

Angular2
johnpapa
13.0.0

angular2-inline
natewallace
0.0.17

auto-close-tag
formulahendry
0.5.14

auto-rename-tag
formulahendry
0.1.10

azure-account
ms-vscode
0.10.1

csharp
ms-dotnettools
1.24.1

data-workspace-vscode
ms-mssql
0.1.1

githistory
donjayamanne
0.6.19

gitlens
eamodio
12.0.4

html-css-class-completion
Zignd
1.20.0

material-icon-theme
PKief
4.14.1

mssql
ms-mssql
1.13.0

ng-template
Angular
13.3.0

prettier-vscode
esbenp
9.3.0

remote-containers
ms-vscode-remote
0.224.2

sql-database-projects-vscode
ms-mssql
0.14.1

vs-keybindings
ms-vscode
0.2.1

vscode-autoprefixer
mrmlnc
3.0.1

vscode-azureappservice
ms-azuretools
0.23.1

vscode-azureresourcegroups
ms-azuretools
0.4.0

vscode-cosmosdb
ms-azuretools
0.18.1

vscode-csharp-snippets
jorgeserrano
1.1.0

vscode-css-peek
pranaygp
4.2.0

vscode-docker
ms-azuretools
1.20.0

vscode-eslint
dbaeumer
2.2.2

vscode-mjml
DanielKnights
2.4.10

vscode-npm-script
eg2
0.3.24

vscode-peacock
johnpapa
4.0.1

vscodeintellicode
VisualStudioExptTeam
1.2.17

Github project page disappeared too and the package became unlisted.

Thanks I will close it here as it is related to the server. https://github.com/OmniSharp/omnisharp-roslyn/issues/2369


Duplicate asset names issue

Having two assets with the same name (minus extension) will not load properly.  For example, abc.wav and abc.ogg will cause an error.

This has traditionally been the case in MPF. It will even happen when both files are in different folders. We probably need to use full path + name everywhere to fix this.

currently this works as expected


Accidental occurrence of environ[“REQUEST_METHOD”] key error on my production server, with flask+uwsgi service mode

This error occasionally occurs on the production server, which using flask combine uwsgi and nginx.
What I can see in the traceback below is the REQUEST_METHOD parameter is missing from the environment variable uwsgi passes to flask app.
Traceback (most recent call last):
  File "/home/projects/igor/virtualenv/lib/python2.7/site-packages/flask/app.py", line 1994, in __call__
    return self.wsgi_app(environ, start_response)
  File "/home/projects/igor/virtualenv/lib/python2.7/site-packages/flask/app.py", line 1977, in wsgi_app
    ctx = self.request_context(environ)
  File "/home/projects/igor/virtualenv/lib/python2.7/site-packages/flask/app.py", line 1938, in request_context
    return RequestContext(self, environ)
  File "/home/projects/igor/virtualenv/lib/python2.7/site-packages/flask/ctx.py", line 242, in __init__
    self.url_adapter = app.create_url_adapter(self.request)
  File "/home/projects/igor/virtualenv/lib/python2.7/site-packages/flask/app.py", line 1765, in create_url_adapter
    server_name=self.config['SERVER_NAME'])
  File "/home/projects/igor/virtualenv/lib/python2.7/site-packages/werkzeug/routing.py", line 1524, in bind_to_environ
    environ["REQUEST_METHOD"],
KeyError: 'REQUEST_METHOD'

Environment

Python version:2.7.9
Flask version:0.12

I can't reproduce this issue. uWSGI always provides this required key.
Note that Flask 0.12 is unsupported, you should upgrade to 1.1, although this shouldn't cause this issue.


Pass arguments to super.commitWasRejected to get back DS.Errors

We're having some failing tests with ember+ember-data @ 3.28 due to missing model errors.
These args seem to be necessary if I'm correct https://github.com/emberjs/data/blob/9889ebbd4eec162dba17bb00126ee71e49d04bce/packages/record-data/addon/-private/record-data.ts#L361

@lowski maybe run it with this change in your app

@knownasilya it didn't help. I have the same error.

Released in https://github.com/adopted-ember-addons/ember-data-model-fragments/releases/tag/v5.0.0-beta.3


Inconsistency in events emitted between credentials and connections

As a developer I expect the event listeners present on modules and services to be consistent in how they work and when they emit events.
The connections and credentials modules both contain an event listener that emits state changed events when the state of a record changes. E.g. when a credential exchange record transitions from state requested to issued, or when a connection record transitions from response to completed.
However there is a small inconsistency in when the StateChanged event is emitted:

for connections the event is not emitted on creation (createInvitation / receiveInvitation)
for credentials the event is emitted on creation (createOffer / receiveOffer)

I think it can be helpful to receive a state changed event on creation (state null to ...) so we should probably update the connection event listener to also emit on creation.

I might be missing something, but I'm noticing another events related inconsistency between ConnectionsModule and CredentialsModule.
The ConnectionsModule exposes a events() method that returns the ConnectionsService which allows me to listen for connection changes. When attempting to implement a similar listener for credential changes I noticed CredentialsModule does not have an events() method.
Not sure if this is intentional, but as a developer I'd expect them to work the same.

Closed by #159

Closed by #159


Window only rerendered when resized with xmonad

With xmonad as window manager the window of the examples is not redrawn on request-frame. I need to resize the window after request-frame to be correctly shown.
i am on archlinux with xmonad 0.17.1

Are you running Humble UI demo app or your own code? I’ll probably need your help debugging this, as I don’t have archlinux or xmonad. Is behaviour the same in https://github.com/humbleUI/jwm ./script/run.py?

I tried the empty example from jwm and i experienced the same without any dynamic changes from the repl. I had two windows in fullscreen mode, ie. the empty example and firefox. When i switched from firefox to the example, a frozen image of firefox stayed visible until i resized the window.
I added
} else if (e instanceof EventWindowFocusIn) {
            window.requestFrame();
        }

and then all started to work.
So the problem with my humbleui code was that requestFrame was called and worked as expected but only after that i switched to the window and requestFrame was then not called again. I expected window switching to work without explicitly calling requestFrame.
So, my bad. Sorry for wasting your time.


Fix deadlock when peer disconnects inside a setstate

Solving the deadlock issue using by queueing send messages inside the OnStateChangedAsync in to a new thread, this will avoid having the same thread deadlock on the state change lock handle.

Fixed by #2491


Randomly thrown exception in karate test: org.apache.http.NoHttpResponseException: The target server failed to respond, http call failed after 5010 milliseconds for url: ...

In our company we are using Karate test to monitor our production environment every 30 minutes. We encounter at least 5-10 times every week a failing test because of this exception:
org.apache.http.NoHttpResponseException: The target server failed to respond, http call failed after 5010 milliseconds for url:..
After reruning that test this exception does not occur anymore. It was not possible to reproduce that exception because this happen in random tests in our 30 minutes monitors from time to time. That's why it is hard to provide code which will reproduce the problem.
Luckily I found that this is a problem related with org.apache.httpcomponents:httpclient which is not the best in handling steal connections. In stack overflow is a proposed solution: https://stackoverflow.com/a/10680629
I applied that solution from above stackoverflow to our monitoring tests and the problem does not occur anymore since 3 months.
The commit can be found here: https://github.com/karatelabs/karate/compare/master...ksola:karate:master
Is this fix worth to put int the master branch of karate?

@ksola PRs can go against the develop branch.
the use of disableAutomaticRetries() is intentional by default, else what happens is the logs get confusing when the http client goes off on its own and does retries. also as a best practice - teams should not depend on retries, and fix the root-cause.
by the way - are you aware of retry until perhaps that solves your problem ? looking at your error message I suspect that karate.configure('readTimeout', 5000) has been done, maybe all you need to do is increase that timeout ?
but if you feel this custom HttpRequestRetryHandler is useful, I'm open to merging it. but I want it behind a configure flag, and I propose the name: httpRetryEnabled which defaults to false.

@ptrthomas Thanks for the fast replay.
We have setup a timeout of 1 minute and anyway we get this exception.
Yes I know the retry until but when the org.apache.http.NoHttpResponseException is thrown the test just fail even there is a retry. I think there is no way to catch this exception in the karate tests as there is thrown a RuntimeException in case this exception is thrown (please correct me if I am wrong):
        try (CloseableHttpClient client = clientBuilder.build()) {             httpResponse = client.execute(requestBuilder.build());             HttpEntity responseEntity = httpResponse.getEntity();             if (responseEntity == null || responseEntity.getContent() == null) {                 bytes = Constants.ZERO_BYTES;             } else {                 InputStream is = responseEntity.getContent();                 bytes = FileUtils.toBytes(is);             }             request.setEndTime(System.currentTimeMillis());             httpResponse.close();         } catch (Exception e) {             if (e instanceof ClientProtocolException && e.getCause() != null) { // better error message                                 throw new RuntimeException(e.getCause());             } else {                 throw new RuntimeException(e);             }         }
I will create a PR to make this retry optional as you suggested. My only concern is the naming of the filed. As we will retry on a concert exception then maybe the name should be  httpRetryEnabledOnNoHttpResponseException. This is only a suggestion but I am also open for httpRetryEnabled if you say that is better.

@ksola you are right, retry until applies only for successful http responses
please proceed with httpRetryEnabled as it should apply to any http client exception that triggers the built-in automatic retried, although I have no idea what all exceptions are in scope here

@ptrthomas I created the PR: https://github.com/karatelabs/karate/pull/2409

1.4.1 released


Update

Fixt tag

Re-formatting the HTML documentation doesn't seem to provide any benefits.
(I think it would make more sense to migrate the HTML docs to markdown)
This is just an in-official mirror of the original luaj project from SourceForge (https://sourceforge.net/projects/luaj/). Therefore I don't plan to change the sources at this moment.


AVX flags CPU not working Mac M1

I checked on the CPU options in the advanced settings and it doesn't enable AVX for me. It only enables SSE 4.1 and SSE4.2 but not AVX. How do I enable it?

So those options doesn’t necessarily mean it’s implemented in QEMU. If checked, it still requires QEMU to support it.

ok. so i have to wait for the developers to support this feature in the next versions of UTM?

QEMU must support it.

@osy Would you have any other information on this?

AVX emulation in TCG is part of QEMU 7.2, so an update should fix this issue.

Closing since we have merged QEMU 7.2 changes.


operator >>  to build edges rather than |

I think the Clara team is using a >> operator for denote an edge.  Since we don't have a way of chaining pipes, using a different operator might be more reasonable.
This has nothing to do with the review of this PR, but we should open an issue if we want to make this change.
Originally posted by @ryanolson in https://github.com/nv-morpheus/SRF/pull/75#discussion_r907676552

Just to restate this proposal, as I understand it:
| for intra-node operator chaining and >> for inter-node edge creation.
flowchart LR
 Source-- >> ---Node["op_1 | op_2 | ... | op_n"];
 Node-- >> ---Sink;

If so, we do have compound edge creation (edge chaining) in the PySRF adapters when both data types are registered with Pybind11.

Yes, and to be even more specific, | for intra-node rxcpp::operator chaining


"meter" event not firing

I've just set up a basic use of a recorder and player as described in the docs.
I added a meteringInterval to the options, like so, but the callback is not being called.
let rec = new Recorder("filename.mp4", { meteringInterval: 250 })
    .on("meter", (data) => alert(data))
    .record();

I'm on iOS, React Native 0.63.4.
Is this a bug or have I missed something?

Ah, it's just because the version with the metering is unreleased.

@danielneal - did you resolve this?  I tried to install direct from GitHub, but I got version 1.06.  Did you end up forking and installing to get metering?  I'm using a Voice lib, but would prefer to just use this repo since I'm using it to record and playback.

@mstange22 the version with metering is not published yet. don't waste your time trying to get it from other branches while it is not exists.

Thank you.  I'm working on forking / releasing my own version with metering.

@mstange22  Great it up.
Keep me posted after finishing it if you don't mind.

@mstange22  Great, keep it up.
Please don't forget to keep me posted after finishing it if you don't mind.

@fakhergh I forked and released for our org, but I don't know that I'm crazy about the way it's metering.  -160 means silence?  I can normalize, but it's not the metering level I was hoping for.  I guess I should have seen that in the docs.  I'm currently using a voice recognition library to measure level changes which is working for my application.  I was just trying to avoid bringing in a second library just for that.  But at least it's working.  I may try just a smaller mic level lib (maybe the one the metering working is based on) to avoid requiring voice.  Curious, is there a reason the metering work is not released?  Looks like it's been a couple of years since 2.0.3 was released.


--tracing.config to replace environment variables

Is your proposal related to a problem?
When using OpenTelemetry agents (Deamonset) to ingest traces and decorate them with the node and pod metadata
container envs
- name: HOST_IP
  valueFrom:
    fieldRef:
      apiVersion: v1
      fieldPath: status.hostIP

flag
    --tracing.config=type: JAEGER
    config:
      service_name: "thanos"
      agent_host: "${HOST_IP}"
      agent_port: 14250

Describe the solution you'd like
Something similar for the tracing.config flag
https://github.com/thanos-io/thanos/pull/4327
(Describe your proposed solution here.)
Describe alternatives you've considered
Use OTEL Deployment with a Service but I'll lose important metadata
Additional context
Related with https://github.com/thanos-io/thanos/issues/1972

I think we already have env substitution for --tracing.config flag as defined here. The env substitutions follows K8s style though so it would be something like this. :)
    --tracing.config=type: JAEGER
    config:
      service_name: "thanos"
      agent_host: "$(HOST_IP)"
      agent_port: 14250

Closing this as it truly seems this is already implemented, thanks @saswatamcode :+1:


The binary in the docker image doesn't have a version number

; docker run --rm -it docker.io/hamroctopus/typescript-tools:4.2.5-alpine@sha256:28be6828617caeec5745fac9fb0de0b6f0c5221caf54755c88ebc12b662ca7b2
Found existing alias for "docker". You should use: "d"
/ # which monorepo
/usr/bin/monorepo
/ # monorepo --help
monorepo 0.0.0-semantically-released
Eric Crosson<EMAIL_ADDRESS>
USAGE:
    monorepo <SUBCOMMAND>

OPTIONS:
    -h, --help       Print help information
    -V, --version    Print version information

SUBCOMMANDS:
    help           Print this message or the help of the given subcommand(s)
    link           Configure TypeScript Project References
    lint           Lint internal packages for consistent use of external dependency versions
    make-depend    Create GNU Makefile containing package dependency information
    pin            Pin internal dependencies to locally-declared package versions
    query          Query properties of the current monorepo state
/ #

The docker image has been deprecated and is no longer supported


Set alert value as global variable

I was checking at the file pkg/scanning/payload.go and I noticed that the value 45 is set in most of the payloads, this is something a little annoying because I often need to change it to a particular value while manually validating.
I also understand that this is a integer value and some payloads won't work using a string (for instance). So, it would be a good idea to set this value as a parameter.
Let's say something like this
 dalfox url --custom-alert-value 1337 --custom-alert-type string
Alert value used:  "1337"
 dalfox url --custom-alert-value 1337 --custom-alert-type integer
Alert value used:  1337
 dalfox url --custom-alert-value 1337 --custom-alert-type string, integer
Alert value used:  "1337" and 1337

Hello again @pdelteil ,
Thank you for your opinion😁
I don't know if it's easy to do, but I think it's a good idea, and I'll proceed right away!

Hello again @pdelteil ,
Thank you for your opinion😁
I don't know if it's easy to do, but I think it's a good idea, and I'll proceed right away!

Hi @hahwul
Great. I'm happy to help.

Hi @hahwul
Great. I'm happy to help.

@pdelteil
Added successfully. First of all, it can be used in the go-get version of dev, and later in the 2.3.0 release.
Update
$ go get github.com/hahwul/dalfox

Options

--custom-alert-value = e.g (XSS / 1 / document.location )
--custom-alert-type= e.g (str / none)

none or empty: write only alert-value (e.g --custom-alert-value=130 / --custom-alert-value=location.href)
str: "PAYLOAD" / 'PAYLOAD'
Testing
default (no option)
$ dalfox url http://testphp.vulnweb.com/listproducts.php\?artist\=123
...snip...
[V] Triggered XSS Payload (found DOM Object): cat=</ScriPt><sCripT class=dalfox>alert(1)</sCriPt>
    48 line:  yntax to use near '=</ScriPt><sCripT class=dalfox>alert(1)</sCriPt>' at line 1
[POC][V][GET] http://testphp.vulnweb.com/listproducts.php?artist=123&cat=%3C%2FScriPt%3E%3CsCripT+class%3Ddalfox%3Ealert%281%29%3C%2FsCriPt%3E

used options - only value
$ dalfox url http://testphp.vulnweb.com/listproducts.php\?artist\=123 --custom-alert-value 1337
...snip...
[V] Triggered XSS Payload (found DOM Object): cat='><sVg/onload=alert(1337) class=dalfox>
    48 line:  syntax to use near ''><sVg/onload=alert(1337) class=dalfox>' at line 1
[POC][V][GET] http://testphp.vulnweb.com/listproducts.php?artist=123&cat=%27%3E%3CsVg%2Fonload%3Dalert%281337%29+class%3Ddalfox%3E

used options - with type=str
$ dalfox url http://testphp.vulnweb.com/listproducts.php\?artist\=123 --custom-alert-value 1337 --custom-alert-type str
...snip...
[V] Triggered XSS Payload (found DOM Object): cat=<svG/onload=confirm("1337") class=dalfox>
    48 line:  yntax to use near '=<svG/onload=confirm("1337") class=dalfox>' at line 1
[POC][V][GET] http://testphp.vulnweb.com/listproducts.php?artist=123&cat=%3CsvG%2Fonload%3Dconfirm%28%221337%22%29+class%3Ddalfox%3E

used options - with type=none,str
$ dalfox url http://testphp.vulnweb.com/listproducts.php\?artist\=123 --custom-alert-value 1337 --custom-alert-type str,int
...snip...
[V] Triggered XSS Payload (found DOM Object): cat="><iFrAme/src=jaVascRipt:alert('1337') class=dalfox></iFramE>
    48 line:  syntax to use near '"><iFrAme/src=jaVascRipt:alert('1337') class=dalfox></iFramE
[POC][V][GET] http://testphp.vulnweb.com/listproducts.php?artist=123&cat=%22%3E%3CiFrAme%2Fsrc%3DjaVascRipt%3Aalert%28%271337%27%29+class%3Ddalfox%3E%3C%2FiFramE%3E

Great!
Thanks. I will give it a try.


Methods to load the local downloaded LLM model

in Lida, is it possible to load the model downloaded on a MacBook M2? say the Zephyr 7b or Magicoder 7b, I downloaded the models on a Desktop folder, then I would like to load it using some simple method like llama-cpp-python, or Langchain's LlamaCpp, but not loading it using methods that Lida suggested, like llmx load model from hugging face, vllm server, OpenAI etc.
Thanks!

anything on this ?
can we use quantized local models ?

What quantized models are you interested in using?
In general, as long as you can spin up an openai compliant webserver endpoint from your model, you can integrate it into lida.
Most local models have tools that can spin up an openai compliant api, even llama.cpp.
Once you spin up the openai compliant api, you can simply just use it with lida (see the llmx api docs)

in Lida, is it possible to load the model downloaded on a MacBook M2? say the Zephyr 7b or Magicoder 7b, I downloaded the models on a Desktop folder, then I would like to load it using some simple method like llama-cpp-python, or Langchain's LlamaCpp, but not loading it using methods that Lida suggested, like llmx load model from hugging face, vllm server, OpenAI etc.
Thanks!

any help ? facing the same issue


Missing video data in MVBench CLEVRER validation set

I'm encountering issues with missing video files in the MVBench dataset, specifically in the CLEVRER validation set. When trying to run the code, I'm getting the following error messages:
[15:23:13] /github/workspace/src/video/video_reader.cc:83: ERROR opening: /cache/video_caption/mvbench/video/clevrer/video_validation/video_14727.mp4, No such file or directory
[15:23:52] /github/workspace/src/video/video_reader.cc:83: ERROR opening: /cache/video_caption/mvbench/video/clevrer/video_validation/video_13446.mp4, No such file or directory
[15:37:41] /github/workspace/src/video/video_reader.cc:83: ERROR opening: /cache/video_caption/mvbench/video/clevrer/video_validation/video_14727.mp4, No such file or directory

@dazhangyu123 how to solve it? Some video in star also lost. Like  star/Charades_v1_480/EDXBD.mp4

@dazhangyu123 how to solve it? Some video in star also lost. Like star/Charades_v1_480/EDXBD.mp4

@xmy0916 https://huggingface.co/datasets/OpenGVLab/MVBench/blob/main/video/data0613.zip

@yinanhe I have attempted to download the file 'panda_videos_11.zip' twice, but in both instances, I've found that the video file 'qek9AMGMhzE.mp4' is incomplete. Could you please verify the integrity of this specific video file and ensure it's complete in the source?

@yinanhe I have attempted to download the file 'panda_videos_11.zip' twice, but in both instances, I've found that the video file 'qek9AMGMhzE.mp4' is incomplete. Could you please verify the integrity of this specific video file and ensure it's complete in the source?

@dazhangyu123  We have not released panda_videos_11.zip relevant documents. If possible, could you provide more information?


Feature request: share and shareReplay

Feature request

Please describe the feature.

rxjs is evolving and I suggest keeping up with it.
In particular I suggest to implement new share and shareReplay methods.
This feature also can fix #1218.

Which next library version (i.e., patch, minor or major)?

Any.

What are the platform(s), environment(s) and related component version(s)?

All.

How commonly is this feature needed (one project, several projects, company-wide, global)?

global

See also:  #394

Seconding a request for these operators. .ShareReplay() in particular is a very effective way to cache the results of computationally-intensive queries, for reuse across an application.
The fact that a de-activated ReplaySubject can re-emit out-of-date values upon re-activation was particularly troublesome for me, since these out-of-date values were IDisposable objects that had already been disposed.
My rudimentary workaround for the moment is to use a custom ResettingReplaySubject<T> class, together with .Multicast() and .RefCount(). I lose thread-safety, which I wasn't using anyway.
public sealed class ResettingReplaySubject<T>
    : SubjectBase<T>
{
    public ResettingReplaySubject(int bufferSize)
        => _bufferSize = bufferSize;

    public override bool HasObservers
        => _source?.HasObservers ?? false;

    public override bool IsDisposed
        => _isDisposed;

    public override void Dispose()
    {
        if (!_isDisposed)
        {
            _source?.Dispose();
            _isDisposed = true;
        }
    }

    public override void OnCompleted()
    {
        if (_source is not null)
            _source.OnCompleted();
        else
            AssertNotDisposed();
    }

    public override void OnError(Exception error)
    {
        if (_source is not null)
            _source.OnError(error);
        else
            AssertNotDisposed();
    }

    public override void OnNext(T value)
    {
        if (_source is not null)
            _source.OnNext(value);
        else
            AssertNotDisposed();
    }

    public override IDisposable Subscribe(IObserver<T> observer)
    {
        if (_source is null)
        {
            AssertNotDisposed();

            _source = new ReplaySubject<T>(_bufferSize);
        }

        return new CompositeDisposable()
        {
            _source.Subscribe(observer),
            Disposable.Create(() => _source = null)
        };
    }

    private void AssertNotDisposed()
    {
        if (_isDisposed)
            throw new ObjectDisposedException(string.Empty);
    }

    private int                 _bufferSize;
    private bool                _isDisposed;
    private ReplaySubject<T>?   _source;
}


Overhaul documentation

Fixes #219, #195.
@lamblin would you mind having a look and telling me what you think of it?

@fvisin if you have time, would you mind having a look? I'm looking for an outsider's perspective, and your critical eye for what's unclear or lacking would be very helpful for me.

Great work @vdumoulin !!!
I will go through the rest in the next days.
A general comment on what I have read so far: the tutorials are clear and very well written and they provide an excellent introduction to Fuel for new users.
For experienced Fuel users who are looking for a quick information, the tutorial approach might be difficult to consult though. I suggest to add a wrap-up section at the end of each tutorial (or section in a tutorial) with the main concepts expressed as a list, possibly in a well separated Tip or Info box.
E.g., for the Transformers:
{info:title=Transformers}

Implement :meth:transform_example if they provide single examples and/or :meth:transform_batch if they provide batches
Subclass from :class:AgnosticTransformer if the examples and batches implementation is the same

Implement :meth:transform_any

Subclass from :class:SourcewiseTransformer if are applied sourcewise. In this case their constructor takes an additional which_sources keyword argument

If which_sources is None, then the transformer is applied to all sources
Implement :meth:transform_source_example method and/or a :meth:transform_source_batch

Subclass from :class:AgnosticSourcewiseTransformer if are applied sourcewise and the examples and batches implementation is the same

Implement :meth:transform_any_source

Subclass :class:Mapping if the function applied on the data is not fixed

Its constructor's parameter mapping specifies the function that will be applied to the data.
{info}

@fvisin thanks a lot for your very valuable feedback! I think I addressed everything. Please tell me if there's something I've missed.

@vdumoulin excellent work! :+1:
I am sorry it took me so long to go though it, but I am finally done. I think this refactoring will help a lot users approaching Fuel for the first time as well as experienced users with bad memory!

Haven't had a chance to review this in detail but skimming it it looks really nice, +1 on Francesco's comment about amnesiac experienced users. :+1:

@vdumoulin here is the remainder of what we discussed today:

It would be great to refactor the rest of the documentation, at least adding the summaries.
It would be even greater to have a cheat sheet with all the summaries together. The include directive could be used to avoid code duplication.
Questions about the Import your own data link at the end of the overview tutorial:

If you modify Datasets so that they are function instead of classes, could the import your own data documentation be merged with the contribute to a dataset one?
If not, it should be made clear the distinction between the two of them (changing their names to something more informative might be enough)

@fvisin I think your suggestions regarding refactoring the rest of the documentation as well as the cheat sheet are great ideas, but I'd leave that for another PR.
Regarding your question: possibly. The contribute a dataset section deals with fuel-download and fuel-convert, which you don't need for your own data. However, they could be presented as optional convenience steps and the emphasis could be on the similarities between built-in datasets and local datasets.

I'll merge the PR in its current state, and I'll create a ticket for @fvisin's additional suggestions.

Regarding your question: possibly. The contribute a dataset section deals with fuel-download and fuel-convert, which you don't need for your own data. However, they could be presented as optional convenience steps and the emphasis could be on the similarities between built-in datasets and local datasets.

I guess that making it more clear that fuel can be used with your own data might already be enough. Anyway, I am fine with whatever you decide is best.


Help, im getting error when running the app suddenly

Hi all,
It was working fine until I do npm update, im getting the error below:
react native undefined is not a function (evaluating 'windows.addEventListener('message', idleTick, false)')
Im searching around for few hours but didn't get any answer, anyone please help?

I'm also getting the same problem

I got into the same issue. Spent an hour and tried to detect versions changes in  the package-lock.json. At the end figured its issue with react-dom which depends on some package called schedule. So the fix might be to lower the version of react-dom and re install it. I lowered react-dom to 16.5.0 which would use "schedule": "0.3.0".


Check or remove delete_documents_marked_for_delete, delete_duplicate_drafts & find_duplicate_documents scripts

We should decide whether or not it's worth keeping these scripts. If we do decide to keep them, we'll need to check they work and ensure that they remain working by adding the appropriate test coverage.
From this comment by @h-lame:

delete_documents_marked_for_delete, delete_duplicate_drafts and find_duplicate_documents are to help working around the fact that sometimes normal use of the app can result in duplicate manuals or sections being created.  delete_documents_marked_for_delete is used when the users flag the duplicates so they are easy to remove (prefix the title with an xx I think), and the others try to find things programmatically.  Getting to the bottom of the actual problem should mean we can get rid of all three of these (particularly if we also provide delete/withdraw functionality). See https://trello.com/c/R3kQxY9Z/74-duplication-bug-in-manuals for some thoughts on what the cause might be

I've opened two PRs to improve and add test coverage to the delete_documents_marked_for_delete (PR #913) and find_duplicate_documents (PR #915) scripts.
The delete_duplicate_drafts already appears to work and has test coverage.
Given these scripts appear to be working around functionality that's missing from the UI I'm happy for them to remain. I believe that if/when the two PRs are merged we can close this issue.

Given that #913 and #915 have been merged, @chrislo & I think we can close this. Closing.


Unicode characters in SVG are being garbled in XML output

Describe the issue
Original issue: https://github.com/ietf-tools/xml2rfc/issues/924

Unicode characters in  elements of SVG are being garbled by something in the process of rendering or sanitizing that xml2rfc performs on SVG.
These appear to first be turned into character references, like Ӓ, which are subsequently quoted, producing &#1234;, which puts the literal character reference on the screen rather than the intended character.
It should not be necessary to convert Unicode into character references like this.

Sample draft: https://www.ietf.org/archive/id/draft-ietf-quic-load-balancers-15.xml
NOTE: I was unable to reproduce this on the sandbox or local dev instance.
Code of Conduct

[X] I agree to follow the IETF's Code of Conduct

id template workflow was using an old version of xml2rfc. See https://app.circleci.com/pipelines/github/quicwg/load-balancers/837/workflows/bd32ccbd-81dc-469b-a5b1-a9a74662ec9e/jobs/792/parallel-runs/0/steps/0-101
It was using xml2rfc v3.12.10 and fix was introduced in v3.13.1.


Implement Channel List

Reference: https://api.slack.com/methods/channels.leave
Acceptance Criteria:

[x] Spring Slack Client is extended with given method
[x] Spring Slack Test Client is extended with given method
[x] JavaDoc/KDoc is added

closed by #292


Inconsistent model output across training datasets

For the bridge dataset, the model output is explicitly de-normalized before being compared with the ground truth in the inference notebook.
For other datasets, e.g. Viola, and Berkley cable routing, the raw model predictions match quite well with the ground truth.  Does this mean the ground truth actions in these datasets are normalized?
How one should denormalize to interpret the model output e.g. for Franka
It would be helpful to know how datasets are normalized (at least the 9 datasets RT1-X is trained on) and if this is consistent across 9 datasets.
Thanks!

@quanvuong can you please provide details on the normalization used during training of RT-X?


Detect duplicated pages by visually comparing them

Someone finally sent me some PDFs that have duplicated pages where the pages metadata got lost.
Here, the best way of identifying duplicates would probably be:

Comparing text (easy one, me thinks)
Comparing the visual output, and preferably checking if a lot of pixels have either become darker (usual slides: white background, dark foreground) or lighter (dark theme slides). This is rather slow. (Use a library like https://github.com/mapbox/pixelmatch )

Test_fur_PDF_Stripper.pdf

More test files
algorithmics_ws22_part1-1.pdf
algorithmics_ws22_part2-1.pdf
algorithmics_ws22_part3-1.pdf


[build] Workaround snappy fetch failure in [honister] and [master]

The [master] branch of snappy has been renamed to [main]. Override the SRC_URI setting in its recipe by adding SRC_URI:pn-snappy override to BblayersConfExtraLines[] to prevent these errors:
    WARNING: snappy-1.1.9-r0 do_fetch: Failed to fetch URL gitsm://github.com/google/snappy.git;protocol=https;branch=master, attempting MIRRORS if available
    ERROR: snappy-1.1.9-r0 do_fetch: Fetcher failure: Unable to find revision 2b63814b15a2aaae54b7943f0cd935892fae628f in branch master even from upstream
    ERROR: snappy-1.1.9-r0 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'gitsm://github.com/google/snappy.git;protocol=https;branch=master')

Revert this commit once the pin of meta-oe is moved to include commit a750888a40a7e2f967dfd32ce7a6953dc6bf10f2.

Merged to other branches as well:
37445f606..c49ba0822  build -> build-next


Option to do full-frame chunk size selection (i.e. vary chunk sizes on z but not x and y)

Added via --fullxy


update to 2.4.3

aiohappyeyeballs 2.4.3
Destination channel: main
Links

PKG-6327
https://github.com/aio-libs/aiohappyeyeballs/tree/v2.4.3

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_4dlf0_yarx/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:36: invalid_url: https://aiohappyeyeballs.readthedocs.io/ : Not reachable: 403
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_9fl75t6dru/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:36: invalid_url: https://aiohappyeyeballs.readthedocs.io/ : Not reachable: 403
===== Final Report: =====
0 Errors and 1 Warning were found


System Feature: upgrade to https://

upgrade any incoming http:// request to https://

part of #12


feat: backport break-the-glass to v0.14

❯ go run ./cmd/tfctl break-glass -n terraform helloworld-tf
 Break the glass requested for terraform/helloworld-tf
Waiting:  Reconciliation in progress
Waiting:  Reconciliation in progress
Waiting:  Reconciliation in progress
Waiting:  No drift: main@sha1:3ac83e0ff205dcd2e21f08120312e3502f62a9e2
Waiting:  Reconciliation in progress
Waiting:  Reconciliation in progress
Waiting:  Reconciliation in progress
Waiting:  Breaking the glass ...
The glass is breaking!
/tmp/terraform-helloworld-tf $ ls
README.md                   backend_override.tf         dev-cluster                 generated.auto.tfvars.json  main.tf
/tmp/terraform-helloworld-tf $

Additional changes:

backport Tiltfile to make it easier the development if we have to do anything else with v0.14 in the future (security fix for example)

An upgrade test from this version to version v0.15.1 is required.


client.cutout not working with 15arcmin datasets

When I try to use client.cutout with the 15 arc min data, I get an error.
This is the original code:
import isimip_client.client as cl
client = cl.ISIMIPClient()
query = client.datasets(simulation_round = 'ISIMIP3a',\
                           product = 'InputData',\
                           category = 'climate',
                           climate_forcing = 'gfdl-mom6-cobalt2',\
                           climate_scenario = 'obsclim',\
                           subcategory = 'ocean',\
                           region = 'global',\
                           time_step = 'monthly',\
                           climate_variable = 'tos')

urls = []
urls_sub = []
#Looping through each entry available in search results
for datasets in query['results']:
  for paths in datasets['files']:
    urls.append(paths['file_url'])
    urls_sub.append(paths['path'])

HI_data_URL = client.cutout(urls_sub[0], bbox = [0.0, 40.0, -180.0, -125.0]) #This is the 15 arc min result

I get the following error:
b'{"errors":{"paths":["ISIMIP3a/InputData/climate/ocean/obsclim/global/monthly/historical/GFDL-MOM6-COBALT2/gfdl-mom6-cobalt2_obsclim_tos_15arcmin_global_monthly_1961_2010.nc is not using the correct grid: [\'30arcsec\', \'90arcsec\', \'300arcsec\', \'1800arcsec\', \'30arcmin\', \'60arcmin\', \'120arcmin\']."]},"status":"error"}\n'
HTTPError: 400 Client Error: BAD REQUEST for url: https://files.isimip.org/api/v1

However, if I try client.cutout(urls_sub[1], bbox = [0.0, 40.0, -180.0, -125.0]), I do not have any issues and I can download the subsetted data for my region of interest. Any ideas on what could be causing this issue?

Hi @lidefi87 , thanks for the issue, we just forgot to add the resolution. It should now work as expected.

Amazing! I tested it just now and it worked just fine. Thanks for being so responsive. I will be closing this issue now.


Fix bug with looking up Homeroom when ambiguous param given

Who is this PR for?
educators
What problem does this PR fix?
When linking to a homeroom by id (eg, from the profile page), the page doesn't load.  This is because the lookup process with Homeroom.friendly.find(id_or_slug) doesn't match as expected with the string version of an id.  As a guess, it looks first on the name field and so if any homeroom name matches the string version of an id, it will match that first rather than matching by id.  Alternately, perhaps it's doing a stricter lookup than Homeroom.find and failing to match on a string version of the id, the way that #find would.
What does this PR do?
Fixes it by making explicit the lookup order, and removing the use of friendly to make queries.

selfie


Updated trigger-parameterized-builds support

Capability of trigger-parameterized-builds is vastly improved,
added a test case
Signed-off-by: Eren ATAS<EMAIL_ADDRESS>

It's been in review long enough. If we encounter any issues we'll fix them along the way.


Support for rendering custom views

Internally, a View object can now be dumped passing a :fields option (which is a hash, that can recursively will define which sub-attributes to render along the way).
Blueprints will also accept the :fields option (with the same hash syntax), but it will also accept an array to imply the list of top-level attributes to render (when recursion is not necessary)

Signed-off-by: Josep M. Blanquer<EMAIL_ADDRESS>

Looks good.