Kernel dies when trying to run PyTorch code on Linux

Please see this SO question for the details:
https://stackoverflow.com/questions/45875837/spyder-just-kernel-died-restarting-when-i-run-net-forward-in-pytorch
@andfoy, please take a look at this one.

@ccordoba12 Does mixing Spyder versions from PyPi and conda might have some responsibility here? According to the package dump posted by the user, Spyder 3.1.4 and 3.2.1 are both listed:
spyder                    3.2.1                     <pip>
spyder                    3.1.4                    py27_0

Probably, but did you try to run the OP code?

The code posted by the OP works as expected:

Actually, it works if I use a deeper model such as the ResNet-101:

Thank you very much for your answering.
also i run this code with the same version in my other computer.it works well!!!
I try  to solve the mixing version problem. delete the redundant package 3.1.4.but still "kernel died,restarting"
first I doubt whether Spyder and pytorch have collision in the kernel.
Obviously,The problem should be in the configuration of my own computer
Sadly,there is no error message in the terminal about the kernel died

It seems this is fixed in the latest version of PyTorch:
https://github.com/jupyter/notebook/issues/2784#issuecomment-325230024

not only it has errors in the spyder,but also in jupyter and terminal..
Problem Description

Just now,I update all the packages in anaconda
conda update --all
delightedly the code runs well in terminal and jupyter,but the error in the spyder also exists

Well, I'm running the latest package versions on my current setup, and it works as expected. Any ideas @ccordoba12 ?

Also, the user reports that on a new installation, the package works. @selous123 Have you tried to create a new conda environment on your conflicting PC?

everything goes well
when i use Source installation  instead of "pip install..." as official website proposal to reinstall my pytorch and it works.
thank you very much

@selous123 For future installation, PyTorch developers recommend to install the package using conda:
conda install pytorch torchvision -c soumith


[SPARK-24187][R][SQL]Add array_join function to SparkR

What changes were proposed in this pull request?
This PR adds array_join function to SparkR
How was this patch tested?
Add unit test in test_sparkSQL.R

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3176/
Test PASSed.

Test build #90552 has finished for PR 21313 at commit 0c21160.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90552/
Test PASSed.

Test build #90560 has started for PR 21313 at commit 25977f0.

There are still quite a lot of the SQL functions to be added in R. We can bundle several of the functions together in one PR, but I guess it's too much work to add all of them in one PR. @felixcheung @HyukjinKwon

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3181/
Test PASSed.

Test build #90560 has finished for PR 21313 at commit 25977f0.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90560/
Test PASSed.

Merged build finished. Test PASSed.

sure, let's try 4-5

Test build #90601 has started for PR 21313 at commit 4f429e4.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3207/
Test PASSed.

Test build #90601 has finished for PR 21313 at commit 4f429e4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90601/
Test PASSed.

Test build #91403 has started for PR 21313 at commit e05e701.

@felixcheung @HyukjinKwon  Any more comments?

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3767/
Test PASSed.

Test build #91403 has finished for PR 21313 at commit e05e701.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91403/
Test PASSed.

Test build #91422 has started for PR 21313 at commit 92c41c5.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3781/
Test PASSed.

Test build #91422 has finished for PR 21313 at commit 92c41c5.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91422/
Test PASSed.

Test build #91430 has started for PR 21313 at commit 901ff32.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3786/
Test PASSed.

Test build #91430 has finished for PR 21313 at commit 901ff32.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91430/
Test PASSed.

Test build #91451 has started for PR 21313 at commit b0b1415.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3797/
Test PASSed.

Test build #91451 has finished for PR 21313 at commit b0b1415.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91451/
Test PASSed.

Test build #91475 has started for PR 21313 at commit 55b4518.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3810/
Test PASSed.

Test build #91475 has finished for PR 21313 at commit 55b4518.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91475/
Test PASSed.

Merged to master.

Thank you very much for your help! @HyukjinKwon @felixcheung


allow virtual host-style buckets for s3

The current setup assumes s3 bucket follows a path-style pattern: http://domain/bucket/path.
We should also support virtual host style, which is becoming standard: http://bucket.domain/path.

botocore supports a config field addressing_style, which can be set to auto.
This field is forwarded from s3fs as follows:
fs = s3fs.S3FileSystem(endpoint_url='http://minio-domain:9000', anon=True, config_kwargs={'s3': {'addressing_style': 'auto'}})

fs.ls('bucket-name')

Note to reproduce the setup with minio, one needs to setup a minio container as follows:
$ echo "<IP_ADDRESS>   minio-domain bucket-name.minio-domain" >> /etc/hosts

$ docker run -e 'MINIO_DOMAIN=minio-domain' --rm -p 9000:9000 -p 9001:9001 docker.io/bitnami/minio:2024

both virtual and path addressing styles work on minio, however 'auto' defaults to path according to botocore docs.
Auto is supposed to probe the s3 server configuration to detect preferred addressing style.
Proposed solution: explicitely set the addressing style based on environment variable (but defaulting to auto), to allow overriding addressing style.


10-playgrounds OSX

you need to update the NSView init to propagate its super implementation failure (eg. add ? to init)

@sammyd @icanzilb Fixed it in my pr https://github.com/ShinobiControls/iOS8-day-by-day/pull/11
Thanks

:+1: merged #11


DWARF Analyzer sometimes fails when Macho - Binary has embedded DWARF sections in it .. Not always

Describe the bug
For Static analysis purposes, I have objcopy __DWARF section from dSYM file to the macho binary file from ghidra to work with the executable . Because, ghidra has no way to import the DWARF from external file . It worked well for some binaries . But fails for some binaries as well.
Steps to reproduce the behavior:

llvm-objdump and llvm-objcopy some sections from dSYM file to macho binary
Open the latest version of Ghidra  and auto analyze
For some binaries, An error popus and go to user log to know more about it
(DWARFProgram) Failed to read DIE at offset 0xb in compunit 0 (at 0x0), skipping remainder of compilation unit. java.io.IOException: Unknown DWARFForm 639 (0x27f)

Expected behavior
A normal analysis with DWARF information being imported
Environment (please complete the following information):

OS: both Linux and Mac
Java Version: [e.g. 11.0]
Ghidra Version: [e.g. Latest Version(11.1.1)]
Ghidra Origin: [e.g. official GitHub release (for MAC built the latest version using source)]

Additional context
Compiler : Apple clang version 15.0.0 (clang-15<IP_ADDRESS>)

Can you please attach one of your failing samples?

Sorry to deny.It was a propetiary binary giving for security testing .

I have objcopy __DWARF section from dSYM file to the macho binary file from ghidra to work with the executable . Because, ghidra has no way to import the DWARF from external file . It worked well for some binaries . But fails for some binaries as well.

I need to clear up a few details with you.
Typically, Ghidra can handle external DWARF .dSYM files, and if the .dSYM folder is in the correct location, it should 'just work'.  Can you confirm that the binary you imported into Ghidra had a co-located .dSYM folder?
See https://github.com/NationalSecurityAgency/ghidra/blob/53313af55ae2d64f4385b2e856d8ca3e3bc7622b/Ghidra/Features/Base/src/main/java/ghidra/app/util/bin/format/dwarf/sectionprovider/DSymSectionProvider.java#L43-L44
Also, I would be interested in the objcopy commands you used to port the DWARF sections from the .dSYM file to the main binary.  Could you copy/paste the actual cmd lines you used (minus the real filename if you need to protect that detail)?

Actually i don't know the specific details but the path for the DSymSectionProvider.java is set under format of DWARF so it basically doesn't search for Mach-O binaries. I believe it only searches for the directory if a dwarf section or a dwarf file I used for analysis. Because i have my mach-o binary in place and already tried copying the dSYM in the same directory the analyzers didn't even show the DWARF.
The commands were
llvm-objdump -h --macho ./dsym_file_name # to list the sections in dsym file first
llvm-objdump --macho --section=__DWARF,__debug_section_names_here ./dsym_file_name > inter_1
xxd -r ./inter_1 > inter_2
dd if=inter_2 bs=1 skip=(the start of section from listing section output)of=inter3 # the section seperated from the binary
llvm-objcopy-14 --macho --add-section=__DWARF,__debug_section_name_here=the_location_of_inter3 ./executable to inject the section

DSymSectionProvider.java is set under format of DWARF so it basically doesn't search for Mach-O binaries.

I'm not sure if I'm parsing your reply correctly, but I can assure you that DSymSectionProvider is there to handle mac macho files.
In general, there are many exe formats that can contain dwarf info, so if your .dSYM info wasn't being found, I think figuring out what the problem is with how the files are setup in your env will be the best option, instead of relying on what seems like a painful method of copying the data from the .dsym to the main binary.

I don't know the reason behind it. But the DsymSectionProvider isn't working for me. That's the reason, I have to use the llvm-objcopy trick to copy the dwarf sections inside binary.

If you ever want to finish troubleshooting how Ghidra is / isn't finding the files in their normal .dSym location, go ahead and reopen this issue or open a new one.


Optionally loop around file when navigation hunks.

Hello!
First off, thank you very much for gitsigns, I didn't realise how slow other solutions were before trying this.
This pull requests allows passing optional options to next_hunk and prev_hunk to disable wrapping around the file without having to touch the wrapscan global option. I used the LSP's goto_next and goto_prev as inspiration for how the API should look like but I can change to only pass a boolean to the function if you prefer.
Thanks!

Thanks for the review, I updated the code following your comments!

Thanks!


[HUDI-6387] Fix Spark CDC when delete all records from a filegroup

Change Logs
beforeFileSlice and afterFileSlice were reversed as arguments to the constructor for HoodieCDCFileSplit and an assert was failing that the split didn't have a beforeFileSlice
Wrote a test that fails without the fix and succeeds with it
Impact
Fix bug
Risk level (write none, low medium or high below)
low
Documentation Update
N/A
Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

@danny0405 @YannByron could you review too?


Use UBI9 and RPMS for python deps where possible

Doing both these things further reduces the size of the image.


separate remote-state by env

Now can you just move main.tf up so it's not inside an environment directory?

Not sure if I understand, you mean /remote-state/production/main.tf -> /remote-state/main.tf?
this would go back to the original behavior where they end up sharing state across envs no?

Now can you just move main.tf up so it's not inside an environment directory?

This is part of a bigger discussion actually. The local state here is what's causing the problem, and I think the way we are dealing with that is not quite right. We can't rely on the local state being present for this because it won't be checked in to source control. And if that's the case we should probably just remove it so people don't depend on it. Though that does make it a bit harder to test with because we can't have a teardown command for the remote state that we bootstrap.
I think there are 2 options here:

Delete the local state file after this operation. If someone wants to tear down the environment they would have to manually delete the s3 bucket and dynamodb table. This is fine for normal use cases, as most likely you will create the remote state and leave it forever. It's a pain for testing when you may need to delete and recreate.

Write out different state files with the -state=production.tfstate and check them in. Having state in git is not great, and this is not necessary for most cases, but it makes it easer for testing.

I guess a hybrid approach could be to write out state files for the different environments and then exclude them with gitignore, and use them only for testing. But I would be a bit worried that this would be misleading for people.
Or maybe we need some separate make targets just for testing.
Thoughts?

the teardown already often requires manually emptying the S3 bucket, we could alias some commands to do what the terraform destroy since its only 2 resources to replace the make teardown
if we do option2 with -state=production.tfstate <- this means we will treat tfstate as a first class citizen and tie it into our infra? and pull out the correct state based on ENV=?
Hmm, is having 2 folders for 2 env's TF local state that bad? I feel this is the less confusing route.  And all the other stuff would go into the correct remote state since theyre initiated with the terraform backend with terraform/environments/production/main.tf etc  (or you're talking about removing all the environment folders altogether?)

The problem with having directories per environment is that it implies that there should be local state which is not the case.
I'm kinda leaning toward wanting to just delete the local state files after they are created to reinforce the fact that it shouldn't be relied upon.
And if we really want to have some helpers for testing maybe we just delete those resources using the aws cli like you mentioned.
Same goes for secrets.


Redeployment of v1.2 shows 25 resources to change on each rerun

Bug Details
Describe the bug
A clear and concise description of what the bug is.
Steps To Reproduce

Deploy v1.2
Rerun make infrastructure or make deploy to observe upwards of 25 resources to change (even though deployment was just done and should match)

What is the expected behavior?
0 resources to change, as infrastructure was just deployed and should be in a matching state
Screenshots
If applicable, add screenshots to help explain your problem.

Information Assistant details
Please provide the following details. You can simply include a screenshot of your Info panel as well.

GitHub branch: [e.g. main]
main
Version or Latest commit: [obtained by running git log -n 1 <branchname>
commit df055a7155028b1d7b2bdda9b8a3ea1a7f96e5cb (tag: v1.2, origin/main, origin/HEAD, main)
Merge: b6c3a3b8 a1e48677
Author: Lon Tierney<EMAIL_ADDRESS>Date:   Thu Sep 19 19:31:15 2024 -0700

Merge pull request #857 from microsoft/vNext-Dev

Merging 1.2 features into Main

What region is your Azure Open AI Service in?
EastUS2

If the bug is confirmed, would you be willing to submit a PR?

[x] Yes
[ ] No

Even after a failed partial deployment and attempting to resume, Terraform is already trying to change on redeployment.

In turn, this leads to errors changing the Key Vault Secret resources:


Polygon fill alpha not applied on legend

Describe the bug
fill color of the polygon looks different on the polygon than it looks on the legend:

To Reproduce
use fill alpha on polygon

I think this one's in the bag! I may have also fixed the rendering bug that made the legend have a white block in the middle on Linux. Want to check this one out on your Linux system and see how it looks?

I'm pretty confident this did the trick, but feel free to open this issue again if the result isn't what you expected. Thanks again for mentioning this @SeidChr!

looks promising!
its a hazzle to use your dev code for developing this. ill wait for the release to test it.

Use whatever workflow works best for you, but using the latest version and updating with git seems easier than manually updating with NuGet on every release
https://github.com/swharden/scottplot#build-scottplot-from-source-code

To use the latest ScottPlot source code in your application, download this repository and add references in your project to ScottPlot.csproj, and one of ScottPlot.WPF.csproj or ScottPlot.WinForms.csproj (in the src folder).


Play video from local file

@lipangit
I've integrated this library to my app and it's playing the video from url very nicely.
The problem is that I don't find any option to play the video from local file which I've downloaded from the url. The video file can be saved to internal or external storage. I want to play this video file using this library.
I have seen several issues related to playing video from local file but I didn't find the solution.
Can you please let me know how I can play the video from local file?
I like this library and it would be appreciated if you provide me the solution.
Thanks!

It will solve your problem.
Have a nice day.


Fixed #31330 -- Corrected catchall URL pattern in flatpages docs.

Use re_path() pattern with the regex used before original regression in
df41b5a05d4e00e80e73afe629072e37873e767a.
Regression in a0916d7212aaae634f4388d47d8717abc2cd9036.
It's not worth using path() in this kind of context. (You want the control of the regex.)

Thanks :+1:


Implement reset code

Feature to reset code manually and reset code automatically after error

Hi, thank you for interest to my project and for automatic reset implementation. It is looks nice and will be a part of next release.


Document the origin of database files

I could not find any information in this repo on how the trie database files are produced. I'm thinking of packaging these files to other distros (than SailfishOS) and files with unknown origin are unlikely to be accepted.
Ideally, this repo should contain a build system from a freely distributable corpus to database for each language.

Its a good idea to document it. Used files were very large and it would not make sense for them to be uploaded. At least one of them I cannot distribute either. But I will document as much as I know and would try to ask for pointers if I haven't made them myself.


AggregateException from PS cmdlet when deploying using existing key valut

Hi,
I got an aggregation exception when I tried to run this comand
New-AzureRmServiceFabricCluster -ResourceGroupName $resourceGroupName -SecretIdentifier $secretID -TemplateFile $templateFilePath -ParameterFile $parameterFilePath
The exception says

New-AzureRmServiceFabricCluster : One or more errors occurred.
At line:1 char:1
+ New-AzureRmServiceFabricCluster -ResourceGroupName $resourceGroupName ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo          : CloseError: (:) [New-AzureRmServiceFabricCluster], AggregateException
+ FullyQualifiedErrorId : Microsoft.Azure.Commands.ServiceFabric.Commands.NewAzureRmServiceFabricCluster

Could you help me understand the problem here? Before running this script, I've created my resource group, and a key vault in it, and a certificate in the key vault. I'm also connected to the right subscription. What did I miss?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6202fb05-c2b0-b87f-71c9-5683e54f5e0c
Version Independent ID: 39505638-9926-fbc6-a795-3d7699859cde
Content: Create an Azure Service Fabric cluster from a template
Content Source: articles/service-fabric/service-fabric-cluster-creation-via-arm.md
Service: service-fabric
GitHub Login: @aljo-microsoft
Microsoft Alias: aljo

I'm closing this issue as we would go through msft internal deployment process to be compliant with company policy.

Thanks for the update @hukun01


Disable certificate check on proxy target url

Bug:
2023-11-06T15:22:47Z DBG http-get match from=<IP_ADDRESS> match= proxy=https_proxy rule=malleable_https_traffic
2023-11-06T15:22:47Z ERR Can't make proxy request error="Get "https://<IP_ADDRESS>:8443/test?param=aGVsbG8gd29ybGQsZnJvbSBibGFja3NudWZraW4K/test": tls: failed to verify certificate: x509: cannot validate certificate for <IP_ADDRESS> because it doesn't contain any IP SANs" from=<IP_ADDRESS> proxy=https_proxy
Fix:
/BounceBack/Internals/proxy/http/proxy.go
Line 81:

	if p.TLSConfig != nil {
		p.TLSConfig.InsecureSkipVerify = true // Add this line to skip certificate verification
		p.client.Transport = &http.Transport{
			TLSClientConfig:   p.TLSConfig,
			ForceAttemptHTTP2: true,
		}
		p.server.TLSConfig = p.TLSConfig
	}

	return p, nil

Thank you for your bug report! Accidentally deleted this in the previous version of BounceBack. Fixed, closing issue.


Add support for gcloudMode during Deploy

Allow deployments to use alpha or beta on gcloud <mode> app deploy

Did a need for this surface somewhere?

https://github.com/GoogleCloudPlatform/app-maven-plugin/issues/374

@elharo internal teams requesting it.


Php to zephir

hi,
I'm currently working on project that convert php to zephir using an AST.
It allready translate some project ex : symfony/event-dispatcher, doctrine/instanciator...
If you are interest, take a look at https://github.com/fezfez/php-to-zephir !
Thanks for your work.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/6875286-php-to-zephir?utm_campaign=plugin&utm_content=tracker%2F280146&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F280146&utm_medium=issues&utm_source=github).

Fezfez, I created a tool on top of the PHP Parser and your work, just making developers to more comfortably write php extension with php, feel  free to check out:
https://github.com/jimthunderbird/php-to-c-extension

Close, not an issue.


🐛 The identifier defer is no longer accepted

Environment information
Playground

What happened?
The following code now raises a syntax error:
const defer = 0;
//    ^^^^^^^^^
//    Expected an identifier, an array pattern, or an object pattern but instead found 'defer = 0'.

This is a bug caught by our Ecosystem CI on multiple repositories.
This is certainly caused by #4301.
Playground.
Expected result
The code must not raise a syntax error.
Code of Conduct

[X] I agree to follow Biome's Code of Conduct

cc @fireairforce

sorry, maybe i should move defer from the keywords, i will fix this later

You should leave defer as a keyword (because it is). The parser should just only check for the defer keyword when dealing with import statements.

I can look into this issue if you don't mind. @fireairforce


SPIKE: Research Extensibility options and extensibility strategy for Busola

Description
Research and document a technical solution that allows Busola to be easily extended by other teams and projects. A good target for the exploration would be to be able to extract all Kyma components as external ones, and be able to release Busola without them being part of the codebase.
Security Requirements:
We need to be sensitive with our app context. Code running in the app context have access to very sensitive informations.
Nice to have:
Plugins can extend certain sections of the app to be extended. Example : Preferences, Deployments Detail Page ( or any other section )
Reasons
As Busola plans on being a universal K8s dashboard, we need to offer a way to allow custom UI implementations and extensions for projects that have special needs to extend Busola.
Specific custom implementation for Kyma, is embedded in Busola codebase, and might be irrelevant for non Kyma K8s Clusters.
Attachments

https://github.com/backstage/backstage
https://github.com/dapr/dapr and https://github.com/dapr/components-contrib
https://github.com/Paciolan/remote-component
https://www.npmjs.com/package/@shopify/react-import-remote
Check Lens implementation

Estimated effort: 5 days for 2 people = 10MD

https://github.com/kyma-project/busola/pull/732

Spike was done.


Content-Type "multipart/form-data" in POST request occasionally crashes WiFiWebServer

Describe the bug
Very random bug that I can't even seem to reproduce at the moment. Was using XMLHttpRequest to submit form data from client to server via POST. Form data is stored in a FormData object.
As plain vanilla as it gets, no extra headers etc. But request did not get parsed correctly by the server when (by default) Content-Type was set to "multipart/form-data". When switching to Content-Type "application/x-www-form-urlencoded" the POST worked as expected.
Steps to Reproduce
The relevant code snippets are for the client (taken from https://developer.mozilla.org/en-US/docs/Learn/Forms/Sending_forms_through_JavaScript):
//////////////////////////////////////////////////////
Click Me!

//////////////////////////////////////////////////////
The server used was WiFiWebServer, called from SAMD_WiFiNINA.ino in the WiFiManager_NINA_Lite examples. Server connected to local WiFi, both WIFI and WIFININA debug levels set to 4.
Expected behavior
Expect the submitted test data (value pair "test" and "ok") to show up in the debug log, like it does when using "application/x-www-form-urlencoded", see log below:
[WIFI] handleClient: New Client
[WIFI] method:  POST
[WIFI] url:  /
[WIFI] search:
[WIFI] headerName:  Host
[WIFI] headerValue:  <IP_ADDRESS>
[WIFI] headerName:  User-Agent
[WIFI] headerValue:  Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:88.0) Gecko/20100101 Firefox/88.0
[WIFI] headerName:  Accept
[WIFI] headerValue:  /
[WIFI] headerName:  Accept-Language
[WIFI] headerValue:  en-GB,en;q=0.5
[WIFI] headerName:  Accept-Encoding
[WIFI] headerValue:  gzip, deflate
[WIFI] headerName:  Content-Type
[WIFI] headerValue:  application/x-www-form-urlencoded
[WIFI] headerName:  Content-Length
[WIFI] headerValue:  175
[WIFI] headerName:  Origin
[WIFI] headerValue:  null
[WIFI] headerName:  Connection
[WIFI] headerValue:  keep-alive
[WIFI] headerName:  Sec-GPC
[WIFI] headerValue:  1
[WIFI] headerName:  Pragma
[WIFI] headerValue:  no-cache
[WIFI] headerName:  Cache-Control
[WIFI] headerValue:  no-cache
[WIFI] args:  -----------------------------276130166930317460881212043603
Content-Disposition: form-data; name="test"
ok
-----------------------------276130166930317460881212043603--
[WIFI] args count:  2
[WIFI] args:  -----------------------------276130166930317460881212043603
Content-Disposition: form-data; name="test"
ok
Actual behavior
See log below. The request did not go past the parser, but got stuck somewhere in Parsing-impl.h.
Server then became unresponsive, and with it the whole board.
Debug log
[WIFI] handleClient: New Client
[WIFI] method:  POST
[WIFI] url:  /
[WIFI] search:
[WIFI] headerName:  Host
[WIFI] headerValue:  <IP_ADDRESS>
[WIFI] headerName:  User-Agent
[WIFI] headerValue:  Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:88.0) Gecko/20100101 Firefox/88.0
[WIFI] headerName:  Accept
[WIFI] headerValue:  /
[WIFI] headerName:  Accept-Language
[WIFI] headerValue:  en-GB,en;q=0.5
[WIFI] headerName:  Accept-Encoding
[WIFI] headerValue:  gzip, deflate
[WIFI] headerName:  Content-Type
[WIFI] headerValue:  multipart/form-data; boundary=---------------------------180992477013271867871486342273
[WIFI] headerName:  Content-Length
[WIFI] headerValue:  174
[WIFI] headerName:  Origin
[WIFI] headerValue:  null
[WIFI] headerName:  Connection
[WIFI] headerValue:  keep-alive
[WIFI] headerName:  Sec-GPC
[WIFI] headerValue:  1
[WIFI] args:
[WIFI] args count:  0
[WIFI] args:
[WIFI] args count:  0
[WIFI] Parse Form: Boundary:  ---------------------------180992477013271867871486342273
[WIFI] Length:  174
...and this is where we become stuck!
Other observations
I did look at the HTTP request details (Request payload section) in the Firefox Network debugger.

In the --...---xx... Boundary line, after the last number, a space and two double quotes showed up ( ""), which looked odd and out of place. Too bad, I can't reproduce this at the moment and provide a matching screen shot. And it does not show in the log above, either.
At an earlier time, the last message on the console would be "Error: line: ...", and it would only then go unresponsive. That led me to look at Parsing-impl.h, where this message must be generated in method WiFiWebServer::_parseForm.
Maybe the extra quotes are mistaken by the parser for the start of a key/data value? I'm not sure, and I'm sorry I can't even reproduce it at the moment at all. Hope any of this makes some sense to you.
Information

Arduino IDE version: 1.8.13 on Windows 10
Board: Arduino NANO 33 IoT with latest firmware

Hi,
Wow, so great to get your bug report, again with the same impressive details. Will look at it very soon.
Thanks and Regards,

Hi,
The MPUs' software and library are not designed to be complex with all the features as the normal PC ones (lack of power, memory, etc.) . Sometimes, the memory limitation (heap / stack overflow) can cause hard-to-duplicate issues, especially if we send too much more data than the MPU can handle.
Currently, the multipart/form-data header type is not fully tested / supported yet, but the application/x-www-form-urlencoded has already been supported. Hopefully we can find out where the issue is and fix it.
Parsing-impl.h#L717-L721
      if (headerName.equalsIgnoreCase("Content-Type"))
      {
        using namespace mime;

        if (headerValue.startsWith(mimeTable[txt].mimeType))
        {
          isForm = false;
        }
        else if (headerValue.startsWith("application/x-www-form-urlencoded"))
        {
          isForm = false;
          isEncoded = true;
        }
        else if (headerValue.startsWith("multipart/"))
        {
          boundaryStr = headerValue.substring(headerValue.indexOf('=') + 1);
          // KH
          boundaryStr.replace("\"", "");
          //
          isForm = true;
        }
      }

It's possible we're stuck in an infinite loop (???) here in Parsing-impl.h _parseForm().
  do
  {
    line = client.readStringUntil('\r');        <============ the culprit possibly is readStringUntil() of Stream library
    ++retry;
  } while (line.length() == 0 && retry < 3);

For example, the sample code of Stream lib
String Stream::readStringUntil(char terminator, size_t max)
{
  String ret;
  int c = timedRead();
  while (c >= 0 && c != terminator)
  {
    ret += (char)c;
    c = timedRead();
  }

  return ret;
}

It's helpful if you can provide the full source code so that anybody can easily rerun and test.
If you have time, please also try to duplicate and nail the issue down. I currently have no idea yet.

Hi Khoi,
Thanks for looking into this. I have today encountered the issue again, and did some digging. Plastered Parsing-impl.h with a million WS_LOGDEBUGs, basically. Turns out, the problem is caused by this very innocent looking statement:
if (_postArgs)
delete[] _postArgs;   ----> **we don't get past this point!**

This is supposed to call the destructor for _postArgs, an array of "RequestArgument" structures, each with 2 strings (key and value) inside.
As soon as I comment out the delete[] _postArgs; statement, the script works fine and correctly parses all parameters.
The delete[] must be there for good reason, though. It then dawned on me that _postArgs is actually just a pointer to the array of structures, so if (_postArgs) would always be true, even if _postArgs pointed to nothing. Changing the if statement to if (_postArgs != nullptr) seems to do the trick. So, I think the issue is caused by trying to delete _postArgs when it hasn't been instantiated yet. Which happens right after processing the POST headers, when no key/value pairs have yet been processed.
I will run with my mod for a while and see whether that fixes the issue for good. Have changed all the other delete[] sections, too, as they are similar.

Wow, such great findings after a lot of works :+1: .
I'll have to spend time to look why it's there.
Please have more tests to be sure it's the only culprit, or there are more.
When you're sure it's working reliably, please make a PR.

Will do. Looks like I need to change a bit more, explicitely assigning nullptr to newly instatiated object pointers, and also after deleting them...

explicitely assigning nullptr to newly instatiated object pointers, and also after deleting them...

This is a must, but sometimes we forget to do it correctly. It  takes time and devotion to find out. Thanks.

Just submitted a PR. That should take care of this issue. In any case, adding = nullptr  to the pointer instantiation in WifiWebServer won't do any harm for the other variables either. No changes needed in Parsing-impl!

Already merged the PR.
Can you also help check the remaining code using  delete, delete [], or new and modify using nullptr and nullptr check as well before we can publish new release.
Parsing-impl.h:    delete[] _currentArgs;
Parsing-impl.h:    delete[] _currentArgs;
Parsing-impl.h:      delete[] _postArgs;
Parsing-impl.h:      delete[] _currentArgs;
Parsing-impl.h:      delete[] _postArgs;
Parsing-impl.h:    if (_currentArgs) delete[] _currentArgs;
Parsing-impl.h:      delete[] postArgs;
WiFiWebServer-impl.h:    delete[]_currentHeaders;
WiFiWebServer-impl.h:    delete handler;
WiFiWebServer-impl.h:        delete[] toencode;
WiFiWebServer-impl.h:        delete[] toencode;
WiFiWebServer-impl.h:        delete[] encoded;
WiFiWebServer-impl.h:      delete[] toencode;
WiFiWebServer-impl.h:      delete[] encoded;
WiFiWebServer-impl.h:    delete [] buffer;
WiFiWebServer-impl.h:    delete[]_currentHeaders;

Parsing-impl.h:      buf = newBuf;
Parsing-impl.h:    dataLength += newLength;
Parsing-impl.h:  _currentArgs = new RequestArgument[_currentArgCount + 1];
Parsing-impl.h:    _currentArgs = new RequestArgument[1];
Parsing-impl.h:  _currentArgs = new RequestArgument[_currentArgCount + 1];
Parsing-impl.h:    _postArgs = new RequestArgument[WEBSERVER_MAX_POST_ARGS];
Parsing-impl.h:              _currentUpload = new HTTPUpload();
Parsing-impl.h:    _currentArgs = new RequestArgument[_postArgsLen];
Parsing-impl.h:    RequestArgument* postArgs = new RequestArgument[32];
Parsing-impl.h:    _currentArgs = new RequestArgument[postArgsLen];
utility/RingBuffer.cpp:  ringBuf = new char[size + 1];
WiFiWebServer-impl.h:      char *toencode = new char[toencodeLen + 1];
WiFiWebServer-impl.h:      char *encoded = new char[base64_encode_expected_len(toencodeLen) + 1];
WiFiWebServer-impl.h:  uint8_t* buffer = new uint8_t[SENDCONTENT_P_BUFFER_SZ];
WiFiWebServer-impl.h:  _currentHeaders = new RequestArgument[_headerKeysCount];

Regards,


Introducing Connectors.AI.HuggingFace Package

Description
In an effort to slim down SemanticKernel.Core and standardize around the Connectors.AI packaging pattern, we're moving the Connectors.HuggingFace calls into their own Connectors.AI.HuggingFace nuget package, which will be an optional reference.
This connector currently only connects to models running on the local Hugging Face python server. With some minor updates, it will be able to point to Hugging Face hosted models. This is a code move and repackaging only -- no new functionality.
Contribution Checklist

[X] The code builds clean without any errors or warnings
[X] The PR follows SK Contribution Guidelines (https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
[X] The code follows the .NET coding conventions (https://learn.microsoft.com/dotnet/csharp/fundamentals/coding-style/coding-conventions) verified with dotnet format
[X] All unit tests pass, and I have added new tests where possible
[X] I didn't break anyone :smile:

This connector currently only connects to models running on the local Hugging Face python server. With some minor updates, it will be able to point to Hugging Face hosted models.

Actually, text completion works with HF hosted models as well, in case you don't pass endpoint to your local endpoint in constructor, it will use endpoint of hosted model by default (https://api-inference.huggingface.co/models) 😃


Replace 'require' with 'import'.

The require in the es6 module was breaking rollup for me.
Changing it to import seems to work nicely for both rollup and webpack.

Thanks -- much appreciated.


Not valid unit for device class distance

Region and Brand of car
EU, Hyundai Kona 2024 (scc2 supported)
Version of the integration
master using hyundai_kia_connect_api==3.14.1
Describe the bug
I found the following errors in my HA log after upgrading to master so that I cloud test hyundai_kia_connect_api==3.14.1
Debug logs if an error occurred
Logger: homeassistant.components.sensor
Source: components/sensor/__init__.py:719
Integration: Sensor (documentation, issues)
First occurred: 1:38:12 PM (3 occurrences)
Last logged: 1:38:12 PM

Entity sensor.kona_total_driving_range (<class 'custom_components.kia_uvo.sensor.HyundaiKiaConnectSensor'>) is using native unit of measurement 'None' which is not a valid unit for the device class ('distance') it is using; expected one of ['km', 'cm', 'ft', 'mi', 'yd', 'm', 'mm', 'in']; Please update your configuration if your entity is manually configured, otherwise create a bug report at https://github.com/fuatakgun/kia_uvo/issues
Entity sensor.kona_target_range_of_charge_ac (<class 'custom_components.kia_uvo.sensor.HyundaiKiaConnectSensor'>) is using native unit of measurement 'None' which is not a valid unit for the device class ('distance') it is using; expected one of ['km', 'cm', 'ft', 'mi', 'yd', 'm', 'mm', 'in']; Please update your configuration if your entity is manually configured, otherwise create a bug report at https://github.com/fuatakgun/kia_uvo/issues
Entity sensor.kona_target_range_of_charge_dc (<class 'custom_components.kia_uvo.sensor.HyundaiKiaConnectSensor'>) is using native unit of measurement 'None' which is not a valid unit for the device class ('distance') it is using; expected one of ['km', 'cm', 'ft', 'mi', 'yd', 'm', 'mm', 'in']; Please update your configuration if your entity is manually configured, otherwise create a bug report at https://github.com/fuatakgun/kia_uvo/issues

I see the same. Not sure were it is comming from. The hard coded odometer (km) is working.

I think I found the problem. It should be fixed now.

A new version 2.20 is out which has fixed this bug. You might control and close this bug.

The changes where merged after 2.20, so we need a new 2.21 for this

You can try it out by using HACS and using redownload and select master version.  Releases of Ki_uvo auto release Sundays and Wednesday. Or if we force it.

Fixed, warnings gone


feature: adding a weather appication showing mocking capability of keploy

This pr closes:https://github.com/keploy/keploy/issues/422
this is a weather applicaiton showing mocking capability of keploy.
RECORD_MODE

TEST_MODE

KEPLOY

Closing as its incompatible with the current version of keploy.


feat: Handle fee-on-transfer token taxes in price impact calculations

Now that sdk-core Token returns information about token taxes and V2 trade routes are constructed with pre tax input amount and post-tax output amount in mind, we should update priceImpact calculations to exclude taxed differences. More in the diagram here, but we should be reading from the values right before and after the "Swap" step:


module file was created by an older version of the compiler in xcode 8 and swift 2.3

New Issue Checklist

[ +] I have looked at the Documentation
[ +] I have read the F.A.Q.

Issue Info

Info
Value

Platform
e.g. ios

Platform Version
e.g. 8.0

SnapKit Version
e.g. 0.22.0

Integration Method
e.g. cocoapods

@WE-St0r please ensure you read the contributing guidelines and try to provide a complete issue ticket rather than just a title.


Cannot Install Extension on Azure DevOps Server 2019 (on-premise)

Describe the bug
I cannot install the OWASP Dependency Check Azure DevOps Server Extension.
Version of dependency-check used
Azure DevOps Extension <IP_ADDRESS>
To Reproduce
Steps to reproduce the behavior:

Go to your on-premise Azure DevOps Server 2019 Update 1 (version 17.M153.5) root website
Click on "Browse Marketplace" in the upper right corner
Search the "OWASP Dependency Check" Plugin in the Azure DevOps Marketplace https://marketplace.visualstudio.com/items?itemName=dependency-check.dependencycheck

Click on "Get it free"
An error is displayed: "We've encountered an error while downloading the extension. Please try again later."

Expected behavior
The extension installs an our local Azure DevOps Server.
or
The extension does not list "Azure DevOps Server 2019" as compatible installation target. (less prefered behavior)
Additional context

Other extensions install just fine
When downloading the vsix-Extension file and uploading it manually to the local Azure DevOps Server Extension Gallery, the following message is displayed:

I found the following thread in which Microsoft states, that the extension size is limited to 25 Mb. The OWASP-Extension is approx. 36MB. The extension package size exceeds the maximum package size '26214400 bytes'

Same issue as https://github.com/dependency-check/azuredevops/issues/7

@ejohn20 Thanks for moving this issue and pointing me in the right direction.
Maybe it would help to add some guidance at the Azure DevOps Marketplace page on how to configure this extension? Many other extensions include special on-premise configuration steps, e.g. this one (Definition of Done)[https://marketplace.visualstudio.com/items?itemName=agile-extensions.dod]

I think that's a great idea. I don't have access to an on-prem installation of Azure DevOps. If you don't mind, would you want to take a shot at writing up your on-prem set up steps?
This content is in the overview.md file: https://github.com/dependency-check/azuredevops/blob/master/overview.md

@Sebbl22 FYI - The latest release now downloads the installer during execution, which reduced the package size tremendously.

@ejohn20 Thanks. I can now download the extension in my test environment without problems. There should be no more need for special on-prem installation steps.


Understand why headers were reported "missing" by the stale dep. rule

Happened after a 2-month hiatus for no apparent reason.
The problem is they weren't actually missing at all.

Well, albeit not yet fully understanding the reason, it was definitely a recent attempt to make that %.h: rule more general by adding %.hpp %.inl to it. But instead of just catching those file types too, it just still matched the EXISTING .h files, while also considering them non-existing, probably because of the other patterns not matching...


how to we work with the postGIS column??

Describe the task
Spike to determine how it works with (1)  java and (2) how it can work with the seedlot_audit table.
Ricardo to work with java classes and document how they work with Java and the ETL. For the seed_audit table need to capture changes to the seedlot postgis columns.
Acceptance Criteria

[ ] document cases one and two #1036 in Github Wiki

Logs from the database, regarding the Seedlot Audit table:
2024-05-13 18:38:26.019 UTC [23624] WARNING:  [AUDIT.IF_MODIFIED_FUNC] - UDF ERROR [OTHER] - SQLSTATE: 42601, SQLERRM: INSERT has more expressions than target columns
2024-05-13 18:38:26.019 UTC [23624] CONTEXT:  PL/pgSQL function seedlot_if_modified_func() line 345 at RAISE
2024-05-13 18:42:04.000 UTC [23929] WARNING:  [AUDIT.IF_MODIFIED_FUNC] - UDF ERROR [OTHER] - SQLSTATE: 42601, SQLERRM: INSERT has more expressions than target columns
2024-05-13 18:42:04.000 UTC [23929] CONTEXT:  PL/pgSQL function seedlot_if_modified_func() line 345 at RAISE
2024-05-13 18:42:04.045 UTC [23929] WARNING:  [AUDIT.IF_MODIFIED_FUNC] - UDF ERROR [OTHER] - SQLSTATE: 42601, SQLERRM: INSERT has more expressions than target columns
2024-05-13 18:42:04.045 UTC [23929] CONTEXT:  PL/pgSQL function seedlot_if_modified_func() line 345 at RAISE
2024-05-13 18:42:04.581 UTC [23929] WARNING:  [AUDIT.IF_MODIFIED_FUNC] - UDF ERROR [OTHER] - SQLSTATE: 42601, SQLERRM: INSERT has more expressions than target columns
2024-05-13 18:42:04.581 UTC [23929] CONTEXT:  PL/pgSQL function seedlot_if_modified_func() line 345 at RAISE
2024-05-13 18:42:05.627 UTC [23929] WARNING:  [AUDIT.IF_MODIFIED_FUNC] - UDF ERROR [OTHER] - SQLSTATE: 42601, SQLERRM: INSERT has more expressions than target columns
2024-05-13 18:42:05.627 UTC [23929] CONTEXT:  PL/pgSQL function seedlot_if_modified_func() line 345 at RAISE

Based on this task. A SPAR wiki page was put together: How to work with PostGIS in Java
References:

GeometryFactory JavaDoc
LocationTech JTS Java library
Hibernate Spatial Types
Map PostGIS with Hibernate - Old, but some relevant comments

Indirectly related:

PostGIS 3D Point - PoitZ
PostGIS Geometries


merge CL:0002294 into CL:0009077

Fixes #2101
Requires changes in Uberon (changing UBERON:0006936 to use CL:0009077)
My choice of choosing CL:0009077 was due to its use in HRA subset
I see that there are obsoletion notices now - not sure exact ways of working now so will leave that to @bvarner-ebi
Also due to obsoletion method, import file is changed - happy for this change to be reverted and fixed at source (Uberon).
PS could someone help me fix it in Uberon side please? requires import and its a whole thing here.
Thanks!

@shawntanzk, thanks for the suggested changes.
If you propose to merge/obsolete a term, kindly just open an issue. An editor will review and make an announcement on slack and give at least 2 weeks' notice before obsoleting if there is no objection. We're requesting outside collaborators to request PR reviewers instead of automatically assigning them.

@bvarner-ebi - happy for you to close this and go through your processes :) thanks

We're requesting outside collaborators to request PR reviewers instead of automatically assigning them.

btws @bvarner-ebi  sorry for assigning directly, I figured that was the way to request PR reviewers. Do let me know how I should go about it in the future. Personally I dont really mind who reviews my PRs, but I tend to find that if I don't assign a reviewer, the PR sits there and nothing happens. Is there a system to pick up PR reviews in CL if I dont really mind who reviews my PR?
Currently I am following CL documentation to assign a reviewer https://obophenotype.github.io/cell-ontology/contributing/#pull-request-guidelines quoting the docs:

Make sure pull requests have someone assigned to review them and remind them once in a while. Do not let them go dormant

Happy to follow whatever procedure is preferred by the community, but would like it documented cause different ontologies have different preferences in workflow and all :)
PS on a seperate note, I notice that @gouttegd was to be generic assignee for tickets in the documentation lol - I think this was written up when he was sheparding CL tickets, might consider a change?

This PR involves obsoleting a CL class.
Will close without merging for now (acknowledged by assignee) with following action items:

When time permits, editor will review ticket, if necessary find literature support to justify change
notify slack #cl-editors of planned obsoletion
if no objection after at least 2 weeks, proceed with merge
next CL release is planned for next week, so if there are no objections change will be reflected in September release at the earliest
work with @anitacaron to incorporate synonym QC in CL checks

@shawntanzk, thanks again for spotting these potential changes to improve CL.


Add linting for backward compatibility

Show a soft lint warning when API/Query data is assigned to JSObject variables. Warning message: JSObject variables are not reactive. Any updates to API/Query data will not be propagated to widget bindings. Re-assign the variable to update widgets.
```jsx
Button1 onClick => JSObject.getUsers()
Table1.data bound to {{JSObject1.userData}}

export default {
	userData: {},
  // Initial value changed from [1,2,3]
  getUsers: async() {
    await API1.run()
		this.userData = API1.data
	},
	getMaleUsers: () {
		this.userData = _.filter(users, { 'gender': 'male' });
	},
	getFemaleUsers: () {
		this.userData = _.filter(users, { 'gender': 'female' });
	},
}
```

Expected Execution Flow:
1. Initial value of userData changed from `[1,2,3]` to `{ }`
2. Button clicked. `getUsers` executes. `API1` runs and returns a response. `userData` is set to API response. `Table1` displays all users.
3. Execute `getMaleUsers`. `userData` is modified. `Table1` displays only male users.
4. Execute`getFemaleUsers`. `userData` is modified. `Table1` displays only female users.

@satbir121 this needs to be prioritized along with JSObject variable mutation.

@bharath31 Did we notice user queries regarding confusion about reactivity not working for mentioned scenario? Last time we discussed about it, we planned to collect user queries to accordingly take action here AFAIK.

There has been no signals that users are confused about JS object mutation.


unable to use environment variables in cwd

I'm trying to run a program called entangled inside my neovim directory. When I specify $XDG_CONFIG_HOME, the entangled daemon doesn't work and isn't able to find its config file.
procs:
  neovim_literate:
    cwd: "$XDG_CONFIG_HOME/nvim"
    env:
      XDG_CONFIG_HOME: "/home/username/.config"
    shell: "entangled daemon"

However, if I specify an absolute path to the neovim config directory, the entangled daemon starts without issues.
procs:
  neovim_literate:
    cwd: "/home/username/.config/nvim"
    shell: "entangled daemon"

I'm not sure if what I'm trying to do is intended or not but I think mprocs should inherit the environment variables defined inside the terminal where it runs and YAML config keys like cwd, shell etc should be able to use these environment variables.

cwd doesn't support env variables. It is just a plain path string. You can try to do something like this: shell: "cd $XDG_CONFIG_HOME/nvim && entangled daemon".

Would it be desirable to support environment variables in cwd? In my opinion, that sounds like a cleaner solution than the proposed shell solution.

I think it's not justified to add that logic to cwd. But even if adding that feature, I would expect it to only use env variables that are passed to mprocs initially (not env vars set in mprocs.yaml).

But even if adding that feature, I would expect it to only use env variables that are passed to mprocs initially (not env vars set in mprocs.yaml).

mprocs can inherit the environment variables from the session where it's started. $XDG_CONFIG_HOME is one such variable that should already be defined and available to inherit on most Linux systems.

I'm contemplating adding some operator to config which would allow using env variables. Something like this:
procs:
  neovim_literate:
    shell: entangled daemon
    cwd: { $expand: "$XDG_CONFIG_HOME/nvim" }

Where { $expand: "$XDG_CONFIG_HOME/nvim" } would be replaced with a string "$XDG_CONFIG_HOME/nvim" with $XDG_CONFIG_HOME replaced with an actual value.
But it feels too complex and not very flexible. If we support this, why not just support complete language for configs, like lua.

But it feels too complex and not very flexible. If we support this, why not just support complete language for configs, like lua.

If adding functionality like expanding environment variables in a YAML config format makes things complex, I think mprocs would definitely benefit by supporting Lua as a configuration language.


fix: incorrect vendor for bluecoat

Revert change to symantec from bluecoat to prevent breaking customer deployments

:tada: This PR is included in version 2.26.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Cordova iOS App Build Failed "Module 'FirebaseFunctions' not found"

Frameworks in Pod File:
pod 'ZXingObjC', '3.6.5'
pod 'Firebase/Core', '7.6.0'
pod 'Firebase/Auth', '7.6.0'
pod 'Firebase/Messaging', '7.6.0'
pod 'Firebase/Performance', '7.6.0'
pod 'Firebase/RemoteConfig', '7.6.0'
pod 'Firebase/InAppMessaging', '7.6.0'
pod 'Firebase/Firestore', '7.6.0'
pod 'Firebase/Crashlytics', '7.6.0'
pod 'GoogleSignIn', '5.0.2'
pod 'GoogleTagManager', '7.2.0'
I also added Cordova  "cordova-plugin-ionic-keyboard": {} but the iOS App build failed with the following error:
Module 'FirebaseFunctions' not found.

FirebaseFunctions is a new Firebase SDK component so the most likely cause is your local pods repo is out-of-date - please see the documentation for how to resolve this.
You can validate your build environment against a known working codebase by building the example project

No I have another error, Module 'FirebaseFirestore' not found.

are you encountering this when trying to build your own project or the example project?
either way it looks like an issue satisfying the cocopods dependencies in your build env.
I recommend removing the platform project (cordova platform rm ios --nosave) and re-adding with verbose logging (cordova platform add ios --verbose) and inspect the console output for errors.

I have the same issue in my work project, I can deploy the app in my own iPhone and Android device, but I can't emulate the app on the iOS simulator due to the mentioned error

I updated the plugins
pod 'Firebase/Core', '8.4.0'
pod 'Firebase/Auth', '8.4.0'
pod 'Firebase/Messaging', '8.4.0'
pod 'Firebase/Performance', '8.4.0'
pod 'Firebase/RemoteConfig', '8.4.0'
pod 'Firebase/InAppMessaging', '8.4.0'
pod 'FirebaseFirestore', :git => 'https://github.com/invertase/firestore-ios-sdk-frameworks.git', :tag => '8.4.0'
pod 'Firebase/Crashlytics', '8.4.0'
pod 'GoogleSignIn', '5.0.2'
pod 'GoogleTagManager', '7.3.1'
but now I am getting another error:

Looks like you're using an old version of this plugin because FirebaseInstanceID has been deprecated and removed from recent versions of the Firebase SDK for iOS and has therefore been removed from latest versions of this plugin.
Please update to the latest plugin version (v13.0.1) and re-test.

I updated this framework, but cannot find Firebase Messaging

I have a reproducible build system (Btirise), and builds suddenly stopped to work yesterday, on the same commit, with the error :
In file included from /Users/vagrant/git/platforms/ios/Boks preprod/Plugins/cordova-plugin-firebasex/FirebasePlugin.m:1:
/Users/vagrant/git/platforms/ios/Boks preprod/Plugins/cordova-plugin-firebasex/FirebasePlugin.h:4:9: fatal error: module 'FirebaseFirestore' not found
@import FirebaseFirestore;
 ~~~~~~~^~~~~~~~~~~~~~~~~
1 error generated.
The following build commands failed:
	CompileC /Users/vagrant/Library/Developer/Xcode/DerivedData/Boks_preprod-axpubthxykkfxvhflqqrgrpvwivc/Build/Intermediates.noindex/ArchiveIntermediates/Boks\ preprod/IntermediateBuildFilesPath/Boks\ preprod.build/Release-iphoneos/Boks\ preprod.build/Objects-normal/arm64/FirebasePlugin.o /Users/vagrant/git/platforms/ios/Boks\ preprod/Plugins/cordova-plugin-firebasex/FirebasePlugin.m normal arm64 objective-c com.apple.compilers.llvm.clang.1_0.compiler
(1 failure)
xcodebuild: Command failed with exit code 65
[ERROR] An error occurred while running subprocess cordova.

        cordova build ios --release --device --buildConfig /var/folders/6q/wgy6jtp12w5gz... exited with exit code 65.

I have the same problem...

I have the same problem...

@dpa99c
I have the same problem.
cordova-plugin-firebasexz 1.13.1

Does this have anything to do with it?
https://githubmemory.com/repo/invertase/firestore-ios-sdk-frameworks/issues/28


Suggestion for Admin Panel

We would like to hear your suggestions for what you would like in the Admin Panel Dashboard.

Please put in your suggestions by commenting on this issue. Thank you.

Server Logs
Google Analytics Dashboard


Error with GitHub registery

Error with GitHub registery
I have the following .yarnrc.yml
enableImmutableInstalls: false

nodeLinker: node-modules

npmScopes:
  xxx-xxx:
    npmAuthToken: "${GITHUB_TOKEN-''}"
    npmPublishRegistry: "https://npm.pkg.github.com/"

Here is the CI that I have ("translated" into GitHub Actions, I use another CI than Github)
jobs:
  publish:
    runs-on: ubuntu-latest
    steps:
      - XXXX

      - run: yarn install --immutable

      - run: 'yarn changeset version && yarn config set enableImmutableInstalls false && yarn install && git add yarn.lock && git commit -m "chore: update lockfile [skip-ci]" && git push --set-upstream origin master'

      - run: yarn changeset publish
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

The last command yarn changeset publish fail with the following error:
🦋  error Received an unknown error code: E401 for npm info "@xxx-xxx/test-publish"
🦋  error Unable to authenticate, need: Basic realm="GitHub Package Registry"
error Command failed with exit code 1.

When I use yarn npm publish instead I can publish the package,
Did you have any idea how I can fix the issue or understand why we have it

@JulienKode it seems that we should switch to a yarn equivalent of npm info when using Yarn Berry. I'm reworking parts of the publish process in Changesets right now to make it work better with Berry but a fix for this one is not included in my work yet. I would first like to land a fix for a more standard publish process and then get back to this issue here and fix it.

Related; https://github.com/changesets/changesets/issues/965


Installed napalm package doesn't work

Hi there!! I'm trying to use Peering Manager with Docker but I need to install napalm-huawei-vrp driver, so I jumped into the peering-manager container and run pip install napalm-huawei-vrp, what worked as expected but Peering Manager gives error "Unable to connect to the router. " when I click in Ping button.
Ok, so I created a new Dockerfile and there I install that driver, but in logs I can see same error, no napalm driver: 'huawei_vrp' for platform: 'Huawei VRP' found (not installed or does not exist)
If I try from command line, it works!
Is there a way I can do that? Or am I missing an update somewhere?
Thanks!
My Dockerfile:
FROM docker.io/peeringmanager/peering-manager:latest

RUN /opt/peering-manager/venv/bin/pip install napalm-huawei-vrp

ENTRYPOINT [ "/sbin/tini", "--" ]

CMD [ "/opt/peering-manager/docker-entrypoint.sh", "/opt/peering-manager/launch-peering-manager.sh" ]

I was using the image with Huawei VRP driver only in peering manager container, but not for rqworker container
I updated docker-compose.override.yml to use my image with Huawei VRP driver and now it's working.


User Data lingering when downloading app from Google Play Store

Hi,
For some odd reason, this issue is only happening in my device. When I download the app directly from the Play Store, I see that I have about 15 MB worth of User Data. When I open the app, I see silent crashes linked to SafeRoom. I am not sure if somehow SafeRoom is saving the encrypted data in a database outside of the app; completely removing the app and re-downloading the APK did not resolve the issue.
The one change I can think of was bumping the version of Room. I also have fallbackToDestructiveMigration mode enabled.
The passphrase has not changed either.
Here is the stack trace I have been getting in Crashlytics:
Fatal Exception: net.sqlcipher.database.SQLiteException
file is not a database: , while compiling: select count(*) from sqlite_master;
net.sqlcipher.database.SQLiteCompiledSql.native_compile (SQLiteCompiledSql.java)
net.sqlcipher.database.SQLiteCompiledSql.compile (SQLiteCompiledSql.java:91)
net.sqlcipher.database.SQLiteCompiledSql.<init> (SQLiteCompiledSql.java:64)
net.sqlcipher.database.SQLiteProgram.<init> (SQLiteProgram.java:89)
net.sqlcipher.database.SQLiteQuery.<init> (SQLiteQuery.java:48)
net.sqlcipher.database.SQLiteDirectCursorDriver.query (SQLiteDirectCursorDriver.java:60)
net.sqlcipher.database.SQLiteDatabase.rawQueryWithFactory (SQLiteDatabase.java:2012)
net.sqlcipher.database.SQLiteDatabase.rawQuery (SQLiteDatabase.java:1898)
net.sqlcipher.database.SQLiteDatabase.keyDatabase (SQLiteDatabase.java:2647)
net.sqlcipher.database.SQLiteDatabase.openDatabaseInternal (SQLiteDatabase.java:2590)
net.sqlcipher.database.SQLiteDatabase.openDatabase (SQLiteDatabase.java:1243)
net.sqlcipher.database.SQLiteDatabase.openOrCreateDatabase (SQLiteDatabase.java:1318)
net.sqlcipher.database.SQLiteOpenHelper.getWritableDatabase (SQLiteOpenHelper.java:166)
com.commonsware.cwac.saferoom.Helper$OpenHelper.getWritableSupportDatabase (Helper.java:172)
com.commonsware.cwac.saferoom.Helper.getWritableDatabase (Helper.java:82)

Has this been reported in the past? I can provide more information if needed.
Thank you in advance.

Here is the stack trace I have been getting in Crashlytics

The stack trace indicates that you are trying to open a database that either is:

Not encrypted
Encrypted with a different passphrase than the one that you are using
Not a recognized database (e.g., data corruption)

This error is coming from SQLCipher for Android. By design, for security reasons, it does not indicate which of those three scenarios occurred (and, in many cases, it cannot tell, anyway).

When I download the app directly from the Play Store, I see that I have about 15 MB worth of User Data

That cannot have come from SafeRoom, as none of your code will have been executed immediately after your app has been downloaded.

For some odd reason, this issue is only happening in my device.

If you have android:allowBackup="true" in your <application> in the manifest, perhaps it is some past file that Android/Google are restoring.

I am not sure if somehow SafeRoom is saving the encrypted data in a database outside of the app

The database will go wherever you told your RoomDatabase to put it. SafeRoom itself is not involved in that decision.

completely removing the app and re-downloading the APK did not resolve the issue

Sorry, but I do not understand what you mean by this.

The passphrase has not changed either.

FWIW, the passphrase should be unique to each user, either coming from the user themselves or from some encrypted file secured by their device.

Has this been reported in the past?

I am not quite certain what the scope of "this" is. The stack trace is fairly common in SQLCipher for Android use.

I can provide more information if needed.

This repository comes with contribution guidelines, including instructions for filing bug reports. If you feel that this is a bug in SafeRoom specifically (and not in SQLCipher for Android), I need steps to reproduce the problem.
This feels like a support question, which could be better handled elsewhere.


[MM-983]: Resolved TS errors in action and disconnect modal files

Summary
Resolved TS errors in action and disconnect modal files
Original PR
https://github.com/mattermost/mattermost-plugin-jira/pull/1140
What to Test

Complete major functionality of the plugin

I don't think we need a QA on this PR. Hence, merging it. QA can be handled in the release sanity.


fix: increase out-of-order log level to error

:tada: This PR is included in version 0.1.0-beta.9 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 0.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Update historic records with invalid dates

Update historic records with invalid dates created by issue #4264

@thakurveerendras kindly verify

This ie ready for the review in DEV. If it looks good then @nickmango can update them in PROD.

Hello @nickmango
Found following behaviour

On CD board: Invalidate date records are not listed

On PCC Signature table: Invalidate date still reproducible

@thakurveerendras kindly re-verify

@nickmango , Issue is still reproducible on PCC at the reported project SUN
Project link: https://v1.pcc.dev.platform.linuxfoundation.org/project/a09P000000DsCE5IAN/tools/easycla/overview/01af041c-fa69-4052-a23c-fb8c1d3bef24/signatures
Refer to the screenshot

@thakurveerendras kindly recheck

Tested reported records on dev site & found that Date Signed is properly updated & invalid dates is not appears, So updating this issue status


Add MSAs to mapping.

This is somewhat tricky since the AHS stores them as 4-character strings. We need to append a 0.

And update to this: These are actually 1980 MSAs

This merge is currently being handled by https://github.com/enigma-io/smoke-signals-model, but should still be abstracted out for alternative use cases.


Add clickable rows to dynamic tables

One idea is to introduce a meta attribute, called :link@kino, that when present makes the row clickable.

To make sure I understand: for instance if one cell contained a HTTP link, would it mean I could make it clickable? It would be helpful!

It is more about among the whole row clickable! We are not sure if we are going this route though. Note you can also use markdown to build HTML (and therefore tables).


Error handling for a watchify recepie

I would like to see a working example for error handling for fast-browserify-builds-with-watchify. Now it just crashes for me on error.
Thanks!

Finding this no longer works with newest version of watchify/browserify.

:-1:  this no longer works :-(

@FlorentD, try to add this.emit("end")
.on('error', function (err) {
  gutil.log(err.toString());
  this.emit("end");
})

@FlorentD @alferov Maybe just callback? For me it works well
.pipe(...)
.on('error', done)

this.emit('end') was the key.  Thanks @alferov


amplify console command for auth returns error

Describe the bug
amplify console for auth returns the following error:
amplify console
? Please select the category or provider auth
/usr/local/lib/node_modules/@aws-amplify/cli/node_modules/gluegun/build/index.js:13
    throw up;
    ^

TypeError: plugin.console is not a function
    at Command.run (/usr/local/lib/node_modules/@aws-amplify/cli/src/commands/console.js:20:19)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Console option for auth is not available yet, but we’ll provide a fix for better the error message.

PR for this is submitted and approved -> #632


Autometic reconnection.

If tcp timeout occurs, we need to have option for automatic reconnection. when connecting , give them option for this, default should be false.

done.


Remote desktop connection from windows 10, with x11vnc and -unixpw argument, weird key events

xrdp version
0.9.19
Detailed xrdp version, build options
user@mvc:~$xrdp --version
xrdp 0.9.19
  A Remote Desktop Protocol Server.
  Copyright (C) 2004-2020 Jay Sorg, Neutrino Labs, and all contributors.
  See https://github.com/neutrinolabs/xrdp for more information.

  Compiled with OpenSSL 3.1.3 19 Sep 2023

Operating system & version
Yocto  built OS
Installation method
dnf / apt / zypper / pkg / etc
Which backend do you use?
x11vnc 0.9.16
What desktop environment do you use?
Xfce
Environment xrdp running on
phisical machine
What's your client?
windows remote desktop connection
Area(s) with issue?
Keyboard / Mouse
Steps to reproduce
When trying to login from windows remote desktop connection tool, i get the login screen but i don't get to enter my username, because there are some weird key events which causes to skip directly to password.

After failed login, prompts come back correctly and i can login.
✔ Expected Behavior
No extra keys, login successful  with first attempt.
❌ Actual Behavior
Login fails with first attempt.
Anything else?
No response

Hi @adrianalin
When you say 'login screen', do you mean the xrdp login screen or something else? I don't recognise the image you have posted.

Login screen -> I mean the x11vnc login screen.
https://linux.die.net/man/1/x11vnc check the argument -unixpw [list] , that is how I got to that login screen.

Thanks - that's a new one on me.
I've managed to reproduce this using this command line:-
UNIXPW_DISABLE_SSL=1 x11vnc -forever -repeat -unixpw -dk

I've run through this in a debugger, and I can see the keypresses coming over the wire from mstsc.exe. If I connect from FreeRDP (Linux), this doesn't happen. If I connect from MobaXterm (Windows), the same events occur.
They're all 'up' keypresses. I imagine the idea is to make sure the keyboard is in a known state before starting. It seems odd, as there's a sync event in the RDP specification which does exactly this. I've double-checked and we're not processing that event in VNC mode.
This looks like a problem with the x11vnc login box. I can't see why it should respond to up keypresses in this way.
I'm afraid I can't suggest a workaround for you within xrdp, as we're not generating these. I've tried playing with a few mstsc.exe options, and I can't stop the key up events being sent.


How to run Teku DAS with Kurtosis suite

Install Kurtosis (Documentation, Quick install)
Patch your local Teku with something like this: https://github.com/zilm13/teku/commit/e38b353f93e8d75a3695bf58f7fb97f28c1a0d1b (mimic deneb in restAPI, hardcode config yaml constants, preset constants not needed, will be wired up)
Run ./gradlew distDocker in Teku repository to cache it locally as consensys/teku:develop
Create your Kurtosis config. Something like this, say it's called das.yaml:

participants:
  - el_type: geth
    el_max_cpu: 2000
    el_max_mem: 2000
    cl_type: teku
    cl_image: consensys/teku:develop
    cl_extra_params:
      - "--Xnetwork-das-fork-epoch=1"
    count: 1
network_params:
    deneb_fork_epoch: 0
    preset: "minimal"
additional_services:
  - el_forkmon
  - tx_spammer
  - blob_spammer
  - dora
snooper_enabled: true

Some notes about it:

I see issues with geth missing execution payload often with default settings, so added cpu and mem, defaults are 1000 and 1000
We start DAS at epoch 1, first is deneb. Only CL thinks that it's another fork, EIP7594, EL still works as usual on Deneb
Increase count if you need several CL-EL pairs
blob_spammer will include blobs in execution payload

Run enclave in Kurtosis:

kurtosis run --enclave my-testnet github.com/kurtosis-tech/ethereum-package --args-file ./das.yaml

After command completes, type kurtosis web to check how it goes.
Another quick notes:

to shutdown enclave: kurtosis enclave rm -f my-testnet
from web access dora  web, it's a block explorer. It doesn't contain any blobs info, but you could check it in CL logs
I've not tried to use blobscan is it should be useless in EIP-7594, because it's designed for Deneb
access something like cl-1-teku-geth -> Logs from web panel to view Teku logs

TODO:

several pairs startup with predefined p2p private key for fixed subnets and extra_subnets, so they cover all columns

obsolete with all kurtosis updates
nothing special is needed now


BUG: Primary Contact/Primary Organization if more than one organization is marked primary

Some funkiness with primary organization. By chance I had already set a primary organization for my contact in my affiliated records, but I didn't realize it. So, I created a new Affiliated record, marked primary, that organization now showed as my primary organization on my contact record. However, when I saw my error and edited the other affiliation (so it was not primary), the organization went blank on the contact record. There is clearly an issue when more than one organization is marked primary in affiliations.

Thread on the Hub that's possibly related to this: https://powerofus.force.com/0D580000021uhh0

Thank you for including me Judi. You are the best!!
Peace,
Ashima
Database Sherpa
http://www.databasesherpa.com
The wisdom of a Sherpa.
The reward of your practice.
Please excuse the typos and brevity of the msg

On Apr 10, 2015, at 6:31 AM, Judi Sohn<EMAIL_ADDRESS>wrote:
Thread on the Hub that's possibly related to this: https://powerofus.force.com/0D580000021uhh0
—
Reply to this email directly or view it on GitHub.

Included in beta release version 3.40 (Beta 3) and higher

Included in production release version 3.40


Is REST Api supports?

@santoshgistto there isn't a specific HospitalRun REST API, but on the server side, HospitalRun uses CouchDB, which has a strong REST API: http://docs.couchdb.org/en/1.6.1/api/index.html#api

@jkleinsc  Thank you


Normal & Simple Pagination

I'm quite unsure if this has been requested already, but can we add an option of a simple pagination (w/c also exists on tables). Something like this:

The only indicator for this doesn't include ellipses (from w/c sometimes can get daunting to look at) but the nav arrows themselves w/c tells the story.

A more suitable option to hide/disable ellipses on pagination.
Set a max of viewable pagination (min of 4 buttons at a glance)

To follow this one up, I find this one(current version) quite unnecessary:
By default this is the starting view(at a glance)

But upon clicking the next button, this displays:

This could've been just the numbers instead.
I hope you consider this option to disable ellipses. Thanks!

I'm having this issue too. Hope you fix it sooner. tnx.


integer types

Claiming that this works for "integer types" is kind of weird because it seems that by design it doesn't work for char and bool. I am not questionning that design, but then this should be made cristal clear in the documentation.

This is modelled after the C++20 APIs: https://en.cppreference.com/w/cpp/utility/intcmp
Those APIs explicitly disallow char and bool and I elected to follow the same principles. Those are not types that should be treated as mathematical types. I agree that the documentation should be made more clear on this.

Documentation updated.


Fix/bedrock client injection

Allow Custom boto3 Client Argument in 09_Guardrail Notebook.
This PR addresses the inconsistency in the 09_Guardrail sample notebook wherein it was previously not accepting a customized boto3 client argument upon initialization, unlike other notebooks.
With the modifications, users can now pass a customized boto3 client to the Bedrock class init function.


Added setHasOne functionality

#10

Thanks for the PR!  @blah238 has been the latest maintainer and can take it from here.  Otherwise, ping me & I'll give you both GitHub & NPM publishing rights so your work isn't in vain :)
Thanks!


Cleaner doc

I propose a small clean-up of the readme file, to use better the possibilities of Github (syntax highlighting, proper use of the title levels, a few formatting issues). Feel free to look on my branch to see the resulting look.
I also took the liberty of reformulating a few passages that were confusing to me - as I am not a native English speaker, please feel free to ignore them.
Finally, I also kept a fixed line length of 80, as I find it is nicer to read.
Would be nice to add the Travis badge, too!

Sadly, there's been a divergence of content from what exists in source control vs what exists in the adapt.mycroft.ai portal. In the race to get Adapt out the door, I kept the Adapt site up to date with the code, and the README fell behind. I think your notes on line length and organization are valid, but there's a number of additional changes that need to occur (specifically the lack of references to the IntentDeterminationObject).
I'm going to incorporate your ideas, but probably as a separate set of changes. Thanks for keeping me honest on the quality of the docs!

No worries, this happens. The trick about having the syntax coloring by Github really helps when reading code examples, and it should also work on any site with pygments (which should be the case for the adapt.mycroft.ai site).

@baudren please check out https://github.com/MycroftAI/adapt-documentation - those are the docs that appear on the site. They could always use some lovin'


Fix wrong behaviour of SGIO::progress

See #3509.
SG_PROGRESS current behaviour:

SG_PROGRESS patch behaviour:

Style fixed.

Do we actually have a unit test for this thing? Just to ensure nothing crashes?

As far as I know, the entire SGIO has no unit tests, which means no, there is no unit test to ensure the correctness of the code. Shall I spend some time creating one just to be sure it works as before?

I think a test that at least executes the stuff you added would be good. Correctness is tricky as it just prints out. Not sure it is worth the hassle to check this. But making sure it doesnt crash on corner cases would be useful definitely :)

This one is fine to merge from my side


discovery/consul: close idle connections on stop

The Run() method needs to close the idle connections before exiting. I also set IdleConnTimeout to ensure that idle connections not reused are effectively closed after some time.
Closes #4425.

@ashepelev @surmehta can one of you give it a try?

@simonpasquier
Unfortunately it didn't help

Yeah, it's https://github.com/prometheus/prometheus/issues/4427. I'll rebase on top of master.

@ashepelev can you provide a graph with net_conntrack_dialer_conn_closed_total{dialer_name="consul_sd"} only?

@simonpasquier We installed the fix and can now see consul connections closing. Please see below graph with net_conntrack_dialer_conn metrics

Thanks for fixing the issue.

:+1:

@ashepelev thanks for the details and confirming that the PR fixes the consul SD part at least. Regarding the increase of connections for the scrape job, I have no clue yet. Can you share net_conntrack_dialer_conn_closed_total{dialer_name="consul-services"} alone to check if some connections still get closed?

@simonpasquier
Sure,

One more thing I've faced is an abnormal RAM utilization.
We have two prometheus nodes with similar configuration. The second one suffer from very often config reloads. Thus we detect that it uses lots of RAM (15-20% more than the first one) though the configuration is similar and the problem node doesn't process API/Web requests.
We've already faced several out-of-memory kills and we are going to increase RAM, however this situation appeared also with the new update. I understand that it might be another issue, but it might be related to the big stack of unclosed connections.

@ashepelev can you quantify "very often config reloads"?
It seems ok to have occasional memory spikes after reloads (objects are recreated and it will take time for Go to garbage collect everything). According to the last graph, scrape connections are being closed eventually, it's not like with the Consul SD bug where the connections would live forever.

@simonpasquier yep, they are closing but not the same way they did before, when we have an almost constant difference (open - closed)
Often reloads - I gues they are happening once per 5 minute now.

@iksaif PTAL when you return.

I don't see what change could have triggered that, but it can't hurt.


"error loading model: unrecognized tensor type 11"

I was intrigued by your medium article, so I downloaded and ran this repo, and the following error appears.
"error loading model: unrecognized tensor type 11"
Please help.
And there is a code snippet that loads the environment variable, where and how do I declare it?

Have you solved it yet？


NIFI-3380 Support Multiple Versions of the Same Component

This PR introduces support for running multiple versions of the same component.
In order to make full use of this capability we need to release and updated version of the NAR Maven plugin (currently 1.1.0, need to release 1.2.0) and then update NiFi's master branch to use this new version. In this PR we have left it using the 1.1.0 NAR plugin, and NiFi is able to run as it normally does, but you can't actually run multiple versions of the same component yet because the framework needs the new information from the new NAR plugin.

@bbende I created a 3-node cluster. I added MyProcessor v2.0 to the flow. I then shut down node 3, removed the nifi-example-processors-nar-2.0.nar file from the lib/ directory and removed conf/flow.xml.gz. I then restarted Node 3. It fails to startup because the cluster flow cannot be inherited, due to the node not having v2.0 of the Processor. This, I think, is the expected behavior. However, it fails with the following error message in the logs:
2017-03-17 13:14:58,602 ERROR [main] o.a.nifi.controller.StandardFlowService Failed to load flow from cluster due to: org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow.
org.apache.nifi.controller.UninheritableFlowException: Failed to connect node to cluster because local flow is different than cluster flow.
	at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:921) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:513) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:780) [nifi-jetty-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.NiFi.<init>(NiFi.java:162) [nifi-runtime-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.NiFi.main(NiFi.java:269) [nifi-runtime-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
Caused by: org.apache.nifi.controller.UninheritableFlowException: org.apache.nifi.processors.example.MyProcessor from org.apache.nifi:nifi-example-processors-nar:2.0 is not known to this NiFi instance.
	at org.apache.nifi.controller.StandardFlowSynchronizer.checkBundleCompatibility(StandardFlowSynchronizer.java:431) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:246) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1535) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:83) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:707) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:896) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	... 4 common frames omitted
Caused by: java.lang.IllegalStateException: org.apache.nifi.processors.example.MyProcessor from org.apache.nifi:nifi-example-processors-nar:2.0 is not known to this NiFi instance.
	at org.apache.nifi.util.BundleUtils.findCompatibleBundle(BundleUtils.java:54) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.util.BundleUtils.getBundle(BundleUtils.java:88) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	at org.apache.nifi.controller.StandardFlowSynchronizer.checkBundleCompatibility(StandardFlowSynchronizer.java:429) ~[nifi-framework-core-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
	... 9 common frames omitted

I find this error message confusing. It used to make sense when the local flow as different than the cluster flow and that was the only way we could get into this situation. However, it now is caused by failing to create the necessary Processor. We should use a different error message.
Either we could throw a different Exception (perhaps something that extends UninheritableFlowException?) and provide a different error message, or we should make the message more generic, such as: "Unable to update local flow to match the cluster's flow" instead of "Local flow is different from cluster flow," given that the local flow was empty and therefore should try to inherit the cluster flow.
Does that make sense?

@markap14 The PR has been updated to address your comments and to fix a couple of other issues that were identified, also rebased against master as of yesterday evening.
Here are the changes since your last review:

https://github.com/apache/nifi/pull/1585/commits/fadf43d7ccc755b5a5e3b52692e6b8f814afb657 (synchronization in node classes)
https://github.com/apache/nifi/pull/1585/commits/b1ed76c2bc4ec3a639d360017fe899a8fd5777a7 (CS bundled with API + restructure Hive NAR)
https://github.com/apache/nifi/pull/1585/commits/6b2ac1fb77ee08ce4b183e3b78c7c178c38256ae (missing components in fingerprinting)
https://github.com/apache/nifi/pull/1585/commits/8988cd9a88ab528bbbb25c07260b17b5179c5886 (checkstyles and failing tests)

I'm going to continue testing today, but let me know if there is anything else to address.

This all looks good. I've run through the standard cases of standalone and clustered instances. Ran through some crazy cases that I could think of. Didn't run into any unexpected problems. Code looks good. I especially paid attention to the *Node classes, StandardFlowService, and Fingerprint classes when reviewing code but found nothing concerning. +1 merged to master!


[BUG]: Total {bots} Bots: {onlineBots} bots-online and {offlineBots} bots-offline

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.

Please edit the body


[FEATURE REQUEST] Add support for external search zones

It is quite common for customers to want to be able add additional search zones in resolv.conf to be able to search hostnames in zones outside of the cluster zone.
Context
Currently only the cluster's internal zone is added to the search zone.
We would like to be able to add additional zones.
Feature
Ideally we would be able to specify a additional search zone(s), preferably in general_settings/external.yml, for example:
external_dns:
#  dns_server:  # set as forwarders in named.conf
  dns_server:
    - ww.xx.yy.zz
    - yy.xx.ww.zz
#  dns_client:  # set directly on client side in resolv.conf
#    - <IP_ADDRESS>
  dns_search_zone: company.com

The template should also be able to manage either a single string or list in case we need to add multiple zones.
external_dns:
#  dns_server:  # set as forwarders in named.conf
  dns_server:
    - ww.xx.yy.zz
    - yy.xx.ww.zz
#  dns_client:  # set directly on client side in resolv.conf
#    - <IP_ADDRESS>
  dns_search_zone:
    - company.com
    - subdomain.company.com

Additional data
Here is a fix I implemented on an older version of the role.
{% if external_dns.dns_search_zone is defined %}
  {% if external_dns.dns_search_zone is iterable and external_dns.dns_search_zone is not string %}
search {{ domain_name }} {% for zone in external_dns.dns_search_zone %}{{ zone }}{% if not loop.last %} {% endif %}{% endfor %}
  {% else %}
search {{ domain_name }} {{ external_dns.dns_search_zone }}
  {% endif %}
{% else %}
search {{ domain_name }}
{% endif %}

Dear @dietergorecki
Thank you for this request 🙂
The resolv.conf file has become difficult to use, since both Network Manager and Networkd Systemd now manage the dns resolution dynamically, which means this file is always overwritten by these daemons.
Would using the dns4_search key of nic role solve the solution for you ?
You can find description of this parameter in the nmcli role of community general : https://docs.ansible.com/ansible/latest/collections/community/general/nmcli_module.html
And in the main code of BlueBanquise, it is used in the NIC role, in RedHat/Suse part (not implemented in Ubuntu/Debian) : https://github.com/bluebanquise/bluebanquise/blob/b3a0565e672e090e7d830f1109e3cc6e5b215281/collections/infrastructure/roles/nic/tasks/RedHat/main.yml#L29

That's probably a good idea to also manage this kind of settings with nmcli.
For now on I have no time to check if it works as expected but I will keep in mind to test it during my next install which will happen in less than a month.
Is it OK to leave this issue opened for a few weeks ?
Thanks

For sure ! It is ok for me ! 😊
Some Issue are open during a long time, they act as reminder too, so no pb at all !

Hello @dietergorecki
Were you able to double check usage with nmcli ? :blush:

By adding external dns forwarders, I'm able to resolve any external domain host names even when search is set to cluster.local only.  Such query for external domain name is also very fast.

Closing due to inactivity, please re-open in case of need. 2 solutions were proposed :blush:


Enable all tests on windows target

For full windows support we need to define which tests needs to be executed on the Windows and enable them. We need to ensure compatibility with Windows as well for full ROS 2 support.

Moving this to #33 and closing this one here.


Let's add an experimental query suite to each language

Let's add an experimental query suite to each language.
Sebastian did this for gh-tailor:
- description: Java experimental security queries
- queries: .
- include:
    kind:
    - problem
    - path-problem
    - alert
    - path-alert
    tags contain:
    - security
    query path:
      - /experimental\/.*/
- include:
    kind:
    - diagnostic
- include:
    kind:
    - metric
    tags contain:
    - summary
- exclude:
    deprecated: //
- exclude:
    query path:
      - Metrics/Summaries/FrameworkCoverage.ql
      - /Diagnostics/Internal/.*/
- exclude:
    tags contain:
      - model-generator

This has now been included in the product


Add Kegger.app v1.0.0

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} reports no offenses.
[x] The commit message includes the cask’s name and version.

Additionally, if adding a new cask:

[x] Named the cask according to the token reference.
[x] brew cask install {{cask_file}} worked successfully.
[x] brew cask uninstall {{cask_file}} worked successfully.
[x] Checked there are no open pull requests for the same cask.
[x] Checked the cask was not already refused in closed issues.
[x] Checked the cask is submitted to the correct repo.

Thanks for the PR! Unfortunately this doesn't meet our notability requirements.
Rejected Casks

The Cask is too obscure (for example, a self-submitted app from a GitHub repository that is not notable enough (under 50 stars)).

I'd suggest creating your own tap.


not my project

not my project delete thirdpartynotices not mine either

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

ThirdPartyNotices
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


feat: custom default HTTP transport

Changes

:gift: use in cluster dialer by default:
This sets http.DefaultTransport to our specialized RoundTripper.
The RoundTripper first tries dial in standard way.
If dial operation fails due to hostname resolution error the in cluster dialer will be used.

:broom: dialer pod auto-exit:
The pod should exit (be Completed) when func exits (even in case of SIGKILL).

@lkingland not this automatically enables things like:
func emit --sink http://dialer-test-service.dialer-test-ns.svc

e2e are failing but that's not fault of this PR, the main is broken.

I'll prepare revert.


Print entire comment line for report_todo/report_fixme

This changeset make it so the entire comment line is printed when report_todo or report_fixme finds an issue.
It is motivated by the following example. Consider the following source:
// TODO implement something!
fn main() {}

Currently rustfmt will output something similar to:
warning: found TODO without issue number
  --> path/to/source/file.rs
   |
 1 | // TODO
   |

This change accumulates all the TODO and FIXME issues for each line and outputs the entire comment in the error message:
warning: found TODO without issue number
  --> path/to/source/file.rs
   |
 1 | // TODO implement something!
   |

Some concerns:

I'm not sure if CharClasses or files always end in a \n, or if we need to handle the "todo in a comment at the end of a file with no trailing newline" edge case explicitly.
I'm not sure how to test this effectively.

Thanks for your time!

Hi @tangmi!

I'm not sure how to test this effectively.

I'd suggest adding a test to src/test/mod.rs with something like the below snippet:
#[test]
fn todo_test() {
    init_log();
    // let filename = "tests/issue-checks/todo.rs";
    // let input = Input::File(filename.into());
    let source = "// TODO implement something!\nfn main() {}\n";
    let input = Input::Text(source.to_owned());
    let output = vec![
        "warning: found TODO",
        " --> stdin:1",
        "  |",
        "1 | // TODO",
        "  |\n",
        "warning: rustfmt has failed to format. See previous 1 errors.\n",
    ].join("\n");
    let mut config = Config::default();
    config.set().report_todo(ReportTactic::Always);
    config.set().emit_mode(EmitMode::Stdout);
    let mut buf: Vec<u8> = vec![];
    let mut session = Session::new(config, Some(&mut buf));
    let report = session.format(input).unwrap();
    let errors = ReportedErrors {
        has_check_errors: true,
        has_formatting_errors: true,
        ..Default::default()
    };
    assert_eq!(session.errors, errors);
    let actual = format!("{}", FormatReportFormatterBuilder::new(&report).build());
    assert_eq!(actual, output);
}

For the sake of simplicity I structured that example with everything inline, though you could move the input/output to separate files if you prefer (I left a commented out line for using a file input should you decide to do so). And of course you'd need to update that expected output to include the file comment line, replace stdin with the filename if you move the input to a file, etc.


Remove the leading slash from network URLs.

This is a common source of user-error and an easy fix.

Instead of automatically stripping leading slash from network URL, can we just warn users about it? Can you give an example why it tends to be a common mistake?

Custom images were moved to https://github.com/GoogleCloudPlatform/dataproc-custom-images


fixed for asyncFinishLock: avoid call finish more than once

Please answer these questions before submitting pull request

Why submit this pull request?

[ *] Bug fix

[ ] New feature provided

[ ] Improve performance

Related issues

Bug fix

Bug description.
fixed for asyncFinishLock: avoid call finish more than once
How to fix?
call "finish"  after asyncFinishLock lock and before unlock

New feature or improvement

Describe the details and related test reports.

set breakpoint before call checkFinishConditions and inside checkFinishConditions, then try in debug mode,asyncStop in other thread(pause before checkFinishConditions ), let stopSpan pop make activeSpanStack to empty first,...
It's hard reproduct without codeline debug
I'll do the demo if have the time
In my point of view: The method(checkFinishConditions) code do not change program(object) state,the asyncFinishLock is useless if it's not a problem.
===>  理论上一个方法内部没改状态且程序又依赖于其返回值，方法内部加锁是不正确的使用方式：因为多线程在同时请求checkFinishConditions时就会出问题
如有不对，请指:)

I think I get your point of issue, but if you are talking about #asyncStop and #stopSpan called concurrently, then your solution is still not working, due to the same reason no status change.
I think this problem only could be solved by adding a field #running in TracingContext, default true in the constructor. check running==true before finish condition check, set it to false if check passed. Then add your change, move finish into it.
// rename checkFinishConditions
private void finish () {
     ... lock
     if (running) {
            if (activeSpanStack.isEmpty() && (!isRunningInAsyncMode || asyncSpanCounter.get() == 0)) {
                  running = false;
                  _doFinish(); // rename old finish method
            }
    }
   .... unlock
}

Yep, my fix still have issue.Please fix it :)

Yep, my fix still have issue.Please fix it :)

By you or me? Do you want me to raise to new PR?