Material 3 common buttons should use sparkle splash effect on Android.

Part of: #91605
Part of the Material 3 migration for the common buttons is to use the sparkle splash effect if running on Android. This will be handled by the full button migration in #100794, but that is delayed due to an API issue we need to resolve. In the mean time this PR just turns on the sparkle effect (#99731) for buttons when ThemeData.useMaterial3 is turned on and the platform is non-web Android.
Added tests to check that the right splash factory is used for each button.
Pre-launch Checklist

[x] I read the [Contributor Guide] and followed the process outlined there for submitting PRs.
[x] I read the [Tree Hygiene] wiki page, which explains my responsibilities.
[x] I read and followed the [Flutter Style Guide], including [Features we expect every widget to implement].
[x] I signed the [CLA].
[x] I listed at least one issue that this PR fixes in the description above.
[x] I updated/added relevant documentation (doc comments with ///).
[x] I added new tests to check the change I am making, or this PR is [test-exempt].
[x] All existing and new tests are passing.

So if I've got an app that builds to both iOS and Android that uses Material buttons on both, and I set useMaterial3 to true, it will not sparkle on iOS? Just out of curiosity, is it not possible to get iOS to sparkle even if I want to?

It is intended only for Android devices so that is why we have the defaults set up that way. I don't know enough about the implementation whether it would work on iOS. @clocksmith would know more about that.

So if I've got an app that builds to both iOS and Android that uses Material buttons on both, and I set useMaterial3 to true, it will not sparkle on iOS? Just out of curiosity, is it not possible to get iOS to sparkle even if I want to?

It is intended only for Android devices so that is why we have the defaults set up that way. I don't know enough about the implementation whether it would work on iOS. @clocksmith would know more about that.

It will currently work on any platform that uses the non-web engine (try manually setting splashFactory for theme to InkSparkle), and eventually it will also work on the CanvasKit engine!

But yes, it is correct that the Material guidance is to only use on Android. I will be following up with a post on making custom ripples with the same tech


A little Typo maybe regarding "Filter on columns" - and missing "missing feature"

You write that "Filter on column on FlowFields" is Not supported. But it is - you can make a filter on columns with calculated amounts. What is NOT supported and witch can be business crucial in the Web Client is filtering on fields not shown as a column (that's a very important feature in the Windows Client).

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d2b3a845-b388-9c69-478f-87cc70b87819
Version Independent ID: af209cd5-e554-fe3f-30f0-05d771b21a17
Content: Feature Limitations of the Web Client - Dynamics NAV
Content Source: dynamics-nav/Feature-Limitations-of-the-Microsoft-Dynamics-NAV-Web-Client.md
Product: dynamics-nav-2018
GitHub Login: @jswymer

Thanks for the feedback, we're sorry for not getting back sooner. This issue refers to NAV product documentation and we no longer update this docset.


rocm-smi: 4.3.1 -> 4.1.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for rocm-smi is: "System management interface for AMD GPUs supported by ROCm"
meta.homepage for rocm-smi is: "https://github.com/RadeonOpenCompute/rocm_smi_lib"
meta.changelog for rocm-smi is: ""
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

/nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0/bin/rocm_smi.py passed the binary check.

/nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0/bin/rocm-smi passed the binary check.

/nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0/bin/rsmiBindings.py passed the binary check.

/nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0/bin/.rocm_smi.py-wrapped passed the binary check.

3 of 4 passed binary check by having a zero exit code.

1 of 4 passed binary check by having the new version present in output.

found 4.1.0 with grep in /nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0

found 4.1.0 in filename of file in /nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0

directory tree listing: https://gist.github.com/bcebe2666135d1a838a560dd27064be2

du listing: https://gist.github.com/690799eadef150fcd4c2fc8116122d92

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

1 x86_64-linux rebuild(s)
0 i686-linux rebuild(s)
0 x86_64-darwin rebuild(s)
0 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
rocm-smi

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A rocm-smi https://github.com/r-ryantm/nixpkgs/archive/55428f783ff6c766abdf9710edeed8abc7be452c.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0
ls -la /nix/store/acrg8l9iizrbi95fabfjria80gjsrj25-rocm-smi-4.1.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

rocm-smi

Maintainer pings
cc @lovesegfault for testing.

@ryantm is this a bug? It's trying to downgrade the package.

@ryantm is this a bug? It's trying to downgrade the package.

@lovesegfault Looks correct to me. The updatescript is trying to make it be the latest release: https://github.com/RadeonOpenCompute/rocm_smi_lib/releases
If this is supposed to be an unstable package, the updatescript should get updated to reflect that.

I don't think it's unstable, the current tag is more recent than what the bot is trying to bump to. It looks like upstream stopped creating releases on github and just pushes the tags now.

That's correct, they no longer do GH releases and just use tags.


too many calls, blacklisted? how to avoid

So this just happened on my LAMP server, I have no ablilty to run chrome/etc on it to answer the captcha and get the cookies...
Hope they un-blacklist the server :-)
If they ever do, how often can you call the transcript function for a video and not get burned.
Will doing many videos at once help? I was doing one at a time.
Thanks!

Hi @themindfactory,
unfortunately, there aren't any ways to work around this (that I know of), other than what's stated in the error message. Also, I haven't been able to figure out how long it takes to get un-blacklisted, nor how many request you can do before getting blacklisted. It doesn't seem to be consistent though, therefore I assume YouTube decides depending on the current system load. You can try adding sleeps in between requests, to avoid bombarding YouTube with requests, which seems to decrease your likelihood of being blacklisted. However, once again, I don't have any hard numbers on how long you have to sleep, to avoid being blacklisted with certainty 😕
If you make any observations, which help putting some numbers on these behaviours, I would love to hear those! 😊
However, I will close this issue for now, as there unfortunately isn't much which can be done here.


Improve performance related to variables holding part data

To implement the part upload chunks of the file are kept in shell variables and processed using echo -n (mainly to determine the range of the chunk). It seems to be more efficient to store those large variables to a temporary file, see e.g. here:
https://superuser.com/questions/279141/why-is-reading-a-file-faster-than-reading-a-variable
An alternative mechanism to determine the range might be an other option.

The sequence number of the part can be retrieved from a replacement string from in the command argument in parallel, which hex conversion, adding line numbers and the related storage of the data in shell variables obsolete. #8

Merged in #8.


best order for proposals to utils

I have updated utils / dipnet/ realpolitik

I have a problem import BaselineBot in utils.py
this is for hints in below function
def get_best_orders(bot: BaselineBot, proposal_order: dict, shared_order: dict):

@wwongkamjan can you provide the error you are receiving? You may need to use Dict instead of dict. Also, you can run tests locally via pytest tests/ in terminal.

This is an error I got.
ImportError: cannot import name 'BaselineBot' from 'baseline_bots.bots.baseline_bot' (/home/runner/work/baseline_bots/baseline_bots/src/baseline_bots/bots/baseline_bot.py)

https://github.com/ALLAN-DIP/baseline_bots/actions/runs/3145380014/jobs/5112589351 I think you can also see it here?

This is an error I got.
ImportError: cannot import name 'BaselineBot' from 'baseline_bots.bots.baseline_bot' (/home/runner/work/baseline_bots/baseline_bots/src/baseline_bots/bots/baseline_bot.py)

Try from baseline_bots import BaselineBot. Look at how other files import BaselineBot

from baseline_bots import BaselineBot
ImportError: cannot import name 'BaselineBot' from 'baseline_bots' (/home/runner/work/baseline_bots/baseline_bots/src/baseline_bots/init.py)
https://github.com/ALLAN-DIP/baseline_bots/actions/runs/3145498107/jobs/5112862819
It didn't work :(

@wwongkamjan This may be a circular import issue. Read https://stackabuse.com/python-circular-imports/ and try to resolve it.

I will just remove the parameter hint for BaselineBot. Easiest to avoid, However, CI cannot find a module name 'diplomacy_research'. Does CI have diplomacy research folder in there?
https://github.com/ALLAN-DIP/baseline_bots/actions/runs/3146100725/jobs/5114163121

I will just remove the parameter hint for BaselineBot. Easiest to avoid, However, CI cannot find a module name 'diplomacy_research'. Does CI have diplomacy research folder in there? https://github.com/ALLAN-DIP/baseline_bots/actions/runs/3146100725/jobs/5114163121

It does not. I can try to set that up at a later point. For now, just comment out your test and Ill try to fix this later.

RealPolitik testt removeed

@wwongkamjan Just one last thing: could you add your function call into the __call__ function of the soa bot in the appropriate place?

done adding best_proposer to SOA

Please run the Makefile

this is a weird error. I ran make without any problem yesterday
login1.ls6(1066)$ make
black src/
make: execvp: black: Permission denied
make: *** [Makefile:2: format_code] Error 127

@wwongkamjan I merged regardless. Someone else will run styling soon enough. I do not have a solution for that, unfortunately.


Multiline function args higlighted incorrectly

When I do:
#@ lib = struct.make(
#@   arg1=arg1,
#@   arg2=arg2
#@ )

the last three lines are being highlighted as if they were comments.
Using version 0.0.2 and vscode 1.45.1 (linux)

This is because the function call end matcher in starlark grammar looks for ), so the #@'s are being interpreted as starlark comments in the arguments to the function. I am not sure there is a great to fix this; I will think on it some more.

the same happen for:
#@ apps = [
#@  "first",
#@  "second"
#@ ]


fix(gabrie30/ghorg): include semver in asset name

Include the version name in the asset.

Hey @suzuki-shunsuke, can you help me out here?
Originally I was just trying the fix the asset name, since by defined default the version was not included. This caused v1.9.9 to fail to download, so I decided to re-scaffold.
Now I cannot get the checksums in v1.9.9 to work. I think the reason is that the in checksums.txt in v1.9.9, the filename does not contain the version within. For all previous releases it does contain the version in the filename.

Thank you for your contribution!
ERRO[0002] Checksum isn't found in a checksum file. Checksum file content:
4978cb4c0965813314dfc8454c93144336f2dd681db2f502c579e5f4aff5aee6  ghorg_Darwin_arm64.tar.gz
4ca21e8c2ba57f68621fe0b5bd2fe3801f1c11bff6588d87a5562538b58f8273  ghorg_Linux_arm64.tar.gz
7790e3e29c1e4ecb0ecc7cfc4b11a17e3247ab799ec9d48025d0d90b2bee8de9  ghorg_Linux_x86_64.tar.gz
99458b6541b82aa353eea900e42f40cb0ee8f290795d2d75b9affb7d0d22139e  ghorg_Linux_i386.tar.gz
b0e29471dd1753c0824075b6065ababaedad79a1187e68b1dff6f26df908648e  ghorg_Windows_i386.tar.gz
b186bdabb9595e655818a9b8f01d937fc1e9c8f890981bbf93b40a3a15208def  ghorg_Darwin_x86_64.tar.gz
c093391a219159bc4aa2849c422b38846362d74b61a4f5f7f3ac42d03db0d06e  ghorg_Windows_x86_64.tar.gz
dc183ad43d98f49397c8c1a3490b527e7ff76a9705f603411297c7f8aee0cc9e  ghorg_Windows_arm64.tar.gz  aqua_version=2.21.3 checksum_file_format=regexp checksum_pattern_checksum="^(.{64})" checksum_pattern_file="^.{64}\\s+(\\S+)$" env=linux/amd64 package_name=gabrie30/ghorg package_version=v1.9.9 program=aqua registry=standard
ERRO[0002] install the package                           aqua_version=2.21.3 asset_name=ghorg_1.9.9_Linux_x86_64.tar.gz env=linux/amd64 error="no checksum is found" package_name=gabrie30/ghorg package_version=v1.9.9 program=aqua registry=standard

It seems the checksum file is wrong, so I reported the issue.

https://github.com/gabrie30/ghorg/issues/382

We need to disable the checksum for now.

v4.122.1 is out 🎉
https://github.com/aquaproj/aqua-registry/releases/tag/v4.122.1


feat: google sheets external table support for bigquery datastore

Resolve https://github.com/odpf/optimus/issues/44

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

114 of 164 (69.51%)  changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.1%) to 67.654%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

ext/datastore/bigquery/table_spec.go
6
7
85.71%

ext/datastore/bigquery/adapter.go
53
59
89.83%

ext/datastore/bigquery/bigquery.go
0
8
0.0%

ext/datastore/bigquery/external_table.go
38
54
70.37%

ext/datastore/bigquery/external_table_spec.go
17
36
47.22%

Totals

Change from base Build<PHONE_NUMBER>:
0.1%

Covered Lines:
4043

Relevant Lines:
5976

💛  - Coveralls


Update tx-example.py and blocks-query.py

Signed-off-by: Igor Egorov<EMAIL_ADDRESS>Description of the Change
New Iroha lib in Python gets able to query blocks stream.
Examples tx-example.py and blocks-query.py are updated.
Benefits
Up to date examples.
Possible Drawbacks
None ?
Usage Examples or Tests
Run:
1. Iroha
2. blocks-query.py
3. tx-example.py

Since those files (tx-example.py and blocks-query.py) are not tested in CI, the branch will be merged without waiting for CI.


Add total count utility method to FreqMap

I've come across a couple of cases where i'm getting the total count from a FreqMap so might be worth adding a utility method to do it

Sounds to me like a transform is a better way to achieve this - calculate the total count at query time from the values in a map. If the total count is always needed and performance is critical, then just have  a second property to keep track of the total.

Closed based on suggestion from @d21211122


fix controller crash when action annotation didn't exists

Changes done:
fix controller crash when action annotation didn't exists but referenced by ingress spec.
Test done:

create ingress spec reference action without specify action annotation, observed logs below instead of crash:
failed to reconcile listeners due to failed to reconcile rules due to backend with servicePort: use-annotation was configured with serviceName: ssl-redirect but an action annotation for ssl-redirect is not set

Thoughts:
we should use pointer rarely. Only use pointer to represent optional semantic(or the copy operation is indeed heavy).  Also, client code should check for nil, if there is optional semantic. (I'd like java's Optional =.=)

/lgtm

/lgtm


Service is not displayed on iOS7+ or OS X 10.8+

iOS7 requires also an existing (Fairplay-secured) Airtunes service to display a computer as mirroring target. Feasible solution might be detecting and upgrading a running shairport instance.

Implemented in 9b6031f.


chore: Update cluster-key-slot to latest

When using ioredis, with the licence-compliance package, it fails due to a sub-dependency having an invalid licence string. The sub-dependency has fixed that, but ioredis hasn't updated to use it yet, resulting in this output:
ioredis (main) λ  npx license-compliance --allow "ISC;MIT;BSD-3-Clause;BSD-2-Clause;Apache-2.0;Python-2.0;MPL-2.0;LGPL-2.0;LGPL-3.0;LGPL-2.1;0BSD;Unlicense" --report detailed
Packages
└─<EMAIL_ADDRESS>   ├─ Licenses: UNKNOWN
   ├─ License file: node_modules/cluster-key-slot/LICENSE
   ├─ Path: node_modules/cluster-key-slot
   └─ Repository: https://github.com/Salakar/cluster-key-slot

Upgrading cluster-key-slot, to the latest version, so that this PR that fixes the incorrect licence string is included.

Looks like the tests fail.


feat: import surface body properly when reading design

Closes #834

Requires some extra changes for boolean operations. Working on them now. And adding some tests for that

@RobPasMue Maybe rename PR to reflect boolean changes?

@jonahrb - can I get an approval here?


PyCrypto is dead. Switch to PyCryptodome

@maebert

I hope this gets merged. It'd be a good temporary fix until 2.0

I am currently unable to install jrnl[encrypted] due to dlitz/pycrypto#218, which will not be fixed because the project is no longer maintained.

Too bad about this not getting merged in. The above info seems to not fully work for me with the work around. It installs pycrypto, and then jrnl installs... creates the journal and encrypts... then asks for the password and errors saying pycrypto is not installed.

Hi, we switched away from PyCrypto in v2.0. Sorry that this didn't get merged in! Thank you for the PR anyway!


Question: [Can Mica be used in Web Apps running in Edge WebView]

We are working on a progressive web application which we plan on submitting to windows store. We are toying around using Mica to make our layout match what has been implemented in the new Windows Store on Windows 11.

@jevansaks or @codendone can you answer?

Maybe better question would be if Edge WebView 2 supports Mica Material
Get Outlook for iOShttps://aka.ms/o0ukef

From: Stephen L Peters @.>
Sent: Wednesday, July 14, 2021 6:14:46 PM
To: microsoft/microsoft-ui-xaml @.>
Cc: Tony Beretini @.>; Author @.>
Subject: Re: [microsoft/microsoft-ui-xaml] Question: [Can Mica be used in Web Apps running in Edge WebView] (#5461)
@jevansakshttps://github.com/jevansaks or @codendonehttps://github.com/codendone can you answer?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/microsoft-ui-xaml/issues/5461#issuecomment-880270490, or unsubscribehttps://github.com/notifications/unsubscribe-auth/APUUMIGQFSIWFRQ7M4C6HHDTXYK6NANCNFSM5ALN7V6Q.

Any update on this?

This would be a great feature for PWAs…


Problem running RNN example

The shape argument in https://github.com/tensorflow/tensorflow/blob/master/tensorflow/models/rnn/ptb/ptb_word_lm.py#L123 should be a tensor ( [-1] instead of -1). Otherwise, the example does not run.

Thanks for the report. We'll update the code.

Fixed in the source in https://github.com/tensorflow/tensorflow/commit/41930f0b81b52a34fb56d921c9bad65c36168323.  Will be also pushed out in the next binary release.


Allow customization of URL directory and filename

Internally we would like to use our own mirror which does not conform to the ELECTRON_MIRROR/VERSION/NAME. Would you accept a PR like this?

Sure, can you add some docs though?

Yeah totally! Thanks. I'll add them soon.

I've updated the PR with documentation. Look good?


Node rating model

To start: very happy with Pool! It's great stuff.
It seems though, that Pool has a dependency on BOS, which over time has appeared to become imperfect:

The list is very small. I believe more than 1.7% (246/14585*100) of nodes are good peers. Why not publish a list of 2000 nodes, and have people/nodes/software decide a minimum score to act on (in Pool give a minimum score for example)
Criteria are unclear. I believe the list criteria should become open. Earlier thoughts have been that if that was done, people could game the system. I do not believe that's bad, as long as criteria are good ("Oh no! Someone opened 10 channels with low fees to other well connected nodes!" is not something someone would be worried about :wink: ).

Bidders will want to choose:

Nodes with high uptime. A sensor node will have to keep track of this, and this will make the list inherently non-reproducible. We should accept this. 1000 points for
Nodes well-connected. Look at amount of channels, and connectivity to other top-50/100 nodes in last week's list.
Fees, score for fees lower than (mean+20%)
Nodes which are over n (90?) days old
Nodes with a % of capacity of the network
Nodes which are reachable over both tor and clearnet

Someone should take some time I think, with actual data from the network, and tune these parameters. Output of actual network data could also become variables in calculations (some score being [this node's mean rate] vs [network mean rate]).
An even better idea would be to change the complete model, where one would only get some input (sensor data) from a monitoring node (uptime) and calculate the rest itself. People would use the default model, but would also be able to tune to their liking (some might want more decentralized nodes, not valuing connectivity-to-top15% so high).
Bottom line: I believe the rating model should be more open, and node owners should be able to decide how they rank peers. Lightning Labs could publish an interactive dashboard where node owners could do their calculations, and change their behavior in a way the network likes. Changes to the model ("node age is much more important!", "ipv4 is not worth 50k points but 30k!") would be done in a git repo.

Working on giving more insights into this, and improve the scoring system! Stay tuned 👀

Seems like we're not relying specifically on BOS anymore (it's no longer updated since 2022-01-20).
The rest of the issue still looks just as relevant as before, though?

Pool does rely on the same list that Terminal Web (terminal.lightning.engineering) depends on. There is a bit more information about how to improve your node score available on said page. And a node that doesn't get a score value (e.g. doesn't pass all 6 health checks) will still show up on the list and improvement suggestions are displayed.
I know that doesn't answer all your all your questions/concerns, but should at least address some of them.


Add DooC documentation

Examples:

ComposableArchitecture
RevenueCat

More details

@omaralbeik , this can be closed right. I have checked and confirmed the Stores is listed https://swiftpackageindex.com/omaralbeik/Stores

It is added indeed, but this is something else, when you go to the docs you see a blank screen, unlike the examples in the description, where you see an intro and a discussion about the library.

@omaralbeik Good catch that one. i'll try to investigate why that is happening.


to_string for negative values

If I create a negative value:
m = Money.new(-20000)
%Money{amount: -200, currency: :GBP}
and I try to convert it to string
Money.to_string(m)
I get a wrong format like
"-,200.00"
This happens when I try to convert values of hundreds such as:
200.00
200000.00
etc.

Thanks again for the quick resolution.
However I have updated the Money:
mix deps.update money
It shows :money, "1.1.1" in my mix.lock
But behaves the same both in my project as in console.
Is there anything else I should do?
Thanks

Oh the shame :-(
To fix a bug which is not fixed. I’m reopening this and I’ll see what’s wrong.

Sorry, I did something wrong when releasing 1.1.1
I have released 1.1.2 and tested that it works.

Works perfectly ! Thanks !


dsf election post

Create a new announcement post for the DSF Election
links:

https://www.djangoproject.com/weblog/2024/oct/28/2025-dsf-board-candidates/
https://forum.djangoproject.com/t/2025-dsf-board-elections-candidates-and-voting/36033

Hello @kjaymiller please check this out https://github.com/BlackPythonDevs/blackpythondevs.github.io/pull/551#issuecomment-2446055072


[Bug]: 404 error at URL: /txns/kxp28AQD54vB5ISS6QISAVbyZL4cWPBmO3yUEou4qao

What happened?
A bug happened!
I send HNT  to my wallet to relocate assortment of my hotspot and don’t appear my hnt on my wallet .already have the confirmation from Binance of the transaction
‘this sis my TxId  kxp28AQD54vB5ISS6QISAVbyZL4cWPBmO3yUEou4qao

URL
kxp28AQD54vB5ISS6QISAVbyZL4cWPBmO3yUEou4qao
What browsers are you seeing the problem on?
Chrome
Do you see the issue on Mobile or Desktop?
No response
Relevant log output
No response

There's an ongoing API issue reported in #announcements on the Helium Discord:

There's an ongoing API issue reported in #announcements on the Helium Discord:

Thanks  for the advice …:)

works now, closing.


Update with PanProject techniques

This PR replaces the old one #22.
These techniques have been updated based on the changed discussed during the latest meetings. A few minor additional changes may be done following our meeting tonight (3 techniques only).
@lzehl:

Ignore the SDS-FRL technique. Marked for tonight. May change.
Check for useless "technique" mentioned in the LDs. As discussed with @tgbugs, we can remove "[...] technique" from the name whenever the rest makes sense on its own (e.g. "secondary antibody staining (technique)" but not "reconstruction technique").
 We decided to keep those but to make curators aware that these should not (ever) be used.

@UlrikeS91 I forgot that this was still open. We can wait for @tgbugs to comments here. After we have all feedback, could you move the PR to the openMINDS_instances?

Yeah, can do that.

Actually, on further review, I think it is ok to zap Technique from the end of all of these because you have /technique/ in the url as well, so it is clear. It should be retained in the label though.

I've updated the techniques according to this PR now on openMINDS_instances and will therefore close this PR here now.
@tgbugs : thank you for your feedback. The ontological identifiers for the techniques can be added to the openMINDS_instances when they are ready.
@UlrikeS91 : a big thank you for preparing this PR!


Add 'tags must be closed' rule to JSX guide

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Thank you @meowwwls for your contribution.
Congratulations on your first PR merge to this repo. 🎉


[FLINK-6134] Set UUID(0L, 0L) as default leader session id

Before the default leader session id was null in the standalone case. However, in the ZooKeeper
case null indicated that there was no active leader available. With this commit, the default
leader id will be set to UUID(0L, 0L). This allows the uniform treatment of null denoting that
there is no active leader across the standalone and the ZooKeeper case.
With this change, the FlinkActors will now ignore all LeaderSessionMessages if the actor's
leader id field is null. This indicates that the FlinkActor does not know the current leader.

Good fix!
Changes look good. Pending CI success, +1 to merge

Thanks for the review @StephanEwen.
Travis passed locally: https://travis-ci.org/tillrohrmann/flink/jobs/213720094.
The failing test case is unrelated due to a problem downloading an old Flink version for japicmp. Merging this PR.


Add paymentMethodNonceInputField selector option to braintree.setup

By default, braintree.js inserts the following field
<input type="hidden" name="payment_method_nonce" />

Please add an option to allow an ID, DOM element, or jQuery object representing a pre-existing input field to be specified in the configuration passed into braintree.setup,
When set, braintree.js will write the nonce into this field instead of inserting a new hidden field. (similar to the paymentMethodNonceInputField option on the paypal object)
Adding this will allow custom validation to be easily configured for the field, i.e preventing submission when empty etc and negates the need for adding logic using the onPaymentMethodReceived function

Because you can already do this with onPaymentMethodReceived, we don't plan to add this. We'd like to keep the code as simple as possible going forward.
You can accomplish what you want using onPaymentMethodReceived:
var paymentForm = document.querySelector('form');
var nonceField = document.querySelector('#my-braintree-nonce-input');

braintree.setup('your-token', 'dropin', {
  onPaymentMethodReceived: function (payload) {
    // Set the <input>'s value with the nonce.
    nonceField.value = payload.nonce;

    // You can write myFormIsValid() to validate your form.
    if (myFormIsValid()) {
      paymentForm.submit();
    }
  }
});

You can also write the nonce to your form on your own with something like this:
var paymentForm = document.querySelector('form');
var nonceField;

braintree.setup('your-token', 'dropin', {
  onPaymentMethodReceived: function (payload) {
    // Create the <input> if it doesn't already exist.
    if (!nonceField) {
      nonceField = document.createElement('input');
      nonceField.name = 'payment_method_nonce';
      nonceField.type = 'hidden';
      paymentForm.appendChild(nonceField);
    }

    // Set its value.
    nonceField.value = nonce;

    // You can write myFormIsValid() to validate your form.
    if (myFormIsValid()) {
      paymentForm.submit();
    }
  }
});

Hope that helps!


catalog-backend: ensure subqueries are isolated from one another

Hey, I just made a Pull Request!
Ensures that independent calls to parseFilter are isolated from one
another, by always wrapping additional clauses to the query in
andWhere. I think that the bug in the previous incarnation is strictly
theoretical, as long as parseFilters is only called once for a given
filter (which today, it is). When authorization lands in catalog-backend
though, we'll need to call it multiple times - once to add the authz
filters, and once to add the filters requested by the caller, which
would expose this bug.
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[ ] Tests for new functionality and regression tests for bug fixes
[ ] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

Would of course be nice to exercise this with tests.

As far as I can tell, it's not possible to actually expose this bug right now, because parseFilter is private, and nothing calls it multiple times. Once we add support for authz filters in the catalog-backend, we'll definitely add tests which prove it works as intended! Sad that we can't do it more TDD, but I don't think it's doable this time 😁.


Bump Jackett and Lidarr versions and fix Radarr URL

Version bumps for Jackett and Lidarr, changed to Radarr URL to point to the latest .NET Core version since the mono version has been deprecated and gives a warning in the application.

Scripts has been updated 6 Aug 2021.


use MAP_NORESERVE for mapping a large chunk of memory

To support a large chunk of memory, we might set MAP_NORESERVE flag to mmap to get either proper memory accounting or full overcommit on both Linux and macOS. Would it make sense?

Done :-)


⚠ Bofrost.nl has degraded performance

In 8ba21b8, Bofrost.nl (https://www.bofrost.nl) experienced degraded performance:

HTTP code: 200
Response time: 891 ms

Resolved: Bofrost.nl performance has improved in 74b0521.


GEMS Education

@AR1VU gemselearning.txt I am sorry, I have to close the request without merging, because you made a mistake in a request and did not specify any filepath. Please ensure that you are familiar with this repository rules located at the bottom of this page and make a new correct request. Thank you for your understanding!


Release 0.6.3

replacement for #147

Codecov Report

Merging #148 (04220c1) into main (abfd01c) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #148   +/-   ##
=======================================
  Coverage   22.43%   22.43%
=======================================
  Files          23       23
  Lines        2086     2086
  Branches     1147     1147
=======================================
  Hits          468      468
  Misses        808      808
  Partials      810      810


Can not mount a ssh-key in the Pod

Environment

OS: Ubuntu 20.04.5 LTS
Kubernetes/K3s: v1.25.3+k3s1 (f2585c16)
AWX Operator: 0.29.0

Description
I am following the documents to mount a ssh key in my pod so that the pod can connect to a bastion host, but it is not working. Not even mounting a file is successful.
Step to Reproduce

I created a file named abc5.conf using the following command: kubectl -n awx create configmap awx-kerberos-config --from-file=abc5.conf

cat abc5.conf
[realms]
  KUROKOBO.INTERNAL = {
    kdc = kuro-ad01.kurokobo.internal
    admin_server = kuro-ad01.kurokobo.internal
  }

[domain_realm]
  .kurokobo.internal = KUROKOBO.INTERNAL
  kurokobo.internal = KUROKOBO.INTERNAL

I added volumes to the Instance Groups as follows:

apiVersion: v1
kind: Pod
metadata:
  namespace: awx
spec:
  serviceAccountName: default
  automountServiceAccountToken: false
  containers:
    - image: quay.io/davidyp/pylibssh:latest
      name: worker
      args:
        - ansible-runner
        - worker
        - '--private-data-dir=/runner'
      resources:
        requests:
          cpu: 250m
          memory: 100Mi
      volumeMounts:
        - name: shared-volume
          mountPath: /shared
        - name: awx-kerberos-volume
          mountPath: /etc/abc5.conf
          subPath: abc5.conf
  volumes:
    - name: shared-volume
      persistentVolumeClaim:
        claimName: awx-files-claim
    - name: awx-kerberos-volume
      configMap:
        name: awx-kerberos-config
  securityContext:
    runAsUser: 1000

I used kubectl -n awx describe pod to list the volumes, but the awx-kerberos-volume was not shown.

Did I miss something or should I use another method to achieve this? Any advice would be appreciated.

@David-yanp
Hi, thanks for using my guide.
In the first place, why did you follow that guide to mount SSH key? That guide is not to mount SSH key on the pod but to use Kerberos authentication. abc5.conf is not SSH key. /etc/abc5.conf is not a path for SSH key.
Could you be more specific about your goal?

@kurokobo
Hi, thank you for your reply.
Yes, I know this guide is not for ssh-key, I can't find a proper way to do this. So I tried to mount a file on the Pod, but that didn't work either.
I have been tried to using the secret to mount an ssh-key and it's not working.
I don't know how to do this,could you guide me how can I mount an SSH key or a batch of SSH key in the Pod?

@David-yanp
If you simply want to connect to the target node of the playbook via SSH with public key authentication, you can add the SSH key to your credentials.

Rather, do you want to connect to the target node via bastion host? If so, you may want to use Container Group as you have tried.
The pod spec in the Container Group is the spec for ephemeral automation job pod which is created on job launch and removed after job completion. I think your configuration is correct, but if you invoke describe pod when no job is running, you can see nothing. You should invoke describe pod during job runtime.
Ensure that your Container Group is specified in Job Template. Also for SSH key, you sould consider permission for the file to be mounted.
  volumes:
    ...
    - name: awx-kerberos-volume
      configMap:
        name: awx-kerberos-config
        items:
          - key: your-file
            path: your-file
            mode: 0600

In addition, this is a bit different approach, there is a good feature called Execution Node in AWX. Plrobably you can replace your bastion host with it without any SSH key.
https://github.com/ansible/awx/blob/devel/docs/execution_nodes.md

Also I recommend you to ask this on official mailing list or IRC channel. This is a good use case of AWX.
https://github.com/ansible/awx#get-involved

Thanks for the suggestion, I see Execution Node is a way to select nodes in a cluster without needing ssh-keys, but my bastion
host and current AWX are in different locations so it's not ideal for this solution.
Could you spare a bit more time to help me see if my steps for mounting the ssh-key on a Pod are correct?

kubectl -n awx create configmap awx-ssh-keys --from-file=id_rsa
kubectl -n awx get configmap

NAME                              DATA   AGE
kube-root-ca.crt                  1      89d
awx-operator-awx-manager-config   1      89d
awx-awx-configmap                 5      89d
awx-ssh-keys                      1      54m
awx-operator                      0      89d

Custom pod spec under Instance Groups

apiVersion: v1
kind: Pod
metadata:
  namespace: awx
spec:
  serviceAccountName: default
  automountServiceAccountToken: false
  containers:
    - image: quay.io/davidyp/pylibssh:latest
      name: worker
      args:
        - ansible-runner
        - worker
        - '--private-data-dir=/runner'
      resources:
        requests:
          cpu: 250m
          memory: 100Mi
      volumeMounts:
        - name: shared-volume
          mountPath: /shared
        - name: awx-ssh-volume
          mountPath: /root/.ssh
          subPath: id_rsa
  volumes:
    - name: shared-volume
      persistentVolumeClaim:
        claimName: awx-files-claim
    - name: awx-ssh-volume
      configMap:
        name: awx-ssh-keys
  imagePullSecrets:
    - name: davidyp-pull-secret
  securityContext:
    runAsUser: 1000

running a job and get in the pod with kubectl -n awx exec -it kubectl -n awx get pods|tail -n 1| awk '{print $1}' -- /bin/bash
Using `ls /root/.ssh/' to check the directory doesn't have the file.
Still can't find the Ssh-key in the Pod. Thanks.

@David-yanp

I see Execution Node is a way to select nodes in a cluster without needing ssh-keys

Nop, Execution Node is a way to use any standalone linux nodes for job execution. The automation job container will run on Podman on Execution Node, without Kubernetes.
Anyway, not fully tested, but I can confirm my id_rsa can be mounted in the pod and can SSH to connect another host using the key.

Create kay pair
ssh-keygen -t rsa -f ./id_rsa

Copy public key to jump host
ssh-copy-id -i ./id_rsa demo@jumphost

Create Secret from generated id_rsa
kubectl -n awx create secret generic awx-ssh-key --from-file=./id_rsa

Ensure awx-ssh-key is created
$ kubectl -n awx describe secret awx-ssh-key
Name:         awx-ssh-key
Namespace:    awx
Labels:       <none>
Annotations:  <none>

Type:  Opaque

Data
====
id_rsa:  2610 bytes

Create new Container Group on AWX with following pod spec
apiVersion: v1
kind: Pod
metadata:
  namespace: awx
spec:
  serviceAccountName: default
  automountServiceAccountToken: false
  containers:
    - image: 'quay.io/ansible/awx-ee:latest'
      name: worker
      args:
        - ansible-runner
        - worker
        - '--private-data-dir=/runner'
      resources:
        requests:
          cpu: 250m
          memory: 100Mi
      volumeMounts:
        - name: awx-ssh-volume
          mountPath: /home/runner/.ssh
  volumes:
    - name: awx-ssh-volume
      secret:
        secretName: awx-ssh-key

Modify Job Template to use Container Group ([Templates] > [Edit] > [Instance Groups])

Launch Job Template

Dig into the newly created Automation Job Pod
# Get Bash session of the pod
$ kubectl -n awx exec -it $(kubectl -n awx get pod -o=name | grep automation-job) -- bash

# Ensyre the key is mounted
$ kubectl -n awx describe $(kubectl -n awx get pod -o=name | grep automation-job)
...
Containers:
  worker:
    ...
    Mounts:
      /home/runner/.ssh from awx-ssh-volume (rw)
    ...
Volumes:
  awx-ssh-volume:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  awx-ssh-key
    ...

# Ensure the key is visible in the pod
$ ls -l /home/runner/.ssh/id_rsa
lrwxrwxrwx. 1 root root 13 Feb 14 16:35 /home/runner/.ssh/id_rsa -> ..data/id_rsa

# Ensure connecting the jump host via SSH using the key works as expected
bash-5.1$ ssh -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null demo@jumphost
Warning: Permanently added 'jumphost' (ED25519) to the list of known hosts.
Last login: Wed Feb 15 01:19:24 2023 from <IP_ADDRESS>
[demo@jumphost ~]$

Hi @kurokobo ,
I wanted to take a moment to thank you for your incredibly detailed response and patient guidance regarding my issues with awx-on-k3s. Your step-by-step explanations were extremely helpful, and I truly appreciate the time and effort you put into helping me.
I realized that my previous attempts failed due to my misunderstanding of the relationship between Instance Groups and Execution Environments on AWX, and that having multiple Instance Groups was the cause of the problem. With your guidance, I was able to successfully mount the SSh-key.
However, I encountered an issue when trying to connect to the target host through the bastion host, and received a raise ConnectionError(to_text(msg, errors='surrogate_then_replace'), code=code) error message. I was wondering if you have come across similar issues before and if you could offer any advice to help me troubleshoot the issue.
Once again, thank you so much for your help and support.

@David-yanp
One thing I have noticed but have not commented yet is the EE image you'd specified in the pod spec.
I think you want to use quay.io/davidyp/pylibssh:latest to enable ansible-pylibssh instead of paramiko to connect your target node (some network device?).
Note that the image in the pod spec for Container Group will be ignored and overridden by EE that specified on the Job Template. I mean, you have to add new EE (Execution Environments > Add) with the image quay.io/davidyp/pylibssh:latest and specify this EE on your Job Template.
Also you can get verbose log to investigate connection issue by specifying Verbosity on the Job Template.
If your issue still persists with correct EE, provide detailed information of your AWX, inventory, variables for the host (especially ansible_ssh_common_args), and your playbook.

@kurokobo
I found this on the ansible community, it looks like it might be a bug.?Additionally, my AWX configurations are as follows:"

ansible.cfg

[defaults]
host_key_checking = False
stdout_callback = yaml
bin_ansible_callbacks = True
deprecation_warnings = False
[inventory]
[privilege_escalation]
[ssh_connection]
ssh_args = -o PreferredAuthentications=keyboard-interactive,password
[persistent_connection]
command_timeout = 30
[accelerate]
[selinux]
[colors]
[diff]

variables include ansible_ssh_commom_args

{
  "ansible_connection": "network_cli",
  "ansible_host": "<IP_ADDRESS>",
  "ansible_network_os": "ce",
  "ansible_network_type": "huawei",
  "connect_type": "vrp",
  "ansible_ssh_common_args": "-o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o PreferredAuthentications=password -oKexAlgorithms=+diffie-hellman-group1-sha1 -o Ciphers=aes256-cbc,3des-cbc -o ProxyCommand='ssh -p 22 -W %h:%p -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null<EMAIL_ADDRESS>}

After running a backup job, I encountered a verbosity error

{
  "msg": "ssh connection failed: ssh connect failed: Timeout connecting to <IP_ADDRESS>",
  "invocation": {
    "module_args": {
      "prompt": [
        "login as:",
        "password:"
      ],
      "answer": [
        "user",
        "passwd"
      ],
      "command": "display current-configuration",
      "newline": true,
      "sendonly": false,
      "check_all": false
    }
  },
  "_ansible_no_log": false,
  "changed": false
}

the EE's ansible version

bash-4.4$ ansible --version
ansible [core 2.12.5.post0]
  config file = None
  configured module search path = ['/home/runner/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/local/lib/python3.8/site-packages/ansible
  ansible collection location = /home/runner/.ansible/collections:/usr/share/ansible/collections
  executable location = /usr/local/bin/ansible
  python version = 3.8.13 (default, Jun 24 2022, 15:27:57) [GCC 8.5.0 20210514 (Red Hat 8.5.0-13)]
  jinja version = 2.11.3
  libyaml = True

Any ideas?

Hmm, no idea. Any other verbose logs by specifying Verbosity to 4 (Connection Debug)?

Haven't any more detailed information in the connection debug
{
  "msg": "ssh connection failed: ssh connect failed: Timeout connecting to <IP_ADDRESS>",
  "exception": "  File \"/runner/requirements_collections/ansible_collections/ansible/netcommon/plugins/modules/cli_command.py\", line 170, in main\n    response = connection.get(**module.params)\n  File \"/usr/local/lib/python3.8/site-packages/ansible/module_utils/connection.py\", line 200, in __rpc__\n    raise ConnectionError(to_text(msg, errors='surrogate_then_replace'), code=code)\n",
  "invocation": {
    "module_args": {
      "prompt": [
        "login as:",
        "password:"
      ],
      "answer": [
        "username",
        "passwd"
      ],
      "command": "display current-configuration",
      "newline": true,
      "sendonly": false,
      "check_all": false
    }
  },
  "_ansible_no_log": false,
  "changed": false
}

Where did you see that JSON log...? Is that all of your Output tab? Usualy 4 (Connection Debug) includes detailed information   about connection (Below is just example for local connection).

I know, I just select the keywords of the file, the complete output is as follows
ansible-playbook [core 2.12.5.post0]
  config file = /runner/project/ansible.cfg
  configured module search path = ['/home/runner/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/local/lib/python3.8/site-packages/ansible
  ansible collection location = /runner/requirements_collections:/home/runner/.ansible/collections:/usr/share/ansible/collections
  executable location = /usr/local/bin/ansible-playbook
  python version = 3.8.13 (default, Jun 24 2022, 15:27:57) [GCC 8.5.0 20210514 (Red Hat 8.5.0-13)]
  jinja version = 2.11.3
  libyaml = True
Using /runner/project/ansible.cfg as config file
SSH password:
setting up inventory plugins
host_list declined parsing /runner/inventory/hosts as it did not pass its verify_file() method
Set default localhost to localhost
Parsed /runner/inventory/hosts inventory source with script plugin
Loading callback plugin default of type stdout, v2.0 from /usr/local/lib/python3.8/site-packages/ansible/plugins/callback/default.py
Loading callback plugin awx_display of type stdout, v2.0 from /usr/local/lib/python3.8/site-packages/ansible_runner/display_callback/callback/awx_display.py
Skipping callback 'awx_display', as we already have a stdout callback.
Skipping callback 'default', as we already have a stdout callback.
Skipping callback 'minimal', as we already have a stdout callback.
Skipping callback 'oneline', as we already have a stdout callback.

PLAYBOOK: backup.yml ***********************************************************
Positional arguments: backup.yml
verbosity: 4
remote_user: netdev
connection: smart
timeout: 10
ask_pass: True
become_method: sudo
tags: ('all',)
inventory: ('/runner/inventory/hosts',)
subset: EC12-S5700
extra_vars: ('@/runner/env/extravars',)
forks: 5
1 plays in backup.yml

PLAY [backup cisco's device using the roles] ***********************************
META: ran handlers

TASK [backup : include the pre test] *******************************************
task path: /runner/project/roles/backup/tasks/main.yml:2
included: /runner/project/roles/backup/tasks/pre.yml for EC12-S5700

TASK [backup : Test variables are OK] ******************************************
task path: /runner/project/roles/backup/tasks/pre.yml:2
redirecting (type: connection) ansible.builtin.network_cli to ansible.netcommon.network_cli
Loading collection ansible.netcommon from /runner/requirements_collections/ansible_collections/ansible/netcommon
redirecting (type: terminal) ansible.builtin.ce to community.network.ce
Loading collection community.network from /runner/requirements_collections/ansible_collections/community/network
redirecting (type: cliconf) ansible.builtin.ce to community.network.ce
<<IP_ADDRESS>> attempting to start connection
<<IP_ADDRESS>> using connection plugin ansible.netcommon.network_cli
Found ansible-connection at path /usr/local/bin/ansible-connection
<<IP_ADDRESS>> local domain socket does not exist, starting it
<<IP_ADDRESS>> control socket path is /home/runner/.ansible/pc/a3e354055e
<<IP_ADDRESS>> redirecting (type: connection) ansible.builtin.network_cli to ansible.netcommon.network_cli
<<IP_ADDRESS>> Loading collection ansible.netcommon from /runner/requirements_collections/ansible_collections/ansible/netcommon
<<IP_ADDRESS>> redirecting (type: terminal) ansible.builtin.ce to community.network.ce
<<IP_ADDRESS>> Loading collection community.network from /runner/requirements_collections/ansible_collections/community/network
<<IP_ADDRESS>> redirecting (type: cliconf) ansible.builtin.ce to community.network.ce
<<IP_ADDRESS>> local domain socket listeners started successfully
<<IP_ADDRESS>> loaded cliconf plugin ansible_collections.community.network.plugins.cliconf.ce from path /runner/requirements_collections/ansible_collections/community/network/plugins/cliconf/ce.py for network_os ce
<<IP_ADDRESS>> ssh type is set to auto
<<IP_ADDRESS>> autodetecting ssh_type
<<IP_ADDRESS>> ssh type is now set to libssh
<<IP_ADDRESS>>
<<IP_ADDRESS>> local domain socket path is /home/runner/.ansible/pc/a3e354055e
ok: [EC12-S5700] => {
    "changed": false,
    "msg": "All assertions passed"
}

TASK [backup : Ensure backup dir exists] ***************************************
task path: /runner/project/roles/backup/tasks/pre.yml:15
redirecting (type: connection) ansible.builtin.network_cli to ansible.netcommon.network_cli
Loading collection ansible.netcommon from /runner/requirements_collections/ansible_collections/ansible/netcommon
redirecting (type: terminal) ansible.builtin.ce to community.network.ce
Loading collection community.network from /runner/requirements_collections/ansible_collections/community/network
redirecting (type: cliconf) ansible.builtin.ce to community.network.ce
<<IP_ADDRESS>> attempting to start connection
<<IP_ADDRESS>> using connection plugin ansible.netcommon.network_cli
Found ansible-connection at path /usr/local/bin/ansible-connection
<<IP_ADDRESS>> found existing local domain socket, using it!
<<IP_ADDRESS>> updating play_context for connection
<<IP_ADDRESS>>
<<IP_ADDRESS>> local domain socket path is /home/runner/.ansible/pc/a3e354055e
<<IP_ADDRESS>> ESTABLISH LOCAL CONNECTION FOR USER: runner
<<IP_ADDRESS>> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/runner/.ansible/tmp/ansible-local-19cf1o54y6 `"&& mkdir "` echo /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373 `" && echo ansible-tmp-1676534124.6143255-35-130240151905373="` echo /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373 `" ) && sleep 0'
Using module file /usr/local/lib/python3.8/site-packages/ansible/modules/file.py
<<IP_ADDRESS>> PUT /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/tmpcji_zgju TO /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373/AnsiballZ_file.py
<<IP_ADDRESS>> EXEC /bin/sh -c 'chmod u+x /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373/ /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373/AnsiballZ_file.py && sleep 0'
<<IP_ADDRESS>> EXEC /bin/sh -c '/usr/bin/python3 /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373/AnsiballZ_file.py && sleep 0'
<<IP_ADDRESS>> EXEC /bin/sh -c 'rm -f -r /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/ansible-tmp-1676534124.6143255-35-130240151905373/ > /dev/null 2>&1 && sleep 0'
ok: [EC12-S5700] => {
    "changed": false,
    "diff": {
        "after": {
            "path": "/shared/network_backups//HKIDC"
        },
        "before": {
            "path": "/shared/network_backups//HKIDC"
        }
    },
    "gid": 0,
    "group": "root",
    "invocation": {
        "module_args": {
            "_diff_peek": null,
            "_original_basename": null,
            "access_time": null,
            "access_time_format": "%Y%m%d%H%M.%S",
            "attributes": null,
            "follow": true,
            "force": false,
            "group": null,
            "mode": null,
            "modification_time": null,
            "modification_time_format": "%Y%m%d%H%M.%S",
            "owner": null,
            "path": "/shared/network_backups//HKIDC",
            "recurse": false,
            "selevel": null,
            "serole": null,
            "setype": null,
            "seuser": null,
            "src": null,
            "state": "directory",
            "unsafe_writes": false
        }
    },
    "mode": "0755",
    "owner": "runner",
    "path": "/shared/network_backups//HKIDC",
    "size": 4096,
    "state": "directory",
    "uid": 1000
}

TASK [backup : include the exactly tasks] **************************************
task path: /runner/project/roles/backup/tasks/main.yml:5
included: /runner/project/roles/backup/tasks/huawei.yml for EC12-S5700

TASK [backup : using cli_command to backup huawei vrp device] ******************
task path: /runner/project/roles/backup/tasks/huawei.yml:2
redirecting (type: action) ansible.builtin.cli_command to ansible.netcommon.cli_command
Loading collection ansible.netcommon from /runner/requirements_collections/ansible_collections/ansible/netcommon
included: /runner/project/roles/backup/tasks/huawei_vrp.yml for EC12-S5700
redirecting (type: action) ansible.builtin.cli_command to ansible.netcommon.cli_command

TASK [backup : Save Huawei vrps configure using cli_command through SSH] *******
task path: /runner/project/roles/backup/tasks/huawei_vrp.yml:4
redirecting (type: connection) ansible.builtin.network_cli to ansible.netcommon.network_cli
redirecting (type: terminal) ansible.builtin.ce to community.network.ce
Loading collection community.network from /runner/requirements_collections/ansible_collections/community/network
redirecting (type: cliconf) ansible.builtin.ce to community.network.ce
<<IP_ADDRESS>> attempting to start connection
<<IP_ADDRESS>> using connection plugin ansible.netcommon.network_cli
Found ansible-connection at path /usr/local/bin/ansible-connection
<<IP_ADDRESS>> found existing local domain socket, using it!
<<IP_ADDRESS>> updating play_context for connection
<<IP_ADDRESS>>
<<IP_ADDRESS>> local domain socket path is /home/runner/.ansible/pc/a3e354055e
redirecting (type: action) ansible.builtin.cli_command to ansible.netcommon.cli_command
redirecting (type: action) ansible.builtin.cli_command to ansible.netcommon.cli_command
<<IP_ADDRESS>> ANSIBLE_NETWORK_IMPORT_MODULES: enabled
redirecting (type: modules) ansible.builtin.cli_command to ansible.netcommon.cli_command
<<IP_ADDRESS>> ANSIBLE_NETWORK_IMPORT_MODULES: found cli_command  at /runner/requirements_collections/ansible_collections/ansible/netcommon/plugins/modules/cli_command.py
<<IP_ADDRESS>> ANSIBLE_NETWORK_IMPORT_MODULES: running cli_command
<<IP_ADDRESS>> ANSIBLE_NETWORK_IMPORT_MODULES: complete
The full traceback is:
  File "/runner/requirements_collections/ansible_collections/ansible/netcommon/plugins/modules/cli_command.py", line 170, in main
    response = connection.get(**module.params)
  File "/usr/local/lib/python3.8/site-packages/ansible/module_utils/connection.py", line 200, in __rpc__
    raise ConnectionError(to_text(msg, errors='surrogate_then_replace'), code=code)
fatal: [EC12-S5700]: FAILED! => {
    "changed": false,
    "invocation": {
        "module_args": {
            "answer": [
                "netdev",
                "mq}bh62wy>#pHFw6"
            ],
            "check_all": false,
            "command": "display current-configuration",
            "newline": true,
            "prompt": [
                "login as:",
                "password:"
            ],
            "sendonly": false
        }
    },
    "msg": "ssh connection failed: ssh connect failed: Timeout connecting to <IP_ADDRESS>"
}
...ignoring

TASK [backup : resetting the output to a new variable] *************************
task path: /runner/project/roles/backup/tasks/huawei_vrp.yml:16
fatal: [EC12-S5700]: FAILED! => {
    "msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'stdout'\\n\\nThe error appears to be in '/runner/project/roles/backup/tasks/huawei_vrp.yml': line 16, column 3, but may\\nbe elsewhere in the file depending on the exact syntax problem.\\n\\nThe offending line appears to be:\\n\\n#    msg: \\"{{ vrp_output }}\\"\\n- name: resetting the output to a new variable\\n  ^ here\\n"
}
...ignoring

TASK [backup : using ce_command to backup huawei ce device] ********************
task path: /runner/project/roles/backup/tasks/huawei.yml:5
skipping: [EC12-S5700] => {
    "changed": false,
    "skip_reason": "Conditional result was False"
}

TASK [backup : dump the configure to file] *************************************
task path: /runner/project/roles/backup/tasks/huawei.yml:8
fatal: [EC12-S5700 -> localhost]: FAILED! => {
    "msg": "The task includes an option with an undefined variable. The error was: 'huawei_output' is undefined\\n\\nThe error appears to be in '/runner/project/roles/backup/tasks/huawei.yml': line 8, column 3, but may\\nbe elsewhere in the file depending on the exact syntax problem.\\n\\nThe offending line appears to be:\\n\\n  when: connect_type == \\"ce\\"\\n- name: dump the configure to file\\n  ^ here\\n"
}
...ignoring

TASK [backup : delete some words on the file] **********************************
task path: /runner/project/roles/backup/tasks/main.yml:10
<localhost> ESTABLISH LOCAL CONNECTION FOR USER: runner
<localhost> EXEC /bin/sh -c 'echo ~runner && sleep 0'
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/runner/.ansible/tmp `"&& mkdir "` echo /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346 `" && echo ansible-tmp-1676534227.9158719-68-134748528056346="` echo /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346 `" ) && sleep 0'
<EC12-S5700> Attempting python interpreter discovery
<localhost> EXEC /bin/sh -c 'echo PLATFORM; uname; echo FOUND; command -v '"'"'python3.10'"'"'; command -v '"'"'python3.9'"'"'; command -v '"'"'python3.8'"'"'; command -v '"'"'python3.7'"'"'; command -v '"'"'python3.6'"'"'; command -v '"'"'python3.5'"'"'; command -v '"'"'/usr/bin/python3'"'"'; command -v '"'"'/usr/libexec/platform-python'"'"'; command -v '"'"'python2.7'"'"'; command -v '"'"'python2.6'"'"'; command -v '"'"'/usr/bin/python'"'"'; command -v '"'"'python'"'"'; echo ENDFOUND && sleep 0'
<localhost> EXEC /bin/sh -c '/usr/bin/python3.9 && sleep 0'
Using module file /usr/local/lib/python3.8/site-packages/ansible/modules/lineinfile.py
<localhost> PUT /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/tmpdpunrazi TO /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346/AnsiballZ_lineinfile.py
<localhost> EXEC /bin/sh -c 'chmod u+x /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346/ /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346/AnsiballZ_lineinfile.py && sleep 0'
<localhost> EXEC /bin/sh -c '/usr/libexec/platform-python /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346/AnsiballZ_lineinfile.py && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /home/runner/.ansible/tmp/ansible-tmp-1676534227.9158719-68-134748528056346/ > /dev/null 2>&1 && sleep 0'
ok: [EC12-S5700 -> localhost] => (item={'regex': '! ?(Last|NVRAM) config*'}) => {
    "ansible_loop_var": "item",
    "backup": "",
    "changed": false,
    "diff": [
        {
            "after": "",
            "after_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (content)",
            "before": "",
            "before_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (content)"
        },
        {
            "after_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (file attributes)",
            "before_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (file attributes)"
        }
    ],
    "found": 0,
    "invocation": {
        "module_args": {
            "attributes": null,
            "backrefs": false,
            "backup": false,
            "create": false,
            "firstmatch": false,
            "group": null,
            "insertafter": null,
            "insertbefore": null,
            "line": null,
            "mode": null,
            "owner": null,
            "path": "/shared/network_backups//HKIDC/EC12-S5700.txt",
            "regexp": "! ?(Last|NVRAM) config*",
            "search_string": null,
            "selevel": null,
            "serole": null,
            "setype": null,
            "seuser": null,
            "state": "absent",
            "unsafe_writes": false,
            "validate": null
        }
    },
    "item": {
        "regex": "! ?(Last|NVRAM) config*"
    },
    "msg": ""
}
<localhost> EXEC /bin/sh -c 'echo ~runner && sleep 0'
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/runner/.ansible/tmp `"&& mkdir "` echo /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034 `" && echo ansible-tmp-1676534228.4413135-68-58450451243034="` echo /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034 `" ) && sleep 0'
Using module file /usr/local/lib/python3.8/site-packages/ansible/modules/lineinfile.py
<localhost> PUT /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/tmpez231v89 TO /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034/AnsiballZ_lineinfile.py
<localhost> EXEC /bin/sh -c 'chmod u+x /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034/ /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034/AnsiballZ_lineinfile.py && sleep 0'
<localhost> EXEC /bin/sh -c '/usr/libexec/platform-python /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034/AnsiballZ_lineinfile.py && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /home/runner/.ansible/tmp/ansible-tmp-1676534228.4413135-68-58450451243034/ > /dev/null 2>&1 && sleep 0'
ok: [EC12-S5700 -> localhost] => (item={'regex': 'show running-config'}) => {
    "ansible_loop_var": "item",
    "backup": "",
    "changed": false,
    "diff": [
        {
            "after": "",
            "after_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (content)",
            "before": "",
            "before_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (content)"
        },
        {
            "after_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (file attributes)",
            "before_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (file attributes)"
        }
    ],
    "found": 0,
    "invocation": {
        "module_args": {
            "attributes": null,
            "backrefs": false,
            "backup": false,
            "create": false,
            "firstmatch": false,
            "group": null,
            "insertafter": null,
            "insertbefore": null,
            "line": null,
            "mode": null,
            "owner": null,
            "path": "/shared/network_backups//HKIDC/EC12-S5700.txt",
            "regexp": "show running-config",
            "search_string": null,
            "selevel": null,
            "serole": null,
            "setype": null,
            "seuser": null,
            "state": "absent",
            "unsafe_writes": false,
            "validate": null
        }
    },
    "item": {
        "regex": "show running-config"
    },
    "msg": ""
}
<localhost> EXEC /bin/sh -c 'echo ~runner && sleep 0'
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /home/runner/.ansible/tmp `"&& mkdir "` echo /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043 `" && echo ansible-tmp-1676534228.7225175-68-142878117321043="` echo /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043 `" ) && sleep 0'
Using module file /usr/local/lib/python3.8/site-packages/ansible/modules/lineinfile.py
<localhost> PUT /home/runner/.ansible/tmp/ansible-local-19cf1o54y6/tmpitll2vxo TO /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043/AnsiballZ_lineinfile.py
<localhost> EXEC /bin/sh -c 'chmod u+x /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043/ /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043/AnsiballZ_lineinfile.py && sleep 0'
<localhost> EXEC /bin/sh -c '/usr/libexec/platform-python /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043/AnsiballZ_lineinfile.py && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /home/runner/.ansible/tmp/ansible-tmp-1676534228.7225175-68-142878117321043/ > /dev/null 2>&1 && sleep 0'
ok: [EC12-S5700 -> localhost] => (item={'regex': 'ntp clock-period'}) => {
    "ansible_loop_var": "item",
    "backup": "",
    "changed": false,
    "diff": [
        {
            "after": "",
            "after_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (content)",
            "before": "",
            "before_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (content)"
        },
        {
            "after_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (file attributes)",
            "before_header": "/shared/network_backups//HKIDC/EC12-S5700.txt (file attributes)"
        }
    ],
    "found": 0,
    "invocation": {
        "module_args": {
            "attributes": null,
            "backrefs": false,
            "backup": false,
            "create": false,
            "firstmatch": false,
            "group": null,
            "insertafter": null,
            "insertbefore": null,
            "line": null,
            "mode": null,
            "owner": null,
            "path": "/shared/network_backups//HKIDC/EC12-S5700.txt",
            "regexp": "ntp clock-period",
            "search_string": null,
            "selevel": null,
            "serole": null,
            "setype": null,
            "seuser": null,
            "state": "absent",
            "unsafe_writes": false,
            "validate": null
        }
    },
    "item": {
        "regex": "ntp clock-period"
    },
    "msg": ""
}
META: role_complete for EC12-S5700
META: ran handlers
META: ran handlers

PLAY RECAP *********************************************************************
EC12-S5700      : ok=9    changed=0    unreachable=0    failed=0    skipped=1    rescued=0    ignored=3

@David-yanp
Thanks for providing full logs. I want to try to reproduce your issue but it requires much time (to deploy jump host and network devices behind jump host in my home lab to use network_cli), so it's hard for me to provide excellent solution right now.
Ideas for investigation;

Ensure your SSH keys mounted under /home/runner/.ssh (not /root/.ssh)
Ensure your playbook works locally (without AWX and EE) with same version of pip modules, Ansible, and Collections.
Ensure you can SSH to target device through jump host from inside your EE using SSH keys.
Try creating and mounting /home/runner/.ssh/config on EE that includes ProxyCommand for your devices and test connection inside EE.
Try using paramiko instead of ansible-pylibssh.

@David-yanp
I think it would be a good idea to ask the community as well, as just asking a question here will not get you any help other than from me.

https://github.com/ansible/awx#get-involved
https://docs.ansible.com/ansible/latest/community/communication.html#real-time-chat

Ok got it, thanks for the suggestion, thanks for the help.

Ok got it, thanks for the suggestion, thanks for the help.


Client Allocation Request for: [Firefly ]

Client Allocation Questions
Core Information

Name: Firefly
Website / Social Media:http://fireflyblock.com
DataCap Requested: [50T]
Addresses to be Notarized: [f1dbpdc56q6wfcmb4p2ppzqruufiqcr2s5xqwybma]

Hey @Firefly2020-cloud - thanks for your request. At this time, the FF is only considering data cap requests <5 TB. This is to ensure effective diligence relative to the tooling available and time. If you would like to request <5 TB, then please file a new request via the app.

Name: Firefly
Website / Social Media:http://fireflyblock.com
DataCap Requested: [5T]
Addresses to be Notarized: [f1dbpdc56q6wfcmb4p2ppzqruufiqcr2s5xqwybma]


Loading Salicon dataset

Hi,
I'm trying to retrain the models on salicaon using your code.  I don't see the fixations and fixation maps data as used in the code here. Like separate files for each image.  Or is there a preprocessing part that I'm supposed to do before using the code?
Can you give me pointers to the dataset download url?
I'm currently downloading the dataset from
http://salicon.net/download/
Thank you so much!
Spandana

Hi @spandanagella,
thanks for downloading our code.
You can download the ground-truth density maps and fixation maps from this page: http://salicon.net/challenge-2017/. If you want to replicate our results, you have to use the original release of the SALICON dataset.

Hi @marcellacornia,
I downloaded your code and I'm trying to train model on SALICON Dataset.
However I faced with few issues:

Here:https://github.com/marcellacornia/sam/blob/bba23cdc3eb921563d23a4339cd774a45b7b903c/utilities.py#L106
you referencing to key "I" in fixation map, but there is no such a key in SALICON fixation maps. There are only these keys:

fix_map.keys()
Out[68]: dict_keys(['__header__', '__version__', '__globals__', 'image', 'resolution', 'gaze'])

I supposed that 'I' equivalent to 'gaze'. But on the next line:https://github.com/marcellacornia/sam/blob/bba23cdc3eb921563d23a4339cd774a45b7b903c/utilities.py#L107
fix_map is passed to padding_fixation, where it is handled like an image (padding addition and). But 'gaze' is nested ndarray of shape (54, 1), where each internal array consists of 3 arrays with different shapes.
So my question is: what do I need to pass to padding_fixation as the fix_map, cause I can't find the appropriate data?

Hi @Mastya,
are you using the original release of the SALICON dataset (that is reported at the end of this page)?
SALICON authors changed the data format few months ago, but my code only supports the original data format.

Yes, @marcellacornia, I checked all datasets from this page, including previous release of SALICON (Matlab files and saliency maps, used in ’15 and ’16 challenges). Data structure is the same as I described before, and it's not correspond with the data processing in the code.
Can you, please, tell me, where I can get the original data, that you used for training? Or how can I convert the existing data to suitable format?

Hi @marcellacornia,
I really like your work "Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model".
Can I ask a question that if your precomputed saliency map by SAM-RES on the SALICON validation set is the same one that you used to report result in TABLE IV in the paper.
Many thanks
Sen

Hi @SenJia,
thank you.
The results in Table IV were obtained by using the output of the Attentive ConvLSTM at different timesteps as input for the rest of the model. The results are on the SALICON validation set, using the 2015 version of the dataset.

@Mastya I see nan for lambda_2_loss as well. How did you resolve this?

@prachees Me too, the loss start from a nan number.
It looks like
loss: nan - lambda_2_loss:nan
Is it normal?

@marcellacornia Do you observe this issue? Right from the start of the training the loss goes to nan.


new Example page structure

Our examples page got busy and difficult to enjoy.
The proposed structure:

keeps each project on its own page
separates projects from starter kits
keeps the /examples as a main directory

Next step will be making /examples sortable and filtrable.


feat: allow to embed superset dashboard in instructor dashboard

Description
This PR migrates the Instructor Dashboard superset integration code from platform-plugin-superset.

Thanks for the pull request, @Ian2012! Please note that it may take us up to several weeks or months to complete a review and merge your PR.
Feel free to add as much of the following information to the ticket as you can:

supporting documentation
Open edX discussion forum threads
timeline information ("this must be merged by XX date", and why that is)
partner information ("this is a course on edx.org")
any other information that can help Product understand the context for the PR

All technical communication about the code itself will be done via the GitHub pull request interface. As a reminder, our process documentation is here.
Please let us know once your PR is ready for our review and all tests are green.

@Ian2012 Even though your pull request wasn’t merged, please take a moment  to answer a two question survey so we can improve your experience in the future.


Validate the 32 bit install as well

Once we are through the initial backlog of testing, this will be beneficial

@ferventcoder will this be a second run of the installation, with the -x86 flag?

Yes.

:+1:


"#number" after street name does not parse as unit number, but as street name.

Hi!
I was checking out libpostal, and saw something that could be improved.

My country is
US

Here's how I'm using libpostal
Parsing list of addresses in my city to store in a normalized relational database.

Here's what I did
Parsed the following address "1141 Kendall Town Blvd #3202, Jacksonville, FL 32225"

Here's what I got
house_number: 1141
road: kendall town blvd #3202
city: jacksonville
state: fl
postcode: 32225

Here's what I was expecting
house_number: 1141
unit: #3202
road: kendall town blvd
city: jacksonville
state: fl
postcode: 32225

Does the input address exist in OpenStreetMap?
No

Do all the toponyms exist in OSM (city, state, region names, etc.)?
City and state are in OSM

If the address uses a rare/uncommon format, does changing the order of the fields yield the correct result?
"1141 #3202 Kendall Town Blvd, Jacksonville, FL 32225" results in the following format

house_number: 1141 #3202
road: kendall town blvd
city: jacksonville
state: fl
postcode: 32225
But "#3202" should be in listed under "unit" and not house number. However "1141 apt 3202 Kendall Town Blvd, Jacksonville, FL 32225" outputs the correct format
house_number: 1141
unit: apt 3202
road: kendall town blvd
city: jacksonville
state: fl
postcode: 32225

If the address contains apartment/floor/sub-building information or uncommon formatting, does removing that help? Is there any minimum form of the address that gets the right parse?

Yes, the following results in correct output
"1141 apt 3202 Kendall Town Blvd, Jacksonville, FL 32225"

Here's what I think could be improved
If  "# followed by numbers is listed before the city it would be treated as unit number.

Did you try the Senzing provided model?
On Sat, Sep 21, 2024 at 16:12 arya6000 @.***> wrote:

Hi!
I was checking out libpostal, and saw something that could be improved.
My country is
US
Here's how I'm using libpostal
Parsing list of addresses in my city to store in a normalized relational
database.
Here's what I did
Parsed the following address "1141 Kendall Town Blvd #3202, Jacksonville,
FL 32225
https://www.google.com/maps/search/1141+Kendall+Town+Blvd+%233202,+Jacksonville,+FL+32225?entry=gmail&source=g
"
Here's what I got
house_number: 1141
road: kendall town blvd #3202
city: jacksonville
state: fl
postcode: 32225
Here's what I was expecting
house_number: 1141
unit: #3202
road: kendall town blvd
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
city: jacksonville
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
state: fl
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
postcode: 32225
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g

Does the input address exist in OpenStreetMap
https://openstreetmap.org?
No
Do all the toponyms exist in OSM (city, state, region names, etc.)?
City and state are in OSM
If the address uses a rare/uncommon format, does changing the order of
the fields yield the correct result?
"1141 #3202 Kendall Town Blvd, Jacksonville, FL 32225
https://www.google.com/maps/search/Kendall+Town+Blvd,+Jacksonville,+FL+32225?entry=gmail&source=g"
results in the following format
house_number: 1141 #3202
road: kendall town blvd
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
city: jacksonville
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
state: fl
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
postcode: 32225
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
But "#3202" should be in listed under "unit" and not house number. However
"1141 apt 3202 Kendall Town Blvd, Jacksonville, FL 32225
https://www.google.com/maps/search/Kendall+Town+Blvd,+Jacksonville,+FL+32225?entry=gmail&source=g"
outputs the correct format
house_number: 1141
unit: apt 3202
road: kendall town blvd
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
city: jacksonville
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
state: fl
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g
postcode: 32225
https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g

If the address contains apartment/floor/sub-building information or
uncommon formatting, does removing that help? Is there any minimum form of
the address that gets the right parse?

Yes, the following results in correct output
"1141 apt 3202 Kendall Town Blvd, Jacksonville, FL 32225
https://www.google.com/maps/search/Kendall+Town+Blvd,+Jacksonville,+FL+32225?entry=gmail&source=g
"
Here's what I think could be improved
If "# followed by numbers is listed before the city it would be treated as
unit number.
—
Reply to this email directly, view it on GitHub
https://github.com/openvenues/libpostal/issues/671, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF6OZVH54OBZC3COXQSRSUTZXXHKHAVCNFSM6AAAAABOT3YFGKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGU2DANBZGM3DMNA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Did you try the Senzing provided model?
…
On Sat, Sep 21, 2024 at 16:12 arya6000 @.> wrote: Hi! I was checking out libpostal, and saw something that could be improved. ------------------------------ My country is US ------------------------------ Here's how I'm using libpostal Parsing list of addresses in my city to store in a normalized relational database. ------------------------------ Here's what I did Parsed the following address "1141 Kendall Town Blvd #3202, Jacksonville, FL 32225 https://www.google.com/maps/search/1141+Kendall+Town+Blvd+%233202,+Jacksonville,+FL+32225?entry=gmail&source=g " ------------------------------ Here's what I got house_number: 1141 road: kendall town blvd #3202 city: jacksonville state: fl postcode: 32225 ------------------------------ Here's what I was expecting house_number: 1141 unit: #3202 road: kendall town blvd https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g city: jacksonville https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g state: fl https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g postcode: 32225 https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g ------------------------------ - Does the input address exist in OpenStreetMap https://openstreetmap.org? No - Do all the toponyms exist in OSM (city, state, region names, etc.)? City and state are in OSM - If the address uses a rare/uncommon format, does changing the order of the fields yield the correct result? "1141 #3202 Kendall Town Blvd, Jacksonville, FL 32225 https://www.google.com/maps/search/Kendall+Town+Blvd,+Jacksonville,+FL+32225?entry=gmail&source=g" results in the following format house_number: 1141 #3202 road: kendall town blvd https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g city: jacksonville https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g state: fl https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g postcode: 32225 https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g But "#3202" should be in listed under "unit" and not house number. However "1141 apt 3202 Kendall Town Blvd, Jacksonville, FL 32225 https://www.google.com/maps/search/Kendall+Town+Blvd,+Jacksonville,+FL+32225?entry=gmail&source=g" outputs the correct format house_number: 1141 unit: apt 3202 road: kendall town blvd https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g city: jacksonville https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g state: fl https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g postcode: 32225 https://www.google.com/maps/search/kendall+town+blvd+
city:+jacksonville+
state:+fl+
postcode:+32225?entry=gmail&source=g - If the address contains apartment/floor/sub-building information or uncommon formatting, does removing that help? Is there any minimum form of the address that gets the right parse? Yes, the following results in correct output "1141 apt 3202 Kendall Town Blvd, Jacksonville, FL 32225 https://www.google.com/maps/search/Kendall+Town+Blvd,+Jacksonville,+FL+32225?entry=gmail&source=g " ------------------------------ Here's what I think could be improved If "# followed by numbers is listed before the city it would be treated as unit number. — Reply to this email directly, view it on GitHub <#671>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AF6OZVH54OBZC3COXQSRSUTZXXHKHAVCNFSM6AAAAABOT3YFGKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGU2DANBZGM3DMNA . You are receiving this because you are subscribed to this thread.Message ID: @.>

I was not aware of Senzing. You are referring to this https://github.com/Senzing/libpostal-data  ?

Yes.  If you search the libpostal docs for alternative data models you
should see how to enable it.
On Sat, Sep 21, 2024 at 18:55 arya6000 @.***> wrote:

Did you try the Senzing provided model?
I was not aware of Senzing. You are referring to this
https://github.com/Senzing/libpostal-data ?
—
Reply to this email directly, view it on GitHub
https://github.com/openvenues/libpostal/issues/671#issuecomment-2365348330,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF6OZVDLW2MSXXAM4TSLPRTZXX2MNAVCNFSM6AAAAABOT3YFGKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNRVGM2DQMZTGA
.
You are receiving this because you commented.Message ID:
@.***>

Yes. If you search the libpostal docs for alternative data models you should see how to enable it.

I just tried with a the Senzing model and it solved the issue. Thanks


sudo: 1.8.25p1 -> 1.8.26

Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Fits CONTRIBUTING.md.

@GrahamcOfBorg test sudo

No attempt on x86_64-linux (full log)
The following builds were skipped because they don't evaluate on x86_64-linux: tests.sudo
Partial log (click to expand)
error: while evaluating 'recursiveUpdate' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:415:26, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:148:28:
while evaluating 'recursiveUpdateUntil' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:384:37, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:416:5:
while evaluating 'zipAttrsWith' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:347:21, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:394:8:
while evaluating 'zipAttrsWithNames' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:332:33, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:347:27:
while evaluating anonymous function at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/lists.nix:113:41, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/lib/attrsets.nix:347:46:
while evaluating the attribute 'sudo' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/nixos/tests/all-tests.nix:194:3:
while evaluating 'handleTest' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/nixos/tests/all-tests.nix:17:22, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/nixos/tests/all-tests.nix:194:10:
while evaluating 'discoverTests' at /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/nixos/tests/all-tests.nix:13:19, called from /var/lib/gc-of-borg/.nix-test-rs/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/rbvermaa-spot/nixos/tests/all-tests.nix:18:5:
access to path '/nix/store/q5sxwfi970znmldfnxly848v8m4ki2zx-rbvermaa-spot' is forbidden in restricted mode

No attempt on aarch64-linux (full log)
The following builds were skipped because they don't evaluate on aarch64-linux: tests.sudo
Partial log (click to expand)
Cannot nix-instantiate `tests.sudo' because:
error: while evaluating 'recursiveUpdate' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:415:26, called from /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:148:28:
while evaluating 'recursiveUpdateUntil' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:384:37, called from /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:416:5:
while evaluating 'zipAttrsWith' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:347:21, called from /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:394:8:
while evaluating 'zipAttrsWithNames' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:332:33, called from /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/lib/attrsets.nix:347:27:
while evaluating the attribute 'sudo' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/nixos/tests/all-tests.nix:194:3:
while evaluating 'handleTest' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/nixos/tests/all-tests.nix:17:22, called from /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/nixos/tests/all-tests.nix:194:10:
while evaluating 'discoverTests' at /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/nixos/tests/all-tests.nix:13:19, called from /var/lib/gc-of-borg/nix-test-rs-29/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-29/nixos/tests/all-tests.nix:18:5:
access to path '/nix/store/60pbzqp65mnqwxx2ri76871rjx4w9dcx-grahamc-aarch64-community-29' is forbidden in restricted mode

Success on x86_64-linux (full log)
Attempted: sudo
Partial log (click to expand)
shrinking /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/bin/sudoreplay
shrinking /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/bin/sudo
shrinking /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/bin/cvtsudoers
gzipping man pages under /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/share/man/
strip is /nix/store/cr415sky7bmrpyp63adqhaaslj83b15w-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/libexec  /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/bin  /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/sbin
patching script interpreter paths in /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26
checking for references to /build in /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26...
moving /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/sbin/* to /nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26/bin
/nix/store/9g2i6iccw3z5w7gpkfxmlkq9q27gn5mx-sudo-1.8.26


[Bug]: Teleporting to another world bugged this one !

/mv version -p output
https://j.mp/3r67hCP
Server logs
https://paste.gg/p/anonymous/f54c7e5b0d5142f09a11cb1b3ebdb981
Server Version
[18.11 20:35:06] [Server] [INFO] This server is running Mohist version 1.16.5-818 (MC: 1.16.5) (Implementing API version 1.16.5-R0.1-SNAPSHOT, Forge version 36.2.8)

Bug Description
When I teleport to a world on my list (no matter the type of world) I am tp in a parallel universe to the world I came from but bugged. For a flat world it is the same problem as before except that there is indeed a place which will be flat. Unfortunately this flat area is not accessible because I bug in the air.
Steps to reproduce

Start a server with the same version as that of my server, all multiverse plugins (core, inventory and portal) and the worldedit plugin.
Create a world using the / mv create command (try all types of worlds as not all of them work)
Use the command / mv tp (the name of the created world)

If the bug doesn't appear it's either I'm cursed or the world wants me to end my life (even though I wouldn't kill myself)
Agreements

[X] I have searched for and ensured there isn't already an open or resolved issue(s) regarding this.
[X] I was able to reproduce my issue on a freshly setup and up-to-date server with the latest version of Multiverse plugins with no other plugins and with no kinds of other server or client mods.

Multiverse doesnt support any bukkit on forge mods, these include magma, mohist, etc...


Error Message using requirejs

I am using sheetjs with requires and set the require configuration for sheetjs as described here. But I get an error message because sheetjs tries to load fs via require: "Error: Module name "fs" has not been loaded yet for context: _. Use require([])"
Nevertheless sheetjs is working but I needed to get rid of this message. I made a workaround by defining an empty object in the very beginning like so:
var disableRequire = {};
Then I replaced all ocurences of "typeof require" by "typeof disableRequire.require". This helps that require is never used in sheetjs. But it's of course a hack and not a proper solution.

Follow the demo and use the standalone bundles:
require.config({
	baseUrl: ".",
	name: "app",
	paths: {
		xlsx: "xlsx.full.min"
	}
});

You can also use "xlsx.mini.min" if you don't need XLS support


No ssh-agent delegation during clone

Description
During the TM clone (maybe also some others) operation, the OpenNebula's ssh-agent running on the front-end should is not delegated:
Mon Aug 24 12:35:30 2020 [Z0][VM][I]: New LCM state is PROLOG
Mon Aug 24 12:35:31 2020 [Z0][TM][I]: Command execution failed (exit code: 1): /var/lib/one/remotes/tm/ssh/clone opennebula-frontend-ssh:/var/lib/one//datastores/1/a3a646460dbf9e460f9d35417aa46de5 <IP_ADDRESS>:/var/lib/one//datastores/0/1/disk.0 1 1
Mon Aug 24 12:35:31 2020 [Z0][TM][I]: clone: Cloning opennebula-frontend-ssh:/var/lib/one//datastores/1/a3a646460dbf9e460f9d35417aa46de5 in /var/lib/one/datastores/0/1/disk.0
Mon Aug 24 12:35:31 2020 [Z0][TM][E]: clone: Command "scp -r opennebula-frontend-ssh:/var/lib/one//datastores/1/a3a646460dbf9e460f9d35417aa46de5 <IP_ADDRESS>:/var/lib/one//datastores/0/1/disk.0" failed: Warning: Permanently added '<IP_ADDRESS>' (ECDSA) to the list of known hosts.

I.e., the command should be scp -o ForwardAgent=yes ....
Details

Affected Component: TM drivers
Version: 5.12.0

Progress Status

[ ] Branch created
[ ] Code committed to development branch
[ ] Testing - QA
[ ] Documentation
[ ] Release notes - resolved issues, compatibility, known issues
[ ] Code committed to upstream release/hotfix branches
[ ] Documentation committed to upstream release/hotfix branches

Should be fixed by moving from scp to tar/ssh in #5058 .