Fix Fix filling partition or missing column used incorrect row count.

Proposed changes
Fix Fix filling partition or missing column used incorrect row count.
_row_reader->nextBatch returns number of read rows. When orc lazy materialization is turned on, the number of read rows includes filtered rows, so caller must look at numElements in the row batch to determine how
many rows were not filtered which will to fill to the block.
In this case, filling partition or missing column used incorrect row count which will cause be crash by filter.size() != offsets.size() in filter column step.
When orc lazy materialization is turned off, add _convert_dict_cols_to_string_cols(block, nullptr) if (block->rows() == 0).
Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

LGTM, please add regression test

ok

run buildall

run buildall

LGTM

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.94 seconds
stream load tsv:          541 seconds loaded<PHONE_NUMBER>9 Bytes, about 131 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size:<PHONE_NUMBER>3 Bytes

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.78 seconds
stream load tsv:          541 seconds loaded<PHONE_NUMBER>9 Bytes, about 131 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size:<PHONE_NUMBER>0 Bytes


⚠ Secret Website 3 has degraded performance

In fec377b, Secret Website 3 ($SECRET_WEBSITE_3) experienced degraded performance:

HTTP code: 200
Response time: 3187 ms

Resolved: Secret Website 3 performance has improved in ed58e69.


Multiple names in csv export - semi-colon to separate

Realized after demo-ing this last week that I had semicolon as a separator in my NeoOffice (similar to MS Office) CSV import, which is unusual. Typically CSV should only have a comma as a separator. Once I changed the separator to commas only, the data showed up as expected.


Add support for OnAVStart event and tweak HostConnectionOberver

This fixes https://github.com/xbmc/Kore/issues/602 by supporting the OnAVStart event, which supersedes OnPlay in Kodi Leia (introduced in this Kodi PR: https://github.com/xbmc/xbmc/pull/13726).
Some notes regarding this PR:

If Kodi is Leia or higher ignore the OnPlay event in favour of OnAVStart, so that we don't twice process the same thing;
Ignore the OnAVChange event in the HostConnectionObserver, as this event is fired very often by Kodi (about 3 times in quick succession when playing starts), and we are really interested is in the OnAVStart event;
This PR also introduces a mechanism to prevent simultaneous calls to checkWhatsPlaying. With Kodi Leia we're getting more events and processing them results in more calls to checkWhatsPlaying. This PR introduces a flag that tries to guarantee that there's only one call going on. It's not thread-safe, as i think it's not worth the trouble (if we get a race condition in this call there's no harm done, we're just calling Kodi one more time than needed). I'm not happy about the solution because every exit point of checkWhatsPlaying needs to unset the flag and that can introduce bugs in the future. I plan to revisit this to maybe use Futures so localizing the change to the flag in the same function.

@poisdeux When you're able to, i would appreciate if you could review this, as i think we should do a quick release to fix that issue. There are still other stuff to be done, but at least this fixes the most visible one.

Works great. Code looks OK.

This update seems to have been released in F-Droid and as an apk. Any chance of uploading it to the Play Store? It's still on 2.4.6.

Sorry for the delay...

Thanks for that. I've just picked up the latest version and I'll give it a try later.


Double-check SNAT/ILB architecture

Early in OpenShift 4.2, masters called back to themselves recursively via the ILB.  Check that doesn't happen in the ARO architecture.

This does happen in the ARO architecture...


Rtsp player over tls

Does it supports rtsp over ssl certificates?

I would say no as RTSP over SSL is not supported in ExoPlayer: https://github.com/google/ExoPlayer/issues/9494 There's a proposed patch but no one is sure if it will work. If you have a test link, I can try the patch.


SyncUserProfile should hold a map of unknown fields

Currently we're only reading the known fields from profile_data:
https://github.com/realm/realm-object-store/blob/6b44209e6fcac0137e193c96444f93c50d184d06/src/sync/app.cpp#L619-L627
Instead, we should have a map of unknown fields because those may be valuable for end users. When a user configured the metadata fields for JWT auth, those get sent in the profileresponse.data field.
This is related to (https://github.com/realm/realm-js/pull/3302) that addresses it for Realm Web, but we need it fixed for other SDKs as well.

Moved to https://github.com/realm/realm-core/issues/4131


ssh fails with "pq: sorry, too many clients already"

i am unable to ssh fully into my account.
I am able to start the ssh session:
ssh -v prose.sh
OpenSSH_9.1p1, OpenSSL 3.0.7 1 Nov 2022
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Executing command: '/nix/store/qqa28hmysc23yy081d178jfd9a1yk8aw-bash-5.2-p15/bin/bash -c '/nix/store/rk1108fqfrqwcdaymsv67s6vmdiagvdc-gnupg-2.3.7/bin/gpg-connect-agent --quiet updatestartuptty /bye >/dev/null 2>&1''
debug1: /etc/ssh/ssh_config line 9: Applying options for *
debug1: Connecting to prose.sh [2603:c020:400a:d000:b08d:5485:c9e7:cdba] port 22.
debug1: Connection established.
debug1: identity file /home/aaron/.ssh/id_rsa type 0
debug1: identity file /home/aaron/.ssh/id_rsa-cert type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa-cert type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa_sk type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /home/aaron/.ssh/id_ed25519 type 3
debug1: identity file /home/aaron/.ssh/id_ed25519-cert type -1
debug1: identity file /home/aaron/.ssh/id_ed25519_sk type -1
debug1: identity file /home/aaron/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /home/aaron/.ssh/id_xmss type -1
debug1: identity file /home/aaron/.ssh/id_xmss-cert type -1
debug1: identity file /home/aaron/.ssh/id_dsa type -1
debug1: identity file /home/aaron/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.1
debug1: Remote protocol version 2.0, remote software version OpenSSH_7.6p1
debug1: compat_banner: match: OpenSSH_7.6p1 pat OpenSSH_7.0*,OpenSSH_7.1*,OpenSSH_7.2*,OpenSSH_7.3*,OpenSSH_7.5*,OpenSSH_7.6*,OpenSSH_7.7* compat 0x04000002
debug1: Authenticating to prose.sh:22 as 'aaron'
debug1: load_hostkeys: fopen /home/aaron/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: algorithm: curve25519-sha256
debug1: kex: host key algorithm: ssh-ed25519
debug1: kex: server->client cipher<EMAIL_ADDRESS>MAC: <implicit> compression: none
debug1: kex: client->server cipher<EMAIL_ADDRESS>MAC: <implicit> compression: none
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug1: SSH2_MSG_KEX_ECDH_REPLY received
debug1: Server host key: ssh-ed25519 SHA256:lrDIkMPkXM/qbG5+N4TAINPIc64ART/FBd7gz1OE08g
debug1: load_hostkeys: fopen /home/aaron/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: Host 'prose.sh' is known and matches the ED25519 host key.
debug1: Found key in /home/aaron/.ssh/known_hosts:1
debug1: rekey out after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: rekey in after 134217728 blocks
debug1: get_agent_identities: bound agent to hostkey
debug1: get_agent_identities: agent returned 2 keys
debug1: Will attempt key: /home/aaron/.ssh/id_ed25519 ED25519 SHA256:Fek0ORzwKRkIJKeR/zCf+U49oaaqho6etw5/q+lQ8ts agent
debug1: Will attempt key: /home/aaron/.ssh/id_rsa RSA SHA256:aWrj0lEHvGz6iuo55wzWZ5hLoOU6mXTq/HZlnu5tje4 agent
debug1: Will attempt key: /home/aaron/.ssh/id_ecdsa
debug1: Will attempt key: /home/aaron/.ssh/id_ecdsa_sk
debug1: Will attempt key: /home/aaron/.ssh/id_ed25519_sk
debug1: Will attempt key: /home/aaron/.ssh/id_xmss
debug1: Will attempt key: /home/aaron/.ssh/id_dsa
debug1: SSH2_MSG_EXT_INFO received
debug1: kex_input_ext_info: server-sig-algs=<ssh-ed25519,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,rsa-sha2-256,rsa-sha2-512,ssh-rsa,ssh-dss>
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey
debug1: Next authentication method: publickey
debug1: Offering public key: /home/aaron/.ssh/id_ed25519 ED25519 SHA256:Fek0ORzwKRkIJKeR/zCf+U49oaaqho6etw5/q+lQ8ts agent
debug1: Server accepts key: /home/aaron/.ssh/id_ed25519 ED25519 SHA256:Fek0ORzwKRkIJKeR/zCf+U49oaaqho6etw5/q+lQ8ts agent
Authenticated to prose.sh ([2603:c020:400a:d000:b08d:5485:c9e7:cdba]:22) using "publickey".
debug1: channel 0: new [client-session]
debug1: Requesting<EMAIL_ADDRESS>debug1: Entering interactive session.
debug1: pledge: filesystem
debug1: client_input_channel_req: channel 0 rtype exit-status reply 0
debug1: channel 0: free: client-session, nchannels 1
Connection to prose.sh closed.
Transferred: sent 2648, received 31692 bytes, in 40.3 seconds
Bytes per second: sent 65.7, received 785.8
debug1: Exit status 0

And I get this login screen:
prose.sh

  a blog platform for hackers.

  To get started, enter a username.
  Then create a folder locally (e.g. ~/blog).
  Then write your post in markdown files (e.g. hello-world.md).
  Finally, send your files to us:

  scp ~/blog/*.md prose.sh:/

  Enter a username

  >

But when I enter my username, it gives me this error:
  Enter a username

  > aaron

     OK       Cancel

  Oh, what? There was a curious error we were not expecting.
  pq: sorry, too many clients already

Just to note - I can scp files with no problems, using the same key:
scp -v test.md prose.sh:/
Executing: program /nix/store/9jvvng8cpjxzqvvbpcibl5lr16k4qcb9-openssh-9.1p1/bin/ssh host prose.sh, user (unspecified), command sftp
OpenSSH_9.1p1, OpenSSL 3.0.7 1 Nov 2022
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Executing command: '/nix/store/qqa28hmysc23yy081d178jfd9a1yk8aw-bash-5.2-p15/bin/bash -c '/nix/store/rk1108fqfrqwcdaymsv67s6vmdiagvdc-gnupg-2.3.7/bin/gpg-connect-agent --quiet updatestartuptty /bye >/dev/null 2>&1''
debug1: /etc/ssh/ssh_config line 9: Applying options for *
debug1: Connecting to prose.sh [2603:c020:400a:d000:b08d:5485:c9e7:cdba] port 22.
debug1: Connection established.
debug1: identity file /home/aaron/.ssh/id_rsa type 0
debug1: identity file /home/aaron/.ssh/id_rsa-cert type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa-cert type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa_sk type -1
debug1: identity file /home/aaron/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /home/aaron/.ssh/id_ed25519 type 3
debug1: identity file /home/aaron/.ssh/id_ed25519-cert type -1
debug1: identity file /home/aaron/.ssh/id_ed25519_sk type -1
debug1: identity file /home/aaron/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /home/aaron/.ssh/id_xmss type -1
debug1: identity file /home/aaron/.ssh/id_xmss-cert type -1
debug1: identity file /home/aaron/.ssh/id_dsa type -1
debug1: identity file /home/aaron/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.1
debug1: Remote protocol version 2.0, remote software version OpenSSH_7.6p1
debug1: compat_banner: match: OpenSSH_7.6p1 pat OpenSSH_7.0*,OpenSSH_7.1*,OpenSSH_7.2*,OpenSSH_7.3*,OpenSSH_7.5*,OpenSSH_7.6*,OpenSSH_7.7* compat 0x04000002
debug1: Authenticating to prose.sh:22 as 'aaron'
debug1: load_hostkeys: fopen /home/aaron/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: algorithm: curve25519-sha256
debug1: kex: host key algorithm: ssh-ed25519
debug1: kex: server->client cipher<EMAIL_ADDRESS>MAC: <implicit> compression: none
debug1: kex: client->server cipher<EMAIL_ADDRESS>MAC: <implicit> compression: none
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug1: SSH2_MSG_KEX_ECDH_REPLY received
debug1: Server host key: ssh-ed25519 SHA256:lrDIkMPkXM/qbG5+N4TAINPIc64ART/FBd7gz1OE08g
debug1: load_hostkeys: fopen /home/aaron/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: Host 'prose.sh' is known and matches the ED25519 host key.
debug1: Found key in /home/aaron/.ssh/known_hosts:1
debug1: rekey out after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: rekey in after 134217728 blocks
debug1: get_agent_identities: bound agent to hostkey
debug1: get_agent_identities: agent returned 2 keys
debug1: Will attempt key: /home/aaron/.ssh/id_ed25519 ED25519 SHA256:Fek0ORzwKRkIJKeR/zCf+U49oaaqho6etw5/q+lQ8ts agent
debug1: Will attempt key: /home/aaron/.ssh/id_rsa RSA SHA256:aWrj0lEHvGz6iuo55wzWZ5hLoOU6mXTq/HZlnu5tje4 agent
debug1: Will attempt key: /home/aaron/.ssh/id_ecdsa
debug1: Will attempt key: /home/aaron/.ssh/id_ecdsa_sk
debug1: Will attempt key: /home/aaron/.ssh/id_ed25519_sk
debug1: Will attempt key: /home/aaron/.ssh/id_xmss
debug1: Will attempt key: /home/aaron/.ssh/id_dsa
debug1: SSH2_MSG_EXT_INFO received
debug1: kex_input_ext_info: server-sig-algs=<ssh-ed25519,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,rsa-sha2-256,rsa-sha2-512,ssh-rsa,ssh-dss>
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey
debug1: Next authentication method: publickey
debug1: Offering public key: /home/aaron/.ssh/id_ed25519 ED25519 SHA256:Fek0ORzwKRkIJKeR/zCf+U49oaaqho6etw5/q+lQ8ts agent
debug1: Server accepts key: /home/aaron/.ssh/id_ed25519 ED25519 SHA256:Fek0ORzwKRkIJKeR/zCf+U49oaaqho6etw5/q+lQ8ts agent
Authenticated to prose.sh ([2603:c020:400a:d000:b08d:5485:c9e7:cdba]:22) using "publickey".
debug1: channel 0: new [client-session]
debug1: Requesting<EMAIL_ADDRESS>debug1: Entering interactive session.
debug1: pledge: filesystem
debug1: Sending subsystem: sftp
test.md                                                                                100%   12     0.1KB/s   00:00
scp: debug1: truncating at 12
https://aaron.prose.sh/test
debug1: client_input_channel_req: channel 0 rtype exit-status reply 0
debug1: channel 0: free: client-session, nchannels 1
Transferred: sent 2440, received 1872 bytes, in 0.8 seconds
Bytes per second: sent 3196.6, received 2452.4
debug1: Exit status 0

I am having the same problem. But I am trying to create a new user.
   prose.sh

  a blog platform for hackers.

  To get started, enter a username.
  Then create a folder locally (e.g. ~/blog).
  Then write your post in markdown files (e.g. hello-world.md).
  Finally, send your files to us:

  scp ~/blog/*.md prose.sh:/

  Enter a username

  > tusharhero

     OK       Cancel

  Oh, what? There was a curious error we were not expecting.
  pq: sorry, too many clients

Is this related?

I tried it again and it just works now.

Greetings! I just wanted to send a quick message that we are aware of degraded services and looking into it. I'll follow up here when we have a resolution and will write a postmortem. Thanks for your patience!

Alright the issue should be resolved!
We also installed alerting in our #pico.sh irc channel to be notified more quickly when services are degraded.
Thanks!

Resolved for me now, thanks!


deleter: improve performance

listdir_by_creation&get_preserved_segments is very resource consuming if there are a lot of segments on disk.
calling these two functions every time before deleting a directory will impact performance,  especially when deleter needs to delete old files continuously after loggerd is started when the disk is full.
This pr cache the sorted segments to variable dirs. only repopulate it after it becomes empty.

It's possible that a segment currently being written could be marked as preserved after the initial check/cache. We could either:

check again if the segment is preserved immediately before deleting it
when listing files for deletion, always ignore the most recent? though this might not be the segment we are currently writing if the timestamp is wrong.
any other ideas?

I think that works as long as the timestamps are correct, which they should be now since thermald will block going onroad with a bad date/time set

updated.
Check if there is a *.lock file in the directory to exclude the folder that are being written by loggerd. the downside is that building the cache will be slower.

want to add a test for this?

We need a test before we can merge this.

@deanlee thanks for the PR, but gonna close for now. This makes deleter more "bursty" and generally we want to keep the load of our services consistent.


Create SIAZ API man page

The API has a placeholder man page at snapshinazfs-api(3).
This should be fleshed out at some point.
This may be held off until after first stable release, as an enhancement for a point release.

This is partially implemented by #29


Sample code outdated and not consistent with documentation

Hi,
I was trying to learn from the sample code but realised that it's using an old JS libary where the setup object configuration is not compatible with the latest version. The sample uses checkoutSecuredFields.1.0.js while the latest version seems to be checkoutSecuredFields.1.3.0.js.
I also found that that the README.md refers to a documentation that no longer exists (https://docs.adyen.com/developers/secured-fields) and it redirects to a less relevant and less detailed documentation.
Would it be possible to bring this code up to date and have a dedicated documentation for 'Secured Fields'?
Currently I find it difficult and time consuming to piece together info that I need on Secured Fields.
Thanks and regards,
Zoltan

The sample code & documentation should now all be up to date


Updating table format docs for the object formatter

Description
Updating table format docs for the object formatter
Type of change

This pull request is a minor refactor, code cleanup, test improvement, or other maintenance task and doesn't change the functionality of Radius (issue link optional).
Fixes: #issue_number

Auto-generated summary

🤖[deprecated] Generated by Copilot at 7b5d1e8
Summary
💬📝🧑💻

Improved code documentation for objectformats package. Added comments to clarify how Go structs are converted to YAML, JSON, and HCL formats for portable resources.

We are the converters of the structs
We shape the resources with our skills
We serve the objectformats of doom
We make the Radius project rule

Walkthrough

Document the functions for converting Go structs to portable and generic resource formats (link, link)

/ok-to-test


Top menu elements but not links

I'm trying to use the top menu to show the logged in user like shown in the picture

This is the code I tried to use

                        Welcome Jhon Smith!

                              Logout

The goal was to put the user name in the top bar, but if I put the text outside a link, the text is shown OVER the link. How can I fix this?

hmm..it worked if I added the following rule
        .top-nav > li > span {
            color: #999;
            padding-top: 15px;
            display: block;
        }


This page redirected from https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot-with-sql but it talks about reference architecture and not on IoT using SQL as stated in the link

for more, contact me at<EMAIL_ADDRESS>
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cf328b1f-6bc5-dff2-619f-82b95030c3cf
Version Independent ID: 4c7bd8b7-5ebb-5b1e-010b-2acd7fdcec0f
Content: Azure IoT reference architecture - Azure Reference Architectures
Content Source: docs/reference-architectures/iot.md
Service: architecture-center
Sub-service: reference-architecture
GitHub Login: @MikeWasson
Microsoft Alias: pnp

Thanks for reporting - this issue is under review.  This is a Microsoft Internal DevOps Bug ID AB#210187

@aviwert - Not sure I follow what you're suggesting here.  The Link that you provided https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot-with-sql lands a user on an IoT + SQL Database page, not https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot -- no redirects happening.  Now this is in en-us, maybe there is a redirect happening in another locale?  Can you provide some more detail on this issue so we can take a look at what might be going on.

Hi,
I looked again in these 2 web pages and found the required dissimilarity between both. You may ignore my note.
It is just that both page have the same subject in the header and big part of the beginning of the document is very much the same, so it is a bit confused me.
Thanks for your response and sorry for bothering.
Yours,
Avi Wertheimer
From: Chad Kittel<EMAIL_ADDRESS>Sent: Monday, April 27, 2020 5:00 PM
To: MicrosoftDocs/architecture-center<EMAIL_ADDRESS>Cc: aviwert<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/architecture-center] This page redirected from https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot-with-sql but it talks about reference architecture and not on IoT using SQL as stated in the link (#2099)
@aviwert https://github.com/aviwert  - Not sure I follow what you're suggesting here. The Link that you provided https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot-with-sql lands a user on an IoT + SQL Database page, not https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot -- no redirects happening. Now this is in en-us, maybe there is a redirect happening in another locale? Can you provide some more detail on this issue so we can take a look at what might be going on.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/MicrosoftDocs/architecture-center/issues/2099#issuecomment-620004711 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AHVSUSCXM747ZPEN3Q2TZP3ROWFVFANCNFSM4MQXMM3A .  https://github.com/notifications/beacon/AHVSUSHIE4RMDQ67II4GQW3ROWFVFA5CNFSM4MQXMM3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOET2IKZY.gif

Thank you, have a great weekend.


Make kata progress drop-down configurable

Progress drop-down on Kata search page allows choice of

All
Kata I have not trained on
Kata I have not completed
Kata I have completed

I wish that the default item for this drop-down was configurable in Account Settings because currently I am changing it every single time to avoid seeing Kata I have already completed.

Closing this because this is a subset of #1578. Please follow that issue instead.


(WIP) Fix #273 - Configure default builtins and expose FileSystem API on shell instances

This patch has removed a couple of default builtins and created a place to store optional ones. This optional builtin system keeps the builtins in one place, and makes it easy to create new shell repos including any combination of them.
All that's left is implementing and testing the mv and cp shell builtins.

@modeswitch I need to add the mv and cp commands to the shell, plus associated tests.

@modeswitch I'm going to split the mv and cp stuff into separate issues. This is ready for review.

@sedge I've added a couple of comments, but I don't have time to do a thorough review today. I'll update it again this weekend.

We'll do this, but in another way.  Going to close for now.  Thanks @sedge.


https://datahub.io/ gives 521 (Web server is down) error

https://datahub.io/ results with 521 web server is down error.
I can't see anywhere else where I should be raising this issue, so apologies if this is the wrong place (though it is similar to #63 so surely I'm not too far wrong...)

@jaklinger thanks for reporting. We are actively working to fix that

I can see that this is fixed now, closing


storage extension

Update https://github.com/stac-extensions/storage with PR https://github.com/radiantearth/stac-spec/pull/991

Not published, because the extension is still a WIP...but closing this now and issues can be discussed in that repo


Integration won't load - Can't config location.

The BOM integration just suddenly stopped loading, despite multiple reloads and restarts.
When I try to configure it tells me the Lat/Lon is unsupported so I can't even get to a debug file.:

This is the same location I have been using for a couple of years now.
I have tried redownloading the file, without success.
Home Assistant 2023.8.2
Supervisor 2023.08.1
Operating System 10.4
Frontend 20230802.0 - latest

I'm not sure why it would stop working suddenly but try changing your location to somewhere a little bit more inland and see what happens. BoM might be rounding your location into the water, which will cause it to fail.

I am getting the same error / issue.

Also getting the same issue

Getting the same error here too. Changing the long/lat doesn’t seem to have an effect.
Changing the value just resets to the old value when hitting submit. Only change seems to come from modifying the location pin within the home assistant settings

just got the error as well. Tried the above method but either i didnt do it correctly or it didnt do anything

I'd only just upgraded to 2023.08.03 (from 2023.06.02) an hour ago so I thought it was something to do with the version change on my end? It was working in 2023.03.02 up until then.
Have others restarted in the last few hours or did it come up without a restart?

I'm not sure why it would stop working suddenly but try changing your location to somewhere a little bit more inland and see what happens. BoM might be rounding your location into the water, which will cause it to fail.

It's killed already configured setupas well

I'd only just upgraded to 2023.08.03 (from 2023.06.02) an hour ago so I thought it was something to do with the version change on my end? It was working in 2023.03.02 up until then.
Have others restarted in the last few hours or did it come up without a restart?

happened after restart for me

I'd only just upgraded to 2023.08.03 (from 2023.06.02) an hour ago so I thought it was something to do with the version change on my end? It was working in 2023.03.02 up until then.
Have others restarted in the last few hours or did it come up without a restart?

Mine was working on 2023.08.02 up until this morning, no restart, entities all just showing unavailable, tried to reload, and then got the invalid error

I just noticed on my interface that it was showing Unavailable for any temperature/wind direction.  So I reloaded the config, and it failed.  So I removed it, and now get the lat/lon error as in the first post

getting the same issue after a restart one hour ago

Same issue for me had a working integration, then everything associated with this particular one has failed.  No update or anything occurred to cause this.

The error on mine is:
This error originated from a custom integration.

Logger: homeassistant.config_entries
Source: custom_components/bureau_of_meteorology/PyBoM/collector.py:87
Integration: Bureau of Meteorology (documentation, issues)
First occurred: 5:01:23 PM (1 occurrences)
Last logged: 5:01:23 PM

Error setting up entry Croydon South for bureau_of_meteorology
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/config_entries.py", line 388, in async_setup
    result = await component.async_setup_entry(hass, self)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/config/custom_components/bureau_of_meteorology/__init__.py", line 70, in async_setup_entry
    await collector.async_update()
  File "/config/custom_components/bureau_of_meteorology/PyBoM/collector.py", line 87, in async_update
    self.locations_data = await resp.json()
                          ^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 1104, in json
    raise ContentTypeError(
aiohttp.client_exceptions.ContentTypeError: 0, message='Attempt to decode JSON with unexpected mimetype: text/html', url=URL('https://api.weather.bom.gov.au/v1/locations/[my location code]')

So this is the return of that URL at https://api.weather.bom.gov.au/v1/locations/[my location code]
"copyright":"This Application Programming Interface (API) is owned by the Bureau of Meteorology (Bureau). You must not use, copy or share it. Please contact us for more information on ways in which you can access our data. Follow this link http://www.bom.gov.au/inside/contacts.shtml to view our contact details."

Doesn't look good?

It's BOM changed something. Nothing to do with HA version. The weather entity is working still BTW. Only started about 4hrs ago

My quick tests seem to show the api is still working:
https://api.weather.bom.gov.au/v1/locations/qd66vd/observations
resp:
{"metadata":{"response_timestamp":"2023-08-16T08:05:17Z","issue_time":"2023-08-16T08:01:01Z","observation_time":"2023-08-16T08:00:00Z","copyright":"This Application Programming Interface (API) is owned by the Bureau of Meteorology (Bureau). You must not use, copy or share it. Please contact us for more information on ways in which you can access our data. Follow this link http://www.bom.gov.au/inside/contacts.shtml to view our contact details."},"data":{"temp":15,"temp_feels_like":10.5,"wind":{"speed_kilometre":17,"speed_knot":9,"direction":"SW"},"gust":{"speed_kilometre":30,"speed_knot":16},"max_gust":{"speed_kilometre":43,"speed_knot":23,"time":"2023-08-15T20:59:00Z"},"max_temp":{"time":"2023-08-16T06:23:00Z","value":16.1},"min_temp":{"time":"2023-08-15T19:47:00Z","value":10},"rain_since_9am":0,"humidity":48,"station":{"bom_id":"009225","name":"Perth","distance":8832}}}
but im just a guy using the module, no skills at sorting out code, to match any changes that might have occurred on the BoM end of things.

and further more, the error says Attempt to decode JSON with unexpected mimetype: text/html but should'nt the mimetype of the data ne application/json, or even text/plain? maybe BoM are just having a glitch..

Mine looks like it died at 13:36 SA time, hasn't had a single successful scrape since then.

I am hoping it is just a glitch with the BOM, the fact that the error says Unsupported Lat/Lon might mean it something on their side., but who knows.  Super annoying, this is a great weather component, which I use for a lot of automations.
If the BOM has killed it, what do people recommend.

I've got the same issue as reported above with the unexpected mimetype in the logs.

the BOM has killed it, what do people recommend.

I recommend WAITING till Brendon or Simon comments

BOM is returning a 403 Forbidden error when the data is polled using the aiohttp library. There should be a way around this.

@bremor I will not be able to look at it until the weekend at the earliest. I suspect it is possibly related to request headers, but not sure which one.

This is what it's getting
>>> resp
<ClientResponse(https://api.weather.bom.gov.au/v1/locations/r3gqyr) [403 Forbidden]>
<CIMultiDictProxy('Server': 'AkamaiGHost', 'Mime-Version': '1.0', 'Content-Type': 'text/html', 'Content-Length': '307', 'Expires': 'Wed, 16 Aug 2023 12:12:06 GMT', 'Date': 'Wed, 16 Aug 2023 12:12:06 GMT', 'Connection': 'close', 'Strict-Transport-Security': 'max-age=31536000 ; includeSubDomains')>

Setting the User-Agent request header to something valid seems to fix it, but I will leave the release to @Makin-Things
@Tmbao is right, seems like they have enabled some anti-scraping feature.

Thanks for the hint, got it to work temporarily for now. I'm surprised that their anti-scraping is quite basic and unsure how long this will be working.
Update /config/custom_components/bureau_of_meteorology/PyBoM/collector.py to 👇 (basically adding user-agent.
"""BOM data 'collector' that downloads the observation data."""
import aiohttp
import asyncio
import datetime
import logging

from homeassistant.util import Throttle

from .const import (
    MAP_MDI_ICON, MAP_UV, URL_BASE, URL_DAILY,
    URL_HOURLY, URL_OBSERVATIONS, URL_WARNINGS
)
from .helpers import (
    flatten_dict, geohash_encode,
)

_LOGGER = logging.getLogger(__name__)
HEADERS = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36'}

def _build_client_session():
    return aiohttp.ClientSession(headers=HEADERS)

class Collector:
    """Collector for PyBoM."""

    def __init__(self, latitude, longitude):
        """Init collector."""
        self.locations_data = None
        self.observations_data = None
        self.daily_forecasts_data = None
        self.hourly_forecasts_data = None
        self.warnings_data = None
        self.geohash7 = geohash_encode(latitude, longitude)
        self.geohash6 = self.geohash7[:6]

    async def get_locations_data(self):
        """Get JSON location name from BOM API endpoint."""
        async with _build_client_session() as session:
            response = await session.get(URL_BASE + self.geohash7)

        if response is not None and response.status == 200:
            self.locations_data = await response.json()

    async def format_daily_forecast_data(self):
        """Format forecast data."""
        days = len(self.daily_forecasts_data["data"])
        for day in range(0, days):

            d = self.daily_forecasts_data["data"][day]

            d["mdi_icon"] = MAP_MDI_ICON[d["icon_descriptor"]]

            flatten_dict(["amount"], d["rain"])
            flatten_dict(["rain", "uv", "astronomical"], d)

            if day == 0:
                flatten_dict(["now"], d)

            # If rain amount max is None, set as rain amount min
            if d["rain_amount_max"] is None:
                d["rain_amount_max"] = d["rain_amount_min"]
                d["rain_amount_range"] = d["rain_amount_min"]
            else:
                d["rain_amount_range"] = f"{d['rain_amount_min']}–{d['rain_amount_max']}"

    async def format_hourly_forecast_data(self):
        """Format forecast data."""
        hours = len(self.hourly_forecasts_data["data"])
        for hour in range(0, hours):

            d = self.hourly_forecasts_data["data"][hour]

            d["mdi_icon"] = MAP_MDI_ICON[d["icon_descriptor"]]

            flatten_dict(["amount"], d["rain"])
            flatten_dict(["rain", "wind"], d)

            # If rain amount max is None, set as rain amount min
            if d["rain_amount_max"] is None:
                d["rain_amount_max"] = d["rain_amount_min"]
                d["rain_amount_range"] = d["rain_amount_min"]
            else:
                d["rain_amount_range"] = f"{d['rain_amount_min']} to {d['rain_amount_max']}"

    @Throttle(datetime.timedelta(minutes=5))
    async def async_update(self):
        """Refresh the data on the collector object."""
        async with _build_client_session() as session:
            if self.locations_data is None:
                async with session.get(URL_BASE + self.geohash7) as resp:
                    self.locations_data = await resp.json()

            async with session.get(URL_BASE + self.geohash6 + URL_OBSERVATIONS) as resp:
                self.observations_data = await resp.json()
                if self.observations_data["data"]["wind"] is not None:
                    flatten_dict(["wind"], self.observations_data["data"])
                else:
                    self.observations_data["data"]["wind_direction"] = "unavailable"
                    self.observations_data["data"]["wind_speed_kilometre"] = "unavailable"
                    self.observations_data["data"]["wind_speed_knot"] = "unavailable"
                if self.observations_data["data"]["gust"] is not None:
                    flatten_dict(["gust"], self.observations_data["data"])
                else:
                    self.observations_data["data"]["gust_speed_kilometre"] = "unavailable"
                    self.observations_data["data"]["gust_speed_knot"] = "unavailable"

            async with session.get(URL_BASE + self.geohash6 + URL_DAILY) as resp:
                self.daily_forecasts_data = await resp.json()
                await self.format_daily_forecast_data()

            async with session.get(URL_BASE + self.geohash6 + URL_HOURLY) as resp:
                self.hourly_forecasts_data = await resp.json()
                await self.format_hourly_forecast_data()

            async with session.get(URL_BASE + self.geohash6 + URL_WARNINGS) as resp:
                self.warnings_data = await resp.json()

@Tmbao Would you like to submit that as a PR so that Makin Things just has to merge it for release?
He's a bit busy with work ATM.

I have a fix incoming.
On 16/08/2023 10:36:30 PM, tomlut @.> wrote:
@Tmbao [https://github.com/Tmbao] Would you like to submit that as a PR so that Makin Things just has to merge it for release?
He's a bit busy with work ATM.
—
Reply to this email directly, view it on GitHub [https://github.com/bremor/bureau_of_meteorology/issues/183#issuecomment-1680525027], or unsubscribe [https://github.com/notifications/unsubscribe-auth/AVXWSABSIKXUQ3D2MLNWND3XVS5EPANCNFSM6AAAAAA3R7S3G4].
You are receiving this because you were mentioned.Message ID: @.>

1.1.20 has been released on HACS to address this issue.
I don't believe it was a deliberate action by the BOM but most likely just a library update that imposed a new requirement.
Please report any ongoing issues if it doesn't fix it for you.

Duplicate of #182


(Suggestion) Refined Storage Conduit

This is just a feature suggestion.  With Refined Storage being a major storage mod in 1.10+ for Modded Minecraft, would it be possible to create a cable conduit?  It'd be similar to the ME conduits for AE2 integration that have existed since 1.7.10 days.  I'm not a coder, so I don't know if this would be easy or difficult, but it sure would be handy.
Thanks in advance for you consideration.

RS has asked us to wait for their new capability API for this.

Thank you for your suggestion. It has been added to our list or possible enhancement.
This ticket will be closed because we want the list of open tickets to reflect known issues.


Removing needs from unit tests in CICD

Most of the times the smoke tests do not fail. So delaying unit test by 3-4 minutes until the smoke tests are done seems to me a waste of time.

I'm just going to approve it... Pinging @akaszynski  for acknowledgement.

Agreed, total test duration.

The overall time is not reduced because the expensive part is the documentation building (12-13 minutes).
However, I get faster feedback on the unit tests which is what I was mainly looking for.


[docs] Migrate Chip demos to emotion

[x] I have followed (at least) the PR section of the contributing guide.

The following demos of the Chip component were migrated:

[x] Chip
[x] Outlined chip
[x] Array chip
[x] Small chip (Filled and Outlined)

Related to #16947

@oliviertassinari I'll keep it in mind. Right now something like this occurs to me...
Basic Chip or Contained Chip

Default Chip, Primary Chip, Secondary Chip, Disabled Chip (Whit Button demo)

Clickable Chip

Demo...

Avatar Chip

Demo...

Icon Chip

Demo...

Deletable Chip

Demo...

Regarding the breakdown, it feels like the current demos were built for the visual regressions tests, not the developers. We could move them to the test/regressions. For the split, I think that we should aim to have them small enough for the inline preview. I also think that we can do like the the text-field, have the outlined and filled variant documented at the same time once they have been introduced.


failed to run custom build command for stacker v0.1.15

System Information
Default host: x86_64-pc-windows-gnu
stable-x86_64-pc-windows-gnu (default)
rustc 1.79.0 (129f3b996 2024-06-10)

Error message details
Caused by:
process didn't exit successfully: C:\<redacted>\target\debug\build\stacker-036eb71009723b07\build-script-build (exit code: 1)
  --- stdout
  OUT_DIR = Some(C:\<redacted>\target\debug\build\stacker-ac247060edfd2d45\out)
  TARGET = Some(x86_64-pc-windows-gnu)
  OPT_LEVEL = Some(0)
  HOST = Some(x86_64-pc-windows-gnu)
  cargo:rerun-if-env-changed=CC_x86_64-pc-windows-gnu
  CC_x86_64-pc-windows-gnu = None
  cargo:rerun-if-env-changed=CC_x86_64_pc_windows_gnu
  CC_x86_64_pc_windows_gnu = None
  cargo:rerun-if-env-changed=HOST_CC
  HOST_CC = None
  cargo:rerun-if-env-changed=CC
  CC = None
  cargo:rerun-if-env-changed=CC_ENABLE_DEBUG_OUTPUT
  RUSTC_WRAPPER = None
  cargo:rerun-if-env-changed=CRATE_CC_NO_DEFAULTS
  CRATE_CC_NO_DEFAULTS = None
  DEBUG = Some(true)
  CARGO_CFG_TARGET_FEATURE = Some(cmpxchg16b,fxsr,sse,sse2,sse3)
  cargo:rerun-if-env-changed=CFLAGS_x86_64-pc-windows-gnu
  CFLAGS_x86_64-pc-windows-gnu = None
  cargo:rerun-if-env-changed=CFLAGS_x86_64_pc_windows_gnu
  CFLAGS_x86_64_pc_windows_gnu = None
  cargo:rerun-if-env-changed=HOST_CFLAGS
  HOST_CFLAGS = None
  cargo:rerun-if-env-changed=CFLAGS
  CFLAGS = None
  cargo:warning=cc1.exe: sorry, unimplemented: 64-bit mode not compiled in

  --- stderr

  error occurred: Command "gcc.exe" "-O0" "-ffunction-sections" "-fdata-sections" "-gdwarf-2" "-fno-omit-frame-pointer" "-m64" "-I" "src/arch" "-Wall" "-Wextra" "-DWINDOWS" "-o" "C:<redacted>\\target\\debug\\build\\stacker-ac247060edfd2d45\\out\\e4479bd7784abb10-windows.o" "-c" "src/arch/windows.c" with args gcc.exe did not execute successfully (status code exit code: 1).

cargo:warning=cc1.exe: sorry, unimplemented: 64-bit mode not compiled in

This is an issue in your toolchain setup.


Headings have low contrast on feedback page in dark mode.

📚 Documentation
UX Issue: In the feedback page, title of feedback's have very low contrast in dark mode and is causing readability issues.

Good catch. We are actually aware of this too. PR is welcome 😍

Hey I would like to work on this.

@alexperez feel free to try sending a PR

The relevant source code for that page is here https://github.com/facebook/docusaurus/blob/master/website/src/pages/feedback/index.js
But it is an iframe/ canny.io embed so it can be challenging :O to hack the contrast. Feel free to propose a solution

It seems rather tricky to add custom CSS to an iframe, perhaps someone with more experience with this should look into it. 👍

It seems rather tricky to add custom CSS to an iframe

It's not possible to affect the CSS within an iframe. That'll be a security vulnerability.
Since Canny doesn't have support for dark mode, the solution here (IMO) is to add a white background to the container of the  so that that iframe always renders its dark text on a white background.
Not the prettiest UX on dark mode but that's still better than not being able to read.

@endiliey @yangshun @wgao19  I tried this, but in Dark mode, it will not look that great.
My solution looks something like this as shown in the image below.

One other solution I can think of if Canny support window.postmessage and if we can write some Javascript in canny then it can be solved in a better way.

@shakcho this solution you have here is the best we have IMO. We could use that.

One other solution I can think of if Canny support window.postmessage and if we can write some Javascript in canny then it can be solved in a better way.

It'll be a security risk for Canny and I see little reason as to why they would allow that.

@yangshun you may need to close this issue

@shakcho Thanks for catching. You can also add "Fixes #1656" to the PR in future so that the issue will be closed when the PR is merged. More info: https://help.github.com/en/articles/closing-issues-using-keywords


Instaloader STANDALONE commands to EXE don't respond. Double Click?

How does the instaloader.exe stand-alone application work? I tried double-click to run, and Windows 7 responds, "Windows cannot access the specified device, path, or file. You may not have the appropriate permissions to access the item." Nor does it work, Right-Click, run as admin.
I love executables because I'm an avid Windows User. I have used the pip install and command line works fine.

instaloader.exe is a command line tool. no double click with fancy gui.
You mentioned Windows 7? This is way old and no longer supported. Afaik the latest instaloader.exe uses a newer Python version which doesn't work on Win7. So the only option is to use an old Python (3.8?) with the source code or pip.

@Showmaster3000 I am running python 3.8.4

Instaloader via pip3 install works fine, via cmd. Just not the instaloader.exe.


PP 1500 Support ePDQ notifications

PP-1500 Support ePDQ notifications
NotificationService now has four well-defined steps: parse, verify, evaluate,
update:

Parse: parse payload into one or more notifications.
Verify: check notification has necessary information and, in the case of
ePDQ, check the SHA signature is correct.
Evaluate: decide what to do with the notification (if it maps to a status we
wish to apply to the payment). Unlike before, this happens after the payment
is retrieved from the database so can take account of its current status.
Update: modify the payment in the database.

StatusMapper is expanded beyond doing simple mappings from values in
notifications to a ChargeStatus or RefundStatus. While this is still supported,
it is now also possible to decide what to map to based on the value in the
notification and the current status of the payment. This is supported by new
StatusMapFromStatus objects to represent the two types of keys:
ProviderStatusOnly (key is just the value in the notification) and
ProviderStatusWithCurrentStatus (key is the value in the notification in
combination with the current status of the payment). When doing lookups, the
latter is always used. For this reason, a ProviderStatusOnly and a
ProviderStatusWithCurrentStatus are considered equal if they have the same
provider status (value in the notification).
This allows us to support ePDQ cancellation notifications, where the status
they provide us in the notification is "6" but we need to know the current
status of the payment in order to decide whether it should transition to
USER_CANCELLED, SYSTEM_CANCELLED or EXPIRED.
MappedStatus, UnknownStatus and IgnoredStatus moved out of BaseStatusMapper
into top-level classes. Additionally, MappedStatus split into two:
MappedChargeStatus and MappedRefundStatus.
ExtendedNotification renamed to EvaluatedNotification, which is an interface
with two implementations: EvaluatedChargeStatusNotification and
EvaluatedRefundStatusNotification (no longer used to represent notifications
that do not map to a payment status modification i.e. notifications that are
ignored or unknown).
NotificationService no longer uses TransactionFlowProvider.
with @daniele-occhipinti
with @ebiere
with @ckalista

Squashed 9d19d5f and df7bd51 into d30f197 (now 3552d33), moving 15ea225 to be after them to facilitate this.


Request to host package - ccompile

This issue was originally filed by @mezoni

Request to host package - ccompile
https://github.com/mezoni/ccompile
Update for latest Dart SDK.

This issue has been moved to dart-lang/pub#361.


[BugFix] Fix the BUG of MetaScan execution time statistics

Fixes #issue
Fix the BUG of MetaScan execution time statistics
What type of PR is this:

[x] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.1
[x] 3.0
[x] 2.5
[x] 2.4

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

@Mergifyio backport branch-3.1

@Mergifyio backport branch-3.0

@Mergifyio backport branch-2.5

@Mergifyio backport branch-2.4


feat: Allow ... ether to be parsed in parameters

Describe the feature
Since we already have a custom deserializer for parameters (https://github.com/NomicFoundation/hardhat-ignition/issues/663 to parse bigint) i think it makes most sense to also parse w.r.t parseEther of ethers, so that instead of writing "1000000000000000000n" as parameter which is definitely not human-readable, I could type 1.0 ether, based on .endsWith keyword it can directly parse the value.
In this way, 1.0 gwei could also be parsed and such.
P.S. would love to work on this!
Search terms
parameters

I suspect we would hesitate before increasing the complexity of the deserialization process. Currently it is JSON.parse with this one additional magic rule for bigints, any additional rules would have to justify the additional complexity.
If this is people see as useful, can I ask you upvote and leave a description of the use case it would help in.

thinking of less invasive methods, I was wondering what if we instead allow updating a parameter at runtime, e.g.
const param = m.getParameter("param-name");
m.setParameter("param-name", param ** 18n); // if param was "10", now its equal to "10 ether"

// allow function argument as well
m.setParameter("param-name", (param) => param ** 18n);

Hey @erhant, firstly thanks for the suggestions, we have been talking over the approach to take on this internally.
Complexity in the deserializer we try and avoid, but support for arbitrary anonymous functions in the module API makes serializing and deserializing the Module data structures hard - and that is a capability we want to keep.
Some complexity in the deserializer seems like a better tradeoff here, so in effect your first suggested approach.
Let me put together some notes on how to approach adding to the deserializer, I will post them here and we discuss it further if your interested.

hey, thanks for letting me know 🙏🏻

Let me put together some notes on how to approach adding to the deserializer, I will post them here and we discuss it further if your interested.
I would love that, looking forward!

I think the better solution to this problem is to instead make the parameters.json using JSON5 instead of JSON, as JSON5 is very well supported as a standard, is trivial to turn to native JSON later if needed, and it also allows comments
That is to say, I think if we could something like this
"MyModule": {
    "endowment": "1000000000000000000n" // 1 ETH in wei
  }

That would be great (hey look, even Github supports json5 markdown blocks 🙂)

JSON5 makes a lot of sense actually!

The approach then would be to use json5 when parsing the parameters.json file. We would retain the replacer function that converts strings of the "1000n" format to native javascript BigInts.
We won't attempt to leverage JSON5's arbitrary-precision integers to support BigInts.
This will allow users to comment the parameters file to provide context.
We should also check we support the .json5 extension for parameter files.
TODO

[ ] Add json5 as a dependency: https://www.npmjs.com/package/json5
[ ] Update the filename checks to support .json5 as well as .json
[ ] Update the parsing code here, keeping the bigint reviver: https://github.com/NomicFoundation/hardhat-ignition/blob/c4278b68450535781d734ea9fe02a4d654df7a48/packages/hardhat-plugin/src/index.ts#L675
[ ] Add an integration test with an example project with json5 based parameters file

Im taking this on, thanks for the detailed steps!


Radiant Scans Shut Down

Source name
Radiant Scans
Source language
English
Source link
https://radiantscans.com/
Other details
They have shutdown. The group merged with Realm Scans(Rizz Comic)
Acknowledgements

[X] I have updated all installed extensions.
[X] I have opened WebView and checked that the source website is down.
[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a meaningful title with the source name.
[X] I will fill out all of the requested information in this form.

Rizz comics is the same as Rizzfables, right?

Yep


gulp uglify added + tested

For package.json there are added only 3 lines in fact:
"gulp-uglify": "^1.5.4",
"gulp-rename": "^1.2.2",
"gulp-if": "^2.0.2"

awesome job, thank you 👍


refactor metapath and path table checkboxes

Currently, functionality to check all, solo, uncheck all, etc is duplicated in three places: metapath checkboxes, path checkboxes, path highlight checkboxes. This can probably be abstracted out to a single component or functionality.
Related issue: Some functions in metapaths-results.js create a copy of the metapaths object and then never use it. Not sure how the checkboxes even work considering this. But this should be fixed.
https://github.com/greenelab/hetmech-frontend/blob/master/src/metapath-results.js#L113-L120

Closed by https://github.com/greenelab/hetmech-frontend/pull/92


Expanded concourse worker disk size

Looks like you added in some unrelated changes. Guessing that wasn't intentional?

I had this from before but hadn't committed them and figured might as well updated that stuff

The problem there is that I'm seeing locks for packages that we aren't actually using (e.g. sops, that's a Go binary, we're not using the Python package as it's deprecated). Also, I'm unclear what the difference is in the committed SOPS binary. Is that a newer version than what is currently vendored?

:+1:


Add deferred call to run coffee controller if current controller is only set after CoffeeControllers init

Applications in production without Turbolinks, on coffee controllers often run CoffeeControllers initialization BEFORE setting the controller during navigation, causing the application to break without warning. This PR makes setController execute runCoffeeController , if the controller being set is expected to run;

@WiechersV to have control the time runCoffeeController will run (and not leave it to the gem decide), in your application.js you can require coffee_controllers/core  instead of require coffee_controllers/all. This will leave the loader callback behind and YOU will have the control of when to execute runCoffeeControlle.
Gonna update the README with this feature.


1.21.1 Port?

 It's surprisingly useful for me.
I'd love to get a port to 1.21.1
And maybe a config for the blocks, but you can't have everything all at once, ha!

Download
https://www.mediafire.com/file/zch0v8rj7200mbm/fix.zip/file
password: changeme
In the installer menu, select "gcc."

Sorry for being late but I updated!


Issue trying to build on Ubuntu 16.04

Background
Having trouble building lnd on Ubuntu 16.04 machine. It seems that there is a problem with fetching dependencies, I'm not familiar with golang. Here's the error message after running the first command :
$ go get -d github.com/lightningnetwork/lnd
package context: unrecognized import path "context" (import path does not begin with hostname)
package math/bits: unrecognized import path "math/bits" (import path does not begin with hostname)
package net/http/httptrace: unrecognized import path "net/http/httptrace" (import path does not begin with hostname)

It still finishes, but as I expected after trying to build I get errors of "cannot find package".
How do I install those dependencies? I'm using golang 1.6.
Your environment

default golang version parsed from apt-get, which was 1.6
latest version of lnd
Linux ubuntu 4.4.0-138-generic
bitcoind : /Satoshi:0.17.0/

Try uising golang 1.11 to start with.

Apparently the context package has been added in Go 1.7. I'll look into it.

The docs are updated, which docs are you referring to?


Update user-portal branch

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.5 out of 7 committers have signed the CLA.:white_check_mark: ayshsandu:white_check_mark: senthalan:white_check_mark: janakamarasena:white_check_mark: JKAUSHALYA:white_check_mark: piraveena:x: jenkins-is-staging:x: KavinduZoysajenkins-is-staging seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Data messages without notifications permission

Is there a way to receive data messages while the app is in foreground and no notifications permissions?

Assuming you are referring to push messages - no you need notifications.
You may be able to use real time database to achieve the same thing thought.

No reason to store anything. Just need to inform clients when something happens on the backend.


VS code crash

When i run my program on GitBash (CMD), it tends to lag and keeps prompting me to {close the editor || keep waiting}.

/needsMoreInfo


update sentence transformer to v3.2.1

What does this PR do?
This PR is to upgrade the sentence transformer package to latest version v3.2.1.
There are three test places related to sentence transformer package and have tested these three test places and all passed.
Welcome for any comments!
Thanks.
Fixes # (issue)
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

@ZhengHongming888  have you tested with latest docker?

@libinta yes it passed the test under vault.habana.ai/gaudi-docker/1.18.0. thanks.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.


✨ Implement and Test ML Models with Enhancements and New Unit Tests

Kindly add level3 for this PR! i have done lot of editing! and assign me!  @UTSAVS26
1. decision_tree.py:
Enhanced DecisionTreeClassifier to:

Support a max_depth parameter to limit the tree's depth and prevent overfitting.
Implemented Gini impurity in _best_split() method to improve decision-making during node splitting.
Ensured the model can handle cases where the data is homogeneous or has only one class.
Unit Tests: Added tests to check the model's behavior with different tree depths and single-class datasets.

2. knearest_neighbors.py:
Implemented KNN algorithm:

Added the k parameter to determine the number of nearest neighbors for classification.
Used Euclidean distance for measuring similarity between points.
Unit Tests: Added tests for the general functionality of KNN, as well as for edge cases like k=1.

3. linear_regression.py:
Implemented Linear Regression:

Used the Normal Equation (X^T * X) to calculate model coefficients and intercepts.
The fit() method computes the optimal coefficients that minimize the cost function.
Unit Tests: Added tests for fitting and predicting, including handling non-invertible matrices (singular matrices) to check robustness.

4. random_forest.py:
Refined Random Forest implementation:

Integrated multiple decision trees with bagging (bootstrap aggregation) to improve model performance and robustness.
Added max_depth and min_samples_split parameters to control tree growth and avoid overfitting.
Unit Tests: Added tests for random forest fitting and predicting, with multiple trees and edge cases (single tree).

5. svm.py:
Implemented SVM classifier:

Used gradient descent to optimize weights and bias.
Added hinge loss and L2 regularization to improve the classifier's generalization.
Unit Tests: Added tests for fitting, prediction, and margin checking. Included tests for handling non-linearly separable data.

6. test_decision_tree.py:
Added tests for:

Fitting and predicting with a decision tree model, including behavior with different max_depth values.
Single-class datasets to check if the tree correctly predicts a single class.

7. test_knearest_neighbors.py:
Added tests for:

Fitting and predicting with the KNN model using different values of k.
Edge case where k=1, ensuring the model predicts the closest neighbor correctly.

8. test_linear_regression.py:
Added tests for:

Fitting the Linear Regression model and making predictions.
Handling non-invertible matrices in the fit() method and verifying that the model raises a LinAlgError in such cases.

9. test_random_forest.py:
Added tests for:

Fitting the Random Forest model with multiple trees and making predictions.
Ensuring the model can handle edge cases, including the scenario where only one tree is used.
Testing predictions with different tree depths and sample splits.

10. test_svm.py:
Added tests for:

Fitting and predicting with the SVM model on a toy dataset.
Checking if the margin is correctly computed and if the model handles non-linearly separable data.
Verifying predictions on a small dataset to ensure the SVM classifies correctly.

@UTSAVS26 atleast add level3 for one PR !!


adds merge for simple objects

@cdambo hey! I'd love to make you a collaborator so you can merge this and other PRs and roll a new release! Please signup over at https://github.com/KyleAMathews/deepmerge/issues/25 and let's make this happen!

Thanks for the good tests with the pull request!
I'm not sure implementing "coalesce" support for primitives is a good choice for this library, though - it seems like having this function do anything other than merging properties is a bit conceptually muddy.
I'll leave this pull request open a while longer in case anyone wants to argue for primitive-coalescing support.


clarify required fields in Extractor setup forms

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/1340
Originally created by @dmor on 2019-12-02 23:24:20

Make it more clear which field are required (with a * is the typical way) so that the user can quickly fill in what is needed and know when it is okay to skip something.
See @derek-knox's comments https://gitlab.com/meltano/account-management/issues/30#note_253574349
Prioritization: This was a blocker to a user getting set up with their Meltano instance

View 11 previous comments from the original issue on GitLab


Editor is not responding to clicks after it has been snapped to the corner, and then expanded to full window height.

VSCode Version: 1.0.0
OS Version: Windows 10

Steps to Reproduce:

Snap editor to the top-left corner.
Drag bottom border of the editor, so it snaps to the taskbar.
Try entering text to the editor or navigating through files.

My bad! It happens with Chrome as well, not just VSC. Probably something to do with the rendering engine.

I am closing this because I believe this is fixed, otherwise please report back. If you can reproduce I would appreciate if you could try to reproduce with our insiders build:
You can give our preview releases a try from: http://code.visualstudio.com/Download#insiders


VOCGasIndexAlgorithm.h file missing to compile !

Hi
I'm trying to compile the code using Arduino IDE. I have installed all dependencies, modified the c file with the proper Lora identifuirs but still it refuses to compile stating that "VOCGasIndexAlgorithm.h" file is missing and I can't find that file in the repo :( Where can I get that file ?
Thanks

oki problem solved (dependencies listed on repo are very incomplete !). I needed to install some extra Sensirion libs to get it to compile or at least move more forward in compilation :)


GpuInsertIntoHiveTable supports parquet format

close https://github.com/NVIDIA/spark-rapids/issues/9939
This is a new feature adding the parquet support for GpuInsertIntoHiveTable, who only supports text write now. And this feature is tested by the new added tests in this PR.

build

build

build

build

build

build

build

build


Add Google Cloud PubSub logging

Adds Google Cloud PubSub logging for status and results.
This also changes the Write interface for logging modules to add a context.Context (only used by pubsub currently).

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Michael Samuel seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

Awesome! I'll give this a full review when you sign the CLA. Thank you!

Just waiting on legal, hopefully won't be too long.
I couldn't find the CLA in the source repo, otherwise I would've done it sooner.

CLA is signed now, sorry for the delay!

Great, thank you! I'll be occupied at QueryCon the next couple days and will get to this when I can.

Hey @therealmik I'd love to get this merged if you have a chance to make the requested changes. Thank you!

Hi,
I've made the changes, but I'm currently travelling and haven't had time to test properly.  I'll see if I can figure out a test setup that'll work and get back to you ASAP.

I've been trying it out in staging and found a couple of bugs.  Sorted them out now, will get changes up soon after a few more tests.
Not sure about renaming pubsub to gcp_pubsub - it's a bit of a mouthful, and firehose isn't prefixed with aws.

I'm okay with leaving it as "pubsub". Do you have an ETA for getting the final changes in? I was going to cut a new release today, but would love to get this PR in if it can be done in the next 24 hours or so.

I'll do one last test with some cleanups, then should have it ready today (AU time, so overnight).

Hey @therealmik we are having trouble with the CLA tool. Can you please (1) re-sign the CLA and (2) ensure that your git commit includes the email associated with your Github account. The check should show up as completed when everything is correct. Thank you for your contribution and patience!

Sorry about that, I amended the author in the commits and it looks good now.

Wonderful thank you! I'm going to merge and try to get this release out!


Unable to Update NodeJS

Analysis
When attempting to update NodeJS from the terminal, the update can't download the Node package.
Expected Behavior
NodeJS will be updated to the latest version.
Steps To Reproduce
pi@homebridge:~ $ sudo hb-config
Updating Node.js to LTS, please wait...
Installed: v16.14.0
Current Node.js LTS: v20.15.1
Updating Node.js to v20.15.1...
Downloading to /tmp/tmp.KULqzgyRnZ/node-v20.15.1-linux-armv6l.tar.gz ...
curl: (22) The requested URL returned error: 404 Not Found

Failed to download node-v20.15.1-linux-armv6l.tar.gz. See logs above.

Logs
See above.

Configuration
Probably not relevant.

Environment

OS: *** Homebridge Raspbian v1.0.30 - Raspberry Pi 4 Model B Rev 1.2 ***

Process Supervisor
hb-service
Additional Context
No response

Looking at the messages, am thinking you are running an older version of the Homebridge UI, and that the download URL it is trying to download from was changed.
Also if it is an older implementation, the OS won't support NodeJS 20.  NodeJS 20 is only supported by Bullseye or newer.
 * Debian Version - Supplied GLIBC Version
   *
   *  9 - Stretch       2.24
   * 10 - Buster        2.28
   * 11 - Bullseye      2.31
   * 12 - Bookworm      2.36
   * 13 - Trixie
   *
   * NodeJS Version - Minimum GLIBC Version
   *
   *      18            2.28
   *      20            2.31

@mzagaja
I think it's easiest for you if you backup homebridge and then perform fresh homebridge installations from the latest version of homebridge raspbian image and restore the backup. The operation is really simple.
If you currently have e.g. Linux Bullseye, you will not go to Bookworm through the simple Homebridge update. You need to backup, install newest radpbian image and restore backup.

@mkz212 will give it a shot. Thanks for the advice here.


FastHashMap class documentations

The class src/main/java/com/xceptance/common/collection/FastHashMap.java looks really interesting but there is no real information in the class comment why someone should use this in favor of the java one.
Any chance to add some words about the idea, the pro/cons and maybe also what 'fast' means here.

Sure. Will do. Bottom line: It uses less memory, has less cache misses due to direct value storage, and due to less code, is easier inlineable by the JIT.

Copied to Neko and improved.


Remove tox version cap

Summary
The recent release of pyproject-api 1.6.x seems to have broken compatibility with older versions of tox. We had capped the tox version at < 4.4.0 for some time to avoid other issues in tox. This commit removes that cap to test if it is fixed and we can use the latest versions of tox and pyproject-api together. If this fails CI then the alternative approach will be to use the constraints file to cap pyproject-api to < 1.6.0.
Details and comments

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
6 unchanged lines in 2 files lost coverage.
Overall coverage increased (+0.008%) to 87.298%

Files with Coverage Reduction
New Missed Lines
%

crates/qasm2/src/lex.rs
3
91.65%

qiskit/pulse/library/waveform.py
3
93.75%

Totals

Change from base Build<PHONE_NUMBER>:
0.008%

Covered Lines:
74435

Relevant Lines:
85265

💛  - Coveralls


Menu text is hard to read in dark mode

what browser is this, and do you have system or browser settings for global light/dark theme?

i got a similar result on chromium so i assume that's what you're using. should work now

i'm using chrome, and it's fixed now thx


Test count star for hive storage formats

Test count star for hive storage formats

this test is really about “select no columns”.

I think count(*) is a special case, because we read files, but only the metadata portion of them.
“select no columns” does not convey this
Can we have something that is less SQL-ish but still conveys the meaning?

testCount

Theoretically count(*) might be using different execution path than SELECT 1 FROM x. However, my point to here was to add a select no columns test. Anyway, I will also add a test for SELECT 1 FROM x.

Updated


Identify datasets in nested structures

This PR introduces a DatasetLocatorImpl class, that enables the ETL
to grab the actual dataset path in case of nested structures, generated after processing with the Dropboxhandler.

Is this ready for review?


Gen 1 Supported VM Sizes is Incorrect

The page "Support for generation 2 VMs on Azure" does not seem to contain accurate information regarding Gen 1 image support.
The documentation states:

Generation 1 VMs are supported by all VM sizes in Azure (except for Mv2-series VMs).

Which is not correct as I've experienced recently with launching ND96asr A100 v4 VM types which explicitly require a Gen 2 image.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 940f5217-9f40-0563-27d2-d9e7f7e42005
Version Independent ID: e088e366-77aa-6358-2540-2c937c6474ec
Content: Azure support for generation 2 VMs - Azure Virtual Machines
Content Source: articles/virtual-machines/generation-2.md
Service: virtual-machines
Sub-service: generation-2-vm
GitHub Login: @ju-shim
Microsoft Alias: jushiman

Hello,
I am the content developer who supports the VM sizes team when it comes to doc needs. I do not own these documents, I mainly support the team if they run into issues. I can make the update, but I need the owner on the PM side to confirm this information and help adjust any related information on this document and other articles as well.
Khye Wei is the Gen 2 PM and I will reach out to them in our email thread for assistance. Thank you for your patience!
Julia

This issue is actively being resolved (through an internal PR). It will be live sometime today or tomorrow.
#please-close


Is there a way to open files from fterm into the running neovim instance ?

Hello,
I would like to know if is there a way to open the files from Fterm, to the actual neovim instance that i'm running in a simple way.
Thanks,

I believe not, you could use neovim-remote alongside FTerm.


Integrate a spinner to track time taken for long running operations  #679

**Summary: ** Integrate a spinner to track time taken for long running operations. #679
What Happened: Multiple logs with the same message is printed on screen which is redundant by nature, a spinner can be used to achieve the objective.
I0927 03:24:02.531498  835123 import.go:258] Importing image rhel-94-04242024-tier0. Please wait...
I0927 03:24:06.596504  835123 import.go:277] Image import is in-progress, current state: queued
I0927 03:26:06.680951  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:28:06.623011  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:30:06.843204  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:32:06.727223  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:34:06.769074  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:36:06.920080  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:38:06.861958  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:40:06.951969  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:42:06.826810  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:44:06.873676  835123 import.go:277] Image import is in-progress, current state: running
I0927 03:46:06.901292  835123 import.go:271] Image imported successfully, took 22m0.670579377s
Rather a spinner can be set-up lo track the current status and the time elapsed to improve user experience.

What you expected to happen:
A single line of log to track the status.
**Test: **
Example Output During Polling:

Fixes: #679

@priyanshikhetwani, I see there are merge conflicts, can you PTAL?
Thanks!

/lgtm
Thanks.


build: Clean deletes all un-versioned controlled files

Checklist:

[x] Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this is a chore.
[x] The title of the PR is (a) conventional, (b) states what changed, and (c) suffixes the related issues number. E.g. "fix(controller): Updates such and such. Fixes #1234".
[x] I've signed the CLA.
[x] I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
[x] My builds are green. Try syncing with master if they are not.
[x] My organization is added to USERS.md.

This PR makes it harder to create "dirty" version (like v2.10.0-rc4).


qlImageSize on OS X Snow Leopard

Is it possible to add a little backwards compatibility? On Snow Leopard QuickLook fails back to the default view for me.

I don't have a computer with 10.6, so atm I can't look what's the problem.


Update comment in alluxio.master.LocalAlluxioMaster#kill

Update comment in alluxio.master.LocalAlluxioMaster#kill

Can one of the admins verify this patch?

ok to test

Thanks for the PR @dh-song! LGTM.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/8962/
Test PASSed.

+1 LGTM

@dh-song For future reference, we usually put [SMALLFIX] at the start of the PR title for PRs like this.

got it. Thank you.

On Mar 19, 2016, at 11:15 AM, Andrew Audibert<EMAIL_ADDRESS>wrote:
@dh-song https://github.com/dh-song For future reference, we usually put [SMALLFIX] at the start of the PR title for PRs like this.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub https://github.com/Alluxio/alluxio/pull/2878#issuecomment-198760639


The train/test split ratio of LIBERO Benchmark evaluation.

Hi !
Thanks for opening the code for the LIBERO benchmark evaluation.
I succeeded in fine-tuning and evaluating the model on LIBERO dataset.
I wonder how the train-set and the test-set are split in the LIBERO benchmark.
As far as I know, each task suite of LIBERO has 10 tasks and each task with 50 episodes which results in 500 episodes per each task-suite.
How are these episodes split into the train/test set ?
What is the split ratio of train/test set ?
Thanks in advance!

Hi @jis3613,
We actually just used the full dataset as the training set (no test set) so that we could ensure fair comparisons with other works. However, if you need a validation/test set for hyperparameter tuning, you could split the dataset during project iteration and then later on train on the full dataset when reporting results (it's really up to you). Note that the train sets include less than 500 demos per suite because we filtered out unsuccessful demos.
-Moo Jin

Thanks for the helpful issue and reply.
I would like to ask a follow-up question related to this.
What I understood so far:

Each task suite in LIBERO (spatial, object, goal, 100) consists of 10 tasks, each with 50 episodes.
OpenVLA used the LIBERO dataset, which has been filtered and modified.
As Moo Jin explained, OpenVLA used the full dataset as the training set.

Here is my question: In Appendix E of the LIBERO paper, it states that "all methods are evaluated across 500 trials for each task suite." Does this mean that the same set of tasks and episodes are used for both training and evaluation (test) in OpenVLA? I want to clarify whether there is any distinction between the training set and the evaluation set in this context.
Thanks in advance for your clarification!

I think the same tasks and episodes are used for both training and evaluation.
The difference between training and evaluation is that when training, the ground-truth action label, the action trajectory annotated by the humans, are exploited to calculate the loss and train the model.
However, when evaluating, it does not require any GT action label.
It only gives the initial state of each episode, and just let the policy model decide which action to take on its own at each time-step.
It might seem a little unfair that it uses the same initial states of the episodes used during training at evaluation-time,
but I think this is how things are like in the field of robotics.
I am new to robotics research like you, so hopefully the authors can give better answer than mine...

Hi @YEOMJINSEOP and @jis3613,
For LIBERO, the initial object/robot positions at test time are different from the ones used at train time. Bo Liu (first author of the LIBERO benchmark) confirmed this in this GitHub issue: "1 task has 50 demonstrations and 50 initial states, the initial states are not necessarily the same as the initial state in the demonstration, but they are sampled i.i.d from the same initial state distribution. By doing so, we can test the in-distribution generalization." You can check this for yourself by saving an image of the initial states at train time and test time, for all episodes within a task, and comparing them.
If you load in the initial object/robot states seen in the training demonstrations, you will observe very high success rates, as OpenVLA fits the training data very well. The numbers we reported in the paper are lower though because we tested on the default eval settings, where the initial states are different than the ones seen in the training demonstrations.
-Moo Jin

@jis3613 No worries! This information is not immediately clear unless you have played around with the benchmark for a while. Good to hear!

@jis3613 No worries! This information is not immediately clear unless you have played around with the benchmark for a while. Good to hear!

Hi @moojink and @jis3613,
Thank you both for your detailed explanations.
Your insights clarified a lot about the OpenVLA's LIBERO benchmark setup and evaluation.
I really appreciate your precious time and help!
Best,
JINSEOP


Enhancement - Add a build indicator

Enhancement - Please add a small icon when a building is in the process of being built.

The building is made translucent.


Edit doc overall based on PyAnsys doc style guidelines

PyAnsys libraries are to follow the Google developer's style guide, which uses sentence case for headings. Most of its other guidelines are the same as the Ansys documentation style guide. For example, use active voice, present tense and short, clear sentences. Once Vale is implemented in the Fluent repos, it will catch all violations of the Google guidelines. The plan will be to keep Vale off until I run it locally and fix any existing violations and then turn it on so that new contributions must pass its check.

Would someone be able to help me get the Build and Unit Testing check to pass. I have trouble deciphering the details on this! Thanks!

Would someone be able to help me get the Build and Unit Testing check to pass. I have trouble deciphering the details on this! Given the size, I'd assume we'd want to get this finalized and merged ASAP. Thanks!

It looks to me like there was an issue with spinning up Fluent or connecting to it through the gRPC channel.  I've re-run the unit test job, should be fine hopefully as these changes would not impact unit testing.

Would someone be able to help me get the Build and Unit Testing check to pass. I have trouble deciphering the details on this! Given the size, I'd assume we'd want to get this finalized and merged ASAP. Thanks!

Now the latest one did not pull the docker image.  Not sure why.  We did add a 23.1 image today, let me check....

Would someone be able to help me get the Build and Unit Testing check to pass. I have trouble deciphering the details on this! Given the size, I'd assume we'd want to get this finalized and merged ASAP. Thanks!

It looks ok now after a few retries.


OCM-10017 | fix: revert adding EC2 policy to worker role

Breaks creation of account-roles for orgs that do not have the zero-egress feature enabled.

/test coverage

/lgtm

/lgtm
/approve


Reserve IP addresses for Mac addresses on my DHCP server

[ ] Create table of mac to IP mappings
[ ] Add to router
[ ] Update /etc/hosts file on freehold
[ ] Provision all VMs

IP address reservation
Mac table

Mac
IP
Name

52:54:00:11:22:33
<IP_ADDRESS>
dev-node01

52:54:00:11:22:44
<IP_ADDRESS>
build-node01

52:54:00:11:22:55
<IP_ADDRESS>
build-node02

52:54:00:11:11:00
<IP_ADDRESS>
k0s-controlplane

52:54:00:11:11:01
<IP_ADDRESS>
k0s-node01

52:54:00:11:11:02
<IP_ADDRESS>
k0s-node02

52:54:00:11:11:03
<IP_ADDRESS>
k0s-node03

52:54:00:11:12:00
<IP_ADDRESS>
kubeadm-controlplane01

52:54:00:11:12:01
<IP_ADDRESS>
kubeadm-node01

52:54:00:11:13:00
<IP_ADDRESS>
rancher-controlplane

52:54:00:11:13:01
<IP_ADDRESS>
rancher-node01

52:54:00:11:13:02
<IP_ADDRESS>
rancher-node02

52:54:00:11:13:03
<IP_ADDRESS>
rancher-node03

Hosts
<IP_ADDRESS>  dev-node01
<IP_ADDRESS>  build-node01
<IP_ADDRESS>  build-node02
<IP_ADDRESS>  k0s-controlplane
<IP_ADDRESS>  k0s-node01
<IP_ADDRESS>  k0s-node02
<IP_ADDRESS>  k0s-node03
<IP_ADDRESS>  kubeadm-controlplane01
<IP_ADDRESS>  kubeadm-node01
<IP_ADDRESS>  rancher-controlplane
<IP_ADDRESS>  rancher-node01
<IP_ADDRESS>  rancher-node02
<IP_ADDRESS>  rancher-node03


Implement R2D2 (SAC ver.)

Work in progress for accelerating.

Thank you very much for adding R2D2 with SAC!


AWQ with Python 3.10 error

I installed everything following the guide, and with python3.10, cuda 11.8, installing the wheel from source, I get this error when importing packages from lm_eval.
Traceback (most recent call last):
  File "/home/user/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1382, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
  File "/share/apps/python-3.10.0-shared/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/user/.local/lib/python3.10/site-packages/transformers/pipelines/__init__.py", line 65, in <module>
    from .document_question_answering import DocumentQuestionAnsweringPipeline
  File "/home/user/.local/lib/python3.10/site-packages/transformers/pipelines/document_question_answering.py", line 29, in <module>
    from .question_answering import select_starts_ends
  File "/home/user/.local/lib/python3.10/site-packages/transformers/pipelines/question_answering.py", line 9, in <module>
    from ..data import SquadExample, SquadFeatures, squad_convert_examples_to_features
  File "/home/user/.local/lib/python3.10/site-packages/transformers/data/__init__.py", line 26, in <module>
    from .metrics import glue_compute_metrics, xnli_compute_metrics
  File "/home/user/.local/lib/python3.10/site-packages/transformers/data/metrics/__init__.py", line 19, in <module>
    from scipy.stats import pearsonr, spearmanr
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/stats/__init__.py", line 391, in <module>
    from .stats import *
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/stats/stats.py", line 180, in <module>
    from . import distributions
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/stats/distributions.py", line 8, in <module>
    from ._distn_infrastructure import (entropy, rv_discrete, rv_continuous,
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/stats/_distn_infrastructure.py", line 23, in <module>
    from scipy import optimize
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/optimize/__init__.py", line 421, in <module>
    from ._shgo import shgo
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/optimize/_shgo.py", line 9, in <module>
    from scipy import spatial
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/spatial/__init__.py", line 107, in <module>
    from . import distance, transform
  File "/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/spatial/transform/__init__.py", line 19, in <module>
    from .rotation import Rotation, Slerp
ImportError: /share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/spatial/transform/rotation.cpython-310-x86_64-linux-gnu.so: undefined symbol: _PyGen_Send

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/user/AutoAWQ/calibration.py", line 2, in <module>
    from lm_eval import evaluator
  File "/home/user/.local/lib/python3.10/site-packages/lm_eval/__init__.py", line 1, in <module>
    from .evaluator import evaluate, simple_evaluate
  File "/home/user/.local/lib/python3.10/site-packages/lm_eval/evaluator.py", line 12, in <module>
    import lm_eval.tasks
  File "/home/user/.local/lib/python3.10/site-packages/lm_eval/tasks/__init__.py", line 7, in <module>
    from lm_eval.api.task import TaskConfig, Task, ConfigurableTask
  File "/home/user/.local/lib/python3.10/site-packages/lm_eval/api/task.py", line 8, in <module>
    import evaluate
  File "/home/user/.local/lib/python3.10/site-packages/evaluate/__init__.py", line 29, in <module>
    from .evaluation_suite import EvaluationSuite
  File "/home/user/.local/lib/python3.10/site-packages/evaluate/evaluation_suite/__init__.py", line 10, in <module>
    from ..evaluator import evaluator
  File "/home/user/.local/lib/python3.10/site-packages/evaluate/evaluator/__init__.py", line 27, in <module>
    from .audio_classification import AudioClassificationEvaluator
  File "/home/user/.local/lib/python3.10/site-packages/evaluate/evaluator/audio_classification.py", line 23, in <module>
    from .base import EVALUATOR_COMPUTE_RETURN_DOCSTRING, EVALUTOR_COMPUTE_START_DOCSTRING, Evaluator
  File "/home/user/.local/lib/python3.10/site-packages/evaluate/evaluator/base.py", line 34, in <module>
    from transformers import Pipeline, pipeline
  File "<frozen importlib._bootstrap>", line 1075, in _handle_fromlist
  File "/home/user/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1372, in __getattr__
    module = self._get_module(self._class_to_module[name])
  File "/home/user/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1384, in _get_module
    raise RuntimeError(
RuntimeError: Failed to import transformers.pipelines because of the following error (look up to see its traceback):
/share/apps/python-3.10.0-shared/lib/python3.10/site-packages/scipy/spatial/transform/rotation.cpython-310-x86_64-linux-gnu.so: undefined symbol: _PyGen_Send

Any idea why?

Traceback (most recent call last):
File "/alidata1/admin/model/quick_start.py", line 12, in
model = AutoModelForCausalLM.from_pretrained(
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 566, in from_pretrained
return model_class.from_pretrained(
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3533, in from_pretrained
model, has_been_replaced = replace_with_awq_linear(
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/transformers/integrations/awq.py", line 81, in replace_with_awq_linear
from awq.modules.linear import WQLinear_GEMM, WQLinear_GEMV
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq/init.py", line 2, in
from awq.models.auto import AutoAWQForCausalLM
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq/models/init.py", line 1, in
from .mpt import MptAWQForCausalLM
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq/models/mpt.py", line 1, in
from .base import BaseAWQForCausalLM
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq/models/base.py", line 12, in
from awq.quantize.quantizer import AwqQuantizer
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq/quantize/quantizer.py", line 11, in
from awq.modules.linear import WQLinear_GEMM, WQLinear_GEMV
File "/alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq/modules/linear.py", line 4, in
import awq_inference_engine  # with CUDA kernels
ImportError: /alidata1/admin/anaconda3/envs/yi4b/lib/python3.10/site-packages/awq_inference_engine.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi
I meet too

I solved mine by installing scipy 1.7.2. For some reason when installing with python>=3.10 it installs scipy 1.6.7 which has some problems.


Unable to load js files from atlas.microsoft.com

Hi, was trying the sample code above and got the below error.
Loading failed for the <script> with source “https://atlas.microsoft.com/sdk/js/atlas.min.js?api-version=1”. mapRoute.html:10:1
Loading failed for the <script> with source “https://atlas.microsoft.com/sdk/js/atlas-service.js?api-version=1”.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a83c299e-5f1e-be71-41c6-879815e4801c
Version Independent ID: 01996a4c-2897-e3cb-8e60-0be6ca52230d
Content: Find route with Azure Maps
Content Source: articles/azure-maps/tutorial-route-location.md
Service: azure-maps
GitHub Login: @walsehgal
Microsoft Alias: v-musehg

@ameetkonnur Could you provide more details about the issue which you are facing? In which step you are getting this error message? Have you created map account and configured the key accordingly?

I am trying the sample routeMap.html which gives the below error. It doesn’t even load the map. It just shows a blank screen with error below.
I have set the Azure Map key in the code. Am using this from India.
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows 10

From: AshokPeddakotla-MSFT<EMAIL_ADDRESS>Sent: Friday, January 4, 2019 3:03:50 PM
To: MicrosoftDocs/azure-docs
Cc: Ameet Konnur; Mention
Subject: Re: [MicrosoftDocs/azure-docs] Unable to load js files from atlas.microsoft.com (#21631)
@ameetkonnurhttps://github.com/ameetkonnur Could you provide more details about the issue which you are facing? In which step you are getting this error message? Have you created map account and configured the key accordingly?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/azure-docs/issues/21631#issuecomment-451395531, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ATj_WwOI6aZjYa5yzfvQMCIFoxu-_C2hks5u_x_-gaJpZM4ZpJ1e.

The Azure Maps API is currently available in all countries except for the following:

Argentina
China
India
Morocco
Pakistan
South Korea

This could be a problem with the region. I had the same blank screen issue when i try this.
As a work around you can create a VM and try the example.

Thanks. Any timelines when this would be available in India ?
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows 10

From: AshokPeddakotla-MSFT<EMAIL_ADDRESS>Sent: Friday, January 4, 2019 3:42:34 PM
To: MicrosoftDocs/azure-docs
Cc: Ameet Konnur; Mention
Subject: Re: [MicrosoftDocs/azure-docs] Unable to load js files from atlas.microsoft.com (#21631)
The Azure Maps API is currently available in all countries except for the following:

Argentina
China
India
Morocco
Pakistan
South Korea

This could be a problem with the region. I had the same blank screen issue when i try this.
As a work around you can create a VM and try the example.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/azure-docs/issues/21631#issuecomment-451404231, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ATj_W4ZxMIRB05B32CRaUnYsQPbyjRpcks5u_ykSgaJpZM4ZpJ1e.


style:use root path

What this PR does:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

Codecov Report
Base: 35.95% // Head: 35.95% // No change to project coverage :thumbsup:

Coverage data is based on head (0e46fe4) compared to base (4c363c8).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #445   +/-   ##
=======================================
  Coverage   35.95%   35.95%
=======================================
  Files         124      124
  Lines       19966    19966
=======================================
  Hits         7179     7179
  Misses      12001    12001
  Partials      786      786

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


OpenOffice Calc (.ods) importer creating many empty columns

Original author: tfmorris (May 01, 2012 20:30:42)
When importing an ODS spreadsheet with 90 rows, I ended up with a project which had 90 columns, 85 of which were completely empty.  Perhaps it was just a coincidence, but I suspect that columns and rows are getting confused somewhere.  Whatever the cause, it's tedious to deal with all the extra columns, so we should try to eliminate empty columns.
Original issue: http://code.google.com/p/google-refine/issues/detail?id=565

Here's a copy of the file (Plecoptera-OHIO_WORKING.txt) from https://github.com/OpenRefine/OpenRefine/issues/565#issuecomment-11253960 in case the Google Drive version goes away


scheduled dropblock?

Hi,
did you implement scheduled dropblock as mentioned in the paper?

In our experiments, we use a linear scheme of decreasing the value ofkeep_prob, which tends to work well across many hyperparameter settings. This linear scheme issimilar to ScheduledDropPath

Hey,
Not yet, but it is in the todo list in the README (unchecked)
However I am not sure how the ideal implementation would go, as you need to keep track of the number of iterations / epochs.
So it might be a better if the user manages that. I'll try to come up with something nevertheless
Miguel

@miguelvr
Maybe you can write a example about how to manage scheduled dropblock?

Yes, definetely! I will try to do that soon... An example is much needed anyway

Expect you release a version of scheduled dropblock


Typescript support of RAGatouille

Hello,
I want to use the RAGatouille library in a lightweight application and want to know if there is a typescript-compatible API that can be used to access the RAGatouille-created indices and initialize the RAGPretrained model. I'm trying to avoid using Python backend for latency purposes.

Hey! This isn't currently planned/in-scope. It wouldn't, in theory, be too complicated, but for PLAID indexes, this'd require reproducing the ColBERT querying code in typescript.