BLE Provisioning in esp-idf v4.4 on Android 12 causes extra pairing prompt (IDFGH-6661)

Environment

Development Kit:      none

Module or chip used:  ESP32-WROOM-32

IDF version (run git describe --tags to find it): v4.4

Build System:         idf.py

Compiler version (run xtensa-esp32-elf-gcc --version to find it): xtensa-esp32-elf-gcc (crosstool-NG esp-2021r2) 8.4.0

Operating System:     macOS

Using an IDE?: No

Power Supply:        external 5V

Problem Description
BLE protocom provisioning on Android now triggers a prompt on the Android device asking the user to pair. On esp-idf version 4.3.2 the esp module can pair without prompting the user on the Android device. This happens with the provisioning example Android app on Android 12 on Pixel 6 pro.
Expected Behavior
The provisioning app should list discovered devices, the user should select the device then be able to provision the device.
Actual Behavior
The provisioning app lists discovered devices, upon selecting a device, a system notification is shown asking the user if they want to pair with the device. If the user ignores this notification or declines, the esp device is not provisionable.
Steps to reproduce

Flash the BLE provisioning example to the esp module
Attempt to provision the device using the demo Android app
Select the scanned device and see the new system notification that stops immediate pairing

Similarly on iOS, the example provisioning app prompts to pair twice, once when the scanned device is selected, and again after the PoP token is submitted.

I'm seeing this issue on both iOS and Android as well.  Works just fine on 4.2 and 4.3, but with 4.4 I'm seeing these prompts, and the root cause appears to be on the ESP32 SoC side since there is no change on the mobile app side.

Hello, @joshgalicic and @GeoffArmstrong!
Thank you for the issue report.
Could you try out this patch - wifi_prov_ble_pair.zip? It adds a config option WIFI_PROV_BLE_SECURE_PAIRING which can be toggled at (Top) → Component config → Wi-Fi Provisioning Manager. Disabling it should fix the issue.

I applied the patch and disabled that option, and it fixed the issue. Thank
you!
On Fri, Feb 11, 2022 at 6:03 AM Laukik Hase @.***>
wrote:

Hello, @joshgalicic https://github.com/joshgalicic and @GeoffArmstrong
https://github.com/GeoffArmstrong!
Thank you for the issue report.
Could you try out this patch - wifi_prov_ble_pair.zip
https://github.com/espressif/esp-idf/files/8048778/wifi_prov_ble_pair.zip?
It adds a config option WIFI_PROV_BLE_SECURE_PAIRING which can be toggled
at (Top) → Component config → Wi-Fi Provisioning Manager. Disabling it
should fix the issue.
—
Reply to this email directly, view it on GitHub
https://github.com/espressif/esp-idf/issues/8297#issuecomment-1036193079,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AALMBEK7NVGYJSMS53STJZ3U2UCJLANCNFSM5M335SHA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi @GeoffArmstrong  , @joshgalicic ,
We have made a generic fix for this issue. Can you kindly confirm if issue is resolved with attached patch ? We can make it part of official release.
0001-Merge-branch-bugfix-wifi_prov_mgr_conn_issue-into-ma.patch.txt
Thanks,
Rahul

Hi @rahult-github
I removed the previous patch that you sent and then applied this new patch however the problem described in this issue has  unfortunately reappeared.

Hi @GeoffArmstrong ,
Thanks for trying the patch. Can you please confirm that when the patch was applied, you ensured that previous pairing / bonding information on the remote phone ( android phone ) was removed ?
Basically, it should be fresh pairing and then any instance of trying to pair / unpair should work.
Thanks,
Rahul

Hey @rahult-github
I have a question about this - should users be seeing a iOS/Android "pair" message at all?  Firmware built with IDF 4.3.x our app is able to communicate with the device without getting a pairing message. Going forward, is the user going to need to answer a pairing prompt from the mobile OS?
I'll test again with your most recent patch and actually accept the "pairing" request.  I just ignored the pairing message because I figured users shouldn't be getting it in the first place. Our specific goal of using the Bluetooth interface for our IoT device is to just initialize a WiFi connection, and then never use Bluetooth again. So for our needs increased security on a Bluetooth connection isn't as important as a simple setup experience since it's only used for a brief moment.

Hi @rahult-github
I can confirm that the first patch is working, but the second is not.

Hi @rahult-github,
Is it expected that the first one will be included in release/v4.4?

Hi @ndevev , @GeoffArmstrong
We will need some more debugging, before we can simply disable some piece of code.
As pointed out by @GeoffArmstrong  in above comment:
Works just fine on 4.2 and 4.3, but with 4.4 I'm seeing these prompts,
However, the first patch disables the code which is present even on v4.3 .
https://github.com/espressif/esp-idf/blob/release/v4.3/components/protocomm/src/transports/protocomm_nimble.c#L498
This issue may be specific to android version. We tried with multiple phones , but were of version Android 10 and 11 and are not able to reproduce the issue at our end.
May i request you to kindly share with us debug enabled logs ( with / without the patch ) so we can analyse and give a proper fix, rather than just disabling a segment of code that may cause regression.
Thanks,
Rahul

Hi @rahult-github!
It's getting weirder. I tried again to generate the debug logs you asked, but now the whole provisioning doesn' t work. After the BLE connection, the service discovery is OK, then the Android app tries to send the prov-session command with the client pub key, but it is failed because of timeout. And no pairing request popup is appear. And there is nothing interesting in the debug log too.
The same thing happens with and without the patch and with the iPhone app.
I don’t understand why I experienced anything else last time. Maybe I didn't do fullclean.
D (00:00:32.260) protocomm_nimble: Inside BLE connect w/ conn_id - 0
I (00:00:33.139) protocomm_nimble: mtu update event; conn_handle=0 cid=4 mtu=256

D (00:00:37.457) protocomm_nimble: disconnect; reason=531
D (00:00:37.457) protocomm_nimble: Inside disconnect w/ session - 0
I (00:00:37.462) NimBLE: GAP procedure initiated: advertise;
I (00:00:37.465) NimBLE: disc_mode=2
I (00:00:37.469) NimBLE:  adv_channel_map=0 own_addr_type=0 adv_filter_policy=0 adv_itvl_min=256 adv_itvl_max=256
I (00:00:37.480) NimBLE:

But v4.3.2-350-g040ae4ac72 still works well (and without any pairing popup).

Hi @ndevev ,
This looks completely different from the original issue.
Can you please enable debug logs by  modifying log level via menuconfig like below, and help capture one log ?
Component Config  --> Log Output --> Default Log Verbosity --> Debug
Component Config --> Bluetooth --> NimBLE Options --> NimBLE Host log verbosity --> Debug Logs
Thanks,
Rahul

It turned out that the provisioning was not successful due to turning the log verbosity level to debug.
So I cannot create successful provisioning connection if the debug log verbosity is debug.

Hey @rahult-github

Thanks for trying the patch. Can you please confirm that when the patch was applied, you ensured that previous pairing / bonding information on the remote phone ( android phone ) was removed ?

I had some time today, so I tested again and this time used a phone that had previously never communicated with that ESP32 before via BLE just to be sure that there were no lingering problems, and the the prompting problem didn't exist with the first patch but it did with the second.

Hi @GeoffArmstrong ,
Link encryption is by default now enabled for characteristic read / write during provisioning. If link is not encrypted, it will go for link encrpytion which needs LTK. If LTK is not present, it will proceed for pairing to generate one. This should be the reason pop-ups are observed now.
Can you please confirm if attached patch results in no pop ups during provisioning at your end. This patch should be applied in $IDF_PATH
Double_Pairing_Prompt.txt
Thanks,
Rahul

Hi @rahult-github ,
Thanks, I reverted the previous patches and applied the latest patch and the pairing worked without any extra Bluetooth pairing prompts.
I've only done a few minutes of testing, but it's looking good so far and I'll follow up here if I find any more issues when doing more comprehensive regression testing.

Thanks for reporting and sorry for slow turnaround, fixes are available

master branch: https://github.com/espressif/esp-idf/commit/c4eb0c3584620d78e5e700b3e54cd6e25eff2fa2
release:4.4: https://github.com/espressif/esp-idf/commit/1861ca57001a25ff621b975a6b003204d941d8d5
release/4.3: https://github.com/espressif/esp-idf/commit/6a92fb2d76cd7bc1bc12233baee0ef69c0b08b33

Feel free to reopen if the issue still happens. Thanks.


Improve documentation by creating a user guide for recording and installing security profiles based on use cases

What would you like to be added:
We should write a user guide for recording and installing security profiles based on use cases. This will improve the user experience when using the security profiles operator to manage security profiles in general.
With the introduction of spoc CLI, spo provides now capabilities to manage security profiles beyond the Kubernetes clusters. We should add a detailed step by step guide for following use cases:

Manage security profiles in-cluster such as seccomp and apparmor, this is the standard use case to record and install security profiles within a k8s cluster.
Manage security profiles for containers outside of k8s, step by step guide how to use the spoc CLI in this case
Manage security profiles on your local Linux system,  this is the case when someone wants to record and install a security profile for a process running on a local system, this use case is also now covered by the spoc CLI, and it can provide a seamless experience when #2387 is implemented.

Why is this needed:
Improve user experience and facilitate the spo adoption.
User story covered

/remove-lifecycle stale


Update docs for publish command

This PR

Updates docs for the new Publish Dev and Publish Export commands

related https://github.com/dendronhq/dendron/pull/1614/


python310Packages.pyvisa-py: 0.6.0 -> 0.6.1

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python310Packages.pyvisa-py is: PyVISA backend that implements a large part of the Virtual Instrument Software Architecture in pure Python
meta.homepage for python310Packages.pyvisa-py is: https://github.com/pyvisa/pyvisa-py
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.6.1 with grep in /nix/store/5z4wwblfsxffv1g7z63f58308rv4lg11-python3.10-pyvisa-py-0.6.1
found 0.6.1 in filename of file in /nix/store/5z4wwblfsxffv1g7z63f58308rv4lg11-python3.10-pyvisa-py-0.6.1

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath
python310Packages.pyvisa-py
python311Packages.pyvisa-py

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/5z4wwblfsxffv1g7z63f58308rv4lg11-python3.10-pyvisa-py-0.6.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python310Packages.pyvisa-py https://github.com/r-ryantm/nixpkgs/archive/e5f1aad42161b4c61db581a9d6297bfcdc088436.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/5z4wwblfsxffv1g7z63f58308rv4lg11-python3.10-pyvisa-py-0.6.1
ls -la /nix/store/5z4wwblfsxffv1g7z63f58308rv4lg11-python3.10-pyvisa-py-0.6.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages built:

python310Packages.pyvisa-py
python311Packages.pyvisa-py

Maintainer pings
cc @mvnetbiz for testing.

@ofborg build python311Packages.pyvisa-py


URI::createFromEnvironment mistake?

Hi Guys!
In my project the script directory name is "public".

+app
-public
index.php
+vendor

When I defined a route which started with 'public', then the createFromEnvirontment method chunks this part:
the route:
$app->get('/public_idea/{idea_id}',	'App\Action...');
and the request in App.php:
/var/.../vendor/slim/slim/Slim/App.php on line 367
Slim\Http\Request Object
(
    [method:protected] =>
    [originalMethod:protected] => GET
    [uri:protected] => Slim\Http\Uri Object
        (
            [scheme:protected] => http
            [user:protected] =>
            [password:protected] =>
            [host:protected] => xxx
            [port:protected] => 80
            [basePath:protected] => /public
            [path:protected] => _idea/1 <-------------------------------
            [query:protected] =>
            [fragment:protected] =>
        )

If I tailed the requestScriptDir with a slash, it improved:
//        } elseif ($requestScriptDir !== '/' && stripos($requestUri, $requestScriptDir) === 0) {
        } elseif ($requestScriptDir !== '/' && stripos($requestUri, $requestScriptDir.'/') === 0) {

If somebody using a failed url (included with the script directory name) the trailing slash will be there anyway, so imho this change will not cause trouble.
Best,
e.

Can you provide the contents of $env that is passed to URI::createFromEnvironment?

Sorry, what kind of content would you like?
The request uri from $_SERVER is "/public_idea/1"
and the chunked path is "_idea/1" as above.

In theory, this is the problem:
$environment = Environment::mock([
    'SCRIPT_NAME' => '/foo/index.php',
    'REQUEST_URI' => '/foo_bar',
    'HTTP_HOST' => 'example.com:8080',
    'SERVER_PORT' => 8080,
]);

But when the /foo won't be on REQUEST_URI?
For me the correct Request URI would be 'REQUEST_URI' => '/foo/foo_bar',

I created a public/index.php file with the following content
<?php
var_dump($_SERVER);

and started a PHP built-in web server in the directory above public. I get the following output:
array (size=23)
  'SERVER_NAME' => string 'localhost' (length=9)
  'SERVER_PORT' => string '8000' (length=4)
  'REQUEST_URI' => string '/public/foo_bar' (length=15)
  'SCRIPT_NAME' => string '/public/index.php' (length=17)
  'PATH_INFO' => string '/foo_bar' (length=8)
  'PHP_SELF' => string '/public/index.php/foo_bar' (length=25)
  'HTTP_HOST' => string 'localhost:8000' (length=14)
  ...

Perhaps other servers (Apache, Nginx) return a different value for REQUEST_URI?

I'm so sorry! It was my mistake, but interested:
I've got from our SA a test host with config pointed for the web directory. When I looked it, the SA were on holiday, so I created a simple .htaccess file, rewrite all request (without condition) for the /public directory. And it's remain...
So my SCRIPT_NAME was /public/index.php against /index.php (wo the .htaccess rewrite).
AND... so the URI::createFromEnvironment() do that, what I wrote: it chunks the part of route which eq the rewrited target directory's name.
Thank you for the help!


Add config support for model composer and quantizer

Done in https://github.com/aifoundry-org/Quant/commit/073dc13edeac8247087f6df8c72e84e842b55ff7


Handle town battles in the battle UI

Towns are currently displayed in battle UIs as #. This should be special-cased and described as a town.

Handled "good enough" in #128


chore(package): update stylelint to version 9.1.1

Closes #96

Peer dependency warnings on yarn install.
stylelint-config-standard ><EMAIL_ADDRESS>expect<EMAIL_ADDRESS>Waiting until stylelint-config-standard and  stylelint-config-recommended get updated to stylelint@^9
yarn install v1.3.2
[1/4] Resolving packages...
[2/4] Fetching packages...
info<EMAIL_ADDRESS>The platform "win32" is incompatible with this module.
info<EMAIL_ADDRESS>is an optional dependency and failed compatibility check. Excluding it from installation.
[3/4] Linking dependencies...
warning "stylelint-config-standard ><EMAIL_ADDRESS>has incorrect peer dependency<EMAIL_ADDRESS>[4/4] Building fresh packages...
Done in 72.44s.


Adds prompts for missing credentials, hostname, and/or namespace

Fixes issue #105.  Also repairs printDeploymentAssets to add parameter.

merged


hotfix: scatterplot labels

Closes list issues numbers here
Developer Checklist (Definition of Done)
Issue

[ ] All acceptance criteria from the issue are met
[ ] Tested in latest Chrome/Firefox

UI/UX/Vis

[ ] Requires UI/UX/Vis review

[ ] Reviewer(s) are notified (tag assignees)
[ ] Review has occurred (link to notes)
[ ] Feedback is included in this PR
[ ] Reviewer(s) approve of concept and design

Code

[ ] Branch is up-to-date with the branch to be merged with, i.e., develop
[ ] Code is cleaned up and formatted
[ ] Unit tests are written (frontend/backend if applicable)
[ ] Integration tests are written (if applicable)

PR

[ ] Descriptive title for this pull request is provided (will be used for release notes later)
[ ] Reviewer and assignees are defined
[ ] Add type label (e.g., bug, feature) to this pull request
[ ] Add release label (e.g., release: minor) to this PR following semver
[ ] The PR is connected to the corresponding issue (via Closes #...)
[ ] Summary of changes is written

Summary of changes

Screenshots
Additional notes for the reviewer(s)

Thanks for creating this pull request 🤗

@dvmoritzschoefl
the fix has a conflict with your previous changes,
could you please test it and let me know if this code doesn't work for you


bump up prometheus operator version

bump up prometheus operator version for https://github.com/sustainable-computing-io/kepler-metal-ci/blob/main/.github/workflows/equinix_k8s_flow.yml#L142

merge as it is for https://github.com/sustainable-computing-io/kepler-metal-ci/pull/61 testing.


Remove uri validation from collectible schema

The uri validation provided by AJV set for uri and imageUri fails on some payloads that should be considered valid
See uri and imageUri fields of the following request https://safe-client.safe.global/v2/chains/5/safes/0x4127839cdf4F73d9fC9a2C2861d8d1799e9DF40C/collectibles

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-0.07%) to 92.038%

Files with Coverage Reduction
New Missed Lines
%

src/routes/transactions/mappers/common/transaction-info.mapper.ts
1
77.59%

Totals

Change from base Build<PHONE_NUMBER>:
-0.07%

Covered Lines:
4146

Relevant Lines:
4393

💛  - Coveralls


How does warp's networking work?

The readme says it doesn't use a central server, how does it work?

From what I understood @nilbot is right that in the code source there is a default address warp.link:4242 but it seems more to be a development thing or a demo thing.
Users can update it by setting the environment var WARPD_ADDRESS.
Once the address updated this way to your own machine public address, clients should be able to connect to the warpd daemon that your machine is running.
Routing, firewalls problems have still to be addressed to my mind.

It may be worth looking at webrtc, there is a golang library  for it (but it does require cgo if i remember correctly) and that gives you nice peer to peer connections.

the WARPD_ADDRESS is a mystery here which I believe does the nat-traversal etc, and it can also record all my screen which is a security concern, what is running at WARPD_ADDRESS?

@nilbot I just tested it from two peers both behind NAT, there is no way it can work without a server in the public domain that knows how to relay the traffic between two peers reliably

I'm talking about NAT-NAT traversal here, which normally needs a third-party server.

Yes I think that it really needs a third-party server too!

warp by default connects to warp.link:4242 (see protocol.go). The server address (running warpd) can be overridden with env variable WARPD_ADDRESS if you want to run your own warpd.


Menu editor

What feature do you want to get added on the base engine?
It would be cool if there was a menu editor
like you could edit menus and add new menu

this is just a ruff sketch of what It could be
To test your sight, and reliability, please select the option of what should NOT be requested.
Useful feature

failed the test

Failed test + useless + probably a lua user :\


api: Add support for Private Network Access header preflight requests

Summary
During development of Algorand smart contracts and platforms users will often run local environments consisting of algod, kmd, and indexer via sandbox or more recently algokit. By default all of these services are running on local/private network addresses (e.g. <IP_ADDRESS>), however popular tools such as DappFlow and Lora are hosted on public network addresses and require the user to specify their local endpoints. Additionally some dapps allow their users to provide their own endpoints for a more decentralised experience.
Schedule for Google Chrome 130 (although many users are already experiencing it), PNA protections will be enabled by default, disallowing public websites from making requests to local/private resources without a specific header response during a preflight request. This PR introduces a new configuration option that will add middleware to the API handler to support responding to the Private Network Access request header.
Test Plan
I've currently just compiled this branch locally and tested it by changing the indexer.yml config and passing the command line flag.

I rebased on the latest main, as the removal of rewind (changing DeveloperMode) had caused some conflicts.


Fix incdirs of src_files.yml

This PR fixes incdirs of src_files.yml.
#570 added  `include "prim_assert.sv", but no incdir added.

Good catch, thanks!


Amazon Fresh and other websites

Thanks for an awesome tool!
Feature request: please could you add Amazon Fresh, Waitrose, etc? I've tried but the js is beyond me. The Tesco bot runs nicely but yielded nought.

Hi Stephen, It would be great to get some more supermarkets added - it took me about a day and half to get Tesco working but I'm sure someone more talented than me could do it in less!
I've had a quick look at Amazon, it's a bit more tricky because you have to put items in your basket and then go through as if you are checking out, but otherwise the process is quite similar.
How long have you had the Tesco bot running for? It took me about a week to get a slot using the tool.

Paul, Andy and everyone else who's contributed: thanks for this awesome tool. But yes, it would be great to have Sainsburys, Asda and Morrisons in the mix.

…it took me about a day and half to get Tesco working…

I'm not up to writing new JavaScript, but would it help you if we outlined the basic procedures for the other supermarkets – a flowchart or pseudcocode, say – and tried to spot any likely issues?

I've had a look at Waitrose and finding it a bit too tricky to do via chrome, as its a single page app backed by a graphql api. I may try and integrate with the api directly instead, which I've grabbed the necessary api calls from

👍 although not a priority for me in the wilds of Norfolk!

Here's a Mac script that someone has written for Amazon Fresh:
https://github.com/ahertel/Amazon-Fresh-Whole-Foods-delivery-slot-finder

…and he's on CNBC, so I wonder how many downloads that's had :-) A masterpiece of AppleScript, which is a pretty opaque language.


FoD on 2022 causes RDP to not work

Microsoft has not responded to the "Feedback Hub" post on this, but in all tests it appears certain that installing this in 2022 is breaking the ability to remote desktop into the servers.
This entire document should be excluded from the 2022 material until Microsoft has resolved this, or until such time as there is an applicable patch/workaround/etc.  Alternatively, a note should be added that it does not work with 2022.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 42e7fb95-09a6-1dec-859a-08261408b289
Version Independent ID: 823213b4-7445-da48-fb1f-82c5e74dc1af
Content: Server Core App Compatibility Feature on Demand (FOD) in Windows Server
Content Source: WindowsServerDocs/get-started/server-core-app-compatibility-feature-on-demand.md
Product: windows-server
Technology: getting-started
GitHub Login: @dknappettmsft
Microsoft Alias: daknappe

Hi @TayschrennSedai. thanks for the feedback. This is a known issue that is being worked on and will be fixed in a Cumulative Update.  As suggested, I have added a note to the article for this, which should be visible later today.
#please-close

Is there an Estimated Time of Arrival for the fix for the known issue with App Compatibility FOD for Windows Server 2022 and RDP connections?

Why is this marked as CLOSED? it has not been fixed or patched - as yet? Or has it?

GitHub issues in this repo are for issues with the documentation, not support for the product itself. The original request here was to make sure the document calls out this issue, which it does and is why this issue has been closed here. I do not have an update for the product issue, please contact Microsoft Support.


PushSecret [Vault provider] - Multiple keys into one secret? (property, dataFrom)

Hello,
I am a bit confused with the way of specifying RemoteRef  for PushSecret.
In documentation there is RemoteRefs [array] which expect list of RemoteKey
But in CRD the schema contains just RemoteRef [object]...
Also there is no way how to enter the property same as in ExternalSecret. How I can then add multiple keys into one HashiCorp Vault secret?
Tried the following code but it creates two separate secrets instead of two keys in one ("credentials") secret.
  selector:
    secret:
      name: credentials # Source Kubernetes secret to be pushed
  data:
  - match:
        secretKey: password1 # Source Kubernetes secret key to be pushed
        remoteRef:
          remoteKey: kv/data/credentials/password1 # Remote reference (where the secret is going to be pushed)
  - match:
        secretKey: password2 # Source Kubernetes secret key to be pushed
        remoteRef:
          remoteKey: kv/data/credentials/password2 # Remote reference (where the secret is going to be pushed)

Also without the property, the whole remoteKey path is then added as the key:

Its probably doable with adding base path into the SecretStore, but then it limits the SecretStore for only one destination...
And last but not least, is it planned to add dataFrom so I can extract all the keys?
Many Thanks!

yes, as of today I think the hashi vault implementation for PushSecret is not the best... what we should be doing is taking for granted that the secret Key itself would be a JSON, and then load it as a single secret in HAshivault.

and, sure, it makes sense to add a dataFrom there :)

thanks for your reply :) I will write a shell script then that can migrate k8s secrets to vault as an temp solution, and will impatiently wait for the PRs :)


docker pull Failure lhwong/kie-workbench-showcase

Expected behavior
I got the docker image
Actual behavior
Client.Timeout exceeded while awaiting headers
Information about the Issue
Operating results environment with other docker image.
Steps to reproduce the behavior

docker pull lhwong/kie-workbench-showcase
Using default tag: latest

Error response from daemon: Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

Please make sure that you're on a stable connection and use a solid DNS such as Google DNS.
Additionally verify that you can pull the image via the cli: docker pull lhwong/kie-workbench-showcase

Thank you for your reply.
My problem was caused by not logging in to the docker HUB.
It was not a problem of DNS and HTTP PROXY.


[BUG] ACSRawIncomingVideoStream CVPixelBuffer glitches

Describe the bug
CVPixelBuffer glitches and shows artefacts when resolution width of the ACSRawIncomingVideoStream isn't multiple of 16
Exception or Stack Trace
Add the exception log and stack trace if available
To Reproduce
Steps to reproduce the behavior:
Send outgoing stream (could be any stream type, raw or not) of any resolution, which width will not be multiple of 16 (e.g. 540x960)
Code Snippet
Add the code snippet that causes the issue.
Expected behavior
Stream should look exactly the same as what we've sent as OutgoingVideoStream
Screenshots
If applicable, add screenshots to help explain your problem.
https://github.com/Azure/azure-sdk-for-ios/assets/141160531/52221a3e-5add-41da-ae9e-b211caf64c90

Setup (please complete the following information):

OS: [e.g. iOS] iOS 16.6.1
IDE : [e.g. IntelliJ] Xcode 14.3.1
Version of the Library used 2.5.1

Additional context
Add any other context about the problem here.
Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

[x] Bug Description Added
[x] Repro Steps Added
[x] Setup information Added

@raosanat can you please take a look?

Additional context
The problem appears both when we're using AVFoundation with AVSampleBufferDisplayLayer and Metal with MTKView to render received CVPixelBuffer from Azure SDK

Could you please try this app on your end and lets us know if that works on your devices
https://github.com/Azure-Samples/communication-services-ios-quickstarts/tree/main/raw-video

Thanks for the answer!
I've tried test app from shared link, but unfortunately this issue could be reproduced here too:
https://github.com/Azure/azure-sdk-for-ios/assets/141160531/13da2b5d-4595-406b-b099-8e932f8c3fc5
To reproduce it I used Microsoft teams(App Store version) from my iPhone 13 Pro Max, iOS 17.3.1

Additional info:
On this video you can see 3 opened application. From left to right: Raw-Video test app on simulator, Teams with opened meeting and our demo application, which is now showing how buffer looks like on our side before we send it
https://github.com/Azure/azure-sdk-for-ios/assets/141160531/b673f10d-e93b-4a8a-a7f3-568ec6511259


v1: compute initial Y, C, D from iniq for CNT

This PR adds the capability to initialize depth, celerity and diffusivity as a function of initial flow conditions in the diffusive CNT model. Prior to this PR, initial flow conditions were being passed from t-route framework and utilized to populate initial flow arrays in the Fortran kernel. However, depth, celerity and diffusivity were being arbitrarily initialized at the first timestep. These changes physically align all initial channel states.

closing. Relevant changes incorporated into #432


Integration of Speech-to-text

Given the deployment to mobile and tablet devices running on Android it would be great to have the ability to use speech-to-text feature. This way, it would be possible to dictate your blog posts rather than typing them.
Eventually, this could be a keyboard-related feature on Android but surely an interesting addition to the pure Markdown based editor.
What's your opinion on that?
Regards, JoKi

Hi @jochenkirstaetter 👋
This is a keyboard feature and already possible to use by enabling it in your phone settings > Languages and Input > Google Voice Typing (might vary depending on your phone manufacturer).

Hi @vickychijwani
Thanks for clarification. I wasn't sure whether it's a built-in feature of the keyboard or not. Even better than.


docs(readme): updated README.md docs and added Docker Compose support

Docker compose support added through a project Makefile which handles launching Madara and pulling in dependencies

Pull Request type

Feature
Documentation content changes

What is the current behavior?

Project readme is severely outdated and contains incorrect information about Madara. This pr brings this up to date with the latest version of Madara, adding more sections, extra information and step by step guides for some key features.
What is the new behavior?

Update the README.md
Added Docker Compose support, you can now easily start and stop Madara with make. See the readme  'Run with Docker' section for more information.

Does this introduce a breaking change?

No

Self-reviewed, seem ok


Edit README.md contents to match contents of Gim

Does not include changes to docs/images/Ui.png

Codecov Report
Base: 72.15% // Head: 72.15% // No change to project coverage :thumbsup:

Coverage data is based on head (4a8c2c1) compared to base (8e99d1e).
Patch has no changes to coverable lines.

Additional details and impacted files
@@            Coverage Diff            @@
##             master      #17   +/-   ##
=========================================
  Coverage     72.15%   72.15%
  Complexity      399      399
=========================================
  Files            70       70
  Lines          1232     1232
  Branches        125      125
=========================================
  Hits            889      889
  Misses          311      311
  Partials         32       32

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


accept multiple ACKs sent in the same packet

Codecov Report

Merging #1684 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff           @@
##           master   #1684   +/-   ##
======================================
  Coverage    87.2%   87.2%
======================================
  Files          97      97
  Lines        6291    6291
======================================
  Hits         5486    5486
  Misses        573     573
  Partials      232     232

Impacted Files
Coverage Δ

internal/ackhandler/sent_packet_handler.go
75.76% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b166757...a4128ed. Read the comment docs.


Do not limit number of groups in combine operator (inter-segments)

Right now we limit number of groups stored both inner-segment and
inter-segments with the same limit. Once the segment results reach
the inner-segment limit, it will also reach the inter-segments
limit after combining the results in the combine operator. This
will cause the new groups from the other segment being dropped.
This might cause inconsistent result depending on the order of
segment execution.
The solution would be, only limit number of groups inside segment
but not inter-segments to get consistent result regardless of the
order of execution. This won't increase the memory cost
significantly because most of the groups stored inner-segment
should be the same.

What about some heuristic like dropping x% of bottom groups each time the limit is reached?
A better alternative is to use penalize groups each time a new group is seen, and then drop the groups that reach zero. This would be costly to implement, and also is known to work mostly on frequency, not sure about aggregation functions such as sum.

@mayankshriv There is no easy way to drop groups since we should drop groups based on the value of the groups. Once we support the normal sql semantic of group-by (keep the same groups for all aggregations and use same key to order them), we can implement what you suggested.

Removing the limit is definitely a concern.
I like @mayankshriv  suggestion of dropping bottom x% every time we reach the limit.  Not sure why this would be expensive.
100k limit for group by is already a  big number. is there a use case that is hitting this limit?
Another naive solution would be to set the Intersegment limit to be double the inner segment limit.

@kishoreg For most of the queries, removing the inter-segments limit won't add new keys because all the keys are common across segments. If keys are not common across segments, then the data is very skewed, thus limiting the key can give very wrong result.
Actually there are several use cases hitting this limit. With this change, at least we can guarantee consistent result running the same query.
The problem with @mayankshriv suggestion is that, as I mentioned, with the current semantic, we don't know how to define the bottom x% if there are multiple aggregations.

I dont understand why someone would be fetching 100k group by values with Pinot. It's definitely not the right use of Pinot.
How about making it configurable and override it as needed. Let's leave the default as it is at 100k for inner and maybe 200k for inter?

@kishoreg I don't believe that users are fetching >100k groups. But given the current implementation, its possible that incorrect group-by results are returned because many groups are not considered.

@sunithabeeram I didn't follow that comment, do you have a concrete example. Let's say user does group by x,y,z. the max cardinality of the group by keys is cardinality(x) * cardinality(y) * cardinality(z).
So the only time we reach this limit is the unique group by keys cross 100k within the segment and 200k across segments.
If our goal is to consider all groups then the only solution is to remove all limits but then we risk one bad query crashing the system.

@kishoreg It's not about fetching 100k groups, it's about there are more than 100k unique groups inside the segment, and we only keep the first 100k unique groups in the memory. The heuristic here is that if the group is not in the first 100k groups, then it's not important and we can drop it. GROUP BY some id can easily reach this limit.
Adding inter-segment limit is unnecessary for most cases, but I can use 2*inner-segment limit for extreme corner cases.

Codecov Report

Merging #4208 into master will increase coverage by 0.01%.
The diff coverage is 66.66%.

@@             Coverage Diff              @@
##             master    #4208      +/-   ##
============================================
+ Coverage     67.11%   67.13%   +0.01%
  Complexity       20       20
============================================
  Files          1035     1035
  Lines         51520    51520
  Branches       7220     7220
============================================
+ Hits          34577    34587      +10
+ Misses        14569    14562       -7
+ Partials       2374     2371       -3

Impacted Files
Coverage Δ
Complexity Δ

...pinot/core/plan/maker/InstancePlanMakerImplV2.java
95.71% <ø> (ø)
0 <0> (ø)
:arrow_down:

...va/org/apache/pinot/core/plan/CombinePlanNode.java
75% <ø> (ø)
0 <0> (ø)
:arrow_down:

...he/pinot/core/operator/CombineGroupByOperator.java
75.58% <66.66%> (-1.17%)
0 <0> (ø)

...er/validation/BrokerResourceValidationManager.java
50% <0%> (-31.25%)
0% <0%> (ø)

...mpl/dictionary/DoubleOffHeapMutableDictionary.java
65.45% <0%> (-7.28%)
0% <0%> (ø)

...e/impl/dictionary/LongOnHeapMutableDictionary.java
82.22% <0%> (-6.67%)
0% <0%> (ø)

.../org/apache/pinot/transport/netty/NettyServer.java
80.8% <0%> (-3.04%)
0% <0%> (ø)

.../impl/dictionary/BaseOffHeapMutableDictionary.java
81.03% <0%> (-2.88%)
0% <0%> (ø)

...manager/realtime/HLRealtimeSegmentDataManager.java
78.35% <0%> (-2.58%)
0% <0%> (ø)

...ot/core/query/pruner/ColumnValueSegmentPruner.java
87.32% <0%> (-1.41%)
0% <0%> (ø)

... and 14 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3cca15f...f48abe7. Read the comment docs.

@kishoreg Can you have another look on the PR?


⚠ Bofrost.fr has degraded performance

In 24152b6, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1294 ms

Resolved: Bofrost.fr performance has improved in 2921a33.


fix/thebe widgets restore

https://github.com/executablebooks/myst-theme/assets/1473646/0ac45c7c-574d-4f61-8b95-437b117ae3b2

Works so well!!


Regex in ext-language_tools.js wrong

The changed regex (from the original ace-repository) cause problems witin our application - point (".") added
var ID_REGEX = /[a-zA-Z_0-9$-\u00A2-\u2000\u2070-\uFFFF.]/;

Why is that point "." added within that regex on line 1367?

Should'nt the "." in the regex be escaped?

Hello @Rob-Rocket,
the point was added, that when using the dynamicAutocompletion you could use a "." as seperator, for example when re-creating a class like autocompletion:
Class A with 2 methods:
a.method1
a.method2
...

What problems is it causing and which version of Ace are you using, as all of my test's went through completely fine (and the language_tools.js change was released with 2.0.0 as far as I remember).

Refernce where people used that code aswell (official Ace Repo)
https://github.com/ajaxorg/ace/issues/1670

Hello F0rce,
I've the same problem as Rob-Rocket, the additional point in the ID_REGEX causes problems with all higher level languages using ace editor. We have implemented an IDE using Ace with an Xtext based JVM integrated language behind. With this change the code completion broke because deriving the correct context is more complex than just looking for point separated junks. Would it be possible to make the ID_REGEX defineable?
Regards, Pythia

Hello @askpythia,
I will tomorrow (as it is super late in Germany) change the regex to escape the .. If it does not break current logic I will build a hotfix asap.
I'll keep you updated.

... or is it possible to use lit-ace together with the latest official ajaxorg/ace-builds together with your Vaadin Component? It seems that the ajaxorg builds have the correct ID_REGEX in ext-language_tools.js ...

Just saw your answer, thank you (from Vienna, also late here :-)

be careful, not escaping but removing. The ID_REGEX should match Identifiers which don't contain "." in their names not calls

Any news?

Sorry @askpythia,
I had my finals exams, and was not being able to test everything out. As a new version of ace was released I will try use some time migrating to the new version and testing out the regex.
Will keep you updated. Really hope it won't take that long...

Hello @askpythia,
as I was investigating this, I came to the conclusion that the "." in the regex makes no difference.
https://regexr.com/6m3f7
As you can see here, it matches the "." character and not every character as you thought. So to keep the current logic and as it is not breaking anything, I will mark this ticket as closed.
Sorry for the long awaited answer.

Sorry for the late answer, but it is the point itself which causes the scope to consume all expressins on the left side including points. In the code lookup itself high level languages navigate from expression to expression (called via ".") by themself. The point at the end causes that a callstack of expressions is handled like one big and that's definitely wrong.
We patched the regexp in node_modules after install (just remove the point) to get it work, but this is not the right way...
If you take the last Version of Ace, please don't add the point again ...

Hei @askpythia,
could you please provide some more information on that (especially on your use-cases) ? I am likely to keep the point in the regex, as in many cases I was able to create a class based autocompletion model (using the dynamic autocompletion I created for ace). And if the seperator is something else then a "." it just seems odd for an IDE.


Conflict when installing cert-utils-operator with other redhat-cop operators ?

I've noticed that having this operator installed with other redhat-cop operators like https://github.com/redhat-cop/resource-locker-operator in the same cluster is causing problems to OLM. The other operators seems to be stuck in Pending state.
Maybe because the SA used is default ? I've noticed that this issue doesn't happen with https://github.com/redhat-cop/namespace-configuration-operator since some days ago the have changed the SA name.

this should be fixed by #87


Module Fields Not Getting Created

Describe the bug
Adding a new module field after module is created doesn't do anything and doesn't report any issues.
To Reproduce

Set module data store to a non-default value. Save.
Add a new field and set type to column
See that the field is added to the module page as well as record page layout.
Editing and saving content in the field is a no-op with no error reported

Expected behavior
Field is created in DB and data is saved. Or at the very least a detailed error is shown with instructions on how to work around current limitations.
Screenshots
See video for full flow. The DB previewer I'm using is Jetbrains.
https://user-images.githubusercontent.com/19151369/194841870-e2a5e56f-25b4-4a05-8544-cc6513a14e1c.mp4

No support for schema modifications right now. Not sure why no error/issues is raised.

The error message doesn't display when there is a value set in 'collection or database table name'. Please see screenshots for blank value and error response.

No support for schema modifications right now. Not sure why no error/issues is raised.

@darh ,
Is there any interest in me providing limited support to schema modification (e.g. only add and delete columns, no renaming)?
I have something like that working locally. But I wanted to ask if this is a type of contribution Corteza would be interested in before I put in the work of a proper PR.

@skamensky i would very much appreciate that! Feel free to open a PR.


To avoid recompute as much as possible.

Currently, any server-side node sends a request to the server every time it is executed. Figure out a way to avoid that as much as possible. This is key to the efficiency of ComfyUI.
Future me, how to make nodes dirty and how to manage the status of all nodes. Think carefully.

In ComfyUI, the server compares the current workflow and the workflow from the last execution. The server search for discrepancy recursively.
Here we are going to do this in Javascript.
Whenever a node is changed, trigger an onChange function, and set all its output nodes to changed, and hence trigger a chain of onChange functions of its following nodes.
When onAction, if the node is not changed, use the cache and move on.
I think that is the basic principle.


Merge open scala-steward PRs?

There are many scala-steward PRs open, with many of them passing CI. Should they be merged? Could we configure scala-steward to automatically merge them if they pass CI?

Would be cool, thinking about it.


MDTextField needs to allow Text Color changes

Description of the Feature
Currently the programmer can not change the TextColor attribute of a MDTextField Object.
Code and Logs
from kivy.app import App
from kivy.lang import Builder

kv = """
Screen:
    # KV-Code
"""

class MainApp(App):
    def build(self):
        self.root = Builder.load_string(kv)

if __name__ == '__main__':
    MainApp().run()

Screenshots
Add images to explain us this feature. Paste urls here.
Remove this section if no images here
Versions

OS:
Python:
Kivy:
KivyMD:

@edwit1971
https://kivymd.readthedocs.io/en/latest/components/text-field/index.html#color-mode
line_color_focus: 1, 0, 1, 1


Need to get codepoint for a specific ligature

Somewhat related to https://github.com/marella/material-icons/issues/32. I now have a need to find the codepoint for a specific icon. Would it be possible to publish codepoints.json in addition to versions.json? I think my other option is to parse the font with fontkit, which seems a bit heavy handed.

I did end up parsing the font to get the list of codepoints, in a package.json postinstall script. It's not great, but it seems to work!


New version: Jackett.Jackett version 0.21.1454

Pull request has been created with WinGet Releaser v2 :rocket:
Microsoft Reviewers: Open in CodeFlow

Automatic Validation ended with:

Installation failed with exit code -1978335187
2023-12-29 08:20:48.627 [FAIL] Installer failed security check. Url: https://github.com/Jackett/Jackett/releases/download/v0.21.1454/Jackett.Installer.Windows.exe Result: 0x80004005

(Automated response - build 508.)

Hi @ilike2burnthing,
The package didn't pass a Defender or similar security scan. This might be a false positive and we can rescan tomorrow.
(Automated response - build 509.)

Definitely a false positive - https://www.virustotal.com/gui/file/316493ac14a72905065d344f886f65909b0e860366e6f4377d53f0a420ff4262

/AzurePipelines run


Fixes spelling in generate help

ClusteRole -> ClusterRole

@austinpray-mixpanel - thanks

@austinpray-mixpanel - thanks


COM-357: Add import source as column in DAM grid

The import source column is only shown if importSourceTypeLabels is provided via DamConfigProvider. This is done to not show the column if no external DAMs are supported.

[x] Add changeset (if necessary)

Alternative to #1697

The import source column is only shown if importSourceTypeLabels is provided via DamConfigProvider. This is done to not show the column if no external DAMs are supported.

What do you think of this automatism?


[Need Help] Alignment and Scroll not work, flet-0.25.*

Previous Flet Version < flet-0.25.0 works normally:

Lastest Version cant alignment and scroll:

Code sample
Code
import flet as ft
from flet_core import MainAxisAlignment, CrossAxisAlignment, ScrollMode

class MainView(ft.View):
    def __init__(self, page: ft.Page, endpoint):
        super().__init__()
        self.page = page
        self.route = f'/{endpoint}'
        self.scroll = ScrollMode.ADAPTIVE
        self.horizontal_alignment = CrossAxisAlignment.CENTER
        self.appbar = ft.AppBar(title=ft.Text(f"Alignment and Scroll not work"))

    def did_mount(self):
        self.page.run_task(self.view_mount)

    def will_unmount(self):
        pass

    async def view_mount(self):
        test_alignment = ft.Row(alignment=MainAxisAlignment.END, controls=[
            ft.Text(f"Alignment not work"),
        ])

        self.controls = [
            test_alignment, *[ft.Text('Scroll not work') for i in range(100)]
        ]

        self.update()

def main(page: ft.Page):
    page.scroll = ScrollMode.ADAPTIVE
    page.horizontal_alignment = CrossAxisAlignment.CENTER
    page.views.append(MainView(page, '/'))
    page.update()

if __name__ == '__main__':
    ft.app(main)

To reproduce
Run the code
Operating System
macOS
Operating system details
MacOS Sequoia 15.1.1
Flet version
flet-0.25.1
Regression
No, it isn't

Solved
Change import from:
from flet_core import MainAxisAlignment, CrossAxisAlignment, ScrollMode
to:
from flet.core.types import ScrollMode, CrossAxisAlignment, MainAxisAlignment

You can also use ft.ScrollMode.


No documentation for older versions

On https://reactjs.org/versions/, versions >=16.9 only display link to changelog, missing link to documentation. Versions <16.9 display both links, but documentation links lead to page not found.

We're tracking this in https://github.com/reactjs/reactjs.org/issues/4306.


Implement FromRequest / ToResponse traits for inputs/outputs/errors.

Add server rejection and error management.
Signed-off-by: Bigo<EMAIL_ADDRESS>Motivation and Context

Description

Testing

Checklist

[ ] I have updated CHANGELOG.md
[ ] I have updated aws/SDK_CHANGELOG.md if applicable

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

The Kotlin code that actually implements the traits for the Smithy types is missing.


Conv operator

I have two questions:
When I read this:
// >>> conv1 = brew.conv(model, data, 'conv1', dim_in=1, dim_out=20, kernel=5)
model.AddConvOps("data", "conv1", 1, 20, 1, 0, 5, test);
What is dim_out? How do I compute it?
Is this operation a 1d convolution? Is there a 2D convolution example?

I believe that this is a 2D Conv. The kernel number define both kernel_h, kernel_w at the same time.
The convolutional operation in default has dimensions of {batch, channel, height, weight}. The "dim_out=20" means that the output channel will be 20.
Overall, this conv1 will take input with {batch, 1, height, weigth} using kernel size 5*5 and generate output with dimension of {batch, 20, height-4, weight-4}
You can also refer to this tutorial:
https://github.com/leonardvandriel/caffe2_cpp_tutorial/blob/master/src/caffe2/binaries/mnist.cc#L47


var [x,y] does not work

JavaScript code
var [childMinHeight, childNaturalHeight] = this._appSwitcher.actor.get_preferred_height(primary.width - hPadding);

is converted to
] = @_appSwitcher.actor.get_preferred_height(primary.width - hPadding)

Yes: redux has started to support es6.
https://github.com/js2coffee/js2coffee-redux/issues/3


Add a button to enable / disable proxy

Hello,
it will be nice to have a simple button to enable or disable proxy.
As I'm switching off or on the proxy depending of my location due to teleworking or not.
For example, the same one that is already available for the CERTIFICATE TRUST just bellow in the same menu will be perfect.
I'm using Lens 5.5.4.
Thanks a lot for your great tool !!!

Thank you for the good enhancement request.


ORA-12564: TNS connection refused when using BuildJDBC

I'm currently facing an issue when trying to connect using BuildJDC function with the a orclNetDescString similar to the following:
DESCRIPTION=(ADDRESS=(PROTOCOL=TCPS)(HOST=host.com)(PORT=port))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=service))(SECURITY=(SSL_SERVER_CERT_DN="CN=cname,O=org,L=location")))
Using the following code
package main

import (
	"database/sql"
	"log"
	"path/filepath"

	_ "github.com/sijms/go-ora/v2"
	go_ora "github.com/sijms/go-ora/v2"
)

func main() {

	desc :=`DESCRIPTION=(ADDRESS=(PROTOCOL=TCPS)(HOST=host.com)(PORT=port))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=service))(SECURITY=(SSL_SERVER_CERT_DN="CN=cname,O=org,L=location")))`

	username := "admin"
	password := "secret"

	walletPath, err := filepath.Abs("wallet")
	if err != nil {
		log.Fatal(err)
	}

	urlOptions := map[string]string{
		"TRACE FILE": "trace.log",
		"AUTH TYPE":  "TCPS",
		"SSL":        "TRUE",
		"SSL VERIFY": "FALSE",
		"WALLET":     walletPath,
	}
	connectString := go_ora.BuildJDBC(username, password, desc, urlOptions)
	db, err := sql.Open("oracle", connectString)
	if err != nil {
		log.Fatal(err)
	}

	err = db.Ping()
	if err != nil {
		log.Fatal(err)
	}

	log.Printf("Connected to Oracle: %s\n\n", connectString)
}

I am getting the ORA-12564: TNS connection refused error.
But when I create a connection string, using the values from the  orclNetDescString, I'm able to connect successfully.
Here's an example:
package main

import (
	"database/sql"
	"log"
	"path/filepath"

	_ "github.com/sijms/go-ora/v2"
	go_ora "github.com/sijms/go-ora/v2"
)

func main() {
	username := "admin"
	password := "secret"

	walletPath, err := filepath.Abs("wallet")
	if err != nil {
		log.Fatal(err)
	}

	connectString := fmt.Sprintf("oracle://%s:%s@%s:%s/%s?SSL=TRUE&SSL VERIFY=FALSE&AUTH TYPE=TCPS&WALLET=%s", username, password, "host.com", "port", "service", walletPath)
	db, err := sql.Open("oracle", connectString)
	if err != nil {
		log.Fatal(err)
	}

	err = db.Ping()
	if err != nil {
		log.Fatal(err)
	}

	log.Printf("Connected to Oracle: %s\n\n", connectString)
}

Any ideas as to what could be causing the ORA-12564: TNS connection refused error when only using BuildJDBC function?

hi @ColinLeeCampbell
remove security section (SECURITY=(SSL_SERVER_CERT_DN="CN=cname,O=org,L=location") and test again

Is there anyway we can look into allowing for the security section? It's need to verify certs.

we will discuss this issue with #517

Custom configuration is supported in v2.8.12


Bug: the highlights tab selection get unselected when we use filters

Describe the bug
the highlights tab selection get unselected when we use filters
https://github.com/open-sauced/insights/assets/18273833/645af6b6-f041-4f84-bb66-15dde667bc04
Steps to reproduce

go to highlights https://insights.opensauced.pizza/feed?repo=griff-m001/Data-Collection-Project
check the highlight tab on the top, the color is orange
select a filter,
check the tab again, the color is black.

Browsers
No response
Additional context (Is this in dev or production?)
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Contributing Docs

[ ] I agree to follow this project's Contribution Docs

May I please work on this issue?

.take


Can I add more pics onto the page?

Hi, @rajaprerak
I love your project and this layout design, so I would like to use this project to put in my own portfolio.
Before my act, I just wonder is that possible to add one or more pics on the pop-up panel after clicking any project instance?
like in here:

Looking forward your reply and thanks in advance~

Hi, same query here, did you manage to put an image/ row of pictures?


There should be a type for composed samplers

Also Sampler, Composite, etc should inherit the correct ABCs.

merged


Dev

Its a Frontend part of 3 screens of Event-Details page
It contains :

Nav Bar
Side Bar
Attendees Section
Photo Section
FAQ
Footer with social media links
For this React with Typescript is used

@BharathGuddadar  add screenshot in the message.

Screenshots of UI

Screenshots of UI


Update make 4.2 -> 4.3

request to update make version

Upgrading requires updating the hash as well. I just pushed a branch that
does this, make-4.3 (currently 2c1946f). Cross compilation is broken in
GNU Make 4.2, so I had a hack to fix it (-Iglob). That seems to be fixed,
so the hack should be removed, too.
Unfortunately GNU Make 4.3 is incompatible with Mingw-w64, so this still
does not work. Otherwise I would have done it already. This version makes
assumptions about fcntl() and dirent that don't hold in Mingw-w64, and so
the build fails. (See my notes in the commit.) It would probably take
substantial patching to fix.
It's quite possible that w64devkit will forever have GNU Make 4.2. "The
devil you know" and all that. It's a feature-complete mature program, and
there is practically no innovation happening in this space. The only
significant future improvements would be better Windows support (e.g.
learning how to deal with PowerShell for SHELL, and its limitations). More
likely I'd replace it altogether with a different make that has reasonable
GNU Make compatibility, enough to work with existing, real world GNU
Makefiles (in Vim, Putty, zlib, etc.).

GNU Make 4.4 recently came out, and this version seems to work well on Windows, so I've merged it as 1000d8e. (The new --shuffle feature is intriguing.)


"Operation not permitted"

New versions of ESXI do not allow root to run scripts from the datastore. Even after making executable this will result in "Operation not permitted" when you attempt to call either of the scripts (locally or remotely via ssh).
If you add the scripts to a new root level folder e.g. "/tools" and make them executable they can be run, but of course this folder and files will not be there after a reboot.
I did try to use the start up script /etc/rc.local.d/local.sh to recreate the directory and copy the files from the data store but this did not appear to run - the folder was not there after a reboot.
Is there a persistent file location that is not on a datastore where the scripts can be kept and where root can run them?
VMware ESXi 8.0.0 build-20513097
VMware ESXi 8.0 GA

That's interesting, thank you very much for the report! I do not have an ESXi 8 machine atm, but will setup one for testing soon.


X-axis and color change

Hi,
Is there any way to change the color as per the requirement,
for example:
My Requirement is

I want the color to be green in the bar chart when the value is less than 1.25
I want the color to be orange in the bar chart when the value is 1.25 to 2.5
I want the color to be Red in the bar chart when the value is 2.5 to 3.75
I want the color to be black in the bar chart when the value is 3.75 to 5

Is this possible, If possible please let me know.
then I also want to Define the x-axis value in the bar chart, can I define it with my own values, Just started to use your chart work. If there is any example for this please link it here.
I'm a beginner, If anything I have asked is wrong, I'm sorry.

You can use lambda expression to change the colors in a bar chart. The second part I think it is not possible. If you have an example in JavaScript, I can add more properies.


add addons files in /lib/addons folder

Many examples are using p5.dom.js that should b present in /lib/addons/ folder.

PRIMARY
simply paste a p5.dom.js file into that folder
ADVANCED
figure out a way to load p5.dom.js file from npm as we are doing with p5.js file.

hi @endurance21 the p5.dom.js was deprecated, and all its functionalities are now in p5.js, so we shouldn't have any p5.dom.js file or dependency.
my guess is that if we delete any link to p5.dom.js in the examples, they should work now :)

yes , i just saw the same.
Thanks for confirming it

i am modifying this issue by then

Hey @endurance21!! I'd like to work on

Hey @endurance21 !!
I'd like to work on this issue.

So,
All I have to do is remove the links to p5.dom.js library in all html files in examples. Right?

hi @satyasaibhushan thanks so much for your help! :)
these are my suggested steps:

make a list of the examples that are trying to import p5.dom.js
go through them and see if they are broken / how
remove the p5.dom.js reference
i'm not sure how the examples are linked to p5.js, maybe check other examples? maybe all examples have a link to p5.js, maybe the link is there but it is pointing to an older version of p5.js and that needs to be updated to the latest one?
make sure the example is working
create pull requests, i would make first one PR with one example, to see if the code compiles, the website works, and then small batches of them, because a PR with hundreds of files it's harder to review :)

feel free to ask here any doubt ~

Hey @montoyamoraga !! thank you for your quick response.

I think that all the examples are importing the p5.dom.js library through html itself
I modified first 5 examples (starting from amplitude_analysis ) and they had a 404 error which is fixed by removing the import script statement and worked well with no errors
So, I'm creating a PR

please correct me if I am doing something wrong

So, May I do all the examples similarly (but like 20 examples at once) ?

hi @satyasaibhushan i merged your PR, it was great, now let's check on the website if everything is OK, and if so, i say you can do even more examples at once, maybe all of them? it's only one line that you are deleting and i will take care of reviewing the PR :)
also now i will do a PR on p5.js to add you as a contributor, on it

hi @satyasaibhushan
the examples are showing great for me at
https://processing.github.io/p5.js-sound/
so please go ahead and change the rest of them :)


Motion #256 | KodaDot NFT Explorer | Intake review observations

As discussed, Motion #256 | KodaDot NFT Explorer | Treasury Intake review observations are captured in below review report.
https://docs.google.com/document/d/1BhHwDe_jVu_sp64psIyCWAcAjKfNOkrO88Uh8_veOIE/edit?usp=sharing

Awesome work @rajesh-nodle
I'm missing info for this figure

Morever, Issue no. 5 was fixed in #362

Briefly run over issues linked doc, seems all of them are fixed, tentatively closing.
@rajesh-nodle please reopen if you don't agree. Happy to collaborate and fix if I missed some.


Usage in Chrome Extension

Hi there!
Thank you for creating this repo. I have a question around usage of this library in a Chrome Extension.
I am using a React/Typescript setup for my extension.
Here is what my manifest.json file looks like.
{
    "version": "1.0.0",
    "manifest_version": 3,
    "name": "React Chrome Extension",
    "description": "This is a Chrome extension built with React and TypeScript",
    "action": {
        "default_popup": "dist/js/index.html",
        "default_title": "React Chrome Extension"
    },
    "background": {
        "service_worker": "background.js"
    },
    "permissions": [
        "identity",
        "identity.email"
    ],
    "host_permissions": [
        "https://www.googleapis.com/"
    ],
    "key": "HIDDEN",
    "content_security_policy": {
        "extension_pages": "script-src 'self'; object-src 'self'; script-src-elem 'self' 'unsafe-inline' https://accounts.google.com/gsi/client;"
    }
}

Here is my App.tsx file:
import { GoogleOAuthProvider, GoogleLogin } from '@react-oauth/google';
import { useEffect } from 'react';

function App() {
  useEffect(() => {
    const loadGoogleScript = () => {
      const script = document.createElement('script');
      script.src = '../public/google_client.js'; // due to the CSP issue, i have downloaded the contents of https://accounts.google.com/gsi/client into a local file called google_client.js and am referencing that in <script> in my index.html file
      script.async = true;
      script.defer = true;
      document.body.appendChild(script);
    };

    loadGoogleScript();
  }, []);

  return (
    <GoogleOAuthProvider clientId={CLIENT_ID}>
      <div className="App" style={{
        height: '100vh',
        width: '300px',
      }}>
      <GoogleLogin onSuccess={(res) => console.log(res)} />
      </div>
    </GoogleOAuthProvider>
  );
}

export default App;

When the extension loads, it looks like the  component doesn't get rendered properly, when I go to inspect the element, it seems to only show an empty div with a height of 40px.
I'd appreciate any thoughts / suggestions on what the issue may be! Thank you.

I have the same problem @ChenCodes @MomenSherif Any idea what to do here for the component to render, or when using the
const login = useGoogleLogin({
		onSuccess: (tokenResponse) => {
			return console.log(tokenResponse);
		},
		flow: "auth-code",
	});

there is nothing happening when clicking a button that calls this

the same @flazouh there is nothing happening when clicking a button that calls this
Non-OAuth Error: _.rj {message: 'Popup window closed', stack: 'Error: Popup window closed\n    at new _.rj (https:… (https://accounts.google.com/gsi/client:223:551)', type: 'popup_closed'}
i tried every thing that i found
last one
server: { headers: { "Cross-Origin-Opener-Policy": "same-origin-allow-popups", "Cross-Origin-Embedder-Policy": "require-corp", }, },


Tasks built based on coding challenges

We can use the task description of coding challenges (the ones that are relatively simple to understand for avg humans) and create input/output instances based on the solution program.
https://leetcode.com/
https://www.codechef.com/problems/school
https://edabit.com/challenges

FYI: @DZuoShi

FYI: @maykillmore

This may also be helpful or relevant, though it is pseudocode to code and could also go vice versa: https://sumith1896.github.io/spoc/
Time to make our own OpenAI Codex lol.

Yes I'll start working on this. Just submitted a big assignment for 515 and
I can get on this.
On Fri, 3 Sep, 2021, 8:27 pm Eshaan Pathak, @.***>
wrote:

This may also be helpful or relevant, though it is pseudocode to code and
could also go vice versa: https://sumith1896.github.io/spoc/
Time to make our own OpenAI Codex lol.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/allenai/natural-instructions-expansion/issues/127#issuecomment-912899591,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AFNAUHA7PIYHATIA5OK7DIDUAGG2PANCNFSM5C3VGFOQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

I guess @Ravsehajsinghpuri is also working on it.

Make sure to create a PR soon so that your tasks get registered.
Note that, if multiple people create the exact same task, we usually accept the PR created first and ask the other person to change their PR.


NLP Pytorch fixes and improvement: JIT, torchtext preprocessing, other fixes

This is commit on pytorch NLP example, focusing on implementation of torch.jit to avoid hardcoding net shape on inference, changing keras text preprocessing to torchtext, and other minor fixes.

There was a bug in the code. Will raise another pull request with the fix


Add user data extraction feature

This commit adds a new feature to extract user statistics, including top questioners and repliers, from the chat data.

Adding features accepted.


[OneExplorer] Open ConfigEditPanel by clicking

This commit enables users to open ConfigEditPanel by clicking
the .cfg file on OneExplorer view.
ONE-vscode-DCO-1.0-Signed-off-by: Dayoung Lee<EMAIL_ADDRESS>

This PR may be conflict with #553 because of including same commit...?

@llFreetimell That's true. I put it to have approvals concurrently.

Then please put no merge lable until #553 is merged so that reviewers do not need to be curious about the order.

My mind was in a hurry that I thought today was the demo day.
I will split prs on the previous one.
PTAL this first.


How could I run this as a part of an Android app?

The readme mentions android, is it just to indicate  that the html elements are prepped to display well on mobile devices, or has this library been tested with a backend running on Android, if so, are there any example projects?

HI @ItsCubeTime ...
Here is a recipe/example to transform your "htag app" (you main component) into an android/apk.
https://github.com/manatlan/htagapk
Here is the "htag app" : (here, the App'Class)
https://github.com/manatlan/htagapk/blob/main/app/main.py
It's runned in an AndroidApp Runner.
see https://github.com/manatlan/htagapk/blob/227d9c01ed0c0261947c34f749bd5a540d0a0345/app/main.py#L82
Here ... the APK is builded by a CI/CD github action :
https://github.com/manatlan/htagapk/blob/main/.github/workflows/build.yml
But you could build it locally, using kivy/buildozer (see readme)
The AndroidApp runner, is a bit like the BrowserHTTP runner ..... but will use kivy to start an webview intent to display the GUI on the android device, and will run a http/server in a android thread, to interact with the UI in the webview.
So it makes an (13Mo) APK which embbed everything to be runned in the android.


Sequence (and Serial) support

Add support for serials (and sequences).
We initially won't support altering sequences, but this should unblock some folks, since serials are frequently used.

Sequence support added in PR above


Misspelled names in annotations.SecurityDefinition

annotations.SecurityDefinition contains two misspelled method names:

apiKeyAuthDefintions should be apiKeyAuthDefinitions
basicAuthDefinions should be basicAuthDefinitions

Yikes.  If you have time, please send a PR that adds the new methods and deprecates (but leaves present) the old.  We'll have to make some adjustments in the Reader to ensure that the annotation values are both considered.
This will ensure it's address in the next major version

Ok, see #1919 (untested)


Add Stripe client-side validate features

https://stripe.com/docs/stripe.js#card-validation-helpers

validateCardNumber
validateExpiry
validateCVC
etc.

Hey @fxlemire ,
I will add these methods for the next release.

Awesome, thanks!

The validation methods are now available in version 1.3.0 of this plugin.


Fix one page bug

The options.page option only works on multipage PDFs.  Although pdf2img can convert single page documents when the option is not set, setting it to 1 makes it run into an off-by-one error and fail. I've corrected the check my changing < to <=.

@fitraditya any chances for this to be merged in? I wouldn't like to have to use own fork / write workarounds for this.

add dependencies in your package.json

"dependencies": {
    "koa": "^2.5.0",
    "koa-multer": "^1.0.2",
    "md5-file": "^4.0.0",
    "shelljs": "^0.8.1",
    "pdf2img": "git@github.com:lever/node-pdf2img.git" // add this
  },

and npm install or yarn


Updated documentation and feature files for examples

Most cases wrong groupId. Changed from org.apache.camel to org.apache.camel.example.

Thanks!


Different connectivties and UMAP if using data in X or obsm

[ x] I have checked that this issue has not already been reported.
[ ] I have confirmed this bug exists on the latest version of scanpy.
[ ] (optional) I have confirmed this bug exists on the master branch of scanpy.
Version: '1.8.0.dev70+g560bd5d3'

I have made adata with same data in X and obsm. Then I used either of those two matrices for neighbours and subsequent UMAP. The connectives and UMAPs however look different despite same starting data (does not seem to be due to randomness as I get same UMAPs with same representations on multiple runs).
# Adata
adata_pb=sc.AnnData(latent_pb)
adata_pb.obsm['X_integrated']=latent_pb

# From rep=X
sc.pp.neighbors(adata_pb,n_pcs=0,use_rep='X')
c_x=adata_pb.obsp['connectivities']
sc.tl.umap(adata_pb)
rcParams['figure.figsize']=(6,6)
sc.pl.umap(adata_pb)

# From rep=obsm
sc.pp.neighbors(adata_pb,n_pcs=0,use_rep='X_integrated')
c_o=adata_pb.obsp['connectivities']
sc.tl.umap(adata_pb)
rcParams['figure.figsize']=(6,6)
sc.pl.umap(adata_pb)

np.allclose(c_x.A, c_o.A)
False

Hm, i will check.

I can't reproduce the problem, for me the connectivities are the same.


Add Unspent Capacity

The value of coinjoin outputs that are still unspent.

No function on Dumplings for this yet.

There is, you might need to update your dumplings repo
https://github.com/nopara73/Dumplings/commit/7bb72f37a4aae3b92ef0c7bdd9aa160ab2843aac

True!
CalculateUnspentCapacity(RPCClient rpc)

If you need this progress through the RR board.

Done?

Done?

Not yet.

A timer has been set to save and upload UnspentCapacity daily. They are accessable on Miranda.

@CAnorbo please add the UI

@CAnorbo please add the UI

No data yet, in the database so we have to wait until tomorrow.

What's up with this? Done?

Yes on my part.

Done.


Add OpenOCD package for all platforms

Current one comes from MounRiver Studio and is Windows-Only. Seems to be a custom fork of OpenOCD with "wch-link" support that is not in mainline. Must be added for all operating systems.

The packages have been submitted to the PIO Registry for review under the community-ch32v organization and are waiting for approval.

All but darwin_arm64 have been accepted into the registry.


Added scope :near! for strict results

Provide strict scope :near! for ActiveRecord::Base instance methods
Current method implementation with invalid location input.
Address.near("New York, VA").to_sql
# => "SELECT addresses.*, NULL::text AS distance, NULL::text AS bearing FROM \"addresses\"  WHERE (false)"

New method with invalid location input.
Address.near!("New York, VA").to_sql
#Geocoder::InvalidLocation: The provided location didn't return as valid

If patch #1004 gets accepted I can modify this to not check for nil as well.

Since all good pull requests require tests - here's mine:
gem 'activerecord', '<IP_ADDRESS>'
require 'active_record'
require 'minitest/autorun'
require 'logger'

#Ensure backward compatibility with Minitest 4
Minitest::Test = MiniTest::Unit::TestCase unless defined?(Minitest::Test)

# This connection will do for database-independent bug reports.
ActiveRecord::Base.establish_connection(adapter: 'sqlite3', database: ':memory:')
ActiveRecord::Base.logger = Logger.new(STDOUT)

ActiveRecord::Schema.define do
  create_table :addresses, force: true  do |t|
    t.text     "city"
    t.text     "state"
    t.text     "postal_code"
    t.float    "latitude"
    t.float    "longitude"
  end
end

module Geocoder
  module Railtie; end
end
require 'geocoder'
ActiveRecord::Base.extend(Geocoder::Model::ActiveRecord)

class Address < ActiveRecord::Base
  geocoded_by :string_of_address
  after_validation :geocode

  def string_of_address
    [[city,state].join(","), postal_code].join(" ")
  end
end

class ScopeTest < Minitest::Test
  def test_this_passes
    assert Address.send(:near!, "New York, NY").to_sql
  end

  def test_this_does_not_pass
    assert_raises Geocoder::InvalidLocation do
      Address.send(:near!, [1,1,1,1,1]).to_sql
    end
  end
end

And the results are:
-- create_table(:addresses, {:force=>true})
D, [2016-03-18T17:21:33.724319 #2839] DEBUG -- :    (0.7ms)  select sqlite_version(*)
D, [2016-03-18T17:21:33.725098 #2839] DEBUG -- :    (0.3ms)  CREATE TABLE "addresses" ("id" INTEGER PRIMARY KEY AUTOINCREMENT NOT NULL, "city" text, "state" text, "postal_code" text, "latitude" float, "longitude" float)
   -> 0.0070s
Run options: --seed 61835

# Running tests:

..

Finished tests in 0.117916s, 16.9612 tests/s, 16.9612 assertions/s.

2 tests, 2 assertions, 0 failures, 0 errors, 0 skips

And to test them you need to have this in the Gemfile
gem 'activerecord', '<IP_ADDRESS>'
gem 'minitest'

I understand your motivation here, but I don't think this is a good idea for at least a couple of reasons:

Elsewhere in the gem, an unsuccessful geocode is not considered an error-worthy condition. If we want to change that, we should change it everywhere (and introduce other ! methods that raise exceptions in similar conditions, like Geocoder.search!), and I don't think the use cases warrant that kind of change.
This method is only relevant to the least common (and least recommended) way of calling near, which is to pass an un-geocoded string as a center point. I don't like the idea of introducing a method that will encourage a style of usage that's not really recommended (because results of the API call are lost after the query is run).

Sorry!


Update README.md

I think these minor changes fix a few typos in the README

Thanks for building it :)


Test Run on GPU

Goal: Double check that the current code works on a single machine with multiple (Ampere) GPUs

This might be related to the jax version I am using. I would try reinstalling Jax for GPU specifically.

After I reinstall Jax for CUDA 11, it would now recognize GPU as the backend.
>>> import jax
>>> jax.default_backend()
'gpu'

I consistently encountered this issue in both the NLP Cluster and GPU on GCP:
python examples/gpt2_example.py --config_path config/gpt2_small.yaml --trainer.checkpointer.base_path gs://levanter-checkpoints/gpt2/ --trainer.checkpointer.save_interval 60m
Traceback (most recent call last):
  File "/sailhome/ivanzhou/dev/levanter/examples/gpt2_example.py", line 12, in <module>
    import haliax as hax
  File "/sailhome/ivanzhou/dev/levanter/src/haliax/__init__.py", line 6, in <module>
    import haliax.random as random
  File "/sailhome/ivanzhou/dev/levanter/src/haliax/random.py", line 15, in <module>
    from .partitioning import auto_sharded, physical_axis_name, physical_axis_size, pspec_for_axis
  File "/sailhome/ivanzhou/dev/levanter/src/haliax/partitioning.py", line 13, in <module>
    from jax.interpreters.pxla import PartitionSpec
ImportError: cannot import name 'PartitionSpec' from 'jax.interpreters.pxla' (/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/interpreters/pxla.py)

'PartitionSpec' is indeed not from 'jax.interpreters.pxla' in the latest Jax code. I suspect it is a version issue.

This issue might be from the CUDA toolkit version on the nlp cluster:
The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/sailhome/ivanzhou/dev/levanter/examples/gpt2_example.py", line 295, in <module>
    main()
  File "/sailhome/ivanzhou/dev/levanter/src/levanter/config.py", line 585, in wrapper_inner
    response = fn(cfg, *args, **kwargs)
  File "/sailhome/ivanzhou/dev/levanter/examples/gpt2_example.py", line 85, in main
    data_key, loader_key, model_key, training_key = jrandom.split(jrandom.PRNGKey(seed), 4)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/random.py", line 137, in PRNGKey
    key = prng.seed_with_impl(impl, seed)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 320, in seed_with_impl
    return random_seed(seed, impl=impl)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 734, in random_seed
    return random_seed_p.bind(seeds_arr, impl=impl)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/core.py", line 380, in bind
    return self.bind_with_trace(find_top_trace(args), args, params)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/core.py", line 383, in bind_with_trace
    out = trace.process_primitive(self, map(trace.full_raise, args), params)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/core.py", line 790, in process_primitive
    return primitive.impl(*tracers, **params)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 746, in random_seed_impl
    base_arr = random_seed_impl_base(seeds, impl=impl)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 751, in random_seed_impl_base
    return seed(seeds)
  File "/nlp/scr/ivanzhou/miniconda3/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 980, in threefry_seed
    return _threefry_seed(seed)
jaxlib.xla_extension.XlaRuntimeError: INTERNAL: nvlink exited with non-zero error code 256, output: nvlink fatal   : Input file '/tmp/ivanzhou/tempfile-jagupard30.stanford.edu-c0a9f660-922442-5fd413e18fe99.cubin' newer than toolkit (118 vs 111)

Changed to GCP -- received the following error:
Traceback (most recent call last):
  File "/home/ivanzhou/levanter/examples/gpt2_example.py", line 295, in <module>
    main()
  File "/home/ivanzhou/levanter/src/levanter/config.py", line 585, in wrapper_inner
    response = fn(cfg, *args, **kwargs)
  File "/home/ivanzhou/levanter/examples/gpt2_example.py", line 85, in main
    data_key, loader_key, model_key, training_key = jrandom.split(jrandom.PRNGKey(seed), 4)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/random.py", line 155, in PRNGKey
    key = prng.seed_with_impl(impl, seed)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 369, in seed_with_impl
    return random_seed(seed, impl=impl)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 650, in random_seed
    return random_seed_p.bind(seeds_arr, impl=impl)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 662, in random_seed_impl
    base_arr = random_seed_impl_base(seeds, impl=impl)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 667, in random_seed_impl_base
    return seed(seeds)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/prng.py", line 896, in threefry_seed
    return _threefry_seed(seed)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/traceback_util.py", line 166, in reraise_with_filtered_traceback
    return fun(*args, **kwargs)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/pjit.py", line 249, in cache_miss
    outs, out_flat, out_tree, args_flat = _python_pjit_helper(
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/pjit.py", line 160, in _python_pjit_helper
    out_flat = pjit_p.bind(*args_flat, **params)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/core.py", line 2647, in bind
    return self.bind_with_trace(top_trace, args, params)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/core.py", line 383, in bind_with_trace
    out = trace.process_primitive(self, map(trace.full_raise, args), params)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/core.py", line 790, in process_primitive
    return primitive.impl(*tracers, **params)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/pjit.py", line 1193, in _pjit_call_impl
    return xc._xla.pjit(name, f, call_impl_cache_miss, [], [], donated_argnums,
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/pjit.py", line 1177, in call_impl_cache_miss
    out_flat, compiled = _pjit_call_impl_python(
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/pjit.py", line 1113, in _pjit_call_impl_python
    always_lower=False, lowering_platform=None).compile()
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/interpreters/pxla.py", line 2319, in compile
    executable = UnloadedMeshExecutable.from_hlo(
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/interpreters/pxla.py", line 2638, in from_hlo
    xla_executable, compile_options = _cached_compilation(
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/interpreters/pxla.py", line 2551, in _cached_compilation
    xla_executable = dispatch.compile_or_get_cached(
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/dispatch.py", line 497, in compile_or_get_cached
    return backend_compile(backend, computation, compile_options,
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/profiler.py", line 314, in wrapper
    return func(*args, **kwargs)
  File "/opt/conda/envs/levanter/lib/python3.10/site-packages/jax/_src/dispatch.py", line 465, in backend_compile
    return backend.compile(built_c, compile_options=options)
jax._src.traceback_util.UnfilteredStackTrace: jaxlib.xla_extension.XlaRuntimeError: FAILED_PRECONDITION: DNN library initialization failed. Look at the errors above for more details.

@julian-q you saw this issue before I think? I think it's version mismatch

what's the error that comes before that error? how are you installing jax?

I installed jax for GPU with this:
pip install "jax[cuda11_cudnn82]" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html

This will install the latest version, which is 0.4.11. I need to use this branch to run with the latest version: https://github.com/stanford-crfm/levanter/pull/179

Ok, yeah. Jax changed the instructions nad I think that you're just getting
a silent failure. Try this:
https://github.com/google/jax#pip-installation-gpu-cuda-installed-via-pip-easier
pip install --upgrade pip
CUDA 12 installation
Note: wheels only available on linux.
pip install --upgrade "jax[cuda12_pip]" -f
https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
CUDA 11 installation
Note: wheels only available on linux.
pip install --upgrade "jax[cuda11_pip]" -f
https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
On Sun, Jun 4, 2023 at 2:13 PM Ivan Zhou @.***> wrote:

I installed jax for GPU with this:
pip install "jax[cuda11_cudnn82]" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
This will install the latest version, which is 0.4.11. I need to use this
branch to run with the latest version: #179
https://github.com/stanford-crfm/levanter/pull/179
—
Reply to this email directly, view it on GitHub
https://github.com/stanford-crfm/levanter/issues/177#issuecomment-1575727229,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAACLIIIMJECWJCLU3HYCF3XJT3ADANCNFSM6AAAAAAYZQ5III
.
You are receiving this because you commented.Message ID:
@.***>

I think the mismatch is between Jax and cuDNN. The latest jax 0.4.11 works with CUDA 11 and cuDNN 8.6. However, in my GCP instance, I have CUDA 11.6 and cuDNN 8.2. This caused mismatch.
Only jax 0.4.8 was compatible with cuDNN 8.2, but jax 0.4.8 won't work for our codebase.
Therefore, a viable approach is for me to upgrade cuDNN from 8.2 to 8.6.

After switching to nvidia-ai-enterprise-vmi-1-vm image with CUDA 12, I was able to launch a training job successfully!
https://wandb.ai/stanford-mercury/levanter-examples/runs/f22i92qs?workspace=user-ivanzhou
🎉

I tested on a GCP instance with 2 A100s. Both GPUs are occupied:


[SMALLFIX] workaround bulk delete limitation

Added a workaround for S3 compatible UFS with no bulk delete support.

@calvinjia @madanadit PTAL.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/18136/
Test PASSed.

Merged build finished. Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/18138/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/18140/
Test PASSed.


Inkrato API node module

I'm happy to make a wrapper for the Inkrato http API if you think it is worth the time?

That's a great idea! I'd happily fix up the API too if you have any recommendations (I'm aware there are things missing I'd like to add). - I'd love to chat to you about this over coffee if you are free some time!

Absolutely, I'm fairly busy for the next few weeks, but it'll be good to catch up! I'll send an e-mail when I'm free!


Fix ffi compilation on macOS

This problem was added in #294 . I don't know why CI didn't cache it. Maybe the --scard feature wasn't turned on during compilation on macOS/Linux

Maybe the --scard feature wasn't turned on during compilation on macOS/Linux

https://github.com/Devolutions/sspi-rs/blob/dc61d98d1398b1dc5d310ade6d391c07b572720d/.github/workflows/ci.yml#L36-L43 and https://github.com/Devolutions/sspi-rs/blob/dc61d98d1398b1dc5d310ade6d391c07b572720d/.github/workflows/ci.yml#L65-L76
Let's enable this feature on Linux and macOS.


1029 infura p2

:clipboard: Add associated issues, tickets, docs URL here.
Overview
Describe what your Pull Request is about in a few sentences.
Changes
Describe your changes and implementation choices. More details make PRs easier to review.

Change 1
Change 2
...

Testing
Describe how to test your new feature/bug fix and if possible, a step by step guide on how to demo this.

Coverage decreased (-24.8%) to 60.234% when pulling 2a191e2c2b152a5446deedbb3eb0fad7f7bd01dd on 1029-infura-p2 into 05844948fad1bad391f8688e9420eeba67c616bc on master.

To deploy with infura support, ETH_NODE environment variable needs to be set to infura and PRIVATE_KEY environment variable needs to be set to whatevertheprivate key is.


arcade colliders take gameobjects, not arcade bodies

This PR (delete as applicable)

Updates the Documentation

Describe the changes below:
Adding an Arcade Physics Collider was throwing an error because it expected the passed objects to be Arcade Bodies (which is incorrect since you can pass in groups, arrays, tilemap layers, etc). This PR updates the param types for that method (and a couple of others) to match the param types of the Arcade World's collideObjects function, which takes in GameObjects instead.

Ah hold up a sec, they actually take Phaser.GameObjects.GameObject | Phaser.GameObjects.GameObject[], i'll update the PR in a little bit.


[CHORE] Update gems 2024-06-12

Description of change
Gem updates based on Snyk/Depandabot recommendations
Link to relevant ticket
NA
Notes for reviewer

Works on my machine
Updatede brakeman warnings which were outofdate
Updated govuk-frontend manually

Nice syntactic sugar change forced by rubocop to Prometheus SQL queries - seem to be identical:

Looks good and working on my machine 👍


Possible dangling raw pointers

          In other methods, you copy the `self.scip` pointer. Do you have a guarantee that you don't have any other references to it anywhere else when you get there ?

A quick look seems to indicate that one could drop the model but keep variables, or a solution, that still contain a pointer to the scip struct.
You should probably be more careful with copying raw pointers. At least, write a comment explaining why you think it's safe every time. At best, just never do it, make a single rust struct for each type of C pointer, and then manage that memory with traditional rust memory management.
Originally posted by @lovasoa in https://github.com/mmghannam/russcip/pull/13#discussion_r1111264447

Fixed in #20

Let's maybe add more tests before marking this as closed ? A quick look at the code doesn't seem like it is really guaranteeing correct memory management. If the current logic is perfectly sound, maybe add some comments to explain what are the invariants and how they are enforced ?

Update: Added a memory leak test to CI in #26


Add AbstractStringAssert#asInstanceOf(Class<? extends Number>, ...)

Summary
Please forgive me If this issue is already fulfilled or not appropriate.
I just faced a situation that I need to assert an actual of String against an expected of int.
String actual = calculate();
int expected = 1;
assertThat(actual).isNotNull().satisfies(v -> {
    assertThat(Integer.parseInt(v)).isEqualsTo(expected);
});
assertThat(actual).isNotNull()
        .asInstanceOf(new InstanceOfAssertFactory<>(String.class, v -> assertThat(Integer.parseInt(v))))
        .isEqualTo(expected);

Example
Do I have an already existing handy idiom or do I have any chance to get following one?
String actual = calculate();
int expected = 1;
assertThat(actual).parsesAsInt().isEqualsTo(expected);
 // <N extends Number, A extends NumberAssert<?, N>> A asInstanceOf(Class<N>, Class<A>)
assertThat(actual)
        .asInstanceOf(Integer.class, AbstractIntegerAssert.class)
        .isEqualTo(expected);
 // AbstractIntegerAssert<?> asInstanceOfIntegerAssert()
assertThat(actual)
        .asInstanceOfIntegerAssert()
        .isEqualTo(expected);

Thanks.

I don't think asInstanceOf is a good fit for your target.
Probably a combination of assertThatObject and extracting(Function) is more readable:
assertThatObject(actual)
  .isNotNull() // will be done implicitly in `extracting` with 3.23.0
  .extracting(Integer::parseInt)
  .isEqualTo(expected);

We could think about adding transformation methods to AbstractStringAssert as shortcuts for extracting use cases, like:

asInteger() as shortcut for .extracting(Integer::parseInt, InstanceOfAssertFactories.INTEGER)
asLong() as shortcut for .extracting(Long::parseLong, InstanceOfAssertFactories.LONG)
and so on.


Please provide static build for windows-arm64, linux-arm64, darwin-x86

Is your feature request related to a problem? Please describe.
Please provide static build for windows-arm64, linux-arm64, darwin-x86
Describe the solution you'd like
Additional context
I am developing x-cmd. It would be nice to have 'x tcping' so user can use tcping without installation in (mac, win, linux) x (arm64, x86) ~
Later, x-cmd will support (openbsd, freebsd, netbsd) ~
Thank you.

Hi,
Sure, will include those as well.

Hello there,
In #245 I'm rewriting the Makefile, which will make it convenient to add new targets. So I've been asked to accommodate your requests.
Just want to double check with you though, by darwin-x86, are you absolutely sure you mean 32-bit Intel MacOS? As far as I can tell, these Macs were only made for a very brief period of time back in 2006 or something. I am hesitant to add support for such an old and obscure target without a very compelling reason.

Hello there,
In #245 I'm rewriting the Makefile, which will make it convenient to add new targets. So I've been asked to accommodate your requests.
Just want to double check with you though, by darwin-x86, are you absolutely sure you mean 32-bit Intel MacOS? As far as I can tell, these Macs were only made for a very brief period of time back in 2006 or something. I am hesitant to add support for such an old and obscure target without a very compelling reason.

Hi ~ Thank you !
No, we just need arm64 and amd64 for macOs.

Yep no worries!

Thank you both @cyqsimon and @edwinjhlee.
The requested binaries are now uploaded in https://github.com/pouriyajamshidi/tcping/releases/tag/v2.6.0

Can you provide more build for other system/arch ?
Like this: https://github.com/junegunn/fzf/releases/tag/v0.55.0
Currently, x-cmd pkg is not providing tools to openbsd/freebsd/netbsd ~ But x-cmd script code can run on bsd series OS ~~ In the future we would like to do that ~
I assume that tcping can run across all mainstream platform (*bsd, linux, win, mac) x (arm64, x64) ~

I am novice user in bsd. I have set up some bsd vm ( freebsd, openbsd ). I can help testing tcping on bsd ~

I found these bsd artifcats and darwin-x64 and win-amd64 are already created in the Makefile. Will they be uploaded ? @pouriyajamshidi

@edwinjhlee  yes, I will put them up. But not all of them just yet, because I need to change some details in the README file first since this will mess with the way download links are provided.

@pouriyajamshidi
We add tcping in x-cmd pkg: https://x-cmd.com/pkg/tcping

While developing a shell wrapper to visualize ping output, I discovered I could also perform TCP pings using curl. So I wrote tping module in x-cmd. The introduction and code is here: https://x-cmd.com/mod/tping
However, currently this approach has limitations.
I'm curious if there are any plans/roadmap to implement visualization features directly within tcping.  I'm hesitant to introduce visualization through a shell wrapper, as this might conflict with future tcping development.

Thank you.

Hey @edwinjhlee
There will be a new release in January and all binaries will be provided.
Waiting on CSV PR to be merged.

Happy to update the Chinese translation in README for new releases - just ping me ~

Thanks a lot. Will do.