Integration_testing: Platform.environment is empty

Steps to Reproduce

Create integration test, using the following code:

import 'dart:io' show Platform;
import 'package:flutter_test/flutter_test.dart';
import 'package:integration_test/integration_test.dart';
import 'package:myapp/main.dart' as app;
void main() {
  IntegrationTestWidgetsFlutterBinding.ensureInitialized();
  testWidgets("Test", (WidgetTester tester) async {
    app.main();
    print('Platform.environment: ${Platform.environment}');
  });
}

run flutter drive --driver=test_driver/integration_test.dart --target=integration_test/test.dart -d <deviceID>

Expected results:
flutter: Platform.environment: {FLUTTER_HOME: /path/to/flutter,etc}
Actual results:
flutter: Platform.environment: {}

Logs
Run flutter analyze:
Analyzing myapp...
No issues found! (ran in 26.4s)

Run flutter doctor -v:
[✓] Flutter (Channel stable, 1.22.6, on Mac OS X 10.15.6 19G2021 darwin-x64, locale en-US)
    • Flutter version 1.22.6 at /Users/ajachte/projects/software/flutter
    • Framework revision 9b2d32b605 (6 weeks ago), 2021-01-22 14:36:39 -0800
    • Engine revision 2f0af37152
    • Dart version 2.10.5

[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.3)
    • Android SDK at /Users/ajachte/Library/Android/sdk
    • Platform android-29, build-tools 29.0.3
    • ANDROID_HOME = /Users/ajachte/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.0)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.0, Build version 12A7209
    • CocoaPods version 1.9.3

[!] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6915495)

[✓] VS Code (version 1.29.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 2.21.1

[✓] Connected device (3 available)
    • SM G955U (mobile)                   • 98899a435a32535651                   • android-arm64 • Android 9 (API 28)
    • iPhone 11 Pro (mobile)              • 4D914F42-398A-48EA-96A3-61B1047857FB • ios           • com.apple.CoreSimulator.SimRuntime.iOS-14-0
      (simulator)
    • iPhone SE (2nd generation) (mobile) • 57584336-60B9-4012-9122-BCE6DEC3AEA6 • ios           • com.apple.CoreSimulator.SimRuntime.iOS-14-0
      (simulator)

When running an integration test, the test script is run on the device itself - so the host machines environment will not be populated.

@jonahwilliams Thanks for the quick response! Is there a way to access system variables in a different approach? I was using them to help with passing creds when testing with flutter_driver.

You could read them in the driver script separately and pass them through some sort of getData callback, or build them into the app under test via some sort of prebuild script?

@html-rulez-d00d
Check above workaround / solution because the original issue you posted seems to be working as intended.

@jonahwilliams

You could read them in the driver script separately and pass them through some sort of getData callback

I understand what you are suggesting with passing the data but not familiar with the syntax. Do you happen to have an example that illustrates how you can achieve this?

@html-rulez-d00d
Since the issue you logged is actually WAI, I suggest you to ask this question on support channels to get help. Please see https://flutter.dev/community for resources, you may also get some help if you post it on Stack Overflow and if you need help with your code, please see https://www.reddit.com/r/flutterhelp/
Closing from here. If you disagree, write in comments and I'll reopen it.


WIP: Full rewrite

Hi @gimre
Just for context, were you wanting to merge this at some point? Can you give me some of the thinking around the rewrite?

Hey @brian-armstrong!
Sure thing! I had three main goals with this rewrite:

publishing to npm
having only one file for the whole library (also for publishing to npm)
adding support for the new WebAudio spec, while also maintaining compatibility with the old spec

Is there any place we can chat live for more details?

Hi @gimre
Sure, how about we sync up over email and then we can find another channel? You can find my email on my github profile.
Cheers!

opened https://github.com/quiet/quiet-js/pull/27 instead


nixos/tests/installer: prevent race between parted and udev

Motivation for this change
Our installer tests still suffer from non-deterministic failure on Hydra (18.09 and master), which often delays channels.
One typical symptom of non-deterministic failure seems to be this:
Successful example:
machine: must succeed: parted --script /dev/vda -- mkpart primary linux-swap 1M 1024M
machine# [    9.146921]  vda:
machine: exit status 0
machine: must succeed: parted --script /dev/vda -- mkpart primary ext2 1024M -1s
machine: exit status 0

Failed example:
machine: must succeed: parted --script /dev/vda -- mkpart primary linux-swap 1M 1024M
machine# [   10.560431]  vda: vda1
machine# Error: Partition(s) 1 on /dev/vda have been written, but we have been unable to inform the kernel of the change, probably because it/they are in use.  As a result, the old partition(s) will remain in use.  You should reboot now before making further changes.
machine# [   10.572443]  vda: vda1
machine: exit status 1
machine: output:
error: command `parted --script /dev/vda -- mkpart primary linux-swap 1M 1024M' did not succeed (exit code 1)
command `parted --script /dev/vda -- mkpart primary linux-swap 1M 1024M' did not succeed (exit code 1)

The failed example looks like udev recognizes the new partition before parted tries to tell the kernel about it.  I found some reports that confirm a race between udev and parted, like this one. This can happen between separate parted calls, so it is recommended to combine multiple parted commands into a single parted call to create the correct partition layout in one pass without udev interfering.
And that's what this PR does. The change itself is a series of trivial rewrites.
It should eliminate this particular cause of non-deterministic failure (but probably there are others, so don't expect zero failures from now on :smile:).
Relevant for ZHF #45960, please backport to 18.09
~WIP because I still like to run all the tests locally once, which will take some time.~ done
Things done

[x] run all installer tests locally

I've noticed the races myself at some point as well:
https://github.com/NixOS/nixpkgs/pull/40230#issuecomment-388513572
I have a fear that even after this a similar race condition exists. Namely, udev can still be holding the partition devices open during the time mkfs programs or mdadm are run and want to open the partition for exclusive access, leading to Device or resource busy errors. See e.g. this thread: https://groups.google.com/forum/#!topic/scylladb-dev/u87yHgo3ylU

It will be difficult to eliminate all causes of such races. Just looking at how they tried to fix this in parted by "sleep-and-retry" doesn't look promising.
Two things we can do to further reduce the probability of failure:

Wrap each parted (and maybe also mkfs etc.) call with flock /dev/vda parted ... to acquire an exclusive lock on the device. That's what util-linux recommends for sfdisk. Doesn't work with device-mapper devices like md though.

For the swraid test which is the only one using mdadm, disable udev queue execution with udevadm control --stop-exec-queue like mentioned in the google groups thread above.

We could also protect all calls to mkfs/mkswap in a similar way but I don't recall seeing these fail in our tests yet, so let's fix those failures when they happen.

Example data point: In the latest 18.09 Hydra eval there are 5 installer test failures blocking the channel, and all of them show the kind of error addressed by this PR. So these changes can really improve things.

backported:  35271fdb2fd..570ec19f391


Streaming performance issues on upgrading to release v2.0.0

Describe the bug
On updating to release v2.0.0, I've been noticing some performance issues when running real-time audio streams against a quantized e2e model (no LM) via runtime/server/x86/bin/websocket_server_main. For some stretches of time, performance may be comparable between v1 and v2, but there are points where I can expect to see upwards of 20s delay on a given response. Outside of a few minor updates related to the switch, nothing else (e.g. resource allocations) has been changed on my end.
Thus far, I haven't been able to pinpoint much of a pattern to the lag, except that it seems to consistently happen (in addition to other times) at the start of the stream. Have you observed any similar performance issues between v1 and v2, or is there some v2-specific runtime configuration I may have missed?
Expected behavior
Comparable real-time performance between releases v1 and v2.
Screenshots
The following graphs show the results from a single test. The x-axes represent the progression of the audio file being tested, and the y-axes represent round-trip response times from wenet minus some threshold, i.e. any data points above 0 indicate additional round-trip latency above an acceptable threshold (in my case, 500ms). As you can see, in the v1 graph responses are largely generated and returned below the threshold time (with the exception of a few final-marked transcripts). However, in the v2 graph, there are several lengthy periods during which responses take an unusually long time to return (I've capped the graph at 2s for clearer viewing, but in reality responses are taking up to 20s to return).
Wenet v1

Wenet v2

Additional context
Both tests were run with wenet hosted via AWS ECS/EC2. So far as I've seen, increasing CPU + memory allocations to the wenet container doesn't seem to resolve the issue.

There is no such problem in our experiment.
@Mddct @xingchensong @day9011 Any idea on the problem?

Any difference of the test data on v1/v2 test?

Same test data used between v1/v2, sent in the same way (chunks of audio sent at 250ms intervals). Not 100% sure what you mean by long audio, but the test data I've been using has generally been within the 2-10 min range, with endpoints forced at 15s of continuous transcription.

Maybe it is just a warmup issue, in https://github.com/wenet-e2e/wenet/pull/942, we can clearly see that warmup round(round-1) is significantly slower than the forllowing rounds. We can draw a conclusion that both encoder (processing audio chunks) and decoder (processing text with various length) need warmup, the outliers at the very begining might be caused by encoder warmup and the outliers at the middle stage might be caused by decoder warmup (i.e., the decoder might be rescoring a hyp text whose length is different from all previous hyps). You can run this test twice and check if there still exist such phenomenon in the second round.

@xingchensong It looks like it may be related, reviewing the following results.
Cold (up to 25s delay)

Warmed

I ran the test a few times to ensure the system is properly warmed up prior to the second screenshot, and we can see that the response times are significantly lower. Given this, is there a guideline on how to warm up the system prior to usage (other than passing through arbitrary audio files)? In my case users rely on real-time transcripts to make critical decisions, so a 25s delay would be unacceptable in a production scenario.

yes, and it is mostly caused by different versions of libtorch
I think the time spend for warmup is not a big issue in production env since we can set the upper limit of concurrent requests for the current container and when the concurrency reaches 80% (or less) of the threshold, just pre-launch a new container and do warmup for it.

@xingchensong I also encountered this problem. warmup is effective, but I found a problem.  when the length of the data changes in decode(), it needs to be warmup again. Is there a simpler way?
log like this:
asr_decoder.cc:104] Required 60 get 60
asr_decoder.cc:113] forward takes 12152 ms, search takes 10 ms
asr_decoder.cc:104] Required 59 get 59
asr_decoder.cc:113] forward takes 17248 ms, search takes 6 ms     ## warmup fail
asr_decoder.cc:104] Required 52 get 52
asr_decoder.cc:113] forward takes 4708 ms, search takes 6 ms       ## warmup fail
asr_decoder.cc:104] Required 48 get 13
asr_decoder.cc:113] forward takes 17446 ms, search takes 1 ms      ## warmup fail
asr_decoder.cc:104] Required 47 get 47
asr_decoder.cc:113] forward takes 8462 ms, search takes 5 ms         ## warmup fail
....
asr_decoder.cc:104] Required 52 get 52
asr_decoder.cc:113] forward takes 56 ms, search takes 7 ms              ## warmed
asr_decoder.cc:104] Required 60 get 60
asr_decoder.cc:113] forward takes 137 ms, search takes 16 ms           ## warmed

I confirm it takes time at auto outputs = model_->get_method("forward_encoder_chunk")(inputs).toTuple()->elements(); .
Rescoring I haven't confirmed whether there is this problem

I tested python recognize.py and observed the log of chunk size change, but I didn't find this problem.
log like this:
#################take time:0.4461658000946045 chunk size:67
#################take time:0.03869509696960449 chunk size:67
...
#################take time:0.03129744529724121 chunk size:18
2022-09-13 07:36:45,817 INFO test_data_20200811_1_825e7573_29a2_4b49_9f8b_1c863332ab7b_8_11.wav 你肯定只有到店里去了才能了才能了解
#################take time:0.04446840286254883 chunk size:67
#################take time:0.04583621025085449 chunk size:67
...
#################take time:0.03129100799560547 chunk size:7

@robin1001 Could you please help me?  I don't have any ideas.

Just use multiple utterances with different lengths to warmup, it should work.

May we can bump libtorch to v1.11 or higher
Xingchen Song(宋星辰) @.***> 于 2022年7月20日周三 22:48写道：

yes, and it is mostly caused by different versions of libtorch
I think the time spend for warmup is not a big issue in production
env since we can set the upper limit of concurrent requests for the current
container and when the concurrency reaches 80% (or less) of the threshold,
just pre-launch a new container and do warmup for it.

—
Reply to this email directly, view it on GitHub
https://github.com/wenet-e2e/wenet/issues/1296#issuecomment-1190383274,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABFN3QZHZPLWXRU5IYGYVITVVAGVRANCNFSM53HW4TGQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

cc @robin1001 , Do we need recipe checking if we want to upgrade torch from 1.0 to 1.11?

What kind of checking? It's better to upgrade to 1.12 since it is the lastest stable version.

training recipe, wer metrics, etc

No, it will take too mush efforts to check, just go.


Usr/jasteph/jswv

Adding a JavaScript Extended Features doc.

Docs Build status updates of commit b0dda2f:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error-PullRequestMergeConflict] Cannot sync git repo to specified state. Please make sure the pull request is mergeable.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 5d402b8:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error-PullRequestMergeConflict] Cannot sync git repo to specified state. Please make sure the pull request is mergeable.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit c69135c:
:warning: Validation status: warnings

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:warning:Warning

Details

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/js.md

Line 20, Column 0: [Warning-hard-coded-locale] Link 'https://docs.microsoft.com/en-us/microsoft-edge/webview2/reference/wpf/0-9-515/microsoft-web-webview2-wpf-webview2#executescriptasync' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 21, Column 0: [Warning-hard-coded-locale] Link 'https://docs.microsoft.com/en-us/microsoft-edge/webview2/reference/win32/0-9-538/icorewebview2#addscripttoexecuteondocumentcreated' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 59c7bcf:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit d185a36:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit ab7720c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit f7fdf14:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 6a7feb1:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 2b664cd:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error-PullRequestMergeConflict] Cannot sync git repo to specified state. Please make sure the pull request is mergeable.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit a21e2fe:
:warning: Validation status: warnings

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:warning:Warning
View
Details

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/dragtext.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

microsoft-edge/webview2/howto/js.md

Line 18, Column 0: [Warning-hard-coded-locale] Link 'https://docs.microsoft.com/en-us/microsoft-edge/webview2/gettingstarted/wpf' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit f741517:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/dragtext.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 362e305:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/dragtext.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 0a8e12d:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/dragtext.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit e50c22f:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/dragtext.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 98fcebd:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/webview2/howto/js.md
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/contextmenu.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/dragtext.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/howto/media/start_dd.png
:white_check_mark:Succeeded
View

microsoft-edge/webview2/toc.yml
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

#sign-off


Unable to insert document with a field of type BsonBinary

When trying to create a collection and seed some data as part of a changeUnit i receive the following error because my model has a field of type BsonBinary.
Caused by: org.bson.codecs.configuration.CodecConfigurationException: Can't find a codec for class org.bson.BsonBinary_$$_mongock_78c_5.
This is a valid type as its used as part of the Client Side Field Level Encryption. Is the mongo-driver used by mongock out of date with the latest version used in spring boot? Are there any workaround for this?

Hello @mcveighc ,
the MongoDB driver dependency is imported by your project, if you see the scope is provided, so that shouldn't be the problem.
Have you tried that without Mongock, I believe is not related to Mongock nor MongoDB driver. Instead I think somehow the codec is missing and needs to be provided

@dieppa thanks for quick response.
Yeah strangely it works fine when i use my mongo repository with the same model. I tried a few different routes to insert the data in the changeUnit and seemed to get the same or similar issues.

Inject mongoTemplate via method parameter
Inject dedicated repository and insert
Grab the collection from the mongoTemplate using codecs from MongoClientSettings.getDefaultCodecs()

It almost seems when running in the mongock boundary it cant find them for some reason.

Hello @mcveighc ,
I think the easiest way to approach this is you setting up a dummy project in github reproducing this issue, grant me access and I can debug it. Is that something you can do?

Hi @dieppa
I've created a private repo and added you as a collaborator. There are instructions on the readme how to run it.
Let me know if you have trouble. Thanks

@mcveighc we'll take a look next week.


feat: hide actor resources

Closes WEB-236

it doesnt look like we expose it anywhere in the api, so ill have to fix that. its whether or not the build kind is js
https://github.com/rivet-gg/rivet/blob/main/sdks/api/fern/definition/actor/builds.yml#L120-L121


v0.28.0 is coming!

Hi all and happy new year!
We intend to release v0.28.0 by the end of next week (Jan 16th).
Release notes will be shared in due time but please be aware that this release will have some breaking changes (we're still in v0).
The following functions have been removed:

composeK (see composeWith)
composeP (see composeWith)
contains (see includes)
merge (see mergeAll, mergeRight and mergeLeft)
pipeK (see pipeWith)
pipeP (see pipeWith)

The reported vulnerability (see https://github.com/ramda/ramda/pull/3177) has been addressed and the fix will ship in that release too.
Thank you all for your continued support and patience.
PS: It is possible that the documentation site will be temporarily out of date by the time we release v0.28.0. We're working on it ;)

I am eagerly awaiting this release because of the upstream security issues it's causing, so thank you.
I'm feeling a little put off by the comment about the breaking changes though. This package has been in development for over 7 years and is used in some of the most popular node packages in the ecosystem. I feel like these things should create an obligation to move to a stable 1.x.x release and prevent braking changes in the future. Is there a reason this hasn't had a stable release?
Security fixes bundled with breaking changes as a child dependency of a dependency is a recipe for disaster for many applications.

Thank you @customcommander, this update is long waiting and going to solve a big problem we have in our project.
Can I quickly suggest, if possible, if there's a way to release the security update before the breaking changes?
In my project, we use a 3rd party package, and while they fixed a bug that I need fixed, I can't upgrade since they are using this package and my organization's security scan blocks the PR for the update. The best scenario would be if we follow here what @tonytamps suggested which is to release a version without breaking changes as 0.28.X and the one with the breaking changes as 1.X.
What are your thoughts?

The best scenario would be ...  to release a version without breaking changes as 0.28.X and the one with the breaking changes as 1.X.

@ap-shahar IMO the master branch already contains breaking changes wrt v0.27.1. Considering the duration since the last release, my guess is that a best-of-both-worlds scenario is not possible. (Though I am no git expert)

The best scenario would be ...  to release a version without breaking changes as 0.28.X and the one with the breaking changes as 1.X.

@ap-shahar IMO the master branch already contains breaking changes wrt v0.27.1. Considering the duration since the last release, my guess is that a best-of-both-worlds scenario is not possible. (Though I am no git expert)

One option I can think of if the authors of this package are open to it would be to create a new commit that brings back composeK and composeP that will make a call to composeWith and also print a console warning that this will be deprecated in a next version and to use composeWith instead. And do the same with the rest of the breaking changes.

Hi folks,
Thank you for your feedback!
We've decided to release the security patch for the ReDoS vulnerability in v0.27.2 (see #3216).

Thank you 🙇


Connection was not be put back to QueuePool after un-caught exceptions

when an exception (such as  commit a duplicated record) comes, the connection seems not be recycled.
After  a time, Errors comes like below:
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2367, in first
    ret = list(self[0:1])
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2228, in __getitem__
    return list(res)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2438, in __iter__
    return self._execute_and_instances(context)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2451, in _execute_and_instances
    close_with_result=True)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2442, in _connection_from_session
    **kw)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 854, in connection
    close_with_result=close_with_result)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 858, in _connection_for_bind
    return self.transaction._connection_for_bind(engine)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 322, in _connection_for_bind
    conn = bind.contextual_connect()
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1798, in contextual_connect
    self.pool.connect(),
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 338, in connect
    return _ConnectionFairy._checkout(self)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 644, in _checkout
    fairy = _ConnectionRecord.checkout(pool)
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 440, in checkout
    rec = pool._do_get()
  File "/home/koala/.virtualenvs/koala-online/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 959, in _do_get
    (self.size(), self.overflow(), self._timeout))
TimeoutError: QueuePool limit of size 30 overflow 10 reached, connection timed out, timeout 30

I found this happen only when  app.debug = True

it just bit me as well.

???

I found this happen only when app.debug = True

Is this because the Werkzeug debugger has to keep the context of the request in order to allow dynamic debugging in the error page?

I am experiencing this error message with app.run(debug=False, threaded=True). I don't think I have any uncaught exceptions, but I'm not sure.

@jwg4 is right. See https://github.com/pallets/flask/issues/661#issuecomment-11975645
If you're okay with using the debugger without a request, you can set PRESERVE_CONTEXT_ON_EXCEPTION = False in your flask config.
I'm additionally considering setting use_evalex=False when running the debug server via app.run to disable the interactive part of Werkzeug's debug server to avoid confusion with the above change.

 Is there a way to see where the connections were used to but not returned?

This isn't something Flask-SQLAlchemy can control. There might need to be some change to how long Flask stores preserved contexts.


Express and fusker

So, I'm trying to make this work, but no matter what I do (after add fusker) throws me this error:
TypeError: Object function (source, overwrite, deep) {
      var name, x, _i, _j, _len, _len2, _ref, _ref2;
      if (overwrite == null) overwrite = false;
      if (deep == null) deep = false;
      if (deep) {
        _ref = Object.getOwnPropertyNames(source);
        for (_i = 0, _len = _ref.length; _i < _len; _i++) {
          name = _ref[_i];
          if (this.hasOwnProperty(name && !overwrite)) continue;
          Object.defineProperty(this, name, Object.getOwnPropertyDescriptor(source, name));
        }
      } else {
        _ref2 = source.keys();
        for (_j = 0, _len2 = _ref2.length; _j < _len2; _j++) {
          x = _ref2[_j];
          if (this.hasOwnProperty(x && !overwrite)) continue;
          this[x] = source[x];
        }
      }
      return this;
    } has no method 'push'
    at Router._route (/home/alejandromg/dev/Dropbox/ulearn/node_modules/express/lib/router/index.js:396:6)
    at HTTPServer.merge (/home/alejandromg/dev/Dropbox/ulearn/node_modules/express/lib/http.js:556:31)
    at HTTPServer.<anonymous> (/home/alejandromg/dev/Dropbox/ulearn/node_modules/express/lib/http.js:575:17)
    at Array.forEach (native)
    at HTTPServer.all (/home/alejandromg/dev/Dropbox/ulearn/node_modules/express/lib/http.js:573:11)
    at Object.<anonymous> (/home/alejandromg/dev/Dropbox/ulearn/app.js:468:5)
    at Module._compile (module.js:432:26)
    at Object..js (module.js:450:10)
    at Module.load (module.js:351:31)
    at Function._load (module.js:310:12)

I saw the example but it's not working for me

Can you post the code you're having an issue with?

Yes :: https://gist.github.com/1494041

Ah fusker changed and I forgot to update the express example. You should be doing it like
var express = require('express')
var app = exports.app = express.createServer();

var fusker = require('fusker');
fusker.config.dir = process.cwd();
fusker.config.banLength = 1;
fusker.config.verbose = true;
fusker.http.detect('csrf', 'xss', 'sqli', 'lfi', '404');
fusker.http.punish('blacklist', 'bush');
fusker.socket.detect('xss', 'sqli', 'lfi');
fusker.socket.punish('blacklist');

app.configure(function() {
   app.use(fusker.express.check);
   //...
});

//...

app.all('/*', detectMobile, function(req, res, next) { //Line 468 <- throw error about PUSH
    res.header("Access-Control-Allow-Origin", "*");
    res.header("Access-Control-Allow-Headers", "X-Requested-With");
    res.header('Strict-Transport-Security', 'max-age=31556926; includeSubDomains');
    next();
});

No... That doesn't work.

Sorry I'm not very familiar with Express. Do you know why app.all would be causing an issue?

Jot really. Looking to the express code:
/**
 * Special-cased "all" method, applying the given route `path`,
 * middleware, and callback to _every_ HTTP method.
 *
 * @param {String} path
 * @param {Function} ...
 * @return {Server} for chaining
 * @api public
 */
app.all = function(path){
  var args = arguments;
  if (1 == args.length) return this.routes.lookup('all', path);
  methods.forEach(function(method){
    if ('all' == method) return;
    app[method].apply(this, args);
  }, this);
  return this;
};

So basically, that method only applies my options to every VERB, nothing obscured I think.

I can't get fusker to work with express either... I setup fusker as you mentioned but here is the output of my application:
root@dev:/home/rnd/domains/design.rnd/public_html/app-ui# npm start

><EMAIL_ADDRESS>start /home/rnd/domains/design.rnd/public_html/app-ui
> NODE_ENV=development nodemon -d 0

27 Jan 06:39:49 - [nodemon] v0.6.7
27 Jan 06:39:49 - [nodemon] watching: /home/rnd/domains/design.rnd/public_html/app-ui
27 Jan 06:39:49 - [nodemon] starting `node app.js`
27 Jan 06:39:49 - [nodemon] reading ignore list
The "sys" module is now called "util". It should have a similar interface.

Express server listening on port 3000 in development mode
GET /
[fusker - debug] HTTP: <IP_ADDRESS> -> /generated/bundle/e764825_global.js
TypeError: undefined is not a function
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:105:25
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http.coffee:119:14
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:97:13
    at Array.forEach (native)
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:26:24
    at Object.forEach (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:96:9)
    at Object.processRequest (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http.coffee:121:18)
    at Object.handle (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/express.coffee:6:10)
    at next (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/express/node_modules/connect/lib/http.js:203:15)
    at pass (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/express/lib/router/index.js:219:24)

[fusker - debug] HTTP: <IP_ADDRESS> -> /generated/bundle/87ae25b_head.js
TypeError: undefined is not a function
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:105:25
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http.coffee:119:14
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:97:13
    at Array.forEach (native)
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:26:24
    at Object.forEach (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:96:9)
    at Object.processRequest (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http.coffee:121:18)
    at Object.handle (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/express.coffee:6:10)
    at next (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/express/node_modules/connect/lib/http.js:203:15)
    at pass (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/express/lib/router/index.js:219:24)

[fusker - warn] HTTP attack detected! Module: 404 IP: <IP_ADDRESS>
[fusker - debug] <IP_ADDRESS> has been blacklisted for 1 min

http.js:562

    throw new Error("Can't render headers after they are sent to the client.")

^

Error: Can't render headers after they are sent to the client.
    at ServerResponse.<anonymous> (http.js:562:11)
    at ServerResponse._renderHeaders (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/express/node_modules/connect/lib/patch.js:76:25)
    at ServerResponse.writeHead (http.js:824:20)
    at Object.run (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http-payloads/bush.js:2:7)
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http.coffee:129:14
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:97:13
    at Array.forEach (native)
    at /home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:26:24
    at Object.forEach (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/node_modules/async/lib/async.js:96:9)
    at Object.handleAttack (/home/rnd/domains/design.rnd/public_html/app-ui/node_modules/fusker/lib/http.coffee:132:18)

27 Jan 06:40:06 - [nodemon] app crashed - waiting for file changes before starting...

Don't use any middleware that sends headers - fusker manages that.  I'm working on a new library called 'slate' that will come with express-compatible fusker plugins.

@Contra hi! Thanks for the reply! Do you have "state" available on a public repo or you currently work on it locally? :) thanks!

Slate doesn't have a lot of the features express does, it most likely isn't what you're looking for. https://github.com/wearefractal/slate

@Contra Hello, I got the point, so slate is not a middleware to connect or express :) Thanks for your support though :)
Could you suggest me anything to check-out regarding security on web pages build with node.js? I saw express-csrf but I was looking something similar to PHPIDS if you worked with php, phpids is very popular.
Thanks again!

You can always go for a full blown IDS like snort - I'm actually working on my own IDS written in Node but haven't finished it yet


The MIxS description of menarche is unconventional

"Date of most recent menstruation" is not compatible with wikipedia's

Menarche (/məˈnɑːrki/ mə-NAR-kee; from Ancient Greek μήν (mēn) 'month' and ἀρχή (arkhē) 'beginning') is the first menstrual cycle, or first menstrual bleeding, in female humans. From both social and medical perspectives, it is often considered the central event of female puberty, as it signals the possibility of fertility. Girls experience menarche at different ages.[1][2] Having menarche occur between the ages of 9–14 in the West is considered normal.[3]

https://en.wikipedia.org/wiki/Menarche


Updatable MultipartConfigElement implemented, config controller and s…

Pull Request Description
This pull request solves part of - #1819
Acceptance Test

[x] Building the code with mvn clean install -Dintegration.tests still works.
[x] Running mvn spring-boot:run in the strongbox-web-core still starts up the application correctly.
[x] Building the code and running the strongbox-distribution from a zip or tar.gz still works.
[ ] The tests in the strongbox-web-integration-tests still run properly. (I was not able to run them but checked file upload manually)

Questions

Does this pull request break backward compatibility?

[ ] Yes
[x] No

Does this pull request require other pull requests to be merged first?

[ ] Yes, please see #...
[x] No

Does this require an update of the documentation?

[ ] Yes, please see strongbox/strongbox-docs#{PR_NUMBER}
[ ] No

Code Review And Pre-Merge Checklist

[x] My code follows the coding convention of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code in hard-to-understand areas.
[x] My changes generate no new warnings.
[ ] I have added tests that prove my fix is effective or that my feature works.
[x] New and existing unit tests pass locally with my changes.

Hi!
Thanks for your contribution!
Your Github user doesn't appear to be configured properly (the email part).
Can you please fix it?
Thanks!

Hi @JanBucko ,
Thank you for your contribution!
Would you mind signing the ICLA, as described in the Contributing page?
Also, please, feel free to join our chat channel, if you'd like to learn more about the project and/or like to find out what else you could help with.
The username under which you're committing and pushing to Github seems to be mis-configured. You will have to look into how to configure your git settings properly, amend the author of the commits and then force push back to the branch. (When your user is properly set up, you see your avatar when against your commits in the commit history, otherwise it's a default grey avatar).
Could you please have a look at our coding convention and apply the necessary changes to your IDE, so that you could be compliant with our rules? Thanks! :)
Kind regards,
Martin

Workiong on commit rebase

Hi @JanBucko ,
Thanks for these fixes!
How much more work is left? Have you had a chance to look into the UI part of the task (in the strongbox-web-ui project)?

hello i have focuse solely on the part:  Implement support for this in the org.carlspring.strongbox.controllers.configuration.ServerConfigurationController. of this issue, for now I didnt know if hte changes I have made would be acceptable, but I may take a look on the UI part now if this is done.

@JanBucko ,
Could you please remind me, if you've signed the ICLA?

Hello, does the ICLA need handwritten signature ?

@JanBucko yes - we need your signature. You can either use a PDF editor and sign it with a mouse / touchscreen or print it, sign it, scan it and send it as PDF :)

@carlspring @steve-todorov Hi, I have sent you the signed ICLA document. About the tests, I will try to add them next week, for now I got a lot of other work to do.

Thanks for signing the ICLA, @JanBucko ! (I asked for a change in the ICLA, could you please look into that as well, thanks!). :)

@JanBucko ,
What is the status of this pull request?

Hi @carlspring I deeply apologise, but I didn't get a chance to look onto the tests by now, I hope I'll be able to get them done ASAP.

Hi @JanBucko ,
Okay! Thanks for the update!

Hello, @carlspring  I have a question about testing, so far I have written tests to verify that setting maxUploadSize works propperly, but about the MockedFIle upload test, shall I test file upload on any particular controller, or can I create a dummy controller inside the ServerConfigurationController class ?

@sbespalov , @ptirador , @steve-todorov ,
Any thoughts regarding @JanBucko 's question?

@JanBucko ,
You should be able to test this using restassured and the MavenArtifactController (and all other *ArtifactController implementations for that matter).

Allright so doesn't matter which implementation I choose, thank you.

Hello @carlspring , I have implemented the tests, hopefully to your satisfaction, but the travis build threw an error about dependency resolution exception. Is that error possibly somehow related to my changes ?

There should be UI for this - will you be doing that as well?

I havent noticed that I missed the maxUpload size option inside serverSettingsShouldBeSaved test so I added it, also UI support here https://github.com/strongbox/strongbox-web-ui/pull/46


Single chain EVM Multisig. Wrong balance definition for signatory.

Description
For single chain multisig in transfer flow is shown wallets as a signatory with wrong balances.
Steps to Reproduce

Create EVM multisig in Moonbeam
Select created wallet
Try to send some GLMR in Moonbeam

Expected Behavior
Is shown addresses with right balances
Actual Behavior
Is shown 0-s
Screeenshots:

Status verification: ✅


Add XJM Docker image

It is a mirror of XHT image with indent added.
@yegor256 after review please merge, publish to Docker Hub and set up automated build, thanks!

@yegor256 I need your help here

@yegor256 ping

@yegor256 ping again

@mkordas here it is: https://hub.docker.com/r/yegor256/xjm/

@mkordas should be built after 6da099a

@yegor256 thanks a lot, build is successful: https://hub.docker.com/r/yegor256/xjm/builds/banmnjmthmyvba2vnge9hch/


[BUG] Uploading blob on iOS throws System.ExecutionEngineException

Library name and version
Azure.Storage.Blobs 12.14.1
Describe the bug
When we upload a file on physical iOS device, the System.ExecutionEngineException is thrown for this reason : Attempting to JIT compile method 'void Azure.Storage.PartitionedUploader`2<Azure.Storage.Blobs.Models.BlobUploadOptions, Azure.Storage.Blobs.Models.BlobContentInfo>:.ctor
I try to fix it by create a PartitionedUploader to force the compiler to generate the generic class but PartitionedUploader is internal.
Expected behavior
The blob is uploaded
Actual behavior
System.ExecutionEngineException is thrown
Reproduction Steps
Create an iOS application (Xamarin.iOS) => I have create an Xamarin.Forms app
Write this code :
var blobContainer= new BlobContainerClient("connectionString", "test");
await blobContainer.CreateIfNotExistsAsync();
var stream = new MemoryStream(fileByteArray);

var blobClient = imageContainer.GetBlobClient("blobUrl");
await blobClient.UploadAsync(stream, true);

When executing, this code throws System.ExecutionEngineException
Environment
Visual Studio 17.4.4
Xamarin.Forms <IP_ADDRESS>5
iOS 16.1

@RenaudAvenas Thanks for reaching out to us and reporting this issue. Could you please let me know if the below sample  also throws the same exception ?
using Microsoft.WindowsAzure.Storage;
using Microsoft.WindowsAzure.Storage.Blob;

private async void UploadBlob(string filePath)
{
    // Retrieve storage account information from connection string
    CloudStorageAccount storageAccount = CloudStorageAccount.Parse("<your_storage_connection_string>");

    // Create a blob client for interacting with the blob service
    CloudBlobClient blobClient = storageAccount.CreateCloudBlobClient();

    // Get a reference to the container
    CloudBlobContainer container = blobClient.GetContainerReference("<your_container_name>");

    // Create the container if it doesn't already exist
    await container.CreateIfNotExistsAsync();

    // Get a reference to the blob
    CloudBlockBlob blockBlob = container.GetBlockBlobReference(Path.GetFileName(filePath));

    // Open the file and upload its data
    using (var fileStream = File.OpenRead(filePath))
    {
        await blockBlob.UploadFromStreamAsync(fileStream);
    }
}

Hello,
Thanks for your answer.
I try your code and it works but it use the deprecated nuget package. I will use the workaround for now.

@RenaudAvenas Thanks for the update. I am glad that you are now unblocked with the workaround.
@amnguye @seanmcc-msft Are you aware of this issue in v12 ? . We have isolated the issue, since v11 SDK seems to be working just fine.

I think this is due to the fact that iOS does not allow JITing code. @RenaudAvenas what's the full error message?
I haven't looked into the v11 SDK but I'm assuming the v11 SDK wasn't using any code that does Class<T> while the v12 SDK does Class<T> (e.g. PartitionedUploader<T,T>).
So when the code goes to create the PartionedUploader<Azure.Storage.Blobs.Models.BlobUploadOptions, Azure.Storage.Blobs.Models.BlobContentInfo> it throws this error cause iOS does not allow this.

Yes I think too, the whole exception message is :
BlockBlobClient.GetPartitionedUploader (Azure.Storage.StorageTransferOptions transferOptions, Azure.Storage.UploadTransferValidationOptions validationOptions, System.Buffers.ArrayPool1[T] arrayPool, System.String operationName) System.ExecutionEngineException: Attempting to JIT compile method 'void Azure.Storage.PartitionedUploader2<Azure.Storage.Blobs.Models.BlobUploadOptions, Azure.Storage.Blobs.Models.BlobContentInfo>:.ctor (Azure.Storage.PartitionedUploader2/Behaviors<Azure.Storage.Blobs.Models.BlobUploadOptions, Azure.Storage.Blobs.Models.BlobContentInfo>,Azure.Storage.StorageTransferOptions,Azure.Storage.UploadTransferValidationOptions,System.Buffers.ArrayPool1,string)' while running in aot-only mode. See https://docs.microsoft.com/xamarin/ios/internals/limitations for more information.
The stack trace is :
Azure.Storage.Blobs.Specialized
BlockBlobClient.GetPartitionedUploader (Azure.Storage.StorageTransferOptions transferOptions, Azure.Storage.UploadTransferValidationOptions validationOptions, System.Buffers.ArrayPool1[T] arrayPool, System.String operationName) Azure.Storage.Blobs BlobClient.GetPartitionedUploader (Azure.Storage.StorageTransferOptions transferOptions, Azure.Storage.UploadTransferValidationOptions validationOptions, System.Buffers.ArrayPool1[T] arrayPool, System.String operationName)
Azure.Storage.Blobs
BlobClient.StagedUploadInternal (System.IO.Stream content, Azure.Storage.Blobs.Models.BlobUploadOptions options, System.Boolean async, System.Threading.CancellationToken cancellationToken)

@RenaudAvenas Thanks for sharing the exception callstack. I hope you are unblocked now with my above workaround of using v11 SDK.
@amnguye To me this issue seems to be IOS specific and not related Azure.Storage.Blobs SDK. Could you please let me know your thoughts ?

It is an IOS specific error however we need to resolve why the SDK isn't getting along with Xamarin / iOS. I think it maybe be due to the version of .NET being used. I think if you were to downgrade to .NET 3.1 we might not see this problem. However I can't recommend that either as .NET 3.1 is out of support.

It is an IOS specific error however we need to resolve why the SDK isn't getting along with Xamarin / iOS. I think it maybe be due to the version of .NET being used. I think if you were to downgrade to .NET 3.1 we might not see this problem. However I can't recommend that either as .NET 3.1 is out of support.

Thanks @amnguye for your reply.
I am adding Service team to take this forward.


⚠ Bofrost.hr has degraded performance

In 0d7b5a9, Bofrost.hr (https://www.bofrost.hr) experienced degraded performance:

HTTP code: 200
Response time: 3115 ms

Resolved: Bofrost.hr performance has improved in 796e086.


gVim on Windows starts with a tiny window when using "set guioptions+=k"

Bug
When running gVim on Windows, if you have set guioptions +=k in vimrc, the window will be really tiny (see screenshot). The user has to manually resize it for it to be in a usable size. This issue doesn't show up if the 'k' guioptions wasn't set.
Screenshot

Cause
This bug was introduced by #3616. See my comment (https://github.com/vim/vim/pull/3616#issuecomment-449952161) for more details. We can't just fix this by reverting that PR (which changed initialization to call gui_set_shellsize with FALSE) since it would break the original issue it's trying to fix (#3615), but we should probably find a way to initialize it properly so it still works with set guioptions+=k in vimrc.

Can this solve this?
diff --git a/src/gui.c b/src/gui.c
index d993bc6b0..3d2e632bf 100644
--- a/src/gui.c
+++ b/src/gui.c
@@ -682,7 +682,11 @@ gui_init(void)
     // Set the shell size, adjusted for the screen size.  For GTK this only
     // works after the shell has been opened, thus it is further down.
     // For MS-Windows pass FALSE for "mustset" to make --windowid work.
-    gui_set_shellsize(FALSE, TRUE, RESIZE_BOTH);
+    // But if go+=k specified, resize forcibly.
+    if (vim_strchr(p_go, GO_KEEPWINSIZE) == NULL)
+	gui_set_shellsize(FALSE, TRUE, RESIZE_BOTH);
+    else
+	gui_set_shellsize(TRUE, TRUE, RESIZE_BOTH);
 #endif
 #if defined(FEAT_GUI_MOTIF) && defined(FEAT_MENU)
     /* Need to set the size of the menubar after all the menus have been

I don't make sure that it is needed to checking whether --windowid or --socketid is specified.

I think this patch wouldn't completely fix the issue. If a user's vimrc has set go+=k and launches gVim using --windowid he would still see the issue that #3616 is trying to fix (that the window size doesn't look maximized).
Looking more into it, the issue is that when you pass --windowid in, these lines in gui_mch_init(void) will maximize the window (win_socket_id would be non-null in this case):
if (s_hwnd != NULL && win_socket_id != 0)
{
    SetParent(s_hwnd, (HWND)win_socket_id);
    ShowWindow(s_hwnd, SW_SHOWMAXIMIZED);
}

As I mentioned in https://github.com/vim/vim/pull/703#issuecomment-199448937, if the window is maximized, we should be calling gui_set_shellsize(FALSE,…) to initialize with the system's provided dimensions. Otherwise, we should pass call gui_set_shellsize(TRUE,…) to initialize with Vim's default lines/columns dimensions regardless of whether GO_KEEPWINSIZE is. The original patch (#703) just assumed gVim never starts maximized.
For reference this is the code in gui_set_shellsize(int mustset, …) that shows the behavior:
    /* If not setting to a user specified size and maximized, calculate the
     * number of characters that fit in the maximized window. */
    if (!mustset && (vim_strchr(p_go, GO_KEEPWINSIZE) != NULL
						       || gui_mch_maximized()))
    {
	gui_mch_newfont();
	return;
    }

I think this following patch should fix the issue in Windows. I need to see if there are other lurking issues with the GTK implementation as well (even though this issue isn't related to the GTK GUI). This also fixes a bug in gui_init_font(…), where if you call set guifont=… when maximized, it will bump you out of the maximized state.
diff --git a/src/gui.c b/src/gui.c
index 39968954a..dc99919ae 100644
--- a/src/gui.c
+++ b/src/gui.c
@@ -681,8 +681,13 @@ gui_init(void)
 #ifndef FEAT_GUI_GTK
     // Set the shell size, adjusted for the screen size.  For GTK this only
     // works after the shell has been opened, thus it is further down.
-    // For MS-Windows pass FALSE for "mustset" to make --windowid work.
-    gui_set_shellsize(FALSE, TRUE, RESIZE_BOTH);
+    // If the window is already maximized (e.g. when --windowid is passed in),
+    // we want to use the system-provided dimensions by passing FALSE to
+    // mustset. Otherwise, we want to initialize with the default rows/columns.
+    if (gui_mch_maximized())
+	gui_set_shellsize(FALSE, TRUE, RESIZE_BOTH);
+    else
+	gui_set_shellsize(TRUE, TRUE, RESIZE_BOTH);
 #endif
 #if defined(FEAT_GUI_MOTIF) && defined(FEAT_MENU)
     /* Need to set the size of the menubar after all the menus have been
@@ -721,7 +726,10 @@ gui_init(void)
 # endif

 	/* Now make sure the shell fits on the screen. */
-	gui_set_shellsize(TRUE, TRUE, RESIZE_BOTH);
+	if (gui_mch_maximized())
+	    gui_set_shellsize(FALSE, TRUE, RESIZE_BOTH);
+	else
+	    gui_set_shellsize(TRUE, TRUE, RESIZE_BOTH);
 #endif
 	/* When 'lines' was set while starting up the topframe may have to be
 	 * resized. */
@@ -906,7 +914,7 @@ gui_init_font(char_u *font_list, int fontset UNUSED)
 # endif
 	    gui_mch_set_font(gui.norm_font);
 #endif
-	gui_set_shellsize(TRUE, TRUE, RESIZE_BOTH);
+	gui_set_shellsize(FALSE, TRUE, RESIZE_BOTH);
     }

     return ret;

After scrubbing through the code seems like the only real place that sets mustset to TRUE outside of this is when you call :win or :set lines/:set columns. This means if you are in maximized mode calling :win 100 100 will put you back to windowed mode. I'm not sure if that's the desired behavior or not (seems like :win should just be ignored in maximized mode).


Inconsistent behavior with new options structs

After testing for the past two days the new option structs in our applications that use protobom I've notivecd that we introduced a very cumbersome usability problem in the way the options are structured.
Common options are not really common and the writer's functions are not really the writer's. This means that for every format we have a separate set of CommonRenderOptions and CommonSerializeOptions. This is not practical. Take this snippet for example:

    w := writer.New()

    // Write the SBOM to STDOUT in SPDX 2.3:
    w.Format = formats.SPDX23JSON
    w.WriteStream(document, os.Stdout)

    // Write the SBOM to STDOUT in CycloneDX 1.4:
    w.Format = formats.CDX14JSON
    w.WriteStream(document, os.Stdout)

In this example, each call to w.WriteStream has a different options set, this means that we will need to reconfigure with the same options everything from indetntation, logging, deprecation log, etc whenever we change formats.  If not, renders for each format will behave differently
This is because the option sets for each format are keyed at the wrong place, for each format we repeat the full writer option set:
https://github.com/bom-squad/protobom/blob/b3dae45f586c6bfd9da72786a563b9fc7476a1c5/pkg/writer/writer.go#L35-L36
This also introduces all sorts of usability problems in practice. For example. Before, if I wanted to set the indentation level of the output, I could just do:
// Original way of setting options
w := writer.New()
w.Options.Indent = 4

The new equivalent becomes this to avoid a panic:
w := writer.New()
if _, ok := w.RenderOptions[string(w.Format)]; ok {
   w.RenderOptions[string(w.Format)].Indent = 4
}

But there is a problem, that code introduces inconsistency across all sets of options. So, to force a consistent behavior I need to change each individual options set:
w := writer.New()
for f = range w.RenderOptions {
   w.RenderOptions[f].Indent = 4
}

This is clearly inefficient and impractical. We need to factor out common options into a reusable struct to be able to set the common options in a practical way (as in the first example).
The only sets that we need to catalog behind a key are the serializer functions, so I propose we restructure the functions like this:
// Current writer options, two sets repeated for each format

r := &Writer{
    RenderOptions: : map[string]*native.RenderOptions{
        string(formats.SPDX23JSON): native.RenderOptions{
                CommonRenderOptions {}
                // more optios
        },
        string(formats.CDX14JSON): native.RenderOptions{
                CommonRenderOptions {} // these common options repeat the struct above
                // more optios
        },
    },
    SerializeOptions: map[string]*native.SerializeOptions{
        string(formats.SPDX23JSON): native.SerializeOptions{
                CommonSerializeOptions
                // more options
        },
        string(formats.CDX14JSON): native.SerializeOptions{
                CommonSerializeOptions // same options as the spdx23 set
                // more options
        },
    },
}

// New Proposal, one options struct with the writer options, embedding the
// common serializer and render options and a dict keyed to the specific
// serializer structs:

type Options struct {
	Format           formats.Format
	RenderOptions    *native.RenderOptions
	SerializeOptions *native.SerializeOptions
	formatOptions    map[string]interface{
                 string(formats.SPDX23JSON): spdxOpts{},
                 string(formats.CDX14JSON): spdxOpts{},
        }
}

This new options struct lets us control a unique shared setting for the serializer options, no matter if it is in the render or serialize structs and it is effective for al calls to serialize documents:
  myWriter.Options.Indent = 4
  myWriter.Options.Logger = myLogger
  myWriter.Options.DebugLevel = 1
  myWriter.Options.ErrOnDataLoss = true

I will send a PR to demo the proposal, we can discuss it in our meeting.

@puerco It was a pleasure reading this; thank you so much for pointing this out.
I liked your proposal, and would really like to see this happen before we ship v0.2


Cannot import pwd while using jupyter-repo2docker in docker terminal

Hi @lalwanigunjan,
Windows support is still in the experimental stage see documentation section. Please try another OS or the suggestion in the documenation section about WSL. Thanks.


EgorBot for EgorBo in #52

Processing https://github.com/EgorBot/runtime-utils/issues/52#issuecomment-2327234704 command:
Command
-intel -arm64 -profiler -pr 107218
using System;
using System.Runtime.CompilerServices;
using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;

BenchmarkRunner.Run<Bench>(args: args);

public class Bench
{
    [Benchmark]
    public void Foo()
    {
        for (int i = 0; i < 1000; i++)
            Work<char>(1);
    }

    [MethodImpl(MethodImplOptions.NoInlining)]
    static void Work<T>(int size) => GC.KeepAlive(GC.AllocateUninitializedArray<T>(size));
}

(EgorBot will reply in this issue)

Benchmark results on Intel
BenchmarkDotNet v0.14.0, Ubuntu 22.04.4 LTS (Jammy Jellyfish)
Intel Xeon Platinum 8370C CPU 2.80GHz, 1 CPU, 16 logical and 8 physical cores
  Job-OTJYDB : .NET 10.0.0 (<IP_ADDRESS>424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
  Job-NHEJYJ : .NET 10.0.0 (<IP_ADDRESS>424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
RatioSD=0.02

Method
Toolchain
Mean
Error
Ratio

Foo
Main
10.058 μs
0.1493 μs
1.00

Foo
PR
9.389 μs
0.1258 μs
0.93

BDN_Artifacts.zip
Flame graphs: Main vs PR 🔥
Hot asm: Main vs PR
Hot functions: Main vs PR
Counters: Main vs PR
For clean perf results, make sure you have just one [Benchmark] in your app.

cc @EgorBo (logs)

Benchmark results on Ampere
BenchmarkDotNet v0.14.0, Ubuntu 22.04.4 LTS (Jammy Jellyfish)
Ampere
  Job-QANLBI : .NET 10.0.0 (<IP_ADDRESS>424), Arm64 RyuJIT AdvSIMD
  Job-GMRJLU : .NET 10.0.0 (<IP_ADDRESS>424), Arm64 RyuJIT AdvSIMD

Method
Toolchain
Mean
Error
Ratio

Foo
Main
12.446 μs
0.0616 μs
1.00

Foo
PR
9.029 μs
0.0190 μs
0.73

BDN_Artifacts.zip
Flame graphs: Main vs PR 🔥
Hot asm: Main vs PR
Hot functions: Main vs PR
Counters: Main vs PR
For clean perf results, make sure you have just one [Benchmark] in your app.

cc @EgorBo (logs)


Error:Module 'com.wu-man:android-oauth-client:0.4.4' depends on one or more Android Libraries but is a jar

getting this build error in gradle.
one work around is to force it to use the aar by putting
compile 'com.wu-man:android-oauth-client:0.4.4@aar' in the gradle dependecies

What is the solution for this problem? I am facing the same issue

As above, instead of using the gradle line wuman has in the docs, you need to but @aar in it which forces gradle to pull a valid format. I'm guess wuman hasn't configured the library correctly in the root directory or something.

Putting an @aar in the end resolved the build error, but now what is happening that it did not got all the dependencies of this library like JacksonFactory, ClientParametersAuthentication, etc...
Do I have to add these missing dependencies of this library in my project? or is it the library should have got them.

Er yeah no idea what's going on with gradle... At this point best option is to download the actual .jar, import it to the libs folder, right click and add as a library ¯_(ツ)_/¯

Will adding the jar of this library resolve all the dependencies? or still I will need to add those explicitly in my app?

Finally I've got it to work.
I ve added the library project provided in the repo to my project as a dependency in my build.gradle
compile project (':library').
and It got all the underlying dependencies of the library as well.

This is what I did to resolve my issue. Thanks to this issue.
    compile 'com.wu-man:android-oauth-client:0.4.5@aar'
    compile('com.google.api-client:google-api-client-android:1.20.0') {
        exclude group: 'com.google.android.google-play-services', module: 'google-play-services'
        exclude group: 'junit', module: 'junit'
        exclude group: 'com.google.android', module: 'android'
    }
    compile 'com.google.oauth-client:google-oauth-client-java6:1.20.0'
    compile 'com.google.http-client:google-http-client-jackson:1.20.0'

You can update the versions of the dependencies for this project to newer versions if you'd like. If you are pulling in the @aar for this project, then you will also need to open your AndroidManifest.xml and add the tools namespace xmlns:tools="http://schemas.android.com/tools" and also tools:replace="android:allowBackup" to the <application> tag.


Fill values distort model fitting procedures

The fill values used when requesting image tiles from OpenSlide can produce errors in building models to distinguish tissue from glass. Need to modify code to exclude pixels from filled areas that are added to create an integral-sized tiling.

Fixed. Now model fitting in SimpleMask.py is performed only in valid regions of the image, not in fill-value areas extended beyond the original image boundaries produced by tiling.


Implement Claim redeemer branch for the deposit validator + relevant mutations

Subtask of #199

Implement the Claim redeemer branch of the deposit validator.

Add head currency symbol to the Claim redeemer in order to check it against the datum value.

Add upper validity bound for increment in order to be able to check if the deposit deadline has not been reached.

Double the amount of contestation period value when setting the deposit deadline in order to give enough room for increment
to be valid (before the deadline).

Add appropriate deposit mutations.

[ ] CHANGELOG updated or not needed
[ ] Documentation updated or not needed
[ ] Haddocks updated or not needed
[ ] No new TODOs introduced or explained herafter

closing since I really want to rename this branch name


Using upload_files through GitHub URL doesn't copy the exact code

What's your CLI version?
1.1.0
Description & steps to reproduce
I am using plan.upload_files with a private GitHub URL, the code doesn't get copied as it is. I see some parts are missing, it is a solidity file.
Desired behavior
Files should get copied inside enclave as is.
What is the severity of this bug?
Critical; I am blocked and Kurtosis is unusable for me because of this bug.
What area of the product does this pertain to?
CLI: the Command Line Interface

Hey @nidhi-singh02 would you mind expanding on this? Could you give me an example of the github URL/how you are referencing it? Is it referencing a package (upload_files only allows referencing kurtosis packages, not arbitrary urls) Additionally, if you are referring to a private GitHub URL - are you authenticated via kurtosis github login to access that private github url?

Sure, unfortunately I cannot share the GitHub URL as it is private repository. Yes, I am using upload_files - I read in the documentation that it works for any GitHub URL irrespective of it being a kurtosis package. Let me know if my understanding needs correction. What I understand is whatever is being uploaded, is stored inside the enclave.
Yes, I am authenticated via kurtosis github login.

Hey @nidhi-singh02 let me know if you were able to solve this - I'm happy to iterate with you over Discord to see why all files aren't being copied. Feel free to send me a friend request.


Fix pehar rara issue in translations

a pehar haha is getting changed to a pehar rara followed by a haha - this should be a global replacement

please provide from and to character strings

from "Rh" to "H" can you do a search on the translations for "Rh" ?

ping

@tarunsingh5
+----------+
| count(*) |
+----------+
|     9877 |
+----------+```

do you want to dump these grouped by the word into a csv and I can check and we can mass replace

submitted to control panel with this query:

INSERT INTO `VerseChangeQueue`
(`ID`,
`English`,
`Gurmukhi`,
`GurmukhiBisram`,
`GurmukhiUni`,
`Translations`,
`Transliterations`,
`WriterID`,
`Punjabi`,
`PunjabiUni`,
`Spanish`,
`RaagID`,
`PageNo`,
`LineNo`,
`SourceID`,
`FirstLetterStr`,
`MainLetters`,
`Bisram`,
`Visraam`,
`igurbani_bisram1`,
`igurbani_bisram2`,
`FirstLetterEng`,
`Transliteration`,
`Updated`,
`FirstLetterLen`,
`UserID`,
`Pending`)
SELECT
`ID`,
`English`,
`Gurmukhi`,
`GurmukhiBisram`,
`GurmukhiUni`,
JSON_REPLACE(`Translations`, '$.pu.ss', REPLACE(JSON_UNQUOTE(JSON_EXTRACT(Translations, '$.pu.ss')),'Rh', 'R')) AS Translations,
`Transliterations`,
`WriterID`,
`Punjabi`,
`PunjabiUni`,
`Spanish`,
`RaagID`,
`PageNo`,
`LineNo`,
`SourceID`,
`FirstLetterStr`,
`MainLetters`,
`Bisram`,
`Visraam`,
`igurbani_bisram1`,
`igurbani_bisram2`,
`FirstLetterEng`,
`Transliteration`,
NOW() AS `Updated`,
`FirstLetterLen`,
36 as `UserID`,
1 as `Pending`
FROM
	Verse
WHERE
	JSON_EXTRACT(Translations, '$.pu.ss')
	LIKE BINARY '%Rh%';

INSERT INTO `VerseChangeQueue`
(`ID`,
`English`,
`Gurmukhi`,
`GurmukhiBisram`,
`GurmukhiUni`,
`Translations`,
`Transliterations`,
`WriterID`,
`Punjabi`,
`PunjabiUni`,
`Spanish`,
`RaagID`,
`PageNo`,
`LineNo`,
`SourceID`,
`FirstLetterStr`,
`MainLetters`,
`Bisram`,
`Visraam`,
`igurbani_bisram1`,
`igurbani_bisram2`,
`FirstLetterEng`,
`Transliteration`,
`Updated`,
`FirstLetterLen`,
`UserID`,
`Pending`)
SELECT
`ID`,
`English`,
`Gurmukhi`,
`GurmukhiBisram`,
`GurmukhiUni`,
JSON_REPLACE(`Translations`, '$.pu.ss', REPLACE(JSON_UNQUOTE(JSON_EXTRACT(Translations, '$.pu.ss')),'Rh', 'H')) AS Translations,
`Transliterations`,
`WriterID`,
`Punjabi`,
`PunjabiUni`,
`Spanish`,
`RaagID`,
`PageNo`,
`LineNo`,
`SourceID`,
`FirstLetterStr`,
`MainLetters`,
`Bisram`,
`Visraam`,
`igurbani_bisram1`,
`igurbani_bisram2`,
`FirstLetterEng`,
`Transliteration`,
NOW() AS `Updated`,
`FirstLetterLen`,
36 as `UserID`,
1 as `Pending`
FROM
  Verse
WHERE
  JSON_EXTRACT(Translations, '$.pu.ss')
  LIKE BINARY '%Rh%'
  AND
  JSON_EXTRACT(Translations, '$.pu.ss')
  NOT LIKE BINARY '%bRhm%'
  AND
  JSON_EXTRACT(Translations, '$.pu.ss')
  NOT LIKE BINARY '%gRhx%'
  AND
  JSON_EXTRACT(Translations, '$.pu.ss')
  NOT LIKE BINARY '%igRhsqI%'
  AND
  JSON_EXTRACT(Translations, '$.pu.ss')
  NOT LIKE BINARY '%gRhsq%'
  AND
  JSON_EXTRACT(Translations, '$.pu.ss')
  NOT LIKE BINARY '%pRhlwd%'
  AND
  JSON_EXTRACT(Translations, '$.pu.ss')
  NOT LIKE BINARY '%igRhsQ%'
  LIMIT 500\G

can this be closed?

no, its being batched right now and we are waiting for queue to empty for
next part of batch.
On Thu, Apr 16, 2020 at 2:33 PM maneetpaul<EMAIL_ADDRESS>wrote:

can this be closed?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/KhalisFoundation/banidb-api/issues/34#issuecomment-614908239,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAE5OFMOJW63MSVPJZKNKTDRM52UFANCNFSM4E2WHVDA
.


[Badge] Improve demos

Orignal Title: [Badge] Retain text, color and variant while disappearing
Currently, Badge will apply all appearance immediately even while disappearing transition.
It perhaps causes flicker in some cases like:

Show red badge with counter if the user has an urgent notification.
Otherwise show blue badge with counter.
<Badge color={hasUrgent ? 'error' : 'secondary'} badgeContent={count}>
Then it unwantedly shows disappearing blue 0 badge after the user opens notification.

Simulating such situation with demo:
docs/src/pages/components/badges/BadgeVisibility.js
-        <Badge color="secondary" badgeContent={4} invisible={invisible} className={classes.margin}>
+        <Badge color={invisible ? 'primary' : 'secondary'} badgeContent={invisible ? 0 : 4} className={classes.margin}>

This PR fixes that flicker: text, color and variant will be applied at next appearing.

Browser test was failed with timeout. Can I retry it?

I don't understand, what problem do the changes solve?

Changing the appearance of a badge while disappearing animation (like badgeContent={1} to {0}, or changing color prop) causes a flickering experience. So this PR keeps the appearance while the animation. It is an enhancement, not a bug.
(I checked Google Analytics and found that its badge will be invisible immediately after the notification item is opened.)

Should it be handled in userland? What's the use case for changing the appearance during an animation?

I think most of the users write badgeContent={count} and make count 0 to hide a badge. It will effectively change appearance (content text) at the start of the animation. Color is

I think most of the users write badgeContent={count} and set count to 0 to hide a badge, and it effectively changes appearance (content text) at the start of the animation.
Color must be less frequently changed, but writing something like <Badge color={hasUrgent ? 'error' : 'secondary'}> and resetting hasUrgent flag at hiding also causes flicker.
(I checked Google Analytics (which uses different colors for same badge), and it does not animate at disappearing.)

@ypresto Ok thanks for sharing the use case. I don't think that we should care about the color change. Regarding the 0 -> 1 jump. I have updated the demo to reproduce it and updated the implementation with a simple patch. If that work for you, I think that it would be great to add a test case (with testing-library, not enzyme).

@ypresto I have sent one commit to focus on the demo only.
Regarding the animation problem. I can't wrap my head around a viable solution. Any idea?

I was in new year holidays :pray:

leave it to userland until we have enough time to deticate to it.

I agree with you. Might better to have demo, but perhaps someone want to fix it  can find this PR. 😺

It seems that the documentation has this exact same issue with the notification, we can see a

cc @mbrookes

Ah, it was hidden when the popper content covered the icon, so hadn't noticed.
What about this diff?:
index cf1fcef48..1ddcfe62b 100644
--- a/packages/material-ui/src/Badge/Badge.js
+++ b/packages/material-ui/src/Badge/Badge.js
@@ -171,6 +171,8 @@ const Badge = React.forwardRef(function Badge(props, ref) {
     ...other
   } = props;

+  const [lastContent] = React.useState(badgeContent, []);
+
   let invisible = invisibleProp;

   if (
@@ -184,6 +186,7 @@ const Badge = React.forwardRef(function Badge(props, ref) {

   if (variant !== 'dot') {
     displayValue = badgeContent > max ? `${max}+` : badgeContent;
+    displayValue = badgeContent === 0 && !showZero ? lastContent : badgeContent;
   }

   return (

@mbrookes Does it work with consecutive updates?

It works with the docs +/- demo, but as soon as I posted it, I realised that for the notifications icon, it's still showing showing 0 before transitioning out. 🤷🏽♂


Added guide for inbound sso oauth2

Checklist

[x] You have read the Contribution Guidlines before creating this PR.

Description of change
Added a guide for inbound sso oauth2 under content/guide/inbound-sso-oauth and added the link to container.js
JIRA Ticket :https://loginradius.atlassian.net/browse/LSS-576

This is linked to #276


Compiler warnings on windows:

1>C:\Users\ruud\source\repos\Nate\NateParser.tab.h(554,1): warning C4065:  switch statement contains 'default' but no 'case' labels
1>C:\Users\ruud\source\repos\Nate\NateParser.tab.h(545): message :  while compiling class template member function 'void yy::parser::basic_symbol<yy::parser::by_type>::clear(void)'
1>C:\Users\ruud\source\repos\Nate\NateParser.tab.h(540): message :  see reference to function template instantiation 'void yy::parser::basic_symbol<yy::parser::by_type>::clear(void)' being compiled
1>NateParser.cpp
1>C:\Users\ruud\source\repos\Nate\NateParser.tab.h(651): message :  see reference to class template instantiation 'yy::parser::basic_symbol<yy::parser::by_type>' being compiled

That's part of the fun writing code generators for pedantic compilers 😳
I suppose this happens with an empty set of rules?

It happens in the clear() method of basic_symbol struct
      /// Destroy contents, and record that is empty.
      void clear ()
      {
        // User destructor.
        symbol_number_type yytype = this->type_get ();
        basic_symbol<Base>& yysym = *this;
        (void) yysym;
        switch (yytype)
        {
       default:
          break;
        }

Hm. This doesn't look like code that is part of reflex or generated by it, unless you've put it in a lexer file or is part of the project built. The basic_symbol struct is a Bison thing when symbol_types are used (aka. Bison complete symbols).

ah sorry, you're right. Close.


Crash upon loading a world

Every time I load a world, I received this crash report as soon as the loading screen is over. I'm pretty sure that this is the mod that causes the crash. This is the crash text file. I just wanna play this mod it seems really cool.
crash-2019-07-06_16.30.42-server.txt

After I've tested some more, I have found that the result of this crash was optifine believe it or not. I've installed another version of optifine and no longer receiving this crash report.


[i18n]zh-cn minor fix

Issue(s):
Description
Fix typos.
Checklist

[ ] CI Verifier: Run cairo_programs_verifier successfully
[ ] Contract Tests: Added tests to cover the changes
[ ] Remix Link: Added a link to open the contract in Remix
[ ] Deployed Contract (Optional): If possible, include a Voyager link to a deployed contract on Goerli

@julio4 Yes it breaks sths but not too many. Most of them are links.
I will rebase and fix it.

@julio4 Finished. We will translate the components chapter next week(because I am translating the components chapter of Cairo Book :p)

I think @cryptonerdcn or I should upload the updated message.pot, I checked their new translation file zh-cn.po, and I think the merge will break it just like what's happening in Spanish.

Did you encounter the same errors in the Cairo book? I can try to downgrade mdbook to 0.4.31.
I'll need to read the i18n documentation. Feel free to open an issue and continue the discussion there.

@julio4 Yes, also in Cairo Book, dojobook and starknetbook. They all have same issue now.

@julio4 Maybe we can merge this first.


Adding new types aren't recognized until restarting VSCode

Environment data
dotnet --info output:
.NET SDK:
 Version:   7.0.400
 Commit:    73bf45718d

Runtime Environment:
 OS Name:     Mac OS X
 OS Version:  13.5
 OS Platform: Darwin
 RID:         osx.13-arm64
 Base Path:   /usr/local/share/dotnet/sdk/7.0.400/

Host:
  Version:      7.0.10
  Architecture: arm64
  Commit:       a6dbb800a4

.NET SDKs installed:
  6.0.404 [/usr/local/share/dotnet/sdk]
  7.0.203 [/usr/local/share/dotnet/sdk]
  7.0.400 [/usr/local/share/dotnet/sdk]

.NET runtimes installed:
  Microsoft.AspNetCore.App 6.0.12 [/usr/local/share/dotnet/shared/Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 7.0.5 [/usr/local/share/dotnet/shared/Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 7.0.10 [/usr/local/share/dotnet/shared/Microsoft.AspNetCore.App]
  Microsoft.NETCore.App 6.0.12 [/usr/local/share/dotnet/shared/Microsoft.NETCore.App]
  Microsoft.NETCore.App 7.0.5 [/usr/local/share/dotnet/shared/Microsoft.NETCore.App]
  Microsoft.NETCore.App 7.0.10 [/usr/local/share/dotnet/shared/Microsoft.NETCore.App]

Other architectures found:
  x64   [/usr/local/share/dotnet/x64]
    registered at [/etc/dotnet/install_location_x64]

Environment variables:
  Not set

global.json file:
  Not found

Learn more:
  https://aka.ms/dotnet/info

Download .NET:
  https://aka.ms/dotnet/download

OmniSharp log
Using dotnet configured on PATH
Dotnet path: /usr/local/share/dotnet/dotnet
Activating C# + C# Dev Kit + C# IntelliCode...
[Info  - 8:50:14 AM] [Program]Language server initialized
[Error - 8:50:37 AM] [LanguageServerHost]System.ArgumentException: The changes must not overlap. (Parameter 'changes')
   at Microsoft.CodeAnalysis.Text.SourceText.WithChanges(IEnumerable`1 changes) in /_/src/Compilers/Core/Portable/Text/SourceText.cs:line 679
   at Microsoft.CodeAnalysis.Text.ChangedText.WithChanges(IEnumerable`1 changes) in /_/src/Compilers/Core/Portable/Text/ChangedText.cs:line 158
   at Microsoft.CodeAnalysis.Completion.Providers.AbstractImportCompletionProvider.GetChangeAsync(Document document, CompletionItem completionItem, Nullable`1 commitKey, CancellationToken cancellationToken) in /_/src/Features/Core/Portable/Completion/Providers/ImportCompletionProvider/AbstractImportCompletionProvider.cs:line 196
   at Microsoft.CodeAnalysis.Completion.CompletionService.GetChangeAsync(Document document, CompletionItem item, Nullable`1 commitCharacter, CancellationToken cancellationToken) in /_/src/Features/Core/Portable/Completion/CompletionService.cs:line 237
   at Microsoft.CodeAnalysis.LanguageServer.Handler.Completion.AbstractLspCompletionResultCreationService.GenerateAdditionalTextEditForImportCompletionAsync(CompletionItem selectedItem, Document document, CompletionService completionService, CancellationToken cancellationToken) in /_/src/Features/LanguageServer/Protocol/Handler/Completion/AbstractLspCompletionResultCreationService.cs:line 398
   at Microsoft.CodeAnalysis.LanguageServer.Handler.Completion.DefaultLspCompletionResultCreationService.ResolveAsync(CompletionItem lspItem, CompletionItem roslynItem, TextDocumentIdentifier textDocumentIdentifier, Document document, CompletionCapabilityHelper capabilityHelper, CompletionService completionService, CompletionOptions completionOptions, SymbolDescriptionOptions symbolDescriptionOptions, CancellationToken cancellationToken) in /_/src/Features/LanguageServer/Protocol/Handler/Completion/DefaultLspCompletionResultCreationService.cs:line 89
   at Microsoft.CodeAnalysis.LanguageServer.Handler.CompletionResolveHandler.HandleRequestAsync(CompletionItem completionItem, RequestContext context, CancellationToken cancellationToken) in /_/src/Features/LanguageServer/Protocol/Handler/Completion/CompletionResolveHandler.cs:line 66
   at Microsoft.CommonLanguageServerProtocol.Framework.QueueItem`3.StartRequestAsync(TRequestContext context, CancellationToken cancellationToken) in /_/src/Features/LanguageServer/Microsoft.CommonLanguageServerProtocol.Framework/QueueItem.cs:line 176
[Error - 8:50:37 AM] Request completionItem/resolve failed.
  Message: The changes must not overlap. (Parameter 'changes')
  Code: -32000
[object Object]

Steps to reproduce

Create an empty .NET Console app (dotnet new console) in a folder
Open the folder in VSCode
Add a file (e.g. Test.cs) and fill in a namespace and add an empty class to it (e.g. public class Test {}
Open Program.cs and instantiate the new type: var t = new Test()
Try to use code fix to add the using statement.
Add the using statement for the namespace manually.

Expected  behavior
Type should be recognized and give me a code fix to add the necessary using statement. When adding the namespace manually, I would be expecting it not to have any squiggles and intellisense working.
Actual behavior
Codefixes doesn't give me the option and the type is not recognized even after adding the namespace manually. The error in the C# Log comes while typing out the using statement for the namespace. If one tries to just restart the language server, the type is still not recognized. The only thing that makes it work again is restarting VSCode. This is for every type being created.
Additional context
This problem just started happening with version 2.0.436. I've tried to revert step by step back to previous versions, but none of the 2.* versions work. Going back to version 1.26.0 makes this work again.
This is on a M1 Mac running Ventura 13.5.1.
I tried uninstalling VSCode, removing the Code folder in Application Support and the .vscode folder in the home folder. And then reinstalling it and my extensions and still didn't work on 2.0.436, but fine on 1.26.0.

I'm also experiencing this

Same problem.

Same

Any updates on this?

I did a test today by updating everything (VS Code: 1.83.0, C# extension: 2.5.30) and now it looks like this is corrected.
I'll be using this setup throughout the day and report back if it is stabile - and possibly close this issue.

I've now worked with this for a few hours, and with my workflow of typically working in one file and create a bunch of types and then extracting them using refactoring to their own files seems to be working fine. All types are discovered and VSCode has not been giving me any squigglies so far.


Pin karma, karma-mocha dev dependencies

CC @hankim813

Codecov Report

Merging #7 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master       #7   +/-   ##
=======================================
  Coverage   97.82%   97.82%
=======================================
  Files           1        1
  Lines          46       46
=======================================
  Hits           45       45
  Misses          1        1

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3407527...0a1d5ca. Read the comment docs.


Import SHA-1 specification document

This document will serve as base for the hardware implementation and testbenches.

Imported SHA-1 spec published by FIPS + SHA-1 wiki documentation (commit sha 0db74ee1).
Issue closed.


Improve test display names

Fixes #24538

Display name of method, parametrised method, suite, class events are quoted and has prefixes. E.g. Test name(), Test name()(org.example.TestCase) and Test suite 'name(org.example.TestCase)' should be name;
Display name for JUnit 5 method event by default has information about method arguments. E.g. test(), test(int, String), etc should be test;

Display names are now passed transparently from Junit5, without transformations

Display name for JUnit 4 class event has class with package prefix. E.g. org.example.TestCase should be TestCase;

fixed

Display name for parametrised intermediate method event (which class are annotated by @DisplayNameGeneration(DisplayNameGenerator.ReplaceUnderscores.class)) has trailing space in name. E.g. pretty name (int)[1] should be pretty name;

This is expected, added a test to cover that. Resulting display name is passed from Junit5 directly and doesn't have a trailing space.

Class and method names are absent for JUnit 5 parametrised and Spock intermediate method events;

Those can be acquired via OperationDescriptor.getParent() and JvmTestOperationDescriptor

Method name for JUnit 5 parametrised method event has suffix with parameter number.  E.g. test(int)[1], test(int)[2], test(int)[3], etc should be test;
Method name has unparsed signature of test method. I prefer to see here only method name. E.g. test(), test(int), test(int)[1], etc should be test;

fixed
Reviewing cheatsheet
Before merging the PR, comments starting with

❌ ❓must be fixed
🤔 💅 should be fixed
💭 may be fixed
🎉 celebrate happy things

@bot-gradle test ACT

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

@bot-gradle test ACT

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

@bot-gradle test ACT

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

@bot-gradle test ACT

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

@bot-gradle test ACT

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

@bot-gradle test ACT

I've triggered the following builds for you. Click here to see all build failures.

AllCrossVersionTestsReadyForNightly build

The merge queue build has started. Click here to see all failures if any.


Remove SmallBank Round-Robin approach for Transaction Scheduling in C…

Remove SmallBank Round-Robin approach for Transaction Scheduling in C…

Please raise PR to caliper repo.


WIP: Do not merge

Which issue(s) this PR addresses:

Closes #

/test ?

/test ocp-full-conformance-rhel-eus
/test ocp-full-conformance-serial-rhel-eus

/close


problems with snakemake installation

hi there,
i followed instructions for installation ... however when I went to run the test data I got the following:
(tobias_snakemake_env) user:~/TOBIAS_snakemake$ snakemake --configfile example_config.yaml --use-conda --cores 10
/TOBIAS_snakemake/Snakefile:45: SyntaxWarning: invalid escape sequence '\-'
  state = "bound|unbound",
/TOBIAS_snakemake/Snakefile:46: SyntaxWarning: invalid escape sequence '\-'
  plotname = "[a-zA-Z0-9\-_\.]+",
/TOBIAS_snakemake/Snakefile:48: SyntaxWarning: invalid escape sequence '\-'
  #Save timestamp to config
/TOBIAS_snakemake/Snakefile:88: SyntaxWarning: invalid escape sequence '\-'
  sys.exit()
/TOBIAS_snakemake/Snakefile:91: SyntaxWarning: invalid escape sequence '\{'
  #-------------------------------------------------------------------------------#
/TOBIAS_snakemake/snakefiles/helper.snake:21: SyntaxWarning: invalid escape sequence '\s'
  if re.match("(^.+\s\d+\s\d+.*\n)+", file_content):
NotImplementedError in file
/TOBIAS_snakemake/snakefiles/wilson.snake, line 4:
Remote providers have been replaced by Snakemake storage plugins. Please use the corresponding storage plugin instead (snakemake-storage-plugin-*).

I'm a bit confused as it suggests an issue with regular expressions. The remote provider could be an incompatibility with snakemake?
snakemake --version
8.21.0

I'd appreciate any advice!

an update:
i forced an older snakemake version (6.10.0) and it runs ... but now I have the following issue:
snakemake --configfile example_config.yaml --use-conda --cores 10
Building DAG of jobs...
Creating conda environment environments/uropa.yaml...
Downloading and installing remote packages.
CreateCondaEnvironmentException:
Could not create conda environment from ~/TOBIAS_snakemake/environments/uropa.yaml:
error    libmamba Non-conda folder exists at prefix
critical libmamba Aborting.

adding --conda-prefix /tmp does not help.


Fuzz: Fix out of bounds access in squeeze channels

squeeze in_place transforms use the residual channels from right after
the squeeze transform range, but that might be out of bounds if the
endc channel is near the end of the list. This patch checks for the
channel number before accessing it.

Converted it into an assert. The actual fix for this issue is now in #370.