Add Sentry for main site

@tybritten I think I fixed the JS situation but take a look and let me know. If that works we're good to go except we need to update README with the hugo version bump.


Pass TLS cert to Traefik mTLS backend

Greetings,
I've scanned across this repo to see if anyone had a similar issue. Please close this issue if this has been made elsewhere, thanks! 😀
Do you want to request a feature or report a bug?
Feature request for V2 alpha.
What did you expect to see?

Traefik being able to pass a TLS certificate from one Traefik instance to another. Where the destination Traefik instance has mTLS enabled to authenticate the request.
The setup I had was my local host along with a remote server with Docker Compose. I've managed to get it working with the passTLSCert function, however this is deprecated in v1.7 as jbd mentioned.
Using passTLSClientCert doesn't work in my scenario since the destination Traefik mTLS mechanism doesn't pick up the certificate in the headers, thus giving me a "bad gateway/certificate" error.
I have described this issue in depth at community.containo.us. This is also similar to issue #4260, which was where I originally follow the V1 hack to get it working.
This feature has also been removed in V2 (#4375). Will there be an alternative approach to this?
What are your thoughts?

I also encounter the same problem because I forget to configure client authentication (https://docs.traefik.io/https/tls/#client-authentication-mtls).
Maybe it could specify on PassTLSClientCert page (https://docs.traefik.io/middlewares/passtlsclientcert/)


APP-2031 : Fix path and writing on Info logs

Build triggered. sha1 is merged.

Build started sha1 is merged.

Build finished.

Codecov Report

Merging #195 into dev will decrease coverage by 0.57%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##              dev    #195      +/-   ##
=========================================
- Coverage   89.07%   88.5%   -0.58%
=========================================
  Files         155     186      +31
  Lines        2820    3644     +824
  Branches      269     358      +89
=========================================
+ Hits         2512    3225     +713
- Misses        240     308      +68
- Partials       68     111      +43

Impacted Files
Coverage Δ

...oning/properties/CompanyCertificateProperties.java
0% <0%> (ø)

...ovisioning/client/model/AppStoreAssetsWrapper.java
100% <0%> (ø)

...visioning/exception/UsernameMismatchException.java
100% <0%> (ø)

...ation/provisioning/client/AppRepositoryClient.java
89.09% <0%> (ø)

...ation/provisioning/service/ApplicationService.java
83.07% <0%> (ø)

.../exception/ConfigurationProvisioningException.java
100% <0%> (ø)

...ion/provisioning/client/model/AppStoreWrapper.java
100% <0%> (ø)

...ning/service/ConfigurationProvisioningService.java
93.93% <0%> (ø)

...on/provisioning/exception/UpdateUserException.java
100% <0%> (ø)

...on/provisioning/exception/UserSearchException.java
100% <0%> (ø)

... and 21 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5b139f1...85fd014. Read the comment docs.


Query parameters parsing is too strict

For whatever reason, my client (a WASM app that use gloo-net to send the query) add an extra & at the end of the query.
The makes the parsing of query parameters fails with a Bad Query error.
The error originate at https://github.com/sammhicks/picoserve/blob/e5086aa61361e095aa9d3c5410d25be4c0faa4e8/src/url_encoded.rs#L473
I think we could be more forgiving and ignore empty URL segments at least at the end of the URL.

Sounds good, and thanks for the pull request :)


Problem with GUI import

Hello,
I installed spikeinterface GUI from
git clone https://github.com/SpikeInterface/spikeinterface-gui.git
cd spikeinterface-gui
pip install .
The GUI was installed as "spikeinterface-gui 0.6.0 "
However, when I import it I get an error:
import matplotlib.pyplot as plt
import numpy as np
from pathlib import Path
import spikeinterface-gui as sigui
%matplotlib inline
%matplotlib notebook

Cell In[36], line 6
    import spikeinterface-gui as sigui
                         ^
SyntaxError: invalid syntax

So I tried to replace the - with the underscore (_), but I get a different error:
import matplotlib.pyplot as plt
import numpy as np
from pathlib import Path
import spikeinterface_gui as sigui
%matplotlib inline
%matplotlib notebook

ImportError                               Traceback (most recent call last)
Cell In[37], line 6
      3 from pathlib import Path
      5 #import ephyviewer
----> 6 import spikeinterface_gui as sigui
      8 # %matplotlib widget
      9 get_ipython().run_line_magic('matplotlib', 'inline')

File ~/anaconda3/envs/s_i/lib/python3.10/site-packages/spikeinterface_gui/__init__.py:7
      1 """
      2 GUI without copy on top of spikeinterface objects
      3 """
      5 from .version import version as __version__
----> 7 from .myqt import QT, mkQApp
      8 from .mainwindow import MainWindow
      9 from .controller import SpikeinterfaceController

ImportError: cannot import name 'mkQApp' from 'spikeinterface_gui.myqt' (/home/paola322/anaconda3/envs/s_i/lib/python3.10/site-packages/spikeinterface_gui/myqt.py)

Any idea of why this happens and how can I fix it?
Thank you!

Hi Paola.
Thanks you for report.
import spikeinterface_gui as sigui is the correct way.
For the second error: I think you need to install PyQt5 or PySide6
I you are on anaconda you should do conda install pyqt=5

Hi Samuel,
thanks for your answer.
I ran conda install pyqt=5 and installed the libraries, but I get the same error.
ImportError: cannot import name 'mkQApp' from 'spikeinterface_gui.myqt' (/home/paola322/anaconda3/envs/s_i/lib/python3.10/site-packages/spikeinterface_gui/myqt.py)

Actually all these librarier are already installed in my environment.
pyqt                      5.15.7          py310h6a678d5_1
pyqt5                     5.15.9                   pypi_0    pypi
pyqt5-qt5                 5.15.2                   pypi_0    pypi
pyqt5-sip                 12.12.1                  pypi_0    pypi
pyqt6                     6.4.2                    pypi_0    pypi
pyqt6-qt6                 6.4.3                    pypi_0    pypi
pyqt6-sip                 13.4.1                   pypi_0    pypi
pyqtgraph                 0.13.2                   pypi_0    pypi
pyrsistent                0.19.3                   pypi_0    pypi
pyside2                   <IP_ADDRESS>                 pypi_0    pypi
pyside6                   6.4.3                    pypi_0    pypi
pyside6-addons            6.4.3                    pypi_0    pypi
pyside6-essentials        6.4.3                    pypi_0    pypi

However they are not recognized, that's why I can't use ephyviewer. That's why I am trying to use the GUI...

OK I guess th problem.
You have all of then in the same env! You should choose only one of then otherwise it is buggy.
I would choose pyqt5. Try to remove pyside2 and pyside6 and pyqt6

Dear Samuel,
I have removed those packages.
Now the list of the libraries is:
Nevertheless I get the same error when importing:
pyqt                      5.15.7          py310h6a678d5_1
pyqt5                     5.15.9                   pypi_0    pypi
pyqt5-qt5                 5.15.2                   pypi_0    pypi
pyqt5-sip                 12.12.1                  pypi_0    pypi
pyqt6                     6.4.2                    pypi_0    pypi
pyqt6-qt6                 6.4.3                    pypi_0    pypi
pyqt6-sip                 13.4.1                   pypi_0    pypi
pyqtgraph                 0.13.2                   pypi_0    pypi

ImportError                               Traceback (most recent call last)
Cell In[2], line 6
      3 from pathlib import Path
      5 #import ephyviewer
----> 6 import spikeinterface_gui as sigui
      7 #import PyQt5
      8
      9 # %matplotlib widget
     10 get_ipython().run_line_magic('matplotlib', 'inline')

File ~/anaconda3/envs/s_i/lib/python3.10/site-packages/spikeinterface_gui/__init__.py:7
      1 """
      2 GUI without copy on top of spikeinterface objects
      3 """
      5 from .version import version as __version__
----> 7 from .myqt import QT, mkQApp
      8 from .mainwindow import MainWindow
      9 from .controller import SpikeinterfaceController

mportError: cannot import name 'mkQApp' from 'spikeinterface_gui.myqt' (/home/paola322/anaconda3/envs/s_i/lib/python3.10/site-packages/spikeinterface_gui/myqt.py)

You are really unlucky (and also pyqt5 is a pain for installtion in conda)
What you need is this working:
import PyQt5
from PyQt5 import QtCore, QtGui, QtWidgets

You have both pyqt5 and pyqt in your env.
This look like a conflict
My guess is that you have installed both using conda install pyqt=5 and pip install PyQt5.
You should choose only one for instance conda for both pyqtgraph and pyqt.
conda install pyqt=5
conda install pyqtgraph
Here you should have working envs for installtion spikeinetrface + spiekinetrface-gui
https://github.com/SpikeInterface/spikeinterface/tree/main/installation_tips
Maybe download the yml and modify then to your needs.

So you suggest me to re-install spikeinterface?
I already have my spikeinterface environment (s_i) and I am afraid to re-install it then I will face again all the problems I faced already to be able to use it .I am not an expert on python and I wasted weeks try to troubleshoot issues...
What if I uninstall
pyqt                      5.15.7          py310h6a678d5_1
pyqt5                     5.15.9                   pypi_0    pypi
pyqt5-qt5                 5.15.2                   pypi_0    pypi
pyqt5-sip                 12.12.1                  pypi_0    pypi
pyqtgraph                 0.13.2                   pypi_0    pypi

and I install only these two as you suggested?
conda install pyqt=5
conda install pyqtgraph

Currently, if I try to import these:
import PyQt5
from PyQt5 import QtCore, QtGui, QtWidgets

I get:
ImportError                               Traceback (most recent call last)
Cell In[3], line 8
      5 #import ephyviewer
      7 import PyQt5
----> 8 from PyQt5 import QtCore, QtGui, QtWidgets
      9 import spikeinterface_gui as sigui
     10 # %matplotlib widget

ImportError: libGL.so.1: cannot open shared object file: No such file or directory

When I installed spikeinterface I cloned the link.

Maybe
pip uninstall pyqt5
pip uninstall pyqt5-qt5
pip uninstall pyqt5-sip
pip uninstall pyqtgraph
conda install pyqt=5
conda install pyqtgraph

Hi Samuel,
I deleted and reinstalled the libraries. Currently my list is:
pyparsing                 3.0.9           py310h06a4308_0
pyqt                      5.15.7          py310h6a678d5_1
pyqt5-sip                 12.11.0                  pypi_0    pypi
pyqtgraph

Nevertheless I get the same error if I try to import spikeinterface_gui:
ImportError: cannot import name 'mkQApp' from 'spikeinterface_gui.myqt' (/home/paola322/anaconda3/envs/s_i/lib/python3.10/site-packages/spikeinterface_gui/myqt.py)
And if I try to import:
import PyQt5
from PyQt5 import QtCore, QtGui, QtWidgets

ImportError: cannot import name 'QtCore' from 'PyQt5' (unknown location)`

Lauching sigui from jupyter should be avoid. (we have in docs for demonstration but should be avoid)
Qt and jupyter event loop do not play weel I think.
You should have a separated python script that run sigui or run it from a terminal.

Hi @samuelgarcia,
Thank you for the prompt response and greatly appreciate the help! Could you please clarify on what python script should contain that can run sigui. Or how to run sigui on the terminal, to be more specific I need these to run in a docker container.
Thank you,
Rohan

Hi.
The way of launching sigui are describe here for python script or command line
Doing GUi stuff inside a docker can be quite tricky specially from windows host because there is a need of a X server display. Even host linux can be annoying. My knowlegde on docker system will be limited to help you on this. I am sorry.


Hello, how to run the app locally

Sorry - documenting this has been on my to-do list for a long time and I've still not gotten around to it.
cf. https://github.com/IBM/taxinomitis/issues/4


Setup Windows CI build

Since #288 looks to be due to file paths it might be good to setup an additional CI build on Windows using AppVeyor

setup appveyor


UpdateExpression with DataMapper.update

Is it possible to use an UpdateExpression with the DataMapper.update method?
I think the docs around advanced usage could use a little more detail and examples :) I am happy to pull request some of this, but I haven't been able to get much of it working myself!

A PR with this change is up at #53
For docs, PRs adding to the JSDoc blocks or to the package READMEs are always welcome. Anything in particular that you haven’t been able to get working?

This feature was included in v0.5.0


Add toolranks support

Adds toolranks support for More Ores tools, due to support being removed from the toolranks mod (https://github.com/lisacvuk/minetest-toolranks/pull/7) to fix the circular dependency issues:
Closes https://github.com/minetest-mods/moreores/issues/33
https://github.com/lisacvuk/minetest-toolranks/issues/5
https://github.com/pandorabox-io/pandorabox.io/issues/389
It is also compatible with TenPlus1's fork (already has support removed): https://notabug.org/TenPlus1/toolranks

Thanks!
Also, thanks for taking the time to update the changelog :slightly_smiling_face:


Reducer (retrying after failed tests)

Implement deterministic pseudorandom reducer bridge as described in #1019
I've been running this locally for a while now.
Never figured out what the problem with the checks previously, so I'm merging in master and trying again.

Cool idea!

For a random number between 0 and 100 just do array_rand(range(0,100))?

For a random number between 0 and 100 just do array_rand(range(0,100))?

The key idea behind "deterministic pseudorandom" reduction is that the result will be the same each time the bridge is retrieved.

It's a nice idea. Does it have to be its own bridge? Can it be a context in e.g. FilterBridge?
Also a better name is maybe ReducerBridge.

I like this and I think adding it to the filter bridge would probably kill backwards compat with filterbridge and add a big chunk of complexity to filter.
Can you please add examplevalues? The filterbridge has a nist.gov feed that you could also use. Then it can be automatically tested.


Can’t even get this to work

It’s sheer impossible for me to get this to even work as the instructions say to get VendettaTweak from the prebuilt .deb files from GitHub Actions for Vendetta, but VendettaTweak doesn’t even install in the first place to be able to use this.
Maybe I’m doing something wrong but it says to get the deb file for VendettaTweak from the GitHub actions, which I do and it gives me a zip to unpack and then a deb file named Vendetta to install within Sileo. Trying to install it gives me an error about a pathname not being absolute

It says that Vendetta is already installed but it’s not, as the file disappears from my downloads

Trying to install via sideloadly does not work either as I get this error. Either something is seriously wrong for me or something else as I tried on both a jailbroken device and non-jailbroken device:

This is unfortunately outside of my expertise, I don't have any experience using tweaks at all. I can only make a guess that this is related with rootless/rootful tweak there, since I haven't heard any issue with the tweak itself (ensure you use the right one)
As for the error from Sideloadly, assuming that you got the IPA from Vendetta IPAs thread, no that's not your fault, it's just an issue from a decrypted raw IPA. I'm not sure if you can circumvent that

I tried both rootful and rootless but they both seem to give errors. The rootless one is the one that prevents being installed by Sileo by giving me actual errors so I assume my device needs the rootful version the one, which is in the screenshot. It acts like it installed but it does not and the deb file magically disappears nor does Sileo let me uninstall it.
For Sideloadly I got that from the readme from the host listed

I made a unofficial tweak, maybe try that?
https://github.com/Mukul1127/BunnyUnofficialTweak

I ended up giving up with getting it to work

Can you try BunnyTweak? Refer to the readme.
Closing issue since it's irrelevant to the reoo (loader issue)


build: Update change log and released go mods for 2.1.1 patch

Signed-off-by: Leonard Goodell<EMAIL_ADDRESS>

If your build fails  due to your commit message not passing the build checks, please review the guidelines here: https://github.com/edgexfoundry/edgex-go/blob/main/.github/Contributing.md
PR Checklist
Please check if your PR fulfills the following requirements:

[x] I am not introducing a breaking change (if you are, flag in conventional commit message with BREAKING CHANGE: describing the break)
[x] I am not introducing a new dependency (add notes below if you are)
[ ] I have added unit tests for the new feature or bug fix (if not, why?)
[ ] I have fully tested (add details below) this the new feature or bug fix (if not, why?)
[ ] I have opened a PR for the related docs change (if not, why?)

Testing Instructions

New Dependency Instructions (If applicable)

Codecov Report

Merging #4042 (c1ceb6c) into jakarta (f08ebb1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           jakarta    #4042   +/-   ##
========================================
  Coverage    45.84%   45.84%
========================================
  Files          112      112
  Lines         9655     9655
========================================
  Hits          4426     4426
  Misses        4845     4845
  Partials       384      384

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f08ebb1...c1ceb6c. Read the comment docs.


S3 endpoint creation broken due to S3 endpoint Interface type availability

Hi there
According to
https://aws.amazon.com/blogs/aws/aws-privatelink-for-amazon-s3-now-available/
there are now 2 types of S3 VPC Endpoints available, which breaks VPC module in case enable_s3_endpoint variable is set.
The workaround is to disable S3 endpoint management and add it via plain TF resource.
the error message is:
Error: multiple VPC Endpoint Services matched; use additional constraints to reduce matches to a single VPC Endpoint Service
here is how it looks like:
{
    "ServiceNames": [
        "com.amazonaws.eu-central-1.s3",
        "com.amazonaws.eu-central-1.s3"
    ],
    "ServiceDetails": [
        {
            "ServiceId": "....",
            "Owner": "amazon",
            "BaseEndpointDnsNames": [
                "s3.eu-central-1.amazonaws.com"
            ],
            "Tags": [],
            "AcceptanceRequired": false,
            "ManagesVpcEndpoints": false,
            "ServiceType": [
                {
                    "ServiceType": "Gateway"
                }
            ],
            "AvailabilityZones": [
                "eu-central-1a",
                "eu-central-1b",
                "eu-central-1c"
            ],
            "ServiceName": "com.amazonaws.eu-central-1.s3",
            "VpcEndpointPolicySupported": true
        },
        {
            "ServiceId": "...",
            "Owner": "amazon",
            "BaseEndpointDnsNames": [
                "s3.eu-central-1.vpce.amazonaws.com"
            ],
            "Tags": [],
            "AcceptanceRequired": false,
            "ManagesVpcEndpoints": false,
            "ServiceType": [
                {
                    "ServiceType": "Interface"
                }
            ],
            "AvailabilityZones": [
                "eu-central-1a",
                "eu-central-1b",
                "eu-central-1c"
            ],
            "ServiceName": "com.amazonaws.eu-central-1.s3",
            "VpcEndpointPolicySupported": true
        }
    ]
}

#573 covers it all. Please upgrade the module to v2.70.0.


Update german Translation and init inlang

Hi,
Changes

added an inlang.config.js file to the root of the repo
updated and fix German translations

I saw your german translation was broken. To make it easier for me to contribute to your translation, I added the tool inlang/inlang. I am opening this PR as a draft to discuss the tool. Maintainers or contributors would have no overhead as inlang is built on git. No accounts (login with GitHub), no sync, and no pipelines are required. Contributions open a PR.
Would an UI over the translations in this repo be of benefit to the goaccess community?
You can try it out on my fork and post your feedback under this draft.
https://inlang.com/editor/github.com/jannesblobel/goaccess
The PR is theoretically ready for review.

Note:
I saw a lot of translations that needed to be improved in other languages. Maybe you know some people and can ask for help :)
Example screenshots
let me know what your thoughts are :)

I think this is great! Like you said, having the UI makes it a lot easier to review and update. I'm happy to merge this.


Update to TeamCity 2021.1?

I think TeamCity 2020 is outdated, so I want to run TeamCity 2021 on my Raspberry. How can I upgrade? Can you adjust the warehouse alive?

I update my local repo, I found out that he has been updated, sorry


Can't Edit neoreset.json

Whenever I pressed F7 from the home screen, the script would work but it never created a new world. Instead it would just flick through random options sometimes closing out the game and other times chaning the narrator settings. I went to trouble shoot this by increasing the delay between presses. So I went to edit the delay (and also the sound since I don't like the voice) in the neoreset.json file in my .minecraft folder. But everytime I press F7 to test it, it would revert back to the original file. I kept an eye on the neoreset.json file when I closed out of minecraft, relaunched it and the file remained the same until I would press F7 then it would just switch back to the original.

That happens if neoreset was still running. Make sure to exit any running instance and then you can edit the file.
About the actual world creation issue: This sounds a lot like your list of existing worlds in Minecraft is empty. Make sure that there is at least one existing world (if not just create one manually) or else the input sequence to create a new world is different and neoreset will mess up. (If there is no existing world then the game will actually skip the screen where you would normally select a world and go straight to the new world screen.)

Also make sure that you have the correct version (1.14 or 1.16) selected in neoreset.json.

@The-cude Have you managed to get it working? Another thing that occurred to me is that perhaps you have some mods enabled that add (or remove) certain buttons from the vanilla Minecraft menu which could mess up the input sequence.

I did manage to get it working! Thanks for the advice that I can't edit it while its still running. I use linux mint, and I have no idea how to close neoreset. So what I end up doing is logging off my computer (which closes all applications), logging back in, edit neoreset, then try and see if it works. I found the defualt delay was way to short for me. It was almost random what it would do when I hit F7. I already have existing worlds, I'm using and selected the correct version (1.16) and I don't have any mods that add or remove buttons. When I increased the delay it worked perfectly no issues, just kinda slow. So I found the sweet spot of .15 second delay seems to work. If you have any reason why a shorter delay doesn't work and if I can fix it I would love to hear it! Thanks again for your help!

If it works with .15 then I would honestly just use that. I don't think there is much you can do, it's probably related to the overall performance of your computer at this point and how fast it can handle inputs. As long as your actual game isn't lagging I wouldn't worry about it.
About how to close neoreset: The easiest way to run neoreset is from the command-line. Open a terminal and just run it from there (you can either type the path to the executable or drag-and-drop the file into the terminal window and press enter). To stop neoreset (or any command for that matter) you just to press Ctrl+C and it will exit.


fix: JSON deserialisation fix to make google authentication stable for Dart and Flutter applications (firebase_auth)

Description
As I can see Firebase Authentication can omit some nullable fields (for example, isAnonymous in my own case) during the authentication process. And now it's not possible to sign in using last version of Firebase Auth package.
Related Issues
Replace this paragraph with a list of issues related to this PR from the issue database. Indicate, which of these issues are resolved or fixed by this PR. Note that you'll have to prefix the issue numbers with flutter/flutter#.
Checklist
Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]).
This will ensure a smooth and quick review process. Updating the pubspec.yaml and changelogs is not required.

[ ] I read the [Contributor Guide] and followed the process outlined there for submitting PRs.
[ ] My PR includes unit or integration tests for all changed/updated/fixed behaviors (See [Contributor Guide]).
[ ] All existing and new tests are passing.
[ ] I updated/added relevant documentation (doc comments with ///).
[ ] The analyzer (melos run analyze) does not report any problems on my PR.
[ ] I read and followed the [Flutter Style Guide].
[ ] I signed the [CLA].
[ ] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Does your PR require plugin users to manually update their apps to accommodate your change?

[ ] Yes, this is a breaking change.
[ x] No, this is not a breaking change.

Closing out as no response from user.


difference between ResNet implementation with TorchVision

Noticed that in PyTorch 1.3 and TorchVision 0.4.x , we get a ResNet that is slightly different from the implementation here.. should it be safe to port to the new version ?
torchvision.models.resnet on the left  model/faster_rcnn/resnet.py on the right

May be too late, but i implement this net with torchvision backbones of VGG16 and ResNet networks.
Results (VOC 2007) are the same:

VGG16 70,9%
ResNet50 73,1%
ResNet101 74,5%


CONFIG_DEADLOCK_COUNT in the drivers is a bad idea !

A lot of drivers use CONFIG_DEADLOCK_COUNT as a way to avoid infinite loops. This doesn't work.
Depending on the CPU power or level of optimization, this could trigger an assert and make a perfectly good software stall.
The solution is not obvious... We can increase the countdown but take the risk to see it fail anyway or find a way to determine the max counter depending on the CPU frequency.
This one is available in the clock HAL, but this means the clocks must be initialized, which is not satisfying either.

Partially "solved" with the use of arch_delay_us()


Robolectric will not work with XML annotated fontPath declarations

In the method getAttributeResourceValue(String namespace, String attribute, int defaultValue) in Robolectric, it will go to fetch the name of the attribute, and then find it, but because there is no '@' prefixing the name, the part of the method
if (attr.startsWith("@")) {
        return getResourceId(attr.substring(1), packageName, null);
      }

which would normally get the resource ID fails.
Thus I am unable to run unit tests on classes that inflate XML files that use Caligraphy

This is an issue with Robolectric. You could probably get around this by putting your fonts in your strings.xml file though.
Personally I stopped using Robolectric for UI, only and only for pure java. I would move to Espresso for UI tests.


PSD Bulk export of ANIM group

Changes

PSD bulk export has small modification when exports ANIM group in BG Layout extractor

ANIM group is not exported as one output but similar to export to compositing where it's subgroups are exported as separated outputs and are stored the same way

:black_flag:
Pype 3.x PR

pype
https://github.com/pypeclub/pype/pull/966

resolves #939


Support unicode values for mapping to punycode BNS names in recipient field of send form

For added usability (e.g. users can enter 🌎✌🏻.btc instead of xn--7bix418m.btc to send STX to someone).
It'd be prudent to display some sort of guidance about how we're doing this mapping on the fly, perhaps by showing the converted punycode value, even though there are no non-mapped unicode registrations on chain (but could potentially exist in the future with BNS protocol upgrades).

Yes, do it mark! People all ages across globe use emojis in their everyday life. Punycode is good, this is gonna be a big moment for us to build. Thanks team!

For clarification for now this functionality is not added. Because of the vulnerability discussed in the issue here: https://github.com/hirosystems/stacks-wallet-web/issues/2962#issuecomment-1369685802
For now you will see:

And type the bns name instead to resolve the STX address (or BTC address, if available).


[Scenario] Escape from Cthulhu's Mansion

What kind of mission do you want to add (mark with an X, e.g. [X] Descent)?

[X] Mansions of Madness
[ ] Descent

What expansions does the scenario require?

[ ] Conversion Kit (CK)
[ ] First Edition (MoM1E) - Also Recurring Nightmares
[ ] Fatal Alchemy (FA) - Also Suppressed Memories
[ ] Call of the Wild (CotW) - Also Suppressed Memories
[ ] Beyond the Threshold (BtT)
[ ] Streets of Arkham (SoA)
[ ] Sunctum of Twilight (SoT)
[ ] Horrific Journeys (HJ)
[ ] Path of the Serpent (PotS)

What expansions can the scenario optionally use?

[ ] Conversion Kit (CK)
[ ] First Edition (MoM1E) - Also Recurring Nightmares
[ ] Fatal Alchemy (FA) - Also Suppressed Memories
[ ] Call of the Wild (CotW) - Also Suppressed Memories
[ ] Beyond the Threshold (BtT)
[ ] Streets of Arkham (SoA)
[ ] Sunctum of Twilight (SoT)
[ ] Horrific Journeys (HJ)
[ ] Path of the Serpent (PotS)

Please enter the GitHub Url to your scenario here
https://github.com/vidimus/DomeAcolyte/tree/main/Lost_chronicles_09
Escape room style scenario for Mansions of Madness.

@antontimmermans , would you mind to add it to the statistics?

Done


Some feature requests after using for several months

I have been using Spoolman for several months now. Using mostly for logging what's on-hand for design work, gives me a pallet of color and material choices at-a-glance.
Some iIdeas I have ...
1-(un)group spools for a project.  I would like to group spools I intend to use for a project for easy access (I have 157 spools in my spool man database making it cumbersome to find what I need quickly).  Then when I'm done with that project I want to remove that group.  I'm thinking these groups are only a way to view spools so they do not need to remove the spools from the overall spool list only group ones I want to see on a per project basis then remove the group when done.
2-update 'used' from Gcode import.  It would be nice to be able to import a Gcode files only to read how much filament is estimated to be used and then be able to tell Spoolman what filament(s) are to be consumed.  I ask this as a way to handle using my Bambu Lab X1C.  My 2 Prusa printers are using Octoprint with the Spoolman plugin so no issues here on tracking usage.  But the idea to read the Gcode file, or at least a better GUI to manually enter filament used would be overall nice for anyone that has a 3D printer to use this software...at least how I am (design color/material choices on-hand and Bambu Lab tracking).
3-adjustable column widths.  I would like to be able to make the columns wider, especially the comments column.
4-link and unlink attributes between Spoolman pages/categories.  I would like to be able to show an attribute on the Spools page that is actually from the Filaments page.  In this example I want to hex color code but being able to chose any would be perfect.  And of coarse be able to unlink them.
Thank for this great work.  I hope you consider my ideas seriously as I think some of them others would like too.

4-link and unlink attributes between Spoolman pages/categories. I would like to be able to show an attribute on the Spools page that is actually from the Filaments page. In this example I want to hex color code but being able to chose any would be perfect. And of coarse be able to unlink them.

I would love to simply add attributes from a filament to the Spools view.  For example:  I created a custom boolean column to track that I've calibrated that filament for my printer.  I would love to see which of my spools have been calibrated based on the filament attribute, as I have multiple spools of a given filament.


캐러셀 링크 변경

Describe the problem and solution
캐러셀 링크를 변경합니다.
Notion task
TAS-518
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines
[X] Check that there isn't already an issue

Changed the connected Notion task status to done
 TAS-644 캐러셀 링크 변경


[T5A1][W10-A3] Yan Xiaoxuan

Some general suggestions for your effort in raising the PR:
User stories:

used as a lightweight way to collect user needs.
include the three parts, especially the ‘benefit’ part.

Use cases:

used to figure out interactions between user and the system.
check if interaction is back-and-forth.
no need to have detailed list of commands involved.
important to get the extensions right

NFR

requirements that do not describe a functionality.
ensure functional requirements are not given under NFR
make NFRs precise


Change Basic Iterative Method (BIM)

Description
The current implementation of the Basic Iterative Method asks for a value of eps but does not project to eps.
After discussing with @mathsinn we think that BIM should be implemented as a special case of PGD using no random initialisation (num_random_init=0) and norm=np.inf.
Fixes #90
Type of change
Please check all relevant options.

[ ] Bug fix (non-breaking)
[ ] New feature (non-breaking)
[x] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] This change requires a documentation update

Testing
Please describe the tests that you ran to verify your changes. Consider listing any relevant details of your test configuration.

[ ] Test A
[ ] Test B

Test Configuration:

OS
Python version
ART version or commit number
TensorFlow / Keras / PyTorch / MXNet version

Checklist

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

@mathsinn Thank you for your review. During addressing your review requests I have noticed that the methods set_params also need to be updated and consistently applied in the __init__ methods of ProjectedGradientDescent and FastGradientMethod


Gluon LSTM Projection and Clipping Support (#13055) v1.3.x

support projection in LSTM

add tests

update rnn to use cudnn ex

extend cudnn test to handle different versions

add lstm clip

use CUDNN_VERSION

merge USE_CUDNN_LSTM_CLIP and USE_CUDNN_LSTM_PROJ

assign false value to clip nan explicitly to RNN and  GRU

update test

Description
(Brief description on what this PR is about)
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[ ] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

@mxnet-label-bot [pr-awaiting-merge]

As stated in the @dev list, I would be rather opposed to have it in the patch release.


[kuttlefish] Use dl.kuzzle.io to store reports

What does this PR do?
Because we flush docs-v2.kuzzle.io when deploying.
It is not a safe place for snippets reports anymore.
Other changes
Fix travis build stages order.

:warning: Wait for kuttlefish comment :warning:
And let me merge, I need to check something in comment template.

 Snippets tests reports   SDK Version Tests overview      v6        v5                                   :heavy_minus_sign:                    v1        v1        v1


Collinear groundToImage Jupyter Notebook

Added a simple collinear implementation of groundToImage in a python notebook for experimentation.

:+1:

:1st_place_medal:


roblox.roblox version 480

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?

[x] Does your manifest conform to the 1.0 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

@perpelator You might be interested with Bloxstrap, which is available in Winget.


[Question] Is it possible to use non-English audio?

Just curious about possibility to change audio prounounce style from EN to other language. Trying to force the text using my local language but the result so weird since the text still pronounced in EN.

Yes, it's in the frontend. Git pull..

great!


pkg/types.Decoder

Solves https://github.com/lawrencejones/pgsink/issues/3
Touches on https://github.com/lawrencejones/pgsink/issues/21
This project needs to care a lot about types, and how we handle
different fields from Postgres. Due to the way it was built, the code
aimed to produce a sensible intermediate format (pkg/changelog) that
had parsed Postgres types into Golang native types.
While this worked, it meant we decided how to parse Postgres fields
before we ever knew where we'd put that data. There was a small effort
to abstract serialization on-top of the changelog package, but it was
clear that wouldn't be the end of the story even at the start.
Now we have first-class support for arbitrary sinks, it becomes clear
that we can't make serialization decisions without knowledge of where we
aim to put the data. Sure, we could translate things to a feature-rich
intermediary and then bail if the downstream doesn't support it, but
that sucks too.
The best idea is to push decoding/serialization decisions into the
sinks. In a full pgsink stream, we expect:
postgres (import & stream)
  -> intermediary
  -> sink

If we can have sinks advertise the PG types they support and how they
want them parsed up-front, we can provide that to the Postgres import
and stream components and have them make appropriate decisions based on
the sink.
That is what this commit does. It established a (very inefficient)
decoder that maps Postgres OID to the chosen scanner, and the empty
Golang native type the scanner will produce. Each sink bundles a decoder
to ensure the Postgres upstream parses content that is compatible with
the sink.
In future, we'll want to tidy the abstractions so they fit more neatly
into package responsibilites (sinks should probably all provide a
decoder? and that be exposed in the interface?) but we also force user
decisions, such as:

Should pgsink reject Postgres tables with unsupported types?
Or should we fallback to sending the Postgres textual representation
if we don't have a supported type?

People will have different preferences depending on the sink and their
use case, so it needs to be configurable.
This commit sets the stage for all of this, while making a massive mess.

There is little point keeping this open when it's got so large. Everything seems to work, it just needs a big tidy up.
Clean-ups should prioritise:

Simplifying the concept of the decoder, and creating a safe interface around decoding Postgres types
Understanding how we can share decoders (or if we should) between competing goroutines
Performance impact of new decoding
Integration tests to confirm all supported types decode to something sensible
Consider if the current pointer-to-everything setup is legit. It probably is, as everything can be null? But it would be good to think carefully about the memory model now we're doing more reflection

There is little point keeping this open when it's got so large. Everything seems to work, it just needs a big tidy up.
Clean-ups should prioritise:

Simplifying the concept of the decoder, and creating a safe interface around decoding Postgres types
Understanding how we can share decoders (or if we should) between competing goroutines
Performance impact of new decoding
Integration tests to confirm all supported types decode to something sensible
Consider if the current pointer-to-everything setup is legit. It probably is, as everything can be null? But it would be good to think carefully about the memory model now we're doing more reflection


CC-1239: Extract inspectable_byte_string to tester_utils

(Go version mismatch)

(Go version mismatch)

@ryan-gang still needs to be fixed

I have updated the go.mod to use Go 1.21, should I also update the test.yml file to use the same version ?
(One of the functions we use max needs the updated version).

Figure out please, this doesn't seem like something you need my help on


Enable dynamic media queries and classes

Adds a unified method of defining and modifying breakpoint names and media query ranges. Creating new breakpoints is simply a matter of modifying one map:
$regular-breakpoints: (
  small: 0,
  little: 421, // New breakpoint
  medium: 641,
  average: 801, // New breakpoint
  large: 1025,
);

This defines new media query ranges and all of the attendant grid, block grid, text alignment, and icon bar classes. Extra large breakpoints are defined in a separate map to preserve the functionality of settings like $include-xl-html-grid-classes.
Breakpoint values
Breakpoints must be defined in order, with the smallest one first and the largest one last. This is important for establishing the relationship between adjacent breakpoints, and for outputting proper media queries.
The breakpoint values are defined using the bottom of each media query range. That's why small is defined as 0, because it's the first breakpoint and therefore goes all the way down to the smallest viewport possible.
I would normally define the other breakpoints by using nice, round numbers (640, 1024, 1440, 1920), but I've added 1 to each of them in order to preserve the resulting media query ranges in the previous version. It's not very likely that most people would notice a 1px difference in the media queries, but I wanted to avoid any unnecessary changes.
Differences in generated CSS
Generating the Foundation CSS from these new components results in a few differences, though they should have no effect on practical usage:

There is no max-width for the largest breakpoint, so xxlarge-only is identical to xxlarge-up.
There is a new meta.foundation-mq-xxlarge-only rule, which was missing from the previous version. Since all breakpoint-related classes are generated automatically, this one gets added. Again, there is no max-width for the largest breakpoint.
Legacy push-* and pull-* classes are extracted from the medium and large media queries.
small classes for icon bars are defined separately from the default icon bar styles. This introduces a negligible amount of redundancy in the CSS, and is again due to all breakpoint-related classes being generated automatically.
Redundant icon bar classes are removed.

Hard-coded breakpoints
Please note that there are still places throughout the components that specify a particular breakpoint by name. For example, in _reveal.scss:
@media #{map-get($queries-up, medium)} { // Was: @media #{$medium-up}
  top: $top-offset;
}

Some of these could possibly be extracted into new variables (like $reveal-top-offset-size for the above example), but others are a bit more deeply ingrained or are otherwise more difficult to extract in a meaningful way. I've left all of these cases as they are. If a user is savvy enough to define their own breakpoint names that do not include the standard ones, they can certainly troubleshoot any errors resulting from a missing map key.

Uh, yeah, so I just saw your announcement detailing dynamic breakpoints in Foundation 6. So, never mind!

@a-dg You read our mind! :) Sorry we can't merge this in, since it's clear you put a lot of work into it. But with 6 out, 5 is now at a feature lock.
That being said, there's a whole new codebase to make contributions to, so I look forward to seeing more from you in the future. :)

No problem at all, I'm thrilled that you went in a similar direction for Foundation 6. Looking forward to trying it out!


Migrate building SwiftSyntax to swift_build_support

This migrates the build infrastructure of SwiftSyntax to swift_build_support. It goes hand-in-hand with https://github.com/apple/swift-syntax/pull/160.

https://github.com/apple/swift-syntax/pull/160
@swift-ci Please smoke test

https://github.com/apple/swift-syntax/pull/160
@swift-ci Please smoke test

preset=buildbot_swiftsyntax_macos
@swift-ci Please test with preset macOS Platform

https://github.com/apple/swift-syntax/pull/160
preset=buildbot_swiftsyntax_macos
@swift-ci Please test with preset macOS Platform

Great! The preset caught the generated files in SwiftSyntax being out-of-date. Let’s see if it passes now that the files have been updated.
https://github.com/apple/swift-syntax/pull/160
preset=buildbot_swiftsyntax_macos
@swift-ci Please test with preset macOS Platform

CI didn’t pick up the changes in the SwiftSyntax repo yet. Let’s fire it up again.
preset=buildbot_swiftsyntax_macos
@swift-ci Please test with preset macOS Platform

CI didn’t pick up the changes in the SwiftSyntax repo yet. Let’s fire it up again.
preset=buildbot_swiftsyntax_macos
@swift-ci Please test with preset macOS Platform

https://github.com/apple/swift-syntax/pull/160
preset=buildbot_swiftsyntax_macos
@swift-ci Please test with preset macOS Platform

https://github.com/apple/swift-syntax/pull/160
@swift-ci Please test

Build failed
Swift Test Linux Platform
Git Sha - aff7a5c36e95fbaea8e0cdee909ffcc2f88a098b

Build failed
Swift Test OS X Platform
Git Sha - aff7a5c36e95fbaea8e0cdee909ffcc2f88a098b

SwiftSyntax preset passed.
Let’s try if SouceKit-LSP still builds since I touched its build script as well.
https://github.com/apple/swift-syntax/pull/160
preset=buildbot_sourcekitlsp_macos
@swift-ci Please test with preset macOS Platform

Building SourceKit-LSP also passed. https://ci.swift.org/job/swift-PR-osx-preset/60/
Let’s finally test the stress tester.
https://github.com/apple/swift-syntax/pull/160
preset= buildbot_skstresstester_macos
@swift-ci Please test with preset macOS Platform

Mistakingly added a space after preset= in the above comment. Let’s run again without the space.
https://github.com/apple/swift-syntax/pull/160
preset=buildbot_skstresstester_macos
@swift-ci Please test with preset macOS Platform

https://github.com/apple/swift-syntax/pull/160
preset=buildbot_skstresstester_macos
@swift-ci Please test with preset macOS Platform

Cool! Is this read to land?


Fix newline removal in twoslash inlays

I think if you want to do this, you'd need to at least make sure there is a corresponding preceding whitespace for the extra lines, or you'd probably get this:
console.log(a)
//                   ^? {
  a: string
}

Now looking at this on the playground, and it doesn't look good at all. Playground Link
These probably should have been replaced with spaces. I didn't realize that it was being replaced with the empty string.


Improving flag --save-dev for add package in devDependecies

Bug Report or Feature Request (mark with an x)
- [ ] bug report -> please search issues before submitting
- [x] feature request

Command (mark with an x)
- [ ] new
- [ ] build
- [ ] serve
- [ ] test
- [ ] e2e
- [ ] generate
- [x] add
- [ ] update
- [ ] lint
- [ ] xi18n
- [ ] run
- [ ] config
- [ ] help
- [ ] version
- [ ] doc

In our @ngxs/schematics package we need to add it in devDependencies, but by default in angular-cli flag --save-dev will be true. You can make sure on it in this file: https://github.com/angular/angular-cli/blob/master/packages/angular/cli/tasks/npm-install.ts.
We can send PR and add ability to add package with ng add command in devDependencies.

https://github.com/angular/angular-cli/blob/master/packages/angular/cli/commands/add-impl.ts#L46
I think the save default should be false, because of this comment.

@hansl implemented the autosave in https://github.com/angular/angular-cli/commit/729d407fa1877d60d1e44efa3d657dc3ab4279e1
Also, this is a duplicate of https://github.com/angular/angular-cli/issues/12003


Is at EOL?

This hasn't been updated in 2 years, shouldn't this be archived?

Hey @crownalexanraven, yeah I've not had the time to continue developing this and there haven't been any new feature request so will probably archive it.

negative, just wanted to know.
i'm not smart enough to update it so i wanted to know.
Good work though :)


download_file is maxing out at less than half the speed of upload_data

Version 12.10.0 of azure.storage.filedatalake
Today I decided to spend some time trying to tune the SDK to get better performance when on very high speed (10gbps+) connections. My defaults for the past several months have been ~50 MiB/second for both upload and download, which is nowhere near the limit of my connection, but it was high enough that it wasn't worth optimizing at first.
After a bit of trial and error, I landed on max_concurrency=3 and max_chunk_get_size=2**20*64 # = 64MiB. This got me a ~4x download speed/bandwidth increase. Increasing either or both of these numbers did not yield anything greater than 208 MiB/second (usually right at 200 after about ten tests).
Imagine my surprise, then, when I decided to try tuning uploads, and almost immediately, I managed to get to 550 MiB/second by setting max_concurrency to 16 (and max_block_size to 64 MiB).
The upload speed will reproduce consistently (though with max_concurrency at 16 and the default connection pool size of 10, I get some warnings about dropped connections).
These are on the same box with the exact same large file (~7 GiB).
I wondered for a bit whether it might have something to do with the concurrency of the original upload (perhaps ADLS splits the actual bytes across multiple physical servers when originally uploaded with high concurrency?), so I tried downloading from the same file that I had successfully uploaded with concurrency=16, but I still get nothing better than 200 MiB/second for the download, again with max_concurrency set anywhere between 3 and 16.
My code looks basically like this:
DOWNLOAD_FILE_MAX_CONCURRENCY = 3
MAX_CHUNK_GET_SIZE = 2**20 * 64  # 64MB
MAX_SINGLE_GET_SIZE = 2**20 * 64  # 64MB
MAX_BLOCK_SIZE = 2**20 * 64
UPLOAD_FILE_MAX_CONCURRENCY = 16

...

    fs_client = DataLakeServiceClient(
        account_url=f"https://{storage_account}.dfs.core.windows.net",
        credential=SharedCredential(),
        max_single_get_size=MAX_SINGLE_GET_SIZE,  # for downloads
        max_chunk_get_size=MAX_CHUNK_GET_SIZE,  # for downloads
        max_block_size=MAX_BLOCK_SIZE,  # for uploads
    ).get_file_system_client(file_system=container)

    ...
    file_client = fs_client.get_file_client(adls_path)

    file_client.upload_data(
            open_file_stream,
            overwrite=True,
            content_settings=content_settings_with_md5,
            connection_timeout=14400,
            max_concurrency=UPLOAD_FILE_MAX_CONCURRENCY,
    )

    ...

    file_client.download_file(max_concurrency=DOWNLOAD_FILE_MAX_CONCURRENCY).readinto(open_file_stream)

Do you have any suggestions for how else to tune this? Is there something about the architecture of ADLS that would explain why I get significantly better upload speeds than download speeds?
Thanks in advance for any thoughts anyone has.

Hey, thanks for the detailed issue. @jalauzon-msft, @vincenttran-msft: can either of  you provide any insight into what could be going on here?

Hi @petergaultney Peter Gaultney, thanks for your inquiry. After a quick search through the codebase and some limited testing, I've come up with the following observations:
I see that you're passing parameters such as max_single_get_size, max_chunk_get_size, and max_block_size. Technically, these are not officially supported parameters, but some may be functional if the DataLake's API call is backed by Blob (such as in the case of download_file)
And so, that would mean your options pertaining to download (max_chunk_get_size and max_single_get_size) were being successfully set, while options for upload such as max_block_size were being ignored entirely.
For tuning upload_data, you would want to pass your desired value to the chunk_size keyword.
With that being said, although this means your custom upload values were not being used, that still doesn't answer the question as to why upload and download performance are not closer in value. Do you expect download to be as fast (or faster) than upload in your particular environment?
Please give the above a try and let me know your thoughts. Hopefully with this information we can get closer to identifying the root cause!
Thanks!

And so, that would mean your options pertaining to download (max_chunk_get_size and max_single_get_size) were being successfully set, while options for upload such as max_block_size were being ignored entirely.

This is good to know. max_block_size did not have an obvious effect on anything, so this seems reasonable to me. Upload speed was pretty clearly varying primarily (and possibly only) as a result of max_concurrency. I just wanted to be transparent about the other thing I had tried.

For tuning upload_data, you would want to pass your desired value to the chunk_size keyword.

Ultimately, I'm pretty satisfied with upload_data at the moment - 550 MiB/s is very solid performance. It's download capping out at 200 MiB/s that I'm confused about; we seemed not to benefit from max_concurrency greater than 3 or 4.

...that still doesn't answer the question as to why upload and download performance are not closer in value. Do you expect download to be as fast (or faster) than upload in your particular environment?

I would expect download to be exactly as fast as upload - these values are coming from a Kubernetes cluster running on these node types in Azure and I have no reason to believe the network is not symmetric. The claimed write performance of the storage is 500 MiB/s - more than twice what I'm seeing - but perhaps I'm running into my bottleneck there rather than on the actual download? I will see if I can test this theory on a node with higher write performance to try to rule that out.

I get similar results when downloading directly to an in-memory buffer, and using a separately-constructed DataLakeServiceClient. So it seems like there's something else going on under the hood.
I know there are 'alternate' methods of downloading things rather than using the DataLakeServiceClient. Should I try something else to benchmark against? I haven't yet figured out how to get azcopy working in my environment, but I think that would be an interesting comparison to make at the very least.

azcopy copy https://<src> a_local_file got me:
100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,

Job c0fc0243-7d6d-7a48-4ae9-b31db147134e summary
Elapsed Time (Minutes): 0.3007
Number of File Transfers: 1
Number of Folder Property Transfers: 0
Number of Symlink Transfers: 0
Total Number of Transfers: 1
Number of File Transfers Completed: 1
Number of Folder Transfers Completed: 0
Number of File Transfers Failed: 0
Number of Folder Transfers Failed: 0
Number of File Transfers Skipped: 0
Number of Folder Transfers Skipped: 0
TotalBytesTransferred:<PHONE_NUMBER>
Final Job Status: Completed

which comes out to about 385 MiB/sec.
I then used azcopy benchmark --file-count 2000 with the same SA/container, and was informed that 64 connections is the optimum. It then also gave me the following result for upload:
Main Result:
  Code:   VMSize
  Desc:   The size of this Azure VM may have limited throughput
  Reason: Throughput may be limited by the size of the Azure VM that's running AzCopy. Check the documented expected network bandwidth for this VM size (Standard_D32ds_v4).
     If the observed throughput of 14823 Mbits/sec is close to the documented maximum for the VM, then upsize to a larger VM. But if the observed throughput is NOT close to the maximum, and your VM is not in the same region as your target account, consider network bandwidth as a possible bottleneck.
        (AzCopy displays this message on Azure VMs when throughput per core is greater than 375 Mbps and no other limiting factors were identified.)

14823 Mbits/sec is 1853 MiB/sec, which is roughly 10x what I'm getting with the Python SDK.
the VM and the SA are both in the same region
(possibly a red herring...) 1853 MiB/s is almost exactly the expected read bandwidth for the VM in question.

I then followed up with a download test, using the following azcopy command, and receiving the result:
AZCOPY_CONCURRENCY_VALUE=64 azcopy benchmark 'https://..../benchmark-e798995c-20d8-0d41-5af2-7e07a0436132' --file-count 200 --mode='Download' --size-per-file 100M --delete-test-data=false
INFO: Cannot auto-tune concurrency because it is fixed by environment variable AZCOPY_CONCURRENCY_VALUE
INFO: The benchmark feature is currently in Preview status.
INFO: Benchmarking downloads from https://..../benchmark-e798995c-20d8-0d41-5af2-7e07a0436132.
INFO: Scanning...
INFO: Autologin not specified.
INFO: Authenticating to source using Azure AD
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support

Job 8322d9cb-f400-2548-4d43-e29654196a3c has started
Log file is located at: /root/.azcopy/8322d9cb-f400-2548-4d43-e29654196a3c.log

100.0 %, 200 Done, 0 Failed, 0 Pending, 0 Skipped, 200 Total, 2-sec Throughput (Mb/s): 13108.5245

13108 Mbits/sec is still roughly 8x the download performance I get using the Azure Python SDK.  To be fair, azcopy is probably downloading these files in parallel, whereas I'm using the SDK to download a single, large file. But I am still confused. As far as I know, ADLS itself doesn't cap the throughput on single files - at least not anywhere near the levels I'm seeing.
Somehow, I'm leaving a lot of performance on the table with the Azure Python SDK. I am very open to suggestions for things to try next.  Thanks!

Hi @petergaultney Peter, thanks for reporting on all your testing so far!
With regards to the difference in performance between azcopy and the Python SDK, I would say this is mostly expected unfortunately. Python is just not as performant as other languages in most scenarios unfortunately. This is due to various language limitations like it being interpreted, the Global Interpreter Lock, etc. AzCopy is backed by our GoLang SDK and is specifically designed to be as performant as possible for upload/download/copy scenarios and uses a lot of parallelism, buffer pooling, etc. to achieve that level of performance. I don't think we expect the Python SDK to reach that level of performance. Also, as you mention, AzCopy benchmark likely uses many files for its testing.
That is not to say that the Python SDK is not theoretically capable of any more performance. We have a few items in our backlog that could help to improve our upload/download performance, but we just haven't had time to prioritize those. Also, we plan to do some more in-depth performance testing which can likely reveal some further improvements that could be made.
As for why you are not able to get at least matching performance between upload/download using the Python SDK, we're still not sure. Expecting similar if not better performance for download is a reasonable expectation so we will look further into this. There could potentially be some differences in how these APIs buffer memory, parallelize, etc. that could be causing this discrepancy.  We will try and do some testing/investigation on our side to see if we can find anything, though it may be a little while before we can get to this.
Ultimately if you are looking for higher performance than the Python SDK can offer, it may be worth exploring some of our other options like AzCopy or our .NET SDKs, both of which are known to consistently offer better performance. We do realize though; this might not be possible in your scenario.

With regards to the difference in performance between azcopy and the Python SDK, I would say this is mostly expected unfortunately. Python is just not as performant as other languages in most scenarios unfortunately. This is due to various language limitations like it being interpreted, the Global Interpreter Lock, etc. AzCopy is backed by our GoLang SDK and is specifically designed to be as performant as possible for upload/download/copy scenarios and uses a lot of parallelism, buffer pooling, etc. to achieve that level of performance. I don't think we expect the Python SDK to reach that level of performance. Also, as you mention, AzCopy benchmark likely uses many files for its testing.

agreed - i don't expect the Python SDK to measure up to azcopy at all. I just thought it would help me rule out some kind of asymmetricity between upload and download that was inherent to the machine.

As for why you are not able to get at least matching performance between upload/download using the Python SDK, we're still not sure. Expecting similar if not better performance for download is a reasonable expectation so we will look further into this. There could potentially be some differences in how these APIs buffer memory, parallelize, etc. that could be causing this discrepancy. We will try and do some testing/investigation on our side to see if we can find anything, though it may be a little while before we can get to this.

It's good to know that I'm not missing some obvious tuning parameter, in any case.  It would definitely be nice to see roughly the same performance in both directions. Ultimately, I can live with what I have. It may be that the easiest optimization for me will be to investigate whether I can use azcopy as a "fast path" in certain scenarios. But I'll keep an eye on this issue in case you end up discovering something that I can use to make downloads act more like uploads.
Thanks!


How to show sub headers on the left sidebar

I am trying to show sub headers in a page on the left sidebar. I can't find any option for that.

do you mean a subheader like the level 2 header from the pages?
If that's the case is it answering your problem?

number of navigation level shown by default: https://pydata-sphinx-theme.readthedocs.io/en/latest/user_guide/navigation.html#control-how-many-navigation-levels-are-shown-by-default
number of level shown in the collapsing btn: https://pydata-sphinx-theme.readthedocs.io/en/latest/user_guide/navigation.html#control-the-number-of-navigation-levels

do you mean a subheader like the level 2 header from the pages? If that's the case is it answering your problem?

number of navigation level shown by default: https://pydata-sphinx-theme.readthedocs.io/en/latest/user_guide/navigation.html#control-how-many-navigation-levels-are-shown-by-default
number of level shown in the collapsing btn: https://pydata-sphinx-theme.readthedocs.io/en/latest/user_guide/navigation.html#control-the-number-of-navigation-levels

I am try to show the items here on the left sidebar, basically as collapsed items under the topic.

like this ?
https://pydata-sphinx-theme.readthedocs.io/en/latest/user_guide/page-toc.html#show-more-levels-of-the-in-page-toc-by-default

like this ? https://pydata-sphinx-theme.readthedocs.io/en/latest/user_guide/page-toc.html#show-more-levels-of-the-in-page-toc-by-default

I tried that before, it didn't work. The left sidebar items were still the same.

just to make sure you are talking about the right sidebar ? (because your screenshot is showing the page TOC which is on the right side of the screen)
I tested the configuration in my test documentation and it worked as expected:
html_theme_options = {"show_toc_level": 3}

just to make sure you are talking about the right sidebar ? (because your screenshot is showing the page TOC which is on the right side of the screen)
I tested the configuration in my test documentation and it worked as expected:
html_theme_options = {"show_toc_level": 3}

I was using it as an example of what I want. I want the collapsible items to be on the left sidebar instead of the right. The way you have collapsible items for subpages.

you can't this theme only displays pages and subpages in the left sidebar and use the right sidebar to display in-page TOC

This theme is designed for heavy API that requires the header navbar to navigate their content. If you can afford to let the content of your pages in the left sidebar I assume it's way lighter, did you consider the other themes suggested in the documentation?

If you are looking for a Sphinx theme that puts all of its sub-pages in the sidebar, the Sphinx Book Theme has a similar look and feel, and Furo is another excellent choice. You can also see the Sphinx Themes Gallery for more ideas.

This theme is designed for heavy API that requires the header navbar to navigate their content. If you can afford to let the content of your pages in the left sidebar I assume it's way lighter, did you consider the other themes suggested in the documentation?

If you are looking for a Sphinx theme that puts all of its sub-pages in the sidebar, the Sphinx Book Theme has a similar look and feel, and Furo is another excellent choice. You can also see the Sphinx Themes Gallery for more ideas.

Thanks


yarn2nix: pkgsCross.aarch64-multiplatform.yarn2nix fails to build

Describe the bug
Building pkgsCross.aarch64-multiplatform.yarn2nix fails with the following error:
error: makeWrapper/makeShellWrapper must be in nativeBuildInputs
… while evaluating the attribute 'shell' of the derivation 'hook'
… while evaluating the attribute 'nativeBuildInputs' of the derivation 'yarn2nix-1.0.0-x86_64-unknown-linux'
… while evaluating the attribute 'buildCommand' of the derivation 'yarn.nix'
...

Steps To Reproduce
Steps to reproduce the behavior:

Checkout the nixpkgs repository and go into the checkout;
nix-build . -A pkgsCross.aarch64-multiplatform.yarn2nix.

Expected behavior
This should build and give a working yarn2nix.
Notify maintainers
None are specified
Metadata
The reproduction has been confirmed at 469aec905bab3be98838c7eb996ceffb2ea44404.

yarn2nix is deprecated, see https://github.com/NixOS/nixpkgs/issues/324246 . If you want to talk about cross compilation support in general for yarn packages that's legitimate, but there is no point in discussing it in Nixpkgs' sphere when it is not clear if the Yarn ecosystem even supports that in principal. In either case, I'm closing this issue so this should be discussed in a separate, more concise issue.


Enable more rules in codebase

See commit messages

Also add import-spacing and typeof-compare to base?

@mohsen1 I only want to enable rules that have been released -- we use the latest TSLint release to lint our source code, not the current binary in ./bin/tslint


[Bug] Serious problem after 5.2.0 update with middlewares using octane

Bug report
What I did
I've gone back to the previous version (5.1.4) and now it's working normally.
What I expected to happen
Load the page normal
What happened
When I load a page that is using a certain middleware for the first time, it works and uses that middleware normally, when I load another page that uses another middleware, the system is thinking it should use the old middleware, not the other one.
If I run the command: artisan octane:reload, the page that was giving an error works again, but the previous one stops working, because it's trying to use middleware that it's not supposed to use.
Ps. I am using octane with swoole
What I've already tried to fix it
I am looking at the differences in those versions: https://github.com/Laravel-Backpack/CRUD/compare/5.1.4...5.2.0
I think the problem can be here: src/app/Library/CrudPanel/Traits/HasViewNamespaces.php, i am trying to change codes to check.
Tried to rollback changes in those files according to compare:
src/app/Library/CrudPanel/CrudFilter.php
src/app/Library/CrudPanel/CrudButton.php (this break all)
src/app/Http/Controllers/Operations/ListOperation.php
Tried to comment: src/app/Library/CrudPanel/Traits/Columns.php
src/app/Library/CrudPanel/Traits/Read.php
src/app/Library/CrudPanel/Traits/Views.php
Is it a bug in the latest version of Backpack?
Yes
After I run composer update backpack/crud the bug... is it still there?
Yes
Backpack, Laravel, PHP, DB version
When I run php artisan backpack:version the output is:
PHP VERSION:
PHP 8.1.2 (cli) (built: Jan 24 2022 10:42:33) (NTS)
Copyright (c) The PHP Group
Zend Engine v4.1.2, Copyright (c) Zend Technologies
with Zend OPcache v8.1.2, Copyright (c), by Zend Technologies
LARAVEL VERSION:
v9.21.3@66bfa61e61ffceddb6370b57306c76ead7667622
BACKPACK VERSION:
5.2.1@0dc8eb9073cede13dc2afc0cebb41f067fc58271

Hello @dilneiss
Thanks for the report, I had never used Backpack with Octane myself, today was my first 🙃 🍾
I've submitted a PR that fixes the issue: https://github.com/Laravel-Backpack/CRUD/pull/4542
Can you give it a try and let me know if it solved for you too ?
Also can you let me know if you found any other corner cases while using Backpack with Octane ?
Cheers

Thankyou @pxpm, i believe you understand my problem :)
I think now it gonna work, is there a way to test just this branch? because it was not merged yet

@dilneiss yes, you should be able to do composer require backpack/crud:"dev-singleton-view-namespaces as 5.2.99" and get that particular branch.

@tabacitu @dilneiss note that probably you would need to do the same if using PRO:
composer require backpack/pro:"dev-use-CrudPanelViewNamespaces-class as 1.2.99" since PRO service provider needs changes with this branch.
Cheers

@tabacitu @pxpm tested and everything is working now, thankyou! please merge that branch :)

Awesome. Thanks for the confirmation @dilneiss . Let's close this in order to move the conversation to https://github.com/Laravel-Backpack/CRUD/pull/4542 - there are still a few minor details to work out there, before merging.

I can confirm:
In dev-branch everything works fine.
I got other (more errors) before. Some fields are shown under different names.
e.g. "locations" table with "city" and "country". the country was shown under the city and the other way around.
But in dev branch everything works fine with octane :)


Namespace drop box to be responsive

Signed-off-by: Ayush<EMAIL_ADDRESS>Description
This PR fixes #2979
Notes for Reviewers
The user is now able abled to type in the field when he clicks on it, instead of wanting to cross the X mark to type in (Previous scenario).

[x] Yes, I signed my commits.

Thank you, @Ayush-Khandelwal-007!

💥


⚠ Bofrost.es has degraded performance

In d52d831, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1670 ms

Resolved: Bofrost.es performance has improved in d8a2c43 after 6 minutes.


resolves issue 3

Coverage increased (+1.8%) to 91.755% when pulling afbb3bee866296ece95f95e3c5c9f7d63b9e4dab on boothby:issue3 into<PHONE_NUMBER>9da37611abd173bbfc6ec9cb1140cf on dwavesystems:master.

Coverage increased (+1.8%) to 91.755% when pulling afbb3bee866296ece95f95e3c5c9f7d63b9e4dab on boothby:issue3 into<PHONE_NUMBER>9da37611abd173bbfc6ec9cb1140cf on dwavesystems:master.


Feat/generator widget

@cesar-tonnoir please review
Also, @alexnoox would be good if you could also take a look at this. Keep in mind there is still so much that could be done, plenty of code clean ups (the Swiip generator is definitely inspiring), but this is a first iteration of Maestrano's first Yoeman generator?? :beers: :beers: :beers:

@cesar-tonnoir @xaun: Looks good to me. Well done on the implementation of the generator.
I had some remarks but it is already in the todo comments. Maybe some unused files can be removed like .travis.yml or .editorconfig moved to the root of impac project if not already there.
If we continue to go in this way with generators, a good source of inspiration could be https://github.com/driftyco/ionic-cli.
$ mno-cli install template audit # create a frontend with the audit template
$ mno-cli mnoe page contact # add a custom page to the frontend
$ mno-cli impac widget # add a new widget

Thanks @xaun and thx @alexnoox for the review.
Looks awesome. Will really help other developers to get started on the creation of new widgets!


CI: Fix CI on main

The recent accelerate release includes: https://github.com/huggingface/accelerate/pull/2472 that sets set_to_none to True by default for optimizers, leads to our tests failing since we explictly check for param.grad after the optimization step. The fix is to patch the optimizer.zero_grad method to expliclty call it with set_to_none=False
cc @lvwerra

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.


Access Key from novelai_api.utils.get_access_key Failing to Authenticate

Description:
When using the novelai_api.utils.get_access_key method, the generated access_key was working correctly in previous attempts, but today, the generated key is failing to authenticate. The API returns a 401 error: "Incorrect access key."
Steps to Reproduce:

Call the novelai_api.utils.get_access_key method with valid email and password.
Use the generated access_key in an API request.
The request returns a 401 error with the message "Incorrect access key."

Expected Behavior:
The generated access_key should work and allow successful API authentication.
Actual Behavior:
The generated access_key is no longer valid, and API requests return a 401 error: "Incorrect access key."
Additional Information:

First occurrence: November 15, 2024.
Yesterday: The generated access_key worked correctly.
Code Version: novelai-api-0.31.0
Environment: python 3.10.4

Invalid access key means the email or password is wrong.
Nothing has changed since yesterday, so double check you are providing the right ones (including required string escapes). If you have changed your password, make sure to update the provided password accordingly.
I'll check locally on my side when I get home, but I do not expect any irregularity from the API.

Apologies for the confusion, and thank you for your assistance. After reviewing the issue, it seems that the problem was caused by incorrect handling of special characters in the password when reading it from the YAML file. The special characters in the password were not correctly converted, which led to the authentication failure.
Once I replaced the YAML file with an older version, the program executed correctly, and the access_key was generated as expected.
Thank you again for your patience and support!


(#381) - fix Android 4.0 support

This replaces #381 with the _createBlob function
from #382. It's one additional commit on top of #382.
#381 is a great commit but I feel it was missing a few things:

doesn't fix the tests
doesn't work for all BlobBuilder vendor prefixes

With this commit, I have manually confirmed a 100%
green run in an Android 4.0.3 emulator.
Yes, I solved this problem with copypasta, but gzip
can sort those things out. :)

Confirmed 100% in Kitkat emulator too.

Looks like Travis is failing due to an intermittent npm error (Warning: Cannot find module 'esprima'). I'll re-push to re-test.

Urgh, whoops, I'm going through emails chronologically and I should've read this first. I'll fix the merge conflicts here and use this code.

I'm going through this and would love to clean up the copypasta, but I'd rather get what works in here first.
I've sorted some of it out in the src/ folder but the tests still copy.
I feel like our require setup is out of control as I'm barely groking it ;-)

Doing this in #386 so closing here :smile:

@tofumatt Yeah, I apologize for that, but it was late at night and I was just happy that the tests were passing. :)
As for the require setup, in PouchDB anyway we converted everything to browserify about a year ago and haven't looked back. It makes for a more complicated build process, but it's really nice to just write for one module system. I also believe derequire is the magic that makes it work for RequireJS as well, but I'm not sure since I've never used RequireJS. :stuck_out_tongue:
So our build command becomes:
browserify index.js | derequire | es3ify > output.js

(es3ify converts stuff like promise.catch to promise['catch'])
I was thinking of helping rewrite LocalForage to use a similar build process, but I didn't want to be presumptuous in case you liked your current setup. But if you'd like, I could try to help. :smiley:

That actually sounds amazing. Honestly I don’t use require or browserify right now (I used to use require a fair bit but these days I’m just doing whatever is easiest, often using Ember’s build system). I just like to support everything :-)
I’ll check into how Pouch does it and ping you for help, thanks ^_^
—
Sent from Mailbox
On Sun, May 31, 2015 at 5:50 PM, Nolan Lawson<EMAIL_ADDRESS>wrote:

@tofumatt Yeah, I apologize for that, but it was late at night and I was just happy that the tests were passing. :)
As for the require setup, in PouchDB anyway we converted everything to browserify about a year ago and haven't looked back. It makes for a more complicated build process, but it's really nice to just write for one module system. I also believe derequire is the magic that makes it work for RequireJS as well, but I'm not sure since I've never used RequireJS. :stuck_out_tongue:
So our build command becomes:
browserify index.js | derequire | es3ify > output.js
(es3ify converts stuff like promise.catch to promise['catch'])
I was thinking of helping rewrite LocalForage to use a similar build process, but I didn't want to be presumptuous in case you liked your current setup. But if you'd like, I could try to help. :smiley:
Reply to this email directly or view it on GitHub:
https://github.com/mozilla/localForage/pull/383#issuecomment-107222940

As for the require setup, in PouchDB anyway we converted everything to browserify about a year ago and haven't looked back.

I also wanted to echo this sentiment. Browserify is an excellent tool that would aid any front end project.

How about those who don't use any module system? Will they still be able
to just add a script tag and access localforage from the global object?

Those with requirejs?

I've been working on an es6-babel branch for the last 4-5
months and I really like using import statements and have babel transform
it to use the UMD pattern. I guess that at some point the es6 module system
should prevail, so it should be a safe bet to use it.
If we decide to drop support for dynamically loading the appropriate driver
when using requirejs, then all the code can be changed to just use import
statements on the top of the file. Any thoughts about this?

PS: can we also change browserify requires to named modules instead of
'./drivers/indexeddb/' ? Is it not prefered? Along with (3), these are the
only things that currently  prevent from dropping all module systems and
just use es6 modules. Can anybody give me some info or hints?
On Sun, May 31, 2015, 21:15 JP Richardson<EMAIL_ADDRESS>wrote:

As for the require setup, in PouchDB anyway we converted everything to
browserify about a year ago and haven't looked back.
I also wanted to echo this sentiment. Browserify is an excellent tool that
would aid any front end project.
—
Reply to this email directly or view it on GitHub
https://github.com/mozilla/localForage/pull/383#issuecomment-107231388.

--
Thodoris Greasidis https://www.linkedin.com/in/thgreasi
Computer, Networking &
Communications Engineer

I assume everything will still work for those wanting a simple

@tofumatt moving to browserify or completely moving to es6 imports, would
probably have to sacrifice the dynamic driver loading under requirejs.
Is this ok with you?
Perhaps I could do some tests as soon as the browserify tests get merged.
That's the reason that I'm not using es6 imports in my es6-babel branch.
On the other hand, creating (and using) a transformer for the System.load
(now out of the latest standardization draft) should also solve the dynamic
requirejs part.
On Mon, Jun 1, 2015, 11:41 Matthew Riley MacPherson <
<EMAIL_ADDRESS>wrote:

I assume everything will still work for those wanting a simple

We should probably move this discussion to a new issue

Agreed. But for what it’s worth the dynamic require of localForage components isn’t a huge deal to me :-)
—
Sent from Mailbox
On Mon, Jun 1, 2015 at 11:07 AM, Thodoris Greasidis
<EMAIL_ADDRESS>wrote:

We should probably move this discussion to a new issue
Reply to this email directly or view it on GitHub:
https://github.com/mozilla/localForage/pull/383#issuecomment-107386702

That's all I need to hear! I will create a mock branch as soon as soon as
browserify tests get merged.
We can try restoring the requirejs dynamic driver loading at a later time.
On Mon, Jun 1, 2015, 15:34 Matthew Riley MacPherson <
<EMAIL_ADDRESS>wrote:

Agreed. But for what it’s worth the dynamic require of localForage
components isn’t a huge deal to me :-)
—
Sent from Mailbox
On Mon, Jun 1, 2015 at 11:07 AM, Thodoris Greasidis
<EMAIL_ADDRESS>wrote:

We should probably move this discussion to a new issue
Reply to this email directly or view it on GitHub:
https://github.com/mozilla/localForage/pull/383#issuecomment-107386702

—
Reply to this email directly or view it on GitHub
https://github.com/mozilla/localForage/pull/383#issuecomment-107424436.

For a lib like LocalForage, which is already under 10KB, I agree that dynamic module loading is not super important. :) As for ES6, yeah, there is babelify, which you can use as a browserify transform for ES6 code.

I've been using pain babel in my test branch and the result follows the umd
pattern. As a result it can be used even by the component module system
(I'm planning to also investigate if it works with webpack).
How the bebelified bundle would look like? Are there any extra pros when
using babelify??
On Mon, Jun 1, 2015, 17:55 Nolan Lawson<EMAIL_ADDRESS>wrote:

For a lib like LocalForage, which is already under 10KB, I agree that
dynamic module loading is not super important. :) As for ES6, yeah, there
is babelify, which you can use as a browserify transform for ES6 code.
—
Reply to this email directly or view it on GitHub
https://github.com/mozilla/localForage/pull/383#issuecomment-107549985.

babelify is just a shortcut to tell browserify to use babel :)


Please, describe method Stream.fold()

The description of method dart:async:Stream.fold() reads:

Future<S> fold<S>(
S initialValue,
S combine(
S previous,
T element
)
)
Reduces a sequence of values by repeatedly applying combine.

Please, provide more information about the method.
Here are some helper questions:

When the returned future is completed?
combine returns Future instance. (Is it allowed?)
Is it like List.fold()?
Error handling
4.1 errors in original stream
4.2 combine throws error
4.3 is it fail-fast? (i.e. first error stops further handling)

When the stream completes.
The return type of combine is S. That can be a future, but the fold method doesn't do anything special in that case.
It is exactly like List.fold.
It cancels on the first error (it returns a future so it has to, it can only report one result), either from the original stream or from the combine call.


Crash on 'zeus start'

Description of Problem
Zeus crashes on startup.
System details

uname -a:

Linux hostname 4.10.0-28-generic #32~16.04.2-Ubuntu SMP Thu Jul 20 10:19:48 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

ruby -v:

ruby 2.3.1p112 (2016-04-26 revision 54768) [x86_64-linux]
Steps to Reproduce

zeus start in a new rails project

Observed Behavior
$ zeus --log /dev/stderr start

zeus --log /dev/stderr start
Starting Zeus server v0.15.14
2017/07/31 09:25:26.886201 [/Users/phil/Source/go/src/github.com/burke/zeus/go/processtree/slavenode.go:149] development_environment/(no PID) entering state SUnbooted
2017/07/31 09:25:26.886201 [/Users/phil/Source/go/src/github.com/burke/zeus/go/processtree/slavenode.go:149] default_bundle/(no PID) entering state SUnbooted
2017/07/31 09:25:26.886211 [/Users/phil/Source/go/src/github.com/burke/zeus/go/processtree/slavenode.go:149] boot/(no PID) entering state SUnbooted
2017/07/31 09:25:26.886288 [/Users/phil/Source/go/src/github.com/burke/zeus/go/processtree/slavenode.go:391] boot/(no PID) running the root command now
[ready] [crashed] [running] [connecting] [waiting]
boot
└── default_bundle
    └── development_environment
[ready] [crashed] [running] [connecting] [waiting]
boot
└── default_bundle
    └── development_environment

Available Commands: [waiting] [crashed] [ready]
[ready] [crashed] [running] [connecting] [waiting]
boot
└── default_bundle
    └── development_environment
[ready] [crashed] [running] [connecting] [waiting]
boot
└── default_bundle
    └── development_environment

Available Commands: [waiting] [crashed] [ready]
[ready] [crashed] [running] [connecting] [waiting]
boot
└── default_bundle
    └── development_environment

Available Commands: [waiting] [crashed] [ready]
zeus server (alias: s) [run to see backtrace]

+1


Custom TypeScript language and language service extension for better DX

Hey there! Super into this project!
Bear in mind, i may be missing crucial bits of information to this project as i'm new to it, and what i've done may not be the most ideal.
I noticed a few quirks within TypeScript cells, such as top level awaits showing up as errors (for a few possible reasons such as requiring "module": "ESNext"), and that TypeScript doesn't know about variables shared between cells.
I've been playing around with making this work, and had a bit of sucess with shipping a new language and language service extension (cloned from the existing typescript extensions), as this allowed me to change one tiny detail:

which made top level awaits work (if you import something):

I'm completely aware that this may be a drastic change (shipping a new language) however i'm hoping that it just becomes a matter of importing and augmenting the existing extensions rather than shipping 99% of the same code...if that makes any sense?
My question is: would you accept this kind of contribution given it was designed well?
Also, some background: i'm also trying to solve the same issue for a similar side project https://dmisdm.github.io/ts-notebook/
I haven't yet thought of a cleaner way to solve these issues, and i'm not 100% a new language is the best way.
E.g. i also thought a lot could be done using a custom "typescript.tsdk" (VSCode config), similar to what @yarnpkg/pnpify does (it augments typescript/lib/tsserver.js to support loading definitions in a PnP environment), however this has it's drawbacks too.

would you accept this kind of contribution given it was designed well?

Absolutely yes.
My only concern is the fact that it's a custom language, however there's only one way to learn of this is a problem or not, and that's to get it in from of the users

Looking forward to ur PR, thanks


CI is broken due to missing libcomposefs on Ubuntu

Since we took a depend on the composefs crate, we need to have libcomposefs available in the system, but it looks like we don't have that on Ubuntu.

The container approach maybe isn't so great because the tests need fs-verity...


WIP: Kube dashboard

Codecov Report

Merging #102 into v2-master will decrease coverage by <.01%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##           v2-master    #102      +/-   ##
============================================
- Coverage      71.91%   71.9%   -0.01%
============================================
  Files            687     687
  Lines          29711   29711
  Branches        6815    6815
============================================
- Hits           21366   21364       -2
- Misses          8345    8347       +2


Add known issue for preview 7 compatibility with 17.6

@leecow @rbhanda @dsplaisted Can I get a review and get this merged?  Thanks.


Added ZAI Stablecoin for mainnet and base

Description
On mainnet we have the ERC20 token deployed here: https://etherscan.io/address/0x69000405f9dce69bd4cbf4f2865b79144a69bfe0
The lockbox deployed here:
~~https://etherscan.io/address/0x919F0356C049255e20FFe89fE31D34bd4a20B617~~
https://etherscan.io/address/0x278fb6522f962ffd7091ab103618b09aab24ae78
And the XERC20 deployed here:
~~https://etherscan.io/address/0xb4F40e14Cb88C7e17b5227d5657A4e3b8350770a~~
https://etherscan.io/address/0x6900070DE14ffFAf3A129Dc3880e0153444167Fa
On base chain we have the XERC20 token deployed here: https://basescan.org/address/0x69000cc63be9b4322f3f62c233dd1a7f509ae080
Type of change

[ ] Docs change / dependency upgrade
[ ] Configuration / tooling changes
[ ] Refactoring
[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Requires changes in customer code

High-level change(s) description - from the user's perspective

Related Issue(s)
Fixes
Related pull request(s)

Merged into whitelist branch.


Drop unnecessary tempfile require

What was the end-user problem that led to this PR?
The tempfile dependency was dropped in 1, but the require was left in there. This could cause gem conflicts because tempfile requires tmpdir which requires fileutils, which loads the default gem instead of our namespaced version, and that could cause fileutils version mismatches and code overriding warnings.
What is your fix for the problem, implemented in this PR?
My fix is to drop the unnecessary require.

@bundlerbot merge


Replacement for set_draw_delta()?

With 0.17.0-rc.6, set_draw_delta is no longer.
In my application using 0.16.2, I used it effectively to limit updates to every 1% of progress with an inc(1) inside a loop with millions of iterations by doing set_draw_delta( record_count / 100);.
I understand that with 0.17, a lot of refactoring was done to improve performance.
Is it no longer necessary to use set_draw_delta then and I can just do inc(1) for a loop with millions of rows and the indicatif overhead will be minimal?

Yes, the idea is that it is no longer necessary. Effectively there's still rate limiting in place for drawing to the terminal, which defaults to drawing every 50ms (but this can be customized by setting calling ProgressDrawTarget::std{out,err}_with_hz(). I'd be curious to hear if this approach works for your use case!

@jqnatividad any conclusions from your tests?

Sorry @djc, didn't get around to do the tests. Will do so this week with the latest rc.

Thanks!

Adding my data point to this issue.
I had a similar issue and I was able to apply ProgressDrawTarget::stdout_with_hz to rate limit the refresh rate on a multi-progress bar.
source: using 0.17.0-rc.10 https://github.com/agourlay/dlm/commit/72495f5faee73ac8611e5e4032ea257d7525058d

@agourlay thanks for the data! What rate did you limit it to, and how did that impact the indicatif overhead for your workload?

@djc I do not see a difference in CPU utilization between before and after applying the refresh rate patch.
My application is IO bound so I don't think I would see any significant changes anyway :)

Thanks, that makes sense! So you like to play it safe with your low refresh rate limit, but it seems like the defaults would actually work just as well for your use case.

Yes the default refresh rate of 50ms works fine technically, I just find it a tad too fast in terms of UI for my use case.

Hi @djc , sorry didn't get back as promised, but just wanted to confirm that 0.17.0 is awesome!
I no longer need to futz with tweaking refresh rate, no matter how large the job is.
And as for what I'm using indicatif for - I use it in extensively in qsv - a CSV data-wrangling toolkit forked from xsv.
Thanks heaps for everything you do for the Rust ecosystem!!!

Sounds good, thanks for the confirmation!


What does the hyperparameter "normalize" refer to in PPO?

PPO hyperparameter configurations often refer to normalize as a logical, e.g.
https://github.com/DLR-RM/rl-baselines3-zoo/blob/8ea4f4a87afa548832ca17e575b351ec5928c1b0/hyperparams/ppo.yml#L44
It's not clear to me what configuration this particular hyperparameter refers to, (if anything?)  e.g. I see A2C tunes the normalize_advantage parameter, but that's not a hyperparameter for PPO.  PPO has a boolean to normalize_image, but don't think that's it either.  Is this controlling whether or not the env gets wrapped in vector normalize?
(For context here -- I've found the zoo scripts here particularly handy for tuning even for my custom environments, thanks! but am struggling to reproduce some of the tuned results by passing the best hyper-parameters directly to fresh initializations of the RL algorithms.  Thanks for the amazing work you've done in developing stable-baselines and the zoo!)

Yes, this parameter refers to wrapping environment with VecNormalize, wrapped here.

Yes, this parameter refers to wrapping environment with VecNormalize, wrapped here.

It's not clear to me what configuration this particular hyperparameter refers to

Yes, those are parameters to VecNormalize wrapper.
By default, observation and return normalization are enabled, but you can change that as in
https://github.com/DLR-RM/rl-baselines3-zoo/blob/master/hyperparams/sac.yml#L208
A PR that document this value in the config would be appreciated ;)

It's not clear to me what configuration this particular hyperparameter refers to

Yes, those are parameters to VecNormalize wrapper.
By default, observation and return normalization are enabled, but you can change that as in
https://github.com/DLR-RM/rl-baselines3-zoo/blob/master/hyperparams/sac.yml#L208
A PR that document this value in the config would be appreciated ;)

Awesome, thanks.  So just to be sure I got this right, all algos, not just PPO, use the VecNormalize wrapper around the environment, with norm_obs and norm_reward are True by default (unless over-ridden in hyperparameters yaml files as shown?)  With these parameters listed at
https://github.com/DLR-RM/stable-baselines3/blob/master/stable_baselines3/common/vec_env/vec_normalize.py#L29-L37 ?
Or it looks like some of those parameters are overwritten? e.g. gamma for the normalization is set to whatever gamma the agent is using?  Happy to prep a PR, and sorry for all the questions, my earlier attempts to eyeball the source definitely miss-read this (looked to me that the default normalization was False, a la https://github.com/DLR-RM/rl-baselines3-zoo/blob/master/utils/exp_manager.py#L85). again apologies for being dense

Awesome, thanks.  So just to be sure I got this right, all algos, not just PPO, use the VecNormalize wrapper around the environment, with norm_obs and norm_reward are True by default (unless over-ridden in hyperparameters yaml files as shown?)  With these parameters listed at
https://github.com/DLR-RM/stable-baselines3/blob/master/stable_baselines3/common/vec_env/vec_normalize.py#L29-L37 ?
Or it looks like some of those parameters are overwritten? e.g. gamma for the normalization is set to whatever gamma the agent is using?  Happy to prep a PR, and sorry for all the questions, my earlier attempts to eyeball the source definitely miss-read this (looked to me that the default normalization was False, a la https://github.com/DLR-RM/rl-baselines3-zoo/blob/master/utils/exp_manager.py#L85). again apologies for being dense

So just to be sure I got this right, all algos, not just PPO, use the VecNormalize wrapper around the environment, with norm_obs and norm_reward are True by default
unless over-ridden in hyperparameters yaml files as shown?

yes

Or it looks like some of those parameters are overwritten? e.g. gamma for the normalization is set to whatever gamma the agent is using?

gamma is the only one we override automatically for correctness (and only if present in the hyperparameters).
We also deactivate reward normalization when evaluating the agent (to have the true reward, even though it is not needed anymore as we recently switched to Monitor wrapper).

Happy to prep a PR, and sorry for all the questions,

no pb ;)
If you were confused, then you were probably not the only one.

So just to be sure I got this right, all algos, not just PPO, use the VecNormalize wrapper around the environment, with norm_obs and norm_reward are True by default
unless over-ridden in hyperparameters yaml files as shown?

yes

Or it looks like some of those parameters are overwritten? e.g. gamma for the normalization is set to whatever gamma the agent is using?

gamma is the only one we override automatically for correctness (and only if present in the hyperparameters).
We also deactivate reward normalization when evaluating the agent (to have the true reward, even though it is not needed anymore as we recently switched to Monitor wrapper).

Happy to prep a PR, and sorry for all the questions,

no pb ;)
If you were confused, then you were probably not the only one.