First  example for a cwl integration of workflows

This is a first example for a cwl integration of workflows. It includes:

implementation of two basic workflows, which represent probably almost all cases for setting and validation
command line tool in cwl which runs the application print_array_elements.py (to demonstrate how a command line tool is calling a simtools application)
several placeholder command line tools (for demonstration)

This is incomplete and to show that this is a way forward to connect different tasks together. There are a couple of items unclear (configuration, passing files or file identifier, scatter and gather, ...), but it is a reasonable good looking start.
The following sketches might help - goal is to have as many generic steps as possible to minimize the number of workflows and command line tools to be written:

Please look at the two following application, best to use the cwl viewer:

SetParameter

SetArrayElementCoordinates

Please review this not in detail, but with a 'will this work?' question behind the review. Plan is to use this and implement an actual working example for the two workflows using the existing applications in simtools.

In general: it is still playing around with this to understand if it is a good way forward. It should be not more complicated than writing this in python scripts.
Could you let me know about a more complicated workflow you have in mind? I can try to write it up to make sure we don't run against walls?
It probably would be good to have 2-4 complete workflows written up and implemented. We can then review the approach (also possibly see if for e.g. the trigger threshold workflow we can run it on dirac).

Actually the workflow of deriving the random reflection error is a good representative of a "complicated" workflow. We can further "complicate" it by also using the effective focal length calculated in the validation part and insert that to the DB or another workflow. However, that would just make the workflow longer, not necessarily give us an additional use case not included already.
So, if we implement the random reflection and trigger rates workflows, it would already cover the majority of the workflows we will need I think.

All of my comments were answered, we can merge I think

Great, thank you!


Fix an error when using regexp with non-encoding option

This PR fixes the following error when using regexp with non-encoding option.
% cat /tmp/example.rb
/\x82/n =~ 'a'

% rubocop -d /tmp/example.rb
(snip)

For /tmp: An error occurred while VariableForce cop was inspecting /tmp/example.rb.
invalid multibyte escape: /\x82/
/Users/koic/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/rubocop-1.25.1/lib/rubocop/cop/variable_force.rb:193:in
`initialize'
/Users/koic/.rbenv/versions/3.1.0/lib/ruby/gems/3.1.0/gems/rubocop-1.25.1/lib/rubocop/cop/variable_force.rb:193:in `new'

This error is due to VariableForce#regexp_captured_names not processing the regexp option.
This PR uses RegexpNode#to_regexp to prevent the regexp option from being cut.
In addition, the test code replaces the Parser gem (plain) AST with ProcessedSource#ast so that it can call RegexpNode#to_regexp defined in the RuboCop AST.

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[ ] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[x] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

Thanks!


Group source into single

Bit of an odd question.  Currently each pod shows up as a separate "Source" under the GUI.  Is there a way to group them differently. Instead of per pod, let's say, per namespace?
I mean, look at this...

Thanks for the comment @GoldenMouse. You can try using the app instead to reference all the different pods:

If you want to filter by namespace you can use the following query instead (assuming they are in the logdna-agent namespace):

namespace:logdna-agent

I'll also pass a note to our internal teams so we can look into making the UX experience more intuitive for kubernetes data

Yes no complaints of the app part.  Feels like Host should either be an instance node or k8s cluster and Pods should be a new header under Apps.  Thanks for looking into this!.


passwordvalidator.Validate always return nil error, even when the supplied password is well below min entropy

Describe the bug
Validate method always returns nil error, even when password entropy is less than minimum entropy
To Reproduce
No additional steps required, it is a main line usecase. try with password as "123" with minimum entropy as 60
func strongPass(password string) error {
const minEntropyBits = 60
err := passwordvalidator.Validate(password, minEntropyBits)
return err
}
The problem is the following code, when you return error object it is nil to calling function,  as the call fmt.Errorf it is by value and is lost on return.
if len(allMessages) > 0 {
	return fmt.Errorf(
		"insecure password, try %v or using a longer password",
		strings.Join(allMessages, ", "),
	)
}

Expected behavior
Should return an error.
Screenshots
None
Environment (please complete the following information):

OS: Mac OSX

Additional context
None

Sorry, I think your example is mistaken. I just added the example you gave as a unit test and it performs as expected. Could you take another look or provide a different example pelase.


Scroll bar missing on "Add Project Member" and "Project Permissions" therefore not all role

Internal Reference: SURE-4934
Create a few project roles.
Go to the local cluster -> Cluster -> Projects/Namespaces.
Choose a project and from the three dots, choose 'Edit Config'. Click 'Add' beneath members.
Shrink the height of the browser window - dialog does not scroll, so you can't access the buttons or see all of the content:

This issue was fixe din 2.6.7 by another PR.
To Test:
Follow instructions above.
UI should now show a scroll bar along the right-hand side of the dialog:

While we wait for the new PR to be merged, reproduced this behavior in 2.6.6.
ENVIRONMENT DETAILS

Rancher Install: Docker
Rancher version

Reproduced version: v2.6.6

Browser: Chrome

TEST RESULT
REPRODUCED
REPRODUCTION STEPS

Setup Rancher and navigate to the UI in a browser.
Navigated to Cluster Explorer > Users & Authentication > Roles > Project/Namespaces.
Created multiple placeholder project roles (I created five).
Navigated to Cluster Explorer > local > Cluster > Projects/Namespaces.
Clicked Create Project > Add member.
Minimized the window and verified that no scrollbar appears:

Full screen view looks like this:

Verified that this is addressed on v2.6-head https://github.com/rancher/rancher/commit/93a4f30d9c361c8c274f58ebdff73e4f6cc45a81.
ENVIRONMENT DETAILS

Rancher Install: Docker
Rancher version

Reproduced version: v2.6-head https://github.com/rancher/rancher/commit/93a4f30d9c361c8c274f58ebdff73e4f6cc45a81

Browser: Chrome

TEST RESULT
PASS
VERIFICATION STEPS

Setup Rancher and navigate to the UI in a browser.
Navigated to Cluster Explorer > Users & Authentication > Roles > Project/Namespaces.
Created multiple placeholder project roles (I created five).
Navigated to Cluster Explorer > local > Cluster > Projects/Namespaces.
Clicked Create Project > Add member.
Minimized the window and verified that a scrollbar now appears:


Enterprise Sales Engineer - Zhang Zhao

Please review my answer Thanks.
Position: Enterprise Sales Engineer
Zhang Zhao

Correction
Position: Enterprise Sales Engineer
Zhang Zhao
Please review my answer a link

Update my answer with more descriptions.


Search results getting trimmed

When searching the docs for something which has multiple matches, the results flows out of the browser and thus gets trimmed. There is no way I can scroll down the search results.

Hi @varundey, thanks for the issue!
When you do scroll the page, what happens? Is the issue that the overall site header is fixed, so the search results never move relative to the viewport (i.e., you always see the top of the search results even if you scroll the rest of the site)? Thanks!

Sorry should have specified that in the original issue. Yes your assumption
is correct. The header is fixed and when I try to scroll, the page in the
background starts scrolling and the result container is static.
On Thu, Jan 3, 2019, 6:51 PM Kevin Partington<EMAIL_ADDRESS>wrote:

Hi @varundey https://github.com/varundey, thanks for the issue!
When you do scroll the page, what happens? Is the issue that the overall
site header is fixed, so the search results never move relative to the
viewport (i.e., you always see the top of the search results even if you
scroll the rest of the site)? Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/eslint/eslint.github.io/issues/531#issuecomment-451140979,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AIxp18HZaDG5PPPOnymVazSldZuzUtPjks5u_gPVgaJpZM4Zn-4d
.

@platinumazure Also if you have not already started working on it, I'd like
to give it a try.

@varundey I haven't started yet, please feel free to take a look!
I recommend looking at the DocSearch documentation; there may be an option somewhere that will ensure the container is scrollable. I think that will be better than making the ESLint site header non-fixed.

Well this is weird. Turns out, this bug is coming from DocSearch itself. I went to https://community.algolia.com/docsearch/ and tried searching for something, and woot, I could repro the bug on their site 😄

Nice find! Maybe it's worth searching their GitHub repository for issues related to this; and if none exist, maybe you could create one? Thanks!

Yep. That is what I intended to do after commenting here. Seems this issue is across all the platforms that use DocSearch (bootstrap, react etc.) 😄

Closing this issue since it stems from DocSearch's current behavior. Please feel free to make a new issue if there's something we can do here!


Fix issues #17 and #19 (i.e. writing to stdout and handling of single digit integers)

This pull request fixes the following two issues:

Remove printing of debugging information to stdout  #17
Invalid parsing of integers with one digit or the value 0 #19

Quite critical fixes, any timeline on merging this?

@fgblomqvist done
@cipriancraciun Thanks for the fix!


Feature/stream codec and codec context

Hey! Now I am using own fork and sync pull request for your base repo

Implement method Codec for CodecContext
Fixes for Stream getRotation method
Codec implement methods getName, getLongName
CodecContext implement CodecIsOpen method instead of AvcodecIsOpen (it is needed to be deprecated with unexpected name and not boolean return type)

Thanks

ping @giorgisio

ping @giorgisio

@ovr I haven't done proper tests on the last few merges. I've moved master back to a relatively working version while I go through the recent pull requests, and merges. I will also re-implement Travis CI. (Depends on how much time I get soon). In the mean time, running the examples (cd example && go run tutorial01.go) can point few but critical bugs.

@giorgisio
I cant explain, via In the latest PR i fixes all prevent bugs via I am using fork of goav in production,,,
I fail with  ec3780c and fix it in https://github.com/giorgisio/goav/pull/19
https://github.com/ovr/goav/commit/20263059364d80d37874e5dbdbeedf2063762b4b

You need to merge it in https://github.com/giorgisio/goav/commits/merged-issues
merged-issues and try to run go tutorial
And this will work

@giorgisio
Use this commit https://github.com/ovr/goav/commit/20263059364d80d37874e5dbdbeedf2063762b4b
git cherry-pick<PHONE_NUMBER>4d80d37874e5dbdbeedf2063762b4b

in merged-issues branch


Fix Is.EqualTo for collections

Fix Is.EqualTo for collections.
It should be translated to Should().Equal() rather than Should().Be().
Note
I had an NRE, but wasn't able to figure out where was it coming from, so IsCollection is now as defensive as possible - but at least it works fine on a big solution.
System.NullReferenceException : Object reference not set to an instance of an object.
   at Meziantou.FluentAssertionsAnalyzers.NunitAssertAnalyzerCodeFixProvider.<>c__DisplayClass5_0.<Rewrite>g__IsCollection|0(ArgumentSyntax argumentSyntax)

Thank you very much for the sponsorship and all your contributions to this project ❤

Thank you very much for the sponsorship and all your contributions to this project ❤

Thank you for all your work!
I managed to convert about 5500 assertions and about 80% of them were converted successfully. Not 100%, but still much better than doing it by hand or with regexes only.


Build package for RMS 11 and 12.1

RMS 11 - 12.0 uses Python 3.6.1
RMS 12.1 uses Python 3.8.6
We also need to deal with different versions of numpy's ABI.

Done in 9e62048feada7cc158331db6b023a72ca73f2dce


add Linuxacademy.com integration

This PR adds Toggl button integration for Linux Academy training website.

Match Course title as project and current video lecture as description.

Hey @zendyani , we decided to clear up old PRs to make way for some big refactoring that is upcoming. If you wish to continue work on this PR please feel free to reopen or add an issue for adding Linuxacademy.com support!


Fix 'unresolved import syn::export' error in version 0.8.1

Hi
The syn crate has breaking change from 1.0.57 to 1.0.58(related change) and this change cause compilation error in other projects like qodot-next that still using version 0.8.x.
I create the pull request for master branch because there isn't a branch for 0.8.
If it's possible, please release version 0.8.2 to fix this bug.
Thanks

Please understand that the godot-rust project is still in 0.x, where we're focusing more on finding a good API, and don't intend / have the resources to provide support for older versions. Please inform the qodot-next project to migrate to 0.9, or use a [patch] section in your project for syn instead.

That's understandable, I create the PR because that was a simple fix and could help someone.
Thanks for the provided link for mitigation by overriding dependencies.


Install baltrad into book environment

If we want to automatically run the notebooks which are using baltrad on book build, we need to install baltrad into that environment too. That is different from the binder, but we can use the same procedure there.

We would also need to pull the baltrad notebooks to have them on book build time.

@kmuehlbauer please explain what the "book environment" is. I have noted that the baltrad_short_course Jupyter notebooks have installed, and that the one I checked seems to work through the browser, so that's a good start. The notebooks will probably need a little updating to become current. The notebooks are run interactively, so are you referring to automated capabilities with the book env?

@DanielMichelson Yes, there is one environment which is used with binder. And there is another environment which is run via GitHub Actions (book environment). This creates the current website (see repo main site on the right, there is a link).
We would need to run the same procedure in GitHub Actions, which we now run in binder.
Does that make sense?

You're referring to the notebook content on the course website: https://openradarscience.org/erad2022/ ?
This makes sense to me. Is the objective to enable all the notebooks we have? There is only a handful of BALTRAD notebooks, so I hope this does not involve too much extra effort.

Exactly, I was referring to the course website.
In my opinion it would be great, if the course website would have the same content what would be available on binder.
From my current experience the additional build cost with regard to time is not that big of a deal. The environment can also be cached IIRC.

It would be most wanted if we could just use the baltrad install process for both binder and book environment. Same would be true for the data parts of the other packages.

We can likely add a few additional lines to the build-book.yml file, calling the postBuild script, placing that line after the environment build but before the book build.

@mgrover1 Yes, something along these lines.
I've tested (successfully) installing locally (as GHA would do) into conda env. But we need more tweaks to the install scripts to work transparently on binder, GHA and locally.
I need to finalize this, but if you are eager to look, the WIP is in my fork (
https://github.com/kmuehlbauer/erad2022/tree/local-baltrad).


FYI language mode case change breaks language mode settings

Describe the bug
Looks like an ID for the COBOL language has been added in lower-case cobol. Sadly this means that some of my files now open in a different language mode (based on previous configuration). I have *.c85_m mapped to COBOL and *.cbl without mapping opens as cobol
VS Code treats these as completely different languages with their own set of config overrides.
"[COBOL]": {
        "editor.autoIndent": "full",
        "editor.renderIndentGuides": false,
        "editor.rulers": [
            6,
            7,
            72,
            80,
            84
        ],
        "editor.useTabStops": false,
        "files.autoGuessEncoding": false,
        "files.encoding": "windows1252"
    },

has to be duplicated, in lowercase to apply to both, or I have to adjust my files.associations.
To Reproduce
Steps to reproduce the behavior:

Have two COBOL files: A.c85_m (mapped to COBOL) B.cbl (not mapped to anything)
Open both files

Expected behavior
These two share the same language/settings.
Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

OS: Windows

What user & workspace settings are being used?:
Attached workspace.
Additional context
Is there a reason to define the langs with different IDs?

I am not able to reproduce the issue you are having:
https://user-images.githubusercontent.com/5991192/112658108-fd1a1080-8e4a-11eb-801a-ec605402fb37.mp4

Odd. Let me clear all my user settings and see if it's something else I didn't include. Does your language picker show two langs?

Not quite, the same

All user settings removed. 7.3.26 clean installed in insiders.

More head scratching, association picker shows both upper- and lower-case on selected concurrently:


Support for 'Bearer' in the Authentication header

Hello, sorry to bother, I'm having some problems because my application is using angular-jwt for the frontend and node-jsonwebtoken for the backend.
The problem is that when I use the interceptor in angular, the authPrefix  is set to 'Bearer ' while jsonwebtoken expects the header prefix to be 'JWT '.
I'm not sure this is an issue for you guys, but I was not sure how to operate.
Thanks a lot!

I think the answer is https://github.com/auth0/angular-jwt/issues/49.
I'll try as soon as possible.


Add Cache API helper

Dang bro! It's cool... but I think you should rename the class name from CacheMiddleware to Cache. But, let's see first what the response is from @notrab

Dang bro! It's cool... but I think you should rename the class name from CacheMiddleware to Cache. But, let's see first what the response is from @notrab

Yes, you're right! I was thinking of “HttpCache” to be even more precise in case other caching systems were to be integrated, like FileSytemCache. What do you think ?

I think we should follow the Hono naming files, the default cache is HTTP cache and when you want to add more cache systems then add another type of parameters that will be more clean IMO. 😊

Hey @notrab I hope you doing well,
I've successfully applied the middleware to a specific path, and it works great!
For example, all routes starting with /api will be cached, while the others won't.
In addition, I added some tests to the CacheMiddleware class to ensure more consistency and robustness in the codebase.


python310Packages.jax: disable crashing tests

The disabled tests have been crashing the python interpreter on hydra
on multiple platforms. This is a problem that I could also reproduce origin
a local Zen 3 machine, while my 8th Gen Intel machine had no such
issues.
Follow up on the root causes of #258089.
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux (Ryzen 5600)
[x] aarch64-linux (Altra Q80-30)
[ ] x86_64-darwin
[ ] aarch64-darwin (fails in ml-dtypes tests)

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Even without pytest-xdist I'm still seeing memory usage peak above 10 GB. Also, yet another crash on my AMD CPU.
jax> tests/sparsify_test.py ..............................................Fatal Python error: Segmentation fault
jax>
jax> Current thread 0x00007ffff7e93740 (most recent call first):
jax>   File "/build/source/jax/_src/compiler.py", line 251 in backend_compile
jax>   File "/build/source/jax/_src/profiler.py", line 314 in wrapper
jax>   File "/build/source/jax/_src/compiler.py", line 289 in compile_or_get_cached
jax>   File "/build/source/jax/_src/interpreters/pxla.py", line 2518 in _cached_compilation
jax>   File "/build/source/jax/_src/interpreters/pxla.py", line 2611 in from_hlo
jax>   File "/build/source/jax/_src/interpreters/pxla.py", line 2263 in compile
jax>   File "/build/source/jax/_src/pjit.py", line 1134 in _pjit_call_impl_python
jax>   File "/build/source/jax/_src/pjit.py", line 1198 in call_impl_cache_miss
jax>   File "/build/source/jax/_src/pjit.py", line 1214 in _pjit_call_impl
jax>   File "/build/source/jax/_src/core.py", line 821 in process_primitive
jax>   File "/build/source/jax/_src/core.py", line 389 in bind_with_trace
jax>   File "/build/source/jax/_src/core.py", line 2604 in bind
jax>   File "/build/source/jax/_src/pjit.py", line 166 in _python_pjit_helper
jax>   File "/build/source/jax/_src/pjit.py", line 255 in cache_miss
jax>   File "/build/source/jax/_src/traceback_util.py", line 177 in reraise_with_filtered_traceback
jax>   File "/build/source/jax/_src/numpy/array_methods.py", line 256 in deferring_binary_op
jax>   File "/build/source/jax/_src/numpy/lax_numpy.py", line 1391 in nonzero
jax>   File "/build/source/jax/experimental/sparse/bcoo.py", line 303 in _nonzero
jax>   File "/build/source/jax/experimental/sparse/bcoo.py", line 305 in _bcoo_fromdense_impl
jax>   File "/build/source/jax/_src/core.py", line 821 in process_primitive
jax>   File "/build/source/jax/_src/core.py", line 389 in bind_with_trace
jax>   File "/build/source/jax/_src/core.py", line 386 in bind
jax>   File "/build/source/jax/experimental/sparse/bcoo.py", line 290 in _bcoo_fromdense
jax>   File "/build/source/jax/experimental/sparse/bcoo.py", line 268 in bcoo_fromdense
jax>   File "/build/source/jax/experimental/sparse/bcoo.py", line 2510 in fromdense
jax>   File "/build/source/tests/sparsify_test.py", line 238 in testSparseMul
jax>   File "/nix/store/2qsf9npffzv0cdrd4jzaczv29kl1rj9z-python3.10-absl-py-1.4.0/lib/python3.10/site-packages/absl/testing/parameterized.py", line 318 in bound_param_test
jax>   File "/nix/store/pzf6dnxg8gf04xazzjdwarm7s03cbrgz-python3-3.10.12/lib/python3.10/unittest/case.py", line 549 in _callTestMethod
jax>   File "/nix/store/pzf6dnxg8gf04xazzjdwarm7s03cbrgz-python3-3.10.12/lib/python3.10/unittest/case.py", line 591 in run
jax>   File "/nix/store/pzf6dnxg8gf04xazzjdwarm7s03cbrgz-python3-3.10.12/lib/python3.10/unittest/case.py", line 650 in __call__
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/unittest.py", line 333 in runtest
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 169 in pytest_runtest_call
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_callers.py", line 80 in _multicall
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_manager.py", line 112 in _hookexec
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 433 in __call__
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 262 in <lambda>
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 341 in from_call
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 261 in call_runtest_hook
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 222 in call_and_report
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 133 in runtestprotocol
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/runner.py", line 114 in pytest_runtest_protocol
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_callers.py", line 80 in _multicall
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_manager.py", line 112 in _hookexec
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 433 in __call__
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/main.py", line 349 in pytest_runtestloop
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_callers.py", line 80 in _multicall
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_manager.py", line 112 in _hookexec
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 433 in __call__
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/main.py", line 324 in _main
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/main.py", line 270 in wrap_session
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/main.py", line 317 in pytest_cmdline_main
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_callers.py", line 80 in _multicall
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_manager.py", line 112 in _hookexec
jax>   File "/nix/store/fif9irpy193aw3hni5zcs75nlvhsmy42-python3.10-pluggy-1.2.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 433 in __call__
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/config/__init__.py", line 166 in main
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/_pytest/config/__init__.py", line 189 in console_main
jax>   File "/nix/store/s3rq2p38bq0pcyqfmikhdjc7crl5411z-python3.10-pytest-7.4.0/lib/python3.10/site-packages/pytest/__main__.py", line 5 in <module>
jax>   File "/nix/store/pzf6dnxg8gf04xazzjdwarm7s03cbrgz-python3-3.10.12/lib/python3.10/runpy.py", line 86 in _run_code
jax>   File "/nix/store/pzf6dnxg8gf04xazzjdwarm7s03cbrgz-python3-3.10.12/lib/python3.10/runpy.py", line 196 in _run_module_as_main
jax>
jax> Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, jaxlib.cpu_feature_guard, PIL._imaging, scipy._lib._ccallback_c, scipy.special._ufuncs_cxx, scipy.special._ufuncs, scipy.special._specfun, scipy.special._comb, scipy.linalg._fblas, scipy.linalg._flapack, scipy.linalg.cython_lapack, scipy.linalg._cythonized_array_utils, scipy.linalg._solve_toeplitz, scipy.linalg._decomp_lu_cython, scipy.linalg._matfuncs_sqrtm_triu, scipy.linalg.cython_blas, scipy.linalg._matfuncs_expm, scipy.linalg._decomp_update, scipy.sparse._sparsetools, _csparsetools, scipy.sparse._csparsetools, scipy.sparse.linalg._isolve._iterative, scipy.sparse.linalg._dsolve._superlu, scipy.sparse.linalg._eigen.arpack._arpack, scipy.sparse.csgraph._tools, scipy.sparse.csgraph._shortest_path, scipy.sparse.csgraph._traversal, scipy.sparse.csgraph._min_spanning_tree, scipy.sparse.csgraph._flow, scipy.sparse.csgraph._matching, scipy.sparse.csgraph._reordering, scipy.linalg._flinalg, scipy.special._ellip_harm_2, numpy.linalg.lapack_lite, scipy.integrate._odepack, scipy.integrate._quadpack, scipy.integrate._vode, scipy.integrate._dop, scipy.integrate._lsoda, scipy.optimize._minpack2, scipy.optimize._group_columns, scipy._lib.messagestream, scipy.optimize._trlib._trlib, scipy.optimize._lbfgsb, _moduleTNC, scipy.optimize._moduleTNC, scipy.optimize._cobyla, scipy.optimize._slsqp, scipy.optimize._minpack, scipy.optimize._lsq.givens_elimination, scipy.optimize._zeros, scipy.optimize.__nnls, scipy.optimize._highs.cython.src._highs_wrapper, scipy.optimize._highs._highs_wrapper, scipy.optimize._highs.cython.src._highs_constants, scipy.optimize._highs._highs_constants, scipy.linalg._interpolative, scipy.optimize._bglu_dense, scipy.optimize._lsap, scipy.spatial._ckdtree, scipy.spatial._qhull, scipy.spatial._voronoi, scipy.spatial._distance_wrap, scipy.spatial._hausdorff, scipy.spatial.transform._rotation, scipy.optimize._direct, scipy.cluster._vq, scipy.cluster._hierarchy, scipy.cluster._optimal_leaf_ordering, scipy.ndimage._nd_image, _ni_label, scipy.ndimage._ni_label, scipy.special.cython_special, scipy.stats._stats, scipy.stats.beta_ufunc, scipy.stats._boost.beta_ufunc, scipy.stats.binom_ufunc, scipy.stats._boost.binom_ufunc, scipy.stats.nbinom_ufunc, scipy.stats._boost.nbinom_ufunc, scipy.stats.hypergeom_ufunc, scipy.stats._boost.hypergeom_ufunc, scipy.stats.ncf_ufunc, scipy.stats._boost.ncf_ufunc, scipy.stats.ncx2_ufunc, scipy.stats._boost.ncx2_ufunc, scipy.stats.nct_ufunc, scipy.stats._boost.nct_ufunc, scipy.stats.skewnorm_ufunc, scipy.stats._boost.skewnorm_ufunc, scipy.stats.invgauss_ufunc, scipy.stats._boost.invgauss_ufunc, scipy.interpolate._fitpack, scipy.interpolate.dfitpack, scipy.interpolate._bspl, scipy.interpolate._ppoly, scipy.interpolate.interpnd, scipy.interpolate._rbfinterp_pythran, scipy.interpolate._rgi_cython, scipy.stats._biasedurn, scipy.stats._levy_stable.levyst, scipy.stats._stats_pythran, scipy._lib._uarray._uarray, scipy.stats._statlib, scipy.stats._sobol, scipy.stats._qmc_cy, scipy.stats._mvn, scipy.stats._rcont.rcont, scipy.signal._sigtools, scipy.signal._max_len_seq_inner, scipy.signal._upfirdn_apply, scipy.signal._spline, scipy.signal._sosfilt, scipy.signal._spectral, scipy.signal._peak_finding_utils (total: 127)
jax> /nix/store/fw2zkp57474jdlrqn6yyzai4ij3715la-pytest-check-hook/nix-support/setup-hook: line 53:  2454 Segmentation fault      (core dumped) /nix/store/pzf6dnxg8gf04xazzjdwarm7s03cbrgz-python3-3.10.12/bin/python3.10 -m pytest -k "not test_custom_linear_solve_aux and not testKde3 and not testKde5 and not testKde6" --ignore="tests/sparse_test.py" -W ignore::DeprecationWarning tests/

Even without pytest-xdist I'm still seeing memory usage peak above 10 GB. Also, yet another crash on my Ryzen 5600 CPU, yet again in some sparse test scenario.

Huh weird, well it works fine on nixpkgs-upkeep. Not totally sure why, maybe swap?

Can we make it at least optional, because that way testing is way more fun: https://dl.thalheim.io/y5qgkcXBYmnZe0VyOZ3ESQ/20230930-074225.png
From ad29163c90254e4fc3998490ec392b84a8cfba78 Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?J=C3=B6rg=20Thalheim?=<EMAIL_ADDRESS>Date: Sat, 30 Sep 2023 07:45:39 +0200
Subject: [PATCH] python3.pkgs.jax: make parallel testing optional
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

Signed-off-by: Jörg Thalheim<EMAIL_ADDRESS>---
 pkgs/development/python-modules/jax/default.nix | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/pkgs/development/python-modules/jax/default.nix b/pkgs/development/python-modules/jax/default.nix
index db4389d68969..16e19ec58ae9 100644
--- a/pkgs/development/python-modules/jax/default.nix
+++ b/pkgs/development/python-modules/jax/default.nix
@@ -15,6 +15,8 @@
 , pythonOlder
 , scipy
 , stdenv
+, pytest-xdist
+, enableParallelTesting ? true
 }:

 let
@@ -61,7 +63,8 @@ buildPythonPackage rec {
     jaxlib'
     matplotlib
     pytestCheckHook
-  ];
+    # disabled by default because it exceeds the 8GB memory limit on samuela's nixpkgs-upkeep on github action
+  ] ++ lib.optional (enableParallelTesting) pytest-xdist;

   # NOTE: Don't run the tests in the expiremental directory as they require flax
   # which creates a circular dependency. See https://discourse.nixos.org/t/how-to-nix-ify-python-packages-with-circular-dependencies/14648/2.
--
2.42.0

Can we make parallel testing at least optional? Because that way testing is way more fun: https://dl.thalheim.io/y5qgkcXBYmnZe0VyOZ3ESQ/20230930-074225.png
From ad29163c90254e4fc3998490ec392b84a8cfba78 Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?J=C3=B6rg=20Thalheim?=<EMAIL_ADDRESS>Date: Sat, 30 Sep 2023 07:45:39 +0200
Subject: [PATCH] python3.pkgs.jax: make parallel testing optional
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

Signed-off-by: Jörg Thalheim<EMAIL_ADDRESS>---
 pkgs/development/python-modules/jax/default.nix | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/pkgs/development/python-modules/jax/default.nix b/pkgs/development/python-modules/jax/default.nix
index db4389d68969..16e19ec58ae9 100644
--- a/pkgs/development/python-modules/jax/default.nix
+++ b/pkgs/development/python-modules/jax/default.nix
@@ -15,6 +15,8 @@
 , pythonOlder
 , scipy
 , stdenv
+, pytest-xdist
+, enableParallelTesting ? false
 }:

 let
@@ -61,7 +63,8 @@ buildPythonPackage rec {
     jaxlib'
     matplotlib
     pytestCheckHook
-  ];
+    # disabled by default because it exceeds the 8GB memory limit on samuela's nixpkgs-upkeep on github action
+  ] ++ lib.optional (enableParallelTesting) pytest-xdist;

   # NOTE: Don't run the tests in the expiremental directory as they require flax
   # which creates a circular dependency. See https://discourse.nixos.org/t/how-to-nix-ify-python-packages-with-circular-dependencies/14648/2.
--
2.42.0

Looks like I cannot test if this works because somehow some stuff seems to hang

Can we make parallel testing at least optional? Because that way testing is way more fun: https://dl.thalheim.io/y5qgkcXBYmnZe0VyOZ3ESQ/20230930-074225.png
0001-python3.pkgs.jax-make-parallel-testing-optional.patch.txt

I also disabled tests marked as "slow":
=============== 17482 passed, 2590 skipped in 1233.05s (0:20:33) ===============

tests/x64_context_test.py s.......Fatal Python error: Segmentation fault

and

tests/stax_test.py .....Fatal Python error: Segmentation fault

:cry:

tests/x64_context_test.py s.......Fatal Python error: Segmentation fault

and

tests/stax_test.py .....Fatal Python error: Segmentation fault

😢

Interesting. Having seen those yet. Same hardware? I am also testing on AMD cpus.

See the ofBorg logs.

I think it is time to understand why it broke in the first place. It happend on both aarch64-linux and x86_64-linux in the same evaluation.
https://hydra.nixos.org/build/236085123
https://hydra.nixos.org/build/236077232
The related commit range is displayed in https://hydra.nixos.org/api/scmdiff?rev1=4fc8d8b9ace09c69ba791cb0615d54b1f1bb6053&type=git&branch=&rev2=e35dcc04a3853da485a396bdd332217d0ac9054f&uri=https%3A%2F%2Fgithub.com%2FNixOS%2Fnixpkgs.git.
$ git log --grep=jax 4fc8d8b9ace09c69ba791cb0615d54b1f1bb6053..e35dcc04a3853da485a396bdd332217d0ac9054f
commit 42efd8d7124b00e50aa7aafa6925118ce3afc74e
Merge: 21c1f3920a6d bddafba6a54a
Author: Samuel Ainsworth<EMAIL_ADDRESS>Date:   Thu Sep 21 17:40:08 2023 -0400

    Merge pull request #255992 from samuela/samuela/jax

    python3Packages.jax: remove pytest-xdist

commit bddafba6a54a4ea07428a6ff0713898f81b25cca (origin/samuela/jax)
Author: Samuel Ainsworth<EMAIL_ADDRESS>Date:   Mon Sep 18 17:48:17 2023 -0700

    python3Packages.jax: remove pytest-xdist

    This dependency has caused nothing but trouble for us since its introduction. It offers moderate test suite speedups, but at the cost of frequent OOM failures in CI, including Hydra and nixpkgs-upkeep. Furthermore, the test suite takes only 1.5 CPU-hrs, limiting xdist's utility.

My working theory is that without pytest-xdist things are conflicting within the same process, which leads to these crashes. The problem for us is, that upstream does not test without pytest-xdist, so we are on our own on this way.
Please accept the offer to migrate nixpkgs-upkeep to nix-community and let's revert 4fc8d8b9ace09c69ba791cb0615d54b1f1bb6053.

My working theory is that without pytest-xdist things are conflicting within the same process, which leads to these crashes. The problem for us is, that upstream does not test without pytest-xdist, so we are on our own on this way.
The build failing on hydra was also already mentioned in https://github.com/NixOS/nixpkgs/pull/255992#issuecomment-1737115595, where ofborg didn't build the package due to python3Packages.jax not triggering the build, see https://github.com/NixOS/ofborg/issues/577. Please always reference the primary version we're currently using, e.g. python310Packages now, python311Packages soon.
Please accept the offer to migrate nixpkgs-upkeep to nix-community and let's revert https://github.com/NixOS/nixpkgs/commit/bddafba6a54a4ea07428a6ff0713898f81b25cca.

Ok, I think that makes sense. Let's merge this and then @Mic92 and I can sort out how to migrate nixpkgs-upkeep into nix-community.

Thanks @mweinelt !


Build show some warning on gcc 12

OS: Alpine 3.18
gcc: 12.2.1
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-alpine-linux-musl/12.2.1/lto-wrapper
Target: x86_64-alpine-linux-musl
Configured with: /home/buildozer/aports/main/gcc/src/gcc-12-20220924/configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --build=x86_64-alpine-linux-musl --host=x86_64-alpine-linux-musl --target=x86_64-alpine-linux-musl --enable-checking=release --disable-fixed-point --disable-libstdcxx-pch --disable-multilib --disable-nls --disable-werror --disable-symvers --enable-__cxa_atexit --enable-default-pie --enable-default-ssp --enable-languages=c,c++,d,objc,go,fortran,ada --disable-libssp --disable-libsanitizer --enable-shared --enable-threads --enable-tls --with-bugurl=https://gitlab.alpinelinux.org/alpine/aports/-/issues --with-system-zlib --with-linker-hash-style=gnu --with-pkgversion='Alpine 12.2.1_git20220924-r10'
Thread model: posix
Supported LTO compression algorithms: zlib
gcc version 12.2.1 20220924 (Alpine 12.2.1_git20220924-r10)

Build warning:
src/tests/debugallocation_test.cc: In static member function 'static void Test_DebugAllocationTest_DoubleFree::Run()':
src/tests/debugallocation_test.cc:147:32: warning: pointer may be used after 'void operator delete(void*, std::size_t)' [-Wuse-after-free]
  147 |   IF_DEBUG_EXPECT_DEATH(delete pint, "has been already deallocated");
      |                                ^~~~
src/tests/debugallocation_test.cc:75:5: note: in definition of macro 'IF_DEBUG_EXPECT_DEATH'
   75 |     statement;                                          \
      |     ^~~~~~~~~
src/tests/debugallocation_test.cc:146:10: note: call to 'void operator delete(void*, std::size_t)' here
  146 |   delete pint;
      |          ^~~~

and
src/heap-checker.cc: In function 'void HeapLeakChecker_InternalInitStart()':
src/heap-checker.cc:2130:39: warning: pointer used after 'void operator delete [](void*)' [-Wuse-after-free]
 2130 |     RAW_CHECK(!heap_profile->FindAlloc(test_str, &size),
      |                ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
./src/base/logging.h:96:11: note: in definition of macro 'RAW_CHECK'
   96 |     if (!(condition)) {                                                        \
      |           ^~~~~~~~~
src/heap-checker.cc:2125:12: note: call to 'void operator delete [](void*)' here
 2125 |   delete[] test_str;
      |            ^~~~~~~~

and
In file included from src/base/googleinit.h:37,
                 from src/heap-checker.cc:72:
src/heap-checker.cc: In function 'void HeapLeakChecker_InternalInitStart()':
src/heap-checker.cc:2130:39: warning: pointer used after 'void operator delete [](void*)' [-Wuse-after-free]
 2130 |     RAW_CHECK(!heap_profile->FindAlloc(test_str, &size),
      |                ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
./src/base/logging.h:96:11: note: in definition of macro 'RAW_CHECK'
   96 |     if (!(condition)) {                                                        \
      |           ^~~~~~~~~
src/heap-checker.cc:2125:12: note: call to 'void operator delete [](void*)' here
 2125 |   delete[] test_str;
      |            ^~~~~~~~

and
src/tests/stacktrace_unittest.cc: In function 'void CheckStackTraceLeaf(int)':
src/tests/stacktrace_unittest.cc:273:7: warning: variable 'size' set but not used [-Wunused-but-set-variable]
  273 |   int size;
      |       ^~~~

and
In file included from src/libc_override.h:92,
                 from src/tcmalloc.cc:150:
src/libc_override_gcc_and_weak.h:225:7: warning: 'int mallopt(int, int)' specifies less restrictive attribute than its target 'int tc_mallopt(int, int)': 'nothrow' [-Wmissing-attributes]
  225 |   int mallopt(int cmd, int value) __THROW         ALIAS(tc_mallopt);
      |       ^~~~~~~
src/tcmalloc.cc:2205:35: note: 'int mallopt(int, int)' target declared here
 2205 | extern "C" PERFTOOLS_DLL_DECL int tc_mallopt(int cmd, int value) PERFTOOLS_NOTHROW {
      |                                   ^~~~~~~~~~

and
In file included from src/tests/pagemap_unittest.cc:45:
In member function 'void TCMalloc_PageMap3<BITS>::set(Number, void*) [with int BITS = 20]',
    inlined from 'void TestMap(int, bool) [with Type = TCMalloc_PageMap3<20>]' at src/tests/pagemap_unittest.cc:85:14:
./src/pagemap.h:268:39: warning: array subscript 128 is above array bounds of 'TCMalloc_PageMap3<20>::Node* [128]' [-Warray-bounds]
  268 |     reinterpret_cast<Leaf*>(root_.ptrs[i1]->ptrs[i2])->values[i3] = v;
      |                             ~~~~~~~~~~^
./src/pagemap.h: In function 'void TestMap(int, bool) [with Type = TCMalloc_PageMap3<20>]':
./src/pagemap.h:224:11: note: while referencing 'TCMalloc_PageMap3<20>::Node::ptrs'
  224 |     Node* ptrs[INTERIOR_LENGTH];
      |           ^~~~
In member function 'void TCMalloc_PageMap3<BITS>::set(Number, void*) [with int BITS = 20]',
    inlined from 'void TestMap(int, bool) [with Type = TCMalloc_PageMap3<20>]' at src/tests/pagemap_unittest.cc:73:14:
./src/pagemap.h:268:39: warning: array subscript 128 is above array bounds of 'TCMalloc_PageMap3<20>::Node* [128]' [-Warray-bounds]
  268 |     reinterpret_cast<Leaf*>(root_.ptrs[i1]->ptrs[i2])->values[i3] = v;
      |                             ~~~~~~~~~~^
./src/pagemap.h: In function 'void TestMap(int, bool) [with Type = TCMalloc_PageMap3<20>]':
./src/pagemap.h:224:11: note: while referencing 'TCMalloc_PageMap3<20>::Node::ptrs'
  224 |     Node* ptrs[INTERIOR_LENGTH];
      |           ^~~~
In member function 'void TCMalloc_PageMap2<BITS>::set(Number, void*) [with int BITS = 20]',
    inlined from 'void TestMap(int, bool) [with Type = TCMalloc_PageMap2<20>]' at src/tests/pagemap_unittest.cc:85:14:
./src/pagemap.h:159:10: warning: array subscript 1024 is above array bounds of 'TCMalloc_PageMap2<20>::Leaf* [1024]' [-Warray-bounds]
  159 |     root_[i1]->values[i2] = v;
      |     ~~~~~^
./src/pagemap.h: In function 'void TestMap(int, bool) [with Type = TCMalloc_PageMap2<20>]':
./src/pagemap.h:134:9: note: while referencing 'TCMalloc_PageMap2<20>::root_'
  134 |   Leaf* root_[ROOT_LENGTH];             // Pointers to child nodes
      |         ^~~~~
In member function 'void TCMalloc_PageMap2<BITS>::set(Number, void*) [with int BITS = 20]',
    inlined from 'void TestMap(int, bool) [with Type = TCMalloc_PageMap2<20>]' at src/tests/pagemap_unittest.cc:73:14:
./src/pagemap.h:159:10: warning: array subscript 1024 is above array bounds of 'TCMalloc_PageMap2<20>::Leaf* [1024]' [-Warray-bounds]
  159 |     root_[i1]->values[i2] = v;
      |     ~~~~~^
./src/pagemap.h: In function 'void TestMap(int, bool) [with Type = TCMalloc_PageMap2<20>]':
./src/pagemap.h:134:9: note: while referencing 'TCMalloc_PageMap2<20>::root_'
  134 |   Leaf* root_[ROOT_LENGTH];             // Pointers to child nodes
      |         ^~~~~

and
In file included from src/base/googleinit.h:37,
                 from src/heap-checker.cc:72:
src/heap-checker.cc: In function 'void HeapLeakChecker_InternalInitStart()':
src/heap-checker.cc:2130:39: warning: pointer used after 'void operator delete [](void*)' [-Wuse-after-free]
 2130 |     RAW_CHECK(!heap_profile->FindAlloc(test_str, &size),
      |                ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
./src/base/logging.h:96:11: note: in definition of macro 'RAW_CHECK'
   96 |     if (!(condition)) {                                                        \
      |           ^~~~~~~~~
src/heap-checker.cc:2125:12: note: call to 'void operator delete [](void*)' here
 2125 |   delete[] test_str;
      |            ^~~~~~~~

and
In file included from src/base/googleinit.h:37,
                 from src/heap-checker.cc:72:
src/heap-checker.cc: In function 'void HeapLeakChecker_InternalInitStart()':
src/heap-checker.cc:2130:39: warning: pointer used after 'void operator delete [](void*)' [-Wuse-after-free]
 2130 |     RAW_CHECK(!heap_profile->FindAlloc(test_str, &size),
      |                ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~
./src/base/logging.h:96:11: note: in definition of macro 'RAW_CHECK'
   96 |     if (!(condition)) {                                                        \
      |           ^~~~~~~~~
src/heap-checker.cc:2125:12: note: call to 'void operator delete [](void*)' here
 2125 |   delete[] test_str;
      |            ^~~~~~~~

@vndroid - did you manage a workaround to build or is this breaking the build for you?

Hm. What workaround? This is just couple harmless warnings. You guys have any real trouble with it ?

In my case of trying to build for OpenWrt (cross compiling), it fails.  See: Makefile
Build log is here.

Is this to blame?
https://github.com/gperftools/gperftools/pull/765

Well, you're not building latest code. And yes, it fails in completely unrelated place (so doesn't apply to this ticket).

2.10 is not the latest?

master is latest. In about a week or so I'll cut 2.11

So most of these should now be fixed. except nothrow thingy. The later is hard to do semi-portably. And there is no goal of having warning-free builds for every system. And with all my respect towards clean-ness and principledness of musl, it is not major libc. So this warning is likely to stay. If that specific warning bugs you, just -Wno-XYZ it in your builds. Closing.


[Refactor] Move GenerateBlastLayer logic to helper functions

Right now, the blasting algorithm is stored as an Enum/string. This is used to gate which algorithm is used in GenerateBlastLayer.
This change instead stores the blasting algorithm as a BlastRadiusAlgorithm. This algorithm can be accessed and called directly from RtcCore.Radius
This change hasn't yet been tested, and it will need to be tested to validate that I didn't introduce a regression.

I'm not so sure about the Func<T,TOut> method. Gonna ping @ircluzar on this one. Not sure if he'd prefer an interface, abstract class, or this Func method. I'm leaning on interface since there's other similar chunks of code (e.g. engines) that'd probably make the most sense as an interface.

Not sure if he'd prefer an interface, abstract class, or this Func method.

Agreed! I don't have enough context on the codebase or C# to be confident in my choice here. I'm fine with any of those implementations, and I contemplated all of them in my drafts of this change.

Agreed! I don't have enough context on the codebase or C# to be confident in my choice here.

This approach definitely feels like a very C++ way of doing things. That your usual language of choice by any chance?
Long-term, components like these should be able to register themselves and just work. No wacky switch statements, no having to manually connect them to the UI, etc. What we want to achieve is component independence where you can go and make a plugin that implements some completely custom corruption logic and as long as you've filled the contract you can just have the component register itself and just work.
This brings up a key design choice. Should components register themselves (abstract class that implements a Register() function that you can optionally override & extend if required for your specific component), or should there be some form of service that handles the registration on load? I'm not sure to be honest.

This approach definitely feels like a very C++ way of doing things. That your usual language of choice by any chance?

I split most of my time between C++ and TypeScript. I know in TypeScript I would just pass around a function as an object and call it directly 😛
Regarding the rest of your comment: good food for thought

So ircluzar and I spent a decent amount of time discussing this last and and as it stands, we're thinking using an interface over an abstract class and using a service to register components. The main reason for this is plugins. Once we lock down a strong plugin API, plugins should be able to extend without messing with underlying functionality. As such, we're leaning on the service approach over the self-sufficient approach.
The goal here is allowing user extensibility in a controllable way, we need to ensure we can make plugins abide by rules and not mess with the RTC too much. They'll slot into the base UI/framework in a predictable way, and the plugin maker can implement custom logic on top of that. In all likelyhood, we'll probably build out a "base" plugin that implements the contract that can be extended to achieve the advantages of an abstract class (having that base functionality in there without locking you to that base functionality).

Closing this due to code rot and since I've lost context.


Stop uploading coverage and docs until dl.google.com issue is resolved

https://github.com/flutter/flutter/issues/10940

:-(


Assignement_1

What changes are you trying to make? (e.g. Adding or removing code, refactoring existing code, adding reports)
Assignment_1 of production.
What did you learn from the changes you have made?
learned the difference between Pandas DF and Dask DF
Was there another approach you were thinking about making? If so, what approach(es) were you thinking of?
Not this time.
Were there any challenges? If so, what issue(s) did you face? How did you overcome it?
na
How were these changes tested?
changes were tested in vs_code
A reference to a related issue in your repository (if applicable)
na
Checklist

[ ] I can confirm that my changes are working as intended
yes

A1 incomplete : need to use group_by("ticker") for rolling average as well

Runtime was high and getting some partition error. I have submitted it without results but hopefully, the code is correct.


Add a proper validation example for beaconCommonElements

The current example is actually not using the definitions.
A validation schema that uses the definitions in the beaconCommonElements.json is required.
This is due to the fact that beaconCommonElements.json is not a orthodox schema but just a set of definitions. No actual document would have that schema, therefore we need to create a fake schema with elements pointing to the definitions and validate the example against that fake schema.

Solved in commit 8dde28f2d333ae1a79faed45c300c20642a682b2


Layer dir with no metadata gets cached by pack

When a buildpack creates a directory at /workspace/<buildpack>/<layer>, but does not create a <layer>.toml, the directory will by cached by pack, which simply caches whatever is left after the export.
This happens because we iterate over the layers by globbing the *.toml files. Thus, if there is no <layer>.toml, the layer directory is "invisible" to the exporter.
We should probably add a step that checks for these "orphaned" layer dirs and removes them. Maybe, this should happen as part of a LocalVolumeCacher (because this is probably only a problem with that kind of caching mechanism).

fixed in lifecycle v0.1.0


Added caching of speech

For me, speech generation takes a noticeable time, and is usually the same few dozen phrases.  Caching the output of the speech generator is extremely helpful for me, removing the delay between action and result.  I don't know if it would be useful generically or not.  Since I really think the cache size should be configurable, I'm marking this as a draft request; making it configurable can be done if adding this request is desirable.
Note: Generated speech will be cached in /data, you must make this path
available to your docker container.
Dockerfile changes:
Added supervisor to docker image
Added new scripts, manage_tts_cache.sh and run.sh
Changed ENTRYPOINT to run.sh
app.py changes:
Updated to check for cached speech in /data.  If it exists, it will be
returned and no new speech generated.  If it does not exist (or is
empty), then the speech is generated and saved to a file before it is
returned.  Note, too, that the cache files are named as the SHA256 hash
of the actual text, the name of the TTS engine, and the voice id.  This
means that if you request the same speech with different voices or TTS
engines, a cached result will not be used.  By using a SHA256 hash, we
also prevent exposure of the text in the cache.  If testing reveals
collisions in the SHA256 hash, dropping the TTS engine and voice id
would likely reduce collisions.
manage_tts_cache.sh:
The new manage_tts_cache.sh script is nearly identical to one I wrote
for a different project using snips.  It will delete cached speech if
the specified size is exceeded.  It gets invoked through supervisor once
an hour.  The size is hard-coded as 50000000 bytes.  This could be made
configurable.
run.sh:
The new run.sh sript is the new entrypoint for the container.  It
creates a configuration file for supervisor based on the command line
arguments (which will get passed to app.py) and runs supervisor.
Additionally, the script will wait, watching for SIGTERM and SIGKILL.
If it gets either, it will nicely terminate supervisor, which stops
app.py and manage_tts_cache.sh.
Discussion:
This should probably be modified to add some sort of configuration for
how long the data is cached.
Perhaps command-line arguments to docker could be used to configure the
size for manage_tts_cache.sh, but run.sh would need to recognize the
configuration option for manage_tts_cache.sh and pass it to
manage_tts_cache.sh while passing all other options to app.py.
Alternatively, manage_tts_cache.sh could be reworked in python, and
invoked regularly from app.py, which would eliminate the need for
run.sh and supervisor.

Thanks for this, @franc6. I've added caching to OpenTTS 2.0 somewhat based on your implementation. I decided to add a --cache option to the command line that can either be empty (use /tmp) or be a path to a specific directory (probably mapped with docker run -v). This lets the user have fine-grained control over the cache, so they can run a clean-up script or not depending on their needs.
Thanks again!


Compile error across all branches

Whenever I attempt to build kawa, go complains with this message:
# deedles.dev/wlr/xkb
../../share/go/pkg/mod/deedles.dev/wlr@v0.0.0-20230609170122-c83b1a7b6114/xkb/syms.go:260:45: could not determine kind of name for C.XKB_KEY_dead_aboveverticalline
../../share/go/pkg/mod/deedles.dev/wlr@v0.0.0-20230609170122-c83b1a7b6114/xkb/syms.go:261:45: could not determine kind of name for C.XKB_KEY_dead_belowverticalline
../../share/go/pkg/mod/deedles.dev/wlr@v0.0.0-20230609170122-c83b1a7b6114/xkb/syms.go:262:45: could not determine kind of name for C.XKB_KEY_dead_longsolidusoverlay
../../share/go/pkg/mod/deedles.dev/wlr@v0.0.0-20230609170122-c83b1a7b6114/xkb/syms.go:259:45: could not determine kind of name for C.XKB_KEY_dead_lowline

This is true across all branches.

I haven't worked on this in about a year or so, thought I do still intend to get back to it at some point. Trayscale is a higher-priority project for me, though.
This is probably because of C dependencies having been updated. I'll take a look and see if I can at least get it to compile.

I took a look and I could. Fixed.

Awesome, thank you!


[Event Request] Table 18 Customer - OnBeforeValidateEmail

Hi Team,
In table 18, please provide the possibility to have event OnBeforeValidateEmail in field E-mail

Event:

Please backport to BC14 also.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


support for Quadro RTX 8000?

flash attention 1 support turing, but flash attention 2 not ?

Yup, it's mentioned in the README
FlashAttention-2 currently supports:

Ampere, Ada, or Hopper GPUs (e.g., A100, RTX 3090, RTX 4090, H100). Support for Turing GPUs (T4, RTX 2080) is coming soon, please use FlashAttention 1.x for Turing GPUs for now.

Support for Turing GPUs (T4, RTX 2080) is coming soon.
Looking forward to it.  @tridao

Unfortunately I've had no bandwidth to work on this. We welcome contributions.


Deadlock while resolving dependencies

Bug Description
When using a composite build and running the Gradle task dependencies in two or more subprojects at the same time, a deadlock occurs when version constraints are also used. This issue can be seen in the a and b subprojects of the gradle-deadlock repository, which defines a constraint for both subprojects in the version-constraints gradle project. The toplevel project includes a, b and the version constraints (version-constraints) while a and b are just adding one platform dependency to the version constraints.
Expected Behavior
Running the Gradle tasks :a:dependencies and :b:dependencies simultaneously with the command ./gradlew :a:dependencies :b:dependencies should create the same output as running both tasks separately.
Current Behavior
The build process hangs indefinitely, preventing completion of the tasks.
Context
This issue affects a large repository containing around 50 libraries that use a composite build and version constraints. We want to use the dependencies task to preload all dependencies into the cache in our CI system.
Steps to Reproduce

Clone the repository at https://github.com/lancomsystems/gradle-deadlock
Navigate to the repository directory and run the command ./gradlew :a:dependencies :b:dependencies

Your Environment

gradle 7.6 and gradle 8.0
java 11
linux

Creating a Build scan is not possible, because the build will not complete because of the deadlock.

Thank you for providing a valid reproducer.
The issue is in the backlog of the relevant team and is prioritized by them.

FWIW if you enable the configuration cache the build succeeds.

Could you try your reproducer with the latest Gradle version?

This still reproduces on 8.10, with the following thread dump: https://gist.github.com/octylFractal/85764839ca9cb103350795fd016095d3


Update deps to float back to master, add anti-affinity config

@mattmoor have any idea what is up here?

No, I'd pull it down and debug

Just missed the new rbac for leases. Added.


vector layer not showing

I am trying to add a vector layer to a map using the following code but not showing on the map:
var geojsonFormat = new GeoJSON({ dataProjection: "EPSG:3978" });
          var features = geojsonFormat.readFeatures(jsonData);
          let layer = new VectorLayer({
            visible: true,
            source: new VectorSource({
              features: features,
              format: geojsonFormat,
            }),
          });

          mapObject?.addLayer(layer);

JSON that is being transformed into GEOJSON
custom.geo.json

I am able to see the layer added to the map object but it is not visible on the canvas even though its visibility is set to true. Below it is layer number 12

Are you sure your GeoJSON is in EPSG:3978? To me it looks like a standard WGS84 GeoJSON. So you need to remove the dataProjection config option.

I tried without the projection as well but still nothing on the canvas

does anybody using laravel for the openlayers? cause i got an issue when i try to display the map using basic instruction and it not show up. I need your help please, i try to check the error and there is no error in console or in network browser

does anybody using laravel for the openlayers? cause i got an issue when i try to display the map using basic instruction and it not show up. I need your help please, i try to check the error and there is no error in console or in network browser

what's your problem in php and openlayers?


Network communication stucks when large arrays are transfered repeatedly

I found my network application stucks when using async-std v1.6.x which uses smol.
async-std v1.5.0 is fine, which does not use smol.
I converted my project to use smol directly, and the problem remained.
Then I wrote test programs to reproduce the problem.

https://gitlab.com/kashiko/test-smol
https://gitlab.com/kashiko/test-async-std

Each project compiles to two binaries server and client.
To reproduce the problem, first run server on a terminal
and then run client on another terminal.
The client sends arrays repeatedly to the server,
and the server echoes the arrays,
and the client receives the echoed arrays.
Communication logs are printed on both terminals.
At a point of the iteration, the network communication stucks when using smol.
When using async-std v1.5.0, the demonstration program works fine and the client exits.
Usage of the programs:
If server is invoked with no arguments, it listens <IP_ADDRESS>:8080.
The server's socket address can be specified by the first argument.
If client is invoked with no arguments, it connects to <IP_ADDRESS>:8080
and send arrays 32 times with increasing sizes.
The count of the iteration can be specified by the first argument,
and the server's socket address to connect can be specified by the second argument.
In my environment, iteration count 17 is sufficient to stuck.

Dup of #161? Should be fixed by #162.

@sopium Thanks!
The problem ceased by using your branch on #162.
So it should be dup.

I have published version 0.1.13 with the fix. Let's close this if the problem is resolved :)

@stjepang Thank you. The problem is resolved.


fix when request comes from curl

When access is through curl or using google console, the server responds 500.
This solution takes the first element of the language array if not exist the language from the browser.
Before de change:

After the change:

thanks for pointing the problem out, I fixed it in a slightly different way #3


Bad use of transition

https://github.com/sadmann7/skateshop/blob/aaa1b2190d8a53a3aa0a9c248c4e3c4af3a06911/src/components/generate-button.tsx#L16
"The function you pass to startTransition must be synchronous."
https://react.dev/reference/react/useTransition#react-doesnt-treat-my-state-update-as-a-transition

Sophie from the react team said it will be changed soon. Things are working ok right now with async transactions.
Here is a tweet thread if you wanna learn more about transaction:
https://twitter.com/sadmann17/status/1672417150378860544

Duplicate of #1


Refactor/use updated get method

Closes https://github.com/Telmate/terraform-provider-proxmox/issues/1078
Create, delete and update were already using the non-deprecated code, only read was. Modify it so it uses the updated code.
Also document the pool resource.

@Sonlis Tested this, and everything functions as intended. Thanks for your contribution.


Add PSA configuration for image unpacker

Creating an issue from the follow-ups outlined here: https://github.com/operator-framework/rukpak/pull/539#issuecomment-1233371230
Summary
In a recent merge we introduced the initial approach for adding PSA compliance to RukPak resources. In this approach, however, we opted to run the rukpak-system namespace in baseline PSA enforcement, which allows lower levels of security validation (like Pods being allowed to run as root which is a necessity for the current image unpacker implementation).
We would like to introduce a level of configuration for the unpacker struct that allows provisioners to opt-in to more a restrictive security context. This will allow the plain provisioner (and potentially helm provisioner) to use that configuration for more advanced pod security while also allowing the registry provisioner to ignore the configuration as it has legacy content that could run as root and should be considered immutable.

Note: It may also be necessary to create a separate namespace that the registry provisioner runs in with baseline set while the default rukpak-system namespace runs in restricted (which would contain all other RukPak resources).

A/C

[ ] Add the configuration for setting restrictive security contexts and have it be opt-in
[ ] Update the plain provisioner to utilize this more restrictive configuration
[ ] Update the tests and testdata for the plain provisioner to pass with restrictive contexts (I.E, not allowing root users for bundles)
[ ] Update the documentation for the plain provisioner to outline how bundle files need to be world-readable.
[ ] Determine if all of the above options need to allow happen for the helm provisioner.

/label lifecycle/stale

/label lifecycle/frozen


Rewrite subscriber flow control example

In Node, flow control settings appear set in the subscription, but do not persist across subscribers.
This rewrite addresses some of the confusion around subscription/subscriber.

@kir would you like to comment on this PR before we merge?

Thanks for the ping.  Two comments on this:

The older sample should not have worked since those options are not
valid for a subscription.  Is it fair to say that the fact that it did is
just a general feature of the JavaScript library that allows for arbitrary
object fields and ignores them if it does not know how to read them?

Your comment along the lines of "...flow control settings that are not
persisted server side" should not mention server side since it suggests
that there is some other magical way to get persistent flow control.  It
should just say "this is flow control" or "flow control is a property of
the client / listener instance"

Otherwise LGTM.
On Fri, Jul 12, 2019, 5:56 PM Tianzi Cai<EMAIL_ADDRESS>wrote:

@kir-titievsky https://github.com/kir-titievsky would you like to
comment on this PR before we merge?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/googleapis/nodejs-pubsub/pull/683?email_source=notifications&email_token=AENMYFVZFRCK3RGOHR3GM3DP7D42JA5CNFSM4IB27R5KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZ27DCA#issuecomment-511046024,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AENMYFWZUCKP2J5AAJ4JXL3P7D42JANCNFSM4IB27R5A
.

@kir-titievsky Thank you for reviewing!

The Node library calls a subscriber a subscription. That causes confusion. The old example set flow control on the subscriber.

Cool, I will make the changes.


execute command don't work

The output of /version on my server is: git-Spigot-b0f4c22-2ced023 (MC: 1.13.2)
The output of /version denizen on my server is: 1.30 (Build 196), CraftBukkit: 1.0.3-SNAPSHOT (build 607-DEV)
debug : https://one.denizenscript.com/paste/52171
The issue is:
The "execute command don't work with every command (tested with different things see : pastebin eg execute as_server "timings on")
We get for example
13:22:10: Incorrect argument for command
13:22:10: <--[HERE]

Trying with the console and in a script, (another person had tested it and confirm that issue)
logs : https://pastebin.com/1j85dwip

/execute is not a Denizen command.
- execute is a Denizen command.
The Denizen in-game command is ``/ex, which can be used like /ex execute as_server "something"`


Add linebreaks for every type

@anttiviljami I made a little change to be sure every type is on a new line
(And some autofixes on the linting)

Thanks! LGTM ✅


How to handle errors signaled during read-time evaluation?

Wrap the signaled condition in an Eclector condition?

Sounds good to me.


[WIP]Do not Merge!!! Rsyslog implementation

This patch provisions a new server and implements rsyslog server and its respective filters for storing logs from Network devices, Compute iLO.

please test this

please test this

please test this

please test this

please test this

please test this

please test this

@bodepd @hkumarmk  does this look good, we want to start provisioning this and then i will add the couple of more features on this.

I think the most interesting part of this is how you intend to integrate it? How will the various system be able to a) discover it and b) reach it?

The log server will be on a special subnet which will have access to both Underlay and overlay. All the devices would just point to this server and send the logs. I can send you a diagram for this

please test this

please test this

please test this

Test FAILed

please test this

Test FAILed

please test this

Test FAILed

please test this

Test FAILed


[FEATURE] Parser

Is your feature request related to a problem? Please describe.
A parser is not currently implemented.
Describe the solution you'd like
A custom parser similar to the lexer.
Describe alternatives you've considered
None. I have already made the lexer and I won't throw that into the garbage.
Additional context
None.

I am currently stuck on groups, so I will work on a different part for now.

Back from holidays.

Copied from the official discord

After a long holiday break I can announce the following (still unreleased) changes:
The parser now uses patterns instead of my first idea, using something like the matching in the lexer.
This is a pseudo code example for what I mean.
add_parser(vec![Pattern::DummyToken(DummyTokenABC), Pattern::Any)], MyNode);

It will add a sub parser to the global parser. If the pattern is matched (which is the case if the first token is of the same token type as DummyTokenABC and one token of any kind follows it) it will pass the matched tokens to the sub parser using the MyNode::get_node() function and will add the returned node, in this case MyNode to the AST for further compilation steps.
Please note that this is highly experimental and that the pattern syntax and the node system may change in the future.
I also added parser errors and did some other small changes.

And again, I promissed and delivered nothing.... Working on it again tho.


efficientunet.onnx file is missing

hi @lskog7 , I followed the README instructions to run the project, but I encountered an issue. The logs indicate that the efficientunet.onnx file is missing, and the project cannot proceed. Could you please provide this file or suggest a solution to this problem?

Hi, @sawyerwu! Thank you for your issue. The problem is - I tried to make everything more complicated and fancy and then again simpler) So, the current state of the model is not the best one. I'm working on new, better version currently, I think I could finish it in few days. It will be better, I think)
Although, to fix this problem you can remove .onnx file existance checking in app.constants.constants.py file. At the end of this file there is some code for this. And today I think I will make some kind of quick fix for this also.
Current model state does not depend on ONNX files. Model is in .pth in /demo/

Pushed some fix to main. Currently works for me.

@lskog7 Thanks for your update, I will try it.

@lskog7  I've pulled the latest code from the main branch, but when I run the command gradio segmnet.py, I get an error log stating FileNotFoundError: [Errno 2] No such file or directory: 'segmnet.py'. I'm running the code locally on my MacBook Air with an M3 chip. I haven't used Gradio before, so I'm not sure what the issue might be. Could you please help me identify the cause of the problem? If it's easier, I can also wait for the complete version of your code to be available.

@sawyerwu To run the app you need to use 'gradio app.py' from the project folder.

Thanks for your quick reply! It works fine with the command gradio app.py. I wanted to ask if you're using nii.gz format files for uploading? I'm having trouble uploading files, as it seems that Pillow doesn't support the nii.gz format.

Sure, that sounds good! I'll wait for the updated version. Thanks for letting me know!


Fix protobuf itest dependency on deployment

I've did mvn process-resources -Pformat -N, not sure the changes in quarkus-extension.yaml are needed.

Thanks @llowinge, my bad.


Several new bartender tools

About the PR

Added some new bartender tools in boozeomat.
Jigger - a small tool for controlling the amount of drink. Volume - 20u
Ice bucket - a huge steel bucket with ice, which you can use in making drinks (NO ICE BUCKET CHALLENGE PLS!!) Volume - 200u
Bar spoon - like a normal spoon, but longer and for drinks.
Why / Balance

This PR adds some very important things in IRL bartender job, without it this job is really difficult. In my opinion, we can use it in bartender roleplay on some higher level. Moreover, adding these things will not present any problems, but only a little more opportunities for players.
Media

https://github.com/space-wizards/space-station-14/assets/75203942/e6da0cee-8e8b-40d6-9298-462fb7f41e3b

[x] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes
Changelog

:cl: Dezzzix

add: Added bar spoon, jigger and ice bucket
add: Bartender tools added in boozeomat
add: Jigger added in Bartender guidebook

If I may make a request, the ability to insert a wine bottle into the ice bucket and have it display would be very cool.

If I may make a request, the ability to insert a wine bottle into the ice bucket and have it show as a layer would be very cool.

I think about that, but my skills now isn't very good rn for changes like this. Maybe I will do it in future PRs, idk, the time will show.


Looking for a new maintainer

Hello,
After more than 8 years (according to the git logs), I'd like to hand over maintenance of this library. I don't use it personally, and haven't dedicated much care and attention to it in a long time. It would be best for someone with an interest in it (as in, someone that relies on this library as part of their project(s)) to take over.
I believe the Hugo project uses this? If so, that could be a good fit, but anyone interested, please reach out!
Thanks,
Martin

Hello,
I'm happy to report that Yuki Okushi (@JohnTitor) has offered to maintain the purell repository and will take care of it going forward :tada: ! Thank you so much and feel free to ping me if you have any questions about the code or the repo.
Martin


How would the content of this page apply to Azure Functions (Java-based)?

Would any of the information provided in this page be applicable to Azure Functions (Java-based)? Would be very interested to see how we can apply similar approach for Java-based Functions using Logback or Log4j and MDC. I can't find much useful information about capturing MDC properties in Application Insights traces' customProperties -- which would be very useful for our Java-based Functions.
Thanks!

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 750f10f8-28b3-c30d-2475-0e5217a446dd
Version Independent ID: 66562094-9524-c37a-e493-971908169eef
Content: Azure Monitor Application Insights Java - Azure Monitor
Content Source: articles/azure-monitor/app/java-in-process-agent.md
Service: azure-monitor
Sub-service: application-insights
GitHub Login: @AaronMaxwell
Microsoft Alias: aaronmax

@mikeliucc - This feature is currently in public preview for Java Azure Functions both Windows and Linux If your applications are written in Java you can view richer data from your functions applications, including requests, dependencies, logs, and metrics. The additional data also lets you see and diagnose end-to-end transactions and see the application map, which aggregates many transactions to show a topological view of how the systems interact, and what the average performance and error rates are.
Take a look at the document for more information - https://learn.microsoft.com/en-us/azure/azure-monitor/app/monitor-functions#distributed-tracing-for-java-applications-public-preview
Help channels include the following:
 Microsoft Azure Monitor Q&A question page Q&A
Create a support ticket Support ticket
Post coding questions to Stack Overflow using an Application Insights tag.
At this moment, Since there is no doc update required, We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

Thanks for your feedback, @MonikaReddy-MSFT . Unfortunately neither the link you provided nor your comment address my initial inquiries. I'm grateful for the information, however.
My question primarily is about the MDC properties support. Let me try to be more descriptive...
In my Function code, I am logging certain messages using Logback, as well as adding additional
contextual information via MDC, like this:
MDC.put("classification", "xyz");
MDC.put("achieved", "true");
...
logger.info("Request processed with 17 results");
...
...
I can see the log messages captured in the Application Insights traces (under message field). But none of my MDC properties (i.e. "classification", "achieved") can be found in any of the tables in Application Insights.
Is there anything I need to do in order for MDC properties to be captured and exposed in Application Insights? I've read elsewhere that it is possible to capture MDC properties in the customDimensions field of traces. But I can't find any relevant documentation on this.
If possible, please re-open this ticket until a resolution is reached.
Any help you can provide would be greatly appreciated!!


[core-http] delay loading of DOM parser error namespace

We eagerly save the namespace of "parsererror" element on module load. It's
unnecessary because in most scenarios we would not encounter a parse error.
Furthermore, it caused Content Security Policy error in Chrome version 86.0 or
newer because the returned DOM object for parser errors contains some CSS
styles.
This change fixes the issue by lazily loading the error namespace when the
parsed DOM document contains "parsererror" elements.
Fixes #13268

@xirzec @chradek Please take a look


Basic System.d Service

Here is a bash script for installing psocksd as linux service :)
cd /tmp
wget https://github.com/clue/psocksd/releases/download/v0.4.0/psocksd.phar -O psocksd.phar
mv psocksd.phar /usr/local/bin/
sudo adduser psocksd -s /sbin/nologin
echo "[Unit]
Description=psocksd Service (PHP Socks Server)
After=network.target

[Service]
Type=simple
User=psocksd
ExecStart=/usr/bin/php /usr/local/bin/psocksd.phar socks5://priv8:test@<IP_ADDRESS>:5555--no-interaction
Restart=on-abort

[Install]
WantedBy=multi-user.target" > /etc/systemd/system/psocksd.service
sudo systemctl daemon-reload
sudo systemctl start psocksd
systemctl enable psocksd

Nice, thanks for sharing, I'm sure many others may also appreciate this! :+1:
I'll close this for now (marked as resolved?), but please feel free to come back if there's anything you want to discuss about this :+1:

Well thanks to you for sharing phpsocks :)
Here is an updated version that fixes the stop problem
cd /tmp
wget https://github.com/clue/psocksd/releases/download/v0.4.0/psocksd.phar -O psocksd.phar
mv psocksd.phar /usr/local/bin/
sudo adduser psocksd -s /sbin/nologin
echo "[Unit]
Description=psocksd Service (PHP Socks Server)
After=network.target

[Service]
User=psocksd
PIDFile=/var/run/psocksd.pid
ExecStart=/usr/bin/php /usr/local/bin/psocksd.phar socks5://priv8:test@<IP_ADDRESS>:5555--no-interaction
Restart=always

[Install]
WantedBy=multi-user.target" > /etc/systemd/system/psocksd.service
sudo systemctl daemon-reload
sudo systemctl start psocksd
systemctl enable psocksd


feat(getTokenData2): Adding token icon and media retrieval

:tada: This PR is included in version 1.4.0 :tada:
The release is available on npm package (@latest dist-tag)
Your semantic-release bot :package::rocket:


couldn't find shard "" for cluster

while query from edge based on many conditions
We create  two collection  ，one  named user used to store user info ，the other named   tag used to store tags we designed . we also create a edge to store the relation between each tag and user ,including the weight about the tag to each user .
Now ,we have 500 tags and 60000000 users and more than 250 million relationData in edge .
the data like that :
user :   {"user_id": "phoneNum"}
tag :{  "t_id": "xxxx", "t_name": "XXXX, "t_weight": 1}
relation: {"_from":"tag/xxxx","_to":"user/phoneNum","weight":0.25}
we have 250 million data in edge named relation and it cost more than 3 minutes to return the result.
sometimes it will shutdown or throw an error like that     couldn't find shard "" for cluster .....
it caused by hardware ? or we used arangodb in wrong way ?

please add more details about your installation. OS, Hardware, RAM, Disk, etc.


Problem with twitter front-page ban

Some changes to bypass twitter restrictions

Tested, this worked great for me. Thanks!

works for me too

worked for me too, only after patch.

Works for me, when this changes will be released?

I don't know about this, I'm just testing today as beginner, every few tweets I got one from GamesRedDeer with tweet promoting a giveaway. With or without proxy. is this the expected result?
it's always<PHONE_NUMBER>329061889, no matter what query I do
https://twitter.com/GamesRedDeer/status/1293568121329061889

Can anyone provide a guide for someone new on how to use this commit request?

click on files tab, then a diff will appear. on the right side, click on
the three dots icon and click on "show file", the full file will load, then
you search the "show raw" and open it, then copy all the content over the
same file on your machine.
python cares for white spaces, that's why you should carefully copy the
exactly file (you can download via wget/curl)
if you are running via docker, you should rebuild the image before running
the command client.
On Thu, Aug 13, 2020, 21:18 sspartzz257<EMAIL_ADDRESS>wrote:

Can anyone provide a guide for someone new on how to use this commit
request?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/taspinar/twitterscraper/pull/337#issuecomment-673771673,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAOUQZEE2V5Q5CMNUH2QNETSAR7FDANCNFSM4P44VMMQ
.

Test and works for me

How I can implement this solution without modifying the module ?

Worked as well. Thanks!

This worked a few times, and then I get this error message and only a fraction of my limit.
Failed to parse JSON while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=thGAVUV0VFVBaAwKqhpsTgySEWgoCogZGk3sohEjUAFQAlAFUAFQAVARUAFQAA&q=arson%20OR%20firebug%20since%3A2019-12-12%20until%3A2019-12-26&l=english" Traceback (most recent call last): File "/opt/anaconda3/lib/python3.8/site-packages/twitterscraper/query.py", line 109, in query_single_page html = json_resp['items_html'] or '' KeyError: 'items_html'
I also get errors for line 104 and 182 which doesn't resolve until a reinstall twitterscraper and the commit request.
Can anyone help? I'm a first time coder. Very, very new to this stuff.

Thanks! I'm using Query Search with User Search, this work for a while, sometimes i get a lot of tweets and sometimes i get 0 tweets!
Sometimes i repeat the searches with the same keywords, Accounts and dates, and a i get different tweets.

Thanks! I'm using Query Search with User Search, this work for a while, sometimes i get a lot of tweets and sometimes i get 0 tweets!
Sometimes I repeat the searches with the same keywords, Accounts, and dates, and a i get different tweets.

yeah same for me, I put the patch code and apparently the limit parameter doesn't work fine for instance I put "limit = 5" and I retrieve 142 tweets

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

don't worry, you have to go here
https://github.com/taspinar/twitterscraper/pull/337/commits/2233682b3c04840531a94ba8ee3c3325d7bf6b4a
copy the green code lines and replace the red code lines  in  your query.py  file and save it that's all
and make sure to create a copy before do it

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

don't worry, you have to go here
2233682
copy the green code lines and replace the red code lines in your query.py file and save it that's all
and make sure to create a copy before do it

Thank you so much, I can do scraping normally, with changing some code on query.py.

Thanks for the PR! Anyone else receiving improper tweets (could be sponsored material) since using this patch?

It doesn't work again. Return 0 tweet.

I confirm that it is not working anymore since this midnight 18-09-2020.

I confirm that it is not working anymore since this midnight 18-09-2020.

404 error with init_url, anyone knows how to fix if?
INIT_URL = 'https://twitter.com/i/search/timeline?f=tweets&vertical='
'default&include_available_features=1&include_entities=1&'
'reset_error_state=false&src=typd&max_position=-1&q={q}&l={lang}'

I get this error requests.exceptions.ConnectionError: HTTPSConnectionPool(host='free-proxy-list.net', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f5323ef37c0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution')).

I get this ERROR:twitterscraper:An unknown error occurred! Returning tweets gathered so far.

Some changes to bypass twitter restrictions

Seems this solution is NOT working again :-(

Here is a alternative scweepy. I can extract more meaningful features inthe next days.


Spec for Triggers and Custom Clickable Links

Abstract
This spec outlines a mechanism by which users can define custom actions to run
when a string of text is written to the Terminal. This lets users create
powerful ways of automating their Terminal to match their own workflows. This
same mechanism can be used by third-party applications to customize the way the
terminal control automatically identifies links or other clickable regions of
the buffer, and handle it in their own way.

Specs #5916
Specs #8849
Specs #6969
References #7562, #2671, #11901, #11000

Our current URL regex code is still essentially a prototype and would need to be rewritten to work well. For instance, it still doesn't work well with text that is partially outside of the viewport. There's also the problem that we won't be able to correctly match newlines as written in the spec because we currently don't store any newlines. The same would be true for matching trailing whitespace

Oh in my prototype I did some real dumb stuff:
https://github.com/microsoft/terminal/compare/f99757176215e46b76b82d0bd4baa5a95f76a5e6


Database seed / installation fails when no User present

In the event of a fresh install where the administrator has not yet created a user, database seeding will fail because it expects such a user.

Hey, sorry I just did  pull request #126 to fix this bug.
The installation couldn't see the user_class because forem.rb wasn't loaded after it was installed in the generator.
It now handles this.

Awesome.


npe2 cookiecutter notes

hey @nclack
Taking a look through the npe2 cookiecutter, instead of a PR, just want to put some tasks here that we can tackle individually:

[x] we shouldn't use from numpy.typing import ArrayLike in _writer for two reasons: first, it's only available in pretty new versions of numpy (I think 1.20+) and we didn't pin numpy in the users' setup.cfg.  Second, it's not an accurate type., layer data can come in many types.  We're trying to codify this with the LayerDataProtocol, but i wouldn't use that either.  Just call it typing.Any for now.
[ ] writers need more docstrings with clearer expectations about what they expect, and what they should do.  I know there's a link there, but it would be nice if the cookiecutter stood alone a bit more.
[x] #71def write_single_image(path: str, data: Any): ...
# should be changed to
def write_single_image(path: str, data: Any, meta: dict): ...

anddef write_multiple(path: str, data: List[ArrayLike], layer_types: List[str]): ...
# should be change to
def write_multiple(path: str, List[FullLayerData]): ...

The args are passed here
[x] ... obviously, we should make the equivalent of the hook_specifications.py for npe2, so we have one authoritative place to look for all signatures expected by npe2. (See https://github.com/napari/npe2/pull/61)
[x] #70  commands:
    - id: napari-foobar.get_reader
      python_name: napari_foobar._reader:napari_get_reader
      title: Open data with napari FooBar
    - id: napari-foobar.writer
      python_name: napari_foobar._reader:napari_get_reader
      title: Save data with napari FooBar

[x] (This one is in main like this, but just noting this so I don't forget)...  in _widget.py, we should prefer viewer: 'napari.viewer.Viewer'over using the param named napari_viewer, and we should add at the top:

if TYPE_CHECKING:
    import napari.viewer
    import napari.layers

[ ] writer tests need improvement (possible others as well)

the equivalent of the hook_specifications.py for npe2

I like it a lot

the writer test is anemic/not-present which contributes to some of these. I let that slip my mind. I'll edit the issue to add that to the list.

I'll close this issue as most of the issues are probably out of date. We can make new issues (better writer docs and tests) as they surface in napari/napari-plugin-template.


networkUp only after service active for 5s

rancher/rancher#10217

@kinarashah can you look at the failure to see if it is related to the changes we've made? Looks like it might.

LGTM


Conformer encoder model architecture

Hi @lucidrains, here's Conformer encoder model architecture, it has a few other Modules:

I have not started working on it, should I do a PR to include Multi-Headed Self-Attention Module and Feed forward module?

@jinglescode Hi Hong! Sure, I can add the ConformerBlock at some point. I don't think the rest of the architecture contains anything too novel

@jinglescode Hi Hong! Sure, I can add the ConformerBlock at some point. I don't think the rest of the architecture contains anything too novel

@jinglescode Are you familiar with how the SpecAug and Convolution Subsampling is done in Pytorch?

@jinglescode Are you familiar with how the SpecAug and Convolution Subsampling is done in Pytorch?

@jinglescode Hey Hong, I added the Conformer Block, let me know if that's good enough for you

@jinglescode Hey Hong, I added the Conformer Block, let me know if that's good enough for you


Datagrid: column-toggle design issue in case of many columns and few rows

Describe the bug
In case of many columns and few rows, a portion of the column toggle panel is out of the viewport.
How to reproduce
Steps to reproduce the behavior:

Go to https://stackblitz.com/edit/clr-datagrid-column-toggle-design-issue
Click on the column toggle icon
See that a portion of the column toggle panel is out of the viewport. The user cannot access the first coupe of columns' checkbox.

Expected behavior
I expect to see every columns' checkbox.
Versions
App

Angular: 6
Node: 10.8.0
Clarity: 0.11.28

Device:

Type: Dell
OS: Windows 10
Browser: Tested with Chrome, Firefox

Hi @dszegvari
This is something that we could stand to make easier. But it will probably become a non-issue before we can get to it.
Here is a stackblitz demonstrating the workaround.
It will be hard to prioritize this as #2240 is something we will need to complete to finish #1586
If you are looking for the enum that has the anchor points in the stackblitz, you can find it here.

There is a workaround available for this issue, and we recommend using it for Clarity Angular. As we build Clarity Core implementations, we expect that this issue won’t be an issue or will be configurable on the application side. To help us clean up our backlog, we are going to close this with a functional workaround available and suggest you follow updates for Clarity Core for enhancements that can support your use case with Clarity Core components.

There is a workaround available for this issue, and we recommend using it for Clarity Angular. As we build Clarity Core implementations, we expect that this issue won’t be an issue or will be configurable on the application side. To help us clean up our backlog, we are going to close this with a functional workaround available and suggest you follow updates for Clarity Core for enhancements that can support your use case with Clarity Core components.


Added Photo Production Model for pcgym

Hi Max,
I have added a model as we discussed via MS Teams. Looking forward to hearing your feedback.
Kind regards and have a good christmas
Matthew

Looks like a nice model and implementation. My only question is it a setpoint tracking problem or are we trying to maximize the biomass? If it is the latter, we will need to rework the "default" reward function accordingly.
Thank you and have a good Christmas too.

Hello Max,Not set point tracking, but looking to minimise the terminal concentration of nitrate. I agree we need to change the reward function, as shown in: https://arxiv.org/pdf/2011.07925I am happy to alter this but my GitHub kept trying to delete everything else associated with PC Gym. Have a lovely weekend,RegardsSent from my iPhoneOn 13 Dec 2024, at 18:59, Max Bloor @.***> wrote:
Looks like a nice model and implementation. My only question is it a setpoint tracking problem or are we trying to maximize the biomass? If it is the latter, we will need to rework the "default" reward function accordingly.
Thank you and have a good Christmas too.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>


Is it possible to use this for the Landkreis Vechta?

The AWV (Abfallwirtschaft Vechta) uses Abfallplus somehow, however it uses it's own App.
I can not use the original Abfallplus app and it prompts me to use the AWV app instead if I try.
Is it still possible to use this integration with it? Since I can not get the required IDs.
AWV Website
Thanks in advance

I had a quick look at theit website and it seems they do not embed the AbfallPlus web widget anywhere on their page.
I assume the've just licenced the App (IOS/Android). Without the widget the necessary keys cannot be extracted (I've not yet figured out how to reverse engeneer the Apps in order to get the keys).
Without the keys the HA integration does not work, sorry 🤷🏽


Update leaflet.toolbar.js #49

Improve indentation

Thanks for your interest in this project!
The file you've modified is a generated file (generated by the build rules defined in Gruntfile.js, which you can run with grunt at the command-line). There are two reasons why it doesn't make sense to maintain special spacing for this file:

It's re-written every time the project is rebuilt.
It's purposely minified to save data for clients. Adding tabs and spaces and newlines to this file goes against the entire purpose of minification.

If you're interested in reading the code, I recommend that you look at the code under https://github.com/Leaflet/Leaflet.toolbar/tree/master/src.