test(fixtures): refactor to cache base git repo fixture

INCLUDES #799, will rebase after merge

Purpose
Improve speed of test code and reduce the number of IO operations
Rationale
PR 2 for test caching. Now the base git repo (git init & configuration on top of the example project) is cached for all the repos to extend from without having to execute the init action every time.  This is phase 2 before the caching of each repo type.

(from #799) In other development towards changelog testing, I came across the high use of IO operations as we rebuild a project with each test case.  This causes a lot of IO operations, and even more so on the use of git.  I followed the rabbit hole, and this PR is the first of a few that help increase the test execution speed through deliberate abstraction/modularity.  I felt it all at once would be way to confusing and too much for a good review.

This also includes some slight modification to the test fixtures and test setup to better ensure that the files exist as it is not possible to handle when the fixtures resolve/execute when passed as parameters (and their ordering).
How I tested
Besides checking the result here in the CI, I originally was able to confirm the caching mechanism through the VSCode debugger and many break points through the code to see how many times each fixture was called.  Once this commit was implemented, the session scope ensured that cached_example_git_project was only called once but the git_repo_factory fixture called every test run by the repo_* fixtures.
How to Verify
To get VSCode to run the debugger, you have to change the tool.pytest.ini_options.addopts by removing the --cov* options and then changing -nauto to -n0.  Once you do this, add a breakpoint to the start of git_repo_factory, and cached_example_git_project.  Then execute a test (a minimum of 2 that use a repo_*) with the debugger. When you step through, you will see how many times each is called, and you will see the cleanup occur as well if you put a few breakpoints in teardown_cached_dir.

@bernardcooke53, pr ready for review for when you have time, thanks!

This got merged with #804


bug: s_start, s_end, t_start, t_end w/diffusers

It looks like compel is setting values that aren't right for these terms when used in InvokeAI:
{'s_start': 0.0, 's_end': 0.2062994740159002, 't_start': 0.0, 't_end': 1.0}
t_start should be 0.2, and the s_* terms don't mean anything for diffusers.

fixed in 57f5b2f


Change storage location of offline mode from in-memory array to localStroage

Hi,
Can I extend this module, to allow injection of the storage location of offline events. So, that as per the application need developer can inject. By default it would in-memory array only. So, that it stays backward compatible.
Let me know your thoughts.
Regards
Mohit Thakral

Do you want to extend it with localStorage and/or sessionStorage as per HTML5?
If you keep it fully backwards compatible, add an acceptable suite of unit tests, and ensure there is no requirement on another module / package, then absolutely. You just need to submit a PR for the change and I will be happy to code review, provide feedback, and assist you in getting the change in.


Don't verify bot itself, add missing awaits

Don't try to verify the bot itself.

Codecov Report

Merging #694 (5ed3d12) into main (5934f9c) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main      #694   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           70        70
  Lines         3141      3143    +2
  Branches       312       312
=========================================
+ Hits          3141      3143    +2

Impacted Files
Coverage Δ

src/spellbot/client.py
100.00% <100.00%> (ø)

src/spellbot/interactions/leave_interaction.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5934f9c...5ed3d12. Read the comment docs.


[bug] Tauri app fails to launch in release mode on Mac OS

Describe the bug
Some kind of failed memory allocation causes the app to not launch when built in release mode. When tauri tries to free that memory it fails
Reproduction

Create a new tauri app
Run tauri build
Launch the app
The app should immediately quit

Expected behavior
The app should launch as it does in development mode
Platform and versions
Environment
  › OS: Mac OS 12.3.1 X64
  › Node.js: 16.13.2
  › npm: 8.1.2
  › pnpm: Not installed!
  › yarn: 3.2.0
  › rustup: 1.24.3
  › rustc: 1.59.0
  › cargo: 1.59.0
  › Rust toolchain: stable-x86_64-apple-darwin

Packages
  › @tauri-apps/cli [NPM]: 1.0.0-rc.9
  › @tauri-apps/api [NPM]: Not installed!
  › tauri [RUST]: 1.0.0-rc.8,
  › tauri-build [RUST]: 1.0.0-rc.7,
  › tao [RUST]: 0.8.3,
  › wry [RUST]: 0.15.1,

App
  › build-type: bundle
  › CSP: unset
  › distDir: ../out
  › devPath: http://localhost:3000/
  › framework: React (Next.js)
  › bundler: Webpack

App directory structure
  ├─ .yarn
  ├─ out
  ├─ node_modules
  ├─ .next
  ├─ styles
  ├─ public
  ├─ src-tauri
  ├─ .git
  └─ pages

Stack trace
tauri-app(68865,0x10148d600) malloc: *** error for object 0x1: pointer being freed was not allocated
tauri-app(68865,0x10148d600) malloc: *** set a breakpoint in malloc_error_break to debug

Additional context
This problem randomly happened one day without changing anything in the app.

Can you provide a minimal repo that re-creates this bug? Because on it's on the steps are fine, I run these steps almost daily and they work on my macos machine.

I believe this was fixed here: https://github.com/tauri-apps/wry/pull/567
A patch will be published soon. I can confirm if you send us a minimal repo to reproduce this (from my tests it happens when the response is empty e.g. an empty file).


feat: #658 Config UI: Add GitHub Data Provider

Config-UI / Data Providers / GitHub
Key Points

[x] Add GitHub Data Provider Configuration

Single-Limit Instance ONLY (Source Limit = 1)

[x] Create GitHub Settings Form Template settings/github.jsx

No additional settings required message.
[x] Apply GitHub-UI Specific Form Settings
The "Auth Tokens" Field can support more than 1 token, comma-separated
Like Jenkins, no additional settings options are required at this time.

[x] Create Global Providers Configuration Constants

Create Form Labels Configuration
Create Form Placeholders Configuration
Dynamic Labels+Placeholders by Provider (Defined in data/Providers.js)

[x] Update Connection Manager Hook
[x] Refactor Code Flow

Use Constant Provider.XXX references where applicable
Relocate Settings Component to Configuration Object
Update Menu Configuration

[ ] Confirm BE API Routes [OPEN]
[x] Test GitHub UX Workflow

Description
This PR adds support for GitHub as a Data Provider on Config-UI as well as makes the Provider configuration within the config-ui application a bit more dynamic so we can continue expanding our list of supported providers.
Does this close any open issues?
#658
Current Behavior
GitHub is not listed as a data provider.
New Behavior
GitHub added as a new Data Provider.
Screenshots

@joncodo @kevin-kline This is ready for main. We still need to get the Backend API routes built & verified, any further changes for GitHub can be handled under a new ticket. Thanks!


THIS ISSUE TRACKER IS CLOSED - use the Home repo issue tracker

Hello, this issue tracker is no longer used. Please log new issues here: https://github.com/aspnet/Home/issues
For information about this change, see https://github.com/aspnet/Announcements/issues/283

Please use https://github.com/aspnet/Extensions. This repo is being archived.


Is Raven DB's Voron engine suitable for our purposes?

I havent looked into it.
https://github.com/ravendb/ravendb/tree/v3.0/Raven.Voron
The license might be permissive enough: https://github.com/ravendb/ravendb/blob/v3.0/license.txt

It looks interesting, but I wonder whether it's overkill. We just need the log, rather than a whole key-value store.
I'm not sure on the details but it looks like the Symas LMDB which it sits on is closed source and not free.


curve smoothing and null data series

If you have 'stroke.curve': 'smooth' enabled and try to display an empty data serie (array with null only), it will throw the following error:
Uncaught (in promise) TypeError: Cannot read property 'indexOf' of undefined
Please see my codepen, simply remove the stroke.curve property to make it work: https://codepen.io/Heartz66/pen/KKVRdbW

This is fixed in this commit and an update will be released soon.


Set up pre-commit hooks and lint codebase

In this PR:

Set up black and flake8
Lint codebase

Where's the CI to run this!

I’m getting there, one PR at a time :)


Adding ngCordova causing Ionic app stop working in iOS device

I try to add ngCordova inside my Ionic app module. After adding and built it inside my iPhone 5 running iOS 9.3.1 (I tried both ways; built using Xcode and by running ionic run ios), tapping on Test button not firing the test function.
When I remove ngCordova from my app module, the button fires the test function and I can see the alert box.
Any idea?
Am I missing something here?
What I've done?

I try ionic platform remove ios and ionic platform add ios and built it again. Still not working.
I try running this app on my Xcode simulator, it works fine. The app only stop working in real iOS device.

My Ionic info
Cordova CLI: 6.0.0
Ionic Version: 1.2.4
Ionic CLI Version: 1.7.14
Ionic App Lib Version: 0.7.0
ios-deploy version: 1.8.6
ios-sim version: 5.0.8
OS: Mac OS X El Capitan
Node Version: v5.6.0
Xcode version: Xcode 7.3 Build version 7D175

The way I called ngCordova script
<script src="lib/ng-cordova.min.js"></script>
<script src="cordova.js"></script>

Please help. Thanks!

If you run it in browser; or on the device through XCode; what do you see in the console? There should be errors.

@gortok running in browser is fine. I got no errors and I can see the alert box.

what do you see when you run it on the device in Xcode?

The only logs that I can see from my Xcode logs is:
2016-04-20 08:53:14.904 LaunchNavigator[226:9922] Apache Cordova native platform version 4.0.1 is starting.
2016-04-20 08:53:14.906 LaunchNavigator[226:9922] Multi-tasking -> Device: YES, App: YES
2016-04-20 08:53:15.016 LaunchNavigator[226:9922] Using UIWebView
2016-04-20 08:53:15.020 LaunchNavigator[226:9922] [CDVTimer][handleopenurl] 0.301003ms
2016-04-20 08:53:15.024 LaunchNavigator[226:9922] [CDVTimer][intentandnavigationfilter] 3.786981ms
2016-04-20 08:53:15.025 LaunchNavigator[226:9922] [CDVTimer][gesturehandler] 0.238955ms
2016-04-20 08:53:15.062 LaunchNavigator[226:9922] [CDVTimer][splashscreen] 36.476970ms
2016-04-20 08:53:15.199 LaunchNavigator[226:9922] [CDVTimer][statusbar] 135.217011ms
2016-04-20 08:53:15.201 LaunchNavigator[226:9922] [CDVTimer][keyboard] 1.166999ms
2016-04-20 08:53:15.201 LaunchNavigator[226:9922] [CDVTimer][TotalPluginStartup] 181.199014ms
2016-04-20 08:53:15.855 LaunchNavigator[226:9922] Resetting plugins due to page load.
2016-04-20 08:53:16.413 LaunchNavigator[226:9922] Finished load of: file:///var/containers/Bundle/Application/4C6D332E-B3A1-4549-A946-F8DC6B79213B/LaunchNavigator.app/www/index.html

Touching the button didn't log anything.

Don't know your specific issue; but here's an example app that works with ngCordova; it appears you're missing a few things?
https://github.com/Jewelbots/ble-demo-app/blob/master/app/scripts/app.js#L8

I had the same problem.
I was able to fix it by moving the 'ngCordova' dependency to the top of the dependencies array.
So my module declaration is:
angular.module('AppName', [
'ngCordova',
'ngCordovaBluetoothle',
'ngRoute',
'mobile-angular-ui',
'AppName.controllers.Main',
'AppName.controllers.Home',
])

Still not working for me. @mrtomhoward are you using Ionic? I can't see ionic inside the dependencies array.

@zulhfreelancer Sorry, no I'm not using ionic, I'm using mobile-angular-ui.
But I was able to pinpoint and fix the problem by creating a fresh Cordova project, and one-by-one adding modules and my own src code back in and seeing what it was that caused it to break.

This could be because of JS incompatibility
check adding the below code before all of your scripts. This will give you the error which preventing it from running.
Any new javascript syntax wont work on iOS 9.3.x
`

`


Improve oso parsing time, especially OSLQuery/oslinfo

In an interactive application, we were hoping to eliminate the fractional second hiccup that occurred when the app had to use OSLQuery to parse an oso file on disk in order to comb through the metadata to build an appropriate UI. It seemed especially slow when the shader parameters had metadata containing very long strings.
I'm pleased to report that the changes in this PR give us around a 10x speed improvement for our big shaders, and up to 100x improvement for doctored shaders that we modified specifically to tickle this slowdown with the string metadata.
The changes are:

Change (both in oslquery and oslc) our use of flex: instead of using the FlexLexer C++ wrapper, just use the usual straight C interface. The C++ wrapper uses IOstreams, I think that's why it was slow. Changing to C vastly speeds things up. That's 90% of the improvement.

Change the way the lexer and parser dealt with hints. It was confusingly parsing the hints themselves into their constituent parts, then reasembling them into a big string to pass to OSOReader::hint(). Silly! So the lexer itself has been modified to just consider the entire hint to be one lexical object and pass it directly. Also simplified the way the lexer handles quoted strings generally to avoid creating so many intermediate ustrings.

Some messing around with string_view instead of raw string pointers and ustrings for hint text.

Does the switch to the plain C interface of flex mean we put any symbols outside the namespace? Or are they all just private functions?
LGTM to the changes otherwise -- very nice speedup!

I'm going to guess that the flex-generated symbols using the C++ wrapper were also not inside our namespace. Also, the C++ wrapper I don't think prevented the C interface from being built underneath all along. So, this affair certainly shouldn't make the problem any worse.
I think the speedup may be even better than reported. I hadn't incorporates your timing patch, so those numbers I cited on our internal ticket were just total runtime of oslinfo, and the fact that the fast shader and slow shader reported the same time probably indicates that it's nearly all overhead of running the binary.
The story of this is amusing. I did not originally suspect IOstreams (if it's indeed that) to be a problem. Rather, I was reading the flex manuals, and there are some table size vs speed options that it kept saying were not available if you are using the C++ mode. So I switched to the C APIs only so that I could try those options. And it was a huge PITA that I almost abandoned a couple times. But once I finally got it building and working, suddenly it was 100x faster. I never even got around to trying out the options I was originally looking at. (I guess I could, but the time is already almost negligible, and I"m not sure how I'd accurately measure any further improvements.)

Cool to hear. We can worry about the symbols in other review, was just curious.

There's an option -- which we use -- to change symbol name prefix. That's how we can have an oso parser and an osl parser in the same binary. (yyparse becomes osoparse and oslparse, etc.) We might be able to do some preprocessor-fu to somehow incorporate the custom namespace and version. Let's tackle that separately.

I can't wait to hear how this speedup addresses your Katana-side hiccup.


Preparing release v1.59.0

Which problem is this PR solving?

Description of the changes

How was this change tested?

Checklist

[ ] I have read https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
[ ] I have signed all commits
[ ] I have added unit tests for the new functionality
[ ] I have run lint and test steps successfully

for jaeger: make lint test
for jaeger-ui: yarn lint and yarn test

@frzifus I think it would make sense reject the request to the webhook when the mode is set to the sidecar. Now it seems only args are checked https://github.com/jaegertracing/jaeger-operator/pull/2497/files#diff-32094fefd1a64042b98c218228dd2d9b3e52ffcacc06f939ad6dabfdd7fb17a2R99

Some deployments fail:

Deployment does not have minimum availability.

         status:
        -  readyReplicas: 1
        +  conditions:
        +  - lastTransitionTime: "2024-06-27T07:56:55Z"
        +    lastUpdateTime: "2024-06-27T07:56:55Z"
        +    message: Deployment does not have minimum availability.
        +    reason: MinimumReplicasUnavailable
        +    status: "False"
        +    type: Available
        +  - lastTransitionTime: "2024-06-27T07:56:55Z"
        +    lastUpdateTime: "2024-06-27T07:56:55Z"
        +    message: ReplicaSet "simple-streaming-ingester-5d586cb4d6" is progressing.
        +    reason: ReplicaSetUpdated
        +    status: "True"
        +    type: Progressing
        +  observedGeneration: 1
        +  replicas: 1
        +  unavailableReplicas: 1
        +  updatedReplicas: 1

If otlp is enabled and no explicit port for grpc or http is configured, we change the default address from localhost to <IP_ADDRESS>.
See:

https://github.com/jaegertracing/jaeger/issues/5737

FTR: We skipped 1.58.


Add simulation for QR using the QR pattern catalogue

The user should be able to select a QR pattern from the catalogue, simulate values for the params and decide to include the concret QR (QR pattern + concrete values for the parameters)

depending of qrapids-qma-elastic issue number 3
related to issue  #23

Estimated effort: 15 hours
Real effort: 12 hours


IO 1.5.0, Util 1.5.0

To validate this pull request against other sbt modules, please visit this link.


First Draft of client_wait

"started migrating prefect client waiter from 1.0 task library to 2.0 collections"

@mtconger97 okay I fixed the test.
To explain
    monkeypatch.setattr(
        "prefect_aws.client_wait.create_waiter_with_client",
        mock_create_waiter_with_client,
    )

Wherever prefect_aws.client_wait.create_waiter_with_client is called, use mock_create_waiter_with_client instead, and mock_create_waiter_with_client returns "waiter" so the result == "waiter"


kvm: add vm monitoring apis

see #144

Codecov Report

Merging #162 into 1.1.0-alpha will not change coverage.
The diff coverage is n/a.

@@             Coverage Diff              @@
##           1.1.0-alpha     #162   +/-   ##
============================================
  Coverage        16.73%   16.73%
============================================
  Files               15       15
  Lines             1034     1034
============================================
  Hits               173      173
  Misses             850      850
  Partials            11       11

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8264815...3b0e716. Read the comment docs.


Updates "Render Modes (SPA, SSR, SSG, HTML-only)" to fix a typo

Tiny fix to update the missing extension in a page filename.

Good catch 👌


Fix functional tests to run on macOS (and hopefully still Linux)

sed -i needs something after it
printf is incompatible, use date
mention coreutils needed

Resolves #802

@markstur FYI I didn't close this, it was a GitHub bug having to do with the open-sourcing, no action was taken on my part, feel free to reopen


Center - Agency must be reported with the metadata sent to the the metrics application

Users of the metrics application have requested to be able to sort by applications according to which agency submitted the application, so in order for this data to be logged, the center application must report the information to the metrics application. This can be done by reporting an "Event Name" of the agency when an application launch is tracked.

Passed test in all 4 browsers on Master (Admin or Org Steward):
Metrics page: Event Categories/Event Name/Applications (+)

Day range - record TO/TO2/TO3 numbers, open apps in all, F5, recount to verify
Same test for Week, Month, Year, Date Range


Quick Parts, field formula

Would it be possible to add a Quick parts, > field, then formula with this program?

I've no idea what you're talking about. When adding an issue, please take the time to fully describe the issue, including enough background on what you're trying to achieve to give context to your request.

sorry, was in a rush.
Essentially, in MS word, you can go to  the insert tab, then click "Quick Parts", field, and then select your field type to be a formula. Therein, type in a formula to be executed upon opening the document
Would this be possible within your program?

There's no direct API support for this. If you search on 'python-docx field' you'll find a few situations where folks have gotten something like this working using a workaround function that accesses the underlying XML.


Plugin does not parse out the filetypes

According to nvim docs filetype, Filetypes may have multiple filetypes associated separated with '.' character.
The result when running prettier on a file in my project results in "javascript.javascriptfamily not supported by prettier"

No support for that, you have to use g:coc_filetype_map


Remote read ReadResponse should allow for multiple queries

The remote read proto currently allows for multiple queries to be made, in line with future expectations to bundle queries together.
However the response only allows for a single vector. We should add another level of list on top of what we have.
It'd be best to do this before 1.6.

But multiple queries are fine to end up in the same range vector, no? The multiple queries is there so that we can request multiple label selector sets with different time ranges and all, but all we need as a result in the end is a list of all the time series with all their data points (which we have now).

But multiple queries are fine to end up in the same range vector, no?

Consider the query a + b. We need the a's and the b's separately unless you want to separate them out on the Prometheus end. Downsampling optimisations/tweaks may also require offering different data for the same metric depending on context.

So I guess you mean that in the end at https://sourcegraph.com/github.com/prometheus/prometheus@5f3327f620e3fd29bfc3770acd68d679d165d49c/-/blob/promql/engine.go#L584:1-591:1, it should only get the iterators for that (sub)query and not all the others. Ok yeah.

For now we just need to adjust the proto, so this is possible in the future.

:+1:


gradle: Decouple from JDK 8 and support Java Toolchains

This sets a default Java installation per Gradle version, and allows to specify Java Toolchains.

Gradle Version
Attribute
Default Java Version
defaultJava

7.3
gradle_7
17
jdk8

6.9.1
gradle_6
11
jdk11

5.6.4
gradle_5
11
jdk11

4.10.3
gradle_4
8
jdk8

(see also Gradle's Compatibility Matrix)
E.g. with gradle_7.override { javaToolchains = [ jdk8 jdk11 ]; } I get
$ gradle -q javaToolchains

 + Options
     | Auto-detection:     Enabled
     | Auto-download:      Enabled

 + N/A JDK 17.0.1+12-nixos
     | Location:           /nix/store/1vi5p9gliab13jc3v56kz7z78x5bq0da-openjdk-17.0.1+12/lib/openjdk
     | Language Version:   17
     | Vendor:             N/A
     | Is JDK:             true
     | Detected by:        Current JVM

 + OpenJDK 1.8.0_272-b10
     | Location:           /nix/store/4f0d8c9lmj174hz3qvn1qhc70n22bai4-openjdk-8u272-b10
     | Language Version:   8
     | Vendor:             Oracle
     | Is JDK:             true
     | Detected by:        environment variable 'JAVA_TOOLCHAIN_NIX_0'

 + OpenJDK 11.0.12+0-adhoc..source
     | Location:           /nix/store/7r5b2r4kjsbflgxs8sy7i86c1wy773is-openjdk-11.0.12+7
     | Language Version:   11
     | Vendor:             Oracle
     | Is JDK:             true
     | Detected by:        environment variable 'JAVA_TOOLCHAIN_NIX_1'

Hey, @SuperSandro2000 I hope you don't mind me pinging you after ~2weeks. I'd still like to get this PR merged and would appreciate your advice on how we can get it done 🚀 😃 Any other changes to make?

Hey, @SuperSandro2000 I hope you don't mind me pinging you after ~2weeks.

You can ping me if you have a question but it can take me a few days to answer if you are unlucky.

I'd still like to get this PR merged and would appreciate your advice on how we can get it done 🚀 😃 Any other changes to make?

ofborg is red because something does not eval correct. I don't really know why from ofborgs log. Maybe nix-env -f . -qaP --show-trace gives something more useful?

ofborg is red because something does not eval correct. I don't really know why from ofborgs log. Maybe nix-env -f . -qaP --show-trace gives something more useful?

Yes, that helped. I decided to ditch minor versions (gradle_x_y is gone in favour of gradle_x) and expect it to eval now.

expect it to eval now.

ofborg has a different opinion on that. I am not sure why it fails now but I assume the variable is not a derivation but I can't really help your with that.

/marvin opt-in
/status needs_reviewer

After the release of Gradle 7.3 (#145365) and some clean up (#145460) I'd like to give this another try. I took inspiration from GraalVM Community Edition, but can't get this to work. Would be very happy if someone could help me.

This now sets a defaultJava per Gradle version, and allows to specify Java Toolchains.

Pinging @tadfisher to review with respect to gradle2nix compatibility. I tried to keep everything compatible:

gradleGen will default to defaultJava = jdk8 if it's not given.
gradleGen is still exposed (even though I originally wanted to remove it).

It looks like all concerns have been addressed. If any remain they can be fixed in post.

This PR completely broke the gradleGen interface, breaking gradle2nix https://github.com/tadfisher/gradle2nix/issues/53

@Profpatsch yes. I did not understand that this PR would break gradle2nix. My apologies. I tried to reach @tadfisher, as evidenced in https://github.com/NixOS/nixpkgs/pull/119444#issuecomment-974282158 but never received a response. Overall I think that this PR still provided some convenient features. Thanks to @Mic92 for cleaning up.

@lorenzleutgeb What's the proper way to use gradleGen with jdk overrides in the new interface? I.e. what would be the new solution for something like this:
{ jdk }:
{
  packageOverrides = p: {
    gradle = (p.gradleGen.override {
      java = p.${jdk};
    }).gradle_latest;
  };
}

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/auto-detecting-java-installations/4677/9


Analyze a developer methodology to work with SQL queries

https://github.com/jabrena/spring-boot-relational-database-poc/pull/69


Add sample service instance create to go broker

Other misc changes
Signed-off-by: Doug Davis<EMAIL_ADDRESS>

LGTM


Azurite Update Azure Storage SDK to Track 2

Update Azurite to track2.
Update Azurite unit tests to track2

Thank you for doing this work.
Please rebase azurite:master into your branch and target the PR towards Azurite:master, not jongio/azurite.  That will speed things up.

Already merged into Azurite. Closing


RAM issue

Current error:
RuntimeError: CUDA out of memory. Tried to allocate 384.00 MiB (GPU 0; 6.00 GiB total capacity; 4.29 GiB already allocated; 299.14 MiB free; 52.89 MiB cached)
I have the following PC specs -
Operating System: Windows 10
Processor: Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz 2.80 GHz
Graphics card: Geforce GTX 1060 with 6GB's of V-RAM
System RAM: 32GB
My issue is I can't even start training with my GPU due to always getting "out of RAM errors" even when I have enough allocated. I'm able to train just fine with my CPU, but I would really like to use my GPU.
My questions:

Can I train a model using this A.I. with my current set-up?
If not, what is the minimum GPU & V-RAM requirement to train with a dataset of at least 75-150 pairs?

Thank you so much in advance!

I fixed it!
I reduced the batch size from 4 to 2. This was just enough to get going! For anyone facing the same issue, append the training command with the following -
python train.py -i dataset/instrumentals -m dataset/mixtures -M 0.5 -g 0 -b 2 -B 2


Introduce roave/backward-compatibility-check

Q
A

Documentation
yes

New Feature
yes

Description

This adds roave-backward-compatibility-check to the globally available tools.
By moving setup/staabm-annotate-pull-request-from-checkstyle into the roots composer.json, we allow renovate to automatically bump composer dependencies.
By adding another GHA, we do also verify that the tools we are installing are actually executable (i.e. due to the aggressive PHP version requirements of roave packages).

Ready for review.


Child elements of  are not nested properly when config is saved

From @comschmid in #168:

When I was looking at the generated XML above, I realized that some of the child-elements of <httpClientFactory> appear after this element, like <connectionTimeout>

This has been fixed in the latest snapshot release.  Please test it.

Thanks, works as intended!


Change the starting directory in terminal to $NOTEBOOK_ROOT

Current starting directory in Jupyter terminal is ondemand working directory. I think it would confuse PI or students who use terminal because it is hard for them to find the notebook working directory $NOTEBOOK_ROOT. Can we change the jupyter command  kick-off directory to $NOTEBOOK_ROOT?

Can we change the jupyter command kick-off directory to $NOTEBOOK_ROOT?

Sure. I think just a cd may work too. But yea, I think that makes sense for the terminal to start where the UI starts.

This has been released to production. Thanks for the ticket!


Gateway mode added with storage options s3 and azure.

Gateway mode implemented without caching.

Thank you for the contribution @Barteus can you tell us a bit more on how you have tested this? What storage options besides azure did you try?
Also if you could provide us some documentation to test it ourselves that would be great!
@ca-scribner and @knkski  please take a look at this PR.

I have checked for azure and s3 storage options.
Scenarios checked (both azure and s3 if applicable):

run default in server mode
green path, proper credentials
bad mode - message error in juju status
bad storage mode - container failure in juju status, log in container shows why
bad credentials - container failure in juju status, log in container shows why

I tested this with S3 and it worked for me as well.  Actually it worked easier than I expected and I wasn't sure how/where the access/secret keys were used.  @Barteus do you understand how exactly this works?  I read through the docs a bit and wasn't certain.  Am I right that we must:

provide access-key/secret-key that is allowed to access the S3 storage of interest
provide the above creds to the charm, which then starts minio with those credentials
provide those same creds to anyone connecting to the minio API (eg through mc or through a charm interfacing with this charm via a relation) so they can connect to the minio api with them (I guess minio uses those creds as it's auth as well as uses them to auth with S3?)

We should probably add some documentation in the readme that describes how to deploy and interface with these.  We could also add integration tests that connect to a real S3 store somewhere (and could even have a client connect through minio to that store), but that might be overkill

I fully agree with the first two points.
About providing users access to Minio buckets and console (currently on random port each time). You can share your S3 AWS creds, but for security reasons, it is not advisable. There is another alternative - you can create a user in console and give them proper accesses (ie read-only or read-write or admin). Users will use their "Minio User" access key and secret.

Re creds yeah that seemed odd.  So am I right that you're saying instead of using the aws creds both as the login to minio and minio's login to aws, we can:

give minio the aws creds (like done in the current examples) so minio can access S3
create creds in minio that are used by users (/other charms) to log into minio (which then lets them see the S3 storage from point (1))

I have added a new feature request (issue) for user management actions - https://github.com/canonical/minio-operator/issues/28

I added two tiny requests but otherwise it looks great and I'm good to merge it either way


How to test DSL vars?

This library is great and really useful for testing Jenkins Pipelines. I'm using it to test our shared library for Jenkins and having some success. I'm setting up the tests with this:
  @Rule
  public TemporaryFolder scriptsFolder = new TemporaryFolder()

  @Before
  void setup() {
    setUp()
    FileUtils.copyDirectory(new File('.'), scriptsFolder.newFolder('sharedlib@master'))
    def library = library()
            .name('sharedlib')
            .retriever(localSource(scriptsFolder.root.absolutePath))
            .targetPath(scriptsFolder.root.absolutePath)
            .defaultVersion("master")
            .allowOverride(true)
            .implicit(false)
            .build()
    helper.registerSharedLibrary(library)
  }

When testing a simple var, this works fine:
// vars/gitCommit.groovy
import com.sharedlib.Scm

String call() {
  env.GIT_COMMIT ?: Scm.current().commit()
}

  def SHA = '96cd94a34dda6ce6a1ad51eeb4ea68769be45c00'

  @Test
  void testFindsInEnvironmentVariable() throws Exception {
    binding.setVariable('env', ['GIT_COMMIT' : SHA])
    loadScript("src/main/jenkins/pythonProject.jenkins")
    assertTrue(helper.callStack.findAll { call ->
        call.methodName == "sh"
    }.any { call ->
        callArgsToString(call).contains("echo $SHA")
    })
  }

However, if I try to bind a method to var that uses a DSL method, I can't seem to get it to locate the variable:
// vars/testPython.groovy
def call(body) {
  def config = [:]
  body.resolveStrategy = Closure.DELEGATE_FIRST
  body.delegate = config
  body()

  def sources = config.sources
  node {
    sh "nosetests --someflags ${sources}"
  }
}

  @Test
  void testPythonBlock() throws Exception {
    helper.registerAllowedMethod("node", [Map, Closure], null)
    loadScript("src/main/jenkins/pythonProject.jenkins")
  }

groovy.lang.MissingMethodException: No signature of method: testPython.node() is applicable for argument types: (testPython$_call_closure1) values: [testPython$_call_closure1@27adc16e]
Possible solutions: use([Ljava.lang.Object;), notify(), wait(), run(), run(), dump()
	at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:58)
	at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:81)
	at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52)
	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154)
	at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:166)
	at testPython.call(testPython.groovy:22)

How can I bind these methods to vars?
Thanks.

Hi @ewhauser,
It is pretty strange. There is a test in the project which applies exactly your use case. You can see them here :
Test class :
https://github.com/lesfurets/JenkinsPipelineUnit/blob/master/src/test/groovy/com/lesfurets/jenkins/TestSharedLibrary.groovy
Test shared lib var :
https://github.com/lesfurets/JenkinsPipelineUnit/blob/master/src/test/resources/libs/commons%40feature/vars/helloMessage.groovy
Test script :
https://github.com/lesfurets/JenkinsPipelineUnit/blob/master/src/test/jenkins/job/library/libraryJob_feature.jenkins
Could you give more context on how you use the var in pythonProject.jenkins ?

@ozangunalp: Thanks for looking at this. I eventually figured it out (and yes it was strange).
In my build.gradle file, I was putting my vars on the classpath so IntelliJ would load it as a source folder.
sourceSets {
    main {
        java {
            srcDirs = ['src/mainjava', 'vars/']
        }
    }
}

For whatever reason, that was causing the issue with the classloading.

I ran into the same problem but like @BernalCarlos I think that the problem is not resolved because of the broken autocompletion in IntelliJ when vars is not part of the main source set.


Update shell.nix

This is just slightly more idiomatic.

I also added openssl and pkg-config as build inputs because the build failed without them for me.

Thanks! 🙏


Doesn't work with Applied Energistics 2 v8.4.0

Hello,
I just add your mod in my modpack, and first start with your mod installed, the crash directly with error during the load_registries event phase;
image
Here's the crash log: https://gist.github.com/Fireztonez/75fe5ba5ed71d30ec83970b90952f35a
After that, question to see if this is caused by the last update of AE2, I have downgrade AE2 to the last release version before the current one (v.8.3.1), and the game start correctly. So in conclusion, the last AE2 update broke your mod.
Minecraft: 1.16.5
Forge: 36.1.32
AE2 Wireless Terminal: v. 0.2-1
Aapplied Energistics: v. 8.4.0
Fireztonez

Sorry, I just saw this is a duplicate from older post;
https://github.com/Tfarcenim/AE2WirelessTerminalLibrary/issues/12
So I think this issue can be closed.


Fail to get the pinned bpf map

A map name is defined as being longer than BPF_OBJ_NAME_LEN. If a userspace program load bpf object file for the scond time, it will fail to get the bpf map by the map actual name.
I have wrote some code to test this situcation.
Link: https://github.com/leiqi96/libbpf-fix/tree/go
This is related to libbpf. I have submitted patch to libbpf.
Link: https://git.kernel.org/bpf/bpf-next/c/bf3f00378524
Maybe libbpfgo can use the latest libbpf or  limit the length of the  bpf_map name

Maybe libbpfgo can use the latest libbpf or limit the length of the bpf_map name

@grantseltzer we're already using libbpf with the mentioned changes.
I tested this with current libbpfgo:
	pinnedMap1, err := bpfModule.GetMap("process_pinned_map_1")
	if err != nil {
		fmt.Fprintln(os.Stderr, err)
		os.Exit(-1)
	} else {
		fmt.Printf("success:get bpf name name %s %d\n", pinnedMap1.Name(), pinnedMap1.FileDescriptor())
	}

	pinnedMap2, err := bpfModule.GetMap("process_pinned_map_2")
	if err != nil {
		fmt.Fprintln(os.Stderr, err)
		os.Exit(-1)
	} else {
		fmt.Printf("success:get bpf name name %s %d\n", pinnedMap2.Name(), pinnedMap2.FileDescriptor())
	}

struct {
	__uint(type, BPF_MAP_TYPE_HASH);
...
} process_pinned_map_1 SEC(".maps");

struct {
	__uint(type, BPF_MAP_TYPE_ARRAY);
...
} process_pinned_map_2 SEC(".maps");

$ sudo bpftool map
5: hash  name process_pinned_  flags 0x0
        key 4B  value 4B  max_entries 1024  memlock 8192B
        btf_id 364
6: array  name process_pinned_  flags 0x0
        key 4B  value 4B  max_entries 1024  memlock 8192B
        btf_id 364

And got:
success:get bpf name name process_pinned_map_1 5
success:get bpf name name process_pinned_map_2 6

So, if you don't think otherwise (like limiting the name to BPF_OBJ_NAME_LEN), I bet this is no longer an issue.

@leiqi96 Thanks for reporting this, and for making the change upstream! Sorry it took so long for us comment, I was on vacation when you reported it.
@geyslan Thanks for checking this out, seems like we're in the clear. Closing!


Pytorch lightning import side effect changes default multiprocessing CPU affinity

Bug description
I encountered an issue where adding pytorch lightning to a script caused a dramatic slowdown in some parallelized preprocessing steps. (These steps are being parallelized directly, not using a DataLoader).
It appears that a side effect of the pytorch lightning import is to change the CPU affinity of processes spawned by multiprocessing, so that only 2 cores are being used despite 8 being available.
Any ideas what is causing this or how it can be avoided?
What version are you seeing the problem on?
2.0+
How to reproduce the bug
import pytorch_lightning  # <--- Comment or uncomment to test

import os
import multiprocessing

pool = multiprocessing.Pool(8)
pool.map(os.sched_getaffinity, [0] * 8)

Error messages and logs
No errors are produced but the test case has different results:
With lightning:
[{0, 4}, {0, 4}, {0, 4}, {0, 4}, {0, 4}, {0, 4}, {0, 4}, {0, 4}]

Without lightning:
[{0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7},
 {0, 1, 2, 3, 4, 5, 6, 7}]

Environment

Current environment
- Lightning Component (e.g. Trainer, LightningModule, LightningApp, LightningWork, LightningFlow): N/A
- PyTorch Lightning Version (e.g., 1.5.0): 2.0.0
- Lightning App Version (e.g., 0.5.2): N/A
- PyTorch Version (e.g., 2.0): 1.13.1
- Python version (e.g., 3.9): 3.9
- OS (e.g., Linux): Linux
- How you installed Lightning(`conda`, `pip`, source): conda

More info
No response
cc @tchaton

@mwaskom I couldn't use your code, could you paste the full code that produces these outputs?
Also, could you replace the pytorch lightning import with just import torch and rerun your test?

That is the full code. What is the issue you had? The os module on a Mac doesn’t have sched_getaffinity so you’ll need to run on a Linux system to replicate; sorry coulda made that more clear.

Also, could you replace the pytorch lightning import with just import torch and rerun your test?

Ah good, thinking — could have sworn I tested this yesterday but apparently not! It the default affinity is also changed by importing only torch so this looks unrelated to pytorch_lightning. Sorry for the noise!
(Would be very interested if anyone has a suggestion about something I could set to suppress this behavior anyway, though).

Thanks, I ran it on the linux machine and was able to print the output.
If you open an issue on the pytorch side, could you link it? I would like to follow it.


Debug Actions Menu out of window boundaries

VSCode Version: 1.9.1
OS Version: Windows 10

Steps to Reproduce:

Start Debugging session.
Drag Debug Actions Menu more than maximum size of window to the left.
You cannot Drag and Drop it again, bacause Drag area is not vissible.

As you can see from the screenshots, when I resize the VSCode window, the Debug Actions Menu is appearing but yet, I cannot see Drag button :)
On fullscreen the menu is completely invisible.

Sorry about this issue, it is fixed in vscode insiders. You can switch to vscode-insiders and everything should work fine.
In case you do not want to do that, here are steps to get out of this bad state

Open developer tools
Application > Local Storage > File //
Find key storage/workspace/WORKSPACE_PATH/debug.actionswidgetposition
Delete that key
Here's an example in my workspace

Thank you,
The solution worked perfectly :)

How do you get to dev tools for VSCode?


Added Backdoor on port 8000 in nginx proxy

Fixes #109

For Local Development, you can alter the .env file
CONFIGURATION_LOCATION=/nginx-backdoor.conf
BACKDOOR_PORT=8000

This opens a proxy on localhost/next to port 8000.
You can run CoMPAS OpenSCD (next) via npm and it will be served under localhost/next.

closes #109


docker_images: diffusers, do not start if pipeline fails to load

closing pr: seen with @Narsil if we do so, the deployment will crashloop and the model will be loading indefinetely on widget side. Thus, people won't have the chance to get the failure trace for troubleshooting. I need to think about some other solution


Update batch-loader docs dead-link

Not sure if there used to be a batch-loader guide previously, but it's a dead link now
Change the "read more" link to point to the repo

Resolves #648 if merged

Thanks @skinofstars for the PR! We updated this in https://github.com/feathersjs-ecosystem/feathers-hooks-common/commit/5898a5620faeff36945e57291cf3890c7010cec8 which is part of a major typescript rewrite


Add example of captive portal setup

This might help. Limitations, notes and instructions, see PiCockpit tutorial.
from phew import logging, server, access_point, dns
from phew.template import render_template
from phew.server import redirect

DOMAIN = "pico.wireless"  # This is the address that is shown on the Captive Portal

@server.route("/", methods=['GET'])
def index(request):
    """ Render the Index page"""
    if request.method == 'GET':
        logging.debug("Get request")
        return render_template("index.html")

# microsoft windows redirects
@server.route("/ncsi.txt", methods=["GET"])
def hotspot(request):
    print(request)
    print("ncsi.txt")
    return "", 200

@server.route("/connecttest.txt", methods=["GET"])
def hotspot(request):
    print(request)
    print("connecttest.txt")
    return "", 200

@server.route("/redirect", methods=["GET"])
def hotspot(request):
    print(request)
    print("****************ms redir*********************")
    return redirect(f"http://{DOMAIN}/", 302)

# android redirects
@server.route("/generate_204", methods=["GET"])
def hotspot(request):
    print(request)
    print("******generate_204********")
    return redirect(f"http://{DOMAIN}/", 302)

# apple redir
@server.route("/hotspot-detect.html", methods=["GET"])
def hotspot(request):
    print(request)
    """ Redirect to the Index Page """
    return render_template("index.html")

@server.catchall()
def catch_all(request):
    print("***************CATCHALL***********************\n" + str(request))
    return redirect("http://" + DOMAIN + "/")

# Set to Accesspoint mode
# Change this to whatever Wifi SSID you wish
ap = access_point("Pico W Captive")
ip = ap.ifconfig()[0]
# Grab the IP address and store it
logging.info(f"starting DNS server on {ip}")
# # Catch all requests and reroute them
dns.run_catchall(ip)
server.run()                            # Run the server
logging.info("Webserver Started")

Forked from https://github.com/kevinmcaleer/cyberdog

Not sure if it's helpful but I made an example that exposes an captive AP then asks the user to supply their wifi credentials and saves those, then reboots and connects to their wifi, returning to the captive AP if the connection couldn't be made (e.g. because the SSID supplied can't be seen or the password supplied was incorrect) https://github.com/simonprickett/phewap

This might help. Limitations, notes and instructions, see PiCockpit tutorial.
from phew import logging, server, access_point, dns
from phew.template import render_template
from phew.server import redirect

DOMAIN = "pico.wireless"  # This is the address that is shown on the Captive Portal

@server.route("/", methods=['GET'])
def index(request):
    """ Render the Index page"""
    if request.method == 'GET':
        logging.debug("Get request")
        return render_template("index.html")

# microsoft windows redirects
@server.route("/ncsi.txt", methods=["GET"])
def hotspot(request):
    print(request)
    print("ncsi.txt")
    return "", 200

@server.route("/connecttest.txt", methods=["GET"])
def hotspot(request):
    print(request)
    print("connecttest.txt")
    return "", 200

@server.route("/redirect", methods=["GET"])
def hotspot(request):
    print(request)
    print("****************ms redir*********************")
    return redirect(f"http://{DOMAIN}/", 302)

# android redirects
@server.route("/generate_204", methods=["GET"])
def hotspot(request):
    print(request)
    print("******generate_204********")
    return redirect(f"http://{DOMAIN}/", 302)

# apple redir
@server.route("/hotspot-detect.html", methods=["GET"])
def hotspot(request):
    print(request)
    """ Redirect to the Index Page """
    return render_template("index.html")

@server.catchall()
def catch_all(request):
    print("***************CATCHALL***********************\n" + str(request))
    return redirect("http://" + DOMAIN + "/")

# Set to Accesspoint mode
# Change this to whatever Wifi SSID you wish
ap = access_point("Pico W Captive")
ip = ap.ifconfig()[0]
# Grab the IP address and store it
logging.info(f"starting DNS server on {ip}")
# # Catch all requests and reroute them
dns.run_catchall(ip)
server.run()                            # Run the server
logging.info("Webserver Started")

Forked from https://github.com/kevinmcaleer/cyberdog

I'm having an odd issue with that. My old Nexus 7 (android 4) can connect to that AP, and even gets sent the "sign in to wifi" to direct me to the right page, no errors.. However when I try to connect using my Samsung phone (android 6), I get an error, and no notification or popup. (I can manually access the pages tho.)
Soon as my phone connects, I get this error on my Pico:
Task exception wasn't retrieved
future: <Task> coro= <generator object '_handle_request' at 2001a420>
Traceback (most recent call last):
  File "uasyncio/core.py", line 1, in run_until_complete
  File "phew/server.py", line 242, in _handle_request
  File "phew/server.py", line 161, in _parse_headers
ValueError: need more than 1 values to unpack

Anyone know how I can get it working with the Android 6 devices?

Android 6 might be pinging for a response from an endpoint that isn't set up to respond. My code is meant for newer devices.
According to this page, Android 6 would be seeking a response from connectivitycheck.gstatic.com

Android 6 might be pinging for a response from an endpoint that isn't set up to respond. My code is meant for newer devices.
According to this page, Android 6 would be seeking a response from connectivitycheck.gstatic.com

Thanks for the link, tho for some reason, even if I add a check for that address, our weird old phones still cause that error. Works great on pretty much everything else I've tested, so no worries.


Add 'systemd-tmpfiles-create'

Looks good. If you're going to provide the tmpfiles exec though, I wouldn't mind a defined type to wrap around Augeas modifications, and even shipping the lens (since it's currently unreleased). Maybe an Augeas provider could be a good idea here.

You mean that we could ship a custom type with this module?

We sure could. We do that in our openldap and varnish modules for example.


Policy Enforcement Service support

Envoy as an east-west service-to-service proxy is the perfect place to enforce Microsegmentation policies. With an externalized policy service Envoy can support using an API to can policy enforcement service to find out if Service A is allowed to talk to Service B.

just curious, how is this difference from mixer check call ?

I think the question is, is Mixer API going to be standardized as part of Envoy API? I don't think we should tie the two together, but implementing a custom policy enforcement engine using Mixer filter/Mixer API might be a good option to reuse Istio infrastructure.

It seems this is beyond the scope of what we want to do in v2. The scope is described at https://github.com/lyft/envoy-api#goals. v2 is largely about moving most of the existing runtime config to dynamic JSON/gRPC APIs and some specific improvements around load balancing and health checking. My inclination is to regard this as an Istio feature today and leave any consideration of convergence for the future.

@kyessenov @louiscryan I would like to discuss whether we want to move mixer API/filter into Envoy repo. I agree it's a separate discussion, but I an see many reasons to do this.

Generally agreed though I think we need some time for the APIs to settle down here

Generally agreed though I think we need some time for the APIs to settle down here

Yup sounds good.

I'm going to close this out as it seems we have consensus and there is no immediate implication for the v2 APIs.


Skip caching of problem glyphs

Glyphs of size 0 fail to create a character surface when pre-rendering characters to a bitmap image cache. We don't actually care about the reason why the pre-rendering fails. We just want to skip over glyphs that can be printed. Effectively we will print an empty glyph in their place, which will likely also have a size of 0.
This is an alternate solution to PR #1021.

I like this solution a lot better.


Revert "include glfw as a submodule, update to 3.3.9"

Reverts PistonDevelopers/glfw-sys#28
I am having problems compiling this on OSX.

Closing.


Improve clustering of Energy Systems

@lappemic I had to fix some issues with the clustering of power systems as the last PR I merged into the main failed.The linter did not pass.Please have a quick look so we can merge it and get the website + ClimateTriage.com working again.Let's make more improvements to the clustering with more pull requests.
The current clustering is based on what you did + some deep dive analysis I did until this morning.

I think you merged restructuring-biosphere branch into `restructuring-energy-systems', right? After this there were some merge conflicts.
I just realized after you merged that i forgot to update the content section... Part of the conflicts could be from this...
The existing ones are most probably from the newly added projects...
I agree, we should do more PR's per reclustering. And also merge only in main probably.

Is it fixed with this? Or do we still have to update something?


[release] add change log, update dependabot interval

Update roadmap, link features with issue URL.


Creating API Management service

Hi
I think the create new service should be changed. It's no longer in the list. Might be best to have a screenshot to search for API management then create new service
Thanks
E

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 158c5972-c090-6469-7bb3-499419f821d3
Version Independent ID: 25e946d3-5c67-ce68-e33a-af8db2d540fd
Content: Create an Azure API Management instance
Content Source: articles/api-management/get-started-create-service-instance.md
Service: api-management
GitHub Login: @vladvino
Microsoft Alias: apimpm

Enterprise Integration category was accidentally dropped from Azure portal and should be coming back soon. Good catch though, thanks!


feat(customPatches): support kustomize 'images' directive

This patch adds support for using kustomize's image directive, allowing to patch images globally to all the distribution manifests.
could be useful when using private registries instead of SIGHUP's one, for example.
Example:
...
.spec:
  distribution:
    customPatches:
      images:
        - name: registry.sighup.io/fury/prometheus-operator/prometheus-operator
          newName: quay.io/prometheus-operator/prometheus-operator
          newTag: latest
...

Rebased to main and regenerated schemas


Log out function in secure route does not clear token

When logged in to the user secured route, the log out button is missing the clear token functionality.

This bug was introduced through testing, now that routes are established this issue has been resolved.


market creation depth chart / order not visible

@Chwy5  we need to fix this for v1.13

approved

better-closing


FireFly Support

Please add FireFly-Setup

Firefly is only subscription based now. No way to crack it anymore


Feature/ud pmarkers

Have a look at this.  The only thing I am unsure about is my strategy of sharing the SDFileOpen with the board object.

Check this out


Unable to connect to NFS VM: "Connection timed out"

Similar to #3, JupyterHub is unable to connect to the NFS instance. I have followed the instructions to the letter.
Setup
Deployment Name:	jupyterhub-filer
Zone:	us-east1-d
Machine type:	n1-standard-1
Storage Name:	data
Enable SMB Sharing:	Uncheck the checkbox
Storage disk size:	10 GB
IP address used: Internal IP address
Logs
Events:
  FirstSeen	LastSeen	Count	From							SubObjectPath	Type		Reason		Message
  ---------	--------	-----	----							-------------	--------	------		-------
  18m		18m		1	default-scheduler							Normal		Scheduled	Successfully assigned jupyterhub-4173372450-tw4qk to gke-jupytercluster1-default-pool-06f143fe-6rlr
  14m		1m		4	kubelet, gke-jupytercluster1-default-pool-06f143fe-6rlr			Warning		FailedMount	MountVolume.SetUp failed for volume "kubernetes.io/nfs/0d639173-93a2-11e7-9f94-42010a8e0ff3-nfs" (spec.Name: "nfs") pod "0d639173-93a2-11e7-9f94-42010a8e0ff3" (UID: "0d639173-93a2-11e7-9f94-42010a8e0ff3") with: mount failed: exit status 1
Mounting command: /home/kubernetes/containerized_mounter/mounter
Mounting arguments: <IP_ADDRESS>:/data /var/lib/kubelet/pods/0d639173-93a2-11e7-9f94-42010a8e0ff3/volumes/kubernetes.io~nfs/nfs nfs []
Output: Mount failed: Mount failed: exit status 32
Mounting command: chroot
Mounting arguments: [/home/kubernetes/containerized_mounter/rootfs mount -t nfs <IP_ADDRESS>:/data /var/lib/kubelet/pods/0d639173-93a2-11e7-9f94-42010a8e0ff3/volumes/kubernetes.io~nfs/nfs]
Output: mount.nfs: Connection timed out

  16m	50s	8	kubelet, gke-jupytercluster1-default-pool-06f143fe-6rlr		Warning	FailedMount	Unable to mount volumes for pod "jupyterhub-4173372450-tw4qk_jupyterhub(0d639173-93a2-11e7-9f94-42010a8e0ff3)": timeout expired waiting for volumes to attach/mount for pod "jupyterhub"/"jupyterhub-4173372450-tw4qk". list of unattached/unmounted volumes=[nfs]
  16m	50s	8	kubelet, gke-jupytercluster1-default-pool-06f143fe-6rlr		Warning	FailedSync	Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "jupyterhub"/"jupyterhub-4173372450-tw4qk". list of unattached/unmounted volumes=[nfs]

Debugging
Ping works:
# kubectl run docker -it --image=ubuntu bash
# apt-get update ; apt-get install -y iputils-ping
# ping <IP_ADDRESS>
PING <IP_ADDRESS> (<IP_ADDRESS>) 56(84) bytes of data.
64 bytes from <IP_ADDRESS>: icmp_seq=1 ttl=63 time=1.15 ms
64 bytes from <IP_ADDRESS>: icmp_seq=2 ttl=63 time=0.235 ms
64 bytes from <IP_ADDRESS>: icmp_seq=3 ttl=63 time=0.315 ms
...

If you ssh into the Filer server you should be able to use: sudo showmount -e localhost
and see the following, if that isn't what you see then the filer was not started correctly.
Export list for localhost:
/data <IP_ADDRESS>,<IP_ADDRESS>/8

I ran through the setup again and verified that the single filer vm is working correctly and the solution deployed. There were changes that needed to be made to address load-balancer health-checks, but that would be unrelated to this issue.


AirCash

It is on developing.
AirCash system will be online within 3 months.

I received a notification email from you and I reply

Hey, what is this project all about. Can we get some guidelines to start coding

The AIR project started from a meme coin.
It was issued to mock the madness of the cryptocurrency market.
$ * The first product is called AirPool, a pool system for DeFi mining.
$** The second product is called AirSwap, a decentralized exchange system.
$***" The third  product is called AirCash, a cash system for AIR.
Although AIR is only a BSC token now, it will be one of the biggest ecosystems in the crypto world.
On Wednesday, July 21, 2021, 04:30:42 PM GMT+3, Stonks3232<EMAIL_ADDRESS>wrote:

Hey, what is this project all about. Can we get some guidelines to start coding
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.


Support trailing slash in URL paths

Fixes #4291
Nearly all language-specific writers support parameterized paths that have a trailing slash. The TypeScript writer does correctly write the request builder files but because it writes to index.ts rather than to a filename based on the request builder like the other writers, there is a conflict when a code namespace has more than one code file.
When the spec has paths like /{foo} and /{foo}/, kiota writes the first request builder correctly then overwrites it with the second request builder.
The first commit addresses this in the TypeScript refiner by detecting when the code namespace has more than one code file and merging them all into one.
However, this creates a new problem because the request metadata generator only selects the first UriTemplate. With the code files merged, there are multiple UriTemplate elements so one of the request metadata constants would have the wrong UriTemplate.
The second commit addresses this by taking advantage of how the UriTemplate property is unused in a CodeConstantKind.RequestsMetadata code constant and sets it to match the expected name of the correct UriTemplate. The request metadata generator can then use this now-populated property to find the correct UriTemplate.
Unfortunately, this creates a hidden coupling with how UriTemplates are named but it appears to be unavoidable.
Like the first issue, non-parameterized paths that have a trailing slash also result in conflicts. However, the conflict is earlier in the process so it affects all languages.
When the spec has paths like /foo and /foo/, kiota resolves both nodes (segments foo and foo\\ respectively) to the same name which causes a lot of problems later, resulting in broken generated code.
The third commit addresses this by changing how slashes are cleaned up so that the foo segment still results in foo but the foo\\ segment results in fooSlash. This also changes the naming of code elements like foo\\RequestBuilder from fooRequestBuilder to fooSlashRequestBuilder.
I'm not completely happy with this third commit because the trailing slash will now leak into the code element names and files. However, with my shallow understanding of the project, I'm not seeing a better way without messier changes.

Thanks for the feedback!

if we have both /foo/bar/ and /foo/{id} what happens? what about /foo/ and /foo?

For a minimal spec containing /foo/bar/ and /foo/{id}, the main[^1] branch of kiota generates the following because bar/ and {id} are not collapsed:
├── apiSdk.ts           # main entry point contains `get foo()`
├── foo
│   ├── bar
│   │   └── index.ts    # UriTemplate is "{+baseurl}/foo/bar/"
│   ├── item
│   │   └── index.ts    # UriTemplate is "{+baseurl}/foo/{id}"
│   └── index.ts        # UriTemplate is "{+baseurl}/foo"
│                       # RequestBuilder contains `byId(id: string)` and `get bar()` and the standard
│                       # NavigationMetadata contains `byId` and `bar`
├── kiota-lock.json
└── models
    └── index.ts

For a minimal spec containing /foo/ and /foo, the main[^1] branch of kiota generates
├── apiSdk.ts       # main entry point contains `get foo()`
├── foo
│   └── index.ts    # only has 1 UriTemplate "{+baseurl}/foo/"
│                   # RequestBuilder contains the usual `get(requestConfiguration)` and `toGetRequestInformation(requestConfiguration)`
│                   # RequestsMetadata contains 2 entries for `get` with the exact same contents
├── kiota-lock.json
└── models
    └── index.ts

/foo/index.ts
export const FooRequestBuilderRequestsMetadata: RequestsMetadata = {
    get: {
        uriTemplate: FooRequestBuilderUriTemplate,
        responseBodyContentType: "text/plain;q=0.9",
        adapterMethodName: "sendPrimitive",
        responseBodyFactory:  "string",
    },
    get: {
        uriTemplate: FooRequestBuilderUriTemplate,
        responseBodyContentType: "text/plain;q=0.9",
        adapterMethodName: "sendPrimitive",
        responseBodyFactory:  "string",
    },
};

Can we start by identifying patterns where the trailing slash in the URI template is problematic?
Any other pattern we should be careful about?

I have started this and it turns out that there are some edge cases I had not considered. I'll post another comment once I have a report for you, likely in the form of a GitHub repo so we can browse and discuss differences and desired state between the generated results.
I've put this PR back into a draft state for now.
[^1]: main specifically being 6c4376e08

Thanks for the detailed answer here! I think this and your next answer will help flesh things out to an improved solution.

@chelkyl gentle nudge on the topic :)

Thanks for the poke! Please see the report here.
Highlights:

Test URI Paths
TypeScript kiota main Results
Python kiota main Results

          File: 6.yaml
          /foo
          /foo/

          🚫
          has only 1 uri template
          has /foo/ but missing /foo
          weirdly, some comments reference /foo/ and others /foo
          RequestsMetadata has duplicate "get" property

          🚫
          almost completely correct
          has /foo/ but missing /foo

          File: 7.yaml
          /foo/
          /foo

          🚫
          almost same as 6
          only difference is comments have reversed which route they refer to

          🚫
          almost completely correct
          has /foo but missing /foo/
          however, help doc references /foo/

          File: 8.yaml
          /foo/
          /foo/bar

          🚫
          missing /foo/

          🚫
          missing /foo/

          File: 9.yaml
          /foo/
          /foo/bar/

          🚫
          same as 8
          missing /foo/

          🚫
          same as 8
          missing /foo/

          File: 14.yaml
          /{path}
          /{path}/

          🚫
          missing /{path}/

          ✅
          /{path} and /{path}/ are handled separately

          File: 15.yaml
          /{path}/
          /{path}

          🚫
          missing /{path}

          ✅
          same as 14

          File: 17.yaml
          /{path}/
          /{path}/{id}

          🚫
          missing /{path}/
          NavigationMetadata uses a RequestsMetadata value that was not imported

          ✅


Contents of 'static' directory not copied to build output

I'm new to Gatsby so I followed the tutorial on gatsbyjs.org to get started, but I noticed that when building this starter template from its default state, the contents of the 'src/static' directory isn't copied to the build output directory (public) as it is described in the documentation.
Steps to replicate:

Run steps 1-3 of the 'Create a Gatsby site' section of the tutorial (https://www.gatsbyjs.org/tutorial/part-zero/#create-a-site).
Run gatsby build to generate the output.
Inspect the contents of the 'public' directory. Notice that the 'favicon.ico' file hasn't been copied from 'src/static'.

It seems the way to resolve this issue is to move the 'src/static' directory into the root of the project before building. When you run gatsby build after doing so, the 'favicon.ico' file is correctly copied into the root of the 'public' output directory.
Steps to resolve:

Run steps 1-3 of the 'Create a Gatsby site' section of the tutorial (https://www.gatsbyjs.org/tutorial/part-zero/#create-a-site)
Move the 'src/static' directory into the root of the project.
Run gatsby build to generate the output.
Inspect the contents of the 'public' directory. Notice that this time the 'favicon.ico' file has been copied from 'src/static'.

Created PR #23
According to the docs, the static folder should be placed directly under the project root.
BTW @krugarmatt if you would like to further customize favicon etc, be sure to check out gatsby-plugin-manifest 😃

Fixed, thanks @hexrcs!


docs: Development / development on docker

Create a Development page with some documentation on how to get started with
development on an Aya project, and the minimum prerequisites to get started. Also
add a sub page with specific instruction for developing on Docker (for Max & Linux)

Thanks for this! Looks like the tests are failing 👀
Also, what did you need the headers for? aya-gen does not require kernel headers at the moment. We do want to add an option to use headers too, see https://github.com/aya-rs/aya/issues/95, but at the moment headers should never be required.

Closing as stale. Happy to look at this again if there is interest in adding this to the book.


"counter" dataset raises an error in normal mode, but not in streaming mode

Describe the bug
counter dataset raises an error on load_dataset(), but simply returns an empty iterator in streaming mode.
Steps to reproduce the bug
>>> from datasets import load_dataset
>>> a = ds.load_dataset('counter', split="train", streaming=False)
Using custom data configuration default
Downloading and preparing dataset counter/default (download: 1.29 MiB, generated: 2.48 MiB, post-processed: Unknown size, total: 3.77 MiB) to /home/slesage/.cache/huggingface/datasets/counter/default/1.0.0/9f84962fa0f35bec5a34fe0bdff8681838d497008c457f7856c48654476ec0e9...
Traceback (most recent call last):
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/datasets/builder.py", line 726, in _download_and_prepare
    self._prepare_split(split_generator, **prepare_split_kwargs)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/datasets/builder.py", line 1124, in _prepare_split
    for key, record in utils.tqdm(
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/tqdm/std.py", line 1185, in __iter__
    for obj in iterable:
  File "/home/slesage/.cache/huggingface/modules/datasets_modules/datasets/counter/9f84962fa0f35bec5a34fe0bdff8681838d497008c457f7856c48654476ec0e9/counter.py", line 161, in _generate_examples
    with derived_file.open(encoding="utf-8") as f:
  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/pathlib.py", line 1222, in open
    return io.open(self, mode, buffering, encoding, errors, newline,
  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/pathlib.py", line 1078, in _opener
    return self._accessor.open(self, flags, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/home/slesage/.cache/huggingface/datasets/downloads/extracted/b57aa6db5601a738e57b95c1fd8cced54ff28fc540efcdaf0f6c4f1bb5dfe211/COUNTER/0032p.xml'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/datasets/load.py", line 1112, in load_dataset
    builder_instance.download_and_prepare(
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/datasets/builder.py", line 636, in download_and_prepare
    self._download_and_prepare(
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/datasets/builder.py", line 728, in _download_and_prepare
    raise OSError(
OSError: Cannot find data file.
Original error:
[Errno 2] No such file or directory: '/home/slesage/.cache/huggingface/datasets/downloads/extracted/b57aa6db5601a738e57b95c1fd8cced54ff28fc540efcdaf0f6c4f1bb5dfe211/COUNTER/0032p.xml'
>>> b = ds.load_dataset('counter', split="train", streaming=True)
Using custom data configuration default
>>> list(b)
[]

Expected results
An exception should be raised in streaming mode
Actual results
No exception is raised in streaming mode: there is no way to tell if something has broken or if the dataset is simply empty.
Environment info

datasets version: 1.11.1.dev0
Platform: Linux-5.11.0-1016-aws-x86_64-with-glibc2.29
Python version: 3.8.11
PyArrow version: 4.0.1

Hi @severo, thanks for reporting.
Just note that currently not all canonical datasets support streaming mode: this is one case!
All datasets that use pathlib joins (using /) instead of os.path.join (as in this dataset) do not support streaming mode yet.

OK. Do you think it's possible to detect this, and raise an exception (maybe NotImplementedError, or a specific StreamingError)

We should definitely support datasets using pathlib in streaming mode...
For non-supported datasets in streaming mode, we have already a request of raising an error/warning: see #2654.

Hi @severo, please note that "counter" dataset will be streamable (at least until it arrives at the missing file, error already in normal mode) once these PRs are merged:

#2874
#2876
#2880

I have tested it. 😉

Now (on master), we get:
import datasets as ds
ds.load_dataset('counter', split="train", streaming=False)

Using custom data configuration default
Downloading and preparing dataset counter/default (download: 1.29 MiB, generated: 2.48 MiB, post-processed: Unknown size, total: 3.77 MiB) to /home/slesage/.cache/huggingface/datasets/counter/default/1.0.0/9f84962fa0f35bec5a34fe0bdff8681838d497008c457f7856c48654476ec0e9...
Traceback (most recent call last):
  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 726, in _download_and_prepare
    self._prepare_split(split_generator, **prepare_split_kwargs)
  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 1124, in _prepare_split
    for key, record in utils.tqdm(
  File "/home/slesage/hf/datasets/.venv/lib/python3.8/site-packages/tqdm/std.py", line 1185, in __iter__
    for obj in iterable:
  File "/home/slesage/.cache/huggingface/modules/datasets_modules/datasets/counter/9f84962fa0f35bec5a34fe0bdff8681838d497008c457f7856c48654476ec0e9/counter.py", line 161, in _generate_examples
    with derived_file.open(encoding="utf-8") as f:
  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/pathlib.py", line 1222, in open
    return io.open(self, mode, buffering, encoding, errors, newline,
  File "/home/slesage/.pyenv/versions/3.8.11/lib/python3.8/pathlib.py", line 1078, in _opener
    return self._accessor.open(self, flags, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/home/slesage/.cache/huggingface/datasets/downloads/extracted/b57aa6db5601a738e57b95c1fd8cced54ff28fc540efcdaf0f6c4f1bb5dfe211/COUNTER/0032p.xml'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/slesage/hf/datasets/src/datasets/load.py", line 1112, in load_dataset
    builder_instance.download_and_prepare(
  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 636, in download_and_prepare
    self._download_and_prepare(
  File "/home/slesage/hf/datasets/src/datasets/builder.py", line 728, in _download_and_prepare
    raise OSError(
OSError: Cannot find data file.
Original error:
[Errno 2] No such file or directory: '/home/slesage/.cache/huggingface/datasets/downloads/extracted/b57aa6db5601a738e57b95c1fd8cced54ff28fc540efcdaf0f6c4f1bb5dfe211/COUNTER/0032p.xml'

The error is now the same with or without streaming. I close the issue, thanks @albertvillanova and @lhoestq!

Note that we might want to open an issue to fix the "counter" dataset by itself, but I let it up to you.

Fixed here: https://github.com/huggingface/datasets/pull/2894. Thanks @albertvillanova

Associated to the above exception, if I create a test and run it with pytest, I get an awful traceback.

create a file test_counter.py

import pytest
from datasets import load_dataset, IterableDataset
from typing import Any, cast

def test_counter() -> Any:
    iterable_dataset = cast(IterableDataset, load_dataset("counter", split="train", streaming=True))
    with pytest.raises(TypeError):
        list(iterable_dataset.take(100))

run the test with pytest

$ python -m pytest -x test_counter.py
============================================================================================================================= test session starts ==============================================================================================================================
platform linux -- Python 3.9.6, pytest-6.2.5, py-1.10.0, pluggy-1.0.0
rootdir: /home/slesage/hf/datasets-preview-backend, configfile: pyproject.toml
plugins: anyio-3.3.2, cov-2.12.1
collected 1 item

tests/test_counter.py .                                                                                [100%]Traceback (most recent call last):
  File "/home/slesage/.pyenv/versions/3.9.6/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/slesage/.pyenv/versions/3.9.6/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pytest/__main__.py", line 5, in <module>
    raise SystemExit(pytest.console_main())
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/config/__init__.py", line 185, in console_main
    code = main()
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/config/__init__.py", line 162, in main
    ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_callers.py", line 60, in _multicall
    return outcome.get_result()
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/main.py", line 316, in pytest_cmdline_main
    return wrap_session(config, _main)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/main.py", line 304, in wrap_session
    config.hook.pytest_sessionfinish(
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_hooks.py", line 265, in __call__
    return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_manager.py", line 80, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_callers.py", line 55, in _multicall
    gen.send(outcome)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/terminal.py", line 803, in pytest_sessionfinish
    outcome.get_result()
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_result.py", line 60, in get_result
    raise ex[1].with_traceback(ex[2])
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/pluggy/_callers.py", line 39, in _multicall
    res = hook_impl.function(*args)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/cacheprovider.py", line 428, in pytest_sessionfinish
    config.cache.set("cache/nodeids", sorted(self.cached_nodeids))
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/_pytest/cacheprovider.py", line 188, in set
    f = path.open("w")
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/datasets/utils/streaming_download_manager.py", line 199, in xpathopen
    return xopen(_as_posix(path), *args, **kwargs)
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.9/site-packages/datasets/utils/streaming_download_manager.py", line 117, in _as_posix
    path_as_posix = path.as_posix()
AttributeError: 'str' object has no attribute 'as_posix'

I opened a PR to fix these issues.
Also in your test you expect a TypeError but I don't know why. On my side it works fine without raising a TypeError

I had the issue (TypeError raised) on my branch, but it's fixed now. Thanks


Add GET for Transcriptions instance and list

https://github.com/markandrus/twilio-haskell/issues/14

@conniec Thanks for your pull request! Don't worry that the Travis CI build failed. It uses some sensitive credentials to run the tests so it doesn't run on PRs.
I will need to generate some transcriptions on my account so that I can test.

+1


Light Theme uses wrong horizontal scroll colors

Example:

Affected all light theme.

I am not sure if it's possible to change the scrollbar's color.
Does the scrollbar look different with other themes?

Hello @Vincent-P!
This particular scroll bar looks good in the default (non-light) variant of the gruvbox theme. Other themes somehow customize it too.

I second that, in fact i reported a similar issue in gradianto
https://github.com/thvardhan/Gradianto/issues/21
This was likely fixed on October 13 2020 (https://github.com/thvardhan/Gradianto/commits/master)

I second that, in fact i reported a similar issue in gradianto
https://github.com/thvardhan/Gradianto/issues/21
This was likely fixed on October 13 2020 (https://github.com/thvardhan/Gradianto/commits/master)


Each bind mount should handle its mountpoint

Currently the bind mounts are created by the reset service which runs only once at boot and then based on the existence of a file which nukes the overlays.
This can get us into troubles when updating to a hostOS with a new bind mount which is a file. The reset will not create the mountpoint and the service will assume that target is a directory and create it accordingly breaking the mount service.
What we want is let each and every bind service handle their own destination.

Fixed by https://github.com/resin-os/meta-resin/pull/989


All photos not loading automatically

Some photos only load when I manually refresh the corresponding day. Due to this, I may miss some old photos from the timeline, and of course this is not ideal. Is this expected behaviour or a bug?

Just figured out when this happens. If I go to a person's album and then back to the timeline, all the photos from a day in which the person appeared are hidden except for the photos in which the person appears. I sent the logs by email

Hm. I will try to replicate and fix, thanks :)


Manifest followup tweaks

After #2407 was merged, we ran into some issues around CSS files that reference missing images and other assets. This PR fixes those, and in some cases removes them. There were also a whole swath of files (under 'pb') that are no longer used at all, and thus removed here.
The errors in Jenkins look like:
[deploy@server] out:
[deploy@server] out: Traceback (most recent call last):
[deploy@server] out:   File "manage.py", line 10, in <module>
[deploy@server] out:     execute_from_command_line(sys.argv)
[deploy@server] out:   File "/srv/cfgov/versions/125/venv/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 354, in execute_from_command_line
[deploy@server] out:     utility.execute()
[deploy@server] out:   File "/srv/cfgov/versions/125/venv/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 346, in execute
[deploy@server] out:     self.fetch_command(subcommand).run_from_argv(self.argv)
[deploy@server] out:   File "/srv/cfgov/versions/125/venv/local/lib/python2.7/site-packages/django/core/management/base.py", line 394, in run_from_argv
[deploy@server] out:     self.execute(*args, **cmd_options)
[deploy@server] out:   File "/srv/cfgov/versions/125/venv/local/lib/python2.7/site-packages/django/core/management/base.py", line 445, in execute
[deploy@server] out:     output = self.handle(*args, **options)
[deploy@server] out:   File "/srv/cfgov/versions/125/venv/local/lib/python2.7/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 168, in handle
[deploy@server] out:     collected = self.collect()
[deploy@server] out:   File "/srv/cfgov/versions/125/venv/local/lib/python2.7/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 120, in collect
[deploy@server] out:     raise processed
[deploy@server] out: ValueError: The file 'nemo/_/consumerstories/img/us_flag_small.png' could not be found with <django.contrib.staticfiles.storage.ManifestStaticFilesStorage object at 0x7f1478fb7e90>.
[deploy@server] out:

Basically, css references to assets that don't exist will now break deployments.
Review

@cfpb/cfgov-frontends
@willbarton

Checklist

[ ] Changes are limited to a single goal (no scope creep)
[ ] Code can be automatically merged (no conflicts)
[ ] Code follows the standards laid out in the front end playbook
[ ] Passes all existing automated tests
[ ] New functions include new tests
[ ] New functions are documented (with a description, list of inputs, and expected output)
[ ] Placeholder code is flagged
[ ] Visually tested in supported browsers and devices
[ ] Project documentation has been updated (including the "Unreleased" section of the CHANGELOG)

Basically, css references to assets that don't exist will now break deployments.

This is a benefit I didn't expect!


Allow RequestIdentity object to force a whitelisting of a request.

This is a practical little feature in case you want to whitelist certain types of requests. Like OPTIONS.

Has been deployed on NuGet v<IP_ADDRESS>
Thanks


Too much ash early game

Mod source
PyAE Beta
Which mod are you having an issue with?

[X] pyalienlife
[X] pyalternativeenergy
[X] pycoalprocessing
[X] pyfusionenergy
[X] pyhightech
[X] pyindustry
[X] pypetroleumhandling
[X] pypostprocessing
[X] pyrawores

Operating system

=Windows 10

What kind of issue is this?

[ ] Compatibility
[ ] Locale (names, descriptions, unknown keys)
[ ] Graphical
[ ] Crash
[ ] Progression
[X] Balance
[ ] Pypostprocessing failure
[ ] Other

What is the problem?
You generate A LOT of ash in the early game.  More than a player really has the ability to deal with at that point in the game on overflow.  I think a reduction in the % chance of ash generation and or increasing the amount of ash needed in the automation science so it has somewhere to go.
This may make things more challenging late game where you generate less ash and have more sinks but that's why this is a suggestion on balance.
Steps to reproduce
No response
Additional context
No response
Log file
No response

I've made a Factorio API request, so we can change burnt_result amount/probability. Keep an eye on it (and Factorio changelogs).
https://forums.factorio.com/viewtopic.php?f=28&t=102789

ash is being rebalanced and added recipes to use/dispose them early game.


Fix color ramp function

We don't think this line is working as it should. https://github.com/USGS-VIZLAB/gage-conditions-gif/blob/master/2_process/src/process_dv_stat_colors.R#L18
It is using the entire vector of percentiles for the whole year to figure out what colors they should correspond to. What if this particular year saw more daily discharges that were above 50th percentile? Then our vector would be skewed and the color ramp function would match a value > 50th %ile to our "median" color, white. Investigating further to figure out if that is going on.
A potential solution is to use col_fun with just the 0, 0.5, and 1 percentiles and then use breaks or cut to match our vector of percentiles to a color range.

Conclusion: concern debunked! It works fine and doesn't need fixing. colorRamp appears to automatically operate based on a scale from [0,1], so our percentiles are automatically interpreted appropriately. Verified using the code below.
color_palette <- c("#ca0020", "#f4a582", "#efefef", "#efefef", "#92c5de", "#034064")
col_fun <- colorRamp(color_palette)

# data that is even on both sides of the "middle"
even_data <- c(0.1, 0.5, 0.9)
even_data_cols <- rgb(col_fun(even_data), maxColorValue = 255)
plot(1:length(even_data), rep(2, length(even_data)), pch = 20, cex=3,
     col = even_data_cols, axes = FALSE, xlab = "", ylab = "")

# data where there are more percentiles greater than the 50th
odd_data <- c(0.1, 0.5, 0.6, 0.75, 0.72, 0.9)
odd_data_cols <- rgb(col_fun(odd_data), maxColorValue = 255)
plot(1:length(odd_data), rep(2, length(odd_data)), pch = 20, cex=3,
     col = odd_data_cols, axes = FALSE, xlab = "", ylab = "")

# data where there are more percentiles less than the 50th
odd_data2 <- c(0.01, 0.2, 0.33, 0.43, 0.5)
odd_data_cols2 <- rgb(col_fun(odd_data2), maxColorValue = 255)
plot(1:length(odd_data2), rep(2, length(odd_data2)), pch = 20, cex=3,
     col = odd_data_cols2, axes = FALSE, xlab = "", ylab = "")

# data where there are no 50th percentiles
no50_data <- c(0.01, 0.2, 0.33, 0.43, 0.9)
no50_data_cols <- rgb(col_fun(no50_data), maxColorValue = 255)
plot(1:length(no50_data), rep(2, length(no50_data)), pch = 20, cex=3,
     col = no50_data_cols, axes = FALSE, xlab = "", ylab = "")

So, if we wanted to change the range of the white color to say that "normal" captures a larger range of percentiles, we would need to rescale the percentiles that fit in our normal range to be equal to 0.5. Something like this should do the trick:
dv_stats_adjusted <- dplyr::mutate(dv_stats, per_adjusted = ifelse(per >= 0.4 && per <= 0.6, yes = 0.5, no = per)

Phew!


Where is the 'model' directory in this path (datasets/reddit) ?

Describe the bug
There is no directory whose name is model, and I can't find the model of stacked_lstm.
How do I use this dataset (reddit)?

We are sorry for the misleading. Reddit dataset is not supported by FedLab currently.
The README about reddit is from the original repo LEAF. For now, FedLab supports FEMNIST, ShakeSpeare, Sent140, and CelebA datasets with pytorch datasets.

We are sorry for the misleading. Reddit dataset is not supported by FedLab currently. The README about reddit is from the original repo LEAF. For now, FedLab supports FEMNIST, ShakeSpeare, Sent140, and CelebA datasets with pytorch datasets.

@Zengdun-cs Thanks for your prompt reply.


Add WikiAnswers dataset

Adding a Dataset

Name: WikiAnswers
Description: The WikiAnswers corpus contains clusters of questions tagged by WikiAnswers users as paraphrases. Each cluster optionally contains an answer provided by WikiAnswers users.
Paper: https://dl.acm.org/doi/10.1145/2623330.2623677
Data: https://github.com/afader/oqa#wikianswers-corpus
Motivation: Dataset for training and evaluating models of conversational response

uploaded dataset here


Messages sent on command do not work.

This version has both the code for messages without command and a message on command, but
They do not work together.

The code for sending messages using commands is commented on.

done in v1.1.0


Upgrade to Cobra 1.7.0

What this PR does / why we need it
Cobra 1.7.0 was released April 4, 2023.
It is a small release but it has a couple of changes and bug fixes that would be nice to include.
In particular support for completion Powershell7.2+ is fixed, and it is now possible to source the zsh completion script.
The corresponding PR in tanzu-plugin-runtime: https://github.com/vmware-tanzu/tanzu-plugin-runtime/pull/72
Which issue(s) this PR fixes

Fixes # N/A
Describe testing done for PR
Let CI run.
Release note

Additional information
Special notes for your reviewer

This had been done in #258


Deep copying OrderedDicts

Dear all,
there might be an issue in how OrderedDicts are handled by deepcopy:
julia> d1 = OrderedDict([("hi", 1)])
OrderedDict{ASCIIString,Int64} with 1 entry:
  "hi" => 1

julia> d2 = deepcopy(d1)
OrderedDict{ASCIIString,Int64} with 1 entry:
  "hi" => 1

julia> d2["hi"] = 2
2

julia> d1
OrderedDict{ASCIIString,Int64} with 1 entry:
  "hi" => 2

I would expect a behaviour similar as this one:

julia> d1 = Dict([("hi", 1)])
Dict{ASCIIString,Int64} with 1 entry:
  "hi" => 1

julia> d2 = deepcopy(d1)
Dict{ASCIIString,Int64} with 1 entry:
  "hi" => 1

julia> d2["hi"] = 2
2

julia> d1
Dict{ASCIIString,Int64} with 1 entry:
  "hi" => 1

I am using Julia 0.3.5 and DataStructures 0.3.5.
Let me know if you have an idea where the problem is or if you have an idea for a workaround. Thanks in advance!
Best,
Philipp.
Edit: Added formatting (kms)

Interestingly, this works on v0.4.

This was fixed on Julia 0.4 by #8560, but that was never backported to Julia v0.3.  That should happen (I believe) with the next point release of v0.3.

Thank you!


[DNM] Test Firestore required check

#no-changelog

Required check is skipped because FST does not have any changes.


Fixing containerized deployment with kv

Adding option to change etcd port and docker image tag. Removing symbolic links, fixing enabling of systemd unit files. Migrating from docker module to shell module to ensure osd disk prepare finishes before launching next task.

@leseb removed --rm.

@PiotrProkop would you mind rebasing this? Thanks!

@leseb done


Temporarily disable Istio reconciliation due to upgrade issue in prod for Kyma 2.11

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Unblock: Sky Sport 10 (Italy)

Channel ID (required)
SkySport10.it
Reason (required)
Other
Notes
No response

No return-back on DMCA decisions, unless written by a copyright holder.


[Bug]: Cannot move single entries.

What happened?
I have installed the whole thing, but I cannot move my entries.
I use Firefox, but have also tried Edge.
How to reproduce the bug
As described above
Package Version
^2.8
PHP Version
8.2.4
Laravel Version
^11.9
Which operating systems does with happen with?
Windows
Which browsers does with happen with?
Firefox
Notes
No response

Here is the code to follow:
class OrderKanbanBoard extends KanbanBoard
{

    protected static string $model = Order::class;

    protected static ?string $navigationGroup = 'Bestellungen';
    protected static ?string $navigationLabel = 'Bestellübersicht';
    protected static ?string $title = 'Bestellübersicht';
    protected static ?string $navigationIcon = null;
    protected static ?int $navigationSort = 2;

    protected static string $recordTitleAttribute = 'treatmentNr';
    protected static string $recordStatusAttribute = 'production_step_id';

    public bool $disableEditModal = true;

    public function onStatusChanged(int $recordId, string $status, array $fromOrderedIds, array $toOrderedIds): void
    {
        Order::whereId($recordId)->update([
            'production_step_id' => $status
        ]);
    }

    public function onSortChanged(int $recordId, string $status, array $orderedIds): void
    {
    }

    protected function records(): Collection
    {
        return Order::latest('updated_at')->get();
    }

    protected function statuses(): Collection
    {
        $collection = new Collection();

        $collection->add([
            'id' => null,
            'title' => 'Nicht zugewiesen'
        ]);

        ProductionStep::orderBy('sort')->get()->each(function (ProductionStep $step) use ($collection) {
            $collection->add([
                'id' => $step->id,
                'title' => $step->name,
            ]);
        });

        return $collection;
    }

}

Yes, you were right. Now everything works perfectly, thank you!


Bitmap symbol font doesn't seem to work in 4.1

Godot version
4.1.1.stable.official
System information
Godot v4.1.1.stable - Linux Mint 20.3 (Una) - Vulkan (Mobile) - dedicated NVIDIA GeForce GT 740M (nvidia; 470.199.02) - Intel(R) Core(TM) i5-4200M CPU @ 2.50GHz (4 Threads)
Issue description
I have a bitmap font in .fnt format in order to display some button prompts and icons. However, I am unclear on how to make it work in Godot 4.1 as it worked in Godot 3.5.
In Godot 3.5, I could create a BitmapFont resource where I could import a .fnt file and adjust some settings. In Godot 4.1, that resource type is gone. I don't know what to use instead.
I could make a FontVariant with the auto-generated FontFile from the .fnt file, with a SystemFont as a fallback, but the symbols from the bitmap font do not show up.
Steps to reproduce

Create Godot 4.1 project, add a .fnt file into res://
Attempt to use the .fnt file by either setting it as a theme override on a Label, or adding it to a Theme

Minimal reproduction project
bitmapfonttest.zip

This is explained in the documentation: https://docs.godotengine.org/en/stable/tutorials/ui/gui_using_fonts.html#bitmap-fonts
Note that 3.x bitmap fonts are not the same as the standard BMFont format. The internal font format has changed in 4.0, so you must reimport the original BMFont file in the project.

This is explained in the documentation: https://docs.godotengine.org/en/stable/tutorials/ui/gui_using_fonts.html#bitmap-fonts
Note that 3.x bitmap fonts are not the same as the standard BMFont format. The internal font format has changed in 4.0, so you must reimport the original BMFont file in the project.

I reimported the file, and nothing changed. No icons are displayed.
I had some success by using the "manually metadata a PNG image" method, but the vertical position is screwed up relative to the rest of the text, inflating the line height.

I tried generating a color emoji font with Icomoon, but neither the TTF nor WOFF had color. SVG and EOT could not be used.

Your bitmap font file is broken, it has zero width and xadvance for all character, change it to 16 (or whatever correct value is) and it will work.

I am also having issues with bitmap fronts. I have tried both the "Allegro Font Importer" (abfi) and the "Texture Fonts" plugins in both Godot 4.2.1 and 4.3b2. The plugins display characters perfectly in the editor, but don't load resources properly at runtime. The built in Font Data (monospaced) importer works just fine, but the two plugins display missing character glyphs or a fallback font. Any help is appreciated.


catch invalid cape reports

ERROR:root:'target'
Traceback (most recent call last):
cape2stix/cape2stix/scripts/convert.py", line 188, in convert
if self.content["target"]["category"] == "file": # NOTE: i don't have enough reports to test if this will ever not be true;this is for safety -wb
KeyError: 'target'
CRITICAL:root:File failed to convert:

duplicate first task in issue #18 , closed by commit 0723d8b7c9b5f1017efe8ba7814dc53e31fc63b9


Create Posts “mock-window-object-behaviors”

Automatically generated by Netlify CMS

👷 Deploy Preview for monetaboot processing.
🔨 Explore the source changes: 5583cd9e29a9fd2619d41c775285162ce1ce308b
🔍 Inspect the deploy log: https://app.netlify.com/sites/monetaboot/deploys/61a7953a5857710008ab2f8e


getting_started/windows.md obsolete

The issue that prevents the installation of Roc on windows seems to have been closed.

@folkertdev could you update getting_started/windows.md with remaining issues for windows?

you mean remaining limitations when using roc on a windows machine? I think the advise should still be to not use windows right now, the surgical linker works for hello world, but the more complex platforms (e.g. cli) still have linker issues (and possibly other problems) today