Invoke-RestMethod High Memory Usage

Steps to reproduce
Call Invoke-RestMethod more than 1 million times.
try
{
    $reader = New-Object System.IO.StreamReader("input.csv") # 5,000,000 Lines
    $writer = New-Object System.IO.StreamWriter("output.csv"), ([System.IO.FileMode]::Append)
    for($count = 0;;$count++)
    {
        $line = $reader.ReadLine()
        if($line -eq $null) { break }
        $data = $line.Split(",")
        $input_variable = $data[0]

        $result = Invoke-RestMethod -Uri http://localhost:5000/api/compute_something/$input_variable # Result of api is an integer number.
        if($result -gt 0)
        { $writer.WriteLine($line + ",$result") }
    }
}
finally
{
    $reader.Close()
    $writer.Close()
}

Expected behavior
Minimum memory usage.
Actual behavior
High memory usage. Uses 900MB-1GB for a 5 million line file.
Environment data

> $PSVersionTable
Name                           Value
----                           -----
PSVersion                      6.0.0-rc
PSEdition                      Core
GitCommitId                    v6.0.0-rc
OS                             Darwin 16.7.0 Darwin Kernel Version 16.7.0: Thu Jun 15 17:36:27 PDT 2017; root:xnu-3789.70.16~2/RELEASE_X86_64
Platform                       Unix
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

Is the problem only on MacOS?

I'll check it on windows 8 and post the results here in a day,

No issue on Windows 8. Average Memory Usage Was 40MB
Name                           Value
----                           -----
PSVersion                      6.0.0-rc
PSEdition                      Core
GitCommitId                    v6.0.0-rc
OS                             Microsoft Windows 6.3.9600
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

Does the problem reproduce for something simpler? Like maybe this:
$Url = "http://localhost:5000/api/compute_something/1"
1..5000000 | ForEach-Object {
    $result = Invoke-RestMethod -uri $Uri
}

Where you use the same URI every time and aren't trying to do any other logic. I would need something I can actually do myself to look into it.

Yes. The issue can be reproduced for something simple as:
for($count = 1;$count -le 5000000;$count++)
{
    $result=Invoke-RestMethod -Uri http://localhost:5001/api
}

Web server in express.js
const express = require('express')
const app = express()

app.get('/api', function (req, res)
{
    res.send('0')
})

app.listen(5001, function ()
{
    console.log('Example app listening on port 5001')
})

I'm not familiar with express.js. What character encoding and contet-type does it return for that? Does it do any content encoding (gzip, deflate, chunked?).
I'm testing with an ASP.NET Core 2.0 API app and memory usage is not rising fast enough to hit 1G. after about 30 minutes it's only at 150M. It could be that the encoding and content-type are different though which would make it hi different .NET APIs.

Response Header
X-Powered-By: Express
Content-Type: text/html; charset=utf-8
Content-Length: 1
Memory usage 100-250MB after 1 Million Calls and hits 1GB after 4 Million Calls.
Issue does not exist for windows 8 but exists on MacOS. Don't know about linux.

@javaptgl thanks. I will set my test environment to match and test to the full 5 million requests when I can get back to my macOS system. In the meantime, can you see if the same thing happens with
$null = Invoke-RestMethod -Uri http://localhost:5001/api

I'm trying to narrow down where the issue is exactly and trying to eliminate as many as many variables as possible.
As another thing to try... This emulates the calls made under the hood skipping the JSON and XML conversion attempts and going straight to the string fallback:
$Handler = [System.Net.Http.HttpClientHandler]::New()
$HttpClient = [System.Net.Http.HttpClient]::New($Handler)
$Response = $HttpClient.GetAsync('http://localhost:5001/api').GetAwaiter().GetResult()
$Stream = $Response.Content.ReadAsStreamAsync().GetAwaiter().GetResult()
$reader = [System.IO.StreamReader]::new($Stream)
$result = $reader.ReadToEnd()
$reader.Dispose()

If memory usage there is normal, that will point us to something in the JSON and XML conversion process.

I ran the above two snippets simultaneously in separate processes for 2 hours.
The results were similar. 280MB and 300MB usage.

hmm but not the 1GB you were seeing with $result=Invoke-RestMethod -Uri http://localhost:5001/api?

API calls on powershell are really slow. About 130/s. It'll take more than 10hrs unless I use some kind of concurrency like background jobs.

ok. So we need to go with a lower number than 5,000,000 so we can check across versions and platforms and not take an eternity then.
Was the 280MBB-300MB usage after 2 hours with the to the consumption in the first to hours of the 5,000,000 run? was it more? was it less?

Both snippets finished with memory usage of around 900MB each. The memory wasn't released until I quit the powershell processes.

@javaptgl I'm still gathering data to try and track down where this is happening, but here are some observations so far.

The raw C# .NET HttpClient calls do not grow in memory size
running pwsh -noni -nop -file seems to only have negligible memory growth.
adding a call to [Microsoft.PowerShell.Commands.JsonObject]::ConvertFromJson($result,[ref]$null) in the [System.Net.Http.HttpClient] example appears to grow at the same rate as $result=Invoke-RestMethod

These are the scripts I'm working with https://gist.github.com/markekraus/b16f0991a843d2d2459aa4178dfe55b5

@javaptgl how are you measuring memory usage on macOS? can you provide some output? I want to make sure we are not chasing a ghost by looking at the wrong numbers. My tests indicate that beetween 10,000 and 500,000 iterations there is no significant increase in resident memory. some methods use more than others, but between iterations it is fairly static per method. For example:

Iterations
Invoke-RestMethod
HttpClient
dotnet

10,000
79.20
62.30
52.3

100,000
79.15
63.10
52.4

500,000
79.35
62.40
52.2

I'm using the MacOS activity monitor (Equivalent of Windows Task Manager) to check the usage.

You could use https://github.com/dotnet/coreclr/blob/027180d8ef4a8a0e50f4cba3ad985af38882f5ef/Documentation/coding-guidelines/cross-platform-performance-and-eventing.md

After learning that macOS has an "internal memory size" metric which doesn't map to anything in Windows or Linux, and figuring out how to reliably get the actual memory usage of pwsh in macOS, I'm satisfied that there is no memory leak here.
The "internal memory size" of the process grows over time up to 1GB, however, the actual resident memory and virtual memory of the process do not grow past a certain peak. On my macOS at both 500,000 and 1,000,000 iterations of $result = Invoke-RestMethod -uri $Uri (with $uri is the uri of the express.js microservice), the actual usage never goes beyond ~80MB. There is no significant difference between 10,000 iterations, 100,000 iterations, 500,000 iterations, or 1,000,000 iterations. This memory usage is consistent with the same test in Windows, WSL ubuntu, and ubuntu server with a margin of about +/-2MB. Between all of them
@javaptgl either I'm not able to reproduce your problem, or, perhaps you are looking at this "internal memory size" that macOS reports as I was when initially trying to reproduce the issue. In top this is the MEM column. If that is the case, I do not believe this to be a reliably accurate view of the process's memory usage. instead use ps or htop to get the RSS/RES and VIRT/VSZ values.

This was taken at 3,670,000th call. Activity Monitor "Memory" column reported 860MB Usage.
Apple:~ air$ ps v
PID STAT      TIME  SL  RE PAGEIN      VSZ    RSS   LIM     TSIZ  %CPU %MEM COMMAND
9170 S+   232:10.61   0   0      0  5758660 154564     -        0   8.4  3.7 pwsh irm_test.ps1
9695 S      0:00.17   0   0      0  2461044    984     -        0   0.4  0.0 -bash
3504 S      0:00.10   0   0      0  2461044    504     -        0   0.0  0.0 -bash
1108 S      0:00.07   0   0      0  2461044    428     -        0   0.0  0.0 -bash

Do you have a reference link to the "internal memory size" metric used in MacOS?
I posted this issue because I have run other powershell scripts(such as sql access and log parsing) for days and none have crossed 100MB Memory as reported by the activity monitor.
I'm going to post the screenshot  of the activity monitor window after completing 10 million calls.

@javaptgl ok so your ps is showing the RSS and VSZ are way higher than mine ever get. At 2 million I was still at ~80MB
can you run your test with pwsh -nop -file irm_test.ps1 to eliminate any potential profile issues?
Also, what version of macOS are you on? My test machine is at 10.13.1
Which install method did you use (brew, pkg, or Start-PSBuild)?
Can you please also run the code from this and post the results? https://github.com/markekraus/PowerShell/blob/TestMacosFails/test/powershell/Libcurl.Tests.ps1

Do you have a reference link to the "internal memory size" metric used in MacOS?

https://developer.apple.com/legacy/library/documentation/Darwin/Reference/ManPages/man1/top.1.html
The description for MEM column. then just googling around to try and find out what that is and coming across people trying and failing to compare it to metrics in linux and windows. However, that's not a concern now. Your RSS and VSZ are what I was suing to test with myself and yours are way higher than mine.

I'm using MacOS Sierra, Version 10.12.6

Which install method did you use (brew, pkg, or Start-PSBuild)?

A month ago I installed Powershell v6.0.0-beta.7 for the first time on my mac using the mac pkg and found this issue. A week ago I uninstalled this and installed the v6.0.0-rc using homebrew cask.

Can you please also run the code from this and post the results? https://github.com/markekraus/PowerShell/blob/TestMacosFails/test/powershell/Libcurl.Tests.ps1

LIBCURl=====================================================
LIBCURL GetSslVersionDescription(): SecureTransport
LIBCURL GetSupportedFeatures(): CURL_VERSION_IPV6, CURL_VERSION_SSL, CURL_VERSION_LIBZ, CURL_VERSION_NTLM, CURL_VERSION_ASYNCHDNS, CURL_VERSION_SPNEGO, CURL_VERSION_LARGEFILE, CURL_VERSION_NTLM_WB, CURL_VERSION_GSSAPI, CURL_VERSION_KERBEROS5, CURL_VERSION_UNIX_SOCKETS
LIBCURL GetSupportsHttp2Multiplexing(): False
LIBCURL GetVersionDescription(): 7.54.0
LIBCURl=====================================================

can you run your test with pwsh -nop -file irm_test.ps1 to eliminate any potential profile issues?

Just started with the script now.

@javaptgl thank you!
can you please also do a test with the following:
brew install openssl
brew install curl --with-openssl --with-gssapi
export DYLD_LIBRARY_PATH=/usr/local/opt/curl/lib:/usr/local/opt/openssl/lib:${DYLD_LIBRARY_PATH};
pwsh irm_test.ps1

I have recently seen some issues with 10.12.6's system supplied 7.54.0 libcurl, which is what your pwsh appears to be using based on the output. This forces pwsh to use the libcurl+openssl+gssapi installed by brew.

LIBCURl=====================================================
LIBCURL GetSslVersionDescription(): OpenSSL/1.0.2n
LIBCURL GetSupportedFeatures(): 3064733
LIBCURL GetSupportsHttp2Multiplexing(): False
LIBCURL GetVersionDescription(): 7.57.0
LIBCURl=====================================================

After 6,860,000 calls:
Apple:~ air$ ps v
  PID STAT      TIME  SL  RE PAGEIN      VSZ    RSS   LIM     TSIZ  %CPU %MEM COMMAND
11740 R+   436:07.64   0   0      0  6360868  27564     -        0   6.4  0.7 pwsh -nop -file irm_test.ps1
34581 S+     0:00.10   0   0      0  2461044   3244     -        0   0.0  0.1 -bash

Here is mine after 6,000,0000.

I'm not sure. it could be something in your environment that is different than mine. You are basically seeing the same memory increase over time no matter what method we've tried too. So I'm not even sure where to look. If you would be willing to install the .NET Core 2.0.2 SDK (https://github.com/dotnet/core/blob/master/release-notes/download-archives/2.0.2-sdk-download.md) and then run
mkdir MemLeakRepro
cd MemLeakRepro
dotnet new console

Then replace the contents of Program.cs with this https://gist.github.com/markekraus/b16f0991a843d2d2459aa4178dfe55b5#file-program-cs
then run
dotnet restore
dotnet run http://localhost:5001/api 6000000

and watch the memory usage. that will eliminate anything to do with PowerShell.
Also, just to be sure, you're not outputting anything to the console in these tests, right? Output to the console could skew the results.

Apple:MemLeakRepro air$ dotnet run http://localhost:5001/api 6000000
Start: 12/10/2017 09:23:05
End: 12/11/2017 01:11:15
Run: 15:48:10.0077740
Memory: 491.00 mb
Press any key to exit...
Apple:MemLeakRepro air$

@javaptgl Thanks! This makes it clear to me that the problem is not with PowerShell or the web cmdlets. You see the same behavior with a simple .NET app. That leads me to believe there is an issue with either .NET Core or your environment. I recommend taking this simple program and opening an issue on dotnet/corefx. There is no reason for that program to balloon like that. On my 10.13.1 mac it never gets above 55mb.

Thank you. I'll be linking this issue to the dotnet/corefx repo.

@javaptgl You're welcome! Since we have determined the problem is outside of PowerShell I'm closing this issue. We can always reopen it later if the situation changes.

The HttpResponseMessage in WebRequestPSCmdlet.ProcessRecord should be disposed?

@benaadams my understanding is that reader.Dispose() disposes the reader, the content stream, and the HttpResponseMessage.

The Stream returned from GetResponseStream via response.Content.ReadAsStreamAsync() doesn't look like it necessarily has a link to the Content or Message e.g. it can just be a MemoryStream over an array

https://github.com/dotnet/corefx/blob/6b5ef121ebea45b14f489a177e2e3f27fce86781/src/System.Net.Http/src/System/Net/Http/HttpResponseMessage.cs#L203
HttpResponseMessage.Dspose() calls Dispose() on HttpResponseMessage.Content which gets called when reader.Dispose() is called because it is the stream from HttpResponseMessage.Content.

The stream returned from HttpResponseMessage.Content is usually either a LimitMemoryStream or a MemoryStream and has no reference to anything else, so Disposing it doesn't Dispose the classes that create it (e.g. HttpContent or HttpResponseMessage) and only disposes the stream.

HttpResponseMessage.Dspose() Calls HttpContent.Dispose() Which calls HttpContent.Dispose(bool disposing) which creates the content stream if it hasn't already been created, then calls dispose on the content stream. Every thing points to  HttpResponseMessage.Dspose() being no different than calling reader.Dispose() which disposes the exact same stream.


Meta_Search overides Tire.search method.

Meta_Search overrides Tire.search method.
Tire (https://github.com/karmi/tire) does not seem to have an alternative search method like "metasearch()" and when I installed the meta_search gem I lost my elastic search capabilities.
How can I install meta_search without it changing the already existing activerecord search method?
Thanks.

If you have a model Thing, you can search it using Thing.tire.search.


MODELIX-475: Let dependabot add reviewers

:tada: This PR is included in version 2.13.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Add info about preloading factories to README.md

I wanted to keep all my factories in test/factories folder, which is not loaded by default in the Phoenix framework. I think this information might be useful in the readme.

Thanks for the PR!

Thank you!


I use this format

Looks like this:

Actually, this is what it was already, just reduces the overlap between users.


VGroup stretched items when given absolute size in UICollectionViewCompositionalLayout.

Hi all! Thanks for the awesome library :) very clean and easy to use.
I had one question when implementing a view using VGroup, so basically when given absolute size for NSCollectionLayoutItem, VGroup is not laying out things from top to bottom based on their intrinsicContentSize, instead it would stretch some items in the group to fill the entire view. Wondering is there anyway I can config this behaviour, so items are rendered from top to bottom based on their content size?
Thank you so much!

@Mononster I am going to close this issue - please let me know if that didn't work and provide a code example so I can look into it.


Updated for new torchtext and solved issue with 100% accuracy

Found the issue with 100% accuracy. The labels in IMDB dataset were "pos" and "neg" earlier. Now they are 1 and 2 for positive and negative respectively. Tested on Colab and got expected results.

fixes #135

Thanks for the patch. I just checked and it works for me. I made some additional changes that will also make it work for readers who use the older torchtext version (it's just an if/else version check). Somehow I can't push to this branch due to a permission error (maybe "allowing contributions from maintainers" was disabled for this PR) so I will do that after merging. Thanks for the fix!

Sounds great. Thanks a lot for this great book. ♥


ESP-DL ONNX Conversion for quantization tool

Hello Frazinkh,
I am also a student who is interested int ML and embedded AI.
I found your repo while browsing for ESP-DL stuff. Furthermore, I want to compare ESP-DL TVM with the quantization tool, but it is harder than I thought.
At the moment I am facing some problems with the quantization tool from ESP and I wonder if you could help me out.
In one of your colab scripts, I found the following, could you explain to me why?
## Second way (not working with ESP_DL optimizer)
Maybe we could get in contact. I would be very happy to receive a reply.

Hello, Michel.
I would be very happy if I can help you out with this problem.
In my last experience with ESP-DL TVM, I found it extremely buggy and absolutely unstable, so I stopped working on it.
Regarding my colab script, when I tried to extract the model to ONNX format using the tf2onnx library, I got several errors for the bad architecture of the model. However, using it as a tool (First way) did the trick and solved the errors.
Yes, we could be in contact. Email me your social media ID.


ag3.aa_allele_frequencies() method

resolves #101
Adds a method which is similar to snp_allele_frequencies() except it collapses multi-variant aa-changes and drops unneeded columns.

Hi @alimanfoo - I have revised as suggested.


[dunfell][gatesgarth][hardknott][honister][kirkstone] {galactic} Upgrade to 2021-11-11 release

https://discourse.ros.org/t/new-packages-for-galactic-geochelone-2021-11-11/23075

Merged to other branches as well:
5c9305947..05d30c57a  dunfell -> dunfell-next
c4850195f..bd5ff83d7  gatesgarth -> gatesgarth
c4850195f..bd5ff83d7  gatesgarth -> gatesgarth-next
bbe23a397..2e0707c9f  hardknott -> hardknott
bbe23a397..2e0707c9f  hardknott -> hardknott-next
af20deedc..72afd08de  honister -> honister
af20deedc..72afd08de  honister -> honister-next
af20deedc..72afd08de  master -> master
af20deedc..72afd08de  master -> master-next


Temporarily disable support for column aliases in HAVING

To unbreak practical HAVING cases in CubeJS.

Codecov Report

Merging #28 (a5f9d2a) into cube-main (3a32e08) will decrease coverage by 0.02%.
The diff coverage is 33.33%.

@@              Coverage Diff              @@
##           cube-main      #28      +/-   ##
=============================================
- Coverage      77.51%   77.48%   -0.03%
=============================================
  Files            297      297
  Lines          67791    67772      -19
=============================================
- Hits           52550    52516      -34
- Misses         15241    15256      +15

Impacted Files
Coverage Δ

rust/datafusion/src/sql/planner.rs
83.00% <20.00%> (-0.48%)
:arrow_down:

rust/datafusion/tests/sql.rs
98.36% <100.00%> (ø)

rust/datafusion/src/sql/utils.rs
80.12% <0.00%> (-8.08%)
:arrow_down:

...t/datafusion/src/physical_plan/sorted_aggregate.rs
1.08% <0.00%> (+1.08%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3a32e08...a5f9d2a. Read the comment docs.


Programmatically generate ellie links for showcase examples

Problem: When creating new code examples in the showcase app, we need to specify a metaInfo record with a ellieDemo url (see code snippet below for an example). The issue is that for a lot of these demos, the code is not yet published in https://package.elm-lang.org/ ... so we have to then do a follow up PR / commit after publishing to https://package.elm-lang.org/ to update the ellieDemo link to actually contain the demo code.
Right now I just enter a dummy url and forget to update it (plus, it's extra work and I'm lazy to follow up and update it).
basicExample : Model -> Styled.Html Msg
basicExample model =
    let
        metaInfo =
            { title = "Basic"
            , content = "Basic usage of checkbox."
            , ellieDemo = "https://ellie-app.com/9mjDjrRz2dBa1"
            }
    in
    Container.createDemoBox
        (DemoBoxMsg << SimpleExample)
        model.basicExample
        (\_ -> SimpleExample.example)
        metaInfo

Desired Outcome
1. Use Ellie's programmatic API to dynamically create ellie demos programmatically.
Documentation on how to do this.
Specifically, use Luke Westby's suggestion of encoding the entire elm demo app in the URL.
2. Update all existing demos to use this new API

Ooh this looks really interesting. I'd like to take a shot at this!
I was just wondering how you would like to approach this. Would this be python file (or whatever executable) we'd run to generate an ellie link given the file, and print out the link? Or maybe it doesn't matter as long as the link generation is slightly automated haha.
On a side note, do you want to add a hacktoberfest topic to this repo? It might attract some more contributors and people who can help :)). Also my PRs don't count toward Hacktoberfest right now because this repo isn't opted in 😅.

Go for it!

I was just wondering how you would like to approach this.

We would generate the url in elm once the source code is loaded from the file-server. So clicking the code icon in an demo box prior to the source code being loaded should be a no-op. Once we generate the correct url as per the issue comment I linked above, then we would add that as the ellieDemo value for metaInfo.
Does that make sense?

do you want to add a hacktoberfest topic to this repo

Done!

We would generate the url in elm

Oh I think I get it! What I understand is that the Ellie link will be created in Elm by the file contents, once it's received by the ExampleSourceCodeLoaded. That makes it a lot simpler, actually.

Done!

Thank you so much!

I'll be busy over the weekend but I just wanted to give you an update on what I did recently (Sorry for the long comment!)
TL;DR: URL encoding is finished (with gist and github repo) but there are some caveats that prevent us from using it right away.
Good news
URL encoding is surprisingly easy, since all you have to do is replace some reserved characters with their percent encodings. I made this gist that showcases that functionality. It hardcodes the Ellie title, HTML and the packages that the Ellie link will generate, but those aren't too difficult to change.
For example, a simple Hello World example:
module Main exposing (main)

import Html exposing (Html)

main : Html msg
main =
    Html.text "Hello World!"

Will be converted to this Ellie link.
If you want to test it out yourself in the command line, I made a small headless Elm program that prints out the URL when the file is taken as a CLI argument. The repo is here.
Caveats
This seems close to actual functionality, but it unfortunately doesn't work on the antd code examples, without some major refactoring. The program assumes the code is already compatible with Ellie straight off the bat, so file names that aren't called Main and aren't exposing  a main function wouldn't work.
I looked into the examples and it seems like there are three main types of "files":
1. Stateless and Message-less (most common)
module Routes.ButtonComponent.TypeExample exposing (example)

Files like these are pretty easy to make compatible because we just have to rename the file to Main. Renaming example to main is harder but we could just add a line below the imports like so (although this is a little hacky):
main : Html msg
main = example

2. Stateless with Messages
module Routes.ButtonComponent.IconExample exposing (Msg, example)

This will be harder to make compatible because, alone with changing the name and exports, we'd have to add some extra code to make this able to export a main : Program () Model Msg function.
3. Stateful with Messages
module Routes.AlertComponent.CloseableExample exposing
    ( Model
    , Msg
    , init
    , update
    , view
    )

This is similar to the above problem, but we have lot more things already defined for our main function.
I believe these problems are all solvable with elm/parser, though it will take some time. I'm not sure how many changes you'd like to make to the example files, since the complexity of this problem might change slightly with how flexible you are willing to be. An example is changing example to main in all the files.
Apologies for the really long winded comment! This problem's really interesting to look into. I'll be busy with homework for this weekend so I won't be able to do much, but I hope this comment helps you out with this issue.

Amazing! Don't apologize for the long comment. This is great research & detail!
Regarding the list of packages, I thought that it was optional to specify package versions with this hidden ellie API? We need to use the latest version ofelm-antd. The showcase is always running on the latest version of elm-antd. If we hardcode a elm-antd version then a lot of the new examples won't work unless we modify the version referenced within the file enocder / url generator.
So ideally there's an option to say Package "supermacro/elm-antd" "latest" or omit the package version entirely (which would then resolve to using the latest version).

Regarding the size & scope of this change:
I would recommend first implementing a naive approach / v1 implementation that only generates links for the "Stateless and Message-less" examples.
That way the size of the refactor is reduced by a considerable amount.
Once that's merged, then we can iterate on this design and generalize it for the more complex examples.
That way no one is biting off more than they can chew :)

An example is changing example to main in all the files.

I would say, do what you think makes sense in the context of a v1 implementation. We can then do some manual QA'ing to make sure things are still good.

You're right, I feel like we should be able to specify the latest package version automatically, but unfortunately I couldn't find a way to do that with the URLs :((.
I looked at the source code for the Ellie URL parsers a bit more, specifically at Version.elm and Package.elm, and it seems that they only accept hardcoded numbers. Not specifying a package version at all would make the Package parsing fail completely.
Hardcoding the latest elm-antd version is going to be kind of annoying, but it seems to be the best we can do unless one of the Ellie devs has something to say about it.

I would recommend first implementing a naive approach / v1 implementation

A naive v1 implementation is definitely possible! I will be a little slow to make it due to a couple of midterms that are coming up, but I'll submit a PR with basic functionality sometime within a week and we can slowly work on making it more powerful.

Hmm, ok I think another thing that could be done is to dynamically get the version of elm-antd and then use that to create the ellie links.
It might be possible to do this in elm using the metadata-utils package (but I am not very familiar with the package, so I can't make any promises).
Alternatively, the version could be hardcoded at build time by fetching the version of elm-antd using github's API (and reading the list of tags). Then there would be a javascript environment variable that would use that value, and it would get sent into elm via ports.

I took a quick look at the options and it seems like Github's API is the easiest to use. I'm not too familiar with JS environment variables, though, especially with Webpack. Maybe you can make some changes once I have a PR ready 😅 .
Right now, I can just do an HTTP request (either in JS or on the Router.elm init function), and listen to the response on Router.elm. I'm not sure how I would "send" the version to a component without introducing a bunch of new code, though. I might have to introduce a "saveVersionToModel" field in the DocumentationRoute type. What do you think?

I'm not too familiar with JS environment variables, though, especially with Webpack

No worries! It's quite straight forward. Let me see if I can explain in a simple manner:
JS that runs in browsers technically does not have environment variables. The process object is undefined.
However, in NodeJS, process is indeed defined, and you can access environment variables in NodeJS using process.env.<ENV_VAR_NAME>.
So what webpack does (remember, webpack runs in a NodeJS context), with the help of the awkwardly named "DefinePlugin" plugin, is that it allows you to replace tokens in your JS code with anything you want. So what I've set up is a string replace to take anything with the process.env.<ENV_VAR> pattern and replace it with the value of that environment variable at runtime.
So for example, when I write process.env.NODE_ENV in the JS source code, webpack turns it into the string literal '"development"or"production"`.
See here for the actual line of code where the above happens.
Does that make sense?

With regard to HTTP requests, they should be done at build time, meaning in a Circle CI script. So your PR would do an HTTP request inside of the [config.yml](https://github.com/supermacro/elm-antd/blob/master/.circleci/config.yml) file that runs on deployments and PRs.
I can install the github cli in the Docker file so that the github cli is usable within CI/CD runs in Circle.
So imagine there was something like this:
# inside of config.yml

# create an env variable based on an api call to list git tags from most recent to oldest, and then pipe it to 'head' to attain only the most recent git tag
export CURRENT_ANTD_VERSION=$(github-cli list-tags supermacro/elm-antd | head -n 1)

Note that the above is a hypothetical usage of the github cli as I actually am not familiar with the cli's API.
... Then in JS, you would call process.env.CURRENT_ANTD_VERSION .. and tada! You now have the antd version avaialble to you!

Wow, thanks for such a good explanation of the environment variables! I definitely understand env variables a lot more, and your string replace webpack plugin is really cool.
My experience with webpack (and I guess environment variables as well) only went as far as using create-elm app and firebase, so I'm glad I'm getting to learn so much from this project.

With regard to HTTP requests, they should be done at build time

Oh wow I really misinterpreted your earlier comments, sorry! I haven't had a lot of experience with CI/CD, but it seems like a really neat thing to learn, and has a lot of good documentation online.
For the Github CLI, It turns out that you don't even need to install anything, since the API is a simple fetch command from a URL which returns a JSON string. From what I've seen, you can run terminal commands right in the config.yml file. If I'm correct, this script should give return the newest version, without any dependencies:
curl -s 'https://api.github.com/repos/supermacro/elm-antd/releases/latest' |  \
    python3 -c "import sys, json; print(json.load(sys.stdin)['tag_name'])"

This works on my terminal, though the python script is a bit weird. Alternatively, the jq library can make it a lot simpler, though this requires a 3rd party library.
curl -s 'https://api.github.com/repos/supermacro/elm-antd/releases/latest' | jq -r '.tag_name'

Then in JS, you would call process.env.CURRENT_ANTD_VERSION

I'm looking at the Circle CI documentation and there seems to be a lot of different ways to export an environment variable. If it doesn't matter how we do it, I'll just wrap the terminal command with $(), if that's a correct thing to do.

My last question in this unfortunately long comment is about passing down the version number from the Showcase.elm to the containers, which are responsible for setting the Ellie links.
I think the easiest way would be for the Showcase.elm to receive it as a flag and send it to Router.elm. We will add an extra argument to a Component's view function, which will send it to a container through a modified DemoBoxMetaInfo record. How does that sound? I can probably get a PR ready within the next day or so for you to see the code.

Happy to help :)
I just checked to see if either jq or python3 were installed in the docker image that I use, and it turns out that neither are currently available.
So I've taken the liberty of adding jq to the Circle CI environment.
In config.yml file you can now run the curl + jq command you posted.
The best way to test out if your code works is to run it inside of a docker container.
# download the latest docker image from dockerhub
> docker pull giorgio14/elm-antd-ci:latest

# "go into" the docker container in a bash session
> docker run -it giorgio14/elm-antd-ci:latest bash

After you run the above command, you'll be running an interactive bash shell within the docker container. Here you can prototype ideas, and once you're happy with them, then add them to the config.yml file.

I did however just realize that the actual building / deployment of the app is done outside of circle 😅 It's done via netlify, so I'm going to have to read a bit about programmatic builds for netlify. Meaning that right now this task is a bit blocked until I figure out how to build the app within circle and then upload it to netlify.

If you want to, you can set up a free netlify account and learn how you can use the netlify cli to build a site and upload it to netlify (but not publish it ... I manually deploy builds on netlify).

Oh, I forgot to answer your last question!
I think an even simpler way of passing the version into elm would be by using Ports!
See the implementation of copySourceToClipboard for an example of how to build a port.
Docs on ports:
https://guide.elm-lang.org/interop/ports.html

Thanks for installing jq into the environment! The API call works in the bash session.
And sorry for not being active lately, school's been pretty annoying. I'll look at netlify when I have more time later, but right now I'll just do a quick PR showcasing what I've got for the URL generator.

I decided to go the parsing route because generating an AST gives the most flexibility with the code manipulation. It's pretty bare bones and the parsing code is a bit wacky, but it works on Stateless and Message-less files, such as the Alerts and Typography.
To pass the versions down, I added a "version" field to every component's Model. The initialModel of the DocumentationRoute then became a function that took in a version and returned a model, so the Router.init function immediately passed on the version number to every component model on initialization. I also hardcoded the version number in the flags, but this is pretty easy to replace with the environment variable once we get that working.
One issue regarding the Ellie links is that we don't import the CSS, so the Buttons and Alerts don't have the necessary styling. One approach I was thinking of (at least on stateless and message-less files) is to generate a new function at the bottom of the file which we'll expose:
main : Html Msg
main model =
    div []
      [ Ant.Css.defaultStyles
      , example
      ]

but I'll focus on the functionality of the URL generator first, before dealing with this.

Reading through your PR now. Very excited about this 🤩 👏 🤩 👏 🤩 👏


Concierge compose tool not using the custom subject logic when sending message in NewDot

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: <IP_ADDRESS>
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: @quinthar
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1702573610539439
Action Performed:

Open the concierge compose tool and observe

Expected Result:
Customizes the "Subject" and sending the ND message immediately
It SHOULD do this by sending a NewDot message formatted like this:
# <custom subject>
<body>

Actual Result:
Uses the logic
*<custom subject>*

<body>

So it's not actually triggering the custom subject logic at all.  It's just sending a normal message, with the first line in bold.  This would trigger the regular UnreadMessageSummary job a day later, with the subject line Expensify chat from  to
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

View all open jobs on GitHub

Reproduced

Hey @cristipaval, sorry to snatch this from you. I was pinged about this on slack and had some free time today so i went ahead and tackled it.
I've placed a PR for review.

Thanks @chiragsalian!

The PR is on production, this was reopened by mistake


feat(ci): add slack bot / update buildkite slack bot to report which job failed in ci

Context: https://github.com/risingwavelabs/risingwave/issues/8371#issuecomment-1460199521

Not sure whether it's easy to do. Please take a look


link to the details about video classification  is not available?

Thanks for your great project. I noticed that the link for the zero-shot video classification task is not valid. is it not ready or just forget to link it?

Hi， you can see it in our paper.


Configure Dependabot

Which issue, if any, is this issue related to?

None.

Is there anything in the PR that needs further explanation?

I believe setting interval: monthly prevents us from too many PR notifications.

LGTM, thank you!


Minor doc change for DataFrame.spark.checkpoint/DataFrame.spark.local_checkpoint

Codecov Report

Merging #1943 (b67d394) into master (8d35a74) will decrease coverage by 2.75%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1943      +/-   ##
==========================================
- Coverage   94.50%   91.74%   -2.76%
==========================================
  Files          45       45
  Lines       10682    10588      -94
==========================================
- Hits        10095     9714     -381
- Misses        587      874     +287

Impacted Files
Coverage Δ

databricks/koalas/spark/accessors.py
94.33% <ø> (-0.63%)
:arrow_down:

databricks/koalas/usage_logging/__init__.py
25.66% <0.00%> (-66.65%)
:arrow_down:

databricks/koalas/usage_logging/usage_logger.py
47.82% <0.00%> (-52.18%)
:arrow_down:

databricks/koalas/__init__.py
73.43% <0.00%> (-17.19%)
:arrow_down:

databricks/conftest.py
88.13% <0.00%> (-11.87%)
:arrow_down:

databricks/koalas/spark/functions.py
88.88% <0.00%> (-7.41%)
:arrow_down:

databricks/koalas/accessors.py
86.43% <0.00%> (-7.04%)
:arrow_down:

databricks/koalas/namespace.py
78.17% <0.00%> (-6.07%)
:arrow_down:

databricks/koalas/generic.py
88.18% <0.00%> (-4.74%)
:arrow_down:

databricks/koalas/frame.py
93.41% <0.00%> (-3.26%)
:arrow_down:

... and 17 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d35a74...b67d394. Read the comment docs.

Thanks! merging.

@ueshin Thank you!

Thanks :-)

@HyukjinKwon Thanks for catching this :)!


[Draft] Add jruby to CI

Add JRuby and JRuby CI to expand the platform coverage.
Motivation

Implementation

Automated Tests

Manual Tests

Fixes https://github.com/Shopify/ruby-lsp/issues/687

This is the error I am getting, Same issue is reported by another user [here](https://github.com/Shopify/vscode-ruby-lsp/issues/920)

Thank you, it seems this related to the patch we have for URI::Generic.from_path.
As Sorbet does not officially support JRuby, this may be a difficult one to solve...


Feature request: trim column names

I have encountered some column names with trailing blanks, it could be useful to have them removed automatically.

Hey @ericemc3,
this seems to be somewhat related to this issue: https://github.com/polydbms/sheetreader-duckdb/issues/54


Fix asciidoc include_path. Version bump.

https://github.com/elastic/logstash/issues/7993

LGTM

Merged to 5.x; closing


Actually, the email regex matches WAY more than it should.

Package version eg. v8, v9:
Master
Code sample, to showcase or reproduce:
fmt.Println(emailRegex.MatchString(`"\"@example.com`))

Produces true, it should produce false.
The fault is a missing \\\\ to match a backspace in the subexpression covering quoted-pair, as a result although the quoted-string should require \ and " to be quoted, both are accepted even without escaping.

@puellanivis thanks for reporting, would you be able to make a PR to fix :)

Working through what it would take to fix this regular expression, I stumbled upon something that there is an even bigger problem with this regexp that everyone is passing around: it improperly includes folding-white-space (FWS).
This means even if this bug is corrected, this code would still accept the email address (quote encoded): "\"\r\n<EMAIL_ADDRESS>even though the RFC specifically notes that the CRLF in the FWS is “invisible” and thus not semantically part of the email addres, thus using that byte sequence as an address would actually canonically be "<EMAIL_ADDRESS>The remaining interesting point is that there is no way to legally encode a CR or LF into an email address at all. The escaping backslash is considered invisible, and as such literally escapes the following byte sequence, thus (quote-encoded<EMAIL_ADDRESS>as an email address is canonically equivalent to<EMAIL_ADDRESS>due to how escaping workings. And while<EMAIL_ADDRESS>demonstrates how to properly escape a TAB, the quote-pair definition does not allow escaping of either CR or LF.
Basically, everyone inherited a pretty bad email regexp, and while it’s had tweaks here and there, it is far more complex than it needs to be, in part because it is attempting to match far more than it actually should.
I could propose a better alternative, but it will intentionally not be compatible with what this has been matching before.

@puellanivis I’m ok with a fix that might not be compatible as it seems like a bug.
It doesn’t even have to be a regex.
Looking forward to anything you can come up with :)

@puellanivis any follow-up proposed solution here?

Well, I had https://github.com/puellanivis/pedantic-regexps/blob/master/email.go that I wrote out awhile ago, but it’s not all kind of collected into one single expression. I had to build it up by parts, because it was otherwise just too unwieldy to even reason about. But I imagine anyone could copy paste the regexp out of the TestEmail log, but it’s also 4170 bytes all on its own. :cold_sweat:

Thanks @puellanivis thats looks great! I’m totally fine with keeping it separate as long as you don’t mind if I try to bring it into the core of this lib :)

I’ve gone ahead and made the LICENSE file explicit in the repo. It’s now MIT license, so you should be free to use it without any questions now.

Awesome thanks!


"Todireni", "Cernești", "Florești", "Gârbești" and "Iurești" are listed in the drop-down menu

Description:
"Todireni", "Cernești", "Florești", "Gârbești" and "Iurești" are listed in the drop-down menu alongside its corresponding county and commune, according to the law
Precondition:
The website is up an running.

Step 1
Type "Todireni" in the search bar.

Expected results
The location is listed in the drop-down menu as "Todireni, Botoșani (Todireni)".

Step 2
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 3
Type "Cernești" in the search bar.

Expected results
The location is listed in the drop-down menu as "Cernești, Botoșani (Todireni)".

Step 4
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 5
Type "Florești" in the search bar.

Expected results
The location is listed in the drop-down menu as "Florești, Botoșani (Todireni)".

Step 6
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 8
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 9
Type "Iurești" in the search bar.

Expected results
The location is listed in the drop-down menu as "Iurești, Botoșani (Todireni)".


Hello, I want to download the synthetic shadow image and the corresponding mask, can you help me to open the permission of google drive? thanks

Hello, I want to download the synthetic shadow image and the corresponding mask in FSDSRD, can you help me to open the permission of google drive? thanks

Hello, I accepted you to access the dataset.
If you have any problems, please let me know.
Thanks.

can you share dataset on baidu 云盘  ，thanks！！！！


fix: newegg out-of-stock

Description

Fix for Newegg product pages that don't have an "auto notify" label
Follow-up to removing "out of stock" label which triggers on the in-stock card pages, changed it to "see similar items below" - on pages like this: https://www.newegg.com/evga-geforce-rtx-3080-10g-p5-3885-kr/p/N82E16814487520

Testing

Tested the newegg scraping for in-stock and out-of-stock cards and saw expected results

New dependencies

N/A

Moved it for testing and forgot to put it back, just constantly trying to disrupt the nicely organized code


Create Traceability Matrix

Trace-ability matrix for demo 1 complete to be expanded as we go through the project


Adding adopter section and link to adopters.md.

Adding the adopter section and instruction for adopters to add themselves.
Also fixing a broken link:

Roadmap
Akri uses a single project board to track issues.

Thank you for reviewing, @kate-goldenring , I have update the PR based on your suggestion.


CRD Installation failed 4.7.0

Description
The CRD installation will fail when I try to apply it like documented:
kubectl apply -f https://github.com/k8up-io/k8up/releases/download/k8up-4.7.0/k8up-crd.yaml
Additional Context
No response
Logs
kubectl apply -f https://github.com/k8up-io/k8up/releases/download/k8up-4.7.0/k8up-crd.yaml
customresourcedefinition.apiextensions.k8s.io/archives.k8up.io unchanged
customresourcedefinition.apiextensions.k8s.io/backups.k8up.io unchanged
customresourcedefinition.apiextensions.k8s.io/checks.k8up.io unchanged
customresourcedefinition.apiextensions.k8s.io/prunes.k8up.io unchanged
customresourcedefinition.apiextensions.k8s.io/restores.k8up.io unchanged
customresourcedefinition.apiextensions.k8s.io/schedules.k8up.io unchanged
customresourcedefinition.apiextensions.k8s.io/snapshots.k8up.io unchanged
Error from server (Invalid): error when creating "https://github.com/k8up-io/k8up/releases/download/k8up-4.7.0/k8up-crd.yaml": CustomResourceDefinition.apiextensions.k8s.io "podconfigs.k8up.io" is invalid: metadata.annotations: Too long: must have at most 262144 bytes
Error from server (Invalid): error when creating "https://github.com/k8up-io/k8up/releases/download/k8up-4.7.0/k8up-crd.yaml": CustomResourceDefinition.apiextensions.k8s.io "prebackuppods.k8up.io" is invalid: metadata.annotations: Too long: must have at most 262144 bytes

Expected Behavior
What in my case worked was the ---server-side suffix.
kubectl apply -f https://github.com/k8up-io/k8up/releases/download/k8up-4.7.0/k8up-crd.yaml --server-side
It should work out of the box, may shorten the metadata or change the docs to the server-side flag.
Steps To Reproduce
No response
Version of K8up
4.7.0
Version of Kubernetes
1.27.10
Distribution of Kubernetes
Kubernetes

Same output for me.  Fix from a previous issue is to include --server-side in the kubectl command:
kubectl apply -f https://github.com/k8up-io/k8up/releases/download/k8up-4.7.0/k8up-crd.yaml --server-side

Hi @matthiasbaldi
Can you point us to the location in the docs where you found the outdated instructions?

@Kidswiss yes of course - sorry :wink:
https://github.com/k8up-io/k8up/tree/master/charts/k8up#installation


Update HubSpot form on contact's page

Title
Update new HubSpot form
Description
Update the existing form on Contact page with the new Hubspot form, keeping the same styling as the website.
To Reproduce (required) Steps to reproduce the behavior:
When going to the link provided in the description, it should display the new form from HubSpot with the code provided.
Device (required):
Here is the embedded code for the form:
<!--[if lte IE 8]>
<script charset="utf-8" type="text/javascript" src="//js.hsforms.net/forms/v2-legacy.js"></script>
<![endif]-->
<script charset="utf-8" type="text/javascript" src="//js.hsforms.net/forms/v2.js"></script>
<script>
  hbspt.forms.create({
	region: "na1",
	portalId: "6160488",
	formId: "178f8cb9-1fa9-4fe8-a6ca-706f3bd31c7a"
});
</script>

Screenshots

Predicted results
Implement support ticket workflow and improve support

@MRTIBBETS  new form update in the works.

There is a new form.


remove redundant reversals from all clients

This is a follow up to #232, but for all the other clients as well.
Previously we reversed a vec, which was made by (effectively) zipping together two reversed vecs, now we just skip all the reversals for the same end result.
Note that I haven't personally tested the .cs changes because I don't have a build environment set up for that, but I'm hoping CI will catch any issues there.

Ok since you are now two claiming that it's redundant perhaps you are right. :) I still want to think it through some more... and make absolute certain it doesn't affect index structure because that would break compatibility. As mentioned elsewhere this logic was changed/added as part of spatial index structure changes in spec v3 with the most important change that the tree was turned up side down. That work was done in https://github.com/flatgeobuf/flatgeobuf/pull/40 and specifically https://github.com/flatgeobuf/flatgeobuf/pull/40/commits/8e9820a30ba857b747038021691afd839c00dfc1 added the reversals.

I've added #234 to help verify correctness. With #234 you can easily generate FGB files from geojson to compare outputs.
For example you can run this command on different shas to compare the output of FGB's generated from test/fixtures/*
cd src/cpp
DIR=output-$(git rev-parse --short HEAD); mkdir -p $DIR; for file in test/fixtures/*; do build/geojson2fgb $file > $DIR/$(basename $file.fgb); done

Comparing the output before and after 7d11892700c56488e5a32404df494f11749d83dc produces the same result.
Intentionally breaking things, e.g. removing 2 of the three reversals, generates different binaries.

Hmm same CI issue as in https://github.com/flatgeobuf/flatgeobuf/pull/234#issuecomment-1219753943.

Ok I'm pretty convinced at this point.


Feature Request - Prompt Error on Missing json-summary Reporter

Instead of failing in a weird way lets fail on missing the json-summary reporter.
This will help people like myself that fail to read the readme.

Working on this now in my fork.


Migrate Curaçao to holiday groups

Proposed change

Migrate Curaçao holidays to holiday_groups standard.
Add in the missing Easter Sunday holidays.
Add l10n supports for en_US, nl, pap, uk localization; uk's l10n need some double checking from @KJhellico .
(Blocked by #1313)

Type of change

[ ] New country/market holidays support (thank you!)
[ ] Supported country/market holidays update (calendar discrepancy fix, localization)
[x] Existing code/documentation/test/process quality improvement (best practice, cleanup, refactoring, optimization)
[ ] Dependency upgrade (version update)
[ ] Bugfix (non-breaking change which fixes an issue)
[ ] Breaking change (a code change causing existing functionality to break)
[ ] New feature (new python-holidays functionality in general)

Checklist

[x] I've followed the contributing guidelines
[x] This PR is filed against beta branch of the repository
[x] This PR doesn't contain any merge conflicts and has clean commit history
[x] The code style looks good: make pre-commit
[x] All tests pass locally: make test, make tox (we strongly encourage adding tests to your code)
[x] The related documentation has been added/updated (check off the box for free if no updates is required)

coverage: 99.991%. remained the same when pulling 1792c66e648121d89042e98a608bde4ff35260ab on PPsyrius:curacoa_holiday_group into 522a9951f4457c68977016ecc8d8d9e08011f8d2 on dr-prodigy:beta.

Seems all good now :tada:


default_permission doesn't have any effect

Hi,
Thanks a lot for this project!
I am trying to restrict the use of a command to a specific role using the following options, though it does not seem to have any effect:
    "default_permission": False,
    "permissions": {
        GUILD_ID : [ create_permission(ROLE_ID, SlashCommandPermissionType.ROLE, True) ]
    },

Other options I've tried that don't work:

Only setting one "positive" permission to the role
Setting one "negative" permission to the role @everyone and one positive to one role (the negative permission has no effect)
Setting default_permission=False without anything else also has no effect.

The only way I can disallow a role/user to use it is by explicit adding a negative permission for them, meaning that for admin commands I would need to add a negative permission to all the guild users (because some users don't have roles).
I believe that's not the intended behavior and is a bug right?

I use this when I was testing the permission PR, and user with id<PHONE_NUMBER>70931969 was able to run the command. From that little code snippet from you, its not enough to pin point any issue with your code tho.
@slash.slash(name="test_guild", description="test_guild", default_permission=False, guild_ids=[750556940127436880,<PHONE_NUMBER>89787914], options=[create_option("test", "lol", SlashCommandOptionType.INTEGER, True)])
@slash.permission(823454213089787914, generate_permissions(allowed_users=[281300452270931969]))
async def test_guild(ctx, test):
    print(test)
    await ctx.send("test_guild")

So I investigated further. It looks like creating a command without adding default_permission=False the first time it is created and then adding it later has not effect.
I was able to go around the issue by temporarily renaming the command, adding the option and renaming it back to its original name.
Here is roughly the script I have, to give you more context, though I'm not sure if that helps.
slash = SlashCommand(bot, sync_commands=True, delete_from_unused_guilds=True

slash.add_slash_command(
    name=BASE_COMMAND_NAME,
    cmd=_base_cmd,
    guild_ids=[GUILD_ID],
    options=[],
    default_permission=False,
    permissions={
        GUILD_ID: [
            create_permission(RESTRICTED_COMMANDS_ROLE_ID, SlashCommandPermissionType.ROLE, True)
        ]
    })

 slash.add_subcommand(base=BASE_COMMAND_NAME, **{
    "cmd": _some_function,
    "description": "description",
    "guild_ids": [GUILD_ID],
    "connector": {
        "utilisateur": "member"
    },
    "options": [
        {
            'name': 'utilisateur',
            'description': "Utilisateur à qui le message d'accueil sera envoyé",
            'type': SlashCommandOptionType.USER,
            'required': True
        }
    ]
})

ok yea, I think I found the issue. will link a pr soon.

You can test the above PR with pip install git+https://github.com/benwoo1110/discord-py-slash-command@default-permission-missing --force


Libs v0.62.2

Summary
pure react-native v0.62.2 libs for ios pods
Changelog
https://github.com/krmao/template/tree/master/mobile/react_native/tools/libsforios/.libsforios

I think you probably messed something up there in your PR, or sent it against the wrong repo. Please fix it.


Atom shortcut is removed from taskbar after update

Prerequisites
OS - Windows 8.1, shortcut to the Atom is added to task bar.
Description
Periodically Atom shortcut disappears from the task bar. Looks like, this happens when the editor is updated. After every update I need manually add a shortcut to the taskbar.
Steps to Reproduce

Install Atom editor
Wait for update

Expected behavior:
No shortcuts are removed.
Actual behavior:
Shortcut is removed from the task bar.
Versions
I do not remember version before update. Current is 1.6.2

It has been happening to me as well.
OS - Windows 10.

Some important changes were made in Squirrel (the updater) to handle this and they are included in 1.7.

To clarify the update from 1.6 to 1.7 should preserve the pinned task bar icons.


NetworkInfo.getIPV4Address returns wrong IP address (Android)

This is a weird one -- it works fine on a Nexus 6 I have that's running Android 6.0.1, but on my Pixel 2 running 8.1.0 NetworkInfo.getIPV4Address is returning the wrong IP address.
I'm using it as expected:
        NetworkInfo.getIPV4Address(ip => {
            console.warn(ip);
        });

On my Pixel 2 the IP address this function is returning is <IP_ADDRESS>, but when I go into my Wifi settings to check my real IP address is <IP_ADDRESS> (for example).
Any idea what could be causing this discrepancy and how to fix it?

Having the same issue


Add workaround which Location Header isnot absoluteURI

http://github.com/opscode/chef/ returns the following header.
HTTP/1.1 302 Found
Connection: close
Pragma: no-cache
cache-control: no-cache
Location: /TXQcK/opscode/chef/

I believe Location fieald must be absoluteURI for RFC2396. However I add the workaround.

Ummm...

force pushed.


Bug: Action.Url is not using the RoutePrefix attribute of the class to build the Url

I have the following class:
    [RoutePrefix("api/AdServer/AdImage")]
    public class AdImageController : OurBaseApiController
    {
        [HttpGet]
        [Route("{adId}/image", Name = "AdServerImage")]
        public async Task<HttpResponseMessage> GetImage(int adId, int userId)
        {
        }
    }

When I call Action.Url method for the GetImage method, the return value is:
?adId=${adId}&userId=${userId}
But the real Url should be:
api/AdServer/AdImage/?adId=${adId}&userId=${userId}
The issue is that the RoutePrefix attribute on the class isn't being taken into consideration when building the Url.

I think you will see this when you look at the code, but I just realized that the bug is deeper than just not looking at the RoutePrefix attribute.
In the example I gave above, I was wrong on what the real Url should be because the Route attribute has parameter. So the real Url should be:
api/AdServer/AdImage/{adId}/image/?userId=${userId}

@NeVeSpl Thank you for this fix. It makes the Action.Url much, much better.
 There is one case that has jumped out. I will open a new issue for that case. I want to do more investigation to see if I can figure out what is really triggering it.  Oh, it might be the second optional parameter isn't being picked up or something.


"Hover to zoom" no longer working in Settings UI

Describe the bug
An empty popup appears in the Settings UI when the pointer is hovered over the font texture.
To Reproduce

Open the Settings UI in the demo app, e.g. https://emilk.github.io/egui/index.html will do fine for testing.
Expand the "Fonts" collapsing header.
Hover your pointer over the font texture.
I see an empty popup.

Expected behavior
This is a regression introduced in version 0.10.0. Older versions would show a magnified view of the font texture.
Screenshots

The empty box at the bottom should not be empty. See below for the expected result as shown in version 0.9.0:

Thanks!


Find case insensitive

Hi,
Will case insensitive find come to restIc?
R

Good idea, thanks for reporting this issue!


Thinfinty

Hello,
when I try to use your implementation with Thinfinity (https://www.cybelesoft.com/thinfinity/virtualui/),
I get the error message:  error code 0x80070005 ... any idea where to look ?
Nils

Something similar happens when you try to use Thinfinity with CEF4Delphi.
https://github.com/salvadordf/CEF4Delphi/issues/391
Thinfinity doesn't seem to allow the app to launch subprocesses. In the case of WebView2 the app executes several msedgewebview2.exe subprocesses.
My trial period is over and I can't keep testing. Can you run Chrome or Edge inside Thinfinity?


Issue 551

#551 Resolve issue 551. Add table_form of correlations and black reformat

@damianbrzoza This PR was closed automatically on merging the latest release in master. I'm happy to merge your changes once the comments are resolved!


Add way to define named-only parameters

I’ve been thinking for a while that some parameters of functions should only ever be passed using named arguments, to avoid confusion (my go-to example is assertEquals so you don’t have to remember the order of expected and actual, though that might be controversial), and whether there might be a way to enforce that.
Today I found out that Python has something like this, which motivated me to file this issue. It looks like this:
def compare(a, b, *, key=None):
    # ...

Any parameters after the bare asterisk cannot be passed as positional arguments – a TypeErrror is raised if you attempt to do so.
However, I don’t think that’s a very Ceylonic style, and I also find it very unreadable unless you already know the syntax. For Ceylon, I think an annotation would make much more sense:
function compare(Object a, Object b, named String? key = null) {
    // ...
}

Furthermore, since unlike Python we have a separate compilation step, I would make this a (suppressible) warning instead of a hard error. (In Python, the only alternative would be delegating this check to an external tool, which most people would never run.)
Specifying non-named parameters after named ones should probably be a warning as well.

I would prefer named annotation for parameters to indicate this.
It could also improve DSLs for building HTML/XML content -- if attributes would always be required to be called with named argument syntax, it would make the declarations look so much more closed to the markup language convention...


Component not loading inside Shadow DOM. Throws: Cannot read properties of null (reading 'offsetWidth')

Active table does not load and throws: TypeError Cannot read properties of null (reading 'offsetWidth')
Library: Lit
The active-table component fails to load inside the shadow dom.
Once I remove the shadow dom the component loads fine.
Reproduced the error here: Sandbox

duplicate #16


Support actions before/after upgrade

This commit included the following changes:

Update CRD to support adding/deleting cluster labels before
enable upgrade and after upgrade is completed
Move deleteResources action under "spec.actions.afterCompletion"
Update managedclusterForCGU controller to add proper label actions
in generated UOCR
Prevent managedClusterForCGU controller to generate UOCR when
ztp-done label applied to the cluster
Monitor delete action for owned UOCR so new UOCR can be automatically
created when the old one is deleted

This commit fixs Bug2038253 and Bug2040874
Signed-off-by: Angie Wang<EMAIL_ADDRESS>

@irinamihai @imiller0 @vitus133 @browsell

/retest-required

/retest-required

/retest-required

/retest-required

/retest-required

/retest-required

/retest-required

/retest-required


Support all possible values for test_result in full ELR

Problem statement
In HCA full ELR sample messages, OBX-5.1 (observation value) can be many more possible values than for COVID-19.  Our current value set is limited to those in covid-19/test_result now.  ReportStream needs to support any value supplied.
Example:
"details" : "Report 1: The code 112283007 for field OBX-5 is invalid."
"details" : "Report 1: The code 115329001 for field OBX-5 is invalid."
"details" : "Report 1: The code 3092008 for field OBX-5 is invalid."
"details" : "Report 1: The code 43492007 for field OBX-5 is invalid."
"details" : "Report 1: The code 77352002 for field OBX-5 is invalid."

112283007 is Escherichia coli
Acceptance criteria

[ ] ReportStream accepts all possible observation values.

So, in general, I think validating SNOMED and LOINC codes should be a lower priority if one at all. There are 10000s of these codes. They are updated all the time. It involves a lot of work.


Explicitly disable Style/AccessorMethodName for set_transaction_id

From #752.
This method is doing a lot more than just setting transaction_id for self, so to me it doesn't make sense to rename it to transaction_id=.

This method is doing a lot more than just setting transaction_id for self, so to me it doesn't make sense to rename it to transaction_id=.

If it weren't an AR model, I'd be OK with transaction_id=. I don't like overriding attribute mutator methods in activerecord.
How about update_transaction_id? It hints at the save.
Renaming this method is not a breaking change.
I'd rather not use linter comments, if possible.

Closed by https://github.com/airblade/paper_trail/pull/763


Case endpoint added

endpoint for case adding
minor fixes

Existing problem: bug with history additg to database

Hello @nicl-nno! Thanks for opening this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file app/api/composer/schema.py:

Line 12:58: W292 no newline at end of file


Issues producing to Pulsar

We're seeing issues with producing to one of our clusters running Pulsar 2.4.0.
The chart below shows the occurrences of errors producing to the cluster.

While looking through the logs, we see:
org.apache.pulsar.broker.loadbalance.impl.LeastLongTermMessageRate - Broker x is overloaded
org.apache.pulsar.broker.loadbalance.impl.OverloadShedder - Broker x is overloaded despite having no bundles
We got a thread dump. It's quite large, and it appears that almost all of the threads are in a WAITING (parking) state.
The thread dump file is attached.
thread-dump-broker07.txt

Closed as stale. Please create a new issue if it's still relevant to the maintained versions.


Handle publishers sending no data at all

We need to handle this to be able to close the stream without adding anything to it, which errors out as we get an EOF in the discard.
See https://rollbar.com/Heroku-3/busl/items/39/

Closing. #134 should be enough for our current need.


Will this increase the user's data flow ？

I like this view very much ,but I have some problems too.
As there have an extra image to be downloaded ,will this increase data flow usage?How this view resolve this problem ?
I am wondering is there anyway for the client to detect the image info and download as scream ? Not the service return two set images?

Cool, These are good questions!
Q1: As there have an extra image to be downloaded ,will this increase data flow usage?How this view resolve this problem?
A1: Yes, this way of loading pic do increase data flow usage. For BlurImageView now, it doesn't do anything about this. But Let's be clear of the condition when this view is being used.
First, if you decide to use this view, that means you have harsh demand for high quality and big size image, which takes normally 200KB - 400KB (this range depends on yourself, like this one). For 2G user (network speed ranges from 10KB/s - 25KB/s) This loading needs 15s+, For 3G user (100KB/s - 200KB/s), still needs 1.5s - 2s. So you can negotiation with yourself based on the best user experience.
Second, the size of small pic which will be loaded firstly often is very low like this one, Its size is 0.8KB, It's very fast and low-costing to load this pic, But it can really improve user experience especially when user has bad network or the real image has very big size.
So, you should choose to use BlurImageView based on condition.
Q2:  is there anyway for the client to detect the image info and download as scream ? Not the service return two set images?
A2: It's a good question. Actually I'm also learn the Progressive loading image. Recommend this article to you Faster Photos in Facebook for iOS. This way only needs to load once, but it's kinds of difficulty to understand.
Thx for your question.

@wingjay Thanks for your explanation , I read that post , but still can't find the best way to achieve this good feature in android . I am still learning too . :smile:


ComputeMolVolume of Methane Error Question

Hi all. I'm looking to calculate the molecular volume for methane and I keep getting an error. Hoping someone can point out my mistake.

RDKit Version: 2017.09.3
Platform: MacOS, python3.6

m = Chem.MolFromSmiles('C')
m =Chem.AddHs(m)
AllChem.EmbedMolecule(m)
AllChem.ComputeMolVolume(m, confId=0)

RuntimeError: Invariant Violation

	Violation occurred on line 293 in file Code/GraphMol/MolTransforms/MolTransforms.cpp
	Failed Expression: dim >= 1
	RDKIT: 2017.09.3
	BOOST: 1_63

The problem is in CanonicalizeConformer()

It also seems to fail for water, ammonia, and any other single-heavy atom molecule.

yeah, I found that too

Ah, ok, this is easy to fix.
CanonicalizeConformer() ignores Hs by default.


Fix ClusterClaim deletion webhook bug

After K8s 1.16, the req.Object in a deletion request is empty, and only req.OldObject will be provided, so change the ClusterClaim webhook to decode OldObject if it is a deletion operation.
This will fix a bug that ClusterCliam is unable to be deleted with the below error:
Error from server: error when deleting "clusterclaims.yaml": admission webhook
"vclusterclaim.kb.io" denied the request: there is no content to decode

/test-multicluster-e2e

@jianjuns  could you help to review this PR? I think we need backport this fix. Thanks.

Yeah,  e2e doesn't cover deletion part, I have created an issue to improve the e2e with antctl #5084, the deletion command test should be able to help on this.

/skip-all


Install with quickstart of angualr

Please, I need a little tutorial for installing with angular quickstart

I recommend you to use AngularCLI to start a new projet. It will be much easier to add ng2-materialze.
https://github.com/angular/angular-cli


[Feature] sparse_tensor_dense_matmul with two SparseTensor

Would it be possible to implement matrix multiplication between two SparseTensor?
Currently, it's possible to multiply two dense Tensor with many zeros using the X_is_sparse parameter of tf.matmul, and a SparseTensor with a Tensor using tf.sparse_tensor_dense_matmul.
However, with some datasets it is impossible to store dense matrices in memory and it would be great if we could have the option of fully sparse multiplication.
Thanks,
Daniele

@ebrevdo @rmlarsen : Do you know if anyone is planning to add this?

Another thing I would like to add is that it would be awesome if there would be an option to return a SparseTensor instead of a Tensor, I am doing normalization of a SparseTensor with tf.sparse_tensor_dense_matmul but this results in a dense Tensor with the same shape as the SparseTensor, which makes the whole SparseTensor obsolete.

We are looking into sparse-sparse matmuls but won't have anything available
in the near future.  If we do, it won't be
called sparse_tensor_dense_matmul.
On Jun 27, 2017 4:09 AM, "wbwvos"<EMAIL_ADDRESS>wrote:

Another thing I would like to add is that it would be awesome if there
would be an option to return a SparseTensor instead of a Tensor, I am
doing normalization of a SparseTensor with tf.sparse_tensor_dense_matmul
but this results in a dense Tensor with the same shape as the SparseTensor,
which makes the whole SparseTensor obsolete.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/10375#issuecomment-311326800,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABtim6yX-MdU4x4BaO7qPB0GNi-Eba-Yks5sIOLcgaJpZM4NtKgf
.

Sparse matrix multiply another sparse matrix. The implementation should be simpler than "sparse X dense". It is so strange that the former does not exist in TF but later one exists.

It has been 14 days with no activity and the awaiting tensorflower label was assigned. Please update the label and/or status accordingly.

+1

+1

Yes; at this point I'd say this is a "contributions welcome" since no one
is actively working on this.
On Fri, Feb 16, 2018 at 11:26 AM, Pierre Lison<EMAIL_ADDRESS>wrote:

+1
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/10375#issuecomment-366334441,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABtim0Sr3_4EMQo1ascqkB3KDVOPdn18ks5tVdZtgaJpZM4NtKgf
.

+1

+1

+1

+1

+1

+1

Hi, I'm just checking back after a few months.
I am starting to look into developing this on my own, if anybody has any suggestions they are more than welcome (maybe @ebrevdo can help). I'm a total C++ noob but I'll try to edit some existing ops in order to reuse boilerplate code.
Is this a good starting point (sparse_tensor_dense_matmul_op.cc/cu.cc/h)?
I was thinking that maybe all that's needed is to convert the sparse inputs to a format supported by cuSPARSE and let it handle the multiplication. Would that be a possible approach?
Thanks

We do have a sparse matrix TF library that uses cuSparse; and it does have
this functionality.  We hope to move it into tf.linalg.experimental
sometime this year.
On Thu, May 2, 2019 at 2:24 AM Daniele Grattarola<EMAIL_ADDRESS>wrote:

Hi, I'm just checking back after a few months.
I am starting to look into developing this on my own, if anybody has any
suggestions they are more than welcome (maybe @ebrevdo
https://github.com/ebrevdo can help). I'm a total C++ noob but I'll try
to edit some existing ops in order to reuse boilerplate code.
Is this
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/kernels/sparse_tensor_dense_matmul_op.cc
a good starting point (sparse_tensor_dense_matmul_op.cc/cu.cc/h)?
I was thinking that maybe all that's needed is to convert the sparse
inputs to a format supported by cuSPARSE and let it handle the
multiplication. Would that be a possible approach?
Thanks
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/10375#issuecomment-488607403,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AANWFG5DV2TMBLLTIDDCN5DPTKXLFANCNFSM4DNUVAPQ
.

class GraphConvolutionSparse(Layer):
"""Graph convolution layer for sparse inputs."""
def __init__(self, input_dim, output_dim, adj, features_nonzero, dropout=0., act=tf.nn.relu, **kwargs):
	super(GraphConvolutionSparse, self).__init__(**kwargs)
	with tf.variable_scope(self.name + '_vars'):
		self.vars['weights'] = weight_variable_glorot(input_dim, output_dim, name="weights")
	self.dropout = dropout
	self.adj = adj
	self.act = act
	self.issparse = True
	self.features_nonzero = features_nonzero

def _call(self, inputs):
	x = inputs
	x = dropout_sparse(x, 1 - self.dropout, self.features_nonzero)
	x = tf.sparse_tensor_dense_matmul(x, self.vars['weights'])  # X W
	x = tf.sparse_tensor_dense_matmul(self.adj, x)  # A X W
	outputs = self.act(x)
	return outputs

I am working on GCN (Graph Convolutional Network). My graph data has more than 1 million nodes. When I run this model, I meet a memory explosion which will kill my process. But once I reduce the size of the graph, it works well. So my question is: is there any solution to the large-scale matrix multiplication? I am stuck here, please help me! Thanks!

class GraphConvolutionSparse(Layer):
"""Graph convolution layer for sparse inputs."""
def __init__(self, input_dim, output_dim, adj, features_nonzero, dropout=0., act=tf.nn.relu, **kwargs):
	super(GraphConvolutionSparse, self).__init__(**kwargs)
	with tf.variable_scope(self.name + '_vars'):
		self.vars['weights'] = weight_variable_glorot(input_dim, output_dim, name="weights")
	self.dropout = dropout
	self.adj = adj
	self.act = act
	self.issparse = True
	self.features_nonzero = features_nonzero

def _call(self, inputs):
	x = inputs
	x = dropout_sparse(x, 1 - self.dropout, self.features_nonzero)
	x = tf.sparse_tensor_dense_matmul(x, self.vars['weights'])  # X W
	x = tf.sparse_tensor_dense_matmul(self.adj, x)  # A X W
	outputs = self.act(x)
	return outputs

I am working on GCN (Graph Convolutional Network). My graph data has more than 1 million nodes. When I run this model, I meet a memory explosion which will kill my process. But once I reduce the size of the graph, it works well. So my question is: is there any solution to the large-scale matrix multiplication? I am stuck here, please help me! Thanks!

PS: the X inputs in the code is super large.

@chaoyanghe Hmm, facing the exact same problem on GCN.

+1. I'm facing same problem on GCN . Although the memory of my GPU is 24gb, it's still not enough to apply a dense tensor of adjacent matrix to execute calculation.

@danielegrattarola Is there any progress on this? I also need this functionality and would be willing to assist you in developing it. I also have some prior experience with developing new tf-ops. Let me know if I can assist you

@chpohl I gave up after @ebrevdo told me that they already have the functionality implemented, but it never got released.
Unfortunately, TF2 and the new Keras broke most practical uses of sparse matrices, so I don't think the the tf devs have any interest in supporting the feature moving forward.
If you want to implement sparse-sparse matmul for some older version of TF drop me an email, maybe we can look at it together.

It's available in tf2 nightlies under the tf.linalg.experimental module
On Sat, Nov 2, 2019, 4:34 PM Daniele Grattarola<EMAIL_ADDRESS>wrote:

@chpohl https://github.com/chpohl I gave up after @ebrevdo
https://github.com/ebrevdo told me that they already have the
functionality implemented, but it never got released.
Unfortunately, TF2 and the new Keras broke most practical uses of sparse
matrices, so I don't think the the tf devs have any interest in supporting
the feature moving forward.
If you want to implement sparse-sparse matmul for some older version of TF
drop me an email, maybe we can look at it together.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/10375?email_source=notifications&email_token=AANWFG42DJNBCOFX556DYPDQRYFAHA5CNFSM4DNUVAP2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEC5HJYY#issuecomment-549090531,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AANWFGYSLXJE2FJ6RI4DT23QRYFAHANCNFSM4DNUVAPQ
.

Thanks @ebrevdo! I'll close the issue.

I just install tf-nightly-gpu and cannot find a tf.linalg.experimental module. Do you mean the functionality under tensorflow.python.ops.linalg.sparse ? When I read it correctly, the matmul there supports both sparse inputs.


flexget: 2.17.20 -> 2.20.17

Motivation for this change
use python37
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Assured whether relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

cc @sjau @agentpt5

This breaks a test of python2.pkgs.cherrypy. I have no idea why.
=================================== FAILURES ===================================
__________________________ BusMethodTests.test_block ___________________________

self = <cherrypy.test.test_bus.BusMethodTests testMethod=test_block>

    def test_block(self):
        b = wspbus.Bus()
        self.log(b)

        def f():
            time.sleep(0.2)
            b.exit()

        def g():
            time.sleep(0.4)
        threading.Thread(target=f).start()
        threading.Thread(target=g).start()
        threads = [t for t in threading.enumerate() if not t.daemon]
        self.assertEqual(len(threads), 3)

        b.block()

        # The block method MUST wait for the EXITING state.
        self.assertEqual(b.state, b.states.EXITING)
        # The block method MUST wait for ALL non-main, non-daemon threads to
        # finish.
        threads = [t for t in threading.enumerate() if not t.daemon]
        self.assertEqual(len(threads), 1)
        # The last message will mention an indeterminable thread name; ignore
        # it
        self.assertEqual(self._log_entries[:-1],
                         ['Bus STOPPING', 'Bus STOPPED',
                          'Bus EXITING', 'Bus EXITED',
>                         'Waiting for child threads to terminate...'])
E       AssertionError: Lists differ: ['Bus STOPPING', 'Bus STOPPED'... != ['Bus STOPPING', 'Bus STOPPED'...
E
E       First differing element 3:
E       'Waiting for child threads to terminate...'
E       'Bus EXITED'
E
E       First list contains 1 additional elements.
E       First extra element 5:
E       'Bus EXITED'
E
E         ['Bus STOPPING',
E          'Bus STOPPED',
E          'Bus EXITING',
E       +  'Bus EXITED',
E       -  'Waiting for child threads to terminate...',
E       ?                                             ^
E
E       +  'Waiting for child threads to terminate...']
E       ?                                             ^
E
E       -  'Waiting for thread Thread-23.',
E       -  'Bus EXITED']

cherrypy/test/test_bus.py:223: AssertionError

I guess these test are just very fragile.

@GrahamcOfBorg build python2.pkgs.cherrypy python3.pkgs.cherrypy


Cake for Visual Studio 2017

Please, update Cake extension (https://marketplace.visualstudio.com/items?itemName=vs-publisher-1392591.CakeforVisualStudio) for VS 2017

Issue moved to cake-build/cake-vs #69 via ZenHub


[Bug] 在jdk21下，可以启动fe，无法启动be

Search before asking

[X] I had searched in the issues and found no similar issues.

Version
2.1.0
What's Wrong?
在jdk21下，可以启动fe，无法启动be
centos7 x86
adoptium 21.0.1+12-LTS
INFO: java_cmd /opt/jdk-21.0.1+12/bin/java
INFO: jdk_version 21
Picked up JAVA_TOOL_OPTIONS: -Xmx500m
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-2.1.0-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-2.1.0-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-2.1.0-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
*** Query id: 0-0 ***
*** tablet id: 0 ***
*** Aborted at<PHONE_NUMBER> (unix time) try "date -d @1711985086" if you are using GNU date ***
*** Current BE git commitID: 91efb6a43d ***
*** SIGSEGV address not mapped to object (@0x0) received by PID 30231 (TID 30275 OR 0x7f00c0dff700) from PID 0; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:417
1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /opt/jdk-21.0.1+12/lib/server/libjvm.so
2# JVM_handle_linux_signal in /opt/jdk-21.0.1+12/lib/server/libjvm.so
3# 0x00007F0149B49400 in /lib64/libc.so.6
4# je_arena_dalloc_promoted at ../src/arena.c:1277
5# je_free_default at ../src/jemalloc.c:3014
6# __pthread_create_2_1 in /lib64/libpthread.so.0
7# os::create_thread(Thread*, os::ThreadType, unsigned long) in /opt/jdk-21.0.1+12/lib/server/libjvm.so
8# CompilerThread::CompilerThread(CompileQueue*, CompilerCounters*) in /opt/jdk-21.0.1+12/lib/server/libjvm.so
9# CompileBroker::make_thread(CompileBroker::ThreadType, _jobject*, CompileQueue*, AbstractCompiler*, JavaThread*) [clone .constprop.0] in /opt/jdk-21.0.1+12/lib/server/libjvm.so
10# CompileBroker::possibly_add_compiler_threads(JavaThread*) in /opt/jdk-21.0.1+12/lib/server/libjvm.so
11# CompileBroker::compiler_thread_loop() in /opt/jdk-21.0.1+12/lib/server/libjvm.so
12# JavaThread::thread_main_inner() in /opt/jdk-21.0.1+12/lib/server/libjvm.so
13# Thread::call_run() in /opt/jdk-21.0.1+12/lib/server/libjvm.so
14# thread_native_entry(Thread*) in /opt/jdk-21.0.1+12/lib/server/libjvm.so
15# start_thread in /lib64/libpthread.so.0
16# clone in /lib64/libc.so.6
What You Expected?
正常启动
How to Reproduce?
No response
Anything Else?
No response
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I have the same problem using jdk11

fe可以用java21，be有问题，还是用8吧，别折腾了
fe can use java21, be a problem, or use 8, don't toss

I have the same problem using jdk11

I have the same problem using jdk17


chore: refine source manager

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.
What's changed and what's your intention?
as title
Checklist
~- [ ] I have written necessary rustdoc comments~
~- [ ] I have added necessary unit tests and integration tests~
~- [ ] All checks passed in ./risedev check (or alias, ./risedev c)~
Documentation
If your pull request contains user-facing changes, please specify the types of the changes, and create a release note. Otherwise, please feel free to remove this section.
Types of user-facing changes
Please keep the types that apply to your changes, and remove those that do not apply.

Installation and deployment
Connector (sources & sinks)
SQL commands, functions, and operators
RisingWave cluster configuration changes
Other (please specify in the release note below)

Release note
Please create a release note for your changes. In the release note, focus on the impact on users, and mention the environment or conditions where the impact may occur.
Refer to a related PR or issue link (optional)

@mergifyio requeue


Showcase Removal Notice

Hello friends of Tauri,
With the upcoming v1 release and accompanying overhaul of the https://tauri.studio website, we will be removing the showcase section in favor of Awesome Tauri.
If you want to keep your project featured, please submit it to that list instead, but please note the rules for submissions have changed.
Thank you for all your support in getting Tauri to this point!
Jonas,
the Tauri team

thank you for your notice


started new page for the bridge event

@etrepum , can you help me out with sizing? I'm a bit confused about how the sizing works on the logos.

@etrepum, there is also this weird behavior for the page on Safari. The same thing happens on the 2020 page as well. (Second Screenshot)


Is mmdetection prediction on CPU possible??

Hello,
In mmdetection, tools/test.py uses single_gpu_test and multi_gpu_test for the prediction. I would like to do it on CPU only. Is it possibe to use CPU for test.py for mmdetection prediction?
Thank you in advance for your answer!

Yes, you can use PyTorch-CPU and re-build mmcv with CPU if you want to use the ops in mmcv.
We did not deliberately go to be compatible with the CPU, but theoretically, it can be tested with the CPU.


Convention for error reporting and aborting

It would be nice to have some agreed upon convention on when to use which kind of error reporting:
https://github.com/effekt-lang/effekt/blob/430369f402d78abdc70486ad8d38d54a8cb24060/effekt/shared/src/main/scala/effekt/util/Messages.scala#L115-L134
When should something abort? When should something panic? When to just report an error?
Related to this, what is the contract of calling a run function of phase? Should the caller check whether the previous phase reported an error by check if it returned None and then abort/panic, or rather should each phase (callee) handle their own errors appropriately and in turn do not return Option[A] but just A?
class  SomePhase extends Phase[A, B] {
  def run(...)(using ctx: Context): Option[B] = {
    // ...
    ctx.report(...)
    None
  }
}

// or rather

class SomePhase1 extends Phase[A, B] {
  def run(...)(using ctx: Context): B = {
    // ...
    ctx.abort(...)
  }
}

Given that in Phase, we have
def apply(input: In)(using C: Context): Option[Out] = try {
    run(input)
  } catch {
    case FatalPhaseError(msg) =>
      C.report(msg)
      None
  }

what about we change
def run(input: In)(using C: Context): Option[Out]
def run(input: In)(using C: Context): Out // can throw FatalPhaseError using `abort`.

?


add macos ci tests

No need to add this for a Python project. NEURON dependency is already tested across multiple platforms.


Unable to use Azure Key Vault Secret Provider in China

When initializing a stack with
pulumi up --secrets-provider https://<keyvault_name>.vault.azure.cn/keys/<keyname>

I got the following error
error: invalid keyID "https://<keyvault_name>.vault.azure.cn/keys/<keyname>"; must match ^(https://.+\.vault\.azure\.net/)keys/(.+)$ []
(This was a useful error message. Was very clear.)
This seems like a valid secrets provider if we can change the regex to include .cn.

It looks like that error is coming from the go-cloud library that we use for this - https://github.com/google/go-cloud/blob/master/secrets/azurekeyvault/akv.go#L237-L240.
And specifically the regex they use for validation does not allow for azure.cn - https://github.com/google/go-cloud/blob/master/secrets/azurekeyvault/akv.go#L211.

It would make sense to enable all possible clouds for this:
*.vault.usgovcloudapi.net
*.vault.azure.net
*.vault.azure.cn


Feature :: Delete step

Delete a step when clicking on its trash icon.
Closes https://github.com/ToucanToco/vue-query-builder/issues/39

Codecov Report

Merging #138 into master will decrease coverage by 0.43%.
The diff coverage is 88.23%.

@@            Coverage Diff            @@
##           master    #138      +/-   ##
=========================================
- Coverage   93.83%   93.4%   -0.44%
=========================================
  Files          17      17
  Lines         373     379       +6
  Branches       55      56       +1
=========================================
+ Hits          350     354       +4
- Misses         14      15       +1
- Partials        9      10       +1

Impacted Files
Coverage Δ

src/components/DataViewer.vue
100% <ø> (ø)
:arrow_up:

src/store/backend-plugin.ts
71.42% <0%> (-11.91%)
:arrow_down:

src/components/Pipeline.vue
94.44% <100%> (ø)
:arrow_up:

src/store/mutations.ts
84.61% <100%> (+1.28%)
:arrow_up:

src/components/Step.vue
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1eb9b69...1102d97. Read the comment docs.


Forseti Slack invite link expired

The Forseti slack link has expired and needs to be updated.

New version of website has been published.


📝 Correct typo in Readme

Hi friends! Hope you are well 🎄🎅
I am assuming that there isn't a gem called apprasials separate from appraisals and that this is a typo.

Thanks!


Version numbering out of sync between client and server?

I notice the Microsoft.AspNetCore.SignalR nuget package is 1.0.1, while the latest npm package is 1.0.0.  One issue I've had in the past is where the version numbers are out of sync and the client stops communicating with the server (or vice-versa.) Was having these out of sync intentional, because to me, even if there were no changes in one or the other, the version numbers should be kept in sync so that there isn't confusion about whether your versions match or not.

The requirement that the client and server versions match applies to preview builds only. In general, we expect released builds of the client to work with any released build of the server (at this time).
There were no changes to the JS client in 1.0.1 so we didn't ship a new version, that's been our pattern for most things in ASP.NET Core since the beginning. We could certainly consider a different strategy for this NPM package, but in general we've been sticking with what we've done elsewhere.

We periodically close 'discussion' issues that have not been updated in a long period of time.
We apologize if this causes any inconvenience. We ask that if you are still encountering an issue, please log a new issue with updated information and we will investigate.


Improve the error message if publish is false or empty list

What does this PR try to resolve?
close https://github.com/rust-lang/cargo/issues/11262
Improve the error message if publish is the false or empty list.
Say publish is set to false or an empty list in Cargo.toml and prevents publishing.
How should we test and review this PR?
Unit test
Additional information
If there was a way we could tell publish to be empty or false, I think it would get better. If you know an easy way to implement it, please feel free to comment.

r? @epage
(rust-highfive has picked a reviewer for you, use r? to override)

If there was a way we could tell publish to be empty or false, I think it would get better. If you know an easy way to implement it, please feel free to comment.

I think we can use VecStringOrBool for public, but I  am not sure does it make sense to use it in the Manifest struct.

Thanks!
@bors r+

:hourglass: Testing commit 6c9f36d99b6ff774f1619c9a44b509079cc0024d with merge 19d37d29b1a2e093116bfcc7f9327aa04c07a44c...


How to modify the number of the anchors and Aspect ratio

Hi,thank you for your contribution,i want to know is it possible to modify the number of the anchors and aspect ratio? thanks.

Are you referring to YOLO models?
If so, the answer is yes.  My code would read anchor values from the cfg file and build TensorRT YOLO  engines accordingly.


Non intuitive behaviour of Tokenizer

Tokenizer fails in a way that is not intuitive to the user. Pls refer example below
from txtai.tokenizer import Tokenizer

Tokenizer.tokenize("abc")
# output -> ["abc"]
Tokenizer.tokenize("12c")
# output -> []
Tokenizer.tokenize("c12")
# output -> ["c12"]

Looking at the source comments one would believe that 12c will be tokenized and matched.
# Require strings to be at least 2 characters long.
# Require at least 1 alpha character in string.

At the least, user should be warned that tokenizer did not match the string & hence returned a blank.
Possible rectification:
\d{0,1}\d*[a-z]([\-.0-9:_a-z]{1,})*$
The assumptions of Tokenizer should also be clearer in the main documentation.

Thank you for reporting this! I've corrected the documentation in the source code and added a note regarding the tokenizer to the README. A couple of similar issues (#39 and #43) were similar in nature regarding the tokenizer but I failed to update the documentation.
While the tokenizer is enabled by default, it is designed to work against standard English text. In other cases, it's best to disable the tokenizer (non-English transformer models) or use a custom tokenizer (for word embedding models).

Thanks for prompt response & action.


Increase ruff usage by ASDF

This PR enables ruff to use all its builtin checks, not just its default checks. This will overlap with some of the other pre-commit hooks. However, 100% coverage of the current tools we are using is not guaranteed, so I am leaving those out for now.
Note that some of the builtin checks have been manually turned off, but by default any new checks added to ruff will be applied to ASDF when the pre-commit gets updated. This is so we can recognize and decide if those checks should be included/fixed as they occur in a semi-automated fashion.
Not all the fixes are entirely automated, so I suggest we review this for style closely.

pre-commit.ci autofix

@braingram and @eslavich would this PR be easier to review if I broke it into incremental changes? That is, introducing each new set of checks which requires fixes as a separate PR.

Breaking this up would certainly be helpful.

Moving this to a draft to better track all the PRs @braingram's comment leads to

I'm seeing all the remaining PRs that were split from this PR as draft.
I would like to mark them all as approved. Is it easier to revive this PR?

I'm seeing all the remaining PRs that were split from this PR as draft.

They are draft because they need to be merged one at a time. There should be one out of draft at a time

I would like to mark them all as approved. Is it easier to revive this PR?

I linked back to this PR just so I would have a convenient ordered list to reference. Feel free to use this PR in the same way.

Can we just move them all out of draft so I can review them in one go rather than waiting for each one to be merged?

Can we just move them all out of draft so I can review them in one go rather than waiting for each one to be merged?

Sure, they are in draft only to prevent accidental mergers.


feature - adding watchdog data to SF profile data collector

Add watchdogs data to Profile DataCollection :

list of defined watchdogs
for each of those, list of date config
visualy indicate if there is a match on some piece of this config ("disabled" grey vs. green)

resolved with  #9


CSV records have a variable number of fields

CSV records have a variable number of fields. I assume the missing fields for any given record are suppose to be empty fields.
For example records with type 20 and 23 have a differing number of fields. And neither of them have the 22 fields I would expect based upon the header.
365,1,+1XXXXXXXXXX,1,97,1522112554906,1522112554906,0,1,-1,20,0,0,It's ok. Not too bad ,+12819659999,-1,0,0,0,0
366,1,+1XXXXXXXXXX,1,1522111363707,1522111363707,1,-1,23,0,How is the job going?,-1,0,0,0,0

I'm pretty sure I've identified why this is happening and was an oversight on my part. The fix should be coming within the next few hours.

I've pushed a new release to hopefully fix this. If it doesn't fix the issue, feel free to re-open and I'll have another look.