Module Support for PasswordState 8 Active Directory Authentication

Module Support for PasswordState 8 Active Directory Authentication
Topic
Hello -
I wanted to start a discussion topic on support for AD auth now that it is a feature that PasswordState 8 supports.
I would imagine there would need to be support for both methods (both API keys and the newer AD auth) as some organizations might use them side by side, or opt to stick with API keys possibly in an environment without AD.  I wasn't sure if there was any plans to add the new functionality to this module but it seems to be the most popular one for PasswordState (and my favorite as well :) ).
High Level Solution
Unless I'm over simplifying it I would think this could be accomplished with parameter sets on the functions.  One that takes the API key still and another that would take -Credential, and possibly a 3rd that would take -UseDefaultCredentials.
In the past for other Invoke-RestMethod based API wrappers I've built a splat based on the parameter sets to feed a single command and could maybe leverage that design.
Overall just wanted to start a convorsation on the idea!

I think that's a great idea!
Yes, multiple parameters sets like you mentioned would be the way to go. Probably also create a private function that actually implements Invoke-RestMethod to centralize any logic needed. All public functions would call the private one. That is the model I use for my NetScaler module.
Is this something you'd like to tackle?

Great!  I'd be willing to give it a go.  I do like the model you use with the private function to centralize the logic.

I've had some time to start digging into this lately.  One thing that is a little tricky especially regarding implementing a private function to feed Invoke-RestMethod is the compatibility for the V6 API.  I have never used it myself, we've been at v7 since we've had the product.  I can implement it, I'll just need to try and figure out the most graceful way to handle WinAPI vs APIKey vs v6APIKey.
Maybe 3 separate parameter sets on the private function?  I was also wondering if it made sense to store them as different option sets in the options file and have _GetDefault return a little more possibly?
Wanted to bounce if off you / whoever else uses this module to see what your thoughts were!


[Broken] [YouTube] ERROR: Unable to download webpage: HTTP Error 429: Too Many Requests

Checklist

[X] I'm reporting a broken site support
[X] I've verified that I'm running yt-dlp version 2021.09.02
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones

Verbose log

C:\Users\Jondo>yt-dlp --verbose https://www.youtube.com/channel/UC64UiPJwM_e9AqAd7RiD7JA
[debug] User config file: C:\Users\Jondo\AppData\Roaming\yt-dlp\config.txt
[debug] User config:
[debug] Command-line config: ['--verbose', 'https://www.youtube.com/channel/UC64UiPJwM_e9AqAd7RiD7JA']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] yt-dlp version 2021.09.02 (exe)
[debug] Python version 3.8.10 (CPython 64bit) - Windows-10-10.0.19042-SP0
[debug] exe versions: ffmpeg 2021-09-08-git-5e7e2e5031, ffprobe 2021-09-08-git-5e7e2e5031
[debug] Optional libraries: mutagen, pycryptodome, sqlite, websockets
[debug] Proxy map: {}
[debug] [youtube:tab] Extracting URL: https://www.youtube.com/channel/UC64UiPJwM_e9AqAd7RiD7JA
WARNING: [youtube:tab] A channel/user page was given. All the channel's videos will be downloaded. To download only the videos in the home page, add a "/featured" to the URL
[youtube:tab] UC64UiPJwM_e9AqAd7RiD7JA: Downloading webpage
ERROR: [youtube:tab] UC64UiPJwM_e9AqAd7RiD7JA: Unable to download webpage: HTTP Error 429: Too Many Requests (caused by <HTTPError 429: 'Too Many Requests'>); please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; see  https://github.com/yt-dlp/yt-dlp  on how to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
  File "yt_dlp\extractor\common.py", line 693, in _request_webpage
  File "yt_dlp\YoutubeDL.py", line 3218, in urlopen
  File "urllib\request.py", line 531, in open
  File "urllib\request.py", line 640, in http_response
  File "urllib\request.py", line 563, in error
  File "urllib\request.py", line 502, in _call_chain
  File "urllib\request.py", line 755, in http_error_302
  File "urllib\request.py", line 531, in open
  File "urllib\request.py", line 640, in http_response
  File "urllib\request.py", line 569, in error
  File "urllib\request.py", line 502, in _call_chain
  File "urllib\request.py", line 649, in http_error_default

Description

I'm trying to download a channel but i'm getting the error above, the channel is accessible for me on the browser and i'm able to play all the videos, i have successfully downloaded some videos from another channel earlier today and it worked without issues.
Tried both, with and without cookies, no difference.
When i try to download only one video, there are no issues.

Here's an example:
C:\Users\Jondo>yt-dlp --verbose https://www.youtube.com/watch?v=65YNgr8cN4o
[debug] User config file: C:\Users\Jondo\AppData\Roaming\yt-dlp\config.txt
[debug] User config:
[debug] Command-line config: ['--verbose', 'https://www.youtube.com/watch?v=65YNgr8cN4o']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] yt-dlp version 2021.09.02 (exe)
[debug] Python version 3.8.10 (CPython 64bit) - Windows-10-10.0.19042-SP0
[debug] exe versions: ffmpeg 2021-09-08-git-5e7e2e503, ffprobe 2021-09-08-git-5e7e2e5031
[debug] Optional libraries: mutagen, pycryptodome, sqlite, websockets
[debug] Proxy map: {}
[debug] [youtube] Extracting URL: https://www.youtube.com/watch?v=65YNgr8cN4o
[youtube] 65YNgr8cN4o: Downloading webpage
WARNING: [youtube] Unable to download webpage: HTTP Error 429: Too Many Requests
WARNING: [youtube] Cannot extract signature timestamp without player_url.
[youtube] 65YNgr8cN4o: Downloading android player API JSON
WARNING: [youtube] Cannot extract signature timestamp without player_url.
[youtube] 65YNgr8cN4o: Downloading web player API JSON
[debug] Sort order given by user: br
[debug] Sort order given by extractor: quality, res, fps, source, codec:vp9.2, lang
[debug] Formats sorted by: hasvid, ie_pref, tbr, vbr, abr, quality, res, fps, source, vcodec:vp9.2(10), acodec, lang, filesize, fs_approx, asr, proto, vext, aext, hasaud, id
[youtube] 65YNgr8cN4o: Downloading initial data API JSON
[info] 65YNgr8cN4o: Downloading 1 format(s): 137+140
[debug] Invoking downloader on "https://r10---sn-uxaxovg-vnaee.googlevideo.com/videoplayback?expire=1631163883&ei=i0E5YeiYOsmmyAWJq7WAAQ&ip=<IP_ADDRESS>&id=o-AErv5NXwUJAQkDME_f1_x6-jo3VkizlKMJjJ3X9dtlw2&itag=137&source=youtube&requiressl=yes&mh=OP&mm=31%2C29&mn=sn-uxaxovg-vnaee%2Csn-5go7yne6&ms=au%2Crdu&mv=m&mvi=10&pcm2cms=yes&pl=21&initcwndbps=1690000&vprv=1&mime=video%2Fmp4&gir=yes&clen=125738528&dur=470.499&lmt=1625761636219639&mt=1631142043&fvip=1&keepalive=yes&fexp=24001373%2C24007246&c=ANDROID&txp=5535432&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRAIgNEZ8zh_Bmi1g1YZy1I8OgUTXEbFcpivwbENhdzzbqN0CIHvFndBXRTZb-AlmfFYj7S5Uiw2KG9d9CEd26K8mROP1&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpcm2cms%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRAIgbWWqY46Z5m8GGJRD29BVtXTe0rsHTU3yqdu2kZINvmACIGfP5rZ_Gln7qu9tsLR21r57Dp9Zr2rpLg3KIJbg72VQ"
[download] Destination: C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.f137.mp4
[download] 100% of 119.91MiB in 00:25
[debug] Invoking downloader on "https://r10---sn-uxaxovg-vnaee.googlevideo.com/videoplayback?expire=1631163883&ei=i0E5YeiYOsmmyAWJq7WAAQ&ip=<IP_ADDRESS>&id=o-AErv5NXwUJAQkDME_f1_x6-jo3VkizlKMJjJ3X9dtlw2&itag=140&source=youtube&requiressl=yes&mh=OP&mm=31%2C29&mn=sn-uxaxovg-vnaee%2Csn-5go7yne6&ms=au%2Crdu&mv=m&mvi=10&pcm2cms=yes&pl=21&initcwndbps=1690000&vprv=1&mime=audio%2Fmp4&gir=yes&clen=7616130&dur=470.552&lmt=1625761196712504&mt=1631142043&fvip=1&keepalive=yes&fexp=24001373%2C24007246&c=ANDROID&txp=5531432&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRAIfFYM9s5K1J5yrZuN9qV27yVpFAvvkXNOx0LiGWRnQWQIhAMGp3IKHgElFkeRTYUnu3hQpOhnAdHVBkd9mkbNNxxda&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpcm2cms%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRAIgbWWqY46Z5m8GGJRD29BVtXTe0rsHTU3yqdu2kZINvmACIGfP5rZ_Gln7qu9tsLR21r57Dp9Zr2rpLg3KIJbg72VQ"
[download] Destination: C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.f140.m4a
[download] 100% of 7.26MiB in 00:00
[Merger] Merging formats into "C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel "repeat+info" -i "file:C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.f137.mp4" -i "file:C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.f140.m4a" -c copy -map "0:v:0" -map "1:a:0" "file:C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.temp.mp4"
Deleting original file C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.f137.mp4 (pass -k to keep)
Deleting original file C:\Users\Jondo\Desktop\Surviving the Sahara Desert with the World's Loneliest Tree 65YNgr8cN4o 08-07-2021.f140.m4a (pass -k to keep)

Can't reproduce
Might be solved by https://github.com/yt-dlp/yt-dlp/pull/860?

Unable to download webpage: HTTP Error 429: Too Many Requests

You are temporary blocked (probably by IP) from the YouTube webpage, but not from the API.
The video download works because we have working fallbacks with the API so it doesn't require the webpage (for interest, you can purposefully trigger this after https://github.com/yt-dlp/yt-dlp/commit/b6de707d13ca3b7a573d9695b7fc0616fe394f60) . However playlist extraction still relies on the initial webpage, hence that fails.

Thanks!
If i understand this correctly will i be able to skip the initial webpage download using player_skip=webpage for channel download and be able to bypass this?
If that's not the case, how can i bypass this? if this is a an ip temp block i think it's is very strange that it happened so quickly because before, i had to download continuously for an excessive amount of time before i was blocked, i think YouTube is changing this and getting so strict about this these days.

Thanks!
If i understand this correctly will i be able to skip the initial webpage download using player_skip=webpage for channel download and be able to bypass this?

This is only for individual video extraction, not playlists/channels atm. Also this is only in master, not current release yet.
(I am slowly experimenting on it for playlists/channels in #682 but there's some issues atm)

If that's not the case, how can i bypass this? if this is a an ip temp block i think it's is very strange that it happened so quickly because before, i had to download continuously for an excessive amount of time before i was blocked, i think YouTube is changing this and getting so strict about this these days.

Yeah, YouTube can be a bit unpredictable with these things. Probably easiest method is to use a proxy/VPN and/or wait it out.

Indeed, i tested a VPN just now and it worked but the speed is so slow, so this shows that this is an ip block.
Do you know if --force-ipv4 or something similar can help bypass this? i read some people said they succeeded when using --force-ipv4 but that could be an unrelated issue so i'm not sure.

Do you know if --force-ipv4 or something similar can help bypass this? i read some people said they succeeded when using --force-ipv4 but that could be an unrelated issue so i'm not sure.

I'm not sure about this, but I suppose it could work if you were blocked on your IPv6 IP and not IPv4 one?
You could possibly also try --force-ipv6

Well, i got No remote IPv6 addresses available for connect, can't use i think i don't have any IPv6 IPs.
I'll just wait for the block to expire, i'm closing this issue now as it is not valid.
@coletdjnz I wish you the best of luck with #682

@coletdjnz What about using this? https://anti-captcha.com


Fix globalThis

[x] tests and linter show no problems (npm t)
[x] tests are added/updated for bug fixes and new features
[x] code is properly formatted (npm run fmt)
[ ] description of changes is added in CHANGELOG.md
[x] update .d.ts typings

Landed in https://github.com/metarhia/metautil/commit/84409cc5f5c6b136532c352f930f519c6346dc1f and https://github.com/metarhia/metautil/commit/d585842a10e3a698b6824a6185d4a71467b9ba3b


feat(framework): auto-gen service schemas + upgrade event mechanism

What type of PR is this?
feat(framework)
What this PR does / why we need it:

Auto generate schema(graphql) of service

use #[derive(SchemaObject)] to mark payload or response of service method
use #[description("comments")] to add comments to schema

   #[derive(SchemaObject)]
   #[description("This is TestA")]
   struct TestA {
        #[description("This is String a")]
        a: String,
        #[description("This is TestB b")]
        b: TestB,
        #[description("This is bool c")]
        c: bool,
    }
    #[derive(SchemaObject)]
    #[description("This is TestB")]
    struct TestB {
        #[description("This is Vec<u8> d")]
        d: Vec<u8>,
    }

use #[derive(SchemaEvent)] to mark all events struct

#[derive(SchemaEvent)]
pub enum Event {
    Asset,
    TransferEvent,
    ApproveEvent,
    TransferFromEvent,
}

use #[service(Event)] to inform framework that your service will emit events, which is optional

Add topic attribute to Event and remove bloom

Add macro emit_event! to emit event

Fix: clear events if tx exec failed

Add new chain-api to get schema

type Query {
  getSchema: ChainSchema!
}

type ChainSchema {
  schema: [ServiceSchema!]!
}

type ServiceSchema {
  service: String!
  method: String!
  event: String!
}

Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

Schema considers the layered design.
schema_derive only returns a struct describing metadata and is not responsible for direct conversion to GQL language.
The conversion to GQL language will be done in Muta-API.

Schema considers the layered design.
schema_derive only returns a struct describing metadata and is not responsible for direct conversion to GQL language.
The conversion to GQL language will be done in Muta-API.

Done

/close
until framewrok2.0


ADDED: Data Structures

Hi, I added a freeCodCamp course on data structures (that is available on Youtube)

resolved a conflict with my branch that was missing one recently added course entry

Hey @michalinaj !
Congrats on submitting your pull request and thank you for taking out the time to contribute in this project. Your PR has been merged and the changes will be reflected on the website in a few minutes,.
Do leave a star, if you liked the repo ;)
Happy hacking ! 🎊


Fix broken logo

As reported by @dialex in #198
Sorry for the trouble!

Why did you close the issue? PR @philippw?

I merged #206 so its fixed now


Unable to install uzu on a newly installed Rakudo-Star

Gregor Goldbach @glauschwuffel wrote:

Hi there,
I’m unable to install Uzu. These are the steps I performed:

Installed rakudo-star-2017-04
Ran ```
zef install Uzu --depsonly
zef install Uzu

The last command fails with the following output:

$ zef install Uzu
===> Searching for: Uzu
===> Testing: Uzu:ver('0.1.8'):auth('gitlab:samcns')
t/00-basics.t .. ok
===SORRY!===
Probable version skew in pre-compiled 'site#sources/279EEE655EA4F4F78AD74E7C34CB47AD9AE9A173 (Log::Any::Filter)' (cause: no object at index 1044)
t/01-serve.t ... No subtests run
===SORRY!===
Probable version skew in pre-compiled 'site#sources/279EEE655EA4F4F78AD74E7C34CB47AD9AE9A173 (Log::Any::Filter)' (cause: no object at index 1044)
t/02-build.t ... No subtests run
All tests successful.
Test Summary Report
t/01-serve.t  (Wstat: 0 Tests: 0 Failed: 0)
Parse errors: No plan found in TAP output
t/02-build.t  (Wstat: 0 Tests: 0 Failed: 0)
Parse errors: No plan found in TAP output
Files=3, Tests=1,  1 wallclock secs
Result: FAILED
===> Testing [FAIL]: Uzu:ver('0.1.8'):auth('gitlab:samcns')
Aborting due to test failure: Uzu:ver('0.1.8'):auth('gitlab:samcns') (use --force to override)
in code  at /Applications/Rakudo/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 346
in method test at /Applications/Rakudo/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 325
in code  at /Applications/Rakudo/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 497
in sub  at /Applications/Rakudo/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 494
in method install at /Applications/Rakudo/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 600
in sub MAIN at /Applications/Rakudo/share/perl6/site/sources/09969B10D9F270B8DBAAB9961FA7E6CDB8AD58C9 (Zef::CLI) line 139
in block  at /Applications/Rakudo/share/perl6/site/resources/85BD232410222F167A35B9969B036802FECD78D2 line 1

I’m fairly new to Perl6 and zef, so I’m stuck at this point. Is there any information you need to resolve this issue?

Hi @glauschwuffel,
It does look like 2017.04 is the latest Rakudo Star release for MacOS. I have been testing using rakudobrew and having better success. It looks like homebrew has 2017.04 also.
Can  you test again now that I have resolved the zef META6 author issue?
Thanks again for the feedback / troubleshooting on the MacOS. This is very helpful.
Sam

Hi @glauschwuffel,
Just a follow up. I was able to install using zef that comes installed with brew install rakudo-star using these commands:
zef install Uzu --depsonly --/test
zef install Uzu

There was a modification in rakudo in 2017.06 that caused an issue with IO / spawning processes.  Some of the tests that are failing on these dependencies run fine on the 2017.06 and later.

Hi @scmorrison,
sorry for the delay.
I'll try both: 2017-04 after your fix and 2017-06. This may take some time.

Hi @scmorrison ,
things are getting weirder. On my iMac the installation fails after a few seconds.
Gregors-iMac:~ glauschwuffel$ brew install rakudo-star
[...]
==> Pouring rakudo-star-2017.04.sierra.bottle.tar.gz
🍺  /usr/local/Cellar/rakudo-star/2017.04: 1,117 files, 40.6MB
Gregors-iMac:~ glauschwuffel$ perl6 -v
This is Rakudo version 2017.04.3 built on MoarVM version 2017.04-53-g66c6dda
implementing Perl 6.c.
Gregors-iMac:~ glauschwuffel$ zef install Uzu --depsonly --/test
===> Searching for: Uzu
===> Searching for missing dependencies: Template6, Bailador:ver('0.0.6'), YAMLish, Test::Output
===> Failed to find dependencies: Bailador:ver('0.0.6')
Failed to find some required dependencies
  in block  at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 142
  in block  at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 100
  in sub MAIN at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/sources/09969B10D9F270B8DBAAB9961FA7E6CDB8AD58C9 (Zef::CLI) line 124
  in block <unit> at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/resources/85BD232410222F167A35B9969B036802FECD78D2 line 1

Hi @glauschwuffel
ok, what happens when you run these commands?
zef install Uzu --deps-only --/test
zef install Uzu --/test

Hi @scmorrison ,
well, running the first command gets me these results:
Gregors-iMac:~ glauschwuffel$ zef install Uzu --depsonly --/test
===> Searching for: Uzu
===> Searching for missing dependencies: Template6, Bailador:ver('0.0.6'), YAMLish, Test::Output
===> Failed to find dependencies: Bailador:ver('0.0.6')
  in block  at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 142
  in block  at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/sources/4B1D5A60B59D9541E13F76E0E2A2D550E0144053 (Zef::Client) line 100
  in sub MAIN at /usr/local/Cellar/rakudo-star/2017.04/share/perl6/site/sources/09969B10D9F270B8DBAAB9961FA7E6CDB8AD58C9 (Zef::CLI) line 124
[...]

Ok, I have removed the Bailador version requirement from META6. Can you try that command again?
Also, I am still trying to track down the cause of these Log::Any issues:
Probable version skew in pre-compiled 'site#sources/279EEE655EA4F4F78AD74E7C34CB47AD9AE9A173 (Log::Any::Filter)' (cause: no object at index 1044)

Hi @scmorrison ,
I have been able to install the dependencies now. However, Uzu itself won't install because of the Log::Any issue:
Gregors-iMac:~ glauschwuffel$ zef install Uzu --/test
===> Searching for: Uzu
===> Installing: Uzu:ver('0.1.9')
===> Install [FAIL] for Uzu:ver('0.1.9'): ===SORRY!===
Probable version skew in pre-compiled 'site#sources/279EEE655EA4F4F78AD74E7C34CB47AD9AE9A173 (Log::Any::Filter)' (cause: no object at index 1044)

Should I try 2017-06 instead? And if so, where can I get a stable version of it?

Hi @glauschwuffel,
I have switched the web server to HTTP::Server::Tiny. Bailador is under heavy development at the moment so switching to a simple HTTP::Server::Tiny implementation for the time being. Uzu's web server requirements are much simpler than the features included with Bailador.
Please try these commands again:
zef update
zef install Uzu

Thanks,
Sam

Should I try 2017-06 instead? And if so, where can I get a stable version of it?

The modifications that I changed should resolve the issue you were seeing (Log::Any is a Bailador dependency). But if you are interested in checking out the newest versions of rakudo, you can use rakudobrew. It will allow you to install the latest versions. It compiles each version it installs, so it takes a little more time to setup than the official releases.
Let me know if you have any questions about rakudobrew and I will try my best to provide assistance.
Thanks again,
Sam

Hi @scmorrison ,
the installation of HTTP::Server::Tiny fails. The test 06-channel.t fails:
===> Testing: HTTP::Server::Tiny:ver('0.0.1')
t/01-psgi.t ............. ok
t/02-server.t ........... ok
t/04-get.t .............. ok
t/05-post.t ............. ok
t/06-channel.t ..........1/2
# Failed test 'Received channel content as response from post request'
# at t/06-channel.t line 42
t/06-channel.t ..........2/2# expected: '123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100'
#      got: ''

Can this module be installed on your machine?

Hi @scmorrison ,
I tried installed HTTP::Server::Tiny without running the tests (shame on me).
Installing Uzu still fails, this time with some other message:
Gebrauchtwarenzentrum:~ glauschwuffel$ zef install Uzu --/test
===> Searching for: Uzu
===> Installing: Uzu
===> Install [FAIL] for Uzu: ===SORRY!===
Could not find Log::Any at line 3 in:
    /Applications/Rakudo/share/perl6/site
    /Applications/Rakudo/share/perl6/vendor
    /Applications/Rakudo/share/perl6
    CompUnit::Repository::AbsolutePath<140626954585168>
    CompUnit::Repository::NQP<140626906879000>
    CompUnit::Repository::Perl5<140626906879040>

Is there some kind of cache I have to clear?

This looks like zef is still hanging onto the old version. This command should clear it out:
rm -rf ~/.zef/store/uzu.git ~/.zef/tmp/uzu.git

~/.zef is the default zef cache, but might be different on your system.

Also, I am seeing the HTTP::Server::Tiny test failure on 2017.04 OSX also. Install with this command:
zef install Uzu --/test

Hi @scmorrison ,
just a short update: I was able to install Uzu on 2017-06. Uzu still seems to use Bailador in some way:
uzu
===SORRY!===
Could not find Bailador at line 45 in:
    /Users/glauschwuffel/.perl6
    /Users/glauschwuffel/.rakudobrew/moar-2017.06/install/share/perl6/site
    /Users/glauschwuffel/.rakudobrew/moar-2017.06/install/share/perl6/vendor
    /Users/glauschwuffel/.rakudobrew/moar-2017.06/install/share/perl6
    CompUnit::Repository::AbsolutePath<140488928193360>
    CompUnit::Repository::NQP<140488945326816>
    CompUnit::Repository::Perl5<140488945326856>

I installed Bailador and the same error is reported. I'm still stuck, I'm afraid.

Hi @glauschwuffel,
This happens because zef caches these sometimes and doesn't update the cache with new versions. Try the following:
# Uninstall uzu
zef uninstall Uzu
# Clear the zef cache
rm -rf ~/.zef/store/uzu.git ~/.zef/tmp/uzu.git
# Reinstall Uzu
zef install Uzu
# If that fails, try without tests
zef install Uzu --/test

Hope that works for you.
Thanks,
Sam

Hi @scmorrison,
clearing the cache as described above didn't help, I had to remove the directories "store" and "tmp" completely.
I have successfully installed uzu now. Thanks for your support!

Great, glad you were able to get it installed. Please create more issues if you run into any problems or have questions.
Thanks, Sam


fix(executor): Handle sidecar killing in a process-namespace-shared pod

Checklist:

[x] My organization is added to USERS.md.

I found sending SIGTERM fails to stop a container if shareProcessNamespace: true is set with the k8sapi executor because the PID of a container isn't 1. I understand it doesn't make sense using the option without the pns executor, but my company's cluster forcibly set shareProcessNamespace: true but we haven't evaluated the pns executor yet. We should at least report the invalid option to users.
I also improved error messages during sidecar killing.

LGTM

Merged into https://github.com/argoproj/argo/releases/tag/v2.12.0-rc4


Finish the installation wizard

we need to add the instructions from the readme's of all three installation methods (one, two, three)

This means that your plan for the installation wizard to be advisory - not to take same actions based on the results of the interview, right?
I am not proposing to make this similar to a "real installer" but rather trying to understand your plans.

Correct. We will advise what installation method to use (core, vendors or
jspm-git)  and show some easy to follow steps, which depends on the input
of the user
Op 29 nov. 2015 20:41 schreef "Nikolaj Ivancic"<EMAIL_ADDRESS>
This means that your plan for the installation wizard to be advisory - not
to take same actions based on the results of the interview, right?
I am not proposing to make this similar to a "real installer" but rather
trying to understand your plans.
—
Reply to this email directly or view it on GitHub
https://github.com/aurelia-ui-toolkits/aurelia-kendoui-plugin/issues/101#issuecomment-160458716
.

Perfect - this clearly puts the installation wizard "behind" the other menu items in the sense of priority of user's viewing the demo application and we should make the about page be the default.

We will advise what installation method to use (core, vendors or
jspm-git)  and show some easy to follow steps

This same information (although not in the form of a wizard) should be added to this README file

Just saw the new wizard and have one suggestion - show the final set of instructions on the same (wizard) page, rather than switching to a new page - so that there cannot be any confusion about what are the choices user has made (the responses to the wizard play the role of "bread crumbs"

I have doubts about the installation wizard, its not worth the complexity. We are better off just creating an html file with instructions per installation method, and have one page where a user can decide which method to use

I have doubts as well as the complexity of the decision making process might not warrant a three page wizard. Graphically, it "unbalanced" as it occupies only a small part of the page

We are better off just creating an html file with instructions per installation method, and have one page where a user can decide which method to use

I agree


NotImplementedError: act_type: prelu is not supported in nnvm.

Hi
is prelu not supported in nnvm?.

yes, MXNet. will check it. thanks


[imb] Avoid using Pandas

While a dataframe is a nicer datastructure for holding the data coming out of the IMB benchmarks, we don't really use dataframes features in any way and this needlessly put a requirement for pandas when running the benchmark.  We can easily live with a list of lists, without much effort (actually, with one or two lines less in total)
Fix #47.

Done :+1:


在Android 10.0版本上报错：Cannot run program "/system/bin/su": error=2, No such file or directory

我百度了一下，需要把/system/bin/su修改为/system/bin/sh
https://blog.csdn.net/weixin_43266090/article/details/108245698
希望能修正一下

此library不提供ROOT权限,请自行打开串口666权限

Maybe you need change the path /system/bin/su to /system/xbin/su

Maybe you need change the path /system/bin/su to /system/xbin/su

What special privileges "/system/xbin/su" does have w.r.t. root access?


Issues with style and question about colors

Hey,
I'm using Mapbox with a style and it shows something like

However when I use your code I get a different look even using the same style url

Is it because the heatmap applies to the whole map instead of just the location where I have points ?
Also I'd like the colors to be inversed, meaning blue for high values and red for low values, is there a way to do it other than by manipulating the values myself to make low values high and high values low ?

Hello,
About the different look: Yes, I think it's because the heatmap applies to the whole map. You have two options to fix this:

Use the pointRadius parameter to only apply the heatmap around points. Something like pointRadius: 500 should be enough.
Use the roi parameter to only apply the heatmap in a specific area. Something like:

roi: [{
  lat: 33.666166159172775,
  lon: -84.48114332974401
},
{
  lat: 33.666166159172775,
  lon: -84.3771437096422
},
{
  lat: 33.607548312648866,
  lon: -84.3771437096422
},
{
  lat: 33.607548312648866,
  lon: -84.48114332974401
}]

would cover your area.
About inversing the colors: you can use the valueToColor parameter. Something like:
valueToColor: `
   vec3 valueToColor(float value) {
      return vec3(max((0.5-value)*2.0, 0.0), 1 - 2.0*abs(value - 0.5), max((value-0.5)*2.0, 0.0));
   }
`

(I just inversed the red and blue components of the default valueToColor function)

Thanks @Rylern I used the radius and it's way better and faster. Also knowing the range of my values I'm just inversing them. I'm now trying to find out if I can make it a bit faster but it seems to come from mapbox itself ... also I suppose if I create the map in advance it should be faster to just play with the layer, adding it and removing it right ?

What do you mean by creating the map in advance?
There are two parameters you can use to make the map faster:

fasterPointRadius: true
framebufferFactor: 0.1 (or any low value greater than 0)

However, they tend to reduce the visual quality.

What do you mean by creating the map in advance?
I mean if I create it before loading the specific tab when I want it to appear

Also as you can see the rendering is blurry, is there any way to improve it ?

I mean if I create it before loading the specific tab where I want it to appear

It depends on what you want to make faster. If you want to speed up the map initialization, yes you can do that. But if you want to speed up the rendering when the map is moved / zoomed in or out, you should use the parameters I mentionned.

Also as you can see the rendering is blurry, is there any way to improve it ?

Can you try to set this parameter and see if it changes:
framebufferFactor: 1

Same, it's still blurry as you can see

Can I see your code calling the interpolateHeatmapLayer.create() function? It still looks pixelated (especially the red/green part).
This usually happens when the framebuffer factor is too low. For example, this layer has a framebuffer factor of 0.1:

And this one has a framebuffer factor of 1:

Here it is https://pastebin.com/raw/RhkyfHHj. I also tried with the style you use in your example and it's slightly different as you can. Also don't you think the glowing effect where I have my outliers is weird in the rendered picture ?

I see, it's because the layer parameters are defined when creating the map and not the layer.
You just have to change
const layer = InterpolateHeatmapLayer.create({
            layerId: "mylayer",
            points: [...]
})

to
const layer = interpolateHeatmapLayer.create({
        layerId: "mylayer",
        pointRadius: 500,
        framebufferFactor: 1,
        p: 3,
        points: [...]
})

and remove the pointRadius and framebufferFactor parameters from the map creation.
You see that I also added a p parameter. You might want to try different values for it as it changes the visualization. Higher values make the heatmap more sharp, like this (with p=5):


add help text for file uploads

Description
Adding help text to file upload to say that mobile phone camera can be used.

Based on BE recommendations: https://docs.google.com/presentation/d/1aRaYEP4UBzO-ubS9bqPX1bhoSJlfpH59eRv1X6X9pwI/edit#slide=id.g11d69b7a937_0_51
Release notes:
Adds help text under file upload button saying "On your phone? “Choose File” also allows you to use your phone camera to upload documents."
Checklist
General

[ ] Added the correct label: < feature | bug | dependencies | infrastructure | ignore-for-release >
[ ] Created tests which fail without the change (if possible)
[ ] Extended the README / documentation, if necessary

User visible changes

[ ] Wrote browser tests using the validateAccessibility method
[ ] Manually tested at 200% size
[ ] Manually evaluated tab order

New Features

[ ] Add new FeatureFlag env vars to server/conf/application.conf
[ ] Conditioned new functionality on a FeatureFlag
[ ] Wrote browser tests with the feature flag off and on, etc.

Issue(s) this completes
Fixes #<issue_number>; Fixes #<issue_number>...

Codecov Report

Merging #3817 (18a3ccd) into main (d1e44fe) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##               main    #3817   +/-   ##
=========================================
  Coverage     80.63%   80.63%
  Complexity     2441     2441
=========================================
  Files           296      296
  Lines          9642     9643    +1
  Branches        659      659
=========================================
+ Hits           7775     7776    +1
  Misses         1613     1613
  Partials        254      254

Impacted Files
Coverage Δ

server/app/services/MessageKey.java
100.00% <100.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


CB-5566 Upgrade CM to 7.1.4 and remove all the bigdecimal value.

See detailed description in the commit message.

Thanks for the fixes. 😄

Thanks for the fixes. 😄

Success story :D


No "kind" information in AExprTransform

For the function AExprTransform in postgrespaser.cpp, it gets the type of the expression from the name field. But this is not enough for some kinds of expressions like AEXPR_DISTINCT (whose name is =, but has nothing to do with COMPARE_EQUAL actually). So now IS DISTINCT FROM will be considered as =, which is not true.
A fix of this is inducting the target_type from the kind field in A_Expr, instead of from the name field.
I am currently developing triggers for Peloton, where many SQLs has expressions like IS DISTINCT FROM. It would be great if we could support types like this. Hope someone experienced could help fix that. (AExprTransform function is highly shared, so I am afraid that changing it by myself may mess up the system 😂)
Thanks!

@nblintao FYI, Hao is going to look at this now for you.

Hi Tao,
Would you please provide some example queries so that I can add support for them?
Hao

Thanks, @apavlo @haojin2 !
CREATE TRIGGER check_update
    BEFORE UPDATE ON accounts
    FOR EACH ROW
    WHEN (OLD.balance IS DISTINCT FROM NEW.balance)
    EXECUTE PROCEDURE check_account_update();

This is one example from Postgres doc.
Another thing is the current type does not handle <> correctly. This could be easily resolved by my changes to types.cpp at https://github.com/cmu-db/peloton/pull/613/commits/19b3f4d76677dc74a7945dd1b647bc9baa2f2227

@nblintao Is this still an issue? If not, we can help you

This is handled already in Issue #624

LGTM. Thank you!


REST API and server

In addition to CLI, it would be great if we have a web interface REST API server. Since we have already implemented json outputs for CLI, it would be relatively easy to extend the function.

Implemented in v0.0.5 first.


Share Paging Termination Between PagedFlux and PagedIterable

Description
Fixes #26064
This PR resolves an issue where PagedFlux and PagedIterable handled terminating the paged request stream based on the continuation token received as they have divergent logic to handle idiosyncrasies of async vs sync and the usage of Reactor. Now, PagedIterable will use the paging termination Predicate from the backing PagedFlux and pass that into the ContinuationState that is being maintained during the lifetime of a paged request stream. In this change ContinuationState now takes the Predicate as a constructor argument instead of being passed when the continuation token is being updated to better align with the requirement of having the Predicate. This has simplified the divergent logic between PagedFlux and PagedIterable to a constructor call instead of being in a few places where the ContinuationState is being updated.
All SDK Contribution checklist:

[x] The pull request does not introduce [breaking changes]
[x] CHANGELOG is updated for new features, bug fixes or other significant changes.
[x] I have read the contribution guidelines.

General Guidelines and Best Practices

[x] Title of the pull request is clear and informative.
[x] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[x] Pull request includes test coverage for the included changes.

Thanks a lot, @alzimmermsft !


Rename/deprecate num_signatures to num_total_signatures

Problem

The num_signatures function name is confusing since it includes "actual" signatures on the transaction, as well as "pre-compile" signatures that are attached as instructions.

Summary of Changes

deprecate SantizedMessage::num_signatures
add new function SanitizedMessage::num_total_signatures
rename SVMMessage::num_signatures to SVMMessage::num_total_signatures to match

Fixes #

Noticed this odd/misleading naming when working on stuff related to #1918

Have not deprecated anything in SDK before; is this the correct way to do it?

Want to use the new name in #2125; because we need a way to distinguish so that we get the right number to inspect the Signatures on transaction.


How to remove this in vim

in neovim

You see this because vim will render italic text as reverse format(I don't know why😂😂).
I have fixed this by disable italic text. Update to latest version pls.


How to load private model in tgi in docker and difference inference performance when loading from huggingface/loading from locally directory

Hi team,
How do we load a private model in tgi in the docker because of the access issue?
One solution I think is to pre-download the model and then mount the model directory and load into tgi. However, I find out there is a big performance inference gap between these two methods and could the team provide some hints on why is it?
Reproduce step:
Model example: bigcode/santacoder

inference on 100 tokens via model-id bigcode/santacoder is 180ms
Command: docker run --gpus all  --shm-size 1g -p 8080:80 -v /data:/data ghcr.io/huggingface/text-generation-inference:0.9.4 --model-id bigcode/santacoder  --num-shard 1 --max-input-length 1000 --max-total-tokens 2000 --max-batch-total-tokens 4096 --max-concurrent-requests 1 --max-stop-sequences 20 --dtype float16 --trust-remote-code

total_time="158.787824ms" validation_time="221.404µs" queue_time="48.671µs" inference_time="158.517849ms" time_per_token="7.925892ms"
2.1 first git clone the bigcode/santacoder directory by running  git lfs install  && git clone https://huggingface.co/bigcode/santacoder
2.2 running docker image loading via model-id santacoder directory. inference on 100 tokens is 280ms.
command
docker run --gpus all  -v santacoder_path:/model  --shm-size 1g -p 8080:80 -v /data:/data ghcr.io/huggingface/text-generation-inference:0.9.4 --model-id /model  --num-shard 1 --max-input-length 1000 --max-total-tokens 2000 --max-batch-total-tokens 4096 --max-concurrent-requests 1 --max-stop-sequences 20 --dtype float16 --trust-remote-code
total_time="329.15002ms" validation_time="183.883µs" queue_time="52.371µs" inference_time="328.914016ms" time_per_token="16.4457ms" seed="None"}:
For loading with local directory, it takes more time to shard  and it has one warning about  Model does not support automatic max batch total tokens.  Also the output is garbage.
Test Command for query server  curl <IP_ADDRESS>:8080/generate     -X POST     -d '{"inputs":"What is Deep Learning?","parameters":{"max_new_tokens":20}}'     -H 'Content-Type: application/json
I think there may be some additional steps to make model better performance but I have not realized it yet. Thanks for the help in advance!
Docker image version: ghcr.io/huggingface/text-generation-inference:0.9.4

Santacoder is unfortunately a bit special as it was released with trust_remote_code.
We had to have a special flag for it https://github.com/huggingface/text-generation-inference/blob/main/server/text_generation_server/models/init.py#L95
Your local version is slow because is pass here, and is therefore using the standard slow modeling code.

To fix it you can trick it by renaming your directory as starting with bigcode/


python3Packages.sopel: add missing packaging dependency and mainProgram

Description of changes
The package was missing a dependency.
<Rutherther> on IRC helped me test with an override, and I got it working through that.
In addition I'm working on a service for this that I plan to upstream, and was suggested to use lib.getExe, which warned about a missing meta.mainProgram field, so I added this too.
I have not been able to test this, and if that is a strong requirement, I will definitely try and get a VM running on my desktop to run the tests in.

Things done
Got the package working and running with
(python312Packages.sopel.overridePythonAttrs(o: { dependencies = o.dependencies ++ [ pkgs.python312Packages.packaging ];

in my systemPackages

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 342045 run on x86_64-linux 1

4 packages built:

python311Packages.sopel
python311Packages.sopel.dist
python312Packages.sopel
python312Packages.sopel.dist

Additionally also tested sopel configure -> sopel, and in a python repl with import sopel. Everything looks to be working well. Welcome to the community and LGTM on your first PR!

Result of nixpkgs-review pr 342045 run on aarch64-darwin 1

4 packages built:

python311Packages.sopel
python311Packages.sopel.dist
python312Packages.sopel
python312Packages.sopel.dist

Thanks for the reviews guys! :)
I believe I have squashed and re-worded the commit to be compliant now? 🙂


Fine-grained global rate limiting control

We should be able to select if global rate limiting is applied on a per-service basis.

It will ease fising issue like https://github.com/kalisio/aktnmap/issues/163.


How can I keep selection when lost focus?

see the source code,
 // from line 6543:
       if (jexcel.current) {
            jexcel.current.resetSelection(true);
            jexcel.current = null;
      }

it seems no options can control this behavior?
this makes it difficult to select a big area when i need to drag the scroll bar.

Would you like to create a jsfiddle to explain a bit better?

I think I know what he's referring to.
When you have a selection on your jExcel table and you click somewhere else in the page, you lose those selected cells.
It would be great to keep the selection marked because I'm having the same issue. I want to have a selection marked and then I want to be able to click on a button outside the excel table and not loose selected cells.
Is there any way to prevent this?

If you click outside you going to lose focus. There is no way to prevent that. In your case, it is different. You want to integrate a button on jExcel and you can do that, but your button must be inside the container. In this case, you won't lose the selection.

<link rel="stylesheet" href="https://bossanova.uk/jexcel/v3/jexcel.css" type="text/css" />

<link rel="stylesheet" href="https://bossanova.uk/jsuites/v2/jsuites.css" type="text/css" />

Hi @paulhodel ,
I'll give this a try, but my code is in React, not jQuery.
Thanks.

Figured out how to make it appear right before the jExcel table.

                       <Button onClick={(e) => this.transformSelection(e)} variant="contained" color="primary">Transform Data</Button>

My case:
I have wide table with tableOverflow: false
I can select entire row by click on row number (at very first column).
Then I click browser's scrollbar and table loose selection. If not click, just use mouse wheel - selection stay in place.
How can I make selection slightly more stable?
Ubuntu 18, Firefox 70.0.1 x64.


Remove points operation

Add an operation for removing points within the selector. Should allow a variable percentage, where 100% deletes all in the selector, and any % less than that uses some geometry-aware processing to delete the % asked, while adjusting the remaining gaussians to fit the shape/colors that were there before.

Invert selection and deleting (all) points supported. No support yet for decimating only a fraction of the gaussians.

Completed using custom KD tree. Could be faster still.


Crash on opening

Here is the crash log link:
http://paste.ee/p/N3F4L

You could try the latest version 7.1.2 (https://github.com/aidancbrady/Mekanism/releases). Also i would remove ResonantInduction as it's pretty alpha and unstable, and i've experienced that it messes up other mods.

Installing the latest ic2 api from http://ic2api.player.to:8080/job/IC2_experimental/ should fix this crash

Adding ic2 worked! Thanks!


Build fails on website validation

I'm submitting a ...
[x ] bug report
[ ] feature request
[ ] question about the decisions made in the repository
[ ] question about how to use this project

Summary
While trying to add a token, build keeps failing on website validation, I've used the same website before on other token it's already in current existing json file, nothing is wrong with website (to my knowledge) so something on validation side?

Website is: https://www.martianarmy.space
Build: https://github.com/solana-labs/token-list/pull/20214/checks?check_run_id=5345058535
PR: https://github.com/solana-labs/token-list/pull/20214

Other information
Error:
failed to verify website: https://www.martianarmy.space/: failed to verify https://www.martianarmy.space/ using HEAD request: context deadline exceeded

weird
merged


[Event Request] codeunit 1012 "Job Jnl.-Post Line" - OnAfterRunCode new parameter

Could we please have additional parameters in event OnAfterRunCode in Codeunit 1012?
    OnAfterRunCode(JobJnlLine, JobJnlLine2, JobLedgEntryNo);  // Standard Event misses Variable JobJnlLine as parameter!!

Event:
local procedure OnAfterRunCode(var JobJournalLine: Record "Job Journal Line"; JobJournalLine2: Record "Job Journal Line"; JobLedgEntryNo: Integer)
begin
end;

ok, we have checked once more, and we decided to cancel this request because we can use JobJnlLine2.
Thank you.


Documentation for -k[1|2] is incorrect

Using Sqlcmd from SQL Server 2019, we can see that -k is not the same as -k1
-k removes control characters
-k1 replaces each control character with a space
-k2 replaces consecutive control characters with a single space
>sqlcmd -k 2
1> select '1
2~
3~
4~ 3'
5> go

--------
1 3

(1 rows affected)
1> quit

>sqlcmd -k
1> select '1
2~
3~
4~ 3'
5> go

--------
13

(1 rows affected)
1> quit

>sqlcmd -k1
1> select '1
2~
3~
4~ 3'
5> go

--------
1      3

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 8da1f57b-a8fd-cca7-4cf0-9d594d365062
Version Independent ID: 60c46780-6a03-7958-c77a-e7c94e3b9e85
Content: sqlcmd utility - SQL Server
Content Source: docs/tools/sqlcmd/sqlcmd-utility.md
Service: sql
Sub-service: tools-other
GitHub Login: @grrlgeek
Microsoft Alias: jeschult

Thanks, @shueybubbles. Mind doing a PR in the private repo?


Why do the parameters in $attributes and prompts. yaml need to be concatenated with ' ' instead of: ","

file location：trainscripts/imagesliders/prompt_util.py
row 163-167：
copy_['target'] = att + ' ' + copy_['target']
copy_['positive'] = att + ' ' + copy_['positive']
copy_['neutral'] = att + ' ' + copy_['neutral']
copy_['unconditional'] = att + ' ' + copy_['unconditional']
Why do $attributes need to be concatenated with ' ' for all parameters?
Will this not be considered as the same set of prompt words as the following prompt words? Should ' ,' not be used for concatenation?

Hi, thanks for the question! I dont think we have looked into different ways to concatenate the attributes to the original prompts. This was a design choice to use '  ' instead of a ','
Please let us know if you have observed any significant performance improvements or changes when using a comma instead. Would be happy to integrate the change to the code


Dynamic addNodeToDrawFlow

Hi, been using this for a project and it's been good. But a requirement was added on our side of the project. Is there a way to add the drawflow-node dynamically? In our case, we get data from database and create drag-drawflow div according to data. But now have stuck with adding the drawflow-node by drag-drawflow div that we created dynamically.

addNodeToDrawFlow not native function is the demo function.
You can use addNode. To add anything dynamically.

Thanks a lot for your quick response.But I am wondering how to add pos_x and pos_y. Can you please let me know how to add pos_x and pos_y dynamically?

pos_x  and pos_y is based on event  (ev.clientX, ev.clientY)
The code:
  function drop(ev) {
      if (ev.type === "touchend") {
        var parentdrawflow = document.elementFromPoint( mobile_last_move.touches[0].clientX, mobile_last_move.touches[0].clientY).closest("#drawflow");
        if(parentdrawflow != null) {
          addNodeToDrawFlow(mobile_item_selec, mobile_last_move.touches[0].clientX, mobile_last_move.touches[0].clientY);
        }
        mobile_item_selec = '';
      } else {
        ev.preventDefault();
        var data = ev.dataTransfer.getData("node");
        addNodeToDrawFlow(data, ev.clientX, ev.clientY);
      }

    }

    function addNodeToDrawFlow(name, pos_x, pos_y) {
      if(editor.editor_mode === 'fixed') {
        return false;
      }
      pos_x = pos_x * ( editor.precanvas.clientWidth / (editor.precanvas.clientWidth * editor.zoom)) - (editor.precanvas.getBoundingClientRect().x * ( editor.precanvas.clientWidth / (editor.precanvas.clientWidth * editor.zoom)));
      pos_y = pos_y * ( editor.precanvas.clientHeight / (editor.precanvas.clientHeight * editor.zoom)) - (editor.precanvas.getBoundingClientRect().y * ( editor.precanvas.clientHeight / (editor.precanvas.clientHeight * editor.zoom)));
...

I think you are not understanding how it works.
For what you want to do, I think you could add the "default" in the "switch" to add the new nodes dynamically.

Thanks a lot this is working as expected.


having trouble installing

I am having trouble installing vars-gridview. I don't see this issue in the open or closed issue list.
I am running Apple Mac M1, Mac OS 13.4.1 (c) . I created a venv in which to install the code. I have python 3.8.17, though I can create a venv with a different version if required.
When I either tried installing from
pip install vars-gridview
I get error:
ERROR: Failed building wheel for pymssql
Failed to build pymssql
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -I/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include -DOPENSSL_NO_SSL3 -I/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include -I/Users/duane/vars-gridview/vars-gridview/vars-gridview/include -I/Users/duane/.pyenv/versions/3.8.17/include/python3.8 -c src/pymssql/_mssql.c -o build/temp.macosx-13.4-arm64-cpython-38/src/pymssql/_mssql.o -DMSDBLIB
  src/pymssql/_mssql.c:1127:10: fatal error: 'sqlfront.h' file not found
  #include "sqlfront.h"
           ^~~~~~~~~~~~

or, after cloning the code,
poetry install
(vars-gridview) (base) duane@ICEFISH vars-gridview % poetry install
Creating virtualenv vars-gridview-WGnW6x_E-py3.8 in /Users/duane/Library/Caches/pypoetry/virtualenvs

[Errno 2] No such file or directory: '/Users/duane/.pyenv/versions/3.8.17/lib/python3.8/site-packages/xattr/lib_build.h'

@@ I am doing this in hopes of helping Steve Haddock run vars-gridview. He reports that he was able to install the program, but does not know how to run it...

@duane-edgington This Stack overflow answer may cover the issue. In fact, just installing freetds and openssl may be sufficient:
brew install freetds openssl
pip install pymssql

@duane-edgington @kevinsbarnard I've found that I have to do the following on apple silicone to install pymssql properly:

pip uninstall pymssql (if its already installed)
pip install pymssql --no-binary :all:


Add update-stack command

Add ability to update created cloudformation stack, e.g.:
$ perun update-stack <stack-name> <path-to-template>

closed by


target:pkg("name"):get("includedirs") returns an empty string

Steps to reproduce
In an empty directory, use the following xmake.lua file
add_requires("lua")
target("name")
    set_kind("phony")
    add_packages("lua")
    on_build(function(target)
        print(target:pkg("lua"):get("includedirs"))
    end)

then execute xmake, it prints an empty line.
But it works fine for other fields, such as linkdirs, syslinks and libfiles. I'm not sure if it is a bug, and target:pkg is undocumented at the moment.

目前包默认用的是 sysincludedirs 不是 includedirs，所以你得用 sysincludedirs 来取。。或者 add_requires("lua", {external = false}) 切到 includedirs 上去


chapter 7 cbow loss outputs 'nan'

Hi ,
I am getting loss result as nan while implementing the cbow code from chapter 7.
I wrote the code learning it from the book and then suspicious of my output i copy pasted from repo...
and still i got 'nan'
Please kindly suggest a work around...

I changed learning_rate = 0.5 to learning rate = 0.01 also tried with learning_rate = 0.05 and batch_size=100, after 50k epochs it gave me loss=3.4292  from learning_rate= 0.01 and loss=2.6028  from learning_rate=0.05...with a gradual decrease from both the cases...need to optimize it though...


README.md Updating clone link & Removing $ for bash commands

Line 34: $ git clone https://github.com/rustyxlol/chat-app-django.git if a dev wants to clone the repo the link will not work.
As well, I propose to remove all the $ for the CLI commands because the user will always have to go at the beginning of the line to delete "$"
I hope this contribution will improve the cloning experience of this exciting project.
Cheers

You're welcome!


Tweets Table is not being populated

Hi,
I believe this repo isn't been touched for a while now but I can see response table getting filling in SQL but not tweets. Is there anything I am missing? I can see in cli that 100 tweets found but in SQL I can't see any.
Waiting for an answer, thanks!

Hello, and yes, this library is no longer actively being maintained. It's possible that the API has changed to the point where this library's logic no longer works properly, so I will mark this repository as "archived." Thank you for the reminder.

Sounds good, thank you for the update.


Tequila Cloud sync

chainlayer now has fully automated Tequila snapshots.
use them.

same as issue #10


Support downloading YouTube videos with multiple audio tracks

Checklist

[x] I'm asking a question
[ ] I've looked through the README and FAQ for similar questions
[ ] I've searched the bugtracker for similar questions including closed ones

Question
how to downloa dmultiple audio tracks from  youtube
WRITE QUESTION HERE

First use -F to list the available formats; then specify the desired audio format in the download command.

@mahaveergautamji ?

i used that command but how i can download a selected track like japaness or hindi pls

The instructions assume that you've read the Manual, especially the concerning the -F and -f options, and also Format Selection.
If the language of the tracks is not clear from the format listing, you would have to guess. As always, post a full verbose text log of any command that doesn't seem to be doing what you expect from the documentation.

@mahaveergautamji the audio tracks are labelled in the -F output with their 2-letter language code. For example:
python3 -m youtube_dl -F https://www.youtube.com/w
atch\?v\=HwAPLk_sQ3w
[youtube] HwAPLk_sQ3w: Downloading webpage
[info] Available formats for HwAPLk_sQ3w:
format code  extension  resolution note
249-0        webm       audio only [fil] audio_quality_low   47k , webm_dash container, opus  (48000Hz
), 8.88MiB
249-1        webm       audio only [de] audio_quality_low   49k , webm_dash container, opus  (48000Hz)
, 9.11MiB
249-2        webm       audio only [ar] audio_quality_low   49k , webm_dash container, opus  (48000Hz)
, 9.14MiB
249-3        webm       audio only [ru] audio_quality_low   49k , webm_dash container, opus  (48000Hz)
, 9.15MiB
249-4        webm       audio only [pl] audio_quality_low   49k , webm_dash container, opus  (48000Hz)
, 9.16MiB
249-5        webm       audio only [es] audio_quality_low   49k , webm_dash container, opus  (48000Hz)
, 9.20MiB
249-6        webm       audio only [zh] audio_quality_low   49k , webm_dash container, opus  (48000Hz)
, 9.21MiB
249-7        webm       audio only [fr] audio_quality_low   50k , webm_dash container, opus  (48000Hz)
, 9.21MiB
249-8        webm       audio only [uk] audio_qual...

However, it doesn't seem there is a way to get the video with a specific language track as audio - all the video options will be "video only", so you will have to download the audio you want and then post-process to combine it with the video (I think ffmpeg can combine audio and video).

Formats labelled video-only have no audio language by definition. They may possibly have burned-in subtitles that imply a specific language: it depends on the site and extractor as to whether that is reported in the extracted metadata, as the language attribute.
To get a desired audio language, you specify the language code, say pl for Polish, as the value of language for the audio format, so -f 'bestvideo+bestaudio[language=pl]' (Windows: '...' -> "..."), or, if there are language-specific combined audio+video formats, `-f '(bestvideo+bestaudio/best)[language=?pl]'.
Example showing that the language of the selected audio format matches the requested selection:
$ python -m youtube_dl -f 'bestaudio[language=pl]' -o '%(language)s' --get-filename HwAPLk_sQ3w
pl
$

@mahaveergautamji ?


[runtime-security] Use correct path when changing owners of eBPF programs

What does this PR do?
Fix path of eBPF programs when changing owner in post install script
Motivation
Postinstall script fails because the path of eBPF is wrong

CI seems to be failing with:
The following shell command exited with status 1:
     $ objcopy --only-keep-debug /opt/datadog-agent/embedded/share/system-probe/ebpf/tracer-ebpf-debug.o /opt/datadog-agent/.debug/opt/datadog-agent/embedded/share/system-probe/ebpf/tracer-ebpf-debug.o.dbg
 Output:
     (nothing)
 Error:
     objcopy: Unable to recognise the format of the input file `/opt/datadog-agent/embedded/share/system-probe/ebpf/tracer-ebpf-debug.o'


rebase of pull request sivel/speedtest-cli/pull/162

Not trying to steal work here. Credit goes to @gonzalo
Just wanting to help by rebasing the changes on top of existing devel for a merge.

Failures look related to virtualenv + python 3.2 independent of the changes in this PR

CSV output is being implemented in https://github.com/sivel/speedtest-cli/pull/212 which will become the next major release.


Change "readBlocksForPage" to "readBlocksForArea"

Currently we have a GraphQL query which is getBlocksForPage. This is a bit awkward because blocks can be separated into multiple areas, and pages don't necessarily have elemental areas. A better solution would be to expose the actual relationship that exists - the elemental area.
We should convert our query to getBlocksForArea:
query ReadBlocksForArea($id:ID!) {
  readOneArea(ID: $id, Versioning: {
    Mode: DRAFT
  }){
    ID
    Elements {
      pageInfo {
        totalCount
      }
      edges {
        node {
          ID
          Title
          BlockSchema
          InlineEditable
          IsLiveVersion
          IsPublished
          Version
        }
      }
    }
  }
}

This also removes the awkward ElementalAreaIfExists.
After this, the components will need to be updated to deal with area IDs instead of page IDs.

Note that now we also need to update the sort mutation's optimistic update

This would be required for "Layout" blocks.

Done in #522


Add flatcar support

This PR adds Flatcar Linux support:

reboot outdated nodes
replace nodes if image has changed in nodepool
use Flatcar image by default
fixes e2e test

This is going in now.


Warnings about "Image type is {}" and "torch.meshgrid: in an upcoming release"

Describe the bug
Hi, DeepForest is working just fine, but I have a couple warnings popping up that I'm not sure how to adress. Is it my environment that isn't quite right or is there something else that needs updating?
The warnings I receive are when calling predict_tile are:
…/python3.9/site-packages/deepforest/predict.py:34: UserWarning: Image type is {}, transforming to float32. This assumes that the range of pixel values is 0-255, as opposed to 0-1.To suppress this warning, transform image (image.astype('float32')

…/python3.9/site-packages/torch/functional.py:445: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at  ../aten/src/ATen/native/TensorShape.cpp:2157.)
To Reproduce
Steps to reproduce the behavior:
Run predict_tile() with any settings.
Environment (please complete the following information):

DeepForest 1.1.3
OS:  Mac OS BigSur 11.6
Python version and environment : Plain old vanilla Python 3.9.4 using Pyenv and Poetry 1.1.11 for package management

Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Apart from the warning, everything works just fine :)

First warning - . This is just a check to make sure that the pixel data is encoded like the model expects them to be. Did you try the approach recommended in the warning of explicitly setting the image type to 'float32'?
Second warning - that's upstream of us, so nothing to worry.

I don't believe there is anything to worry about here. Our policy has been to not suppress upstream warnings.


Cleanup documentation

Make it clearer by reformulating vague parts
Make bash commands copy-pastable (drop the prefixing currency units)
Make the style consistent

This change is

Review status: 0 of 5 files reviewed at latest revision, 2 unresolved discussions.

CASSANDRA_DESIGN.md, line 56 [r1] (raw file):

A metric's metadata contains:
- UUID

We actually don't have the UUID yet .. we really should though. It would save some space.

CASSANDRA_DESIGN.md, line 56 [r1] (raw file):

A metric's metadata contains:
- UUID

the metric metadata currently doesn't contain a UUID ... we should implement that thoug

Comments from Reviewable

Lol.

Reviewed 4 of 5 files at r1, 1 of 1 files at r2.
Review status: all files reviewed at latest revision, 2 unresolved discussions.

Comments from Reviewable

Review status: all files reviewed at latest revision, 2 unresolved discussions, all commit checks successful.

Comments from Reviewable

please rebase

Review status: all files reviewed at latest revision, 2 unresolved discussions, some commit checks failed.

CASSANDRA_DESIGN.md, line 56 [r1] (raw file):
Previously, iksaif (Corentin Chary) wrote…
> the metric metadata currently doesn't contain a UUID ... we should implement that thoug

now it does

CASSANDRA_DESIGN.md, line 56 [r1] (raw file):
Previously, iksaif (Corentin Chary) wrote…
> We actually don't have the UUID yet .. we really should though. It would save some space.

now we do

Comments from Reviewable

merged it :)


Provide strictly formatted common log message prefix provider

At the moment all components are to set the log message prefix directly.
A common approach will ease search for generated log messages.

Done after merge.
Tracee context logger messages now use prefixes of the following format:
TRACEE_CL_<LOG_LEVEL>[<CONTEXT_PROVIDER_TYPE>]  :
for example
TRACEE_CL_ERROR[Watchdog] :


Main

Make Grafana image as a variable so private repositories can also be used.
Added Grafana replicas as a variable to  be able to scale.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Better document versioning of parameters in SPInstallPrereqs

Details of the scenario you try and problem that is occurring:
The Wiki content of SPInstallPrereqs is giving information about all parameters. In code however we only allow certain parameters for SP2013 and different ones for SP2016. The documentation however does not reflect these very clearly.
So we need to update the documentation to specifically mention which parameter has to be used for which version of SharePoint.
The DSC configuration that is using the resource:
N/A
Version of the Operating System and PowerShell the DSC Target Node is running:
All
Version of the DSC module you're using:
<IP_ADDRESS>

Picking this up

Fixed in PR #680


[Feature Request] Better / more flexible accept completion by word

Great work with this package!
It would be great if copilot-accept-completion-by-word was a bit more flexible. It looks like at the moment it just considers word boundaries as whitespace. However, this doesn't work for a lot of languages.
E.g. Python:
foo(bar).filter(x=y).accept_when(deleted=True)
would all be considered one word.
I think it would be preferable if copilot-accept-completion-by-word would treat punctuation as a word boundary, or if whatever mechanism Emacs uses to decide word boundaries was used, or the regex that decides it was customisable.

(defun copilot-accept-completion-by-word-new (n-word)
  "Accept first N-WORD words of completion."
  (interactive "p")
  (setq n-word (or n-word 1))
  (copilot-accept-completion (lambda (completion)
                               (with-temp-buffer
                                 (insert completion)
                                 (goto-char (point-min))
                                 (forward-word n-word)
                                 (buffer-substring-no-properties (point-min) (point))))))

(advice-add 'copilot-accept-completion-by-word :override #'copilot-accept-completion-by-word-new)

Could you try this in your config and see if it helps?

Thanks for looking into this! Seems to work well, thanks.

Thank you for verifying the patch. I applied these changes to the main branch.


Stuck on "stop-signup" page

Location
https://sc-nightly.netlify.com/stop-signup/

Expected behavior
Selecting Blue check mark will lead back to hashtag list
Actual behavior
The blue check mark doesn't do anything when selected
Steps to reproduce the problem
Create account - hit the back button on the screen - arrive on stop-signup page - select blue check mark.
Operating system / hardware
27: iMac, Mid 2011, OS High Sierra V. 10.13.4, Chrome incognito V. 68.0.3440.106

@kikipluche @matthewcarano should be fixed please verify

It worked for me  @xaedas


Feature/swift 6

This is pretty much WIP, not ready for full review, just to get feedback if someone wants to try as I make progress or contribute.
This builds on Xcode 16 / Swift 6 and 5 mode and Xcode 15 swift 5.
Tests are passing except for one that can't find an import. I'll look into it.
Now I went for the easy path annotating quite a lot of thing with @MainActor which might simply be sendable instead. I first wanted to have something compilable and test to run. I'll check deeper now if I can avoid some MainActor requirements as one might want to use some of the conditions for code outside of swift despite this not being the main intent of the lib.
Open to feedbacks, it's my first open contribution outside of some small bug fixes.
Edit: Fixes https://github.com/siteline/swiftui-introspect/issues/418

Fixes #418

Hmm well I thought that would link the issue and this pull request but apparently not. Seems like you must say it in the pull request description. See here.

I finally didn’t had time to investigate further this week. I’m planning on trying things next week. @GeorgeElsham can you try this branch and telle me if you have issues in your project like over constraints to main actor ? That way I can adapt the PR before asking for review. We only use small parts of the library so I’m not sure if the choices I made à always sensible.

I don't use all that much of the package. The main thing is no warnings in complete concurrency mode and no errors in Swift 6 mode. SwiftUI views are @MainActor by default so I suspect a lot of things will have that annotation. I'll have to check it out later (today, ideally) but this looks like a good start after skim read of the changes. I'm by no means a Swift 6 concurrency expert but I'll see what I can do.

Thing is most of the api is indeed made to be used inside a SwiftUI view but I kept wondering if some should instead be Sendable to enable code outside to use parts of it. I’m not sure it makes total sense though.

This builds in my project perfectly fine and removed the warnings. I'll also try to refactor from the main branch too and see if I have less reliance on @MainActor, otherwise if I can't simplify it this looks good to merge.

I've made a new pull request which makes far less use of @MainActor. Let me know what you think, continuing the conversation on #424.

This builds in my project perfectly fine and removed the warnings.

If this branch fixes all the Swift 6 concurrency warnings, let's get it merged.

I kept wondering if some should instead be Sendable to enable code outside to use parts of it. I’m not sure it makes total sense though.

We can worry about this in a separate PR.
@Alex293 mark as ready for review if you're happy with your changes.

I'll rename the commits, do you prefers a signe one ? or maybe one for the Package.swift edits ?

I'll rename the commits, do you prefer a signe one ? or maybe one for the Package.swift edits ?

Doesn't matter, I'm going to squash and merge anyway.


V3 sdk samples

Fixes #
Proposed Changes

Testing

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: lefteris-xidis sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

This is pointing at the wrong branch, please create a new PR that aims to move your changes into the v3-sdk-samples branch. Closing PR.


Use standard keywords and phrases within the data and models catalogues

We should come up with, or preferably adopt, a standard list of keywords for building our catalogues. For instance, my intension was that "domains" refers to the scientific domains (e.g., chemistry, physics, oceanography etc). Is there a standardised list we could take these from?

e.g. domains: https://www.re3data.org/browse/by-subject/


Handy script for installing devel_themer

devel_themer is a handy dev tool for checking what theme template files apply to parts of a page.
It's a bit fiddly to install because it needs a given version of simplehtmldom, so let's script it.

Looks good


feat: Add more details to MissingTargetException error

Include names of other functions found in the file. This will help debug issues like #157.

This PR is outdated and @di isn't working on this anymore.
Created PR: https://github.com/GoogleCloudPlatform/functions-framework-python/pull/189


feat: add desktop file and icons

Background

Checklist

[x] The Pull Request has been fully tested
[ ] There's an entry in the CHANGELOGS
[ ] There is a user-facing docs PR against https://github.com/daeuniverse/daed

Full changelogs

[Implement ...]

Issue reference

Closes #[issue number]
Test Result

Could you please add a screenshot to illustrate what this PR does?

What?
I added a Linux desktop file for the web panel, which allows users to launch the web panel from their desktop environment with a single  click. The desktop file contains the name, icon, URL, and category of  the web panel.
Why?
I added this feature because it improves the user experience and  accessibility of the web panel. Users do not need to open a browser and  type the URL of the web panel every time they want to use it. They can  simply click on the desktop icon and the web panel will open in their  default browser.
How?
I created a new file called daed.desktop in the install directory of  the project. I used the Desktop Entry Specification to define the  properties of the desktop file. I also added a new icons directory in  the install directory, which contains the icon files for daed. I added  multiple sizes of icons to ensure that they look good on different  resolutions and scaling factors.
Testing?
I tested this feature on openSUSE Leap 15.5. I  verified that the desktop file was installed correctly and that the web  panel opened in the browser when I clicked on the icon. I also checked  that the icon and name of the web panel were displayed correctly in the  desktop environment.
Screenshots
Here are some screenshots of how the web panel looks like on different desktop environments:

GNOME:
KDE:

Well, your supplement far exceeded my expectations. Thank you so much for that. Now I have a good understanding about what this does. Amazing detail.


Error during deploy

I have followed below tutorial.
https://learn.microsoft.com/en-us/azure/machine-learning/tutorial-power-bi-custom-model
During the deployment in last code there is an error below.
How should I fix it?
`service_name = 'my-diabetes-model-2022-11-10'
service = Model.deploy(ws, service_name, [model], inference_config, overwrite=True)
service.wait_for_deployment(show_output=True)`
Tips: You can try get_logs(): https://aka.ms/debugimage#dockerlog or local deployment: https://aka.ms/debugimage#debug-locally to debug if deployment takes longer than 10 minutes.
Running
2022-11-10 00:22:35+00:00 Creating Container Registry if not exists.
2022-11-10 00:22:35+00:00 Registering the environment.
2022-11-10 00:22:35+00:00 Use the existing image.
2022-11-10 00:22:36+00:00 Submitting deployment to compute.
Failed
Service deployment polling reached non-successful terminal state, current service state: Transitioning
Operation ID: 8fcf765d-a2ab-41c3-831b-9ec0ecf4b641
More information can be found using '.get_logs()'
Error:
{
"code": "AuthorizationFailed",
"statusCode": 403,
"message": "ACI Service request failed. Reason: The client '92e00f87-75e7-4b9b-ae55-5d72a1f160c2' with object id '92e00f87-75e7-4b9b-ae55-5d72a1f160c2' does not have authorization to perform action 'Microsoft.ContainerInstance/containerGroups/write' over scope '/subscriptions/cb8bdd1b-0c79-4261-9078-239b63fb9575/resourceGroups/bap-maruyama-aikatsuyou/providers/Microsoft.ContainerInstance/containerGroups/my-diabetes-model-2022-11-10-QqDhfTElkEOCWdEQJMcPAw' or the scope is invalid. If access was recently granted, please refresh your credentials.."
}

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: c3dfa0c7-942e-7120-1f84-aeec42f9b10a
Version Independent ID: 18a7dc7e-11f3-f612-d239-1682f283aff5
Content: Tutorial: Create the predictive model with a notebook (part 1 of 2) - Azure Machine Learning
Content Source: articles/machine-learning/tutorial-power-bi-custom-model.md
Service: machine-learning
Sub-service: core
GitHub Login: @samuel100
Microsoft Alias: samkemp

I have checked.
It is due to Authorization setting.

@jingwora
this thread as resolved by customer.


#5726 Spaces are valid group name characters

This fixes #5726. @Kartones CR this, please.

A test? :stuck_out_tongue_winking_eye:
+1

@Kartones , ok, you're 100% right, this was a quick commute fix but I should've done a test. Is it better now? :)

Thanks, great!


remove indexing by label in Lines.js

The curves should not be indexed by their labels since we do not impose a one-to-one mapping between them.
This fixes issue #129
It will also make the legend display properly in case there are identical labels.

LGTM


Selection CSS is very dark

Your css for selection is very dark

.terminal .terminal-output div div::selection,
.terminal .terminal-output div div a::selection,
.terminal .terminal-output div span::selection,
.cmd > span::selection,
.cmd .prompt span::selection {
    background-color: #aaa;
    color: #000;
}

May I suggest use white instead of black as the highlight color?

.terminal .terminal-output div div::selection,
.terminal .terminal-output div div a::selection,
.terminal .terminal-output div span::selection,
.cmd > span::selection,
.cmd .prompt span::selection {
    background-color: #aaa;
    color: #fff;
}

I prefer dark one, they are reversed default colors.

They might be reversed but they are hard to read.
Never mind, I'll just override them locally.


Atoms are not visible in Redux Devtools if the atom value is not used

I am using useAtomsDevtools().
If I use useSetAtom() for atom in the react component and do not useAtom() or useAtomValue(), the atom is not displayed in the Redux Devtools.
As a workaround, I was able to display the atom in Redux Devtools by using the store obtained with useStore() and setting store.sub(atom, () => {}).
  const store = useStore();
  useEffect(() => {
    if (process.env.NODE_ENV !== 'production') {
      return store.sub(myAtom, () => {
        // nop
      });
    }
    return undefined;
  }, [store]);

Although useAtomDevtools() will allow you to display with the Redux Devtools, we prefer not to use it because it causes unnecessary re-rendering.
It would be nice if useAtomsDevtools() would also display the atom when useSetAtomValue() is used.

This sounds very difficult.
If we simply display (add to the list) with useSetAtom, it will be infinite and leak memory. It might be fine in practice, but we pay attention for memory leaks and won't take such approach.
In v2 API, your workaround seems most reasonable for now. If you are using default store (no providers), getDefaultStore should help, and you don't need useEffect (and leaks memory).

@dai-shi
Thank you for your response!
Right now jotai-devtools is using useAtom(), which affects React rendering. I guess this will change to an implementation using the v2 store API.
Also, it would be nice to be able to connect jotai with redux devtools outside of React.
I would like to dig deeper into the source, as I still don't fully understand the possibility of an infinite loop.


Claude stuck on "Generating response"...

I just installed Avante with the defauilt configuration, on the docs, it says that on the first time opening it, we will be prompted to input our API key, but i didnt get it. then i store my claude key on my shell, and right now i cant figure it out why its not working. can anyone please help me? thanks!

I just installed it too and i"m having the same issue

Same here, I also skipped the prompt for key as I did not have it by hand, but added it to my .zshrc later (by onepassword cli). Also if I choose copilot:

Can you send your configuration here?

Just using the default
{
"yetone/avante.nvim",
event = "VeryLazy",
build = "make",
opts = {
-- add any opts here
},
dependencies = {
"nvim-tree/nvim-web-devicons", -- or echasnovski/mini.icons
"stevearc/dressing.nvim",
"nvim-lua/plenary.nvim",
"MunifTanjim/nui.nvim",
--- The below is optional, make sure to setup it properly if you have lazy=true
{
"MeanderingProgrammer/render-markdown.nvim",
opts = {
file_types = { "markdown", "Avante" },
},
ft = { "markdown", "Avante" },
},
},
}

return {
{
"yetone/avante.nvim",
event = "VeryLazy",
build = "make lua51",
opts = {
-- add any opts here
},
dependencies = {
"nvim-tree/nvim-web-devicons",
"stevearc/dressing.nvim",
"nvim-lua/plenary.nvim",
"MunifTanjim/nui.nvim",
--- The below is optional, make sure to setup it properly if you have lazy=true
-- {
-- 	"MeanderingProgrammer/render-markdown.nvim",
-- 	opts = {
-- 		file_types = { "markdown", "Avante" },
-- 	},
-- 	ft = { "markdown", "Avante" },
-- },
},
},
}

This is now fixed on main

when i first opened my nvim, it said that tiktoken_core is not found, does that mean the API is not found? but this is where i stored my claude token

Still no response here:

I fixed it by providing the key in the config with the one password cli:
		opts = { 			provider = "claude", 			claude = { 				api_key_name = "cmd:op read op://vaultname/claude-key/credential --no-newline", 			}, 		},

Ah oversight on my end, it has to do with vim.schedule.
it should evaluate envvar correctly now.

Ah oversight on my end, it has to do with vim.schedule.
it should evaluate envvar correctly now.

I just installed Avante for the first time and I am running into some issues with loading the env, it's set on my shell but every time I open nvim i get the key prompt and a message that says:

Could this be related?

im sorry this might not be related, but i dont know whereelse to ask about this,
for those who use claude, do we need to upgrade our account to the paid one? can we just use the free tier to use the API key? @uflaks @Milk-Maven

im sorry this might not be related, but i dont know whereelse to ask about this,
for those who use claude, do we need to upgrade our account to the paid one? can we just use the free tier to use the API key? @uflaks @Milk-Maven

I am already on a paid plan so I am not certain


Questions about elevation optimization experiments

Hi, in your nice Rome paper, you have below statements,
so we initiate our experiments by exploring two methods for BEV elevation representation. The first method treats BEV elevation as independent optimizable parameters, similar to RGB and semantics. The alternative one utilizes an MLP representation.
While playing with  the "altenative" approach (representing elevation as an MLP), it looks that the learned heights can only vary within a very small range.   So I wonder if you could kindly shed a light on what configurations/codes I need to change to experiment with the first method? Thanks.

Hi @DRosemei , Thanks for your time and code snippets, with which I was able to implement the two aforementioned methods of mesh elevation representation, namely, 1,  mesh elevation as per-vertex learnable parameters 2. mesh elevation as an MLP.
I  previously assumed that while the mesh elevation learned by the first method has more jitters, it can capture higher frequency details. If this is true, then the first method can be very helpful,  as they are able to optimize the mesh elevation more drastically when the initial mesh elevation is quite off from the ground truth.
The results I got suggests otherwise. The first method does have more jitters, but its ability to drastically adjust initial mesh elevation is even weaker than the second method.  Below are the three experiments I did.
1.  Test the second method when mesh elevation initialization is close to ground truth
The purpose of this step is to confirm that code/configurations are okay. I select scene 0655 of the nuscene dataset, a small bev size configuration to quicken the experiment process (60m * 60m), camera_height is set to its ground truth value 1.5m. Some code changes to support the switch of both methods is also made.
Below is the mesh elevation visualization right after z initialization (before training). the title of the figure show the min, max, and mean statistics of mesh elevations,  which is 0.011, 0.062, 0.042.  The color bar range of the figure is obtained by placing an OrthographicCamera 10 meters above the bev frame, which is from 9.95 to 9.99

Below is the mesh elevation after the training. From here we can see that now the  mesh elevation is adjusted to 0.033-0.077-0.047.  Also the right side is slightly closer to the camera, which conforms to our expectation.

Below is the final bev rgb, we can see that it's quite good.

2. Test the second method when mesh elevation initialization is 40cm off
We know that the camera is 1.5 meters above from the ground, here I deliberately set the camera height as 1.9 meters, so the bev frame would 1.9 meter below the camra, and thus the road surface 0.4 meter above the bev frame. In other words, an ideal training would adjust the mesh elevation to around 0.4 meter.
Below is the mesh elevation visualization right after z initialization, which is what we expect.

Below is the mesh elevation after the training. After the training the mean value of mesh elevation was adjusted from 0.042 to 0.051.  Mesh elevation is optimized to grow in the right direction, but is still far from the 0.4 meter ground truth.

below is the final bev rgb,  we can see the crosswalk on the left side of the image is quite blurred.

3. Test the first method when mesh elevation initialization is 40cm off
Below is the mesh elevation visualization right after z initialization, which is all zero as we expected.

Below is the mesh elevation after the training. After the training the mean value of mesh elevation remains as 0, which is even worse than the second method.

below is the final bev rgb, not good at all,

From above experiments, it looks that both methods are insufficient in terms of learning mesh elevation given an incorrect initialization. This leads me to wonder what can be done to improve this behavior.

@LevinJ Thanks for your interest. In wild data, elevation initialization is important and you can refer to https://arxiv.org/pdf/2309.11754.pdf for more infomation. We use ego trajectories and sparse SfM points or dense MVS ponits to initialize road elevations.

Hi @DRosemei ,  Thanks for your  pointer to the excellent CAMA work.  Indeed, a careful mesh elevation initialization procedure (by meas of ego trajectories, sfm or mvs) before the actual mesh training can effectively solve this problem.
On the other side, if we could simply initialize mesh elevation as zero, and then somehow empower ROME to learn the elevation only based on 2D RGB and semantics supervision, the whole road surface reconstruction pipeline can be much simplified. I don't have any definite clues on how this can be achieved, or if this is even possible (though I know nerf/neus can do a decent job of learning 3d depth based on 2D image alone, without depth initialization).
On a surface level,  the problem is that the output layer of HeightMLP network in ROME below can only output elevation values within a small range (like -0.2 meter -0.2 meter),
self.height_layer_1 = nn.Sequential(
            nn.Linear(self.D + self.pos_channel, self.D), nn.ReLU(),
            nn.Linear(self.D, self.D), nn.ReLU(),
            nn.Linear(self.D, self.D), nn.ReLU(),
            nn.Linear(self.D, 1),
        )

Here what we wish to achieve is that HeightMLP network can output elevation values of larger range (like -10 meters to 10 meters).  Looking at the ExtrinsicModel network in ROME, it tries controlling the range of translation output values by below mechanism
translations = self.configs["extrinsic"]["translation_m"]*torch.tanh(translations.unsqueeze(2))

From what I understand, tanh controls the output range to be from -1 to 1, and then multiply it by configured max value, the final output range can be explicitly set to  [-max, max].
I am wondering if we can do something similar to the HeightMLP output , for example, to make the elevation range to be [-10 , 10].  Do you think it's worth trying this idea, or are there other potential solutions we could try exploring to make ROME learn elevation without careful initialization?

Hi @LevinJ. We have tried to scale HeightMLP output while it is difficult to restore fine road elevation due to week rgb&label supervision. In particular, camera sensors have various exposures which is different from official datasets in nerf/neus. So if you want to get precise elevation, traditional methods like sfm/mvs will give strong supervision. Bellow is our reconstruction results by mvs:

On a second thought, to restore ground truth depth for a pixel, Nerf/Neus do sample all possible depths between near and far bounds by  utilizing numerical quadrature in its volume rendering process. Rome, on the other hand, would only try recovering ground truth depth from one fixed initialized depth. Your kind sharing above is very informative about how to obtain good results in real world data, Thanks, @DRosemei.

@LevinJ Hello, I'm curious about your first method experimental "3. Test the first method when mesh elevation initialization is 40cm off". I used the SquareFlatGridRGBLabel to initialize the mesh, and the resulting elevation heatmap aligns with yours. However, after training, I noticed no changes in the elevation. Could you please share how you configured it?
this my training config
# Training Parameters
waypoint_radius: 400  # meters
batch_size: 6
pos_enc: 4
lr:
  vertices_rgb: 0.1
  vertices_label: 0.1
  # vertices_z: 0.001
  rotations: 0.01
  translations: 0.01

this picture is initial mesh

this picture is after training


Remove remaining references to v4.19

bpf: remove references to v4.19
Signed-off-by: Lorenz Bauer<EMAIL_ADDRESS>
ci-verifier: remove v4.19 complexity tests
Signed-off-by: Lorenz Bauer<EMAIL_ADDRESS>
test: remove references to v4.19
Signed-off-by: Lorenz Bauer<EMAIL_ADDRESS>
gh: remove 4.19 from maintainers little helper
Signed-off-by: Lorenz Bauer<EMAIL_ADDRESS>

Remaining mentions of 4.19 in the code base.
$ rg -B 1 '\b4\.19(\.\d+)?' -g '!vendor/*' -g '!*.svg'
bpf/bpf_overlay.c
230-	* perform revSNAT. However, we observed the mysterious
231:	* verifier error in the kernel 4.19 that when we only do

Documentation/requirements.txt
33-Jinja2==3.1.3
34:jsonschema==4.19.0

daemon/cmd/daemon_main.go
1383-		if err := ipsec.ProbeXfrmStateOutputMask(); err != nil {
1384:			log.WithError(err).Fatal("IPSec with tunneling requires support for xfrm state output masks (Linux 4.19 or later).")

daemon/cmd/kube_proxy_replacement.go
333-			if err := probes.HaveAttachType(ebpf.CGroupSockAddr, ebpf.AttachCGroupUDP4Recvmsg); err != nil {
334:				return fmt.Errorf("BPF host-reachable services for UDP needs kernel 4.19.57, 5.1.16, 5.2.0 or newer: %w", err)
--
345-			if err := probes.HaveAttachType(ebpf.CGroupSockAddr, ebpf.AttachCGroupUDP6Recvmsg); err != nil {
346:				return fmt.Errorf("BPF host-reachable services for UDP needs kernel 4.19.57, 5.1.16, 5.2.0 or newer: %w", err)

Documentation/operations/system_requirements.rst
146-use on agent start. For this version of Cilium, it is recommended to use kernel
147:4.19.57 or later (or equivalent such as 4.18 on RHEL8). For a list of features

Documentation/operations/performance/tuning.rst
167-
168:* Kernel >= 4.19.57, >= 5.1.16, >= 5.2
--
330-
331:* Kernel >= 4.19.57, >= 5.1.16, >= 5.2

Documentation/network/external-workloads.rst
27-
28:* External workloads must run a recent enough kernel (>= 4.19.57) for k8s

pkg/datapath/linux/modules/modules_linux.go
28-// names in /lib/modules by convention. Some examples are 5.15.17-1-lts and
29:// 4.19.0-16-amd64.

test/k8s/net_policies.go
27-var _ = SkipDescribeIf(func() bool {
28:	// We only need to run on 4.19 with kube-proxy and net-next with KPR

pkg/datapath/linux/probes/attach_type_test.go
26-		{ebpf.CGroupSockAddr, ebpf.AttachCGroupInet6Connect, "4.17"},
27:		{ebpf.CGroupSockAddr, ebpf.AttachCGroupUDP4Recvmsg, "4.19.57"},
28:		{ebpf.CGroupSockAddr, ebpf.AttachCGroupUDP6Recvmsg, "4.19.57"},

test/k8s/hubble.go
26-	// replacement, as the trace events depend on it. We thus run the tests
27:	// on GKE and our 4.19 pipeline.

pkg/datapath/linux/ipsec/probe_linux.go
55-// ProbeXfrmStateOutputMask probes the kernel to determine if it supports
56:// setting the xfrm state output mask (Linux 4.19+). It returns an error if

Documentation/bpf/progtypes.rst
408-|                        +-------------------------+-------------+
409:|                        | veth                    | >= 4.19     |

Documentation/network/concepts/routing.rst
283-   ClusterIP load-balancing will be performed using eBPF for all version of GKE.
284:   Starting with >= GKE v1.15 or when running a Linux kernel >= 4.19, all

Documentation/network/concepts/masquerading.rst
51-The eBPF-based implementation is the most efficient
52:implementation. It requires Linux kernel 4.19 and can be enabled with

Documentation/installation/requirements-intro.rst
6-* Kubernetes >= 1.16
7:* Linux kernel >= 4.19.57 or equivalent

/test


The extended User class UserProfile does not generate fully when a user account is created

BACKEND in user_profile module
When a user account is created, a new user record is added to the database, but the extension table does not create a new record to track additional user information (website and bio). Which create an issue during the update of user information.
To fix this issue, I added a signal which create a new record for the extended class each time a user is created.
The signals.py file I added to the app to solve the issue:
`from django.db.models.signals import post_save
from django.dispatch import receiver
from .models import UserProfile
from django.contrib.auth.models import User
@receiver(post_save, sender=User, dispatch_uid='save_new_user_profile')
def save_profile(sender, instance, created, **kwargs):
user = instance
if created:
profile = UserProfile(user=user)
profile.save()`
you might need additional instructions about how to make this work by checking this tuto: https://simpleisbetterthancomplex.com/tutorial/2016/07/28/how-to-create-django-signals.html

to make the above work, make sure to add this to user_profile/apps.py
`from django.apps import AppConfig
class UserProfileConfig(AppConfig):
name = 'user_profile'
def ready(self):
    from .signals import save_profile`

and to user_profile/init.py add this:
default_app_config = 'user_profile.apps.UserProfileConfig'


github-runner: install hashFiles expression function

Motivation for this change
Fixes a bug which caused workflow steps to fail if they called the
hashFiles expression function; we didn't install it. This commit makes
sure the Nodejs script is in the expected location.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 152596 run on x86_64-linux 1

1 package built:

github-runner


Cleanup

This PR performs some housekeeping after the latest merges:

fix compiler and sanitizer warnings
unify CMake build directory names for maintainer tasks
add CMake message when implicit conversions are switched off
update documentation
extend gitignore file

Coverage remained the same at 100.0% when pulling 3c7dc635e7690f76fe49d2d1b5dcd588d6e95c81 on cleanup into 43e07bb92dfea53b9aa93b241afb5c4b361e9a55 on develop.