research: Load and Stress Testing for Grid-Proxy

The goal is to perform stress and load testing (give the priority to the load testing) on the grid-proxy.  Stress and load testing are crucial to ensure the service can handle high traffic and maintain optimal performance under different scenarios.
Goals

Identify performance bottlenecks under stress and load conditions (load is the more important one).
Ensure the service can handle a high volume of concurrent requests.
Validate the service's stability and responsiveness during peak usage.

Test Scenarios

Scenario 1: Peak Load

Simulate a scenario where the service experiences peak load to evaluate its behavior under stress.

Scenario 2: Concurrent Connections

Test the service with a large number of concurrent connections to assess its ability to handle simultaneous requests.

Scenario 3: Resource Utilization

Monitor and analyze resource utilization (CPU, memory) during stress tests to identify potential bottlenecks.

... xD

Tooling Suggestions
To achieve the goals outlined above, the following tooling is recommended:

Load Testing Tool:

Consider using Vegeta or Locust for simulating realistic HTTP loads.

Monitoring and Profiling:

Integrate Prometheus for monitoring metrics such as response times, error rates, and resource utilization.
Utilize pprof for profiling the Go application to identify performance bottlenecks.

Automation:

Leverage continuous integration (CI) pipelines to automate the stress and load testing process.

Note: make sure to be hitting expensive endpoints too

17-11-2024
created script which used locally using vegeta pkg
testing main endpoints with Prometheus metrics for:

latency
total success request
success rate
error rate
count of http request based on status code

TODO:

add resource utilization metrics to promtheus
modify script
utilizing pprof

Update:
Promthues --> resource utilization already each node has node exporter could be monitored from Grafana since tests can be running on different machine
pprof --> need to modify in the server, not compatible with the mux server we are using, can be added in the upcoming refactoring of the api


fixed setting locale in admin pages

Small bug fix. Previously if you set in your app
I18n.default_locale = :fi
ComfortableMexicanSofa.config.admin_locale = :en

and loaded "/cms-admin/sites/" the locale wasn't set to :en because SitesController has some skip_before_filter commands. Fixed with new before_filter.

Thanks!


Upgrade to latest Smithay

This is mainly in order to add support for the pointer constraints Wayland protocol so that SDL will eventually pick up the relative mouse movements when going outside the edge of the window.
This turns out to be a huge refactor..

The good news is that the compiler is happy and I can finally build and test this; the bad news is that there's nothing in the stream..
The unit test in Wolf where I'm simply importing the buffer and checking it is failing, but when I debug it, it works. So I'm wondering if it's related to your comment about the sync.. I've added this but it might not be enough or not in the right spot?
https://github.com/games-on-whales/gst-wayland-display/blob/63d9e80081d54293718a26590e4ff8c19513b1b5/wayland-display-core/src/comp/mod.rs#L386-L391
Also, I've added a call to go from info.format() instead of hardcoding it
https://github.com/games-on-whales/gst-wayland-display/blob/63d9e80081d54293718a26590e4ff8c19513b1b5/wayland-display-core/src/comp/mod.rs#L334-L338
but I'm not sure it's working properly,
https://github.com/games-on-whales/gst-wayland-display/blob/63d9e80081d54293718a26590e4ff8c19513b1b5/wayland-display-core/src/comp/mod.rs#L300
prints out

Requested video format: RGBx .to_fourcc() = 0
so I guess it's going to the hardcoded path anyway.

I'll debug further what's going on with the GstBuffer on Wolf side.

Or maybe simply this missing bit should be implemented..
https://github.com/games-on-whales/gst-wayland-display/blob/63d9e80081d54293718a26590e4ff8c19513b1b5/wayland-display-core/src/comp/mod.rs#L499-L514


error: mounting /dev/pts: Operation not permitted

Describe the bug
sudo HOME=/root /nix/store/lsr79q5xqd9dv97wn87x12kzax8s8i1s-nix-2.13.2/bin/nix-env -i /nix/store/lsr79q5xqd9dv97wn87x12kzax8s8i1s-nix-2.13.2 --show-trace
installing 'nix-2.13.2'
error:
… while setting up the build environment
   error: mounting /dev/pts: Operation not permitted

Steps To Reproduce
Steps to reproduce the behavior:
Ubuntu 20.04 install nix
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.
Notify maintainers

Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
output here

Thanks for reporting. This appears to be a problem with the nix installer setting up its sandbox on ubuntu. I'll move the issue from nixpkgs to nix.
I suspect that this may have worked before https://github.com/NixOS/nix/pull/3600 was merged, so Nix <= 2.12.0.


Remove 'core' prefix for main related integration tests modules

[ ] An issue should be filed for the change unless this is a trivial change (fixing a typo or similar). One issue should ideally be fixed by not more than one commit and the other way round, each commit should fix just one issue, without pulling in other changes.
[ ] Each commit in the pull request should have a meaningful and properly spelled subject line and body. Copying the title of the associated issue is typically enough. Please include the issue number in the commit message prefixed by #.
[ ] The pull request description should explain what the pull request does, how, and why. If the info is available in the associated issue or some other external document, a link is enough.
[ ] Phrases like Fix # or Fixes # will auto-close the named issue upon merging the pull request. Using them is typically a good idea.
[ ] Please run mvn process-resources -Pformat (and amend the changes if necessary) before sending the pull request.
[ ] Contributor guide is your good friend: https://camel.apache.org/camel-quarkus/latest/contributor-guide.html

saas tests cancelled because of oom


Index of video in a playlist on youtube not tallying with the number during and after downloading

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.02.08. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[ ] I've verified and I assure that I'm running youtube-dl 2018.02.08

Before submitting an issue make sure you have:

[ ] At least skimmed through the README, most notably the FAQ and BUGS sections
[ ] Searched the bugtracker for similar issues including closed ones
[ ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[ ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2018.02.08
[debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2
[debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4
[debug] Proxy map: {}
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://www.youtube.com/watch?v=BaW_jenozKc
Single video: https://youtu.be/BaW_jenozKc
Playlist: https://www.youtube.com/playlist?list=PL4lCao7KL_QFVb7Iudeipvc2BCavECqzc

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
I tried downloading a set of videos randomly from a particular playlist on YouTube, then i noticed that when the program starts the downloading it assigns a number(or index) starting from 1 to the video instead of the original playlist index of the video on YouTube
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

C:\Users\USER>youtube-dl --config-location C:\Users\USER\Desktop\Youtube-dl --pl
aylist-items 77,78,79,80,81,82 https://www.youtube.com/playlist?list=PLBlnK6fEyq
RhG6s3jYIU48CqsT5cyiDTO
[debug] System config: []
[debug] User config: []
[debug] Custom config: ['-o', 'C:\\Users\\USER\\Desktop\\YouTube Videos\\%(playl
ist)s\\%(playlist_index)s.%(title)ss', '--console-title', '--write-thumbnail', '
-v', '-f', 'bestvideo[height<=480]+bestaudio/best[height<=480]']
[debug] Command-line args: ['--config-location', 'C:\\Users\\USER\\Desktop\\Yout
ube-dl', '--playlist-items', '77,78,79,80,81,82', 'https://www.youtube.com/playl
ist?list=PLBlnK6fEyqRhG6s3jYIU48CqsT5cyiDTO']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.02.04
[debug] Python version 3.4.4 (CPython) - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-89956-gcaa4bd7a9f, ffprobe N-89956-gcaa4bd7a9f
[debug] Proxy map: {}
[youtube:playlist] PLBlnK6fEyqRhG6s3jYIU48CqsT5cyiDTO: Downloading webpage
[download] Downloading playlist: Signals and Systems
[youtube:playlist] playlist Signals and Systems: Downloading 6 videos
[download] Downloading video 1 of 6
[youtube] XMuSNiCO-TI: Downloading webpage
[youtube] XMuSNiCO-TI: Downloading video info webpage
[youtube] XMuSNiCO-TI: Extracting video information
[youtube] XMuSNiCO-TI: Downloading thumbnail ...
[youtube] XMuSNiCO-TI: Writing thumbnail to: C:\Users\USER\Desktop\YouTube Video
s\Signals and Systems\1.jpg
WARNING: Requested formats are incompatible for merge and will be merged into mk
v.
[debug] Invoking downloader on 'https://r2---sn-nfp4uob-avnl.googlevideo.com/vid
eoplayback?mt=1518201347&mv=m&ms=au%2Crdu&source=youtube&keepalive=yes&mime=vide
o%2Fmp4&gir=yes&clen=3776723&requiressl=yes&mm=31%2C29&mn=sn-nfp4uob-avnl%2Csn-w
oc7en7d&itag=135&signature=AFE1F23913A8AA1FC1CE1463C5AAAAE1A8555B7E.E13F6B960824
D68556E2E829BC4E2C6931EE0B70&ipbits=0&aitags=133%2C134%2C135%2C136%2C137%2C160%2
C242%2C243%2C244%2C247%2C248%2C278&pl=20&dur=949.533&expire=1518223083&c=WEB&key
=yt6&initcwndbps=266250&ei=i-p9Wqn4HcfeW_CykagC&id=o-AJch_TTBHNzEm1LODEtxxseB-iN
QzYt9N0swRabBYRlw&lmt=1501779437916616&fvip=1&ip=<IP_ADDRESS>&sparams=aitags%2C
clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%
2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Crequiressl%2Csource%2Cexpire&ratebypass=yes'
[download] Destination: C:\Users\USER\Desktop\YouTube Videos\Signals and Systems
\1.Differentiation of Continuous Time Signalss.f135
[download] 100% of 3.60MiB in 00:20
[debug] Invoking downloader on 'https://r2---sn-nfp4uob-avnl.googlevideo.com/vid
eoplayback?mt=1518201347&mv=m&ms=au%2Crdu&source=youtube&keepalive=yes&mime=audi
o%2Fwebm&clen=13502093&requiressl=yes&mm=31%2C29&mn=sn-nfp4uob-avnl%2Csn-woc7en7
d&itag=251&signature=321700C3AE722C5B73998F667E60BD5DEF352616.4850B8E0282ADFEE82
ECE04ED0936AC43B1DD19A&ipbits=0&gir=yes&pl=20&dur=949.561&expire=1518223083&c=WE
B&key=yt6&initcwndbps=266250&ei=i-p9Wqn4HcfeW_CykagC&id=o-AJch_TTBHNzEm1LODEtxxs
eB-iNQzYt9N0swRabBYRlw&lmt=1501781526516639&fvip=1&ip=<IP_ADDRESS>&sparams=clen
%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmi
me%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Crequiressl%2Csource%2Cexpire&ratebypass=yes'
[download] Destination: C:\Users\USER\Desktop\YouTube Videos\Signals and Systems
\1.Differentiation of Continuous Time Signalss.f251
[download] 100% of 12.88MiB in 00:50
[ffmpeg] Merging formats into "C:\Users\USER\Desktop\YouTube Videos\Signals and
Systems\1.Differentiation of Continuous Time Signalss.mkv"
[debug] ffmpeg command line: ffmpeg -y -i "file:C:\Users\USER\Desktop\YouTube Vi
deos\Signals and Systems\1.Differentiation of Continuous Time Signalss.f135" -i
"file:C:\Users\USER\Desktop\YouTube Videos\Signals and Systems\1.Differentiation
 of Continuous Time Signalss.f251" -c copy -map "0:v:0" -map "1:a:0" "file:C:\Us
ers\USER\Desktop\YouTube Videos\Signals and Systems\1.Differentiation of Continu
ous Time Signalss.temp.mkv"
Deleting original file C:\Users\USER\Desktop\YouTube Videos\Signals and Systems\
1.Differentiation of Continuous Time Signalss.f135 (pass -k to keep)
Deleting original file C:\Users\USER\Desktop\YouTube Videos\Signals and Systems\
1.Differentiation of Continuous Time Signalss.f251 (pass -k to keep)
[download] Downloading video 2 of 6
[youtube] jPMxF_qYZdg: Downloading webpage
[youtube] jPMxF_qYZdg: Downloading video info webpage
[youtube] jPMxF_qYZdg: Extracting video information
[youtube] jPMxF_qYZdg: Downloading MPD manifest
[youtube] jPMxF_qYZdg: Downloading MPD manifest
[youtube] jPMxF_qYZdg: Downloading thumbnail ...
[youtube] jPMxF_qYZdg: Writing thumbnail to: C:\Users\USER\Desktop\YouTube Video
s\Signals and Systems\2.jpg
[debug] Invoking downloader on 'https://r1---sn-nfp4uob-avnl.googlevideo.com/vid
eoplayback/id/8cf33117fa9865d8/itag/135/source/yt_otf/requiressl/yes/pl/20/initc
wndbps/282500/mn/sn-nfp4uob-avnl,sn-woc7en7s/mm/31,29/ms/au,rdu/ei/3up9Wo7JE8GMW
o6zpKAB/mv/m/ratebypass/yes/mime/video%2Fmp4/otfp/1/otf/1/lmt/1501846908912168/f
vip/11/mt/1518201473/ip/<IP_ADDRESS>/ipbits/0/expire/1518223166/sparams/ip,ipbi
ts,expire,id,itag,source,requiressl,pl,initcwndbps,mn,mm,ms,ei,mv,ratebypass,mim
e,otfp,otf,lmt/signature/1B4983C790F5DB5F268BD240E0EC901273504818.85F42AA80932A0
5F7C101235085CA8B6C948DFBC/key/dg_yt0/'
[dashsegments] Total fragments: 119
[download] Destination: C:\Users\USER\Desktop\YouTube Videos\Signals and Systems
\2.Differentiation of Continuous Time Signals (Solved Problems)s.f135
[download]  15.1% of ~4.47MiB at 76.44KiB/s ETA 08:16
ERROR: Interrupted by user```

Link to the Playlist: https://www.youtube.com/playlist?list=PLBlnK6fEyqRhG6s3jYIU48CqsT5cyiDTO
This doesn't happen if you were to make use of the --playlist-start  - --playlist-end arguments.

@dstfw could you please direct me to the issue that's the same as this? Can't seem to locate it.


Mentions in YouTube video title change when using flat-playlist + English extractor

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I remove or skip any mandatory* field

Checklist

[X] I'm reporting a bug unrelated to a specific site
[X] I've verified that I'm running yt-dlp version 2023.01.06 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Provide a description that is worded well enough to be understood
YouTube has a feature called mentions, where a YouTube video's title can link to another channel. However, these can change the title based on if --flat-playlist is used vs if it isn't (with an English extractor).
Here is an example:
yt-dlp --simulate --flat-playlist --print filename --extractor-args "youtube:lang=en" https://www.youtube.com/playlist?list=PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0

Prints out:
Ala Barfi! ｜ Official Song ｜ @MohitChauhanOfficial ｜ @pritam7415 ｜ Swanand Kirkire ｜ Ranbir ｜ Priyanka ｜ Ileana [VBHjGRi4OqA].NA

While this:
yt-dlp --simulate --print filename --extractor-args "youtube:lang=en" https://www.youtube.com/watch?v=VBHjGRi4OqA

Prints out:
Ala Barfi! ｜ Official Song ｜ @Mohit Chauhan ｜ @Pritam ｜ Swanand Kirkire ｜ Ranbir ｜ Priyanka ｜ Ileana [VBHjGRi4OqA].webm

(The first one is a dummy playlist I made with only the video in it).
Notice how @MohitChauhanOfficial ｜ @pritam7415 changes to @Mohit Chauhan ｜ @Pritam when --flat-playlist isn't used. If I remove the English extractor, both become the top one (@MohitChauhanOfficial ｜ @pritam7415).
I don't really care which one stays the same between these, I just want consistency, so both have to be the same for my use case.
Thanks in advance!
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
yt-dlp --simulate --flat-playlist --print filename --extractor-args "youtube:lang=en" https://www.youtube.com/playlist?list=PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0 -vU:

[debug] Command-line config: ['--simulate', '--flat-playlist', '--print', 'filename', '--extractor-args', 'youtube:lang=en', 'https://www.youtube.com/playlist?list=PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0', '-vU']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2023.01.06 [6becd25] (pip)
[debug] Python 3.11.1 (CPython AMD64 64bit) - Windows-10-10.0.22621-SP0 (OpenSSL 1.1.1q  5 Jul 2022)
[debug] exe versions: ffmpeg 5.1.1-essentials_build-www.gyan.dev (setts), ffprobe 5.1.1-essentials_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.16.0, brotli-1.0.9, certifi-2022.12.07, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1760 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2023.01.06, Current version: 2023.01.06
yt-dlp is up to date (2023.01.06)
[youtube:tab] Extracting URL: https://www.youtube.com/playlist?list=PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0
[youtube:tab] PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0: Downloading webpage
[youtube:tab] PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0: Redownloading playlist API JSON with unavailable videos
[download] Downloading playlist: dummy playlist
[youtube:tab] Playlist dummy playlist: Downloading 1 items of 1
[debug] The information of all playlist entries will be held in memory
[download] Downloading item 1 of 1
Ala Barfi! ｜ Official Song ｜ @MohitChauhanOfficial ｜ @pritam7415 ｜ Swanand Kirkire ｜ Ranbir ｜ Priyanka ｜ Ileana [VBHjGRi4OqA].NA
[download] Finished downloading playlist: dummy playlist

----------------------------------------------

yt-dlp --simulate --print filename --extractor-args "youtube:lang=en" https://www.youtube.com/watch?v=VBHjGRi4OqA -vU:

[debug] Command-line config: ['--simulate', '--print', 'filename', '--extractor-args', 'youtube:lang=en', 'https://www.youtube.com/watch?v=VBHjGRi4OqA', '-vU']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2023.01.06 [6becd25] (pip)
[debug] Python 3.11.1 (CPython AMD64 64bit) - Windows-10-10.0.22621-SP0 (OpenSSL 1.1.1q  5 Jul 2022)
[debug] exe versions: ffmpeg 5.1.1-essentials_build-www.gyan.dev (setts), ffprobe 5.1.1-essentials_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.16.0, brotli-1.0.9, certifi-2022.12.07, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1760 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2023.01.06, Current version: 2023.01.06
yt-dlp is up to date (2023.01.06)
[youtube] Extracting URL: https://www.youtube.com/watch?v=VBHjGRi4OqA
[youtube] VBHjGRi4OqA: Downloading webpage
[youtube] VBHjGRi4OqA: Downloading android player API JSON
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec:vp9.2(10), channels, acodec, lang, proto, filesize, fs_approx, tbr, vbr, abr, asr, vext, aext, hasaud, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] VBHjGRi4OqA: Downloading 1 format(s): 244+251
Ala Barfi! ｜ Official Song ｜ @Mohit Chauhan ｜ @Pritam ｜ Swanand Kirkire ｜ Ranbir ｜ Priyanka ｜ Ileana [VBHjGRi4OqA].webm

--extractor-args "youtube:lang=en" applies only to single videos, and therefore not to --flat-playlist. Remove it to get consistent result

@pukkandan I can't remove it, because if I remove the --extractor-args "youtube:lang=en", then I get different outputs based on if I have --flat-playlist or not for certain videos with titles in a different language.
I added another video to the dummy playlist to showcase this:
yt-dlp --simulate --flat-playlist --print filename https://www.youtube.com/playlist?list=PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0

Outputs:
Ala Barfi! ｜ Official Song ｜ @MohitChauhanOfficial ｜ @pritam7415 ｜ Swanand Kirkire ｜ Ranbir ｜ Priyanka ｜ Ileana [VBHjGRi4OqA].NA
遊生夢死(Living idly and dying as if dreaming) - Eve MV [roh_p2l8DHo].NA

While this:
yt-dlp --simulate --print filename https://www.youtube.com/playlist?list=PLsPsHE7buzKlu_x-7N4x7uPuidp3Kq2Y0

Outputs:
Ala Barfi! ｜ Official Song ｜ @MohitChauhanOfficial ｜ @pritam7415 ｜ Swanand Kirkire ｜ Ranbir ｜ Priyanka ｜ Ileana [VBHjGRi4OqA].webm
遊生夢死 - Eve MV [roh_p2l8DHo].webm

Notice that even though it fixes the problem for the first video, the second video has a completely different title.
I have asked about this previously in the discord server and got a reply saying that I just have to use the English extractor, which works perfectly and bypasses this issue (the second video always shows up as 遊生夢死(Living idly and dying as if dreaming) - Eve MV [roh_p2l8DHo] with the English extractor). I need the --flat-playlist as not adding it takes way too long with the amount of videos in my actual playlist.

Perhaps what you want is --extractor-args youtube:lang=en-IN?

--extractor-args "youtube:lang=en" applies only to single videos, and therefore not to --flat-playlist. Remove it to get consistent result

I believe it's the opposite

What does the web browser show as the title in the playlist as well as the watch page with the youtube language set to English US?
There does seem to be some weird inconsistency here but I wonder if it's just to do with the different pages.

Yeah as far as I can tell this seems to be a bug/inconsistency on YouTube's end with how it handles the handles/hyperlinks to channels. I don't think there is anything we can do to reliably keep it consistent.


Request level coordinator slow logs

Related Issues
Resolves https://github.com/opensearch-project/OpenSearch/issues/9642
Documentation PR: https://github.com/opensearch-project/documentation-website/pull/5298
Description
Slow logs at coordinator level: As of now, we only have the capability to enable slow logs at a shard level for desired search phase(query and fetch). See this. Setting this threshold is tricky when customer usually sees latency spikes at a request level. Plus shard level slow logs doesn't offer a holistic view. So as part of this, we will also add capabilities to capture slow logs at a request level along with different search phases from coordinator node perspective.
Coordinator slow logs are governed by cluster settings.
// Setting on a whole request level
cluster.search.request.slowlog.threshold.warn: 10s
cluster.search.request.slowlog.threshold.info: 5s
cluster.search.request.slowlog.threshold.debug: 2s
cluster.search.request.slowlog.threshold.trace: 500ms

// Minimum level to print
cluster.search.request.slowlog.level: "trace"

Sample SearchRequestSlowLog:
% cat runTask_index_search_slowlog.log
[2023-10-27T11:38:06,741][TRACE][c.s.r.slowlog] [runTask-0] took[119.5ms], took_millis[119], phase_took_millis[{expand=0, query=76, fetch=24}], total_hits[1 hits], search_type[QUERY_THEN_FETCH], shards[{total: 10, successful: 10, skipped: 0, failed: 0}], source[{"query":{"query_string":{"query":"value1","fields":[],"type":"best_fields","default_operator":"or","max_determinized_states":10000,"enable_position_increments":true,"fuzziness":"AUTO","fuzzy_prefix_length":0,"fuzzy_max_expansions":50,"phrase_slop":0,"escape":false,"auto_generate_synonyms_phrase_query":true,"fuzzy_transpositions":true,"boost":1.0}}}], id[]

% cat runTask_index_search_slowlog.json | jq
{
  "type": "search_request_slowlog",
  "timestamp": "2023-10-27T11:38:06,741-07:00",
  "level": "TRACE",
  "component": "c.s.r.slowlog",
  "cluster.name": "runTask",
  "node.name": "runTask-0",
  "took": "119.5ms",
  "took_millis": "119",
  "phase_took": "{expand=0, query=76, fetch=24}",
  "total_hits": "1 hits",
  "search_type": "QUERY_THEN_FETCH",
  "shards": "{total: 10, successful: 10, skipped: 0, failed: 0}",
  "source": "{\"query\":{\"query_string\":{\"query\":\"value1\",\"fields\":[],\"type\":\"best_fields\",\"default_operator\":\"or\",\"max_determinized_states\":10000,\"enable_position_increments\":true,\"fuzziness\":\"AUTO\",\"fuzzy_prefix_length\":0,\"fuzzy_max_expansions\":50,\"phrase_slop\":0,\"escape\":false,\"auto_generate_synonyms_phrase_query\":true,\"fuzzy_transpositions\":true,\"boost\":1.0}}}",
  "cluster.uuid": "iH0dDisEQFar-1ZyfD_vjw",
  "node.id": "AR_pfXWRSm-di2Ru8aaruQ"
}

Thresholds are set based on total search duration, but logs include phase-level breakdown.
Testing

Launch local OpenSearch server with debugger
https://github.com/opensearch-project/OpenSearch/blob/main/TESTING.md#launching-and-debugging-from-an-ide

./gradlew run --debug-jvm

Create an index and ingest some data

curl -X PUT "localhost:9200/test2?pretty" -H 'Content-Type: application/json' -d'
{
  "settings": {
    "number_of_shards": 10
  }
}'

curl -X POST "localhost:9200/_bulk?pretty" -H 'Content-Type: application/json' -d'
{ "index" : { "_index" : "test2", "_id" : "1" } }
{ "field1" : "value1" }
{ "index" : { "_index" : "test2", "_id" : "2" } }
{ "field2" : "value2" }
{ "index" : { "_index" : "test2", "_id" : "3" } }
{ "field3" : "value3" }
{ "index" : { "_index" : "test2", "_id" : "4" } }
{ "field4" : "value4" }
'

Update and verify cluster setting

curl -X PUT "localhost:9200/_cluster/settings" -H 'Content-Type: application/json' -d '{"transient" : {"cluster.search.request.slowlog.threshold.trace" : "0ms"}}'
curl -X GET "localhost:9200/_cluster/settings?pretty&flat_settings"

Search request

curl -XGET 'localhost:9200/_search?pretty' -H 'Content-Type: application/json' -d'
{
 "query": { "query_string": { "query": "abc" } }
}'

Check output in OpenSearch server tab

Performance Tests
x% increase in P50, P90, P99 latency observed when logging all requests.
No significant impact to P50, P90, P99 latency observed when logging no requests (all searches under log threshold).
Procedure:

Spin up localhost OpenSearch cluster

./gradlew run

Update slowlog threshold cluster setting

curl -X PUT "localhost:9200/_cluster/settings" -H 'Content-Type: application/json' -d '{"transient" : {"cluster.search.request.slowlog.threshold.trace" : "0ms"}}'
curl -X GET "localhost:9200/_cluster/settings?pretty&flat_settings"

Run opensearch-benchmark nyc_taxis workload

opensearch-benchmark execute-test --workload-path=./nyc_taxis --pipeline=benchmark-only --client-options="basic_auth_user:'admin',basic_auth_password:'Admin_123'" --results-file=/tmp/output.txt

Results

Main
50th percentile latency
90th percentile latency
99th percentile latency

1
6.45966
7.16774
12.2049

2
7.14608
8.80989
14.7602

3
6.23131
9.04382
15.4128

4
6.7432
8.19057
11.8496

5
6.92057
8.19506
9.92856

6
6.01713
7.73637
10.7374

7
6.21754
7.18561
8.82464

8
7.15195
8.22125
12.5205

9
5.51498
7.36984
9.75166

10
7.6733
8.25051
11.0328

Mean
6.60757
8.01707
11.70231

St Dev
0.64087
0.64559
2.12586

Slowlog Off (-1 threshold)
50th percentile latency
90th percentile latency
99th percentile latency

1
7.14947
8.37281
12.2798

2
7.52558
8.81152
15.9566

3
6.53822
7.56006
10.7598

4
8.16498
8.82595
11.5625

5
7.20736
8.58643
10.4346

6
6.43303
8.07587
8.72964

7
6.73321
8.41968
9.49111

8
6.72711
8.32944
14.8351

9
6.53244
7.71201
16.0138

10
6.46849
7.6002
9.50796

Mean
6.94799
8.2294
11.95709

St Dev
0.56304
0.47424
2.73339

Slowlog On (0ms thresold)
50th percentile latency
90th percentile latency
99th percentile latency

1
7.69207
9.87628
13.73330

2
6.76473
7.63000
9.31518

3
6.28997
9.05151
16.19130

4
6.81525
8.31300
17.52860

5
7.74137
8.48340
10.63630

6
6.77349
8.65474
11.93540

7
7.31905
8.94366
15.39660

8
7.78096
8.90685
11.84000

9
6.36214
8.52370
15.33980

10
6.56414
8.96694
12.39780

Mean
7.01032
8.73501
13.43143

St Dev
0.57552
0.58148
2.63721

Check List

[x] New functionality includes testing.

[x] All tests pass

[x] New functionality has been documented.

[x] New functionality has javadoc added

[x] Commits are signed per the DCO using --signoff
[x] Commit changes are listed out in CHANGELOG.md file (See: Changelog)
[x] Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Hey -- sorry for the late idea, but can we maybe implement this a completely different way: as a search pipeline response processor?
It occurs to me that things like this that run at the coordinator level and depend on the search request/response could use search pipelines, rather than needing to modify OpenSearch core at all.

@msfroh Thanks for bringing up search response processors. I believe it can be done via search pipelines and I get your point about shifting logic into modules, but it does not exactly fit our use case. Coordinator slow logs are designed similar to existing shard slow logs so it does not make sense to implement then in different ways. I could see the argument if we wanted to move both into search pipelines (although don't think processors can be injected at the shard level currently).
Also, we want to keep the user experience consistent between request vs shard slow logs. For search pipelines, users would need to pass a parameter with every request to enable logging. This itself is not an issue, but seems unintuitive for request slow logs to require a param while shard slow logs uses index settings.
// To use a pipeline with a query, specify the pipeline name in the search_pipeline query parameter:
GET /my_index/_search?search_pipeline=my_pipeline

For search pipelines, users would need to pass a parameter with every request to enable logging.

That's not actually true. You can specify a default search pipeline for an index, such that the pipeline gets applied on every request (by default).

Coordinator slow logs are designed similar to existing shard slow logs so it does not make sense to implement then in different ways.

That's kind of a circular argument: "We did it this way, so it doesn't make sense to do it another way."
I would argue that the existing shard-level slow logs were not a great choice in the first place. Why would I want shard-level logging for slow queries before having request-level logging for slow queries?
In my opinion, we have an opportunity to build something that is more useful (i.e. request-level logging), easier to configure (i.e. a response processor), and that doesn't need to be permanently woven into core search APIs.

So, I've been thinking about this some more, and I think I like both solutions:

coordinator slow logs that behave like shard-level slow logs as a short-term solution that addresses the (significant) problems with shard level slow logs (see e.g. https://github.com/opensearch-project/OpenSearch/issues/2054), and
a search pipeline response processor that can log queries, optionally based on conditions.

IMO, we should do both.
The response processor query logging doesn't need to be limited to slow logging. (Maybe I only want to log every query containing a prefix query. Maybe I want to log different subsets of queries to different places.) In the long run, I think the response processor logging could replace coordinator-level slow logging, but that should be up to users to decide which they want to use.

Looks like you have a merge conflict still.
The buildRewriteListener method still uses searchRequestOperationsListener:
> Task :server:compileJava FAILED
/var/jenkins/workspace/gradle-check/search/server/src/main/java/org/opensearch/action/search/TransportSearchAction.java:525: error: cannot find symbol
                searchRequestOperationsListener
                ^
  symbol:   variable searchRequestOperationsListener
  location: class TransportSearchAction
/var/jenkins/workspace/gradle-check/search/server/src/main/java/org/opensearch/action/search/TransportSearchAction.java:579: error: cannot find symbol
                    searchRequestContext
                    ^
  symbol:   variable searchRequestContext
  location: class TransportSearchAction
/var/jenkins/workspace/gradle-check/search/server/src/main/java/org/opensearch/action/search/TransportSearchAction.java:601: error: cannot find symbol
                            searchRequestContext
                            ^
  symbol:   variable searchRequestContext
  location: class TransportSearchAction
/var/jenkins/workspace/gradle-check/search/server/src/main/java/org/opensearch/action/search/TransportSearchAction.java:652: error: cannot find symbol
                                searchRequestContext


[FEATURE]: improve notify

[ ] Improve the input field by adding a modal
[ ] Set a title field to notify
[ ] User can see the list of notifies they scheduled
[ ] User can edit/delete a specific notify Schedule

This Idea I cancelled due to insufficient implementation and laziness


Using temporary variable to check existence

Flow version: 0.107.0
Very simple reproduction shown in the flow try
Expected behavior
When using a temporary variable derived from a value to check the existence of that value, I expect type refinement to happen on the original value.
Actual behavior
Checking a temporary variable derived from the variable in question does not refine the type of the original value.

Link to Try-Flow or Github repo:
https://flow.org/try/#0GYVwdgxgLglg9mABAWwJ4DFwQBQAcCGATvsgFyID8AzlITGAOYCUiA3gFCKIQI2IxUACoTgA3GABMAphPIAjOHAA2U-EgC8iAIRaCxZJ0SGeYPoVVKAyrXoNyNOo0SaBwsZJmVEekonIByaWB8ECUof3YAXyA

Well, I ran into this exact issue and went to create a new issue. Little did I know some helpful user already made an issue for it 🤦♂ . Here's another flow try that shows the behavior
https://flow.org/try/#0CYUwxgNghgTiAEA3W8oC54H4DOAXGAlgHYDmAUKJLAsjPAEYaZECuAtvSDGWWAPZE8qAIJFgAIQz0+fCCChF4AXngBCVVHgAyLWtX0eBAGbwAFFFESAlPADeZePH6DcqAAqE2IDHkKllqGQAvmRAA

Flow only supports type refinements in a limited set of syntactic forms.


Dev/frames ui

Introduction
modified frames UI
Description
I have changes Ui as required, but now I have not added date and id.
How to test
In frames.js I have modified Frames UI

This PR does not contain my changes, Again asking to update your master from origin(dev-frames) and not from origin(master).
I have merged you old commit in new branch in origin --> deb-frames
Then I have made my commits there over your changes.
And all these are yet not available in origin(master).
So please create a new branch in your fork and update that branch from origin(dev-frames).
Then you will get the changes that i have pushed.
Over which you just need to fix the frames.
Please try to understand the concept.


Fix performance issues and refactoring the addon with the modern Wow API

The addon redraws all map markers when a nameplate disappearing or the player entering a new zone, which can cause significant performance issues.
In particular, turning the lens in an area full of nameplates, redrawing events will occur in each rendering ticket.
It seems that registering NAME_PLATE_UNIT_REMOVED and letting it hit the else branch (causing redraw) is an unexpected result. Removing it does not seem to have side effects, but it can significantly alleviate performance issues when turning the lens.
Similarly, since CodexMap:UpdateNodes() draws all map markers each time, it is no longer necessary to register for zone change events.

This may fix https://github.com/project-classic/ClassicCodex/issues/31 and https://github.com/project-classic/ClassicCodex/issues/27
For https://github.com/project-classic/ClassicCodex/issues/27, although it takes a long time to draw these markers each time, there may no significant performance issue as long as it is not redrawn.

If someone wants to try my fix right away, the addon package can be downloaded via the link below.
Must rename the directory to ClassicCodex, or the addon will not load.
https://github.com/SwimmingTiger/ClassicCodex/archive/master.zip
If you find that my changes are causing any problems, please reply here.

Done. rendering pipeline has been refactored to ensure that it is redraw only when necessary.
I have only conducted a simple test and I will continue to test it in the game to make sure there are no side effects.

Fixed the problem with the database not matching the real quest name. Because Blizzard API returns the quest id directly, everything becomes very simple.
local title, _, _, header, _, complete, _, questId = GetQuestLogTitle(questLogId)

Done the fix. I have modified all the code to get the quest title from the Blizzard API. The addon now only uses the quest titles in its own database.
I have tested and used ClassicCodex's zhTW database in a zhCN Wow client (most quest names don't match). It seems that everything is working fine.
I will continue the game to find more possible problems.

I found that I could draw a lot of makers by searching the quest "https://classic.wowhead.com/quest=1712/cyclonian" in the ClassicCodex Browser.
All icons are drawn in 1 second. Although it was obvious when drawing, there was no stuck in the follow-up. very good.

In addition, I also noticed the lack of location data in the quest database. For example: https://classic.wowhead.com/quest=6621/king-of-the-foulweald does not have any location information about its quest item. At first I thought this was a bug in the addon. After searching in the database, it was discovered that there is no location data at all. But obviously, wowhead currently has the location data of the item.
Therefore, we should consider a comprehensive update of the database. Of course this has nothing to do with the current Pull Request. If I do the work, I will open a new Pull Request or Issue.

The database info was extracted from a private server database. There's no
way of extracting that data from wowhead. Questie started making manual
changes to their DB with the many devs they have and have recently offered
to possibly share the DB so we could benefit from updated data
On Sat., Sep. 14, 2019, 6:20 a.m. 老虎会游泳<EMAIL_ADDRESS>wrote:

In addition, I also noticed the lack of location data in the quest
database. For example:
https://classic.wowhead.com/quest=6621/king-of-the-foulweald does not
have any location information about its quest item. At first I thought this
was a bug in the addon. After searching in the database, it was discovered
that there is no location data at all. But obviously, wowhead currently has
the location data of the item.
Therefore, we should consider a comprehensive update of the database. Of
course this has nothing to do with the current Pull Request. If I do the
work, I will open a new Pull Request or Issue.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/project-classic/ClassicCodex/pull/33?email_source=notifications&email_token=ADR4JCW7Z6SGYRYKMU77O3LQJS3G7A5CNFSM4IVWA2EKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6WY74Q#issuecomment-531468274,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADR4JCUC3FUBQGDQMPKCWTLQJS3G7ANCNFSM4IVWA2EA
.

BigFoot users have reported a problem saying that after completing a class quest, they can still see its equivalent version appearing as an available quest in another zone, but they can't actually find the quest in game.
For example, someone finished https://classic.wowhead.com/quest=1505/veteran-uzzek so he cannot find https://classic.wowhead.com/quest=1818/speak-with-dillinger in game, but the latter is still displayed as an available quest on the map.
It seems that ClassicCodex (and pfQuest) is simply missing a quest mutual exclusion mechanism? @pgarneau

Hey Swimming, im just a random person who likes this addon and wants to use it since it stopped working! I contacted the addon developer on reddit since I was having issues and it led me here.
Another aspect of the performance issues, I believe, is the drawing of map markers for world drops, i.e. the quest Cyclonian has Liferoot as one of the required items, which has a very low chance to drop from many mobs in the game. This causes ClassicCodex to render map markers all over the world map for an extremely large number of mobs, and causes a lot of stuttering. While talking to the addon developer he suggested changing the minimumDropChance variable to equal 1 instead of 0, which will hide Liferoot during Cyclonian and any similar quests (Nogg's Ring Redo has Moss Agate as a requirement, as another example off my head).
Just thought you'd like to bundle this in with your changes since it seems (tangentially) related. It's a one character change but here's a commit for reference: https://github.com/Whaitiri/ClassicCodex/commit/1f84bd9f0f2c55d0c4ec3d9b7544c7649d0648ed

Thanks for your work on this addon either way, think I'll be using your version for a little while :)

I have just pushed a minor fix for a big issue (4142bb5). For some quests (such as id 1149 Test of Faith), GetQuestLogLeaderBoard() may get a full nil returns. At this point the addon will continue to trigger Lua errors and will not be able to render any new map markers.

@Whaitiri Thanks for your solution, I will add it as an option in ClassicCodex Settings.

@pgarneau There are currently no more bug feedback. I think you can merge this Pull Request now.
The option of minimumDropChance will become another Pull Request.

Please modify the minimumDropChance at least 2-3% and you can dp a PR later
for an ingame option.
Ill merge after
On Sun., Sep. 22, 2019, 3:45 a.m. 老虎会游泳<EMAIL_ADDRESS>wrote:

@pgarneau https://github.com/pgarneau There are currently no more bug
feedback. I think you can merge this Pull Request now.
The option of minimumDropChance will become another Pull Request.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/project-classic/ClassicCodex/pull/33?email_source=notifications&email_token=ADR4JCSYVPXIA3NZG6BULRDQK4PABA5CNFSM4IVWA2EKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7JANUI#issuecomment-533858001,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADR4JCVXS24IH7RJNC76MPTQK4PABANCNFSM4IVWA2EA
.

@pgarneau Done. Added a new option to hide low probability drop items. The default value is 2%, which only applies the item that from the QuestLog (browser queries are not restricted).


chore: delete modules and use latest from npm

Deletes the code of everything under packages/** and takes a dependency on the published modules instead. Modules are new mastered in cdk8s-core, cdk8s-cli and cdk8s-plus-17.
Doc website, examples and integration tests are now executed against the released versions (installed via the root package.json file).

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

@iliapolo Ready for another round


Better syntax for ## and #=

cc @bobzhang
Currently, for BuckleScript (and hopefully jsoo) we have foo##bar for dot access, and foo##bar #= 1 for object field assignment.
The feedback we've gotten is that people are scared of "hash hash" ¯_(ツ)_/¯
So we can special-case hash hash and hash equal to something else in Reason. Proposal:

foo..bar .= baz
foo->bar <- baz
foo."bar" = baz

Third one might or might not work. #= can be another PR then.
Third one allows names that are otherwise illegal, e.g. foo."BAR-BAZ_QUX"

Yes I will confirm that ## is too heavy for me https://github.com/bsansouci/tapknight/blob/6c3d7371a5c67209d75ee6bc309db755d8cf4081/src/client.re#L57, especially formatted like this ^.
If spacing was added as a special case, life would be a tiny bit nicer.
Could we get foo->bar = baz to work? otherwise I'd prefer 2nd.
Getting sidetracked:
It'd be interesting if we could open a syntax locally to a scope. For example, it'd be cool to locally override {} and foor.bar = bas to be [%bs.obj {}] and foo##bar #= baz. That overriding could maybe look like
let obj = JS.(
  bar.baz = 10; /* bar##baz #= 10; */
  let a = {}; /* let a = [%bs.raw "{}"] */
 print_endline bar.baz; /* console.log(bar##baz); */
 bar
);

obj.baz /* error, this is of type Js.obj and not a record with a field bas */

It would be like you open a module. It would probably become a bit strange if you need to use records inside a JS.(...) block.

It'd be interesting if we could open a syntax locally to a scope

Might be dangerous if you refactor code and pull e.g. a function out.
The thing about foo->bar = baz and foo."bar" = baz and foo..bar = baz to infer what to desugar = to, is that I'm not sure if this is possible: myRefToFooBar = baz. In which case this'd fail. Others know better.

I like proposal 1, another important thing is to make merlin easy to auto-complete
cc @let-def

Adding a 4th proposal that @bobzhang mentioned.

Out of these options I would prefer (3) or (4). I don't like (1) much because I feel like having more instances of . and .. in the syntax is just going to look confusing. I already kind of wish we would only have ....
Regarding merlin, the prefix that gets sent to merlin is determined by the editor, so I don't think the choice of which syntax we use here will have much impact on that (the editor modes will need to be updated regardless).
One other possibility to keep in mind is that once we have modular implicits, we might be able to overload # so we wouldn't even need to have ##. We might not even need to wait for that if we were willing to use an approach like ppx_implicits currently does.

Ok, spiritually bumping the priority of this a bit.
The name mangling part of BS, foo##bar_baz (which compiles to foo.bar) is gonna trip a lot of people. Proposal 3 fixes this. We don't have to worry about the assignment operator for now.
Tldr foo."bar_baz" which desugars to ??? (cc @bobzhang) which compiles to the correct foo.bar_baz.
cc @bsansouci @SanderSpies.

see my thoughts here: https://github.com/bloomberg/bucklescript/issues/999

How about obj['property'] = value


Convert full ELR HL7 ORC segment data to FHIR resource for the first observation

User Story:
As a sender, I want my all of my submitted data to be converted to FHIR, so it can be fully and accurately reported to STLTs.
Description/Use Case
We have an initial HL7 to FHIR conversion, but we now need to verify that all data fields are correctly converted and contained in a FHIR resource to make sure we do not lose any data in the conversion.  This work is to verify that ALL data is retained without any loss for a given HL7 portion (see acceptance criteria).
Risks/Impacts/Considerations

May need some research as to what resources will contain a piece of data.
Is there a possibility we are not able to decode some HL7 data due to the current libraries we are using?
There seem to be duplicate resources in the generated FHIR bundle, so care must be taken to remove those duplicates as needed.
There are duplicate segments in the HCA HL7 messages that need to be handled accordingly.  May need to communicate with HCA to ask about those segments, but it is expected those are coming from the source and we will probably have to handle them.

Dev Notes:

The HL7 to FHIR conversion is configuration driven.
HCA sample data is stored in Keybase.  It has no PII.
Note there are repeating OBR segments, and each segment has its own set of segments up to the next OBR segment.

Acceptance Criteria

The full ELR HL7 ORC segment data is converted to FHIR resources.
The segment's HL7 conversion is documented using the HL7 v2 to FHIR mapping information.
All available data from the ORC segment fields of an HCA full ELR HL7 message are stored as part of the FHIR bundle.

Spreadsheet with mappings:
HL7 to FHIR - ORC Segment.xlsx
HL7 to FHIR - ORC Segment.pdf
Sample HL7 file (rename to sample_hl7.hl7):
sample_hl7.txt


SingleChildScrollView, desktop, touchpad, scroll on dragbar

Steps to reproduce

Run the sample
Move the cursor to the edge to show the dragbar (over the dragbar)
Scroll on touchpad

Expected results
Widget also scrolls.
Actual results
The widget does not scroll.
Windows and MacOS have this issue.
I have no Linux touchpad to test.
Code sample
Code sample
import 'package:flutter/material.dart';

/// Flutter code sample for [SingleChildScrollView].

void main() => runApp(const SingleChildScrollViewExampleApp());

class SingleChildScrollViewExampleApp extends StatelessWidget {
  const SingleChildScrollViewExampleApp({super.key});

  @override
  Widget build(BuildContext context) {
    return const MaterialApp(
      home: SingleChildScrollViewExample(),
    );
  }
}

class SingleChildScrollViewExample extends StatelessWidget {
  const SingleChildScrollViewExample({super.key});

  @override
  Widget build(BuildContext context) {
    return DefaultTextStyle(
      style: Theme.of(context).textTheme.bodyMedium!,
      child: LayoutBuilder(
        builder: (BuildContext context, BoxConstraints viewportConstraints) {
          return SingleChildScrollView(
            child: ConstrainedBox(
              constraints: BoxConstraints(
                minHeight: viewportConstraints.maxHeight,
              ),
              child: Column(
                mainAxisSize: MainAxisSize.min,
                mainAxisAlignment: MainAxisAlignment.spaceAround,
                children: List.generate(10, (int i) {
                  return Container(
                    color: i.isEven
                        ? const Color(0xffeeee00)
                        : const Color(0xff008000),
                    height: 120.0,
                    alignment: Alignment.center,
                    child: Text('List item $i'),
                  );
                }),
              ),
            ),
          );
        },
      ),
    );
  }
}

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[√] Flutter (Channel stable, 3.24.5, on Microsoft Windows [Version 10.0.22631.4460], locale en-US)
    • Flutter version 3.24.5 on channel stable at D:\DevEnv\flutter\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision dec2ee5c1f (2 weeks ago), 2024-11-13 11:13:06 -0800
    • Engine revision a18df97ca5
    • Dart version 3.5.4
    • DevTools version 2.37.3

[√] Windows Version (Installed version of Windows is version 10 or higher)

[X] Android toolchain - develop for Android devices
    X Unable to locate Android SDK.
      Install Android Studio from: https://developer.android.com/studio/index.html
      On first launch it will assist you in installing the Android SDK components.
      (or visit https://flutter.dev/to/windows-android-setup for detailed instructions).
      If the Android SDK has been installed to a custom location, please use
      `flutter config --android-sdk` to update to that location.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[√] Visual Studio - develop Windows apps (Visual Studio Community 2022 17.7.0)
    • Visual Studio at C:\Program Files\Microsoft Visual Studio\2022\Community
    • Visual Studio Community 2022 version 17.7.34003.232
    • Windows 10 SDK version 10.0.22621.0

[!] Android Studio (not installed)
    • Android Studio not found; download from https://developer.android.com/studio/index.html
      (or visit https://flutter.dev/to/windows-android-setup for detailed instructions).

[!] Proxy Configuration
    • HTTP_PROXY is set
    ! NO_PROXY is not set

[√] Connected device (3 available)
    • Windows (desktop) • windows • windows-x64    • Microsoft Windows [Version 10.0.22631.4460]
    • Chrome (web)      • chrome  • web-javascript • Google Chrome 131.0.6778.86
    • Edge (web)        • edge    • web-javascript • Microsoft Edge 130.0.2849.80

[√] Network resources
    • All expected network resources are available.

! Doctor found issues in 3 categories.

It seems to work very well on my devices
https://github.com/user-attachments/assets/bf985e76-75ce-4308-8951-a527d534ad39

Desktop on Windows and MacOS have this issue.
Web works fine.

2. Move the cursor to the edge to show the dragbar (over the dragbar)

@fufesou Can you provide a small video that shows the reported behavior ? I didn't completely understand this step.

Sorry for late

@fufesou
I tried on macOS desktop using latest master and I was able to see the expected behavior per original issue description, ie, the widgets scrolls, as shown below:
https://github.com/user-attachments/assets/e8659363-2e31-4307-bb82-7528dca388a9

I tried the master channel on macOS. Still got the issue.
@darshankawar Did you use the trackpad?

@darshankawar Did you use the trackpad?

Yes, with trackpad, this is replicable, but not with mouse. The reported behavior seems to occur on desktop platforms only, as on web, the screen scrolls if the pointer is on scrollbar and we try to scroll using trackpad.
Keeping the issue open for team's tracking.
stable : 3.24.5
master : 3.27.0-1.0.pre.744


CAAX box

child of
http://www.sequenceontology.org/browser/current_release/term/SO:0100017
A C-terminus protein motif (CAAX)  serving as a post-translational  prenylation site modified by the attachment of either a farnesyl or a geranyl-geranyl group to a cysteine residue.
Farnesyltransferase recognizes CaaX boxes where X = M, S, Q, A, or C, whereas Geranylgeranyltransferase I recognizes CaaX boxes with X = L or E

Hi Val,
I am sorry it took me so long to get back to looking at the issue requests. This term has now been added with the definition that you provided.
Thanks,
Dave

Thanks!
Val

I don't see it yet. Could you pop the SO ID into this ticket?
Thanks

Hi Val,
Sorry, I forgot to put the info in the comment. The web browser updates once daily and was probably not updated when you responded.
id: SO:0002230
name: CAAX_box
http://www.sequenceontology.org/browser/current_svn/term/SO:0002230
Sometimes the browser has trouble updating. If browsing does not work then the I will email the manager of the website.
Thanks,
Dave


parse message type description correctly

Requires branching for dashing!
Fixes ros-visualization/rqt#197
Signed-off-by: Karsten Knese<EMAIL_ADDRESS>

Requires branching for dashing!

Instead of breaking compatibility the patch could easily be updated to be compatible with both version. I will edit it in place...


[FMS-6] Implement storage strategy: FILE

Storage strategy - FILE (no storage into database)
File storage based  on the following rule: ${file.db.location} / ${tenant} / ${file_id}
To storage the file, the request will contains: tenant. To return the file_id.
To receive the file, the request will contains: tenant and file_id.

done


c++ and python inference give different result with params trained on python

Description
I trained a shallow yolo-like model on python (dtype=float32), and got different results while running inference with c++ api (GetDType=0).
I visualize come output activation as follows:
confidence activation with python and c++ api
Environment info (Required)
ubuntu 18.04 with mxnet 1.4.0 cpu build
Build info (Required if built from source)
Compiler:
g++
MXNet commit hash:
b3b952f9d5490ee2707209ab866e6c3f094e2046
Minimum reproducible example
I modified the code from the cpp-package inference example and loaded with my python trained symbol.json and .params file.

@hallazie Could you please provide the code you run with?
@leleamol here to see if you can help

@hallazie
Can you please provide some details such as:

Modifications to the inference example.
The output you were expecting
Details about the model you have trained, etc

It will help us answer the question.
Thanks

@mxnet-label-bot add ["Pending Requester Info"]

@hallazie Close it for now since the question has been answered. Please feel free to reopen if the suggest solution did not fix your problem.


Support for Gindex,Onedrive Index

Can you add support for gindex,onedrive index support ? It will allow us download superfast,without logging in to the account

You may be confused between the two, you should set up the above platform and then send the download link to this program for download


Certificate verify failed (URLError(err))

When i try to run:
geckodriver_autoinstaller.install()
I get this error message:
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1108)>
I'm not sure what's wrong; whether its my side or something else i need to install?

I had the same issue running Python 3.6 on macOS 10.14. Turns out default Python 3.6 is kinda broken and needs a workaround for SSL requests, e.g. https://stackoverflow.com/questions/57630314/ssl-certificate-verify-failed-error-with-python3-on-macos-10-15/57630381


Request: Add child selector support to 'appendTo' option

Environment

flatpickr version used: 4.5.2
Browser name and version: Firefox Developer Edition 64.0b11 (64-bit)
OS and version: Arch Linux (rolling release; up to date a week ago)

Suggestion
In the following example everything functions as expected:
flatpickr('#fooID', {
        appendTo: barHTMLElement
}

Consider the next example:
flatpickr('.fooClass', {
        appendTo: barHTMLElement
}

This allows for multiple elements to trigger flatpicker which will always appear at 'barHTMLElement'.
It would be useful if 'appendTo' would accept a selector used to search for child elements of '.fooClass' as follows:
flatpickr('.fooClass', {
        appendTo: '.barClass'
}

..or perhaps:
flatpickr('.fooClass', {
        appendToDescendants: '.barClass'
}

I just realized I actually want a sibling not a descendant element.
My solution is to iterate over the elements passing each one to flatpicker as an element rather than as a selector:
document.querySelectorAll('.foo').forEach(el => {
    flatpickr(el, {
        appendTo: el.nextElementSibling,
    });
});

@DeltaBravo glad you figured it out. I'm really unsure what this library could do to make things easier for you - all relevant elements and methods are already exposed in the flatpickr instance.


Backward model with one-dimensional feature

Hi!
Thanks for making the a python version of mTRF toolbox!
I would like to address following issue: the backward model is currently not working for one-dimensional features. The basic usage example of the backward model (https://mtrfpy.readthedocs.io/en/latest/basics.html#backward-model)
envelope = [s.mean(axis=1) for s in stimulus]
bwd_trf = TRF(direction=-1)
bwd_trf.train(envelope, response, fs, tmin, tmax, regularization=1000)
r_bwd, mse_bwd = cross_validate(bwd_trf, stimulus, response)
print(f"correlation between actual and predicted envelope: {r_bwd.round(3)}")

This code is working. However it uses stimulus (i.e., the spectrogram with 16 frequency band). If you use the same code but replace stimulus with envelope (r_bwd, mse_bwd = cross_validate(bwd_trf, envelope, response)), an assertion error occurs (assert x.ndim == 2 and y.ndim == 2). By reformatting the shape of the one-dimensional feature (similar to stimulus) different errors popped up.
Thanks!

Hey Marlies,
Thanks for catching that bug! I think the error is raised because per default numpy removed the dimension that is averaged. It should work if you replace the first line with
envelope = [s.mean(axis=1, keepdims=True) for s in stimulus]
But the TRF should definitely be able to handle one-dimensional features , I'll look into it

Also just noticed that there is another error in this example. The cross_validate should use envelope, not stimulus as parameter. I fixed the documentation as well as the dimensions issue, once you download the latest version using pip, it should work. Once you confirmed it works, feel free to close the issue :)

It works! Thanks!


CI not automatically publishing

The publish action in CI isn't automatically running after the bot pushes updates

@lengau Is it still happening?

@soumyaDghosh unfortunately yes - I had to kick off the run for version 0.6.8 manually: https://github.com/snapcrafters/ruff/actions/workflows/release-to-candidate.yaml

I suspect this is because you're using the internal GitHub token for commit permissions. You need to use SNAPCRAFTERS_BOT_COMMIT because the internal one is designed by GitHub to not cause any push-triggered actions to run when using it to push changes to a branch.

Thanks @lucyllewy - that checks out! Fixed now.


Don't work if username and password is different

Hello, thanks for this lib
This lib seems only work when username and password it's the same, which is quite strange.
Look this line https://github.com/lauslim12/basic/blob/main/basic.go#L92
users[username] is returning the password, not the username. Then this comparison is wrong

Thank you so much for reporting this error. I just realized the comparison is wrong and would be fixing this as soon as possible.

I have updated the library with this pull request: https://github.com/lauslim12/basic/pull/6, and have released a new library version which addresses this issue. I have also added more tests to catch this error.
Please take a look when you have time, and thank you again for reporting this problem!

I will test it now, thanks for your reactivity

Work as expected to me :heavy_check_mark:

Thank you so much! ❤


Extending Example 18: DG Euler Equations

Hello,
I am a new user to mfem and would like to use mfem to solve compressible Euler equations.
Is it possible to extend example 18: DG Euler Equations to implicit time stepping with triangular mesh? If yes, could I get some advise of how to achieve this?
Thanks in advance!
Henry

Hi Henry,
It is certainly possible to extend it to these cases. In fact, the example should be able to work with triangular meshes now, but as far as I can tell there is no periodic mesh that uses triangles included in the MFEM data directory. You could implement a different boundary condition and use a triangular mesh that MFEM provides.
Extending it to implicit time stepping poses no challenges for MFEM, but is beyond the scope of a simple example. Doing so requires computing derivatives of the fluxes, which can become quite a bit of code for a nonlinear system like this. Example 16 (nonlinear scalar diffusion) is a good example to follow of adding implicit time-stepping - the gist of it is that you need to implement FE_Evolution::ImplicitSolve.
I hope this helps,
Johann

Hello Johann,
Thanks for the response!!
Would it be possible to link mfem to Sacado in the Trilinos package to perform automatic differentiation in order to prevent computation of the derivative of the fluxes?
Thanks again!
Henry

Certainly. All you need to provide is a means of obtaining the vector du/dt given a scalar timestep dt, and an input state vector u. How you implement that is entirely up to the application. Inside that method it can certainly call an AD package.

You can use petsc and obtain a matrix-free action of the Jacobian, or a
finite-differenced assembly. Just use a PetscOdeSolver , see ex9 in the
petsc subdirectory for an example
Il Ven 18 Mag 2018, 23:46 sakupkmnc616<EMAIL_ADDRESS>ha
scritto:

Hello Johann,
Thanks for the response!!
Would it be possible to link mfem to Sacado in the Trilinos package to
perform automatic differentiation in order to prevent computation of the
derivative of the fluxes?
Thanks again!
Henry
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mfem/mfem/issues/496#issuecomment-390327565, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AE4lAWe_O4hWb1TWp8Jd5PoMIjSHB_Pxks5tzzMngaJpZM4UFPbS
.

Hello all,
Thanks for the response!!
If I encounter any problems/issues, I will post them on this discussion thread!
Henry

Glad we could help! I'm closing for now, but feel free to open it again if you have questions.


Allow phpdoc for language constructs, fixes #2634

if list is supported, shouldn't its shorthand counter part on 7.1 be as well? For example:
/** @var int $a */
[$a] = $array;

Possibly
Op 24 mrt. 2017 08:19 schreef "SpacePossum"<EMAIL_ADDRESS>
if list is supported, shouldn't its shorthand counter part on 7.1 be as
well? For example:
/** @var int $a */[$a] = $array;
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/FriendsOfPHP/PHP-CS-Fixer/pull/2636#issuecomment-288950793,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAGzWDf__qJdkv00C5LcWXgGMcspNmp3ks5ro25zgaJpZM4MngAB
.

ping @ceeram

whats up?

could you handle case provided by SpacePossum please ?

I can do that. Not sure when I get to doing so.
Op 30 mrt. 2017 22:56 schreef "Dariusz Rumiński"<EMAIL_ADDRESS>could you handle case provided by SpacePossum please ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/FriendsOfPHP/PHP-CS-Fixer/pull/2636#issuecomment-290542511,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAGzWHQ6mt8jJAdUqOf58cLwBGoxrR5oks5rrBb-gaJpZM4MngAB
.

Closing as picked up by SpacePossum in #2657
cc @ceeram


ReferenceStore creation, non-async

Fixes #202

Just made those changes. Potentially a use case for https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/try once available as well


Update LICENSE to GitHub compatible

Following https://github.com/Polymer/lit-html/pull/84

Reference: GitHub Help: Adding a license to a repository

We're generally really careful about how we handle LICENSE files, as we've got policies we're operating under. Passed this to @tjsavage who's the most knowledgable on the team about those policies.

Friendly ping to @tjsavage.

@tjsavage, may I ask what is up with this?


correct comments for "compress edge if it crosses a traffic signal"

Issue
What issue is this PR targeting? If there is no issue that addresses the problem, please open a corresponding issue and link it here.
Closes https://github.com/Telenav/osrm-backend/issues/198
Please read our documentation on release and version management.
If your PR is still work in progress please attach the relevant label.
Tasklist

[ ] CHANGELOG.md entry (How to write a changelog entry)
[ ] update relevant Wiki pages
[ ] add tests (see testing documentation
[ ] review
[ ] adjust for comments
[ ] cherry pick to release branch

Requirements / Relations
Link any requirements here. Other pull requests this PR is based on?
This PR is cherry-pick from https://github.com/Project-OSRM/osrm-backend/pull/5384 which don't know when can be merged.

Some proof of this PR:
I try to add a debug log at here like this:
                if (has_node_penalty)
                {
                    util::Log(logDEBUG) << "node: " << node_v << " has traffic_signal when compress.";

                    // we cannot handle this as node penalty, if it depends on turn direction
                    if (fwd_edge_data1.flags.restricted != fwd_edge_data2.flags.restricted)
                        continue;

Then I got some logs when I compile the latest nevada.osm.pbf:
[debug] node: 16454 has traffic_signal when compress.
[debug] node: 48093 has traffic_signal when compress.
[debug] node: 71512 has traffic_signal when compress.
[debug] node: 82989 has traffic_signal when compress.
[debug] node: 115384 has traffic_signal when compress.
...

I check several of them in compiled .osrm.cnbg, none of them is exist, which means all of them have been compressed.
$ osrm-files-extractor -alsologtostderr -f nevada-latest.osrm.cnbg -summary 2
I0311 12:30:04.623195   27125 contents.go:41] Loaded from nevada-latest.osrm.cnbg
I0311 12:30:04.624706   27125 contents.go:42]   OSRN v5.22.0
I0311 12:30:04.624754   27125 contents.go:44]   compressed node based graph meta 746678 count 746678
I0311 12:30:04.624779   27125 contents.go:46]     CompressedNodeBasedGraphEdges[0] {Source:15 Target:724080}
I0311 12:30:04.624831   27125 contents.go:46]     CompressedNodeBasedGraphEdges[1] {Source:15 Target:589125}
$
$ osrm-files-extractor -alsologtostderr -f nevada-latest.osrm.cnbg -summary 746678 2>&1 | grep ":16454"


arrow function support

added arrow function support in nodejs function template
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #2802 into master will decrease coverage by 1.14%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #2802      +/-   ##
==========================================
- Coverage   64.59%   63.45%   -1.15%
==========================================
  Files         201      201
  Lines       10017    10197     +180
  Branches     1964     2099     +135
==========================================
  Hits         6470     6470
- Misses       3256     3432     +176
- Partials      291      295       +4

Impacted Files
Coverage Δ

...lify-graphql-types-generator/src/compiler/index.ts
90.32% <0%> (ø)
:arrow_up:

...y-graphql-types-generator/src/compiler/legacyIR.ts
96.72% <0%> (ø)
:arrow_up:

...ges/amplify-graphql-types-generator/src/loading.ts
74.5% <0%> (ø)
:arrow_up:

...psync-simulator/src/data-loader/dynamo-db/index.ts

...fy-appsync-simulator/src/data-loader/none/index.ts

...-appsync-simulator/src/velocity/util/list-utils.ts

...simulator/src/data-loader/dynamo-db/utils/index.ts

...amplify-appsync-simulator/src/data-loader/index.ts

...s/amplify-appsync-simulator/src/type-definition.ts
0% <0%> (ø)

...amplify-appsync-simulator/src/server/operations.ts
0% <0%> (ø)

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b97a7db...9f2b0a3. Read the comment docs.

context is optional for async functions. i dont think it's the recommended approadh.
see: https://docs.aws.amazon.com/lambda/latest/dg/nodejs-prog-model-handler.html#nodejs-handler-async

For async functions, you return a response, error, or promise to the runtime instead of using callback.

The change was introduced with the Node.js 4.3.2 Runtime
https://aws.amazon.com/blogs/compute/node-js-4-3-2-runtime-now-available-on-lambda/


use a configuration file to setup the kernel

xtask build --arch  --config
the default configuration file is => /lib/config_default.toml
for example cargo xtask build --arch riscv --config nezha loads the configuration from /lib/config_nezha.toml
to get xtask clippy to work i had to add those parameter too

the clippy xtask has changed, because of conditional compiling i had to add the --arch and --config arguments.

@erde74 is there a reason this wasn’t merged in?  There are some conflicts to resolve now.
If you think it’s ready to be merged, resolve the conflicts and I can reapprove. Thanks!

@gmacd i have rebased this, if you think it is useful you may merge this


[core] 16-bit resource entry offsets are not supported

Issue details
https://cs.android.com/android/platform/superproject/+/android15-release:frameworks/base/libs/androidfw/include/androidfw/ResourceTypes.h;l=1471-1473
Jadx version
1.5.0

@pubiqq can you share a sample with such flag?

can you share a sample with such flag?

android.jar from Android SDK Platform 35.


Change cols validation logic

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (162940c) 100.00% compared to head (5c45082) 100.00%.
Report is 16 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #18   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            6         6
  Lines          174       173    -1
=========================================
- Hits           174       173    -1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Incorrect "validated" state on Broker when provider test fails with runtime error

When the provider verification test fails due to a runtime error - most commonly we have MissingStateChangeMethod due to getting the state match up wrong - the results still get published to the broker and incorrectly show as verified.
This is pretty misleading, because actually the verification test didn't run so we don't know if it would have passed or not - we've had cases where it wouldn't.
Could you help me problem solve this? Is it a bug or is there a setting I can tweak so that this shows as "not run" or something else on the broker? Our main requirement is that it doesn't show as "passed"
Here's an example using the public broker as suggested - nb the consumer and provider tests are both in the same project for convenience here!
I've added steps to recreate to the readme, let me know if anything is unclear.
https://github.com/csbiggar/pact-example/blob/master/README.md
Many thanks for any help

following pact slack chats here
https://pact-foundation.slack.com/archives/C9VPNUJR2/p1584800617098000
and here
https://pact-foundation.slack.com/archives/C9UN99H24/p1585165517013600
thanks!

Just wondered if you had any thoughts on this at all? It's continuing to cause confusion for us, would love some advice about how we might work around it to force the broker to show "not run"

(FYI: I work in the same team as @csbiggar)
I have been caught out a couple of times while working with API consumers by this. It is also made a bit worse for me as consumers typically check the broker for validation status rather than our pipeline. This leads to false positives without the opportunity for us to correct them on the result unless we are extra diligent (which I try to be!).

👍

Thanks for the example project, it made it easy to diagnose the issue.
The problem is you're using an old version of the pact-jvm-provider-junit5 library (au.com.dius:pact-jvm-provider-junit5_2.12:3.6.11. This has been fixed in a later version.
Changing the dependency in the example project to
    testImplementation "au.com.dius:pact-jvm-provider-junit5:4.0.8"

fixes the issue.

Hi @uglyog  thanks very much for looking
I've upgraded as you suggested (apologies, should have checked versions first thing!) and I'm still able to  recreate the problem , with a subtle difference ...
If the provider verification would pass if the @state was present, and the only issue is the missing @State, then the verification still fails with MissingStateChangeMethod  but the result is still published to the broker as success. I've updated the example project to reflect this, so the readme steps to recreate will still recreate this.
If however the provider verification would fail (should the state be present) and also, the state is missing -  then it looks like it's running the verification first and not worrying about the state check; the verification fails, and shows as failed on the broker. You can recreate this with the example project by changing  line 23 in the ProviderVerificationTest to something else , for example
context.target = HttpsTestTarget("www.google.com/abc", 443, "/")
This is better than previously, but, I think it's inconsistent in its judgement on whether missing state is a problem.
If the idea is to force the provider to acknowledge the consumer's "givens" / state requirements, shouldn't a missing state error show up as failed on the broker , even if the test passes without it?
Alternatively, make state truly optional and don't fail the provider verification if it is missing?  (log a warning or something instead?)
Hope this makes sense, thanks again, Carolyn

With my testing of your example project, it posted a failed result when the missing state change exception occurred. You can see the result of that here: https://test.pact.dius.com.au/matrix/provider/ron.google/consumer/ron.pretend-consumer
It runs all the state change methods first. If any of those fail, it should abort at that point with an error.
Can you enable debug level logs and post them here?

Yep let me see if I can figure out how to do that ;)
But also ... your verification is from some hours ago, perhaps you could  pull the latest of the example code and try again? Until I tweaked about an hour ago,  I think the verification was giving a genuine failure - ie (2) in my comment above -  when I upgraded it just now i changed it so it should pass if state is present  - ie (1) in my comment above.
Will update when I've figured out debugging ...

Here's the logs:
1-pact-verification-should-pass-but-missing-state.txt

scenario 1 above - you can recreate this with the example project (pull the latest). State is missing, but broker shows green

2-pact-verification-genuine-failure.txt

scenario 2 above - make  a small change to the target url in the example project to see this, eg
context.target = HttpsTestTarget("www.google.com/abc", 443, "/"). State is missing but also there is a genuine verification error, broker show red

I think I have replicated your issue. It looks like you are correct, the missing state change method results in a failure being published, but then the test is run and the results are overwritten with a success.
Thanks for the example project, it made it easy to diagnose.
BTW, the debug logging needed to be enabled for the tests. I did this by adding
testImplementation "ch.qos.logback:logback-core:1.2.3",
            "ch.qos.logback:logback-classic:1.2.3"

to your project dependencies. Then I could see the HTTP requests that were made in the test output.

Thanks so much for fixing this so fast! Have just upgraded our provider tests to use 4.0.10 and it's working perfectly. Much appreciated!


[SPARK-10556] Remove explicit Scala version for sbt project build files

Previously, project/plugins.sbt explicitly set scalaVersion to 2.10.4. This can cause issues when using a version of sbt that is compiled against a different version of Scala (for example sbt 0.13.9 uses 2.10.5). Removing this explicit setting will cause build files to be compiled and run against the same version of Scala that sbt is compiled against.
Note that this only applies to the project build files (items in project/), it is distinct from the version of Scala we target for the actual spark compilation.

Merged build triggered.

Merged build started.

Removing this explict setting will cause build files to be compiled and run against the same version of Scala that sbt is compiled against.

I'm not too sure that's desirable, though.

Test build #42305 has started for   PR 8709 at commit f17ee06.

@vanzin I believe that is what SBT expects, I'm not sure why this setting was there in the first place.  You shouldn't be running files compiled with different versions of scala together or you can get weird abstract method errors.

The problem with explicitly setting a different Scala version for build files is that SBT expects plugins and build files to be compiled against the same version of Scala it is running on, otherwise it's possible to run into errors (NoSuchMethodError or ClassNotFoundException) that arise from changes in Scala.

I'm not doubting that, just questioning the fact that we're now allowing people to build Spark against "non-blessed" versions of Scala. Which might be ok, just feels a little weird.
(The alternative would be to fail if the version is not the expected.)

To clarify, this is not changing how Spark is built.  It's changing how project/SparkBuild.scala is built, which in turn is used to compile spark when someone is using SBT. project/SparkBuild.scala will have its own notion of scalaVersion that will be used to compile Spark.

Ah, ok. That clarifies things. In that case, move on, nothing to see here. :-)

Test build #42305 has finished for   PR 8709 at commit f17ee06.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42305/
Test FAILed.

Test build #1740 has started for   PR 8709 at commit f17ee06.

Test build #1740 has finished for   PR 8709 at commit f17ee06.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #1741 has started for   PR 8709 at commit f17ee06.

Test build #1741 has finished for   PR 8709 at commit f17ee06.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged into master / 1.5 / 1.4 / 1.3


Agora.io Support

Can this integration work with Agora.io, if not what it takes to hook Agora instead of the current supported videoconferencing

The current Jitsi integration uses the Element-integrated Jitsi widget and is configured in the default_events.json:
https://github.com/nordeck/matrix-meetings/blob/f1578790dbf63ba94b893cbe120e52cbc9438aec/matrix-meetings-bot/conf/default_events.json#L29-L43
You can replace the Video Conference with a different one, but you would require an agora version that runs as a widget.

Hello @sm2x, does the comment from @dhenneke solves your issue? if yes, please close the issue or reach out to us here or on our public Room


[Bug] the Bar is invisible on Bar chart when the width is small

Hi Guys,
So i have bar chart with long data, it has around 1000 data, but the bar is not shown at all.

Expected Behavior

Keep showing the bar even if it's too small

Current Behavior

The bar is hidden in some window size

Possible Solution

Follow the same as script as version 2.3.0

Steps to Reproduce (for bugs)

Open this fiddle https://jsfiddle.net/e8n4xd4z/8911/
Resize the result section until the bar is gone.

Context
i notice the older version still support it, like version 2.3.0
here's the fiddle for version 2.3.0 with the same script https://jsfiddle.net/e8n4xd4z/8912/
it is working properly.
i think it's better to keep showing the bars instead of removing it,

Environment

Chart.js version: 2.7.*
Browser name and version: Linux ubuntu Mozilla 60.0.1 (64-bit)

i hope the description is clear,
thanks in advance

Well I can't fix this and don't have a solution for this.
But for anyone encountering this: maybe it is a solution to use a filled (stepped) line chart with pointRadius: 0.
A line chart does seem to work with so many datapoints.

This has been fixed in master: https://jsfiddle.net/s5n7r2gj/


Replace auto approve and merge GH actions with Kodiak bot

Sets up the Kodiak bot to approve and merge dependabot PRs
Removes auto merge and approve GH actions

Manual Ops

created the "automerge" label

Does this one still need the auto-approve.yml?

It has been converted into tidy.yml.

Aaah I see. Missed that somehow...


PG 14, PG 15 support

I ran into this issue using a vscode extension Plpgsql language server, https://github.com/UniqueVision/plpgsql-lsp/.
PG14 introduced "create or replace trigger" which causes a parse error in libpg-query-node.
Do you intend to introduce support at some point for PG14?

Hi! (pardon the delay, I just fixed my notifs)
https://github.com/pganalyze/libpg_query still is on 13, and therefore so are we. We can track and upgrade when they do.

Hi there =)
https://github.com/pganalyze/libpg_query is now for 14 (and 15), thanking you in advance

tracking 14 here and 15 here

13.3.1
14.0.0
15.0.0 (in progress)

Hello @pyramation, thank you for the work you've been doing in libpg-query-node. I'm a developer from the Supabase codebase and we've been facing issues parsing Postgres queries past V13. We were able to trace the issue here since we use pgsql-parser, which uses this library as a sub-dependency.
We noticed that you have the V15 PR ready here, and we wanted to ask if it would be possible to merge this in, assuming it's ready. If not, could we get a timeline on how long before it can be merged?

hey there @nith2001 — we have documented the issue here https://github.com/launchql/pgsql-parser/issues/107
This is now closing and anyone who needs pgsql-parser upgrades, please check out the issue above and join the party there :)


How to share *.proto files with  other repositories

Summary
Ostracon's API request/response is defined in ProtocolBuffers *.proto files, and we need to discuss how the *.proto files should be shared when creating another application related to Ostracon.

Problem Definition
The current *.proto file is located in the same place as the regular Ostracon source files. Eath related-applications will have to copy the *.proto file when developing them, which isn't easy to maintain and may cause version differences.
Proposal
One solution is to create an independent repository that defines the schema of the inter-system interfaces, such as ProtocolBuffers, and have each project, including Ostracon, reference that repository (e.g., as a submodule).

For Admin Use

[x] Not duplicate issue
[x] Appropriate labels applied
[x] Appropriate contributors tagged
[ ] Contributor assigned/self-assigned

Currently-known issues for sharing ProtocolBuffers definitions with other languages:

A lot of *.proto files contains gogoproto-specific import "gogoproto/goto.proto" and attribute such as [(gogoproto.nullable) = false] or (gogoproto.customname) = "ID"].
There is no way to specify a Rust mod name (values like option rust_module cannot specify). As a result, types/types.proto and privval/types.proto are output to the same file types.rs.


If hiccup is a function call the function until it returns hiccup data

It is common to write hiccup components like this
(defn notifications-dropdown []
  (fn []
      hiccup))

;; where hiccup is a data structure like [:div ]

whereas render! expects the pure data structure.

Now that I think about it I wonder if it will work for nested function calls 🤔

Thank you for your contribution. I am going to merge it.


python311Packages.flux-led: 1.0.2 -> 1.0.4

Diff: https://github.com/Danielhiversen/flux_led/compare/refs/tags/1.0.2...1.0.4
Changelog: https://github.com/Danielhiversen/flux_led/releases/tag/1.0.4
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 254604 run on x86_64-linux 1

12 packages built:

home-assistant-component-tests.flux_led
home-assistant-component-tests.led_ble
ledfx
ledfx.dist
python310Packages.flux-led
python310Packages.flux-led.dist
python310Packages.led-ble
python310Packages.led-ble.dist
python311Packages.flux-led
python311Packages.flux-led.dist
python311Packages.led-ble
python311Packages.led-ble.dist


[AutoTVM][Fix] Fixed 'not in list' error for define_reorder with 'candidate' policy.

Hello! This is my first time sending a pull-request. I found when the candidate policy is chosen for define_reorder, AutoTVM throws an error of xxx not in list. It's because in
https://github.com/apache/incubator-tvm/blob/d0f988988a6f4875d176da1d79628feebf2ee023/python/tvm/autotvm/task/space.py#L313
and other similar places, x has the type of iter_var while elements in axes have the type of VirtualAxis. This pull request fixes the bug.
A review would be much appreciated! @tqchen @comaniac @merrymercy

@comaniac Thank you for the review! I look into the example you mentioned, and I think it works well because the candidates pass to kwargs of the _add_new_transform function are lists of VirtualAxis, while in my application candidates are lists of IterVar. Is define_reorder supposed to accept IterVars as arguments?

@comaniac A quick replication of the bug is to replace
https://github.com/apache/incubator-tvm/blob/520ca0a8b39aeb4765369f169477265230ea7c6c/tutorials/autotvm/tune_simple_template.py#L209
with
    cfg.define_reorder('reorder', [yo, xo, k, yi, xi], policy='candidate', candidate=[[yo, xo, k, yi, xi], [xo, yo, k, yi, xi]])
    cfg['reorder'].apply(s, C, [yo, xo, k, yi, xi])

@comaniac A quick replication of the bug is to replace
https://github.com/apache/incubator-tvm/blob/520ca0a8b39aeb4765369f169477265230ea7c6c/tutorials/autotvm/tune_simple_template.py#L209
with
    cfg.define_reorder('reorder', [yo, xo, k, yi, xi], policy='candidate', candidate=[[yo, xo, k, yi, xi], [xo, yo, k, yi, xi]])
    cfg['reorder'].apply(s, C, [yo, xo, k, yi, xi])

I see what you meant. It seems like all use cases in current TOPI reorder only the splitted axises, which are all virtual axises already. Accordingly, I'd suggest checking and creating VirtualAxis for axes in the beginning of ReorderSpace.__init__.

@comaniac A quick replication of the bug is to replace
https://github.com/apache/incubator-tvm/blob/520ca0a8b39aeb4765369f169477265230ea7c6c/tutorials/autotvm/tune_simple_template.py#L209
with
    cfg.define_reorder('reorder', [yo, xo, k, yi, xi], policy='candidate', candidate=[[yo, xo, k, yi, xi], [xo, yo, k, yi, xi]])
    cfg['reorder'].apply(s, C, [yo, xo, k, yi, xi])

I see what you meant. It seems like all use cases in current TOPI reorder only the splitted axises, which are all virtual axises already. Accordingly, I'd suggest checking and creating VirtualAxis for axes in the beginning of ReorderSpace.__init__.

Yeah, actually axes are all good. I add a few lines of type checking code for some of the policies.

In the original design and underlying implementation, All APIs should only accept VirtualAxis.
Later, we make some APIs support IterVar as sugar.
We can merge this. Thanks @moderato and @comaniac

In the original design and underlying implementation, all APIs should only accept VirtualAxis.
Later, we make some APIs support IterVar as sugar.
@moderato Please fix the CI.

@merrymercy Thank you for the review! Can you clarify the semantics of naming a VirtualAxis (see above)? Our confusion is if the name argument of the constructor should dominate when it's not None andvar has a type of IterVar or VirtualAxis that has a name.

The name is just for printing and debugging. Ideally you should not use it for equality check.

The name is just for printing and debugging. Ideally, you should not use it for the equality check.
You should only create one VirtualAxis for one IterVar.

Yeah, my question is, when a VirtualAxis is being constructed and a name is passed to the constructor, should we assign it to the name of this new VirtualAxis? Or we use the name of the var if it's a VirtualAxis or IterVar?

Because the 'name' is only used for printing and debugging. It does not matter.
I am saying the ideal way is that you create VirtualAxis in your templates explicitly and do not reply on name to do the equality check.
So we can even cloes this PR.

Because the name is only used for printing and debugging, it does not matter.
The correct way is that you create VirtualAxis in your templates explicitly and do not rely on name to do the equality check.
If you agree with this, we can close the PR. The existing code does not have bugs.

Well, the name_ct variable does affect the equality check at places like
https://github.com/apache/incubator-tvm/blob/052ea4d14d4a528ae7a2c1f39e74436284864d39/python/tvm/autotvm/task/space.py#L313
when var is an IterVar and needed to be converted to VirtualAxis. That's why I was asking about name. Or, would you suggest to change the equality check codes?
However, if the plan to support IterVar is to be done in the future instead of now, I agree we can close this PR for now.

Users should do the conversion from IterVar to VirtualAxis by themself in the templates.
Then the equality check follows the default semantics of python, which is check by reference.
Then the candidates argument works correctly.
If you are happy with this design, you can close this PR. Otherwise, the priority of 'name' does no matter to me, you can choose either.

Users should do the conversion from IterVar to VirtualAxis by themself in the templates.
Then the equality check follows the default semantics of python, which is check by reference.
Then the candidates argument works correctly.
Checking by name is not desired.


Calendar view

Add Calendar view similar to Calendar community plugin (as it will be easier to customize it this way).

Released in 1.1.0

Nice, thanks. Quick feedback:

What are the "pick date" and "today" buttons good for? They don't seem to do anything except moving the calendar month. But you can do that already with the "<>" buttons.
Would be good to show interval journal entries in reverse order, since the last ones are usually more interesting.
The Obsidian calendar plugin also shows whether daily notes exist and how long they are. I found that feature very useful. Maybe we can add that as well.
Maybe start (and end?) dates of interval based journal entries could be also somehow marked in the calendar view.
Maybe the current interval could be particularly highlighted (similarly to today's date).
The "show weeks" option doesn't seem to work.

Thank you for feedback

What are the "pick date" and "today" buttons good for? They don't seem to do anything except moving the calendar month. But you can do that already with the "<>" buttons.

Yeh they currently move to corresponding month (current one for today and the month around picked date)
Pick date main reason is to quickly navigate back in past (as you can click on month name to select monthn 2 clicks, and clicking year after that will allow to change year quickly)
I think I'll change both to also open corresponding daily note.

Would be good to show interval journal entries in reverse order, since the last ones are usually more interesting.

chronological order seemed logical, but you are right reverse order might be interesting. I'll make this configureable

The Obsidian calendar plugin also shows whether daily notes exist and how long they are. I found that feature very useful. Maybe we can add that as well.

It already shows that there is note (given note is connected to a journal - reindexing old notes is high on my priorities list).
As for length - will think about that.

Maybe start (and end?) dates of interval based journal entries could be also somehow marked in the calendar view.

I'll add this as part of configurable highlights https://github.com/srg-kostyrko/obsidian-journal/issues/18

Maybe the current interval could be particularly highlighted (similarly to today's date).

Good point, will add that

The "show weeks" option doesn't seem to work.

Weeks are shown only if you have journal with weekly notes enabled. Apparently might be confusing as it is now. I'll change that "Show weeks" setting to also have "Don't show" option and so that is does not depend on weekly notes enabled


Fixing account users count in backoffice

There was a problem with seeds, and account owners did not have account_id applied. When I was adding user count + 1, I somehow thought we are not counting owners in users relationship :), because I had 0 and it was because of the bug in seeds. Just realized that when entering back office on staging when I saw that all accounts somehow have 2 users which is wrong.
Testing instructions
What to test? How to do it?
Tracking
Link to the task(s), if any

Yeah, and that is the way it should be done. I don't know why I thought account owner is not among users ;]


Allow setting of separator between key and default value.

Implemented by commit: https://github.com/BoolPurist/crust_boot_you/commit/d7e225b2978ae2299d79f035ba43c5cc376e54b8


doc: Update InfluxDB Cloud integration guide

Summary

Reorganize InfluxDB Cloud integration guide
Add new integration method - native MQTT subscription from InfluxDB Cloud

Notes for Reviewers
Still waiting for some input from InfluxData side regarding how to organize metrics, because visualizing them on their platform is not too intuitive.
Checklist

[x] Scope: The referenced issue is addressed, there are no unrelated changes.
[x] Run Locally: Verified that the docs build using make server, posted screenshots, verified external links. Test with HUGO_PARAMS_SEARCH_ENABLED=true if style changes will affect the search bar.
[ ] New Features Marked: Documentation for new features is marked using the new-in-version shortcode, according to the guidelines in CONTRIBUTING.
[x] Style Guidelines: Documentation obeys style guidelines in CONTRIBUTING.
[x] Commits: Commit messages follow guidelines in CONTRIBUTING, there are no fixup commits left.

Closing this as per InfluxData, they are discontinuing development of native MQTT connector.


Post-event CS&S reporting

To do after events complete. See email from Angela re:
Narrative Report Template
Financial Report Template

Narrative report to funder published as a blog post
Community building for Black environmental and marine researchers: Pathways to Open Science


Allow configuration of sass/scss filter sourcemap option.

This is already supported by assetic.

It took time, but here we go, this is in now. Thank you very much @thetiby.

Thank you as well!