Piping to stdout writes to a file instead of stdout with some format specifier

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.10.25. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2016.10.25

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

Piping to stdout does not work when using format bestvideo+bestaudio/best. It downloads to a file named -.ext.
For example :
$ youtube-dl -v -f bestvideo+bestaudio/best -o - 'https://www.youtube.com/watch?v=0YSEagC7tsI' | mpv
It works without the above format specifier although ironically it is documented to be the default.
I noticed this because I have -f bestvideo[width<=?1920]+bestaudio/best in my youtube-dl config file, but I expected it to use the format which does not require merging when piping.

I am not sure this is actually a bug. Excerpt from the FAQ:

Note that if you use youtube-dl to stream to stdout (and most likely to pipe it to your media player then), i.e. you explicitly specify output template as -o -, youtube-dl still uses -f best format selection in order to start content delivery immediately to your player and not to wait until bestvideo and bestaudio are downloaded and muxed.

If my understanding is correct, this means youtube-dl will always use -f best when -o - is set. If that is the case, then this issue is void but I think we do have uncovered another one.
Here is behaviour I reproduce using version 2016.10.26:

Source video: https://www.youtube.com/watch?v=a0pVCoOHXkA (best quality available: 2160p)
Not setting any format nor -o - will correctly download and mux bestvideo+bestaudio using ffmpeg. [Sample 1](####Sample 1)
Not setting any format but setting -o - will correctly download best and stream it to an external player. [Sample 2](####Sample 2)
Trying to force any format while setting -o - will override -o - detection: if chosen format requires muxing, then it will mux to file, if chosen format does not require muxing, then it will stream correctly. [Sample 3](####Sample 3)

Sample 1
C:\Users\Skymirrh>youtube-dl -v https://www.youtube.com/watch?v=a0pVCoOHXkA
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/watch?v=a0pVCoOHXkA']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2016.10.26
[debug] Python version 2.7.10 - Windows-8-6.2.9200
[debug] exe versions: ffmpeg 3.1.5, ffprobe 3.1.5
[debug] Proxy map: {}
[youtube] a0pVCoOHXkA: Downloading webpage
[youtube] a0pVCoOHXkA: Downloading video info webpage
[youtube] a0pVCoOHXkA: Extracting video information
[youtube] a0pVCoOHXkA: Downloading MPD manifest
[debug] Invoking downloader on u'https://r3---sn-n4g-ouxl.googlevideo.com/videoplayback?id=6b4a550a83875e40&itag=266&source=youtube&requiressl=yes&mv=m&initcwndbps=2612500&pl=26&ms=au&mm=31&mn=sn-n4g-ouxl&ratebypass=yes&mime=video/mp4&gir=yes&clen=494559241&lmt=1475244314252943&dur=182.415&upn=gYfexa4Njnw&key=dg_yt0&mt=1477807007&signature=0AA0A7CD3DBEAE6701A58F2F5AD66EA65A534960.70050BE21BFEBA9EA7E8C68F82FC59BF675857B8&ip=<IP_ADDRESS>&ipbits=0&expire=1477828691&sparams=ip,ipbits,expire,id,itag,source,requiressl,mv,initcwndbps,pl,ms,mm,mn,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.f266.mp4
[download] 100% of 471.65MiB in 00:41
[debug] Invoking downloader on u'https://r3---sn-n4g-ouxl.googlevideo.com/videoplayback?id=6b4a550a83875e40&itag=140&source=youtube&requiressl=yes&mv=m&initcwndbps=2612500&pl=26&ms=au&mm=31&mn=sn-n4g-ouxl&ratebypass=yes&mime=audio/mp4&gir=yes&clen=2899389&lmt=1475244461425945&dur=182.508&upn=gYfexa4Njnw&key=dg_yt0&mt=1477807007&signature=8ECD8C007E50FF46C5FDCF47AB1DEA3782F00A7B.35FF07F707719A1B31B030F440E311CF74E025CC&ip=<IP_ADDRESS>&ipbits=0&expire=1477828691&sparams=ip,ipbits,expire,id,itag,source,requiressl,mv,initcwndbps,pl,ms,mm,mn,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.f140.m4a
[download] 100% of 2.77MiB in 00:00
[ffmpeg] Merging formats into "Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.mp4"
[debug] ffmpeg command line: ffmpeg -y -i 'file:Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.f266.mp4' -i 'file:Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.f140.m4a' -c copy -map 0:v:0 -map 1:a:0 'file:Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.temp.mp4'
Deleting original file Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.f266.mp4 (pass -k to keep)
Deleting original file Titanfall 2 - Official Nvidia 4K PC Multiplayer Gameplay-a0pVCoOHXkA.f140.m4a (pass -k to keep)

Sample 2
C:\Users\Skymirrh>youtube-dl -v https://www.youtube.com/watch?v=a0pVCoOHXkA -o - | mpc-hc64 -
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/watch?v=a0pVCoOHXkA', u'-o', u'-']
[debug] Encodings: locale cp1252, fs mbcs, out None, pref cp1252
[debug] youtube-dl version 2016.10.26
[debug] Python version 2.7.10 - Windows-8-6.2.9200
[debug] exe versions: ffmpeg 3.1.5, ffprobe 3.1.5
[debug] Proxy map: {}
[youtube] a0pVCoOHXkA: Downloading webpage
[youtube] a0pVCoOHXkA: Downloading video info webpage
[youtube] a0pVCoOHXkA: Extracting video information
[youtube] a0pVCoOHXkA: Downloading MPD manifest
[debug] Invoking downloader on u'https://r3---sn-n4g-ouxl.googlevideo.com/videoplayback?signature=3116C14A6EE185A242DD7FEECF5BAAC68F01EF12.BEECE2FFE40F90E2EE756A5E8A0D44BA395F7CC0&id=o-ANWfOlbIKJTq0tylZrijw6D9rOhiZk16Y8S5N8ASY-xJ&mv=m&upn=EoR1c0xD36Q&mt=1477806378&ms=au&mn=sn-n4g-ouxl&ip=<IP_ADDRESS>&mm=31&itag=22&pl=26&key=yt6&mime=video%2Fmp4&dur=182.508&ratebypass=yes&requiressl=yes&initcwndbps=2625000&source=youtube&ei=84kVWKPZH-T8iAbXk7fQAg&lmt=1475245834826510&sparams=dur%2Cei%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Cratebypass%2Crequiressl%2Csource%2Cupn%2Cexpire&ipbits=0&expire=1477828179'
[download] Destination: -
[download]  11.7% of 50.56MiB at 457.21KiB/s ETA 01:39

Sample 3
C:\Users\Skymirrh>youtube-dl -v -f bestvideo+bestaudio/best https://www.youtube.com/watch?v=a0pVCoOHXkA -o - | mpc-hc64 -
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'-f', u'bestvideo+bestaudio/best', u'https://www.youtube.com/watch?v=a0pVCoOHXkA', u'-o', u'-']
[debug] Encodings: locale cp1252, fs mbcs, out None, pref cp1252
[debug] youtube-dl version 2016.10.26
[debug] Python version 2.7.10 - Windows-8-6.2.9200
[debug] exe versions: ffmpeg 3.1.5, ffprobe 3.1.5
[debug] Proxy map: {}
[youtube] a0pVCoOHXkA: Downloading webpage
[youtube] a0pVCoOHXkA: Downloading video info webpage
[youtube] a0pVCoOHXkA: Extracting video information
[youtube] a0pVCoOHXkA: Downloading MPD manifest
[debug] Invoking downloader on u'https://r3---sn-n4g-ouxl.googlevideo.com/videoplayback?id=6b4a550a83875e40&itag=266&source=youtube&requiressl=yes&mn=sn-n4g-ouxl&mm=31&initcwndbps=2625000&ms=au&mv=m&pl=26&ratebypass=yes&mime=video/mp4&gir=yes&clen=494559241&lmt=1475244314252943&dur=182.415&key=dg_yt0&signature=488EB2E72958A968E3AA6788368F230CBFAA2D1A.0FA06621EED28C7C425A596C25E1A3300FD6CC01&upn=xx-JdUdzEBQ&mt=1477806378&ip=<IP_ADDRESS>&ipbits=0&expire=1477828026&sparams=ip,ipbits,expire,id,itag,source,requiressl,mn,mm,initcwndbps,ms,mv,pl,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: -.f266
[download] 100% of 471.65MiB in 00:41
[debug] Invoking downloader on u'https://r3---sn-n4g-ouxl.googlevideo.com/videoplayback?id=6b4a550a83875e40&itag=140&source=youtube&requiressl=yes&mn=sn-n4g-ouxl&mm=31&initcwndbps=2625000&ms=au&mv=m&pl=26&ratebypass=yes&mime=audio/mp4&gir=yes&clen=2899389&lmt=1475244461425945&dur=182.508&key=dg_yt0&signature=501276A18181AEACB6C36B40035F83F0397D7E37.814C82F0A6648DFCD6C47137027947445E898F74&upn=xx-JdUdzEBQ&mt=1477806378&ip=<IP_ADDRESS>&ipbits=0&expire=1477828026&sparams=ip,ipbits,expire,id,itag,source,requiressl,mn,mm,initcwndbps,ms,mv,pl,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: -.f140
[download] 100% of 2.77MiB in 00:00
[ffmpeg] Merging formats into "-.mp4"
[debug] ffmpeg command line: ffmpeg -y -i file:-.f266 -i file:-.f140 -c copy -map 0:v:0 -map 1:a:0 file:-.temp.mp4
Deleting original file -.f266 (pass -k to keep)
Deleting original file -.f140 (pass -k to keep)

this means youtube-dl will always use -f best when -o - is set

The current behavior is: the default value for -f is best use best when -o - is set, and youtube-dl does not check whether merging is suitable or not if -f is specified manually. That's a bug.

In my opinion youtube-dl should either:

throw an explicit error ("output format incompatible with streaming")
automatically choose the first format that does not require merging

Anyway it should never write to a -.ext file if -o - is passed.

Any update here?


Removed Google Action Swags

Removed details about Google action swags from Google assistant. Since That community program was stopped by Google.

Thanks a lot for contributing, mate! Keep rocking ✨✨


wlx-overlay-s: 0.5.0 -> 0.6

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for wlx-overlay-s is: Wayland/X11 desktop overlay for SteamVR and OpenXR, Vulkan edition
meta.homepage for wlx-overlay-s is: https://github.com/galister/wlx-overlay-s
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.6 with grep in /nix/store/xmpkvc0nbxqshrqh4rpv5vnf6gfzm0sv-wlx-overlay-s-0.6
found 0.6 in filename of file in /nix/store/xmpkvc0nbxqshrqh4rpv5vnf6gfzm0sv-wlx-overlay-s-0.6

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

wlx-overlay-s

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/xmpkvc0nbxqshrqh4rpv5vnf6gfzm0sv-wlx-overlay-s-0.6 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A wlx-overlay-s https://github.com/r-ryantm/nixpkgs/archive/6304db46629030d6e55a0f0ad6c115a0614dc825.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/6304db46629030d6e55a0f0ad6c115a0614dc825#wlx-overlay-s

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/xmpkvc0nbxqshrqh4rpv5vnf6gfzm0sv-wlx-overlay-s-0.6
ls -la /nix/store/xmpkvc0nbxqshrqh4rpv5vnf6gfzm0sv-wlx-overlay-s-0.6/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

wlx-overlay-s

Maintainer pings
cc @Scrumplex for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 345762 run on x86_64-linux 1

1 package built:

wlx-overlay-s

@NixOS/nixpkgs-merge-bot merge


password-gorilla <IP_ADDRESS>.3 doesn't require 32-bit mode

homebrew-cask/Casks/password-gorilla.rb indicates in caveats that:

Password Gorilla must be run in 32-bit mode

This should no longer be the case as it was related to an older issue that I believe was resolved in a previous update. The application runs correctly without the 32-bit mode limitation.
Also in caveats:

Gatekeeper may need to be temporarily disabled for the first launch

Note https://github.com/zdia/gorilla/issues/154 - a known Gatekeeper workaround for allowing unsigned apps to run (CTRL+click, Open) was found to not work in at least some cases, and another workaround was identified to allow the program to run without working around Gatekeeper (clearing the com.apple.quarantine extended attribute from the bundle using xattr(1)). I don't know if this is of value for the formula, as I notice that none of the installed files in /opt/homebrew-cask/Caskroom/password-gorilla have extended attributes and it launches without problem on my system (OS X 10.10.5) with Gatekeeper enabled. Perhaps after testing, this caveat could be removed also.

Sounds good. Care to submit the modifications?

I've got some breakage in my system I'm working through... someone else able to for now?

You can submit the fixes anyway. It’ll be easier for us to test and discuss, having a central point of discussion.

https://github.com/caskroom/homebrew-cask/pull/21528


Improve event types

What is it?

[x] Feature / enhancement
[ ] Bug
[ ] Docs / tests

Description
Improvement on https://github.com/BuilderIO/qwik/pull/1559
Use cases and why
Automatically infer the correct types for events based on the HTML element it is on, instead of having to manually add a type assertion (which breaks type-safety)

Merged!!! thanks a lot for the amazing work!


Fix partition table type

Problem:
Invalid setup when setting partition table type to MBR in the installer. The string in the elemental config.yaml should be msdos, not mbr
Solution:
Change the string in PartTable to the correct value
Related Issue:
harvester/harvester#4515
Test plan:

@mergifyio backport v1.2


NGINX not reloading correctly

I'm using the latest Ingress Controller (following the 'master' branch), but using my on prod Kubernetes Cluster.
I have some Ingress misconfigured, and this is causing a loop message with them (ssl certs, etc), and also the continuous reload of the NGINX.
What happens here is that even with those reloads, it seems NGINX is not loading the nginx.conf file correctly.
The following is what happens:

NGINX starts with the empty/start nginx.conf file
Ingress Controller  inserts the default_backend conf, and reloads nginx correctly
Ingress Controller tries to fetch the remaining config, does this correctly (the final nginx.conf contains all the vHosts) but is not reloading NGINX (even it prints the message about the reload).

The updates just seems to work, after all, when you change any Ingress Object. After changing any object, Nginx reloads correctly.
Thanks

@rikatz please test the image quay.io/aledbf/nginx-ingress-controller:0.185

@rikatz please post the logs of the ingress pod

@aledbf It seems your image is using the bogused nginx.tmpl:
E0821 19:01:00.565011      10 controller.go:428] unexpected failure restarting the backend:  template: nginx.tmpl:576:40: executing "SERVER" at <.Hostname>: can't evaluate field Hostname in type *ingress.Location
I'll replace the .Hostname to $server.Hostname and post the logs.

@aledbf Your image is using the bogused nginx.tmpl (https://github.com/kubernetes/ingress/blob/master/controllers/nginx/rootfs/etc/nginx/template/nginx.tmpl#L576)
I'm replacing it to $server.Hostname and will post the logs.

@aledbf I have some confidential data here, but will try to clean the logs.
Here's what happens:
W0821 19:08:41.685915       5 controller.go:956] service gscvi-t/appfla does not have any active endpoints
W0821 19:08:41.692205       5 controller.go:887] error obtaining service endpoints: service ouvserpro-d/dummy-soto-jboss does not exist
W0821 19:08:41.696117       5 controller.go:956] service namespace12/api-siafi does not have any active endpoints
W0821 19:08:41.702834       5 controller.go:956] service gscvi-p/ws-custos does not have any active endpoints
W0821 19:08:41.705346       5 controller.go:956] service gscvi-t/cerebro does not have any active endpoints
W0821 19:08:41.727107       5 controller.go:956] service namespace110-d/backend does not have any active endpoints
W0821 19:08:41.732101       5 controller.go:956] service namespace105-h/nginx-estatico does not have any active endpoints
W0821 19:08:41.736048       5 controller.go:887] error obtaining service endpoints: service namespace11/nginx-estatico does not exist
W0821 19:08:41.743510       5 controller.go:956] service namespace101-p/backend does not have any active endpoints
W0821 19:08:41.746072       5 controller.go:956] service namespace101-p/tesseract does not have any active endpoints
W0821 19:08:41.751963       5 controller.go:887] error obtaining service endpoints: service gsopi-p/httpd-gsopi does not exist
W0821 19:08:41.782882       5 controller.go:887] error obtaining service endpoints: service namespace100-h/jboss-events does not exist
W0821 19:08:41.795289       5 controller.go:887] error obtaining service endpoints: service namespace11/teste does not exist
W0821 19:08:41.799641       5 controller.go:887] error obtaining service endpoints: service namespace11/cors does not exist
W0821 19:08:41.810235       5 controller.go:956] service namespace100-p/jboss-auth-preprod does not have any active endpoints
W0821 19:08:41.810809       5 controller.go:956] service namespace100-p/jboss-servicos-preprod does not have any active endpoints
W0821 19:08:41.810924       5 controller.go:887] error obtaining service endpoints: service namespace100-p/jboss-authn-preprod does not exist
W0821 19:08:41.820350       5 controller.go:887] error obtaining service endpoints: service namespace15/backend-core does not exist
W0821 19:08:41.848247       5 controller.go:956] service namespace9-v/service-jboss does not have any active endpoints
I0821 19:08:41.881847       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.881958       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.881997       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.882117       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.882204       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.882328       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.882422       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.882502       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.882618       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.882833       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883029       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883082       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883339       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883440       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883523       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883656       5 controller.go:1137] ssl certificate "namespace1/secret1" does not exist in local store
I0821 19:08:41.883709       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.883791       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.883903       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.884172       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.884253       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.884366       5 controller.go:1137] ssl certificate "namespace8/secret3" does not exist in local store
I0821 19:08:41.884453       5 controller.go:1137] ssl certificate "namespace8/secret3" does not exist in local store
I0821 19:08:41.884499       5 controller.go:1137] ssl certificate "namespace8/secret3" does not exist in local store
I0821 19:08:41.884645       5 controller.go:1137] ssl certificate "namespace8/secret3" does not exist in local store
I0821 19:08:41.884851       5 controller.go:1137] ssl certificate "namespace3/secret2" does not exist in local store
I0821 19:08:41.885053       5 controller.go:1137] ssl certificate "namespace4/secret2" does not exist in local store
I0821 19:08:41.885145       5 controller.go:1137] ssl certificate "namespace4/secret2" does not exist in local store
I0821 19:08:41.885189       5 controller.go:1137] ssl certificate "namespace4/secret2" does not exist in local store
I0821 19:08:41.885284       5 controller.go:1137] ssl certificate "namespace4/secret2" does not exist in local store
I0821 19:08:41.885396       5 controller.go:1137] ssl certificate "namespace4/secret2" does not exist in local store
I0821 19:08:41.885561       5 controller.go:1137] ssl certificate "namespace120-v/secret-tls" does not exist in local store
I0821 19:08:41.886028       5 controller.go:1137] ssl certificate "namespace5/secret-tls" does not exist in local store
I0821 19:08:41.886066       5 controller.go:1137] ssl certificate "namespace5/secret-tls" does not exist in local store
I0821 19:08:41.886164       5 controller.go:1137] ssl certificate "namespace6/secret-tls" does not exist in local store
I0821 19:08:41.886264       5 controller.go:1137] ssl certificate "namespace6/secret-tls" does not exist in local store
I0821 19:08:41.886367       5 controller.go:1137] ssl certificate "namespace7/secret-tls" does not exist in local store
I0821 19:08:41.886459       5 controller.go:1137] ssl certificate "namespace7/secret-tls" does not exist in local store
I0821 19:08:41.886647       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:41.886696       5 controller.go:1137] ssl certificate "namespace2/secret2" does not exist in local store
I0821 19:08:42.396432       5 controller.go:423] backend reload required
I0821 19:08:43.110050       5 controller.go:432] ingress backend successfully reloaded...

This is in a loop, and while nginx.conf is configured correctly, nginx is not reloading.
After changing the ingress object of one of the cases (like namespace2/ingress), ingress reloads correctly NGINX

BTW, I'm using your image:
I0821 19:08:34.930954       5 launch.go:108] &{NGINX 0.9.0-beta.11 git-827d8520 https://github.com/aledbf/ingress}
I0821 19:08:34.931304       5 launch.go:111] Watching for ingress class: nginx
I0821 19:08:34.933678       5 launch.go:270] Creating API server client for https://master.kubernetes
I0821 19:08:34.940218       5 nginx.go:168] starting NGINX process...
I0821 19:08:35.015667       5 launch.go:127] validated estaleiro/ingress-default-backend as the default backend
W0821 19:08:35.016735       5 controller.go:311] Update of ingress status is disabled (flag --update-status=false was specified)
I0821 19:08:35.017134       5 controller.go:1280] starting Ingress controller

@rikatz this works as expected. Please keep in mind that any update (or initial sync) to ingress, secrets, endpoints and configmaps are asynchronous.

@aledbf but Ingress only starts answering correctly after someone changes any Ingress Object.
Before this, NGINX directs all the ingresses to default backend.

@rikatz please update the image to  quay.io/aledbf/nginx-ingress-controller:0.186

OK, the template is ok, but the error still happens.
I'm looking here to see if there's some secret causing this, or maybe this initial (a)sync is causing some issue to Ingress Controller.

@aledbf So it seems it's working, but Ingress is taking too much time to load each of the secrets.
The CA certificates are loaded immediately, but the TLS certs are not being loaded as fast as the CA. Isn't the case to load all the available secrets before reloading, in initial sync? And then reload as necessary?
Thanks!

@rikatz please test quay.io/aledbf/nginx-ingress-controller:0.187. This image includes an initial sync of the secrets.

Yeap, this is working as expected o/


web.render argument garbage

dmd 2.066
vibe.d 0.7.21-rc.3

I ran into a situation where the compiler  would crash&burn with
Assertion failure: 'type->ty != Tstruct || ((TypeStruct *)type)->sym == this' on line 915 in file 'struct.c'

I seemingly reduced my code to the following. However, the reduced case does not crash as the original did, but it does print garbage.
/1 and /3 work fine, /2 has the problem (with the <---------- :).
app.d
shared static this()
{
	auto router = new URLRouter;
	router.registerWebInterface(new Web);

	auto settings = new HTTPServerSettings;
	settings.port = 8080;
	settings.bindAddresses = ["::1", "<IP_ADDRESS>"];
	settings.sessionStore = new MemorySessionStore;
	listenHTTP(settings, router);
}

class Web
{
	@path(`/1`)
	void get1()
	{
		import std.random: uniform;
		auto rnd = uniform(0, 2);

		if(rnd == 0)
		{
			C c = new C;
			render!(`test.dt`, rnd, c);
			// rnd 0 C 0
		}
		else
		{
			C c = new C;
			render!(`test.dt`, rnd, c);
			// rnd 1 C 0
		}
	}

	@path(`/2`)
	void get2(HTTPServerRequest req, HTTPServerResponse res)
	{
		import std.random: uniform;
		auto rnd = uniform(0, 2);

		if(rnd == 0)
		{
			C c = new C;
			render!(`test.dt`, rnd, c);
			// rnd 0 C 0
		}
		else
		{
			C c = new C;
			render!(`test.dt`, rnd, c);
			// rnd 1 C 13314720 <----------------
		}
	}

	@path(`/3`)
	void get3(HTTPServerRequest req, HTTPServerResponse res)
	{
		import std.random: uniform;
		auto rnd = uniform(0, 2);

		C c = new C;

		if(rnd == 0)
		{
			render!(`test.dt`, rnd, c);
			// rnd 0 C 0
		}
		else
		{
			render!(`test.dt`, rnd, c);
			// rnd 1 C 0
		}
	}
}

class C
{
	int i;
}

views/test.dt
html

body
	p rnd #{rnd} C #{c.i}

Looks like it may be related to D issue 11260. Maybe it's possible to reproduce the issue with a dummy render!() function, too? Something like:
void render(ALIASES...)()
{
    import std.stdio;
    writefln("%s C %s", ALIASES[0], ALIASES[1]);
}

dmd v2.066.1
vibe.d v0.7.22

This reduced code now indeed crashes the compiler same as my original code did.
That dummy render makes it compile.
It also compiles when I move the C c = new C(); outside the if/then to below the auto rnd = ...

In the D issue it's mentioned that this is supposed to be fixed on recent DMD versions. Can we close this?

dmd 2.067.1
vibe.d 0.7.24-beta.3

Still the same for me.

There is a new bugzilla issue for this. I've added a reduced case of the example here: https://issues.dlang.org/show_bug.cgi?id=10619

You'll be happy to know that Kenji's upcoming fix (the one which covers 9748) will fix that as well then.


Need the repo in npm.

@sivaramsi given that the this is published to npm, what are you requesting with this ticket?

here is the package listing

@derek-adair that's for the jQuery version. Here is the correct library, but it's out of date, with version 0.13.3 published.

Can we get the npm version up-to-date?

+1
We're moving all our dependencies out of bower and into npm.  That seems to be trend.  Try to bower install angular 2.


find_embed hook

Wagtail provides two options for finding embeds

A fixed list of provider URLs
Embedly

So if you need an embed provider that isn't in wagtails built in list, your only option is to sign up to embedly.
I propose that we add a find_embed hook. Developers can use this hook to register embed handlers containing their own custom logic.
The embed finder functions will take 1 positional argument (the URL) and return an Embed object (or None). They must also have **kwargs allowing the get_embed function to pass in any extra hints to the function without other functions breaking (they can choose to ignore the kwargs though).
Example
@register_hook('find_embed')
def youtube(url, **kwargs):
    if url.startswith('http://www.youtube.com'):
        ...
        return Embed(...)

:+1:

The need for this came from recent sites which are all on secure HTTP. OEmbed doesn't appear to provide a method of requesting the secure version of a URL. Embedly does.
Having discovered this limitation I'm personally more inclined to always install Embedly on all future sites, but for those without that luxury it might be nice to package a few common find_embed hooks with wagtail. Otherwise it feels like rather a lot of work to create such a minor feature for every single site created.

I'm in favour of Karl's suggestion. It's a nuisance to sign up to an Embedly account just to make YouTube work on secure sites, or to embed gists. Can / should we bundle the common ones?

@kaedroho will create new python library which we will reference for this.

One issue with using hooks is that the order isn't guarenteed and you would want some handlers to run before others (youtube_https before oembed for example).
One other idea could be to change WAGTAILEMBEDS_EMBED_FINDER to accept a list of values so the order can be defined by the developer:
Eg:
WAGTAILEMBEDS_EMBED_FINDERS = [
    'myproject.embed_finders.youtube_https',
    'wagtail.wagtailembeds.finders.oembed',
]

This is covered by the "class-based embed finders" and new embeds configuration that was introduced in Wagtail 1.12.
http://docs.wagtail.io/en/v1.13/advanced_topics/embeds.html


Minor template fixes

This fixes a mismatched <th>...</td> and trims trailing whitespace.

Much appreciated, thanks Chris! 👍


update qaware sponsor logo

We updated our CI a while ago. Would be nice if we could update it :).

Thanks, merged and deployed: https://www.jug-mz.de/


[c++] Syntax highlighting gets confusing when defining a reference to an array.

If a function's parameter is a reference to an array of constants, the data type will be recognized as a function declaration:

If a reference to an array of constants is defined in a block, the data type will not be highlighted:

If a reference to an array (not constant) is defined in a block, the data type will be recognized as a function call:

Version of VS Code: 0.10.2
Color theme: Dark(Default color theme)

Oh, the color theme I chose is Dark, Default color theme.

@LittleSaya VSCode uses the C++ textmate definition from https://github.com/textmate/c.tmbundle . Fixing the bug there will have it fixed for all editors consuming the grammar.

It would be great if you can file these against https://github.com/atom/language-c.
Once fixed there I will update our grammar.


chore(deps): update terraform github.com/terraform-ibm-modules/terraform-ibm-key-protect-all-inclusive to v4.8.3

This PR contains the following updates:

Package
Type
Update
Change

github.com/terraform-ibm-modules/terraform-ibm-key-protect-all-inclusive
module
patch
v4.8.2 -> v4.8.3

Release Notes

terraform-ibm-modules/terraform-ibm-key-protect-all-inclusive (github.com/terraform-ibm-modules/terraform-ibm-key-protect-all-inclusive)
v4.8.3
Compare Source
Bug Fixes

deps: update terraform-module (#422) (bcef67b)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

:tada: This PR is included in version 1.6.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Remove ArcREST dependency

Evaluate removing ArcREST dependency in the script

reduces requirements for deployment
improves error reporting

ArcREST is not longer used by the script.

Validated with #12


bug 1939226: make kube-apiserver readiness checks, check readyz

readyz has different semantics than healthz
/assign @sttts

/cherrypick release-4.7

/cherry-pick release-4.7

/cherrypick release-4.7

/cherrypick release-4.6

/cherrypick release-4.5

/bugzilla refresh

Different question: why do we have a readiness probe at all?

Ic, this is for monitoring service? Make sense.
/retest
/approve

/lgtm

/bugzilla refresh

/bugzilla refresh


Add logs to cache hooks events

Changes:

Adds a log message for each event received by CacheHooksService in order to improve traceability.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

20 of 20 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.03%) to 90.388%

Totals

Change from base Build<PHONE_NUMBER>:
-0.03%

Covered Lines:
5131

Relevant Lines:
5539

💛  - Coveralls


Add host-based agent creation for init and step functions

A new, very simple example is included as an example of use / test case.
The host to device memcpy currently assumes that the number of agents created in a single step is a small portion of the total amount, so many small memcpys are better than  a single enourmous copy.
It may be worthwhile adding a single copy variant which is conditionally used when the number of agents represent a significant portion of the buffer size (highlighted by an @todo).
Agent variable arrays are copied with arrayLength individual copies. This is ok for small arrays, but very large arrays would likely suffer. An alternate to copy using a single large copy would be beneficial for this case.
The project file for the new example uses CUDA 8.0 and VS2015.
Closes #73

need to add comment to header prototypes that can only be called from init /step fn

Change this to be h_add_agent(struct) and h_add_agents(AoS/std::vec), when the function is called it will do the (many) copies etc.
This allows it to be called from within visualisation and means the schema doesn't need changing etc.


Version 4.10.4

This PR adds the following improvements:
Xcode 13 compatibility issue:

#433
#439

State validation:

#434
#437

Minor enhancements:

#438
#440 to help with #436

Note:

ZipFoundation has not been updated to 0.9.12, as this version increases lower API version to iOS 12 (https://github.com/weichsel/ZIPFoundation/commit/8dd1fa9664d8144b3c22421257febeb1b08207dd). This change will happen in the future, but not yet in this release.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.2 out of 3 committers have signed the CLA.:white_check_mark: dinesharjani:white_check_mark: philips77:x: Nick KibyshNick Kibysh seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Fixes deprecations errors on php 8.1

Since the library is meant to support php 7.1, some attributes were added to methods in a few classes (CurrentWeatherGroup, WeatherForecast and Forecast), fixing deprecations errors being thrown on php 8.1

@cmfcmf 👋🏻 Please can we get this merged to fix PHP 8.1 deprecation notices?

Thanks a lot, and sorry for the long delay!
I also modified CI to fail on deprecation notices, so issues like this hopefully don't come up again in the future (https://github.com/cmfcmf/OpenWeatherMap-PHP-API/commit/5a620de9b953478ba7f096bf59c7e5a33a1522a5).


Upgraded to laravel 5.1

Did I miss anything regarding the fact that apc is not longer a required cache driver?

Sweet! This closes #600 too!

StyleCI broken again. I have no idea what's causing that?

Moondragon!

lol - doubt it's related

StyleCI seems to be working again?

Cool :+1: !!!

@joecohens Looking more closely, StyleCI is still broken. It's been randomly not updating the status of commits for weeks. I have no idea why.

Is this PR good to merge?

@GrahamCampbell Since the update to 5.1? Maybe?

Since the update to 5.1? Maybe?

Been failing all month I think.

Look through https://github.com/cachethq/Cachet/compare/v0.1.0-alpha...master. Starts happening on May 10th.

Is this PR good to merge?
Yeah it is :)

No commits were pushed to StyleCI on May 10th. Some were on May 9th though.
Could this introduce the changes that's causing these failures?
https://github.com/StyleCI/StyleCI/commit/8f801d787547c28deb02dc126796ea7fa362c1bc

https://github.com/laravel/framework/compare/v5.0.28...5.0.30

Maybe, I can make a quick test locally with the latest changes


Can you help, trying to install Commander Pi on RaspPi4b 8GB running Windows10, downloaded sip file but cant seem to run?

anything I type after this - says it does not recognise as an operable file

anything I type after this - says it does not recognise as an operable file

Sorry but CommanderPi is designed to run on Linux operating systems, specifically Raspberry Pi OS or TwisterOS. You will not be able to run CommanderPi on Windows 10

Sorry but CommanderPi is designed to run on Linux operating systems, specifically Raspberry Pi OS or TwisterOS. You will not be able to run CommanderPi on Windows 10

Arrgg OK was hoping to overclock etc. through this - will have to go back through the long route

Arrgg OK was hoping to overclock etc. through this - will have to go back through the long route

Arrgg OK was hoping to overclock etc. through this - will have to go back through the long route

@Laurenceellis use WoRCP for that, you can get it from the WoR discord server.

Arrgg OK was hoping to overclock etc. through this - will have to go back through the long route

@Laurenceellis use WoRCP for that, you can get it from the WoR discord server.

Hi like @KinoZampie said CommanderPi is designed for Linux. I don't think it would be port to WoR anytime soon

Hi like @KinoZampie said CommanderPi is designed for Linux. I don't think it would be port to WoR anytime soon


Add Windows Support

Coming from https://github.com/opensearch-project/opensearch-plugins/issues/95, add Windows support.

[ ] Passing CI on Windows
[ ] Documentation

Adding Windows CI will ensure that the plugin actually works on Windows, we can't assume that it works because it's theoretically portable.

Waiting for one more review here: https://github.com/opensearch-project/observability/pull/1108. Once merged, will close this issue

Merged Changes

Are integration/cypress tests also running? If not please reopen this issue. Close when there's no gap between testing on Linux and Windows.


Add some guidance about communication channels.

LGTM - nits

Jenkins job istio/presubmit passed

Jenkins job istio/presubmit passed


chore: resolve deprecation around data.GetJSON

This PR removes this deprecation warning:

proof that this still works:

I'll be happy to approve this, but I'm not sure I fully understand everything I read...
Cc: @ramyaragupathy @louwers

Honestly this whole approach seems overcomplicated to me.

Thank you. 🙏


how can we do early stopping for sample notebook I provided in the below

I saw there're argument called disable_early_stopping in autoML. Can we do the same thing in the below notebook?
https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/36455b8125802459f3a40752fbda0e4c9407c854/notebooks/official/migration/UJ11 Vertex SDK Hyperparameter Tuning.ipynb

disable_early_stopping is for AutoML only. The referenced notebook is HPT for a custom job. One can DIY implement early stop for training. Likewise when doing HPT you set max_trials. If HPT does not think it making progress, it will stop early.


ExtensionUpdateRequest fails when try to pass transition

When I try to call the extension update.
I know that I need to pass
example: extensionUpdateRequest.transition(new UserTransitionInfo[]{new UserTransitionInfo().sendWelcomeEmail(false)});
but it fails with this message
{
"errorCode" : "InvalidParameter",
"message" : "Parameter [transition] value is invalid.",
"errors" : [ {
"errorCode" : "CMN-101",
"message" : "Parameter [transition] value is invalid.",
"parameterName" : "transition"
} ],
"parameterName" : "transition"
}
need to change it to
extensionUpdateRequest.transition(new UserTransitionInfo().sendWelcomeEmail(false));
and then it would work, accept an UserTransitionInfo

I think this is a swagger spec issue, because the spec says it should be an array:
https://github.com/ringcentral/RingCentral.Net/blob/master/code-generator/rc-platform.yml
transition:
        type: array
        items:
          $ref: '#/definitions/UserTransitionInfo'
          description: For NotActivated extensions only. Welcome email settings

I will file an internal ticket for the spec team.

Fixed


feature: provide config.isIdle indicating idle state and stop revalidation

Description
give user ability to decide whether they want revalidation in some edge cases:

page transition on slow connection that revalidations can cause more errors
page is in background sometimes they don't want any revalidation

Changes

add config.isPaused()
stop doing revalidation on config.isPaused() is true

related discussion 841

@shuding Thanks for the nice feedback! I was thinking the paused state might be related to sth (like DOM state) out of react, i.e. swr can be paused when document.visible is false like isOnline.
will update PR by comments 🙏

But the behavior of this option is to pause requests right (everything will be skipped)?

yup, I've changed to config.isPuased() to let user add some condition like
isPuased() { return document.visibility === 'hidden' }

and add one more case in revalidation catch branch, which is ignoring the errors when promises are been rejected under paused state

Thanks, this is a good fix!


Doesn't use updated statblock in preview pages

data.json.txt
Wouldn't let me upload the json file directly, so added the txt extension.
Seeing some oddness with the preview/read mode not using the new layout I created. Also seeing some of the "traits" not showing up. Could be something I did though. :D

Okay, I fixed the layout issue in the latest beta.
The undefined fields unfortunately were entered incorrectly into the data, and I need to make it easier to enter this information. Now that the importing is done maybe I will tackle that next. Basically, traits require a name and a desc field. Try this data file - the correct monster is "Goblin Dog 2".
data.json.txt


Error When with -w or -f Options at line 110 $1: unbound variable

Hello,
I'm trying to create a writable image:
sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm singularityware/docker2singularity -w fcpindi/c-pac
but it errors out with:
/docker2singularity.sh: line 110: $1: unbound variable
It works fine when not using the -w or -f flags,  but I need to make a modification before converting to an .simg.
I've tried escaping the slash in the image name, and using quotes.
Can you give men some insight as to what the error is indicating?
Many thanks,
Louis

I think there is just an extra shift - let me put in a quick PR for you to test (you'll need to build the image first) - back in a bit!

hey @ppdac you should be able to pull this branch:
https://github.com/singularityhub/docker2singularity/pull/75
and then build the container locally to test. E.g.,
git clone -b fix/extra-shifts https://www.github.com/singularityhub/docker2singularity
cd docker2singularity
docker build -t docker2singularity .

And then use docker2singularity to test. If/when that works let me know and we can merge the PR and update the containers. Also note that updated containers are being served from quay.io:
https://quay.io/repository/singularity/docker2singularity
It's late here and I'm done for the day, but I can finish up after you've tested tomorrow. Thanks for catching this!

Thank you for the super quick attention here, @vsoch! 🥇
Hit the below issue with the -w flag, but -f was a huge success! Forward progress on my end, so you've helped me clear a hurdle here :)
louis@server:~/source/docker2singularity$ sudo docker image list
REPOSITORY                               TAG                 IMAGE ID            CREATED             SIZE
docker2singularity                       latest              3bfffb899de4        26 seconds ago      350MB
<none>                                   <none>              bacc1f0a5ea5        37 seconds ago      1.14GB
quay.io/singularity/docker2singularity   latest              606348dfb722        9 days ago          350MB
docker                                   18.09.8             e48dc77a28ea        6 weeks ago         171MB
singularityware/docker2singularity       latest              96a6f87eed76        6 weeks ago         339MB
golang                                   1.12.7-alpine3.10   6b21b4c6e7a3        2 months ago        350MB
nipy/mindboggle                          latest              9c29be1f7297        3 months ago        4.55GB
fcpindi/c-pac                            latest              20f00f383f26        4 months ago        3.81GB
fcpindi/c-pac                            <none>              af15c31b0b39        6 months ago        3.85GB
childmind/c-pac                          latest              9d2e274369b7        6 months ago        5.53MB
centos                                   latest              1e1148e4cc2c        10 months ago       202MB
childmind/c-pac                          <none>              482d3d5f1def        10 months ago       3.97GB
childmid/c-pac                           oldest              abd442b86718        11 months ago       4.64GB
childmind/c-pac                          <none>              abd442b86718        11 months ago       4.64GB
poldracklab/fmriprep                     1.1.8               ac3a493f03a7        12 months ago       11.5GB
nipy/mindboggle                          <none>              3f24f84333cf        12 months ago       5.19GB
hello-world                              latest              4ab4c602aa5e        13 months ago       1.84kB
filo/docker2singularity                  latest              54abb69c7312        19 months ago       102MB
louis@server:~/source/docker2singularity$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity -w fcpindi/c-pac:latest

Image Format: writable
Docker Image: fcpindi/c-pac:latest

Inspected Size: 3810 MB

(1/10) Creating a build sandbox...
(2/10) Exporting filesystem...
(3/10) Creating labels...
(4/10) Adding run script...
(5/10) Setting ENV variables...
(6/10) Adding mount points...
(7/10) Fixing permissions...
(8/10) Stopping and removing the container...
(9/10) Building writable container...
Error for command "build": unknown flag: --writable

Options for build command:

      --arch string       Architecture for remote build (default "amd64")
      --builder string    remote Build Service URL, setting this implies --remote (default
                          "https://build.sylabs.io")
  -d, --detached          submit build job and print build ID (no real-time logs and requires --remote)
      --disable-cache     do not use cache or create cache
      --docker-login      login to a Docker Repository interactively
  -e, --encrypt           build an image with an encrypted file system
  -f, --fakeroot          build using user namespace to fake root user (requires a privileged installation)
  -F, --force             delete and overwrite an image if it currently exists
  -h, --help              help for build
      --json              interpret build definition as JSON
      --library string    container Library URL (default "https://library.sylabs.io")
      --no-cleanup        do NOT clean up bundle after failed build, can be helpul for debugging
      --nohttps           do NOT use HTTPS, for communicating with local docker registry
  -T, --notest            build without running tests in %test section
      --passphrase        Enter a passphrase for an encrypted contaner
      --pem-path string   Enter an path to a PEM formated RSA key for an encrypted container
  -r, --remote            build image remotely (does not require root)
  -s, --sandbox           build image as sandbox format (chroot directory structure)
      --section strings   only run specific section(s) of deffile (setup, post, files, environment, test,
                          labels, none) (default [all])
      --tmpdir string     specify a temporary directory to use for build
  -u, --update            run definition over existing container (skips header)

Run 'singularity build --help' for more detailed usage information.

Using Singularity version: 2.4.2-dist. I'm not sure if this is due to something on my setup, but if not feel free to have me test more.
Thanks again!

Ah, so that's not an issue with the client here, but the version of singularity you are using (that doesn't have writable as an option to build). Your options are to use a newer version of singularity, or go back to use one of the older docker2singularity (the tags correspond with version).  If this is the only issue, then the PR here should be good - let me know when you are comfortable with merging, and if/when you test older versions of the client, if you have any success (not that the branches also correspond to versions if you want to see the code).
I'll check up on this issue/thread tomorrow! It's like 7pm and I haven't even started making dinner yet :/

I'll upgrade Singularity and let you know how it goes. Enjoy your dinner, and dessert. You deserve it!

Thanks!! :plate_with_cutlery:
One quick thought that just came to mind (I'm back, haha) is that if you figure out that your version needs a different flag (e.g., --sandbox instead of --writable) we could add an argument for custom options, that way any supported option (for any version of singularity) could be provided to the build. So if :

updating doesn't work
using an older version of docker2singularity doesn't work

Let's nail down the command you need to build, and then add the --options argument to handle it.
Okay - now I'm off!

Firstly, hope you had a yummy meal! My dog ate my take out as I stepped out of the room for the second day in a row. :(

updating doesn't work
I'm not quite sure. I think --writable appeared in v2.5, but I updated directly to v3.2.1 to match what our HPC is running. Looking at the docs for versions older than v2.5 I don't see it mentioned (v2.4 docs are missing; not on the Wayback Machine)

I'm guessing the --writable flag was dropped in v3: we can work with sandboxes and convert them to SIF images using singularity build new-sif.  So perhaps the functionality was deemed redundant?

using an older version of docker2singularity doesn't work
I should have tried this first, well really I should have upgraded to the final v2 release and tried your patch first. But the tags/v2.3 failed for the same reasons, just on a different line. I think this is to be expected now that I am of the viewpoint that build --writable was short-lived on versions of Singularity that I didn't get to test.

I'm reluctant to mess around with the system any further, as I'm getting sleepy and don't want to start making errors; and also I think you solved the problem by fixing the -f sandbox flag.
I think support for -w can be dropped, or only kept around  with a version check of Singularity for 2.5–6. Having -f's sandbox support complements the current documentation for Singularity.
--
I was just messing around, so don't look at this seriously, but interestingly, using build new-sif allows singularity shell --writable to work on .simgs. I'm new to Singularity, so I can't comment much on what I mean to say here other than, build new-sif seems to create mutable immutable images. Heheh...
#docker2singularity.sh
elif [ "$image_format" == "writable" ]; then
    new_container_name=${new_container_name}.img
    singularity build new-sif $build_sandbox
    mv $build_sandbox $new_container_name

For newest Singularity the supported option is "Sandbox" instead of writable. I think what I should add to the current PR is support for a general option, that way you can add whatever you like. Note that this will just be for the current master (which builds 3.4.1).

@ppdac I've added an options argument, so you should be able to provide any options that you like to the build. Would you care to test it out? When you approve the PR, we can merge.

Sorry for the late reply. I wasn't at work today, but work was sure coming at me.
I tried rebuilding docker2singularity again, but it doesn't seem to work anymore:
(base) louis@server:~/source$ git clone -b fix/extra-shifts https://www.github.com/singularityhub/docker2singularity
Cloning into 'docker2singularity'...
warning: redirecting to https://github.com/singularityhub/docker2singularity.git/
remote: Enumerating objects: 15, done.
remote: Counting objects: 100% (15/15), done.
remote: Compressing objects: 100% (10/10), done.
remote: Total 495 (delta 4), reused 11 (delta 3), pack-reused 480
Receiving objects: 100% (495/495), 210.43 KiB | 11.69 MiB/s, done.
Resolving deltas: 100% (250/250), done.
(base) louis@server:~/source$ cd docker2singularity
(base) louis@server:~/source/docker2singularity$ sudo docker build -t docker2singularity .
Sending build context to Docker daemon  424.4kB
Step 1/21 : FROM golang:1.12.7-alpine3.10 as base
 ---> 6b21b4c6e7a3
Step 2/21 : FROM docker:18.09.8 as builder
 ---> e48dc77a28ea
Step 3/21 : COPY --from=base /go /go
 ---> Using cache
 ---> cd78dc6d5580
Step 4/21 : COPY --from=base /usr/local/go /usr/local/go
 ---> Using cache
 ---> b35f4163f405
Step 5/21 : ENV GOPATH /go
 ---> Using cache
 ---> 1448046e9911
Step 6/21 : ENV PATH $GOPATH/bin:/usr/local/go/bin:$PATH
 ---> Using cache
 ---> 6040b6a8b3dc
Step 7/21 : ENV GOLANG_VERSION 1.12.7
 ---> Using cache
 ---> 14305b7d60db
Step 8/21 : RUN apk update &&     apk add --virtual automake build-base linux-headers libffi-dev
 ---> Using cache
 ---> 2755e0bb8723
Step 9/21 : RUN apk add --no-cache bash git openssh gcc squashfs-tools sudo libtool gawk ca-certificates libseccomp
 ---> Using cache
 ---> a34c3ee7993a
Step 10/21 : RUN apk add --no-cache linux-headers build-base openssl-dev util-linux util-linux-dev python rsync cryptsetup
 ---> Using cache
 ---> 818e63fdb112
Step 11/21 : RUN mkdir -p /usr/local/var/singularity/mnt &&     mkdir -p $GOPATH/src/github.com/sylabs &&     cd $GOPATH/src/github.com/sylabs &&     wget -qO- https://github.com/sylabs/singularity/releases/download/v3.4.1/singularity-3.4.1.tar.gz |     tar xzv &&     cd singularity &&     ./mconfig -p /usr/local/singularity &&     make -C builddir &&     make -C builddir install
 ---> Using cache
 ---> bacc1f0a5ea5
Step 12/21 : FROM docker:18.09.8
 ---> e48dc77a28ea
Step 13/21 : LABEL Maintainer<EMAIL_ADDRESS> ---> Using cache
 ---> 789a0b6300b8
Step 14/21 : COPY --from=builder /usr/local/singularity /usr/local/singularity
 ---> Using cache
 ---><PHONE_NUMBER>12
Step 15/21 : RUN apk add --no-cache ca-certificates libseccomp squashfs-tools bash python rsync
 ---> Using cache
 ---> 186b075a9db2
Step 16/21 : ENV PATH="/usr/local/singularity/bin:$PATH"
 ---> Using cache
 ---> bd6e36062539
Step 17/21 : ADD docker2singularity.sh /docker2singularity.sh
 ---> f38d1671f5d8
Step 18/21 : ADD addLabel.py /addLabel.py
 ---> bb4951a08105
Step 19/21 : ADD scripts /scripts
 ---> 91ad1e5c09c3
Step 20/21 : RUN chmod a+x docker2singularity.sh
 ---> Running in 1f3b5d6a0341
Removing intermediate container 1f3b5d6a0341
 ---> f9c23b3e431f
Step 21/21 : ENTRYPOINT ["docker-entrypoint.sh", "/docker2singularity.sh"]
 ---> Running in 3e4adcf0b850
Removing intermediate container 3e4adcf0b850
 ---> 18fd6d59168b
Successfully built 18fd6d59168b
Successfully tagged docker2singularity:latest

(base) louis@server:~/source/docker2singularity$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity -w fcpindi/c-pac
(base) louis@server:~/source/docker2singularity$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity --writable fcpindi/c-pac
(base) louis@server:~/source/docker2singularity$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity -f fcpindi/c-pac
(base) louis@server:~/source/docker2singularity$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity -f fcpindi/c-pac:latest
(base) louis@server:~/source/docker2singularity$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity fcpindi/c-pac:latest

(base) louis@server:~/source/docker2singularity$ singularity --version
singularity version 3.4.1

Hope all is well,
Louis

So sorry about that! I put in an exit 0 for testing the options argument, and just forgot to take it out!
Just removed it - you should be able to do the same above and have it test fully.

Okay, so the -w fails as expected in Singularity 3.4.1, but -f works, which is great and an improvement.
$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity -w fcpindi/c-pac

Image Format: writable
Docker Image: fcpindi/c-pac

Inspected Size: 3810 MB

(1/10) Creating a build sandbox...
(2/10) Exporting filesystem...
(3/10) Creating labels...
(4/10) Adding run script...
(5/10) Setting ENV variables...
(6/10) Adding mount points...
(7/10) Fixing permissions...
(8/10) Stopping and removing the container...
(9/10) Building writable container...
Error for command "build": unknown flag: --writable

Options for build command:

      --arch string       Architecture for remote build (default "amd64")
      --builder string    remote Build Service URL, setting this implies --remote (default "https://build.sylabs.io")
  -d, --detached          submit build job and print build ID (no real-time logs and requires --remote)
      --disable-cache     do not use cache or create cache
      --docker-login      login to a Docker Repository interactively
  -e, --encrypt           build an image with an encrypted file system
  -f, --fakeroot          build using user namespace to fake root user (requires a privileged installation)
  -F, --force             delete and overwrite an image if it currently exists
  -h, --help              help for build
      --json              interpret build definition as JSON
      --library string    container Library URL (default "https://library.sylabs.io")
      --no-cleanup        do NOT clean up bundle after failed build, can be helpul for debugging
      --nohttps           do NOT use HTTPS, for communicating with local docker registry
  -T, --notest            build without running tests in %test section
      --passphrase        Enter a passphrase for an encrypted contaner
      --pem-path string   Enter an path to a PEM formated RSA key for an encrypted container
  -r, --remote            build image remotely (does not require root)
  -s, --sandbox           build image as sandbox format (chroot directory structure)
      --section strings   only run specific section(s) of deffile (setup, post, files, environment, test, labels, none) (default [all])
      --tmpdir string     specify a temporary directory to use for build
  -u, --update            run definition over existing container (skips header)

$ sudo docker run -v /var/run/docker.sock:/var/run/docker.sock -v /opt/SingularityImages/test:/output --privileged -t --rm docker2singularity -f fcpindi/c-pac

Image Format: sandbox
Docker Image: fcpindi/c-pac

Inspected Size: 3810 MB

(1/10) Creating a build sandbox...
(2/10) Exporting filesystem...
(3/10) Creating labels...
(4/10) Adding run script...
(5/10) Setting ENV variables...
(6/10) Adding mount points...
(7/10) Fixing permissions...
(8/10) Stopping and removing the container...
(9/10) Building sandbox container...
(10/10) Moving the image to the output folder...
  4,622,208,358  99%  203.20MB/s    0:00:21 (xfr#107299, to-chk=0/129506)
Final Size: 3765MB

I created a VM to build Singularity from the 2.6.1 tag, and surprisingly the writable flag isn't there:

I then downgraded to 2.5.2-HEAD.b258b6513 because that was around when the old docs mention build --writable, and tried with docker2singularity with -w again:

Given this, I would recommend dropping support for the flag altogether. Or maybe warning users to use -f instead and work with sandboxes.
Sandboxes are easy to later convert to SIF images (singularity build new-sif sandboxName.
Thanks for all of your help with this! I had fun learning to use git and github in new ways 👍

Awesome! So - ready for merge?

Yes! We are go for launch!
--
Sent from mobile. Please forgive any typos.
Louis Waweru
Senior Staff Associate
Department of Psychology
373 Schermerhorn Ext.
Columbia University
(212) 854-8167
(347) 843-9167

From: Vanessasaurus<EMAIL_ADDRESS>Sent: Friday, October 4, 2019 1:36 AM
To: singularityhub/docker2singularity
Cc: Louis Waweru; Mention
Subject: Re: [singularityhub/docker2singularity] Error When with -w or -f Options at line 110 $1: unbound variable (#74)
Awesome! So - ready for merge?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/singularityhub/docker2singularity/issues/74?email_source=notifications&email_token=AAZ2URIZZ7R4ARJ6YRSS2D3QM3I3ZA5CNFSM4I436GJKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAKPELI#issuecomment-538243629, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAZ2URKW3KVNBGXV3HR5LBTQM3I3ZANCNFSM4I436GJA.


add support for rocm 5.6 in CI

Changes to support ROCm 5.6 for CI

Lets disable the misc-use-anonymous-namespace tidy check. I dont really see why its useful to use an anonymous namespace over static function. They are essentially the same.

Lets disable the misc-use-anonymous-namespace tidy check. I dont really see why its useful to use an anonymous namespace over static function. They are essentially the same.

Done.
Also fixed warnings for the custom ops.


Forward rendered cullShadowmaps bug

After the latest release this function has a bug, I couldn't determine the pattern but on game maps, nothing changed. For some reason, it appeared after the latest engine release.
Here is a screenshot from it :

The only pattern I determined is when I remove all objects from the scene and add new ones, including lights.
I have this issue right now on the game, live version, it freezes the user's game for one second on map load then it doesn't occur again.
I'm not sure how I can provide a scene for reproducing it. I'll try to investigate it more. But I wanted to post this issue because it's on live and maybe PlayCanvas team has an easy solution for it.
Potential causes :

I change the scene and it also removes batched entities, maybe the new culling system somehow caches entities and when they are not on the list, it causes the issue.
I have some custom shaders on the scene, like a flag, they also have shadows, but maybe that can also cause the issue.
Lights has "once" option on them, I update them once when scene loaded, I'm not sure if this has any affect on issue.

Hi @devcem - thanks for the report, I'll investigate this tomorrow .. from looking at the code, this should be quick to sort out.

In the meantime, perhaps release the game with the previous version of the engine is possible?

@devcem - I've looked over the code, it's related to the shadows for the directional light based on the callstack, but I don't see an obvious way to reproduce it or see where it could possibly happen in code. Is there a way I can reproduce it in your project? If so, a link / repro steps would be great.

@mvaligursky I prepared a demo for you, so you can test it out quickly.

Open the link, wait until the game ends
Vote "Temple" map
You'll see an error in logs
Since the game is short it will continue to switch maps, select different maps on each case to trigger it

https://playcanv.as/index/rFDxa2Km#NDA
Make sure it has "#NDA" has at the end, otherwise it doesn't connect server properly.

Ok I have a fix .. I have not tested it with your game, but I'm very confident this is the reason. Thanks for the report and repro, that was very useful in tracking this down.

@devcem Now that this has been fixed, when would you like us to deploy 1.10.5?

@devcem Now that this has been fixed, when would you like us to deploy 1.40.5?

Well if possible, today would be great. So I can update the game today. I know it doesn't crash the game but I believe it causes some issues on map switches, like frame drops, etc.
Also thank you for quick response and fix :)

@devcem 1.40.5 has finally be deployed. Can you let us know if you continue to have problems with this?

@willeastcott it's fixed, thank you!


Specify a licence

Hi, what licence should we use for this? I default to MIT, but if anyone thinks it's not appropriate, let me know! Check that out if you want to know more about licences: https://choosealicense.com

See #10

Solved by #10


RecordCells is unreasonably slow for getField on large result sets

Some large result sets may have thousands of rows contained within a single record. It appears that the implementation of RecordCells.getField in WrappedRow.java is very inefficient. At present, it's much quicker to fill down than to use row.record.

getField() is not intended to be used that way.
It is faster and easier if you instead select ONLY the row or rows you need from the Record array.
This gets only the 2nd row of the Record array
row.record.cells["Column 1"].value[1]

If you want to get multiple rows then just use Array slicing
This gets the 1st through 4th row of the Record array
row.record.cells["Column 1"].value[0,3]
This gets the 2nd through 4th row of the Record array
row.record.cells["Column 1"].value[1,3]


[Feature]: Ability to exclude dev packages from production Docker image

Is your feature request related to a problem you're trying to solve? Please describe.
The Devbox documentation says you can generate a production Docker image with the exact same tools you used for development. But a Devbox environment typically contains tools that you would not want to be present in production, e.g. Git, Make, Terraform. (Especially when using pure mode, which forces more of these types of tools to be specified in the Devbox environment.)
Describe the solution you'd like
I would like Devbox to be able to generate a "production" Dockerfile that excludes certain packages. This could be achieved by having a dev_packages attribute in devbox.json, in much the same way as package.json files have dependencies and devDependencies attributes.

By default, all packages should be included unless a --production flag is used. This flag would be needed on at least the devbox generate dockerfile and devbox install commands, but could be added to others too (e.g. devbox shell).
Ideally, Devbox itself should be excluded from Dockerfiles too. This may require a similar trick to what was done in #1036, where devbox shellenv --init-hook was used to set up the environment in the container so that Devbox does not need to be run.
The following could be moved out into a separate issue if necessary: A new dev_init_hooks array may also be required in devbox.json, in case people have init hooks that should not run in production. Alternatively, Devbox could pass a DEVBOX_PRODUCTION environment variable to each hook, so that the hook can decide whether or not to run. The former approach is cleaner, but the latter gives users more control over the order in which the hooks run. Perhaps both approaches should be implemented so that users can choose what's best for them.

Describe alternatives you've considered
An alternative solution would be to maintain two separate devbox.json files, one for dev and one for production, but this is not ideal because the versions specified for common packages may become out of sync.

I would actually prefer not to limit the solution to just two environments ("dev" and "production"). My CI pipelines include "build" and "deploy" steps, each of which use a different subset of packages in devbox.json. Downloading all packages takes a long time (even with a cache set up). I'd like only the packages required for each step to be downloaded.
So, I propose an --environment option and/or a DEVBOX_ENVIRONMENT environment variable that determines which packages to use:

The packages required for each environment would be specified by a new environments array in the packages map.

Omitting --environment and DEVBOX_ENVIRONMENT would cause all packages to be downloaded (which is appropriate for a development environment where all packages should be available).

Example:
{
  "$schema": "https://raw.githubusercontent.com/jetify-com/devbox/0.12.0/.schema/devbox.schema.json",
  "packages": [
    "bash": "5",
    "python": {
        "version": "3.12",
        "environments": ["ci-build", "prod"]
    }
    "jfrog-cli": {
        "version": "2",
        "environments": ["ci-build"]
    }
    "shellcheck": {
        "version": "0.10",
        "environments": ["ci-build"]
    }
    "jq": {
        "version": "1",
        "environments": ["ci-build", "ci-deploy"]
    }
    "awscli2": {
        "version": "2",
        "environments": ["deploy"]
    }
    "curl": {
        "version": "8",
        "environments": ["deploy"]
    }
    "terraform": {
        "version": "1",
        "environments": ["deploy"]
    }
  ]
}


add release action and update markdown docs with linter rule

add  release action
update markdown docs based on linter rule for later super linter PR.
split more files into multiple PRs

#1


⚠ PrivateHD has degraded performance

In fb10959, PrivateHD ($PHD) experienced degraded performance:

HTTP code: 200
Response time: 16811 ms

Resolved: PrivateHD performance has improved in f97d8ba.


--max-filesize not working with --external-downloader

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2<IP_ADDRESS>. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2<IP_ADDRESS>

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
command: youtube-dl -v -x --external-downloader aria2c --max-filesize 10m "https://www.youtube.com/watch?v=MD3ROlR6k8I"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-x', u'--external-downloader', u'aria2c', u'--max-filesize', u'10m', u'https://www.youtube.com/watch?v=MD3ROlR6k8I']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.09.02
[debug] Python version 2.7.12 - Linux-4.13.0-26-generic-x86_64-with-LinuxMint-18.3-sylvia
[debug] exe versions: ffmpeg N-88041-gb89081e-1, ffprobe N-88041-gb89081e-1
[debug] Proxy map: {}
[youtube] MD3ROlR6k8I: Downloading webpage
[youtube] MD3ROlR6k8I: Downloading video info webpage
[youtube] MD3ROlR6k8I: Extracting video information
[youtube] {22} signature length 44.45, html5 player vflI0cIzU
[youtube] {43} signature length 44.45, html5 player vflI0cIzU
[youtube] {18} signature length 44.45, html5 player vflI0cIzU
[youtube] {36} signature length 44.45, html5 player vflI0cIzU
[youtube] {17} signature length 44.45, html5 player vflI0cIzU
[youtube] {137} signature length 44.45, html5 player vflI0cIzU
[youtube] {136} signature length 44.45, html5 player vflI0cIzU
[youtube] {135} signature length 44.45, html5 player vflI0cIzU
[youtube] {134} signature length 44.45, html5 player vflI0cIzU
[youtube] {133} signature length 44.45, html5 player vflI0cIzU
[youtube] {160} signature length 44.45, html5 player vflI0cIzU
[youtube] {140} signature length 44.45, html5 player vflI0cIzU
[debug] Invoking downloader on u'https://r12---sn-bvvbax-a5ne.googlevideo.com/videoplayback?ipbits=0&lmt=1420572757474128&c=WEB&mm=31%2C26&mime=audio%2Fmp4&id=o-AFDaqai5lkIsqUYamT6vs3QwErIaSuYFd0OhUV4zrr92&pl=16&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Crequiressl%2Csource%2Cexpire&mt=1522428497&mv=m&ms=au%2Conr&fvip=3&key=yt6&ip=<IP_ADDRESS>&mn=sn-bvvbax-a5ne%2Csn-n4v7sn7l&gir=yes&expire=1522450217&requiressl=yes&keepalive=yes&itag=140&ei=yWq-WsznKsuZ_AOqkJPYDw&clen=49268948&dur=3068.934&source=youtube&initcwndbps=1428750&nh=EAE%2C&signature=E166CAE9C56A7A3B80DB5DD798FCB14285EFB65C.21F3326E3E57158AE711D090752A375C1AF85CA0&ratebypass=yes'
[download] Destination: Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a
[debug] aria2c command line: aria2c -c --min-split-size 1M --max-connection-per-server 4 --out 'Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a.part' --header 'Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7' --header 'Accept-Language: en-us,en;q=0.5' --header 'Accept-Encoding: gzip, deflate' --header 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' --header 'User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)' '--check-certificate=true' -- 'https://r12---sn-bvvbax-a5ne.googlevideo.com/videoplayback?ipbits=0&lmt=1420572757474128&c=WEB&mm=31%2C26&mime=audio%2Fmp4&id=o-AFDaqai5lkIsqUYamT6vs3QwErIaSuYFd0OhUV4zrr92&pl=16&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Crequiressl%2Csource%2Cexpire&mt=1522428497&mv=m&ms=au%2Conr&fvip=3&key=yt6&ip=<IP_ADDRESS>&mn=sn-bvvbax-a5ne%2Csn-n4v7sn7l&gir=yes&expire=1522450217&requiressl=yes&keepalive=yes&itag=140&ei=yWq-WsznKsuZ_AOqkJPYDw&clen=49268948&dur=3068.934&source=youtube&initcwndbps=1428750&nh=EAE%2C&signature=E166CAE9C56A7A3B80DB5DD798FCB14285EFB65C.21F3326E3E57158AE711D090752A375C1AF85CA0&ratebypass=yes'
[#c2ac28 46MiB/46MiB(99%) CN:1 DL:630KiB]
03/30 09:50:46 [NOTICE] Download complete: /home/colinl/Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a.part

Download Results:
gid   |stat|avg speed  |path/URI
======+====+===========+=======================================================
c2ac28|OK  |   1.7MiB/s|/home/colinl/Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a.part

Status Legend:
(OK):download completed.
[aria2c] Downloaded 49268948 bytes
[download] 100% of 46.99MiB
[ffmpeg] Correcting container in "Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a"
[debug] ffmpeg command line: ffmpeg -y -i 'file:Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a' -c copy -f mp4 'file:Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.temp.m4a'
[debug] ffmpeg command line: ffprobe -show_streams 'file:Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a'
[ffmpeg] Post-process file Monstercat 012 - Aftermath (Order Album Mix) [1 Hour of Electronic Music!]-MD3ROlR6k8I.m4a exists, skipping

Description of your issue, suggested solution and other information
So I have a script that searches and downloads a bunch of files from youtube for me, and am using --external-downloader aria2c in my youtube-dl commands, since it's way faster than default. Anyway, I want it to not download a video bigger than a certain size, so I do --max-filesize 10m, but it downloads the video anyway, even though the filesize is shown to be well over 10Mb. --max-filesize works fine without specifying an external downloader, but if I specify aria2c, avconv, or wget, it downloads the file anyway, despite it being over the specified maximum size. I've tried it with different videos and with ytsearch: and the problem is consistant.

It's not supposed to work with external downloaders.
External downloaders will be much slower for DASH videos due to Youtube throttling that is bypassed in native youtube-dl downloader.
Outdated youtube-dl version.


Transparent Window Randomly Losing Transperancy

This is mostly reproducible when moving a window around close to the edges of a monitor, or when resizing a lot/quickly.

These windows are usually a green tint, but if I resize them quickly with my mouse they will bug out like this and only a restart seems to fix it.
Not quite sure how to debug and potentially fix this.
This is the window style I use;
WindowStyle windowStyle = WindowStyle.Overlapped;
windowStyle |= WindowStyle.OverlappedWindow;
windowStyle ^= WindowStyle.ThickFrame;
this.SetWindowStyle(windowStyle);

The intended purpose is for the windows to be used as a sort of overlay and this styling disable the horrendously annoying aero snapping.

Could you please share a simple app that reproduces the issue?
Also which version of Windows?

Sure, here's a simple one setup via Template Studio. It was too big to upload directly via GitHub.
It seems to be mostly reproducible when resizing via the lower right corner, unless it's just a weird coincidence. The window may also randomly close whilst resizing.
I'm on Windows 11 Pro - Version 10.0.22631 Build 22631

I was able to reproduce the closing of the window. I never saw the transparency disappear, but did observe closing. No message/error was sent. To track what's going on, I added this to overlay window:
       this.Closed += OverlayWindow_Closed;
       this.AppWindow.Closing += AppWindow_Closing;
       this.AppWindow.Destroying += AppWindow_Destroying;
   }

   private void AppWindow_Destroying(Microsoft.UI.Windowing.AppWindow sender, object args)
   {
   }

   private void AppWindow_Closing(Microsoft.UI.Windowing.AppWindow sender, Microsoft.UI.Windowing.AppWindowClosingEventArgs args)
   {
   }

   private void OverlayWindow_Closed(object sender, WindowEventArgs args)
   {
   }

Then the problem went away, which led me to believe this is WinAppSDK issue with references getting lost. So in MainPage.xaml.cs I created a variable to hold a reference to the Overlay window instead of just declaring a local reference to it in your click handler, and again problem went away, confirming you found an interesting C#WinRT issue, and not a WinUIEx issue.
Again I haven't been able to repro your transparency issue, but I do wonder if it also gets addressed by keeping a reference to the window?

I do wonder if you're hitting this issue that's been an issue on Windows for YEARS https://github.com/microsoft/WindowsAppSDK/issues/4068

Very interesting, since there can potentially be more than one of these windows I'm now adding their references to a List and potentially a Dictionary in the future. Hasn't closed on me yet, the transparency however is very reproducible by just resizing it for a while.
When my window does this however it doesn't affect any other windows. Only the window I'm resizing.
Tried doing some more testing;

If I have multiple instances open, they're all affected by this glitch once I've "triggered" it on one of them.
If I try and open a new window after this glitch has occurred, I will get an error which I can't track down. It wants to attach a debugger, but there's already one attached.
It seems to be some kind of buffer/memory relation potentially, it takes on average ~8 seconds of resizing for this glitch to trigger. Regardless if continuous or if I do it in segments with some pauses in between.
Restarting the Desktop Window Manager does restore some level of transparency, but they're still glitchy.

I'm guessing some SDK version differences between us if you can't reproduce it? Unless it's hardware/driver related.

most likely hardware related. We're using the same version since I'm using your project to repro. I'm closing this out since this doesn't seem to be caused by WinUIEx itself - all the transparency rendering and maintaining it is handled by WinUI.

Could also be this: https://github.com/microsoft/microsoft-ui-xaml/issues/8423
It was fixed in the latest 1.5exp2. Perhaps you could confirm with that version whether you still see it?

I tried updating it and sadly, no difference. I also tried disabling the SystemBackdrop on my main window but the issue persists. I've also updated my GPU drivers to the latest.
Guess maybe I should post my findings as an issue over there instead?

most likely hardware related. We're using the same version since I'm using your project to repro. I'm closing this out since this doesn't seem to be caused by WinUIEx itself - all the transparency rendering and maintaining it is handled by WinUI.

@dotMorten - Not quite. You are creating a new brush for clearing the background on each call.
https://github.com/dotMorten/WinUIEx/blob/a830af73719a65c05c0b9f514afbc5fe4f32abc3/src/WinUIEx/TransparentTintBackdrop.cs#L103-L112
This simply hits a limit at some point and then you cannot create any more new brushes - then the transparency gets lost.
To reproduce, you just need to move the window around for a while and be a bit patient, then it will happen.
You should create the brush once and cache it. On dispose, pinvoke DeleteObject, etc..

@softworkz Nice find. Not sure what I was thinking there :-)

Not sure what I was thinking there :-)

In my case it's usually "first, try whether it works and do it right later". And then forget about it... ;-)


Group property numbers not consecutive starting at 1

HI,
When creating a new rePattern, I am receiving initialization error.: "Group property numbers not consecutive starting at 1"
I do not require some groups.
Any reason why I would have this error?
TIMESTAMP.group=1
LOGGER.group=3
LEVEL.group=4
CLASS.group=6
THREAD.group=7
MESSAGE.group=8

Thanks in advance

@unsaved Can you check this?

Pardon my ignorance, I do not understand what you want me to do here.

I have asked @unsaved  (https://github.com/unsaved) to check issue.


Module Parse Failed: File was processed with these loaders

Expected Behavior
It should work without any issue
Current Behavior
After removing the node_modules it always throws an error
Possible Solution
Setting "amplitude-js": "8.21.3", solved the issue, please fix the issue in the package itself
Steps to Reproduce

Use version - ^8.16.1
Uninstall the node modules
Re-install and run npm start

Environment

JS SDK Version:
Installation Method:
Browser and Version:

Same problem with  "amplitude-js": "^8.18.2"

Hello @RastogiNishant @MauricioAires  are you able to solve this issue,

Hello @RastogiNishant @MauricioAires are you able to solve this issue,

using "amplitude-js": "8.21.3" it works

Also happens for me with 8.21.9
Using the 8.21.3 is not an option, since that hasn't the patch of ua-parser-js


Fixed the issue with workflow id and url in the test on comment workflow

@dinogun - Can you please review, thank you.


Extra padding around vertical line in single backtick code block

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open the app
Open any report
Send multiple vertical lines in single backtick code block eg: |||||
Observe that it has padding around each line, try sending other symbols like @ in similar manner eg: @@@@@ and observe that it does not have extra padding around
Try multiple vertical lines in 3 backtick codeblock and observe that it does not have any padding around each symbol eg: |||||

Expected Result:
App should not have extra padding around symbols in code block
Actual Result:
App displays padding around vertical line in single backtick code block, other symbols does not have extra padding
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[X] Android / native
[X] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[X] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: 1.3.47-3
Reproducible in staging?: Y
Reproducible in production?:  Y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://github.com/Expensify/App/assets/43995119/fca1645a-f5c0-4a21-a9b2-e4df71e3c5ef
https://github.com/Expensify/App/assets/43995119/db917c35-0fff-43a5-9153-bb82f4eeae76
Expensify/Expensify Issue URL:
Issue reported by: @dhanashree-sawant
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1690797080473699
View all open jobs on GitHub

Yes I too had that doubt that it could be styling but currently we only have padding for one symbol i.e. '|', that seemed to me as odd and raised it as issue

Agree not a bug and expected. Am closing.


Reject Partially Fillable Orders

Despite our expectation, partially fillable orders seem to be working and causing a good amount of economically unviable solutions (cf. https://etherscan.io/tokentxns?a=0x042b32ac6b453485e357938bdc38e0340d4b9276&p=3)
To be safe, we should prevent people from placing such orders via the API
Test Plan
Added unit test, also checking that the place order script from the contracts repo yields the new error when placing a partially fillable order.

Codecov Report

Merging #1500 (de493d5) into main (56f3fa6) will increase coverage by 0.00%.
The diff coverage is 75.00%.

:exclamation: Current head de493d5 differs from pull request most recent head d328587. Consider uploading reports for the commit d328587 to get more accurate results

@@           Coverage Diff           @@
##             main    #1500   +/-   ##
=======================================
  Coverage   65.90%   65.91%
=======================================
  Files         162      162
  Lines       30912    30928   +16
=======================================
+ Hits        20374    20386   +12
- Misses      10538    10542    +4


[FEATURE REQUEST] Manual Novel Bookmark

Bookmark feature for manually downloaded novels.
Is your feature request related to a problem? Please describe.
There are many novel which do not support automatic download feature. And keeping track of those is bit troublesome
Describe the solution you'd like
Adding them to the library without the feature of automatic updates
Describe alternatives you've considered
A list can be created (preferably in JSON format) where the novel name description etc can be stored and retrived by a drop-down menu for us to download manually the novel.
Additional context
If it is troublesome then can you just make it so that there is a list of links we entered in the field?
Thanks you!1

The problem with manual grabbing is that it's unaware which of the fetched links are actual chapters (just talking about toc grabbing), so the primary function of the library (keeping tack of reading progress) is not possible without also saving a chapter selector (similar to chapter content selector but for links).

So is it possible to just save a record of the novel links that we entered in the field? Like to select it without using the library features at all?

I'm a bit confused as to what exactly you are talking about now. Do you want to have some sort of history tab of previous downloads or basically add a manual novel to the library to see where you left off?

The thing that I actually want to say is that, if possible, after manually providing the novel URL, name, tags, and synopsis, etc metadaa, we can save that instance in a JSON file just like the library. Afterwards, we can just select the name from a list of novels (manually downloaded and added to the JSON file) and redownload it as we do normally in a manual downloading.
If this was not possible

Do you want to have some sort of history tab of previous downloads

This will also work fine. Whatever novel we have downloaded manually, its URL will be saved to a file from where we can retrieve it anytime and redownload it again.  Only problem is that we will not have any metadata here and will have to manually enter it again.

I would also like this feature very much!
It's quite tedious to re-enter all the settings for a manual download each time there is an update.
Ideally it would store all the settings including metadata, blocked tags, and the list of links I removed.
Then the update would download the updated table of contents, and remove the links I removed the first time.
For example The Wandering Inn is no longer hosted on RoyalRoad, only on the wordpress website.
Novel-Grabber in manual works fine, but I dread downloading each update!
Even if the manual library feature just loads all the settings, and starts the manual process with me needing to check result and click "Grab chapters" to complete update, that would still be HUGE improvement over starting from scratch each time.


Color3 improvements

This should implement all the remaining parts of Color3:

fromHSV
toHSV
lerp
comparing two Color3s

Coverage decreased (-2.7%) to 96.822% when pulling fa937576e71d317857f7543c57731dc933ade43d on AmaranthineCodices:color3-improvements into 3b5cc4f6072c4cda25602ec8e753b2fcb5862368 on LPGhatguy:master.

Coverage drop is because of the branches in fromHSV and toHSV v.v
It's easy to fix (different HSV/RGB colors!), but is it worth it?

No, I don't think you have to. I'm this close to trying to figure out how luacov works and writing a PR for it...

Also, can you add these to FEATURES.md?

👍

Looks good!
In the future, I want to convert these types to userdata to make them more opaque and line up with Roblox more closely.


Update documentation

[x] This contribution adheres to CONTRIBUTING.md.

What does this Pull Request accomplish?
Update the user documentation for SLSC Switch and Routing and Faulting Custom Devices.
Why should this Pull Request be merged?
Use current content which supersedes existing content.
What testing has been done?
Review dev branch documentation in browser.

Including screenshots of the examples in the documentation feels weird to me. I'm not asking you to remove them, but we should consider whether this duplication makes sense.

[ ] Include rebuilt CHM


caching vault object for entire run and closing sockets when done

This change requires the wf_master version of vault with the exposed 'shutdown' function on the vault client, and introduces a reliance on the debouncer gem.
The result of this change is a single Vault client object per puppet run and the explicit shutdown of opened sockets if there is a gap in hiera lookups for 10 seconds (a new connection will be established if more lookup occur).
The resolves an issue where each hiera lookup to vault was opening a socket which never closed.

The change required has now been merged into the vault gem.


Can't extract ogg files with unityextract

Extracting ogg files with unityextract from unity3d files keeps giving me this error:
Traceback (most recent call last):
  File "unityextract", line 159, in <module>
    main()
  File "unityextract", line 155, in main
    exit(app.run())
  File "unityextract", line 57, in run
    self.handle_asset(asset)
  File "unityextract", line 97, in handle_asset
    samples = extract_audioclip_samples(d)
  File "C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\lib\site-packages\unitypack\utils.py", line 37, in extract_audioclip_samples
    sample = af.rebuild_sample(sample)
  File "C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\lib\site-packages\fsb5\__init__.py", line 212, in rebuild_sample
    from . import vorbis
  File "C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\lib\site-packages\fsb5\vorbis.py", line 12, in <module>
    vorbis = load_lib('vorbis')
  File "C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\lib\site-packages\fsb5\utils.py", line 76, in load_lib
    raise LibraryNotFoundException('Could not load the library %r' % (names[0]))
fsb5.utils.LibraryNotFoundException: Could not load the library 'vorbis'

Windows 10 64 bit version 1803
unityextract and fsb5 installed with pip and up to date

I have put the libogg and libvorbis provided by fsb5 on the following places and so far none of them worked or changed the error:

C:\Windows\System32
Where the unityextract script is C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\Scripts
Where unitypack got installed C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\Lib\site-packages\unitypack
Where fsb5 got installed C:\Users\Lykrast\AppData\Local\Programs\Python\Python36-32\Lib\site-packages\fsb5

I was facing the same issue. I figured I'd see if it works on Windows 7, so I fired up a VM. As soon as I set everything up and started the script, I got a message box telling me that MSVCRT120.dll was missing from the system. So I went ahead and downloaded and installed the Visual C++ Redistributable Packages for Visual Studio 2013 pack that contains said DLL, and sure enough, it worked! Then I went back to my Windows 10, installed the redistributables there as well, success. So if you get this error despite having libvorbis.dll in the right place, chances are you're also missing this pack. Just make sure you get the right version for your Python -- if you have the 32-bit version (which seems to be the case for you), get the 32-bit version of the redistributables, even if your operating system itself is 64-bit.

This didn't work for me. I've copied the dll mentioned here to more or less the same places as Lykrast above, but the script still can't find them.
I've also installed the Visual C++ Redistributable linked above.
$ ./bin/unityextract --audio -o out/audio2 /d/Games/Hearthstone/Data/Win/{rad_base,rad_enus,actors,cards,cardxml,dbf,expansionmusic,heromusic,gameobjects,legendary,missionsound,otherminionsound,playsound,premiummaterial,scriptableobject,shared,sounds,spell}*.unity3d
Traceback (most recent call last):
  File "./bin/unityextract", line 159, in <module>
    main()
  File "./bin/unityextract", line 155, in main
    exit(app.run())
  File "./bin/unityextract", line 57, in run
    self.handle_asset(asset)
  File "./bin/unityextract", line 97, in handle_asset
    samples = extract_audioclip_samples(d)
  File "C:\Users\Daedin\AppData\Local\Programs\Python\Python37\lib\site-packages\unitypack\utils.py", line 37, in extract_audioclip_samples
    sample = af.rebuild_sample(sample)
  File "C:\Users\Daedin\AppData\Local\Programs\Python\Python37\lib\site-packages\fsb5\__init__.py", line 212, in rebuild_sample
    from . import vorbis
  File "C:\Users\Daedin\AppData\Local\Programs\Python\Python37\lib\site-packages\fsb5\vorbis.py", line 12, in <module>
    vorbis = load_lib('vorbis')
  File "C:\Users\Daedin\AppData\Local\Programs\Python\Python37\lib\site-packages\fsb5\utils.py", line 76, in load_lib
    raise LibraryNotFoundException('Could not load the library %r' % (names[0]))
fsb5.utils.LibraryNotFoundException: Could not load the library 'vorbis'

Still looking, I'll post something here if I ever get it to work :)

Using ProcessMonitor I found out where the script was looking for the libs:

Please also note that it's looking for vorbis.dll, and not libvorbis.
So copying the libvorbis.dll to my user's bin folder and renaming it to vorbis.dll seemed to work


Training in new languages

I want training in difference language, What part I have to modify like data, tokenizer, vocabulary set ...  ???
Thank you for your response.

Hi there, sorry for the terrible long delay in responding. :(
To train a new language, you mostly have to prepare new texts. The tokenizer if its a Latin characterset should be okay, but if it's another you may have to modify the tokenizer, which operates mainly on white-space, however any tokenizer supported by ntlk will be a minimal change.   The vocabulary is derived from the training text, so that should be fine.
Apologies again for the tardy response. And if you have a language specific question, please feel free to add it here or make a new issue.


Delete the words before the cursor CTRL+W

Is your feature request related to a problem? Please describe.
default for bash behavior when a CTRL+W  pressed - delete the words before the cursor
Describe the solution you'd like
In ClapSearchLine,  CTRL+W must delete the words before the cursor

CTRL-W works for neovim by default. For vim, you can vote the feature request in https://github.com/vim/vim/issues/5639 as I don't have to a plan to support it inside the plugin.


[0.21] Use eventing from operator 0.21

Signed-off-by: Matthias Wessendorf<EMAIL_ADDRESS>

/test all

/test ?