Vimeo no longer can find “source” format

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that yt-dlp is broken on a supported site
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and I'm willing to share it if required

Region
United States/Canada
Provide a description that is worded well enough to be understood
yt-dlp seems to no longer be finding the “source” format for Vimeo videos, even ones that were previously working.
These links for a fact all had the source format a week ago.
https://vimeo.com/928483972
https://vimeo.com/930776087
https://vimeo.com/933308863
https://vimeo.com/936307221
https://vimeo.com/939127773
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
yt-dlp -vUF "https://vimeo.com/928483972"
[debug] Command-line config: ['-vUF', 'https://vimeo.com/928483972']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp-nightly-builds [5904853ae] (zip)
[debug] Python 3.9.19 (CPython x86_64 64bit) - Linux-5.15.0-105-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35)
[debug] exe versions: ffmpeg N-67374-g4c422de1db-static (setts), ffprobe N-62475-g130d19bf20-static, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.0.9, certifi-2023.11.17, requests-2.31.0, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-1.26.5, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, websockets
[debug] Loaded 1810 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp-nightly-builds/releases/latest
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp-nightly-builds
yt-dlp is up to date<EMAIL_ADDRESS>from yt-dlp/yt-dlp-nightly-builds)
[vimeo] Extracting URL: https://vimeo.com/928483972
[vimeo] 928483972: Downloading webpage
[vimeo] 928483972: Downloading JSON metadata
[vimeo] 928483972: Downloading JSON metadata
[vimeo] 928483972: Downloading jwt token
[vimeo] 928483972: Downloading JSON metadata
[vimeo] 928483972: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 928483972: Downloading akfire_interconnect_quic m3u8 information
[vimeo] 928483972: Downloading fastly_skyfire m3u8 information
[vimeo] 928483972: Downloading fastly_skyfire m3u8 information
[vimeo] 928483972: Downloading akfire_interconnect_quic MPD information
[vimeo] 928483972: Downloading akfire_interconnect_quic MPD information
[vimeo] 928483972: Downloading fastly_skyfire MPD information
[vimeo] 928483972: Downloading fastly_skyfire MPD information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, lang, vcodec:vp9.2(10), channels, acodec, size, br, asr, proto, vext, aext, hasaud, id
[info] Available formats for 928483972:
ID                                                   EXT RESOLUTION FPS │   FILESIZE   TBR PROTO │ VCODEC        VBR ACODEC      ABR ASR MORE INFO
─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
hls-akfire_interconnect_quic_sep-audio-high-Original mp4 audio only     │                  m3u8  │ audio only        unknown             Original
hls-fastly_skyfire_sep-audio-high-Original           mp4 audio only     │                  m3u8  │ audio only        unknown             Original
dash-akfire_interconnect_quic_sep-audio-cebbcd02     m4a audio only     │ ~ 64.39MiB  195k dash  │ audio only        mp4a.40.2  195k 48k DASH audio, m4a_dash
dash-fastly_skyfire_sep-audio-cebbcd02               m4a audio only     │ ~ 64.39MiB  195k dash  │ audio only        mp4a.40.2  195k 48k DASH audio, m4a_dash
dash-akfire_interconnect_quic_sep-audio-941856c8     m4a audio only     │ ~ 22.78MiB   69k dash  │ audio only        opus        69k 48k DASH audio, m4a_dash
dash-fastly_skyfire_sep-audio-941856c8               m4a audio only     │ ~ 22.78MiB   69k dash  │ audio only        opus        69k 48k DASH audio, m4a_dash
dash-akfire_interconnect_quic_sep-audio-57ce17ce     m4a audio only     │ ~ 33.68MiB  102k dash  │ audio only        opus       102k 48k DASH audio, m4a_dash
dash-fastly_skyfire_sep-audio-57ce17ce               m4a audio only     │ ~ 33.68MiB  102k dash  │ audio only        opus       102k 48k DASH audio, m4a_dash
dash-akfire_interconnect_quic-video-63f61377         mp4 426x240        │ ~111.28MiB  337k dash  │ avc1.640015  337k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-63f61377     mp4 426x240        │ ~111.28MiB  337k dash  │ avc1.640015  337k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-63f61377                   mp4 426x240        │ ~111.28MiB  337k dash  │ avc1.640015  337k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-63f61377               mp4 426x240        │ ~111.28MiB  337k dash  │ avc1.640015  337k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-231                     mp4 426x240     30 │ ~ 76.28MiB  231k m3u8  │ avc1.640015  231k video only
hls-fastly_skyfire-231                               mp4 426x240     30 │ ~ 76.28MiB  231k m3u8  │ avc1.640015  231k video only
hls-akfire_interconnect_quic_sep-425                 mp4 426x240     30 │ ~140.34MiB  425k m3u8  │ avc1.640015  425k video only
hls-fastly_skyfire_sep-425                           mp4 426x240     30 │ ~140.34MiB  425k m3u8  │ avc1.640015  425k video only
dash-akfire_interconnect_quic-video-be5cbb1b         mp4 640x360        │ ~246.01MiB  745k dash  │ avc1.64001E  745k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-be5cbb1b     mp4 640x360        │ ~246.01MiB  745k dash  │ avc1.64001E  745k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-be5cbb1b                   mp4 640x360        │ ~246.01MiB  745k dash  │ avc1.64001E  745k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-be5cbb1b               mp4 640x360        │ ~246.01MiB  745k dash  │ avc1.64001E  745k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-473                     mp4 640x360     30 │ ~156.19MiB  473k m3u8  │ avc1.64001E  473k video only
hls-fastly_skyfire-473                               mp4 640x360     30 │ ~156.19MiB  473k m3u8  │ avc1.64001E  473k video only
hls-akfire_interconnect_quic_sep-667                 mp4 640x360     30 │ ~220.25MiB  667k m3u8  │ avc1.64001E  667k video only
hls-fastly_skyfire_sep-667                           mp4 640x360     30 │ ~220.25MiB  667k m3u8  │ avc1.64001E  667k video only
dash-akfire_interconnect_quic-video-6017c2bd         mp4 960x540        │ ~508.52MiB 1540k dash  │ avc1.64001F 1540k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-6017c2bd     mp4 960x540        │ ~508.52MiB 1540k dash  │ avc1.64001F 1540k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-6017c2bd                   mp4 960x540        │ ~508.52MiB 1540k dash  │ avc1.64001F 1540k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-6017c2bd               mp4 960x540        │ ~508.52MiB 1540k dash  │ avc1.64001F 1540k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-1025                    mp4 960x540     30 │ ~338.46MiB 1025k m3u8  │ avc1.64001F 1025k video only
hls-fastly_skyfire-1025                              mp4 960x540     30 │ ~338.46MiB 1025k m3u8  │ avc1.64001F 1025k video only
hls-akfire_interconnect_quic_sep-1219                mp4 960x540     30 │ ~402.53MiB 1219k m3u8  │ avc1.64001F 1219k video only
hls-fastly_skyfire_sep-1219                          mp4 960x540     30 │ ~402.53MiB 1219k m3u8  │ avc1.64001F 1219k video only
dash-akfire_interconnect_quic-video-0bf68e30         mp4 1280x720       │ ~973.46MiB 2948k dash  │ avc1.640020 2948k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-0bf68e30     mp4 1280x720       │ ~973.46MiB 2948k dash  │ avc1.640020 2948k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-0bf68e30                   mp4 1280x720       │ ~973.46MiB 2948k dash  │ avc1.640020 2948k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-0bf68e30               mp4 1280x720       │ ~973.46MiB 2948k dash  │ avc1.640020 2948k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-1869                    mp4 1280x720    30 │ ~617.16MiB 1869k m3u8  │ avc1.640020 1869k video only
hls-fastly_skyfire-1869                              mp4 1280x720    30 │ ~617.16MiB 1869k m3u8  │ avc1.640020 1869k video only
hls-akfire_interconnect_quic_sep-2063                mp4 1280x720    30 │ ~681.22MiB 2063k m3u8  │ avc1.640020 2063k video only
hls-fastly_skyfire_sep-2063                          mp4 1280x720    30 │ ~681.22MiB 2063k m3u8  │ avc1.640020 2063k video only
dash-akfire_interconnect_quic-video-b7984d71         mp4 1920x1080      │ ~  1.90GiB 5903k dash  │ avc1.64002A 5903k video only          DASH video, mp4_dash
dash-akfire_interconnect_quic_sep-video-b7984d71     mp4 1920x1080      │ ~  1.90GiB 5903k dash  │ avc1.64002A 5903k video only          DASH video, mp4_dash
dash-fastly_skyfire-video-b7984d71                   mp4 1920x1080      │ ~  1.90GiB 5903k dash  │ avc1.64002A 5903k video only          DASH video, mp4_dash
dash-fastly_skyfire_sep-video-b7984d71               mp4 1920x1080      │ ~  1.90GiB 5903k dash  │ avc1.64002A 5903k video only          DASH video, mp4_dash
hls-akfire_interconnect_quic-4971                    mp4 1920x1080   30 │ ~  1.60GiB 4971k m3u8  │ avc1.64002A 4971k video only
hls-fastly_skyfire-4971                              mp4 1920x1080   30 │ ~  1.60GiB 4971k m3u8  │ avc1.64002A 4971k video only
hls-akfire_interconnect_quic_sep-5165                mp4 1920x1080   30 │ ~  1.67GiB 5165k m3u8  │ avc1.64002A 5165k video only
hls-fastly_skyfire_sep-5165                          mp4 1920x1080   30 │ ~  1.67GiB 5165k m3u8  │ avc1.64002A 5165k video only

I have found something strange.
As a random test, I logged in to Vimeo and dumped my cookies.
Even though the videos are public, with cookies, source appears as a format.
Remove the cookies and back to no source format.

I also have this problem. Even if I have updated the yt-dlp nightly version to 2<IP_ADDRESS>715, the source cannot be displayed. Have you found a solution?

The only solution that I have found so far was to login to my free account and then use --cookies.
You probably could use --cookies-from-browser but I didn't want to do all that for a few downloads.

Thank you very much for your reply！ I would like to ask you how you use cookies. I'm so sorrythat I don't understand such a simple question. I may need to trouble you to explain it a little bit.♥

Basically you just need something like "Open Cookies.txt" for Chrome/Edge or "cookies.txt" for Firefox.
Then after you login to Vimeo.com after making an account or logging in to am account, click the addon and save the text.
You then can add --cookies cookie.txt to yt-dlp and it will send that info along with the request.
To make it slightly easier, you could try logging in to Vimeo.com then just doing --cookies-from-browser chrome (or Firefox & others) and often it can load them directly from the browser, saving the txt file step.

Do you have any reason to believe why source formats should still be available without logging in?
From the Vimeo documentation:

You must be logged in to download a source file.

This is also reflected on the website, as clicking on the download button without being logged in no longer shows the source file.

Thanks again for your reply. I tried your method. For example: https://vimeo.com/936640372
But the downloaded file is still a 516M file. There is no source. Can you use the method you just mentioned to download a source file of more than 1G?

Do you have any reason to believe why source formats should still be available without logging in?
From the Vimeo documentation:

You must be logged in to download a source file.

This is also reflected on the website, as clicking on the download button without being logged in no longer shows the source file.

Thanks again for the info!
I didn't see that part of the website.
For some reason, yt-dlp for at least 2 weeks was able to grab Original without logging in but now it definitely does require a login just like you said even on the website.

If you look at an archived version of that page, you can see that they only changed this recently https://web.archive.org/web/20240417180036/https://help.vimeo.com/hc/en-us/articles/12426502581265-How-to-download-a-video
Unless there is say some other downloader that can still grab source files without logging in, I don't see much point in keeping this issue open.
It used to be possible. Vimeo changed that. Unfortunately, nothing we can do about it.

Basically you just need something like "Open Cookies.txt" for Chrome/Edge or "cookies.txt" for Firefox.
Then after you login to Vimeo.com after making an account or logging in to am account, click the addon and save the text.
You then can add --cookies cookie.txt to yt-dlp and it will send that info along with the request.
To make it slightly easier, you could try logging in to Vimeo.com then just doing --cookies-from-browser chrome (or Firefox & others) and often it can load them directly from the browser, saving the txt file step.

So sorry. I obtained cookies. txt through the plugin, but what command should I enter in the yt-dlp interface to add this txt to yt-dlp?
May I ask if you can provide the instruction format? Can you provide an example to make it more intuitive? Thank you very much!

Basically you just need something like "Open Cookies.txt" for Chrome/Edge or "cookies.txt" for Firefox.
Then after you login to Vimeo.com after making an account or logging in to am account, click the addon and save the text.
You then can add --cookies cookie.txt to yt-dlp and it will send that info along with the request.
To make it slightly easier, you could try logging in to Vimeo.com then just doing --cookies-from-browser chrome (or Firefox & others) and often it can load them directly from the browser, saving the txt file step.

Thanks! I have received advice from experts through Discord and successfully downloaded the source format.


Design - button same width

Can the buttons for New blah be the same width please? they look ugly as they are
By Julian

Fixed new design


[error] TypeError: Cannot read properties of undefined (reading 'code')

Command
new
Is this a regression?

[X] Yes, this behavior used to work in the previous version

The previous version in which this bug was not present was
no idea
Description
ng new is failing with a TypeError
Minimal Reproduction
ng new demo
Exception or Error
[error] TypeError: Cannot read properties of undefined (reading 'code')
    at addFormats (/home/yadav/.config/yarn/global/node_modules/ajv-formats/dist/index.js:30:26)
    at formatsPlugin (/home/yadav/.config/yarn/global/node_modules/ajv-formats/dist/index.js:15:5)
    at new CoreSchemaRegistry (/home/yadav/.config/yarn/global/node_modules/@angular/cli/node_modules/@angular-devkit/core/src/json/schema/registry.js:100:35)
    at new BaseWorkflow (/home/yadav/.config/yarn/global/node_modules/@angular/cli/node_modules/@angular-devkit/schematics/src/workflow/base.js:47:30)
    at new NodeWorkflow (/home/yadav/.config/yarn/global/node_modules/@angular/cli/node_modules/@angular-devkit/schematics/tools/workflow/node-workflow.js:33:9)
    at NewCommandModule.getOrCreateWorkflowForBuilder (/home/yadav/.config/yarn/global/node_modules/@angular/cli/src/command-builder/schematics-command-module.js:74:16)
    at NewCommandModule.value (/home/yadav/.config/yarn/global/node_modules/@angular/cli/src/utilities/memoize.js:37:43)
    at NewCommandModule.getCollectionFromConfig (/home/yadav/.config/yarn/global/node_modules/@angular/cli/src/commands/new/cli.js:64:35)
    at async NewCommandModule.builder (/home/yadav/.config/yarn/global/node_modules/@angular/cli/src/commands/new/cli.js:32:15)
    at async runCommand (/home/yadav/.config/yarn/global/node_modules/@angular/cli/src/command-builder/command-runner.js:76:5)

Your Environment
$ node -v
v20.15.0
[Sat Jul 06 14:02:22][yadav@source]:~
$ ng version

     _                      _                 ____ _     ___
    / \   _ __   __ _ _   _| | __ _ _ __     / ___| |   |_ _|
   / △ \ | '_ \ / _` | | | | |/ _` | '__|   | |   | |    | |
  / ___ \| | | | (_| | |_| | | (_| | |      | |___| |___ | |
 /_/   \_\_| |_|\__, |\__,_|_|\__,_|_|       \____|_____|___|
                |___/

Angular CLI: 18.0.7
Node: 20.15.0
Package Manager: yarn 1.22.22
OS: linux x64

Angular:
...

Package                      Version
------------------------------------------------------
@angular-devkit/architect    0.1800.7 (cli-only)
@angular-devkit/core         18.0.2 (cli-only)
@angular-devkit/schematics   18.0.7 (cli-only)
@schematics/angular          18.0.7 (cli-only)

System Info

Operating System: openSUSE Tumbleweed 20240704
KDE Plasma Version: 6.1.2
KDE Frameworks Version: 6.3.0
Qt Version: 6.7.2
Kernel Version: 6.9.7-1-default (64-bit)
Graphics Platform: X11
Processors: 24 × AMD Ryzen 9 5900X 12-Core Processor
Memory: 62.7 GiB of RAM
Graphics Processor: NVIDIA GeForce RTX 3080/PCIe/SSE2
Manufacturer: Micro-Star International Co., Ltd.
Product Name: MS-7A38
System Version: 8.0

Anything else relevant?
No response

I reinstalled ng cli and the problem seems to have gone.
I  installed using npm this time rather than yarn, not sure it something get mixed up.


Improve istio-ingressgateway resource requests and maxReplicas

How to categorize this PR?

/area networking
/kind enhancement
What this PR does / why we need it:
This PR changes the CPU and memory resource requests of the istio-proxy container of the istio-ingressgateway deployment to 300m and 600Mi, respectfully. Additionally, max replicas for the istio-ingressgateway deployed for single zones is increased from 5 to 9. The max replicas for multiple zones is increased from 4 to 6 per zone.
I have kept the ratio of memory limits to memory requests to be 8, so the new memory limits for the istio-proxy container are 4800Mi
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
This change is motivated by the current resource usage of istio-ingressgateway on our landscapes.
/cc @ScheererJ @DockToFuture
Release note:

The CPU and memory resource requests of the `istio-proxy` container for the `istio-ingressgateway` deployment have been changed to `300m` and `600Mi`, respectively.
The HPA `maxReplicas` for the `istio-ingressgateway` deployment have been increased from 5 to 9. When deployed for multiple zones, the `maxReplicas` are increased from 4 to 6 per zone.

/hold
@ialidzhikov Any feedback?


Hotfix lcps parser

Dateparser output needs to be converted to str else the merge generates duplicates.
There's a lot of duplicates in lcps_ic.csv at the moment. df_lcps.drop_duplicates(inplace=True)should take care of the duplicates. I'd recommend removing that line after running it once.

Thanks. Locale wasn't found in Actions. Unfortunately, I wasn't available to merge this yesterday.


Magiclink is not urlsafe

the = at the end gets encoded into %3D on some platforms in the magiclink email
this doesnt get decoded correctly when signing in with the magiclink

we need to use safebase64 conversion or urlencode/decode the magiclink

Definition of Done

magiclink should be urlsafe

Checked on QA environment
Reproduced on desktop and iPhone X // iOS 12.4
https://www.screencast.com/t/oej6liUc5oi8
Will be checked after updating QA version

Checked on QA and eWallet v0.13.0
Work as per requirement.
The magic link is navigated to wallet if = changed to %3D at the end of the link
Video:  https://www.dropbox.com/s/eo2olie00plokc0/2020-01-08_10-46-36.mp4?dl=0


Cleaned up code, README, and added a package.json

Yay!

@MatejMecka Check the new PR (#4). I can't push to this one anymore -- I deleted the repo.


Warn/validate commands with optional arguments before non-optional

As described in #489, a command that declares an optional @Argument before a non-optional @Argument won't ever allow a single-argument call. It would be nice if ArgumentParser provided a validation warning / error so that authors could move to a different design.

I would consider this a logic bug and be a reasonable cause to fatalError or preconditionFailure.


1.0.0-beta3 plain redirect

Hi!
How can i specify plain redirect for 1.0.0-beta3 router?
I'm tried to pass objects like this:
{
    "from": "/requests",
    "to": "/requests/all"
}

to "childRoutes" prop of root route, but it didnt work

+1 I want this feature as well

+1

+1

+1

For now you can get this working with:
{
	path: '/requests',
	onEnter: (nextState, transition) => {
		transition.to(
			'/requests/all'
		);
	}
}

Thanks !

closing in favor of discussion on #1736


Re-enable postgresql-typed 0.5.1

I believe this problem started when postgresql-binary 0.12.1 was released (2 days ago).  (postgresql-typed 0.5.0 now has an upper bound constraint on postgresql-binary of 0.10.)  Earlier versions of postgresql-typed have the same issue, so I don't believe restricting 0.5.0 will fix the problem.  The options seem to be limiting postgresql-binary in stackage or removing postgresql-typed.  I've here removed postgresql-typed, but there's also an argument for restricting postgresql-binary < 0.12.
I'll also work on compatibility with the new postgresql-binary.  See dylex/postgresql-typed#4.

postgresql-typed 0.5.1 is now released and compatible with latest postgresql-binary.  CI build failure seems to be unrelated.

Thanks!


feat(electric, satellite): Add support for timestamp and timestamptz column types

Closes VAX-818.

So you think we need to serialise the values in the DAL?

Sorry, VSCode Github plugin submitted the review without the top comment
The PR looks good to me! I don't have any issues with timestamp implementation and details, but some auxiallary questions. The "no migration" problem seems quite important


multicast opt dropped in v2 plugin

docker plugin install bboreham/weave2:latest
[...]

docker network create --driver=bboreham/weave2:latest --opt works.weave.multicast=true wnet69
m1eyxeah2jky7y2cq92yysamh

meanwhile, stracing the plugin:
luke@beast:~$ sudo strace -s 4096 -f -p 21170
[...]
[pid 21183] read(6, "POST /NetworkDriver.AllocateNetwork HTTP/1.1\r\nHost: \r\nUser-Agent: Go-http-client/1.1\r\nContent-Length: 179\r\nAccept: application/vnd.docker.plugins.v1.2+json\r\n\r\n{\"NetworkID\":\"m1eyxeah2jky7y2cq92yysamh\",\"Options\":{\"works.weave.multicast\":\"true\"},\"IPv4Data\":[{\"AddressSpace\":\"\",\"Gateway\":\"<IP_ADDRESS>/24\",\"Pool\":\"<IP_ADDRESS>/24\"}],\"IPv6Data\":null}\n", 4096) = 338
[pid 21173] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid 21183] write(2, "INFO: 2017/02/24 10:56:49.476811 [net] NetworkAllocate m1eyxeah2jky7y2cq92yysamh\n", 81 <unfinished ...>
[pid 21173] <... select resumed> )      = 0 (Timeout)
[pid 21183] <... write resumed> )       = 81
[pid 21173] select(0, NULL, NULL, NULL, {0, 20} <unfinished ...>
[pid 21183] write(6, "HTTP/1.1 200 OK\r\nDate: Fri, 24 Feb 2017 10:56:49 GMT\r\nContent-Length: 5\r\nContent-Type: text/plain; charset=utf-8\r\n\r\nnull\n", 121) = 121
[...]

note \"Options\":{\"works.weave.multicast\":\"true\"}
yet:
root@beast:/var/run/docker/plugins# docker network inspect wnet69
[
    {
        "Name": "wnet69",
        "Id": "m1eyxeah2jky7y2cq92yysamh",
        "Created": "0001-01-01T00:00:00Z",
        "Scope": "swarm",
        "Driver": "bboreham/weave2:latest",
        "EnableIPv6": false,
        "IPAM": {
            "Driver": "default",
            "Options": null,
            "Config": []
        },
        "Internal": false,
        "Attachable": false,
        "Containers": null,
        "Options": null, # <--
        "Labels": null
    }
]

and multicast doesn't work (tested with mlist) on containers connected to this network

The bug was that NetworkAllocate (run on Swarm master nodes) returned empty options which meant that:

Empty options were passed to CreateNetwork (run on Swarm worker nodes).
NetworkInfo returned no multicast option when joining an endpoint.

Fixed by #2727.

hi,
I have tried to create weave multicast network in docker swarm using weave V2 plugin. I have executed following command:

sudo docker network create --driver=weaveworks/net-plugin:latest_release --attachable --opt works.weave.multicast=true mynetwork

Then I have tried to attach containers to this network:
sudo docker run -it --network=mynetwork cazcade/weave-multicast-test (sender)
sudo docker run -it --network=mynetwork cazcade/weave-multicast-test (receiver)
And then started typing message in sender docker instance, but nothing is received. Is the multicast setup right? Do I need to do anymore configuartion changes?
Regards,
Kaustuv


Fix docs failing tag

Documentation is actually properly generated, but the tag shows the documentation as failing.

Fixed in #275


Assignments layout (WIP)

See #4558

A bit of functionality fxes sneaked in here, too:

permission fix for non-admin users
fix one-vote polls (pollmethod: 'votes')
The candidate list will now be filtered

@GabrielInTheWorld @FinnStutzenstein  The code reused from 'List of speakers' seems to introduce quite a performance drop right now (with my filteredCandidates instead of a full availableCandidates). Maybe it's something quite obvious (I introduced this part in https://github.com/OpenSlides/OpenSlides/pull/4577/commits/2101478266273a173cba795074814f5f154f9177)

Tested. Does not seem to break anything and the most stuff seems to work fine.


Some character sheets do not open

Hi - I noticed some character sheets do not open correctly in my setup.
The one of Alexander Grun from Ubersreik adventures, for example, refuses to open, as do some others in "Bait and Witch".
A PC's one also stopped opening - I am attaching two example json files. Downloads.zip
I am running 0.7.9 under docker, with some add-on modules, so if you need a list of the modules enabled I can provide it.

What system version are you on?

I updated all yesterday, so should be 3.4.1
(By the way, the job you're doing with WFRP is totally GREAT)

Thanks! But please do verify your system version and ensure its 3.4.1

I cannot even begin to say how sorry I am, but I always thought that updating all the modules also updated the game systems!!! So much that I had NEVER noticed the "Game Systems" tab!!! I was running a tremendously old version! I updated everything and now it works fine.
I am horribly sorry for the waste of your time. Of course, the issue is totally invalid, and I closed it.
Thanks for your patience, and again, truly superb work!!


Add capability to handle replication requests in vcr

This is part2 of the two part changes to enable two way replication. In a nutshell this change add capability in vcr to handle replication requests.
NOTE: Atleast 48 of the 60 files changed, have changes only in import statement for ServerErrorCode, as the class was moved from ambry-commons to ambry-api as part of this change.
The main changes are:

Refactor

Refactor StorageManager to create interface StoreManager, which is implemented by StorageManager.
Rename CloudBackupManager to VcrReplicationManager. Add StoreManager support for bookkeeping of cloudblobstores that a vcrserver is responsible for.
Move ErrorMapping and ServerMetrics classes to ambry-commons

Create

CloudStorageManager to manage cloudblobstores of a vcr server.
VcrRequests as a subclass of AmbryRequests to handle replication requests.
Fix tests.

Codecov Report

Merging #1262 into master will decrease coverage by 0.05%.
The diff coverage is 86.02%.

@@             Coverage Diff              @@
##             master    #1262      +/-   ##
============================================
- Coverage      72.4%   72.35%   -0.06%
- Complexity     6163     6172       +9
============================================
  Files           444      447       +3
  Lines         35352    35400      +48
  Branches       4491     4495       +4
============================================
+ Hits          25598    25614      +16
- Misses         8582     8613      +31
- Partials       1172     1173       +1

Impacted Files
Coverage Δ
Complexity Δ

...in/java/com.github.ambry.store/StorageManager.java
88.73% <ø> (ø)
47 <0> (ø)
:arrow_down:

...in/java/com.github.ambry.commons/ErrorMapping.java
80% <ø> (ø)
3 <0> (?)

...n/java/com.github.ambry.server/RequestHandler.java
83.33% <ø> (-3.85%)
4 <0> (ø)

.../src/main/java/com.github.ambry.cloud/VcrMain.java
0% <0%> (ø)
0 <0> (ø)
:arrow_down:

...in/java/com.github.ambry.server/AmbryRequests.java
88.26% <100%> (+0.01%)
120 <1> (+1)
:arrow_up:

...main/java/com.github.ambry.server/AmbryServer.java
76.92% <100%> (+0.17%)
6 <0> (ø)
:arrow_down:

...c/main/java/com.github.ambry.cloud/VcrMetrics.java
100% <100%> (ø)
2 <0> (ø)
:arrow_down:

...n/java/com.github.ambry.commons/ServerMetrics.java
100% <100%> (ø)
13 <1> (?)

...va/com.github.ambry.replication/ReplicaThread.java
87.33% <100%> (+0.18%)
91 <0> (ø)
:arrow_down:

.../main/java/com.github.ambry.cloud/VcrRequests.java
21.42% <21.42%> (ø)
1 <1> (?)

... and 17 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a690862...96e229a. Read the comment docs.

@ankagrawal let's coordinate this PR with #1259 . I also made some changes in replication manager, storage manager and AmbryRequests.

Sure. Lets sync up about it this afternoon after team meeting.
On Sep 16, 2019, at 10:20 AM, Yingyi Zhang <notifications<EMAIL_ADDRESS>wrote:
@ankagrawalhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fankagrawal&data=02|01|ankuagrawal%40linkedin.com|d096ed3236e148058da008d73aca35b6|72f988bf86f141af91ab2d7cd011db47|1|0|637042512471622869&sdata=DOgvrnb8Sf%2B7rp7M72DH1AxY5xqPsY%2FckexVN1HLgkM%3D&reserved=0 let's coordinate this PR with #1259https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Flinkedin%2Fambry%2Fpull%2F1259&data=02|01|ankuagrawal%40linkedin.com|d096ed3236e148058da008d73aca35b6|72f988bf86f141af91ab2d7cd011db47|1|0|637042512471632864&sdata=xYHCAoqPRBIWnb4DE9Ep4bsjYxARIjogf4U4PCi5Efc%3D&reserved=0 . I also made some changes in replication manager, storage manager and AmbryRequests.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Flinkedin%2Fambry%2Fpull%2F1262%3Femail_source%3Dnotifications%26email_token%3DAAK3EBS6YAIL2JHJQA5B4R3QJ656LA5CNFSM4IW7ZFN2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6Z365Q%23issuecomment-531873654&data=02|01|ankuagrawal%40linkedin.com|d096ed3236e148058da008d73aca35b6|72f988bf86f141af91ab2d7cd011db47|1|0|637042512471632864&sdata=rvnY2Vm0VLzjb3g5vNeb4rLnS9VZ6krO2%2FXMAtGo%2Fc8%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAAK3EBXK6OOQFCNOEYC3CATQJ656LANCNFSM4IW7ZFNQ&data=02|01|ankuagrawal%40linkedin.com|d096ed3236e148058da008d73aca35b6|72f988bf86f141af91ab2d7cd011db47|1|0|637042512471632864&sdata=s4zNr9Ak39efXmbl4FcZPh87WxeKTvt5DXS49AieKZQ%3D&reserved=0.

One of the vcr tests failed. Please take a look.

One unit test in VcrRecoveryTest failed. Let's fix it first

One of the integration tests seemed to get an NPE:
com.github.ambry.server.ServerSSLTest > endToEndCloudBackupTest[1] FAILED
    java.lang.NullPointerException
        at com.github.ambry.server.MockNotificationSystem.awaitBlobCreations(MockCluster.java:551)
        at com.github.ambry.server.ServerTestUtil.endToEndCloudBackupTest(ServerTestUtil.java:596)
        at com.github.ambry.server.ServerSSLTest.endToEndCloudBackupTest(ServerSSLTest.java:142)


Git changes in lines take a while when switching tabs

Issue Type: Performance Issue
When dealing with a large file with multiple changes (not yet staged), it takes a while to load the changes (the one that lets you "jump to next change", the blue, green, and red lines by the line numbers). Then switch to a different tab, and switch back. It will load (or find) the changes again, even if there weren't any changes, which is very slow when you have to switch between different tabs while working. I'm dealing with a project that has many .js files. I don't know if the changes are cached or not, but it also seems to wait for "Bracket Pair Colorizer" to finish coloring the brackets. I would want the changes to load before the colorizer. After testing it without the extension (and reloading), it does seem to load a little faster, but it still takes a while. Tested with all extensions disabled but it still takes a while to load the changes.

Have a large file (tried on 10k+ and 100k+ lines)
Add a few changes
Switch tab.
Switch back.
Wait for the changes to load.

VS Code version: Code 1.57.1 (507ce72a4466fbb27b715c3722558bb15afa9f48, 2021-06-17T13:28:07.755Z)
OS version: Windows_NT x64 10.0.19041
Restricted Mode: No

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-7300U CPU @ 2.60GHz (4 x 2712)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onrasterization: enabledskia_renderer: enabled_onvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
15.81GB (7.46GB free)

Process Argv
--crash-reporter-id 292e6dcb-8991-4c16-97cd-94a326b345e4

Screen Reader
no

VM
0%

Process Info
CPU %	Mem MB	   PID	Process
    2	   103	 16184	code main
    0	    62	  1196	   crashpad-handler
    2	   238	  1680	   gpu-process
    0	    66	  9636	   utility
    0	   576	 14880	   window (details.js - optc-db - Visual Studio Code)
    0	    15	  6416	     watcherService
    0	    11	 17344	       console-window-host (Windows internal process)
    0	  1404	 11576	     extensionHost
    0	   309	  9204	       electron_node tsserver.js
    0	   238	 20508	       electron_node tsserver.js
    0	    83	  4780	         electron_node typingsInstaller.js typesMap.js
    0	    80	 15752	     searchService
    1	    89	 19500	   shared-process
    0	    74	 14480	     ptyHost
    0	     4	 16744	       C:\WINDOWS\System32\cmd.exe
    0	     7	 18120	       console-window-host (Windows internal process)
    3	    79	 21488	   window (Issue Reporter)

Workspace Info
|  Window (details.js - optc-db - Visual Studio Code)
|    Folder (optc-db): 1311 files
|      File types: png(650) js(400) html(63) css(39) json(18) md(9) eot(6)
|                  svg(6) ttf(6) woff(6)
|      Conf files: package.json(4);

Extensions (23)

Extension
Author (truncated)
Version

pascal
ale
9.3.0

pascal-formatter
ale
2.5.0

vscode-intelephense-client
bme
1.7.1

bracket-pair-colorizer-2
Coe
0.2.1

go
gol
0.27.1

Lisp
mat
0.1.11

pretty-formatter
mbl
0.2.2

csharp
ms-
1.23.13

python
ms-
2021.8.1105858891

vscode-pylance
ms-
2021.8.1

jupyter
ms-
2021.6.999662501

remote-wsl
ms-
0.56.5

cpptools
ms-
1.5.1

debugger-for-edge
msj
1.0.15

java
red
0.80.0

vscode-hexdump
sle
1.8.1

vscodeintellicode
Vis
1.2.14

vscode-arduino
vsc
0.4.3

vscode-java-debug
vsc
0.35.0

vscode-java-dependency
vsc
0.18.6

vscode-java-pack
vsc
0.18.3

vscode-java-test
vsc
0.30.1

vscode-maven
vsc
0.32.2

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383cf:30185419
pythonvspyt602:30300191
vspor879:30202332
vspor708:30202333
vspor363:30204092
pythonvspyt639:30300192
pythontb:30283811
pythonvspyt551:30345470
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
pythondataviewer:30285071
pythonvsuse255:30340121
vscod805cf:30301675
pythonvspyt200:30340761
vscextlangct:30333562
binariesv615:30325510
vsccppwtct:30329789
pythonvssor306:30344512
bridge0708:30335490
vstre464cf:30350173
bridge0723:30351747

/gifPlease


@JamesButlerGDS This failed to build, as your fork of smart-answers is a bit behind.  I've opened a new PR at #3479.


Installing with admin account places settings.json in admin docs folder

Closed by https://github.com/schiltz3/ComInfo/releases/tag/v0.1.5


Problem rendering to renderTexture

Hi,
I have a nested container with some stuff in it. I'd like to render this container to a renderTexture.
My issue is best demonstrated with an example: http://jsfiddle.net/5mydwyxd/27/
For reasons I don't understand, container2 will render correctly, but not the nested container.

Let me chime in and note that the following seem to work ok:
    app.renderer.render(container, rt, true);

So culprit is probably around your attempt to "negate" transformation, which is probably (?) not what you wanted (see rendering code):
https://github.com/pixijs/pixi.js/blob/dev/src/core/renderers/webgl/WebGLRenderer.js#L278

@Patrick-Hammond @sergebat that's how things are cached in pixi. Yes, its not good. I'm refactoring it at the moment :) I'm working on new iteration of these API's right now.
If you want some kind of stability, don't use "transform" that is passed to renderer at all.

Yes, its not good. I'm refactoring it at the moment :)

And may I ask, sir, what will be the new behavior? :)
Because if you point to arbitrary object in the object tree and ask PIXI to render it in isolation, then what PIXI currently does is quite intuitive, no? "Ignore global transformation of this object, and just render it ignoring its parent transformation, then restore things as they were before".

Right now PIXI depends on side effect of "getLocalBounds()" that changes transforms in subtree.
Just don't copy behaviour in your code, and use "cacheAsBitmap" and "generateTexture()" directly.

Closing this since it seems answered.


Using CGO adds extra friction in certain build pipelines, in particular those using language-specific build frameworks like https://github.com/ko-build/ko (see https://ko.build/advanced/limitations/)
The change was mostly a drop-in replacement, except I had to add the MaxDBConn limit to address SQLite single-writer ~limitation~ design choice. This shouldn't be too controversial, except I don't have an explanation to why the original implementation didn't need it.

!bench

@vroldanbet Any idea if the time increase comes the connection limit or general perf difference in the two sqlite libraries? Looked at the non-CGO one and while it's supposed to be ~16% slower this here is a bit more.

Hey @cschleiden! Thanks for looking into this 🙏🏻
I'm not able to reproduce those numbers locally, and in fact the Go native implementation seems to be faster.  The [monoprocess PR](https://github.com/cschleiden/go-workflows/pull/240) may be a more sensible default

!bench

@vroldanbet good point about the polling interval. Merged master into the branch and benchmark looks good now. Going to merge once CI is green again! 🚀

Thanks for the quick turnaround @cschleiden! 💯 ❤


Add option to change model

Deoldify lists that there are currently 2 models - artistic and stable - it would be nice to have an option to choose which model to use in your gui, many thanks

I tried to do this, but I ran into a problem: it required too much memory to perform coloring with stable weights.

It looks like this problem has been solved. A new convolution algorithm and memory allocation using a different function will solve this problem. Work on stable weights has begun.
Originally posted by @GlebSBrykin in https://github.com/ColorfulSoft/DeOldify.NET/issues/13#issuecomment-1111362236

Done.


Upgrade to babel7

The size is slightly increased because of better helpers.

I'd rather wait for it to get out of beta first.

I'd say it's more stable than babel6. They support it only with critical stuff and didn't considered my critical stuff.


Foxy migration

This issue reports all repos involved in foxy migration and details the future requirements for each of them.
micro-ROS Foxy migration is compound of multiple repos with feature/foxy_migration branches that must be merged into a final foxy branch on each of them:

Repo
Pre-release branch
Comments
Release PR

micro-ROS/micro-ros-build
feature/foxy_migration

https://github.com/micro-ROS/micro-ros-build/pull/148

micro-ROS/rcl
feature/foxy_migration
Should be merged into ros2/rcl
https://github.com/micro-ROS/rcl/pull/9

micro-ROS/rcutils
feature/foxy_migration
Should be merged into ros2/rcutils
https://github.com/micro-ROS/rcutils/pull/8/

micro-ROS/rosidl_typesupport
feature/foxy_migration
Should be merged into ros2/rosidl_typesupport
https://github.com/micro-ROS/rosidl_typesupport/pull/1

micro-ROS-demos
feature/foxy_migration

https://github.com/micro-ROS/micro-ROS-demos/pull/25

micro-ROS/rosidl_typesupport_microxrcedds
feature/foxy_migration

https://github.com/micro-ROS/rosidl_typesupport_microxrcedds/pull/18

micro-ROS/rmw-microxrcedds
feature/foxy_migration

https://github.com/micro-ROS/rmw-microxrcedds/pull/70

micro-ROS/apps
feature/foxy_migration

https://github.com/micro-ROS/apps/pull/25

micro-ROS/freertos_apps
feature/foxy_migration

https://github.com/micro-ROS/freertos_apps/pull/13/files

micro-ROS/raspbian_apps
feature/foxy_migration

https://github.com/micro-ROS/raspbian_apps/pull/6

micro-ROS/micro-ROS-Agent
feature/foxy_migration
Check required changes
https://github.com/micro-ROS/micro-ROS-Agent/pull/30

micro-ROS/zephyr_apps
feature/foxy_migration

https://github.com/micro-ROS/zephyr_apps/pull/11

micro-ROS/ros_tracing
feature/foxy_migration

https://gitlab.com/micro-ROS/ros_tracing/ros2_tracing/-/merge_requests/192

micro-ROS/microros-github.io
Pending

Pending

micro-ROS/docker
feature/foxy_migration

https://github.com/micro-ROS/docker/pull/46

Before release every row must have a PR merged from feature/foxy_migration to foxy
Related PR, should be merged before release procedure:

[x] https://github.com/micro-ROS/rclc/pull/33
[x] https://github.com/micro-ROS/rclc/pull/32
[x] https://github.com/micro-ROS/zephyr_apps/pull/10
[x] https://github.com/micro-ROS/zephyr_apps/pull/9
[x] https://github.com/micro-ROS/zephyr_apps/pull/8
[x] https://github.com/micro-ROS/zephyr_apps/pull/10
[x] https://github.com/micro-ROS/micro-ros-build/pull/130
[x] https://github.com/micro-ROS/apps/pull/23
[x] https://github.com/micro-ROS/rmw-microxrcedds/pull/64
[x] https://github.com/micro-ROS/rmw-microxrcedds/pull/65
[x] https://github.com/micro-ROS/rmw-microxrcedds/pull/66
[x] https://github.com/micro-ROS/rmw-microxrcedds/pull/67
[x] https://github.com/micro-ROS/freertos_apps/pull/6
[x] https://github.com/micro-ROS/rmw-microxrcedds/pull/68
[x] https://github.com/micro-ROS/micro-ros-build/pull/132
[x] https://github.com/micro-ROS/rcl/pull/7
[x] https://github.com/micro-ROS/micro-ros-build/pull/133
[x] https://github.com/micro-ROS/micro-ROS-Agent/pull/30
[x] https://github.com/micro-ROS/micro-ros-build/pull/135
[x] https://github.com/micro-ROS/rcutils/pull/7
[x] https://github.com/micro-ROS/rmw-microxrcedds/pull/69
[x] https://github.com/micro-ROS/rosidl_typesupport_microxrcedds/pull/17
[x] https://github.com/micro-ROS/rosidl_typesupport_microxrcedds/pull/21

NOTES:

https://github.com/eProsima/crazyflie-clients-python should be a standalone CF Radio to micro-ROS Agent bridge with installation instructions: WIP

All feature/foxy_migration branches are referenced from this micro-ROS Build System repo. The last pre-release commits must change all these branches from feature/foxy_migration to foxy

POST RELEASE:

Parameters and graph support will be released just after micro-ROS Foxy Release
[x] rcutils repository HEAD commit has changed in origin ros2 repository since the moment it was forked. A further revision of the last  introduced changes must be done before rebasing this repository to ros2:foxy branch.
[x] repository trace_tools need a review in the CI in order to merge to foxy
Check https://github.com/eProsima/Micro-XRCE-DDS-Client/tree/feature/wait_until_data
[x] Change main branch to foxy for all repos

Hello,
You are doing a great job with the development of Micro-ROS,
We are wondering when we should expect a Foxy release of Micro ROS ?
Thank you for your hard work,
Luca Miller

Hi thank!
We are currently working on it. I hope it is ready for the next week.

Great !!
Looking forward to play around with it,
Thank you for your hard work ;-)

This looks great. Is this complete now @pablogs9 ?

Yes, Foxy release is out!


Scanning Media Failed

I am getting the following error every time I try to use convert_video or transcode_video:
Scanning media title 1 with HandBrakeCLI... HandBrake 1.3.0 found... /usr/local/bin/transcode-video: scanning media title 1 failed
I have tried several different media files and I get the same error every time.  I am running fresh install of  Mac OS 10.15.1.  Is there any guidance as to what I should do to diagnose and fix the problem? Thank you in advance!

I had the same problem but only using the version installed with brew, that version of HandBrakeCLI gives me a segmentation fault.
Try uninstalling that version and trying to install directly the downloaded one from the website.
https://handbrake.fr/downloads2.php

@jxp05j I would agree with @salicio 's suggestion for you to try install a downloaded version of HandBrakeCLI from the website to see if that fixes your problem. Be sure to remove any version of HandBrakeCLI installed with Homebrew first.
Let me know if that doesn't work and we'll figure out how to proceed.

That did it.  Thank you for your help and the work you do on these tools!

@jxp05j No problem and you are very welcome!
I'll close this now but feel free to comment again or open another issue.


Not possible to chain multiple join statements other than regular join

I would like to be able to do the following:
.from("table1")
.leftOuterJoin("table2").on(...)
.leftOuterJoin("table3").on(...)
.where(...)

As far as I understand it is not possible to chain multiple left outer join statements after each other (or any other non-regular join). Any plans to add it?

@mattijsf yes. because of the nature of this lib, features will be added on an as-needed basis so if you come across any missing features that you'd like to see, continue to open issues for them.

See #53


setup error

I clone the luma.oled to raspberry pi. And use 'python setup install' to install.
But meet this error:
error in luma.oled setup command: 'extras_require' must be a dictionary whose values are strings or lists of strings containing valid project/version requirement specifiers.
what should I do?

@Gadgetoid is right, it's likely a setuptools issue. Did you fix it @sgsungeng?


Require documentation

Write documentation under /docs

Major documentations can be found at .
Requrie more docs on configs and annotations, some advanced usage of the file store.

It would be nice also to have a lot of examples of common usages of the Go lib


space in file path

Having trouble when there is a space in the path
Use quotations to wrap the path
cd "C:\Program Files"

Hello,
The same issue here.
@fernandoescolar please update CliCommandBase: getWorkingFolder: just add quotes for the path.

I'd say this is a bug, not an enhancement. The extension executes an incorrect command for when there are spaces (or other special characters) in the path, i.e. it executes "cd" with an unquoted path, which is an incorrect behavior.


[Support]: All photospheres are destroyed on destroy() call

What are you trying to do?
Hi I'm using the react photosphere multiple times on the same page, i have a main photosphere that it's visible all of the time and some other photoshpere containers visible on expanded table rows in an overlay. If i create to many rows in table with photosphere elements > 8 the browser just crash. I have tried to use the destroy() method in order to free the memory on table row unexpanding method - so my table will display only one photosphere on the row at the time, and then in total will be rendered only 2 photospheres on the same page. But the problem which i encounter is that the destroy() method is killing also the main photosphere which should be visible all of the time.
I will attach a snippet with the code that it's called before toggling the expanding of the rows in the table and where the destroy method it's called.
How can i perform the cleanup of tree.js photoshpere only on the specific element without destroying all other instances of photosphere views?
Code
                onExpandedClick: (index: number) => {
                    if (scene.isExpanded) {
                        const currentRef = ((scenesRef.current[i]) as any).current as any;
                        currentRef.destroy();
                    }
                    toggleFlagInSceneState(index, "isExpanded");
                },

Sandbox Link
No response
Library Version
3.4.0-psv5.4.0
What operating system are you using?
macOS
What browser are you using?
Firefox
Logs
No response

I'm working on it!  :)


Support APISIX plugin - limit-count

https://apisix.apache.org/docs/apisix/plugins/limit-count/
In implementation, however, we need not replicate APISIX exactly, but instead should focus on the actual user needs behind the plugins, combined with the specific circumstances of Higress, to re-abstract configuration fields and corresponding capabilities. We can draw lessons from others, but we should not copy them exactly.

/sig

may I would have a try for this?


Uncaught Error: Maximum update depth exceeded in Input onChangeText

I have updated expo version from 32 to 33. Everything working fine but when try to enter text in input field getting below error.
Invariant Violation: Invariant Violation: Maximum update depth exceeded. This can happen when a component repeatedly calls setState inside componentWillUpdate or componentDidUpdate. React limits the number of nested updates to prevent infinite loops.
**I have created custom input component**
export const CustomInput = (props) => {
    const { value, onChange, label = 'Enter', autocapital='none', placeholder, textLength=100, keyboard='default',getRef, style = {}, secureText=false} = props;

    return (
        <Item floatingLabel style={[styles.input,style]}>
            {props.label}
            <Input maxLength={textLength} placeholder={placeholder} autoCapitalize={autocapital} keyboardType={keyboard} onChangeText={onChange} getRef={getRef} value={value} secureTextEntry={secureText}/>
        </Item>
    );
};

**Calling in login screen**
<CustomInput textLength={100} label="Email" style={{marginBottom: 30, marginTop: 30}} keyboard="email-address" value={email}
                      onChange={email => this.setState({email: email.trim()})}
                      />

**I have also tried with simple code without my custom input component**
 <Item floatingLabel>
       Email
       <Input maxLength={100} keyboardType={'email-address'} onChangeText={(text) => this.setState({email: text.trim()})} value={email}/></Item>

In every condition getting same error.

Duplicate #2810

My error is same with #2810, but its coming in Input.

@ashishdigitalrooar Use case? How do I reproduce?

@ashishdigitalrooar Use case? How do I reproduce?
Issue with onChangeText in Input, when going to enter text in input getting error.
I tested with old version 2.12.2 but no luck
These configs in my project
"expo": "^33.0.0",
"react": "16.8.3",
"react-native": "https://github.com/expo/react-native/archive/sdk-33.0.0.tar.gz",

Email
<Input maxLength={100} keyboardType={'email-address'} onChangeText={(text) => this.setState({email: text.trim()})} value={email}/>

@sankhadeeproy007 What about this thread? Did you resolved in latest release?

Can you confirm that this issue persists for all Inputs? Or just inputs with a floating label?
Please check with the latest version.

Please check with 2.13.3

Please check with 2.13.4

I tested input with 2.13.4, Now its working fine but there are I have used tab in my form Tab not changing after click and not showing active
Thank you :)

@ashishdigitalrooar Can you please create a new issue with proper reproduction steps and screenshots/gif?
Closing this one.


Error when no Lambda function: TypeError [ERR_INVALID_ARG_TYPE]: The 'path' argument must be of type string, Buffer, or URL

Are you certain it's a bug?

[X] Yes, I'm using the latest plugin release

Is there an existing issue for this?

[X] I have searched existing issues, it hasn't been reported yet

Issue description
When no Lambda function, serverless-python-requirement receive TypeError.
I know that this is not a common use case. But serverless-python-requirement should handle these exceptions.
I will add a PR related to this issue soon.
Service configuration (serverless.yml) content
service: sls-bug-test

provider:
  name: aws
  runtime: python3.10
  region: ap-northeast-2

package:
  include:
    - "requirements.txt"
  exclude:
    - "node_modules/**"

plugins:
  - serverless-python-requirements

Command name and used flags
sls deploy
Command output
✖ The "path" argument must be of type string or an instance of Buffer or URL. Received undefined
TypeError [ERR_INVALID_ARG_TYPE]: The "path" argument must be of type string or an instance of Buffer or URL. Received undefined
    at readFile (node:fs:409:10)
    at go$readFile (file:///C:/Users/junah/.serverless/releases/4.1.6/package/dist/sf-core.js:3:1334)
    at readFile8 (file:///C:/Users/junah/.serverless/releases/4.1.6/package/dist/sf-core.js:3:1244)
    at go$readFile (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\graceful-fs\graceful-fs.js:118:14)
    at Object.readFile (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\graceful-fs\graceful-fs.js:115:12)
    at Object.readFile (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\universalify\index.js:5:57)
    at Object.tryCatcher (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\util.js:16:23)
    at Object.ret [as readFileAsync] (eval at makeNodePromisifiedEval (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\promisify.js:184:12), <anonymous>:14:23)
    at injectRequirements (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\serverless-python-requirements\lib\inject.js:30:6)
    at ServerlessPythonRequirements.injectAllRequirements (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\serverless-python-requirements\lib\inject.js:169:13)
    at ServerlessPythonRequirements.<anonymous> (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\serverless-python-requirements\index.js:243:43)
    at ServerlessPythonRequirements.tryCatcher (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\util.js:16:23)
    at Promise._settlePromiseFromHandler (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\promise.js:547:31)
    at Promise._settlePromise (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\promise.js:604:18)
    at Promise._settlePromise0 (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\promise.js:649:10)
    at Promise._settlePromises (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\promise.js:729:18)
    at _drainQueueStep (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\async.js:93:12)
    at _drainQueue (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\async.js:86:9)
    at Async._drainQueues (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\async.js:102:5)
    at Async.drainQueues [as _onImmediate] (C:\Users\junah\OneDrive\바탕 화면\sls bug test\node_modules\bluebird\js\release\async.js:15:14)
    at process.processImmediate (node:internal/timers:476:21)

For help, try the following:
  • Run the command again with the "--debug" option
  • Run "serverless support"
  • Review the docs: https://www.serverless.com/framework/docs/

Environment information
serverless framework = 4.1.6
serverless-python-requirements = 6.1.0

Just bumping this as I'm running into the same issue.
It looks like it was fixed with the update in https://github.com/serverless/serverless-python-requirements/pull/843 , however is this going to get released?


Version modules

Checksum the module data to get a version number. On first invoke, check the device has the most up to date code.

Could you elaborate on this? Are we using the body of a module (i.e. the compiled binary, it's name and other metadata, etc.) to "compute" the version as a checksum? Is a version manually assigned but then just associated with a checksum? What exact data is involved here and how is it used?

This is different than the version number.
We need a way to determine if the module that is on the device matches the bindings that are calling it. The simplest way to do this is to checksum the module executable. If there is a difference, we need to reupload and reinstall the module.


Improve documentation and auto-completion

:+1:

Coverage remained the same at 66.758% when pulling 2deb131e228dc6a6d632ff33655f9744588fc4e6 on improve-documentation-aleksi into 66e95c543de6cb43b376ab5f6c838c4cca92b7a4 on master.

Coverage remained the same at 66.758% when pulling 2deb131e228dc6a6d632ff33655f9744588fc4e6 on improve-documentation-aleksi into 66e95c543de6cb43b376ab5f6c838c4cca92b7a4 on master.


Feature request: Fix whatever is breaking this sf/midi combo?

I'm sorry, this request is fairly vague :| It is sort of testing the limit of my sf/midi knowledge and debugging skills!
Playback is much better with most soundfonts w/ your previous 5 or 6 commits (🎈), but now I'm trying to find a small soundfont I can legally distribute w/ an open source game I'm porting.
I'm having a problem with this combo:

SoundFont: GeneralUser GS v1.471.sf2 (http://schristiancollins.com/generaluser.php) (same problem with the older "softsynth friendly" version)
This midi file: LEVEL1.zip
The example3 midi player

Other soundfonts are working fine w/ this track in the example3 player, and this sound font is working fine with this track in a different bassmidi-based player.
The problem is on track 12, when using Lead 6 Voice (85). The track has long held notes, modulation, and aftertouch. The result of playback in example3 is like someone trying to do rapid notes on an instrument with a very long attack, so it barely plays or doesn't sound at all.
I'd just use a different working soundfont, since other ones are working just fine with your lib, but they're either too big, or of dubious legality. I am working on a FOSS game port, so I'd rather not try anything on-the-sly!

Hi there!
Thanks for the great test case, it was indeed a problem with the SoundFont parsing.
GeneralUser GS v1.471.sf2 uses global zones in both presets and instruments with multiple instrument layers which makes it quite a good test font.
TSF actually basically ignored the global zone in presets only handling them on the instrument level, so that was a rather big oversight. It's now fixed since commit 1bfb361.
Glad you didn't just resort to using another soundfont and opened this issue :-)

Tried it with the new sound font. The fix sounds good to me!


exec: cleanly separate stdout/stderr

Commit 40ba3555a43fa2aa8aa1f081af1f2386edda4dd8 intentionally captured
stderr in the output because earlier it was hard to understand why LVM
commands failed. However, we now learned the some error messages can
be safely ignored and not doing so broke LVM mode: when /dev/sda is
unreadable, "vgs" prints a line about it on stderr, but the output on
stdout is fine.
Now we capture both output streams separately, log both, but only
return stdout to the caller.
The TestResult call is unrelated to that fix and will be used for
additional debugging in another PR. It gets added here because it can
use the same test cases and is related.

I tried to trigger the error output from vgs also under QEMU, but without success. Adding an empty CD-ROM driver with -drive if=ide,index=0,media=cdrom did not lead to an error messages. Therefore we have to rely on the unit tests to become confident that output parsing will now ignore stderr.
Log output is also not tested.


Fix analyzer warnings

Caused by https://github.com/flutter/flutter/pull/12686
Not sure why it passed Travis...

/cc @5u3it


Change default policy of intrinsics without a policy suffix from TAMU to TAMA

This PR is currently dependent to #186.

This works is one of the steps to implement the simplification proposal
proposed by Nick Knight [0]. After setting the default policy to TAMA,
the next-step will be to remove the _ta and _tama variant and
further simply other policy suffixes.
[0] https://gist.github.com/nick-knight/6cb0b74b351a25323dfb1821d3a269b9
The maskedoff operand is removed for masked version of the non-policy
intrinsics in this PR.

Closing the PR, after a second thought, I think having changes in a single PR would be more sensible.


charts

what do you think about using a chart component i.e.
https://github.com/jwilber/roughViz
examples

Donut Chart https://blockbuilder.org/jwilber/e713c03097950d53a8cfde4c23aa292f
Bar Chart https://blockbuilder.org/jwilber/4dc5235f7ea5e51ac1219b3605f5af6a

I like the idea. However, I am currently busy refactoring the basic code, so I need to put it on maybelater for now and have a look at it again when the foundations are stable.


Prepackaged METIS RPM on Windows

https://build.opensuse.org/package/show/windows:mingw:win64/mingw64-metis

That's METIS 5.

Can't HSL use Metis 5? The license is much more reasonable on that, and so's the build system.

At least HSL_MA97 is METIS 4 only. I'll have to check the others, but my guess is few, if any, will support METIS 5.

Oh, that's too bad. Worth pinging Jonathan Hogg to ask if there's any ETA on Metis-5-compatible versions?

I've already been harassing him about building shared libs and that might be under way. But I'll ask.


Fix Java 7 compile; README updates; signed header order

This includes two bug fixes and various updates to the README based on feedback from users.
Bugs:
Java 7 compilation fails due to use of java.util.Base64
Headers to sign were not sorted as needed per EdgeGrid spec

I approve. Can you merge?


Query string parameter transform

As discussed in #268 I would like to have the ability to transform parts of the request path into query string parameters to the downstream service. This is an initial stab at adding support for that with a new QueryStringParameterTransform so consider this a work-in-progress that I would like to get some early feedback on to see if I'm going in the right direction.
To configure this I'm using:
{
  "QueryStringParameter": "path",
  "Append": "{remainder}"
}

I'm treating the value of Append here as a route template that I apply to the route values of the original request. I've inspired the design on the existing PathRouteValuesTransform and RequestHeaderValueTransform classes.

For some reason the build fails to compile, but it compiles just fine locally. Not sure what's going on there. Any ideas?

You need to rebase from master.

I've added the Remove option now and I've also added query string parameter transforms to the docs. I believe I've got what I need right now, although there are some open questions. Please let me know if there are any additional changes you'd like.

@Tratcher No problem, I was away on holiday anyway ;). I made the suggested changes. Only thing remaining now I guess is how we're going to fix the performance for the transformation. I saw the suggestion of using a custom query string structure on the RequestParametersTransformContext, but I'm not entirely sure how I would go about it. Perhaps we could parse the query string on the request once and put the resulting dictionary on the context, then allow the transforms to manipulate that dictionary and then put it back into a query string before being sent downstream. Does that make sense?

Yeah, that's similar to how we deal with it on the HttpRequest as well. See the QueryString and Query properties. I'd also want an optimization that reused the original QueryString if nothing changed.
https://github.com/dotnet/aspnetcore/blob/master/src/Http/Http/src/Features/QueryFeature.cs
https://github.com/dotnet/aspnetcore/blob/master/src/Http/Http/src/Internal/DefaultHttpRequest.cs
I wonder if routing always triggers the lazy HttpRequest.Query parse and if we can take advantage of that.

Okay, I've made some changes that should avoid parsing the query string unnecessarily and only once per request. I'm not too sure about the design and naming of things though, so I figured I'd push what I have right now to see if I'm going in the right direction. Also I still have some failing tests because now if we "append" a query parameter that already exists in the original request it comes out as &z=1,6 instead of &z=1&z=6. I couldn't find an easy way to fix that with the current design and I'm also not sure if it is actually a problem. Feedback appreciated ;).

Just checking in here to see if there's still interest in this. I still think it is a nice and useful feature to have.

I'm now exposing a ModifiedQueryParameters collection on the QueryTransformContext which is lazily evaluated which the transforms can use. This does solve my problem with the transforms needing to now whether a query parameter has already been added.
For some reason the tests are failing during CI although they are green on my machine. The 2 failing tests both have the scenario that we append a query parameter that already exists on the original request. Locally I get the value appended to the existing parameter (ie. ?z=1,6), but in CI it is appended as a new query parameter (ie. ?z=1&z=6). Do you know if something changed downstream that causes this?
I still have to look into re-using the parsed collection on the HttpRequest. I looked at the code you've linked below but I'm not entirely sure how I can use it.

I just ran the tests using build.sh and test.sh locally and then they are failing locally as well. Interestingly changing the test to assert on ?z=1&z=6 makes them work on .NET 5.0 (preview 6 seems to be what's downloaded by build.sh currently), but not on .NET Core 3.1. Running the tests using my machine installed .NET SDK (5.0 preview 8) works if I assert on ?z=1,6. This feels like a regression, but I'm not entirely sure what's causing it.

I made the suggested changes, but now it seems that things are no longer compiling. I'm guessing that's because of the SDK bug. Do we have to wait for #382 to land to make this work?

So I think we now have the matter of re-using the parsed dictionary on the HttpContext if it is available remaining. I looked through the code you linked and I think I know how to get to the IQueryFeature (using _request.HttpContext.Features.Get<IQueryFeature>();) but I'm unsure how I would go about checking if it has already parsed the query string. Or would Get<T>() return null if the query string has not yet been parsed?

FYI: 382 got merged so you can rebase on it.
As for the lazy query parsing, it occurs to me that it's already built into HttpRequest.Query. You just need to make a copy of that collection on-demand. If it hasn't been parsed yet then HttpRequest will take care of that.

I did the rebase and I've implemented the copying of the request's Query property. I can't use the IQueryCollection directly because it doesn't support a Remove() operation. So instead I'm copying the individual keys and values over. Not sure if there is a more efficient way to do this.

Never mind, I wasn't thinking straight. Of course I could just new up the dictionary and use the original IQueryCollection as the source. It probably does the same thing under the hood, but I guess that code path can be optimised separately.

@Tratcher So I guess we're about ready here, or do you want to give it another review?

@Tratcher I've processed the comments.

Thanks for sticking with it!

@Tratcher No problem. I learned a lot while working on this, so the pleasure was all mine. Glad to see this got merged though :). Looking forward to trying out the next preview.


openai.AuthenticationError

openai.AuthenticationError: Error code: 401 - {'error': {'message': 'Incorrect API key provided: placeholder. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}}

This issue occurs when I select 'GPT-4 (Azure OpenAI)' in both the RAG tab and Assistant tab, but Chat mode functions perfectly.

As of today, it works in the assistant tab but still fails in the RAG tab.

The issue exists because OpenAIs Embedding models are hard-coded into RAG and "Retrieval".
To use RAG with Azure OpenAI you have to change ./backend/app/upload.py.
Add:
from langchain_openai import AzureOpenAIEmbeddings
to the import-section and add/change:
`embeddings = AzureOpenAIEmbeddings(
azure_deployment="<Your_Embedding_Model_Deployment_Name_On_Azure>",
openai_api_version="2023-09-01-preview",
openai_api_key=os.environ["AZURE_OPENAI_API_KEY"],
azure_endpoint=os.environ["AZURE_OPENAI_API_BASE"],
)
vstore = Redis(
redis_url=os.environ["REDIS_URL"],
index_name="opengpts",
#embedding=OpenAIEmbeddings(),
embedding=embeddings,
index_schema=index_schema,
)
`
And then it works.

@ArneJanning After that changes, it works!, but do you encounter following issue?
https://github.com/langchain-ai/opengpts/issues/93

vstore = Redis(
    redis_url=os.environ["REDIS_URL"],
    index_name="opengpts",
    embedding=embeddings,
    index_schema=index_schema,
)
vstore._create_index_if_not_exist()

bug from langchain, solved by this workaround


Add plugin support to DVM

DVM can now install specific builds of the chef-server addons.

:+1: LGTM


License Explorer (Make Bids)

We want to provide a way to allow people to easily explore licenses and their history.  This is a bit like a transaction explorer #41 but with the products being sold.  What's key here is being able to place a bid on a license at any time, allowing the owner to accept it or allow further bids.

This may also be related to wishlist: #35


Allow "Packages/Plugins" for Franklin

I'm not clear if this functionality is available or not. If it is, then I haven't been able to find a way to implement it.
I effectively wrote a small package for Franklin. It uses custom julia code (lx_* functions), franklin-markdown (newenvironments and newcommands), and css scripts. It allows for theorems using a syntax reminiscent of amsthm in LaTeX, including automatic numbering, labeling, and referencing. It is not clear that this belongs on the Franklin.jl repository.
I would like to make this open source, but I don't see any way to make this installable for other users.
Ideally, I would like to have a folder like _franklin_libraries/ or _fkl_libs/. Within that folder, I should have a directory custom_package_name\, with julia scripts and franklin-markdown scripts in it. Those scripts are evaluated before utils.jl and config.md. This would make sharing/installing packages very easy on the user end. From what I can tell, nothing like this is implemented.
Progress on a workaround:
I would be happy if there was a way for me to just share a folder full with one .jl, one .md, and one .css file, such that other people could write "include statements" somewhere in their code that included these libraries. For instance, I have code in three places:

utils.jl I can move the custom julia code to a new file called "custom_package.jl", and simply write include("custom_package.jl") in the utils.jl file. This is a nice way to "install" the julia script without having to copy-and-paste my full julia code into the user's utils.jl file. This is fine.
_css/custom_package.css The person installing a package just needs to move a css file into the css directory and update style.html. This is fine.
config.md I did not find any way to pull my package's config.md definitions into a new file. Rather, I did not find any way to include some file called custom_package.md into my config.md file. This would force users to copy-and-paste my whole franklin-markdown code into their config.md file, which seems like a real problem.

In order to get third-party / open-source packages, in the short term, there should be some easy way to include one markdown folder into the config.md file. This specifically has to support \newcommand and \newenvironment codes, which would be made available to all pages.
\textinput didn't seem to do this. I also tried writing a custom lx_* function that ran convert_md with isconfig=true, but this didn't work either.
Help on establishing a way for people to create open source and easily installable plugins would be greatly appreciated!

Hello! this is great and exactly what I was hoping that people would ultimately build (there is another such "plugin" package being built by @kellertuer: https://github.com/kellertuer/FranklinLiszt.jl) and I'm definitely keen to help such plugins be easily available to users.

An example of this is the FranklinLiszt package above, and also the meta package https://github.com/tlienart/FranklinUtils.jl which helps defining "Julia-function-like" syntax such as:
\command{opt1=value1, opt2=value2, ...}

Custom CSS
If your package requires custom CSS, then, a bit like the latex .sty file, this one would have to be added in the _css folder and included in the _layout/head.html for instance.
Making stuff easier for the user
Maybe one thing we could do is have the statements be in config.md indicating that the user wants to use package XYZ and Franklin would look at the statement and potentially ensure that the files and statements are at the right place but I'm not yet convinced this simplifies stuff enough to warrant the effort.
Does that kind of make sense? Also if you point me to the repo with your code, I will gladly give this a shot with you so we can see whether there's anything specific beyond what's mentioned here that should indeed be added.
In any case, thanks a lot for working on this!

Hello! this is great and exactly what I was hoping that people would ultimately build (there is another such "plugin" package being built by @kellertuer: https://github.com/kellertuer/FranklinLiszt.jl) and I'm definitely keen to help such plugins be easily available to users.

An example of this is the FranklinLiszt package above, and also the meta package https://github.com/tlienart/FranklinUtils.jl which helps defining "Julia-function-like" syntax such as:
\command{opt1=value1, opt2=value2, ...}

Custom CSS
If your package requires custom CSS, then, a bit like the latex .sty file, this one would have to be added in the _css folder and included in the _layout/head.html for instance.
Making stuff easier for the user
Maybe one thing we could do is have the statements be in config.md indicating that the user wants to use package XYZ and Franklin would look at the statement and potentially ensure that the files and statements are at the right place but I'm not yet convinced this simplifies stuff enough to warrant the effort.
Does that kind of make sense? Also if you point me to the repo with your code, I will gladly give this a shot with you so we can see whether there's anything specific beyond what's mentioned here that should indeed be added.
In any case, thanks a lot for working on this!

Ah sorry you do mention one additional thing which is for people to be able to inject "custom config" in the config.md. Hmmm ok I see what you're saying, I'll think a bit about that one to see what would be the best way forward. In theory you could "just" have a function append "your" config.md to the current one (a bit like Unix programs do the the .bashrc file) but this might require a bit more thinking. I'll re-read what you're suggesting and mull over this a bit.

Ah sorry you do mention one additional thing which is for people to be able to inject "custom config" in the config.md. Hmmm ok I see what you're saying, I'll think a bit about that one to see what would be the best way forward. In theory you could "just" have a function append "your" config.md to the current one (a bit like Unix programs do the the .bashrc file) but this might require a bit more thinking. I'll re-read what you're suggesting and mull over this a bit.

Thanks for responding so fast!
I'm all for having a script that appends a plugin's config.md into the true config.md.
This is what I spent most of my time trying to do, since using and include make the Julia side easy, and adding CSS files is easy in Franklin.
In case it's helpful, here's three different approaches I tried, none of which worked. It's not clear to me why any of these didn't work, and they all just produced the same error message:
Franklin.LxObjError("Command or environment 'definition' was used before it was\ndefined.")

That is, all of these scripts ran, but none of them brought new definitions into scope.
In all cases, I have my custom franklin-markdown file at _fkl_libs/thm_config.md
Attempt 1: \textinput{_fkl_libs/thm_config.md}
I tried adding this to either the config.md file, or at the very top of my actual webpage.md file, but neither case worked. I didn't find any very clear documentation saying if \textinput is supposed to be fully parsed by Franklin, so I don't know if this approach made sense at all.
Attempt 2: Returning a body of franklin-markdown text with an lx_* function
I tried to just paste the contents of the plugin's franklin-markdown file into the config.md by using an lx_* function:
function lx_usepackage(lxc, _)

    # Parse Inputs
    args, kwargs = lxargs(lxc)

    # Grab the given name of the package, like "thm"
    package_name = string(args[1])

    # Make a path out of the package name, like "./_fkl_libs/thm_config.md"
    config_path = "./_fkl_libs/" * package_name * "_config.md"

    # If the file exists
    if isfile(config_path)
        # Print a debug line (to the command line) proving that the file was found
        print("Loaded!\n")
        # Return the file, as a string
        return read(config_path, String)
    else
        # Print an error (on the command line) if the file does not exist
        print("Error!\n\n")
    end
end

So that the command \usepackage{thm} would just return the complete contents of _fkl_libs/thm_config.md.
Attempt 3: Running Franklin.convert_md
I tried to replicate the way that Franklin approaches the config.md parsing, by slightly modifying the definition of process_config:
function lx_usepackage(lxc, _)

    # Parse Inputs
    args, kwargs = lxargs(lxc)

    # Grab the given name of the package, like "thm"
    package_name = string(args[1])

    # Make a path out of the package name, like "./_fkl_libs/thm_config.md"
    config_path = "./_fkl_libs/" * package_name * "_config.md"

    # If the file exists
    if isfile(config_path)
        # Run the same subroutine as process_config()
        Franklin.convert_md(read(config_path, String); isconfig=true)
        # Print a debug line (to the command line) proving that convert_md has run
        print("Loaded!\n")
    else
        # Print an error (on the webpage) if the file does not exist
        return "~~~ERROR : " * config_path * "~~~"
    end
    return ""
end

So that in my config.md file can simply include the line \usepackage{thm} to (hopefully) import the plugin's franklin-markdown data.
In all cases, I don't get any error messages besides
Franklin.LxObjError("Command or environment 'definition' was used before it was\ndefined.")

So I'm unclear if there's anything obvious I'm missing or doing wrong, of if some aspect of Franklin's parsing of \newcomand makes the above approaches fundamentally doomed.

Thanks for responding so fast!
I'm all for having a script that appends a plugin's config.md into the true config.md.
This is what I spent most of my time trying to do, since using and include make the Julia side easy, and adding CSS files is easy in Franklin.
In case it's helpful, here's three different approaches I tried, none of which worked. It's not clear to me why any of these didn't work, and they all just produced the same error message:
Franklin.LxObjError("Command or environment 'definition' was used before it was\ndefined.")

That is, all of these scripts ran, but none of them brought new definitions into scope.
In all cases, I have my custom franklin-markdown file at _fkl_libs/thm_config.md
Attempt 1: \textinput{_fkl_libs/thm_config.md}
I tried adding this to either the config.md file, or at the very top of my actual webpage.md file, but neither case worked. I didn't find any very clear documentation saying if \textinput is supposed to be fully parsed by Franklin, so I don't know if this approach made sense at all.
Attempt 2: Returning a body of franklin-markdown text with an lx_* function
I tried to just paste the contents of the plugin's franklin-markdown file into the config.md by using an lx_* function:
function lx_usepackage(lxc, _)

    # Parse Inputs
    args, kwargs = lxargs(lxc)

    # Grab the given name of the package, like "thm"
    package_name = string(args[1])

    # Make a path out of the package name, like "./_fkl_libs/thm_config.md"
    config_path = "./_fkl_libs/" * package_name * "_config.md"

    # If the file exists
    if isfile(config_path)
        # Print a debug line (to the command line) proving that the file was found
        print("Loaded!\n")
        # Return the file, as a string
        return read(config_path, String)
    else
        # Print an error (on the command line) if the file does not exist
        print("Error!\n\n")
    end
end

So that the command \usepackage{thm} would just return the complete contents of _fkl_libs/thm_config.md.
Attempt 3: Running Franklin.convert_md
I tried to replicate the way that Franklin approaches the config.md parsing, by slightly modifying the definition of process_config:
function lx_usepackage(lxc, _)

    # Parse Inputs
    args, kwargs = lxargs(lxc)

    # Grab the given name of the package, like "thm"
    package_name = string(args[1])

    # Make a path out of the package name, like "./_fkl_libs/thm_config.md"
    config_path = "./_fkl_libs/" * package_name * "_config.md"

    # If the file exists
    if isfile(config_path)
        # Run the same subroutine as process_config()
        Franklin.convert_md(read(config_path, String); isconfig=true)
        # Print a debug line (to the command line) proving that convert_md has run
        print("Loaded!\n")
    else
        # Print an error (on the webpage) if the file does not exist
        return "~~~ERROR : " * config_path * "~~~"
    end
    return ""
end

So that in my config.md file can simply include the line \usepackage{thm} to (hopefully) import the plugin's franklin-markdown data.
In all cases, I don't get any error messages besides
Franklin.LxObjError("Command or environment 'definition' was used before it was\ndefined.")

So I'm unclear if there's anything obvious I'm missing or doing wrong, of if some aspect of Franklin's parsing of \newcomand makes the above approaches fundamentally doomed.

Ok, here's a working example that you can try to copy, please let me know how it works for you: https://github.com/tlienart/FranklinPluginExample.jl
To use this a user would have to add in utils.jl:
using FranklinPluginExample

FranklinPluginExample.plugin_config()

(after installing the relevant plugin package, in this case, you have to clone it bc I didn't register it)
The only extra step would be to add the CSS if there's specific CSS required, that's pretty easy though.
Would you mind trying this out and letting me know what you think?

This is beautiful! This worked like a charm! I'll get to work on making my franklin package now!
Now that this is clearly possible, I'd like to follow up with a less important "due process" type question:
The source for process_config sets FD_ENV[:SOURCE] = "config.md". If I understand correctly, doing this ourselves should correct what files are printed in Franklin's error messages? Should we do this for both the .jl and .md files?
In fact, the plugin_config function you wrote looks almost exactly like process_config. Should file_utils.jl just be updated to include this as a built-in function? In principle, this would hide any bookkeeping (like FD_ENV[:SOURCE]), and allow the error checking to be more consistent (like calling an equivalent of config_warn).
Syntax wise, in utils.jl, the user would write something like
using FranklinPluginExample
Franklin.include_external_config(FranklinPluginExample.config_path())

Where FranklinPluginExample.config_path() just returns a path to its config.md file.
Further, this would allow people to import other config files they might be using (like a really long tex-style preamble full of math definitions).
I don't see any clear downsides to implementing something like this unless Franklin has some other plans for plugin syntax down the road. I'm new to Franklin, so I hesitate to implement this without asking first....

If I understand correctly, doing this ourselves should correct what files are printed in Franklin's error messages? Should we do this for both the .jl and .md files?

Yes that's correct. It's mostly relevant for the .md file though (if we work with the assumption that plugins aren't buggy 😛)

I don't see any clear downsides to implementing something like this unless Franklin has some other plans for plugin syntax down the road. I'm new to Franklin, so I hesitate to implement this without asking first....

Your suggestion makes sense to me. What I'd suggest is that you do this on a branch of Franklin, work on your plugin until you're happy about the ways both work together (feel free to ping me from that repo) and then we can merge the required changes inside Franklin?
Thanks!

Alright, I'm pretty happy with the core of it:

My plugin
The Franklin fork & branch with the new function, with pull request #781.

There's a couple other points where I wonder if existing tools would make it easy to improve the experience a bit:
1. Automatically reloading when plugins are edited.
When editing a plugin's markdown or julia files, Franklin does not automatically recognize the edits to those files, so I have to restart the server every time I want to test an edit to my plugin. It's a minor inconvenience for plugin developers. This uses using PackageName in utils.jl, so I'm not sure if something like Revise.jl would be needed/helpful?
2. Javascript workflow
Even in the long term, it makes sense for the CSS file to not be automatically included by the plugin, since I would expect people to fine-tune CSS to their specific webpage styles. This is less obvious to me from a Javascript perspective though.
Any idea on a nice way to do this in the short term? My current best solution is to include the javascript at the end of a webpage explicitly with a \newcommand that just returns a <script>...</script> block. I suppose I could also use the if-end blocks in foot.html. This requires the user to do more work, which I would rather avoid.
Long-Term Plugin Support
This also got me thinking about the long-term infrastructure for plugins. How can we make Franklin handle most of this setup for us? One idea is to have plugins provide a function plugin_setup_config(), which returns a dictionary that defines what files should be added & edited in order to enable a plugin. Then, when a user decides they want to include a plugin, they navigate to the Franklin site directory, and in their julia repl they run
using Franklin
using FranklinPluginName
Franklin.install_plugin(FranklinPluginName.plugin_setup_config())

Then, Franklin would read this dictionary, and perform initial setup needed to enable a plugin. For instance, this would:

Add the import lines to the utils.jl
Add the default CSS script to \_css\
Add the default javascript code to \_libs\
Update the \_layout\ directory to include the javascript (maybe? not sure if this is possible in general. maybe just create a new file analogous to foot_katex.html?)
Other things I haven't thought about yet

Any thoughts on this long-term design of/for plugins?


extension is not installable: missing executable

> gh extension install gabe565/gh-profile
extension is not installable: missing executable

> gh version
gh version 2.17.0 (2022-10-04)
https://github.com/cli/cli/releases/tag/v2.17.0

The v1.0.0 build is underway! Will be installable pretty soon.

v1.0.0 is released! Try to install again.

Also would be great if create command asked for values for oauth_token, git_protocol, and user to eliminate the burden to manually edit hosts.yml for each newly created profile.

Both are good points!

Completion is fully supported by gh-profile if installed as a standalone command, but I haven't been able to get it working as an extension yet. I'll update this issue if I'm able to make any progress!
gh profile list currently gives an overview of available profiles (and it prints a * before the active profile), but that's a good idea. I'll add a status subcommand!

I should document the workflow a little better. I have been running gh profile create, then running gh auth login to run through the regular login workflow.

Thanks!
I have been using my gist to achieve the same functionality for a while now. I also added link to your repo in the very 1st comment so that others can utilize this extension too.
Looking forward for further development and would be happy to be of any use to help =)

Oh thank you for linking to my repo! Your gist was only of my original inspirations for this extension :) I'll add a link to your gist too.

Sounds great. I have a will, though have no time to develop something more mauture myself =)

I know the feeling. I luckily had some time and decided it would be worth it in this case.
Unfortunately, looks like shell completions aren't supported for gh extensions at the moment. See https://github.com/cli/cli/issues/5309

Unfortunately, looks like shell completions aren't supported for gh extensions at the moment. See cli/cli#5309

That's odd 😢 Might worth to add instructions on how to install gh-profile as a standalone binary via go install ... or on how to add ~/.local/share/gh/extensions/gh-profile/gh-profile/ to PATH env var 🤔

I'll go ahead and close this issue since builds are out and we have a separate issue for a status subcommand. Thank you!


Fix URL for data eng service

Description
Wrong URL for the data engineering service was set as default
Fixes # (issue)
Type of change
Please delete options that are not relevant.

Configuration update

Testing steps
N/A
Checklist

[ ] make before_commit passes
[ ] updated documentation wherever necessary
[ ] added or modified tests if necessary
[ ] updated schemas and validators in insights-data-schemas in case of input/output change

Codecov Report
Patch and project coverage have no change.

Comparison is base (d9a6713) 60.85% compared to head (79775d1) 60.85%.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #1013   +/-   ##
=======================================
  Coverage   60.85%   60.85%
=======================================
  Files          24       24
  Lines        3290     3290
=======================================
  Hits         2002     2002
  Misses       1060     1060
  Partials      228      228

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


fix: use edgexfoundry.curl implementation in proxy-certs test

Use edgexfoundry.curl instead of curl, to properly support TLS 1.2
Add more debug logs on error

Signed-off-by: Siggi Skulason<EMAIL_ADDRESS>

The issue is that the test used this curl version:
curl 7.47.0 (x86_64-pc-linux-gnu) libcurl/7.47.0 GnuTLS/3.4.10 zlib/1.2.8 libidn/1.32 librtmp/2.3
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp smb smbs smtp smtps telnet tftp
Features: AsynchDNS IDN IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz TLS-SRP UnixSockets

and that is an older version, using GnuTLS as well.  We should use edgexfoundry.curl instead which is newer and uses OpenSSL/1.1.1
curl 7.58.0 (x86_64-pc-linux-gnu) libcurl/7.58.0 OpenSSL/1.1.1 zlib/1.2.11 libidn2/2.0.4 libpsl/0.19.1 (+libidn2/2.0.4) nghttp2/1.30.0 librtmp/2.3
Release-Date: 2018-01-24
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtmp rtsp smb smbs smtp smtps telnet tftp
Features: AsynchDNS IDN IPv6 Largefile GSS-API Kerberos SPNEGO NTLM NTLM_WB SSL libz TLS-SRP HTTP2 UnixSockets HTTPS-proxy PSL

This may be because we are using TLS 1.2 and there may have been updates/fixes in in the TLS 1.2 implementation.

Thanks a lot @siggiskulason


Draco encoding

This source file implements draco encoding,
https://github.com/GPUOpen-Tools/Compressonator/blob/master/Compressonator/Applications/_Plugins/Common/gltf/tiny_gltf2.h
what is the relationship between these two projects?
is it possible to integrate a similar functionality in this project?

what is the relationship between these two projects?

There is no relationship. I didn't know that Compressonator uses customized version of tinygltf.

is it possible to integrate a similar functionality in this project?

Yes, you can backport draco encoding to tinygltf. PR is appreciated!

Compressonator solution seems to be outdated, non-buildable and non-working.
What I have checked through - draco compression is disabled by default, after hacking projects and enabling draco, gltf refuses to load "JOINT_0" attributes, and also does not saves them.
So Compressonator project is outdated, please don't analyze it any further.
But @syoyo - do you have any idea when we could have draco encoder support added into tinygltf.
Would be interested in that one even if it's in early stage.
tiny_gltf2.h introduces so many changes changes in diff wise, so I'm not even sure if it's wise to go using that implementation (which is also non working).

@tapika glTF-Maya-Exporter's SaveToDraco code would be a good reference.
https://github.com/kashikacojp/glTF-Maya-Exporter/blob/development/src/kml/SaveToDraco.cpp
glTF-Maya-Exporter creates glTF with draco compression with picojson library. It creates valid glTF with draco-compressed data.

+1 for this. I'm using gltf-pipeline and it is quite slow on mesh with million tris (more than 30min on ryzen 5950x), really hoping tinygltf directly using the c++ version of encoder helps speed it up multiple times.

@Ben-Mack I think it would be enough fast just using tinygltf(or C++ glTF tool) even without draco compression for meshes with millions of triangles.

Actually the file is for serving online so I must use Draco compression to keep loading speed reasonable.
Really looking forward to the implementation of Draco encoder in tinygltf.
If so, tinygltf will be the first cpp lib can compress glTF Draco, performance-oriented, which is clearly missing on the market.

@Ben-Mack There is a Draco compression  code with TinyGLTF(I have updated the link) https://github.com/syoyo/tinygltf/issues/207#issuecomment-533770321
https://github.com/lighttransport/glTF-Maya-Exporter/blob/61116bc6950d270b716969a4236e3c74ea77b751/src/kml/SaveToDraco.cpp#L1
You can implement Draco compression based on this and send PR. Contribution is always welcome!

still open I guess? Any progress on this? Or should i also check it myself ? :)

@sariug No progress. You can contribute Draco encoding support to TinyGLTF!

gltf_decoder.cc

why not support TINYGLTF_MODE_LINE


Feat: Model mapper changes aligned with AAS 3.0 standard

Description

Changes done according to AAS 3.0 standard.
JPA entities and mappers are changed.
New models and tables are created.
Liquibase script has been changed.

Pre-review checks
Please ensure to do as many of the following checks as possible, before asking for committer review:

[x] Copyright and license header are present on all affected files

Additional information
The PR is bigger than the expected 1000 lines because of new AAS 3.0 standard changes, which includes database changes and model changes.

Before merging, wait for the project content review: https://gitlab.eclipse.org/eclipsefdn/emo-team/iplab/-/issues/9749

@SebastianBezold : do you have an update on this PR?

@SebastianBezold : do you have an update on this PR?

Hi @tunacicek , from my point of view the PR is fine, but the project content review linked above is still open

Content review is done (approved):  https://gitlab.eclipse.org/eclipsefdn/emo-team/iplab/-/issues/9749
We will merge the PR


WIP/IDEA Killing mediator

WIP/IDEA 💣 mediator 🔥
Runnable example of architecture without mediator and topics.
Most important changes can be seen in lib/file-client/index.js
See fh-wfm-file changes for complete runnable example.
ping @nialldonnellyfh

We killing mediator and... entire implementation in the same time. Closing.


Theme Submission: Web-Nary

New Hexo Theme Template Addition

If it does not use NetlifyCMS then please change the theme submission cms to No Cms

My Bad I only uses Netlify no NetfilyCMS.

I have recommitted and fixed the changes @JugglerX

Sir Please recheck