Upload Date of videos - not working in --flat-playlist mode

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm requesting a site-specific feature
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and I'm willing to share it if required

Region
India
Example URLs
https://www.youtube.com/playlist?list=PLmnly6_GG0y_W4wAEYpC2Q8SfaQVf2qWM
Provide a description that is worded well enough to be understood
I tried this command with a playlistURL --flat-playlist --print "ID: %(id)s %(title)s %(upload_date)s   %(view_count)s"  . The upload_date field returns NA. However, the view_count works. Is there a way to get a rough upload date of the videos in the playlist, as it is shown underneath the thumbnails.. like '6 months ago', '3years ago' etc. ?
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[debug] Command-line config: ['--flat-playlist', '-vU', '--print', 'ID: %(id)s %(title)s %(upload_date)s   %(view_count)s', 'https://www.youtube.com/@sagarroy']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp [615a84447] (pip)
[debug] Python 3.10.9 (CPython x86_64 64bit) - macOS-10.16-x86_64-i386-64bit (OpenSSL 1.1.1t  7 Feb 2023)
[debug] exe versions: ffmpeg 6.1.1 (setts), ffprobe 6.1.1, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.19.0, brotli-None, certifi-2022.12.07, mutagen-1.47.0, requests-2.31.0, sqlite3-3.40.1, urllib3-2.2.1, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets
[debug] Loaded 1803 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
yt-dlp is up to date<EMAIL_ADDRESS>from yt-dlp/yt-dlp)
[youtube:tab] Extracting URL: https://www.youtube.com/@sagarroy
[youtube:tab] @sagarroy: Downloading webpage
[debug] [youtube:tab] Selected tab: 'videos' (videos), Requested tab: ''
[youtube:tab] Downloading all uploads of the channel. To download only the videos in a specific tab, pass the tab's URL
[youtube:tab] @sagarroy/streams: Downloading webpage
[debug] [youtube:tab] Selected tab: 'streams' (live), Requested tab: 'streams'
[youtube:tab] @sagarroy/shorts: Downloading webpage
[debug] [youtube:tab] Selected tab: 'shorts' (shorts), Requested tab: 'shorts'
[youtube:tab] Downloading as multiple playlists, separated by tabs. To download as a single playlist instead, pass https://www.youtube.com/playlist?list=UUWk9cfsSiXXs2fyIOi9NMCQ
[download] Downloading playlist: Sagar Roy
[youtube:tab] Playlist Sagar Roy: Downloading 3 items of 3
[debug] The information of all playlist entries will be held in memory
[download] Downloading item 1 of 3
[download] Downloading playlist: Sagar Roy - Videos
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 1: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 2: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 3: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 4: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 5: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 6: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 7: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 8: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 9: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 10: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 11: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 12: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 13: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 14: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 15: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 16: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 17: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 18: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 19: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 20: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 21: Downloading API JSON
[youtube:tab] UCWk9cfsSiXXs2fyIOi9NMCQ page 22: Downloading API JSON
[youtube:tab] Playlist Sagar Roy - Videos: Downloading 685 items of 685
[debug] The information of all playlist entries will be held in memory
[download] Downloading item 1 of 685
ID: yurO7HGI2WY Kuch Kuch Hota Hai - Romantic Guitar Tabs Lesson For Beginners NA   484
[download] Downloading item 2 of 685
ID: 5wwmkiChwAs Best Electro Acoustic Guitar In ₹15,000 - Tanglewood Roadster II TWR2 SFCE Review & Sound Check NA   3680
[download] Downloading item 3 of 685
ID: Lbzix2e37RA Teri Yaadon Mein(Phirta Rahoon Darbadar) - K.K | Easy Guitar Tabs For Beginners NA   9641

--extractor-args youtubetab:approximate_date

https://github.com/yt-dlp/yt-dlp/blob/c414c3d4060620faac770662192bf411fda38ede/README.md#L1758


fix: gnav config and locale

Client id is wrong and locale was hardcoded to en_US.
I have tested all the locales, they take me to the corresponding login page on adobe.com.
Test: https://fix-gnav-setup--blog--adobe.hlx3.page/

Looks good, but one observation: this is IMS config, not FEDS. This is important because FEDS uses Dexter's locale (region) format (e.g., ch_de), while IMS uses languages en_US.

: this is IMS config, not FEDS. This is important because FEDS uses Dexter's locale (region) format (e.g., ch_de), while IMS uses languages en_US.

If I understand that correctly, this means we need to have other mappings when we deal with some FEDS related configs, correct ?


[Question]: Memory usage more than doubled since 0.9.4

Ask your question
Previously on 0.9.4, I updated to version 1.3.0 and noticed my Kubernetes cluster was killing the container because it exceed the memory limit of 64MiB I gave it. Upping it to 128MiB was not enough; it seems to peak at about 150MiB after booting for a minute of 2 before finally connecting. Running on ARM64.
Is this behavior to be expected?

I don't know what it was on previous versions, but my Pi is showing 108.5M on 1.3.0.  To be honest, I'm just glad the new version fixed Eufy's security changes.

To be honest, I'm just glad the new version fixed Eufy's security changes.

Absolutely, same here. But as a developer I'd like to know when my software would explode in terms of memory usage ;-) I've just performed some additional testing and it seems like a memory limit of 256MiB was not enough, so I've now set it to 512MiB which seems to work consistently.

how do i change the memory limit? My just get "killed" before it finished,,

how do i change the memory limit? My just get "killed" before it finished,,

+1

how do i change the memory limit?

I'm using K8s pod resource limits. Please open your own issue if you have further questions.

I have removed a resource intensive dependency in version 1.3.1. Please test and let me know.

@bropat Thanks - I've tried 1.3.3 with the old memory limit of 128MiB and it works!


Release: v2.12

For the full release process, we recommend reading this document.
Required items

[ ] https://github.com/kedacore/keda/pull/4860
[x] https://github.com/kedacore/keda/issues/4861

Timeline
We aim to release this release in the week of September 25th.
Progress

[x] Prepare changelog
[x] Welcome message supported versions are up-to-date
[x] Add the new version to GitHub Bug report template
[x] Create KEDA release
[ ] Publish new documentation version
[ ] Setup continuous container scanning with Snyk
[ ] Prepare & ship Helm chart
[ ] Prepare next release
[ ] Provide update in Slack
[ ] Tweet about new release

@zroubalik is our release captain for this release 🚢

Let's release on Sep 28 2023

Images imported in Snyk

Branch is created

We're done!


Deleting a Field with a ReviseFixedPriceItemRequestType

I am trying to delete a field within the ReviseFixedPriceItemRequestType call however no exception raised, however subtitle not removed.
$request = new Types\ReviseFixedPriceItemRequestType();
    $request->RequesterCredentials = new Types\CustomSecurityHeaderType();
    $request->RequesterCredentials->eBayAuthToken = *****

    $item = new Types\ItemType();

        $request->DeletedField[] = "Item.SubTitle";

At first glance it doesn't appear that you are doing anything wrong in the code. Keep in mind that there are restrictions on what and when you can revise an item. You may want to check the response for any messages returned from eBay as they may not be allowing the revision.

Thank you for your reply. This ended up being an issue with ebays caching system, that doesn't update in a timely manner.
It does in-fact remove the field after a period of about 10mins.

Happy it's all sorted.


Service Name	and Description fields

@fandrei for certain services if the data is available in EDB then there will be a "Service Name" and a "Service Description"
We need these as available fields.
Weirdly "Service Name" is not the same as the name of the service in these cases. An example is nolioagent2
The name of the service is nolioagent2 however there is another "Service Name" called Nolio Agent 2.0
Also looking at - https://github.com/cityindex/LogSearchShipper/blob/master/src/LogsearchShipper.Core.Tests/SampleData/EDB/ENV1/Latest.xml#L15-L43
The one is called Name the other ServiceName
<Name>PriceHistoryServiceHost</Name>
<ServiceName>Price History Service Host</ServiceName>

Although not seen in the example I imagine there may be a <ServiceDescription>

@ryanholder, is the service description named ServiceDescription or just Description (as in Environment and Server elements)?

@fandrei It might be just Description, I did not see it in the sample data so made a guess that it was SerivceDescription

@ryanholder, I wonder if someone knows how it's named for sure.

@mrdavidlaing the EDB sample data has nothing about the service description however we do have it in the current diagram app. Is there somewhere we can get a sample with a service description so @fandrei  can see what it is called ?

@ryanholder, @fandrei I send you a full EDB XML file via Flowdock.  I think the element you are after is
<Server>
 <Description>

@mrdavidlaing, @ryanholder I thought it's
			<Services>
				<Entity xsi:type="WindowsService">
					<Description></Description>

isn't it?

@fandrei - you are correct.  I was (erroneously) refering to the Server description.  Service description is Services/Entity/Description as you say

cool.
@ryanholder,
a sample output:
{"@timestamp":"2015-07-21T11:25:06.023Z","environment":"ENV1","cluster":"APP","host":"ENV1-APP01","serverDescription":"The app server","service":"PriceHistoryServiceHost","serviceName":"Price History Service Host","serviceDescription":"Test Description","event_source":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","expected_state":"stopped","serviceType":"WindowsService","binaryPath":"\"D:\\Apps\\PriceHistoryServiceHost\\PriceHistoryServiceHost.exe\"","systemArea":"CORE","tags":"service_tag1,service_tag2","bundlePath":"","website":null,"applicationUri":null,"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","logPathType":"log4net","logPath1":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","logPath1Type":"log4net_stats","logPath2":"\\\\PKH-PPE-APP10\\","logPath2Type":"","logger":"EdbExpectedEventSourcesLogger","level":"INFO"}
{"@timestamp":"2015-07-21T11:25:06.028Z","environment":"ENV1","cluster":"APP","host":"ENV1-APP01","serverDescription":"The app server","service":"PriceHistoryServiceHost","serviceName":"Price History Service Host","serviceDescription":"Test Description","event_source":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","expected_state":"stopped","serviceType":"WindowsService","binaryPath":"\"D:\\Apps\\PriceHistoryServiceHost\\PriceHistoryServiceHost.exe\"","systemArea":"CORE","tags":"service_tag1,service_tag2","bundlePath":"","website":null,"applicationUri":null,"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","logPathType":"log4net","logPath1":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","logPath1Type":"log4net_stats","logPath2":"\\\\PKH-PPE-APP10\\","logPath2Type":"","logger":"EdbExpectedEventSourcesLogger","level":"INFO"}
{"@timestamp":"2015-07-21T11:25:06.028Z","environment":"ENV1","cluster":"APP","host":"ENV1-APP01","serverDescription":"The app server","service":"PriceHistoryServiceHost","serviceName":"Price History Service Host","serviceDescription":"Test Description","event_source":"\\\\PKH-PPE-APP10\\","expected_state":"stopped","serviceType":"WindowsService","binaryPath":"\"D:\\Apps\\PriceHistoryServiceHost\\PriceHistoryServiceHost.exe\"","systemArea":"CORE","tags":"service_tag1,service_tag2","bundlePath":"","website":null,"applicationUri":null,"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","logPathType":"log4net","logPath1":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","logPath1Type":"log4net_stats","logPath2":"\\\\PKH-PPE-APP10\\","logPath2Type":"","logger":"EdbExpectedEventSourcesLogger","level":"INFO"}

have I missed anything?

@mrdavidlaing, ok.
@ryanholder,
a sample output:
{"@timestamp":"2015-07-21T11:25:06.023Z","environment":"ENV1","cluster":"APP","host":"ENV1-APP01","serverDescription":"The app server","service":"PriceHistoryServiceHost","serviceName":"Price History Service Host","serviceDescription":"Test Description","event_source":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","expected_state":"stopped","serviceType":"WindowsService","binaryPath":"\"D:\\Apps\\PriceHistoryServiceHost\\PriceHistoryServiceHost.exe\"","systemArea":"CORE","tags":"service_tag1,service_tag2","bundlePath":"","website":null,"applicationUri":null,"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","logPathType":"log4net","logPath1":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","logPath1Type":"log4net_stats","logPath2":"\\\\PKH-PPE-APP10\\","logPath2Type":"","logger":"EdbExpectedEventSourcesLogger","level":"INFO"}
{"@timestamp":"2015-07-21T11:25:06.028Z","environment":"ENV1","cluster":"APP","host":"ENV1-APP01","serverDescription":"The app server","service":"PriceHistoryServiceHost","serviceName":"Price History Service Host","serviceDescription":"Test Description","event_source":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","expected_state":"stopped","serviceType":"WindowsService","binaryPath":"\"D:\\Apps\\PriceHistoryServiceHost\\PriceHistoryServiceHost.exe\"","systemArea":"CORE","tags":"service_tag1,service_tag2","bundlePath":"","website":null,"applicationUri":null,"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","logPathType":"log4net","logPath1":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","logPath1Type":"log4net_stats","logPath2":"\\\\PKH-PPE-APP10\\","logPath2Type":"","logger":"EdbExpectedEventSourcesLogger","level":"INFO"}
{"@timestamp":"2015-07-21T11:25:06.028Z","environment":"ENV1","cluster":"APP","host":"ENV1-APP01","serverDescription":"The app server","service":"PriceHistoryServiceHost","serviceName":"Price History Service Host","serviceDescription":"Test Description","event_source":"\\\\PKH-PPE-APP10\\","expected_state":"stopped","serviceType":"WindowsService","binaryPath":"\"D:\\Apps\\PriceHistoryServiceHost\\PriceHistoryServiceHost.exe\"","systemArea":"CORE","tags":"service_tag1,service_tag2","bundlePath":"","website":null,"applicationUri":null,"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log","logPathType":"log4net","logPath1":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\PriceHistoryStats.log","logPath1Type":"log4net_stats","logPath2":"\\\\PKH-PPE-APP10\\","logPath2Type":"","logger":"EdbExpectedEventSourcesLogger","level":"INFO"}

have I missed anything?

@fandrei sample output looks correct although I have 1 query...
The following fields event_source, binaryPath, logPath, logPath1, logPath2 they all seem to have extra backslahes, could these be parsed out.
For example in your sample output on the first line:
"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log"

Should this not be;
"logPath":"\\PKH-PPE-APP10\logs\Apps\PriceHistoryService\log.log"

@ryanholder, this is the way how string literals are represented in JSON. The second one is not a valid JSON.

@mrdavidlaing, what do you think?

@ryanholder,
Unfortunately for you, @fandrei is correct; the JSON RFC requires \ to be escaped as \\ for it to be valid JSON.
Thus:
"logPath":"\\\\PKH-PPE-APP10\\logs\\Apps\\PriceHistoryService\\log.log"

is correct, and the only valid way to store this in JSON (and thus Elasticsearch).
If you want to display this with single \, then I suggest to pass the JSON through JSON.parse() when rendering.
Does that solution work in your use-case?

@mrdavidlaing @fandrei no problem, I can handle this on the client side

@mrdavidlaing, @ryanholder merge the PR then?

:+1: from me

Yes from me


Problem with serving bigger files using HttpServer

Now I am trying to use the HttpServer class. Serving small files works perfectly. But as soon as I try to serve bigger files (jquery library) the HttpServer crashes; see log:
> D (11767) Socket:  - accept:  Received new client!: sockFd: 4097
D (11768) Socket: << accept: sockFd: 4097
D (11768) HttpServerTask: HttpServer listening on port 80 received a new client
connection; sockFd=4097
D (11778) HttpParser: >> parseRequestLine: "GET /index.shtml HTTP/1.1" [25]
D (11783) HttpParser: << parseRequestLine: method: GET, url: /index.shtml, versi
on: HTTP/1.1
D (11810) HttpRequest: Method: GET, URL: "/index.shtml", Version: HTTP/1.1
D (11811) HttpRequest: name="Accept", value="text/html,application/xhtml+xml,app
lication/xml;q=0.9,*/*;q=0.8"
D (11816) HttpRequest: name="Accept-Encoding", value="gzipp, deflate"
D (11823) HttpRequest: name="Accept-Language", value="de,en-US;q=0.7,en;q=0.3"
D (11830) HttpRequest: name="Connection", value="keep-alive"
D (11836) HttpRequest: name="Host", value="<IP_ADDRESS>"
D (11841) HttpRequest: name="Upgrade-Insecure-Requestts", value="1"
D (11847) HttpRequest: name="User-Agent", value="Mozilla/5.0 (Windows NT 10.0; W
in64; x64; rv:57.0) Gecko/20100101 Firefox/57.0"
D (11859) HttpRequest: Body: ""
D (11862) HttpServerTask: >> processRequest: Method: GET, Path: /index.shtml
D (11869) PathHandler: plain matching: /helloWorld with /index.shtml
D (11876) PathHandler: plain matching: /http with /index.shtml
D (11881) HttpServerTask: No Path handler found
D (11889) HttpServerTask: Opening file: /sdcard/http/index.shtml
D (11899) Socket: send: Binary of length: 19
D (11899) Socket: send: Raw binary of length: 19
D (11904) Socket: send: Binary of length: 3366
D (11906) Socket: send: Raw binary of length: 3366
D (11913) Socket: close: m_sock=4097, ssl: 0
D (11915) Socket: Calling lwip_close on 4097
D (11923) HttpServerTask: Waiting for new peer client
D (11925) Socket: >> accept: Accepting on <IP_ADDRESS> [80]; sockFd:: 4096, using SSL
: 0
D (111960) Socket:  - accept: Received new client!: sockFd: 4098
D (11961) Socket: << accept: sockFd: 4098
D (11961) HttpServerTask: HttpServer listening on port 80 received a new client
connection; sockFd=4098
D (11971) HttpParser: >> parseRequestLine: "GET /jquery-1.11.3.min.js HTTP/1.1"
[34]
D (11977) HttpParser: << parseRequestLine: method: GET, url: /jquery-1.11.3.min.
js, version: HTTP/1.1
D (12002) HttpRequest: Method: GET, URL: "/jquery-1.11.3.min.js", Version: HTTP/
1.1
D (12002) HttpRequest: name="Accept", value="*/*"
D (12004) HttpRequest: name="Accept-Encoding", value="gzip, deflate"
D (12010) HttpRequest: name="Accept-Language", value="de,en-US;q=0.7,en;q=0.3"
D (12017)) HttpRequest: name="Connection", value="keep-alive"
D (12023) HttpRequest: name="Host", value="<IP_ADDRESS>"
D (12028) HttpRequest: name="Referer", value="http://<IP_ADDRESS>/index.shtml"
D (12036) HttpRequest: name="User-Agent", value="Mozilla/5.0 (Windows NT 10.0; W
in64; x64; rv:57.0) Gecko/20100101 Firefox/57.0"
D (12049) HttpRequest: Body: ""
D (12050) HttpServerTask: >> processRequest: Method: GET, Path: /jquery-1.11.3.m
in.js
D (12058) PathHandler: plain matching: /helloWorld with /jquery-1.11.3.min.js
D (12065) PathHandler: plain matching: /http with /jquery-1.11.3.min.js
D (12072) HttpServerTask: No Path handler found
D (12080) HttpServerTask: Opening file: /sdcard/http/jquery-1.11.3.min.js
abort() was called at PC 0x40122d1a on core 0
0x40122d1a: operator new(unsigned int) at /home/ivan/e/crosstool-NG/.build/src/g
cc-5.2.0/libstdc++-v3/libsupc++/new_op.cc:54

> Backtrace: 0x400876c8:0x3ffd4050 0x400877c7:0x3ffd4070 0x40122d1a:0x3ffd4090 0x4
0126341:0x3ffd40b0 0x4012655b:0x3ffd40d0 0x4017188d:0x3ffd4100 0x401244d6:0x3ffd
4140 0x40174c69:0x3ffd4160 0x401341ca:0x3ffd4180 0x4012460d:0x3ffd41a0 0x40124a8
d:0x3ffd41d0 0x4014216e:0x3ffd4200 0x40142825:0x3ffd4640 0x4014589c:0x3ffd57a0
0x400876c8: invoke_abort at E:/msys32/opt/esp/esp-idf/components/esp32/panic.c:5
72

> 0x400877c7: abort at E:/msys32/opt/esp/esp-idf/components/esp32/panic.c:572
> 0x40122d1a: operator new(unsigned int) at /home/ivan/e/crosstool-NG/.build/src/g
cc-5.2.0/libstdc++-v3/libsupc++/new_op.cc:54

> 0x40126341: __gnu_cxx::new_allocator<char>::allocate(unsigned int, void const*)
at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-elf/build/build-cc-gcc-final/xt
ensa-esp32-elf/libstdc++-v3/include/bits/basic_string.h:2263
 (inlined by) std::allocator_traits<std::allocator<char> >::allocate(std::alloca
tor<char>&, unsigned int) at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-elf/b
uild/build-cc-gcc-final/xtensa-esp32-elf/libstdc++-v3/include/bits/alloc_traits.
h:360
 (inlined by) std::__cxx11::basic_string<char, std::char_traits<char>, std::allo
cator<char> >::_M_create(unsigned int&, unsigned int) at /home/ivan/e/crosstool-
NG/.build/xtensa-esp32-elf/build/build-cc-gcc-final/xtensa-esp32-elf/libstdc++-v
3/include/bits/basic_string.tcc:157
> 0x4012655b: std::__cxx11::basic_string<char, std::char_traits<char>, std::alloca
tor<char> >::reserve(unsigned int) at /home/ivan/e/crosstool-NG/.build/xtensa-es
p32-elf/build/build-cc-gcc-final/xtensa-esp32-elf/libstdc++-v3/include/bits/basi
c_string.h:2263
> 0x4017188d: std::__cxx11::basic_stringbuf<char, std::char_traits<char>, std::all
ocator<char> >::overflow(int) at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-e
lf/build/build-cc-gcc-final/xtensa-esp32-elf/libstdc++-v3/include/sstream:180
> 0x401244d6: std::basic_streambuf<char, std::char_traits<char> >::xsputn(char con
st*, int) at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-elf/build/build-cc-gc
c-final/xtensa-esp32-elf/libstdc++-v3/include/streambuf:436
> 0x40174c69: std::basic_streambuf<char, std::char_traits<char> >::sputn(char cons
t*, int) at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-elf/build/build-cc-gcc
-final/xtensa-esp32-elf/libstdc++-v3/include/streambuf:436
> 0x401341ca: int std::__copy_streambufs_eof<char, std::char_traits<char> >(std::b
asic_streambuf<char, std::char_traits<char> >*, std::basic_streambuf<char, std::
char_traits<char> >*, bool&) at /home/ivan/e/crosstool-NG/.build/src/gcc-5.2.0/l
ibstdc++-v3/src/c++98/streambuf.cc:49
> 0x4012460d: int std::__copy_streambufs<char, std::char_traits<char> >(std::basic
_streambuf<char, std::char_traits<char> >*, std::basic_streambuf<char, std::char
_traits<char> >*) at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-elf/build/bui
ld-cc-gcc-final/xtensa-esp32-elf/libstdc++-v3/include/streambuf:436
> 0x40124a8d: std::ostream::operator<<(std::basic_streambuf<char, std::char_traits
<char> >*) at /home/ivan/e/crosstool-NG/.build/xtensa-esp32-elf/build/build-cc-g
cc-final/xtensa-esp32-elf/libstdc++-v3/include/ostream:570
> 0x4014216e: HttpServerTask::processRequest(HttpRequest&) at E:/msys32/opt/devel/
HttpServer/components/cpp_utils/HttpServer.cpp:294
> 0x40142825: HttpServerTask::run(void*) at E:/msys32/opt/devel/HttpServer/compone
nts/cpp_utils/HttpServer.cpp:294
> 0x4014589c: Task::runTask(void*) at E:/msys32/opt/devel/HttpServer/components/cp
p_utils/Task.cpp:58

> Rebooting...

Any idea what is going wrong here?
Kind regards
Lothar

Actually yes, i do have an idea. Because we are trying to save some heap we have setup not so much stack size in HttpServerTask class and SocketServ class:
https://github.com/nkolban/esp32-snippets/blob/master/cpp_utils/HttpServer.cpp#L88
https://github.com/nkolban/esp32-snippets/blob/master/cpp_utils/SockServ.cpp#L176
Also you may have to change settings in menuconfig -> wifi for TX buffer

This one is a good one ... ugly as sin ... here is the code that exists today:
https://github.com/nkolban/esp32-snippets/blob/master/cpp_utils/HttpServer.cpp#L166
It looks like:
std::stringstream ss;
ss << ifStream.rdbuf();
response.sendData(ss.str());
ifStream.close();

If I'm reading it correctly, we read the file from the file system into RAM and then send it to the browser.  But wait ... what if the file is bigger than available RAM?  We fail in the way you describe.  What I need to do is chunk up the file and send it piece by piece so that at any one time we only have part of the file in RAM before it is transmitted to the partner.

Attempted to create myself a baseline of the problem so placed a 200K on flash and tried to serve it up.  Darn if it didn't work (it shouldn't have).  Then I realized I am using a WROVER board with 4.5MBytes of RAM so switched that off to become a normal ESP32 and recreated the problem as described.  I now have a base line to test again.
To be continued ...

Changes have now been made to the logic.  We now send in 4K chunks from the server to the browser.  The size of the chunk can be changed using HTTPServer#setFileBufferSize(size_t) if needed.
When you get a chance, pull down the latest code and see if we have a resolution.

What do I have to change in menuconfig? Type of TX buffers? or Max. number of TX buffers. And which value?

Now it works! Thany you very much for your precious support.

one more thing: I am setting the send buffer size to 2048 like this:
	HttpServer* pHttpServer = new HttpServer(); 	pHttpServer->setFileBufferSize(2048); 	pHttpServer->setRootPath("/sdcard/http");
The log shows that still:

D (10633) HttpResponse: >> sendData: 0x3ffd82f8, size: 1000
the buffer size is 1000? Am I missing something?

 ... I messed up again.  While testing out the fixes, I had hard-coded 1000 bytes as the buffer size.  Found that all was good but then realized that I had to expose a mechanism to make it configurable.  At that point I added setFileBufferSize() and getFileBufferSize() and then completly failed to use them in the logic that reads file data into the buffer ... as such, the buffer size in the code you were using was 1000 bytes and ignored the file buffer size attribute.  I have just uploaded a new fix and tested and seen with my own eyes that the segmented data is as expected.  Apologies again my friend.

No reason to apologize - I have to thank you.
I tested again and now it works perfectly.
But there are three more issues:

when I open a directory in the browser (e.g. "http://<IP_ADDRESS>/FW7") I can see the directory contents because I set:
pHttpServer->setDirectoryListing(true);
When I click on a link in this directory (e.g. "index.html") then this file is not opened because the browser attepts to open: "http://<IP_ADDRESS>/sdcard/http/FW7/index.html". So, it inserts "/sdcard/http" which I previously set as root path using:
pHttpServer->setRootPath("/sdcard/http");
when opening/requesting a  directory there are several error messages in the log:

E (50827) HttpResponse: << sendData

Sometimes if I open several directories or pages concecutively after some time the HttpServer does not respond any more - until now I was not able to reproduce this.

Do you have fixes for that?
  I actually enjoy trying to solve these puzzles.  However, let me ask a favor.  Can you create a separate issue for tracking each distinct puzzle?  This issue talks about serving large files.  I track each puzzle in its own issue.

thank you for opening these issues for me - it should have been my task...
On the third topic I need to do some more investigation in order to be able to reproduce it. Then I will open a new issue if necessary.

It is working perfect now.


Investigate High CPU usage from docker containers

Generic Issue

[x] Ensure this issue is not a bug report or feature request

Description
Docker images are running at very high CPU usage even when not handling any requests. ~This has not been observed in MacOS.~ It is consistently an issue in Ubuntu running in WSL, but is potentially also an issue in just standalone Linux servers in general (need to confirm).
Possible Solution
Unsure - needs more investigaiton
Additional context/Screenshots
when idle:

when processing requests:

we have also observed CPU Usage up to 700%

For comparison, I'm currently seeing CPU usage of ~50-65% on MacOS while not handling any requests. That also seems high for an idle state though.

I'm getting around ~40-70% when idle 🤔 ... so maybe MacOS does also have this problem?

This could be related to #80 . We're being forced to use --reload which may be causing performance issues as stated in this issue.

That seems right! When I query the processes running in the container, it's definitely due to uvicorn

Closed with previous uvicorn fixes


add Support for ByteArray in Core and Client 🚀

Adds ByteArrayType to Core and Client
Tasks:

[x] Implement in Core
[x] Tests ByteArrayType
[x] Implement in Client
[x] Test in Client

@michaelstaib this PR is ready for review

This one is now in the merge queue :) should go in today ...


Switch to using Node 16 Alpine as base for Docker image

Bring in latest features and reduce size thanks to Alpine.

Turns out it's tricky to get Puppeteer to play nice with Alpine.
node:16-buster-slim seems to work ok though, going with that.


typo fixed - low priority

Observed a typo while reading documentation so wanted to fix it along

Since this is a community submitted pull request, a Jenkins build has not been kicked off automatically. Can an Elastic organization member please verify the contents of this patch and then kick off a build manually?

Signed agreement, but observed no change to existing PR


Trying to go back to "graph" mode does not display the workflow in that mode

Created the standard GTEx workflow with bar chart and could not switch back from report mode
https://playbook-workflow-builder.cloud/report/e093b7e6-5244-32ec-78e7-7469f392c861

Can't reproduce


How to publish PointCloud from Unity to ROS?

[* ] I am at the right place and my issue is directly related to ROS#. General technical questions I would post e.g. at ROS Answers or Stack Overflow. For library-specific questions I would look for help in the corresponding library forums.
[* ] I have thoroughly read the Contributing Guideline and writing this issue is the right thing to do in my case.

I have a question!

[* ] I searched the Wiki, open and closed issues for an answer. I tried my best to find the answer by myself without success. I believe that the discussion we will have in this issue, and the solutions we might find, will help me, and likely other community members who have a similar problem.

Here is my question:
I want to publish the pointcloud from the Unity to ROS and I almost have everything for that. So as I attach the camera, I can get Depth and RGB (correct?).
This package already can send sensor_msgs::PointCloud2 but the problem is that the data has to be in bytes[] format. I also saw the script from this repo and this for loop seems to be doing a correct thing:
 Points[u + v * width].z = depth * invFocal;                         Points[u + v * width].x = u * depth * invFocal;                         Points[u + v * width].y = v * depth * invFocal;                         Points[u + v * width].rgb = new int[] { 0, 0, 0 };// rgbImage[u, v];
That is much better as we can divide data in X, Y and Z but with bytes that is one hell of a task for me. How can it be done correctly?

I haven't yet managed to send any data to ROS. So if I have an depth image from the unity camera of 640 x 480, it means I need a point cloud data array of size of => 640 * 480 * 6 (because X,Y,Z,R,G,B). Then divide that size by 6 and first populate X values up to SIZE / 6 and etc?

Also, I just realized that the format is actually byte[]. So correct me if I am wrong but the actual PC size will be 640 * 480 * 6 * 8

I think this is wrong. You need floats to store X, Y, Z values.
You need to have 3 floats + 3 uint8, so in total 15 bytes are needed for a single point in this case.
That is why you have to use BitConverters to convert 4 bytes of a float object to array of 4 bytes, so that you can place them in data field in the pointcloud2 message.
Here is an example of an interpretation of data field for getting a meaningful XYZRGB values.

considering this issue resolved by @berkayalpcakal .


Upgrade to Jedis 3.6.0

Codecov Report

Merging #7791 (e7b0dc4) into master (1a7ca1e) will decrease coverage by 0.19%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #7791      +/-   ##
============================================
- Coverage     59.47%   59.27%   -0.20%
+ Complexity      556      555       -1
============================================
  Files          1083     1083
  Lines         43755    43708      -47
  Branches       6380     6347      -33
============================================
- Hits          26022    25907     -115
- Misses        14876    14946      +70
+ Partials       2857     2855       -2

Impacted Files
Coverage Δ
Complexity Δ

...ng/transport/dispatcher/all/AllChannelHandler.java
68.96% <0.00%> (-20.69%)
0.00% <0.00%> (ø%)

...rg/apache/dubbo/remoting/utils/PayloadDropper.java
76.92% <0.00%> (-15.39%)
0.00% <0.00%> (ø%)

...ng/transport/dispatcher/WrappedChannelHandler.java
47.82% <0.00%> (-15.22%)
0.00% <0.00%> (ø%)

...bo/config/event/listener/LoggingEventListener.java
50.00% <0.00%> (-12.50%)
0.00% <0.00%> (ø%)

...dubbo/common/status/support/LoadStatusChecker.java
50.00% <0.00%> (-11.54%)
0.00% <0.00%> (ø%)

...in/java/org/apache/dubbo/common/utils/JVMUtil.java
81.13% <0.00%> (-11.33%)
0.00% <0.00%> (ø%)

...che/dubbo/remoting/transport/mina/MinaChannel.java
35.52% <0.00%> (-10.53%)
14.00% <0.00%> (-1.00%)

.../dubbo/remoting/transport/netty4/NettyChannel.java
54.45% <0.00%> (-8.92%)
0.00% <0.00%> (ø%)

...o/remoting/transport/ChannelHandlerDispatcher.java
62.00% <0.00%> (-8.00%)
0.00% <0.00%> (ø%)

...mmon/threadpool/support/fixed/FixedThreadPool.java
80.00% <0.00%> (-7.50%)
0.00% <0.00%> (ø%)

... and 37 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1a7ca1e...e7b0dc4. Read the comment docs.


script resources are broken when used with Ruby shipping with OSX and a non-root user

Install chef using gem with the Ruby bundled with 10.10
Then write a script resource that specifies a user:
    bash "something" do
        user my_user
        group my_group
        code "echo hello"
    end

This does not work because the temporary directory used to write out the script file is in the root's temporary directory.  However it will be my_user who will be executing this script & thus cannot see inside the temporary directory.  For example, the users temporary directory might be /var/folders/s1/t73ss6cd32z3468ct01fhgr80000gn/T/ but root's will be /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T (this is a random folder every boot).
The correct action here is that the script provider needs to copy the temporary file to a temporary directory owned by the user as well as changing the permissions or, alternatively, you could pipe the script directly into the invoked interpreter's stdin.

To clarify this is chef-client running as root, but with the execute resource changing the uid, not running chef-client itself as a non-root user.
Piping to stdin seems like a better solution but more work to overhaul the resource.  If there is a way to identify a tmpdir that we can write to that would be easier code most likely but the stdin solution probably has fewer other edge cases and will just work everywhere.

Technically chef-solo running as root but I think it's the same.  AFAIK, you cannot determine the temporary directory of a user with any kind of API as that would violate the security of the implementation.  You could sudo into the user & read the temporary directory that way (if it can be done at that layer).

Yeah we'd probably need to use mixlib-shellout's (relatively new) ability to get a proper login shell and that would hopefully give us a usable tmpdir and then we could both drop the file and execute as the user.  However, we'd have to use the "login shell" feature to drop the file, and if we wanted to support the current non-login shell use case we'd need to change to the user once to drop the file and then switch back to root and then switch back to the user as a non-login shell.  Which seems really fussy.

What about just using /tmp as the temporary directory when a user is set?

This is a really ugly bug and stole me a couple of hours today.  😡

The execute resource (and the script resources + bash and other resources which inherit from it) need to be able to use the login shell feature of mixlib-shellout.  With login true set on any of those resources then when switching from root to a different user in the execute resource on macos, the TEMP directory should be set to the appropriate directory for the target user rather than the old root user TEMP directory.

another dup of #7690

Oh that one is windows this is the mac one.

I think this issue we'll define as "execute resource needs to support mixlib-shellout login shell" option, which should clean up most of the Unix issues.  So that is the "definition of done" for this one.
I'm leaving #7690 open to track additional issues around how we should handle env variables on windows.

Fixed in #9932.


LIN-529 Bug fix: Match Airflow image with runtime Python version

Description
LineaPy may generate Airflow Docker files that won’t build. For example, if I’m working with LineaPy in a Docker container that uses jupyter/minimal-notebook the base image, it has uses a Python version different from that used in the Docker file generated by LineaPy (i.e., Python version in airflow/airflow:latest). This difference in Python versions then result in incompatibility of packages in requirements.txt.
Based on team discussion, the resolution will be to match the Airflow base image in the LineaPy-generated Docker file match the Python version used in the runtime environment.
Type of change

[x] Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?
Relevant tests already exist, so CI will kick in.

Confirmed (on my end) that this resolves the described issue, so merging the PR.

Thanks!


Feature Request: LD information

Hi ExAC team, I am interested in finding all SNPs in LD (linkage disequilibrium) with a query SNP. Specifically, I am looking for a service like the SNAP proxy search that is built from more comprehensive data than the 1000 Genomes Pilot. Your resource was suggested to us as a newer alternative.
Do you have any whole-genome sequences that allow you assess SNPs outside of the exome? Also, do you plan to release any of the LD information in your massive genome assemblage?

Unfortunately, we have no plans to do this at the present time - we do not yet have enough whole genome sequences to create a scaffold.


Faster? I think not

replaced JSONDecoder() with IkigaJSONDecoder for a geo-json (geometry data) file. The data is characterized by geometry structs each with some coordinate detail. Some of the structs have long coordinate arrays describing tracks or area boundaries. The JSON file size I used to test was 188K. Standard JSONDecoder took 0.024 seconds to decode, IkigaJSONDecoder was a factor 10 slower; 0.23 seconds. I can make data and structs available if you wish.

@gitjoost did you build and run IkigaJSON on release compilation mode?

Definitely happy to see some data that I can optimise for

Attached you will find a json file containing a geometry data and a geojson.swift file with the decoder structs.
Archive.zip

My measured times with your code:
DEBUG build w/ IkigaJSON: 230ms
DEBUG build w/ Foundation: 25ms
RELEASE build w/ IkigaJSON: 17ms
RELEASE build w/ Foundation: 12ms
But I'd also like to note that you're decoding a file into a String, then converting it into Data, which is not the most efficient solution. JSONNull could be a struct, and decoding the doubleArray or double could be improved. Fixing those; you can get faster times still:
IkigaJSON Release: 6ms
Foundation Release: 5.5ms
You're right that IkigaJSON is not as fast (or faster) on this file (thanks for reporting, I can look into this). I've already found a mis-optimisation in parsing Doubles thanks to you! I think the remainder of performance gap is due to your use of arrays, I'm looking into it

Hey that’s great to hear this is of help. The string normally comes from a database so file reads are not really my issue. And I definitely used the debug version as I see the same (roughly) factor 10 difference. I will take another look at my code but perhaps you’ll blow right passed whatever speeds I can come up with - will be using your component in that case.

import Foundation
import IkigaJSON
import CoreData

// GeoJSON decoding structures. This is necessary for getting to a
// track's complete (lon,lat,alt,dts) data which is not supported
// by Apple's standard decoder

class GeoJSON : Codable {
    struct FeatureCollection: Codable, Sequence {
        var features: [Feature]
        let type: String

        func makeIterator() -> IndexingIterator<[Feature]> {
            return features.makeIterator()
        }
    }

    struct Feature: Codable {
        let geometry: Geometry?
        let type: FeatureType
        let id : String
        var properties: Properties
    }

    enum FeatureType: String, Codable {
        case feature = "Feature"
    }

    struct Geometry: Codable {
        let coordinates: [GeoCoordinate]?
        let type: GeometryType
    }

    enum GeoCoordinate: Codable {
        case double(Double)
        case doubleArray([Double])

        init(from decoder: Decoder) throws {
            do {
                var container = try decoder.unkeyedContainer()
                var array = [Double]()
                if let count = container.count {
                    array.reserveCapacity(count)
                }
                while !container.isAtEnd {
                    array.append(try container.decode(Double.self))
                }
                self = .doubleArray(array)
            } catch {
                let container = try decoder.singleValueContainer()
                let x = try container.decode(Double.self)
                self = .double(x)
            }
        }

        func encode(to encoder: Encoder) throws {
            var container = encoder.singleValueContainer()
            switch self {
            case .double(let x):
                try container.encode(x)
            case .doubleArray(let x):
                try container.encode(x)
            }
        }

        func getValue() -> Any {
            switch self {
            case .double(let value):
                return value
            case .doubleArray(let values):
                return values
            }
        }
    }

    enum GeometryType: String, Codable {
        case lineString = "LineString"
        case point = "Point"
        case polygon = "Polygon"
    }

    struct Properties: Codable {
        let visible, labelVisible: Bool?
        let timestamp: Int?
        var title: String
        let propertiesClass: Class
        let updated: Int
        let creator: String
        let description, markerSize, markerSymbol: String?
        let markerRotation: JSONNull?
        let markerColor: String?
        let folderID: String?
        let strokeWidth: Int?
        let stroke: String?
        let weight: Int?
        let strokeOpacity: Double?
        let pattern, fill: String?
        let alias, number: String?
        let unresponsivePOD: String?
        let secondaryFrequency: String?
        let responsivePOD: String?
        let operationalPeriodID, previousEfforts, teamSize, timeAllocated: String?
        let cluePOD: String?
        let primaryFrequency: String?
        let status: String?
        let preparedBy, letter: String?
        let priority: String?
        let transportation: String?
        let resourceType: ResourceType?
        let fillOpacity: Double?

        enum CodingKeys: String, CodingKey {
            case visible, labelVisible, timestamp, title
            case propertiesClass = "class"
            case updated, creator, description
            case markerSize = "marker-size"
            case markerSymbol = "marker-symbol"
            case markerRotation = "marker-rotation"
            case markerColor = "marker-color"
            case folderID = "folderId"
            case strokeWidth = "stroke-width"
            case stroke, weight
            case strokeOpacity = "stroke-opacity"
            case pattern, fill, alias, number, unresponsivePOD, secondaryFrequency, responsivePOD
            case operationalPeriodID = "operationalPeriodId"
            case previousEfforts, teamSize, timeAllocated, cluePOD, primaryFrequency, status, preparedBy, letter, priority, transportation, resourceType
            case fillOpacity = "fill-opacity"
        }
    }
    enum Class: String, Codable {
        case appTrack = "AppTrack"
        case assignment = "Assignment"
        case configuredLayer = "ConfiguredLayer"
        case fieldWaypoint = "FieldWaypoint"
        case folder = "Folder"
        case marker = "Marker"
        case shape = "Shape"
    }

    enum ResourceType: String, Codable {
        case ground = "GROUND"
        case ground1 = "GROUND_1"
        case ground2 = "GROUND_2"
        case ground3 = "GROUND_3"
        case ohv = "OHV"
        case air = "AIR"
        case water = "WATER"
        case mounted = "MOUNTED"
        case dog = "DOG"
        case dogTrail = "DOG_TRAIL"
        case dogArea = "DOG_AREA"
        case dogHrd = "DOG_HRD"
    }

    struct JSONNull: Codable, Hashable {

        public static func == (lhs: JSONNull, rhs: JSONNull) -> Bool {
            return true
        }

        func hash(into hasher: inout Hasher) {
            hasher.combine(0)
        }

        public init() {}

        public init(from decoder: Decoder) throws {
            let container = try decoder.singleValueContainer()
            if !container.decodeNil() {
                throw DecodingError.typeMismatch(JSONNull.self, DecodingError.Context(codingPath: decoder.codingPath, debugDescription: "Wrong type for JSONNull"))
            }
        }

        public func encode(to encoder: Encoder) throws {
            var container = encoder.singleValueContainer()
            try container.encodeNil()
        }
    }

    // -------------------------------------------------------------------------------

    var featureCollection : FeatureCollection?

    init() {}

    func decode(geoJsonStr : Data) -> Bool {
        if geoJsonStr.isEmpty { return false }

        do {
            self.featureCollection = try IkigaJSONDecoder().decode(FeatureCollection.self, from: geoJsonStr)
            return true
        }
        catch {
            print("ERROR GeoJSON decode(): \(error)")
            return false
        }
    }
}

Updated my code and ran as release; JSONDecoder() and IkaJSONDecoder() are now the same speed; 0.0063 seconds.  Nice improvement on your side though not the speed improvement I was hoping for.  Notice that 0.0063 was measured on my M1Max, not the iPhone which is my target OS. Some of the GeoJSON files I need to process there are quite large so anything faster than JSONDecoder() is good.


chore(main): release 2.0.1

:robot: I have created a release beep boop
2.0.1 (2024-11-09)
Dependencies

Update eslint-config-plus-prettier (#112) (81e0781)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/aimeerivers/watchthis-user-service/releases/tag/v2.0.1 :sunflower:


Could not find the exact place where the training set is input?

This repo seems to only provide the prompt dataset in data folder, ignoring the needed training set (Yelp).
I cannot reproduce the experimental results demonstrated in the paper.
Could you please provide the full data and program which are necessary for the result reproduction?

Thanks for telling us about your issue, and I apologize for your experience.
The training data is in the prompt_tasks folder. For text style transfer, we use the preprocessed data which follows the tokenization format of GPT-2.
We will clean up the code further in the next update. I’m closing this now because it’s a clarification question

It seems that no programs read data from the prompt_tasks folder.

The file sql/rewards.py reads the data. You are also welcome to check out our restructured code (still WIP), which is located at the modular-interface branch

Many thanks. I check the restructured modular-interface branch.


TypeError: this.fileObj.file[func] is not a function

I have a problem to implement a upload file in controller assuming new Flow(opts)  as Flow object to upload after.
I follow the ng-flow documentation:

Full documentation
How can I use it?
How can I catch events?

My html init code in form:
<div flow-init  flow-files-submitted="controller.uploadFile($event, $files, $flow, 'profile')">

My controller is below. Assume that controller is the alias to controller.
       /**
         * Upload file asynchronously.
         *
         * @param event
         * @param files
         * @param $flow
         * @param itemType
         */
        vm.uploadFile = function (event, files, $flow, itemType) {
            console.log('=== Estoy acá en uploadFile...');

            var flowFile = files[0];
            console.log('flowFile output:');
            console.log(flowFile);

            var _added = !!{png: 1, gif: 1, jpg: 1, jpeg: 1}[flowFile.getExtension()];

            console.log('file extensions is:');
            console.log(_added);

            if (!_added)
                return null;

            vm.dropEnabled = false;

            var _target = '/api/profile/upload';

            var fileDefaults = {
                singleFile: true,
                testChunks: false,
                target: _target
            };

            var flow = new Flow(fileDefaults);
            flow.addFile(flowFile);

            console.log('new Flow() output:');
            console.log(flow);
            console.log(flow.upload()); // # <-- error here.

...

Error output:
TypeError: this.fileObj.file[func] is not a function
    at FlowChunk.send (ng-flow-standalone.js:1228)
    at ng-flow-standalone.js:306
    at each (ng-flow-standalone.js:1422)
    at ng-flow-standalone.js:304
    at each (ng-flow-standalone.js:1422)
    at Flow.uploadNextChunk (ng-flow-standalone.js:302)
    at Flow.upload (ng-flow-standalone.js:448)
    at ProductsController.vm.uploadFile (ProductsController.js:279)
    at fn (eval at compile (angular.js:15358), <anonymous>:4:426)
    at ChildScope.$eval (angular.js:18161)

I didn't what's happening, because the documentation don't let met more information about errors.

This solution isn't easy but I solved!
First, I solved the problem with changed opts as #61 issue.
Second, I set query parameters in uploadFile method as below:
...
$flow.opts.query = { foo:bar };

$scope.$emit('flow::filesSubmitted', event, $flow, files);

and I catch this event as documentation recommended and there, you will use $flow.upload() to send the file to the web server.
That's it, I learn best practices of ng-flow but the documentation is confuse about steps to follow.


function "hipDeviceGetPCIBusId" has already been defined

Error building HIP/samples/2_Cookbook/0_MatrixTranspose:
# make
results in
/opt/rocm/hip/include/hip/nvcc_detail/hip_runtime_api.h(778): error: function "hipDeviceGetPCIBusId" has already been defined
Dockerfile for developer image:
FROM nvidia/cuda:8.0-cudnn5-devel-ubuntu16.04

RUN \
	apt-get update && \
	apt-get install -y wget

RUN \
	wget -qO - http://packages.amd.com/rocm/apt/debian/rocm.gpg.key | apt-key add - && \
	sh -c 'echo deb [arch=amd64] http://packages.amd.com/rocm/apt/debian/ xenial main > /etc/apt/sources.list.d/rocm.list' && \
	apt-get update && \
	DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y hip_nvcc
ENV PATH /opt/rocm/bin/:$PATH

Same error when building other samples

Can you try by commenting following in
HIP_ROOT/include/hip/nvcc_details/hip_runtime_api.h
inline static hipError_t hipDeviceGetPCIBusId(char* pciBusId,int len,int
device)
{
return
hipCUDAErrorTohipError(cudaDeviceGetPCIBusId(pciBusId,len,device));
}
On Tue, Dec 20, 2016 at 10:42 PM, The Architect<EMAIL_ADDRESS>wrote:

Same error when building other samples
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/GPUOpen-ProfessionalCompute-Tools/HIP/issues/59#issuecomment-268300535,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AD_A91nQ-Ngyu3R2-Oppu6I18UfifjYYks5rKAxvgaJpZM4LSDYJ
.

Hi gargrahul!
Sure, I'll do it right now.
BTW I've found this code in intermediate file MatrixTranspose.cpp1.ii on lines 54195-54203:
inline static hipError_t hipDeviceGetPCIBusId(char* pciBusId,int len,int device)
{
    return hipCUDAErrorTohipError(cudaDeviceGetPCIBusId(pciBusId,len,device));
}

inline static hipError_t hipDeviceGetPCIBusId(char* pciBusId,int len,hipDevice_t device)
{
    return hipCUResultTohipError(cuDeviceGetPCIBusId(pciBusId,len,device));
}

Removed these lines. Now it's working.
Thank you!

gargrahul, could you please explain what was wrong?

On HIP/NVCC path hipDeviceGetPCIBusId(char* pciBusId,int len,int device)
was already implemented as hipDeviceGetPCIBusId(char* pciBusId,int
len,hipDevice_t device) since hipDevice_t is type defined to CUDevice
(which is type defined to int in CUDA)
On Tue, Dec 20, 2016 at 11:30 PM, The Architect<EMAIL_ADDRESS>wrote:

gargrahul, could you please explain what was wrong?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/GPUOpen-ProfessionalCompute-Tools/HIP/issues/59#issuecomment-268312585,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AD_A9xTZT-dA5pCtxGapt2XyEoqn4w-Vks5rKBfGgaJpZM4LSDYJ
.

Thanks again, gargrahul!
Should I close this issue?

I'm getting the same error after building from source (commit f052f43b3b3d48ac79f2111c7da74c24f1ad29b2). The fix works for me, but editing source doesn't feel like a solution...

This was fixed in the developer-preview branch on Dec 20th (commit 4704547). All development and bug fixes happen in the developer-preview branch before being merged into the master branch. Refer to the HIP README.md for details.

Thanks for the info !


Cannot use import statement outside a module

Just wanted to try this out in a Svelte 4 project, and immediately stumbled over this problem:
Cannot use import statement outside a module

/Users/else/ghq/github.com/elsbrock/svelte-vega-repro/node_modules/vega-embed/build/vega-embed.module.js:1
import { applyPatch } from 'fast-json-patch';
^^^^^^

SyntaxError: Cannot use import statement outside a module
    at wrapSafe (node:internal/modules/cjs/loader:1350:18)
    at Module._compile (node:internal/modules/cjs/loader:1379:20)
    at Module._extensions..js (node:internal/modules/cjs/loader:1518:10)
    at Module.load (node:internal/modules/cjs/loader:1249:32)
    at Module._load (node:internal/modules/cjs/loader:1065:12)
    at cjsLoader (node:internal/modules/esm/translators:318:15)
    at ModuleWrap.<anonymous> (node:internal/modules/esm/translators:258:7)
    at ModuleJob.run (node:internal/modules/esm/module_job:262:25)
    at async ModuleLoader.import (node:internal/modules/esm/loader:475:24)
    at async nodeImport (file:///Users/else/ghq/github.com/elsbrock/svelte-vega-repro/node_modules/vite/dist

Repro: https://github.com/elsbrock/svelte-vega-repro (this is a skeleton Svelte 4 project as generated by npx svelte@4 create-app.
Not the biggest JS expert; to me it looks like the affected module is already declaring itself as "type": "module".
Thank you for providing this module.
  System:
    OS: macOS 15.0
    CPU: (8) arm64 Apple M1
    Memory: 46.63 MB / 16.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 22.2.0 - /nix/store/rz5da1id31jgyax1yb6dms0mzpxkywds-nodejs-22.2.0/bin/node
    npm: 10.7.0 - /nix/store/rz5da1id31jgyax1yb6dms0mzpxkywds-nodejs-22.2.0/bin/npm
  Browsers:
    Chrome: 130.0.6723.92
    Safari: 18.0
  npmPackages:
    svelte: ^3.54.0 => 3.59.2

Hmm, odd. Do you have an idea what could be wrong? Could you compare your setup to https://github.com/vega/svelte-vega/tree/main/packages/svelte-vega-sample?

I'm sorry, but can I get that to run? Tried the following:
❯ yarn install
yarn install v1.22.22
[1/5] Validating package.json...
[2/5] Resolving packages...
[3/5] Fetching packages...
[4/5] Linking dependencies...
warning "commitizen > cz-conventional-changelog > @commitlint/load ><EMAIL_ADDRESS>has unmet peer dependency "@types/node@*".
warning " ><EMAIL_ADDRESS>has unmet peer dependency<EMAIL_ADDRESS>|| ^4.0.0-next.0 || ^5.0.0-next.0".
warning " ><EMAIL_ADDRESS>has unmet peer dependency<EMAIL_ADDRESS>|| ^4.0.0".
warning " ><EMAIL_ADDRESS>has unmet peer dependency "vega@*".
warning " ><EMAIL_ADDRESS>has unmet peer dependency "vega-lite@*".
warning " ><EMAIL_ADDRESS>has unmet peer dependency "vega-embed@*".
warning "workspace-aggregator-dca14ed5-6be8-491e-9403-299e625f16c2 > svelte-vega ><EMAIL_ADDRESS>has unmet peer dependency "<EMAIL_ADDRESS>warning Workspaces can only be enabled in private projects.
[5/5] Building fresh packages...
Done in 5.23s.
❯ cd packages/sveltekit-vega-sample
/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample
❯ yarn install
yarn install v1.22.22
info No lockfile found.
[1/4] Resolving packages...
warning svelte-check > svelte-preprocess > sorcery > sander ><EMAIL_ADDRESS>Rimraf versions prior to v4 are no longer supported
warning svelte-check > svelte-preprocess > sorcery > sander > rimraf ><EMAIL_ADDRESS>Glob versions prior to v9 are no longer supported
warning svelte-check > svelte-preprocess > sorcery > sander > rimraf > glob ><EMAIL_ADDRESS>This module is not supported, and leaks memory. Do not use it. Check out lru-cache if you want a good and tested way to coalesce async requests by a key value, which is much more comprehensive and powerful.
[2/4] Fetching packages...
[3/4] Linking dependencies...
warning " ><EMAIL_ADDRESS>has unmet peer dependency<EMAIL_ADDRESS>warning " ><EMAIL_ADDRESS>has unmet peer dependency "vega-lite@*".
warning "vega-embed ><EMAIL_ADDRESS>has unmet peer dependency "vega@*".
warning "vega-embed ><EMAIL_ADDRESS>has unmet peer dependency "vega-lite@*".
warning " ><EMAIL_ADDRESS>has unmet peer dependency "<EMAIL_ADDRESS>|| ^4.0.0-next.1".
[4/4] Building fresh packages...
success Saved lockfile.
Done in 5.65s.
❯ yarn dev
yarn run v1.22.22
$ vite dev
Forced re-optimization of dependencies

  VITE v5.4.10  ready in 956 ms

  ➜  Local:   http://localhost:5173/
  ➜  Network: use --host to expose
  ➜  press h + enter to show help
Error:   Failed to scan for dependencies from entries:
  /home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/src/routes/+page.svelte

  ✘ [ERROR] Failed to resolve entry for package "svelte-vega". The package may have incorrect main/module/exports specified in its package.json. [plugin vite:dep-scan]

    node_modules/esbuild/lib/main.js:1225:21:
      1225 │         let result = await callback({
           ╵                      ^

    at packageEntryFailure (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:46637:15)
    at resolvePackageEntry (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:46634:3)
    at tryNodeResolve (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:46450:16)
    at ResolveIdContext.resolveId (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:46200:19)
    at PluginContainer.resolveId (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:49015:17)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async resolve (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:49627:22)
    at async file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:49798:28
    at async requestCallbacks.on-resolve (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:1225:22)
    at async handleRequest (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:647:11)

  This error came from the "onResolve" callback registered here:

    node_modules/esbuild/lib/main.js:1150:20:
      1150 │       let promise = setup({
           ╵                     ^

    at setup (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:49786:13)
    at handlePlugins (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:1150:21)
    at buildOrContextImpl (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:873:5)
    at Object.buildOrContext (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:699:5)
    at /home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:2032:68
    at new Promise (<anonymous>)
    at Object.context (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:2032:27)
    at Object.context (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:1874:58)
    at prepareEsbuildScanner (file:///home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/vite/dist/node/chunks/dep-BWSbWtLw.js:49573:24)

  The plugin "vite:dep-scan" was triggered by this import

    script:/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/src/routes/+page.svelte?id=0:117:7:
      117 │ import 'svelte-vega'
          ╵        ~~~~~~~~~~~~~

    at failureErrorWithLog (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:1472:15)
    at /home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:945:25
    at runOnEndCallbacks (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:1315:45)
    at buildResponseToResult (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:943:7)
    at /home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:955:9
    at new Promise (<anonymous>)
    at requestCallbacks.on-end (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:954:54)
    at handleRequest (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:647:17)
    at handleIncomingPacket (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:672:7)
    at Socket.readFromStdout (/home/else/ghq/github.com/vega/svelte-vega/packages/sveltekit-vega-sample/node_modules/esbuild/lib/main.js:600:7)

You don't need to install anything in the same package. Try just yarn && yarn sample:svelte from the top-level. Make sure to remove any changes you added.

It looks like an issue with esm. If we switch to esm for Vega embed, things break because some dependencies don't support esm.

Fixed in https://github.com/vega/svelte-vega/pull/971

Thank you! Apologies I didn't get back yet. I'll give it a try.


Missing full stop

Thanks for a lovely tutorial!

Hi @AbdulGh any update on further improvements?
You can do changes like ,

indentation and format related ones
Adding tutorials it can follow.
Add more references through links

for ex:
this section here
Scaling a deployment
To list your deployments use the get deployments subcommand:
               kubectl get deployments
The output should be similar to:
NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
               kubernetes-bootcamp   1/1     1            1           11m

This section can use some cosmetic change that will align the output.
There can be other important improvements as well. Please look into this and update here . if there is no change from your side then you can close this PR as the single full stop doesn't improve this doc.


Feature request: Allow the build to use the system-installed protobuf lib

Describe the problem
Currently, it's impossible to use the system-installed protobuf library because the tensorflow build always uses the protobuf_archive version. There should be an option to use the one installed in the system.
Background: I package tensorflow for Arch Linux and we run into symbol conflicts if a user wants to use protobuf and tensorflow together in a binary because tensorflow's protobuf symbols conflict with the one installed in the system already.
Original Arch bug report: https://bugs.archlinux.org/task/56943

@drpngx could it be this question I posted a while ago https://github.com/tensorflow/tensorflow/issues/8403 ? I'd be very interested as well if any progress is made on this!

@danbarnes333 yes that's right on.
Maybe a stepping stone would be to allow people to link against the system protobuf during the configure step, via some environment variable or a configure flag. I think that would be a good contribution.
We should also consider, at some point, distributing pip packages that are dependent on a libprotobuf package.
CC @allenlavoie @skye

This would be useful to us as well.  We are currently stuck in a situation where the protobuf symbols in libtensorflow_framework.so are being clobbered by symbols in a custom libprotobuf from a different API revision that is being loaded to support the operations of our custom backend to TensorFlow.

We found a workaround by forcing bazel to use a protobuf version that matched the one used elsewhere on the system.  Here is a patch that will force usage of the 3.4.0 library, but one can also point to any other archive tag on github.
patch.tar.gz

@RichDubielzig that is what we have been doing, as well as hiding more symbols in the tensorflow shared library, and has been working ok. However @drpngx mentioned on my original issue that this isnt completely safe unless I misunderstood (about halfway down https://github.com/tensorflow/tensorflow/issues/8403) but perhaps things have changed since then. Either way simply building against the system protobuf would be great.

If this ever gets picked up you'll probably need protobuf to enable dynamic linking as well - https://github.com/protocolbuffers/protobuf/issues/8291

This is definitely still valid.

It's still relevant.

It's still a problem.

I don't see how #73933 fixes this.

Probably because issue # collided with https://github.com/openxla/xla/pull/16104, which was closed in the imported patch
Any way to reopen this?


feat[Filesystem]: Video Component for UI Canvas

Video Component for UI that can be include in Canvas gameobject. Component includes flip and loop.

Aside from the comments, one general question. Is the video able to be paused? Mainly asking because I intend to finish the pause PR this week (#499), and it'd be a great help if this was already doable.

Now there are options of Play and Pause video.

Looking great Eric! Just one thing.
When playing a video is constantly printing this in the console. Shouldn't it be only printed once?

Looking great Eric! Just one thing. When playing a video is constantly printing this in the console. Shouldn't it be only printed once?

A part from that, why isn't the video_test.avi showing the option to be rotated? Is it because of the format?

This is a debug log that I can remove, about opening_previw.avi, yes I the avi format can not be rotate, but .mp4 and .mov yes.


How to use eframe storage?

In eframe we are able to use storage: https://docs.rs/eframe/0.26.2/eframe/index.html#:~:text=app state using-,cc.storage,-(requires%20the%20%22persistence
How to do it when using egui_overlay?

you just serialize egui memory struct from the context using ctx.memory(|mem| serialize(mem)) and save it to a file. And then load it when starting your app, deserialize it (or create default) and assign it to context using ctx.memory_mut()
https://github.com/emilk/egui/blob/master/crates/eframe/src/native/epi_integration.rs#L348 shows you how eframe does it.


[Bug]: TypeError in DataSourceEditor APPSMITH-6CK

Is there an existing issue for this?

[X] I have searched the existing issues

Description
https://appsmith.sentry.io/issues/4177825829
Steps To Reproduce
NA
Public Sample App
No response
Environment
Production
Issue video log
No response
Version
Cloud

less than 300 events, won't fix


Introduce Chip Component

Resolves #508
I have temporarily added the Chip component to the lessons page for easier component testing.

Any desire to add a pointer-cursor to indicate this component is clickable?

Updated from 8150bded74e99abf3966cfef9c5171506ec57b68 to 387639dcf4aff634b4c319771be747434f26c49c (pr530.01 -> pr530.02, diff)
Addressed @benalleng comment

Changed the cursor to cursor pointer when hovering over the component.

@afterburn, @GBKS
A gentle ping!

Updated from 387639dcf4aff634b4c319771be747434f26c49c to 8d7a510fc33b68387f4b194c64a6cec96d4181f0 (pr530.02 -> pr530.03, diff)
Address @afterburn comment

Made the Chip component generalized and introduced the ProfileChip component for specific use cases.


Fix getStopCommand() to invoke getStopScript() instead of getStartScr…

…ipt()

@anujphadke Can you rebase and re-submit this change to pass the travis checks?

Done.


Update dependencies

Updates uglify-js, concat-with-sourcemaps, and copy-props. Closes #948, #949, and #953.

Thanks!


Set up GitHub Actions

See https://github.com/Goooler/kotlin-explorer/actions/runs/7510333742/job/20448621772.

https://github.com/Goooler/kotlin-explorer/actions/runs/8399957453/job/23006686932

What went wrong:
Could not determine the dependencies of task ':compileKotlinJvm'.
No matching toolchains found for requested specification: {languageVersion=17, vendor=JETBRAINS, implementation=vendor-specific} for LINUX on x86_64.
No locally installed toolchains match and toolchain download repositories have not been configured.

Add this plugin to ensure downloading proper Jetbrains JDKs, we can remove this plugin after removing
https://github.com/romainguy/kotlin-explorer/blob/cacd3b68bab8ce6f9021e83595a63673d1ddd9f0/build.gradle.kts#L19
https://github.com/romainguy/kotlin-explorer/blob/cacd3b68bab8ce6f9021e83595a63673d1ddd9f0/build.gradle.kts#L27

No, we can’t remove those, this runtime is necessary.

So we need this plugin now, JBR vendor setups are blocked by https://github.com/actions/setup-java/issues/399.


Update Home Assistant Docker image to version 2024.12.2

This pull request updates the Home Assistant Docker image to version 2024.12.2.

coverage: 99.913%. remained the same
when pulling d6fdde631e040d165082c43cdcd3e40aef26ed2d on update_home_assistant_docker_image
into 7279c0c85ec2dc2669e7580c9a4e11596ef8505e on master.


Update

New branch is now newly created

Why:
Closes [issue link]

What's being changed:

Check off the following:

[x] I have reviewed my changes in staging (look for "Automatically generated comment" and click Modified to view your latest changes).
[ ] For content changes, I have completed the self-review checklist.

Writer impact (This section is for GitHub staff members only):

[x] This pull request impacts the contribution experience

[ ] I have added the 'writer impact' label
[ ] I have added a description and/or a video demo of the changes below (e.g. a "before and after video")

Hello world

Someone hacked my all social media account and my And my home Internet IP address and my iCloud’s IP address my device I am in and the IP address creator helping people there’s a helping websites on the Wikipedia so whatever’s third-party websites using after my use all data so please help mepersonal information or personal data on my all Gmail account Samsung account Google Drive data Apple iCloud iPhone you are number all other social media all account and my domain name my service Canada account my face ID everything scammer you can help me my banking information my credit debit all other information so I want to hug you can help me put it to me pleaseAll my URL number on my domain name of my all service Canada account my all social media accounts without my permission my tax regarding all information you can help me protect me


Add sha512 sum support to file resource

sha512 hash support added to file resource.
Closes #655

Great enhancement, thank you for the contribution!
I made a minor tweak to the PR adding a test to verify this change. Please use the PR template/checklist in the future as it makes it easier to review PRs.
Thanks for the awesome change, should be in the next blackbird release (hopefully this week)!


Not working with jsx when tag contains self closing component.

Hi,
I just tried using a plugin in jsx file (React app), and it's not working properly when jsx contains self closing component. Here's an example code:
import React from 'react';
import MyCustomComponent from './MyCustomComponent';

class Test extends React.Component {
  render() {
    return (

          <MyCustomComponent />

    )
  }
}

Changing div in line with className="main", changes it only on that line, and changing div in line with className="testing" changes that line, and the last closing div tag. Self closing component (<MycustomComponent />) confuses it. When i change it to <MyCustomComponent></MyCustomComponent> everything works fine.

Thanks for reporting -- I thought that removing the matchit dependency would have unfortunate side-effects, we'll see what else shows up :).
I've pushed a potential fix. Could you try it out and let me know if it works for you?

Looks good now. Thanks for the quick fix! :)


Change scenarios to not be impacted by SSL issues with insecure option

cc @vmoravec

+1

@vuntz Could you please add fixme comments to the trove scenarios as well?

@vmoravec done

Note that I'm not 100% sure the bits in 2c are enough for trove, but we'll see soon.

+1 yep

+1


how to submit transaction between different openchain servers？

I have installed openchain servers in 3 nodes, such as <IP_ADDRESS>、<IP_ADDRESS>、<IP_ADDRESS>,  I can visit them  by openchain wallet (http://nossl.wallet.openchain.org/),  but transaction only happened in one server, cannot transfer funds from <IP_ADDRESS> to <IP_ADDRESS>. how to implement transaction between different servers ?

+1


WFLY-5019 ignore test

Windows Build 2249 is now running using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b

Linux with security manager Build 2065 is now running using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b

Linux Build 7193 is now running using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b

Linux with security manager Build 2065 outcome was SUCCESS using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b
Summary: Tests passed: 878, ignored: 281 Build time: 0:06:18

Windows Build 2249 outcome was SUCCESS using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b
Summary: Tests passed: 2955, ignored: 355, muted: 1 Build time: 0:49:34

Linux Build 7193 outcome was FAILURE using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b
Summary: Tests failed: 117 (117 new), passed: 2685, ignored: 352; org.wildfly:wildfly-testsuite-integration-domain Build time: 0:50:05
Build problems:
Failed tests detected
Process exited with code 137
Failed tests
org.jboss.as.test.clustering.single.provider.ServiceProviderRegistrationTestCase: org.jboss.as.test.clustering.single.web.SimpleWebTestCase: <no details avaliable>

org.jboss.as.test.clustering.single.provider.ServiceProviderRegistrationTestCase: org.jboss.as.test.clustering.single.registry.RegistryTestCase: <no details avaliable>

org.jboss.as.test.clustering.single.provider.ServiceProviderRegistrationTestCase: org.jboss.as.test.clustering.single.dispatcher.CommandDispatcherTestCase: <no details avaliable>

org.jboss.as.test.clustering.single.provider.ServiceProviderRegistrationTestCase: org.jboss.as.test.clustering.single.singleton.SingletonServiceTestCase: <no details avaliable>

org.jboss.as.test.clustering.single.provider.ServiceProviderRegistrationTestCase: <no details avaliable>

org.jboss.as.test.clustering.xsite.XSiteSimpleTestCase.testPutRelayedToBackups: <no details avaliable>

org.jboss.as.test.clustering.xsite.XSiteSimpleTestCase.testPutToBackupNotRelayed: <no details avaliable>

org.jboss.as.test.multinode.transaction.TransactionInvocationTestCase: org.jboss.as.test.multinode.ejb.timer.database.DatabaseTimerServiceMultiNodeExecutionDisabledTestCase: <no details avaliable>

org.jboss.as.test.multinode.transaction.TransactionInvocationTestCase: org.jboss.as.test.multinode.ejb.timer.database.DatabaseTimerServiceMultiNodeTestCase: <no details avaliable>

org.jboss.as.test.multinode.transaction.TransactionInvocationTestCase: org.jboss.as.test.multinode.remotecall.scoped.context.DynamicJNDIContextEJBInvocationTestCase: <no details avaliable>

org.jboss.as.test.multinode.transaction.TransactionInvocationTestCase: org.jboss.as.test.multinode.remotecall.RemoteLocalCallTestCase: <no details avaliable>

##### there are 107 more failed tests, see build details

Retest this please

Linux Build 7204 is now running using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b

Windows Build 2260 is now running using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b

Linux with security manager Build 2076 is now running using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b

Linux with security manager Build 2076 outcome was SUCCESS using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b
Summary: Tests passed: 878, ignored: 281 Build time: 0:06:16

Linux Build 7204 outcome was SUCCESS using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b
Summary: Tests passed: 2957, ignored: 354 Build time: 0:44:43

Windows Build 2260 outcome was SUCCESS using a merge of 4b9854af5c540a8831d7cb0194601d780da6bb6b
Summary: Tests passed: 2955, ignored: 355, muted: 1 Build time: 0:47:08


fix just consumers unregister serviceInstance

What is the purpose of the change
1、fix just consumers unregister serviceInstance
Brief changelog
1、set ServiceInstanceHostPortCustomizer Prioritized
2、add ServiceInstanceConsumerHostPortCustomizer fix just consumers unregister serviceInstance
Verifying this change
Start the consumer application, and the host and port will be registered

Checklist

[x] Make sure there is a GitHub_issue field for the change (usually before you start working on it). Trivial changes like typos do not require a GitHub issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[ ] Each commit in the pull request should have a meaningful subject line and body.
[ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[ ] Check if is necessary to patch to Dubbo 3 if you are work on Dubbo 2.7
[ ] Write necessary unit-test to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add sample in dubbo samples project.
[ ] Add some description to dubbo-website project if you are requesting to add a feature.
[ ] GitHub Actions works fine on your own branch.
[ ] If this contribution is large, please follow the Software Donation Guide.

Kindly incorporate additional contextual information to the purpose.  Additionally, please include some test examples for comprehensive coverage.

@chickenlj PTAL

Kindly incorporate additional contextual information to the purpose. Additionally, please include some test examples for comprehensive coverage.

The original interface level can support querying all consumers corresponding to the provider interface. After forcing the application level, we are unable to obtain real-time subscription data for consumers. By registering the serviceInstance of the consumer, the admin can obtain the corresponding serviceInstance, thereby obtaining real-time subscription data.

Kindly incorporate additional contextual information to the purpose. Additionally, please include some test examples for comprehensive coverage.

Obtaining all consumers information of the provider interface can better manage internal interfaces. For example, providing a reference for an offline interface. I think this is the original advantage compared to the Spring Cloud system.

add unit test

Please fix failed test cases.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (2cf54f7) 70.37% compared to head (a9cf89a) 70.33%.
Report is 6 commits behind head on 3.2.

:exclamation: Current head a9cf89a differs from pull request most recent head 95469d1. Consider uploading reports for the commit 95469d1 to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##              3.2   #13685      +/-   ##
==========================================
- Coverage   70.37%   70.33%   -0.05%
==========================================
  Files        1606     1607       +1
  Lines       70032    70062      +30
  Branches    10104    10110       +6
==========================================
- Hits        49287    49280       -7
- Misses      16108    16145      +37
  Partials     4637     4637

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Thanks for the contribution. Could you please explain in what scenario we would need this?

Thanks for the contribution. Please explain in what scenario we would need this.

Thanks for the contribution. Please explain in what scenario we would need this.
For example, when we want to know in admin which business consumers a certain provider interface has. If there is a lack of applications that only have consumers, the data obtained from business consumers will be incomplete.

Thanks for the contribution. Could you please explain in what scenario we would need this?

Prerequisite: dubbo. application. register mode=instance
For example, when we want to know in admin which business consumers a certain provider interface has. If only the consumer application is not registered, the admin will not be able to access all the data of business consumers.


Switched categoryid to utf-8 string to lower without lowering the non…

…-ASCII characters.

Resolves #767.


Show link to gist on browsers that do not service workers

It would be nice if there were a link to the gist when you try to run a gist on a browser that does not support service workers

good call :+1:


⚠ ClamAV has degraded performance

In bf7358d, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 74 ms

Resolved: ClamAV performance has improved in 71ca1b9.


Incomplete Menu on small screens

Describe the bug
Some menu's don't show completely when using small screens
To Reproduce
Steps to reproduce the behavior:

Reduce browser window
Got to site and settle realm
Click market
Click create new offer
The menu won't appear fully

Expected behavior
The menu should show completely irrespective of window size
Screenshots
https://cdn.discordapp.com/attachments/989804511868620800/1149665801851371571/Screenshot_2023-09-08_at_12.18.14.png
Desktop (please complete the following information):

OS: MAC
Browser chrome

fixed in #142


ITV.COM

Does anybody know what settings I need to add to zones.override to access itv.com outside the UK?
I've tried this:
zone "itv.com." {
type master;
file "/data/conf/db.override";
};
zone "itvstatic.com." {
type master;
file "/data/conf/db.override";
};
and then run: service netflix-proxy-admin restart

I realised I needed to restart the docker service. It works now!


Fix the docstring of Upsampling2D

The example shown in the docstring is somehow wrong.
The scope which avoids using cuDNN should be made right before applying max_pooling_2d function.
This PR fixes the example code.

LGTM!


fix: Check inputs type before doing truncation

Fixes https://github.com/getsentry/raven-js/issues/1275

approved pending the ‘max’ thing 👍
good fix and nice to dedupe some code


Connection to local IPFS node over RPC

I assume our IPFS operations will need to go through a local IPFS node's RPC endpoints.  Add this logic, probably as a member of a CAR Mirror client struct or something.

It looks like https://github.com/ipfs/go-ipfs-http-client is what I want.  It's an experimental package apparently, but looks better than https://github.com/ipfs/go-ipfs-api.
I can get a CoreAPI for the local daemon by calling NewURLApiWithClient.  Then things like traverse.Traverse from https://github.com/ipfs/go-merkledag/ are accessible.

I had this working successfully, but this approach isn't needed now since we are using a Kubo daemon plugin, per https://github.com/fission-codes/go-car-mirror/pull/9.


The styling of the  don't appear after building the site

The styling of the  don't appear after building the site with npm run build in github workflows and my environment
the the style of
``javascript
// some code here after building it's with no colors
``

and i know I intentionally put two just now

I had the same issue which is related to purgecss. Purgecss seems to drop the "" styling when there is no code block in the index.html file. it is weird, but I messed around with it and adding "" somewhere in my index.html fixed it on all pages.

Looks like PurgeCSS (PostCSS) runs before Hugo transforms Markdown to HTML.
Adding 'code' to the safelist section of purgecss should fix this


Fix amalgamation in master

Turns out changing "simdjson.h" to <simdjson.h> in src broke amalgamation. This reverts that change, just replacing <> with "".

Turns out changing "simdjson.h" to <simdjson.h> in src broke amalgamation

Do you mean that it breaks the script or that it breaks something more fundamental... That is, is it just a matter of fixing the script?
Anyhow, this does not seem controversial... so let us merge.

The script doesn't recognize #include <...>, only #include "...", so it was putting #include <simdjson.h> into singleheader/simdjson.cpp That means if you don't put -I to the location of simdjson.cpp, it won't work!
When I run make amalgamate in master, this failure happens. I am a little surprised, since I'm not in the habit of merging without CI succeeding, so either CI doesn't trigger the error, or I didn't check it.

@jkeiser You realize no doubt that we could easily fix the script and make it more robust... the key is this line...
if [[ "${line}" == '#include "'*'"'* ]]; then

Obviously, we could tweak this line so that it matches a more general pattern.


Avoid else after return

https://clang.llvm.org/extra/clang-tidy/checks/readability-else-after-return.html

Jenkins, test this please.

Jenkins CI test (for commit 662a8a013510ee4668b9f219a6fc3893f4adfbdf, target branch master) succeeded!

Travis failure seems unrelated.


[Reunion 0.5] PickMultipleFilesAsync Crashes Application / Exception Thrown

Describe the bug
In UWP, the FileOpenPicker works for both PickSingleFileAsync and PickMultipleFilesAsync.
In WinUI 3 Reunion 0.5 PickSingleFileAsync works, but PickMultipleFilesAsync causes a crash.
This issue has been seen before in a previous release.
Steps to reproduce the bug

Clone the WinUI3Reunion05_Problems.
Go to the WinUI3IssuesReunion05 folder.
Open the WinUI3IssuesReunion05.sln solution in Visual Studio 2019 Preview.
Build and run with Debug x64.
Click on the sixth item on the Navigation View ("FileOpenPicker")
Click on the second button, "FileOpenPicker: Multiple Files", and select zero, one, or more files to see the crash.

Expected behavior
We expect to be able to select multiple files and the FileOpenPicker not to crash.
Screenshots

Screenshot#1 - Expected Behavior (UWP)

Screenshot#2 - Current Behavior (WinUI3 Desktop)
Version Info
Targeting:
Target: Universal Windows
Target version: Windows 10, version 2004 (10.0; Build19041)
Min version: Windows 10, version 1809 (10.0; Build 17763)
NuGet package version:
[Microsoft.ProjectReunion 0.5.0]
[Microsoft.ProjectReunion.WinUI 0.5.0]

Windows 10 version
Saw the problem?

Insider Build (xxxxx)

May 2020 Update (19041)

November 2019 Update (18363)

May 2019 Update (18362)

October 2018 Update (17763)
Yes

April 2018 Update (17134)

Fall Creators Update (16299)

Creators Update (15063)

Device form factor
Saw the problem?

Desktop
Yes

Xbox

Surface Hub

IoT

Additional context

@Scottj1s, @manodasanW, and @angelazhangmsft, I think this is an issue with C#/WinRT projections. Can you take a look at the @eleanorleffler code, please?
This is a code snipped:

private async void OnSelectFolder(object sender, RoutedEventArgs e)
{
           var filePicker = new FileOpenPicker();
            IntPtr windowHandle = (App.Current as App).WindowHandle;

            var initializeWithWindow = filePicker.As<IInitializeWithWindow>();
            initializeWithWindow.Initialize(windowHandle);
            filePicker.FileTypeFilter.Add("*");

            IReadOnlyList<StorageFile> files = await filePicker.PickMultipleFilesAsync();
           if (files.Count > 0)
            {
                StringBuilder output = new StringBuilder("Picked files:\n");
                foreach (StorageFile file in files)
                {
                    output.Append(file.Name + "\n");
                }
                System.Diagnostics.Debug.WriteLine(output.ToString());
            }
            else
            {
                System.Diagnostics.Debug.WriteLine("Operation cancelled.");
            }
}

And this is error:
System.Reflection.TargetInvocationException
  HResult=0x80131604
  Message=Exception has been thrown by the target of an invocation.
  Source=System.Private.CoreLib
  StackTrace:
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor, Boolean wrapExceptions)
  at WinRT.SingleInterfaceOptimizedObject..ctor(Type type, IObjectReference objRef)
   at Windows.Storage.Pickers.FilePickerSelectedFilesArray.<.ctor>b__8_0()
   at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
   at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
   at System.Lazy`1.CreateValue()
   at Windows.Storage.Pickers.FilePickerSelectedFilesArray.get__default()
   at Windows.Storage.Pickers.FilePickerSelectedFilesArray.get_Count()
   at ReunionEbookReader.SettingsPage.<OnSelectFolder>d__11.MoveNext() in D:\Repos\ReunionEbookReader\ReunionEbookReader\ReunionEbookReader\SettingsPage.xaml.cs:line 100

  This exception was originally thrown at this call stack:
    [External Code]

Inner Exception 1:
COMException: The application called an interface that was marshalled for a different thread. (0x8001010E (RPC_E_WRONG_THREAD))

I think this code is executed in the UIThread, so no sure why they hit the marshaled exception.


More details

Hello, thank you for your rigorous work, I am interested in your research and look forward to more details about the training!

Please refer to our training code.


Logout

When I attempt to implement Logout, i get the message "HTTP Status 401: Unauthorized, Response: Error processing your OAuth request: Invalid oauth_verifier parameter". I have tried creating a new swifter object on logout as well as reusing the previous one and in both cases I get this exception. If I then close the app and reopen it, it works correctly. How do I go about clearing the swifter object?

`@IBAction func didTouchUpInsideLoginButton(_ sender: AnyObject) {
let failureHandler: (Error) -> Void = { error in
self.alert(title: "Error", message: error.localizedDescription)
    }

    if useACAccount {
        let accountStore = ACAccountStore()
        let accountType = accountStore.accountType(withAccountTypeIdentifier: ACAccountTypeIdentifierTwitter)

        // Prompt the user for permission to their twitter account stored in the phone's settings
        accountStore.requestAccessToAccounts(with: accountType, options: nil) { granted, error in
            guard granted else {
                self.alert(title: "Error", message: error!.localizedDescription)
                return
            }

            let twitterAccounts = accountStore.accounts(with: accountType)!

            if twitterAccounts.isEmpty {
                self.alert(title: "Error", message: "There are no Twitter accounts configured. You can add or create a Twitter account in Settings.")
            } else {
                let twitterAccount = twitterAccounts[0] as! ACAccount

                UserDefaults.standard.set(twitterAccount, forKey: "account")

                session().swifter = Swifter(account: twitterAccount)
                let tweetsViewController = self.storyboard!.instantiateViewController(withIdentifier: "TweetsViewController") as! TweetsViewController
                self.navigationController?.pushViewController(tweetsViewController, animated: true)
            }
        }
    } else {
        let url = URL(string: "swifter://success")!

        session().swifter.authorize(with: url, presentFrom: self, success: { handler in

            UserDefaults.standard.set(handler.0?.key, forKey: "key")
            UserDefaults.standard.set(handler.0?.secret, forKey: "secret")

            let tweetsViewController = self.storyboard!.instantiateViewController(withIdentifier: "TweetsViewController") as! TweetsViewController
            self.navigationController?.pushViewController(tweetsViewController, animated: true)
            }, failure: failureHandler)
    }
}`

and logout. I have tried it with the self.swifter line commented out and not commented out...
`
func logout() {
self.swifter = Swifter(consumerKey: "HIDDEN", consumerSecret: "HIDDEN")
    UserDefaults.standard.set(nil, forKey: "key")
    UserDefaults.standard.set(nil, forKey: "secret")
    UserDefaults.standard.set(nil, forKey: "account")
}`

Replacing the Swifter object should do the trick.
What about removing the userDefaults values first, and then create a new Swifter object?

It still did not work. I do have a workaround but it feels hacky. The error still comes in so in my failure handler, I'm checking what the failure kind is and just ignoring it if it is of type 401 and moving on. Oddly enough, I'm still getting a new key and secret as well as the error... I believe this is a bug in the library or at very least a bug in the example application, as my code is virtually identical to the example.


Datastores duplicated after a refresh

There was no way to identify uniquely datastore during a refresh
which resulted in duplications. This PR solves this issue.
Bug-Url:
https://bugzilla.redhat.com/1510053

@agrare @Ladas please review

 Bug 1510053 - CFME with RHV Graph refresh turned ON - RHV Datastores are displayed multiple times.

@pkliczewski I thought we couldn't just use :location for some reason but it is escaping me now

Oh it was because this is using the ems.storages relation which ignores storages from other EMSs, so it wasn't that using location didn't work but that it wasn't enough to really fix the issue.

@agrare :location is unique for RHV. Do you have suggestions how to fix it for InfraManager globally or should I move it to RHV specific defaults?
BTW. Travis failure is not related to this PR

@pkliczewski can you test that this picks up existing storages?  Maybe create a storage manually with an expected location and make sure that is picked up and not duplicated.

@agrare I can confirm it picks up existing storages

:+1: thanks @pkliczewski

@simaishi please backport https://github.com/ManageIQ/manageiq-providers-vmware/pull/135 once this is backported

Gaprindashvili backport details:
$ git log -1
commit 09f9fe66dafb95ae4fca0c01d8e945977573ad00
Author: Adam Grare<EMAIL_ADDRESS>Date:   Thu Nov 9 10:54:12 2017 -0500

    Merge pull request #16408 from pkliczewski/master

    Datastores duplicated after a refresh
    (cherry picked from commit c736542bd941e275f1765a27fe12989c9a73704d)


Support non localhost setups

Replaced hardcoded localhost with dynamic ws url generation
Fixes: https://github.com/assafelovic/gpt-researcher/issues/30

It looks like the request is succesful, but I never get a response when using a custom domain.
Here I made two requests from my custom domain and one from localhost:

It looks like the first two requests are entirely missing a host.