nonp-printable characters on 8bit locales

Checklist

[x] I'm reporting a bug unrelated to a specific site
[x] I've verified that I'm running yt-dlp version 2021.10.10
[x] I've checked that all provided URLs are alive and playable in a browser
[x] The provided URLs do not contain any DRM to the best of my knowledge
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read the opening an issue section in CONTRIBUTING.md
[x] I have given an appropriate title to the issue

Verbose log

PASTE VERBOSE LOG HERE

yt-dlp -v -o "%(title)s.%(ext)s" -f 135+140 https://www.youtube.com/watch?v=nmpl1PsHlmk
[debug] Command-line config: ['-v', '-o', '%(title)s.%(ext)s', '-f', '135+140', 'https://www.youtube.com/watch?v=nmpl1PsHlmk']
[debug] Encodings: locale KOI8-R, fs koi8-r, out koi8-r, pref KOI8-R
[debug] yt-dlp version 2021.10.10
[debug] Python version 3.10.0 (CPython 64bit) -<EMAIL_ADDRESS>[debug] exe versions: ffmpeg 4.4, ffprobe 4.4, rtmpdump 2.4
[debug] Optional libraries: Cryptodome, mutagen, sqlite, websockets
[debug] ANSI escape support: stdout = True, stderr = True
[debug] Proxy map: {}
[debug] [youtube] Extracting URL: https://www.youtube.com/watch?v=nmpl1PsHlmk
[youtube] nmpl1PsHlmk: Downloading webpage
[youtube] nmpl1PsHlmk: Downloading android player API JSON
[debug] Sort order given by extractor: quality, res, fps, source, codec:vp9.2, lang
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, source, vcodec:vp9.2(10), acodec, lang, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, id
[info] nmpl1PsHlmk: Downloading 1 format(s): 135+140
[debug] Invoking downloader on "https://r2---sn-hxb54vo-88vl.googlevideo.com/videoplayback?expire=1634418241&ei=4elqYeCvBYyxyQXr9IDwAg&ip=<IP_ADDRESS>&id=o-AC5mf_7h1oaSKIuiviWcXXAanzbM3kWiYcWUiNfONVUn&itag=135&source=youtube&requiressl=yes&mh=Pv&mm=31%2C29&mn=sn-hxb54vo-88vl%2Csn-n8v7znly&ms=au%2Crdu&mv=u&mvi=2&pl=21&vprv=1&mime=video%2Fmp4&gir=yes&clen=27297094&dur=660.000&lmt=1634145841439681&mt=1634395672&fvip=5&keepalive=yes&fexp=24001373%2C24007246&c=ANDROID&txp=5535432&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRQIgLBDpKendkKJlTsc5DBkCv7wgnADuF3wTrDYGw9oa188CIQDaH3HiNxqrME6FyoX2mXOLgAOP2aoY7BkEQE2zzJ5BMg%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl&lsig=AG3C_xAwRAIgP3ui8EKsSP-Bo0ohLLl1H3wepcyuWkUJp4ijUChOEq0CIEZcQXyofLrceXJTjbHPMmbuk_V_jmWb9NHdXIP7CKFL"
ERROR: 'charmap' codec can't encode character '\u2014' in position 10: character maps to
Traceback (most recent call last):
File "/usr/lib64/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1263, in wrapper
return func(self, *args, **kwargs)
File "/usr/lib64/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1301, in __extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/usr/lib64/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 1351, in process_ie_result
ie_result = self.process_video_result(ie_result, download=download)
File "/usr/lib64/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 2361, in process_video_result
self.process_info(new_info)
File "/usr/lib64/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 2783, in process_info
partial_success, real_download = self.dl(fname, new_info)
File "/usr/lib64/python3.10/site-packages/yt_dlp/YoutubeDL.py", line 2508, in dl
return fd.download(name, new_info, subtitle)
File "/usr/lib64/python3.10/site-packages/yt_dlp/downloader/common.py", line 397, in download
ret = self.real_download(filename, info_dict)
File "/usr/lib64/python3.10/site-packages/yt_dlp/downloader/http.py", line 371, in real_download
return download()
File "/usr/lib64/python3.10/site-packages/yt_dlp/downloader/http.py", line 264, in download
ctx.stream, ctx.tmpfilename = sanitize_open(
File "/usr/lib64/python3.10/site-packages/yt_dlp/utils.py", line 2068, in sanitize_open
stream = open(encodeFilename(filename), open_mode)
File "/usr/lib64/python3.10/encodings/koi8_r.py", line 12, in encode
return codecs.charmap_encode(input,errors,encoding_table)
UnicodeEncodeError: 'charmap' codec can't encode character '\u2014' in position 10: character maps to
Description

WRITE DESCRIPTION HERE
I use non-unicode 8-bit locale. The filenames are saved under this 8-bit locale.
Sometimes, the filenames at, for example, youtube contain characters non-existing under this 8-bit locale, e.g.  '\u2014'.
yt-dlp stops at this situation, while youtube-dl silently drops these characters on saving files. The option '--restrict-filenames' purges almost everything from filenames here. Possibly, it would be useful to extend the behavior of '--restrict-filenames' to non-ANSI 8-bit locales.

youtube-dl -v -o "%(title)s.%(ext)s" -f 135+140 https://www.youtube.com/watch?v=nmpl1PsHlmk
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-o', u'%(title)s.%(ext)s', u'-f', u'135+140', u'https://www.youtube.com/watch?v=nmpl1PsHlmk']
[debug] Encodings: locale KOI8-R, fs KOI8-R, out KOI8-R, pref KOI8-R
[debug] youtube-dl version 2021.06.06
[debug] Python version 2.7.18 (CPython) -<EMAIL_ADDRESS>[debug] exe versions: ffmpeg 4.4, ffprobe 4.4, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] nmpl1PsHlmk: Downloading webpage
[debug] Invoking downloader on u'https://r2---sn-hxb54vo-88vl.googlevideo.com/videoplayback?expire=1634423365&ei=5f1qYan3Mdn97gT4go7gDQ&ip=<IP_ADDRESS>&id=o-ACAE6mpRg-IiRNcXOjrPWYQJY1ECsCWRe7v5PHkAna8g&itag=135&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278%2C394%2C395%2C396%2C397%2C398%2C399&source=youtube&requiressl=yes&mh=Pv&mm=31%2C29&mn=sn-hxb54vo-88vl%2Csn-n8v7znly&ms=au%2Crdu&mv=u&mvi=2&pl=21&pcm2=yes&vprv=1&mime=video%2Fmp4&ns=KXZZweMvp5k1B_fQQNavQUwG&gir=yes&clen=27297094&dur=660.000&lmt=1634145841439681&mt=1634401441&fvip=5&keepalive=yes&fexp=24001373%2C24007246&c=WEB&txp=5535432&n=T6lj_UiqM3p4jGn_L&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cpcm2%2Cvprv%2Cmime%2Cns%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRgIhAOPxqeMUBSYhHpecFXVPkfneS2p9T689jUjRMaAoyMs6AiEA7_fRxQBkrF9mSkSgIWgNBbiYJOrYvmSBTH2CRM4jWNU%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl&lsig=AG3C_xAwRgIhAOLZMQ2kvDt_TFNggA0VSmisMRZ_UWPwOArNBC2snFvdAiEA6_H94l8vaNI77elf3TxIItnzkPdnO83sNLJ9z9IWCz0%3D'
[download] Destination: Лео и Тиг  Солнечный зайчик  Серия 58 _ Мультики для детей.f135.mp4
[download]   1.5% of 26.03MiB at 56.32KiB/s ETA 07:46^C

In order to reproduce issue I've made cyril-encoding.py:
import sys

import yt_dlp.version
from yt_dlp.utils import sanitize_open

print('python', sys.version)
print('yt_dlp', yt_dlp.version.__version__)

stream = sanitize_open('Лео и Тиг — Солнечный зайчик — Серия 58 _ Мультики для детей.f135.mp4', 'wb')

and running it after following steps at https://wiki.archlinux.org/title/locale#Generating_locales like this:
$ LC_ALL=ru_RU.KOI8-R python my-stuff/cyril-encoding.py
python 3.10.2 (main, Jan 15 2022, 19:56:27) [GCC 11.1.0]
yt_dlp 2<IP_ADDRESS>
Traceback (most recent call last):
  File "/home/arsene/PycharmProjects/yt-dlp/my-stuff/cyril-encoding.py", line 10, in <module>
    stream = sanitize_open('��� � ��� \u2014 ��������� ������ \u2014 ����� 58 _ �������� ��� �����.f135.mp4', 'wb')
  File "/usr/lib/python3.10/site-packages/yt_dlp/utils.py", line 678, in sanitize_open
    stream = locked_file(filename, open_mode, block=False).open()
  File "/usr/lib/python3.10/site-packages/yt_dlp/utils.py", line 2202, in __init__
    self.f = io.open(filename, mode, encoding=encoding)
  File "/usr/lib/python3.10/encodings/koi8_r.py", line 12, in encode
    return codecs.charmap_encode(input,errors,encoding_table)
UnicodeEncodeError: 'charmap' codec can't encode character '\u2014' in position 10: character maps to <undefined>
$

results the same problem.

Alternatively, setting PYTHONUTF8=1 or adding -X utf8 interpreter option might be enough.

https://github.com/yt-dlp/yt-dlp/issues/5341 was a dup of this, but since recent discussions happened there, I'm closing this instead. Pls track that issue for updates


Add editable DateField to TrainingProgress

Similar to Badge.awarded_at.

@pbanaszkiewicz  Is this still relevant given all the changes we've made to tracking instructor training progress?

@maneesha we still don't have such field on TrainingProgress. Currently we only have two fields that store creation timestamp and last update timestamp. This new field would indicate when specific training progress item was awarded / given, and this can be a different date than creation timestamp. So this is question to people handling awarding training progresses - do they want this additional information stored with training progress?

Thanks @pbanaszkiewicz  for clarifying.
I'll leave this to @ErinBecker  and @karenword  to assess.
Which of the following applies to when you want to see this fixed?

Would like to see this fixed as soon as possible, in the next 1-2 development cycles (i.e., by September 2019)
Would like to see this fixed later (by the end of 2019)
Would like to see this fixed, but possibly as part of a larger project that needs more planning
Not sure
No longer relevant - OK to close

Also deferring on this to @ErinBecker as a checkout item

No longer relevant - OK to close


Problem with iw package in kali-linux raspberrypi3b

Hello. I'm working with kali-linuxARM (2023.4 and 2024.1) on raspberrypi3b. Today I updated the system, and the iw package causes an error and does not allow berate_ap to work. It was working perfectly, I updated the iw package, and it stopped working. Evidence:
┌──(kali㉿kali-raspberry-pi)-[~]
└─$ sudo berate_ap wlan0 eth0 mywifi
WARN: brmfmac driver doesn't work properly with virtual interfaces and
      it can cause kernel panic. For this reason we disallow virtual
      interfaces for your adapter.
      For more info: https://github.com/oblique/create_ap/issues/203
WARN: Your adapter does not fully support AP virtual interface, enabling --no-virt
Config dir: /tmp/create_ap.wlan0.conf.cfcK6riD
PID: 7270
Network Manager found, set wlan0 as unmanaged device... DONE
Sharing Internet using method: nat
hostapd command-line interface: hostapd_cli -p /tmp/create_ap.wlan0.conf.cfcK6riD/hostapd_ctrl
Low entropy detected, starting haveged
haveged: command socket is listening at fd 4
Configuration file: /tmp/create_ap.wlan0.conf.cfcK6riD/hostapd.conf
wlan0: Could not connect to kernel driver
Using interface wlan0 with hwaddr b8:27:eb:91:cc:76 and ssid "mywifi"
wlan0: interface state UNINITIALIZED->ENABLED
wlan0: AP-ENABLED
^Cwlan0: interface state ENABLED->DISABLED
wlan0: AP-DISABLED
nl80211: deinit ifname=wlan0 disabled_11b_rates=0

Doing cleanup.. done

┌──(kali㉿kali-raspberry-pi)-[~]
└─$ sudo apt -qq -y install  iw
The following packages will be upgraded:
  iw
1 upgraded, 0 newly installed, 0 to remove and 523 not upgraded.
Need to get 101 kB of archives.
After this operation, 1,024 B disk space will be freed.
(Reading database ... 439007 files and directories currently installed.)
Preparing to unpack .../archives/iw_6.7-1_arm64.deb ...
Unpacking iw (6.7-1) over (5.19-1) ...
Setting up iw (6.7-1) ...
Processing triggers for man-db (2.12.0-3) ...
Processing triggers for kali-menu (2023.4.7) ...

┌──(kali㉿kali-raspberry-pi)-[~]
└─$ sudo berate_ap wlan0 eth0 mywifi
WARN: brmfmac driver doesn't work properly with virtual interfaces and
      it can cause kernel panic. For this reason we disallow virtual
      interfaces for your adapter.
      For more info: https://github.com/oblique/create_ap/issues/203
WARN: Your adapter does not fully support AP virtual interface, enabling --no-virt
Config dir: /tmp/create_ap.wlan0.conf.vKyuZhgO
PID: 7807

ERROR: Your adapter can not transmit to channel 1, frequency band 2.4GHz.

Doing cleanup.. done

┌──(kali㉿kali-raspberry-pi)-[~]

I have not delved deeper into the problem, I have not tried any other system.
Thanks for your attention.
EDIT
Okay. I have tried desktop kali-linux with the same result. Before updating iw everything works correctly, but when updating iw, it stops working.
The native version of iw is 5.19-1 and the updated version is 6.7-1
Thanks!

That is interesting, it might be related to issue #12 with the addition of decimals to the iw output


Compactor: upgrading to Prometheus 2.47.0 breaks the compactor

Thanos, Prometheus and Golang version used:
Prometheus: 2.47.0
Thanos: 0.32.2
Object Storage Provider:
Azure Blob
What happened:
After upgrading Prometheus to vesion 2.47.0 the compactor stopped working. All blocks after the upgrade have out-of-order chunks.
The compactor fails when it reaches a new block with error:
err="compaction: group 0@6061977523826161203: blocks with out-of-order chunks are dropped from compaction:  /data/compact/0@6061977523826161203/01HA7QRGQDB0Z4SV0BM2S4687R: 1157/361848 series have an average of 1.000 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"

What you expected to happen:
The compactor succeeds in compacting the blocks.
How to reproduce it (as minimally and precisely as possible):
Run Prometheus 2.47.0 with the compactor enabled.
Full logs to relevant components:
k exec --stdin --tty prometheus-stack-thanos-storegateway-0 -- thanos tools bucket verify --objstore.config-file=/conf/objstore.yml

ts=2023-09-15T08:01:10.601379049Z caller=index_issue.go:61 level=warn verifiers=overlapped_blocks,index_known_issues verifier=index_known_issues msg="detected issue" id=01HA90YWB92D35CFAS57RQESJ7 err="538/230171 series have an average of 1.186 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-15T08:01:12.606537326Z caller=index_issue.go:61 level=warn verifiers=overlapped_blocks,index_known_issues verifier=index_known_issues msg="detected issue" id=01HA8CBPM19NR869TN69ANARQV err="674/229044 series have an average of 1.221 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-15T08:01:14.526769349Z caller=index_issue.go:61 level=warn verifiers=overlapped_blocks,index_known_issues verifier=index_known_issues msg="detected issue" id=01HA8K7DVGHQJ04JTEETER4TP6 err="596/228614 series have an average of 1.215 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"

Anything else we need to know:
After reverting back to 2.46.0 the newly created blocks done give the error anymore and it seems to be solved.
Already discussed this problem on the CNCF slack: https://cloud-native.slack.com/archives/CK5RSSC10/p1694681247238809

We're on Prometheus 2.47 and thanos 0.32 since yesterday and have not yet experienced this issue, I've just checked our logs. We are trying to figure out why the compactor is suddenly using a LOT of disk io and running constantly though.

Thanos, Prometheus and Golang version used: Prometheus: 2.47.0 Thanos: 0.32.2
Object Storage Provider: Azure Blob
What happened: After upgrading Prometheus to vesion 2.47.0 the compactor stopped working. All blocks after the upgrade have out-of-order chunks. The compactor fails when it reaches a new block with error:
err="compaction: group 0@6061977523826161203: blocks with out-of-order chunks are dropped from compaction:  /data/compact/0@6061977523826161203/01HA7QRGQDB0Z4SV0BM2S4687R: 1157/361848 series have an average of 1.000 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"

What you expected to happen: The compactor succeeds in compacting the blocks.
How to reproduce it (as minimally and precisely as possible): Run Prometheus 2.47.0 with the compactor enabled.
Full logs to relevant components:
k exec --stdin --tty prometheus-stack-thanos-storegateway-0 -- thanos tools bucket verify --objstore.config-file=/conf/objstore.yml

ts=2023-09-15T08:01:10.601379049Z caller=index_issue.go:61 level=warn verifiers=overlapped_blocks,index_known_issues verifier=index_known_issues msg="detected issue" id=01HA90YWB92D35CFAS57RQESJ7 err="538/230171 series have an average of 1.186 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-15T08:01:12.606537326Z caller=index_issue.go:61 level=warn verifiers=overlapped_blocks,index_known_issues verifier=index_known_issues msg="detected issue" id=01HA8CBPM19NR869TN69ANARQV err="674/229044 series have an average of 1.221 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-15T08:01:14.526769349Z caller=index_issue.go:61 level=warn verifiers=overlapped_blocks,index_known_issues verifier=index_known_issues msg="detected issue" id=01HA8K7DVGHQJ04JTEETER4TP6 err="596/228614 series have an average of 1.215 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"

Anything else we need to know: After reverting back to 2.46.0 the newly created blocks done give the error anymore and it seems to be solved.
Already discussed this problem on the CNCF slack: https://cloud-native.slack.com/archives/CK5RSSC10/p1694681247238809

We are also on 2.47.0 and compactor have the same errors messages on One prometheus (not another one)
ts=2023-09-15T14:16:11.347496243Z caller=main.go:161 level=error err="group 0@5028037766798890583: blocks with out-of-order chunks are dropped from compaction:  /thanos/compact/compact/0@5028037766798890583/01HA4QQB074HFBBW6E48KFQA52: 20/8072687 series have an average of 1.000 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)
On this prometheus we do federation and not on the one working.
We rolled back to LTS and problem disapeared.

When you rolled back the versions, did you also delete the problematic chunks, which halted the compaction?

When you rolled back the versions, did you also delete the problematic chunks, which halted the compaction?

We have compactor with "--compact.skip-block-with-out-of-order-chunks", so the blocks are marked for no compaction, we did not delete anything to prevent data loss
Its a rollback, not a solution :)

we've encountered the same problem on a few deployments using AWS S3.

Got the same issue:
ts=2023-09-21T09:12:33.839849253Z caller=factory.go:53 level=info msg="loading bucket configuration"
ts=2023-09-21T09:12:33.840674439Z caller=compact.go:393 level=info msg="retention policy of raw samples is enabled" duration=720h0m0s
ts=2023-09-21T09:12:33.840718066Z caller=compact.go:400 level=info msg="retention policy of 5 min aggregated samples is enabled" duration=2160h0m0s
ts=2023-09-21T09:12:33.840729154Z caller=compact.go:403 level=info msg="retention policy of 1 hour aggregated samples is enabled" duration=8760h0m0s
ts=2023-09-21T09:12:33.840743143Z caller=compact.go:643 level=info msg="starting compact node"
ts=2023-09-21T09:12:33.840758713Z caller=intrumentation.go:56 level=info msg="changing probe status" status=ready
ts=2023-09-21T09:12:33.840845524Z caller=intrumentation.go:75 level=info msg="changing probe status" status=healthy
ts=2023-09-21T09:12:33.840866202Z caller=http.go:73 level=info service=http/server component=compact msg="listening for requests and metrics" address=<IP_ADDRESS>:10902
ts=2023-09-21T09:12:33.840877557Z caller=compact.go:1414 level=info msg="start sync of metas"
ts=2023-09-21T09:12:33.841054051Z caller=tls_config.go:274 level=info service=http/server component=compact msg="Listening on" address=[::]:10902
ts=2023-09-21T09:12:33.841081378Z caller=tls_config.go:277 level=info service=http/server component=compact msg="TLS is disabled." http2=false address=[::]:10902
ts=2023-09-21T09:12:38.314973248Z caller=fetcher.go:487 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=4.474026609s duration_ms=4474 cached=88 returned=52 partial=0
ts=2023-09-21T09:12:38.315015057Z caller=compact.go:1419 level=info msg="start of GC"
ts=2023-09-21T09:12:38.315167885Z caller=compact.go:1442 level=info msg="start of compactions"
ts=2023-09-21T09:12:38.315321271Z caller=compact.go:1062 level=info group="0@{env=\"infra\", k8s_cluster=\"eks-euc1-infra-01\", replica=\"1\"}" groupKey=0@6056763383787088098 msg="compaction available and planned" plan="[01HAS3YBZCWNQRHT3RVS43JXF2 (min time:<PHONE_NUMBER>027, max time:<PHONE_NUMBER>000) 01HASAT3Q01A5DZH3CKSSR0EJJ (min time:<PHONE_NUMBER>024, max time:<PHONE_NUMBER>000) 01HASHNTCDYPG96GQQ7RHK2T4V (min time:<PHONE_NUMBER>000, max time:<PHONE_NUMBER>000) 01HASRHJ8HB5ZD3WD2Y37K9A4Y (min time:<PHONE_NUMBER>010, max time:<PHONE_NUMBER>000)]"
ts=2023-09-21T09:12:38.315339484Z caller=compact.go:1071 level=info group="0@{env=\"infra\", k8s_cluster=\"eks-euc1-infra-01\", replica=\"1\"}" groupKey=0@6056763383787088098 msg="finished running pre compaction callback; downloading blocks" plan="[01HAS3YBZCWNQRHT3RVS43JXF2 (min time:<PHONE_NUMBER>027, max time:<PHONE_NUMBER>000) 01HASAT3Q01A5DZH3CKSSR0EJJ (min time:<PHONE_NUMBER>024, max time:<PHONE_NUMBER>000) 01HASHNTCDYPG96GQQ7RHK2T4V (min time:<PHONE_NUMBER>000, max time:<PHONE_NUMBER>000) 01HASRHJ8HB5ZD3WD2Y37K9A4Y (min time:<PHONE_NUMBER>010, max time:<PHONE_NUMBER>000)]" duration=4.307µs duration_ms=0
ts=2023-09-21T09:12:49.930839658Z caller=intrumentation.go:67 level=warn msg="changing probe status" status=not-ready reason="compaction: group 0@6056763383787088098: blocks with out-of-order chunks are dropped from compaction:  data/compact/0@6056763383787088098/01HASRHJ8HB5ZD3WD2Y37K9A4Y: 128/256707 series have an average of 1.125 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-21T09:12:49.930873487Z caller=http.go:91 level=info service=http/server component=compact msg="internal server is shutting down" err="compaction: group 0@6056763383787088098: blocks with out-of-order chunks are dropped from compaction:  data/compact/0@6056763383787088098/01HASRHJ8HB5ZD3WD2Y37K9A4Y: 128/256707 series have an average of 1.125 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-21T09:12:49.931001135Z caller=http.go:110 level=info service=http/server component=compact msg="internal server is shutdown gracefully" err="compaction: group 0@6056763383787088098: blocks with out-of-order chunks are dropped from compaction:  data/compact/0@6056763383787088098/01HASRHJ8HB5ZD3WD2Y37K9A4Y: 128/256707 series have an average of 1.125 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-21T09:12:49.931017837Z caller=intrumentation.go:81 level=info msg="changing probe status" status=not-healthy reason="compaction: group 0@6056763383787088098: blocks with out-of-order chunks are dropped from compaction:  data/compact/0@6056763383787088098/01HASRHJ8HB5ZD3WD2Y37K9A4Y: 128/256707 series have an average of 1.125 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)"
ts=2023-09-21T09:12:49.931099743Z caller=main.go:161 level=error err="group 0@6056763383787088098: blocks with out-of-order chunks are dropped from compaction:  data/compact/0@6056763383787088098/01HASRHJ8HB5ZD3WD2Y37K9A4Y: 128/256707 series have an average of 1.125 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)\ncompaction\nmain.runCompact.func7\n\t/app/cmd/thanos/compact.go:427\nmain.runCompact.func8\n\t/app/cmd/thanos/compact.go:476\ngithub.com/oklog/run.(*Group).Run.func1\n\t/go/pkg/mod/github.com/oklog/run@v1.1.0/group.go:38\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_arm64.s:1172\ncompact command failed\nmain.main\n\t/app/cmd/thanos/main.go:161\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:250\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_arm64.s:1172"

happened after we upgraded our prometheus instances to v2.47.0 and turned on native-histograms.

We do not have "native-histograms" in our conf
@sylr Do you do federation on your prometheus ?

We do not have "native-histograms" in our conf @sylr Do you do federation on your prometheus ?

No I do not do federation.

Same issue for us. We did try running sidecar with thanos v0.31 since we use kube-prometheus-stack chart and we thought the problem might be in the 0.32 sidecar that comes in the latest chart version , but didn't help, issue was still there.
The streams we get from Thanos receiver get compacted without problems.

Just encounter the same in our setup.
Thanos, Prometheus version used:
Prometheus: 2.47.0
Thanos: 0.32.2
object storage: s3
Thanos compactor falling due to out-of-order chunks, tried the skip-block-with-out-of-order-chunks option, but it was encountering it with almost with every chunk, so we rolled back Prometheus to 2.46.0.

I had the same problem, so I added the log print to find out where the problem was, and at https://github.com/prometheus/prometheus/pull/12874 found that the problem had been fixed in prometheus, but It hasn't been released yet.

I don't want to delete block because of this problem, I want a tool that fixes the problem, and now I'm going to add a directive to the thanos tool to handle the problem.

Can we upgrade prometheus without a release and tag a patch version a thanos.
This is a serious issue that merits actions.
Mimir already did the upgrade https://github.com/grafana/mimir/pull/6107.

Ack!

@saswatamcode After taking another look, this seems a Prometheus issue only. Thanos is still using an old version of Prometheus so not affected by this bug.
It is just the bad blocks created by Prometheus causing compactor to fail.

is that fix? I made some code changes in my branch, testing it, I'm on vacation here, go back after the holiday to see the actual situation. If it's fixed, I'll cancel the code I changed.

@mickeyzzc No, since the bad blocks are created by Prometheus, we need a tool to repair the bad blocks. Thanos doesn't cause those blocks to be corrupted.

I'm testing my environment, and the anomaly block has passed the fix.
@saswatamcode @yeya24

@saswatamcode @yeya24 I'm testing my environment, and the anomaly block has passed the fix.

You mean the faulty blocks got compacted ?

@saswatamcode @yeya24 I'm testing my environment, and the anomaly block has passed the fix.

You mean the faulty blocks got compacted ?
It's possible in this case.
After rewriting, only two neighbors of the same sample point will appear. The downsampled sample will also be processed, but it is better to correct it with tools.

Hello,
This fix:
https://github.com/prometheus-community/helm-charts/pull/3877
Does not fix issue. The logs out-of-order disappeared, but the issue stays the same - metrics are not pushed to store.

Hello,
This fix:
https://github.com/prometheus-community/helm-charts/pull/3877
Does not fix issue. The logs out-of-order disappeared, but the issue stays the same - metrics are not pushed to store.

Sounds like you have a different issue. The issue here was not that blocks are not pushed to the store but that the blocks in the store were out of order and could not be compacted.

@rouke-broersma You are right. My appologies. We assumed this issue resulted in unavailability of data in the storage. Bet as I see now, these are two different issues.


Updating the list functionality

Jesus collaborator PR's are awkward

Now, you can set a rating and a watching status. This will be useful for the next set of PR's which will allow for list formatting, giving a user a fully functional offline watch list.

Things to fix:
Not backwards compatible.
No way to set the metadata yourself (afaik)
No way to see the metadata while in the anime menu

Bug - somehow the user input numbers for the values in the list comes before the sort, which causes user input problems. Laggy and I are fixing it

Bug has been fixed.


enable MKL in GP

@karlnapf

The Python script can be found at https://gist.github.com/yorkerlin/9a64e00543c10d75db793b843ea00623

The script should be turned into a cookbook for the GPs......
At least a meta example (super easy)
But I can do that

Can you please update the news file?

And as said, an api example would help


More robust access optimization for tile download route

The history here is that we deploy large_image into some environments
in which the access.public decorator has its behavior changed to be
equivalent to access.token, and the optimization used to facilitate
cookie-based access to the tile endpoint does not work in that condition.
By also removing access.public and explicitly disabling the access
level checking, we can make this optimization work in that environment.

@zachmullen This seems like a significant usability problem with Girder's API. Can we fix this upstream so this sort of workaround is not necessary?

@brianhelba I agree, I think this indicates that having cookie as a separate decorator is not a great idea, and it should simply be an argument to the other access decorators.

https://github.com/girder/girder/issues/2936


Patch installation problem

Hello, I would like to install the patch that you created for mh3u on my New 3ds but I have big difficulties with the procedure to follow for the installation via homebrew. Could you help me?

What are you having issues with, specifically?

I don't know where to put the patch I downloaded in my 3ds folders and if they need to be modified to make it work.

And above all, how do you know if the patch is working properly?

You can refer to this guide for how to apply the patch
https://gist.github.com/PixelSergey/5dbb4a9b90d290736353fa58e4fcbb42
Or check out the "Enable game patching" section from the official Luma3DS wiki
https://github.com/LumaTeam/Luma3DS/wiki/Optional-features
If you need more help with the installation, you can ask for help in Nintendo Homebrew Discord server
https://discord.gg/MWxPgEp

Thanks for the links and help but unfortunately I couldn't figure out how to be sure the patch worked since the changes to it are hard to see.

You'll have to use Athena's Fish Finder to check the charm table that you're on. Once you do that, save the game, load the save file again, then go back to the first step and see if the new result is a different charm table.

Ok I'll see if I can find a working version because the online application has closed

Well after installing a working version of Athena's, I unfortunately messed up the installation somewhere so I don't know what to do to succeed in installing the patch


Add support for NTLM authentication

Some Windows-based servers only support NTLM authentication and don't work with the more standard types.  This patch adds support for NTLM auth so that cpr can be used to interact with these servers.

Nice work.
Could you please add some tests for this and create a PR at the gh-pages branche to update/add documentation for this?

I don't think I can add any tests unfortunately as from memory the server used in the tests didn't support NTLM.

OK.
Then please solve the conflicts and create a PR for documentation of this feature.

Can we allow merge without proper documentation (but with resolved conflicts), since very important features are missed?

@ZaMaZaN4iK If somebody is willing/planing to do the documentation for NTLM yes.
But until then I prefer not to merge undocumented code.

@adam-nielsen can you please take some precious time and rescue and help all of us by documenting and contributing to this amazing project, I'm sure everyone who'll use it will be very greatfull to your contribution :)

Will do my best, too many deadlines :)


New Featute : Dark mode

I have tried #50.
Please let me know is it Ok or not? Correct me if I am wrong!!

Thank you, Harshil! I haven't checked properly yet but can wo do something for this:

The toggle is not clickable because of that github icon
Maybe we can bring the toggle a little down (along with the content) so adding top padding to that main container should do the job.
Also maybe we can make the dark color a little darker and turn inputs dark as well.
You can refer to this CSS:
https://github.com/abelljs/abell-starter-minima/blob/main/theme/styles/inlined/global.css.js

Oh and off-topic of this PR but your profile is not showing up in the commits and if you send PRs to repositories without that, even after getting PR merged your name won't show up in the contributors.
I guess its because email and name in your terminal is not configured or the email in your GitHub account is different from the one set in terminal.
Maybe try running git config --global user.email and see what email id it outputs and then set/add that email id in GitHub from https://github.com/settings/emails

Thank you, Harshil! I haven't checked properly yet but can wo do something for this:

The toggle is not clickable because of that github icon
Maybe we can bring the toggle a little down (along with the content) so adding top padding to that main container should do the job.
Also maybe we can make the dark color a little darker and turn inputs dark as well.
You can refer to this CSS:
https://github.com/abelljs/abell-starter-minima/blob/main/theme/styles/inlined/global.css.js

Ohh Thanks,I will change that.


Error when trying to load txt summary file.

Hi, I'm having a problem with nanopolish index. the core gets dumped after nanopolish cann't open a summary file. However, the permissions and path of the files that is trying to open are ok (they work when call directly on cmd). I don't understand why it is calling the file as H5F. I have tons of information so, I couldn't afford to skip the summary files. I'd appreciate if you could take a look to the example of the error I get and point me to what I should fix, check or look into.
Many thanks
this is going in a shell script:
#!/bin/bash
Dir1a=/path/run1/fast5s
Dir1b=/path/run2/fast5s
Summary1=/path/run1/sequencing_summary.txt
Summary2=/path/run2/sequencing_summary.txt
FqReads=Chopped.fastq
ls $Summary1 $Summary2 > summary_files.fof
Nanopolish=/software/nanopolish/nanopolish
source activate nanopolish-python3
$Nanopolish index -d $Dir1a -d $Dir1b -f summary_files.fof $FqReads
Here is the error:
blah ... (several lines of the reads with paths...)
[readdb] num reads: 2343834, num reads with path: 2209535
Loaded 1 from fofn
HDF5-DIAG: Error detected in HDF5 (1.8.14) thread<PHONE_NUMBER>6400:
#000: H5F.c line 604 in H5Fopen(): unable to open file
major: File accessibilty
minor: Unable to open file
#1: H5Fint.c line 1085 in H5F_open(): unable to read superblock
major: File accessibilty
minor: Read failed
#2: H5Fsuper.c line 277 in H5F_super_read(): file signature not found
major: File accessibilty
minor: Not an HDF5 file
terminate called after throwing an instance of 'hdf5_tools::Exception'
what(): /Raw/Reads/Read_1895/duration: /path/run1/sequencing_summary.txt: error in H5Fopen
/var/spool/gridengine/job_scripts/34801: line 46: 63778 Aborted (core dumped) $Nanopolish index -d $Dir1a -d $Dir1b -f summary_files.fof $FqReads

Can you paste the contents of the summary fofn? cat summary_files.fof. Also can you confirm you're using the latest version (0.10.1)?

Hi, Just a follow up. The issue above is fixed in the version 0.10.1.
Many thanks !
D

Hi, Just a follow up. The issue above is fixed in the version 0.10.1.
Many thanks !
D


[neuralnet] check stop_cb by every layer

Check stop_cb before doing forwarding/calcGrading/calcDerivative by every layer to stop training more quickly.

Signed-off-by: hyeonseok lee<EMAIL_ADDRESS>

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2015. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.


Issue 2: Inconsistent Behavior for 'Enter' Key Detection

The keydown event handler uses e.keyCode, which may cause inconsistent behavior for detecting the 'Enter' key across different browsers.

The PR has been raised, please do review it.


[Feature Request] Set max_htlc size according to new research.

Zerobasefee is now a large part of the lightning network. Renee has done additional research on max htlc settings to prevent channel drain and increase payment success. Id like to see this implemented in clboss especially for those of us running zerobasefee. The logic and research can be found here:
https://github.com/lnresearch/Flow-Control-on-Lightning-Network-Channels-with-Drain-via-Control-Valves/blob/main/htlc_maximum_msat as a valve for flow control on the Lightnig network.ipynb

Doesn't this require collaboration between nodes?


Incorrect tailscale and usb web interface instructions

I submitted https://github.com/Eeems-Org/remarkable.guide/pull/49 after user confirmation, but upon configuring tailscale myself I have found that tailscale can only share services running on localhost.
I have proposed a package in toltec that will allow the web interface to be accessed over tailscale. Upon that package being merged, the guide can be updated to include/point to the new instructions.
In the meantime it may be advisable to revert #49.

In the meantime it may be advisable to revert #49.

As this would remove the anchor that people may be linking to, this would not be the correct solution for the site. Updated content with a workaround to get this to work, or explaining that it's not currently possible would need to be added, or the anchor added to another place on the page.

Would it be advisable to wait for https://github.com/toltec-dev/toltec/pull/840 or shall I open a pull request here stating that the specific section/anchor is under maintenance?

Would it be advisable to wait for toltec-dev/toltec#840 or shall I open a pull request here stating that the specific section/anchor is under maintenance?

Either works for me. It'll be a little while before https://github.com/toltec-dev/toltec/pull/840 gets to stable.

Since the new package is in stable, are you planning on opening a pr to update this?


[#154957353] Remove s3init.sh

What
Remove usage of our ancient s3init.sh script in favour of self-initialising S3 resources, which we implement in https://github.com/alphagov/paas-s3-resource/pull/8.
How to review
Code review should suffice. We have tested migrating, creating and destroying dev environments with this.
🐝 Merge the s3-resource PR and update this PR's [TMP] commit with the DockerHub tag of the resulting container 🐝
Who can review
Not @46bit @bandesz.

Updated to the "real" version of s3-resource.

Updated temporary commit.

Do we still need concourse/init_files/*, or should they be removed?

It looks like at least one use remains https://github.com/alphagov/paas-bootstrap/blob/6bf510b89b5257e4fa4454c66c2c55a31c850952/concourse/pipelines/destroy-bosh-concourse.yml#L438.


Use stack and go hlint clean

I hope you'll find these things useful.

Thanks! These are incredibly useful!

Thanks for merging.  Beware, I have only compiled and ran the tests included.  With the limited reach of the test suit, I have no clue, whether I haven't introduced any bugs.


Crash when launching for Unreal 4.23.1

Using Unreal 4.23.1 on a Mac running Mojave, the plugin works in the editor but crashes on launch with the error "Could not find SuperStruct OscReceiverActor to create BP_OSC_C". This error seems to be similar to #62.
Any ideas on how to fix this (or am I forgetting to do something prior to launch)?
Thanks for any help!
Assertion failed: [File:/Users/build/Build/++UE4/Sync/Engine/Source/Runtime/CoreUObject/Private/Serialization/AsyncLoading.cpp] [Line: 3610] Could not find SuperStruct OscReceiverActor to create BP_OSC_C
FGenericPlatformMisc::RaiseException(unsigned int) Address = 0x1065d8d6b (filename not found) [in UE4Game]
FMacErrorOutputDevice::Serialize(wchar_t const*, ELogVerbosity::Type, FName const&) Address = 0x1066e86b3 (filename not found) [in UE4Game]
FOutputDevice::LogfImpl(wchar_t const*, ...) Address = 0x1067a1169 (filename not found) [in UE4Game]
AssertFailedImplV(char const*, char const*, int, wchar_t const*, __va_list_tag*) Address = 0x10674ce1d (filename not found) [in UE4Game]
FDebug::AssertFailed(char const*, char const*, int, wchar_t const*, ...) Address = 0x10674cf6b (filename not found) [in UE4Game]
FAsyncPackage::EventDrivenSerializeExport(int) Address = 0x106a30bc5 (filename not found) [in UE4Game]
FAsyncPackage::ProcessImportsAndExports_Event() Address = 0x106a29e1d (filename not found) [in UE4Game]
FAsyncPackage::Event_ProcessImportsAndExports() Address = 0x106a296f2 (filename not found) [in UE4Game]
FAsyncLoadEventQueue::PopAndExecute(FAsyncLoadEventArgs&) Address = 0x106a38767 (filename not found) [in UE4Game]
FAsyncLoadingThread::ProcessAsyncLoading(int&, bool, bool, float, FFlushTree*) Address = 0x106a36c98 (filename not found) [in UE4Game]
FAsyncLoadingThread::TickAsyncThread(bool, bool, float, bool&, FFlushTree*) Address = 0x106a4140a (filename not found) [in UE4Game]
FAsyncLoadingThread::TickAsyncLoading(bool, bool, float, FFlushTree*) Address = 0x106a402dd (filename not found) [in UE4Game]
FlushAsyncLoading(int) Address = 0x106a44d38 (filename not found) [in UE4Game]
LoadPackageInternal(UPackage*, wchar_t const*, unsigned int, FLinkerLoad*, FArchive*, FUObjectSerializeContext*) Address = 0x106c37523 (filename not found) [in UE4Game]
LoadPackage(UPackage*, wchar_t const*, unsigned int, FArchive*, FUObjectSerializeContext*) Address = 0x106c349bc (filename not found) [in UE4Game]
UEngine::LoadMap(FWorldContext&, FURL, UPendingNetGame*, FString&) Address = 0x10931030c (filename not found) [in UE4Game]
UEngine::Browse(FWorldContext&, FURL, FString&) Address = 0x10930c838 (filename not found) [in UE4Game]
UGameInstance::StartGameInstance() Address = 0x108a41a0c (filename not found) [in UE4Game]
UGameEngine::Start() Address = 0x108a29c2e (filename not found) [in UE4Game]
FEngineLoop::Init() Address = 0x105eb1bb9 (filename not found) [in UE4Game]
GuardedMain(wchar_t const*) Address = 0x105ec1766 (filename not found) [in UE4Game]
-[UE4AppDelegate runGameThread:] Address = 0x105ec9baf (filename not found) [in UE4Game]
-[FCocoaGameThread main] Address = 0x1066e7801 (filename not found) [in UE4Game]
Unknown() Address = 0x7fff37a370e2 (filename not found) [in Foundation]
_pthread_body Address = 0x7fff619322eb (filename not found) [in libsystem_pthread.dylib]
_pthread_start Address = 0x7fff61935249 (filename not found) [in libsystem_pthread.dylib]
thread_start Address = 0x7fff6193140d (filename not found) [in libsystem_pthread.dylib]

I was in a Blueprint project- fixed by adding a c++ class and building from source as mentioned in the UE4 forum thread here

Yes.
I know it would help to provide pre-built versions of the plugin, but I wouldn't have the time to maintain them...


Work on CD/CI

Fix condition for generating changelog and commit assembly info updated
Minor improvements on PS

Signed-off-by: José Simões<EMAIL_ADDRESS>

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Hotfix for _include and _revinclude performance

We have customer requests that are timing out on _revinclude searches when there are a large number of physical partitions.
_include can be improved by performing point reads for each resource to include, rather than doing a cross-partition query.
_revinclude can be improved by querying for the includes across physical partitions in parallel. Note that I will change the implementation for main based on the newer parallel querying approach that is not yet in production.

can you merge this PR https://github.com/microsoft/fhir-server/pull/1799 to your branch?

Moved to a hotfix branch hotfix/cosmos-revinclude-perf


places-auto-complete "Can't find variable: google"

Steps to reproduce and a minimal demo(Plunker Example)

Use places-auto-complete and the map-lazy-load
https://plnkr.co/edit/jYJu9jw5DnkKTsgCV3pL?p=preview

Current behavior

Using places-auto-complete and the map-lazy-load approach causes a Can't find variable: google error.

Other information

I'd rather not load the google maps api in the HTML header as it's only needed on one page of a very large application. Not sure what else I can do?

@allenhwkim , oops...forgot to include my plnkr initially. Sorry about that...

Please move place-auto-complete into map-lazy-load to resolve this issue.
https://plnkr.co/edit/dfRz1BKJJF7aIRdpYAxd?p=preview

That's pretty obvious now that you mention it. Should have thought of that :-P Thanks for your help!


Build steps required

Hey there, can you please provide information on how to build the software and the requirements to run in on my machine.

A build specification is not hard to guess, a real hassle is the signed driver.

Well, can somebody please provide a step by step build and sign documentation. It seems like a great tool but useless if it cannot be used.


Typos and edits

Hello @cldeluna,
If I submit some edits for minor typos and such for this repo would you be interested in merging them in?
Please let me know.
Thank you!

Note: I was going to use the Contact form on your site, but there's no form visible.
https://gratuitous-arp.net/contact/

@cldeluna
Do you recall the thought or noun that is being referenced?

Tip: make sure your matches your device hostname exactly!

https://github.com/cldeluna/pyats_intro/blob/master/README.md?plain=1#L298
Maybe this is to be:
Tip: make sure your testbed hostname matches your device hostname exactly!
Thank you for your insight.


The input size  problem

Thank you for your great work.The size of my picture is (256,832),how should I deal with it?Please tell me more details.thanks.

出现了这样一个错误，KeyError: 'VisionTransformer is not in the backbone registry'，请问有解决方法吗？
或者训练自己的数据集的教程能不能再完善一点，谢谢

you will have to organize your dataset to meet the requirements of mmsegmentation. Please check https://mmsegmentation.readthedocs.io/en/latest/tutorials/customize_datasets.html.

Please refer to SETR/mmseg/datasets/ade.py to write a python script SETR/mmseg/datasets/{your_dataset}.py for your own dataset, and add your dataset into SETR/mmseg/datasets/init.py.

Please refer to SETR/configs/base/datasets/ade20k.py to write a configuration file for your own dataset, SETR/configs/base/datasets/{your_dataset}.py. You need to modify dataset_type, data_root, img_scale, crop_size, samples_per_gpu, img_dir, ann_dir, split.

Note that the h and w of crop_size should be equal and must be in multiplies of 16. Neither of h and w is allowed to exceed the shortest side of the image after random resize — dict(type='Resize', img_scale=img_scale, ratio_range=(0.5, 2.0))

Thank you for your reply.I will follow steps that your give.thanks  again.


fix http client to fix recaptcha

@aembler
Should we apply this fix to 8.5.x branch also?

I'd be surprised if this were an issue there. I think we swapped everything out for guzzle at some point just during the long v9 dev process

Alright, 8.5.x doesn't use guzzle yet


Can I use mavsdk::MavlinkPassthrough::queue_message() to transmit the GPS_GLOBAL_ORIGIN message to PX4 to specify the ekf origin?

auto now = std::chrono::system_clock::now();

  auto microseconds = std::chrono::duration_cast<std::chrono::microseconds>(now.time_since_epoch()).count();

    const MavlinkPassthrough::Result pass_result = mavlink_passthrough.queue_message([microseconds](MavlinkAddress mavlink_address,uint8_t channel)->mavlink_message_t{
        mavlink_message_t msg;
        mavlink_address.system_id=1;
        mavlink_address.component_id=1;
        mavlink_msg_gps_global_origin_pack_chan(
            mavlink_address.system_id,
            mavlink_address.component_id,
            MAVLINK_COMM_0,
            &msg,
            41.15403,
<PHONE_NUMBER>,
            57.982,
            microseconds
        );
        return msg;
    });

But I used the qgc console to query vehicle_local_position in HITL and found that the x, y, z coordinate system has not changed.
Does anyone have some suggestions for directions to resolve this issue?

I'm not sure this message is used in the way you think when using HITL.
Have a look at how GPS is sent in the Gazebo plugin.

Thanks for your help, I wrote these lines of code for the takeoff and landing examples. My hardware connection method is to connect Raspberry Pi 4b and pixhawk through USB to TTL via telem port, and then connect pixhawk to my laptop through USB for HITL.
I'm going to learn how GPS is sent in the Gazebo plugin.

I used the wrong message id


[opentelemetry-collector] Remove memory_ballast extension from default template and replace by GOMEMLIMIT

We want to remove the memory_ballast extension in favor of Go 1.19+ GOMEMLIMIT environment variable as stated in open-telemetry/opentelemetry-collector/issues/8343.
The first step to verify that we can effectively remove the extension is to change this on the OpenTelemetry Collector Helm chart.
We can replace the extension by a value of GOMEMLIMIT that is something like 80-90% of the total memory limit for the Collector container. Once we release this change and wait some time to gather feedback, we can move on with deprecation of the memory ballast extension.

cc @dmitryax @TylerHelmuth

@mx-psi @dmitryax i think we should implement this via a feature-gate-like config.
The first PR can add the option to use the Go setting instead of the extension, but disabled by default. After some time, we can enable it by default, but still allow users who want to use the extension to disable it. Then we'd wait until the extension is deprecated to remove the option.

i think we should implement this via a feature-gate-like config.

Have we done anything similar before on the Collector Helm chart? The plan sounds reasonable to me

@TylerHelmuth should this be a usual configuration option or is there an alternative mechanism in the Helm chart for temporary toggles?

We dont have anything like feature gates in the chart, we normally do it via a configuration option (or 2).

I think the only thing we can do is not set the GOMEMLIMIT env?

I am personally fine with that, if you explicitly unset resource limits then you should be on your own to configure this

I have started work on this

How much should we wait until we enable the GOMEMLIMIT option by default? Is something like one month enough?

@mx-psi is this helm chart feature critical for the decision on whether or not to deprecate the extension or has the decision already been made to deprecate it?

@mx-psi is this helm chart feature critical for the decision on whether or not to deprecate the extension or has the decision already been made to deprecate it?

I would want to validate the approach with the Helm chart before committing to deprecate the extension. I don't feel like I personally have enough knowledge about the Go garbage collector to ensure this replacement will be satisfactory for all use cases (it probably will, that's why I pushed for this, but I want to be sure before deprecating the extension).
If anybody else feels like this is clear cut, then we don't have to wait for this, but personally I feel like this is safer.

In that case I think we need to leave it around as long as it take to make a decision.  We won't move forward with turning it  always on until we're sure we are deprecating the extension.
I can enable it on our internal use of the collector, but we'll need other examples as well.

@JaredTan95 based on #912 it seems like you are testing this out. Would you mind sharing any findings about the setting (memory and CPU usage patterns before/after?)
I also posted a call out for more testing on a few channels on the CNCF Slack. Once we have at least two I think we can proceed with the deprecation and enable this by default.

We have been running Collectors using the Helm chart with useGOMEMLIMIT enabled for a few weeks on Datadog's infrastructure with a similar CPU usage as with the memory ballast and lower memory consumption (because of the memory ballast).

We see similar stats at Honeycomb

@JaredTan95 based on #912 it seems like you are testing this out. Would you mind sharing any findings about the setting (memory and CPU usage patterns before/after?)
I also posted a call out for more testing on a few channels on the CNCF Slack. Once we have at least two I think we can proceed with the deprecation and enable this by default.

We switched to this(useGOMEMLIMIT) configuration because of an issue with memory ballast's compatibility with our arm architecture. We haven't verified this configuration in production, but in our test environment, This feature solves the arm compatibility problem and the effect is similar to that of the original memory ballast.
So, I support it.

@mx-psi I'd still like to see the extension officially deprecated in Core before we make this a default value in the helm chart.

@JaredTan95 can you please share more details about memory ballast's compatibility issues with our arm architecture? It be nice to post them in https://github.com/open-telemetry/opentelemetry-collector/issues/8343 as well

Based on the discussion on https://github.com/open-telemetry/opentelemetry-collector/issues/8343 and this issue, I filed #8803 to deprecate the memory ballast extension.

I'd prefer the next step before deprecating the memory_ballast extension to be switching the useGOMEMLIMIT feature gate to true in the helm chart. That way we are not forced to do it and will have a chance to get some more feedback before the actual deprecation. I'd think we should keep useGOMEMLIMIT: true for a couple of versions, then deprecate memory_ballast extension. @mx-psi @JaredTan95 @povilasv @TylerHelmuth WDYT?

I am fine with that, although I think @TylerHelmuth wanted to go the other way around :smile: Up to the Helm chart maintainers I guess :)

Ya I was imagining after the initial testing that the helm chart would follow the guidance from Core. My though being that I didn't want to disrupt users until the component was actually deprecated.
But we could enable it by default and use helm chart users as testers (unless they switch it back to false).

But we could enable it by default and use helm chart users as testers (unless they switch it back to false).

That's what I thought. I wanted to gather as much feedback as possible before the deprecation. I'm thinking of useGOMEMLIMIT as an improvement anyway

I'd think we should keep useGOMEMLIMIT: true for a couple of versions, then deprecate memory_ballast extension

I agree! 👏

@JaredTan95 can you please share more details about memory ballast's compatibility issues with our arm architecture? It be nice to post them in open-telemetry/opentelemetry-collector#8343 as well

The compatibility problem we encountered was only tested on the Chinese operating system, so I think it has little reference value for users using international operating systems, so I did not put it up :-P

open-telemetry/opentelemetry-collector/pull/8803 got merged, we can revert before Jan 8th if we find issues


CSS linting breaks if in css props as template literal

When defining a styled component the plugin enables syntax highlighting and CSS linting in the styled.el`` definition. When writing inline css in a styled component via the css prop the plugin enables syntax highlighting but does not enforce css linting.
const Comp1 = styled.div`
  notaprop: foo;
`;

const Comp2 = (props) => (
  <div
    css={`
      alsonotaprop: foo;
    `}
  >
    {props.children}
  </div>
);

I know a small amount about TM Scopes and these two lines seem to point to the same scope...

Closing as this package has been deprecated in favor of the official styled-components/typescript-styled-plugin fork
After updating to that fork, follow up in the styled-components repo if this is still an issue


Inconsistent result when calling $this->dotenv->load() multiple times from PHPUnit

https://gist.github.com/bilogic/4114836067651905888abd542becee55
I have a set of flaky tests in the gist above. What I can't understand is:

If the tests are ran individually, they all pass
If PHPUnit is used to run them all, test_Can_detect_missing_mandatory_environment_keys fails and it is due to $this->dotenv->load(); returning an empty array here https://gist.github.com/bilogic/4114836067651905888abd542becee55#file-envchecker-php-L61
If I re-order test_Can_detect_missing_mandatory_environment_keys as the first test, it passes and now test_Can_parse_environment_file fails due to the same issue of an empty array

Any idea what I'm missing here?

Use createMutable while I would need to dig through the code to fully comprehend the inner workings, it seems that immutability in this instance returns configuration onces but not on "future" usage of "load()".
I'm not sure whether this is by design, hypothetically, you should be able to have multiple immutable configuration at whatever point you want that shouldn't change outside of a particular bound/context.


Link to localhost in Documentation Gives SSL Error

Hi Nitesh,
I just played around with the Docker containers to reproduce an error. Thank you very much for providing those, they make it much easier to reproduce problems that appear on other machines.
In the Quick Start section of the Docker Containers for Bioconductor page, it is suggested to go to https://localhost:8787. However on my machine, I get an ERR_SSL_PROTOCOL_ERROR which is particularly confusing because the site looks very similar to a page if the application wasn't running:

The error goes away if you go to the standard http page at http://localhost:8787.
Best, Constantin

I am closing this issue. I've updated the documentation. Thanks, @const-ae.

Great, always happy to help :)


Update flag download script and .svg files

Used for making a new adaptive icon

Thanks for sharing your efforts!
I decided to fix the script in a bit simpler way and leave the flags as-is.
Hopefully that should at least make it easier when I or someone else actually wants to update them.


192 code coverage badge

Closes #192
Process:
1 ) Connect the PixarAnimationStudios Github account to codecov.io (ignore the token stuff on the Overview page after you sign in, it's not necessary since OTIO is OSS)
2 ) Select the OpenTimelineIO repository - you can see the reports after I connected it here
3 ) Run a build for Travis, which causes a coverage report to get kicked off which updates the badge (for the master branch).

I think that reported from the integration that I connected to my account which I am now going to disconnect because I tested it out...
Anyway the reason it's saying " No coverage uploaded for pull request base master" is because it's not finding a coverage report for master yet because it's set up to pull from master.

I made a PR on your PR to combine the coverage reports (it looks like the old version just reported results from the contrib adapters).


Ctrl+Shift+I not working

The entry in the "Help" menu states it should work

VS Code Version: 1.55.0, c185983a683d14c396952dd432459097bc7f757f, x64
OS Version: Windows 10 Pro 2004 19041.867

Steps to Reproduce:

press Ctrl + Shift + I

Does this issue occur when all extensions are disabled?: Yes

/duplicate of #89587
By default this keybinding is qualified by the isDevelopment context which means it only works when running VS Code out of source. If you want it to work unconditionally, use the keybinding editor to remove the when-clause.

why is this keybinding shown in the context menu entry without actually working?

See https://github.com/microsoft/vscode/issues/40389#issuecomment-352404326 for an explanation from @alexdima of why when clauses don't get checked before menu entry keybindings get displayed.


FormControlLabel should have "labelTypographyProps" just like ListItemText has "primaryTypographyProps"

FormControlLabel should provide a method to customize its label which is wrapped by typography just as ListItemText has primaryTypographyProps, so could be something like:
<FormControlLabel labelTypographyProps={...} />

@Bouncue Maybe you don't need the FormControlLabel component in this case. Have you tried using a label + Typography component directly?

Have you tried using a label + Typography component directly?

Did you mean like this: <Typography>myLabel</Typography>
I am using FormControlLabel to give my Checkbox component a label next to it:
<FormControlLabel
          label={prop.myLabel}
          control={<Checkbox />}
/>

I don't know how to add label to Checkbox other than that way.
I look into the DevTool, myLabel is wrapped by:
myLabel
And I need to change the variant to "body2"
But I dont have access do it.

@Bouncue Ok, in this case, I would encourage you to use the CSS API or to create your own label. I don't think that there is much value at allowing further customization.

You are right. I didn't notice there is CSS API for label.
 This is bad for my career as a front-end dev.

@Bouncue I wouldn't worry about it. I doubt people will dig into past open issues :). At least, it's how we learn, by making mistakes, that's 100% fine and often required.

Related StackOverflow question: https://stackoverflow.com/questions/58674888/how-change-default-typography-class-of-a-formcontrollabel-material-ui-react/58697484#58697484


Fix the path to plugins configuration

Seems like plugins stopped working since 0.13.0 due to config structure changes. So this change just corrects the path to plugin configuration.

Thanks for the PR. There are few tests failing on Travis. Could you please fix them?

sure, will do later today

@SevInf, fixed, seems like build passed

@SevInf, fixed, build passed


it's showing the cube of 5 is 124??

#include
#include <math.h>
using namespace std;
int main() {
int n;
cin>>n;
int power;
power = pow(n, 3);

cout<<"cube of "<<n<<" is- "<<power<<endl;

return 0;

}
when ever i run this it shows the cube of 5 is 124, and this is making some serious computational issue.
plz help...

Although this isn't a VS Code problem I'll help you out.
In C++ you must initialize your variables so they can have memory allocated to them. If you don't they have garbage starting values.
Try int n = 0; and int power = 0;

This isn't a VS Code issue as you're running the code externally to VS Code. I also do not see the issue running that code on my Mac or an online compiler. Maybe try debugging it


What is the login details

user:admin
pass:admin
user:admin
pass:super@dmin
user:admin
pass@dmin12345
user:admin
pass:p@ssword123
I try all these username and password but none of theme is working , would you please share with me Thanks

user: admin
password: ehsan


[Tachyon-1333] Improved mount path checking

For correctness and simplicity, we place a few restrictions on mounting
paths:

You cannot mount a UFS path that is a prefix or a suffix of an
already-mounted UFS path
You cannot mount to a Tachyon path that shadows a path in the default
underfs
The UFS path you are mounting must exist at mount time

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Tachyon-Pull-Request-Builder/7160/
Test PASSed.

@manugoyal thanks for the PR, just some minor comments

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Tachyon-Pull-Request-Builder/7167/
Test PASSed.

Thanks @manugoyal for the PR. LGTM

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Tachyon-Pull-Request-Builder/7240/
Test PASSed.

please resolve merge conflicts

LGTM

I left a comment on the concurrency control in the FileSystemMaster. Thanks for these improvements!

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Tachyon-Pull-Request-Builder/7248/
Test PASSed.

I had a few more questions about the mount() method.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Tachyon-Pull-Request-Builder/7250/
Test PASSed.

LGTM


How to use Transformers4Rec with pandas

How to use Transformers4Rec with pandas
NVTabular is hard to learn, I want to skip it, and load/transform data for Transformers4Rec. Could you please show me how to achive what I want?
For example, now I was developing an news recommendations, which is exactly an session-based recommender, the train data is as following:

user_id
item_id-count
item_id-list
category-list

0
2
[2343, 16105]
[26, 281]

1
2
[6678, 29121]
[133, 418]

2
2
[3222, 17493]
[43, 297]

3
2
[3222, 5196]
[43, 99]

4
2
[3789, 4359]
[66, 67]

...
...
...
...

199995
7
[7592, 27484, 28222, 28702, 28515, 33114, 34315]
[136, 409, 412, 412, 412, 437, 442]

199996
13
[1379, 7591, 13521, 13555, 13579, 13515, 13509...
[7, 136, 250, 250, 250, 250, 250, 409, 428, 43...

199997
2
[22678, 22649]
[354, 354]

199998
20
[23642, 24255, 23898, 24254, 24173, 24128, 254...
[375, 375, 375, 375, 375, 375, 389, 389, 395, ...

199999
11
[472, 4245, 5215, 7591, 13521, 16531, 16619, 1...
[4, 67, 99, 136, 250, 281, 281, 281, 281, 297,...

200000 rows × 4 columns

@ralgond NVTabular is easy to use. you can take our existing notebooks and just add your data in it.
if you want to use pandas sure, go for it. but then you need to use schema file yourself manually and correctly, so that you can train a TF4Rec model. Please note that NVTabular generates schema file automatically.

ok, thank you, I would try to learn NVTabular.


Create Eclipse Temurin July 2024 CPU blog post

Create a blog post to highlight the new and noteworthy of the July 2024 CPU, that also includes release notes.

Mention the changes to the Docker image external CACERT handling as referenced here.

Some extra items that we're trying to get in:

Removal of tags for CentOS7 now it is EOL (Will create blog post - https://github.com/adoptium/adoptium.net/issues/2936)
Windows installer to start using Wix5 and implement other security-related fixes
Add support for Ubuntu Noble (24.04) in the next PSU alongside the others, with a view to making it the only option for Temurin 23

JDK22 AIX needs a later TL of AIX than the previous versions

Add note about Ubuntu upgrade for containers (noble jammy)


ImageSizeResolverDef crash NullPointerException

Markwon version: 4.6.0

java.lang.NullPointerException: Attempt to invoke virtual method 'android.graphics.Rect android.graphics.drawable.Drawable.getBounds()' on a null object reference
at io.noties.markwon.image.ImageSizeResolverDef.resolveImageSize(ImageSizeResolverDef.java:23)
at io.noties.markwon.image.AsyncDrawable.resolveBounds(AsyncDrawable.java:383)
at io.noties.markwon.image.AsyncDrawable.initBounds(AsyncDrawable.java:278)
at io.noties.markwon.image.AsyncDrawable.initWithKnownDimensions(AsyncDrawable.java:319)
at io.noties.markwon.image.AsyncDrawableSpan.draw(AsyncDrawableSpan.java:104)
at android.text.TextLine.handleReplacement(TextLine.java:940)
at android.text.TextLine.handleRun(TextLine.java:1040)
at android.text.TextLine.drawRun(TextLine.java:481)
at android.text.TextLine.draw(TextLine.java:217)
at android.text.Layout.drawText(Layout.java:539)
at android.text.Layout.draw(Layout.java:286)
at android.widget.TextView.onDraw(TextView.java:7036)
at android.view.View.draw(View.java:19314)
at android.view.View.updateDisplayListIfDirty(View.java:18250)
at android.view.View.draw(View.java:19042)
at android.view.ViewGroup.drawChild(ViewGroup.java:4271)
at android.view.ViewGroup.dispatchDraw(ViewGroup.java:4054)
at androidx.constraintlayout.widget.ConstraintLayout.dispatchDraw(ConstraintLayout.java:2023)
at android.view.View.updateDisplayListIfDirty(View.java:18241)

Hello @huweijian5 ,
can you give me more context about this stacktrace?

What markdown did you use?
What image loader are you using?
How do you initialize your image loader?
Anything at all related to it?

What markdown did you use?
4.6.0
What image loader are you using?
glide4.11.0
How do you initialize your image loader?
.usePlugin(GlideImagesPlugin.create(context))
Anything at all related to it?
it happens occasionally
crash in HuaWei/EMOTION/EmotionUI_8.0.0
i use markwon in RecyclerView

Hello @huweijian5 ,
can you reproduce this issue on your device? It is possible that the issue is related to this specific device and includes some race condition. But it is hard to confirm without a way to validate any assumptions

It happened by accident, but it did happen.

It you happen to have this device, can you have a breakpoint and see on what thread the at io.noties.markwon.image.AsyncDrawable.initWithKnownDimensions(AsyncDrawable.java:319) method is called?
Do you use AsyncLayoutInflater or something similar by the way?


[reggen/doc] Treat Register/Field Description as markdown

This commit revises reggen to parse the descriptions as markdown doc.
This allows writers to use markdown syntax (list, emphasis, etc) inside
the register description and field description.

That would be really nice - I've been wanting to use some more markup in these fields too!


Course units can have different font sizes in the breadcrumbs bar which breaks the positioning of cmdiv

Issue was in UCIL stylesheet. Now fixed


chore(docs): Improve some documentation for element and locators

Fixed a few formatting issues for locator, getWebElement, exactRepeater, and deepCss

Merged!


Feature Support MoW for CCR

Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run clickbench

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.79 seconds
stream load tsv:          539 seconds loaded<PHONE_NUMBER>9 Bytes, about 132 MB/s
stream load json:         21 seconds loaded<PHONE_NUMBER> Bytes, about 107 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          29.5 seconds inserted 10000000 Rows, about 338K ops/s
storage size:<PHONE_NUMBER>0 Bytes


raftstore: learners should be considered when check progresses before merge

Signed-off-by: qupeng<EMAIL_ADDRESS>What have you changed? (mandatory)
Fix a bug about merge with learner, which is when we check the log gap in all replications, learners should also be considered, otherwise learners could panic.
close #4551 .
What are the type of the changes? (mandatory)
Bug fix.
How has this PR been tested? (mandatory)
Unit tests.

Please cherry-pick to release-2.1


[d3d9] Optimize MarkTextureBindingDirty with tzcnt loop of m_activeTe…

…xtures
@DadSchoorse

Will wait to merge on the bsf thing.


Jenkins Agent for nodejs 10

According to the nodejs Long Term Support (LTS) schedule, maintenance for nodejs 8 will end by the end of this year.
Can we have a nodejs 10 Agent for Jenkins in OpenShift similar to agent-nodejs-8?

The slave-base template can be utilized for creating such agent.
In this case we will work on getting a agent-nodejs-10. Thank you for letting us know about the LTS on nodejs8. We will take this up on priority.
/assign @waveywaves

Actually can we also get Node 12 agent?
I don't understand why you did not release Node 10 or 12 agent sooner.

I'm gonna create a separate issue for that.

#940

New agent for 10 has been added

/close


Force-directed layout algorithm generates more cluttered and messy visualizations

Kùzu version
0.6.0
Operating System
macOS Sonoma 14.5
Browser
Google Chrome: Version 127.0.6533.120 (Official Build) (arm64)
Description
In 0.6.0, the force-directed layout seems messier than before. The edges cross over each other and the initial layout that's rendered in the graph view looks more cluttered and harder to interpret.

This is even worse when we visualize larger graphs. There are a lot of criss-crossing edges.

This wasn't happening in earlier versions. See an earlier example of a clean force-directed layout, where the edges don't appear criss-crossed on top of each other:

Is this happening because we aren't running enough iterations for the force-directed algorithm to converge to a better layout?
Steps to reproduce
The graph used to reproduce can be obtained from the attachment in #215.
The following query can be run to test:
// Find all possible paths in an undirected manner between George and Edward with a maximum length of 5
MATCH (p1:Person)-[r*1..5]-(p2:Person)
WHERE p1.name = "George" AND p2.name = "Edward"
RETURN *;

@prrao87. #225 is merged. Can you confirm if the layouting is improved when you have some time?

We have switched to use force2 layout of G6 and it looks fine for most of the cases. I am closing this for now. Feel free to reopen it if there is other layouting issues.


sls invoke test -c does not exit.

Hello, i am trying to connect gitlab pipeline to my project.
I have serious problem with this command sls invoke test -c
It does everything okay but did not close right after completing tests.
It is very important for me to have -c flag, cause I am using real DB, not the local one and I need to sustain my connection. Without this flag, my tests fail.

Ok I have solved it, there is missing --exit flag.


Reapply "SolaceIO.Read: handle occasional cases when finalizeCheckpoint is not executed (#32962)" (#33259)

Reapply changes that were introduced and reverted in https://github.com/apache/beam/pull/32962. See the main discussion there.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

Run Java_Solace_IO_Direct PreCommit

OK, thanks for the info @bzablocki , I am currently preparing a version for us with 2.61.0 and this PR applied. Is it planned on your side to do an official backport (2.61.1 or something like that)?

I'm afraid a patch to an already released version can only be applied in some very specific cases, specifically when there is a major performance issue in the new version, or some serious bug is introduced. I don't think this PR qualifies for that.

Thanks!


Dps track 2 core changes

Notes for Ryan + Paymaun
Changes to DPS core with track 2 (to reflect refactorization and changes to the DPS on the extension side)

change resource group to be optional
deprecate access-policy in favor of policy. All methods otherwise remain the same.
bucket arguments for linked-hub
add hub discovery to linked-hub functions:

for create, users are not required to pass in a hub connection string, they can pass in a hub name
for create, location can be determined from hub discovery if needed
for update, show and delete, linked hub no longer needs to be the hostname - hub discovery will find the right host name if needed.

Description

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

passing tests


Are Technology subclasses needed?

Description of the issue
Are subclasses of Technology like EnergyGeneratorTechnology or EnergyTransferTechnology needed? Or is just Technology enough?
@stap-m raised this question in #86.
Ideas of solution
Delete all subclasses?
Workflow checklist

[ ] I discussed the issue with someone else than me before working on a solution
[ ] I already read the latest version of the workflow for this repository
[ ] The goal of this ontology is clear to me

I am aware that

[ ] every entry in the ontology should have an annotation
[ ] classes should arise from concepts rather than from words
[ ] class or property names should follow the UpperCamelCase

as discussed in february ontohack:

new Technology def: A Technology is an information content entity that specifies how to create an artificial object.
delete or move technology subclasses, depending on #173

I forgot to change the def, pull request will follow soon

@jannahastings if Technology is an information content entity this will move it to oeo-model, is that still in line with our modules?

If we go with that definition, then the name should be changed to "technology specification" rather than just technology. But it does not have to move to oeo-model, as we can have information content entities in the other modules as well? I think, to me, it would make more sense to keep it in the oeo-physical...?

@jannahastings I agree, so how do we proceed, do we make a new module just for one class? that would seem wasteful.  Copy and paste the class direcly inside oeo-physical?

Both are possible, but I vote let's make a new module just for one class, it's not a big deal with robot and we may add more in the future. We could call it "iao-minimal"?

ok, then let's do that

I'll make a pull request


fix: AU-1220: Lint fixes: grants_profile module to a better shape

AU-1220

What was done

Refactored individual methods to lessen complexity of individual methods
Moved re-used code from individual form classes to the base form class
Removed email field from private person profile form
Made the address fields in a private person profile form into a fieldset to match the other forms.
Made it so that there needs to be at least one Official for Unregistered communities
Removed unused things in code
General cleaning up

How to install

Make sure your instance is up and running on correct branch.

git checkout feature/AU-1220-profile-further-grants_profile
make fresh

Run make drush-cr

How to test

[x] Take a comfortable position, this will take a while.
[x] Log in to your development enviornment with a Henkilötunnus you haven't done with before.
[x] Choose yksityishenkilö as your asiointirooli (there should be no errors in creating a new yksityishenkilö)
[x] On the profile form, empty all fields you can, and with the development tools of your browser, remove all required="required" from the input fields that are now empty. Try to save the form and see that all the fields that are not filled give out an error from the server side. Do not remove fieldsets if it would be possible, that's the next step.
[x] Now, fill out the fields, but remove the bank account so that there are no bank accounts (even empty ones). Try to save the form and get the error from the server about there having to have one bank account.
[x] Fill out the profile and save. See that the profile is displayed correctly on the profile page (disregard the english texts on the profile page, there's a ticket out there for those)
[x] Go to a new Kuva Projektihakemus and fill it and see that everything goes forward just fine.
[x] Change asiointirooli to Unregistered community and create a new unregistered community (since you shouldn't have those as this is a hetu you haven't used before. If there are unregistered communities here, go back to step one)
[x] On the profile form, empty all fields you can, and with the development tools of your browser, remove all required="required" from the input fields that are now empty. Try to save the form and see that all the fields that are not filled give out an error from the server side. Do not remove fieldsets if it would be possible, that's the next step.
[ ] Now, fill out the fields, but remove the bank account and official fieldsets with the "poista" buttons on each so that you have no officials or bank accounts. Try to save and see that you get an error from the server about having to have one bank account and one official.
[ ] Fill out the profile properly, but choose "muu" as the role of the toiminnasta vastaava henkilö. Save and get an error about having to have at least one "vastuuhenkilö" in the mix.
[ ] Fill out the profile correctly (with vastuuhenkilö as an official role) and save. See that the profile is displayed correctly on the profile page
[ ] Go to a new Kuva Projektihakemus and fill it and see that everything goes forward just fine.
[ ] Change asiointirooli to Registered community and select one.
[ ] On the profile form, empty all fields you can, and with the development tools of your browser, remove all required="required" from the input fields that are now empty. Try to save the form and see that all the fields that are not filled give out an error from the server side. Do not remove fieldsets if it would be possible, that's the next step.
[ ] Now, fill out the fields, but remove the address, bank account and official fieldsets with the "poista" buttons on each so that you have no addresses, officials or bank accounts. Try to save and see that you get an error from the server about having to have one bank account and one address.
[ ] Fill out the profile properly, and choose "muu" as the role of the toiminnasta vastaava henkilö. Save see that it works properly. See that the profile is displayed correctly on the profile page.
[ ] Go to a new Kuva Projektihakemus and fill it and see that everything goes forward just fine.
[ ] Check that code follows our standards. Do this diligently.
[ ] Bonus task: Refactor GrantsProfileService.php to be less complex.

Rekisteröity yhdistys - Tilinumero:
Tässä varmaan toi otsikko pitäis vaihtaa takaisin? On nyt "Henkilökohtainen tilinumero" - Samoin lukee "Voit antaa vain oman tilisi tiedot".
Lokaali screenshot:

Stage:

Rekisteröity yhdistys - Tilinumero:
Tässä varmaan toi otsikko pitäis vaihtaa takaisin? On nyt "Henkilökohtainen tilinumero" - Samoin lukee "Voit antaa vain oman tilisi tiedot".
Lokaali screenshot:
Stage:

Ah, good catch. Toi oli jossain kohtaa työn alla, mutta päädyin johonkin sivupolkuun. korjataan.

@oskarimysteerio - pankkitilin tekstit profiilityypin mukaan lisätty.

Yksityishenkilö -> Tilinumeron puuttumisesta virheilmotus vois olla tossa inline?

Toimintaryhmä -> Tilinumeron ja vastuuhenkilön puuttumisesta inlinevirhe?

Tein GrantsProfileService refaktorille oman tiketin: https://helsinkisolutionoffice.atlassian.net/browse/AU-1803

@jiisuominen - tein noista inline-virheistä oman tiksun, koska niitä ei ole missään tällä profiilissa hetkellä: https://helsinkisolutionoffice.atlassian.net/browse/AU-1804


CacheOverflowException in Rhino.Testing.Fixtures.RhinoSetupFixture

I turned on breaking at all exceptions and now I'm getting this exception in the OneTimeSetup();

Ignoring this type of exception seems to work ok but I'm unsure if this is correct.


mxnet docker gives different inference output

Description
When using official mxnet docker image on cloud server and without docker on a local server, the inference result is different. The input is exactly the same.
Environment info (Required)
docker on cloud server: cuda9.0, cuda drive 418 (host machine), mxnet 1.4.0
local server: cuda9.0, cuda drive 396, mxnet 1.3.0

After downgrading the mxnet version in the docker to 1.3.0, the inference result are exactly the same. But why?

Any ideas guys?


Check: return non-zero status code for unknown licenses.

Previously if an unknown license was detected, an error message was
printed, but the command would still return 0, indicating success for
many CI tools.
This fixes the behavior to return a proper non-zero error code.
Fixes #31.

Tested this, and it seems to work ok. Makes https://github.com/google/go-licenses/pull/46 even more necessary, or else your project will fail if you don't have license files for all your 1st-party packages (e.g in closed-source projects)

Tested this, and it seems to work ok. Makes https://github.com/google/go-licenses/pull/46 even more necessary, or else your project will fail if you don't have license files for all your 1st-party packages (e.g in closed-source projects)

Superceded by https://github.com/google/go-licenses/pull/150


Development

Changes to the README file

Thanks for your input Vikram. I will review the pull request and merge the same.

@AWADHAMBIKA Could you please review and approve this PR? I can merge post your approval. Thanks.

Hi @bimalkjha  the pull request overwrites the existing README which I don't want as the commit has steps for  AWS EC2 instance running AL2 and needs to be appended to existing README as a section rather than replaced.


Exchanger needs silk touch.

In the forge version you can enchant the exchanging gadget with silk touch. Please consider porting this feature to your fabric version.

It already can, you can even enchant it. Though with enchanting you can only get unbreaking. If you want silktouch you have to use an anvil


Ability to read emails via API

It would be nice to have a feature that allows the user to read the emails via some API.
This feature can be used in UI automation or end-to-end tests where the email's content can be verified.

I used to think the same, but since this project does not evolve a lot (and I don't want to make a PR to add this feature, further more seeing 17 opened PR already!), I've actually fallen back to simply read the EML file that FakeSMTP saves.
In other words, you can simply browser files in the email-saved (or so) folder where FakeSMTP stores the EML. EML parsing is pretty standard (and even pretty straightforward actually). You can also delete files from there if needed, or get the email saving date from the file name.


react-native link react-native-maps corrupts the ios project file

Running react-native link react-native-maps after installing react-native-maps does corrupt the ios project file making impossible to run react-native link or opening the xcproj in xcode.
The prompted error is:
rnpm-install info Android module react-native-maps has been successfully linked
rnpm-install info Linking react-native-maps ios dependency
rnpm-install info iOS module react-native-maps has been successfully linked
rnpm-install info Linking assets to ios project
rnpm-install ERR! It seems something went wrong while linking. Error: Expected "/*" or ";" but "\"" found.
Please file an issue here: https://github.com/facebook/react-native/issues

Expected "/*" or ";" but "\"" found.

I'm able to open the project, but build fails
react-native/React/Views/RCTView.h:21:1: error: duplicate interface definition for class 'RCTView'
@interface RCTView : UIView

@lucamaraschi I manually set my npm dependency to "react-native-maps": "^0.13.0" as per @ddipanfilo's instructions and it fixed the problem.
This is required for React Native >= .40, while older versions should continue to use react-native-maps 0.12.4.

Same issue here!
react-native-maps version: 0.13.1
▶ react-native link react-native-maps
Scanning 650 folders for symlinks in /folder/folder/folder/folder/folder/node_modules (5ms)
rnpm-install info Linking react-native-maps android dependency
rnpm-install info Android module react-native-maps has been successfully linked
rnpm-install info Linking react-native-maps ios dependency
rnpm-install info iOS module react-native-maps has been successfully linked
rnpm-install info Linking assets to ios project
rnpm-install ERR! It seems something went wrong while linking. Error: Expected "/*" or ";" but "\"" found.
Please file an issue here: https://github.com/facebook/react-native/issues

Expected "/*" or ";" but "\"" found.

cc @grabbou do you understand why this would happen?

I'll take a look into that over the weekend, thanks for the ping @lelandrichardson

Anyone affected here, can you drop me an email with your .pbxproj and Info.plist? The former can be located by opening .xcodeproj (it is a folder)

#1862


Gridwich maintenance update

Gridwich code and infrastructure update

Solution and Functions updated to .NET 6.0
Moved to latest Terraform and AzureRM provider
Fixes issues with AppInsights
Moved to AMS v6 SDK
Remove AMS service principal
And more

Thanks for investing the time in this update @xpouyat & @flecoqui


wiki: typo in asconfig.json reference

In asconfig.json reference there is typo:

include-namesplaces

Thanks! Fixed.


pull request for e2e test at 12/06/2016 18:45:02

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

optest/docs/updated_at.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Publish to npm

This needs to be published, at least an initial version.

v0.0.1 is now published


Remove Kafka functionality from QueuingHistoryWriter

Have the caller handle sending events to Kafka to make
QueuingHistoryWriter only be responsible for sending to
ZooKeeper. Simplifies things.

@rohansingh @gimaker
I was thinking about how to use composition instead of inheritance here. We could have TaskHistoryWriter have QueuingHistoryWriter as an attribute. QueuingHistoryWriter wouldn't be abstract, and we'd remove the generic TEvent and just have it write arrays of bytes to ZK.
The abstract method getKey() would instead be implemented to return a checksum of the byte array. But what about getTimestamp() which TaskHistoryWriter implemented in a way to return the timestamp attribute of the TaskStatusEvent? If QueuingHistoryWriter naively wrote byte[] to ZK, it wouldn't be able to know the timestamp or ZK path.
We could have a QueuingHistoryEvent interface with getTimestamp() and getZkEventsPath(), but I'm not sure what the advantage of that is over the current design.

Looks like you broke nginx.

:+1:


Make ff-checkbox label optional

Current Behavior
Fix the invalid prop type error
[Vue warn]: Invalid prop: type check failed for prop "label". Expected String with value "null", got Null
at <FfCheckbox id="formRow-instance-0" ref="input" type="checkbox"  ... >
at <FormRow modelValue=false onUpdate:modelValue=fn type="checkbox"  ... >
Expected Behavior
No response
Steps To Reproduce
No response
Environment

FlowForge version:
Node.js version:
npm version:
Platform/OS:
Browser:

Fixed in https://github.com/flowforge/forge-ui-components/pull/111


OPSEXP-1607: Enforce minimum supported ansible stack version in the playbook

Obviously this implementation is bound to change if we implement the changes form @piraartur's OPSEXP-1565 PR about pipenv, but for now I believe this achieves the desired effect, other than the checks I've tested the changes locally with vagrant and when I provided vagrant a mock-requirements.txt file with some of the modules missing so that the guest machine missed important parts of the module configuration, the playbook exited with message as shown below:

too old version of ansible-core
missing boto3

There is still some cleanup to bo done such as getting rid of debug messages and possibly moving the checking functionality from straight in the playbook to a role, but I put that off before we sort out the pipenv thing.

I just discovered during tests that if I downgrade Jinja2 substantially (a major version down) the playbook doesn't even start to execute and exits with errors related to Jinja2 being too old, so although this PR in it's current state is useful for checking some inconsistencies in versioning it doesn't actually solve the most important problem and the reason behind OPSEXP-1607 in the first place. I will have to think of another solution


Dockerfile builds docker image!

#49 A few things to be considered you will need to change the IP in the Dockerfile and in odin-engine/config/odin-config.yml
Another thing to be aware of a mongodb instance needs to be running

Build the image using the Dockerfile
Run the command: docker run odin

Restored Makefile main.go back to the same as the repo.

Redoing the dockerfile so the repo size isnt doubled will need to test anyway

Will resubmit a better pull request, docker file will be with the rest instead of in the docker directory due to how docker files operate


rdma-core: 40.0 -> 41.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/linux-rdma/rdma-core/releases.
meta.description for rdma-core is: "RDMA Core Userspace Libraries and Daemons"
meta.homepage for rdma-core is: "https://github.com/linux-rdma/rdma-core"
meta.changelog for rdma-core is: ""
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 41.0 with grep in /nix/store/pwlxqklxf3v2pm634kzlpw4wwsx4nrsz-rdma-core-41.0
found 41.0 in filename of file in /nix/store/pwlxqklxf3v2pm634kzlpw4wwsx4nrsz-rdma-core-41.0

Rebuild report (if merged into master) (click to expand)

368 total rebuild path(s)

368 package rebuild(s)

First fifty rebuilds by attrpath
EBTKS
apacheHttpdPackages.mod_tile
apacheHttpdPackages_2_4.mod_tile
bicgl
bicpl
cdo
ceph
ceph-client
ceph-csi
ceph-dev
cloudcompare
cntk
conglomerate
cp2k
crystfel
crystfel-headless
cudaPackages.libcufile
dl-poly-classic-mpi
dpdk
eccodes
elmerfem
elpa
ezminc
febio
freecad
gdal
gdal_2
getdp
globalarrays
gmt
gnudatalanguage
gplates
gpt2tc
grass
gromacsCudaMpi
gromacsDoubleMpi
gromacsMpi
haskellPackages.haskell-mpi
hdf5-mpi
highfive-mpi
hp2p
hpcg
hpl
inormalize
ior
lammps-mpi
libLAS
libceph
libminc
librsb

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/pwlxqklxf3v2pm634kzlpw4wwsx4nrsz-rdma-core-41.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A rdma-core https://github.com/r-ryantm/nixpkgs/archive/3989d02f0029c7dba3835a5f58d81dd1dee99c06.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/pwlxqklxf3v2pm634kzlpw4wwsx4nrsz-rdma-core-41.0
ls -la /nix/store/pwlxqklxf3v2pm634kzlpw4wwsx4nrsz-rdma-core-41.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
nixpkgs-review took longer than 45m and timed out

Maintainer pings
cc @markuskowa for testing.

@GrahamcOfBorg test slurm


[release/1.6 backport] Export remote snapshotter label handler

backport of https://github.com/containerd/containerd/pull/8036 (cherry picked from commit dbf384a5a857b635e0ea8b160645be81e60b3858)
relates to https://github.com/containerd/containerd/pull/8036#issuecomment-1412229046

I wonder if this could make sense for a 1.6 patch release if it would help transitioning. Overall it seems fairly low risk, but it's not a "bug-fix" or "security-fix", so not sure if it would qualify (would be nice though!)

⚠ I had conflicts in:

pkg/cri/server/image_pull.go
pkg/cri/server/image_pull_test.go

The conflicts were in adjacent line changes; I looked at the "parent" commit for https://github.com/containerd/containerd/pull/8036  (https://github.com/containerd/containerd/commit/753bfd6575ece15de49b3df786a9e60fc24cbf55), and the code that was moved did not change;

pkg/cri/server/image_pull.go (appendInfoHandlerWrapper(), getLayers() and the constants):
pkg/cri/server/image_pull_test.go (TestImageLayersLabel)

on main at https://github.com/containerd/containerd/commit/753bfd6575ece15de49b3df786a9e60fc24cbf55

pkg/cri/server/image_pull.go#L555-L623
pkg/cri/server/image_pull_test.go#L341-L384

on release/1.6 at https://github.com/containerd/containerd/commit/4335c650c38a6e91ef9319656ea7086ef5e515c0

pkg/cri/server/image_pull.go#L499-L567
pkg/cri/server/image_pull_test.go#L336-L379

Now the user of remote snapshotter labels appended by CRI plugin is not only stargz-snapshotter but also several remote snapshotter implementations in the community. (There is also discussion to use them from non-snapshotter tool https://github.com/moby/moby/pull/44810)

cvmfs-snapshotter: https://github.com/cvmfs/cvmfs/blob/cvmfs-2.10.0/snapshotter/cvmfs/cvmfs.go#L16-L24
nydus-snapshotter: https://github.com/containerd/nydus-snapshotter/blob/v0.5.0/pkg/label/label.go#L10-L13
soci-snapshotter: https://github.com/awslabs/soci-snapshotter/blob/714f1a971e676fada47cb4c983b4728d06bab309/service/cri.go#L45-L55
overlaybd-snapshotter: https://github.com/containerd/accelerated-container-image/blob/0369b9a8b54d10bae575f4cafb323f28497b5330/pkg/snapshot/overlay.go#L117-L118
stargz-snapshotter: https://github.com/containerd/stargz-snapshotter/blob/v0.14.1/service/cri.go#L29-L39

Currently, the code is defined as private variables/functions so projects outside containerd need to copy-and-paste them. These clones aren't easy to maintain because they need to be copy-and-pasted again every time changes occur on the upstream code.
This PR exports remote snapshotter's label-related logic and tries to make it easier to maintain tools around remote snapshotters.

Failures should be unrelated;
E: Failed to fetch http://azure.archive.ubuntu.com/ubuntu/pool/main/g/gcc-defaults/g++-aarch64-linux-gnu_9.3.0-1ubuntu2_amd64.deb  Connection failed [IP: <IP_ADDRESS> 80]
E: Failed to fetch http://azure.archive.ubuntu.com/ubuntu/pool/main/libc/libconfig-inifiles-perl/libconfig-inifiles-perl_3.000002-1_all.deb  503  Service Unavailable [IP: <IP_ADDRESS> 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

Yeah, a lot of PR checks are getting stuck on Azure networking issue with the Ubuntu apt repos; may be better now but has been failing for hours

@ktock @estesp @fuweid ptal - let me know if you're ok with backporting this to 1.6 (also note the "conflicts" I ran into - see top description - but only adjacent lines, so should be ok®)

@thaJeztah The backport looks good to me. I have re-run the CI.