Bandcamp support down

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.09.20
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log
youtube-dl https://vypole.bandcamp.com/album/vy-pole
[Bandcamp:album] vy-pole: Downloading webpage
WARNING: unable to extract title; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[download] Downloading playlist: vy-pole
[Bandcamp:album] playlist vy-pole: Collected 6 video ids (downloading 6 of them)
[download] Downloading video 1 of 6
[Bandcamp] leftover: Downloading webpage
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description
Every bandcamp album download is broken, tested on multiple artists.  Verified in Firefox inspector there's just a single media stream coming down, looks like parser error

I can confirm this is also broken for me, youtube-dl 2020.9.20 on termux android.

I can confirm as well, youtube-dl 2020.09.06 on Manjaro Linux.

This is probably a duplicate of #26681.

Hi.  I'm just a spectator here - a heavy user of Bandcamp who has used a couple of programs and web sites to convert many Bandcamp tracks to WAV files.   As of about a week ago, I am no longer able to produce large WAV files.   Someone told me it has something to do with "youtube-dl"...?  I am guessing it's a result of some changes made by people at Bandcamp....?     Is anyone else aware of this and has anyone tried to address this?   Either here, or in a different place (pull request?) on this site?   I am very new to this site and am having trouble navigating.  I'm just desperate to get this issue resolved.   Can anyone please help, or tell me where to go to find help?    Thank you!

@JDCourtney1969 Issues are your way of telling the developers of an application that something is broken, or asking questions.
You just commented on an existing issue. If you want your question answered, I'd recommend opening up a new issue here. Select 'Bug Report' and you will be given instructions to follow. Best of luck!

After some tests with https://regex101.com/ it seems ok with following regex
Does anyone can test that ?
https://github.com/ytdl-org/youtube-dl/blob/d65d89183f645a0e95910c3861491a75c26000eb/youtube_dl/extractor/bandcamp.py#L303
Replaced by  <div[^>]*>(.*?<a[^>]+href="([^"]+?)"[^>]*>.*?)</div>
And :
https://github.com/ytdl-org/youtube-dl/blob/d65d89183f645a0e95910c3861491a75c26000eb/youtube_dl/extractor/bandcamp.py#L312
item":{"name":"([^"]+)*"
Test and work with :
<script type="application/ld json">
        {"datePublished":"15 Oct 2009 00:29:22 GMT","albumRelease":[],"name":"Of Porcelain","byArtist":{"name":"Of Porcelain","@id":"https://ofporcelain.bandcamp.com","@type":"MusicGroup"},"albumProductionType":"https://schema.org/StudioAlbum","genre":"https://bandcamp.com/tag/experimental","keywords":["Experimental","chill","downtempo","ooah","Los Angeles"],"@id":"https://ofporcelain.bandcamp.com/album/a-southern-summers-breeze","numTracks":10,"@type":"MusicAlbum","@context":"https://schema.org","image":"https://f4.bcbits.com/img/a3964058248_2.jpg","track":{"@type":"ItemList","itemListElement":[{"item":{"name":"A Portrait Of You","@id":"https://ofporcelain.bandcamp.com/track/a-portrait-of-you","@type":"MusicRecording","duration":"P00H02M13S"},"position":1,"@type":"ListItem"},{"item":{"name":"Gone Til Morning","@id":"https://ofporcelain.bandcamp.com/track/gone-til-morning","@type":"MusicRecording","duration":"P00H03M31S"},"position":2,"@type":"ListItem"},{"item":{"name":"Bleeding Mirrors Remix","@id":"https://ofporcelain.bandcamp.com/track/bleeding-mirrors-remix","@type":"MusicRecording","duration":"P00H05M32S"},"position":3,"@type":"ListItem"},{"item":{"name":"Carressing The Unknown","@id":"https://ofporcelain.bandcamp.com/track/carressing-the-unknown","@type":"MusicRecording","duration":"P00H06M40S"},"position":4,"@type":"ListItem"},{"item":{"name":"Here For Now","@id":"https://ofporcelain.bandcamp.com/track/here-for-now","@type":"MusicRecording","duration":"P00H05M09S"},"position":5,"@type":"ListItem"},{"item":{"name":"Remembering Self","@id":"https://ofporcelain.bandcamp.com/track/remembering-self","@type":"MusicRecording","duration":"P00H07M44S"},"position":6,"@type":"ListItem"},{"item":{"name":"Signal The Captain","@id":"https://ofporcelain.bandcamp.com/track/signal-the-captain","@type":"MusicRecording","duration":"P00H03M14S"},"position":7,"@type":"ListItem"},{"item":{"name":"The Greatest Distraction","@id":"https://ofporcelain.bandcamp.com/track/the-greatest-distraction","@type":"MusicRecording","duration":"P00H05M05S"},"position":8,"@type":"ListItem"},{"item":{"name":"You Are The Sun","@id":"https://ofporcelain.bandcamp.com/track/you-are-the-sun","@type":"MusicRecording","duration":"P00H05M12S"},"position":9,"@type":"ListItem"},{"item":{"name":"Gone Til Morning feat. Katie Gray","@id":"https://ofporcelain.bandcamp.com/track/gone-til-morning-feat-katie-gray","@type":"MusicRecording","duration":"P00H03M31S"},"position":10,"@type":"ListItem"}],"numberOfItems":10},"albumReleaseType":"https://schema.org/AlbumRelease","dateModified":"15 Oct 2009 04:20:37 GMT"}
    </script>

And :
https://github.com/ytdl-org/youtube-dl/blob/d65d89183f645a0e95910c3861491a75c26000eb/youtube_dl/extractor/bandcamp.py#L318
album_title\s*"?:\s*"((?:\\.|[^"\\])+?)"
Test and work witth :
<script type="text/javascript" src="https://s4.bcbits.com/bundle/bundle/1/tralbum_head-11e51ed982b734419417bded4efee97f.fr.js" nonce="" data-cart="{"us_state":null,"currency":"USD","country_name":"États-Unis","is_default":false,"payment_type":null,"us_zip":null,"locale":"fr","country":"US","email":null}" data-fan="{"image_id":null,"name":null,"logged_in":false}" data-band="{"facebook_like_enabled":1,"id":556739587,"image_id":13145,"name":"Of Porcelain","has_discounts":false,"fan_email":"ooah@theglitchmob.com","account_id":4038619595}" data-payment="{"paymentType":null,"paymentDownloadPage":null}" data-embed="{"tralbum_param":{"value":2056483154,"name":"album"},"artist":"Of Porcelain","show_campaign":null,"linkback":"https://ofporcelain.bandcamp.com/album/a-southern-summers-breeze","embed_info":{"public_embeddable":"15 Oct 2009 00:29:22 GMT","exclusive_embeddable":null,"item_public":true,"no_track_preorder":false},"art_id":3964058248,"album_title":"A Southern Summer's Breeze","swf_base_url":"https://bandcamp.com"}" data-referrer-token=""nilZ0a2056483154x1602623808"" data-tralbum-collect-info="{"show_wishlist_tooltip":false,"show_collect":true}" data-tralbum="{"featured_track_id":1568283234,"url":"https://ofporcelain.bandcamp.com/album/a-southern-summers-breeze","preorder_count":null,"last_subscription_item":null,"id":2056483154,"playing_from":"album page","package_associated_license_id":null,"artist":"Of Porcelain","freeDownloadPage":"https://bandcamp.com/download?id=2056483154&ts=1602623808.366373752&tsig=628e64b1c7b0c6792f9fe1eb0f0250a2&type=album","defaultPrice":7.0,"is_preorder":false,"album_is_preorder":false,"is_purchased":null,"play_cap_data":null,"is_bonus":null,"has_discounts":false,"FREE":1,"client_id_sig":null,"album_release_date":"13 Oct 2009 00:00:00 GMT","tralbum_subscriber_only":false,"has_video":null,"items_purchased":null,"PAID":2,"hasAudio":true,"for the curious":"https://bandcamp.com/help/audio_basics#steal https://bandcamp.com/terms_of_use","trackinfo":[{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/5caa8485a4169b0de096d96dd654d240/mp3-128/2017404846?p=0&ts=1602710208&t=ec58ea04a8ba1175ab9176982fe4b43395952f00&token=1602710208_5dbf5b379564b02c4004c6ea14bffa14df18e91c"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":1,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"A Portrait Of You","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":2017404846,"video_poster_url":null,"unreleased_track":false,"encodings_id":2866566267,"track_license_id":null,"play_count":null,"is_draft":false,"duration":133.753,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/a-portrait-of-you","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":2017404846,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/950c6d5c432cb9dce740d6e634df9a3d/mp3-128/1907016944?p=0&ts=1602710208&t=c28a0eea186a79f54381db119b77a4407606ffbf&token=1602710208_323b1da6785319f4055beecb8df078054b0f3fc4"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":2,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Gone Til Morning","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":1907016944,"video_poster_url":null,"unreleased_track":false,"encodings_id":4145055478,"track_license_id":null,"play_count":null,"is_draft":false,"duration":211.2,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/gone-til-morning","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":1907016944,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/223f7db3b0bc7204c7d1d9d8627fd510/mp3-128/1970535879?p=0&ts=1602710208&t=0dba8a9723c05277386a6817443fa33094204243&token=1602710208_f1338c24891b0e578b5a3d0be899223bf148fc2f"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":3,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Bleeding Mirrors Remix","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":1970535879,"video_poster_url":null,"unreleased_track":false,"encodings_id":2538319397,"track_license_id":null,"play_count":null,"is_draft":false,"duration":332.055,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/bleeding-mirrors-remix","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":1970535879,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/e2adeeba6670c7fc4b50a0ca1679254d/mp3-128/747565141?p=0&ts=1602710208&t=d0c1eab752acb9dcf23eeccd0d73d3124798f86b&token=1602710208_0ca81f803fca831711521f354402a57c353a1d5a"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":4,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Carressing The Unknown","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":747565141,"video_poster_url":null,"unreleased_track":false,"encodings_id":219405565,"track_license_id":null,"play_count":null,"is_draft":false,"duration":400.0,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/carressing-the-unknown","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":747565141,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/1552908cd95da8b042c374915101a1fa/mp3-128/1274230040?p=0&ts=1602710208&t=889a96455536e7add9912e6aaf51b74afadc3bae&token=1602710208_329684a80a126f29b38e428ddf3514c14490e382"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":5,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Here For Now","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":1274230040,"video_poster_url":null,"unreleased_track":false,"encodings_id":1827666393,"track_license_id":null,"play_count":null,"is_draft":false,"duration":309.041,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/here-for-now","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":1274230040,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/931981bc50745c7019d296f7701efed0/mp3-128/3990815408?p=0&ts=1602710208&t=1408880b5565612726f1c3094211b12a8387ca52&token=1602710208_09c3ba43eefacf840b939bfbf7fe95026dafdfa4"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":6,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Remembering Self","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":3990815408,"video_poster_url":null,"unreleased_track":false,"encodings_id":3287794686,"track_license_id":null,"play_count":null,"is_draft":false,"duration":464.348,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/remembering-self","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":3990815408,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/072513f2e0e8d151cf662639444da80f/mp3-128/1568283234?p=0&ts=1602710208&t=8ef0c8a6366fb97784c83b23c86168d522b4d131&token=1602710208_55d7dc63dedd7f704712fb09eb8db558b599c334"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":7,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Signal The Captain","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":1568283234,"video_poster_url":null,"unreleased_track":false,"encodings_id":1564560356,"track_license_id":null,"play_count":null,"is_draft":false,"duration":194.585,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/signal-the-captain","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":1568283234,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/75540f4707fbbacabdfe1457d7d26299/mp3-128/3648723361?p=0&ts=1602710208&t=a1f362d9f7f519480be5560dd98d438bd82dde72&token=1602710208_49c62b9aa0a3dbde976c44ba8a33b160fd13c939"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":8,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"The Greatest Distraction","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":3648723361,"video_poster_url":null,"unreleased_track":false,"encodings_id":2589233550,"track_license_id":null,"play_count":null,"is_draft":false,"duration":305.116,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/the-greatest-distraction","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":3648723361,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/f3d4352743462770df4e8ca8d41e5b74/mp3-128/3033840971?p=0&ts=1602710208&t=0724afd6f5e450a28532a98ec2aa6adf7541de67&token=1602710208_71c7c6a1b80fb18a8a8471dc832bc789ee9db093"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":9,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"You Are The Sun","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":3033840971,"video_poster_url":null,"unreleased_track":false,"encodings_id":3875502426,"track_license_id":null,"play_count":null,"is_draft":false,"duration":312.805,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/you-are-the-sun","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":3033840971,"video_featured":null,"has_lyrics":false},{"video_source_type":null,"file":{"mp3-128":"https://t4.bcbits.com/stream/c920026b09e149bdf7e54c27017beadc/mp3-128/1323258418?p=0&ts=1602710208&t=7ac884be85602aca583b11f8f3683f5e35886443&token=1602710208_4ca6441ab733554cf57eeb386603412ee9f8348b"},"alt_link":null,"lyrics":null,"has_info":true,"video_source_id":null,"track_num":10,"encoding_error":null,"is_downloadable":true,"license_type":1,"title":"Gone Til Morning feat. Katie Gray","video_mobile_url":null,"album_preorder":false,"encoding_pending":null,"has_free_download":null,"track_id":1323258418,"video_poster_url":null,"unreleased_track":false,"encodings_id":148833875,"track_license_id":null,"play_count":null,"is_draft":false,"duration":211.278,"free_album_download":false,"private":null,"video_caption":null,"video_id":null,"title_link":"/track/gone-til-morning-feat-katie-gray","is_capped":null,"sizeof_lyrics":0,"streaming":1,"id":1323258418,"video_featured":null,"has_lyrics":false}],"packages":null,"art_id":3964058248,"licensed_version_ids":null,"is_private_stream":null,"initial_track_num":null,"use_expando_lyrics":false,"item_type":"album","is_band_member":null,"current":{"type":"album","art_id":3964058248,"require_email_0":null,"new_date":"15 Oct 2009 00:29:22 GMT","band_id":556739587,"audit":0,"upc":null,"selling_band_id":556739587,"title":"A Southern Summer's Breeze","set_price":5.0,"publish_date":"15 Oct 2009 00:29:22 GMT","mod_date":"15 Oct 2009 04:20:37 GMT","download_desc_id":null,"minimum_price_nonzero":null,"download_pref":2,"killed":null,"purchase_url":null,"new_desc_format":1,"about":null,"private":null,"auto_repriced":null,"artist":null,"minimum_price":0.0,"is_set_price":null,"id":2056483154,"featured_track_id":1568283234,"purchase_title":null,"credits":"written & produced by Josh Mayer aka Ooah","require_email":null,"release_date":"13 Oct 2009 00:00:00 GMT"}}" data-site="{"env":"prod","supportEmail":"support@ofporcelain.bandcamp.com","is_custom_domain":null}" data-band-follow-info="{"tralbum_type":"a","tralbum_id":2056483154}"></script>

https://github.com/ytdl-org/youtube-dl/issues/30306


VerifyOrDie failure during minimalmdns operational discovery

Problem

Having the chip-tool repeatedly send out cluster commands to another device, every so often (between 50-150) during operational discovery, once the controller sends out its mdns query, almost immediately afterwards, a VerifyOrDie SIGABRT is thrown during one of two areas:

VerifyOrDie failure at vendor/csa-iot/connectedhomeip/src/lib/support/Variant.h:217: (mTypeId == VariantInternal::TupleIndexOfType<T, std::tuple<Ts...>>::value)
VerifyOrDie failure at connectedhomeip/src/lib/support/Pool.cpp:71: (value & (kBit1 << offset)) != 0

This seems to occur during the Node resolution / parsing of the mdns query responses. Possibly that the buffers for these packets are getting freed while still being parsed?

Proposed Solution
Does the Matter SDK allocate and copy their own buffers while parsing the mdns query?
Is the MinimalMdnsServer thread safe while parsing the receiving query responses?

tcpdump.zip
Attached is the tcpdump of when the SIGABRT actually occurs.
Will try to get the full call stack tomorrow.

So I was able to confirm after a little more debugging that:
Inside chip::Dnssd::(anonymous namespace)::MinMdnsResolver::AdvancePendingResolverStates(), we get into the 'resolver->IsActiveOperationalParse()' scope. At the start, the resolver->IsActive == true.
Somewhere while resolver->Take() is being called, the function "chip::Dnssd::IncrementalResolver::ResetToInactive()" gets called, where it resets the mSpecificResData. So when Take() gets called, which calls "mSpecificResolutionData.Get();", the mSpecificResolutionData.mTypeId is set to -1 (kInvalidType.
My logs that print out to help debug look something like this:
01-01 01:58:14.960 24096 24098 I CHIP DIS: static void mdns::Minimal::ServerBase::OnUdpPacketReceived(chip::Inet::UDPEndPoint *, chip::System::PacketBufferHandle &&, const chip::Inet::IPPacketInfo *): We have received on endpoint: 0x0xaff78c20
01-01 01:58:14.960 24096 24098 I CHIP DL : virtual void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::OnMdnsPacketData(const mdns::Minimal::BytesRange &, const chip::Inet::IPPacketInfo *): BytesRange is 0x0xaf47f664
01-01 01:58:14.960 24096 24098 I CHIP DL : void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::AdvancePendingResolverStates(): Resolver ptr: 0xaff761a0. isactive? (1)
01-01 01:58:14.960 24096 24098 I CHIP DL : void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::AdvancePendingResolverStates():L390: ResolverIsActiveOperationalParse(). ResolvedNodeData: 0xaf47f450. resolver: 0xaff761a0. isactive?: 1
01-01 01:58:14.960 24096 24098 I CHIP DL : CHIP_ERROR chip::Dnssd::IncrementalResolver::Take(chip::Dnssd::ResolvedNodeData &): mSpecificResolutionData: 0xaff762a0, type=0
01-01 01:58:14.960 24096 24098 I CHIP DL : void chip::Dnssd::IncrementalResolver::ResetToInactive(): Resetting 0xaff761a0 (mSpecificResData=0xaff762a0)
01-01 01:58:14.960 24096 24098 I CHIP DIS: static void mdns::Minimal::ServerBase::OnUdpPacketReceived(chip::Inet::UDPEndPoint *, chip::System::PacketBufferHandle &&, const chip::Inet::IPPacketInfo *): We have received on endpoint: 0x0xaff78c80
01-01 01:58:14.961 24096 24098 I CHIP DL : virtual void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::OnMdnsPacketData(const mdns::Minimal::BytesRange &, const chip::Inet::IPPacketInfo *): BytesRange is 0x0xaf47f664
01-01 01:58:14.961 24096 24098 I CHIP DL : void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::AdvancePendingResolverStates(): Resolver ptr: 0xaff761a0. isactive? (1)
01-01 01:58:14.961 24096 24096 I CHIP DIS: mDNS broadcast had only partial success: 2 successes and 2 failures.
01-01 01:58:14.961 24096 24098 I CHIP DL : void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::AdvancePendingResolverStates():L390: ResolverIsActiveOperationalParse(). ResolvedNodeData: 0xaf47f450. resolver: 0xaff761a0. isactive?: 1
01-01 01:58:14.961 24096 24096 I CHIP DL : void chip::Dnssd::IncrementalResolver::ResetToInactive(): Resetting 0xaff761a0 (mSpecificResData=0xaff762a0)
01-01 01:58:14.961 24096 24098 I CHIP DL : CHIP_ERROR chip::Dnssd::IncrementalResolver::Take(chip::Dnssd::ResolvedNodeData &): mSpecificResolutionData: 0xaff762a0, type=0
01-01 01:58:14.961 24096 24098 I CHIP DL : T &chip::Variant<chip::Dnssd::OperationalNodeData, chip::Dnssd::CommissionNodeData>::Get() [Ts = <chip::Dnssd::OperationalNodeData, chip::Dnssd::CommissionNodeData>, T = chip::Dnssd::OperationalNodeData]: mTypeId (-1) != 0 | Valid? (0)
01-01 01:58:14.961 24096 24098 I CHIP SPT: VerifyOrDie failure at vendor/csa-iot/connectedhomeip/src/lib/support/Variant.h:221: false

Looks like it's getting expired by the function:
ExpireIncrementalResolvers()
01-01 02:27:31.288 29666 29668 I CHIP DL : CHIP_ERROR chip::Dnssd::IncrementalResolver::Take(chip::Dnssd::ResolvedNodeData &): resolver (0xaad1b1a0) mSpecificResolutionData: 0xaad1b2a0, type=0
01-01 02:27:31.288 29666 29666 I CHIP DL : void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::ExpireIncrementalResolvers(): Resetting resolver (0xaad1b1a0) to inactive
01-01 02:27:31.288 29666 29666 I CHIP DL : void chip::Dnssd::IncrementalResolver::ResetToInactive(): Resetting 0xaad1b1a0 (mSpecificResData=0xaad1b2a0)
01-01 02:27:31.288 29666 29668 I CHIP DL : T &chip::Variant<chip::Dnssd::OperationalNodeData, chip::Dnssd::CommissionNodeData>::Get() [Ts = <chip::Dnssd::OperationalNodeData, chip::Dnssd::CommissionNodeData>, T = chip::Dnssd::OperationalNodeData]: mTypeId (-1) != 0 | Valid? (0)

@andy31415 / @andreilitvin Think you'd be able to help assist in how we can mitigate this during active parsing/resolution?

Is there some form of script example on how to reproduce this? The chip-tool repeatedly send out cluster commands to another device is not as clear to me ... do I just loop a readattribute or something like that?

Regarding the thread safety and allocation questions: the chip stack generally assumes a single thread for data processing. in particular, minmdns assumes that packets are received and parsed in-line by the "chip thread" and I do not expect it to manage its own allocation/deallocation.
it does however allocate extra buffers if it needs to reply to packets.

For https://github.com/project-chip/connectedhomeip/issues/21835#issuecomment-1213595012 - does this mean that you observe two separate threads interacting/racing?

In terms of how things should work: ExpireIncrementalResolvers is supposed to mark some resolvers as forcibly done (i.e. timeout before being able to find something), which would expect to get their timeout called and operations should terminate.
It should not result in a double-free which the verify_or_die seems to indicate. Maybe enabling pools on the heap and some memory sanitize could help narrow down where each individual free happens (assuming this pool can be moved to heap).

From what I can see, ExpireIncrementalResolvers is supposed to check if any resolver still needs data and if all needed data is received (i.e. they have an IP) they they are marked as complete.

@andy31415 Yes we basically have a script which repeats over the following commands 100+ times:
chip-tool colorcontrol move-to-hue 0 7 0 0 0 1234 1
chip-tool colorcontrol move-to-saturation 3 0 0 0 1234 1
chip-tool levelcontrol move-to-level 100 0 0 0 1234 1

So would we want to be able to add a sort of "state" to the resolver to indicate whether it's still being parsed within the AdvancePendingResolverStates or not?

What I do not quite understand is:
VerifyOrDie failure at vendor/csa-iot/connectedhomeip/src/lib/support/Variant.h:221:

seems to indicate that the object we call Get on is not the right type. However the code has checks like VerifyOrReturnError(IsActiveOperationalParse(), CHIP_ERROR_INCORRECT_STATE);  which is effecively a:
bool IsActiveOperationalParse() const { return mSpecificResolutionData.Is<OperationalNodeData>(); }

so that Get should not fail given that the check before it succeeds... this is unless there is some multi-threading going on (which should not happen).
Also the original error is VerifyOrDie failure at connectedhomeip/src/lib/support/Pool.cpp:71: (value & (kBit1 << offset)) != 0 which seems to be something else - it is Pool.cpp and not Variant.
I believe I would need to reproduce it myself ideally or maybe if you are on slack see if we get some time overlap so we can debug on your setup. Just reading the code right now does not make anything stand out.

Is this a custom build of sorts or chip-tool? I wonder if some threading issues exist - e.g. some way of chip main thread being started several times. Maybe printing the thread-id during diferent operations may show when take() is called and by what. This behaviour is very odd.

@andy31415  For sure, I'm on slack. I'll try to reach out to you Friday. Meanwhile, I'll check on the thread ids to see what thread(s) are calling these commands.

@andy31415  In the logs I posted, the actual Thread ID is included for each line:
// Format: <date> <time> <processid> <tid> | <log>
// This happens on ThreadID 29668
01-01 02:27:31.288 29666 29668 I CHIP DL : CHIP_ERROR chip::Dnssd::IncrementalResolver::Take(chip::Dnssd::ResolvedNodeData &): resolver (0xaad1b1a0) mSpecificResolutionData: 0xaad1b2a0, type=0
// This happens on ThreadID 29666
01-01 02:27:31.288 29666 29666 I CHIP DL : void chip::Dnssd::(anonymous namespace)::MinMdnsResolver::ExpireIncrementalResolvers(): Resetting resolver (0xaad1b1a0) to inactive
01-01 02:27:31.288 29666 29666 I CHIP DL : void chip::Dnssd::IncrementalResolver::ResetToInactive(): Resetting 0xaad1b1a0 (mSpecificResData=0xaad1b2a0)
01-01 02:27:31.288 29666 29668 I CHIP DL : T &chip::Variant<chip::Dnssd::OperationalNodeData, chip::Dnssd::CommissionNodeData>::Get() [Ts = <chip::Dnssd::OperationalNodeData, chip::Dnssd::CommissionNodeData>, T = chip::Dnssd::OperationalNodeData]: mTypeId (-1) != 0 | Valid? (0)

The CHIP task thread is 29668. So you're right that there's multiple threads. Is this not allowed to have the initialization done within the main process?

I am unsure - we can do things in main() however based on timestamps it looks like both operations happen at the same time (31.288) so we have two threads operating on the same dnssd processing logic. This is generally unexpected as CHIP is designed to work as a single thread.
If you could find a way to get the stack trace of each thread that would help understand things. the main() thread is allowed to do chip operations, however only before the chip main loop is started. You could also try to add some assertChipStackLockedByCurrentThread in all various incremental resolver places (like in ::Take and ::ResetToInactive) and figure out if that asserts. if it does, we likely found the issue. If it does not assert, I still wonder what those threads are.

@andy31415 Because we're setting enableServerInteractions to true and initializing the DeviceControllerFactory before the chip main loop starts, this would startup a DNS-SD server outside of the CHIP thread. Then when we call DeviceControllerFactory.SetupCommissioner() this seems to start the DNS-SD server in the CHIP thread. Which looks like this is where the race condition is from, as we have two servers starting up almost immediately after each other.

This seems like a bug - there should be a single DNS-SD server running at any time. I believe the dnssd server should be a singleton so even though it has a StartServer method, that should only restart the same server and not use separate threads.
Could you clarify the statement of we have two servers starting? Is this actually two servers (different this) or is it two different threads (main and chip thread) conflicting? I would expect the latter.

Sorry for confusion, yes two different threads (main and chip thread) which are currently conflicting with each other. This conflict only occurs when the enableServerInteractions is enabled.

What is the sequence of operations in terms of using serverInteractions and starting the chip main thread?
Things should be safe to run before chip main thread is started (i.e. setting enableServerInteractions), however once you start the chip thread, you are not allowed to operate on anything else from main. So if you do:
ControllerFactory::.....
StartChipMainThread

that is safe (I believe), however:
StartChipMainThread()
ControllerFactory::....

is not ok.

@andy31415 Thanks for that example. We were doing several things after calling the DeviceController::Init, which may have queued up a number of tasks for the thread before starting the thread that created a race condition. After fixing this, I do not see the reported SIGABRT occurring any more.


Why your digits.traineddata will crash my process?

I can recognize noramlly with official eng.traineddata.But I just want to recognize digital in the image. So I use your digits.traineddata here to do this. But I don't know why it will crash my process. It will give me such error windows

Is there anything I have missed?

Firstly, this traineddata is just a proof of concept. You should finetune for your particular case.
Secondly, it is in the new fast 'integer' format, so you need latest tesseract code from github.
Thirdly, it has only been trained for LSTM, so it will only work with --oem 1.
BTW, Since I do not know the language, I do not know what error you are getting.
Please see attached image and it's test output.
# tesseract --tessdata-dir ./tessdata_fast digits.png digits-test-eng --psm 6 --oem 1 -l eng
Tesseract Open Source OCR Engine v4.00.00alpha with Leptonica

# tesseract --tessdata-dir ./tessdata_fast digits.png digits-test-digits --psm 6  --oem 1 -l digits
Tesseract Open Source OCR Engine v4.00.00alpha with Leptonica

digits-test-eng.txt

Wow, I am very surprise your precision for recognization... Actually this is my target image. I just wan to get those digital in the picture..
If I use the official eng.traineddata. I will get such result

But if I use your digits.traineddata I will get a error window. That mean the process of tesseract is broken..

You are not specifying the language. digits is also a config file used for tesseract 3.
Try
.\tesseract.exe .\tem.jpg .\output.txt --oem 1 --psm 1 -l digits

Make sure that digits.traineddata is in your tessdata folder.

Wow, as your prompt, I try to use --oem 1. Then I even cannot use the official eng.traineddata..It will give me such error information

Yes, I know that mean a config file. and I have. This is my folder structure

I don't see any `digits.traineddata' there.
You have to specify the traineddata by -l digits and not use digits config file.

Please download latest version of windows binaries from https://github.com/UB-Mannheim/tesseract/wiki

After install thhat newest version in your link, and copy your digits.traineddata into ...Tesseract-OCR4\tessdata. This is current my structure of testdata. And work for my this target image. it will give a poor result also

And it seem the config file digits don't work anymore. If it work maybe it will not return those ) and ,

After I install the new version 4.0.0 from your this link. The config file digits will don't work normally in --oem 1 mode. It also happen on you?
.\tesseract.exe .\tem.jpg stdout --oem 1 digits

.\tesseract.exe .\tem.jpg stdout --oem 0 digits

digits config file DOES NOT work with --oem 1 / LSTM engine.
Using digits.traineddata is a way to get around it.
However, your image has both numbers and alphabets. Digits traineddata is
ONLY for numbers.
ShreeDevi

भजन - कीर्तन - आरती @ http://bhajans.ramparivar.com
On Tue, Oct 17, 2017 at 4:15 PM, yode<EMAIL_ADDRESS>wrote:

After I install the new version 4.0.0 from your this link
https://github.com/UB-Mannheim/tesseract/wiki. The config file digits
will don't work normally in --oem 1 mode. It also happen on you?
.\tesseract.exe .\tem.jpg stdout --oem 1 digits
https://camo.githubusercontent.com/3046e717f8652ba428eef239308ea382cb02cb54/68747470733a2f2f692e737461636b2e696d6775722e636f6d2f4b6e63394d2e706e67
.\tesseract.exe .\tem.jpg stdout --oem 0 digits
https://camo.githubusercontent.com/29ed1e1c4275f516092f07cf8c0f0c2d6c94fe97/68747470733a2f2f692e737461636b2e696d6775722e636f6d2f6844744f302e706e67
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/Shreeshrii/tessdata4alpha/issues/2#issuecomment-337192482,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE2_ox8hhzxn3q9CXcLtnTg-b6QGUpznks5stIU9gaJpZM4P7qjz
.

I used to think this is a bug of Tesseract. Thanks for your explaination. Could you give me some information about how to trained a .trainneddata file requested by --oem 1? I just can train that data requsted by --oem 0 currently.
And I know your digits.traineddata just can recognize single-digital number. I don't matter.  Your precison about recognization move me deeply. If I use your digits.traineddata . Can Tesseract return the position of those single-digital with high degree of accuracy? I mean those rectangle must have a low degree of accuracy even they is regard as digital.

Sorry for disturb. I swear that is last question. Look forward your response..

Please see https://github.com/tesseract-ocr/tesseract/wiki/4.0-with-LSTM
for information re 4.0 and training.
--oem 0 is for legacy tesseract
--oem 1 is for lstmf
--oem 2 is for both
I had trained digits traineddata using just 0 1 2 3 4 5 6 7 8 9 . , ( )
Using eng.traineddata as base.
You should first try with the existing traineddata files, if they don't
work then do training.
On 17-Oct-2017 6:58 PM, "yode"<EMAIL_ADDRESS>wrote:

Sorry for disturb. I swear it
https://github.com/Shreeshrii/tessdata4alpha/issues/2#issuecomment-337204786
is last question. Look forward your response..
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/Shreeshrii/tessdata4alpha/issues/2#issuecomment-337231176,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE2_o1gWIV4uVWtJnz0fE1UJHdgGOKspks5stKuIgaJpZM4P7qjz
.

I don't think the lstm engine can provide good positional info, since it
does line based recognition.
If that is important to you, please use the legacy engine.
On 17-Oct-2017 7:35 PM, "ShreeDevi Kumar"<EMAIL_ADDRESS>wrote:

Please see https://github.com/tesseract-ocr/tesseract/wiki/4.0-with-LSTM
for information re 4.0 and training.
--oem 0 is for legacy tesseract
--oem 1 is for lstmf
--oem 2 is for both
I had trained digits traineddata using just 0 1 2 3 4 5 6 7 8 9 . , ( )
Using eng.traineddata as base.
You should first try with the existing traineddata files, if they don't
work then do training.
On 17-Oct-2017 6:58 PM, "yode"<EMAIL_ADDRESS>wrote:

Sorry for disturb. I swear it
https://github.com/Shreeshrii/tessdata4alpha/issues/2#issuecomment-337204786
is last question. Look forward your response..
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/Shreeshrii/tessdata4alpha/issues/2#issuecomment-337231176,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE2_o1gWIV4uVWtJnz0fE1UJHdgGOKspks5stKuIgaJpZM4P7qjz
.

Thanks anyway..I think I have bother you already. Sorry sincerely.


New CodeAnalysis/EscapedNotTranslated sniff

At times, people will accidentally forget to add the __ when they intend to use one of the "translate + escape" functions.
I've run into this a number of times now when reviewing/fixing code and found that they aren't that easy to spot visually when you're focussed on other things.
So as it was such an easy sniff to write, I figured I may as well.
AFAICS there are only two escaping functions in core which have direct "translate + escape" sister-functions.
All the same, the sniff has been set up to allow for more similar function-combis to be added.
Includes unit tests.
Includes documentation.
Sniff has been added to the WordPress-Extra ruleset.

@GaryJones Thanks for being thorough!

Thanks for being thorough!

It's rare that I get a chance to find more than one valid thing wrong with your PRs. I suggest you take the rest of the night off as you're clearly not up to your high standards today 😛


A few changes for internal-analytics

leftover classes for images
switch to readr for text
improved partials

Coverage increased (+0.09%) to 77.237% when pulling 2e268b46d51106ef757689d867913086fbe16630 on jiwalker-usgs:master into 9da19ec5a9283bae08d76a7e83e732861c35dc83 on USGS-VIZLAB:master.


200hz monitor

Hello, ran into an interesting problem today. Today one monitor stopped working. After fiddling with packages and their versions came to the conclusion that they are not the problem. And by gauge method I realized that the problem was the frequency of the monitor. I do not know why, but the frequency 200hz stopped working. As soon as I changed to 144hz all at once worked. Any information on this, what is it about and why it suddenly stopped working?
graphics card:
nvidia GP106 [GeForce GTX 1060 6GB]

Nvidia is not supported.
Most likely either your nvidia drivers caused an issue, or it's a problem with wlroots. Can't really think of another issue.
You can check on sway-git (note the -git) but I am pretty sure it will be the same.


account-compression (program): on-chain v0 release

[x] Version account headers

[x] Version changelog output as well

[x] New vanity keys corresponding to spl-naming conventions

[x] Close out preexisting programs

GRoLLzvxpxxu2PGNJMMeZPyMxjAUH9pKqxGXV9DGiceU (account-compression)
WRAPYChf58WFCnyjXKJHtrPgzKXgHp6MD9aVDqJBbGh (noop)

[x] Add a closeTree instruction

For future v1 release:

rewrite in raw Solana + Shank (for autogenerated anchor compatibility)
add batchAppend instruction
add initWithRoot instruction

Versioned account header in #3619

Versioning changelog output in #3632

Waiting to close out this v0 release until I can deploy an example program on mainnet-beta for account-compression.
Blocked on #3615

Deployed on devnet and mainnet-beta

Hey @ngundotra why we don't deploy the account-compression program on testnet?
I'm trying to integrate account-compression with helius but can't run my program on testnet.

@trankhacvy it's on testnet now! thanks for flagging this, forgot to come back around and push there


Reduce embed-grid package size

As a consumer of embedded grids in iframes, I want the package size to be as small as possible so that they load quickly when embedded in other pages.
Currently the largest part of the embed-grid package is the monaco-editor: https://github.com/deephaven/web-client-ui/pull/747#discussion_r967088613
This is used for cell overflow display and custom columns. Perhaps there is a way we can reduce this package size, or lazy load it so it's only loaded when using those features.

We can just deprecate embed-grid and use embed-widget entirely instead.


Return a CDataModel for CalllingConvention::AppleAarch64

According to Apple's documentation, their C data model seems to conform to LP64.
This Wikipedia article also says that macOS uses LP64.
Unless I've missed something, it should be possible to simply return CDataModel::LP64 from Triple::data_model when the calling convention is AppleAarch64.
I'm happy to open a PR for this if this is the right solution.

This is now released in target-lexicon 0.12.15.


[Question]: HTTP API Retrieve chunks efficiency

Describe your problem
There is only one node deployed now. If multiple nodes are added, will the retrieval efficiency be improved? Or is there any way you can improve the efficiency of retrieval?

Reordering is required for accurate retrieval.

Re-rank model is very time consuming. I suggest not to use re-rank model since it's low in terms of ROI.

Even if I don't use the re-rank model, it's still slow. Are there any optimization methods? Is it related to the block size of the embedding or the embedding model?

Click on it and you can see the elapsed time of every step of retrieval.
Paste that screen shot here if it's convenient for you.


Added additional Load Balancer instructions for external endpoint

More documentation on how to get expose the node to the internet

@JSeam2 Thank you. Please rebase to the current main head and drop already merged commits.


Is there any option for user defined custom error messages instead of predefined error messages ?

If not please consider it as a feature request. Because there are cases you don't want the end-user to know exactly which input field is incorrect.
I have implemented this plugin with a unary client interceptor for validation.

Dup of #74


[iOS] All TextInputs are incorrectly avoided when a TextInput with secureTextEntry is mounted

Environment
Library version: 2.3.3
OS version:
15.3.1 - iPhone 8
15.4 - iPhone 12
Affected platforms

[ ] Android
[X] iOS

Current behavior
Hello, let me first preface this with the fact that this is one of the best keyboard avoiding libraries I have ever used! It handled almost all of my cases beautifully. Thank you for that!
There is one issue I noticed though, and it pertains to the password fields on iOS. The core of the issue is that when you focus a TextInput that has a secureTextEntry prop enabled, it doesn't apply the correct padding as it does with regular TextInputs. This may be due to the fact that iOS appends an additional "Passwords" row to the top of the keyboard. I also noticed that the incorrect padding is then applied to every TextInput that is in the same parent view/screen as the one that has secureTextEntry applied, even though those other TextInputs do NOT have a secureTextEntry prop set.
Expected behavior
The expected behavior is for the padding to be correctly applied even when TextFields with secureTextEntry are present.
Reproduction
Reproduction repo: https://github.com/fobos531/keyboard-avoiding-repro
Summary:

freshly initialized Expo SDK 44 project
run with expo run:ios on physical device (may need to set up code signing beforehand). This issue manifests itself only on physical devices, since setting secureTextEntry doesn't have any effect on simulators.

In App.tsx on L16, a TextInput with secureTextEntry is added. If you try to focus any of the textfields, you'll notice that the padding is incorrectly applied to both of them. After removing secureTextEntry and fully reloading the app (exit and reopen, not just hot refresh) the padding is now correctly applied. The issue is the same if you try to set secureTextEntry on the first   TextInput.
Hope this helps! Let me know if you need anything else.

Hi @fobos531 , thx for providing repro. After opening repro app on physical iPhone 12 Pro, I observed following behavior:
(I slightly modify repro - grey background is just full screen <View /> that wraps absolutely positioned input container.)
return (
    <View style={{ backgroundColor: 'lightgray', flex: 1, alignSelf: 'stretch' }}>
      <View style={{ bottom: 20, position: "absolute", width: "100%" }}>
        <Text>insetsBottom: {insets.bottom}</Text>
        <TextInput style={{ borderColor: "red", borderWidth: 2, paddingVertical: 10, marginBottom: 10 }} />
        <TextInput style={{ borderColor: "red", borderWidth: 2, paddingVertical: 10 }} secureTextEntry />
        <StatusBar animated barStyle="dark-content" />
      </View>
    </View>
  );

First input
Second input

Second input screenshot has invisible keyboard, because Apple automatically hides it when there is secureTextEntry input visible
If you will compare those screenshots, you can notice that focused input has the same distance from the keyboard's top edge. I also checked how it looks like when none of the inputs are secureTextEntry:

First input
Second input

Even when keyboard is "higher" because of suggestions row, distance from keyboard remains the same for both inputs.
The weird thing for me was that distance from bottom of input and keyboard's top edge was not 0 (it's the default, that can be configured by setAvoidOffset method).  Also when focusing second input, there is small white area between grey view and keyboard. And it turns out that the distance is equal to bottom safe area inset (34) returned from react-native-safe-area-context.
So I tried to check what happens if I will not use position: 'absolute'.
Following code demonstrates input container positioned relatively:
return (
    <SafeAreaView edges={['bottom']} style={{ flex: 1, alignItems: "center", alignSelf: 'stretch', backgroundColor: 'lightgray', justifyContent: "center" }}>
      <View style={{ alignSelf: 'stretch', flex: 1 }} />
      <Text>insetsBottom: {insets.bottom}</Text>
      <View style={{ alignSelf: 'stretch' }}>
        <TextInput style={{ borderColor: "red", borderWidth: 2, paddingVertical: 10, marginBottom: 10 }} />
        <TextInput style={{ borderColor: "red", borderWidth: 2, paddingVertical: 10 }} secureTextEntry />
      </View>
      <StatusBar animated barStyle="dark-content" />
    </SafeAreaView>
  );

First input
Second input

When I positioned that using flex and additionally wrapped it in <SafeAreaView /> component, focused input is "touching" keyboard's top edge, which is the expected behavior.
My summary is that I would suggest changing input's container position to relative (with flexDirection: 'column-reverse' or with sibling  with flex: 1), because from native code perspective, there is no way to detect if focused input is positioned absolutely (either directly or by positioning parent container absolutely).
Let me know, if we can close that issue 👋


feat: support watching the collaset

What type of PR is this?

/kind feature
What this PR does / why we need it:
feat: support watching the collaset
Which issue(s) this PR fixes:

Fixes #438
Special notes for your reviewer:
Does this PR introduce a user-facing change?

Additional documentation e.g., design docs, usage docs, etc.:

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

20 of 31 (64.52%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-7.5%) to 63.333%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

pkg/engine/printers/printer/oam_printer.go
0
1
0.0%

pkg/engine/printers/printer/kafed_printer.go
9
12
75.0%

pkg/engine/printers/convertor/kafed_convertor.go
11
18
61.11%

Totals

Change from base Build<PHONE_NUMBER>:
-7.5%

Covered Lines:
5313

Relevant Lines:
8389

💛  - Coveralls


xSQLServerAlwaysOnAvailabilityGroup: Remove cert thumbprint from tests

Removing certifcate thumbprint from tests which otherwise will make the example fail to compile when testing with the new common tests.
This Pull Request (PR) fixes the following issues:
n/a

[ ] Change details added to Unreleased section of CHANGELOG.md?
[ ] Added/updated documentation, comment-based help and descriptions in .schema.mof files where appropriate?
[x] Examples appropriately updated?
[ ] New/changed code adheres to Style Guidelines?
[ ] Unit and (optional) Integration tests created/updated where possible?

This change is

Reviewed 2 of 2 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable


Error: Uncaught ReferenceError: readyCaptcha is not defined

I follow all the instroduction, upload the index.html to our hosting but and also register the V3 recaptcha but when run the app it show error:
I/chromium(21519): [INFO:CONSOLE(1)] "Uncaught ReferenceError: readyCaptcha is not defined", source: https://khangtran-development.web.app/index.html (1)
Seem that the function readyCaptcha on the javascript does not loaded.

@basnetjiten I encountered the same issue. It looks like readyCaptcha function is called before the page finishes loading.

How did you fixed this issue?

HOW TO FIX?

Hi @oktopidengbo , This issue should be resolved in the new version now. Please check the updated index.html as well as shown in the example app.


this will help people read my posts more easily :)

theres a 0% chance this gets approved

yeah probably. lets see :)


InvokeGameCenterCallback Unhandled exception

Please fill in the following fields:
Unity editor version: 2018.4.12f1
Firebase Unity SDK version: 6.60
Firebase plugins in use (Auth, Database, etc.): Auth, Analytics, Realtime-Database, DynamicLinks, Messaging, Crashlytics
Additional SDKs you are using (Facebook, AdMob, etc.): Admob, Unity IAP, GooglePlayGames
Platform you are using the Unity editor on (Mac, Windows, or Linux): Windows
Platform you are targeting (iOS, Android, and/or desktop): iOS, Android
Scripting Runtime (Mono, and/or IL2CPP): IL2CPP
Please describe the issue here:
(Please list the full steps to reproduce the issue. Include device logs, Unity logs, and stack traces if available.)
Crashlytics issue below -
Crashed: com.apple.main-thread
0  LabChaos                       0x1001b4ee0 CrashedCheckBelowForHintsWhy + 118 (CrashReporter.mm:118)
1  LabChaos                       0x101d0cadc firebase::dynamic_links::ListenerImpl::DynamicLinkReceived(void*) + 12829684
2  LabChaos                       0x1002a36ec RuntimeInvoker_TrueVoid_t22962CB4C05B1D89B55A6E1139F0E87A90987017_RuntimeObject_RuntimeObject(void ()(), MethodInfo const, void*, void**) + 36363 (Il2CppInvokerTable.cpp:36363)
3  LabChaos                       0x10108c73c il2cpp::vm::Runtime::Invoke(MethodInfo const*, void*, void**, Il2CppException**) + 539 (Runtime.cpp:539)
4  LabChaos                       0x10108d068 il2cpp::vm::Runtime::CallUnhandledExceptionDelegate(Il2CppDomain*, Il2CppDelegate*, Il2CppException*) + 476 (Runtime.cpp:476)
5  LabChaos                       0x10108cff8 il2cpp::vm::Runtime::UnhandledException(Il2CppException*) + 632 (Runtime.cpp:632)
6  LabChaos                       0x100b01ee8 ScriptingInvocation::Invoke(ScriptingExceptionPtr*, bool) + 362 (ScriptingInvocation.cpp:362)
7  LabChaos                       0x100d34780 InvokeGameCenterCallback(char const*, ScriptingArguments const&) + 1368 (GameCenter.mm:1368)
8  LabChaos                       0x100d34834 GameCenter::ExecuteGameCenterCallbacks() + 1456 (GameCenter.mm:1456)
9  LabChaos                       0x100a6efe0 ExecutePlayerLoop(NativePlayerLoopSystem*) + 347 (PlayerLoop.cpp:347)
10 LabChaos                       0x100a6f014 ExecutePlayerLoop(NativePlayerLoopSystem*) + 365 (PlayerLoop.cpp:365)
11 LabChaos                       0x100a6f1ec PlayerLoop() + 45 (RecursionLimit.h:45)
12 LabChaos                       0x100cb5c0c UnityPlayerLoopImpl(bool) + 271 (LibEntryPoint.mm:271)
13 LabChaos                       0x1001abf34 UnityRepaint + 280 (UnityAppController+Rendering.mm:280)
14 LabChaos                       0x1001abe10 -[UnityAppController(Rendering) repaintDisplayLink] + 72 (UnityAppController+Rendering.mm:72)
15 QuartzCore                     0x1a5a7a514 CA::Display::DisplayLink::dispatch_items(unsigned long long, unsigned long long, unsigned long long) + 632
16 QuartzCore                     0x1a5b44774 display_timer_callback(__CFMachPort*, void*, long, void*) + 264
17 CoreFoundation                 0x19f1896d4 __CFMachPortPerform + 172
18 CoreFoundation                 0x19f1b2e5c CFRUNLOOP_IS_CALLING_OUT_TO_A_SOURCE1_PERFORM_FUNCTION + 56
19 CoreFoundation                 0x19f1b2588 __CFRunLoopDoSource1 + 444
20 CoreFoundation                 0x19f1ad45c __CFRunLoopRun + 2168
21 CoreFoundation                 0x19f1ac8bc CFRunLoopRunSpecific + 464
22 GraphicsServices               0x1a9018328 GSEventRunModal + 104
23 UIKitCore                      0x1a32426d4 UIApplicationMain + 1936
24 LabChaos                       0x1001a39e0 main + 41 (main.mm:41)
25 libdyld.dylib                  0x19f037460 start + 4
Please answer the following, if applicable:
Have you been able to reproduce this issue with just the Firebase Unity quickstarts (this GitHub project)?
N/A
What's the issue repro rate? (eg 100%, 1/5 etc)
Device
Model: iPhone 6s Plus
Orientation: Portrait
RAM free: 78.7 MB
Disk free: 5.22 GB
Operating System
Version: 13.1.2 (17A860)
Orientation: Landscape
Jailbroken: No
Device
Model: iPhone 8
Orientation: Face Up
RAM free: 67.77 MB
Disk free: 20.96 GB
Operating System
Version: 13.1.3 (17A878)
Orientation: Landscape
Jailbroken: No
Device
Model: iPad (5th generation)
Orientation: Landscape
RAM free: 31.72 MB
Disk free: 872.8 MB
Operating System
Version: 13.1.3 (17A878)
Orientation: Landscape
Jailbroken: No
Device
Model: iPhone 7 Plus
Orientation: Face Up
RAM free: 119.36 MB
Disk free: 2.74 GB
Operating System
Version: 13.1.3 (17A878)
Orientation: Landscape
Jailbroken: No
Device
Model: iPhone 8
Orientation: Landscape
RAM free: 32.08 MB
Disk free: 18.24 GB
Operating System
Version: 13.1.3 (17A878)
Orientation: Landscape
Jailbroken: No

Thanks for the report. The call stack indicates that the DynamicLinkReceived callback was running when the crash occurred. Did this happen when a Dynamic Link was clicked on and then Game Center sign-in occurred, or are there other repro steps you can share?

Nothing else to reproduce it.  My app starts up receiving the dynamic links and game center sign on at the same time when firebase is initialized.
Sent from Yahoo Mail on Android
On Wed, Nov 13, 2019 at 11:57 AM<EMAIL_ADDRESS>wrote:
Thanks for the report. The call stack indicates that the DynamicLinkReceived callback was running when the crash occurred. Did this happen when a Dynamic Link was clicked on and then Game Center sign-in occurred, or are there other repro steps you can share?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

ScriptingTypes.h line 624
Scripting::ScriptingWrapperFor(Object*)
Unity editor version: 2018.4.12f1
Firebase Unity SDK version: 6.60
[issue_crash_e6fee052ea1544a596cb9c1e865a6440_DNE_0_v2.txt]
(https://github.com/firebase/quickstart-unity/files/4015890/issue_crash_e6fee052ea1544a596cb9c1e865a6440_DNE_0_v2.txt)


Not getting currency unit for locale en-GB

Hi Team,
@PikachuEXE @Sija @fnando @DefV @rywall @masatomo

i am using this repo in my react native app
I set default locale and locale is en-GB
but when i am passing in "0" in ".toCurrency" will return me $0.00 but it should be £0.00
is any thing i am doing wrong
this is i am using when there is no value in cart and i am showing total as zero with unit
please check attachment for i18n object for locale
and this code i have written for show zero value
this.zeroAmount = I18n.toCurrency(0, {delimiter: "", separator: I18n.t("separator"), precision: 2});
so tho output of code is $0.00 but it should £0.00
thanks in advance

Can you provide a small script for reproducing this issue in a browser?
like:
I18n.locale = "en"
I18n.translations = I18n.translations || {}
I18n.translations["en-GB"] = I18n.translations["en-GB"] || {}
// More translations I don't know what do you have so add them yourself

I18n.toCurrency(0)

Also do you have the same issue for other locales (if you use any)?

@PikachuEXE
Hi ,
ya i am using other translations also like fr-CA this issue happend on selecting fr-CA also
In the below code is my configuration for selecting locale for i18n config
const { languageTag, isRTL } = locale && translations[locale] && { languageTag: locale, isRTL: fallback.isRTL } ||
(RNLocalize.findBestAvailableLanguage(Object.keys(translations)) || fallback);
// update layout direction
react_native_1.I18nManager.forceRTL(isRTL);
// set i18n-js config
// @ts-ignore
i18n.locale = languageTag;
// @ts-ignore
i18n.defaultLocale = languageTag;
// @ts-ignore
i18n.translations = { ["en"]: translations["en"],
["fr-CA"]: translations["fr-CA"],
["en-GB"]: translations["en-GB"] };
i need one more clarification. if there is a some missing translation it will show me like "missingTranslation.fr-CA.someText"
is there any way to check if i call i18n.t("someText") so i know this is translation is available or not
on my locale that is configured for use
Thanks in advance

Just answering is there any way to check a translation entry is available or not:
Start reading from https://github.com/fnando/i18n-js#setting-up
There is a section for handling missing translations

@PikachuEXE
ok thank you that i have already read
and what abt missing unit i have used fr-CA and en-GB both giving me $ only when i passed 0 in .toCurrency()

I don't understand your last comment
Please provide the minimal translation/settings so I can try in a browser too
Reading from toCurrency  source code
It's using number.currency.format or number.format or default value which is $
So when providing the script please include the translation entries for one of these 2 keys
for both languages

Here is a very simple script made by me
You can copy and edit it to match your setup
I18n.translations = I18n.translations || {}
I18n.translations["en-GB"] = I18n.translations["en-GB"] || {}
I18n.translations["en-GB"] = I18n.translations["en-GB"] || {}
I18n.translations["en-GB"]["number"] = I18n.translations["en-GB"]["number"] || {}
I18n.translations["en-GB"]["number"]["currency"] = I18n.translations["en-GB"]["number"]["currency"] || {}
I18n.translations["en-GB"]["number"]["currency"]["format"] = {
      unit: "£"
    , precision: 2
    , format: "%u%n"
    , sign_first: true
    , delimiter: ","
    , separator: "."
  }

I18n.locale = "en-GB"
I18n.toCurrency(0)

I get "£0.00" with this script

@PikachuEXE thank you for your help

@PikachuEXE
By default a missing translation will be displayed as
[missing "name of scope" translation]
can i change the missing translation message "translationNotFound" like that message instead of this [missing "name of scope" translation]
i got error bcoz i am using typescript in my project
what is the syntax to change the missing translation message
ERROR - Cannot assign to 'missingBehaviour' because it is a read-only property.
and i also tried to add prefix i got the same error.
the code is
i18n.missingTranslationPrefix = 'notFound: ';
ERROR - Cannot assign to 'missingTranslationPrefix' because it is a read-only property.

I guess the type definition is incorrect if it shows missingBehaviour & missingTranslationPrefix as readonly
Which is another issue :S
You can see https://github.com/fnando/i18n-js#setting-up
for how to use missingBehaviour, missingTranslationPrefix & missingTranslation
Ignore TS error for now, if cannot ignore I will take a look at the definition and try to fix it
(I think it's possible to use your own version of definition)

I have run the test on for i18n-js typing on https://github.com/DefinitelyTyped/DefinitelyTyped
I see no error in test result and I can see assignments to missingBehaviour, missingTranslationPrefix & missingTranslation in test script
So I don't know what TS error can be caused by it
Please share more details if you still encounter TS errors

sure i will get back to you
thanks for your help

@PikachuEXE
Hi
Is there any way that if any translation is not found so it automatically pick that literal from "en-US" locale
like i am writing code for translation I18n.t("someTextHere"); and my locale is set to fr-CA
and we have "fr-CA.json" JSON file were all literals stored
so if this literal "someTextHere" is missing so it automatically pick from locale "en-US"
without using I18n.t("someTextHere", {locale: "en-US"}); "
thanks in advance

I think right now the complex version of "fallback" is implemented via translation generation
https://github.com/fnando/i18n-js#fallbacks
However there is also JS version of fallback (but I have never used it or read the implementation)
https://github.com/fnando/i18n-js#setting-up (search for fallback)


Native integration for Github Projects (beta) and Github Issues

Dear Zulip community and developers, thanks for your great job.
It would be great if Zulip supports native integration for Github Projects and Github Issues, these tools are widely adopted for project management.

What specifically would you want?
(I have some ideas!)
On Mon, Jul 11, 2022 at 4:38 AM eiminola @.***> wrote:

Dear Zulip community and developers, thanks for your great job.
It would be great if Zulip supports native integration for Github Projects
and Github Issues, these tools are widely adopted for project management.
—
Reply to this email directly, view it on GitHub
https://github.com/zulip/zulip/issues/22442, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABCFYQ6Q3MJNXFZOBMPQFDVTPMR3ANCNFSM53GWQQ3Q
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Closing due to lack of details of a specific proposal here. Zulip's GitHub integration has supported issues for years.


NodeJS, Express, Jade partial views issues

While test driving AniJS on a NodeJS/Express site using the Jade template engine, I have noticed that the animations do not work unless the anijs.js script reference is included directly in the partial view where the html tag to be animated with the "data-anijs" attribute exists. If the anijs script reference is included as part of a layout file(loaded into the page ) the anijs script loads prior to the view file's html, but no animation occurs. If the anijs script reference is included in the partial view, the animations work great. For obvious reasons I would rather have the script reference to anijs in the layout head tag, then just add the "data-anijs" attribute where desired throughout the site's views/partial views as with all other script libraries I am using.
Am I missing something here or is this just the nature of the AniJS library? Good work btw.

Hi, we launched AniJS Studio on KickStarter, that allow to designers and programmers add animations and interactions for Web pages in an easy and intuitive way. Please, take a look at the project and if you find it interesting or simply want to help us, you can make a small donation. I would be grateful, Greetings Dariel


get done of actions.payment.execute()

Description
I have integrate paypal checkout in my angular 4 project , paypal checkout works fine but I want to make one api call after successful execution of actions.payment.execute() ,
but in return actions.payment.execute() not allow me to assess any outside object of scope ,
How can i get confirmation of successful execution of actions.payment.execute() ?
Steps to reproduce
Please provide each individual step required to reproduce the issue
Affected browsers

[ ] Chrome
[ ] Safari
[ ] Firefox
[ ] Edge
[ ] IE
[ ] Chrome Mobile/Tablet
[ ] Safari Mobile/Tablet
[ ] Web View / Safari ViewController
[ ] Other

I'm confused about what exactly you're asking. Are you asking how to know when actions.payment.execute() is complete?
If so you can do:
return actions.payment.exectute().then(function() {
   // something
});

Thanks for your quick response , actually i want to make one API call after successful payment execute .
this is my code:
return actions.payment.execute().then(function () {
debugger
this.authService.UpadateBrokerLeadStatus(property, status).subscribe((result) => {
if (property.LeadInfo.ReferredUserId != null) {
var commissiondata = {
UserId: property.LeadInfo.ReferredUserId,
LeadId: property.LeadInfo.ID,
Amount: 35,
Type: 1,
Remark: "Payment for acquired lead",
PaymentStatus: 1,
CreditedOn: new Date(),
CreditedBy: this.currentuser.ID
}
this.authService.CreditUserPaymentInfo(commissiondata).then((result) => {
                                    }).catch((err) => {
                                    });
                                }
                            }, (err) => {

                                this.authService.HideLoader();
                                this.authService.LogException(JSON.stringify(err))
                                console.log(err);
                            });

                            window.alert("payment Done Successfully");
                        });

but the problem is my code inside
return actions.payment.exectute().then(function() {
// something
});
is not executing , it is not allow me use outside object , I cant even use outside variable .
can you give me any workaround this ? I want an API call on success of Payment .
Thanks in Advance
khushbu

That's strange. So it never reaches your debugger statement?
Can you try running the following and seeing if there's any error:
return actions.payment.exectute().then(function() {
   // something
}).catch(function(err) {
    console.error('execute error:', err);
});

Can you also check your network tab for the /execute call, and make sure it comes back with a 200 response?

It reaches , If I only do alert then it shows alert but it does not execute below code
this.authService.UpadateBrokerLeadStatus(property, status).subscribe((result) => {
if (property.LeadInfo.ReferredUserId != null) {
var commissiondata = {
UserId: property.LeadInfo.ReferredUserId,
LeadId: property.LeadInfo.ID,
Amount: 35,
Type: 1,
Remark: "Payment for acquired lead",
PaymentStatus: 1,
CreditedOn: new Date(),
CreditedBy: this.currentuser.ID
}
this.authService.CreditUserPaymentInfo(commissiondata).then((result) => {
                                }).catch((err) => {
                                });
                            }
                        }, (err) => {

                            this.authService.HideLoader();
                            this.authService.LogException(JSON.stringify(err))
                            console.log(err);
                        });

and if i declare any variable outside and try to access inside this method , I am not able to

I see you're trying to reference this (e.g. this.authService). If you want that to work, you're going to need to either use var self = this in the parent, then reference self.authService, or you'll need to use an arrow function, like:
return actions.payment.exectute().then(() => {
   // something
});

Otherwise you lose the value of this in the callback for execute()

I have tried with return actions.payment.exectute().then(() => {
});
It is not executing this method also .

OK. It's difficult to say without seeing the entirety of your code -- do you have this live somewhere I could try? In the meantime, closing this issue since checkout.js doesn't handle this any differently to any other library when dealing with callbacks.

Description : I am facing with the similar problem,Calling the payment execute function inside onAuthorize
onAuthorize: function(data, actions,payment_for) {
var paymentID = data.paymentID;
var payerID   = data.payerID;
var execute_payment_json = {
payer_id: payerID,
};
return actions.payment.execute(paymentID, execute_payment_json).then((response) => {
console.log("response");
});
console.log(this.dumpPaypalResponse);
},
but,after successful execution of return actions.payment.execute(paymentID, execute_payment_json).then((response) => {});
I am not able to access response outside of that.


Job history

My second proposition would be to add ability to pull job history thru api. Right now after connecting to endpoint "/api/v1/jobs/group/project/id" I get only LastFail
"LastFail": {
"Message": "Reconciliation: Task is unknown to the agent",
"Reason": "REASON_RECONCILIATION",
"Source": "SOURCE_MASTER",
"When": "2018-10-12T09:22:13.466889392+02:00"
},
The nice solution would be to specify parameter for example "?history" that would give me more information about previous runs and most importang: LOGS (stdout and stderr from executors sandbox) in a form of path to executor's sanbox. There is a similar functionality in Marathon, when you click on task you can download any file from it's sandbox.

I see two separate requests here:

store history (n latest runs)
access to logs (like in Marathon)

In 1. you're talking only about only failed runs or all?
What would be the best  value for n ?

I am talking about all runs: failed and succeeded just for a sake of being able to read their logs. If I could specify a status of runs that are being retrieved, it would be even more awesome.
About best value - I don't know, sometimes I need to check runs that are more than a week old. Maybe it could be a flexible value?

Access to any files in sandbox can be done via http://mesos.apache.org/documentation/latest/sandbox/#via-the-mesos-web-ui:

Adding new fields to LastFail is needed:

ExecutorID
AgentID

Then having already FrameworkID and list of endpoints, URL to display executor's run (and respective links to sandboxes) is:
MESOS_ADDR/#/agents/AGENT_ID/frameworks/FRAMEWORK_ID/executors/EXECUTOR_ID

Maybe API can simply return such link in LastFail? Storing n previous runs is a different story so let's first establish what is the best way to give easy access to files from sandbox like stdout.

Yes, link would suffice.

@zolech renamed LastFail to LastFailedTask which also contains more details + ExecutorURL which points to Web UI with executor's details like completed tasks (https://github.com/mlowicki/rhythm/commit/69718439c7a039f059b13c5ef4ce437bcc5b4b5b). It's now on master branch. Please let me know what do you think. Adding history of launched tasks is next step.

@zolech first draft of history is on https://github.com/mlowicki/rhythm/tree/tasks_history. For now I've added endpoint api/v/1/jobs/{group}/{project}/{id}/tasks which returns job's tasks (runs). In the background there is a component doing cleanup of old tasks - by default only tasks from last 24h are kept but it's configurable with storage.zookeeper.taskttl (in milliseconds).
Probably I'll rename /tasks to /history.

@zolech tasks history landed on master. Feel free to test it out.


Add basic tests

Add simple unit test to ensure framework is set up
Add simple coverage script
Update gitignore to include coverage related folders
Add workflow for publishing code coverage to codecov

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@e035fdf). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff            @@
##             master     #30   +/-   ##
========================================
  Coverage          ?   5.77%
========================================
  Files             ?       6
  Lines             ?    1125
  Branches          ?     120
========================================
  Hits              ?      65
  Misses            ?    1060
  Partials          ?       0

Flag
Coverage Δ

#unit
5.77% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e035fdf...4b989cd. Read the comment docs.


.travis.yml: switch to trusty.

Wine-based tests in #2735 seem to run faster, see if it has anything to with dist and if trusty works in master...

Wine-based tests in #2735 seem to run faster

Or not... Timing appears to vary on unknown factors. It only makes sense to average values... This is besides errors... Closing this.


erlangR21: 21.2.3 -> <IP_ADDRESS>

Motivation for this change
Update Erlang/OTP 21 to the latest version.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Assured whether relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

@GrahamcOfBorg build erlangR21 wings


Getting %clogged on fakezod

While running integration tests, the fakezod seems to be outputting a debug message like so:
[%e %clogged '<channel_name>' n]
[%e %clogged '1606850483506-65c308' 8]
This probably means we are not acking something or acking too much or something generally bad going on in the main client Urbit.
Investigate

https://github.com/urbit/urbit/blob/0d034f326726d2994ed2804571ad65c0b05b0b1b/pkg/arvo/sys/vane/eyre.hoon#L1565

syntax is [%e %clogged channel-id request-id]

I no longer seem to be getting it. I think this is a consequence of restarting a test too quickly before it has a chance to ack, so closing for now until it starts happening again.


go risc0 example

seems go compiler doesn't support riscv32 ISA

You may have better luck with tinygo, although it does have its limitations.

We don't yet have support for go. We've experimented with adding support for tinygo, and we had some success but nothing released just yet.

Context: Compiling and Running fib_go.go with risc0/tinygo Result Error
What happens
I successfully compiled an ELF binary using risc0/tinygo with the command tinygo build -target zkvm fib_go.go. However, when attempting to run the resulting binary with r0vm --elf fib_go, I encountered the following runtime error:
thread 'main' panicked at risc0/r0vm/src/lib.rs:129:20:
called Result::unwrap() on an Err value: address 0x00000001 is an invalid guest address

This suggests that the ELF binary does not conform to the expected ELF specification required by zkvm for guest programs.
Prior Discussions
I've reviewed the previously closed issue and noted that there was mention of partial success with tinygo. However, it seems that there have been no recent updates to the tinygo project, which leads me to suspect that there might have been changes to zkvm that affect the compatibility of the binaries produced by tinygo.
Questions and Assistance Request
Would it be possible for you to share the results from your experimentation with tinygo? Any insights or progress made could be incredibly helpful for others encountering similar issues.
Additionally, I wanted to inquire if there have been any recent changes to the zkvm that might require updates to the guest program specifications or the way tinygo compiles binaries for zkvm.
Apology for Off-Topic Issue Post
I apologize for raising this issue in the risc0 project tracker. I've noticed that the tinygo project does not have issues enabled, which leaves me with no direct avenue to raise this concern there. I hope you understand the necessity of reaching out through this channel and appreciate any guidance you can provide.


[usmp] Hill Climb greedy layout size check relaxed

This PR relaxes the size check for "initial" layout as the later permutations could lead to winning combination.

cc @Alex-grovety @sergey-grovety @ilyag-grovety for reviews


Testing

Problem

Description of why you made this PR

Solution

And how do you fix that problem

PR Status

[ ] Code finished and ready to be reviewed/tested
[ ] The fix/enhancement were manually tested (if applicable)

Automatic tests
Automatic tests can be triggered on https://ci-apps-dev.yunohost.org/ after creating the PR, by commenting "!testme", "!gogogadgetoci" or "By the power of systemd, I invoke The Great App CI to test this Pull Request!". (N.B. : for this to work you need to be a member of the Yunohost-Apps organization)

!testme

!testme

You basically reverted all changes of this PR 😅

Yes, here code-server is run as the user selected during the install.
We don't want any other user accessible the app.

Yes, but surly there is a way to achieve that without using ynh_permission_update

With manifest v2, not that I know of...
The question init_main_permissions only allows for groups to be selected.

what about main.allowed = "admins"

It's not the same at all.
main.allowed = "admins" will grant access to the admins group
ynh_permission_update --permission="main" --add="$admin" will grant access to the user selected during install

!testme


Line indentation should be consistent and use VS Code settings

Files should use workspace or user settings for line indentation. Currently the spec file uses 2 spaces and the component and css file use 4 spaces.

Thanks for catching this issue!
I'll make sure this makes it into the next patch.

Thanks. I'll also mention - because I'm not sure it's clear in my first post - that currently spaces are used even when the VS code settings specify tabs for indentation.


add coldFeatures to mesh again after loading new data

move addUserData to a new function, remove coldFeatures reference from pointindex


Added preloader

#299 Added preloader to website

Please can you assign me this issue

this is updated one
#299

@CSEdgeOff  assign me this issue


[1.7.10] data inconsistency when a class name contains @

Hi,
A user of mine found a problem that occurs when a class contains the @ character.
orientdb {db=baasbox}> create class a@b
Class created successfully. Total classes in database now: 27
````
````
orientdb {db=baasbox}> insert into a@b content {"k":"v"}
Inserted record 'a@b#27:0{k:v,b@k:v} v1' in 0.004000 sec(s).

orientdb {db=baasbox}> select from a@b
----+-----+----
#   |@RID |b@k
----+-----+----
0   |#27:0|v
----+-----+----
1 item(s) found. Query executed in 0.001 sec(s).

As you can see the inserted record is completely wrong. The "k" field became "b@k" .

class names are not validated and this can cause some particularly unpleasant issues. IMHO they should be restricted to match /^[A-Z_][A-Z0-9_]*$/i

@phpnode is right, but OrientDB doesn't check for @. I've added @ as forbidden char.

Fixing field names


Update README.md

You accidentally pushed this commit to our HandsOnDataViz original code.
Next time make the commit on YOUR code.


added useful links for open-source & github

added useful github and open-source links under other->github

@CBID2  we don't have github in Open Source either we would need to create a new category or can keep them there in Other category. What do you think

@CBID2 we don't have github in Open Source either we would need to create a new category or can keep them there in Other category. What do you think

I thought we had an Open Source category(see picture below) @rupali-codes?

@CBID2 we don't have github in Open Source either we would need to create a new category or can keep them there in Other category. What do you think

I thought we had an Open Source category(see picture below) @rupali-codes?

Yeah but we don't github in there, as subcategory, we would need to add in this Blogs then

@CBID2 we don't have github in Open Source either we would need to create a new category or can keep them there in Other category. What do you think

I thought we had an Open Source category(see picture below) @rupali-codes?

Yeah but we don't github in there, as subcategory, we would need to add in this Blogs then

Ohhh I see. Yeah, I think adding another subcategory would help @rupali-codes.

@CBID2 yeah i think so, what should be the category?

Hmm... maybe? "Tools"?
What do you think @rupali-codes?

@CBID2 yeah i think so, what should be the category?

Hmm... maybe? "Tools"? What do you think @rupali-codes?

Yeah it's better

Hi @anand346! 😊 Add the issue number that this PR solves. Refer to the Contributing file to help you. Once that’s done, your PR will be opened! 😊


Not working when running via -c parameter

It doesn't work if you run commands by directly passing it to python interpreter via -c cli flag.
Can be reproduced using:
python -c "import better_exceptions; val=3; assert val > 10"

What does it do instead?

Alright, so this isn't possible without some extreme hacks - hacks that I don't think should be supported since they would rely solely on cpython's implementation internals.
I dove in deep into the CPython source code, and the default interactive shell never drops into the Python context (i.e. everything happens in the C world). This means there is nothing I can hook into to really help us out here.
However, there is one way, though I'm not sure if it would be useful at all, and that is to extend code.InteractiveConsole to include the information about the last run command. However, that means you would have to run python -m better_exceptions to drop into a fake interactive session.
If that's okay with the community, then I will re-open and implement this.

Also, there is this problem:
>>> assert 5 > 10
Traceback (most recent call last):
  File "<console>", line 1, in <module>
AssertionError
>>> def foo(a):
...     assert a > 10
...
>>> foo(10)
Traceback (most recent call last):
  File "<console>", line 1, in <module>
  File "<console>", line 2, in foo
AssertionError
>>>

Python just doesn't store enough information for me to really do much of anything here.
This module does work, but only when the frames are for code loaded in via a file.

I lied. I'm going to implement this.
I haven't released it yet, but you can do python -m better_exceptions to drop into a REPL that properly supports code entered via the command line.
Further, I'm writing a way to get the code from the -c flag. It's not easy since Python isn't really helping us out here.

Apologies for the comment spam; this is actually a really hard feature, but there's headway!
Here's what the output looks like now:

Implementing this feature turned up a few bugs that have since been fixed and presented a really, really fun engineering problem.
This only works on posix platforms for now. I intend to add Windows support soon, along with improved support on Linux. Will release when I do so.
Thanks for the challenge! The latest code is on master; give it a shot.

Wow that was fast. Better Exceptions now rocks even more! Really good job

Closing; for windows support, please see #27.


Adding connector actions Pause / Resume / Restart

Added connector service mock for Pause / Resume / Restart service call.
Using httpPost method as of now, will replace according to backend implementation

After today discussion on DBZ-2951 , the restart action should always be enabled - even for RUNNING and PAUSED status.  Since this is wip, I will go ahead and merge this PR.  We can fix on the next PR.
Also, we should check with UX on the connector actions - they may prefer not showing invalid actions in the menu rather than showing disabled.

After today discussion on DBZ-2951 , the restart action should always be enabled - even for RUNNING and PAUSED status.  Since this is wip, I will go ahead and merge this PR.  We can fix on the next PR.
Also, we should check with UX on the connector actions - they may prefer not showing invalid actions in the menu rather than showing disabled.


Adding convert endpoints

Updated the client class to add support to convert endpoints (create and accept quote)

I've pulled the endpoints out and committed separate to the normal and async clients


[Bug]: dev server error when hmr encounters a wasm package change.

Version
System:
  OS: macOS 14.4.1
  CPU: (12) arm64 Apple M3 Pro
  Memory: 3.34 GB / 36.00 GB
  Shell: 5.9 - /bin/zsh
Browsers:
  Chrome: 124.0.6367.119
  Safari: 17.4.1

Details
I have a project that contains two packages, one which is a react app, and the other a wasm-pack based wasm library.
Everything works as expected when starting the Rsbuild dev server, but if I rebuild the wasm library, the dev compiler fails with the following console error:
start   Compiling...
ready   Client compiled in 0.14 s
start   Compiling...
ready   Client compiled in 0.01 s
start   Compiling...
error   Compile error:
Failed to compile, check the errors for troubleshooting.
File: undefined
  × Conflict: Multiple assets emit different content to the same filename index.44be1698c47b3b8a.hot-update.js

start   Compiling...
error   Compile error:
Failed to compile, check the errors for troubleshooting.
File: undefined
  × Conflict: Multiple assets emit different content to the same filename index.b0c9980bbdb8ffad.hot-update.js

I am unsure why the compiler runs twice as well.
I would like to be able to rebuild the wasm module, and have the hmr pick up the changed package and reload.
Reproduce link
https://github.com/brochington/mult-assets-rsbuild-repro
Reproduce Steps
# At project root

# build wasm bundle
$ npm run build:wasm

# make sure local deps are connected/symlinked
$ npm install

# run client, start up rsbuild dev
$ npm run client:dev

# In a separate terminal, rebuild wasm

$ npm run build:wasm

Rebuild multiple times is because wasm build triggers multiple file changes, and rspack's watchOptions.aggregateTimeout time interval is small.
Multiple assets emit different content to the same filename This error seems to be a problem with the rspack code. I will transfer this issue to the rspack repo.


Sort by date rather than by author

Modify the settings of the plugin, or the plugin itself (if necessary) to show pubs in chronological order
GanttDuration: 60

Deprecated by new website

Deprecated by new website


Background color wrong after changing factory.setDrawingPropertiesForItem

Describe the bug
When display properties are overridden for the first item in the linked list, then the background after the last item is incorrectly set to the background of that item.
Confirm that the bug is in the embedded library
Yes, it is in the embedded library, in the GraphicalDisplayRenderer
Commerical or personal/community use
Commerical, davetcc
To Reproduce
Simply override the first menu item in any sub menu or root.
Expected behavior
The background should be the same as the rest of the menu.
Screenshots
See https://github.com/davetcc/tcMenu/discussions/329 for screenshot and more detail.
Device Specs
Affects all boards
Additional context
N/A

https://github.com/davetcc/tcMenu/issues/330

I'm going to close this as fixed for now. Please reopen if the fix doesn't work as expected.


perf: Chunk read performance on wide tables

In light of recent Parquet discussion my colleague decided to benchmark random chunk ("row group") reading performance on Lance in comparison to current Parquet implementation. We expected Parquet to do worse due to inefficiencies at wide schema but we see a constant multiple (parquet ~25x faster) in performance no matter the parameters. It might be the benchmark is not using the most efficient code path in Lance. Any suggestions on how to optimize chunk reads in lance to take advantage of faster metadata deserialization?
import time
import numpy as np

import lance
import lance.fragment
import pyarrow as pa
import pyarrow.parquet as pq

row_groups = 50
columns = 2000
chunk_size = 1000
rows = row_groups * chunk_size
work_items = 1

parquet_path = "/tmp/my.parquet"
lancedbase_path = "/tmp/"

def get_table():
    data = np.random.rand(rows, columns)
    pa_arrays = [pa.array(data[:, i]) for i in range(columns)]
    column_names = [f'column_{i}' for i in range(columns)]
    return pa.Table.from_arrays(pa_arrays, names=column_names)

def worker_arrow():
   for rg in range(0, row_groups):
        pr = pq.ParquetReader()
        pr.open(parquet_path)
        data = pr.read_row_groups([rg], use_threads=False)
        data = data

def worker_lance():

    for rg in range(0, row_groups):
        dataset = lance.dataset(lancedbase_path)
        data = dataset.to_table(offset=rg * chunk_size, limit=chunk_size)
        data = data

def genrate_data(table, store_schema):

   t = time.time()
   print(f"writing parquet file, columns={columns}, row_groups={row_groups}, rows={rows}")
   pq.write_table(table, parquet_path, row_group_size=chunk_size, use_dictionary=False, write_statistics=False, store_schema=store_schema, compression=None)
   dt = time.time() - t
   print(f"finished writing parquet file in {dt:.2f} seconds")

   lance.write_dataset(table, lancedbase_path, mode = "overwrite")

def measure_reading(worker):

    t = time.time()
    for i in range(0, work_items):
        worker()

    return time.time() - t

table = get_table()
genrate_data(table, False)

print(f"Reading all row groups using arrow (single-threaded) {measure_reading(worker_arrow):.3f} seconds")
print(f"Reading all row groups using lance (single-threaded) {measure_reading(worker_lance):.3f} seconds")

# /bin/python3 /workspace/benchmarks/benchmark_lancedb.py
writing parquet file, columns=2000, row_groups=50, rows=50000
finished writing parquet file in 1.85 seconds
Reading all row groups using arrow (single-threaded) 2.810 seconds
Reading all row groups using lance (single-threaded) 71.201 seconds

# /bin/python3 /workspace/benchmarks/benchmark_lancedb.py
writing parquet file, columns=1000, row_groups=50, rows=50000
finished writing parquet file in 1.51 seconds
Reading all row groups using arrow (single-threaded) 1.332 seconds
Reading all row groups using lance (single-threaded) 35.571 seconds

# /bin/python3 /workspace/benchmarks/benchmark_lancedb.py
writing parquet file, columns=1000, row_groups=100, rows=100000
finished writing parquet file in 6.67 seconds
Reading all row groups using arrow (single-threaded) 4.512 seconds
Reading all row groups using lance (single-threaded) 119.911 seconds

cc @westonpace

Thanks for playing around with lance!  Your experiment is currently using lance v1.  Were you intending to test the new v2 format?  It's still early days in the v2 format and we haven't yet fully connected it to lance datasets.  Your test is currently using the v1 format.
If you're going to compare formats then the most direct comparison would probably be to use LanceFileReader and LanceFileWriter.  The LanceFileReader has a get_range method which is perfect for this test.
If you want to compare parquet files against lance datasets (testing both the file format and the table format) then you will have to do a few things to get the comparison closer.  First, use the use_experimental_writer flag which toggles our beta support for lance v2 in the table format.  Next, it seems that we aren't actually pushing down limit / offset in our scanner today.  So each of your queries was loading all of the data and then discarding the parts it didn't want.  The closest thing we can do is probably to do a take with the desired indices.  Lance's scanner will recognize the indices are sorted and contiguous and translate the request into  a get_range call under the hood.
import time
import numpy as np

import lance
import lance.fragment
import pyarrow as pa
import pyarrow.parquet as pq

from lance.file import LanceFileReader, LanceFileWriter

row_groups = 50
columns = 2000
chunk_size = 1000
rows = row_groups * chunk_size
work_items = 1

parquet_path = "/tmp/my.parquet"
lancefile_path = "/tmp/my.lance"
lancedb_path = "/tmp/lancedb"

def get_table():
    data = np.random.rand(rows, columns)
    pa_arrays = [pa.array(data[:, i]) for i in range(columns)]
    column_names = [f"column_{i}" for i in range(columns)]
    return pa.Table.from_arrays(pa_arrays, names=column_names)

def worker_arrow():
    for rg in range(0, row_groups):
        pr = pq.ParquetReader()
        pr.open(parquet_path)
        data = pr.read_row_groups([rg], use_threads=False)
        data = data

def worker_lance():
    for rg in range(0, row_groups):
        lr = LanceFileReader(lancefile_path)
        data = lr.read_range(rg * chunk_size, chunk_size).to_table()
        data = data

def worker_lance_dataset():
    for rg in range(0, row_groups):
        ds = lance.dataset(lancedb_path)
        rows = [idx for idx in range(rg * chunk_size, (rg + 1) * chunk_size)]
        data = ds.take(rows)
        data = data

def genrate_data(table, store_schema):
    t = time.time()
    print(
        f"writing parquet file, columns={columns}, row_groups={row_groups}, rows={rows}"
    )
    pq.write_table(
        table,
        parquet_path,
        row_group_size=chunk_size,
        use_dictionary=False,
        write_statistics=False,
        store_schema=store_schema,
        compression=None,
    )
    dt = time.time() - t
    print(f"finished writing parquet file in {dt:.2f} seconds")

    with LanceFileWriter(lancefile_path, table.schema) as writer:
        writer.write_batch(table)

    lance.write_dataset(
        table, lancedb_path, use_experimental_writer=True, mode="overwrite"
    )

def measure_reading(worker):
    t = time.time()
    for i in range(0, work_items):
        worker()

    return time.time() - t

table = get_table()
genrate_data(table, False)

print(
    f"Reading all row groups using arrow (single-threaded) {measure_reading(worker_arrow):.3f} seconds"
)
print(
    f"Reading all row groups using lance (multi-threaded) {measure_reading(worker_lance):.3f} seconds"
)
from lance.tracing import trace_to_chrome

trace_to_chrome(level="trace")
print(
    f"Reading all row groups using lance dataset (multi-threaded) {measure_reading(worker_lance_dataset):.3f} seconds"
)

Thanks @westonpace! We're indeed aiming to try v2 and your help is as always invaluable.

Here are my results:
Change in columns
=================
writing parquet file, columns=1000, row_groups=50, rows=50000
finished writing parquet file in 1.80 seconds
Reading all row groups using arrow (single-threaded) 1.797 seconds
Reading all row groups using lance (multi-threaded) 0.408 seconds
Reading all row groups using lance dataset (multi-threaded) 0.746 seconds

writing parquet file, columns=2000, row_groups=50, rows=50000
finished writing parquet file in 1.80 seconds
Reading all row groups using arrow (single-threaded) 3.627 seconds
Reading all row groups using lance (multi-threaded) 0.988 seconds
Reading all row groups using lance dataset (multi-threaded) 1.648 seconds

writing parquet file, columns=3000, row_groups=50, rows=50000
finished writing parquet file in 4.98 seconds
Reading all row groups using arrow (single-threaded) 5.755 seconds
Reading all row groups using lance (multi-threaded) 1.312 seconds
Reading all row groups using lance dataset (multi-threaded) 2.872 seconds

Change in row_groups
====================
writing parquet file, columns=1000, row_groups=50, rows=50000
finished writing parquet file in 1.91 seconds
Reading all row groups using arrow (single-threaded) 1.808 seconds
Reading all row groups using lance (multi-threaded) 0.412 seconds
Reading all row groups using lance dataset (multi-threaded) 0.743 seconds

writing parquet file, columns=1000, row_groups=100, rows=100000
finished writing parquet file in 3.50 seconds
Reading all row groups using arrow (single-threaded) 5.421 seconds
Reading all row groups using lance (multi-threaded) 0.820 seconds
Reading all row groups using lance dataset (multi-threaded) 1.496 seconds

writing parquet file, columns=1000, row_groups=150, rows=150000
finished writing parquet file in 5.02 seconds
Reading all row groups using arrow (single-threaded) 11.432 seconds
Reading all row groups using lance (multi-threaded) 1.255 seconds
Reading all row groups using lance dataset (multi-threaded) 2.303 seconds

That matches what I was seeing as well.  I think, in the extremely wide schema case (tens of thousands of columns) we will still probably want specialized encodings (e.g. something that pivots the data) but it is nice to see that Lance is handling that reasonably well today.

Why would you want to pivot? To avoid column handling overhead? What would be an example of such an encoding?

The case I had in my head was if you have many sparse columns.  If you use a sparse encoding I think you end up with a lot of very tiny pages (because there is not enough data in any single column).
That being said, if your use case is to read a few columns at a time, this is probably fine.  If your use case was reading in the entire table (into some kind of sparse feature matrix) then you would want a specialized encoding.  I'm not sure what it would look like.  If we had a variant type then you could do map<string,variant> (which I guess is not really a specialized encoding).
Also, if this is important to you, and your use case is to read a few columns at a time, then there is another optimization / TODO here that you might be interested in.  It would cut down on the time required to open a reader.

The case I had in my head was if you have many sparse columns. If you use a sparse encoding I think you end up with a lot of very tiny pages (because there is not enough data in any single column).
That being said, if your use case is to read a few columns at a time, this is probably fine. If your use case was reading in the entire table (into some kind of sparse feature matrix) then you would want a specialized encoding. I'm not sure what it would look like. If we had a variant type then you could do map<string,variant> (which I guess is not really a specialized encoding).

Interesting point! At the moment my use case is getting a few dense columns though.

Also, if this is important to you, and your use case is to read a few columns at a time, then there is another optimization / TODO here that you might be interested in. It would cut down on the time required to open a reader.

That's a nice optimization too yeah. Opening the reader currently doesn't dominate our cost but I imagine it'd be good for Lance to optimize this!


CLOUDP-219167: Fix version setting at rebuilds

All Submissions:

[X] Have you signed our CLA?

See how this was not setting the build version properly:
https://github.com/mongodb/mongodb-atlas-kubernetes/actions/runs/7397914114/job/20125946657
  make all-platforms VERSION=
  # not all versiions Makefiles support the version check
  if make |grep -q check-version; then
    make check-version VERSION=
  fi