BBC News stories no longer showing videos to download (+BBC Sports parsing failure)

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2021.06.06
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: ['--ffmpeg-location', 'C:\\Program Files\\ffmpeg-20200311-36aaee2-win64-shared\\bin', '-f', '137+bestaudio/298+bestaudio/136+bestaudio/135+bestaudio/134+bestaudio/DASH-VIDEO-1+bestaudio/html5-video-high+html5-audio-high/best/bestvideo+bestaudio', '--write-sub', '--convert-subs', 'srt', '--embed-subs', '--fragment-retries', 'infinite', '--retries', 'infinite']
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.bbc.co.uk/news/business-58423705']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2021.06.06
[debug] Python version 3.9.7 (CPython) - Windows-10-10.0.19041-SP0
[debug] exe versions: ffmpeg git-2020-03-11-36aaee2, ffprobe git-2020-03-11-36aaee2, rtmpdump 2.4-20151223-gfa8646d-GnuTLS_3.5.12-i686-static
[debug] Proxy map: {}
[bbc] business-58423705: Downloading webpage
[download] Downloading playlist: CEO Secrets: The bra boss busting stereotypes
[bbc] playlist CEO Secrets: The bra boss busting stereotypes: Collected 0 video ids (downloading 0 of them)
[download] Finished downloading playlist: CEO Secrets: The bra boss busting stereotypes

Description

In the last couple of days, BBC News stories such as this and this are parsed as having zero videos, despite having playable videos. The issue does not appear to impact video-centric "/av/ pages such as this and this (a dedicated page for the second link above).
I use YouTube-dl for this because my netbook struggles to play these videos in the browser itself, but MPC-HC can do it.

This issue presents differently to that of BBC Sports stories with videos, which appear not to be parsed correctly at all:
[bbc] 58404777: Downloading webpage
ERROR: Unable to extract playlist data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "c:\program files\python39\lib\site-packages\youtube_dl\YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "c:\program files\python39\lib\site-packages\youtube_dl\YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "c:\program files\python39\lib\site-packages\youtube_dl\extractor\common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "c:\program files\python39\lib\site-packages\youtube_dl\extractor\bbc.py", line 1253, in _real_extract
    self._search_regex(
  File "c:\program files\python39\lib\site-packages\youtube_dl\extractor\common.py", line 1012, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)

Unmerged PRs exist for BBC but even with these, the News pages linked above are parsed as playlists with no videos.
For the business news pages, the extractor is looking at the dict-ified JSON page model initial_data sent as the value assigned to the JS variable window.__INITIAL_DATA__. It expects to, and does, find an object x with initial_data['x']['name'] == 'article'. Then it expects to find x['data']['blocks'] and tries to parse the programme id and other metadata from there. In these new pages, the wanted information is in x['data']['content']['model']['blocks'] instead.
The solution is to change the getter lambda x: x['data']['blocks'] in l.1208 of extractor/bbc.py to this tuple:
(lambda x: x['data']['blocks'], lambda x: x['data']['content']['model']['blocks'],)
The Sport example doesn't have a video now, but with PR #28577 (unmerged) this page https://www.bbc.co.uk/sport/football/58488393 is extracted as a playlist with one video.

https://github.com/ytdl-org/youtube-dl/issues/30291

I used to download those BBC News Headlines every day, does not work anymore
[12/01/21 23:04:48] [debug] System config: []
[12/01/21 23:04:48] [debug] User config: []
[12/01/21 23:04:48] [debug] Custom config: []
[12/01/21 23:04:48] [debug] Command-line args: ['--newline', '-o', 'D:\\Downloads\\%(id)s.%(ext)s', '-f', 'mp4', '--hls-prefer-native', '--verbose', 'https://www.bbc.com/news/av/10462520']
[12/01/21 23:04:48] [debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[12/01/21 23:04:48] [debug] youtube-dl version 2021.06.06
[12/01/21 23:04:48] [debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[12/01/21 23:04:48] [debug] exe versions: ffmpeg 3.3.2, ffprobe 3.3.2
[12/01/21 23:04:48] [debug] Proxy map: {}
[12/01/21 23:04:48] ERROR: Unable to extract playlist data; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

I used to download those BBC News Headlines every day, does not work anymore

PR #30292 takes care of that:
youtube-dl -F "https://www.bbc.com/news/av/10462520" =>

[bbc] 10462520: Downloading webpage
[bbc] p0b7mdbv: Downloading media selection JSON
[bbc] p0b7mdbv: Downloading m3u8 information
[bbc] p0b7mdbv: Downloading m3u8 information
[bbc] p0b7mdbv: Downloading m3u8 information
[bbc] p0b7mdbv: Downloading m3u8 information
[bbc] p0b7mdbv: Downloading MPD manifest
[bbc] p0b7mdbv: Downloading MPD manifest
[bbc] p0b7mdbv: Downloading MPD manifest
[bbc] p0b7mdbv: Downloading MPD manifest
[download] Downloading playlist: One-minute World News
[bbc] playlist One-minute World News: Collected 1 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[info] Available formats for p0b7mdbv:
format code                      extension  resolution note
mf_akamai-audio_eng=96000-0      m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
mf_akamai-audio_eng=96000-1      m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
mf_cloudfront-audio_eng=96000-0  m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
mf_cloudfront-audio_eng=96000-1  m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
mf_akamai-video=86000-0          mp4        192x108    DASH video   86k , mp4_dash container, avc3.42C015, 25fps, video only
mf_akamai-video=86000-1          mp4        192x108    DASH video   86k , mp4_dash container, avc3.42C015, 25fps, video only
mf_cloudfront-video=86000-0      mp4        192x108    DASH video   86k , mp4_dash container, avc3.42C015, 25fps, video only
mf_cloudfront-video=86000-1      mp4        192x108    DASH video   86k , mp4_dash container, avc3.42C015, 25fps, video only
mf_akamai-video=156000-0         mp4        256x144    DASH video  156k , mp4_dash container, avc3.42C015, 25fps, video only
mf_akamai-video=156000-1         mp4        256x144    DASH video  156k , mp4_dash container, avc3.42C015, 25fps, video only
mf_cloudfront-video=156000-0     mp4        256x144    DASH video  156k , mp4_dash container, avc3.42C015, 25fps, video only
mf_cloudfront-video=156000-1     mp4        256x144    DASH video  156k , mp4_dash container, avc3.42C015, 25fps, video only
mf_akamai-video=281000-0         mp4        384x216    DASH video  281k , mp4_dash container, avc3.42C015, 25fps, video only
mf_akamai-video=281000-1         mp4        384x216    DASH video  281k , mp4_dash container, avc3.42C015, 25fps, video only
mf_cloudfront-video=281000-0     mp4        384x216    DASH video  281k , mp4_dash container, avc3.42C015, 25fps, video only
mf_cloudfront-video=281000-1     mp4        384x216    DASH video  281k , mp4_dash container, avc3.42C015, 25fps, video only
mf_akamai-video=437000-0         mp4        512x288    DASH video  437k , mp4_dash container, avc3.4D4015, 25fps, video only
mf_akamai-video=437000-1         mp4        512x288    DASH video  437k , mp4_dash container, avc3.4D4015, 25fps, video only
mf_cloudfront-video=437000-0     mp4        512x288    DASH video  437k , mp4_dash container, avc3.4D4015, 25fps, video only
mf_cloudfront-video=437000-1     mp4        512x288    DASH video  437k , mp4_dash container, avc3.4D4015, 25fps, video only
mf_akamai-video=827000-0         mp4        704x396    DASH video  827k , mp4_dash container, avc3.4D401F, 25fps, video only
mf_akamai-video=827000-1         mp4        704x396    DASH video  827k , mp4_dash container, avc3.4D401F, 25fps, video only
mf_cloudfront-video=827000-0     mp4        704x396    DASH video  827k , mp4_dash container, avc3.4D401F, 25fps, video only
mf_cloudfront-video=827000-1     mp4        704x396    DASH video  827k , mp4_dash container, avc3.4D401F, 25fps, video only
mf_akamai-video=1604000-0        mp4        960x540    DASH video 1604k , mp4_dash container, avc3.64001F, 25fps, video only
mf_akamai-video=1604000-1        mp4        960x540    DASH video 1604k , mp4_dash container, avc3.64001F, 25fps, video only
mf_cloudfront-video=1604000-0    mp4        960x540    DASH video 1604k , mp4_dash container, avc3.64001F, 25fps, video only
mf_cloudfront-video=1604000-1    mp4        960x540    DASH video 1604k , mp4_dash container, avc3.64001F, 25fps, video only
mf_akamai-0                      mp4        256x144     224k , h264
mf_akamai-1                      mp4        256x144     224k , h264
mf_cloudfront-0                  mp4        256x144     224k , h264
mf_cloudfront-1                  mp4        256x144     224k , h264
mf_akamai-349-0                  mp4        384x216     349k , avc1.42C015@ 281k, 25.0fps, mp4a.40.5@ 48k
mf_akamai-349-1                  mp4        384x216     349k , avc1.42C015@ 281k, 25.0fps, mp4a.40.5@ 48k
mf_cloudfront-349-0              mp4        384x216     349k , avc1.42C015@ 281k, 25.0fps, mp4a.40.5@ 48k
mf_cloudfront-349-1              mp4        384x216     349k , avc1.42C015@ 281k, 25.0fps, mp4a.40.5@ 48k
mf_akamai-2                      mp4        448x252     543k , h264
mf_akamai-3                      mp4        448x252     543k , h264
mf_cloudfront-2                  mp4        448x252     543k , h264
mf_cloudfront-3                  mp4        448x252     543k , h264
mf_akamai-565-0                  mp4        512x288     565k , avc1.4D4015@ 437k, 25.0fps, mp4a.40.5@ 96k
mf_akamai-565-1                  mp4        512x288     565k , avc1.4D4015@ 437k, 25.0fps, mp4a.40.5@ 96k
mf_cloudfront-565-0              mp4        512x288     565k , avc1.4D4015@ 437k, 25.0fps, mp4a.40.5@ 96k
mf_cloudfront-565-1              mp4        512x288     565k , avc1.4D4015@ 437k, 25.0fps, mp4a.40.5@ 96k
mf_akamai-4                      mp4        640x360     800k , h264
mf_akamai-5                      mp4        640x360     800k , h264
mf_cloudfront-4                  mp4        640x360     800k , h264
mf_cloudfront-5                  mp4        640x360     800k , h264
mf_akamai-979-0                  mp4        704x396     979k , avc1.4D401F@ 827k, 25.0fps, mp4a.40.5@ 96k
mf_akamai-979-1                  mp4        704x396     979k , avc1.4D401F@ 827k, 25.0fps, mp4a.40.5@ 96k
mf_cloudfront-979-0              mp4        704x396     979k , avc1.4D401F@ 827k, 25.0fps, mp4a.40.5@ 96k
mf_cloudfront-979-1              mp4        704x396     979k , avc1.4D401F@ 827k, 25.0fps, mp4a.40.5@ 96k
mf_akamai-1802-0                 mp4        960x540    1802k , avc1.64001F@1604k, 25.0fps, mp4a.40.5@ 96k
mf_akamai-1802-1                 mp4        960x540    1802k , avc1.64001F@1604k, 25.0fps, mp4a.40.5@ 96k
mf_cloudfront-1802-0             mp4        960x540    1802k , avc1.64001F@1604k, 25.0fps, mp4a.40.5@ 96k
mf_cloudfront-1802-1             mp4        960x540    1802k , avc1.64001F@1604k, 25.0fps, mp4a.40.5@ 96k (best)
[download] Finished downloading playlist: One-minute World News

I have an alternate tool that works:
PS C:\> bbc -hf 10462520
GET http://walter-producer-cdn.api.bbci.co.uk/content/cps/news/10462520
GET http://open.live.bbc.co.uk/mediaselector/6/select/version/2.0/mediaset/pc/vpid/p0b7x5kf
GET http://vod-hls-ww-live.akamaized.net/usp/auth/vod/piff_abr_full_sd/2e861b-p0b7x5kf/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33.ism/pc_hd_abr_v2_hls_master.m3u8?__gda__=1638600233_a87d06cbbec05e07f79c5f8f37fb7053
{ID:0 Resolution:384x216 Bandwidth:400000 Codecs:mp4a.40.5,avc1.42C015 URI:http://vod-hls-ww-live.akamaized.net/usp/auth/vod/piff_abr_full_sd/2e861b-p0b7x5kf/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33.ism/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33-audio_eng=96000-video=281000.m3u8}
{ID:1 Resolution:512x288 Bandwidth:565000 Codecs:mp4a.40.5,avc1.4D4015 URI:http://vod-hls-ww-live.akamaized.net/usp/auth/vod/piff_abr_full_sd/2e861b-p0b7x5kf/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33.ism/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33-audio_eng=96000-video=437000.m3u8}
{ID:2 Resolution:704x396 Bandwidth:979000 Codecs:mp4a.40.5,avc1.4D401F URI:http://vod-hls-ww-live.akamaized.net/usp/auth/vod/piff_abr_full_sd/2e861b-p0b7x5kf/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33.ism/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33-audio_eng=96000-video=827000.m3u8}
{ID:3 Resolution:960x540 Bandwidth:1802000 Codecs:mp4a.40.5,avc1.64001F URI:http://vod-hls-ww-live.akamaized.net/usp/auth/vod/piff_abr_full_sd/2e861b-p0b7x5kf/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33.ism/vf_p0b7x5kf_160271fb-4883-4a2f-8269-b079bcee0c33-audio_eng=96000-video=1604000.m3u8}

https://github.com/89z/mech


Kafka socket.timeout.ms recommended value?

What is the recommended value for socket.timeout.ms?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 6b4e24cc-e875-2988-c6b0-b1011de721ed
Version Independent ID: 6fe7237b-9c92-d29f-7465-dfbd68b2d3cf
Content: Recommended configurations for Apache Kafka clients - Azure Event Hubs
Content Source: articles/event-hubs/apache-kafka-configurations.md
Service: event-hubs
GitHub Login: @spelluru
Microsoft Alias: spelluru

Note: I am getting Local_AllBrokersDown error for Producer and Admin Client in every 5 minutes.

@t03apt
Thanks for your feedback! We will investigate and update as appropriate.

Hi @t03apt
I have contacted our product team about this issue and they think that it requires some troubleshooting. Pasting the response here:
" This looks like an idle connection termination, given you are seeing the error every five minutes. It could due to idling of consumers and producers. Socket timeout typically is as long as request timeout but in this case I think we need to understand if this is an idle situation first."
You could use our Q&A forum: https://learn.microsoft.com/en-us/answers/tags/165/azure-event-hubs or open a support ticket to troubleshoot the issue.
#please-close


Final push to get remaining models using multi-weight pretrained configs and HF hub weights

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


Check for duplicate identification of dirty tiles

The current implementation of dirty tile detection writes the identified tiles into a file, but it doesn't check if the tile was already identified before
This results in rendering a tile twice instead of once
This issue is fixed, if all tiles in the dirty tiles file are distinct

It is possible to do it in SQL as well but the advantage to do it in JS is that we have lots of smaller queries for the zoom levels (which puts less load on the PostgreSQL server). Plus we have stats about what changed on each level.

This issue is fixed, if all tiles in the dirty tiles file are distinct

You can use Underscore uniq.
http://underscorejs.org/


Type use annotations are not present in an incremental processor when existing class file is used

When using an incremental annotation processor, if compile avoidance kicks in and an already-compiled class file is used for processing, type use annotations appear to be missing from annotation language model nodes, even if they're present in the class file.
I don't know if class files can be used for processing in any scenario other than compile avoidance; if they can be, it's possible the same issue applies there as well.
Steps to Reproduce

Build the classes target of gradle-testcase.tar.gz.
Touch the source of either method in bar.Main (for example, by adding a new empty line) and build classes again.

Since the class $0 generated from bar.Victim depends on bar.Main, Victim will be reprocessed.
Current Behavior
The annotation processor gets angry, because it cannot see @TypeUseAnnotation on the type of Victim's field.
Expected Behavior
The type use annotation is presented to the processor, as it is present in the class file of Victim:
  private java.lang.Object x;
    descriptor: Ljava/lang/Object;
    flags: (0x0002) ACC_PRIVATE
    RuntimeInvisibleTypeAnnotations:
      0: #12(): FIELD
        foo.TypeUseAnnotation

Context
In my production code, the type use annotation happens to be @org.checkerframework.checker.nullness.qual.Nullable, with completely different code being generated depending on its presence or absence on any given type.
Your Environment
Gradle 8.0.2, OpenJDK 17.0.6 and 19.0.1, Debian sid

Might be related to JDK-8225377?

Yes, this looks like a compiler bug unfortunately, so it has to be fixed in the JDK. For that specific case you can workaround it by using ElementType.FIELD for @TypeUseAnnotation, e.g.:
 import java.lang.annotation.Target;

 @Retention(RetentionPolicy.CLASS)
-@Target(ElementType.TYPE_USE)
+@Target(ElementType.FIELD)
 public @interface TypeUseAnnotation {
 }

and then you read annotations from variableElement, e.g.:
 VariableElement variableElement = (VariableElement) element;
 Messager messager = processingEnv.getMessager();
-TypeMirror type = variableElement.asType();
-messager.printMessage(Diagnostic.Kind.NOTE, type.toString(), element);
-if (variableElement.asType().getAnnotationMirrors().isEmpty()) {
+if (variableElement.getAnnotationMirrors().isEmpty()) {
     messager.printMessage(Diagnostic.Kind.ERROR, "barf", element);
+} else {
+    messager.printMessage(Diagnostic.Kind.NOTE, "ok: " + variableElement.getAnnotationMirrors(), element);
 }

Of course if you want to use @TypeUseAnnotation annotation anywhere else, you might not be that lucky.
Alternative is, that you mark you annotation processor as non-incremental. Which basically means that the project using the annotation processor will be fully recompiled every time. :/

For that specific case you can workaround it by using ElementType.FIELD for @TypeUseAnnotation
[…]
Of course if you want to use @TypeUseAnnotation annotation anywhere else, you might not be that lucky.

Unfortunately, I cannot, because as I mentioned in the original message, the actual annotation is one of Checker Framework's, so it's not under under my control; even if it was, it still needs to be a type use annotation, because I need to be able to use it on type arguments.
I currently work around the problem by detecting if the processed element comes from a class file and simply failing if that's the case. Being occasionally forced to do full rebuilds beats doing full rebuilds every time, and changes that actually trigger this issue aren't very common in practice.

That is smart. Note: Gradle 7.6 and 8.x have incremental compilation after a failure, so might need to disable that behaviour. You can do that by setting options.incrementalAfterFailure.set(false) for the JavaCompile task.

Closing as this cannot be fixed in Gradle itself.


Wrong link in documentation

From<EMAIL_ADDRESS>on 2009-11-09T04:40:10Z
Wiki page https://code.google.com/p/spyderlib/wiki/NoteForBetaTesters contains
wrong link to issue tracker.
Original issue: http://code.google.com/p/spyderlib/issues/detail?id=111

From pierre.raybaut on 2009-11-09T07:11:51Z
thanks for reporting this!
fixed!
Status: Fixed


Visitor Pattern for Updating Relations

Improve the existing recursion tree with Visitor pattern.
_get_read_rel in ProcessSubstrait

Addressed in  https://github.com/vibhatha/pyiceberg_substrait/pull/4


Add required RBAC on integration finalizers sub-resources (#1486)

Manual cherry-pick of #1486 into 0.5.x branch.
What type of PR is this?
/kind bug
What this PR does / why we need it:
Which issue(s) this PR fixes:
Fixes #1485
Does this PR introduce a user-facing change?
Add Missing RBAC on integration finalizers sub-resources

/ok-to-test


Update zio-oci-objectstorage to 0.4.0

Updates io.laserdisc:zio-oci-objectstorage from 0.3.1 to 0.4.0.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "io.laserdisc", artifactId = "zio-oci-objectstorage" } ]

labels: library-update, early-semver-major, semver-spec-minor, commit-count:1

@amir when you get a chance could you address the issues here in integrating zio-oci-objectstorage 0.4.0?

@sirocchj #660 fixes the issue

Closing in favour of #660


Fix : Unusable When Slowed Down

#4022
Some performance improvements.

Please elaborate on what is happening here

@emilk
It's done up to this point.
There are no special bugs.
If you look at the source code, there is no special change from the original intention.
This is what everyone originally intended, and it eliminates commonly used bottlenecks and improves some subtle performance.
It may be difficult to notice performance improvements in simple programs, but performance has improved.

@emilk
Close #4022
I think issue #4022 can be closed.
FPS is relatively improved at around 40-50.
Reducing FPS from 60 to 50 when creating a viewport is a separate issue.
I think it would be best to end here for now.
Not directly related to this, but influencing,
#4053 FontBook (bulk widget) issue still remains.

@emilk
If #4054 is applied, all viewports will operate normally even if the program is minimized.
However, after applying #4026 yesterday, everything stopped working.


try

Summary of changes
Changes introduced in this pull request:
Reference issue to close (if applicable)

Closes
Other information and links

Do or do not, there is no try.


Slider thumb moves faster than cursor/thinger when using a step

Description
When using a step with the slider, the thumb will move faster than the user's finger/cursor on mobile platforrms. It works fine on web.
CodeSandbox/Snack link
https://snack.expo.dev/@zilhk/native-base-slider-step-issue
Steps to reproduce

Go to provided snack link
Run snack on mobile phone
Place finger on thumb and slide to move it

=> the thumb will move faster than the finger
The slider is used like this:
<Slider w="3/4" maxW="300" minValue={0} maxValue={100} step={10}>
  <Slider.Track>
    <Slider.FilledTrack />
  </Slider.Track>
  <Slider.Thumb />
</Slider>

NativeBase Version
3.4.25
Platform

[X] Android
[ ] CRA
[X] Expo
[X] iOS
[ ] Next

Other Platform
No response
Additional Information
No response

Hi is there some progress on this bug?

I have the same issue, any news ?

I don't think the developer intend to continue developing this package.
See this issue: https://github.com/GeekyAnts/NativeBase/issues/4302

Thanks for your answer, but in my opinon gluestack is still a too early project to be used in production right now...

Hi @LaGregance currently on our project we are thinking to migrate to tamagui But in the meantime we used as our slider component from this library @miblanchard/react-native-slider, which works just fine. Hope it helps.

Thank you, in my case I manage to do what I want using @react-native-assets/slider


[BUG] java.lang.NoSuchMethodError: No direct method (Ljava/lang/Object;Ljava/lang/Object;)V in class Landroidx/compose/animation/core/SeekableTransitionState;

Describe the bug
When going back from a destination (scene) the app crashes with
To Reproduce
Use Compose multiplatform 1.7.X-alpha or dev
navigate from a destination, go back
crash, not always
Expected behavior
User should be returned to the destination safely
Minimal reproducible example
I guess that's something introduced in 1.7.X Compose multiplatform that breaks the library
stack trace is
java.lang.NoSuchMethodError: No direct method <init>(Ljava/lang/Object;Ljava/lang/Object;)V in class Landroidx/compose/animation/core/SeekableTransitionState; or its super classes (declaration of 'androidx.compose.animation.core.SeekableTransitionState' appears in /data/app/~~49ENzoh7ld7afOHMt_9WzA==/com.x.x.debug-AIZoxjVS9E177qpLp0l5xQ==/base.apk)
                                                                                at moe.tlaster.precompose.navigation.NavHostKt$NavHost$6.invoke(NavHost.kt:191)
                                                                                at moe.tlaster.precompose.navigation.NavHostKt$NavHost$6.invoke(NavHost.kt:140)

Yes compose 1.7.x change the SeekableTransitionState's API, which I will update to use the new version after 1.7.x has been released.

Yes compose 1.7.x change the SeekableTransitionState's API, which I will update to use the new version after 1.7.x has been released.

1.7.X is in alpha now, maybe a PreCompose alpha/beta release too?

it would be great if you fix that bug :) thanks for your effort

any news on having it fixed? and thank you for a great library!

PreCompose 1.7.0-alpha01 is out with compose multiplatform 1.7.0-beta02 support, which should resolve the issue.

I saw that precompose 1.7.0-alpha02 was released, but after adding it - I'm getting error:
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':composeApp:transformNativeMainCInteropDependenciesMetadataForIde'.
> Could not resolve all files for configuration ':composeApp:nativeMainResolvableDependenciesMetadata'.
   > Could not find moe.tlaster:precompose-viewmodel:1.7.0-alpha02.
     Required by:
         project :composeApp
   > Could not find moe.tlaster:precompose-koin:1.7.0-alpha02.
     Required by:
         project :composeApp

I don't have the same issue is with 1.7.0-alpha01

I saw that precompose 1.7.0-alpha02 was released, but after adding it - I'm getting error:
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':composeApp:transformNativeMainCInteropDependenciesMetadataForIde'.
> Could not resolve all files for configuration ':composeApp:nativeMainResolvableDependenciesMetadata'.
   > Could not find moe.tlaster:precompose-viewmodel:1.7.0-alpha02.
     Required by:
         project :composeApp
   > Could not find moe.tlaster:precompose-koin:1.7.0-alpha02.
     Required by:
         project :composeApp

I don't have the same issue is with 1.7.0-alpha01

moe.tlaster:precompose-viewmodel is no longer used and replaced by org.jetbrains.androidx.lifecycle:lifecycle-viewmodel-compose, this is a major change for 1.7.0-alpha02, you can still keep 1.7.0-alpha01 if you're not ready to migrate to Jetpack's ViewModel.
https://github.com/Tlaster/PreCompose/releases/tag/1.7.0-alpha02

oh OK, thank you. luckily for me migration should be pretty straightforward, especially because I recently discovered that PreCompose/Molecule is in most cases better choice for me than using ViewModel approach.

Any updates with this issue?

Yes actually it works, mine was just some other plugins' conflict. I suggest to verify carefully all plugins' compatibility, eventually disabling and reintegrating them gradually.


Identifiy and resolve unhnalded promise rejections in unit tests

There seem to be some promises that aren't handled correctly.
The message rejected promise not handled is printed a couple of times when running tests on CI

7 times under Interpreters display version
1 time under Linting - Provider

To help manage our issues and to better communicate what the team plans to work on we are closing issues that we don't plan to work on but would accept a pull request from a volunteer for. To be clear, closing this issue does not mean we won't consider a pull request for this enhancement as outlined in our contributing guide, just that the development team has no plans to work on it themselves.


Update stale issues action

What type of PR is this? (check all applicable)

[ ] Refactor
[ ] Feature
[X] Bug Fix
[ ] Optimization
[ ] Documentation Update
[ ] Community Node Submission

Have you discussed this change with the InvokeAI team?

[X] Yes
[ ] No, because:

Have you updated all relevant documentation?

[ ] Yes
[X] No

Description
Updated script to close stale issues with the newest version of the actions/stale
Related Tickets & Documents

Related Issue #
Closes #

QA Instructions, Screenshots, Recordings

Added/updated tests?

[ ] Yes
[X] No : please replace this line with details on why tests
have not been included

[optional] Are there any post deployment tasks we need to perform?
Not sure how this script gets kicked off

StaleBot was deprecated and GH now directs you to actions/stale@v8. Did you try the latest version (v8)? Probably best to use that

Oh, that is really weird about the docs pointing you to 4.1.1


The SNAT/DNAT problem with injecting into another TCP session using BGP Anycast.

Is there an existing issue for this?

[x] I have searched the existing issues

Version
equal or higher than v1.16.4 and lower than v1.17.0
What happened?

We have Edge Cluster with LB type services for announcing VIP IP's to clients using BGP protocol.
Clients are located in Kubernetes clusters.
Clients connect to Istio Ingress running in Edge Cluster using VIP.
Traffic flow is:
Client sends request to VIP (ipSrc = ClientIP, ipDst = VIP).
Request snat on cilium (ipSrc = NodeIP, ipDst = VIP).
Request arrives to Edge Cluster node.
Request dnat on cilium (ipSrc = NodeIP, ipDst = IstioIP)
Istio responds with SYN/ACK (ipSrc = IstioIP, ipDst = NodeIP)
Cilium revDnat SYN/ACK (ipSrc = VIP, ipDst = NodeIP)
SYN/ACK arrives to Client Node (ipSrc = VIP, ipDst = NodeIP)
Ciliumt revSnat  SYN/ACK (ipSrc = VIP, ipDst = ClientIP) and send it to clint pod
Client gets SYN/ACK and then connection is established.

The problem happens when a second Client2 on the same Node tries to make a request to another VIP address using the same source port. We got tcpdump on Edge node and noticed that Client2 injected in tcp session of Client1:

edge_dump.zip
So, on the Edge side, a TCP session collision occurs, which breaks the TCP protocol.
It seems that the issue is not on the client side but rather in how DNAT is handled on the Edge side. This significantly impacts user traffic since many users rely on HTTP/2 connections and bundle multiple streams within them. Problems of this kind lead to prolonged timeouts on the user side because TCP attempts to recover the connection, which, of course, it cannot do. Our design is based on the ability to allocate multiple VIPs from the Edge cluster, but the current behavior breaks this approach. What can we come up with to mitigate the impact of this issue, and how can it be resolved?
How can we reproduce the issue?
pod A: curl -vk -H "x-set-response-delay-ms: 2000" --local-port 60339-60340 https://test.io --resolve test.io443:<IP_ADDRESS>
hangs...
pod B: curl -vk --local-port 60339-60340 https://test.io --resolve test.io:443:<IP_ADDRESS>
OK
user-node # cilium bpf nat list | grep 10.213.94 | grep OUT
TCP OUT <IP_ADDRESS>:60339 -> <IP_ADDRESS>:443 XLATE_SRC <IP_ADDRESS>:60339 Created=2550sec ago NeedsCT=0
TCP OUT <IP_ADDRESS>:60339 -> <IP_ADDRESS>:443 XLATE_SRC <IP_ADDRESS>:60339 Created=2724sec ago NeedsCT=0
Cilium Version
1.16.4
Kernel Version
5.15.0-113-generi
Kubernetes Version
v1.25.14
Regression
No response
Sysdump
cilium-bugtool-20241205-151937.799+0000-UTC-1530884218.zip
Relevant log output

Anything else?
No response
Cilium Users Document

[ ] Are you a user of Cilium? Please add yourself to the Users doc

Code of Conduct

[x] I agree to follow this project's Code of Conduct

Thanks for making such a detailed description of the issue!
Relevant output from cilium-dbg service list:
310 <IP_ADDRESS>:443/i LoadBalancer 1 => <IP_ADDRESS>:8443 (active)
311 <IP_ADDRESS>:443/i LoadBalancer 1 => <IP_ADDRESS>:8443 (active)
312 <IP_ADDRESS>:443 LoadBalancer 1 => <IP_ADDRESS>:8443 (active)
313 <IP_ADDRESS>:443 LoadBalancer 1 => <IP_ADDRESS>:8443 (active

From cilium-dbg config -a we can see KPR enabled, and I see in the service listing in your image that externalTrafficPolicy: local is set, as well as allocateLoadBalancerNodePorts=false.
It seems like in this particular configuration, the load balancer datapath is not performing a tuple collision check as part of the DNAT operation.
Is it possible to test this also with allocateLoadBalancerNodePorts=true, to check whether maybe the relevant tuple collision check is part of the nodeport logic?

Hi @joestringer,
This issue is very important for us as it directly impacts our production environment. Resolving this has become a top priority for us, and we are eager to see progress. The lack of resolution here is becoming a significant bottleneck for us, and I suspect it might be affecting others in similar scenarios
We are ready and willing to contribute to finding a solution, but we would greatly appreciate some guidance on where to start or how we can help. Could someone from the team provide any pointers, context, or initial steps we can take to move this forward?
Looking forward to your input—thank you in advance!"


remote assist

dear author ,
can i do some extra assist to the remote participant video track ,the function like remote assist of microsoft HoloLens2.  The video url HoloLens 2.  Or do we have the plan to implement it.

you can add remote control yourself by sending control signals over data channels. we will not be adding this capability to livekit natively for now.


Determine whether platform supports dll declspec

Clang contains __has_declspec_attribute for MSVC compatibility. This can be used to determine whether __declspec is available. Use this to determine if dllimport/dllexport should be used when exporting the zlib API.

Rebase please :)

@Dead2 rebased

Thanks :)


Performant pagination on admin addresses

made admin addresses page massively faster with a custom paginator+changelist, a combined index on postcode + uprn, and changing the default order direction
Admin address view now responds in < 1s with >15m rows in the db

LGTM. Snippet code could be refactored, but it's probably better to keep it unchanged.


HARP-6487: Provide placement attribute support for point/line labels.

Introduce new placement technique attribute for:

'labeled-icon' (PoiTechnique),
'line-marker' (LineMarkerTechnique),
techniques that are utilizing LineMarkerTechniqueParams set.

The attribute holds an array of possible (and optional) text
placements relative to label origin (screen anchor) point.
If placements are defined they override hAlignment and vAlignment
settings defined in style. Each placement option is defined in array
as 1 or 2 characters string defining the text position relative to
origin. i.e. "TR" (top-right), "BL", (bottom-left) or simply
"R" (center-right).
Signed-off-by: Krystian Kostecki<EMAIL_ADDRESS>Thank you for contributing to harp.gl!
Before requesting a pull request, please remember to check the following documents:

contribution guidelines
coding style

If you are adding new functionality we would highly appreciate if you can describe what is the capability you are adding and even better if you can add some examples. Please also remember to add tests for it.
CI Check
Our bots will check whether your PR can be directly integrated into the mainline. We have some internal integration tests running on the background, our bots will inform you of the next steps and someone from our team will take a look and help if needed!
And please do not forget to sign-off your commit! You can read more about DCO here. But, in short, you just need to use git commit -s or append --signoff when you are committing to the repo.
Happy contributing!

The decision to make if we would like to parse placement as array of strings:
"attr": {
    "placement": ["literal", ["TR", "TL"]],
    ....
}

or rather simplify it to string encoded list, like this:
"attr": {
    "placement": "TR,TL",
     ...
}

retest this please


Made Renderer.getContext() not null.

Fixes #5

Current coverage is 80.75% (diff: 83.33%)

Merging #6 into master will increase coverage by 0.56%

@@             master         #6   diff @@
==========================================
  Files            15         15
  Lines           212        213     +1
  Methods           0          0
  Messages          0          0
  Branches         25         24     -1
==========================================
+ Hits            170        172     +2
+ Misses           42         41     -1
  Partials          0          0

Powered by Codecov. Last update 920bbdf...144435e


Create a Vibrant README

Create a Vibrant README ✏
suggestions per @chiedo  from issue #23
We have lots of room to make the Open Block Explorer README more inviting to open source developers. See the next.js README as an example.

Describe what Open Block Explorer is
Link out to a live example of the Open Block Explorer
Add a “contributing” guide which guide developers new to the project in the contribution process
Include Links to design docs if available
Link to some “good first issues” for developers new to the project
Describe who the core contributors are in the footer
Link out to the Open Block Explorer Discord and/or Telegram community

Done in latest PR.


Revert "DBX Improvements (SOCKS, Hide window via WindowHandler)"

Reverts EmpireProject/Empire#721
So, this works if there is a dropbox listener. However, if there is an HTTP listener, stager generation fails with:
Exception: generate_launcher() got an unexpected keyword argument 'useWindowHandler

oh snap, you are right.
We have to add the useWindowHandler parameter to all listeners.
I put it into all stages of code generation so we can call "generate" from usestager well as call "launcher powershell" from the listener.
I fixed that in my fork.
will test and re-PR.


RFC: Deno support

Summary

Proposed Solution

Requirements

I'd appreciate if at least the initial parts of the RFC template are filled out here. It's hard to gauge demand of this, I'll just say this beforehand. We've released some libraries on JSR and this hasn't been the smoothest process.
I'd suspect that our sub-dependencies (especially for Svelte/Vue support) will be a temporary blocker here, and importing TypeScript itself will also be a problem unless we reach for npm:* import specifiers. Overall, I'm not really inclined to do the amount of research needed, without seeing the right signals in interest and demand. Sorry
As per what is in the RFC template, there's sections there that really shouldn't be ignored as they give us a lot of initial information and require a baseline of some of the above research questions to be answered:

Describe in a couple of words what you're proposing.
If relevant, include why this should be addressed now.
The problem should be clearly stated and the solution should be summarised.
How will this change be implemented, and how does it work?

These templates are there for a reason. Please don't ignore them ❤
I'll close this for now, since I don't think we have the bandwidth to do all the prerequisite work and research, while also not knowing the demand for this

For clarity, everything gql.tada specific should work, the only thing that isn't implemented in Deno is the TypeScript Language Server plugin which isn't really on our side to start supporting. Last time I tried I had no issues running the CLI to get an introspection and using graphql() to get types from my written GraphQL documents. If that has changed by now, we'd need to know what issues you are running into rather than just throwing an empty issue at us (which is really disrespectful).
If the only thing you are missing is the LSP plugins then this issue is better suited for the deno repository.


Developer documentation

[ ] Class diagram
[ ] Class description

Can we use Sphinx apidoc functionality here?

It seems we already have this? See http://pywps.readthedocs.io/en/latest/api.html

Yes, Jachym started it up when we were in Como, I believe. You can follow on with it if you will. My task at this stage is to produce the Domain Model(s). We then need more detailed class descriptions, that's where Sphinx may help.


Extend operation on chunks applies change before validation

from docarray import Document

d = Document(id='Meow')
d.chunks.extend([1, 2, 3])
d.summary()

Expected Behavior
Throws an error and keeps the Document intact.
Current Behavior
Throws an error but modifies the Document.
Reproduction of the bug in colab environment:
https://colab.research.google.com/drive/1n0olEkZ9iKSIvtq1kXbLv5hv59MsSv1L?usp=sharing

Maybe bug? Opening again

I think it might be worth solving because someone may “Ask forgiveness, not permission” in their code and use a try except case in this scenario. The try except would not work because even though the exception is hit, the damage is done.
Not sure of the tradeoffs though. But if it's as simple as changing an evaluation order then I think it's worth having.

I guess the code is to reimplement some of the dunder methods as __add__ and all this Pythonic ContainerSeqLike objects, but yes it may be worth.

It is understandable why this fail, the chunk in just a MutableSequence that can be extend by anything.
We should do a check, as @Jackmin801 said this is about tradeoff with performance. ( I wish sometime Python could do type checking without overhead).
The code that does that is here : https://github.com/jina-ai/docarray/blob/main/docarray/array/storage/base/seqlike.py#L64-L70
IMO we should check anyway. It is just adding one if statement

More in depth look.
Actually we don't even do extend by bulk, we do a for loop and use append (this is because we need to keep track of the offset2id so this is the only solution). So there is a very minimal overhead to check if the value is a Document or not.
I don't see any reason not to do it @JoanFM

So let's do this @samsja , it should be quick

Decided not to pursue. Reasons explained in the PR opened


zigler doesn't detect that zig has been cached in the zig directory of "deps"

results in this error:
** (CompileError) lib/zigler_test.ex:1: zig hasn't been downloaded.  Run mix zigler.get_zig
expanding macro: Zigler.Compiler.before_compile/1
lib/zigler_test.ex:1: ZiglerTest (module)
(elixir) lib/kernel/parallel_compiler.ex:229: anonymous fn/4 in Kernel.ParallelCompiler.spawn_workers/7

fixed in https://github.com/ityonemo/zigler/pull/60/commits/9fc95cf76ccbba0d737f3a672079b202fd30b191


Some bug with memory or something in array broadcasting?

Maybe I don't understand how the garbage collector works?

Maybe GC can't find pointers that are within structs? Or pointers that are not variables or something?


UI -  Seeing erroneous response from Anthropic provider once we confirm the calls to provider repo.

gptscript version v0.0.0-dev-53f7fbde-dirty
Steps to reproduce the problem:

Launch UI with default model set to Anthropic provider - gptscript  --ui --default-model 'claude-3-5-sonnet-20240620 from github.com/gptscript-ai/claude3-anthropic-provider' github.com/gptscript-ai/cli-demo
Once UI is launched and prompted for allowing call to Anthropic provider repo , allow this operation.
Notice that there is the following chat response message after allowing this.

Tested with electron Version - 0.10.0-rc3
I dont see this issue any more.

Create an assistant with model (in Advanced) as claude-3-5-sonnet-20240620 from github.com/gptscript-ai/claude3-anthropic-provider
Start a chat using this assistant.
I am prompted to enter anthropic key and I am able to get response successfully.

There is no erroneous response from Anthropic provider seen when confirming calls to the provider repo anymore.


Make temp directory path operations more reliable

This fixes the #22.
We want to normalize all paths before doing any string operations - this ensures the result is predictable.
This fixes breaking bug on Windows.

Thanks for your feedback.
However, this PR won't really improve things regarding WSL usage.
In the meantime I implemented proper WSL handling myself: f74f749a414d39caac338186618c01fd62f5db38
The new plugin version (1.9.0) should be available in the JetBrains Marketplace soon.

Very nice! I didn't expect that... 👍
I did try the 1.9.0 and it seems to work fine even with deep files in roles. It's just as slow as my workaround but I guess that's more about the ansible-lint than anything. It takes few seconds to see the highlights (project with 50+ yml).


USER STORY: Add Product Page

As an admin, I will only want other admins or people with the same permissions to view the add product page so that students won't have access to that page.

On the horizon: Protect page “Add product page” so only users can view and use page.

@Robel-003 Add product page back button routes to login page. Might be smoother to have it route back to the update product page for now until we figure out where this page will be accessed from.

@Robel-003 Disregard this. I think it is fine how it is as we will be moving it into the admin and creator pages soon.


Debug Governance Origins via XCM

WIP spike, will probably just open a new PR with the essential changes (or remove most of the stuff here).
related to #3

superseded by #50


Update build and refactor 'update'

Overview
We need to update the build in order to support single-file unit testing.
Our main goal is to refactor update() to follow along the soon-to-be deprecated 'liq-projects-lib' updateDps(). The latter is a bit fancier and has some nice features, but we also want to incorporate support for the current options.

Work for this issue will begin begin on branch work-liquid-labs/npm-toolkit/19.


Correction Needed: Incorrect Information Regarding UseLazyLoadingProxies Implementation in EF Core

Dear Maintainers,
I hope this message finds you well. I'd like to draw attention to a statement within the documentation that might mislead users regarding the implementation of UseLazyLoadingProxies in Entity Framework (EF) Core.
In the current documentation, there's a line that reads: "The UseLazyLoadingProxies call tells EF Core to implement lazy-loading, so child entities are automatically loaded when accessed from the parent."
Proposed Correction:
"The UseLazyLoadingProxies call tells EF Core to implement lazy-loading, so child entities aren't automatically loaded when accessed from the parent."
The existing statement suggests that child entities are automatically loaded when, in fact, using UseLazyLoadingProxies enables lazy-loading, preventing the automatic loading of child entities when accessed from the parent.
I believe correcting this information is essential to prevent potential confusion among users relying on the documentation to understand EF Core's behavior when utilizing lazy-loading proxies.
Thank you for your attention to this matter. I'm willing to contribute to updating the documentation if needed.
Best regards,
bananaback

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: a691101f-b7ea-4539-3745-6d9b0f5e317f
Version Independent ID: 8f488a69-cedf-9c45-f977-23b3d8abd3df
Content: Get Started with WPF - EF Core
Content Source: entity-framework/core/get-started/wpf.md
Product: entity-framework
Technology: entity-framework-core
GitHub Login: @JeremyLikness
Microsoft Alias: jeliknes

@bananaback But lazy-loading does result in child entities being loaded automatically.

Dear @ajcvickers,
Thank you for your response and clarification regarding the UseLazyLoadingProxies functionality in Entity Framework Core.
I appreciate your input and understand that my initial understanding have been incorrect. I apologize for any confusion caused by my suggestion to alter the documentation.
Once again, I apologize for any confusion caused by my previous comment, and I'm grateful for your assistance in ensuring the accuracy of the documentation.
Thank you for your time and help.
Best regards,
bananaback


The PowerShell cmdlets to create the required Azure AD resources are not cross-plaform

The documentation describes the tasks to create the required Azure AD resources using the cmdlets from the AzureAD module. This module is not cross-plaform and required Windows.
Please update the documentation to describe how to create the required Azure AD resources using cmdlets from the Az module as this module supports cross-platform execution.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 912419aa-f5cd-160d-722a-9e1834fe7ad7
Version Independent ID: dbc3b6c9-2edd-a73f-2b4a-4d17f68ed2f5
Content: Enable Azure DS Domain Services using a template
Content Source: articles/active-directory-domain-services/template-create-instance.md
Service: active-directory
Sub-service: domain-services
GitHub Login: @iainfoulds
Microsoft Alias: iainfou

@MWL88 Thanks for the feedback. We are investigating the issue and will update you shortly.
@iainfoulds FYI

In case it is helpful, here is the process I followed to create the Azure AD resources using cmdlets from the Az module.
Check the Microsoft.AAD provider is registered:
Get-AzResourceProvider -ProviderNamespace Microsoft.AAD
If the provider is not registered:
Register-AzResourceProvider -ProviderNamespace Microsoft.AAD
Check the Domain Controller Service service principal has been created:
Get-AzADServicePrincipal -ApplicationId "2565bd9d-da50-47d4-8b85-4c97f669dc36"
If the Domain Controller Service service principal has not been created:
New-AzADServicePrincipal -ApplicationId "2565bd9d-da50-47d4-8b85-4c97f669dc36"
Check the "AAD DC Administrators" group has been created:
Get-AzADGroup -DisplayName "AAD DC Administrators"
If the "AAD DC Administrators" group has not been created:
New-AzADGroup -DisplayName "AAD DC Administrators" -MailNickname "AADDCAdministrators" -Description "Delegated group to administer Azure AD Domain Services"
Check the user creating the Azure AD Domain Services resource is a member of the "AAD DC Administrators" group:
Get-AzADGroupMember -GroupDisplayName "AAD DC Administrators"
If the user creating the Azure AD Domain Services resource is not a member of the "AAD DC Administrators" group…
Get the group's ID:
Get-AzADGroup -DisplayName "AAD DC Administrators"
Get the user's ID:
Get-AzADUser … choose the appropriate parameter the find the required user
Add the user as a member of the group:
Add-AzADGroupMember -MemberObjectId <userId> -TargetGroupObjectId <groupId>

Thanks for the feedback, @MWL88
The commands are cross-plat, and using the latest Azure PowerShell modules. I think the issue is the line breaks. As there are some long cmdlets, they use a backtick to wrap long lines, and the following lines are then indented to show continuation. This is a standard practice in PowerShell cmdlets that are long like this to make it more readable, though I understand it makes a little hard to just copy + paste if using a *nix-based shell.
Your commands look to be the same, minus the line breaks, and some different ordering of parameters. I'm glad you were able to successfully get this working. Our docs engineering team continues to work on ways to improve the formatting of long PowerShell cmdlets to minimize issues like this. For now, please remove any backtick line break continuation issues for cross-platform use.
#please-close

@iainfoulds In the issue I raised I tried to highlight there are 2 different PowerShell modules listed in the prerequisites:

the Azure (Az) Powershell module which is cross-plat
the AzureAD PowerShell module which is not cross-plat

The instructions for creating the required Azure AD resources uses cmdlets from the AzureAD PowerShell module (not cross-plat).
The example cmdlets included in my comment may look similar but they are from the Az PowerShell module (cross-plat), not the AzureAD PowerShell module as used in the current documentation.


Replace J2EE with Java in ToC

@brunoborges : Thanks for your contribution! The author, @, has been notified to review your proposed change.


unexpected use  of reserved word 'let' in strict mode

npm install -g react-native-cli
react-native init testProejct

open the ios proejct by Xcode, and run. then the following happens.

What version of Node are you using? You need at least Node 4.0

node version is 4.2.3

now I try one more time. And it successes! I don't know why. Sorry for this issue.

@timzaak - What steps did you take to resolve this? I'm running into this setting up a new project and seeing same results. Tried multiple times with no luck. Any leads might help, thanks!

@matthewsimo Do you have a .babelrc in your project by any chance?

@satya164 It does!
{
  "presets": ["stage-0", "react-native"],
  "plugins": [
    "transform-decorators-legacy"
  ]
}

@matthewjohnston4 The .babelrc looks correct though. Can you try removing it and see if works anyways?

@satya164 Yes, we made a branch that removed the babel dependency and it is building properly for now. Doing some digging to find out where the conflict is, but no luck as of yet. Appreciate your responses, thanks. :+1:


contentScaleFactor not working 0.9.7 compared with 0.9.6

We put together a SwiftUI proof-of-concept using Macaw 0.9.6 in XCode11 using a UIScrollView with a UIViewRepresentable wrapper and a MacawView as the only subview in the scrollview. We're now using XCode12 Beta which will not build with Macaw 0.9.6.
I integrated our PoC work into the project and noticed that there was a significant degradation in the quality of the rendered image. Previously we had adjusted that (for different zoom levels) by altering MacawView.contentScaleFactor. With Macaw 0.9.7 this value no longer has any effect on the rendering process leaving the image heavily pixelated even at low zoom levels.
I put together a test involving porting our project back to XCode 11, running the app on an emulator with 0.9.6 and then updating to 0.9.7 without any code changes (other than to the podfile) and running on a second emulator. The difference in quality is significant and can be seen in the attached image.

Hi Peter,
Manual adjustment of contentScaleFactor doesn't look correct. There is MacawView.zoom property which you can use for zooming. If you want some custom scaling then you probably need to change place of the root element instead of image scaling (which will be pixelated).
If you'll be able to built a simple sample of what you're trying to achieve then I can help you fixing your code.

Hello @ystrot ,
when I use the MacawView.zoom property, the image still gets pixelated when I pinch. Do you know how can I solve the issue?
Thanks

Could you create a sample project demonstrating your issue?

I only enabled the zoom. Maybe it's a problem with the SVG file? Thanks
macawMap.zip


IoT Controller Process-Data dependency issues

While working to analyse the Steel Mill model aiming to confirm results from a published manual analysis Lee, R.M., Assante, M.J. and Conway, T., 2014. German steel mill cyber attack. Industrial Control Systems, 30(62), pp.1-15., it became apparent that the IoT model is slightly 'off'.
The model connects the onboard IoT processes to the Thing data using inter-process communication only. As a result, a network DoS attack on an IoT Controller leads to the expected result but by an unexpected secondary threat pathway, while an attack to delete/disable the onboard control data does not lead to the expected result.
The model should be rationalised, so that the IoT Controller uses a DataService for external communication, a ControlProcess to handle physical actuator control, and local storage to communicate between the two.

Further analysis reveals that this is quite a complex issue.
Essentially, loss of availablity in a Host means the Host cannot execute processes. It does not directly relate to whether the Host can communicate, because this domain model represents that capability by the associated (inferred) Interface assets (one per Logical Subnet to which the Host is connected).
An IoT Thing is a type of Host, but it is special. Its executes a process (lower case 'p') involving evolution of physical environment in which it is embedded. Parts of the Thing are involved physically in this process, which is the true function of the IoT Thing - if there were no such physical process, the device would not be a Thing. The Thing runs software that sends signals to and/or these physical hardware elements, i.e., it hosts a Process asset (capital 'p'). But this Process is only part of the overall process executed by the Thing.
For a Sensor, the cyber-physical process is a measurement process, which is mainly an information process. If the Sensor shuts down, the measurement process also shuts down. The physical environment continues to evolve, but the purpose of the Sensor is no longer happening. The ultimate purpose of a Sensor is not to make measurements but to send the results to other devices, so that loss of availability in the Sensor is equivalent to a loss of availability in the flow of data from the Sensor. This means there is no need for Sensor-specific secondary threats to propagate loss of availability in the Process to the level of the Sensor. If the Sensor cannot run Processes, it will be unable to send measurements anywhere, so loss of availability in the Sensor (with the usual meaning for a Host) does not conflict with this.
For a Controller, the cyber-physical process is the evolution of physical world, which is primarily a physical process. If the hosted Process shuts down, the Controller cannot send signals to actuator hardware that regulates this evolution, but the physical world (including the actuator hardware) continues to evolve. The process is not halted, but it does become unreliable (it may go in the wrong direction), so this is equivalent to a loss of reliability in the Controller. Is it reasonable to say that there is no loss of availability?
It could be argued that a Controller cannot suffer a loss of availability because its physical actuator hardware will continue to interact with the physical environment, albeit passively. But if it cannot execute hosted Processes then (being a Host), it should still be considered unavailable. Impact levels for loss of availability should be specified with this definition in mind. If the hosted control Process shuts down, the Controller cannot control its actuator hardware, but that doesn't mean there is a loss of availability in the Controller - only a loss of reliability.
Now consider the effect of a compromise in the flow of control inputs to the Controller. These are normally stored, because normally one would update control inputs when necessary, rather than continually send the same values. If the stored copy is compromised (by any means), then the Controller will be affected:

loss of authenticity: means the Controller is using forged input. Controllers are 'trivial' hosts that don't support users as such, but the actions of a Controller are determined from its control input, so the ability to formulate these inputs is equivalent to having user rights on other types of Host. So if the input can be forged, it is equivalent to a loss of control in the Controller.
loss of integrity: means the Controller is using incorrect input and should be considered unreliable.
loss of timeliness: means the controller is using out of date input and should be considered unreliable, unless the process is not time critical.

At present, Sensors do not have control inputs, but really they should. Although a Sensor doesn't control other changes in the physical environment, making measurements is a physical process that should be controlled. If the control input of a Sensor is compromised, the Sensor will be affected:

loss of authenticity: means the measurement process is being changed in such a way that the measurements are misleading (e.g., pointing a camera in the wrong direction) so the effect would be loss of authenticity in the measurements which could be represented as loss of authenticity in the Sensor.
loss of integrity: means the measurement process is faulty, so the measurements should be considered unreliable.
loss of timeliness: means the measurement process is using out of date input so the measurements should be considered faulty, unless the measurement process is not time critical.

Hitherto, the incoming control data was considered as an input to an onboard (inferred) Process that controls the hardware. Surfacing threats typically propagated issues with the Process to the hosting IoT Thing. The relationship of the Process to the Data determined how problems with the Data would affect the Process and hence how it was presented by surfacing to the level of the IoT Thing.
The current model assumes the control input is sent to a Thing via an onboard DataService, which stores the input locally, and also serves the data to the onboard control process which 'receives' the data (does not shut down if the data is not available). This issue was created because this seemed incorrect as if the DataService is subject to a DoS attack, the control process is not rendered unavailable. But as discussed above, that is not correct anyway.
The best solution seems to be elimination of the inferred control process from an IoT Thing. Secondary threats should then be inserted to surface the effects of problems with the incoming data, and (in the case of a Sensor) affect the measurement data sent from the Sensor to other processes.

Proposed solution is as follows.
Introduce two new relationship types:

Sensor-senses-Data: means the Data is the result of sensor measurements
Thing-directedBy-Data: means the Data is a control input for the physical sensor or actuator hardware

Note that domain#controlledBy is already being used for the relationship between a private space and the stakeholder controlling access to the space - something we may want to change if we ever review and rationalise existing relationship types.
Infer the presence of an onboard SensorProcess to create the first type of data, which sends the data to other processes related to the Sensor via the domain#receivesFromSensor relationship type (i.e., the Sensor initiates sending new measurements).
Infer the presence of an onboard DataService to serve the second type of data, which can also be used by processes getting sensor data by polling or reading from the Sensor (i.e., they initiate). This data should also be stored on the Thing.
Do not create the ControlProcess that previously received the second type of data. Instead, use 'surfacing' threats to elevate issues with the stored input to the Thing, and propagate from there to the sensor data as required (e.g., so unauthentic control inputs at a sensor lead to unauthentic rather than merely incorrect sensor output).

The above fixes were implemented in branch 32. However, this means Loss of Availability should now be interpreted the same way as for any other host - i.e., the host is unable to run processes.
For the Sensor output, this is consistent with the surfacing threats. If the Sensor cannot run processes, the data cannot be created by the sensing Process, and so cannot flow from the Sensor. Loss of Availability (as a Host) therefore implies Loss of Availability for every flow of sensor data. If all such outflows are prevented by other means, the Sensor may still be able to run processes, but this is not apparent to anyone outside the Sensor so treating it as unavailable should not cause any unwanted issues.
For a Controller, Loss of Availability does not mean the physical actuator stops functioning, but rather that it functions without any control from the IoT Controller device. To model physical shutdown of the (possibly uncontrolled) process, we need a Misbehaviour representing that condition. This should be added as 'PhysicalShutdown', which is caused as a side effect if the Controller should be suspended.

Fixes now merged into branch 6a, so this issue can be closed.


Cannot find module 'rxjs/BehaviorSubject'.

getting error Cannot find module 'rxjs/BehaviorSubject'.
I have run npm install.
but still have issue.

Same here


Fix missing folder copy for building image

I triggered a building action for it.
https://github.com/Canner/wren-engine/actions/runs/8532529203

It executed it very well https://github.com/Canner/wren-engine/actions/runs/8532794892


scrollbar.limit.y initializing as Infinity

I'm wondering if you can provide some insight as to why my smooth-scrollbar instance is setting it's limit.y to Infinity on init. I'm using this in a react project, and after one or 2 renders it set's to a proper number, but that infinity on load is causing some issues.
Do you have a clear rule for returning the limit.y as Infinity? Maybe when things arn't 100% loaded? Any info you could give me about this behavior would be great!

If scrollbar.limit.{x|y} returns Infinity, it means the scrollable area has not been measured yet. You can use scrollbar.update() to force an update after init.

loud and clear, thanks for the explaination!


ns-extract-mesh not working with custom data

Hello, I am facing a problem with creating a mesh using a trained model with nerfstudio that comes along sdfstudio. The model is training properly and I am able to get the checkpoints. Unfortunately, I am not successful in getting a mesh at all. I do confirm that the ns-export-mesh application is running with the sculp tutorial that is attached to the tutorials.
Has anyone of you succeeded to create mehes on your own trained data? If yes, could you please share with me your working steps?
Thank you
Peter

I have run successfully the "poster" test case with nerfstudio v.0.3.2 and created a trained nerf model.
I tried to use ns-extract-mesh with this trained model from nerfstudio v.0.3.2 and got this errror:
(sdfstudio1) peter@x3:~/Libraries/sdfstudio$ ns-extract-mesh --load-config ../nerfstudio-o3d-16/nerfstudio/outputs/poster/nerfacto/2023-07-19_133253/config.yml     --output-path meshes/test.ply Traceback (most recent call last):   File "/home/peter/anaconda3/envs/sdfstudio1/bin/ns-extract-mesh", line 5, in <module>     from scripts.extract_mesh import entrypoint   File "/home/peter/Libraries/sdfstudio/scripts/extract_mesh.py", line 15, in <module>     from nerfstudio.model_components.ray_samplers import save_points ImportError: cannot import name 'save_points' from 'nerfstudio.model_components.ray_samplers' (/home/peter/Libraries/nerfstudio-o3d-16/nerfstudio/nerfstudio/model_components/ray_samplers.py)
Anyone of you can shed some light on it? Can I use trained model from nerfstudio v0.3.2 and create a mesh with sdfstudio?
Cheers
Peter

Thanks for your answer.
My understanding is that sdfstudio uses an older version of nerfstudio to create the nerf model. Sdfstudio just comes with an additional layer to extract surfaces from nerf models.
So, you are saying that training a model with sdfstudio uses a modified version of nerfstudio? And only nerf models trained by this particular version can be used with ns-extraxt-mesh, right?

@peta-peta SDFStudio implemented many sdf-based methods such as volsdf which are designed for surface reconstruction. You need to train your own model with SDFStudio and then extract the mesh from the sdf field.

Got it! Thanks for your answer and confirming my understanding.
In the meantime I made further progress on my own and was able to use sdfstudio and extract meshes.
However, I came to the same conclusion as some other guys In this forum. Using the sdf based methods such as neus-facto. Does not yield good results. Using my own custom data with nerfacto, I get a  nicely rendered model in the viewer. I compared the results after 20k iterations.

Do I need more iterations with sdf based methods!
Do I need more gpu memory with sdf based methods? I currently have only 8 GB but I will get soon additional 24 GB.
Could I start training with non-sdf based methods and use the checkpoint of the pretrained model as initial condition for sdf based method, such as neus-facto?
people in this forum say that sdf based methods are more unstable and harder to converge. How can I investigate in a simple plot during the training if my model is converging or not?

Cheers Peter

Hi, in general SDF based methods use more iterations and are also slower and needs more GPU memory since it needs to compute the gradient for eikonal regularization and appearance network.
Yes, using a pretrained nerfacto model as initialization for SDF is a very promising idea, and I wanted to try it out but unfortunately couldn't find the time (https://github.com/autonomousvision/sdfstudio/issues/133#issuecomment-1603204173). Please let me know if you can get some good results.
For neus-facto, you could check the plots of these values https://github.com/autonomousvision/sdfstudio/blob/master/nerfstudio/models/neus.py#L117-L118. If s_val increases along the training and reaches >500, it usually indicates it converges well.

I used a pretrained model using nerfacto and used it as starting point for ns-train neus-facto:
Unfortunately, it gave me this error:
Sending ping to the viewer Bridge Server...
Successfully connected.
[NOTE] Not running eval iterations since only viewer is enabled. Use --vis wandb or --vis tensorboard to run with eval
instead.
Disabled tensorboard/wandb event writers
Setting up training dataset...
Caching all 210 images.
Setting up evaluation dataset...
Caching all 210 images.
/home/peter/.local/lib/python3.8/site-packages/torchmetrics/utilities/prints.py:61: FutureWarning: Importing `PeakSignalNoiseRatio` from `torchmetrics` was deprecated and will be removed in 2.0. Import `PeakSignalNoiseRatio` from `torchmetrics.image` instead.
  _future_warning(
Loading latest checkpoint from load_dir
Printing profiling stats, from longest to shortest duration in seconds
Traceback (most recent call last):
  File "/home/peter/anaconda3/envs/sdfstudio1/bin/ns-train", line 8, in <module>
    sys.exit(entrypoint())
  File "/home/peter/Libraries/sdfstudio/scripts/train.py", line 250, in entrypoint
    main(
  File "/home/peter/Libraries/sdfstudio/scripts/train.py", line 236, in main
    launch(
  File "/home/peter/Libraries/sdfstudio/scripts/train.py", line 175, in launch
    main_func(local_rank=0, world_size=world_size, config=config)
  File "/home/peter/Libraries/sdfstudio/scripts/train.py", line 89, in train_loop
    trainer.setup()
  File "/home/peter/Libraries/sdfstudio/nerfstudio/engine/trainer.py", line 120, in setup
    self._load_checkpoint()
  File "/home/peter/Libraries/sdfstudio/nerfstudio/engine/trainer.py", line 268, in _load_checkpoint
    self.pipeline.load_pipeline(loaded_state["pipeline"])
  File "/home/peter/Libraries/sdfstudio/nerfstudio/pipelines/base_pipeline.py", line 439, in load_pipeline
    self.load_state_dict(state)  # type: ignore
  File "/home/peter/anaconda3/envs/sdfstudio1/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1604, in load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for VanillaPipeline:
	Missing key(s) in state_dict: "_model.field_background", "_model.field.encoding.params", "_model.field.glin0.bias", "_model.field.glin0.weight_g", "_model.field.glin0.weight_v", "_model.field.glin1.bias", "_model.field.glin1.weight_g", "_model.field.glin1.weight_v", "_model.field.glin2.bias", "_model.field.glin2.weight_g", "_model.field.glin2.weight_v", "_model.field.laplace_density.beta_min", "_model.field.laplace_density.beta", "_model.field.deviation_network.variance", "_model.field.clin0.bias", "_model.field.clin0.weight_g", "_model.field.clin0.weight_v", "_model.field.clin1.bias", "_model.field.clin1.weight_g", "_model.field.clin1.weight_v", "_model.field.clin2.bias", "_model.field.clin2.weight_g", "_model.field.clin2.weight_v".
	Unexpected key(s) in state_dict: "datamanager.train_camera_optimizer.pose_adjustment", "datamanager.train_ray_generator.pose_optimizer.pose_adjustment", "datamanager.eval_ray_generator.pose_optimizer.pose_adjustment", "_model.field.mlp_base.params", "_model.field.mlp_head.params", "_model.field.position_encoding.params", "_model.field.direction_encoding.params".


Support for markdown would be nice.

There's already support for markdown.

Hi,
I don't think that markdown is really supported. We do have some colors but it's most likely that it inherits some rules from another file type.

I just tried with ccat README.md file.
Is there any way we might help you with that synthax?
I'm using ccat v1.1.0


[Backfill corrections] Publish files in export dir

Description
Makefile publish target was check for output files and publishing to AWS from the input directory. Change to use the export directory.
Changelog

Makefile

@krivard this is ready to merge.


Update during PR

hey, I am trying to generate / update a yaml file as part of the on: pull_request workflow we have.
just no matter what I try I get the following:
failed to create PR: Error: could not parse file with path ...
even tho createPR is false
commitChange: true
    branch: bump-test
    noCompatMode: false
    quotingType: '
    force: false
    masterBranchName: master
    targetBranch: master
    githubAPI: https://api.github.com
    createPR: false
    updateFile: false
    labels: yaml-updates
    token: ***
    repository: testrepo
    workDir: .
    commitUserName: github-actions[bot]
    commitUserEmail<EMAIL_ADDRESS>
I gave the following permissions to the workflow just to exclude that.
permissions:
  checks: write
  contents: write
  pull-requests: write

any good tips or hints?

this error means that the file you referencing does not exist in the file system. So you are sure that you checkout the correct branch and have the file you want to change on your filesystem under the expected path.

Yeah I know it doesn't exist I am trying to create it ;)
just so this:
https://github.com/fjogeleit/yaml-update-action/blob/main/action.yml#L25
so need to specify a method I guess. Did not check what the default was.

hm not sure if I understand correctly, this action will not create the YAML file. It will only modify an existing one.

Then I misunderstood the "method" makes sense now! I will "touch" a file before the action to solve that! thnx


Can't Upload Hello World

Uploads are disabled. Please grant access. Thanks!

looking now.

Do we need a facilitator code to get started?

Sorry I spoke too soon. I just got the Hello World! program to work.

Great!! I think its a good start to our project.
Thanks,
Rahul JC.
On Sun, Jul 2, 2017 at 6:17 PM, caretnavigator<EMAIL_ADDRESS>wrote:

Sorry I spoke too soon. I just got the Hello World! program to work.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/empug/road-quality-project/issues/3#issuecomment-312520414,
or mute the thread
https://github.com/notifications/unsubscribe-auth/APwT7uzJFkzzc48OPQF4v13vQeTvErAvks5sKBcUgaJpZM4OLl77
.

Closing as pull requests were reviewed. additional info found: https://help.github.com/articles/creating-a-pull-request/


Request Onboarding to OSC Data Commons

Requesting onboarding for github user: @romeokienzler
Request access to github team: odh-env-users
View teams here: https://github.com/orgs/os-climate/teams
Onboarding resources:

Data Commons environment setup
credentials.env file

Onboarding checklist:

[x] new user invited to os-climate github org
[x] user invited to requested teams

Sent invite to org and related teams.  Adding @erikerlandson to send credentials

@erikerlandson can this be closed


[SVC-2483] Remove hardcoded uses of rivet.gg

Examples:

SendGrid
Turnstile
Support emails

From SyncLinear.com | SVC-2483

Out of sync with Linear


ModuleNotFoundError: No module named 'Crypto'

I just downloaded the program from pip and tried to run it but it doesn't work and just gives me this error:
Traceback (most recent call last):
File "c:\program files\python39\lib\runpy.py", line 197, in _run_module_as_main
return run_code(code, main_globals, None,
File "c:\program files\python39\lib\runpy.py", line 87, in run_code
exec(code, run_globals)
File "C:\Users\smell\AYqLYyvet1JRpfow927XUoPtmgataMC5m5aLewzNYUP.exe_main.py", line 4, in
File "C:\Users\smell\AYqLnTTThKqhV4npsciGstSpAa1XdkrrBPte-packages\kobodl_init.py", line 3, in
from kobodl.app import app
File "C:\Users\smell\AYqLnTTThKqhV4npsciGstSpAa1XdkrrBPte-packages\kobodl\app.py", line 9, in
from kobodl import actions
File "C:\Users\smell\AYqLnTTThKqhV4npsciGstSpAa1XdkrrBPte-packages\kobodl\actions.py", line 8, in
from kobodl.kobo import Book, BookType, Kobo, KoboException, NotAuthenticatedException
File "C:\Users\smell\AYqLnTTThKqhV4npsciGstSpAa1XdkrrBPte-packages\kobodl\kobo.py", line 18, in
from kobodl.koboDrmRemover import KoboDrmRemover
File "C:\Users\smell\AYqLnTTThKqhV4npsciGstSpAa1XdkrrBPte-packages\kobodl\koboDrmRemover.py", line 7, in
from Crypto.Cipher import AES
ModuleNotFoundError: No module named 'Crypto'

You ignored the issue report template, so I can't help you.   For support, use the template.


Update our PostgreSQL to version 14.3

It is released on Thursday May 12th.

just curious, is this a good-first-issue?

Wort a try, could be simple.
We have a set of patches on top of Postgres, presumably all rebased on top of a fixed Postgres commit.
One updating the version, need to rebase those on top and those might even not conflict (then it's a simple task), otherwise it might get more interesting.
See https://github.com/neondatabase/neon/issues/1236 as one of the examples of such work done in the past.

I think for now, we should not try to rebase the patches. Rebasing is a lot of effort, as you need to rearrange the patches so that each patch is a logical, self-contained set of changes. For now, let's just do git merge pgsql/REL_14_3. That should indeed not be too hard.

thanks much @hlinnaka  @SomeoneToIgnore, i'd give it a shot.

@hlinnaka I think this has already been addressed here. can you confirm if i got that right?

14.4 was merged some time ago already, closing.


Adding releases

If you released a zip with all the compiled latex docs that would probably be a lot easier for someone just looking for the summaries that doesn't need to edit them

At one point I did have the PDF in the repo, but another user suggested removing them and other binary files and only tracking source files. Right now, I will periodically put the PDF files here (under links "81-page guide" and "92-page summary").
One thing I may also consider is using the releases feature on GitHub to mark certain commits that purposely include the PDFs. Do you think this would be a better approach?

I have decided to to ahead and include the PDFs as part of the repo. Although it might be an extra file that is changed with pretty much every commit, it's pretty small, and I think it's more important that people are able to get the PDF for themselves without compiling if they want. This was changed in #10 .

Nice thanks, yep I think that adding it in the Release would work too, thanks for adding this
Also I you could look at enabling github pages to host the pdf


Add support for BMP format

Hi, I needed BMP detection, so I've added some basic support for it, based on wikipedia info.
Thanks

Hi @dim! wow, old stuff I've found! What do you think? Could you merge this PR?

so, it change a bit since 2012. I'll update my PR


Cannot install via CocoaPods

I have installed CocoaPods and I added CocoaLumberjack to the Podfile. I also added #import <CocoaLumberjack/CocoaLumberjack.h>. My project compiles without errors.
After adding [DDLog addLogger:[DDASLLogger sharedInstance]], I get the following error message:
Undefined symbols for architecture x86_64:
"OBJC_CLASS$_DDASLLogger", referenced from:
objc-class-ref in vmkAppDelegate.o
"OBJC_CLASS$_DDLog", referenced from:
objc-class-ref in vmkAppDelegate.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
I've tried so many things and spent hours trying to make this work:

Re-installed CocoaPods
Tried to install CocoaLumberjack manually (did not work)

I use: Xcode 7 beta 4
Target: iOS 9

Please take a look at similar issues first.

I'm receiving the same error using Cocoapods 0.38.2, I've tried every suggestion I could find, these included:
-using an olderversion of CocoaLumberjack (I've tried 2.0 and 2.0.1)
-removing the "platform" section from the Podfile
-Manually installing (The instructions for this seem to be outdated, as files mentioned in the steps do not appear in the project)
After installing the Pod I have changed the "Build Active Architecture Only" to NO.
I have no other Pods in my Podfile, its just CocoaLumberjack.  At this point any help would be appreciated.

Guys: can you properly install other libraries via cocoapods?

2.0.3 seems to be installing fine as well as 2.1.0-beta. Feel free to reopen this otherwise.

I'm having the same error using 2.3.0. Do you have any update?

@dms90 try to delete the derived data folder.

Thanks @bpoplauschi ! It works :) 👏

Glad to hear that.


notifications for subtasks

am I missing something? We don't get notified if a subtask is assigned. I thought that's a feature already.

There are notifications for subtask modifications.

I have the challenge that if someone owns a task, then creates a subtask and assigns it to me, I don't receive the notification - because I'm not assigned to the TASK and I've only got my notification settings on for tasks I'm assigned, instead of all tasks. (I don't want an email for every task that gets modified - we have a lot of activity on our kanboards!)  As far as I can see in the settings, I can't have it configured to notify me of a new subtask assigned to me.  Is that correct?

@nztebs correct, that need to be improved.

Cool - thanks for confirming. :)  I'll watch for comments in future updates.

This issue has been closed automatically by a bot for inactivity after more than 1 year. If you still need this feature, you should consider contributing to this open-source project.


Add pyspark tpch benchmarks

Ha!  This is fun.  Is this working?

Ha! This is fun. Is this working?

Works in a notebook, adapted from Florian's. Fails now for different, unrelated reasons.

It looks like this might work now?  If so, I'll be curious to see what performance is like.  (although I appreciate that that might take more work than what's here so far)

Does indeed work; planning to do preliminary comparison to #971 on Monday. I'm sure some things will need to be changed/adjusted. :)

I believe this was the cluster https://cloud.coiled.io/clusters/281807/information?account=dask-benchmarks&tab=Code
The hardware metrics all look a little disappointing. Nothing is utilized properly. I guess the 100GB dataset is just to small to see any interesting activity. Well, memory seems to increase pretty consistently but I assume this is JAVA VM foo.

Well, memory seems to increase pretty consistently but I assume this is JAVA VM foo

At my old job, there were QA folks using some automated tools and I think I literally had to tell them at least 20 times that this pattern from the JVM didn't mean there was a memory leak. (We had JVM configured to not dealloc to OS, which I think is pretty typical config.)

Also, every time I've tried to use Spark I've missed some critical configuration parameter.  We should run this by a Spark person.  @fjetter do you have that covered or should I go hunting?

There were some setup/teardown calls being made between the runs; moved to the cluster setup and then noticed it was running too fast, which ended up being we needed to materialize the dataframe. This this cluster is more representative now: https://cloud.coiled.io/clusters/282384/information?account=dask-engineering&tab=Metrics&filterPattern=

As a side note, occasionally I'm getting the following error with the queries:

java.nio.file.AccessDeniedException: s3a://coiled-runtime-ci/tpch_scale_100/part/part.0.parquet: getFileStatus on s3a://coiled-runtime-ci/tpch_scale_100/part/part.0.parquet: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: RWF629STDDBDBT3Q

Full error
Exception: ('Long error message', , 'An error occurred while calling o36.showString.\n: org.apache.spark.SparkException: Job aborted due to stage failure: Task 49 in stage 1.0 failed 4 times, most recent failure: Lost task 49.3 in stage 1.0 (TID 63) (<IP_ADDRESS> executor 6): java.nio.file.AccessDeniedException: s3a://coiled-runtime-ci/tpch_scale_100/lineitem/part.765.parquet: getFileStatus on s3a://coiled-runtime-ci/tpch_scale_100/lineitem/part.765.parquet: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: JKG9XPAYKWF912MY; S3 Extended Request ID: vuyILTZotzrJpWUFiTd6I5GPIt4guzoNkjQ2qfxOEbJoKLVZlKWluRDd457/sPLvSqNYqNnzUXH8Mll4NR1qyg==; Proxy: null), S3 Extended Request ID: vuyILTZotzrJpWUFiTd6I5GPIt4guzoNkjQ2qfxOEbJoKLVZlKWluRDd457/sPLvSqNYqNnzUXH8Mll4NR1qyg==:403 Forbidden\n\tat org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:255)\n\tat org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:175)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3796)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3688)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getFileStatus$24(S3AFileSystem.java:3556)\n\tat org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:499)\n\tat org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDuration(IOStatisticsBinding.java:444)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2337)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2356)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:3554)\n\tat org.apache.parquet.hadoop.util.HadoopInputFile.fromPath(HadoopInputFile.java:39)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFooterReader.readFooter(ParquetFooterReader.java:39)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat.footerFileMetaData$lzycompute$1(ParquetFileFormat.scala:211)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat.footerFileMetaData$1(ParquetFileFormat.scala:210)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat.$anonfun$buildReaderWithPartitionValues$2(ParquetFileFormat.scala:213)\n\tat org.apache.spark.sql.execution.datasources.FileScanRDD$$anon$1.org$apache$spark$sql$execution$datasources$FileScanRDD$$anon$$readCurrentFile(FileScanRDD.scala:231)\n\tat org.apache.spark.sql.execution.datasources.FileScanRDD$$anon$1.nextIterator(FileScanRDD.scala:293)\n\tat org.apache.spark.sql.execution.datasources.FileScanRDD$$anon$1.hasNext(FileScanRDD.scala:125)\n\tat org.apache.spark.sql.execution.FileSourceScanExec$$anon$1.hasNext(DataSourceScanExec.scala:594)\n\tat org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.columnartorow_nextBatch_0$(Unknown Source)\n\tat org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.hashAgg_doAggregateWithKeys_0$(Unknown Source)\n\tat org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source)\n\tat org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)\n\tat org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:760)\n\tat scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:460)\n\tat org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:140)\n\tat org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)\n\tat org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:101)\n\tat org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)\n\tat org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:161)\n\tat org.apache.spark.scheduler.Task.run(Task.scala:139)\n\tat org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:554)\n\tat org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1529)\n\tat org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:557)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1623)\nCaused by: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: JKG9XPAYKWF912MY; S3 Extended Request ID: vuyILTZotzrJpWUFiTd6I5GPIt4guzoNkjQ2qfxOEbJoKLVZlKWluRDd457/sPLvSqNYqNnzUXH8Mll4NR1qyg==; Proxy: null), S3 Extended Request ID: vuyILTZotzrJpWUFiTd6I5GPIt4guzoNkjQ2qfxOEbJoKLVZlKWluRDd457/sPLvSqNYqNnzUXH8Mll4NR1qyg==\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1418)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1387)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1157)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:814)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715)\n\tat com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697)\n\tat com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:561)\n\tat com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:541)\n\tat com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5456)\n\tat com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5403)\n\tat com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1372)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getObjectMetadata$10(S3AFileSystem.java:2545)\n\tat org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:414)\n\tat org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:377)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2533)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.getObjectMetadata(S3AFileSystem.java:2513)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3776)\n\t... 34 more\n\nDriver stacktrace:\n\tat org.apache.spark.scheduler.DAGScheduler.failJobAndIndependentStages(DAGScheduler.scala:2785)\n\tat org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2(DAGScheduler.scala:2721)\n\tat org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2$adapted(DAGScheduler.scala:2720)\n\tat scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)\n\tat scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)\n\tat scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)\n\tat org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:2720)\n\tat org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1(DAGScheduler.scala:1206)\n\tat org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1$adapted(DAGScheduler.scala:1206)\n\tat scala.Option.foreach(Option.scala:407)\n\tat org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:1206)\n\tat org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2984)\n\tat org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2923)\n\tat org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2912)\n\tat org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49)\nCaused by: java.nio.file.AccessDeniedException: s3a://coiled-runtime-ci/tpch_scale_100/lineitem/part.765.parquet: getFileStatus on s3a://coiled-runtime-ci/tpch_scale_100/lineitem/part.765.parquet: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: JKG9XPAYKWF912MY; S3 Extended Request ID: vuyILTZotzrJpWUFiTd6I5GPIt4guzoNkjQ2qfxOEbJoKLVZlKWluRDd457/sPLvSqNYqNnzUXH8Mll4NR1qyg==; Proxy: null), S3 Extended Request ID: vuyILTZotzrJpWUFiTd6I5GPIt4guzoNkjQ2qfxOEbJoKLVZlKWluRDd457/sPLvSqNYqNnzUXH8Mll4NR1qyg==:403 Forbidden\n\tat org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:255)\n\tat org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:175)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3796)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3688)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$getFileStatus$24(S3AFileSystem.java:3556)\n\tat org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:499)\n\tat org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDuration(IOStatisticsBinding.java:444)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2337)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2356)\n\tat org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:3554)\n\tat org.apache.parquet.hadoop.util.HadoopInputFile.fromPath(HadoopInputFile.java:39)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFooterReader.readFooter(ParquetFooterReader.java:39)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat.footerFileMetaData$lzycompute$1(ParquetFileFormat.scala:211)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat.footerFileMetaData$1(ParquetFileFormat.scala:210)\n\tat org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat.')
/opt/coiled/env/lib/python3.10/site-packages/py4j/protocol.py:326: Exception

At my old job, there were QA folks using some automated tools and I think I literally had to tell them at least 20 times that this pattern from the JVM didn't mean there was a memory leak. (We had JVM configured to not dealloc to OS, which I think is pretty typical config.)

Thanks for confirming. That's what I thought.

Also, every time I've tried to use Spark I've missed some critical configuration parameter. We should run this by a Spark person. @fjetter do you have that covered or should I go hunting?

Yeah, wouldn't be surprised if that was the case. We're only using default.

do you have that covered or should I go hunting?

I don't have a lot of spark contacts. If you can find somebody, that'll be helpful. I'll poke Powers again but that's it on my end, unfortunately.

Maybe try Powers.  If that doesn't work I'll ask around.
On Mon, Oct 2, 2023 at 4:03 AM Florian Jetter @.***>
wrote:

At my old job, there were QA folks using some automated tools and I think
I literally had to tell them at least 20 times that this pattern from the
JVM didn't mean there was a memory leak. (We had JVM configured to not
dealloc to OS, which I think is pretty typical config.)
Thanks for confirming. That's what I thought.
Also, every time I've tried to use Spark I've missed some critical
configuration parameter. We should run this by a Spark person. @fjetter
https://github.com/fjetter do you have that covered or should I go
hunting?
Yeah, wouldn't be surprised if that was the case. We're only using default.
do you have that covered or should I go hunting?
I don't have a lot of spark contacts. If you can find somebody, that'll be
helpful. I'll poke Powers again but that's it on my end, unfortunately.
—
Reply to this email directly, view it on GitHub
https://github.com/coiled/benchmarks/pull/1027#issuecomment-1742651214,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACKZTEIWPJLN7CP3QS24J3X5J7OLANCNFSM6AAAAAA5KYHZL4
.
You are receiving this because you commented.Message ID:
@.***>

--
https://coiled.io
Matthew Rocklin CEO, Dask Maintainer

closing in favor of work done at #1044


Update split peaks

In this PR we add some comments to split_peaks

Avoid duplicate PRs: https://github.com/AxFoundation/strax/pull/269


D455  RGB data:No frames recieved on Viewer (v2.53.1/ubuntu20.04 /VMware Workstation 17 Pro)

Required Info

Camera Model
{ D400-->D455

Firmware Version
<IP_ADDRESS>

Operating System & Version
Linux ,Ubuntu20.04

Kernel Version (Linux Only)
5.15.0-57-generic

Platform
PC, VMware® Workstation 17 Pro

SDK Version
v2.53.1

Language
intel realsense viewer

Segment
RGB Camera display

Issue Description
I can't get RGB data from D455 camera in ubuntu. When the stereo Module and Motion Module are enabled separately , the data can be received and displayed normally, but an error occurs when the RGB Camera is enabled:
"No Frames Recieved!",
librealsense-2.53.1/src/proc/synthetic-stream.cpp:48 - Exception was thrown during callback: 6rscuda9alloc_devI4int2EESt10shared_ptrIT_EiEUlPS1_E_

The screenshot of the error is as follows;

I searched for existing related issues and tried the following:

Confirm the version: All the devices I use conform to the supported platforms and firmware versions indicated in v2.53.1.
Check whether the camera is damaged: when the same device uses realsense_viewer.exe in the windows system, all data are received normally;
Check the usb interface of the virtual machine: confirm that USB3.1 is selected, and USB3.2 is displayed when connecting to Viewer (there should be no problem here).

Please help me analyze where the problem may be (installation problem, VMware virtual machine problem, or something) and  how to solve it

I forgot the cuda factor, because I enabled cuda when I installed it, but my computer does not have a GPU unit, so  error occured. After disable the cuda option and reinstalling librealsense, all the data is normal.
RGB stream :No frames Received build with cuda (cuda 11.3) on ubuntu 20.04 (both l515 and d455) #9619

It's excellent to hear that you achieved a solution, @qingliuzjj - thanks very much for the update!