Is that possible to put RGBD video into aframe

Hi marek-simonik:
I working with aframe right now ,so just want to know is that possible to put RGBD video from record3d into aframe like your ar demo with three.js

Hi, I'm not sure if I understood your question correctly. The ar.html file shows how to render an RGBD mp4 video (exported by Record3D) via AFrame, using three.js. Let me know if you have any follow-up questions.

Hi Thank you for your reply，I mean render RGBD mp4 directly via aframe aframe example, not very familiar with three.js

Oh, I think I understand now. You want to use only AFrame to render the RGBD videos, without using three.js? So ideally something like this?
<a-scene>
  <a-r3d-video src="https://<some-server>/r3d-rgbd-video.mp4"></a-r3d-video>
</a-scene>

I'm not as familiar with AFrame to be able to implement this feature, and I'm afraid that even when creating such a wrapper HTML tag, three.js would still be required, because it's used to specify vertex/fragment shader that renders the point cloud using HW acceleration, which makes the whole demo playable in real-time. Moreover, AFrame uses three.js internally too.
If all you want is not to deal with three.js-related code, then you can treat the JS classes that this demo provides (e.g. Record3DVideo, OfflineVideoSource) as a library (i.e. just use its API, without worrying about the three.js-related internals). After all, the ar.html demo is quite simple: here is the relevant code — that is pretty much all you need to know to use this demo in your own project. That portion of code is similar to the following:
<a-scene vr-mode-ui="enabled:false;"
         renderer="logarithmicDepthBuffer: true;"
         embedded="true"
         aris="trackingMethod: best; sourceType: webcam;debugUIEnabled: false;">

    <a-marker-camera preset="hiro">

        <a-entity>
            <!-- This AFrame object does internally hold a Three.js point cloud
                 provided by this Record3D demo. JS is used to populate the internal 3D object
                 of this <a-entity> tag by a three.js 3D object (the point cloud):

                     let offlineVideo = new Record3DVideo(videoSource);
                     let ptCloudObj = offlineVideo.videoObject;
                     aEntity.object3D.add(ptCloudObj);

               You can then use the interface/API of Record3DVideo to play/pause the video and more.
            -->
        <a-entity>

    </a-marker-camera>

</a-scene>

First Record3D is the coolest app I've ever seen,and about the VideoSource ,What should I do if I want to use just a local videosource

Try withlet offlineVideo = new Record3DVideo(assets/myvideo.mp4);   not work

Thanks :)
The ar.html file already allows you to load a local file stored on your phone via a <input type="file"> tag (JS doesn't have direct access to the filesystem, so you can only read local files that the user explicitly grants you access to via the file upload form (that's why it's not as simple as using a string with a local file path).

Try withlet offlineVideo = new Record3DVideo(assets/myvideo.mp4); not work

Please take a closer look at the  ar.html file and you will see it demonstrates two ways how to load an mp4 video:

either via <input type="file">
or by loading a video stored on a server

The Record3DVideo class takes as a parameter one of the VideoSource classes, so you cannot directly pass a string with a video URL to it. See this excerpt.

I see， i will check the code again
I'm going to use a new Iphone, so I'm trying to import the data from the Record3D on the old Iphone to the new Iphone, but I can't find a way,So how to do that in Record3D

To transfer your 3D videos from the old iPhone to the new iPhone, you can can export all videos into the "Shareable/Internal format (.r3d)". Note that it's possible to export multiple (or all) videos at once (tap the "Edit" button in the top right corner of the Library).
An exported r3d file take about the same amount of disk space as the 3D video itself, so make sure you have enough disk space if you plan to export all 3D videos into .r3d at once. Alternatively, you can export your videos in smaller-sized batches.
Once you will have the videos exported into .r3d on your old iPhone, you can copy them to the new iPhone in several ways; here are some of the possibilities:
Via AirDrop
You can send each .r3d video manually one-by-one and once received on your new iPhone, open the .r3d file in Record3D and it will be automatically imported into the Library.
Via the Files app or File Sharing
If you have a lot of 3D videos, it might be tedious to import them one-by-one. An alternative is to use either the iOS Files app or the File Sharing feature of iTunes (if you are on Windows) / Files (if you are on macOS) to copy the .r3d file from your old iPhone and put them in the root of the "Record3D" folder (iOS Files app > [On my iPhone] > Record3D > dump all .r3d files here).
Then just open Record3D and wait until all the .r3d videos get automatically imported into the Library.
Once they will be imported, switch between the Library and Record tabs in Record3D to update the Library and check that all your videos have been imported. Once you will confirm that all videos have been successfully imported, then you can safely remove the .r3d files from the root of the Record3D folder in the Files app.
Once you remove the .r3d files via the Files app, don't forget to remove the .r3d files also from Trash in the Files app, otherwise your disk space will not be freed.

Thank you ! your are so nice.


MAC Vendors: Next to Main MR conflict

Please ensure your pull request (PR) adheres to the following guidelines:

Please refer to our contributing documentation for any questions on submitting a pull request, link: Contribution Guide

Pull Request Checklist
Please check if your PR fulfills the following requirements:

[ ] Testing of all the changes has been performed (for bug fixes / features)
[ ] The readme.html has been reviewed and added / updated if needed (for bug fixes / features)
[ ] Use the following format for the PR description: <App Name>: <PR Type> - <PR Description>
[ ] Provide release notes as part of the PR submission which describe high level points about the changes for the upcoming GA release.
[ ] Verify all checks are passing.
[ ] Do NOT use the next branch of the forked repo. Create separate feature branch for raising the PR.
[ ] Do NOT submit updates to dependencies unless it fixes an issue.

Pull Request Type
Please check the type of change your PR introduces:

[ ] New App
[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, renaming)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation
[ ] Other (please describe):

Release Notes (REQUIRED)

Provide release notes as part of the PR submission which describe high level points about the changes for the upcoming GA release.

What is the current behavior? (OPTIONAL)

Describe the current behavior that you are modifying.

What is the new behavior? (OPTIONAL)

Describe the behavior or changes that are being added by this PR.

Other information (OPTIONAL)

Any other information that is important to this PR such as screenshots of how the component looks before and after the change.

Pay close attention to (OPTIONAL)

Any specific code change or test case points which must be addressed/reviewed at the time of GA release.

Screenshots (if relevant)

Thanks for contributing!

Weird conflict

lol I thought the same thing. but based on what I've seen in other cases I'm guessing the main conflict was actually due to divergent branches (i.e. different sets of commits) with nearly the same end state. so the merge is really just creating a common commit and hence has almost no real changes


How to keep alive ?

I am going to use this package to a server base on Node.js, but this package seems to lost connection after sftp.connect(options).then().catch().
Every connection will waste a lot of network resources, right ? So I want to know how can I keep this connection alive during Node App running peroid.
Hope your responses, thank u~

can you set keepaliveInterval config with options?


win-15 low on disk space for local Temp directory.

Type of Request
bug
Infrastructure Environment
LUCI, Github, Cocoon scheduler, Autosubmit, etc...
What is happening?
win-15 low on disk space for local Temp directory.

Steps to reproduce
Step 1:
Step 2:
..
Step n:
Expected results
I expect to see X when Y is finished.

Removing old directories in c:\users\swarming\AppData\Local\Temp\ to free up disk space.


Verify process for applying config changes to LZ2

Describe the issue
We need to be certain that we understand and can execute the process successfully to apply changes  (name / policy changes for e.g.) to our LZ2 based on the AWS-provided code based and our own config file.
Which Sprint Priority is this issue related to?
The 'Milestone' should clearly list Sprint Priorities - which one is this issue related to?
Additional context
Add any other context, attachments or screenshots
Definition of done

Process documented in LZ Ops repo and process executed atleast 1 time.

Process is well documented in public SEA Github repo. Time to be scheduled with AWS technical expert to work through applying changes.

Walked through change process "live" with AWS technical expert and am confident that we can execute in our environment.


"Predictive" lock for buffers

I'm trying to use DeviceLocalBuffer in compute shader (instead of CpuAccessibleBuffer, to speed up memory access), but I need to update it every frame, so I created a few "staging" CpuAccessibleBuffer buffers with {storage_buffer: true, transfer_source: true}, and my  DeviceLocalBuffer is  {storage_buffer: true, transfer_destination: true}.
Then on each frame I'm building a command buffer, first I'm copying needed segment of a buffer from a CpuAccessibleBuffer to DeviceLocalBuffer with copy_buffer_dimensions, and then using this buffer in descriptor set of my compute pipeline. But I'm getting an error that device buffer is already GPU locked. It seesms that it happens because vulkano thinks that buffer is in "read" access by previous frame but then I'm building a new frame where I'm writing to this buffer with copy_buffer_dimensions command, so it returns me this error. Is it possible to fix this? Somehow detect that when we will start writing to the buffer, read access will expire already, because compute shader will finish until then.
self.copy_buffer_dimensions(...).unwrap() // here I'm writing to the device buffer from host buffer
    .bind_pipeline_compute(...)
    .push_constants(...)
    .bind_descriptor_sets(...)
    .dispatch(...).unwrap() // here I'm reading from device buffer in compute shader

Addressed in design proposal here: https://github.com/vulkano-rs/vulkano/issues/1914
I'm going to implement it


deprecate akash-nodes ceph pool

It looks like akash-nodes ceph pool isn't used by anything.
As I don't see any reason for it, I propose to remove it (from the docs, and provide the providers with the instructions to remove it).
@troian thoughts?
refs.
https://github.com/akash-network/support/issues/97

The akash-nodes ceph pool references have been removed from documentation.
Leaving issue open as the second piece of sending instructions to current/pre-existing providers for removal of askash-nodes pool has not been completed.

@chainzero I've created and tested the following procedure on the Hurricane provider before I'd rebuild it.
We can use it:

Deprecating akash-nodes ceph pool

Update rook-ceph-cluster.values.yml

remove akash-nodes section from cephBlockPools

The entire akash-nodes section needs to be removed, example:
  - name: akash-nodes
    spec:
      failureDomain: osd
      replicated:
        size: 2
      parameters:
        min_size: "2"
    storageClass:
      enabled: true
      name: akash-nodes
      isDefault: false
      reclaimPolicy: Delete
      allowVolumeExpansion: true
      parameters:
        # RBD image format. Defaults to "2".
        imageFormat: "2"
        # RBD image features. Available for imageFormat: "2". CSI RBD currently supports only `layering` feature.
        imageFeatures: layering
        # The secrets contain Ceph admin credentials.
        csi.storage.k8s.io/provisioner-secret-name: rook-csi-rbd-provisioner
        csi.storage.k8s.io/provisioner-secret-namespace: rook-ceph
        csi.storage.k8s.io/controller-expand-secret-name: rook-csi-rbd-provisioner
        csi.storage.k8s.io/controller-expand-secret-namespace: rook-ceph
        csi.storage.k8s.io/node-stage-secret-name: rook-csi-rbd-node
        csi.storage.k8s.io/node-stage-secret-namespace: rook-ceph
        # Specify the filesystem type of the volume. If not specified, csi-provisioner
        # will set default as `ext4`. Note that `xfs` is not recommended due to potential deadlock
        # in hyperconverged settings where the volume is mounted on the same node as the osds.
        csi.storage.k8s.io/fstype: ext4

Verify your rook-ceph version

In my case it was 1.10.11
$ helm list -A
NAME                   	NAMESPACE           	REVISION	UPDATED                                 	STATUS  	CHART                         	APP VERSION
...
rook-ceph              	rook-ceph           	3       	2023-05-04 17:31:55.487906039 +0200 CEST	deployed	rook-ceph-v1.10.11            	v1.10.11
rook-ceph-cluster      	rook-ceph           	4       	2023-05-04 13:21:00.196318672 +0200 CEST	deployed	rook-ceph-cluster-v1.10.11    	v1.10.11

Apply the new config

Apply the new rook-ceph-cluster.values.yml config file you have removed the akash-nodes	section from cephBlockPools:

Make sure to specify the same ceph cluster version you are running! (1.10.11 in my case)

helm upgrade --create-namespace -n rook-ceph rook-ceph-cluster --set operatorNamespace=rook-ceph rook-release/rook-ceph-cluster --version 1.10.11 -f rook-ceph-cluster.values.yml

Verify the change has been applied

can see akash-nodes got deleted:

root@control-01:~# kubectl get events -A --sort-by='.metadata.creationTimestamp'
NAMESPACE   LAST SEEN   TYPE     REASON               OBJECT                      MESSAGE
rook-ceph   2m19s       Normal   Deleting             cephblockpool/akash-nodes   deleting CephBlockPool "rook-ceph/akash-nodes"
rook-ceph   2m19s       Normal   ReconcileStarted     cephblockpool/akash-nodes   starting blockpool deletion
rook-ceph   2m11s       Normal   ReconcileSucceeded   cephblockpool/akash-nodes   successfully configured CephBlockPool "rook-ceph/akash-nodes"
rook-ceph   2m11s       Normal   ReconcileSucceeded   cephblockpool/akash-nodes   successfully removed finalizer
rook-ceph   2m11s       Normal   ReconcileSucceeded   cephblockpool/akash-nodes   successfully configured CephBlockPool "rook-ceph/akash-nodes"

can see akash-nodes is not present anymore:

root@control-01:~# kubectl -n rook-ceph get cephblockpool
NAME                PHASE
akash-deployments   Ready

Verify Ceph cluster status is OK

kubectl -n rook-ceph get cephclusters
kubectl -n rook-ceph exec -i $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- ceph status

Additional rook-ceph commands you may find useful:
kubectl -n rook-ceph exec -i $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- ceph df
kubectl -n rook-ceph exec -i $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- ceph osd tree
kubectl -n rook-ceph exec -i $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- ceph osd pool autoscale-status
kubectl -n rook-ceph exec -i $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- ceph osd pool ls detail

kubectl -n rook-ceph exec -it $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- bash -c 'ceph osd pool ls | while read POOL; do echo "=== pool: $POOL ==="; rbd -p "$POOL" ls | while read VOL; do ceph osd map "$POOL" "$VOL"; done; done'

kubectl -n rook-ceph exec -i $(kubectl -n rook-ceph get pod -l "app=rook-ceph-tools" -o jsonpath='{.items[0].metadata.name}') -- ceph pg ls


Some confusion about using the ground-truth mask file of DTU.

In the training stage, I noticed that you adopted the ground-truth mask file provied by DTU to sample more rays withine valid regions. However, these ground-truth mask files can mask out most non-object regions. And this seems to introduce the Mask prior like IDR, or is there something I'm misunderstanding

Hello. This masks in the dataloader are not the ground truth masks provided by IDR.
IDR generates the masks by human annotation, in the DTU dataset, all the background parts like the table floors are masked out.
We just notice that the images of DTU have black backrgound regions (rgb=0), and these regions contribute very small errors in the total loss. Our masks just indicate the regions where rgb values are 0.
We adopt such a simple dataset prior to sample more rays in the regions with nonzero rgb values, which can help the training be faster.  Training without such masks is OK and just needs a bit more epochs.


Testing for valid ron files

It would be pretty awesome if you could provide an example as to how to test the validity of ron files with cargo test tests. With that, at least the 'tested' files can be guaranteed to be valid.
I imagine it to look something akin to this:
#[derive(Default)]
struct Point {
    x: f32,
    y: f32,
}

#[cfg(test)]
mod tests {
    #[test]
    fn load_ron_point() {

        let point: Option<Point> = load::<Point>("path/to/file.ron");
        assert_eq!(point.is_some(), true);

    }
}

And the test failing if for some reason the ron-file from the given path is no syntactically correct Point-type ron file.

Isn't this covered by decode_file example?


#221 Support Package

Fixes #221
Changes proposed in this Pull Request:

Add parsing element inside package

This doesn't parse package itself, neitheir add package info on entity

It looks good... but I've a few doubts:

::getXmlElementFromRawIndexes is just syntaxic sugar for root.packagedElement[rawObjects.rawXXXIndexes[i]], and adds more complexity in the extracted method,
::getXmlElementFromRawIndexes isn't tested,
there are no tests for objects other than classes (it looks like it works though),
and I don't get the need for var indexInfo = {index: i, path: path};.

Yes it's just to avoid code duplication
your are right, i will add test soon
Yes too, so i will add relation and enum
as before i have just the index, but now i need the path (packageElement path) to get the parent of the node element, in order to parse it after founding all element to parse.

So here is all the unit tests. Is it ok ?

I'll need time to review it all. I'll try to do it during the week-end.

thanks ;o).

After a quick review:

I've added some comments,
I get the need for indexInfo so big 👍,
I've you tried with a lot of packages? Like 10+, or even more (a hundred for instance)? I'd be curious to find out whether too deep a recursion would make Node crash -> that would introduce a need for a better algorithm or a upper-bound value,
Have you tried with cross-objects? For instance, say that you have 3 classes A, B and C. A is in no package, B in its package and C in a two-level deep package. What if I want to have a relationship (or more) between them? Or if B is an enum and is used in A and C? I know it's pretty unlikely to have these cases but I'd like to be 100% sure about this. Some users actually love to give you incredibly strange cases...

ok

ok

So it's not so complicated, it's in 2 phases:

Get the index of each element with his path. We just navigate threw the tree. It's mandatory to get all element. Yes it's recursive but it's not so complex. A ten level package produce ten level of call. I looking for max stack size info in nodejs? I found a understable (for me) on SO : "default stack size is 492 kBytes (32-bit) and 984 kBytes (64-bit)." because I don't know what contains this stack (method name, param, context, etc....). So I think a have a large gap before having a problem with recurse no ? And the recurse is directly link to the recursion 1 by 1 so it's a o(n) algorythm.
Simple loop to go threw the xml tree to go to the parent package of current parsed element. So it's a simple o(n). For this one, I think we can create a cache for large package structure. But I think we can have a large number of class, lesser a large number of package....

Yes
I tested it, and it's in the unit test. You can look the Xmi, each time I create 3 classes (1 in a package, 1 in no package,  and one in 2 level of package),, relation between 2 of them. 1 enum inside a package. So it's unitary tested for the 3 parser (modelio, genmymodel, umldesigner).

Indeed, but I've seen diagrams with a lot of packages and a lot more of classes. That's a considerable amount of data to keep in memory and node doesn't (yet?) make use the Tail Call Optimization unless you have the harmony flag and use strict mode. I'll try some things tomorrow.

In fact I not copy Xml entity. I just manipulate path to entity. So I hope it's ok in memory.
Tail call optim is an exchange from stack to memory usage. So I choose memory keep safe because i don't think we have more then 1000 level of embedeed package for exemple. See my code a do comment on it, if you see something wich need to change

any news?

Yes! I've played with the code a bit and it worked great. Just one more test to pass... and some things to fix (comments in the code).

I'll merge this PR this week-end :) Thanks a lot!


Capsule Layer (With Dynamic Routing Between Capsules) #51764

This is an implementation of capsule neural networks as described in "Dynamic Routing Between Capsules" paper (https://arxiv.org/abs/1710.09829).
I made a capsule layer, which was not originally implemented in Tensorflow, which made the developers and researchers job a bit tedious.
I have implemented fuctions given below:
1.) init : where you can do all input-independent initialization
2.) build: where you know the shapes of the input tensors and can do the rest of the initialization
3.) call: where you know the shapes of the input tensors and can do the rest of the initialization
4.) squash: an activation function discussed in the paper
5.) softmax: re-implemented softmax
6.) get_config: this function is important for storing the layer config while saving the model.
7.) compute_output_shape: This function helps in parsing the input dimension to the next layer

@Silver-Whiskey I have some memorable working experiences with CapsNet and so I'm a bit excited to see PR on that. Thanks. However, I'm still not sure whether it's fit to be part of the keras core layers because of its downside (heavily slow training for inner loop logic).
One point to mention, I think you've inspired from this caplayer implementation. I didn't inspect the complete code but I think we also need some other layers to fulfill, such as the Mask layer, PrimaryCapsule layer, etc. Please correct me if I'm missing something.

Some References:

Official
CapsNet-Tensorflow
CapsNet-Keras
CapsNet-PyTorch
Step-by-Stepy-CapsNet-PyTorch

Thanks for the PR! Capsule networks are an exciting research area. However, in this case, the layer doesn't meet our criteria for inclusion in the core Keras API: "we only add new objects that are already commonly used in the machine learning community".


Windows support for live capture

https://wiki.wireshark.org/CaptureSetup/Pipes
Maybe this mechanism could make this project to work in real time and on MS Windows. Anyway I saw this work for nRF sniffer.
https://www.nordicsemi.com/eng/Products/Bluetooth-low-energy/nRF-Sniffer

That nRF thing has it's own software and firmware.
Sure you can pipe things to wireshark on windows too. Still leaves the aiestion

Sorry didn't mean to close this issue.

The nRF Sniffer is not using any files, it is not needed. When packet arrives it is send over UART to the PC (some kind of simple serialization is used - named SLIP, wihile it is not SLIP... ). The python script running on PC is deserializing a captured packet and pushes it to named pipe.
The Wireshark is configured to read from named pipe. So you have realtime sniffing. If you wan to have file you need to save it from Wireshark.

I think this is a cool project (I am working on a similar one to detect MAC addresses in the proximity to control things).
I tried your sketch on an ESP32 and it worked quite well. But unfortunately, I got the message "Data [ Packet size limited during capture] and did not find any MAC addresses. in Wireshark.

@SensorsIot you might want to open a new issue for this. I had the same error one or two times.

# Made by @xdavidhu (github.com/xdavidhu, https://xdavidhu.me/)

import serial
import io
import os
import subprocess
import signal
import time
import win32pipe
import win32file

try:
    serialportInput = input("[?] Select a serial port (default '/dev/ttyUSB0'): ")
    if serialportInput == "":
        serialport = "/dev/ttyUSB0"
    else:
        serialport = serialportInput
except KeyboardInterrupt:
    print("\n[+] Exiting...")
    exit()

try:
    canBreak = False
    while not canBreak:
        boardRateInput = input("[?] Select a baudrate (default '115200'): ")
        if boardRateInput == "":
            boardRate = 115200
            canBreak = True
        else:
            try:
                boardRate = int(boardRateInput)
            except KeyboardInterrupt:
                print("\n[+] Exiting...")
                exit()
            except Exception as e:
                print("[!] Please enter a number!")
                continue
            canBreak = True
except KeyboardInterrupt:
    print("\n[+] Exiting...")
    exit()

canBreak = False
while not canBreak:
    try:
        ser = serial.Serial(serialport, boardRate)
        canBreak = True
    except KeyboardInterrupt:
        print("\n[+] Exiting...")
        exit()
    except:
        print("[!] Serial connection failed... Retrying...")
        time.sleep(2)
        continue

print("[+] Serial connected. Name: " + ser.name)
counter = 0
check = 0

while check == 0:
    line = ser.readline()
    if b"<<START>>" in line:
        check = 1
        print("[+] Stream started...")
    #else: print '"'+line+'"'

print("[+] Starting up wireshark...")
wireshark_cmd=['C:\Program Files\Wireshark\Wireshark.exe', r'-i\\.\pipe\wireshark','-k']
proc=subprocess.Popen(wireshark_cmd)
pipe = win32pipe.CreateNamedPipe(
    r'\\.\pipe\wireshark',
    win32pipe.PIPE_ACCESS_OUTBOUND,
    win32pipe.PIPE_TYPE_MESSAGE | win32pipe.PIPE_WAIT,
    1, 65536, 65536,
    300,
    None)

win32pipe.ConnectNamedPipe(pipe, None)

try:
    while True:
        ch = ser.read()
        win32file.WriteFile(pipe, ch)
except KeyboardInterrupt:
    print("[+] Stopping...")
    os.system("taskkill /im Wireshark.exe")

ser.close()
print("[+] Done.")

I trying to make it actually.
PS. I got a lot of "Malformed Packets"... i have set 115200 baud rate.

Could have python write to wiresharks stdin itself instead of using a file as a middle man. (Using subprocess.communicate)

Update*
p = subprocess.Popen(cmd, stdout=subprocess.PIPE, shell=True, preexec_fn=os.setsid)
By excluding the preexec_fn; was finally able to successfully stream the serial port in windows10.

p = subprocess.Popen(cmd, stdout=subprocess.PIPE, shell=True)

@spacehuhn   i'm guessing you know by know allready, but just incase anyone missed it
you can have windows support using named pipes, than you don't even need a file anymore.
wireshark can also use named pipes as a source and you use them in python as well
head on here for the "official" page on wireshark on this: https://wiki.wireshark.org/CaptureSetup/Pipes
additionally somone made a gist https://gist.github.com/ouoam/3462e73fcfc36d063ecd8f9a5ac77f12 with these changes
his gist also has a fix for the malformed packet
https://gist.github.com/ouoam/3462e73fcfc36d063ecd8f9a5ac77f12#file-esp32_pcap_serial-ino-L57
i also have some ideas how do improve this using tcmenu for filtering packets.


libc++abi.dylib: terminating with uncaught exception of type std::out_of_range: basic_string

Hello,
I have a reference sequence that is 312 bp in length(Contig_cyp.fasta). I have a bam file with merged Illumina reads mapped to the reference(Contig.bam). I have been running freebayes as below
freebayes -f Contig_cyp.fasta Contig_cyp.bam
and I continually get the following error:
libc++abi.dylib: terminating with uncaught exception of type std::out_of_range: basic_string
I have been searching in the errors discussion and this was an error in 2011, but it seemed to be a bug with that version. I am running  v1.1.0. I have double checked the bam file looks okay. Does anyone else have a solution to this problem?

Contig.zip
Here is a zip file containing the fasta and the bam file.


global setting - device types are global

add an application setting, device types are global

mentioned in commit ece6b9e354a149ff1aa73d147bedcb3c406603c0

marked this issue as related to #27

added 1m of time spent

mentioned in commit 256d6e6c453f9e3d95ccb23074a24c205ee5d703


remove tracker

this reverts #23 and #24

100 16341  100    67  100 16274     51  12435  0:00:01  0:00:01 --:--:-- 12432
+resp='{"error":"Maximum workspaces limit exceeded. Limit = 5","code":400}'
+json
+echo '{"error":"Maximum' workspaces limit exceeded. Limit = '5","code":400}'
{
"error": "Maximum workspaces limit exceeded. Limit = 5",
"code": 400
}

@Tomcli can you take a look at this PR?
@scottdangelo the travis tests haven't passed in a while, i should probably disable them and look into it.


accidental commit?

I guess something went wrong and you weren't trying to do this to ase.interface.R?
Can you show me what you expect this to look like?

Oh, I thought I deleted the second return...
It should be
    X <- embed_adjacency_matrix(g, dim)$X
    return(X)

yup you fixed it

There was an (similar) error in lse.interface.R. I fixed it so change api accordingly.


Add Sui Tokenomics to Dev Portal left navigation

can we add the section for "The SUI Token"

Whoops. Sorry. Fixed here and in:
https://github.com/MystenLabs/sui/pull/2158
https://github.com/MystenLabs/sui/pull/2159


Proposal to refactor some large individual files into modules

A few of the source files within iceberg-rust are getting very large (especially manifest.rs, manifest_list.rs, schema.rs, and table_metadata.rs). Maybe it's just my taste but I find it painful to navigate when they get much over 1000 lines.
How would people feel about some PRs to turn these into module folders with nested files so that things like the serde code, builders, visitors etc can live in separate files in each subfolder, keeping the main mod.rs file focussed on the core type definitions & logic?

[...]with nested files so that things like the serde code, builders, visitors etc can live in separate files in each subfolder

I like the idea especially regarding the serde code. Other than that I think I can still navigate quite quickly with the structure we have atm.
Since a lot of features are still missing in terms of read support and a writer framework has not been implemented - I'd wait for those changes until I can reason better about a suitable structure / subfolders?
However, for the serde code I think it be appropriate to do it right now - since it's very limited in scope.

In general I prefer smaller files, but I agree with @marvinlanhenke that for we can wait for more features to land before conducting further restructure. Maybe we can start with serde part and change them one by one so that we don't have too much conflicts?
cc @Xuanwo @ZENOTME @Fokko What do you think?


Facebook Most Recent shows one page and More Posts on the bottom. More Posts button doesn't work with extension on.

The link of the button is (using social fixer as well):
https://www.facebook.com/?ref=tn_tnmn&sk=h_chr#

Thanks for this hint.
 Does this happen in combination with social fixer or does it happen without too?
Only by looking at the link, I just recognize the ref parameter (sk was never considered by this add-on). This was removed by the latest update (1.0.4) and shouldn't be considered any more, so please make sure you use that version. Furthermore check if maybe other add-ons may block this feature of Facebook.
Greetings

Uninstalled Remove Link Tracking, installed again and with Social Fixer on -with Most recent enabled on Social Fixer- the home button points to:
https://www.facebook.com/?ref=tn_tnmn&sk=h_chr&sfx_switch=true
Then if you click on More Posts, the link momentarily tries to work but doesn't
Without Social Fixer the home button points to:
https://www.facebook.com/?ref=tn_tnmn
Which works fine.
Here's the interesting bit, without Remove Link Tracking, but with Social Fixer and Most recent enabled the home button points to:
https://www.facebook.com/?ref=tn_tnmn&sk=h_chr
Which works without More Posts button on the end of first page.
Now, here's what I think happens, Social Fixer -when you enable Most recent on it- changes the Home button link from:
https://www.facebook.com/?ref=tn_tnmn
to
https://www.facebook.com/?ref=tn_tnmn&sk=h_chr&sfx_switch=true
Then the More Posts button doesn't work with Remove Link Tracking enabled, the link is:
https://www.facebook.com/?ref=tn_tnmn&sk=h_chr#
The inspector console when pressing the More Posts button says:
storage event
storage { target: Window, isTrusted: true, key: "x-storage", oldValue: "{"time":1568098141415,"key":"options"}", url: "https://www.facebook.com/?ref=tn_tnmn&sk=h_chr", storageArea: Storage, srcElement: Window, currentTarget: Window, eventPhase: 2, bubbles: false, … }
error TypeError: "json is null"
XLib moz-extension://f8356afe-1fa6-4256-9277-d2da3bd69c11/x.js:1424
json null x.js:1429:14
Load denied by X-Frame-Options: https://www.facebook.com/ajax/pagelet/generic.php/LitestandT…spin_r=1001150254&__spin_b=trunk&__spin_t=1568057441&__adt=6 does not permit framing.

Thanks for this explanation.
I was able to reproduce this error.
On the debug console it says the following thing: Load denied by X-Frame-Options: “DENY” from [...]
Just to see what parameter is involved in this issue I added Console.log(param) after the removing in the remove.js script.
The crazy thing is that with just this line added the error is gone and the posts load.
I will do some further investigations why this line fixes it.
For a short term fix I will just add this line and publish a new version.
But I will keep this issue open till I get to know whats really going on.
Greetings

Hmmm...  I was just playing around with Social Fixer 25.0 with most Recent set + RemoveLinkTracking 1.1.3 and saw the same basic behavior as this closed bug.  "More Posts" doesn't work.  It appears to try, but fails.  The "More Posts" link appears to be:
https://www.facebook.com/?sk=h_chr&sfx_switch=true#
With RemoveLinkTracking, it seems to bomb out with:
"click on A https://www.facebook.com/?sk=h_chr&sfx_switch=true# with URL "undefined" and event undefined"
Perhaps this should be a separate bug, but the outward behavior here seemed identical to my experience.

Thanks for your feedback.
Can you maybe give clear instruction for how to reproduce this error.
I tried to reproduce it, but wasn't able to. To be honest I'm not familiar with the Social Fixer Addon.
By just looking at the URLs the RemoveLinkTracking addon shouldn't intercept at all (as long as you didn't set custom keywords).
I'm going to reopen this issue till the situation is resolved.
Greetings

I just did this with a couple different browser installs now (but same Facebook account).  There were no custom keywords, no changes to RemoveLinkTracking defaults.  I could get more exhaustive if needed, but I hope this will cover enough so you can see the issue for yourself:

Install Waterfox Classic 2020.07 (on MacOS, if it matters)
Install Social Fixer 25.0 (current).
Log into Facebook.  Look for the wrench in the right hand corner.  Click on that and cllck on "Social Fixer Options"
What I use are General->Most Recent and all the "Hide ..." filters in the Filter tab, to take care of a couple serious annoyances about Facebook.  I hate Facebook, definitely not an expert on that side.
Save Changes

At this point, you shouldn't be seeing "More Posts" much or, if you do, it's very brief until it loads the next content.
Install RemoveLinkTracking, restart browser, go into Facebook and poof -- you should see "More Posts" that you can't go through, as described in the initial bug report.  Yeah, I noticed that nothing of what you filter corresponds to the links that are presented.

Ok, I was able to reproduce the issue. But only on the old design of facebook. On the new design the issue seem not to be present.
With the new logging feature of the current dev version I was able to trace down the issue to an ajax request which will be performed when click on 'More Posts'.
In this requests URL contains the URL parameter 'fb_dtsg_ag'. This parameter gets deleted by the RemoveLinkTracking addon because it starts with 'fb'.
I think a proper solution for this would be to implement a list with allowed parameters which get not removed, even when they start with one of the disallowed phrases.
Another solution would be to expand #13 to allow certain parameters on certain URLs.

Thanks!  Disabling fb as a test works, confirms we're seeing the same thing.
What are you trying to capture with fb that you don't get with, say, fbclid?
I could see FB using fb* in general for non-tracking purposes.

In #3 was suggested to consider 'fbid' as well. I don't know if this really is used primarily for tracking or for something else. But it doesn't seem to break anything when it gets removed. Maybe I just add 'fbclid' and 'fbid' to the default keywords, remove 'fb' and hopefully we're fine.

I'm trying that right now -- delete fb, added fbid.  I noticed that fbclid isn't being stripped in some cases...  not sure if related or not.  Here's an example link, and I confirmed that was the link that is run when I click on it (as distinct from copying the URL).
https://news.ycombinator.com/item?id=23911700&fbclid=IwAR0fZMPJzLe1FmG0h-t5xQn4LkgZrDR0ChCjXoaJowLy-4E-bI_GL-B8C7s

I tried the same thing and couldn't reproduce it. The 'fbclid' parameter always get removed. But if this keep on happening, consider open a separate issue for that matter.
Concerning the original problem, I am going to remove the 'fb' parameter and add 'fbid' for it in exchange.


[BUG] - Can't send file nor freeze frame on UE 5.2.1

**UE Version: **
UE 5.2.1
**Frontend Version: **
Latest version of branch UE 5.2
Problem component
Frontend, Pixel Streaming C++ plugin
Description
The 'Send File' node on UE side doesn't work like it used to do. I used it on UE 5.1 and sent images with it to the frontend and I was getting the logs Received first chunk of file X/N and the file successfully. After updating UE to 5.2.1, I made sure to use the Frontend version available on the UE 5.2 branch and realized the Send File node and the Freeze Frame node doesn't work and neither of them log on the frontend or UE (Supposedly should log through UE_LOG(LogPixelStreaming, Error, TEXT("FileHelper failed to load file data")); in case the send file fails)
I can assure I was using correct formatting for the filepath string, MIME type and extension and that the BP nodes gets executed.
Steps to Reproduce:

Make an Actor BP, add a Send File node to it, fill the inputs and drag it to the level
Launch your Signalling Web Server
See if you are receiving the file on the frontend end by checking the console tab
Nothing happens

Expected behavior

Receiving logs on the Frontend having the format : Received first chunk of file X/N
Actually receiving or downloading the file (By changing a.remove() to a.click() in FileUtils.ts)

Platform

OS: Windows 10 Home 19045.3086
Browser Microsoft Edge Version 114.0.1823.67 (Official build) (64-bit)

Hey @kaelyavel,
This is weird.
I tried to reproduce this today and didn't have the same results, both SendFile and FreezeFrame worked as expected and after the small modification, I was able to automatically download the received file.
Only thing I can think of is that the infra has somehow ended up in a bad state. If you're using git, I'd suggest doing a hard reset with a command like git reset --hard origin/UE5.2 and then running ./SignallingWebServer/platform_scripts/cmd/setup_frontend.bat --build to force the frontend to be rebuilt.
Let us know how it goes.
Cheers

Hello @Belchy06 ,
Thank you very much for answering my issue and giving me potential solutions.
I indeed did modify the frontend, more specifically the Application.ts (../ui-library) and FileUtils.ts (../library). I tried the hard reset you suggested me but it didn't solve the issue. I also cloned a new copy of the frontend and got the same issue. I did my tests on the 5.2.1 version of the Engine downloaded from the Epic Games launcher aswell as a 5.2.1 version of the Engine built from source (Because I had to switch to it to package a dedicated server) and in both Engine versions the issue remains.
Do you possibly have any other tip I could try out ? Maybe the way I'm entering my fields (path, MIME, extension) is wrong, do you have any specifications about these ? Even though when its fails to send a file, it should log on the console which it doesn't.
All my process is in this 1 minute timelapse video I captured to show you the BP aswell as the state of the frontend :  https://youtu.be/_wBOBb4HRKo
Thank you, you and all the team putting out this quality work.

https://github.com/EpicGames/PixelStreamingInfrastructure/assets/57868366/da4c9d03-6b32-4da6-bfd6-2e406875a806

Hey @kaelyavel,
I'm on mobile at the minute so can't offer thorough advice, but having a quick look at the video I think I know what's going on.
Basically, pixel streaming doesn't support play in editor. Even though you're streaming the level editor, this isn't the same as streaming that play in editor session and the underlying streamer logic is a little bit different.
Try launching the game standalone with the necessary pixel streaming args and the send file BP should work. File path, mime type and extension all look good.

It works now and I totally get it !
I was streaming the editor (Level window) to the frontend, not the actual game (Play session) and the streaming of the editor doesn't include/consider the (underlying) pixel streaming logic (SendFile/FreezeStream and others) specific to the game running.
Thank you very much @Belchy06 for being extremely responsive and best wishes to you and the team for the development.

Heya @kaelyavel,
I'm going to close this issue now that we've gotten to the bottom of what was going on.
As for your points about the file extension and default name, we currently have no plans to change the way these operate but adding some safety around checking if the user-specified extension already contains a point won't hurt.
Thank you!


set default value

set default value

@sapolang can you please properly describe your issue? provide some code snippet? Maintainers do not read one's thoughts.

@sapolang We will surely consider adding a feature, but as @vict-shevchenko  stated we need more (much more in fact) information as to what it is you are looking for.  The very vague subject doesnt give us much to go on.

I don't exactly know what the author had in his mind, but I also faced the situation, when I need to have a default value set for some of the props that I validate in case they are missing.
I imagine it to myself like this:
// model
{
  limit: 'numeric|fallback:10',
  offset: 'numeric|fallback:0',
  sorting: 'string|in:asc,desc|fallback:asc',
  filter: 'string|fallback:all',
  createdAt: `date|fallback:${new Date().toUTCString()}`
}

From the implementation perspective, because there might be some additional rules following the possible fallback rule (like for example digit:length or required), the fallback rule must be processed prior to those. Ideally, after the type is identified (string, email, numeric, date etc), because this info is enough to know how to convert the fallback value into the expected format.
So, in case of a string/number in the example above, the chain of processing would be:
limit: numeric (type identified) -> fallback (check if given, apply if not).
sorting: string -> fallback (set value as 'asc' if not given) -> in:asc,desc
If in the second case, there was something like:
{
  sorting: 'string|in:asc,desc|fallback:foo'
}

it must result with a validation error, due to the invalid in rule condition (foo is not among the asc,desc)
What if required is given?
{
  email:  'email|required|fallback:test@mail'
}

My opinion is that it should not result with an error and just apply the fallback before checking for required. Actually, such combination of required with fallback is redundant and required rule can be safely skipped.
What if a value comes in?
In case the value is given, fallback rule can be skipped. If both fallback and required rules are given and the value is provided, then both of them can be skipped during the validation logic
The name of the rule can also be changed to default or any other, if you think one is more accurate. Or you can have aliases if you support ones
I hope this made it a bit more clear. Again, I don't know what the author expected, but this is just my vision of such feature

Default values should really live in userland. What if you want to get the data back WITH the default values?   Given your examples you should probably look into present rule


not support token contain '-' ?

func Test_parse(t *testing.T) {
	//jsonStr := `{"foo-bar": "test"}`

	_, err := jp.ParseString(`foo-bar`)
	if err != nil {
		t.Error(err)
	}
}

parse error at 4 in foo-bar
foo\-bar "foo-bar" and "foo\-bar" not work too.
I found - not in tokenMap, can supported it ?

I just hit this today, it looks to be trying to parse the - as an equation.

I have quickly thrown an incomplete fix together here which passes all current tests.
It's incomplete because it doesn't cover the fact that equations/scripts may error if they have a hyphen in the key, so we'd probably need more state.

So - is also an operation for scripts so it can not be treated as a token character. You can use the bracket notation to define a path though. ["foo-bar"]

Can speak for other parsers. I know some support it but don't deal well with scripts with a minus sign or require spaces. I elected to avoid having to guess what the user intended and went with an approach with no ambiguity. So not a bug for OjG.

Dead on, thanks for the clarification.

I checked out the site and jsonpath.com does not support subtraction. OjG attempts to follow https://goessner.net/articles/JsonPath when possible.

Correction on jsonpath.com. It does support subtraction but fails if there is a - in the name.

Cool, being honest I would expect a library to mirror jsonpath.com, but this library is awesome regardless so I don't mind working around this.

There really is no standard. Goessner was first out of the gate but others have followed and filling in the gaps in different ways. Check out https://cburgmer.github.io/json-path-comparison for a comparison of the various implementations.

Okay to close?


Accessibility - Improve labels

During the audit of CC Search with Accessibility tools such as Lighthouse, we found that many of our pages don't have good labels for screen readers. That includes

Labels for inputs on forms
Aria labels and roles on elements such as buttons
The vocabulary icons are now rendered with fonts and probably don't work well with screen readers. We need to add aria labels to those too

These labels will have to be internationalized, once the i18n project is setup

All of the input and button elements are just plain HTML tags, as far as I can tell. It will just take a bit of elbow grease to add aria label to all of them, but looking into the vocabulary, it seems like creativecommons is building and migrating its website into a common reusable UI component library? In that case editing the plain HTML tags now will be a waste of effort, since they will be replaced by custom components. Personally I think using any reusable component library is superior to just plain HTML tags.


Nov23 improvements

Overall Review of Changes:

updated goss binary to 0.4.4
moved majority of audit variables to vars/audit.yml
new function to enable audit_only using remediation
removed some dupes in audit config

How has this been tested?:
Manually and audit only tested

Note: Will fail until audit merged


gpx: init at 2.5.2

Motivation for this change
I added GPX, a tool to convert Gcode to x3g files.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[] (N/A) Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[] (N/A) Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

The error seems like a problem in master; GPX is a standard autotools package with no dependencies AFAIK.

Is the new commit good?

Looks good to me. Just squash those commits.

Should I force push?

That is inevitable as squashing is destructive.

Done.

@GrahamcOfBorg eval

Checks are fixed @ryantm

@GrahamcOfBorg build gpx

Success on x86_64-linux (full log)
Attempted: gpx
Partial log (click to expand)
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2
shrinking /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2/bin/gpx
shrinking /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2/bin/machines
shrinking /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2/bin/s3gdump
strip is /nix/store/fzcs0fn6bb04m82frhlb78nc03ny3w55-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2/bin
patching script interpreter paths in /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2
checking for references to /tmp/nix-build-gpx-2.5.2.drv-0 in /nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2...
/nix/store/kvgfwq661w5x6ciszm69yi1g9srqydls-gpx-2.5.2

Success on x86_64-darwin (full log)
Attempted: gpx
Partial log (click to expand)
make[2]: Entering directory '/private/tmp/nix-build-gpx-2.5.2.drv-0/source'
make[2]: Nothing to be done for 'install-exec-am'.
make[2]: Nothing to be done for 'install-data-am'.
make[2]: Leaving directory '/private/tmp/nix-build-gpx-2.5.2.drv-0/source'
make[1]: Leaving directory '/private/tmp/nix-build-gpx-2.5.2.drv-0/source'
post-installation fixup
strip is /nix/store/vb6mgjqgd9h11nbv60fvrp1ls9nxck2y-cctools-binutils-darwin/bin/strip
stripping (with command strip and flags -S) in /nix/store/6s00h8zdhz73szm77w4wpgqi622mj6ai-gpx-2.5.2/bin
patching script interpreter paths in /nix/store/6s00h8zdhz73szm77w4wpgqi622mj6ai-gpx-2.5.2
/nix/store/6s00h8zdhz73szm77w4wpgqi622mj6ai-gpx-2.5.2

Success on aarch64-linux (full log)
Attempted: gpx
Partial log (click to expand)
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2
shrinking /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2/bin/machines
shrinking /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2/bin/s3gdump
shrinking /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2/bin/gpx
strip is /nix/store/3zq400fri5dv7d30lpxlqm2v9y1iis6j-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2/bin
patching script interpreter paths in /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2
checking for references to /build in /nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2...
/nix/store/3j4gk5k0s059a923myylj4rpfgp9gfcl-gpx-2.5.2


[GSF] Syncing Fork

This PR was automatically created using Sync Fork Chrome Extension. If there aren't any conflicts then this PR will be merged automatically else, you will need to resolve conflicts and merge manually.
If you're facing issues with this extension, please read the wiki first. If still facing an issue, report them here.
Whizzzkid

comment


OAuth permissions?

This project looks really nice - one question though, I'm assuming that it doesn't need "write" permissions just to monitor activity in my account, right?

Looks quite scary when authorising  to be honest

You're totally right, I will fix it as soon as I get off my main job, thanks!

Great, thanks!

The fix is live :)

:+1: Awesome


Working example for decoding using dbc

Hi @tsabelmann. I'm new to rust and recently found your cantools code. I currently use cantools in python to decode BLF files using dbc. I wonder if you may provide a minimal example of rust code that can do the same using your code?

Hi @pzarabadip, I am happy to hear that you want to use cantools-rs. Unfortunately, this project is not yet ready to be used extensively. However, if you want, you can contribute and implement the DBC and BLF file parsers yourself and add them to cantools-rs. So for now I suggest that to keep using the cantools python package. If I can help you with something else, feel free to reach out.

Thanks @tsabelmann for quick response. As I'm new to Rust, it might take a while to contribute but certainly it's gonna be on my radar. Cheers.


Unable to output non-latin characters in file when extracting youtube playlist titles to .txt

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that yt-dlp is broken on a supported site
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[ ] I've read about sharing account credentials and I'm willing to share it if required

Region
No response
Provide a description that is worded well enough to be understood
When exporting video titles from a playlist all non-latin characters in the .txt file are left blank.

yt-dlp -i -o "%(title)s - [%(id)s]~" --get-filename --skip-download PLAYLISTURL > titles.txt

Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[debug] Command-line config: ['-vU', '-i', '-o', '%(title)s - [%(id)s]~', '--get
-filename', '--skip-download', 'https://www.youtube.com/playlist?list=PL0docK9-g
_T5a7bOu8aelZkBm7Sg_DWgu']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out cp1252 (No VT), err
or utf-8 (No VT), screen utf-8 (No VT)
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp [c6387abc1] (win_exe
)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-8.1-6.3.9600-SP0 (OpenSSL
1.1.1k  25 Mar 2021)
[debug] exe versions: ffmpeg git-2020-05-15-b18fd2b, ffprobe git-2020-05-15-b18f
d2b
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.08.30,
 curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.
3, websockets-13.1
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1838 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releas
es/latest
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
yt-dlp is up to date<EMAIL_ADDRESS>from yt-dlp/yt-dlp)
[youtube:tab] Extracting URL: https://www.youtube.com/playlist?list=PL0docK9-g_T
5a7bOu8aelZkBm7Sg_DWgu
[youtube:tab] PL0docK9-g_T5a7bOu8aelZkBm7Sg_DWgu: Downloading webpage
[youtube:tab] PL0docK9-g_T5a7bOu8aelZkBm7Sg_DWgu: Redownloading playlist API JSO
N with unavailable videos
[download] Downloading playlist: Test links
[youtube:tab] PL0docK9-g_T5a7bOu8aelZkBm7Sg_DWgu page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (1/3)...
[youtube:tab] PL0docK9-g_T5a7bOu8aelZkBm7Sg_DWgu page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (2/3)...
[youtube:tab] PL0docK9-g_T5a7bOu8aelZkBm7Sg_DWgu page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (3/3)...
[youtube:tab] PL0docK9-g_T5a7bOu8aelZkBm7Sg_DWgu page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Giving up after 3 retries
[youtube:tab] Playlist Test links: Downloading 4 items of 4
[download] Downloading item 1 of 4
[youtube] Extracting URL: https://www.youtube.com/watch?v=ApfKv8Kx4oI
[youtube] ApfKv8Kx4oI: Downloading webpage
[youtube] ApfKv8Kx4oI: Downloading ios player API JSON
[youtube] ApfKv8Kx4oI: Downloading web creator player API JSON
[debug] Loading youtube-nsig.96d06116 from cache
[debug] [youtube] Decrypted nsig 7bBrUpFJpdeC13Qmna => FBtRG7liMB8mzg
[youtube] ApfKv8Kx4oI: Downloading m3u8 information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec
:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source
, vcodec:vp9.2(10), channels, acodec, lang, proto, size, br, asr, vext, aext, ha
saud, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] ApfKv8Kx4oI: Downloading 1 format(s): 616+251
[download] Downloading item 2 of 4
[youtube] Extracting URL: https://www.youtube.com/watch?v=HG8n_03IHh0
[youtube] HG8n_03IHh0: Downloading webpage
[youtube] HG8n_03IHh0: Downloading ios player API JSON
[youtube] HG8n_03IHh0: Downloading web creator player API JSON
[debug] [youtube] Extracting signature function js_96d06116_109
[debug] Loading youtube-sigfuncs.js_96d06116_109 from cache
[debug] Loading youtube-nsig.96d06116 from cache
[debug] [youtube] Decrypted nsig BfBLjlmuwjmuzCetu5 => 48Tn8e6_hZKUbg
[youtube] HG8n_03IHh0: Downloading m3u8 information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec
:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source
, vcodec:vp9.2(10), channels, acodec, lang, proto, size, br, asr, vext, aext, ha
saud, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] HG8n_03IHh0: Downloading 1 format(s): 313+251
[download] Downloading item 3 of 4
[youtube] Extracting URL: https://www.youtube.com/watch?v=eXci8B6Oh7A
[youtube] eXci8B6Oh7A: Downloading webpage
[youtube] eXci8B6Oh7A: Downloading ios player API JSON
[youtube] eXci8B6Oh7A: Downloading web creator player API JSON
[debug] Loading youtube-nsig.96d06116 from cache
[debug] [youtube] Decrypted nsig MRLUQ8ui2fZ05GYokJ => BcBVjMW7zxaYYA
[youtube] eXci8B6Oh7A: Downloading m3u8 information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec
:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source
, vcodec:vp9.2(10), channels, acodec, lang, proto, size, br, asr, vext, aext, ha
saud, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] eXci8B6Oh7A: Downloading 1 format(s): 616+251
[download] Downloading item 4 of 4
[youtube] Extracting URL: https://www.youtube.com/watch?v=D4e4v3oBUGQ
[youtube] D4e4v3oBUGQ: Downloading webpage
[youtube] D4e4v3oBUGQ: Downloading ios player API JSON
[youtube] D4e4v3oBUGQ: Downloading web creator player API JSON
[debug] Loading youtube-nsig.96d06116 from cache
[debug] [youtube] Decrypted nsig svpqqA_EfiFunMtONc => bi6b_ZgEpWjkjQ
[debug] Loading youtube-nsig.96d06116 from cache
[debug] [youtube] Decrypted nsig -fQUEGHgCPKfxrCTAk => pZflxkUkhnBWig
[youtube] D4e4v3oBUGQ: Downloading m3u8 information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec
:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source
, vcodec:vp9.2(10), channels, acodec, lang, proto, size, br, asr, vext, aext, ha
saud, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] D4e4v3oBUGQ: Downloading 1 format(s): 137+140
[download] Finished downloading playlist: Test links

this seems like an issue with your shell/system

In OP's log, the command is generating filenames, not titles. Although the FS encoding is UTF-8, some filename sanitisation may be applied. Then the stdout encoding is Windows CP1252.
OP could try --print title instead of -o ... --get-filename (old-style --get-title) and set Windows command-line to use UTF-8.

Success! Also swapped the font to lucida console so characters to be copied properly.

yt-dlp -i --print title --print id --skip-download "PLAYLISTURL"


Insane lag when editing Fennel in Markdown code blocks

For some reason, editing Fennel embedded in a Markdown code block produces large amounts of lag.

I don't quite know what causes this, but I can say that it gets worse quickly.

Hey there, would you be able to elaborate a bit here? I can't reproduce this at all.

I would guess your autocomplete is running, failing and consuming a lot of CPU, but that's a wild guess. Any plugins you're using to do this would be useful for reproduction. Thanks!

If you could try turning off Conjure's completion etc (see the :help files) and see if the problem goes away, that'd be really good! And if you're using tree sitter, you can enable the experimental treesitter form extraction code, again, in :help conjure if you have a grep for treesitter.

Oh I assumed this was Conjure, if you're only using Aniseed then I don't see how this would make a difference, Aniseed has no interactive components whatsoever, so I doubt it's Aniseed at all in that case.

Unfortunately,  disabling Aniseed appears to fix the problem, as does switching into Clojure mode. I presume that Aniseed tries to load something more than just syntax highlighting when embedded in Markdown, causing lag on failure.

I can't reproduce this at all though, if I have a code block in markdown it's just unhighlighted code, so I presume you have a plugin to enable sub-language support in buffers? That leans on TreeSitter somehow?
I'm afraid I won't be able to reproduce this until I can reproduce the exact setup you're using. I would imagine it's to do with how your language-in-language thing is implemented but I can't be sure.
Maybe disabling omnicompletion support will help?
let g:conjure#completion#omnifunc = v:null

Ok, forgot I had Polyglot providing Markdown support. If vim-markdown is installed and the following is set, the issue should occur.
(set nvim.g.markdown_fenced_languages  [ "fennel" ])

Hmm, huge guess but is this issue related perhaps? https://github.com/plasticboy/vim-markdown/issues/162 they mention setting let g:vim_markdown_folding_disabled = 1 (presumably at startup before you enter the markdown buffer)
Does that magically fix the issue?

Unfortunately not.

I think this is related to the mentioned Conjure issue, it's really something to do with readline being installed alongside fennel and running the REPL in a headless environment. I'm not sure why, but I've set the recommended TERM=dumb environment variable on the develop branch of Conjure now.
Updating to that should fix your problem since it seems like you were running into the exact same thing. If this is no longer an issue for you due to it being fixed or not using the tooling any more please feel free to close it. Thanks!

I'm going to close this assuming that my recent work fixed it and it wasn't to do with markdown, but readline slowing things down for some unknown reason.


Implement functionality to chose the alternative comment style

This somewhat fixes Issue #145.
I have no experience in VimL whatsoever, but this seems to be the proper way to respect the NERD_<filetype>_alt_style feature.
If you agree that this is a valid fix, I'd have no problem creating another commit that updates the documentation.

:+1: Thanks, works fine.

I have a problem with using this version with split windows.
I have set let g:NERD_erlang_alt_style=1  in my .vimrc. When I now split my window with an erlang file open using CTRL-w s and open a file in another language (e.g. my .vimrc) in that buffer, and then switch back to the erlang file using CTRL-w w and use <LEADER>c<space> to comment out a line it uses the normal comment style again and not the alternate one. Note then I don't have this problem when I simply click on the erlang buffer to switch back to it in MacVim.

I actually have the same problem by switching between LaTeX and Haskell. Since I almost exclusively use the alternative delimiters and I don't want to spend more time on this, this pull request will probably remain kind of broken.

Thanks for taking the time to contribute @seap! I've recently been added as a maintainer on this project and have been going through the backlog of  issues and contributions. I'd really like to see this included as quite a number of people have noted that it doesn't work as documented.
In looking through this it looks like there are a few issues that need to be touched up before it's ready for prime time. Notably the state of regular vs. alternate delimiters should probably be stored in a buffer specific variable (b:... instead of the global g:...) so that it doesn't get messed up while switching panes, tabs, etc. Are you around at all and are you interested in patching this up?

Feel free to adjust and use this patch in an way you like. I am not using this plugin anymore and I don't like commiting untested code.


OIDC4VC settings : add switch for OIDC4VCI draft

This is the protocole standard release for OIDC4VCI
OIDC4VCI
Protocole standard release
Draft 11
Draft 13
by default Draft 11

the draft 11 supports a diffrent implementattion of the deffered endpoint request

see wording ticket


feat: Intercom Read conversations via Search

#1079  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Cobalt0s and the rest of your teammates on  Graphite


how to download for windows

how do i download for windows?

how do i download for windows?

SMH 🤦
@SoulFire2879 If you ever looked at the code (which I'm sure you didn't), you would find out that it's coded in HTML, not Python. It's not executable XD


Add more metadata to load info: Row counts, and any easily available statistics

Background
We want to easily monitor row counts without counting from tables, and maybe even do a row count based anomaly analysis. If there are more stats we can show without adding collection overhead, let's add them
Tasks
This is low hanging fruit task

[ ] use the NormalizeInfo tuple to hold dictionaries of tables with processed items

[ ] in normalize.py gather all item counts - they are actually there and returned to main process

[ ] expose NormalizeInfo in the same way we expose LoadInfo from load.py

[ ] make sure that asdict and asstr are nicely implemented.

[ ] the purpose of asdict is to create a nice table that can be loaded with dlt when we load trace.

[ ] we need a way to expose it. currently we just expose LoadInfo from run command. the rest goes via trace. see below

Tests and Docs

[ ] check the counts in tests/normalize. make sure that asdict and asstr work

[ ] make sure correct counters are returned by adding checks to existing tests in tests/pipeline and tests/load/pipeines

[ ] make sure that count of 0 is returned in test_replace_table_clearing and other tests in this file (those truncate tables)

[ ] you must update running.md where we explain how to get LoadInfo and how to save trace. do a nice writeup on NormalizeInfo and counters

How to expose NormalizeInfo
normalize method returns it but we want to have access in run
luckily NormalizeInfo is already saved by pipeline trace which you obtain as
pipeline.last_trace

as PipelineTrace. please add last_load_info, last_normalize_info and last_extract_info. those methods will look for a trace step and get the required info out of it. this needs to be documented

@adrianbr you could get those counts before they are loaded. no mechanism or that yet, except executing extract/normalize/load one byone


Enable Cypress test coverage

Overview
We would like to know how much of our code is covered by Cypress tests. We don't need this to be part of the CI flow but to run with a command locally. Ideally we would run yarn cypress:cov and we would receive a stat for how much code our E2E tests cover.
Action Items

[ ] Research into how to set up Cypress test coverage.
[ ] Its likely you will need to install cypress/code-coverage plugin

[ ] Make changes to enable code coverage stats
[ ] Commit/ PR and assign @eleanorreem or @annarhughes  as reviewers

Resources/Instructions
Cypress test coverage docs

Hello! I would like to pick this up! Thank you :)

I raised a PR but having a few issues with the code coverage actually being generated. I have added the errors I am getting to the PR and I am really not sure what else I am missing to get this to work. Please have a look when you get a chance, thanks!


Tests failing

I have run the generic tests added at the end of the tutorial but running into two errors:

TypeError: get_asset_price() missing 1 required positional argument: 'price_feed_address'
AssertionError: assert <Transaction '0x8e8f349d64678a12ce68eee1fe48cc3fcd16ef8392513b5d95cd804b9c2946dd'> is True
tests\test_aave_borrow.py:33: AssertionError

Try cloning from scratch and running again. I just ran the tests and they worked great over here.
git clone https://github.com/PatrickAlphaC/aave_brownie_py
cd aave_brownie_py
brownie test

Closing for now, feel free to follow up


Query not working

If you copy and paste the query into the advanced editor and try and run it, it says Semantic error
Error message
'where' operator: Failed to resolve table or column expression named 'EmailPostDeliveryEvents'
How to resolve
Fix semantic errors in your query

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0df69e1b-b972-1c13-3ad0-cfdc23cdc51f
Version Independent ID: 11704756-a7bc-919d-1b1a-6b87c8f483ca
Content: Microsoft Defender for Office 365 in Microsoft 365 Defender
Content Source: microsoft-365/security/defender/microsoft-365-security-center-mdo.md
Product: m365-security
Technology: m365d
GitHub Login: @MSFTTracyP
Microsoft Alias: tracyp

@RichardSwart Thank you for your feedback. I was able to test the query and it seems to be working fine.

This could be more of an issue for your tenant, The best way to get your issue resolved is to contact Microsoft Support. If you’re a Microsoft 365 or Office 365 admin, use the information that’s provided at Get support.
Hope this helps!
Thanks
Sri

@msbemba Thank you very much for the contribution and sharing this explanation. @RichardSwart Hope this comment is helpful for you. If you see a documentation update is required, please feel free to open an issue for the same. We proceed here to close it. Thanks for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.


How to deploy Add-in on Azure When you are invited from someone and how

I don't know How can I Publish my Add-in if someone invited me and gave some permisions. how can I Publish my add-in?

After Accepting Invitation I have this view on Azure

Hi @junaid042,
Have you followed the instructions for deploying from Visual Studio Code or deploying from Visual Studio?
Beyond that, this sounds like it might be an issue with the Azure permissions in your account. I'm not sure what you mean by someone "invited" you. Could you please clarify?


Adding linter image build

Adding linter image build

What type of PR is this?

Uncomment only one  /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:
/kind bug
/kind cleanup
/kind design
/kind documentation
/kind failing-test

/kind feature

/kind flake

What this PR does / why we need it:
Adding linter image build
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

/approve

/lgtm

/lgtm


The definition of rs2_frame

Required Info

Camera Model
D455

Firmware Version
<IP_ADDRESS>

Operating System & Version
Ubuntu 18.04.3

Kernel Version (Linux Only)
5.4.0-48-generic

Platform
PC

SDK Version
2.36.0

Language
C/python

Segment
Robot

Issue Description
I'm trying to get a bit more understanding of the code of librealsense, digging into the definition of rs2::frame in rs_frame.hpp. It contains a pointer to rs2_frame.
However, the only thing defining rs2_frame I can find is in rs_types.h:
typedef struct rs2_frame rs2_frame;
which doesn't actually define the data structure.
How is rs2_frame defined ?
PS: The background of this question is that, I'm trying to see if it's possible to convert cv::Mat to rs2::frame, so I could use some functions from librealsense to process cv::Mat data.
Thanks in advance !

Hi @zc08   A diagram of the structure of rs2_frame can be found here:
http://docs.ros.org/en/kinetic/api/librealsense2/html/classrs2_1_1frame.html
There is a detailed discussion about converting cv::mat to rs2::frame in the link below.
https://github.com/IntelRealSense/librealsense/issues/2634

Hi @zc08   A diagram of the structure of rs2_frame can be found here:
http://docs.ros.org/en/kinetic/api/librealsense2/html/classrs2_1_1frame.html
There is a detailed discussion about converting cv::mat to rs2::frame in the link below.
https://github.com/IntelRealSense/librealsense/issues/2634

Hi @zc08   Do you require further assistance with this case, please?   Thanks!

Hi @zc08   Do you require further assistance with this case, please?   Thanks!

Case closed due to no further comments received.

You have linked documentation to the rs2::frame OBJECT but OP, and now I, are asking about the struct rs2_frame found here

Thanks very much @ShaneKosieradzki for your clarification and link.  What information are you seeking about struct rs2_frame please?

Hello @MartyG-RealSense thank you for your quick reply,
I would like to know the definition of the struct rs2_frame which seems to be the fundamental struct to work with the C-API. This struct does not have any definition within the codebase and I would rather not decompile the .lib to find the definition.
For context we are security researcher studying encryption of low-level devices. We would like to take the point data contained in a struct rs2_frame and encrypt it. However in order to do so we need to be able to write our encrypted data to the appropriate object, which seems struct rs2_frame.
Any advice or help you have in this matter would be greatly appreciated.

We have been using get_data as well as get_vertices to extract the data. We have two issues with this

The distinction between get_data and get_vertices is not as clear as it could be. get_data returns a void* so it seems like the raw data, and get_vertices returns a vertex*. I am not sure if these are pointing to the same memory location and just using different types to interpret the data, but that is my intuition. Is that correct?

After we extract and encrypt the data we have no way of putting the encrypted data back into a frame object. We believe that rs2_frame is the object we need to load our encrypted data back into a frame.

Further research found that the SDK file unit_tests_common.h may be a useful reference for struct information, especially the internal_frame_additional_data struct linked to below.
https://github.com/IntelRealSense/librealsense/blob/master/unit-tests/unit-tests-common.h#L510
In regard to your questions:

A distrinction that can be made between get_data and get_vertices is that get_vertices is typically used to retrieve stream values, such as point cloud coordinates, that have been stored as vertices so that they can be accessed as individual XYZ coordinates.  A Python code snippet below shows an example of get_data and get_vertices being used in the same code block.

An example use of get_data would be to obtain the raw 16-bit depth value (uint16_t) and multiply it by the camera's depth unit scale (usually 0.001 by default on 400 Series cameras) to obtain the real-world distance in meters, as demonstrated in https://github.com/IntelRealSense/librealsense/issues/8150#issuecomment-759344866 - for example, a uintvalue of 65535 x 0.001 would give 65.535 meters in real-world distance.

The RealSense SDK offers the ability to create your own custom frameset for data instead of using the SDK's frameset.    Information about doing this in C++ can be found at https://github.com/IntelRealSense/librealsense/issues/5847


Duplication in docs

On the contribute models page we have a Tutorial section while also having a separate "Tutorials" page.

https://bioimage.io/docs/#/contribute_models/README?id=tutorial


mac-fdisk & pdisk: init

Description of changes
Init mac-fdisk & pdisk, tools for handling the Apple Partition Map (APM) disk partitioning format.
The original upstream for mac-fdisk seems lost to time. I think it was accessible on ftp://ftp.mklinux.apple.com/pub/Other_Tools/ then prolly migrated / was mirrored on ftp://ftp.mklinux.org/pub/Other_Tools/, both of which seem dead (or at least inaccessible to me). Several other distributions are using a Debian mirror or their own mirrors / pre-modified copies. I've opted to also use the mostly-unmodified Debian mirror + a variety of patches from Adélie Linux that apply common patches, introduce wider platform support (for example x86_64), fix compilation on modern systems (missing includes, migrations to strerror). For this reason, I'm also using their CVS as that package's homepage.
pdisk is an Apple-maintained evolution of the original tool. It comes with a slightly different set of additions compared to mac-fdisk, does some of the same modernisations as all of the mac-fdisk patches and updates the platform support from Mac OS to OS X / macOS. Some new files are licensed under APSL-1.0, I can add an entry for it to lib.licenses if that would be better. I have currently marked it as free, but I'm not sure what our guidelines for this are though:

Distributions seem to carry either mac-fdisk or pdisk. I haven't had to do any disk modifications with either of them so just to be safe, I've added both. I've built both cross & natively for ppc64 and they can both read my disk partitions.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[x] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
Just listing disk partitions, no modifications to them yet.
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/1265


Support Android

can build, but can not run

Just need to set up Android with the Flutter Rust Bridge here https://cjycode.com/flutter_rust_bridge/library/platform_setup/android.html

@lyledean1 I have limited experience with rust, and a little with C. If you can help me figure out the cmake part from https://cjycode.com/flutter_rust_bridge/library/platform_setup/android.html. I just might be able to do get this working on android.

Thanks @hussain-mustafa990 , that link is for setting up a library. For Android basically need to:

Configure NDK via cargo-ndk
Rewrite code so it can handle iOS specific code in Rust

So a bit more involved that I first thought, started on this so will finish when I get time

@lyledean1 Any updates on this?

Any updates on the android version? re: "Rewrite code so it can handle iOS specific code in Rust", I do not know Rust unfortunately, but happy to help push this forward if possible.

Here is a java library that might make it easier: https://github.com/GiviMAD/whisper-jni
Also if you just need language -> language conversion, ChatGPT should be able to help out a lot.

Thanks for your response. After digging around, I found whisper.cpp to be slower than whisper-tflite. Ended up using tflite.

Nice! Did you write a platform bridge for flutter or are you only using it on Android?

Sorry for the late reply. Yes, I just implemented platform messaging and it works like a charm.

Very cool - any chance you'd be willing to share the code?


Fix menu positioning

positionContainer() might calculate a wrong value for
the height of the menu. That happens when items are
dynamically added / removed beforeOpen and not on startup.
The previously used lineHeight is only calculated initially.
getMenuEntriesLength() returns the total amount of menu items.
This includes subitems which are not relevant for the height
of the contextmenu.
#242

linked to https://github.com/jonataswalker/ol-contextmenu/issues/240 ?

This will only improve the y-position. So I think it`s not related to #240

@hw-df I guess this is fixed here:
https://github.com/jonataswalker/ol-contextmenu/pull/247/files#diff-4fab5baaca5c14d2de62d8d2fceef376ddddcc8e9509d86cfa5643f51b89ce3dR410
Are you able to confirm?

Yes, I can confirm. Thank you very much! I'm closing this pull request.


Restructuring of the app to allow separate modules as plugins

In this way, a device can be added to the pRMT by adding an .AAR archive.

Fixes #41


Error should be handled for wrong QR code.

There should be special error message for each wrong QR code.

Show as a toast

Verified this issue on dev app v1.8.0(320)


Update Only War C

Rolls to hit now provide dropdowns for difficulty modifiers, prompting for bonuses from aim or attack range as well as final modifier dependant on other conditions, simplifies the process.
The base of the sheet now includes common weapon damage formulas for special effects such as tearing, proven, primitive and 1d5 weapons. These can be placed in the current "Damage" fields without requiring additional code.
Position of Size dropdown now more aesthetically pleasing.

Please let me know if anything further is needed to complete the merge.


Incorrect pattern matching in the type checker makes bottom provable

import prelude

data bool = false | true
caseBool (A : U) (f t : A) : bool -> A = split
 false -> f
 true  -> t
falseNeqTrue : neg (Id bool false true) =
  \(h : Id bool false true) -> subst bool (caseBool U bool N0) false true h false

data bool'
  = false'
  | true'
  | p' (bot : N0) <i> [(i=0) -> false' , (i=1) -> true']

g : bool' -> bool = split
  false' -> false
  true'  -> true
  p' bot @ i-> efq (Id bool false true) bot @ i

-- the following line shouldn't type-check, but it does
uhh : Id bool' false' true' = <i> p'{bool'} @ i
blah : Id bool false true = <i> g (uhh @ i)

bot : N0 = falseNeqTrue blah

File loaded.
> bot
Exception: look: not found "bot"

Thanks for reporting the bug!  The problem also appeared with ordinary constructors (i.e., not path constructors).  It should be fixed now. (But the error message should be improved..)


feat: Add selected state / behaviour / ui to FlexButton

Add Selected state to our previous AddToCartButton and manage UI
Refactoring to make the all button more generalist

Don't add semantics here, as are simple buttons and the Voiceover will process them as "Button - Press to Add To Card" by default.


Add deploy source change 2

…nced g3 linter.
REQUIRED: Add a summary of your PR here, typically including why the change is needed and what was changed. Include any design alternatives for discussion purposes.

Add deployment source to all published model garden notebooks with synced g3 linter.

REQUIRED: Fill out the below checklists or remove if irrelevant

If you are opening a PR for Official Notebooks under the notebooks/official folder, follow this mandatory checklist:

[ ] Use the notebook template as a starting point.
[ ] Follow the style and grammar rules outlined in the above notebook template.
[ ] Verify the notebook runs successfully in Colab since the automated tests cannot guarantee this even when it passes.
[ ] Passes all the required automated checks. You can locally test for formatting and linting with these instructions.
[ ] You have consulted with a tech writer to see if tech writer review is necessary. If so, the notebook has been reviewed by a tech writer, and they have approved it.
[ ] This notebook has been added to the CODEOWNERS file under the Official Notebooks section, pointing to the author or the author's team.
[ ] The Jupyter notebook cleans up any artifacts it has created (datasets, ML models, endpoints, etc) so as not to eat up unnecessary resources.

If you are opening a PR for Community Notebooks under the notebooks/community folder:

[ ] This notebook has been added to the CODEOWNERS file under the Community Notebooks section, pointing to the author or the author's team.
[ ] Passes all the required formatting and linting checks. You can locally test with these instructions.

If you are opening a PR for Community Content under the community-content folder:

[ ] Make sure your main Content Directory Name is descriptive, informative, and includes some of the key products and attributes of your content, so that it is differentiable from other content
[ ] The main content directory has been added to the CODEOWNERS file under the Community Content section, pointing to the author or the author's team.
[ ] Passes all the required formatting and linting checks. You can locally test with these instructions.

Muda à raiz de destino e revise seus códigos pode ser algum confronto de software


Language server doesn't find Blender modules

After the recent updates, the language server does no longer work with the custom packages in the extraPaths settings. It worked before.
Jedi engine is still working.
This might be a similar case to #462
Environment data
VS Code version: 1.30.0
Extension version (available under the Extensions sidebar): 2018.12.1
OS and version: Windows 10
Python version (& distribution if applicable, e.g. Anaconda): 2.7.14 (32-bit)
Actual behavior

Expected behavior
(Jedi works fine)

@wkema - can you show where extraPaths are pointing? In VS Code they are merged into searchPaths (appended at the end).

OK, this is then specific to Blender (changing title). I understand you are trying to author Blender related code outside of the Blender itself. How do you set extraPath exactly?

The blender folder looks like this

and my extraPaths setting is:

Actually I did another experiment by moving the bpy folder in the blender folder shown above to
C:/Python27/Lib/site-packages/
Then it works for the bpy package.

So I still think it is the problem with the path?

Can you try to move the fake_lib out of the Python27 folder?

@AlexanderSher Thanks a lot for this suggestion. It solves the problem. I moved the folder to another directory and change the extraPaths accordingly. Now it works like charm, again.
It is not a good practice to directly modify the Python folder I guess. Thank you guys so much!


Bug: Adding Maya 2022 in softwares list of a project generates an issue

Before posting a new ticket, have you looked through the documentation to find an answer?
Yes I have
Have you looked through the existing tickets to find any related issues ?
Yes I have
Author of the bug
Romain Charoy
Version
3.15.12-nightly.3
What platform you are running OpenPype on?
Linux / Centos
Current Behavior:
When attempting to add Maya 2022 in the list of softwares for the project TEST_OP_RLX_2022, a window pops up with following error :

After that Maya2022 is visible in the list, but does not appear in the action menu of the lighting task.
Expected Behavior:
We expect a fluid adding of any available software on the project, allowing to launch it as expected on the differents tasks.
What type of bug is it ?
Happens everytime with different configurations
Which project / workfile / asset / ...
TEST_OP_RLX_2022
Steps To Reproduce:
1/ in the project info window, add "maya2022" in the application list
2/ go to the lighting task in TEST_OP_RLX_2022>INSTA_sept2023>Sequences101>Shots101_0010
3/ in the action menu of the task, maya2022 is not available
Relevant log output:
No response
Additional context:
No response

Maya 2022.3 is added for the TEST_OP_RLX_2022 project. You can add it now to the wanted projects.

Maya 2022 is launching as expected, but there is no more link with OpenPype in the menus

@fixstudio-it We need the compilation of the OpenSSL 1.1.1+ to run Maya 2022 on CentOS with OpenPype please.


Environment Files

Please provide the environment you discovered this bug in.
NX workspace, analogjs app with ssr
Which area/package is the issue in?
create-analog
Description
Analogjs v0.2.30
NX v17.2.8
File replacements don't work.
I have added env files for development and production.
project.json
{
  "name": "test",
  "$schema": "../node_modules/nx/schemas/project-schema.json",
  "projectType": "application",
  "sourceRoot": "./test/src",
  "targets": {
    "build": {
      "executor": "@analogjs/platform:vite",
      "outputs": [
        "{options.outputPath}",
        "{workspaceRoot}/dist/test/.nitro",
        "{workspaceRoot}/dist/test/ssr",
        "{workspaceRoot}/dist/test/analog"
      ],
      "options": {
        "main": "test/src/main.ts",
        "configFile": "test/vite.config.ts",
        "outputPath": "dist/test/client",
        "tsConfig": "test/tsconfig.app.json"
      },
      "defaultConfiguration": "production",
      "configurations": {
        "development": {
          "mode": "development",
          "fileReplacements": [
            {
              "replace": "test/src/environments/environment.ts",
              "with": "test/src/environments/environment.development.ts"
            }
          ]
        },
        "production": {
          "sourcemap": false,
          "mode": "production"
        }
      }
    },
    "serve": {
      "executor": "@analogjs/platform:vite-dev-server",
      "defaultConfiguration": "development",
      "options": {
        "buildTarget": "test:build",
        "port": 4200
      },
      "configurations": {
        "development": {
          "buildTarget": "test:build:development",
          "hmr": true
        },
        "production": {
          "buildTarget": "test:build:production"
        }
      }
    },
    "extract-i18n": {
      "executor": "@angular-devkit/build-angular:extract-i18n",
      "options": {
        "browserTarget": "test:build"
      }
    },
    "test": {
      ...
    },
    "lint": {
      ...
    }
  },
  "tags": []
}

I run commands:
nx serve test --configuration=development
nx serve test --configuration=production

In both cases, only the production env file is loaded.
No error appeared.
I have added a pure angular app in the same NX project and file replacement work properly.
Please provide the exception or error you saw
No response
Other information
No response
I would be willing to submit a PR to fix this issue

[ ] Yes
[ ] No

ok so it seems Nx Vite uses a plugin for file replacement however when using it i'm getting an error:
 nx run test:serve:development

failed to load config from /Users/luiscastrocabrera/Projects/analog-test-replacement/test/vite.config.ts

 >  NX   (0 , import_rollup_replace_files.default) is not a function

   Pass --verbose to see the stacktrace.

So i guess i'll try to file an issue with the Nx team to see if someone can take a look.

This is resolved please give it a try, i tried in my blog and it works:
quote from Nx issue:
This was fixed by #21077, which was released in Nx v17.3. Please migrate your Nx version to at least 17.3.0 to get the fix. Note that the replaceFiles plugin is no longer a default export from that version onwards.


Abort is reported as Out Of Memory (iOS)

Describe the bug
Calls to the abort() function are reported as Out Of Memory.
Steps to reproduce

Call abort()
Restart app so that crash is reported
On bugsnag it appears as Out of Memory

Environment

Bugsnag version: 5.4.0
Unity version: 2019.4.16f1
iOS/Android/macOS/Windows/browser version: iOS 14.7.1
simulator/emulator or physical device: device
Initializing bugsnag via a Unity GameObject or in code?: Code
Player Settings:

Scripting backend (Mono or IL2CPP): IL2CPP
API compatibility level for .NET: 4.x
Stack Trace level for all error types (None/ScriptOnly/Full): ScriptOnly

Example code snippet
public void Reproduce() {
	UnityEngine.Diagnostics.Utils.ForceCrash(ForcedCrashCategory.Abort);
}

Hi @troy-lamerton - Bugsnag relies on our own heuristic to identify during app re-launch whether the previous termination of the app was an unexpected termination by the OS watchdog. We can identify several other known reasons the OS may kill the app such as device reboot, app upgrade, app hang on main thread or thermal kill.
We send an Out Of Memory error report that the app was likely terminated by the operating system while in the foreground if all other detectable causes have been ruled out. When we diagnose an OOM, we can't capture a stacktrace so generally we advise looking at breadcrumbs etc. to understand what was happening in the app in the lead up to the event.
There's some more detailed discussion on this thread which I'd recommend reading to understand this in more detail.

Can you tell us a little more about the circumstances in which you're seeing these? Are you able to reproduce the issue at will?

can reproduce every time with our large Unity app
cannot reproduce in a small Unity project

It looks like these OOM events you've linked to are coming from a test release - are these automated tests? Do you see the same issue with a production build or is this only during test runs?

I open the large app, tap button, it calls Utils.ForceCrash(ForcedCrashCategory.Abort);
Not using automated tests
Build is made on a cloud machine

If you're able to provide us with a cut down reproduction example that demonstrates the issue you're seeing that would really help us to investigate.

My cut down project does not reproduce yet. I cannot share the project which reproduces. Below I list the setup for both projects.
Which differences here might cause the misreporting? Please tell me what to try and I will make a reproduction example.
Large project - reproduces
SIGABRT is reported as Out of Memory.

bugsnag-unity v5.4.0
Xcode 12
Xcode build setting GCC_OPTIMIZATION_LEVEL O1 (Fast)
ad-hoc build installed from download link
large workspace containing cocoapods and iOS plugins

Small project - cannot reproduce
SIGABRT is reported as SIGABRT.

bugsnag-unity v5.4.0
Xcode 13
Xcode build setting GCC_OPTIMIZATION_LEVEL Os (Fastest, Smallest)
development build installed via Xcode
just a basic xcode project (no cocoapods)

Note that the "Large project" was working correctly with bugsnag-unity v4.8.6 (same build setup and settings). Both projects use Unity 2019.4.16f1.

Closing this for now as it sounds like the original reported issue isn't occurring in 5.4.0, but if you can still reproduce the issue then let us know the details and we can re-open and investigate further.


Search Rooms

How can I perform a customized room search?

I'm not sure what you mean by customized room search.
Maybe you can use rooms-list-search slot to replace the search with you own component.


RouteConfiguration guide uses outdated syntax

Version
3.0.0
Steps to reproduce
Copy and paste example from the first guide:
https://github.com/ReactTraining/react-router/blob/master/docs/guides/RouteConfiguration.md#route-configuration
Expected Behavior
Expected application to render.
Actual Behavior
Uncaught TypeError: Cannot read property 'getCurrentLocation' of undefined(…)

Fix
Add history={browserHistory} to the outer <Router> in the first example:
https://github.com/ReactTraining/react-router/blob/master/docs/guides/RouteConfiguration.md#route-configuration

It's not necessarily outdated, just simplified so we don't have to have tons of verbosity in there. Keeps things readable by reducing some cognitive load.


Cosmetic: Change prep failure message

Flowing directly into the error string without a colon is confusing,
especially if the error message itself starts with something like
"failed to..." then it reads "Prep failed due to failed to..."

/lgtm

/approve


Feature: Insights Page Visibility Action placement

Type of feature
🍕 Feature
Current behavior
90% of the total times I have created insights pages, I have hardly scrolled to the bottom of the page to make my page public

Reasons are:

I mostly don't remember there being an action to trigger between public and private pages
The action is hidden in an area that is not visible to any user that is creating a new insights page

Sometimes I end up creating a private page and having to return back to make it public after the creation
Suggested solution
My suggestion is we move the page visibility toggle action into the below view area

This way users get to see this action while selecting and creating new insights without having to scroll
cc: @bdougie and @brandonroberts Thoughts on this?
Additional context
We might also want to consider having a short description of what making a page public or private means to your insights
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Contributing Docs

[X] I agree to follow this project's Contribution Docs

Great stuff @OgDev-01
In addition to this though, and with mobile usage experience in mind, It's imperative to place all form fields above/before the form action/submit button.
Repositioning the "Page Visibility" to sit below the "Added Repository" box, will send it even further down on mobile, hence transferring our concerns to mobile, even though it wasn't a worry with the current set-up.

For this reason, I would suggest that the "Page Visibility" is positioned above the "Added Repository" box due to the fact that it's where the form action/submit button resides.
That way it persists its position above the "Added Repository" box on mobile.
What do you think??