add more statistical transformations

In branch specify-layered-grammar a protocol for statistical transformations is defined (method statistical-transformation and a protocol class ).
All statistical transformations (except of  and  which is a fallback) should be defined in Source/statistical-transformations.lisp -- task requires looking at ggplot2 and picking the most useful ones at first with their parameters, implementing the transformations and adding tests and documentation for them - used aesthetics, added columns / rows or however they modify a data frame.
It is worth to think about a convention for naming new columns. If any problems with the protocol it may be changed to mitigate them.

Should I create a new pull request with this, or do you want me to add it to the existing pull request 2?
I looked through ggplot2 and took some notes on the various transformations, and prioritized them (simple a-b-c org-mode priorities). The line between geom/layer/stat seems kind of blurry. I created a doc-statistical-transformations.org file with my notes, intending on slowly turning it into the actual documentation. I can upload it, or just keep it here until it is finished.

answering the first question: please push directly to a branch associated with existing pull request. I won't change history until we have all done, then we will rearrange commits (when all is in place). for that reason please keep commits local to one file (i.e do not commit changes to both lisp and org file or to two different lisp files in one go - that will make juggling with commits harder)
please include org file in doc
I agree that we should have a specification, some things will come up while implementing but the goal is to have a documentation, a protocol and an implementaiton
note that aest may be part of stat, but also geom may have its own mappings (and other objects too I suppose), so naming the reader for all simply %aest or aesthetics or mapping (or the constructor make-aest) may be better so there is a single function to probe aest from the object
class name conflict is a problem. otoh it would be nice to not prefix them with the superclass name. I need to think about it more. one mundane solution I can think of is:
(defvar <bin> '<bin>)
(defun geom (type &rest args)
  (case type
    (<bin> (apply <geom-bin> args))
    (otherwise (apply type args)))

and other conflicting names resolved in this spirit. that way we could benefit from the fact that we construct objects with appropriate functions (eitehr geom, stat or something else).

I've been working on the bin statistical transformation to help me flesh out overall concept a bit. I have come across a need to store some information, and I would like to store it in the <stat-bin> instance. This would mean, though, that you couldn't re-use a stat-bin, but would need a new one for each data-frame.  Where do you see the storage -- in the geom instance, or the layer instance?
It seems to me, it either has to be the stat or the geom object. The layer object needs to be independent of the type of geom object it receives.

alternatively we may take a "dwim" road and define function aest as this:
(defun aest (&rest plist)
  (if (alexandria:sequence-of-length-p plist 1)
      (slot-value (pop plist) 'aest)
      (loop for (i j) on plist by #'cddr
            collect i into aes
            collect j into var
            finally (return (<aest> :aest aes :vars var)))))

what kind of information do you need to store? could you give me an example?

Hold that thought. For bins, I might be able to get around it, but maybe not for boxplots. I'm still prototyping the bin though.
I have a working transformation for bin. The major issues are:

does not deal with date / time. How did you want to handle dates and times? I didn't know if you had  a preferred package, or way to do it. ggplot uses days for dates and seconds for time by default. Or do you want to ignore this for the moment?

limited user inputs (fixed uniform bins with left edge in bin and no padding)

interface to data-frame protocol is messy; it is easier to create the bins and frequencies with arrays, and I tried to hammer it into a map-function, but it is a hack. Rather than consing everything, I would like to make a make-data-frame that accepts the rows as arrays. Are you OK with that?

I didn't put much thought into dates. As of preferred library, I'm moderately versed with local-time library so I'd prefer that if we want to jump at dates now. I'd postpone that for later though.

please elaborate what the issue is (maybe with some examples)

how about specializing copy-data-frame on arrays (first row being interpreted as columns)?

I agree; lets postpone dates for later.

This is more of a fact; the current prototype has limited user inputs. The prototype needs some cleanup, and I need to decided about some helper functions. Then I'll start adding user inputs. Do you want to primarily replicate the ggplot2 interface?

Comments in #2.

not necessarily, we are inspired by ggplot but if some change makes sense lets do it. also we may have only the most important options implemented first and when we have a protocol for stats, geoms etc we will deepen the implementation.

Perhaps more important than an array-data-frame may be some methods to quickly access and set specific selections (or perhaps that is the point of the array-data-frame). I tried to refactor the bin transformation to use map-aesthetics and add-rows! starting from an empty data-frame, but this is also difficutl ... probably for a similar reason that you setup a hash table on the count stat, much easier to grab the right location and incf the frequency.
However, I'll be the first to admit, I think more linearly, like a Fortran number cruncher, so perhaps there is some slick solution I haven't thought of yet. I'll cleanup what I have and push it so you can see some of the things I am talking about.
Something else to think about is that when we add a column, or in my case a new data-frame, we need to modify the aest as well to reflect the new (or adjusted) data-frame.
(stat 'bin (aest :x "Salary") :count 29)

results in a new data-frame with 29 rows where x is "Salary" and y is "Frequency" or count or some such thing.

I made a change to the stat-count transformation to return a new data-frame with only the unique :x values. This is consistent with R; not that we necessarily have to do it that way, but it certainly makes sense to me.
One thing I was concerned about is what if you decided you wanted to facet the diamond price histogram on color. I played around with ggplot some more, and although you can specify the histogram and facet in any order, the actual stat is returning a new data-frame with only the relevant columns. As an example with a price histogram, stat_bin is returning a new data-frame with the bin centers and the frequency counts in those bins as x and y respectively. If you save that and add a facet, there is logic to reprocess the original data-frame and send the filtered data to stat_bin, which again, returns a new data-frame with x and y.


currentlyFocusedField is deprecated and will be removed in a future release. Use currentlyFocusedInput #440

In the latest RN release (0.63.0) I get the following error when moving focus from one textinput to another when inside RNKASV.
The fix might just require find & replace all instances (or at least the right side of line 495 below) of currentlyFocusedField with currentlyFocusedInput in the KeyboardAwareHOC in @codler/react-native-keyboard-aware-scroll-view

Duplicate #3273


the choice of positional encoding

Why did you choose adding positional encoding with the input of decoder rather than the output of embedding?

Hi, what do you mean by output of embedding? Do you mean output of the encoder? The positional encoding is supposed to make it easier for the decoder to deal with repeated sequences of phoneme encodings. Based on the duration prediction for a given phoneme, the phoneme encoding is repeated that many times on the decoder input. Since this creates homogeneous segments of vectors, the decoder's task is to learn an expansive mapping from few vectors to many different vectors (spectrogram frames). The positional encoding is supposed to make each input of the decoder unique so that the mapping is closer to one-to-one mapping and easier to learn. Adding positional encoding to the encoder output before expanding each phoneme encoding would not help with the above described problem. Does that answer your question?

The output of embedding I refered to is as shown in the picture. Based on my understanding for your answer, the decoder needs inputs constrained to position information. But, doesn't encoder need related information? I notice the PE will always be added with the output of nn.embedding, such as in Transformer and related models.

In Transformer related models, PE is usually added to the encoder input because the attention layers do not have a notion of location by themselves -- they work on a global scale. In SpeedySpeech, the encoder is fully convolutional. Convolutions work on a local scale and work with neighboring elements in the sequence so the notion of position is implicitly encoded in the layers themselves. You can try adding PE also to encoder, but it works without it too.

Got it! Thank you. Besides, I found the SpeedySpeech cannot deal with long sentences well. When a long sentence is as input, the synthesized audio is not stable and some segments are totally abnormal. Preliminary I guess the receiptive field is not enough, especially for encoder(in which the kernel size=4 and max dilation is 4). Have you any other ideas about the synthesizing stability of long sentences?

Could you post some examples that did not work for you? I tested the model on 10second audios and had no problems with it, but it may be possible that much longer audio can be problematic -- I haven't tested eg full paragraphs or so.

The long sentences I mentioned before do refers to samples that are more than 10 seconds.


systemd-nspawn issue on debian 12 guest / M2 MacBook Pro host

ALSO, if systemd-nspawn fails for you please open an issue on this GitHub. I'd like to do some testing, but I'm having trouble finding one that fails!

Hi, here is the issue I encountered when running sdm --explore <raspios-image-file>.img from my debian 12 vm (distro is from https://mac.getutm.app/gallery/debian-12) running on my M2 MacBook pro with UTM
debian@debian:~$ sudo sdm --explore my-image.img
* Enter IMG 'my-image.img'
execv(/bin/bash) failed: Exec format error
umount: /mnt/sdm/boot unmounted
umount: /mnt/sdm unmounted

As sdm --chroot --explore <raspios-image-file>.img also failed with a "/bin/bash: /bin/bash: cannot execute binary file" error, I noticed the actual issue was the missing /proc/sys/fs/binfmt_misc/qemu-arm which seemed not be added despite running update-binfmts
I managed to workaround thanks to the binfmt_misc tip found in this discussion about arm32 qemu support from apple silicon: https://github.com/containers/podman/discussions/19329#discussioncomment-6528572
It looks like after running this (after each vm reboot)
root@debian:/home/debian# echo ":qemu-arm:M:0:\x7f\x45\x4c\x46\x01\x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x28\x00:\xff\xff\xff\xff\xff\xff\xff\x00\xff\xff\xff\xff\xff\xff\xff\xff\xfe\xff\xff\xff:/usr/bin/qemu-arm-static:F" > /proc/sys/fs/binfmt_misc/register

I am now able to successfully explore my image
debian@debian:~$ sudo sdm --explore my-image.img
* Enter IMG 'my-image.img'
root@sdm:/#

Note: however sdm --chroot --explore <raspios-image-file>.img still fails with the same error as above, which I don't understand.

Interesting problem! Just to confirm, your debian 12 VM is 64-bit and the IMG you're working with is a 32-bit RasPiOS IMG?
I don't have a Mac of any type for testing. Are you up for some trial and error debugging?
Thx!

That’s right: 64bit vm and 32bit IMG
I sure can, let me know what I can do

Here you go:
debian@debian:~$ uname -a
Linux debian 6.1.0-18-arm64 #1 SMP Debian 6.1.76-1 (2024-02-01) aarch64 GNU/Linux
debian@debian:~$ file /bin/ls
/bin/ls: ELF 64-bit LSB pie executable, ARM aarch64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-aarch64.so.1, BuildID[sha1]=9f127c37a4c459cf01639f6ded2fcf11a49d3da9, for GNU/Linux 3.7.0, stripped

I think it hard to guess from the VM the host architecture due to isolation, I also had a quick look but the only thing that comes close would be lscpu which says it's an aarch64 with only 64-bit support
debian@debian:~$ lscpu
Architecture:           aarch64
  CPU op-mode(s):       64-bit
  Byte Order:           Little Endian
CPU(s):                 6
  On-line CPU(s) list:  0-5
Vendor ID:              0x00
  Model name:           -
    Model:              0
    Thread(s) per core: 1
    Core(s) per socket: 6
    Socket(s):          1
    Stepping:           0x0
    BogoMIPS:           48.00
    Flags:              fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid a
                        simdrdm jscvt fcma lrcpc dcpop sha3 asimddp sha512 asimdfhm dit uscat i
                        lrcpc flagm sb paca pacg dcpodp flagm2 frint
NUMA:
  NUMA node(s):         1
  NUMA node0 CPU(s):    0-5
Vulnerabilities:
  Gather data sampling: Not affected
  Itlb multihit:        Not affected
  L1tf:                 Not affected
  Mds:                  Not affected
  Meltdown:             Not affected
  Mmio stale data:      Not affected
  Retbleed:             Not affected
  Spec rstack overflow: Not affected
  Spec store bypass:    Vulnerable
  Spectre v1:           Mitigation; __user pointer sanitization
  Spectre v2:           Not affected
  Srbds:                Not affected
  Tsx async abort:      Not affected

Thanks for that. I have an idea of how to fix. I'll put something together for you to try.

I believe I have corrected some issues that will improve this, but before I give it to you to try, I'd like a preliminary confirmation that I'm on the correct path.
Would you please do the following:

Reboot the system and DON'T update binfmt
Provide the output from:

ls -l /usr/bin/qemu*
ls -l /proc/sys/fs/binfmt_misc

Thx!

Moving ahead anyhow. Please try the sdm-cparse in the attached zip file:

Unzip it
cd /usr/local/sdm
sudo mv sdm-cparse sdm-save-cparse
sudo cp /path/to/new/sdm-cparse sdm-cparse

sdm-cparse.zip
Yes, I know this can be done with a github branch

Regarding your previous message here are the outputs:
debian@debian:/media/share$ ls -l /usr/bin/qemu*
-rwxr-xr-x 1 root root 10326544 Feb  6 09:38 /usr/bin/qemu-aarch64_be-static
-rwxr-xr-x 1 root root 10326544 Feb  6 09:38 /usr/bin/qemu-aarch64-static
-rwxr-xr-x 1 root root  7834768 Feb  6 09:38 /usr/bin/qemu-alpha-static
-rwxr-xr-x 1 root root  8950240 Feb  6 09:38 /usr/bin/qemu-armeb-static
-rwxr-xr-x 1 root root  8950240 Feb  6 09:38 /usr/bin/qemu-arm-static
-rwxr-xr-x 1 root root  7834544 Feb  6 09:38 /usr/bin/qemu-cris-static
-rwxr-xr-x 1 root root  9932000 Feb  6 09:38 /usr/bin/qemu-hexagon-static
-rwxr-xr-x 1 root root  7900304 Feb  6 09:38 /usr/bin/qemu-hppa-static
-rwxr-xr-x 1 root root  8461840 Feb  6 09:38 /usr/bin/qemu-i386-static
-rwxr-xr-x 1 root root  7834752 Feb  6 09:38 /usr/bin/qemu-loongarch64-static
-rwxr-xr-x 1 root root  8097040 Feb  6 09:38 /usr/bin/qemu-m68k-static
-rwxr-xr-x 1 root root  7837024 Feb  6 09:38 /usr/bin/qemu-microblazeel-static
-rwxr-xr-x 1 root root  7837024 Feb  6 09:38 /usr/bin/qemu-microblaze-static
-rwxr-xr-x 1 root root  8752736 Feb  6 09:38 /usr/bin/qemu-mips64el-static
-rwxr-xr-x 1 root root  8752736 Feb  6 09:38 /usr/bin/qemu-mips64-static
-rwxr-xr-x 1 root root  8687424 Feb  6 09:38 /usr/bin/qemu-mipsel-static
-rwxr-xr-x 1 root root  8752736 Feb  6 09:38 /usr/bin/qemu-mipsn32el-static
-rwxr-xr-x 1 root root  8752736 Feb  6 09:38 /usr/bin/qemu-mipsn32-static
-rwxr-xr-x 1 root root  8687424 Feb  6 09:38 /usr/bin/qemu-mips-static
-rwxr-xr-x 1 root root  7837584 Feb  6 09:38 /usr/bin/qemu-nios2-static
-rwxr-xr-x 1 root root  7834672 Feb  6 09:38 /usr/bin/qemu-or1k-static
-rwxr-xr-x 1 root root  8812368 Feb  6 09:38 /usr/bin/qemu-ppc64le-static
-rwxr-xr-x 1 root root  8812368 Feb  6 09:38 /usr/bin/qemu-ppc64-static
-rwxr-xr-x 1 root root  8676048 Feb  6 09:38 /usr/bin/qemu-ppc-static
-rwxr-xr-x 1 root root  8889152 Feb  6 09:38 /usr/bin/qemu-riscv32-static
-rwxr-xr-x 1 root root  8889152 Feb  6 09:38 /usr/bin/qemu-riscv64-static
-rwxr-xr-x 1 root root  8240080 Feb  6 09:38 /usr/bin/qemu-s390x-static
-rwxr-xr-x 1 root root  7900544 Feb  6 09:38 /usr/bin/qemu-sh4eb-static
-rwxr-xr-x 1 root root  7900544 Feb  6 09:38 /usr/bin/qemu-sh4-static
-rwxr-xr-x 1 root root  8034320 Feb  6 09:38 /usr/bin/qemu-sparc32plus-static
-rwxr-xr-x 1 root root  8034320 Feb  6 09:38 /usr/bin/qemu-sparc64-static
-rwxr-xr-x 1 root root  7968784 Feb  6 09:38 /usr/bin/qemu-sparc-static
-rwxr-xr-x 1 root root  8396080 Feb  6 09:38 /usr/bin/qemu-x86_64-static
-rwxr-xr-x 1 root root 10712112 Feb  6 09:38 /usr/bin/qemu-xtensaeb-static
-rwxr-xr-x 1 root root 10822608 Feb  6 09:38 /usr/bin/qemu-xtensa-static

debian@debian:/media/share$ ls -l /proc/sys/fs/binfmt_misc
total 0
-rw-r--r-- 1 root root 0 Feb 21 05:39 python3.11
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-alpha
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-armeb
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-cris
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-hexagon
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-hppa
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-i386
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-loongarch64
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-m68k
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-microblaze
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-mips
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-mips64
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-mips64el
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-mipsel
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-mipsn32
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-mipsn32el
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-ppc
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-ppc64
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-ppc64le
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-riscv32
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-riscv64
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-s390x
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-sh4
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-sh4eb
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-sparc
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-sparc32plus
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-sparc64
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-x86_64
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-xtensa
-rw-r--r-- 1 root root 0 Feb 21 05:39 qemu-xtensaeb
--w------- 1 root root 0 Feb 21 05:39 register
-rw-r--r-- 1 root root 0 Feb 21 05:39 status

And I just tried to sdm --explore with the zip you provided,

Without updating binfmt, I still get the error

debian@debian:~$ sudo sdm --explore my-image.img
* Mount IMG 'my-image.img'
mount: /dev/loop0 mounted on /mnt/sdm.
mount: /dev/loop1 mounted on /mnt/sdm/boot/firmware.
* Enter IMG 'my-image.img'
execv(/bin/bash) failed: Exec format error
umount: /mnt/sdm/boot/firmware unmounted
umount: /mnt/sdm unmounted

However, after updating binfmt, looks like sudo sdm --chroot --explore my-image.img now works!

debian@debian:~$ sudo sdm --chroot --explore my-image.img
* Mount IMG 'my-image.img'
mount: /dev/loop0 mounted on /mnt/sdm.
mount: /dev/loop1 mounted on /mnt/sdm/boot/firmware.
% sdm will use chroot per --chroot on this 'ARM aarch64' host
* Enter IMG 'my-image.img'
root@debian:/#
root@debian:/#
root@debian:/#
root@debian:/#
exit
umount: /mnt/sdm/boot/firmware unmounted
umount: /mnt/sdm unmounted

Here is my sdm directory fyi
debian@debian:~$ ls -l /usr/local/sdm/
total 296
drwxr-xr-x 2 root root  4096 Feb 16 07:13 1piboot
drwxr-xr-x 2 root root  4096 Feb 16 07:12 local-plugins
drwxr-xr-x 2 root root  4096 Feb 16 07:13 plugins
-rwxr-xr-x 1 root root 35613 Feb 16 08:32 sdm
-rw-r--r-- 1 root root   545 Feb 16 07:13 sdm-apps-example
-rwxr-xr-x 1 root root   660 Feb 16 07:13 sdm-apt
-rwxr-xr-x 1 root root  1485 Feb 16 07:13 sdm-apt-cacher
-rwxr-xr-x 1 root root 19427 Feb 16 07:13 sdm-cmdsubs
-rwxr-xr-x 1 root root 51888 Feb 21 05:44 sdm-cparse
-rwxr-xr-x 1 root root 39319 Feb 16 07:13 sdm-cportal
-rwxr-xr-x 1 root root 16232 Feb 16 07:13 sdm-cryptconfig
-rwxr-xr-x 1 root root  4496 Feb 16 07:13 sdmcryptfs
-rwxr-xr-x 1 root root  1295 Feb 16 07:13 sdm-customphase
-rwxr-xr-x 1 root root  7110 Feb 16 07:13 sdm-firstboot
-rwxr-xr-x 1 root root  7650 Feb 16 07:13 sdm-gburn
-rwxr-xr-x 1 root root   142 Feb 16 07:13 sdm-logmsg
-rwxr-xr-x 1 root root   696 Feb 16 07:12 sdm-phase0
-rwxr-xr-x 1 root root  7105 Feb 16 08:47 sdm-phase1
-rwxr-xr-x 1 root root  1312 Feb 16 07:13 sdm-readparams
-rwxr-xr-x 1 root root  2427 Feb 16 07:13 sdm-rpcsubs
-rwxr-xr-x 1 root root 51053 Feb 16 08:53 sdm-save-cparse
-rw-r--r-- 1 root root   929 Feb 16 07:13 sdm-xapps-example

Good news! For completeness, what is the result if you rerun the command WITHOUT the --chroot (and binfmt updated)?

So as I understand it now, both systemd-nspawn and chroot work now, as long as binfmt is updated? Good news!
I will have an updated version for you that does the binfmt update automatically and hopefully it will all work as expected. 🤞

I believe that this version does automatic binfmt setting. Could you give it a try?
sdm-cparse.zip
Thx!

Hi, just tried it, but it does not work (same errors as before) as is.
debian@debian:~$ sudo sdm --explore my-image.img
[sudo] password for debian:
* Mount IMG 'my-image.img'
mount: /dev/loop0 mounted on /mnt/sdm.
mount: /dev/loop1 mounted on /mnt/sdm/boot/firmware.
* Enter IMG 'my-image.img'
execv(/bin/bash) failed: No such file or directory
umount: /mnt/sdm/boot/firmware unmounted
umount: /mnt/sdm unmounted

It does not seems to do something special, whereas with the --chroot option I get
debian@debian:~$ sudo sdm --chroot --explore my-image.img
* Mount IMG 'my-image.img'
mount: /dev/loop0 mounted on /mnt/sdm.
mount: /dev/loop1 mounted on /mnt/sdm/boot/firmware.
% Add binfmt for 'arm' architecture
% sdm will use chroot per --chroot on this 64-bit ARM aarch64 host
* Enter IMG 'my-image.img'
chroot: failed to run command ‘/bin/bash’: No such file or directory
umount: /mnt/sdm/boot/firmware unmounted
umount: /mnt/sdm unmounted

The register part seems to happen but does not seem to succeed. I noticed the diff between what you added and the string I use when manually updating binfmt:
< 		bfs=":qemu-arm:M:0:\x7f\x45\x4c\x46\x01\x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x28\x00:\xff\xff\xff\xff\xff\xff\xff\x00\xff\xff\xff\xff\xff\xff\xff\xff\xfe\xff\xff\xff:qemu-arm-static:"
---
> 		bfs=":qemu-arm:M:0:\x7f\x45\x4c\x46\x01\x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x28\x00:\xff\xff\xff\xff\xff\xff\xff\x00\xff\xff\xff\xff\xff\xff\xff\xff\xfe\xff\xff\xff:/usr/bin/qemu-arm-static:F"

Not sure what this diff means, but when applying my version on sdm-cparse, it does seem to work
debian@debian:~$ sudo sdm --chroot --explore my-image.img

* Mount IMG 'my-image.img'
mount: /dev/loop0 mounted on /mnt/sdm.
mount: /dev/loop1 mounted on /mnt/sdm/boot/firmware.
% Add binfmt for 'arm' architecture
% sdm will use chroot per --chroot on this 64-bit ARM aarch64 host
* Enter IMG 'my-image.img'
root@debian:/#
exit
umount: /mnt/sdm/boot/firmware unmounted
umount: /mnt/sdm unmounted
debian@debian:~$

Huh. Could you try the following:

Edit the 'bfs' string to put the F back in
Reboot
Try both without chroot and then with
If that fails, then put the /usr/bin in, and retry the reboot/test again
Thx!

Ok, I tested
without chroot, it never updates binfmt and does not work.
with chroot, I confirm the only string that seems to work is with an absolute path and F flag

Thx for confirming the binfmt string contents.
I re-imagined 🤪the initialization yesterday with that exact binfmt contents and explicit handling of arm64 host without 32-bit mode, and I believe this one should do it.
Please test both with --chroot and without, rebooting in between. sdm will notify a) if qemu is going to be used, and b) if binfmt is updated.
sdm-cparse.zip
Thx!

I've checked in V11.5 that has this incorporated. Please test V11.5 and LMK how it goes. Thx!

Verified by @garshythoel over in https://github.com/gitbls/sdm/issues/187

Looks great, thanks a lot

Great! And thank you for helping me sort this out!

Closing as resolved.


Сhat - On selecting skin tone emoji symbol disappears

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.50
Reproducible in staging?: Y
Reproducible in production?: N
If this was caught during regression testing, add the test name, ID and link from TestRail: https://expensify.testrail.io/index.php?/tests/view/4417529
Issue reported by: Applause - Internal Team
Action Performed:

Go to https://staging.new.expensify.com/
Open a conversation
Enter :wave
Note suggestions shown
Enter colon at end :wave:
Note emoji shown
Clear the message
Enter :wave
Tap emoji picker and select different skin tone
Tap outside

Expected Result:
Emoji symbol must not disappear in suggestion list
Actual Result:
Emoji symbol disappears in suggestion list
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android: Native
[x] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

https://github.com/Expensify/App/assets/78819774/09449f34-e32c-4129-bbfb-000556432375
View all open jobs on GitHub

I'm removing the deploy blocker label as this is not a crucial path and sending emojis still works.

As @aimane-chnaif pointed out this should be handled by @kubabutkiewicz if possible.

I will take a look on this today @rlinoz

PR ready @rlinoz

No payment due, closing.


Default error messages with Lotus?

I noticed your post here: https://github.com/lotus/validations/issues/67
Is there a way in reform to get a similar output to what rails offers with errors.full_messages when using lotus?

Once I implemented it in Lotus, yeah! :smile:

Oh, you already implemented it? :-) How do I access it?

Read the above as "once I implemented it in Lotus, I'll let you access it". I prototype here: https://github.com/trailblazer/lotus-validations

Ah, cool. I'll play with this fork. Thanks!


pty/client has races of pending writes versus process exit handling

Terminal.write in xterm.js is highly asynchronous. firstly, it uses a setTimeout, then (eventually) it uses a browser animation frame to slot in the actual work.
the result is that we have been playing setTimeout tricks of our own in a mostly vain attempt at handling this race.
we should be able to use terminal.on('refresh') to fix this properly.

details:
Terminal.write calls, via setTimeout, Terminal._innerWrite, which passes off to Terminal.refresh, which passes off to DomRenderer.refreshRows, which passes off to RenderDebouncer.refresh, which then schedules a fancy browser animation frame whose callback is RenderDebouncer._innerRefresh....
the last _innerRefresh calls the DomRenderer's provided callback method when it's done, which in turn percolates all the way back to us as a refresh event.

ok, we do need to introduce a promise to the Terminal.write, in addition to the refresh callback provided by xtermjs 3.13-beta.
this is due to the two levels of asynchrony. Terminal.write calls Terminal._innerWrite as a setTimeout handler; then, the renderers schedule their work asynchronously as animation frames.
the refresh callback only covers the animation frame asynchrony. we need to know when _innerWrite has scheduled the animation frame, too.


Issue - Zombie "Breaking" - Better Barriers

I have found it nearly impossible to get the zombies to go to certain barriers. I've tried many different spawn configurations from having multiple to having only 1 singular spawnpoint for a barrier. They somehow keep breaking them even if not near them.
The only temporary fix I have found is to keep the spawns close to the barrier (somewhat breaking the immersive-ness) and to use barrier blocks to keep them within a set path. That also ruins gameplay as it will make zombies easily memorable and killable.
I think there should be a radius, in blocks, to how close the zombies should be for them to then start "breaking".  I would not know.
Please fix this, it would make everything so much smoother.

See #96 , but yes, the barriers are not very smart currently and start breaking as soon as a zombie is spawned


Created Project to Provide Native Cordova Integration

I am working on a project to provide native cordova notifications to Orion.
For instance the first integration is Cordova Native Notifications. The user will define an entity called notifications . When they create a new notification they will be able to send Android / IOS notifications directly to the device from their app.
This repository is just the start of many of the Cordova items I will try to build so that they can be controlled from the admin panel.
Let me know your thoughts.
Also there is a new name space called orion.cordova , and each integration will follow this namespace so orion.cordova.notifications all the methods integrated for notifications will follow this namespace.
http://github.com/rwatts3/orionjs-cordova

@rwatts3 that's awesome!

Super awesome!
On Apr 12, 2015 5:46 PM, "Ryan Watts"<EMAIL_ADDRESS>wrote:

I am working on a project to provide native cordova notifications to Orion.
For instance the first integration is Cordova Native Notifications. The
user will define an entity called notifications . When they create a new
notification they will be able to send Android / IOS notifications directly
to the device from their app.
This repository is just the start of many of the Cordova items I will try
to build so that they can be controlled from the admin panel.
Let me know your thoughts.
Also there is a new name space called orion.cordova , and each
integration will follow this namespace so orion.cordova.notifications all
the methods integrated for notifications will follow this namespace.
@rwatts3/orionjs-cordova
—
Reply to this email directly or view it on GitHub
https://github.com/orionjs/orion/issues/96.

That seem great! :)
On Mon, Apr 13, 2015 at 1:15 AM Timothy<EMAIL_ADDRESS>wrote:

Super awesome!
On Apr 12, 2015 5:46 PM, "Ryan Watts"<EMAIL_ADDRESS>wrote:

I am working on a project to provide native cordova notifications to
Orion.
For instance the first integration is Cordova Native Notifications. The
user will define an entity called notifications . When they create a new
notification they will be able to send Android / IOS notifications
directly
to the device from their app.
This repository is just the start of many of the Cordova items I will try
to build so that they can be controlled from the admin panel.
Let me know your thoughts.
Also there is a new name space called orion.cordova , and each
integration will follow this namespace so orion.cordova.notifications all
the methods integrated for notifications will follow this namespace.
@rwatts3/orionjs-cordova
—
Reply to this email directly or view it on GitHub
https://github.com/orionjs/orion/issues/96.

—
Reply to this email directly or view it on GitHub
https://github.com/orionjs/orion/issues/96#issuecomment-92150192.


autorepfixer does not respect rules

Is this a bug report?
YES
Did you try recovering your dependencies?
Fresh install
create-react-app: 1.5.2
YARN version v1.3.2
Which terms did you search for in User Guide?
autoprefixer, css, display: grid
Environment

node -v: v8.9.1
npm -v: 5.6.0
yarn --version (if you use Yarn): 1.5.2
npm ls react-scripts (if you haven’t ejected):

Then, specify:

Operating system: Ubuntu based
Browser and version (if relevant):

Steps to Reproduce

(Write your steps here:)

npm i -g create-react-app
create-react-app autoprefixer
add .demo { display: grid } to App.css file
yarn build
open generated css file in build directory and check .demo class content

Expected Behavior

.demo {
display: -ms-grid;
display: grid;
}

Actual Behavior

.demo{display:grid}

I tried to eject and change the autoprefixer option by adding grid: true it works

Folow https://github.com/postcss/autoprefixer/issues/603#issuecomment-365015199
SO please add that option to your webpack autoprefixer config by default

This isn't a create-react-app bug, being that autoprefixer has CSS Grid Layout prefixing disabled by default and to my knowledge create-react-app makes no claims to CSS Grid Layout support.
However, this could be a beneficial proposal. It's important to note though, even with autoprefixer configured to prefix Grid properties, developers will likely need to consider using feature queriers to better support IE 10+. The Grid implementation that exists in IE 10+ is based on the 2011 specification, and the implementation supported today in Chrome, Firefox, and Safari is quite different.
Rachel Andrew, has a great article discussing the challenges of Grid support in IE, which I came across when reading through MDN.
That all being said, configuring autoprefixer to prefix Grid properties would be helpful for IE, although additional CSS overhead is likely.
If it's decided that Grid prefixing should be enabled, I'd be happy to submit a PR.
FYI, I haven't used Grid myself just yet, but I know it's super 🔥 right now, and will likely only grow in popularity.

@joelrindfleisch none. Just be aware of the IE 10+ pain points mentioned above, and know that based on browserslist config CSS output size may increase due to additional prefixing.

Grid is off by default. This will be documented.


ERROR: Condition "actions.default_filter == ShaderLanguage::FILTER_DEFAULT" is true. Returning: String() when running Headless with 4.3 Dev4

Tested versions

Reproducible in: v4.3.dev4.official [df78c0636]
Not Reproducible in: v4.3.dev3.official [36e943b6b]

System information
Godot v4.3.dev4 - Windows 10.0.22621 - Vulkan (Forward+) - dedicated NVIDIA GeForce RTX 3080 Ti (NVIDIA; <IP_ADDRESS>61) - AMD Ryzen 9 5900X 12-Core Processor (24 Threads)
Issue description
Repeated errors like this when building in a headless system:
ERROR: Condition "actions.default_filter == ShaderLanguage::FILTER_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:279)

Note that I'm running this in Linux in WSL2 on Windows, if that matters. Basically, the OS has no video.
I got the same errors on a Digital Ocean droplet (VM) too.
Steps to reproduce
gh repo clone godotengine/godot-demo-projects
Edit export_presets.cfg and change platform="Linux/X11" to platform="Linux" first.
Then build it from the command line
Godot_v4.3-dev4_linux.x86_64 --headless --quiet --path $HOME/Clone/godot-demo-projects/3d/platformer --export-release Linux/X11 $HOME/platformer.x86_64
WARNING: Custom cursor shape not supported by this display server.
     at: cursor_set_custom_image (servers/display_server.cpp:514)
ERROR: Condition "actions.default_filter == ShaderLanguage::FILTER_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:279)
ERROR: Condition "actions.default_filter == ShaderLanguage::FILTER_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:279)
ERROR: Condition "actions.default_filter == ShaderLanguage::FILTER_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:279)
ERROR: Condition "actions.default_repeat == ShaderLanguage::REPEAT_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:283)
ERROR: Condition "actions.default_repeat == ShaderLanguage::REPEAT_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:283)
ERROR: Condition "actions.default_repeat == ShaderLanguage::REPEAT_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:283)
ERROR: Condition "actions.default_repeat == ShaderLanguage::REPEAT_DEFAULT" is true. Returning: String()
   at: _get_sampler_name (servers/rendering/shader_compiler.cpp:283)

You don't actually have to do a build, also running the game headless, such as as a server on a Linux host.
Minimal reproduction project (MRP)
This can be reproduced with the Godot 3D Platformer demo project at https://github.com/godotengine/godot-demo-projects/tree/master/3d/platformer
However, you must edit export_presets.cfg and change platform="Linux/X11" to platform="Linux" first.

See https://github.com/godotengine/godot/issues/88990 , already fixed in master

Thanks for the report. Consolidating in

#88990


Fix SnarkyJS to be compatible with new Berkeley

Description
Merges berkeley into main
Notable Changes

Because the Out-Of-Snark dummy verification key hash changed in this PR, the old verification key hash defaults we used (Field(0)) were incorrect. There are several places where this value is hard-coded, so we change each place to use the new dummy value. All changes are contained in this commit: https://github.com/o1-labs/snarkyjs/pull/1021/commits/9b4805dc28b1892187dd9c4c442cbb7a1aaf2571

Update the vk regression tests by creating a new dump.

Two more small change requests:

Make this a minor version bump -- we want to release a version that works on berkeley asap
Call out in the changelog that all existing zkApp verification keys change


Empty VCF file during nanopolish variants

Hi,
I was trying to run nanopolish variants in a server, and after an hour I obtained the following results:
Number of variants in span (15) would exceed max-haplotypes. Variants may be missed. Consider running with a higher value of max-haplotypes!
[post-run summary] total reads: 41018, unparseable: 0, qc fail: 19, could not calibrate: 950, no alignment: 4911, bad fast5: 0

My workflow is as follows:
nanopolish index -v -s <sequencing_summary.txt> -d <fast5_pass/> <barcode01.fastq>
(the barcode01.fastq file is after trimming, demultiplexing and removing low quality reads with qcat; also it was indexed with sam faidx)
Then after indexing with nanopolish, I aligned my barcode to a reference using minimap2:
minimap2 -ax msp2_reference.fasta barcode01.fastq > output1.sam
I converted from .sam to .bam, sorted and indexed it. And finally I tried running the command that gave me that message:
nanopolish variants --verbose --fix-homopolymers --ploidy=1 --threads=24 --min-candidate-frequency=0.20 --min-candidate-depth=20 --outfile=test --reads ../trim50_dem_q9/indexed_nanopolished_fastq/barcode01.fastq --bam /home/dcmogollon/nanopore/minimap2_alignment/mapped1.bam --genome ../gene_references/msp2_pf3d7_02026800.fasta
My VCF file is empty too. Do you know what could be causing the problem? Thanks!

Hi @dcastaneda5,
When you say the VCF is empty, do you mean there is nothing at all in test or does it print the VCF header but no variant records?
Jared

Hi Jared,
It's completely empty, with no headers.

It looks like the run was successful so its strange that at least the VCF header didn't print. Can you re-run over a small region of the genome (-w contig:start-end) to see if it works? If this is targeted sequencing and you have excessive depth (>500X) you may wish to downsample the data (you can do this by downsampling the BAM file, you don't need to remove reads from the fastq).


support multiple guessed formats

Clean fix for "Fixed .lower()" error.
Similar: #761, #775, #813, #814

Fails for me
`Downloading subtitles  [###---------------------------------]    9%  1d 16:48:03  American Dad! - S13E06 - Kiss Kiss Cam Cam - 1080p HDTV.mkv                                                               Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER.
Traceback (most recent call last):
File "subliminal", line 11, in
sys.exit(subliminal())
File<EMAIL_ADDRESS>line 722, in call
return self.main(*args, **kwargs)
File<EMAIL_ADDRESS>line 697, in main
rv = self.invoke(ctx)
File<EMAIL_ADDRESS>line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File<EMAIL_ADDRESS>line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File<EMAIL_ADDRESS>line 535, in invoke
return callback(*args, **kwargs)
File<EMAIL_ADDRESS>line 27, in new_func
return f(get_current_context().obj, *args, **kwargs)
File<EMAIL_ADDRESS>line 403, in download
hearing_impaired=hearing_impaired, only_one=single)
File<EMAIL_ADDRESS>line 211, in download_best_subtitles
for s in subtitles], key=operator.itemgetter(1), reverse=True)
File<EMAIL_ADDRESS>line 211, in
for s in subtitles], key=operator.itemgetter(1), reverse=True)
File<EMAIL_ADDRESS>line 106, in compute_score
matches = subtitle.get_matches(video)
File<EMAIL_ADDRESS>line 79, in get_matches
matches |= guess_matches(video, guessit(self.filename, {'type': 'episode'}))
File<EMAIL_ADDRESS>line 223, in guess_matches
if gfmt.lower() == video.format.lower():
AttributeError: 'list' object has no attribute 'lower'
`

damned we can receive a list of list? can you print guess['format'] ?

I'm absolutely not a python genius, but added print after it does it's thing:
    if video.format and 'format' in guess:
        gfmts = guess['format'] if isinstance(guess['format'], list) else [guess['format']]
        print(guess['format'])
        for gfmt in gfmts:
            if gfmt.lower() == video.format.lower():
                matches.add('format')

This works just fine on a working file, printing out the following:
python3 subliminal download -l en -l da /volume1/Series/American\ Dad/Season\ 13/American\ Dad\!\ -\ S13E07\ -\ The\ Devil\ Wears\ a\ Lapel\ Pin\ -\ 1080p\ HDTV.mkv Collecting videos  [####################################]  100%  /volume1/Series/American Dad/Season 13/American Dad! - S13E07 - The Devil Wears a Lapel Pin - 1Collecting videos  [####################################]  100%                                                                                1 video collected / 0 video ignored / 0 error Downloading subtitles  [####################################]  100%  American Dad! - S13E07 - The Devil Wears a Lapel Pin - 1080p HDTV.mkvHDTV HDTV HDTV HDTV Downloading subtitles  [####################################]  100%              Some providers have been discarded due to unexpected errors: legendastv Downloaded 1 subtitle
But it never seems to actually populate the format on a non functioning file or I am calling it too late:
`python3 subliminal download -l en -l da /volume1/Series/American\ Dad/Season\ 13/American\ Dad!\ -\ S13E06\ -\ Kiss\ Kiss\ Cam\ Cam\ -\ 1080p\ HDTV.mkv
Collecting videos  [####################################]  100%  /volume1/Series/American Dad/Season 13/American Dad! - S13E06 - Kiss Kiss Cam Cam - 1080p HDTV.Collecting videos  [####################################]  100%
1 video collected / 0 video ignored / 0 error
Downloading subtitles  [####################################]  100%  American Dad! - S13E06 - Kiss Kiss Cam Cam - 1080p HDTV.mkvCam
Traceback (most recent call last):
File "subliminal", line 11, in
sys.exit(subliminal())
File<EMAIL_ADDRESS>line 722, in call
return self.main(*args, **kwargs)
File<EMAIL_ADDRESS>line 697, in main
rv = self.invoke(ctx)
File<EMAIL_ADDRESS>line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File<EMAIL_ADDRESS>line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File<EMAIL_ADDRESS>line 535, in invoke
return callback(*args, **kwargs)
File<EMAIL_ADDRESS>line 27, in new_func
return f(get_current_context().obj, *args, **kwargs)
File<EMAIL_ADDRESS>line 403, in download
hearing_impaired=hearing_impaired, only_one=single)
File<EMAIL_ADDRESS>line 211, in download_best_subtitles
for s in subtitles], key=operator.itemgetter(1), reverse=True)
File<EMAIL_ADDRESS>line 211, in
for s in subtitles], key=operator.itemgetter(1), reverse=True)
File<EMAIL_ADDRESS>line 106, in compute_score
matches = subtitle.get_matches(video)
File<EMAIL_ADDRESS>line 79, in get_matches
matches |= guess_matches(video, guessit(self.filename, {'type': 'episode'}))
File<EMAIL_ADDRESS>line 224, in guess_matches
if gfmt.lower() == video.format.lower():
AttributeError: 'list' object has no attribute 'lower'
`

I've updated my PR. it handles when guess['format'] is a list or when video.format is a list (in your example, video.format == ['Cam', 'HDTV'].

Works for me, thank you. :)

The current fix now works properly for me as well. Cheers!

Fixed a similar issue in adic7ed plugin.

Already fixed by 3121a75499779c7cc9eba059a4fa123cf5541027


.NetCore 3.1 support?

Is it possible to get .Net Standard 2.x support? This would fix my NU1701 warning:
warning NU1701: Package 'LinqToExcel 2.0.0-PRERELEASE-2' was restored using '.NETFramework,Version=v4.6.1, .NETFramework,Version=v4.6.2, .NETFramework,Version=v4.7, .NETFramework,Version=v4.7.1, .NETFramework,Version=v4.7.2, .NETFramework,Version=v4.8' instead of the project target framework '.NETCoreApp,Version=v3.1'. This package may not be fully compatible with your project.

ok, .net standard doesn't have OleDb support. So direct .NetCore 3.1 support is needed.

Interesting, Oledb wasn't supported in .Net Core before... I'll have to look into it.

ok, System.Data.OleDb package  supports .net standard 2.0 and 3.1, but I have no idea how to test it. nunit console only has a beta to test .net core, but this fails.
In my application it looks like it works to load the Excel file and query data.

I tried to implement it with #188 @mrworkman

I gave it up now. I switched to ExcelMapper which is based on a pure managed excel reading library which is an advantage over LinqToExcel so that it doesn't require Office runtimes.

I gave it up now. I switched to ExcelMapper which is based on a pure managed excel reading library which is an advantage over LinqToExcel so that it doesn't require Office runtimes.

I gave it up now. I switched to ExcelMapper which is based on a pure managed excel reading library which is an advantage over LinqToExcel so that it doesn't require Office runtimes.

Thanks man, that helped a lot and the libraries work in a very similar way :)


Trouble using lookup_invoice

Hello, I am having trouble understanding how to use the lookup_invoice function. I want to feed it a payment hash as input. It seems like I need to encode the hash into bytes though? Can you please share code or any thing that can help me what the proper input is?
Or am I supposed to feed it the r_hash? Because that is also not working for me.
Thanks

lnd.lookup_invoice(r_hash_str=b64decode(rhash).hex())

from
https://github.com/SatSale/SatSale/blob/master/node/lnd.py
Hope that helps!


fix: update ui to 0.352.19

Bring in latest UI before release

:tada: This PR is included in version 0.318.3 :tada:
The release is available on:

npm package (@next dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


feat(deps): upgrade runtime dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-runtime-dependencies-1.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1299

Questions ?
Please refer to the Backport tool documentation


Doesn't seem to work with Python 2.x, only with Python3.x

It uses a mock module that doesn't seem to exist in Python 2. When using Python3 it works fine.
Is this project supposed to be Python3 only?
Traceback (most recent call last):
  File "main.py", line 1, in <module>
    import hug
  File "/usr/local/lib/python2.7/dist-packages/hug/__init__.py", line 32, in <module>
    from hug import (authentication, directives, documentation, exceptions, format,
  File "/usr/local/lib/python2.7/dist-packages/hug/test.py", line 26, in <module>
    from unittest import mock
ImportError: cannot import name mock

Tried with version 1.9.3 installed using pip.

Hi @lstep,
Yes hug is for Python 3.x only. The primary reason for this is that it leverages type annotations to automatically validate and convert both incoming and outgoing data for requests, something that simply is not possible with Python2. This is noted in the first section of the README on github: "As a result of these goals Hug is Python3+ only and uses Falcon under the cover to quickly handle requests."
Thanks, and I hope you find hug useless regardless!
~Timothy


[My resources page] Translation bug on category deletion notification

Description: Deletion notification text is not displayed correctly
Environment: Windows 11 x64, Firefox Developer Edition 119.0b6.
Reproducible: always.
Preconditions:
The https://s2s-front-stage.azurewebsites.net/ site is opened.
The user is logged in as a Tutor.
Steps to reproduce:

Click "My Resources" in the navigation bar.
Select "Categories" tab.
Delete category.

Actual result:
We have wrong translation

Hey, I'd like to take this issue

Seems to me like everything works fine.
Tested locally and on the staging

3. Delete category.

Thank you for your comment. I have checked this and everything is working correctly right now. I will close the issue.

This issue is a duplication of issue #1352
It was fixed already and merged in #1353 to develop


Update intersphinx links and others

Summary
Updates links away from qiskit.org to the new locations for the docs
Fixes #585
Fixes #586
Details and comments
Now that all the applications and the algorithms docs are deployed on github pages this updates the intersphinx links, in conf.py, and also urls that are coded directly in other places such as the readme and tutorials. I did not alter past release notes. There is a redirect now in effect for the former location on qiskit.org/ecosystem so they get to the right place.
Note that the current theme is still emitting a link to qiskit.org/ecosystem, but that will get redirected for now until such time as Qiskit/qiskit_sphinx_theme#588 is resolved and new docs are generated with such an updated theme and re-deployed.

It failed spell checking on bits of a url
pylint -rn --disable=all --enable=spelling --spelling-dict=en_US --spelling-private-dict-file=.pylintdict qiskit_optimization test tools
************* Module qiskit_optimization
qiskit_optimization/__init__.py:21:0: C0402: Wrong spelling of a word 'github' in a docstring:
fundamental `minimum eigensolvers <https://qiskit-community.github.io/qiskit-algorithms/apidocs/
                                                            ^^^^^^
Did you mean: ''git hub' or 'git-hub' or 'GitHub''? (wrong-spelling-in-docstring)
qiskit_optimization/__init__.py:21:0: C0402: Wrong spelling of a word 'io' in a docstring:
fundamental `minimum eigensolvers <https://qiskit-community.github.io/qiskit-algorithms/apidocs/
                                                                   ^^
Did you mean: ''oi' or 'Io' or 'oo' or 'ii''? (wrong-spelling-in-docstring)

which seemed weird as other urls there passed ok that also had github.io in them, and were even there ahead of this recent change. The only difference I could see was that other urls were not split over two lines so I altered the format to have it on one line. Its long but still passes lint and black locally for me, so hopefully that sorted things as otherwise I'd have to add the bits to the custom spell dict that I would prefer to avoid doing in this case.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 93.029%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
4511

Relevant Lines:
4849

💛  - Coveralls


Acquire a token silently from the MS Teams Iframe

Hi team !
I'm currently trying to develop an application for Microsoft Teams
Here is the setup:

Angular 5
Node JS
MSAL SDK for auth
Graph SDK for graph requests

Actually, I'm able to get a new token from AADV2 using the MSAL SDK:

Open a new popup hosted on my application
Launch an auth process using the Redirect behavior

Once I'm authenticated, the main page will call the Graph endpoint using, this kind of code (simplified with no error Handler, for demonstration only) (TypeScript Inside) :

let token = await this.userAgentApplication.acquireTokenSilent(this.applicationConfig.graphScopes);

var client = Client.init({
  authProvider: (done) => {
    done(null, this.authService.token); //first parameter takes an error if you can't get an access token
  }
});

let messages: [MicrosoftGraph.Message] = await client.api('/me/messages').get();

return messages;

But it doesn't work since I'm, by design, in an IFRAME

How can I get a token from my userAgentApplication ?
I know there is a token, since I'm able to authenticate my user with my popup code.
There is a method in the SDK, marked as hidden called getCachedToken. Can we use it ? Do you plan to make it available ?
Eventually, Is it possible to use MSAL Inside MS Teams or should I use another sdk ? (passport, implementing the authentication code .. ?)

I was wrong actually. There is no problem with Teams to create an hidden IFRAME, so we should be able to acquire a token silently, if the MSAL sdk is allowed to work in an existing IFRAME.
I reopen the issue, for tracking.
@rohitnarula7176 any idea ?

@Mimetis Msal is not designed to work from inside an iframe.

Thx for your answer, so what is the right way to authenticate users inside MS Teams ?

@Mimetis @AhmedAnwarHafez did you guys ended up finding a solution? I am also stuck because I need to do auth inside an Iframe in Dynamics 365 :/

@jayserdny Nope. I tried fiddling with it but no success.
I have the same problem as yours. Trying to consume MS Graph inside an iFrame in Dynamics 365.

In my case, I am trying to get the access token to send it to a backend. Any HTTP I can make it but when I try to intercept it with MSAL, it is just not working :/ @AhmedAnwarHafez

Hi all, this SDK is not working in a Teams context.
You should take a look on this sample, that should help you : https://github.com/OfficeDev/microsoft-teams-sample-auth-node

The  MSAL.js library is not designed to perform interactive auth requests like popup or redirect from inside an iframe. This is prevented for security reasons by Azure AD Identity provider to mitigate clickjacking or frame busting attacks.
The MS Teams documentation offers the authentication flows to use in the Teams context: https://docs.microsoft.com/en-us/microsoftteams/platform/concepts/authentication/authentication
Please check out those flows.

@navyasric Thanks for your reply.
I'm trying to acquire a token for Dynamics 365. By design, Single-Page-Apps must be hosted inside web forms (iFrames). I'm not exactly sure how I can acquire a token since it's not supported as you said.
Could you please guide us on how to acquire a token for Dynamics 365?
I would really appreciate your help. Thanks :)

Hi  I see you have closed this, and whilst I can understand that you have made a decision to not support IFRAMES, there are occasions where systems written to use this are embedded in an IFRAMe and they need to to know and handle the error.
@brownbl1 was correct when saying

Currently, the call to acquireTokenSilent breaks as the promise does not resolve at all. I think it would make sense to at least reject or return the cached token if it is still valid. That way our app can decide whether it needs to spawn a new window and do the redirect (as mentioned above).

I have this exact issue now, The app is like Ms Stream, which can handle this btw probably because they coded their own library,     It can open full page or be embedded in an IFRAME,
When running this code in an IFRAME the promise does not complete, does not error and is lost,   this surely is not correct and breaks the pattern here.   Please Fix this, and spit out another error type like cantOpenInFrame if you cannot allow use in an IFRAME.

Sure, I guess as we figure out supporting iframe, we can check if emitting an error is possible. @binaryjam Can you please raise another github issue with this request -> Specifically emitting errors in this case?


nuxt + bootstrap: .container min-width

Version
v2.12.2
Reproduction link
https://00297.sse.codesandbox.io/
Steps to reproduce
First of all: unable to reproduce in CodeSandbox.
I've created the app via yarn create nuxt-app with following config: https://imgur.com/y2PqBDc

What is expected ?
CSS to be the as provided in CodeSandbox
What is actually happening?
The .container class has an additional 'min-width: 100vh' property that pulls my header and footer to be at least 100vh without having any control over it nor any cause of it.
Additional comments?

browser: firefox
caching: disabled

browser inspection says it's source is 'inline:2', but I don't understand what is putting it there.

This bug report is available on Nuxt community (#c10549)

oh nvm, the pages/index.vue style wasn't scoped by default and that caused the mixture of classes. :)

Closing here then ☺


Create stub files for new transformer using invoke script

Closes #188
Also adds contribution guidelines.

Codecov Report

Merging #189 (ab1fa33) into main (6291608) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head ab1fa33 differs from pull request most recent head 08d6af1. Consider uploading reports for the commit 08d6af1 to get more accurate results

@@           Coverage Diff           @@
##             main     #189   +/-   ##
=======================================
  Coverage   97.37%   97.37%
=======================================
  Files          25       25
  Lines        1409     1409
=======================================
  Hits         1372     1372
  Misses         37       37

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6291608...08d6af1. Read the comment docs.


Go to newly created stream

Fixes #29375
When a user creates a stream for the first time, they are taken to the newly created stream. Additionally, if this is the first time the user is creating a stream, an explanatory modal is shown.

hotspots.py is used to determine if this is the first time the user has created a stream.
stream_create.test.ts is modified to account for the redirection and the first-time modal.

CZO discussion

 Screenshots
After creating the stream, the following appears

Self-review checklist

[x] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[x] Explains differences from previous plans (e.g., issue description).
[x] Highlights technical choices and bugs encountered.
[x] Calls out remaining decisions and concerns.
[x] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[x] Each commit is a coherent idea.
[x] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[x] Visual appearance of the changes.
[x] Responsiveness and internationalization.
[x] Strings and tooltips.
[x] End-to-end functionality of buttons, interactions and flows.
[x] Corner cases, error conditions, and easily imagined bugs.

The PR is ready for review!

Ready for another review.

If it's not too much of a pain, it would be great to use the stream privacy symbol in the header for consistency, rather than just #.

Other than that, looks good to me in manual testing!

@alya I've made these changes and updated the PR description with the screenshot.

Hm, now the spacing between the stream privacy icon looks inconsistent between the header and the text...
Anyway, @sahil839 , it probably makes sense for you to take a look at this point.

Regarding the behaviour, I've posted a message on CZO (link in PR description)

Looks good to me then.@timabbott this is ready for your review.

Looks great, merged, thanks @kuv2707!
@prakhar1144 FYI since this adds another 1-time-banner that we may or may not want to change the when-mark-as-read semantics for.


How does Autoconnect work?

Hi,
I am not sure if this is the right place to write this question.
But I wanted to know how does Autocorrect work? Does it keep on polling for the device of interest after a particular interval?

It will just try to connect again and again if got 'device disconnected' or 'device connection failed' callback to list of paired device filtered by keyword, one by one.

Hmm okay thanks a lot


User Story: Protect access to API endpoints

As an operator, I would like to restrict the API endpoints of my service so that I can prevent any unauthorised use of my service

See: ELIXIR AAI - Manual for Service Providers
See: Development Guide for ELIXIR OIDC


Error while executing uncommitted

I am getting this error
I could not figure more info, even with verbose
Traceback (most recent call last):
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 38, in run
    return check_output(command, **kw).splitlines()
  File "d:\installations\x64\python37\lib\subprocess.py", line 395, in check_output
    **kwargs).stdout
  File "d:\installations\x64\python37\lib\subprocess.py", line 472, in run
    with Popen(*popenargs, **kwargs) as process:
  File "d:\installations\x64\python37\lib\subprocess.py", line 775, in __init__
    restore_signals, start_new_session)
  File "d:\installations\x64\python37\lib\subprocess.py", line 1178, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] The system cannot find the file specified

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\Installations\x64\Python37\Scripts\uncommitted-script.py", line 11, in <module>
    load_entry_point('uncommitted==2.3', 'console_scripts', 'uncommitted')()
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 264, in main
    scan(repos, options)
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 188, in scan
    lines, subrepos = get_status(directory, ignore_set, options)
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 152, in status_subversion
    for line in run(['svn', 'st', '-v'], cwd=path):
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 43, in run
    .format(command[0], kw['cwd'].decode("UTF-8")))
AttributeError: 'str' object has no attribute 'decode'

Interesting! It looks like a patch 195c868b00d7d5a30e49de2fd17bf4155f0ad39d contributed 2½ years ago both broke the ability to print that error message with .format() when running on Windows, and also entirely broke "uncommitted" when a sub-command (like git or svn) files to run under Python 2 (because FileNotFoundError is in that case not defined).
I have gone through and rewritten the code paths involved. Could you try installing directly from GitHub to see if my fix works?
pip install https://github.com/brandon-rhodes/uncommitted/archive/master.zip

getting this now:
Traceback (most recent call last):
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 38, in run
    return check_output(command, cwd=fixed_cwd).splitlines()
  File "d:\installations\x64\python37\lib\subprocess.py", line 395, in check_output
    **kwargs).stdout
  File "d:\installations\x64\python37\lib\subprocess.py", line 472, in run
    with Popen(*popenargs, **kwargs) as process:
  File "d:\installations\x64\python37\lib\subprocess.py", line 775, in __init__
    restore_signals, start_new_session)
  File "d:\installations\x64\python37\lib\subprocess.py", line 1178, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] The system cannot find the file specified

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 187, in scan
    lines, subrepos = get_status(directory, ignore_set, options)
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 150, in status_subversion
    for line in run(['svn', 'st', '-v'], cwd=path):
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 42, in run
    raise ErrorCommandMissing(cwd, command[0])
uncommitted.command.ErrorCommandMissing: (b'D:\\BACKUPS\\quantum-stage\\svn\\quantumlibrary', 'svn')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\Installations\x64\Python37\Scripts\uncommitted-script.py", line 11, in <module>
    load_entry_point('uncommitted==2.3', 'console_scripts', 'uncommitted')()
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 266, in main
    scan(repos, options)
  File "d:\installations\x64\python37\lib\site-packages\uncommitted\command.py", line 189, in scan
    output(b'{} - skipping: {!r} command not found\n'.format(*e.args))
AttributeError: 'bytes' object has no attribute 'format'

oh the error come from one svn repo
So I guess I just need to install svn

Instead of having you leave svn uninstalled to test over and over again, I decided (as you'll see from the above commit) to add a real integration test for this case. It helped me get the code working again under both Python 2 and Python 3. I'll plan a release for next week to get this out officially. Thanks for letting me know about the failure!

Nice work!
Thanks for this tool. really useful to not lose work :)

Thanks, I'm glad it's been helpful!


add source to diagnostics

This will help with #17, by making it easier to know for which files the reference parser should emit an error.
We could also complete the expected diagnostics in tests to include the source, but I'm not sure if that is worth it. At the moment we only distinguish between runtime and compile-time diagnostics.

@vemoo -- I'm not sure how this helps, can you explain a bit more?
(Also, it needs a rebase, if nothing else, sorry about that...)

To verify the tree-sitter grammar I added this: https://github.com/vemoo/dada/blob/af9cdc0c61cb6de421c733fd73fa167ed6ac716b/components/dada-lang/src/test_harness.rs#L179-L199
But I don't think the grammar should catch validation errors, so we need to know which ones are from lexing or parsing.
I see that brson here: https://github.com/brson/dada/blob/e2861cc6b0c00af2a4e52aa7d6ad93813ad58818/components/dada-lang/src/test_harness.rs#L519-L549 is comparing against the expected diagnostics. So maybe another option is to juste add something like #! PARSE ERROR?

Ah, I see. So the idea is that we (internally) track the phase of the compiler the error comes from, for the purpose of our testing harness? In particular, we want to know whether it got a parse error, so that we can compare that against the reference grammar?

What if instead we just distinguish parse error vs other error, and we make a separate macro parse_error or something like that? This patch seems kind of noisy and makes reporting errors more confusing. I feel like sometimes errors may change whether they are detected at validation or not and it'd be annoying to wonder if this will affect any tooling (same is true of parse errors, but they seem less likely to change). It'd also be good to document clearly the reason for the is_parse_error: bool flag on diagnostics and its role in testing.

Maybe instead of parse_error it makes more sense to call it grammar_error? Because it will also include lexing errors.

With this changes maybe it doesn't make sense to merge it as a separate PR and it should be part of the reference grammar PR?

@vemoo I was just thinking -- another option is, rather than modifying the Diagnostic struct, it's possible to ask for only the errors that resulted from parsing a given file.
The code for getting diagnostics today is:
https://github.com/dada-lang/dada/blob/0199d1bef32a259b30f5b5b721a89ca5cf16dff4/components/dada-db/src/lib.rs#L55-L60
but we could add another method:
    /// Checks `input_file` for parsing errors and returns relevant diagnostics.
    pub fn grammar_diagnostics(&self, input_file: InputFile) -> Vec<Diagnostic> {
        dada_parse::file_parser::parse_file::<dada_ir::diagnostic::Diagnostics>(
            self, input_file,
        )
    }

and it would just the diagnostics emitted by the parser. Maybe that'd be easier still?

Yeah, I like that. It ended up being a little more complicated: https://github.com/vemoo/dada/blob/29b3718387fe2ae3d4e5498455165d24ac1087b2/components/dada-parse/src/lib.rs#L26-L50 because parse_file leaves some parts unparsed as TokenTrees.
I'm going to close this PR because this change will make more sense in the context of adding a reference grammar.


[Bug] Message of activating keyboard/mouse doesn't disappear when clicking on the message.

Device: Desktop.
OS: Windows 10
Browser: Edge and Chrome
Browser Version: latest version
Better xCloud Version: 3.1.4

I can't play with keyboard and mouse because this message won't disappear from the screen. It only goes away if I disable the keyboard and mouse function.

It didn't happen to me when I tested on both Chrome + Edge in Mac

The new update that came out solved the problem

I didn't fix anything. It was caused your device.


PATCH - sends request to '/api/users' instead of '/api/users/123'

I want to make a partial update to a restangularized object but the problem is that restangular sends a request to '/api/users'  and i need it to send to  '/api/users/123'
My api understands only this request. Can i make it work?
Here is my code:
ModelFactoryService.Users.one(123).get()
            .then(function (response) {
                vm.user = response;
            })
            .catch(function (response) {
                console.log("fail", response);
            });

...

vm.update = function () {
            var user = {}; //partial
            _.forEach(vm.user, function (n, key) {
                if (vm.userForm.hasOwnProperty(key) && vm.userForm[key]["$dirty"]) {
                    user[key] = n;
                }
            });
            vm.user.patch(user)
                .then(function (response) {
                    vm.user = response;
                })
                .catch(function (response) {
                    console.log("fail", response);
                });
        };

I found the problem. I use Spring REST and by default the framework does not trasmit the entity id. So  Restangular didn't have the reference id. I thought that internally it kept it as metadata, since in the request  you explicitly tell it which object you want to get.
When i configured my api to pass the id it workded!


functions: reindent the rabbitmq init

Reindent the subfunction used to restart the rabbitmq cluster. There is
no change except the indentation fixes.

Can you add bash8 check on this script ?
:+1:

I was expecting a new testenv bash8 in tox to test with bash8 on all bash file :-)
But that's fair enough ^^


add coherence to supporters list

thanks!

Sure thing, thanks!

@brikis98 - sure thing, thanks!

@SebastianStadil Could you review and merge?

Added in #91


[question]laplacian function available?

Dear yeatse
I successfully install the opencv-spm in my iOS project.
I want to measure blurr of image, so like following
laplacian = cv2.Laplacian(gray, cv2.CV_64F)
I cannot find the likely command under Imgproc.
Can I measure blurr with this package?

According to the documentation, you need to include <opencv2/imgproc.hpp> in order to use the laplacian function. In Swift, you can call Imgproc.Laplacian instead. For example: Imgproc.Laplacian(src: gray, dst: result, ddepth: CvType.CV_64F).

Dear yeatse
Thanks for your advice.
I tried following code (Sorry cannot copy&Past with correct indent)
let src = Mat(uiImage: UIImage(named: "cat0")!)
// Transform source image to gray if it is not already
let gray: Mat
if (src.channels() == 3) {
gray = Mat()
Imgproc.cvtColor(src: src, dst: gray, code: .COLOR_BGR2GRAY)
} else {
gray = src
}
let out = Mat()
let laplacian: Void = Imgproc.Laplacian(src: gray, dst: out, ddepth: CvType.CV_64F)
print("Laplacian value2: (laplacian)")
But print result (). Because Xcode forced me set Void to use Imgproc.Laplacian call
What wrong?
I just installed your spm with your procedure, not additional header such as <opencv2/imgproc.hpp>
Any advice?

In C++, this function does not return a value. Instead, the result is stored in the out parameter. For further details, please refer the documentation:

Dear yeatse
When I use OpenCV on Python, I can get the value with
**
import cv2
laplacian = cv2.Laplacian(gray, cv2.CV_64F)
print("laplacian.var() value？",laplacian.var())
if laplacian.var() < 100:
text = "Blurry"
else:
text = "Not Blurry"
**
But Dit C++, Swift not support this?

You can ask ChatGPT or New Bing

The equivalent of meanStdDev in Swift is Core.meanStdDev.


bug in test_vic_time.py file

when running run_tests.py for unit tests for the classic driver, there is an error in test_vic_time (should be an error in the classic and image drivers since it's a shared test). Specifically, the error is:

dmy_feb_3_noon = <cdata 'dmy_struct *' owning 16 bytes>, dmy_june31 = <cdata 'dmy_struct *' owning 16 bytes>, dmy_too_many_seconds = <cdata 'dmy_struct *' owning 16 bytes>

    def test_invalid_date(dmy_feb_3_noon, dmy_june31, dmy_too_many_seconds):
        for cal in calendars:
>           assert vic_lib.invalid_date(calendars[cal], dmy_feb_3_noon) == 0
E           AttributeError: cffi library '//anaconda/envs/vic_test_env/lib/python3.5/site-packages/vic-5.0.0.dev_a87d259-py3.5-macosx-10.5-x86_64.egg/vic/../vic_core.cpython-35m-darwin.so' has no function, constant or global variable named 'invalid_date'

I'm pretty sure this was fixed in e17b8d8553a1b1a3b8b92160f9a29852b47d4835.  Can you check to make sure you're testing against the current develop branch?

I just pulled recent changes and am still seeing the error. This is when running run_tests.py as python run_tests.py  unit  --driver classic --output_dir $OUTPUT_DIR --data_dir $DATA_DIR --vic_exe /Users/diana/Dropbox/UW/VIC/vic/drivers/classic/vic_classic.exe

@dgergel  - have you:

rebuilt the classic driver?
rebuilt the python driver (python setup.py install)?

@jhamman I had not rebuilt the python driver. This must have been the issue (although i don't really understand why, since I was testing the classic driver). Not seeing the error now.


chore(testproxy): Change the readModifyWriteRow test proxy so that it uses the handwritten layer

Summary:
Currently the test proxy calls the readModifyWriteRow method in the Gapic layer, but it should use the veneer. This PR includes the changes required to make the readModifyWriteRow test proxy service use the veneer with a properly formed request.
Background:
A previous PR adds a helper method for changing the request passed into the test proxy readModifyWriteRow service into a request suitable for the handwritten layer. In this PR, that helper method is used by the readModifyWriteRow service to form a request for the handwritten layer and the handwritten layer is called is called by this test proxy service as required.
Changes:
test/test-proxy/readModifyWriteRow.ts: This file ensures that the helper method for changing the Gapic request to a format for the handwritten layer prepares the request in the proper format.
test/test-proxy/readModifyWriteRowService.ts: This test file ensures that the Gapic shaped request passed into the test proxy service is exactly the same as the request that reaches the Gapic layer after being transformed and passed through the handwritten layer.
testproxy/services/read-modify-write-row.js: The test proxy service is changed to use the handwritten layer.
testproxy/services/request/readModifyWriteRow.ts: This file contains a getRMWRRequest function which is equivalent to how the client builds a readModifyWriteRequest and a getRMWRRequestInverse function that prepares a Gapic layer shaped request for the handwritten layer. getRMWRRequestInverse does the inverse of getRMWRRequest so that when requests pass through getRMWRRequestInverse and then getRMWRRequest they remain unchanged.
Next Steps:
Now we can address some of the test proxy tests that are failing for this service.

Opening this on https://github.com/googleapis/nodejs-bigtable/pull/1535 instead of forked repo.


Remove Vue Router OG Meta logic

The previous Vue Router OG Meta logic I had does not work for our use case since crawlers from previews act before the meta data gets added.
I removed it and have placed the default preview image statically within index.html instead.
If we want the preview image to be different dynamically we would need a server side rendering solution - and currently we don't have this - which would be a larger task...
Merging this PR would make the title and preview image the same across all pages for dev library.
If we wanted different titles and images, we would need to do my suggestion (or find another alternative)
Thoughts?

LGTM


Crashing issue randomly

Myself and a number of people on my server area crashing frequently, occasionally getting stuck unable to log in. Here's the crash report: https://bytebin.lucko.me/2MnfYOXjCe
I'm at a loss!

It seems to be the same issue as #125, which has already been fixed.


Create Friedrich-Ebert Gymnasium

I want to add my school located in Blissestraße 22, 10713 Berlin, Germany.
Thank you in advance

School Website: https://feoberlin.de/
The School uses Iserv as the email service and offers IT courses from 10th grade and mandatory classes from 7th grade

@JKempiu lib/domains/de/Friedrich-Ebert: this request has an incorrect file path format, please ensure that you are familiar with     this repository rules located at the bottom of this page and change     your request accordingly. If you don't know how to change request, close it and open a new one.     If you are not able to make the pull request according the instructions, please send us an email to<EMAIL_ADDRESS>Please mention this request URL in the message.


Metrics requests hang for downstream cluster after project is created

Rancher Server Setup

Rancher version: v2.6.3-rc6

Information about the Cluster

Kubernetes version:
Cluster Type (Local/Downstream):

If downstream, what type of cluster? (Custom/Imported or specify provider for Hosted/Infrastructure Provider):
do, rke v1.21.7

Describe the bug

After creating project in downstream cluster, requesting the cluster's metrics will never return.
To Reproduce

provision downstream cluster
go to metrics endpoint for cluster: <rancher-url>/metrics/<cluster-id>
go to cluster exporer for downstream cluster and create project
go to metrics endpoint for cluster: <rancher-url>/metrics/<cluster-id>

Result
request never returns
Expected Result

request returns just as it did in step 2
Additional context

I think this is related to a wider issue around how we are deferring handlers. For now, to resolve this immediate issue, one of the commits will be revert. After release the underlying problem should be investigated further.
First observed after this commit: https://github.com/rancher/rancher/commit/0f084bf88bd7056686465dfd685152e549379ae9#diff-8b9c5a67f3c8ee7b7b23a1c4c37b181f8609b84f77e5af638fa6d674d09af32dR44
Looking at profile it seems that rancher is sitting in lock for a suspicious amount of time:

Steps to reproduce:

[Rancher] Provisioned 1 node RKE v1.21.6-rancher1-1 cluster

Installed Rancher onto the Rancher RKE cluster via helm install based on Rancher v2.6.3-rc6
[Downstream Provisioned] Used DO node driver provisioner to provision a RKE1 cluster with v1.21.7-rancher1-1

[Downstream Imported] Provisioned 1 node RKE v1.21.6-rancher1-1 cluster

Imported it into Rancher via Cluster Dashboard UI

On both Downstream Provisioned (c-nq4l2) and Downstream Imported (c-m-kpwp2556), I took the following steps:

Try to access metrics (e.g. https://RANCHER_URL/metrics/CLUSTER_ID) - No errors expected
Go to Cluster Explorer (not Cluster Manager) and add a Project
Try to access metrics again - Requests occasionally hang (reproducible by refreshing the page multiple times, e.g. 3+ refreshes)

Successfully seem to have reproduced the issue!

Upgraded the above setup to v2.6.3-rc7.
Issue is no longer reproducible on the Downstream Provisioned cluster, even on multiple refreshes of the metrics pages.
However, the issue is reproducible on the Downstream Imported Cluster in the latest RC in an upgrade scenario.

Provisioned brand new setup and followed same steps as above for v2.6.3-rc7 fresh install.
However, the issue is reproducible on both the Downstream Provisioned and the Downstream Imported Cluster in the latest RC in an fresh cluster scenario.

Reopening issue

@rmweir is taking over dev-validate for this issue, removing myself

Validated that metrics endpoint is now working after adding a project. Problem appears to be solved as far as we can tell through testing that symptom.


Clear LED define for the VBLUno51, VBLUno52 board.

Clear LED define for the VBLUno51, VBLUno52 board.
Because LED was be used in other file
Signed-off-by: iotvietmember<EMAIL_ADDRESS>

@mkiiskila I hope that this commit could be reviewed soon. Thank you very much

Thanks


Move functions for individual args out of channel_args.{h,cc}.

Ping?

Sorry, missed this. I'll get the review done later today.

Thanks!

I'm not sure why the commits being squashed would hide anything in the diff.
In any case, the only other change here is to remove the unused grpc_channel_args_set_socket_mutator() function.

Known issues: #18637 #18511

All right


feat: Start to implement the polling and the activity drawer

What
Add the batch jobs polling
Start implementing the necessary bits for the jobs to show in the activity drawer

Here is the actual result

Te build  will always failed since it depends on different versions of the packages

Should wait until core develop is merged?

Will publish a pre-release of the core and update the PR accordingly


Fixed affinity and tolerations helm chart issue

I have found affinity and tolerations in deployments are indented wrongly and added Pod Disruption Budget template for keda and metrics.

Since it's shipping a new version it would be good to have @ahmelsayed his signoff as well

Actually I would suggest not to ship a new version yet and waith for new release cycle

Thanks, @tomkerkhove for approving this. I am wondering about the merge conflict since I don't have write access. Will maintainers take care of it?

That's actually something you can fix by merging master in your branch and fixing the conflicts.
Would you mind removing the changes that ship a new version as well please?

@tomkerkhove Done as you wish. Let me know if you have any concerns.

LGTM, thanks for the contribution @viperKiran!


Revert "Kos builder"

Reverts behouba/syzkaller#14

Try to push a new commit with the commit format of syzkaller again. The CI check all the previous commit message format and fail is one is not properly formatted.

Hi @behouba your review is still required.


External user granted access to Azure DevOps repository cannot open it in VsCode for web

I've have been granted access to an Azure DevOps project as an external user. When I try to open a repository in VsCode for web, I receive the following error:

For sake of explanation

Email used to login into external Azure DevOps<EMAIL_ADDRESS>External company which owns repository: company-b

When I log in to Azure DevOps, I'm redirected to the login-page of company-b. However, when I need to re-authenticate opening VsCode in the browser, I'm sent to the log-in page of company-a (I'm not able to choose the other). After I'm logged in, the error message above is shown.
The issue of not being able to log in through company-b's portal when re-authenticating seems to be the root cause.
Version: 1.72.2
Commit: d045a5eda657f4d7b676dedbfa7aab8207f8a075
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36 Edg/106.0.1370.42
Embedder: vscode.dev

/gifPlease
Could I see what you see when you say "I'm not able to choose the other"?

Thanks for reporting this issue! Unfortunately, it's hard for us to understand what issue you're seeing. Please help us out by providing a screen recording showing exactly what isn't working as expected. While we can work with most standard formats, .gif files are preferred as they are displayed inline on GitHub. You may find https://gifcap.dev helpful as a browser-based gif recording tool.
If the issue depends on keyboard input, you can help us by enabling screencast mode for the recording (Developer: Toggle Screencast Mode in the command palette). Lastly, please attach this file via the GitHub web interface as emailed responses will strip files out from the issue.
Happy coding!

Actually this is a dupe of https://github.com/microsoft/vscode-remote-repositories-github/issues/183
/duplicate https://github.com/microsoft/vscode-remote-repositories-github/issues/183
since that has to with access across tenants

Thanks for creating this issue! We figured it's covering the same as another one we already have. Thus, we closed this one as a duplicate. You can search for similar existing issues. See also our issue reporting guidelines.
Happy Coding!


support PEP-582

Why is the change needed?
This add support for PEP-582 through PDM (pypackages). Currently, Creosote only supports dependencies in
the 'site-packages' directory of a venv.
What was done in this PR?
PDM-582 support and updated docs
Are there any concerns, side-effects, additional notes?
I currently don't have tests for this (and maybe someone could help with that) but I've given it a good run through
in every situation I think someone would encounter - and it seems to work great!
Checklist, when applicable

[ ] Added test(s)
[ x] Updated README.md
[ ] Is this a backwards-compatibility breaking change?
[ ] Resolves: #issue-number-here

Hi @lesleslie and thanks for this.
I'm not super keen on having to maintain PEP-582 support since it was rejected. However, I thought this was already kind of supported, apart from the function which looks for the "site-packages" folder (not present int the __pypackages__ dir) which you highlighted here.
Can you please try this version of Creosote, and see if it fits your needs?
# install creosote from pep-582 branch
$ pipx install --suffix=@pep-582 --force git+https://github.com/fredrikaverpil/creosote.git@main

# run creosote from pep-582 branch and point it to look at the __pypackages__ venv
$ creosote@pep-582 --venv __pypackages__

# uninstall
$ pipx uninstall creosote@pep-582

I’ll try that out and let you know.
And yes, apart from the function which looks for the "site-packages” folder , Creosote did work by setting
—venv to pypackages

The commands above did not work for me:
$ creosote@pep-582 --venv __pypackages__ Found dependencies in pyproject.toml: aioconsole, aiopath, click, inflection, pdm-bump, pydantic, tomli-w Oh no, bloated venv! 🤢 🪣 Unused dependencies found: aioconsole, aiopath, click, inflection, pdm-bump, pydantic, tomli-w
I've got no problem maintaining my own fork with PEP-582 support. I thought people may find it helpful, but then again, as far as I know I'm the only one actually using it.

Would be great to better understand why this is not working for you. Since you got this working in your fork, what exactly is missing?
To me, it looks like you did not point Creosote towards your Python source code using the --paths argument, like e.g.
creosote --venv __pypackages__ --paths src

It would be helpful if you could add the --verbose argument to your command and post the output here, so that it'll be easier for me to understand what's happening on your end.

Ok, that worked. I didn't have to set --paths in my version because of:
[tool.pdm.options] config = [     "python.use_venv",     "true", ]
so I got in the habit of not using it. I did however have it set in .pre-commit-config.yaml:
args: [--paths, "myproject"]

Ok, cool. Creosote defaults to --paths src so anyone who does not keep their python source code files in an "src" folder will have to specify a different location.
If this is what you need, I'm happy to merge the work done in #171

Yes, that does the trick.
Thank you!

@lesleslie awesome 🎉 I'll get this released sometime today.


Initiated tutorial for devon4ng architecture

What will the user learn in your tutorial?
What should the user already know when starting the tutorial?

Closing this PR as it is out of date. Covering the issue in https://github.com/devonfw-tutorials/tutorials/pull/121


Anyone expirience with BL proxy from ESPHome on yeelight?

Like the title already say, i was wondering if anybody already tried the new BL proxy feature from ESP home on one of this lights?
Since the Xiaomi BLE creates boot-loops i was wondering if the new Proxy is working better.

I just did. Lost connectivity to my lamp completely. Doesn't even go to the safe mode, need to disassemble and refresh :(

turns out if I disable encryption in my config, lamp even boots, and responds to pings, but refuses connection to 6053 port.

thank you for testing! hope its not too much hustle to bring it down and up again.

Will not work, since in Yeelights they use a stripped version of ESP32 - which uses only 1 core of the 2, so simply don't have enough resources to handle the ESPHome code, and the BT too.

@ExPeacer You are right about the number of CPU cores but are you sure about the limitations? I'm aware of some people running a single core ESP32 with ESPHome and bluetooth in general. It's not as smooth/solid as having two cores but it's possible.

it's also enough resources for the original yeelight firmware. Perhaps it is possible to tune FreeRtos to run both stacks.
Also my board response to pings, when it boots WITH bluetooth stack enabled. But it doesn't respond to api. Unfortunately I don't have tools to boot it properly with serial attached, to see what is going on.

This is the workaround to avoid the boot loop (Task watchdog got triggered. The following tasks did not reset the watchdog in time): https://github.com/syssi/esphome-yeelight-ceiling-light/blob/main/yeelight_light_fancl5.yaml#L8-L13
An unresponsible native API and the assert failed: s_prepare_reserved_regions memory_layout_utils.c:100 looks like other issues.

As far as I'm aware Yeelight uses ESP32s with only 2MB of flash. This issue can be circumvented when using a correct partition table. ESPHome won't flash since the fw would be too big for the two app partitions with bt proxy enabled.
esphome:
  platformio_options:
    board_build.partitions: "../../../boards/2mb_partition.csv"

partition table csv:
# Name,   Type, SubType, Offset,   Size, Flags
nvs,      data, nvs,     ,        0x4000,
otadata,  data, ota,     ,        0x2000,
phy_init, data, phy,     ,        0x1000,
app0,     app,  ota_0,   ,        0xEA640,
app1,     app,  ota_1,   ,        0xEA640,

When trying to flash with bt proxy and partition table:
Error: The program size (1327701 bytes) is greater than maximum allowed (960064 bytes)
RAM:   [==        ]  15.4% (used 50420 bytes from 327680 bytes)
*** [checkprogsize] Explicit exit, status 1
Flash: [==========]  138.3% (used 1327701 bytes from 960064 bytes)


Release 0.16.0

Closes: #314

Codecov Report
Patch coverage: 59.62% and project coverage change: +4.41 :tada:

Comparison is base (86cf932) 28.39% compared to head (b6298c7) 32.80%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #319      +/-   ##
==========================================
+ Coverage   28.39%   32.80%   +4.41%
==========================================
  Files          13       13
  Lines        3480     3972     +492
==========================================
+ Hits          988     1303     +315
- Misses       2492     2669     +177

Impacted Files
Coverage Δ

src/producer.rs
2.16% <0.00%> (-0.14%)
:arrow_down:

src/zeek/network.rs
62.35% <59.71%> (-0.96%)
:arrow_down:

src/migration/network.rs
58.95% <61.11%> (+0.87%)
:arrow_up:

src/migration/tests.rs
100.00% <100.00%> (ø)

src/zeek/tests.rs
100.00% <100.00%> (ø)

... and 1 file with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


[FLINK-28053][sql-gateway] Introduce operation lock to execute operat…

…ion in sequence

What is the purpose of the change
Introduce the operation lock that only one operation per Session can execute simultaneously. The main reason to introduce this feature is the CatalogManager, and ResourceManager are not thread-safe.
Brief change log

Make the Operation an inner class, which is much more convenient to access OperaitonManager resources.
Introduce the lock and Operation should acquire the lock before doing the work.

Verifying this change
This change added tests and can be verified as follows:

Added integration tests for executing the operation in sequence.
Added the IT tests that failed operation will release the operation lock(testCancelAndCloseOperationInParallel and testFailedToSubmitOperationInParallel).

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@flinkbot run azure

@flinkbot run azure


Use environment variables

Hi,
do you have anything against including environment variables as a way to configure web driver and remote URL?
I could make up a patch.

@mpasternak makes sense, no objections

Hi. Thanks for reply. I’ve found a walk around so I’m not exactly interested in adding this functionality now.


Get QR code image

get the qr code of image + do not show browser

Hi, @Eikosa. Thanks for adding this issue.
Can you please add a more detailed description, so that we can get the best possible solution for it? Steps to reproduce, screenshots, and other resources are also welcome.
Thanks a lot in advance.

Hello, I would like to set up alright for my server at bot-hosting.net
Is it still possible to use alright for a server that has no access to the screen?