virtualbox: 5.2.28 -> 6.0.6

Quite some fixing was needed to get this to work. See the discussion and comments in commits and comments.
Things done
Tested host and guest (including desktop) on 19.03, no breakage observed.

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[x] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Assured whether relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@ambrop72 thanks a lot for your work, especially for upstreaming the patches!
However, there's already a WIP PR at https://github.com/NixOS/nixpkgs/pull/53120 - which is blocked on getting the virtualbox VM tests to work again.
I tried running the VM test based on your PR, however, they fail with a different error than there:
machine: must succeed: su - alice -c 'VBoxManage setextradata test2 VBoxInternal/PDM/HaltOnReset 1'
machine# VBoxManage: error: Could not launch a process for the machine 'simple' (VERR_FILE_NOT_FOUND)
machine# VBoxManage: error: Details: code VBOX_E_IPRT_ERROR (0x80bb0005), component MachineWrap, interface IMachine, callee nsISupports
machine# VBoxManage: error: Context: "LaunchVMProcess(a->session, sessionType.raw(), Bstr(strEnv).raw(), progress.asOutParam())" at line 726 of file VBoxManageMisc.cpp

Don't know why I didn't find that, I remember searching. Comparison:

I know about VirtualBox -> VirtualBoxVM setuid, was planning to send that separately as I assumed it's for 5.2 too (not sure though), I will add it here.
fix_kbuild.patch here is the same thing as fix-kernel-module-include.patch in #53120.
fix_module_makefile_sed.patch which is not in #53120 is needed for non-hardening setup to work, otherwise runtime errors result when starting a VM.
fix_printk_test.patch here which is not in #53120 is just cosmetic (prevents interesting kernel messages).
#53120 removed i686-linux platform, not sure why, maybe just because nobody tests it?
#53120 doesn't have the guest-additions zlib fix, this problem can be seen when using with nixops (missing library error).
#53120 removed fix_kernincl.patch in guest additions, I suppose it's unneeded, I will try removing it too.
I think my adjustment of qtx11extras.patch is better (will break less in the future and avoids unneeded linking to Qt5X11Extras).

How does one run the VM test?

No worries! Thanks a lot for taking the time! I hope not too much effort was duplicated…
Given patches were already sent to upstream as used here, it might makes sense to continue in this PR.
Could you incorporate the other changes from #53120 in here, and copy over the PR checkboxes?

#53120 removed i686-linux platform, not sure why, maybe just because nobody tests it?

Oracle mentions 32-bit support as being discontinued:
from https://www.virtualbox.org/wiki/Downloads:

If you're looking for the latest VirtualBox 5.2 packages, see VirtualBox 5.2 builds. Please also use version 5.2 if you still need support for 32-bit hosts, as this has been discontinued in 6.0. Version 5.2 will remain supported until July 2020.

I'm not sure if they actively dropped any code, but given even they don't test it, it probably makes sense to drop support on our side, too.

How does one run the VM test?

nixos vm tests can be run via nix-build -A nixosTests.virtualbox (or nix-build nixos/tests/virtualbox.nix --arg enableUnfree true -I nixpkgs=$PWD if you want to run the unfree tests, too).
As explained in #53120, I guess the problem is somehow related due to the tests being run inside a qemu vm, but we can't really run tests elsewhere currently (see https://github.com/NixOS/nixpkgs/issues/5241 for that discussion)…

I've added all relevant changes from #53120 to this PR.
I don't have the same error with the NixOS tests but a guru medidation from virtualbox in the kvm guest:
machine# [   32.548367] GUEST-headless[1188]: [    6.559399] io scheduler noop registered
machine# [   32.558857] GUEST-headless[1188]: [    6.569958] io scheduler deadline registered
machine# [   32.571355] GUEST-headless[1188]: [    6.581486] io scheduler cfq registered (default)
machine# [   32.588894] GUEST-headless[1188]: [    6.595775] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
machine# [   32.606390] GUEST-headless[1188]: [    6.611486] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
machine# [   32.625210] GUEST-headless[1188]: [    6.631288] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
machine# !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
machine# !!
machine# !!         VCPU0: Guru Meditation -2403 (VERR_TRPM_DONT_PANIC)
machine# !!
machine# !! TRAP=0e ERRCD=0000000000000010 CR2=00000000a082bf60 EIP=a082bf60 Type=0 cbInstr=ff
machine# !! EIP is not in any code known to VMM!
machine# !!
machine# !!
machine# !!

which is then followed by tons of hex values. This error is the same as encountered in #53120. I have then found this, which I believe to be about the same bug in VirtualBox: https://forums.virtualbox.org/viewtopic.php?f=6&t=91974. In that case they got an almost identical guru meditation, with VirtualBox using SW virtualization (like these NixOS tests do, that's why they must run a 32-bit guest) which happens when a program opens a serial port (but with windows host and guest). That the last kernel message before our crash is about initializing the serial port suggests this is the same problem.
I have then tried enabling nested virtualization in KVM:

On my NixOS sytem: boot.extraModprobeConfig = "options kvm-intel nested=Y";
In nixpkgs/nixos/tests/virtualbox.nix: added virtualisation.qemu.options = ["-cpu" "host"]; just below virtualisation.memorySize = 2048;.

That actually went surprisingly well, it does seem like VirtualBox is successfully using hardware virtualization within KVM (but I would have to confirm by looking at the VirtualBox machine log). But there is an error with mounting vboxsf in the guest initrd:
machine# [   57.708212] GUEST-test1[1388]: [   30.960936] ata29: SATA link down (SStatus 0 SControl 300)
machine# [   58.070847] GUEST-test1[1388]: [   31.328555] ata30: SATA link down (SStatus 0 SControl 300)
machine# [   58.136735] GUEST-test1[1388]: [   31.395590] sd 0:0:0:0: [sda] 204800 512-byte logical blocks: (105 MB/100 MiB)
machine# [   58.182420] GUEST-test1[1388]: [   31.451239] sd 0:0:0:0: [sda] Write Protect is off
machine# [   58.221397] GUEST-test1[1388]: [   31.486002] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
machine# [   58.273606] GUEST-test1[1388]: [   31.523178] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
machine# [   58.315176] GUEST-test1[1388]: [   31.590331]  sda: sda1
machine# [   58.349428] GUEST-test1[1388]: [   31.615236] sd 0:0:0:0: [sda] Attached SCSI disk
machine# [   58.531087] GUEST-test1[1388]: + kbd_mode -u -C /dev/console[   31.796150] stage-1-init: + kbd_mode -u -C /dev/console
machine# [   58.551821] GUEST-test1[1388]:
machine# [   58.575680] GUEST-test1[1388]: %Gkbd_mode: KDSKBMODE: Inappropriate ioctl for device
machine# [   58.611712] GUEST-test1[1388]: + printf '\033%%G'[   31.872347] random: lvm: uninitialized urandom read (4 bytes read)
machine# [   58.630747] GUEST-test1[1388]:
machine# [   58.660727] GUEST-test1[1388]: [   31.918082] stage-1-init: kbd_mode: KDSKBMODE: Inappropriate ioctl for device
machine# [   58.683391] GUEST-test1[1388]: + loadkmap
machine# [   58.701572] GUEST-test1[1388]: + echo 'starting device mapper and LVM...'
machine# [   58.713662] GUEST-test1[1388]: starting device mapper and LVM...
machine# [   58.731231] GUEST-test1[1388]: + lvm vgchange -ay
machine# [   58.751559] GUEST-test1[1388]: [   32.020318] stage-1-init: + printf '\033%%G'
machine# [   58.783469] GUEST-test1[1388]: [   32.053469] stage-1-init: + loadkmap
machine# [   58.825016] GUEST-test1[1388]: [   32.084754] stage-1-init: + echo 'starting device mapper and LVM...'
machine# [   58.867346] GUEST-test1[1388]: [   32.128324] stage-1-init: starting device mapper and LVM...
machine# [   58.903963] GUEST-test1[1388]: [   32.170289] stage-1-init: + lvm vgchange -ay
machine# [   58.939453] GUEST-test1[1388]: + test -n [   32.211719] stage-1-init: + test -n
machine# [   58.958317] GUEST-test1[1388]:
machine# [   58.977025] GUEST-test1[1388]: + test -e /sys/power/resume -a -e /sys/power/disk
machine# [   58.987728] GUEST-test1[1388]: + test -n
machine# [   58.994578] GUEST-test1[1388]: + test -n
machine# [   59.027920] GUEST-test1[1388]: [   32.281629] stage-1-init: + test -e /sys/power/resume -a -e /sys/power/disk
machine# [   59.082373] GUEST-test1[1388]: + mkdir -p /mnt-root[   32.340608] vboxsf: No mount data. Is mount.vboxsf installed (typically in /sbin)?
machine# [   59.126313] GUEST-test1[1388]: [   32.395357] vbsf_read_super_aux err=-22
machine# [   59.144763] GUEST-test1[1388]:
machine# [   59.150752] GUEST-test1[1388]: + exec
machine# [   59.159521] GUEST-test1[1388]: + read -u 3 mountPoint
machine# [   59.168249] GUEST-test1[1388]: + read -u 3 device
machine# [   59.175655] GUEST-test1[1388]: + read -u 3 fsType
machine# [   59.184951] GUEST-test1[1388]: + read -u 3 options
machine# [   59.199342] GUEST-test1[1388]: [   32.472041] stage-1-init: + test -n
machine# [   59.220147] GUEST-test1[1388]: + pseudoDevice=
machine# [   59.228767] GUEST-test1[1388]: + pseudoDevice=1
machine# [   59.235017] GUEST-test1[1388]: + test -z 1
machine# [   59.253576] GUEST-test1[1388]: + udevadm settle[   32.526592] stage-1-init: + test -n
machine# [   59.269318] GUEST-test1[1388]:
machine# [   59.274870] GUEST-test1[1388]: + '[' -n  ]
machine# [   59.316404] GUEST-test1[1388]: + mountFS vboxshare / defaults vboxsf[   32.574887] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000100
machine# [   59.323288] GUEST-test1[1388]: [   32.574887]
machine# [   59.384964] GUEST-test1[1388]: [   32.643752] CPU: 0 PID: 1 Comm: init Tainted: G           O    4.9.171 #1-NixOS
machine# [   59.652395] GUEST-test1[1388]: [   32.902316] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
machine# [   59.748346] GUEST-test1[1388]: [   32.966723]  edcc3f04 de8c85cc edcd8000 decb4e60 edcc3f1c de7599c5 decb4e60 edcd8000
machine# [   59.837885] GUEST-test1[1388]: [   33.048874]  decb4e60 edd03ce4 edcc3f60 de667e68 dec013c8 00000100 00000000 00000000
machine# [   59.914608] GUEST-test1[1388]: [   33.136403]  00000249 edcd843c 01000000 edfcc040 de66822f 00000003 edcc3f4c edcc3f4c
machine# [   59.939345] GUEST-test1[1388]: [   33.215372] Call Trace:
machine# [   59.971934] GUEST-test1[1388]: [   33.241521]  [<de8c85cc>] dump_stack+0x58/0x7c
machine# [   60.005227] GUEST-test1[1388]: [   33.275323]  [<de7599c5>] panic+0x94/0x1d1
machine# [   60.040485] GUEST-test1[1388]: [   33.307803]  [<de667e68>] do_exit+0xa38/0xa40
machine# [   60.075254] GUEST-test1[1388]: [   33.341565]  [<de66822f>] ? SyS_waitpid+0x6f/0xe0
machine# [   60.110461] GUEST-test1[1388]: [   33.376187]  [<de667ee7>] do_group_exit+0x37/0x90
machine# [   60.152886] GUEST-test1[1388]: [   33.416403]  [<de665df0>] ? task_stopped_code+0x60/0x60
machine# [   60.196942] GUEST-test1[1388]: [   33.458489]  [<de667f56>] SyS_exit_group+0x16/0x20
machine# [   60.235829] GUEST-test1[1388]: [   33.500336]  [<de6037a9>] do_fast_syscall_32+0x99/0x170
machine# [   60.273837] GUEST-test1[1388]: [   33.539722]  [<deb13902>] sysenter_past_esp+0x47/0x75
machine# [   60.322656] GUEST-test1[1388]: [   33.576092] Kernel Offset: 0x1d600000 from 0xc1000000 (relocation range: 0xc0000000-0xf07effff)
machine# [   60.363095] GUEST-test1[1388]: [   33.634888] Rebooting in 1 seconds..
machine# [   61.413719] GUEST-test1[1388]: [   34.685497] ACPI MEMORY or I/O RESET_REG.

This needs to be debugged, I think it's just a regression due to the VirtualBox update. If this works out then at least the tests will work with some manual intervention (enabling nested KVM on Hydra builders is probably not a smart idea because the feature is experimental).

With nested KVM I have gotten several tests (probably all others) to work except simple-gui. It is timing out wating for the VM to start. Maybe sending just an enter press no longer works to start the VM. The output says screenshots were made but since the build fails I think they are lost. Build output.

With the current state of this PR, the tests pass for me. The precondition is enabling nested KVM on the build machine, by adding options kvm-intel nested=Y (or kvm-amd) to boot.extraModprobeConfig.
Needed changes were:

The vboxsf mount error (and resulting kernel panic) was fixed by ensuring that mount.vboxsf has glibc in RUNPATH. The actual errors from mount were somehow lost in buffers once the kernel panicked from init exiting. Along the way I refactored the additions package, with a side effect that RUNPATH stripping is now done as it should be.
Two issues due to dlopen() of libdbus failing (in VBoxService and systemd-detect-virt) were fixed by adding libdbus to LD_LIBRARY_PATH.
The GUI test was fixed by updating the key sequence sent to the VirtualBox Manager to start the VM.
Added the needed cpu option for qemu-kvm to enable nested virtualization, and comments to the top of the file explaining the requirement for the build machine.

I added another commit with the latest fixes. Tests still pass. Is there anything else to do before it can be merged?

I was mistaken about systemd-detect-virt needing libdbus, that is not the case. I must have confused the error messages (the test output is quite messy). So I updated the latest commit to completely remove the LD_LIBRARY_PATH in the tests, which still pass.

Should I merge these commits all into one, so they can easily be cherry-picked by anyone who wants it on release versions?

Can we switch between "hardware virtualization, 64 bit guest" and "software virtualization, 32 bit guest" via some argument, similar to enableUnfree?

I will add a flag to control whether HW- or SW-virt is used, and what bitness guest is used, independently, with an assert that SW-virt requires 32-bit guest.

I will try to reproduce the SW virt problem, but I am not sure I will be successful.

Should I merge these commits all into one, so they can easily be cherry-picked by anyone who wants it on release versions?

I'm a bit confused with the github temporary anomaly, but yes please - we probably might want to cherry-pick this to 19.03 too, or should at least have the option to.

Amazing work @ambrop72, thanks for digging into this further. :beer:

I definitely owe @ambrop72 a :beer: at NixCon ;-)

Filed the VirtualBux bug for the guru meditation: https://www.virtualbox.org/ticket/18632
Basically, it is an issue specific to using software virtualization AND enabling a serial port. Reproducing it was tricky because on common configurations (i.e. modern 32-bit kernels with modern CPUs and VBox software virtualization), guests kernel-panic before the point where the guru meditation occur. That can be worked around by setting the --cpu-profile option on the VM (see ticket), which is unnecessary for NixOS tests because the KVM VM already presents an older CPU.
I pushed all the changes as a single commit. The tests now run with SW virtualization as before but disable the virtual UART to work around the guru meditation (this suppresses all console output from guests). There are now flags to enable nested KVM, to turn the UART back on and to run 64-bit guests (the latter two require nested KVM). 64-bit guests in fact work (all that is different is the machine system and the virtualbox ostype option).
Let's get this merged now.

Manually ran unfree tests too, and spinned up a real VM, looks good :-)
Let's merge this :rocket:!
Again, thanks for all the great work done here!

The VirtualBox serialport will be fixed in the next maintenance release! https://www.virtualbox.org/ticket/18632#comment:1

awesome! I also see some of your patches being mainlined: https://github.com/flokli/virtualbox/commit/e9a91b9dc332462d7461894af1a9d20b8154c52f :-)


Bump openapi validators to v11

Version 11 of these validators contains various fixes that it would be nice to have, including this, which I just encountered. Means that a totally valid parameter like this currently fails jest-openapi validation:
{
  "in": "query",
  "name": "limit",
  "required": false,
  "schema": {
    "exclusiveMinimum": true,
    "minimum": 0,
    "type": "number"
  }
},

Guess not then 😉

Sorry, have been really busy starting a new job. Thanks for raising this, will merge the improvement when I have a chance

Ah no worries, thanks!
On Sat, 25 Jun 2022, 02:43 Richard Waller, @.***> wrote:

Sorry, have been really busy starting a new job. Thanks for raising this,
will merge the improvement when I have a chance
—
Reply to this email directly, view it on GitHub
https://github.com/openapi-library/OpenAPIValidators/pull/281#issuecomment-1166167222,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABLABMJCDCZ5HKXIOOOY5ODVQZP2VANCNFSM5WB2P34A
.
You are receiving this because you modified the open/close state.Message
ID: @.***>


No results with YGG

Hi,
This is my log : http://paste.ubuntu.com/p/TQVZ58Dcwh/
I tried to research a tv show on Elementum but no results with Ygg. However, the tv show is on ygg : https://www2.yggtorrent.gg/engine/search?name=harry+quebert&do=search
(It's an example, but No results from Ygg for any search)
I tried plugin video Elementum 0.0.67 with Element Burst 0.0.32 but nothing, tried 0.0.66 with Burst 0.0.32 but nothing.
I really don't understand.
Furthermore, when I use a VPN in USA, i have no results from Torrent9, why ?
Thanks a lot

Furthermore, when I use a VPN in USA, i have no results from Torrent9, why ?

0.0.67 Does not have Cloudflare bypass functionality.
You can try Elementum 0.0.68 for your issue.

How to install it ?
I need plugin video 0.0.68 I think...
This new version solves problems with YGG ?
Thanks

@chicungunya you have to provide log files (with 0.0.68).
http://elementum.surge.sh/contribute/log/

@chicungunya and make sure you enable internal proxy.

Ok my logs with VPN in USA : http://paste.ubuntu.com/p/J5qPHDPMZT
My logs without VPN in USA : http://paste.ubuntu.com/p/zTgddJCMJ2
Tried with movie : Venom
With my Trakt Collection
But for me, the most important problem is YGG because I need results
Internal DNS resolver is enabled
Build HTTP is enabled too (I tried to disable both but same results)

Internal proxy is disabled. Elementum -> Proxy -> Use internal proxy, Burst -> Use elementum proxy
You probably have alias set for yggtorrents, because it uses wrong domain name (which is not in burst).

You re the best. All is good !

Great!

Hi,
Problem is come back. No results with YGG and I don't change any settings.

Need to know if Elementum search pack season ? Public and Private trackers ? Because i have no results with pack season.

Logs : http://paste.ubuntu.com/p/HfPvSTnrPd/
Thanks

YGG has probably changed something again, search url is wrong.

I tried with and without alias and it’s not working too
Le jeu. 27 déc. 2018 à 16:24, Denis<EMAIL_ADDRESS>a écrit :

Looks like you have custom domain for yggtorrent, because I see wrong
domain name in the log.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/elgatito/script.elementum.burst/issues/96#issuecomment-450233842,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AYuaj-dXigifbYE4FZZhv8_FTJCq7O2dks5u9TqYgaJpZM4ZYzNX
.

--
Cordialement,
Daniel Guedj

It is working without any alias and with correct login/password.
If not in your case  - provide log file.

Ok it works now without alias.
What about pack season ?
Thanks

Every provider has own queries for handling season search. If you search from elementum menu, not from Kodi library.

Hello,
I'm back haha.
I have no results for YGG since a long time now.
This is my log : http://paste.kodi.tv/tocohecede
I try to watch this : https://www2.yggtorrent.gg/torrent/filmvidéo/série-tv/434322-vernon+subutex+s01e01+french+720p+hdtv+x264-sh0w
Thank you !


Neofetch output display is incomplete

Description
Using neofetch in kali wsl will result in incomplete output results, as shown in the following figure
Neofetch version
Neofetch 7.1.0
Screenshot

Similar to #2217, #2209. Fixed in HyFetch 1.4.3 / neowofetch 7.3.3 by the pull request https://github.com/hykilpikonna/hyfetch/pull/24.

HyFetch is a fork of neofetch with LGBTQ pride flags, but the repo also maintains an updated version of the original neofetch, addressing many pull requests that are not merged in the original repo.
Read the "Running Updated Original Neofetch" section for more info!


Enable IPv6 in libmilter

To replace https://github.com/NixOS/nixpkgs/pull/5813
sorry for creating too many of these, I'm still improving my git skills

cc @rbvermaa

Built locally. Merged thanks, I can revert if @rbvermaa doesn't agree.


Removing Redundant columns in Credit Trade History

#799
Removed is_internal_record, note, update_user and update_timestamp
Changelog:

is_internal_record seems to be an old column that's no longer being used
note has migrated to the comments table
update_user and update_timestamp columns are redundant as they will never change from create_user and create_timestamp

 Data Model | Remove unnecessary columns from the CreditTradeHistory table |2|


yt-dlp: add option to install a youtube-dl alias

Motivation for this change
youtube-dl development seems to have stalled and yt-dlp is the de-facto upstream
nowadays. This provides an easy way to use yt-dlp as a drop-in replacement:
youtube-dl = yt-dlp.override { withAlias = true; };

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Last commit is from 2021-07-01. If this goes on, how would we inform users of the inactivity? Would we switch youtube-dl to yt-dlp silently? Would we have meta.deprecated = true; and permittedDeprecatedPackages?

youtube-dl is still maintained software, so it should not be deperacted
I'm not so sure if we should be the ones propagating the information (again, yt-dl isn't fully dead yet) or if people should just find out from others


Reverse the ordering of the "Project Road Map".

Is just more easy and familiar to scheme that way ;)

Fair enough, and an easy change. Done.


initialValue types

Hello, I see that initialValue must be File, String or Uint8List and this is perfect, but I don't understand why Uint8List is just valid in case of web apps. It could be a case of use in android or ios. Anyways when someone is developing an app could be helpful know in what case which type is correct.

Here is the PR
https://github.com/danvick/form_builder_image_picker/pull/10
This is something that I need in my project and I don't understand the reason why you don't allow Uint8List for mobile apps


Update INTRO.pd with piloslib/ folder declare

Can now keep piloslib in a folder called piloslib in the root directory of the primary patch.
Useful for integrating with other libraries.

Thank you Kyle, much needed :)


Incremental DOM vs Mithril Render

Have you guys take a look at https://github.com/google/incremental-dom?
Do you think it is faster than the Mithril rendering engine? Would be possible to use this approach in a Mithril app?

According to this benchmark, Incremental DOM is much faster.

I'm taking inspiration from cito.js for the rewrite that I'm currently working on

Great @lhorie, I'm looking forward to that!

@lhorie definitely worth working with @joelrich. I know he's working on a "new" version of Cito too and the cross-over would be obvious. I can put you in contact via email as I know Joel is on the road currently?


[llvm] Investiage regression in javacpp 10.0.1

When updating to LLVM 10.0.1/llvm-platform 10.0.1-1.5.4 a regression occured for LLVMMemoryManagerFinalizeCallback.
Previously, this function had a signature of (Pointer?, BytePointer?) -> Int, but in the most recent update, it has a signature of Pointer?, PointerPointer<*>?) -> Int
Investigating this should compare the two versions (10.0.0-1.5.3, 10.0.1-1.5.4). This is could be LLVM changing the function signature.

It seems this regression is caused by the following patch to javacpp-1.5.4
https://github.com/bytedeco/javacpp/commit/cc81ce726c5d15071e6f0dce0dad0913df9dee0a


Create hybridge.txt

chore: Added Hybridge Education school to the domain list.

There's the proof of the school:

Web: https://hybridge.education/en/
-RVOE (School Validation at Mexico Government): https://hybridge.education/rvoe/ and RVOE Validation.xls

You can also check at gov page the validation of the school by putting the state AGUASCALIENTES and institution as HYBRIDGE keyword https://sirvoes.sep.gob.mx/sirvoes/mvc/consultas

-Hub: I use this domain to get my classes https://hub.hybridge.education/ you can only with mails @hybridge.education from Google Auth.

@AntonBronnfjell First stage of verification passed, official domain for Hybridge Education is hybridge.education as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.


integration: Adding Gnocchi

Gnocchi can be used as remote endpoints and storage.
This change adds this in the documentation.

@brian-brazil thx, I have proposed some patches on Gnocchi side related to your comment.

Thanks!


Getting error while loading OMOP dataset

While loading the OMOP dataset I am getting the following error.

Please change "root" to
https://storage.googleapis.com/pyhealth/synpuf1k_omop_cdm_5.2.2

While loading the OMOP dataset I am getting the following error.

Have you solved the problem?


error when I try to delete a function layer

Before opening, please confirm:

[X] I have installed the latest version of the Amplify CLI (see above), and confirmed that the issue still persists.
[X] I have searched for duplicate or closed issues.
[X] I have read the guide for submitting bug reports.
[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
15.4
Amplify CLI Version
lastest
What operating system are you using?
ubuntu
Amplify Categories
function
Amplify Commands
delete
Describe the bug
i have this error when i try to delete a function layer
An error occurred fetching the latest layer version metadata for "globaloappsync": User: arn:aws:sts::421220596947:assumed-role/us-west-2_Dahu8Z0Vx_Full-access/amplifyadmin is not authorized to perform: lambda:ListLayerVersions on resource: arn:aws:lambda:us-west-2:421220596947:layer:globaloappsync-staging
Expected behavior
delete the function
Reproduction steps
amplify remove function
GraphQL schema(s)

# Put schemas below this line

Log output

# Put your logs below this line

Additional information
No response

Hey @royalcala :wave: thanks for raising this! This is due to missing list:LambdaLayerVersions permissions from the amplifyadmin role created by Admin UI, and is being actively tracked by this issue: https://github.com/aws-amplify/amplify-adminui/issues/329
To mitigate in the meantime, please use a local AWS profile with AdministratorAccess-Amplify permissions. This can be changed in your active project by running amplify configure project and choosing to configure AWS Profile setting


HDDS-4584. Coverage not updated since TLP

What changes were proposed in this pull request?
Fix the name of the repository for which coverage data is to be uploaded in post-commit workflow.
https://issues.apache.org/jira/browse/HDDS-4584
How was this patch tested?
Validated workflow file (for syntax errors) by running in own fork.  The fix itself is not verified, since it only applies to apache/ozone repo.

Thanks @vivekratnavel for the review.

Coverage is now updated:
https://app.codecov.io/gh/apache/ozone/branch/master/commits?page=1


ci(pie-monorepo): DSW-000 generate QR code for preview deployments.

Describe your changes (can list changeset entries if preferable)
Author Checklist (complete before requesting a review)

[ ] I have performed a self-review of my code
[ ] If it is a core feature, I have added thorough tests
[ ] If it is a PIE Docs change, I have reviewed the Docs site preview
[ ] If it is a component change, I have reviewed the Storybook preview
[ ] If there are visual test updates, I have reviewed them properly before approving

Reviewer checklists (complete before approving)
Reviewer 1

[ ] If it is a PIE Docs change, I have reviewed the PR preview
[ ] If there are visual test updates, I have reviewed them

Reviewer 2

[ ] If it is a PIE Docs change, I have reviewed the PR preview
[ ] If there are visual test updates, I have reviewed them

Closing this as the github actions available aren't great. Will write my own instead :)


sync upstream main branch to downstream

Sync the upstream changes from csi-addons/kubernetes-csi-addons:main into the
main branch. The most important recent changes that we want included are:

113628da reclaimspace: do not report Unimplemented as an error
rebases of some vendored dependencies
generation of yaml files and inclusion in the repo (not used for deployment by operator)

/lgtm


include activation number in the revm_spec

I've given this a lot of thought, currently we kinda random guess when it comes to the revm_spec function using an if/else statement, this is more optimized if the number of forks is small and the number of operations we do is small and let's assume we have more recent forks we are checking (this should be very true), that's why the initial check was from recent to oldest I guess)
if we include an activation number, we can leverage for times or conditions when we do not check for the most recent forks, leverage on numbers instead of checking each condition
think of it this way, we are in a hotel, moving inside an elevator, we are going to the room at the top floor, but we don't know it yet, so we keep searching each room number from the lowest floor till we get to the one we want but what if we had the number of the room we wanted to go to we can simply just go there instead of checking each room for the one we want
we don't actually need to include an activation number or we might don't know tbh we can just need to label each one numerically from the oldest to the newest, using this we can optimize for the recent fork as well as the older one
of course we are still random guessing only now we don't have to search each rooms and we can just pick a section to search instead

unclear what you're proposing here, but tracking the block activation numbers is a lot of extra work if the timestamp works similarly.
imo this conversion is fine


deel-lip does not work with tf2.6

As tf 2.6 does not include keras, import tf.keras.... breaks. This is not the case with tf 2.5 nor tf 2.7.
A quick fix is to remove support for 2.6. A better fix would be to re-route keras imports specifically for tf2.6

The bug is present in Tensorflow versions 2.6.0 and 2.6.1 when using keras==2.7.0. It can be fixed by manually installing keras==2.6.0 along with TF 2.6.0 or 2.6.1.
Tensorflow 2.6.2 works correctly, since it enforces Keras to be 2.6.0. For more information, see https://stackoverflow.com/a/69830680/17578620
Since it is not a bug related to deel-lip, but only related to TF/Keras, I think it's preferred not to change anything in deel-lip. However, if necessary, we could add a disclaimer to warn users that TF and Keras versions must match for 2.6.*.


Restore reporting of ignore empty directories to scans

We report that we ignore empty directories for normalization strategies which
ignore them always to build scans. This was accidentally removed in #21625, this
PR brings back the old behaviour.

@bot-gradle test and merge

OK, I've already triggered a build for you.


Scaling CPU intensive cron jobs - dedicated server for Cron?

We have 3 production servers (DigitalOcean) running our Meteor app (Using Mupx, Cluster) and these contain SyncedCron jobs doing various background tasks regularly. The server CPUs have recently started getting maxed out and I am  now considering moving all background cron jobs to a separate dedicated server so it does not affect the main app.
My question is, is it possible to run SyncedCron only on a single server?
I think there might be 2 ways to do this:

On the dedicated server running the same meteor app, have an environment variable set to run Cron jobs:

  job: function() {
    if (process.env.RUN_BACKGROUND_TASKS === ‘true’) {
       // do some task
    }
  }

This will make the Cron jobs to only run on that one server.. (Is there some configuration in SyncedCron which can help me do this?)

Create a separate Meteor app which shares the database with the the main app. This app will contain the cron jobs.

Could this package help in this scenario in some way?

@niranjans Yes this is totally possible and you are right in your suggestions.
Essentially suggestion 1 or 2 is fine - I normally run cron on the database server itself  so it can just deal with the tasks and get it done fast. I don't have anything else going on just the database and cron running.
You can add a conditional in your code to check for that via a environmental variable as you suggest.


Azure Core: handling of long-running operations

The core must provide facilities for handling Azure async operations.  This would likely contain primitives for custom end-to-end polling (e.g. some kind of promise/future abstraction) along with a synchronous blocking call.

@RickWinter, @JeffreyRichter - Is this issue still relevant for embedded C or can we close it?

Close it for now. We have nothing that requires this at this time.
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows 10
From: Ahson<EMAIL_ADDRESS>Sent: Friday, July 10, 2020 4:32 PM
To<EMAIL_ADDRESS>Cc: Jeffrey<EMAIL_ADDRESS><EMAIL_ADDRESS>Subject: Re: [Azure/azure-sdk-for-c] Azure Core: handling of long-running operations (#18)
@RickWinterhttps://github.com/RickWinter, @JeffreyRichterhttps://github.com/JeffreyRichter - Is this issue still relevant for embedded C or can we close it?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/Azure/azure-sdk-for-c/issues/18#issuecomment-656937895, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AARLJP6W25HG7HJ3N4UUAK3R26QHFANCNFSM4ITWYMAA.


Replace templated config selectors for user Slurm job profiles

Reference Issues or PRs

What does this implement/fix?

Replace the previous git installation of batchspawner with the latest release, batchspawner==1.3.0
Add batchspawner into jupyterlab environment, as it is a requirement to launch the slurm jobs
Set jupyterlab environment as base environment for running the sbatch script
Updated miniforge version, as it ships a newer mamba version for more stable/fast environment builds
Added new function to generate user profiles base on new config options jupyterhub_profiles
Add new config option jupyterhub_profiles

Put a x in the boxes that apply

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds a feature)
[ ] Breaking change (fix or feature that would cause existing features not to work as expected)
[ ] Documentation Update
[ ] Code style update (formatting, renaming)
[ ] Refactoring (no functional changes, no API changes)
[ ] Build related changes
[ ] Other (please describe):

Testing

[ ] Did you test the pull request locally?
[ ] Did you add new tests?

Documentation

Access-centered content checklist
Text styling

[ ] The content is written with plain language (where relevant).
[ ] If there are headers, they use the proper header tags (with only one level-one header: H1 or # in markdown).
[ ] All links describe where they link to (for example, check the Nebari website).
[ ] This content adheres to the Nebari style guides.

Non-text content

[ ] All content is represented as text (for example, images need alt text, and videos need captions or descriptive transcripts).
[ ] If there are emojis, there are not more than three in a row.
[ ] Don't use flashing GIFs or videos.
[ ] If the content were to be read as plain text, it still makes sense, and no information is missing.

Any other comments?

Using the default configuration:
jupyterhub_profiles:
  - default:
      display_name: default
      options:
        req_memory: "2"
        req_nprocs: "1"

The job was successful


Set-Content expects different argument order when -NoNewline is specified

PowerShell 7.0.3.
When I type Set-Content aaa bbb, the file aaa is created with the content bbb.
When I type Set-Content -NoNewline aaa bbb, the file bbb is created with the content aaa.
It's quite unexpected (especially that it seems that the documentation doesn't mention that).
(Additionally, when I call Set-Content -NoNewline aaa $specificLongText, I get the blue screen of death on my Windows 10 — though I'm not sure whether it's related to PowerShell, it might be that some other software misbehaves when a file with weird name is tried to be created.)
Steps to reproduce
Set-Content -NoNewline aaa bbb
Get-Content aaa,bbb

Expected behavior
bbb
Get-Content: Cannot find path 'C:\Test\bbb' because it does not exist.

Actual behavior
Get-Content: Cannot find path 'C:\Test\aaa' because it does not exist.
aaa

Environment data
Name                           Value
----                           -----
PSVersion                      7.0.3
PSEdition                      Core
GitCommitId                    7.0.3
OS                             Microsoft Windows 10.0.19041
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

This is a parameter binder bug, assign to myself to further investigation/triage.

(Not a blocker for me personally, but still happens in 7.3.9.)

(Not a blocker for me personally, but still happens in 7.4.2.)

Reopen?

Hello?


[Feature]:Can support the ClickHouse database?

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Here is a discussion about this,  welcome.  #322

Already supported, #784


7/7/2020 Publish

Docs Build status updates of commit 6bdbe1c:
:clock10: Full build: the average full build time is 7 min(s) 48 sec(s), this is based on the last 732 build(s) for this repository.

Docs Build status updates of commit 6bdbe1c:
:warning: Validation status: warnings

File
Status
Preview URL
Details

latest/docs-ref-autogen/TOC.yml
:warning:Warning
View (azure-cli-latest)
Details

2017-03-09-profile/docs-ref-autogen/TOC.yml
:white_check_mark:Succeeded
View (azure-cli-2017-03-09-profile)

2017-03-09-profile/docs-ref-autogen/ext/aks-preview/aks.yml
:white_check_mark:Succeeded
View (azure-cli-2017-03-09-profile)

2017-03-09-profile/docs-ref-autogen/ext/databricks/databricks.yml
:white_check_mark:Succeeded
View (azure-cli-2017-03-09-profile)

2017-03-09-profile/docs-ref-autogen/ext/databricks/databricks/workspace.yml
:white_check_mark:Succeeded
View (azure-cli-2017-03-09-profile)

2017-03-09-profile/docs-ref-autogen/ext/databricks/databricks/workspace/vnet-peering.yml
:white_check_mark:Succeeded
View (azure-cli-2017-03-09-profile)

2017-03-09-profile/docs-ref-autogen/ext/databricks/index.yml
:white_check_mark:Succeeded
View (azure-cli-2017-03-09-profile)

2018-03-01-hybrid/docs-ref-autogen/TOC.yml
:white_check_mark:Succeeded
View (azure-cli-2018-03-01-hybrid)

2018-03-01-hybrid/docs-ref-autogen/ext/aks-preview/aks.yml
:white_check_mark:Succeeded
View (azure-cli-2018-03-01-hybrid)

2018-03-01-hybrid/docs-ref-autogen/ext/databricks/databricks.yml
:white_check_mark:Succeeded
View (azure-cli-2018-03-01-hybrid)

2018-03-01-hybrid/docs-ref-autogen/ext/databricks/databricks/workspace.yml
:white_check_mark:Succeeded
View (azure-cli-2018-03-01-hybrid)

2018-03-01-hybrid/docs-ref-autogen/ext/databricks/databricks/workspace/vnet-peering.yml
:white_check_mark:Succeeded
View (azure-cli-2018-03-01-hybrid)

2018-03-01-hybrid/docs-ref-autogen/ext/databricks/index.yml
:white_check_mark:Succeeded
View (azure-cli-2018-03-01-hybrid)

2019-03-01-hybrid/docs-ref-autogen/TOC.yml
:white_check_mark:Succeeded

2019-03-01-hybrid/docs-ref-autogen/ext/aks-preview/aks.yml
:white_check_mark:Succeeded

2019-03-01-hybrid/docs-ref-autogen/ext/databricks/databricks.yml
:white_check_mark:Succeeded

2019-03-01-hybrid/docs-ref-autogen/ext/databricks/databricks/workspace.yml
:white_check_mark:Succeeded

2019-03-01-hybrid/docs-ref-autogen/ext/databricks/databricks/workspace/vnet-peering.yml
:white_check_mark:Succeeded

2019-03-01-hybrid/docs-ref-autogen/ext/databricks/index.yml
:white_check_mark:Succeeded

docs-ref-conceptual/azure-cli-extensions-list.md
:white_check_mark:Succeeded
View (azure-cli-latest) View (azure-cli-2017-03-09-profile) View (azure-cli-2018-03-01-hybrid)

latest/docs-ref-autogen/acr/scope-map.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/acr/token.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/ams/asset.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/ext/aks-preview/aks.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/ext/databricks/databricks.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/ext/databricks/databricks/workspace.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/ext/databricks/databricks/workspace/vnet-peering.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/ext/databricks/index.yml
:white_check_mark:Succeeded
View (azure-cli-latest)

latest/docs-ref-autogen/TOC.yml

[Warning-EmptyTocItemName] TOC item () with empty name found. Missing a name?
[Warning-EmptyTocItemName] TOC item () with empty name found. Missing a name?
[Warning-UidNotFound] Unable to find file with uid "az_functionapp_log_deployment" referenced by TOC file "latest/docs-ref-autogen/TOC.yml"
[Warning-UidNotFound] Unable to find file with uid "az_functionapp_log_deployment_list" referenced by TOC file "latest/docs-ref-autogen/TOC.yml"
[Warning-UidNotFound] Unable to find file with uid "az_functionapp_log_deployment_show" referenced by TOC file "latest/docs-ref-autogen/TOC.yml"
[Warning-UidNotFound] Unable to find file with uid "az_webapp_log_deployment" referenced by TOC file "latest/docs-ref-autogen/TOC.yml"
[Warning-UidNotFound] Unable to find file with uid "az_webapp_log_deployment_list" referenced by TOC file "latest/docs-ref-autogen/TOC.yml"
[Warning-UidNotFound] Unable to find file with uid "az_webapp_log_deployment_show" referenced by TOC file "latest/docs-ref-autogen/TOC.yml"

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Support for fetch for _makeRequest

Fixes #1123

Thanks for the PR.
We don't want to introduce more configuration options. Fetch should be chosen by default when available.
We also need some tests to cover this change.

Fixed in https://github.com/getsentry/raven-js/pull/1157


Add text in profile icon when several profiles use the same icon

When a profile has no icon, the gear button shows the first two letters of the profile name. This allows the user to identify easily the profile he is using.

But if the user associates an icon to several profiles, the same icon is shown instead of the gear icon in every profile. As no text is shown, the profiles can not be identified.
It would be nice if the first two letters of the profile name would be shown over the icon when the icon is used in several profiles.
Thanking you in advance,

/duplicate
https://github.com/microsoft/vscode/issues/194910

Thanks for creating this issue! We figured it's covering the same as another one we already have. Thus, we closed this one as a duplicate. You can search for similar existing issues. See also our issue reporting guidelines.
Happy Coding!


使用burpbounty无法检测sqli

Hi @laowang1026 !
Have you created a profile that detect that string in the response?
Best regards,
Thanks.


OC-Checksum header not checked when uploading file

closing in favor of https://github.com/owncloud/ocis/issues/1316

closing in favor of https://github.com/owncloud/ocis/issues/1316


Add Redis with ElasticCache to Terraform

What: Add Redis with ElasticCache to Terraform
Why: In https://github.com/debtcollective/fundraising/pull/84 we are adding Sidekiq that depends on Redis. In order for the application to run after we deploy, we will need to configure Redis and pass the url through env variables (REDIS_URL)
How:

Add ElasticCache instance to Terraform
Add REDIS_URL to the fundraising container configuration

Moving this to sprint to fix staging for the fundraising app

This is fixed in staging


Localhost domain unable to access

Describe the bug
Localhost domain unable to access.
Cmd
unlighthouse --site http://localhost:5000 --no-cache --mobile

Error
WARN  Request to site http://localhost:5000/ threw an unhandled exception. Please check the URL is valid. connect ECONNREFUSED ::1:5000

Reproduction
No response
System / Nuxt Info
No response

When I use IP its working
unlighthouse --site http://<IP_ADDRESS>:5000 --no-cache --mobile


Transaction committed on domain error for request with multiple mutations

Is there an existing issue for this?

[X] I have searched the existing issues

Product
Hot Chocolate
Describe the bug
Running multiple mutations in a single request. As per the docs here, I want to wrap these in a transaction.

When one of my mutations is not executed because of an Authorization failure, the transaction is not committed, as I would expect.
When one of my mutations is not executed because of an unexpected Exception, say a database timeout, the transaction is not committed, as I would expect.
When one of my mutations returns a domain Error, as exposed to the schema, the transaction is committed, but should not be.

Surely the transaction should be discarded when returning a domain error from one of the mutations in a request?
Steps to reproduce

Configure Hot Chocolate GraphQL server with default transaction scope handler and mutation conventions:

builder.Services
	.AddGraphQLServer()
	.AddAuthorization()
	.AddDefaultTransactionScopeHandler()
	.AddTypes()
	.AddMutationConventions(new MutationConventionOptions
	{
		InputArgumentName = "input",
		InputTypeNamePattern = "{MutationName}Input",
		PayloadTypeNamePattern = "{MutationName}Payload",
		PayloadErrorTypeNamePattern = "{MutationName}Error",
		PayloadErrorsFieldName = "errors",
		ApplyToAllMutations = true
	});

Add mutation resolvers, and cause one to throw a domain error

[MutationType]
public class Mutations
{
	[Error(typeof(ArgumentOutOfRangeException))]
	public async Task<AffectedRowsResponse> UpdateFirstAsync(
		UpdateModel model,
		CancellationToken cancellationToken)
	{
		return new AffectedRowsResponse() { AffectedRows = 11 };
	}

	[Error(typeof(ArgumentOutOfRangeException))]
	public async Task<AffectedRowsResponse> UpdateSecondAsync(
		UpdateModel model,
		CancellationToken cancellationToken)
	{
		throw new ArgumentOutOfRangeException("Some error");
		return new AffectedRowsResponse() { AffectedRows = 22 };
	}
}

Run a request with multiple mutations

mutation TransactionScopeTest (
  $firstInput: UpdateFirstInput!,
  $secondInput: UpdateSecondInput!)
  {
    updateFirst(input: $firstInput)
    {
      affectedRowsResponse {affectedRows}
    }
    updateSecond(input: $secondInput)
    {
      affectedRowsResponse {affectedRows}
    }
  }

Transaction is committed

Relevant log output
No response
Additional Context?
No response
Version
13.7.0

I had a stab at this one and we have a rough idea but it also has a lot of implications. To stop the mutation flow here we actually need to throw an error for the other mutations ... a GraphQL error to comply with the error flows. We can do that but I am not really happy with that ... I will discuss that with a couple of people to get some feedback.

I am moving it to 13.9


feat(http): add map_body to Request and Response

Add Request::map_body and Response::map_body to allow for swapping out the body
with a new version based on the old one -- wrapping a stream combinator around
it, for example.
Motivating scenario: I have a Service combinator which wraps around another Service. The inner Service returns a Response whose body type is a stream of messages. The outer Service needs to wrap a serializer around this body type to serialize its output to binary chunks, before turning the resulting Response over to hyper.

[x] The commit messages match the guidelines in https://github.com/hyperium/hyper/blob/master/CONTRIBUTING.md#git-commit-guidelines

We've been working on a new implementation of Request and Response, which includes a way to separate the head and body parts, and then construct a new one. That'd allow you to achieve the same result, right? We found that preferable to a map, since the naming sounds off.

That sounds great, and I also wrestled with the naming of this function. Feel free to close this then.


Refactor the "specialization" of members during conformance checking

During conformance checking, the type checker tries to match each requirement of the trait to an implementation of the conforming type. That is done by:

inferring the type a requirement would have it was member of the conforming type;
performing qualified name lookup (QNF) for the requirement's name in the conforming type;
identifying a unique declaration with the type computed at step 1.

The computation of the type is done by calling TypeChecker.specialize with a substitution map associating the generic parameter of the trait (i.e., Self) to the conforming type.
Consider the following example:
trait T {
  type U
  fun f(_ x: U) -> Self
}

type A: T {
  public typelias U = Bool
  public f(_ x: Bool) -> A
}

When checking A : T, we create a substitution table [T.Self => A] and then use it to "specialize" the type of T.f, which is [remote let T.Self](Self.U) -> Self. That will give us [remote let A](Bool) -> A, which is the type of A.f.
Currently, specialization processes associated types with a QNF. It works in the above example because if we substitute T.Self by A, then QNF for U in A will find us Bool. Unfortunately, this trick doesn't work if we're looking for an associated type inherited by refinement. That's because the generic parameter of the refined trait won't match that of the refining trait.
Consider this example:
trait T {
  type U
}
trait S: T {
  fun f() -> U
}

Here, the return type of S.f is an associated type rooted in T. So substituting S.Self by the conforming type won't help us find the implementation of that associated type requirement.
We can workaround this problem by completing the substitution map for the generic parameter of all refined traits before calling TypeChecker.specialize. A better solution, though, would be to leverage the conformances we checked to substitute associated types. We can do that by looking at the trait declaring the associated type and searching for the associated conformance.

I am no longer sure that the "workaround" is a worse solution than the one currently implemented. We need to identify how the associated types of a trait are implemented during conformance checking, so we can't simply rely on computed conformances.
We may be able to avoid QNF in the situations where the associated types of a refinements have already been computed, for efficiency. I'll leave the issue open to remember this observation when we'll want to optimize conformance checking.


DLP: Added sample for reidentify content using fpe

Added sample for Reidentify Content Using FPE and test cases

Tests are failing
Failed GoogleCloudSamples.ReidentifyContentUsingFpeTests.TestReidentifyWithFpe [3 ms]
  Error Message:
   System.ArgumentNullException : Value cannot be null. (Parameter 'value')
  Stack Trace:
     at Google.Protobuf.ProtoPreconditions.CheckNotNull[T](T value, String name)
   at Google.Cloud.Dlp.V2.KmsWrappedCryptoKey.set_CryptoKeyName(String value)
   at ReidentifyContentUsingFpe.ReidentifyContent(String projectId, String text, String keyName, String wrappedKey, FfxCommonNativeAlphabet alphabet, InfoType surrogateType) in /tmpfs/src/github/dotnet-docs-samples/dlp/api/Snippets/ReidentifyContentUsingFpe.cs:line 41
   at GoogleCloudSamples.ReidentifyContentUsingFpeTests.TestReidentifyWithFpe() in /tmpfs/src/github/dotnet-docs-samples/dlp/api/Snippets.Tests/ReidentifyContentUsingFpeTests.cs:line 30

The test is failing because the code is not able to find the KeyName, which we are passing from environment variable. If you have not set it then we need to set the KeyName and WrappedKey in the environment.
P.S. README.md file has already mentioned these things; So, I have not covered it.

I've added the env variables. Rerunning tests...

Tests have now timed out. Is it possible that the encryption operations take long. @jainamtrivedi-crest can you please set a timeout for DLP tests similart to https://github.com/GoogleCloudPlatform/dotnet-docs-samples/blob/main/asset/api/runTests.ps1.
And while you are at it it would be great if you make DLP runTests.ps1 match the one linked.
Also, fix the conflicts on this PR (because I merged an earlier one).
Thanks.

Tests have now timed out. Is it possible that the encryption operations take long. @jainamtrivedi-crest can you please set a timeout for DLP tests similart to https://github.com/GoogleCloudPlatform/dotnet-docs-samples/blob/main/asset/api/runTests.ps1. And while you are at it it would be great if you make DLP runTests.ps1 match the one linked.

No, Encryption does not take long time. Also, the test case has passed successfully. Not sure about the timeout error from where and why it has come.

With a Timeout, the test that "provokes" the timeout may very well pass. It just consumes a lot of time and then subsequent tests cannot run.
This one it's towards the higher end of running times, ~10^2ms where most seem to be ~1ms or ~10ms. There are a few others that are running in the order of seconds though.
But consuming the default timeout we have it's normal for products with plenty of samples as DLP so this is nothing to worry about. Just increasing the timeout for the test run as you've done should do the trick.
I'm rerunning tests now.


Runtime Error in Hugo 0.59.0

Hugo Version: Hugo Static Site Generator v0.59.0/extended darwin/amd64 BuildDate: unknown
OS: macOS Mojave 10.14.6
Issue:
Starting with this version I receive three errors when I generate my site.  Nothing has change in my repository since the previous version of Hugo, so this is a new regression.
My site builds as expected (so far as I can tell), but Hugo produces three runtime errors.
Hugo output from terminal below.  Please let me know what other information you might need.
Building sites … ERROR 2019/10/22 16:10:49 runtime error: index out of range [2] with length 2
ERROR 2019/10/22 16:10:49 runtime error: index out of range [2] with length 2
ERROR 2019/10/22 16:10:49 runtime error: index out of range [2] with length 2

                   |  EN
+------------------+------+
  Pages            | 1159
  Paginator pages  |   60
  Non-page files   |    0
  Static files     |   78
  Processed images |    0
  Aliases          |  591
  Sitemaps         |    1
  Cleaned          |    0

Total in 626 ms

Please let me know what other information you might need.

While I agree that this is a bug, I would most likely need access to your project or a Hugo site with this error. If this is a private GitHub project you may consider sharing it with me for a short while so I can run it.

I sent you an invite to the site's repository.  Thank you so much for giving it a look!

@marmanold thanks, I got it. It's a bug introduced in Chroma, the highlighter we use.

It's now fixed upstream in Chroma (that was impressively fast!), and I will try to find time to do a patch release later today.


beaconManager stopMonitoring isn't really implemented. it doesn't stop the cllocationmanager for example

hi,
beaconManager stopMonitoring isn't really implemented. it doesn't stop the cllocationmanager for example

Please refer to #60 . Thanks for your report.


Remove unnecessary casting for record field set

Purpose
Remove unnecessary casting for record field set
Fixes #41876
Depends on #41998
Approach

Describe how you are implementing the solutions along with the design details.

Samples

Provide high-level details about the samples related to this feature.

Remarks

List any other known issues, related PRs, TODO items, or any other notes related to the PR.

Check List

[x] Read the Contributing Guide
[ ] Updated Change Log
[ ] Checked Tooling Support (#)
[ ] Added necessary tests

[x] Unit Tests
[ ] Spec Conformance Tests
[ ] Integration Tests
[ ] Ballerina By Example Tests

[ ] Increased Test Coverage
[ ] Added necessary documentation

[ ] API documentation
[ ] Module documentation in Module.md files
[ ] Ballerina By Examples

Still for following kind of scenarios we create the unnecessary cast
type R record {|
    int f;
|};

function foo() {
    R|R r = { f: 5 };
    r.f = 6;
}

Still for following kind of scenarios we create the unnecessary cast
type R record {|
    int f;
|};

function foo() {
    R|R r = { f: 5 };
    r.f = 6;
}

I think this is a different issue from https://github.com/ballerina-platform/ballerina-lang/issues/41876 since we are not casting the value being assigned (ie 6) but R. And if I am not mistaken we do this whenever we refer to r irrespective of whether we are dealing with an assignment or not. May I create a separate issue for this because I suspect this has do with current type system not being able to reduce R|R to R (I expect this to fix itself with the semtype introduction)

@heshanpadmasiri Ubuntu and windows build are failing. Please check


[Rely] Adding assertion count setup

Using expect.assertions is extremely useful in jest. Is it possible to have similar functionality in rely?

Thanks for bringing this up! I've found myself writing some tests recently that could have used this functionality and I think it should be possible (if a little tricky) to add in.

expect.assertion matchers are included as of the latest release


Use useAsCString instead of unsafe version for InitCommand

Closes #16
I'm not really certain what makes this usage of unsafeUseAsCString, but it definitely seems to be the cause of #16.
I wouldn't think this would have a major performance impact, because init commands would just be used when creating a connection, but I can try to investigate making unsafeUseAsCString work correctly if you think it'd be important.

Thanks!


Facts not showing (blank screen)

For example the 'apt_has_updates' fact from the puppetlabs apt module.  It works at the command line, returning a boolean, but puppetboard shows a blank screen. Apache log shows the following:
[Wed Sep 07 09:09:22.373939 2016] [:error] [pid 12070:tid<PHONE_NUMBER>37408] [client <IP_ADDRESS>:58784] UndefinedError: 'bool object' has no attribute 'replace', referer: http://puppetboard.company.com/sandpit/facts
This is not limited to booleans.  The 'apt_security_updates' fact returns an int, and gets the following error:
[Wed Sep 07 09:11:22.646618 2016] [:error] [pid 12070:tid<PHONE_NUMBER>79040] [client <IP_ADDRESS>:58840] UndefinedError: 'int object' has no attribute 'replace', referer: http://puppetboard.company.com/sandpit/facts
Regards
Chris

I've found out that this only happens if the problem fact appears in the GRAPH_FACTS array.

Anyone else able to reproduce and verify as a bug?

We ran into the same issue with the processorcount fact where we saw an empty facts page but no error.
After dropping it from GRAPH_FACTS it worked again.

Here is a full backtrace when trying to access /fact/is_pe with is_pe  included into GRAPH_FACTS:
App 8650 stderr: [ pid=8650, time=2017-02-05 15:47:44,693 ]: WSGI application raised an exception!
App 8650 stderr: Traceback (most recent call last):
App 8650 stderr:   File "/usr/local/lib/ruby/gems/2.3/gems/passenger/src/helper-scripts/wsgi-loader.py", line 163, in main_loop
App 8650 stderr:     socket_hijacked = self.process_request(env, input_stream, client)
App 8650 stderr:   File "/usr/local/lib/ruby/gems/2.3/gems/passenger/src/helper-scripts/wsgi-loader.py", line 302, in process_request
App 8650 stderr:     for data in result:
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/werkzeug/wsgi.py", line 703, in __next__
App 8650 stderr:     return self._next()
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/werkzeug/wrappers.py", line 81, in _iter_encoded
App 8650 stderr:     for item in iterable:
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/flask/helpers.py", line 130, in generator
App 8650 stderr:     for item in gen:
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 1208, in __next__
App 8650 stderr:     return self._next()
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 1190, in generator
App 8650 stderr:     c = next()
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 1013, in generate
App 8650 stderr:     yield self.environment.handle_exception(exc_info, True)
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/jinja2/environment.py", line 754, in handle_exception
App 8650 stderr:     reraise(exc_type, exc_value, tb)
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/puppetboard/templates/fact.html", line 2, in top-level template code
App 8650 stderr:     {% import '_macros.html' as macros %}
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/puppetboard/templates/layout.html", line 50, in top-level template code
App 8650 stderr:     {% block javascript %} {% endblock javascript %}
App 8650 stderr:   File "/usr/local/lib/python2.7/site-packages/puppetboard/templates/fact.html", line 10, in block "javascript"
App 8650 stderr:     label: '{{ fact.grouper.replace("\n", " ") }}',
App 8650 stderr: UndefinedError: 'bool object' has no attribute 'replace'

This is puppetboard 0.2.1
It seems that any boolean fact (e.g. is_pe, is_virtual, selinux) produce this breakage.

Closing as outdated. Please reopen if you still experience such problem with the current version of the Puppetboard.


Create CODE-OF-CONDUCT.md

This is a requested document for repos. It follows a standard format.

I would keep it verbatim in the repository. It does not need updating that often and if so, we can screen repos who don't follow the exact text if we want to change it.

That might be actually soon, since @nfrisby spotted that we could use a newer version (e.g. 2.1) of this document as well.


Using 'RunOnluIfLoggedOn' is not working for me

The above is not working and i am catching this
Task Scheduler 2.0 (1.2) does not support setting this property. You must use an InteractiveToken in order to have the task run in the current user session.
Thanks in advance
Originally posted: 2015-04-27T07:08:07

Yes, when using TaskScheduler 2.0 (Vista and later) the RunOnlyIfLoggedOn property will throw an exception. You must instead do as instructed and register the task using an InteractiveToken setting.
Originally posted: 2015-05-02T13:48:54


Application's CSS selectors and properties are consolidated and organized to follow semantic structure.

This has been completed.


Add a URI as the Object of statement when a lookup isn’t available or able to retrieve a recently created entity in an external data source.

This issue is mostly to account for items created recently in external data sources that aren't yet available in lookup services because of cache delays. Related, may want to consider validation of the URI, and how to designate when this feature is available in the form.

workaround like LC of having choice for lookup OR create your own?

I think this is addressed with the current functionality in the Typeahead search where the user can enter a literal value or use an URI.


Refactor "order parts" form wizard to use API forms

Ref: https://github.com/inventree/InvenTree/issues/1984
The entire "order parts" multi-step form wizard needs to be refactored to use the API form interface.

I think this might be the last outstanding item for the 0.6.0 release: https://github.com/inventree/InvenTree/issues?q=is%3Aissue+is%3Aopen+milestone%3A0.6.0

Getting close! I had a look at this a couple of weeks ago, I think it may actually take some significant amount of work to do this properly. I'm going to bump this for the next release, we have been dragging our heels for a while now!


Some formats saving doesn't work

Hello!
Thank you for good service.
Unfortunately, it can save results in .png only. If I choose .jpg or .bmp or other - it saves in .png :(

This issue has been fixed.
Thanks for your feedback @glavatskiy1972


Add documentation

Some documentation is needed!

[x] XML Documentation Code: Core-Package
[x] XML Documentation Code: Moq-Package
[x] XML Documentation Code: NSubstitute-Package
[x] README

All needed documentations were added


Automatic Number Plate Detection using Google Tessaract and TFOD

Task#1

Implement ANPR make sure it uses Colab or Kaggle Kernels so that anyone can execute it with limited resources.

Hi, I am GSSoC'21 participant. I would like to work on this issue. Will you please assign it to me?

Hi, please assign this to me i am gssoc participant as well.
Can two people work on one issue?

I am a GSSOC participant. Please assign me this task. Would be happy to contribute.

@prithwirajmitra2001, go ahead.

@aqua0 go ahead.

Thank you

Could you please change the labels of this issue.
I am a gssoc participant that's why.
Thank you


Support like keyword argument in cupy.ascontiguousarray etc.

It was introduced in NumPy 1.20.
https://numpy.org/doc/stable/reference/generated/numpy.ascontiguousarray.html#numpy.ascontiguousarray
https://numpy.org/neps/nep-0035-array-creation-dispatch-with-array-function.html#nep35
(Maybe only thing we can do is just ignore the argument?)

No, the like argument is meant to exist only in NumPy so that the NEP-35 dispatch mechanism can be used. I don't think downstream libraries should support it, at least not us:

https://numpy.org/neps/nep-0035-array-creation-dispatch-with-array-function.html#implementation
Downstream libraries thus do not require to include the like= keyword to their array creation APIs. In some cases (e.g., Dask), having the like= keyword can be useful, as it would allow the implementation to identify array internals. As an example, Dask could benefit from the reference array to identify its chunk type (e.g., NumPy, CuPy, Sparse), and thus create a new Dask array backed by the same chunk type, something that’s not possible unless Dask can read the reference array’s attributes.

but @pentschev can correct me since this NEP is mostly his work 😁

Leo is correct. We intentionally introduced the argument in that way so that downstream libraries such as CuPy don't need to implement it, nor break in any way due to not implementing the argument. That is an argument that is mostly useful for libraries such as Dask, where we can ensure that new arrays created internally will be dispatched to a downstream library --  such as CuPy -- based on a reference input array.
Ignoring like= is the correct way to deal with it in CuPy.
@kmaehashi do you think the existing NEP-35 and API documentation are unclear to library developers such as you? If so, could you point to some part that is unclear so we can try to clarify for future readers that the argument should indeed be ignored?

@leofang, @pentschev Thank you for the comments! I think the NEP is written really clearly 😃
I'm thinking that in principle it's better to keep cupy module interchangeable with numpy module in code level, i.e. making xp.ascontiguousarray(a, like=cupy_array) (where xp can be numpy or cupy) runnable, although I understand it doesn't make much sense in this case.

Thanks for the feedback. I also agree it doesn't make sense, like= is specifically targeted at the NumPy dispatching mechanism with __array_function__, and although adding it would work we tried to make it clear that it's intended for library developers who want to rely on the NumPy API through __array_function__. Implementing is allowed but unnecessary for CuPy, this design was thought specifically to simplify maintenance of downstream libraries as getting the like= implementation correct can be challenging, note that similarly to NumPy you would need to remove the like= kwarg before dispatching.
There are some potential uses for that in upstream libraries such as Dask, but this is completely unnecessary for CuPy today.

Thanks for sharing the context. Adding like in CuPy won't make sense or rather confusing to users. Let me close this.

@kmaehashi Another note: A dispatching mechanism like NEP-35 would no longer be needed once the support for Python array API (#4789) is up. This is in fact one of the many reasons to standardize the array API. I was told during one of the API meetings that there are some complaints for the overhead of __array_function__ dispatching, but I haven't found a reference issue so far.

@kmaehashi Another note: A dispatching mechanism like NEP-35 would no longer be needed once the support for Python array API (#4789) is up.

Only true if the entire PyData community backs that. AFAIK, there haven't been any projects so far who actually started using it, whereas CuPy and Dask pretty much "pioneered" the use of __array_function__, my opinion is that we need to see more engagement from other projects to think it's viable to make a switch.

This is in fact one of the many reasons to standardize the array API. I was told during one of the API meetings that there are some complaints for the overhead of __array_function__ dispatching, but I haven't found a reference issue so far.

I've also heard that in the past, but even then it doesn't seem to have created a highly noticeable impact, otherwise there would be much more outcry from angry users. Therefore, it seems to me that this was more of an issue to very specific use cases.

Only true if the entire PyData community backs that. AFAIK, there haven't been any projects so far who actually started using it, whereas CuPy and Dask pretty much "pioneered" the use of __array_function__, my opinion is that we need to see more engagement from other projects to think it's viable to make a switch.

No there aren't any yet, because the Array API v1 standard is not fully finalized, and the implementation is still ongoing 😄 But I do think there is strong commitment at least from NumPy, PyTorch, and CuPy. I am trying to prioritize my work so that we can get the bulk of it done in CuPy v10.

Therefore, it seems to me that this was more of an issue to very specific use cases.

Yup.

No there aren't any yet, because the Array API v1 standard is not fully finalized, and the implementation is still ongoing 😄 But I do think there is strong commitment at least from NumPy, PyTorch, and CuPy. I am trying to prioritize my work so that we can get the bulk of it done in CuPy v10.

Yeah, but from a Dask perspective I would really like to see more projects that don't implement __array_function__ to actually support this new standard. CuPy is often the first one to get such new features in and that's great, but Dask can already interface well with CuPy today. For the time commitment this will require, IMO there will need to be additional advantages in supporting that, namely the possibility to have Dask interfacing with other libraries, but that requires those  libraries to introduce support first.

No there aren't any yet, because the Array API v1 standard is not fully finalized, and the implementation is still ongoing 😄 But I do think there is strong commitment at least from NumPy, PyTorch, and CuPy. I am trying to prioritize my work so that we can get the bulk of it done in CuPy v10.

Yeah, but from a Dask perspective I would really like to see more projects that don't implement __array_function__ to actually support this new standard. CuPy is often the first one to get such new features in and that's great, but Dask can already interface well with CuPy today. For the time commitment this will require, IMO there will need to be additional advantages in supporting that, namely the possibility to have Dask interfacing with other libraries, but that requires those libraries to introduce support first.

I would think the order should be reversed (@jakirkham can correct me since he's also joined the API meeting recently representing Dask): In order for other libraries to use Dask as a backend in their routines, Dask should support the Array API first. Then, if a backend registration system is devised (sorry I can't link to the internal issue), a library can just implement the routines solely with the array API. Of course this is still a long way to go (ex: Is SciPy going to do this rewrite?) but it's the goal 😄

Yes, what I meant to say is I would like to see those libraries committing to implementing the new standard. If Dask goes through all the work of supporting the standard (as it did for __array_function__) but no new libraries do, then the effort has been mostly wasted. Of course, that isn't to say that someone with lots of free time in their hands couldn't implement the standard in Dask regardless of that. 🙂

Ah yes, right I would love to see at least SciPy and scikit-image commit to it...

Yes, that would be great indeed!


parallel builds docs 2

Proposed changes
I wanted to include this change, but saw it too late.
I would also like to ensure that @arkodg approves this prior to merging--sorry I didn't make that clear before. I know that main content is already there from #11685, but if I'm not 100% correct, he can fix that now 😄
Thank you for the initial feedback @thaJeztah!
Unreleased project version (optional)

Related issues (optional)

O.o I guess those changes did make it in. Sorry!


[IT][CI] CI build kyuubi docker image should using mvn_args to speed up

Why are the changes needed?

CI using build/dockerfile to build kyuubi docker image, which will build distribution frist.
We should pass servals maven args to help build speed up.
We only test spark engine for kyuubi on kubernetes it test, so we use hive and flink provided.
How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[ ] Run test locally before make a pull request

[x] Wait CI

Before:

After:

For IT CI dockerfile related, friendly ping @cfmcgrady @pan3793

#3854 introduced the fast profile, can we reuse it?

#3854 introduced the fast profile, can we reuse it?

Thanks for your info, but in this IT Test case, we need spark binary, should not skip spark download.

Thanks, merging to master


Missing conservative flavour

Following the instuctions in BUILDING.md on Ubuntu 16.04 will not work at step:
./utilikit/generate_build_files.py debian --flavor conservative --apply-domain-substitution
This is because there is no conservative dir in resources/packaging/debian. "Standard" flavour does not work for distributions like Ubuntu 16.04.

See #293
You have to manually apply the minimal patch and rename the directory.

In this release, I have introduced a page about platform support. It is noted there that the Debian conservative packaging type is broken right now.


Push docker image to docker.io for release

NONE

This change is

Jenkins job mixer/presubmit passed

Jenkins job mixer/presubmit passed

Jenkins job mixer/pilot-regression passed

Jenkins job mixer/e2e-smoketest passed

Jenkins job mixer/pilot-regression passed

@sebastienvas: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/mixer-e2e-smoketest.sh
e3fe0bc845bba891b6eb382509d097b7e3dfb8a7
link
@istio-testing smoke test this

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/approve

/approve no-issue

/lgtm

/lgtm


fix(logger): save files on Ctrl+C

Description
Resolves #3679
Currently, when using --record-logs failed and interrupting Detox in the middle, it does not save the logs because it has not received a signalization about failing tests, so the logic is way too straightforward – discard the logs.
I suggest treating Ctrl+C (SIGINT, SIGTERM, etc) as an unsuccessful run so the logs are saved regardless.
That should reduce frustration when you are running into some timeout issues, and you want to interrupt Detox to read some saved logs, but oops – "no error, no logs". The latter rule is too strict, to my taste, in this case.

Sigkill is sigkill, it's hammer time. Less violent signals should end with artifacts.

Sigkill is sigkill, it's hammer time. Less violent signals should end with artifacts.

I see

@noomorph any work left to do here? Mind that I've already approved it

Detox version 20.1.0 has been released with this fix.


PnP API is not discovered when compiling file from different directory, leading to Module not found error

Bug report

What is the current behavior?
It looks like the webpack compiler invoked in a process that does not have pnp enabled is unable to discover pnp dependencies for the file it is compiling in a different directory. This used to work in webpack 4 with pnp-webpack-plugin
If the current behavior is a bug, please provide the steps to reproduce.
I have created a reproduction repository in order to recreate the problem/issue

What is the expected behavior?
I would expect either a way to provide the webpack compiler with the yarn PnP api instance or the instance is automatically discovered in order to compile the file with the correct dependencies. Is the first option possible? It looks like it may be as a resolver option but I'm unsure on how to consume it properly.  Any ideas? Any help would be much appreciated!

Other relevant information:
webpack version:  5.93.0
yarn version: 4.1.1
Node.js version: 20.15.1
Operating System: Mac OS Sonoma 14.3

Duplicate https://github.com/webpack/enhanced-resolve/issues/273?

@alexander-akait I actually think there is an issue in my reproduction. I was able to get webpack 4 and webpack 5 to work upon revisiting, and it looks like updating enhanced-resolve from 5.15.0 to 5.17.0 fixed the issue? I am going to close this as it doesn't seem to be an issue and more of an operator error on my end 🥴 .


Continue on error by default

Erroring when able to continue is brittle and was causing the following HELP mismatch on the same metric name to break metric collection merge for us.
# HELP process_start_time_seconds Start time of the process since unix epoch.

# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.

When trying to get merged result from the exporter:
An error has occurred while serving metrics:

collected metric process_start_time_seconds label:<name:"cluster" value:"tcc-staging" > counter:<value:1.58467339842e+09 >  has help "Start time of the process since unix epoch." but should have "Start time of the process since unix epoch in seconds."

Signed-off-by: Liam White<EMAIL_ADDRESS>

Hey @liamawhite, thank you for the PR but I'd like to know how that error came about?

This came from using the Prometheus exporter in the Open Telemetry Collector. These were metrics from two different receivers: a prometheus scraper and an opencensus agent.
Those metrics are produced by the respective JVMs from an instance of SkyWalking and an instance of Zipkin. The metrics have the same name but different help fields which causes an error in the Prometheus library, which I presume isn't sure how to merge them.


Can not import torch while import wenet

I am using wenet to do asr job,while i also use another torch model to do vad job.I want to combine the two results to do something like speaker diarization.But it raise errors:
1、import torch then import wenet:
raise error "ImportError: DLL load failed" while import _wenet
2、import wenet then import torch:
raise error "OSError: [WinError 127]  Error loading "D:\Anaconda3\envs\asr36\lib\site-packages\torch\lib\c10_cuda.dll" or one of its dependencies" while import torch
I am wondering there is a conflict between them.Maybe wenet should rely on torch installed locally ?
ps:
python version:3.6
install wenet using pip install wenet
torch version:torch-1.8.0+cu111-cp36-cp36m-win_amd64.whl

Plz use different python env.

WARNING: Logging before InitGoogleLogging() is written to STDERR
F0627 11:24:01.351308  5600 wenet_api.cc:47] Check failed: wenet::FileExists(unit_path)
*** Check failure stack trace: ***
Process finished with exit code -1073740791 (0xC0000409)
Ok,i get that.But i have a new error here,it means out of GPU memory?And i do nothing,it works fine last week.

WARNING: Logging before InitGoogleLogging() is written to STDERR
F0627 11:24:01.351308  5600 wenet_api.cc:47] Check failed: wenet::FileExists(unit_path)
*** Check failure stack trace: ***
Process finished with exit code -1073740791 (0xC0000409)
Ok,i get that.But i have a new error here,it means out of GPU memory?And i do nothing,it works fine last week.

plz rename word.txt to unit.txt due to latest chabges for e2e model unit

thanks for help!


Allow setting fallback response

Hi 👋
I've added the possibility to set a fallback response when no other configured response matches.
This is useful in particular when you want to respond with a default response instead of letting the FixtureDispatcher to crash.
It was useful in my case to return a 500 response to all the non-configured requests. Sometimes it's enough for the UI tests instead of letting the MockWebServer crash.
I know that we can use custom Conditions, but it's hard to write that as a fallback response condition as we need to match only the default condition when no other configured paths match. I did it with a whitelist, but it makes more sense to add this feature to the FeatureDispatcher.
This is what I use right now to have a default response:
class DefaultCondition : Condition {

    private var whiteList: HashSet<String> = hashSetOf()

    override fun compareTo(other: Condition): Int = -1

    override fun isRequestMatching(request: RecordedRequest): Boolean =
        !whiteList.contains(request.path)

    fun addPathToWhitelist(path: String) {
        whiteList += path
    }
}

But if the whiteList grows too much, it could have a performance impact on the UI tests.
What do you think about this feature?

I'm closing the PR as I've opened it with the wrong account 🙈


How to place the FeatureContext in custom directory

Here's the relevant part of my wordhat.yml:
default:
  suites:
    wordhat_features:
      paths:
         - "%paths.base%/features/wordhat"
      contexts:
        # Keep WordpressContext first!
        - PaulGibbs\WordpressBehatExtension\Context\WordpressContext
        - "%paths.base%/features/wordhat/bootstrap/FeatureContext"

Given all the files are located in the paths.
And The FeatureContext is in the subdirectory %paths.base%/features/wordhat/bootstrap directory.
When I run vendor/bin/behat --config wordhat.yml --colors
Then I get this error:
> vendor/bin/behat --config wordhat.yml --colors
In UninitializedContextEnvironment.php line 44:
  `/Users/bartonhammond/projects/twlw/wp-content/themes/jumpoff/features/wordhat/bootstrap/FeatureContext` context class not found and can not be used.

Given the error above
When I cat file that is reported as not found
Then I see
$ cat /Users/bartonhammond/projects/twlw/wp-content/themes/jumpoff/features/wordhat/bootstrap/FeatureContext.php
<?php
use PaulGibbs\WordpressBehatExtension\Context\RawWordpressContext;

use Behat\Behat\Context\SnippetAcceptingContext;
use Behat\Behat\Tester\Exception\PendingException;

... cut for brevity

Given I move the FeatureContext to features\snapshot
And I update the Yamal as follows
      contexts:
        # Keep WordpressContext first!
        - PaulGibbs\WordpressBehatExtension\Context\WordpressContext
        - FeatureContext

When I run vendor/bin/behat --config wordhat.yml --colors
Then I see
6 scenarios (6 passed)
27 steps (27 passed)
0m24.18s (13.88Mb)

But I want the FeatureContext to be located in "%paths.base%/features/wordhat/bootstrap/FeatureContext"

How do I do that?

Also where are the specs for the Behat YAML?

Hey,
No need to use gherkin syntax to report a bug :P
But anyhow, if your FeatureContext (or whatever its name...) is autoloadable (e.g through composer), you can place it anywhere you like.

Is there an example of what that looks like specifically for Behat?  I’m pretty new to Php.  I’m aware that auto load exists but not so much on how to direct what files are loaded and when.
Thanks...

It's not really specific to behat. Use composer so that the class can be autoloaded (check out their doc for that, it's pretty good), and then in your behat config, just use the classname as the context, as it is done for e.g your wordpress context.
BTW, if you want to see what are behat's option on the yaml file, you can use the --debug option when invoking behat (behat --debug).

Thanks

For anyone else:
    },
    "autoload": {
	"classmap": [
	    "features"
	]
    }


proposal: deprecate/archive this component

Impetus:
The CloudEvents Gateway will go GA very soon and works very well with Azure Event Grid. This means the ability to receive events from just about any Azure resource -- including Azure Container Registries -- already exists.
I'm not keen to incur the ongoing maintenance burden of a gateway that works with one Azure service, when we already have a component that works with most Azure services.
Can we?
This component isn't GA get. So, yes.
Flip side:
If you configure webhooks directly on an ACR, you have the option to provide an image name pattern that will send webhooks only for image names that match the pattern. If you're using Event Grid to wire events from your ACR into Brigade, you don't have that option.
Is it worth maintaining a whole separate gateway for the sake of that one option? I would argue that the answer is, "No... unless demand for it surfaces."
Ultimately I'm proposing that we archive this repository, but remain open-minded to the possibility of resuming work on it in the future.
cc @vdice for opinion.

I'm inclined to agree that it would be wise to focus the limited resources of the maintainers/contributors to the Brigade project towards the more broadly-useful CloudEvents Gateway for the reasons mentioned.  I'd say we move forward with archiving this component unless stakeholders/community members cry foul around the specific use case that would not be covered via Event Grid + CloudEvents gateway.

Thanks @vdice!


Error caused by mecab-python3

I get an error trying to
pip install sacrebleu
I wonder whether it is this commit that now prevents me from installing sacrebleu on Windows either in the system install or in Anaconda.
Here's the main part of the error:

    ERROR: Command errored out with exit status 1:
     command: 'C:\Users\David\Anaconda3\envs\OpenNMT_tf\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\David\\AppData\\Local\\Temp\\pip-install-7ez0vltn\\mecab-python3\\setup.py'"'"'; __file__='"'"'C:\\Users\\David\\AppData\\Local\\Temp\\pip-install-7ez0vltn\\mecab-python3\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\David\AppData\Local\Temp\pip-record-qbdi82e5\install-record.txt' --single-version-externally-managed --compile --install-headers 'C:\Users\David\Anaconda3\envs\OpenNMT_tf\Include\mecab-python3'
         cwd: C:\Users\David\AppData\Local\Temp\pip-install-7ez0vltn\mecab-python3\
    Complete output (9 lines):
    running install
    running build
    running build_py
    creating build
    creating build\lib.win-amd64-3.7
    creating build\lib.win-amd64-3.7\MeCab
    copying src\MeCab\__init__.py -> build\lib.win-amd64-3.7\MeCab
    running build_ext
    error: [WinError 2] The system cannot find the file specified
    ----------------------------------------

> ERROR: Command errored out with exit status 1: 'C:\Users\David\Anaconda3\envs\OpenNMT_tf\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\David\\AppData\\Local\\Temp\\pip-install-7ez0vltn\\mecab-python3\\setup.py'"'"'; __file__='"'"'C:\\Users\\David\\AppData\\Local\\Temp\\pip-install-7ez0vltn\\mecab-python3\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\David\AppData\Local\Temp\pip-record-qbdi82e5\install-record.txt' --single-version-externally-managed --compile --install-headers 'C:\Users\David\Anaconda3\envs\OpenNMT_tf\Include\mecab-python3' Check the logs for full command output.

I don't think that this is the fault of Sacrebleu though - I can't find a way to install mecab-python3 on my machine at all.  I need a 64 bit python since it is required by TensorFlow that is required by OpenNMT-tf.  The site for Mecab says that it is only available on 32bit Python.  So if that's the case has this change prevented the use of "pip install sacrebleu" on all 64bit python installations?
Originally posted by @davidbaines in https://github.com/mjpost/sacrebleu/pull/61#issuecomment-616145209

A temporary workaround is to force install an older version:
pip3 install sacrebleu==1.4.4

But clearly this is an issue. I don't have a Windows machine to test on, but have not had a problem testing this on 64-bit Linux platforms. Maybe @emjotde could comment?
If this does turn out to be a problem, I wonder if we could (a) remove mecab from the list of required modules and (b) have sacrebleu print a warning about manually installing it if someone tries to use -tok ja-mecab.

Hi,
I have created the PR that adds a Japanese tokenizer, and I have not checked it fully work on Windows because I don't have a machine to test.
I'm sorry about that.
@mjpost I think that is a nice suggestion. If you don't have time to fix it, I may create another PR.

For Windows, are we talking WSL here?

For Windows, are we talking WSL here?

No this is just Python on Windows. The error occurs in a command window. I haven't tried it in Powershell.

@MorinoseiMorizo if you have time to create a PR to handle this for Windows, that would be great. But don't feel bad—I think it's most important that it works on Unix (which it does).

@mjpost Sure, I will send a PR ASAP. Now I have a Windows machine that can be used for testing.

This should be fixed as of bcfdd0368e72f15308509b49ad471497d3dc0e2a and release version 1.4.9.

@mjpost passing --tok ja-mecab fails due to this line .
AttributeError: 'TokenizeMeCab' object has no attribute 'tagger'
Since tagger has been removed from init

Ah, that’s why. Someone had run into this and I couldn’t reproduce it. It must be because I was using -b which disables the signature.


Hyper-V Inventory Doesn't Add Storage for VMs with VHDs on Network Drive

VMs with VHDs residing on network-mounted drives, starting with \ - have a NULL Storage_ID in the database.  An attempt to run smart state analysis on one of these vms fails with the message "Is not located on a storage".    The drive letter can be obtained via the PowerShell command "Net Use".  Querying the VM settings shows the "" address rather than the drive letter.  The inventory script should probably do the right thing.  In addition the code for obtaining the actual VHD file in Smart State Analysis needs to do the right thing.
@blomquisg this is probably an issue for your team (at least partially).

Hi @jerryk55 - I see a lot of commits / PRs made against this issue. Should this still be open?

@bronaghs I think so.  The commits were a work-around to allow SSA to work in this situation, but the storage_id is still NULL in the database for these VMs.  Assuming we want the storage to be populated correctly for these VMs, the issue would be still open.  Your mileage may vary.

Ok, Thanks @jerryk55

@jerryk55 if this issue is no longer relevant then please close.


ENOENT error on OS X npm 3.6

after npm install -g hihat I try running hihat in my terminal and get the following error:
fs.js:584
  return binding.open(pathModule._makeLong(path), stringToFlags(flags), mode);
                 ^

Error: ENOENT: no such file or directory, open '/usr/local/lib/node_modules/hihat/node_modules/electron-prebuilt/path.txt'
    at Error (native)
    at Object.fs.openSync (fs.js:584:18)
    at Object.fs.readFileSync (fs.js:431:33)
    at Object.<anonymous> (/usr/local/lib/node_modules/hihat/node_modules/electron-prebuilt/index.js:4:42)
    at Module._compile (module.js:398:26)
    at Object.Module._extensions..js (module.js:405:10)
    at Module.load (module.js:344:32)
    at Function.Module._load (module.js:301:12)
    at Module.require (module.js:354:17)
    at require (internal/module.js:12:17)

Turned out it is because  when I do npm install -g hihat the first time it didn't finish the post installation of electron. (when I do npm install -g hihat the second time, no error is thrown and I thought the post-installation was done)
Solution: remove & reinstall hihat.


Dockerfile for VerneMQ

In #54 @dergraf suggested a discussion on a generalized Dockerfile for VerneMQ, but I can't seem to find a follow-up on this so I thought I'd ask whether any effort has been made lately regarding this.

Thanks for the follow-up @testark. I am personally quite involved with docker at the moment. So I'd be very happy to see a generalized Dockerile for VerneMQ... it's on our roadmap, but we haven't started with it.

@dergraf thank you very much! Still regarding this, could you please tell me whether cluster joining/leaving order matters for VerneMQ (like it does, for instance, in RabbitMQ)?

What ordering do you have in mind?

Takedown and startup order doesn't matter in the sense of RabbitMQ, as we don't have the same concept of disk nodes and RAM nodes.

We started a public repo for VerneMQ on Docker, which is also available on the Docker hub. Please check it out! https://github.com/erlio/docker-vernemq

Let's have the discussion on how to improve docker-vernemq at https://github.com/erlio/docker-vernemq


[BUG] Add-PnPMicrosoft365GroupToSite , -isPublic parameter

Add-PnPMicrosoft365GroupToSite -Url $SiteURL -Alias $GroupAlias -DisplayName $GroupName -IsPublic $true  -KeepOldHomePage -
Connection   $adminConn
returns an error that: Add-PnPMicrosoft365GroupToSite: A positional parameter cannot be found that accepts argument 'True'
Expected behavior
That a public Group would be add and connected to the site
Actual behavior
Error. I am not sure is IsPublic is expecting a non boolean value, in that case the documentation should be updated?
Steps to reproduce behavior
Add-PnPMicrosoft365GroupToSite -Url $SiteURL -Alias $GroupAlias -DisplayName $GroupName -IsPublic $true  -KeepOldHomePage -Connection   $adminConn
What is the version of the Cmdlet module you are running?
2.1.1
Which operating system/environment are you running PnP PowerShell on?

[x] Windows
[ ] Linux
[ ] MacOS
[ ] Azure Cloud Shell
[ ] Azure Functions
[ ] Other : please specify

The -IsPublic parameter is documented as a SwitchParameter, meaning you don't have to provide a value to it.
If it's there it's evaluated as true, if not it's false, so you just shouldn't provide a value to it.
Contrary to Boolean values, like the -IsInverted on Add-PnPTenantTheme that requires you to provide both the parameter name, and a boolean value.

I suspected as much, yet the name of that parameter triggered the old C and C++ habits to expect an boolean value ;-)  I guess I'll just have to add a code sample using that parameter .


i'm facing this issue in the months when date is 31st.

java.lang.IndexOutOfBoundsException: Invalid index 30, size is 30

Also experiencing this issue, any fix?

Same here! :/


Improved emojify_changelog design for posting on slack

Added bold wrapper around header names
Added •bullets at the beginning of every comment

Wonderful contribution @rotemitz , thank you

@pajapro Glad that you liked it :)