fix race condition crash when boarding dropship as it explodes

adds an endsignal call to ensure that we don't move onto running the idle evac animation if the dropship died while we were performing the boarding animation

Aight, I just made a new version (#438) that doesn't include the line endings change. Seems to be easier than messing messing with git to get the line endings fixed ^^


WebP support

Native side here: https://github.com/CesiumGS/cesium-native/pull/542

Thanks for the pull request @joseph-kaile!

:x: Missing CLA.

Please send in a Contributor License Agreement (CLA) and comment back here to let us know to check this!
Maintainers, here's how to check for a submitted CLA.

Reviewers, don't forget to make sure that:

[ ] Cesium for Unreal Samples works.

Thanks @joseph-kaile! Cross posting my comment from the native PR regarding the few changes I added:

Thanks @joseph-kaile, this looks great! I tested it with the Sponza model tiled on Cesium Ion with the WebP option enabled. It didn't work and I realized Ion outputs webp images wrapped in the EXT_texture_webp. So I generated that extension here and made some small adjustments on the Unreal side to use the texture source found in the extension, if it exists. Webp images should work both ways now, within the extension or just within the regular glTF texture, just like KTX.

Will webp support be merged into ue5-main branch?
with the latest version in UE5 I still get the error:

Failed resolving external glTF buffers from ...(URL).b3dm:

Image not of any known type, or corrupt
Declared image MIME Type: image/webp

@noySimplex Both UE4 and UE5 have had WebP support for awhile now, so we're not sure why you might be seeing that error. Can you share a tileset with us to demonstrate the problem?


Unable to create service connection using a scope level of AzureMLWorkspace

In Azure DevOps, I cannot create a service connection using the scope level of 'AzureMLWorkspace'.  The error generated suggests i don't have permission to add a role.   As a workaround, i manually created an SP and had my subscription admin provide it 'contributor' role access.   This approach also fails from the ADO side likely because the SP is not added as a user to the AML Workspace - and i don't have sufficient permissions as a 'contributor' to do so.  This is a blocker for using  Azure Model registration as an artifact for Azure DevOps and I have documented it on the ML Platform/AzureMLPython SDK teams channel.

Hi Eugene:
I have contributor level access in the azure subscription and am a project admin in the azure devops project.
This is the error I get when I try to create a service connection with AzureMLWorkspace scope:
A new Azure service principal will be created and assigned with the "Contributor" role, having access to all resources within the Workspace.
Failed to set Azure permission 'RoleAssignmentId: 597b3445-352a-41fc-9eca-4f5edf6c93ce' for the service principal '911b87e4-61ef-4f01-b496-f946dd9bb0ed' on machine learning workspace ID '510ebabd-4d14-45f9-8b2f-757fda448fcc': error code: Forbidden, inner error code: AuthorizationFailed, inner error message The client<EMAIL_ADDRESS>with object id 'd51035f6-4a0d-4ba6-8363-6943dacbcf5b' does not have authorization to perform action 'Microsoft.Authorization/roleAssignments/write' over scope '/subscriptions/bf7adf12-c3a8-426c-9976-29f145eba70f/resourceGroups/kbtest/providers/Microsoft.MachineLearningServices/workspaces/kbtest/providers/Microsoft.Authorization/roleAssignments/597b3445-352a-41fc-9eca-4f5edf6c93ce' or the scope is invalid. If access was recently granted, please refresh your credentials.
Ensure that the user has 'Owner' or 'User Access Administrator' permissions on the Workspace. For troubleshooting refer to linkhttps://go.microsoft.com/fwlink/?linkid=835898.
From: Eugene Fedorenko<EMAIL_ADDRESS>Sent: Wednesday, August 28, 2019 11:10 AM
To: microsoft/MLOpsPython<EMAIL_ADDRESS>Cc: Kate Baroni<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [microsoft/MLOpsPython] Unable to create service connection using a scope level of AzureMLWorkspace (#56)
@KBaronihttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FKBaroni&data=02|01|Kate.Baroni%40microsoft.com|a89be7039d464ceffd3e08d72bda81ca|72f988bf86f141af91ab2d7cd011db47|1|0|637026089788232063&sdata=ZLg46zaY%2BiiehvJdpC%2FOS64hk6wJpE%2BVxO%2FscX0MMyc%3D&reserved=0 what permission do you have in the subscription used to create a service connection? Can you provide the error message?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FMLOpsPython%2Fissues%2F56%3Femail_source%3Dnotifications%26email_token%3DACZEWKRIKYCNO3JCFUHOI4TQG2WNDA5CNFSM4IRJ6J2KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5L2AGQ%23issuecomment-525836314&data=02|01|Kate.Baroni%40microsoft.com|a89be7039d464ceffd3e08d72bda81ca|72f988bf86f141af91ab2d7cd011db47|1|0|637026089788232063&sdata=Nk46mYCx8p1ng3CgP2lEffTTEqmcx9T%2BlBzNS3gE0s0%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FACZEWKT2IP46TUDDHCQPHR3QG2WNDANCNFSM4IRJ6J2A&data=02|01|Kate.Baroni%40microsoft.com|a89be7039d464ceffd3e08d72bda81ca|72f988bf86f141af91ab2d7cd011db47|1|0|637026089788242059&sdata=HWQaOKcvkcWXGkcGdh93tN9wm5w3f7sZ8W0nTdRb6TQ%3D&reserved=0.

I just had my azure admin add the SP as an ‘owner’ to the AML Workspace, and it still doesn’t work.
BTW, if owner level permissions is expected on the Azure subscription to execute this repo, that will be a significant blocker for any users with enterprise subscriptions.
From: Eugene Fedorenko<EMAIL_ADDRESS>Sent: Wednesday, August 28, 2019 12:04 PM
To: microsoft/MLOpsPython<EMAIL_ADDRESS>Cc: Kate Baroni<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [microsoft/MLOpsPython] Unable to create service connection using a scope level of AzureMLWorkspace (#56)
So, yes, it expects to be an "Owner" or "User Access Administrator".
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FMLOpsPython%2Fissues%2F56%3Femail_source%3Dnotifications%26email_token%3DACZEWKX35QEAVHM2HVKVT3TQG24XNA5CNFSM4IRJ6J2KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5L7EVY%23issuecomment-525857367&data=02|01|Kate.Baroni%40microsoft.com|3959949826f048416ea108d72be20b84|72f988bf86f141af91ab2d7cd011db47|1|0|637026122236498117&sdata=0%2FjMqPe90HvFfEZMB%2FJsbdwgn7AjaJLpoKBnsPDBXv4%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FACZEWKXGXFZODLUXQHNUN5DQG24XNANCNFSM4IRJ6J2A&data=02|01|Kate.Baroni%40microsoft.com|3959949826f048416ea108d72be20b84|72f988bf86f141af91ab2d7cd011db47|1|0|637026122236508111&sdata=70N%2BFRehp3vYPTdush%2BDc3So6E%2B9ikvon0%2FZbJhOjv4%3D&reserved=0.

It does not work with 'owner' permissions on AML Workspace only.   It works with owner permissions on RG - which can only be assigned by an azure subscription admin.

Thanks for confirming that. We'll add a note to the documentation that one should have owner permission on RG to create a service connection.

@KBaroni  Please ensure you have owner or user admin access on the workspace. Most probably your contributor access from the subscription is inherited to the workspace.
I have also updated doc with an explicit note on this.


Weird behaviour at 767px exactly

@mdo I am having a real weird issue with the whole bootstrap grid system.
The behaviour of the framework is great everywhere, except at a specific point (the 767px). Here apparently it doesn't know what it need to do (or I am probably doing something really wrong).
I need to say that I am testing the outcome using https://addons.mozilla.org/en-us/firefox/addon/toggleresponsive/?src=cb-dl-recentlyadded in firefox, to see the results directly on screen.
Let's consider a simple example to understand what I am finding, and maybe understand also if I am doing something wrong:
I have a div, and I use the following media query to change the background color for every breakpoint:
.colordiv {
    background-color: orange;

    //@include breakpoint($xs) {

    //}

     @include breakpoint($sm) {
          background-color: yellow;
      }

      @include breakpoint($md) {
           background-color: pink;
       }

      @include breakpoint($lg) {
           background-color: red;
      }
  }

where the breakpoint are the default breakpoints of bootstrap(I use a routine in sass to build up the @media{}, and don't repeat it):
$xs: (max: $screen-xs-max);
$sm: (min: $screen-sm-min);
$md: (min: $screen-md-min);
$lg: (min: $screen-lg-min);

Now if I don't target $xs, everything works fine, and at 767 my div change color from yellow($sm) to orange. Instead if I target $xs in the following way (note I moved the background-color orange inside of the media query for $xs):
.colordiv {

    @include breakpoint($xs) {
        background-color: orange;
    }

     @include breakpoint($sm) {
          background-color: yellow;
      }

      @include breakpoint($md) {
           background-color: pink;
       }

      @include breakpoint($lg) {
           background-color: red;
      }
  }

What happen is that everything works fine at each breakpoint the color is correctly changed, except, and this is the weird thing, at exactly 767px, i don't get any color.
At 766px the div becomes orange, and at 768px it becomes yellow, but at 767px it doesn't have any color.
To me seems that the 767px point doesn't know what it needs to do, and it's considered not $xs and not $sm.
Doing some other testing I also discovered that if I change my media breakpoints, to include a maximum, the same weird behaviour happen on every breakpoint limits (meaning at 1199px for$ md, at 991px for $sm) - the div doesn't have any color at exactly the breakpoint change:
$xs: (max: $screen-xs-max);
$sm: (min: $screen-sm-min, max: $screen-sm-max);
$md: (min: $screen-md-min, max: $screen-md-max);
$lg: (min: $screen-lg-min);

What this means? If I have a min and a max, the framework doesn't know what to do at the max point of each breakpoint?
I mean I get a div without color at exactly $screen-xs-max, $screen-sm-max, $screen-md-max.
I can get correct results (like in the first scenarios), removing the max for the $sm and the $md, but I cannot remove the max for the $xs, otherwise I will not have an $xs breakpoint, and in this case I still encounter the weird issue at 767px.
I want to have a breakpoint $xs, because I need to target it specifically with js, but I cannot afford to have a weird things like the one that I explained above.
Do you have any idea of what is going on here?
Thanks so much, I really appreciate any help.
Best
Dinuz

@Dinuz What OS did you test on? Have you tried testing with Firefox's built-in Responsive Design View? (It's possible the extension you used might have some minor bug.)

I can get correct results (like in the first scenarios), removing the max for the $sm and the $md, but I cannot remove the max for the $xs, otherwise I will not have an $xs breakpoint

I'm not clear on what you mean by "I will not have an $xs breakpoint" here. The "only use min-width media queries" approach is workable in most cases.

I want to have a breakpoint $xs, because I need to target it specifically with js

I don't see how that necessitates using max-width media queries.

Closing for now, due to lack of response.


Don't panic if UUIDs or LUIDs are wrong size

The change for issue #14 returns UUIDs or LUIDs for the relevant device param names.
The current implementation gets the values as a Vec<u8> then copies them into arrays of the appropriate size, i.e.: [u8; CL_UUID_SIZE_KHR] and [u8; CL_LUID_SIZE_KHR], so far so good.
The issue is that the library will panic if a device returns the wrong size for a UUID or LUID, either from the explicit assert or in the call to copy_from_slice.
This is wrong: the library shouldn't panic on bad data from a device, it should just return a Result error value.

The fix for the issue is to get UUIDs or LUIDs explicitly as values using CL_UUID_SIZE_KHR and CL_LUID_SIZE_KHR as the appropriate size parameter when calling clGetDeviceInfo.
Not only does this no longer panic, but it also only calls clGetDeviceInfo once instead of twice: once to get the size and then again to get the data. It also saves copying the data from the Vec<u8> into the UUID or LUID array.
Unfortunately, it was not possible to use the api_info_value! macro since the array type does not implement the Default trait.

Incorporated in version 0.6.1.


Getting error while reading from disk

i am trying this repo, but where to run it; ubuntu or windows ( virtual box or in host machinr?)
and
im trying in ubuntu host machine

i setup the win10.vhd successfully running
When i run make its open qemu envi.  and getting "error while reading from disk"???

You should run it in Ubuntu, as it uses kvm (afaik if you run it on Windows you should use HAXM). I personally run it on WSL2 (Ubuntu on Windows), so running it on Ubuntu should work.
"Error while reading from disk" means that something went wrong while using int 0x13 to read the Windows MBR from the disk (see ReadDisk in src/hardware/serial.asm). I would recommend checking the return code (see the Wikipedia page for int 0x13 AH=0x42 which describes the interrupt, and this table for the meaning of the return codes). I'd guess that the disk extensions might not be present (check with int 0x13 AH=0x41).
In order to see the return code, add the line LOG_DEBUG("Return code: %x\n", *(byte_t*)DRIVE_IDX_ADDRESS) between line 24 and line 25 of src/hardware/serial.c.
By the way -

This is probably not related to your current issue, but how did you get the win10.vhd image? It has to be a BIOS one, not UEFI. Try running make win and see if Qemu can run it on itself (without my hypervisor in the middle).
Just to let you know - this project is not finished yet; It currently contains a type 1 hypervisor that can run Windows 10 on it, and work with multiple cores. I have not yet added all the spyware part.

Good luck :)

thank you mr.gognl for reverting back,
On note: am new to this vmbr concept, exploring more into this & initially trying to implement the subvirt/bluepill but confused and stuck so trying these repo's

So, yes am using Ubutnu Host machine environment(ubun-22.04 )
and regarding win10.vhd:
first,   i created a file Using this " qemu-img create -f vpc win10.vhd 20G " -> in VMBR folder/dir.
then,  Manually Create a new virtual machine  win10 with vm manager:
On the "Storage" configuration page, select "Select or create custom storage."
Click "Manage."
Click "Add Hardware."
Choose Disk."
Choose "Select or create custom storage."
Click "Manage."
Click "Browse Local."
Selecting the win10.vhd file
starting Booting with that and it's running successfully

And when i ran make win :

Regarding legacy BIOS: is it an option > need to enable in vm manager? or what??

Yeah, so make win not working means that your win10.vhd file is not good for this. You need to get a Windows 10 ISO that uses Legacy Bios and not UEFI. This is not that easy, since Microsoft hasn't used Legacy Bios in Windows for some years now, iirc.
I must admit that I don't know much about vm manager; There could maybe be an option to create a legacy bios image using vm manager, but not one that I'm aware of.
The way I did it is quite complex. I made a VM on VirtualBox with the UEFI Windows 10 image, which I got from the Microsoft website. Then somehow VirtualBox converted it to Legacy BIOS by itself (but you can also change it from within the VM, in the Windows settings). I then used Clonezilla to transfer the disk image to a USB, and Rufus to transfer it back to an ISO. For more information see this article.
I can also try to compress the image that I have and upload it to git, but it might be a few days before I get to do it since I'm not currently home.

Hello mr.gognl,
So i somehow figured out creating  a "Windows legacy BIOS" setup, in different approach
by selecting the "win10.vhd" file during the creation process in VirtualBox and ensuring that the "Enable EFI" option was unchecked  and it worked(i hope)

and now, i copied the  win10.vhd file to the makefile environment, I encountered the same error.

Can you please explain about this vmbr? need some clarity

and what happens? upon successful win10.vhd uploading QEMU?

This is a project I’m making which in the end is supposed to be a malicious hypervisor which runs Windows, collects spyware (keylogs and maybe network traffic) and sends it to a remote attacker. Currently I only implemented the hypervisor part, and I’m planning to finish the rest in about 2 months from now. I am planning on collecting the keylogs through a Windows function hooking (namely KeyboardClassServiceCallback), and I am planning on building a network driver for RTL8139 which I will use for both hooking the network and sending the data to the attacker. Note that I am not planning on implementing the intrusion part, meaning the project is itself the payload and is not planned to include the part which takes control of the Windows boot process (the code assumes that the hypervisor's code will be loaded upon booting, and not Windows’).
If you run make win Qemu should load and run Windows on itself. If that works, it means that your win10.vhd file is good. When you run make it's supposed to run Windows on top of my hypervisor (which runs in Qemu).

The error you are getting probably isn't related to the win10.vhd file. It means that there was a problem while trying to execute int 0x13 to read the Windows MBR from the disk. I recommend trying what I wrote in my first comment - try and find the error code, and then maybe it will help you (and me) understand the bug better.

So, with my low level understanding and with some help i figure out something but i dunno whether am right or worng:
i Changed the code as mentioned:
`
#include <hardware/serial.h>
#include <boot/addresses.h>
#include <lib/util.h>
void read_first_sector(byte_t drive){
dap_t dap_ptr = (dap_t)DAP_ADDRESS;
dap_ptr->size = sizeof(dap_t);
dap_ptr->unused = 0;
dap_ptr->amount = 1;
dap_ptr->offset = MBR_ADDRESS;
dap_ptr->segment = 0;
dap_ptr->sector = 0;
(byte_t)DRIVE_IDX_ADDRESS = drive;
CallReal(ReadDisk);
LOG_DEBUG("Return code: %x\n", (byte_t)DRIVE_IDX_ADDRESS); // Added return code line
}
void load_guest(){
mbr_t mbr_ptr = (mbr_t)MBR_ADDRESS;
memcpy(REAL_START+low_functions_end-low_functions_start, CallReal, call_real_end-CallReal);
void (*CallRealCopy)(void(*)(void)) = (void (*)(void(*)(void)))(REAL_START+low_functions_end-low_functions_start);

for (byte_t drive_index = 0x80; drive_index < 0xff; drive_index++){
    read_first_sector(drive_index);
    if (mbr_ptr->signature == BIOS_SIGNATURE){
        // LOG_DEBUG("Copying MBR to 0x7c00...\n");
        *(byte_t*)DRIVE_IDX_ADDRESS = drive_index;
        memcpy(0x7c00, (byte_t*)mbr_ptr, sizeof(mbr_t));
        break;
    }
}

CallRealCopy(LoadGuestVmcall);

}
`
getting the something related to boot failed:

if am not worng the error is related to win10.vhd? but, as you mentioned its legacy bios enabled disk

make win  getting not bootable device

i really dont understand where am wrong

The error code you're getting is 0xE0, which means "Status Error". You can read the status from the BIOS Data Area. Add the line LOG_DEBUG("%x", (qword_t)*(byte_t*)(0x400+0x41)); under the line you added (in read_first_sector) in order to print the status.

Hello @gognl, I have done all I could to solve the issue, but I am receiving errors. I tried yours too, but the error persists

Ideally, if possible, Can we connect and resolve this at the earliest possible time, probably it takes 15-30min max; providing my email id further<EMAIL_ADDRESS>

I'm afraid that wouldn't be possible, but I'd be glad to continue helping here.
What's the BIOS data status (according to the line I wrote in my last comment)?

Alright guess am getting the same,

While running make

While running make win

serial.c code:
`#include <hardware/serial.h>
#include <boot/addresses.h>
#include <lib/util.h>
void read_first_sector(byte_t drive){
dap_t dap_ptr = (dap_t)DAP_ADDRESS;
dap_ptr->size = sizeof(dap_t);
dap_ptr->unused = 0;
dap_ptr->amount = 1;
dap_ptr->offset = MBR_ADDRESS;
dap_ptr->segment = 0;
dap_ptr->sector = 0;
(byte_t)DRIVE_IDX_ADDRESS = drive;
CallReal(ReadDisk);
LOG_DEBUG("Return code: %x\n", (byte_t)DRIVE_IDX_ADDRESS); // Existing line
LOG_DEBUG("%x", (qword_t)(byte_t)(0x400+0x41)); // Added line to print the status
}
void load_guest(){
mbr_t mbr_ptr = (mbr_t)MBR_ADDRESS;
memcpy(REAL_START+low_functions_end-low_functions_start, CallReal, call_real_end-CallReal);
void (*CallRealCopy)(void(*)(void)) = (void (*)(void(*)(void)))(REAL_START+low_functions_end-low_functions_start);

for (byte_t drive_index = 0x80; drive_index < 0xff; drive_index++){
    read_first_sector(drive_index);
    if (mbr_ptr->signature == BIOS_SIGNATURE){
        // LOG_DEBUG("Copying MBR to 0x7c00...\n");
        *(byte_t*)DRIVE_IDX_ADDRESS = drive_index;
        memcpy(0x7c00, (byte_t*)mbr_ptr, sizeof(mbr_t));
        break;
    }
}

CallRealCopy(LoadGuestVmcall);

}
`

i already provided above!!!
so actually i added  LOG_DEBUG("Return code: %x\n", (byte_t)DRIVE_IDX_ADDRESS); // first Existing line and
LOG_DEBUG("%x", (qword_t)(byte_t)(0x400+0x41)); // Added line to print the status
and then run make and make win to check for the output that ur mentioning  >> am i doing wrong??

The error code is printed for each drive that it tries (from 0x80 to 0xfe). The Windows disk should be in drive 0x80, so I'll need to see the first error code that is printed.

By the way, if you plan on git cloneing again, make sure you do so from commit a288108d7deab9d94caa73f03da081184a18e26b. Newer commits will work differently as I'm working on the network part.

hey @gognl , actually  i didnt get that, after making changes in serial.c >> do i need to run the serial.c or entire Makefile(make or make win )  ?????
and sure i will try that  a288108d7deab9d94caa73f03da081184a18e26b commit and let you know

You should run make

Yes mr. @gognl, already did that after making changes running make
as you mentioned::

In order to see the return code, add the line LOG_DEBUG("Return code: %x\n", *(byte_t*)DRIVE_IDX_ADDRESS); between line 24 and line 25 of src/hardware/serial.c.

Add the line LOG_DEBUG("%x", (qword_t)*(byte_t*)(0x400+0x41)); under the line you added (in read_first_sector) in order to print the status.

my serial.c added code:

When i run make after added the LOG_DEBUG in terminal:

Qemu terminal:

Running make:

You are getting error code 0x1, which means Invalid Command and might be caused if disk extensions are not present. This is a bit weird since you're running in Qemu. I'd try and gather more information: execute int 13h with ah=0x41, dl=0x80 and bx=0x55aa. Then test the carry flag; If it is set, then that's the problem (and in that case you probably want to read ah and cx; see the picture below).

Add the relevant code to serial.asm before the execution of int 13h ah=0x42.
I would also recommend trying to update Qemu and seeing if it changes anything.

Hey @gognl i tried update the qemu and still getting the same
and  i just wanted to know; is the qemu that mentioned is custom qemu or not??

I used sudo apt-get install qemu

Then, i did the same

Try what I suggested here:

You are getting error code 0x1, which means Invalid Command and might be caused if disk extensions are not present. This is a bit weird since you're running in Qemu. I'd try and gather more information: execute int 13h with ah=0x41, dl=0x80 and bx=0x55aa. Then test the carry flag; If it is set, then that's the problem (and in that case you probably want to read ah and cx; see the picture below).


Docs: Changelog for 2.5.4

Please make sure these boxes are checked before submitting your PR, thank you!

[ ] Make sure you follow Element's contributing guide (中文 | English | Español).
[ ] Make sure you are merging your commits to dev branch.
[ ] Add some descriptions and refer relative issues for you PR.

LGTM


meson: Add cpp_rtti=false default option

Add the missing cpp_rtti=false option in the list of defaults, which will be picked by Meson 0.53 or newer. Older versions will keep using the existing check.

Thanks @bertogg!

Cherry-picked into the wpebackend-1.10 branch as commit a1dcb01ce5763806fde709cbe01cbd604fa6693b


🎉 Create tool to archive steps

Create CLI tool to archive steps, and add it to the ETL dashboard.
I also fixed the formatting of a few random dag files. By the way, @Marigold is there a way to ensure that dependencies in the dag file are always indented?
Fixes https://github.com/owid/etl/issues/1820

By the way, @Marigold is there a way to ensure that dependencies in the dag file are always indented?

Thanks for fixing the old ones. I believe that all new DAG files should be correctly intended. If I remember it correctly, we use either ruamel_dump or yaml_dump functions and both should be using the correct indentation. If that's not the case, please let me know!


IndexError: pop from empty list

when training the 1-B model fllowing the README.md

how was this solved ??getting same error
(elmo_train) D:\bilm-tf-master\bilm-tf-master>python D:/bilm-tf-master/bilm-tf-master/bin/train_elmo.py --train_prefix='D:/Dataset/swb/swb/train/*' --vocab_file D:/Dataset/swb/swb/vocab.txt --save_dir D:/Dataset/swb/swb/checkpoint
2020-03-14 13:12:12.730859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
WARNING:tensorflow:From D:\bilm-tf-master\bilm-tf-master\bin\bilm\training.py:21: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.
WARNING:tensorflow:From D:\bilm-tf-master\bilm-tf-master\bin\bilm\training.py:21: The name tf.logging.INFO is deprecated. Please use tf.compat.v1.logging.INFO instead.
Found 0 shards at 'D:/Dataset/swb/swb/train/*'
Traceback (most recent call last):
File "D:/bilm-tf-master/bilm-tf-master/bin/train_elmo.py", line 73, in
main(args)
File "D:/bilm-tf-master/bilm-tf-master/bin/train_elmo.py", line 59, in main
shuffle_on_load=True)
File "D:\bilm-tf-master\bilm-tf-master\bin\bilm\data.py", line 442, in init
shuffle_on_load=shuffle_on_load)
File "D:\bilm-tf-master\bilm-tf-master\bin\bilm\data.py", line 342, in init
self._ids = self._load_random_shard()
File "D:\bilm-tf-master\bilm-tf-master\bin\bilm\data.py", line 363, in _load_random_shard
shard_name = self._choose_random_shard()
File "D:\bilm-tf-master\bilm-tf-master\bin\bilm\data.py", line 348, in _choose_random_shard
shard_name = self._shards_to_choose.pop()
IndexError: pop from empty list


React?

Hi! I have a need to display KML placemarks on a map, but I'm in a React environment. I've tried to get this to run under React, but there's a fundamental issue, i think, with worker_threads. Do you think it's possible to run this under React and, if so, any tips? Thanks!

This is an interesting issue. I haven't tried this with React, but I do use React for some other projects. I know that Next.js will throw errors with Worker_threads, since it used node.js, which doesn't support workers. I think the easiest fix for this issue would be to have the use of workers optional. I'll see if I can add an options and get back to you.

I added some code to check to make sure the web worker is available before trying to use it. Let me know if that works. This is probably something I should be doing anytime that I use a webworker, so thanks for finding this!

Will do, heading off to England in five minutes but I'll hit it when I get back in a week. ;) Much appreciated!

@sammyjava have you had a chance to look at this again?

Oh, shoot, no, sorry -- I ended up using react-leaflet-kml (and leaflet-fullscreen) which met my KML needs. Those install leaflet, leaflet-kml, and react-leaflet as dependencies.
But I'll give this a shot and report back, totally forgot about it!


Sync eng/common directory with azure-sdk-tools for PR 2381

Sync eng/common directory with azure-sdk-tools for PR https://github.com/Azure/azure-sdk-tools/pull/2381  See eng/common workflow

The failed ubuntu tests are unrelated to the current change.
/checkenforcer override

/check-enforcer override


Use correct property when determining display URL

Closes #5574

Travis build didn't get linked for some reason: https://travis-ci.org/TryGhost/Ghost/builds/71436149

Weird that's the second GitHub hook I've seen fail in the last 30mins or so.


go.mk autogenerate changelog

Description
Checklist
(For exoscale contributors)

[ ] Changelog updated (under Unreleased block)
[ ] Integration tests OK

Testing

If you want to be identified as exoscale:
git config --global user.name "Exoscale"
git config --global user.email<EMAIL_ADDRESS>you should have the logo and point to account:


Add decimal to the possible numbers?

Decimal is different from double and float in that it supports base 10 numbers much better that double and float do. I would love for decimal to be supported by node natively.

I'm closing this until Decimal is supported on Swift Linux, then let's reopen ... the original PR will hopefully serve as an implementation template


Unhandeld exception: input string format incorrect

Hi,
I just discovered Trace Wizard thru the psadmin.io podcast. I was eager to try it... but it fails on all trace files I've thrown it with Unhandled exception: input string format incorrect.
That's a rough translation: the actual exception is in french since I'm on a french OS.
Here are all the details I can think of:
Trace Wizard 1.6.1 downloaded today. (about dialog reports 1.3.6988.18709)
OS: Windows 10 1709, enterprise, x64, french
PeopleTools: 8.55.12 on some Linux
My trace file was produced with settings recommended on Trace Wizard's page:

SQL statements
SQL statement variables
SQL connect, disconnect, commit, rollback
SQL fetch
All other SQL API calls except SSBs
Program starts
External function calls
Internal function calls

The exception message is
System.FormatException: Le format de la chaîne d'entrée est incorrect.
   à System.Number.ParseDouble(String value, NumberStyles options, NumberFormatInfo numfmt)
   à TraceWizard.Processors.SQLProcessor.ProcessLine(String line, Int64 lineNumber)
   à TraceWizard.Processors.TraceProcessor.TraceProcessor_DoWork(Object sender, DoWorkEventArgs e)
   à System.ComponentModel.BackgroundWorker.OnDoWork(DoWorkEventArgs e)
   à System.ComponentModel.BackgroundWorker.WorkerThreadStart(Object argument)

Please find attached inputStringFormatIncorrect.zip

details of the error
a sample trace file

Can you tell whether the problem lies in the trace file itself or because I'm on a french OS ? If so is there anything that can be done to be OS-language independent ?
Let me know if you need more info.
Thanks

Hey, thanks for reporting this issue, let me take a look

The trace seems to load fine (albeit with some message boxes about unsupported PPC objects). I think its an environment issue with the format of decimal numbers. Let me look at how to solve this.
Basically because the machine is in French, i believe it is expecting comma (,) to be used for the decimal place and not the period (.) which is what the trace files have.

I've pushed changes that should fix the reported issue. Attached you'll find a new build with this fix in place in case you are unable to build from source.
Trace.Wizard.1.6.1-CultureFix.zip

Incredible turn around time!

Hi,
I see you fixed both the locale issue and unknown objects.
That new build loads my other traces all right.
thanks for the very quick fix and thanks for making that tool available.


Pretrained model performance is not consistent with claim

After downloading pretrained model, I ran follow command
python eval_rcnn.py --cfg_file cfgs/default.yaml --ckpt PointRCNN.pth --batch_size 1 --eval_mode rcnn --set RPN.LOC_XZ_FINE False
but result is not good as claim

Did I miss something?

How about the recall values?
I have tested the code and provided model and everything goes well.

Sorry, it could be my problem. My friend have tested this code, result is good as claim. I'll check again by myself. Thank for sharing your great work!

Not sure what could be wrong but I get the exact same results as @abbyxxn. Any ideas what could be wrong @sshaoshuai?
2019-06-05 12:04:29,287   INFO  final average detections: 5.615
2019-06-05 12:04:29,287   INFO  final average rpn_iou refined: 0.000
2019-06-05 12:04:29,287   INFO  final average cls acc: 0.000
2019-06-05 12:04:29,288   INFO  final average cls acc refined: 0.000
2019-06-05 12:04:29,288   INFO  total roi bbox recall(thresh=0.100): 12521 / 14385 = 0.870421
2019-06-05 12:04:29,288   INFO  total roi bbox recall(thresh=0.300): 11957 / 14385 = 0.831213
2019-06-05 12:04:29,288   INFO  total roi bbox recall(thresh=0.500): 11340 / 14385 = 0.788321
2019-06-05 12:04:29,288   INFO  total roi bbox recall(thresh=0.700): 7463 / 14385 = 0.518804
2019-06-05 12:04:29,288   INFO  total roi bbox recall(thresh=0.900): 42 / 14385 = 0.002920
2019-06-05 12:04:29,288   INFO  total bbox recall(thresh=0.100): 12515 / 14385 = 0.870003
2019-06-05 12:04:29,288   INFO  total bbox recall(thresh=0.300): 11981 / 14385 = 0.832881
2019-06-05 12:04:29,288   INFO  total bbox recall(thresh=0.500): 11443 / 14385 = 0.795481
2019-06-05 12:04:29,288   INFO  total bbox recall(thresh=0.700): 8928 / 14385 = 0.620647
2019-06-05 12:04:29,288   INFO  total bbox recall(thresh=0.900): 1280 / 14385 = 0.088982
2019-06-05 12:04:29,288   INFO  Averate Precision:
2019-06-05 12:04:37,029   INFO  Car<EMAIL_ADDRESS>0.70, 0.70:
bbox AP:87.8227, 69.9469, 68.5612
bev  AP:79.0169, 67.0757, 65.3114
3d   AP:71.9940, 56.0721, 50.5933
aos  AP:87.10, 68.95, 67.42
Car<EMAIL_ADDRESS>0.50, 0.50:
bbox AP:87.8227, 69.9469, 68.5612
bev  AP:89.1084, 77.1024, 75.8091
3d   AP:89.0065, 75.9968, 70.1514
aos  AP:87.10, 68.95, 67.42

Using:

python 3.7
pytorch 1.1.0
CUDA 10.0

Just in case someone gets similar results I found the source of the issue. I used a copy of the KITTI dataset downloaded by someone else. Velodyne files were very different from the ones I downloaded from the KITTI web site. Not sure why, but anyways, my issue is resolved.


[GURPS] 2.9.15

Submission Checklist
Required

[x] The pull request title clearly contains the name of the sheet I am editing.
[x] The pull request title clearly states the type of change I am submitting (New Sheet/New Feature/Bugfix/etc.).
[x] The pull request makes changes to files in only one sub-folder.
[x] The pull request does not contain changes to any json files in the translations folder (translation.json is permitted)

Changes / Description

Updated toggle buttons from Arrow buttons to an intuitive Plus/Minus buttons, with hover state to help provide feedback. The update also reduces the footprint of the toggle button.
Added additional reason modifier buttons and text box for attributes, which involved tweaking the layout to add space for the toggle buttons.
Updated tooltips for GURPS Horror Stress & Derangement rules.

Character Sheet Info Roll20 Internal Use only.


Add Anonymous Warning

Project details:

Club: Austin High School
Name: Anonymous Warning
Description: This application allows you to Anonymously Message your friends.
URL: http://mahahahajan.github.io/AnonWarning/
GitHub: https://github.com/mahahahajan/AnonWarning
Authors:

Pulkit Mahajan, Gisela Kottmeier

:shipit:

Hmm... @jonleung was there a reason this was merged? We need to change the "Club" to "Hack Camp" on our end before merging shipped submissions from Hack Camp.

@zachlatta oops, sorry I failed on that! Let me know if I should do anything to resolve this!

I opened #72 to address things that could be improved with this PR.
On Mon, Aug 17, 2015 at 4:12 PM, Jonathan Leung<EMAIL_ADDRESS>wrote:

@zachlatta https://github.com/zachlatta oops, sorry I failed on that!
Let me know if I should do anything to resolve this!
—
Reply to this email directly or view it on GitHub
https://github.com/hackedu/shipped/pull/72#issuecomment-131989029.

--
Zach Latta
hackEDU |<EMAIL_ADDRESS>


Support for function chaining in Java SDK

According to the document here https://learn.microsoft.com/en-us/azure/azure-functions/durable/durable-functions-sequence?tabs=python, function chaining doesn't have examples on Java. So is it correct to assume it's not supported yet?
My use case here is to call my app like this :
http://localhost:7071/api/orchestrators/EternalOrchestrator
There are 2 functions here:

HTTP Starter Function
Eternal Orchestrator Function

I should be able to route my request directly to Eternal Orchestrator from HTTP Starter. Like this example here :
https://learn.microsoft.com/en-us/azure/azure-functions/durable/durable-functions-sequence?tabs=csharp#run-the-sample

Looks like it is supported.
Just needed to change from "Route" to "route" from C# to Java.
However, it'll be great if the documentation could be updated :)

FYI @lilyjma


Request: context menu to transform text

Hi,
I think it would be great if you added context menu to SpeakGPT.
Here's how I envision it:

select text like in this picture

click on "[SpeakGPT Icon] Transform text"
SpeakGPT assistant pops up asking for a voice (or textual input). Say something like "Translate to japanese" or "Make this email more to the point"
Send the whole request to ChatGPT with Here's the text I'd like you to transform: '''[what you highlighted]'''\Transform the text according to this instruction: '''[what you said]'''

What do you think?

This functionality is already present. Some of apps do not allow to share text directly to non-system apps. Try to click "Share" > SpeakGPT. Translation function will be added.


[Question] Can't reproduce the result of LLaVA7B

Question
I finetune llava7b on v100, 8GPU with the following script (llava_instruct_150k.json):
deepspeed ./llava/train/train.py
--deepspeed zero3_offload.json
--model_name_or_path /apdcephfs_cq3/share_1603164/user/fuxiaoliu/vicuna-7b-v1.3
--version v1
--data_path /llava_instruct_150k.json
--image_folder /apdcephfs_cq3/share_1603164/user/fuxiaoliu/llava_dataset/train2017
--vision_tower /apdcephfs_cq3/share_1603164/user/fuxiaoliu/llava_dataset/clip-vit-large-patch14
--pretrain_mm_mlp_adapter /apdcephfs_cq3/share_1603164/user/fuxiaoliu/projector/mm_projector.bin
--mm_vision_select_layer -2
--mm_use_im_start_end False
--mm_use_im_patch_token False
--fp16 True
--output_dir /apdcephfs_cq2/share_1603164/user/fuxiaoliu/checkpoints_llava/llava-17b-finetune_llava
--num_train_epochs 3
--per_device_train_batch_size 8
--per_device_eval_batch_size 4
--gradient_accumulation_steps 1
--evaluation_strategy "no"
--save_strategy "steps"
--save_steps 500
--save_total_limit 1
--learning_rate 2e-5
--weight_decay 0.
--warmup_ratio 0.03
--lr_scheduler_type "cosine"
--logging_steps 1
--tf32 False
--model_max_length 2048
--gradient_checkpointing True
--dataloader_num_workers 4
--lazy_preprocess True \
The projector is from here:

My output model weight looks like this:

I try to load the model weight in the web demo, and try the following questions:

It seems that the answer doesn't follow the instruction.
However, when I don't use the image and directly ask about the question:

It follows the instructions. Do you have any ideas?

Hi Fuxiao,
I have not trained model with both FP16 and zero3_offload. I am not sure if there are some issues with this specific configuration, but the commands you are using generally looks good to me.
I tried to train a lightning version (80k+1epoch, FP16, zero3 w/o offload) this morning, and it seems to be working fine. I have attached the command I used and the log below. Unfortunately I do not have the resource to run zero3 offload this week, as this somehow will cause all other processes on our lab machine to halt..
You may try running with the Lightning data (which is quicker and easier to verify).
Wandb: https://api.wandb.ai/links/lht/jjsx93kz
llava/train/train_mem.py --local_rank=0 --deepspeed dev_scripts/ds_zero3.json --model_name_or_path ./checkpoints/vicuna-7b-v1-3 --version v1 --data_path ./playground/data/llava_instruct/conv_reason_no_overlap_80k.json --image_folder /nobackup/haotian/datasets/coco/train2017 --vision_tower openai/clip-vit-large-patch14 --pretrain_mm_mlp_adapter ./checkpoints/ds_llava-vicuna-7b-v1-3-pretrain_blip558k_plain/mm_projector.bin --mm_vision_select_layer -2 --mm_use_im_start_end False --mm_use_im_patch_token False --bf16 False --fp16 True --output_dir ./checkpoints/ds_llava-vicuna-7b-v1-3-pretrain_blip558k_plain-finetune_80k_1e_fp16 --num_train_epochs 1 --per_device_train_batch_size 16 --per_device_eval_batch_size 4 --gradient_accumulation_steps 1 --evaluation_strategy no --save_strategy steps --save_steps 50000 --save_total_limit 1 --learning_rate 2e-5 --weight_decay 0. --warmup_ratio 0.03 --lr_scheduler_type cosine --logging_steps 1 --tf32 True --model_max_length 4096 --gradient_checkpointing True --dataloader_num_workers 4 --lazy_preprocess True --report_to wandb

md5sum ds_llava-vicuna-7b-v1-3-pretrain_blip558k_plain/mm_projector.bin
c96e816e8a1ae5f730fff68f21a00909  ds_llava-vicuna-7b-v1-3-pretrain_blip558k_plain/mm_projector.bin


Query about the timestamp of image frame

Now I am working on a project of synchronization between image and imu readings. To render the sync more precisely, I'd like to ask how the timestamp is assigned to the image frame that is acquired say using depthai.DataOutputQueue.get() method. Is it defined as the time instant when exposure finishes and the image is (fully) read from the sensor (You may refer to your shared doc (https://docs.luxonis.com/projects/hardware/en/latest/pages/guides/sync_frames.html?#software-soft-sync))? OR is it set as the time instant when exposure begins and the image capture starts, as commonly pointed out in related papers (you may refer to Section "B. Sensor Synchronization and Data Acquisition" of this paper (https://ieeexplore.ieee.org/document/6906892))?

@lenardxu

the image frame timestamp, is currently assigned when MIPI streaming starts, that's immediately (few microseconds) after the exposure ends (full frame exposure for global shutter, first row exposure done for rolling shutter).
It has the advantage that the frame interval is fixed from frame to frame in continuous streaming mode, regardless of varying exposure time. That's because the exposure is end-aligned within a time-frame: https://docs.luxonis.com/projects/hardware/en/latest/pages/guides/sync_frames.html?#synchronizng-frames-externally)
Also for hardware-synced multiple cameras, the FSIN/FSYNC signal is aligned with the end of exposure / MIPI SoF.

Quoting @alex-luxonis ^

@lenardxu The timestamp is assigned at the MIPI SoF (start of frame) event, when the sensor starts streaming the frame. For global shutter sensors, this follows immediately after the exposure for the whole frame was finished, so we can say the timestamp assigned is aligned with end-of-exposure-window (within a margin of few microseconds). Marked on the timing diagram from our docs (that you linked above):

For rolling shutter sensors (as our high resolution RGB sensors), it's slightly different, MIPI SoF follows after the first row of the image was fully exposed and it's being streamed, but the following rows are still exposing or may have not started exposing yet (depending on exposure time).
The MIPI readout time for the IMX378 is with the current configs, based on the configured resolution:

THE_1080_P (default resolution) - 16.52ms
THE_4_K - 23.58ms
THE_12_MP - 33.04ms

@themarpe , @alex-luxonis First off, my hearty gratitude for your comprehensive clarification of timestamping method that is adopted by you, which is a brilliant way.
Then I'd like to double check if I understand your way of timestamp assignment since it should be different from the normal way of timestamp assignment where timestamp is defined at the beginning of each image capture and of exposure, and I am not familiar with the concept of MIPI SoF. So, upon your explanantion based on the plot you marked, in case of global shutter sensor for convenience, the timestamp is always set at the end of corresponding image frame, where the affiliated exposure that takes place at the back also ends. For example, for frame_0, the assigned timestamp is actually the instant when frame_1 is to be captured.
Request for an update/extension to another timestamping method
Finally, I'd like to request for an update/extension from your current timestamping method to the one which assigns the mid-exposure time to frame timestamp. That is out of better sync quality (no matter for hardware sync or software sync), for which you may still refer to section "B. Sensor Synchronization and Data Acquisition" of this paper (https://ieeexplore.ieee.org/document/6906892) and experiment section. According to their experiment results, the switch to aligning imu trigger to timestamp (mid-exposure time) of triggered image frame improves sync greatly. Although upon your description, I've learned that would be hard since the fixed period between each two frames would be broken when a simple switch to mid-exposure time is adopted, I still think it deserves your attention.

@themarpe , @alex-luxonis There's still one question about exposure time. Given your current timestamping method and auto exposure by default, I'd like to try using fixed exposure in my software synchronization program (image frame as visual cue, imu measurement as triggered), to see if the alignment of mid-exposure time with imu timestamp will improve the sync quality. However, I don't know which temporal length of fixed exposure (say 0-33.3ms) is reasonable, I'd like to ask for you opinion.


Update upgrade update for no driver

Problem:
On upgrade local cluster or rke will cause warnings in the logs due to
not finding the driver in the config
Solution:
Only look for a schema if we have a driver name
Stop potential panic in map lookup
Clarify log statement
Issue: https://github.com/rancher/rancher/issues/18843

LGTM


Extend Documentation

record & replay
CA certs & properties
JSON match level
JSON schema support
HTTP CONNECT proxy
SOCKS proxy
direct (port mapping) proxy
NOT matching operator
CORS support #276
Dynamic / Object Callbacks
REST API
remove JavaDoc in-line, and replace with more code examples (both Java and Javascript)

proxy notes for record & replay (to ease creation of expectations)
running from command line using maven plugin directly without a pom.xml
proxy client configuration for new client examples

SNAPSHOT download configuration

for SNAPSHOT see #138

homebrew formula

test paralysation / separate using query parameter and Referer header

add HTTP API

if using the API is really the recommended way of setting up expectations (over, say, the Java client), then may I suggest that on this page here: http://www.mock-server.com/mock_server/creating_expectations.html, you remove the client sections, since they are already detailed in http://www.mock-server.com/mock_server/mockserver_clients.html?
I actually didn't see the request matcher API description at first because the client stuff is very prominent. I was lucky that I read this part on the page about clients:

see #172 for more details documentation changes

btw, I ended up using the java client instead of the API directly. I tried to deduce what the API calls would have to look like from the code and the logging but I had trouble with more complicated payloads (possibly escaping quotes and such) so I resorted to using the client. AFAICT there's no single page in the docs dedicated to explaining the actual JSON that needs to be sent to the server. Am I missing something?

You are absolutely correct, creating detailed API documentation is on the list for documentation improvements.

Add useful tip about:
HttpsURLConnection.setDefaultSSLSocketFactory(SSLFactory.getInstance().sslContext().getSocketFactory());
From #205

Hi @jamesdbloom! I've tried the latest version with the command line version of mock server and I get the certificate_unknown exception for https requests. Is creating my own java program the suggested work around for this issue?
Is there an example of how to do this with a simple endpoint to capture https traffic?
Thanks!

@jamesdbloom
Didn't see update on this issue.
We also wonder if we run a stand-alone MockServer, how do we setup the request/response expectation?
In our automation script, we have expectation setup for each request, then run MockServer during automation running.
But what if we want to run a stand-alone MockServer?
from the document, it just tells us how to run it, but didn't mention anything about setting up the response/request, where to set it up?

This is now the highest priority issue, after having fixed numerous other bugs.  Once I have completed one more release (in the next day or two) I will start to improve the documentation and fix no other bugs until it is done.

#257 document the harmonised MockServer and Proxy features.

#637 make "2. Run Test Scenarios" clearer that this refers to a user running their own tests

This has now been completed with the remaining two areas being migrated to the backlog as: https://trello.com/c/aZJt3YJA/57-improve-tls-documentation and https://trello.com/c/7HWvKoVR/55-document-ui


Reduce vector fix

New try. Infinite loop should be now fixed.

Is there a testcase available for the bug that is fixed by this PR?

Is there a testcase available for the bug that is fixed by this PR?

see #434 @whitequark


Move HTTPServer inside cluster_servlet

Results:
Running 15s test @ http://<IP_ADDRESS>:32300/hello/call?serialization=none
8 threads and 64 connections
Thread Stats   Avg      Stdev     Max   +/- Stdev
Latency    60.19ms   24.68ms 346.93ms   92.95%
Req/Sec   138.98     27.70   181.00     79.88%
Latency Distribution
50%   55.34ms
75%   57.83ms
90%   64.41ms
99%  180.67ms
16484 requests in 15.07s, 2.03MB read
Requests/sec:   1093.66
Transfer/sec:    137.78KB

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#648  👈
#647
#646
#645
#644
#643
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @dongreenberg and the rest of your teammates on  Graphite


Add license blocks and add Source class.

'Source' should really have another name.

Pull Request Test Coverage Report for Build 182

0 of 1 (0.0%) changed or added relevant line in 1 file are covered.
2 unchanged lines in 2 files lost coverage.
Overall coverage decreased (-0.3%) to 70.301%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/main/scala/org/codefeedr/pipeline/Source.scala
0
1
0.0%

Files with Coverage Reduction
New Missed Lines
%

src/main/scala/org/codefeedr/plugins/rss/RSSSource.scala
1
0.0%

src/main/scala/org/codefeedr/pipeline/Job.scala
1
0.0%

Totals

Change from base Build 169:
-0.3%

Covered Lines:
187

Relevant Lines:
266

💛  - Coveralls


{CI} Use Python 3.10 as the default and disable Python 3.9 tests

Description
Python 3.9.8 introduced an unexpected breaking change (https://github.com/python/cpython/pull/28420) that breaks Azure CLI:

https://github.com/Azure/azure-cli/issues/20269

According to https://bugs.python.org/issue45235, this change will be reverted on 3.9 and withdrawn from future releases for other version like 3.7, 3.8, 3.10.
Azure Pipeline now only has Python 3.9.8, but not old versions like 3.9.7:

https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/tool/use-python-version
https://github.com/actions/virtual-environments/blob/main/images/linux/Ubuntu2004-README.md#python

Python

...
3.9.8
3.10.0

Even if Python releases 3.9.9 which reverts this change, it will take Azure Pipeline weeks to take that version.
To unblock our development and PRs from being merged, we have to use Python 3.10 (thanks to the timely support for Python 3.10 (https://github.com/Azure/azure-cli/issues/19857)) as the default and disable Python 3.9 tests.

CI


json5 parser demo - DO NOT merge

Work has been demonstrated and discussed as part of #164
Work will be incorporated into branch https://github.com/oasis-open/odata-rapid/tree/annotations and subsequent PR


feat: process images and upload to mediabus

fixes #37

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

v1.3.0
v1.3.0
GitHub release

Your semantic-release bot :package::rocket:


Fix HTTPS environment variable with IIS web server

For more information: http://stackoverflow.com/a/2886224

@sasanrose :+1:


Cannot delete an API key generated through OAuth

See: https://rollbar.com/carto/CartoDB/items/37066/
Context
When granting access to other artifacts (a sequence, a view, etc.) to the db role associated to an OAuth generated API key, the role is not dropped.
Steps to Reproduce
Please break down here below all the needed steps to reproduce the issue

Authorize a user

https://reveal-user1.carto.com/oauth2/authorize?client_id=8vA48VW9UwMr&response_type=token&state=9808598598718741&redirect_uri=https://localhost:8080/oauth&scope=dataservices:routing

Use the access token returned in the previous step to get the session role (in the example below access_token=PJd8M69xWmyoV3P7OnqR3w)

curl -X POST \
  'https://reveal-user1.carto.com/api/v2/sql?api_key=PJd8M69xWmyoV3P7OnqR3w' \
  -H 'Content-Type: application/json' \
  -d '{
    "q": "SELECT session_user"
}'

output: carto_role_c29a4102-e799-426b-80b3-dd851923f1be

GRANT SELECT to a table of another user in the same org:

curl -X POST \
  'https://reveal-admin.carto.com/api/v2/sql?api_key=PJd8M69xWmyoV3P7OnqR3w' \
  -H 'Content-Type: application/json' \
  -d '{
    "q": "GRANT SELECT ON \"reveal-admin\".projects TO \"carto_role_c29a4102-e799-426b-80b3-dd851923f1be\""
}'

Once the key is expired (and destroyed) the rollbar notification pops up

Current Result
See: https://rollbar.com/carto/CartoDB/items/37066/
Expected result
The role is dropped as expected and the key destroyed.
Additional info
Rollbar issue fixed manually from the rails console:
oat.api_key.send(:db_run, "DROP OWNED BY #{oat.api_key.db_role}"); oat.destroy

We could just include the fix here
summoning @javitonino for triage, feel free to assign it to me :)

Ei @alrocar nice description! :)
After reading the docs about DROP OWNED:

we could change this instead of every individual REVOKE of the revoke_privileges method

Any privileges granted to the given roles on objects in the current database and on shared objects (databases, tablespaces) will also be revoked.

we could reassign everything from the role to postgres role to ensure we "dont lose" anything

The REASSIGN OWNED command is an alternative that reassigns the ownership of all the database objects owned by one or more roles.

A question: Do our roles have privileges from several DBs? I think no, just in case.

DROP OWNED drops all the objects within the current database

So, we could modify the revoke_privileges method with:
db_run("REASSIGN OWNED BY \"#{db_role}\" TO postgres")
db_run("DROP OWNED BY  \"#{db_role}\"")

or even remove the revoke_privileges method and do everything in drop_db_role

Hey! thanks for jumping in 👍

A question: Do our roles have privileges from several DBs? I think no, just in case.

I'd say no. This specific case is for when a role in one schema is granted to a table in another schema in the same database.
Apart from that, it has been done manually so that's why the revoke_privileges method does nothing and the error is raised, since there is no api key in the database with table permissions.
Not 100% sure about this, but I'd keep the revoke_privileges method and maybe add your fix to the drop_db_role method. I don't know if REASSIGN to postgres will accumulate objects on that role, maybe you could do a manual test, and see what happens.
In any case, I guess we are adding support for api keys that grant access to tables in different schemas soon, so maybe we'll have to rethink this by then.
Let me know if I can help.

I'd keep the revoke_privileges method and maybe add your fix to the drop_db_role method

I think it is not nedeed, I think the DROP OWNED is making the same (and more) as:

In any case, I guess we are adding support for api keys that grant access to tables in different schemas soon, so maybe we'll have to rethink this by then.

DROP OWNED should work in this case too. It removes every permission for a specific role (in the current database)

I don't know if REASSIGN to postgres will accumulate objects on that role

Yes, it works fine, but I am not sure if it has sense. In addition to the documentation message about it, I have read some advice in the same way, but do we need it? I don't think so. Maybe @javitonino could say something interesting about

The PR is ready https://github.com/CartoDB/cartodb/pull/14307. I am testing it in staging, with the REASSIGN to know how it works

All works fine from my point of view. I will remove the REASSIGN OWNED BY because it has no sense for me to do it now if we dont do it before. I going to create the tests

Useful and related documentation: https://www.postgresql.org/docs/10/static/role-removal.html

:rocket:


Write docstrings for functions

Working on docstrings part @onuratakan !

Added docstring for bump.py @onuratakan


Wrong donation amount value display

Describe the bug
https://opencollective.com/fred-renault is contributing for 20€
but is related to 5€ on contributors page:https://opencollective.com/monnaie-libre

There is effectively something wrong. fred-renault used to be a  5€ donator but is a 20€ since january last year.

@Betree maybe can you have alook?

Hi @zicmama, thanks for reporting this issue. It should be fixed now:


How to use transform for Model.create and update?

I was trying to implement a transform when creating and updating.
  const transform = (
    model: AnyModel,
    op: string,
    name: string,
    value: any,
    properties: OneProperties,
  ): any => {
    return ...; // <====== what should I return here?
  };

  await Test.update(
    { name: 'testxd', id: '8', random: String(Math.random()) },
    { transform },
  );

But that's failing with (node:54912) UnhandledPromiseRejectionWarning: OneTableError: Cannot find existing item to update...

What's the expected return value for transform? The TypeScript interface is defined with any
Is transform going to be deprecated? WARNING: params.transform functions are DEPRECATED and will be removed soon.
I was planning to use transform for adding additional attributes to unique records _unique. So I could also retrieve additional data querying when _unique records. Currently, it saves only pk and sk. I thought of a transform for additional columns. Is it a feasible idea?

Your error may be unrelated to the transform. Use params {log: true} to see the actual request.
You should return any value of the correct type for that attribute from a transform.  Any is right, because the type can be multiple types depending on the attribute being transformed.
The deprecation warning is incorrect -- I've removed it.
Regarding adding additional fields in a transform ... the params transform is meant for simply transforming values, not for adding new fields. The table transform works on the entire record, so you may be able to use that (I've not tested that use case).
Typically we recommend having attributes defined in the schema -- why do you want/need to add them to the unique record?

Thank you!

why do you want/need to add them to the unique record?

It is a way to avoid a GSI for specific use cases. For example, if in addition to the unique record pk & sk I can add, let's say accountId, I could query for the unique pk & sk and retrieve the accountId.
Currently, to accomplish that, I need to have the unique record for the unique attribute, and I need to set this unique attribute as a GSI in the original record so that I can query based on it.

Why don't you just retrieve the full item?  It would contain accountId?


netbird self hosted with keycloak. Client able to connect, but client are not able to come online

Describe the problem
I have self hosted netbird instance with keycloak IDP.
I am able to access dashboard.
I install android client app, and try to to connect host. I get redirected to keycloak login page, I enter the user credentials, I get a login succesfull message
I go back to previous page, it still shows connecting.
I check dashboard, new client is added, but its not online.
I check management logs, I get following error msg:
management-1  | 2024-12-01T08:33:02Z WARN [context: GRPC, requestID: f285a960-373e-49e5-adc7-20ee92005945, accountID: UNKNOWN, peerID: 9bRKd5PKG5YuHXW8dpK9RVLLvJGy56CxH9CdMuBqzBE=] management/server/grpcserver.go:466: failed logging in peer 9bRKd5PKG5YuHXW8dpK9RVLLvJGy56CxH9CdMuBqzBE=: no peer auth method provided, please use a setup key or interactive SSO login
management-1  | 2024-12-01T08:33:04Z WARN [context: GRPC, requestID: 27b8344f-e739-4991-9183-1df2076650e9, accountID: UNKNOWN, peerID: 9bRKd5PKG5YuHXW8dpK9RVLLvJGy56CxH9CdMuBqzBE=] management/server/grpcserver.go:466: failed logging in peer 9bRKd5PKG5YuHXW8dpK9RVLLvJGy56CxH9CdMuBqzBE=: no peer auth method provided, please use a setup key or interactive SSO login
management-1  | 2024-12-01T08:33:05Z INFO management/server/peer.go:737: Peer needs login
management-1  | 2024-12-01T08:33:18Z INFO management/server/peer.go:737: Peer needs login
management-1  | 2024-12-01T08:33:31Z INFO management/server/peer.go:737: Peer needs login
management-1  | 2024-12-01T08:33:46Z INFO management/server/peer.go:737: Peer needs login
management-1  | 2024-12-01T08:33:59Z INFO management/server/peer.go:737: Peer needs login
management-1  | 2024-12-01T08:34:10Z INFO management/server/peer.go:737: Peer needs login

Are you using NetBird Cloud?
No, this is a self hosted instance.
NetBird version
latest as of today
CONTAINER                REPOSITORY             TAG                 IMAGE ID            SIZE
artifacts-coturn-1       coturn/coturn          latest              0d2918daccb2        169MB
artifacts-dashboard-1    netbirdio/dashboard    latest              3f69a0adf9cd        121MB
artifacts-management-1   netbirdio/management   latest              27929d72790e        185MB
artifacts-relay-1        netbirdio/relay        latest              9a5e48d4e593        51.4MB
artifacts-signal-1       netbirdio/signal       latest              7946e65988f4        47.6MB

Screenshots
able to access dashbord, client added but it never comes online :-

mobile client login successfull image :-

error screenshot :-

Hi, I am also facing the same issue with authentik as the authentication provider. The clients also seem to disconnect and reconnect every few minutes

same here, using zitadel as my provider.

Hi, I am also facing the same issue with authentik as the authentication provider. The clients also seem to disconnect and reconnect every few minutes

Second this. Here are the management logs from when I tried to add one of my Linux servers to Netbird
WARN [accountID: UNKNOWN, peerID: xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=, context: GRPC, requestID: 97026caf-9280-497f-ae40-9bf7537af264] management/server/grpcserver.go:471: failed logging in peer xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=: no peer auth method provided, please use a setup key or interactive SSO login WARN [peerID: xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=, context: GRPC, requestID: 23b96b14-eb93-44bb-8bca-51752d0ba92b, accountID: UNKNOWN] management/server/grpcserver.go:471: failed logging in peer xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=: no peer auth method provided, please use a setup key or interactive SSO login

Hi, I am also facing the same issue with authentik as the authentication provider. The clients also seem to disconnect and reconnect every few minutes

Second this. Here are the management logs from when I tried to add one of my Linux servers to Netbird
WARN [accountID: UNKNOWN, peerID: xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=, context: GRPC, requestID: 97026caf-9280-497f-ae40-9bf7537af264] management/server/grpcserver.go:471: failed logging in peer xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=: no peer auth method provided, please use a setup key or interactive SSO login WARN [peerID: xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=, context: GRPC, requestID: 23b96b14-eb93-44bb-8bca-51752d0ba92b, accountID: UNKNOWN] management/server/grpcserver.go:471: failed logging in peer xELfsPgy5fehiPc9wJyy34HMpSzwlf7gU/iv8pIdazs=: no peer auth method provided, please use a setup key or interactive SSO login

command used was
netbird up --management-url https://netbird.tld --setup-key *key*


Issue 335/device camera uploads

This PR implements image capture from mobile devices and refactors UploadDocumentModal with a new UploadButtonGroup sub component.
Had previously experimented with MediaDevice API, but the HTML input approach appears much simpler and are used for this purpose. Currently, only devices with screen widths smaller than 768px has this functionality.
Had tested this implementation on a fork to see if implementation works for mobile devices (see fork below).
https://github.com/codeforpdx/PASS/assets/14917816/ea934ddf-27d2-48bc-ba34-ac3cbc455b85
Note the styling was unaltered for the second button, I simply wanted to check if the implementation works. For styling, it looks like the following with the second button now utilizing Capture image for its wording:

The first button still opens up a file explorer.

I'll dig into the code in a little, but love the look and idea of this.  I also like that it still pulls up a "image selection" if you click the capture image on a larger device - BUT it would be real ideal if it could use the laptop camera (if one existed.)

I'll dig into the code in a little, but love the look and idea of this. I also like that it still pulls up an "image selection" if you click the capture image on a larger device - BUT it would be real ideal if it could use the laptop camera (if one existed.)

Yeah, I did try out the idea with <input> and capture but it doesn't seem to work on desktop. It always seem to end up opening the file explorer.
The only way I manage to make the desktop camera working is if I were to use the MediaDevice API and getUserMedia. But at that point, it would seem like we would need to create a local GUI for the camera on PASS.


Document behavior of ApplyConditionTo.CurrentValidator

see https://github.com/JeremySkinner/FluentValidation/issues/1291

Thanks - I reworded a few bits for grammar and clarity, but that's all merged in now and should show up on the doc site shortly.


Using separately downloaded 6GB checkpoint models?

Is there a way to use separately downloaded 6GB checkpoint models instead of downloaded 12GB models from the web UI? for example for ComfyUI you download the 6GB models and place them in the checkpoints folder.

@AlgorithmicKing  Try this: https://youtu.be/zZTfUZnXJVk

thanks a lot 💐💐💐👍👍


change title on README

make the block size a bit smaller and also make the animations smooth to look better

resolved


Add keybindings suggestion for Safari and Terminal

Hi @nikitabobko ,
I found these two hacks to be useful, happy to contribute them if you think they could be of general interest.
Cheers,
Simon

Thanks!
Merged with the following patch:
diff --git a/docs/goodness.adoc b/docs/goodness.adoc
index 23ddd69..4b6d7b7 100644
--- a/docs/goodness.adoc
+++ b/docs/goodness.adoc
@@ -165,6 +165,37 @@ period = 'period'
 slash = 'slash'
 ----

+[#open-a-new-window-with-applescript]
+== Open a new window with AppleScript
+
+Invoking Safari/Terminal with a command the obvious way (`exec-and-forget open -a Safari`) results in an outcome that is probably not the intended one.
+Namely, that any workspace already containing an instance of Safari/Terminal is brought in focus.
+
+Opening *a new window* of a program that can supports multiple windows (such as Safari or Terminal.app) can be accomplished with an AppleScript inlined in `aerospace.toml` as follows:
+
+- Safari
++
+[source,toml]
+----
+ctrl-g = '''exec-and-forget osascript <<EOF
+tell application "Safari"
+    make new document at end of documents
+    activate
+end tell
+EOF'''
+----
+- Terminal
++
+[source,toml]
+----
+ctrl-g = '''exec-and-forget osascript <<EOF
+tell application "Terminal"
+    do script
+    activate
+end tell
+EOF'''
+----
+
 [#popular-apps-ids]
 == List of popular and built-in applications IDs

@@ -261,23 +292,3 @@ The list is useful to compose custom xref:guide.adoc#on-window-detected-callback
 |kdenlive|`org.kde.Kdenlive`

 |===
-
-[#new-window-command]
-== Open a new window with AppleScript
-
-Opening a new window of a program that can supports multiple windows (such as Safari or Apple Terminal) can be accomplished with an AppleScript inlined in `aerospace.toml` as follows:
-
-[source,toml]
-----
-ctrl-g = '''exec-and-forget osascript <<EOF
-tell application "MyApp"
-    -- often an extra command is needed here, see comment below!
-    activate
-end tell
-EOF'''
-----
-
-Per application notes:
-
-- Safari.app needs `make new document at end of documents` before the `activate` line
-- Terminal.app needs `do script` before the `activate` line


python3Packages.llm: Remove withPlugins

Description of changes
It looks to be an ad-hoc version of withPackages which doesn't compose with overriding.
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

In case anyone hits the same error as I did after this change:
Error: 'claude-3.5-sonnet' is not a known model

What I had before in my configuration.nix was:
(llm.withPlugins [(callPackage ./llm-claude-3.nix {})])

where llm-claude-3.nix is a python3.pkgs.buildPythonApplication. To migrate, I changed the former to
  (python3.withPackages (py: [
    py.llm
    (callPackage ./llm-claude-3.nix {})
  ]))

and, importantly, the latter to python3.pkgs.buildPythonPackage.
Without Application->Package change, my code got built, but I was getting the model not found error.

Hey @matklad, thanks for sharing the tip!
I actually ran into the exact same issue, I even had the same llm-claude-3.nix which is fun.
The change above will bring the llm cli into the environment, however, it also brings the python3 along with all it's luggage. I've got
❯ nix-env -i -f ./pkgs/llm/default.nix
[...]
Executing pythonImportsCheckPhase
Check whether the following modules can be imported: llm_claude_3
building '/nix/store/653s99nry3j1lm72xcs5g8shavhm1lws-python3-3.12.5-env.drv'...
created 405 symlinks in user environment
building '/nix/store/p6ch3h9ycb5azkl3ygj7094ayvs311l6-user-environment.drv'...

So the environment holds python now which to me it is not an option since I use precise versions per project and no need for me to have python installed globally so I made a wrapper:
runCommand "llm" { } ''
  mkdir -p $out/bin
  ln -s ${pyWithPackages}/bin/llm $out/bin/llm
''

to reduce the footprint.
For those who may be interested in Claude3.5 use, here is the full version of my llm with Claude 3.5 models support - https://gist.github.com/olebedev/b87f1f573be817530f2254b43ea936dc

It might be a good idea to reintroduce some withPlugins thing on the top-level package only (implemented using withPackages). It's just problematic to have such constructs inside pythonPackages.


Too many object streams error

The attached file that was created by merging multiple PDF files yields the "too many object streams" error.
tillA4-A3-A4-3-pdftopdf.pdf

[master 038fd86] Fix trailer dictionary handling (Issue #58) Fix generation number handling for object 0 (Issue #59)

Thanks, the "Unexpected 'startxref' token seen." is gone now.
Too many object streams error can be seen with this file for example: https://www.etsi.org/deliver/etsi_ts/136500_136599/13652101/16.06.00_60/ts_13652101v160600p.pdf


ModalBarrier's gesture recognizer does not call invokeCallback

Close #125385 - please see explanations there :)
If you think this PR looks OK, I will polish it (e.g. copy-and-paste-and-modify the tests shown in #125385 into here and make CI pass)
Pre-launch Checklist

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] I read the Tree Hygiene wiki page, which explains my responsibilities.
[x] I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
[x] I signed the CLA.
[x] I listed at least one issue that this PR fixes in the description above.
[x] I updated/added relevant documentation (doc comments with ///).
[ ] I added new tests to check the change I am making, or this PR is test-exempt.
[ ] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel on Discord.

Sure! See my comments above

@fzyzcjy Can you rebase to tip of tree to make the google testing check happy?

Sure!


during prerendering hypermodel has gotten very slow

This is a fairly recent change I think.
More experiments are needed but if you check out this repo: https://github.com/catmando/HyperAQ
and go the prerendering-on branch you will see the problem.
The code is fetching about 70 records, and for each record is displaying 4 pieces of data in a table.
This takes 35 seconds on my box, this is compared to 1 second to fetch and process the data if done on the client.
Some experiments show that for fetching 1 piece of data (instead of 4) it only takes 3 seconds to render the page.  Then if you get two fields from the same records it now takes 6 seconds, then if you get 3 pieces its up to 12, and finally the fourth piece (which is an attribute from a belongs_to relationship)  takes 35 seconds.  It seems like each additional piece of data is basically doubling the time.
I suspect the caching mechanism that keeps track of all the data fetched during pre-rerendering (which is needed so we can dump it the client and instantly rerender without re-fetching) is sub-optimal.
I also wonder if that caching mechanism got moved to the client (in the V8 engine) instead of the server.

Clearly related to the speed problems @janbiedermann is investigating

ill check this out

there is no prerendering_on branch in that repo above


Increasing initial timeout for health check in end to end

Description:
Docker based tasks need a bit more time to come up successfully. This change allows end to end tests that were previously failing to pass.
Testing Done:
End to end tests

Thanks all for verifying!


wondering if this tool will help solve a problem

I have a new Dell XPS laptop with windows hello face recognition built in. I also have a Logitech Brio, and external monitor connected to a Dell Thunderbolt dock. I work with the laptop lid open so both cameras are available to the system. I find a pattern of functionality:

After a cold boot the first face recognition sign in will use the Brio - works fine
Subsequent sign-ins will use the Dell cam - works fine
Eventually through a day of coming and going the laptop will report a problem on the sign in page and I have to use the fingerprint device instead to sign in - works fine
Looking into the device manager a number of devices have reported a code 43 - some sort of unexpected issue - including the windows hello face recognition device. Windows says it has stopped these devices due to the error.
A warm restart doesn't rectify this - it seems to require a shut down and cold boot.
Note: The web cams can still be used in conf calls after windows face recognition stops working so it doesn't seem to affect the normal light optics, just the IR cameras.

I noticed that there was no way to specify which camera to use and wondered if some sort of race condition was present in windows hello face recognition where two cameras are present where eventually the sign-in process will bug out. Is this something you have encountered and does this switcher prevent it happening?

Hello,
I have not experienced a similar issue with my combination (Surface Pro 4 and Lenovo 500 FHD Webcam) and have no idea what actually happens in your system.
Said that, this app intentionally disable specified built-in camera when specified USB camera is connected. Naturally it may change your system's issue.
Actually, I have been working on the improvement of this app and almost finished. Logitech Brio is one of rare web cam models capable of Windows Hello but I don't know much. So I am interested in how it looks like in the OS. If you don't mind, could you execute following command line command and post the result? I will be helpful to work this app with that camera.
pnputil /enum-devices /class camera /connected

Thanks for the response. Since my initial post I tried disabling the integrated webcam and the system used the Brio for a few unlocks but then the devices stopped working again so it seems the root cause is elsewhere. Might be a thunderbolt issue as the Brio can use a lot of bandwidth with its 4k res and there always appears to be an association with system Thunderbolt Controllers stopping at the same time when things go wrong.
The Logitech Brio seems to come up in various classes but not under camera.
steve@DESKTOP-ECSHQVU ❯ pnputil /enum-devices /class Camera /connected
Microsoft PnP Utility

Instance ID:                USB\VID_0BDA&PID_5510&MI_00\6&212fed36&0&0000
Device Description:         Integrated Webcam
Class Name:                 Camera
Class GUID:                 {ca3e7ab9-b4c3-4ae6-8251-579ef933890f}
Manufacturer Name:          Microsoft
Status:                     Started
Driver Name:                usbvideo.inf

Instance ID:                USB\VID_0BDA&PID_5510&MI_02\6&212fed36&0&0002
Device Description:         Integrated Webcam
Class Name:                 Camera
Class GUID:                 {ca3e7ab9-b4c3-4ae6-8251-579ef933890f}
Manufacturer Name:          Microsoft
Status:                     Started
Driver Name:                usbvideo.inf

As you see there are two integrated cameras I have no idea why there are two. There's only one web cam in the laptop itself. The Brio comes up under Imaging Devices in Device Manager but this class appears to be called Image in pnputil
steve@DESKTOP-ECSHQVU ❯ pnputil /enum-devices /class Image /connected
Microsoft PnP Utility

Instance ID:                USB\VID_046D&PID_085E&MI_00\7&3aaf9c37&0&0000
Device Description:         Logitech BRIO
Class Name:                 Image
Class GUID:                 {6bdd1fc6-810f-11d0-bec7-08002be2092f}
Manufacturer Name:          Logitech
Status:                     Started
Driver Name:                oem35.inf

It also shows up in the long list of USB Class devices
steve@DESKTOP-ECSHQVU ❯ pnputil /enum-devices /class USB /connected
Microsoft PnP Utility

Instance ID:                USB\VID_046D&PID_085E\2053DAE4
Device Description:         Logitech BRIO
Class Name:                 USB
Class GUID:                 {36fc9e60-c465-11cf-8056-444553540000}
Manufacturer Name:          Logitech
Status:                     Started
Driver Name:                oem59.inf

as well as an audio device
steve@DESKTOP-ECSHQVU ❯ pnputil /enum-devices /class audioEndpoint /connected
Microsoft PnP Utility

Instance ID:                SWD\MMDEVAPI\{<IP_ADDRESS>00000}.{6c6b8288-a6f5-4f90-803e-ca756e3114c5}
Device Description:         Microphone (Logitech BRIO)
Class Name:                 AudioEndpoint
Class GUID:                 {c166523c-fe0c-4a94-a586-f1a80cfbbf3e}
Manufacturer Name:          Microsoft
Status:                     Started
Driver Name:                audioendpoint.inf

Hope that helps with your update.

Thank you for the quick response.
The results of PnPUtil are quite helpful. The two built-in cameras may indicate ordinary camera and IR one.
I would like to ask one more test of Win32 API. I am interested in whether it is possible to tell the two built-in USB cameras and Logitech Brio are removable or not.
Could you execute the attached executable file and post the result again?
UsbProbe.zip

Can you share the code for the exe?

No problem.
I made some clean up and post it at https://gist.github.com/emoacht/0afa084cf30123f121492ab26fb8174d
I am deleting the executable file. So could you build it on your own and execute it?

I can't see the Brio in this but the integrated cams are there
/// 0 ///
ClassGuid:        {36fc9e60-c465-11cf-8056-444553540000}
DeviceInstanceId: USB\ROOT_HUB30\7&2456A4D2&0&0
HardwareId:       USB\ROOT_HUB30&VID8086&PID15EC&REV0006
FriendlyName:
IsRemovable:      False (CM_DEVCAP_SURPRISEREMOVALOK)
/// 1 ///
ClassGuid:        {36fc9e60-c465-11cf-8056-444553540000}
DeviceInstanceId: USB\ROOT_HUB30\4&B777A39&0&0
HardwareId:       USB\ROOT_HUB30&VID8086&PID06ED&REV0000
FriendlyName:
IsRemovable:      False (CM_DEVCAP_SURPRISEREMOVALOK)
/// 2 ///
ClassGuid:        {53d29ef7-377c-4d14-864b-eb3a85769359}
DeviceInstanceId: USB\VID_27C6&PID_533C\5&338395B4&0&1
HardwareId:       USB\VID_27C6&PID_533C&REV_0100
FriendlyName:
IsRemovable:      False (CM_DEVCAP_SURPRISEREMOVALOK)
/// 3 ///
ClassGuid:        {88bae032-5a81-49f0-bc3d-a4ff138216d6}
DeviceInstanceId: USB\VID_0BDA&PID_5510&MI_04\6&212FED36&0&0004
HardwareId:       USB\VID_0BDA&PID_5510&REV_9179&MI_04
FriendlyName:     Camera DFU Device
IsRemovable:      False (0)
/// 4 ///
ClassGuid:        {36fc9e60-c465-11cf-8056-444553540000}
DeviceInstanceId: USB\ROOT_HUB30\5&143B23AF&0&0
HardwareId:       USB\ROOT_HUB30&VID10DE&PID1ADA&REV00A1
FriendlyName:
IsRemovable:      False (CM_DEVCAP_SURPRISEREMOVALOK)
/// 5 ///
ClassGuid:        {ca3e7ab9-b4c3-4ae6-8251-579ef933890f}
DeviceInstanceId: USB\VID_0BDA&PID_5510&MI_00\6&212FED36&0&0000
HardwareId:       USB\VID_0BDA&PID_5510&REV_9179&MI_00
FriendlyName:     Integrated Webcam
IsRemovable:      True (CM_DEVCAP_REMOVABLE, CM_DEVCAP_SILENTINSTALL, CM_DEVCAP_SURPRISEREMOVALOK)
/// 6 ///
ClassGuid:        {e0cbf06c-cd8b-4647-bb8a-263b43f0f974}
DeviceInstanceId: USB\VID_8087&PID_0026\5&338395B4&0&14
HardwareId:       USB\VID_8087&PID_0026&REV_0002
FriendlyName:
IsRemovable:      False (CM_DEVCAP_SURPRISEREMOVALOK)
/// 7 ///
ClassGuid:        {36fc9e60-c465-11cf-8056-444553540000}
DeviceInstanceId: USB\VID_0BDA&PID_5510\200901010001
HardwareId:       USB\VID_0BDA&PID_5510&REV_9179
FriendlyName:
IsRemovable:      False (CM_DEVCAP_UNIQUEID, CM_DEVCAP_SURPRISEREMOVALOK)
/// 8 ///
ClassGuid:        {ca3e7ab9-b4c3-4ae6-8251-579ef933890f}
DeviceInstanceId: USB\VID_0BDA&PID_5510&MI_02\6&212FED36&0&0002
HardwareId:       USB\VID_0BDA&PID_5510&REV_9179&MI_02
FriendlyName:     Integrated Webcam
IsRemovable:      True (CM_DEVCAP_REMOVABLE, CM_DEVCAP_SILENTINSTALL, CM_DEVCAP_SURPRISEREMOVALOK)
/// 9 ///
ClassGuid:        {36fc9e60-c465-11cf-8056-444553540000}
DeviceInstanceId: USB\ROOT_HUB30\7&904153E&0&0
HardwareId:       USB\ROOT_HUB30&VID8086&PID15EC&REV0006
FriendlyName:
IsRemovable:      False (CM_DEVCAP_SURPRISEREMOVALOK)

Thank you for the results again.
Logitech Brio (shown in 24) seems okay.
But built-in cameras (shown in 9 and 20) are unexpected. They must not be removable. Quite odd.
Anyways, It is great help to improve this app.

Released updated version.
It should work with the devices of your system. I am not sure it can solve your issue though.

Any new development? If no, I will close this issue.

Hi again. I will test during the weekend - been quite busy.
On 26/02/2021 02:50:31, emoacht<EMAIL_ADDRESS>wrote:
Any new development? If no, I will close this issue.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub [https://github.com/emoacht/HelloSwitcher/issues/1#issuecomment-786373882], or unsubscribe [https://github.com/notifications/unsubscribe-auth/AAGVC2EELFP5I7FOG2RMMDTTA4D7NANCNFSM4XV6QNTQ].


co19/LayoutTests/fast/files/file-reader-result-twice_t01 flaky on IE11/Win7

I see at least two failures today. None on Win8. Marking as flaky.
The failure is not very informative.
window.onerror called:
http://<IP_ADDRESS>:54392/root_build/generated_compilations/dart2js-sdk/short7577_s_file-reader-result-twice_t01/test.js:3914:
Unspecified error.

https://dart-review.googlesource.com/c/sdk/+/22803


OpenTimelineIO Module Not Found and Qt5 Assertion Error

After some effort I've been able to squash most of my build problems, but I have two remaining issues with no leads and thought it was time for an issue report. The first one is that I have a system python3.6 and another python3.7 scoped to /usr/local to avoid dependency conflicts on my CentOS installation. OpenTimelineIO seems to load fine when the latter is used but the shared object file _opentime refuses to import unless I install the dependency to my python3.6 environment. It's essentially refusing to import (only) the shared objects but I have no clue why at the moment.
[info] xStudio logging started.
[...]
[info] API enabled on <IP_ADDRESS>:45500, session name default0
[...]
[info] xStudio UI launched.
ASSERT: "last >= first" in file itemmodels/qabstactitemmodel.cpp, line 2760
Aborted

This second error is even more cryptic and seems to be scoped to the Qt5 codebase. I originally thought it was related to the python warning (that one was printing a lot of logs) but after installing OpenTimelineIO into the python3.6 environment it still persists. Any pointers on this one?

Just for reference, the Qt5 build is based off the v5.15.8-lts-lgpl branch from the upstream repository. Seems to build and function fine otherwise, but xStudio will open a window and immediately crash with the above assertion error.

Building everything on CentOS 7.9.2009 with GCC 9.3.1 from the devtoolset-9 package. I am noticing some weird inconsistencies in the configure step regarding python so perhaps you can shed some light there. Tried the PYTHON_EXECUTABLE flag on cmake to force 3.6 but it doesn't seem to work everywhere.
-- Found Python: /usr/local/bin/python3.7 (found version "3.7.11")
-- Found PythonInterp: /bin/python3.6 (found suitable version "3.6.8")
-- Found PythonLibs: /usr/lib64/libpython3.6m.so
-- Found pybind11: /usr/local/include (found version "2.6.2")
-- Found Python: /usr/local/bin/python3.7 (found version "3.7.11")

Regarding the Qt5 build I'll include the steps below. I did have to install a number of dependencies to get the xcb plugin working but other than that it seems fine.
git clone https://code.qt.io/qt/qt5

cd qt5
git checkout v5.15.8-lts-lgpl
perl init-repository

./configure -opensource -developer-build -confirm-license -prefix /opt/xstudio -nomake examples -nomake tests

make --jobs
make install

I also noticed some new warnings during the launch that could potentially be causing issues. Not sure if those would cause a full crash though.
Failed to read preference override Invalid override path /root/.config/DNEG/xstudio/preferences/new_session.json
Failed to read preference override Invalid override path /root/.config/DNEG/xstudio/preferences/qml_ui.json
Failed to read preference override Invalid override path /root/.config/DNEG/xstudio/preferences/application.json

I was able to resolve all outstanding Python quirks by removing the 3.7 installation, but the Qt5 crash has been consistent through everything. No warnings in the logs other than the three mentioned above so I don't have any new leads.

Managed to resolve the Qt5 errors so everything is good now. The first requirement was including the list of dependencies below to make sure Qt5 had X11 support. The assert error was caused by the -developer-build flag, which seems to disable -release during the configure step despite it being the default. Hopefully this is enough context to include Qt5 in the documentation, which is the only manual step in the process right now. At some point I'd love to figure out how I can reduce the Qt5 compile time by excluding unused modules.

libxkbcommon-devel
libxkbcommon-x11-devel
libXinerama-devel
xcb-util-devel
xcb-util-keysyms-devel
xcb-util-image-devel
xcb-util-renderutil-devel
xcb-util-wm-devel


Do a file upload performance test

try to gzip/tar a file

try to harvest lindat

related to #469


TechDebt: Enable MyPy on AMP

Codecov Report

Merging #5546 (911b8fe) into master (98932ac) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master    #5546   +/-   ##
=======================================
  Coverage   96.10%   96.10%
=======================================
  Files         736      736
  Lines       72529    72531    +2
=======================================
+ Hits        69702    69704    +2
  Misses       2827     2827

Flag
Coverage Δ

servertests
36.88% <69.35%> (+<0.01%)
:arrow_up:

unittests
96.04% <100.00%> (+<0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

moto/amp/exceptions.py
100.00% <100.00%> (ø)

moto/amp/models.py
100.00% <100.00%> (ø)

moto/amp/responses.py
92.39% <100.00%> (+0.08%)
:arrow_up:

moto/core/exceptions.py
100.00% <100.00%> (ø)

moto/core/responses.py
95.20% <100.00%> (ø)

moto/core/utils.py
94.29% <100.00%> (ø)

moto/utilities/tagging_service.py
97.77% <100.00%> (+0.02%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


nativescript-facebook not found

Hello, I entered the command as it was specified in the readme file, and I got this error:
$ tns plugin add nativescript-facebook
npm ERR! Darwin 16.5.0
npm ERR! argv "/usr/local/Cellar/node/7.10.0/bin/node" "/usr/local/bin/npm" "install" "nativescript-facebook" "--save"
npm ERR! node v7.10.0
npm ERR! npm  v4.2.0
npm ERR! code E404

npm ERR! 404 Registry returned 404 for GET on https://registry.npmjs.org/nativescript-facebook
npm ERR! 404
npm ERR! 404  'nativescript-facebook' is not in the npm registry.
npm ERR! 404 You should bug the author to publish it (or use the name yourself!)
npm ERR! 404
npm ERR! 404 Note that you can also install from a
npm ERR! 404 tarball, folder, http url, or git url.

this however seems to work: $ tns plugin add nativescript-facebook-login

I was able to work around by cloning this repository, moving src out and renaming it to nativescript-facebook, running tns add plugin <relative path to local copy>, and then manually running tsc to compile the package. I've added the FacebookLoginButton in my app component but nothing shows up. I'm also seeing some errors when the app loads:
Falling back to loading access token from NSUserDefaults because of simulator bug
Falling back to storing access token in NSUserDefaults because of simulator bug
Falling back to loading access token from NSUserDefaults because of simulator bug
Falling back to storing access token in NSUserDefaults because of simulator bug
Falling back to loading access token from NSUserDefaults because of simulator bug
Falling back to storing access token in NSUserDefaults because of simulator bug

Normal message received by listener connection. Ignoring.
Could not successfully update network info during initialization.

Some digging on google shows that others have hit these errors with the ios facebook sdk, and there are some suggestions on how to fix. Unfortunately it's a black box to me, since I'm using this wrapper over the sdk. Any ideas?
http://stackoverflow.com/questions/43446404/could-not-successfully-update-the-network-info-during-initialization-xcode-error
http://stackoverflow.com/questions/41033776/falling-back-to-loading-access-token-from-nsuserdefaults-because-of-simulator-bu

He @wolfgangmeyers. The plugins is still not published to npm. It will be soon. That's why you hit this error.

I will try running those and let you know if I hit any issues.

The nativescript-facebook plugin has been published in npm. You shoul no more experience this issue. I am going to close it.

FYI while other features (like graph api) are in development, it might be worth mentioning that it is straightforward to use the available http client to make authorized calls to the graph api, passing in the token retrieved by the login by appending ?access_token=<token here>.


Write more vitests

Components

[x] Addon.vue
[ ] LocalAddon.vue
[ ] RemoteAddon.vue

Views

[ ] InstalledAddons.vue
[ ] RemoteAddons.vue

[ ] Set up GitHub action to run tests on push

Some upstream issues to investigate first that are failing tests that use VS Code styling


[Enterprise InfluxDB] Update release notes/changelog doc

Update the content in about-the-project/release-notes-changelog with the 1.3.0 information in https://github.com/influxdata/plutonium/blob/1.3/CHANGELOG.md.

Done

Includes 1.3.1 as well.


DownloadFile - get bytes array and give directly to client, not waiting file being downloaded

Im creating web Telegram application using Spring Boot. When I download file its firstly download to server where my app deployed, but I want client gets file directly from telegram server. Is it possible?

Only those who sent request to Telegram server can receive the response. But this doesn't prevent from using a partly downloaded file. You can use readFilePart to read a part of downloaded file and handle updateFile to know, which parts of the file has already been downloaded.


update DOM function mangles this cell

start with this notebook:
http://sharing.beakernotebook.com/gist/anonymous/1b70127ff69db0ce2705
compare how the HTML cell looks there and how it looks right after you run it:

when you run updateDocumentModelFromDOM it breaks and looks like this:

related: https://github.com/twosigma/beaker-notebook/issues/798

this is a dup now


i18n support

I personally do not use Eleventy’s 18n plugin, but anyway it would be nice if this plugin could give the possibility to choose to display the navigation bar in a different language, according to the page’s language. Of course, nav URLs should change accordingly.

I just wanted to share my solution for finding the active element in navigation.
Via config file called "site" I set the available languages.
For generating translated content I'm using the pagination feature to iterate over all languages.
This will create one file per language with the permalink /<lang>/<page-name> e.g. en-US/page.
By adding the custom property baseUrl I can detect if I should show the current navigation element as "active".
With the help of this plugin I'm setting the translated content:
https://github.com/adamduncan/eleventy-plugin-i18n
This way I don't need to specify an extra page per language and still be able to use the features provided by eleventy i18n integration.
If someone found a better solution to achive something like this, it would be awesome to know 👍
My page front matter looks like this:
page.njk
---
layout: layout/onepage.njk
eleventyNavigation:
    key: Page
    order: 3
    baseUrl: "/page"
pagination:
    data: site.languages
    size: 1
    resolve: values
    alias: lang
    addAllPagesToCollections: false
permalink: '{{ lang.code }}/page/'
eleventyComputed:
    title: '{{ "page_title" | i18n }}'
    description: '{{ "page_description" | i18n }}'
---

The navigation part looks like this:

                        {% set navPages = collections.all | eleventyNavigation %}
                        {%- for entry in navPages %}
                            {% set isCurrentPage = entry.url == page.url or entry.baseUrl in page.url %}

                                {{ entry.title }}

                        {%- endfor %}

I think that i18n will be much more easily implemented after accepting this pull request:
https://github.com/11ty/eleventy-navigation/pull/34
Currently it is impossible to filter the navigation entries by language because eleventyNavigation doesn't include the "lang" attribute.

I added a custom filter to get only the pages with the same lang as the current page:
eleventyConfig.addFilter("pageLang", function(value) {
  return value.filter(item => item.page.lang === this.page.lang)
});

It's used like this:
{{ collections.all | pageLang | eleventyNavigation | ... }}


pthread_create: Operation not permitted (1)

[1681713279.028][SEVERE]: pthread_create: Operation not permitted (1)
Starting ChromeDriver 111.0.5563.64 (c710e93d5b63b7095afe8c2c17df34408078439d-refs/branch-heads/5563@{#995}) on port 9515
All remote connections are allowed. Use an allowlist instead!
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
[1681719833.469][SEVERE]: pthread_create: Operation not permitted (1)
docker 启动报的错误

正常日志，并不是报错

好的，谢谢

switch to docker.io instead of docker-ce in debian 11 or ubuntu 22.04.
It's okay.

thx！

另一个解决方案：加一下 privileged: true


Vibration is felt twice while long pressing a song

What was the activity?
I installed the latest 1.1 SNAPSHOT APK.
I long pressed a song to add it to a service.
What was observed?
The vibration effect was felt twice.
What is expected?
The vibration effect should be felt once. To understand this, try long pressing an email in the Gmail mobile app.

We can't recreate this issue.
FYI,
We set the vibration effect time for 15 ms, I think so only the vibration effect was little bit more.
but it's not felt twice.
@sskjames
We gave the same vibration effect for the Service Page, Service song list page.
I think, you already check those also.