Slow local usb backup / high io load

Output of restic version
restic 0.8.1
compiled with go1.9.2 on linux/amd64

How did you run restic exactly?
export RESTIC_PASSWORD="123"
export RESTIC_REPOSITORY="/mnt/usb/backup/restic"

/opt/restic/restic backup --files-from /opt/restic/usb/restic_backup_dirs --exclude-file         /opt/restic/usb/restic_backup_exclude

What backend/server/service did you use to store the repository?

local mounted usb 3.0 drive (4TB) formatted with ext4
Ubuntu 16.04.3 LTS

Expected behavior

higher throughput, lower system load

Actual behavior

backup of ~2TB mainly big video files 200GB smaller files (documents etc)

current output of restic:
password is correct
scan [/data/data0]
scanned 53385 directories, 828226 files in 0:22
[40:34:48] 67.83%  10.637 MiB/s  1.482 TiB / 2.185 TiB  878217 / 881611 items  0 errors  ETA 19:14:47

current load average:
11:55:00 up 5 days,  1:59,  1 user,  load average: 33.42, 33.27, 33.08

top output
%Cpu(s):  2.8 us,  0.3 sy,  0.0 ni, 24.2 id, 72.8 wa,  0.0 hi,  0.0 si,  0.0 st
PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
7407 root      20   0 2015492 1.717g   8452 S 128.9 11.2   1638:24 restic

the system is responsive

but the backup is really slow here, expected it 3-5 times faster (aka the USB drive speed) ;-)

I will test the USB drive speed afterwards I won't cancel the currently running backup for now

Steps to reproduce the behavior

Do you have any idea what may have caused this?
not really but something seem very io/cpu intensive. Maybe related to this bug: https://github.com/restic/restic/issues/1145
Do you have an idea how to solve the issue?
Did restic help you or made you happy in any way?
yes :-), I use it successfully to backup (different files as here) to google cloud storage (with expected speed).

I'm unsure about the correct terminology. I refer to "Restic pack size" as the size of files stored under $RESTIC_REPOSITORY/data/[a-z0-9]{2,2} as documented here.
Similarly i refer to "Borg segment size" as the files stored under $BORG_REPOSITORY/data/[a-z0-9]{1,2} as documented here

restic 0.9.4 (v0.9.4-3-g1107eef2) compiled with go1.11.4 on linux/amd64

I was going to create a new Issue when i stumbled upon this one.
I've just given up on getting Restic to successfully perform a backup on my 8TB Seagate Archive drive (SMR).
I've tested for a couple of weeks, with different filesystems, and come to the conclusion that the Restic pack size doesn't work very well with SMR drives.
My backup set consists of ~6.5TB. It has:

350 GB User Homes, consisting mainly of "smaller" files (along with MailDir)
500 GB JPEG photos.
1.5 TB RAW Photos
4+ TB of video files and other non compressible files.

I tested with Ext4, XFS and Btrfs, and for some reason Btrfs with relatime, SSD and compress=lzo options enabled gave me the best results. I assume it's because SSD's and SMR drives both need "chunks" rewritten as opposed to blocks.
With Ext4 the backup would grind to a halt around the 800GB mark. IO on the drive was 30-50MB/s, but the actual repository size grew with 2-4 MB/s.
With XFS things got even worse, where the backup would "stall" around 600GB.
With Btrfs and SSD options, it would get to around 1.5TB in size before "stalling".
By stalling i mean growing less than 500MB in size within the range of 12 hours.
Restic appeared to be working and the only thing stalling it was IO on the drive.
A simple "ls -l" of $RESTIC_REPOSITORY/data/00 would take 2 minutes to complete.
Restic seems to prefer pack sizes of 4-6 MB.
For comparison, Borg, which uses much larger segment sizes of 500MB on the same backup set, is able to perform a full backup in a couple of days regardless of Ext4 or Btrfs being used as the filesystem.
I firmly believe that the SMR drive is what's causing the problems, as i'm doing a somewhat smaller remote backup to an Odroid HC2 equipped with a 4TB non-SMR drive, and Restic performs fine here.
I also backup the same backup set to Jottacloud via rclone restic-serve, and it also works (surprisingly) well there, so i don't doubt Restic is able to handle the amount of data.
A possible solution would be to allow larger pack sizes, and i've read lots of open and closed issues discussing the pros and cons of this. I haven't been experimenting with it, as i prefer my backup software "unmodified".
If i run the following command on my restic repository (2.2TB, non SMR)
find $RESTIC_REPOSITORY -ls | awk '{sum += $7; n++;} END {print sprintf("%d",sum/n);}'

I get the following value : 5.016.160
For comparison, the same command on a 6TB Borg repository yields : 494.832.961
The bigger segment size ultimately results in far fewer rewrites being done despite rewriting more data.

Huh, thank you very much for the experience report! I don't have any hands-on experience with SMR drives yet, but I agree with your assessment that the pack size restic uses (4-6MiB) is likely the cause for the behavior you see. I'll keep this in mind when we come to implementing any sort of option to change the target size.
Overall, we may need options for users to set the target pack size, there's no one-size-fits-all value here. For users with small upstream bandwidth who use sftp or a cloud service, small files means being able to resume interrupted backups without having to re-upload much data. On the other hand, with a storage device like your SMR drive, the larger the file is the better it is for IO.
So, thanks again for the report!

As for a good default value, I also doubt there is a good default value, but in any case I feel the default Restic value is too low for today’s wire speed. Even when backing up over WiFi, you get 10MB/sec on a somewhat decent 802.11g connection.
As for broadband, most connections today Re capable of uploading 6 MB in seconds. Even a 512 Kbit connection can upload 18 MB in 2 minutes. I have no idea how the rest of the world is connected, but here 100/100 mbit fiber is the slowest fiber you can buy, and if we’re talking ADSL, the slowest speed you can purchase is 50/10 mbit, which means an 18MB file will upload in 14 seconds (not taking into account async transfers)
Another consideration is that storage is growing, and prices are dropping, meaning people backup large amounts of data “for peanuts”. While filesystems can generally handle lots of files, none of them like tens of thousands of them in the same directory. Most start showing noticeable slowdowns around the 3000 files mark. For large backup sets this is a serious limiting factor, even if the drive is not SMR.
I would set an acceptable “loss rate” based on how much people can tolerate reuploading in case of resuming a backup, with a slow link as the speed variable.
So in the case of a 10 mbit upload, and lets say the acceptable loss is 1 minute, that would set the pack size to 75 MB, minus protocol overhead, so let’s say 50-60 MB.
I agree that a configurable option would be optimal, but if that’s very hard to do, perhaps the default pack size could be adjusted without too much work ? The way I read the docs, variable pack sizes are supported in a repository, meaning an existing repository would just add newer, larger, packs right along the old 4-6 MB ones.

(@jinie FYI my upload speed in our town is 1 Mbps.)

My plan was to explore if it's possible to set the pack size dynamically, based on the storage speed of the backend: Start with ~5-10MiB, measure the storage progress over a minute or so, then take that value (maybe limited by sane lower/upper bounds).


pwsh ArgumentList

With the pwsh binary not taking an -ArgumentList parameter it makes it pretty hard to call a PS script with parameters from another shell.
For example in Windows PS you can do:
"Powershell.exe -File Script.ps1" -ArgumentList "-Param1 Value -Param2 Value"
PWSH doesn't seem to support this, if it does can you please point me to the documentation that states how? because this doesn't display it:
https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_pwsh?view=powershell-7

Nevermin, I'm stupid, simply doing works fine.
"pwsh -File Script.ps1" -Param1 Value -Param2 Value


error on powershell deployment

I have uninstalled and let the deployment install the azure cli but I am still getting the following error.
Creating Azure AD App: Company_Communicator-users...
ERROR: unrecognized arguments: --available-to-other-tenants True --oauth2-allow-implicit-flow False
Examples from AI knowledge base:
az ad app create --display-name mytestapp --optional-claims @manifest.json
Create an application with optional claims
az ad app create --display-name mytestapp --identifier-uris https://mytestapp.websites.net --app-roles @manifest.json
Create an application with a role
https://docs.microsoft.com/en-US/cli/azure/ad/app#az_ad_app_create
Read more about the command in reference docs
Waiting for app creation to finish...
Azure AD App: Company_Communicator-users is created.
Updating app secret...
ERROR: argument --id: expected one argument
Examples from AI knowledge base:
az ad app credential reset --id 00000000-0000-0000-0000-000000000000
append or overwrite an application's password or certificate credentials (autogenerated)
az ad app credential reset --id 00000000-0000-0000-0000-000000000000 --cert<EMAIL_ADDRESS>Append a certificate to the application with the certificate file.
https://docs.microsoft.com/en-US/cli/azure/ad/app/credential#az_ad_app_credential_reset
Read more about the command in reference docs
Azure AD App: Company_Communicator-users registered successfully.
Failed to create or update User app in Azure Active Directory. Exiting...

Hi @gyrantol ,
Thanks for raising the query.  Uninstall the existing Azure CLI version. Here is the link for Azure CLI version and try the procedure again.

if I do that I get this error
PS C:\temp\microsoft-teams-apps-company-communicator-main\Deployment> .\deploy.ps1
Checking if Azure CLI is installed.
Please make sure the installed version of Azure CLI is 2.49.0 or higher.
You have version  installed.
Please refer to the prerequisites section of powershell deployment guide
PS C:\temp\microsoft-teams-apps-company-communicator-main\Deployment>


A helper in need on Microsoft Teams

Project name
Buddy
Description
Keep up to date with daily meetings and tasks
Bot created to send notifs.
Repo URL
https://github.com/KerishaStewart/ms-hackathon-mar-2023
Team members
Kerisha Stewart

Sure thing, on it!

Unfortunately not. The deadline for working on projects was end of day yesterday.

Hi, here is a link to my demo. Click here.


backport: 1.6.2 backport patches

Backports include the below changes.
https://github.com/kata-containers/agent/pull/526
https://github.com/kata-containers/agent/pull/532
https://github.com/kata-containers/agent/pull/528
https://github.com/kata-containers/agent/pull/491

/test

Power8 ubuntu failed with below errors
ERROR: Cannot delete workspace: Unable to delete '/home/jenkins/workspace/kata-containers-agent-Power8-ubuntu-16-04-PR-initrd/go/pkg/linux_ppc64le/github.com/kata-containers/tests/vendor/github.com/BurntSushi/toml.a'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
Performing Post build task...
Match found for :.* : True

vsocks build failed with
# time="2019-04-17 07:13:22.783492234Z" level=info msg="About to del CNI network crionet (type=bridge)"
# time="2019-04-17 07:13:23.919444517Z" level=debug msg="event: "/var/run/crio/exits/15566274909acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8.A2JG0Z": RENAME"
# time="2019-04-17 07:13:23.919511317Z" level=debug msg="event: "/var/run/crio/exits/15566274909acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8": CREATE"
# time="2019-04-17 07:13:23.919520917Z" level=debug msg="container or sandbox exited:<PHONE_NUMBER>9acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8"
# time="2019-04-17 07:13:23.919546517Z" level=debug msg="sandbox exited and found:<PHONE_NUMBER>9acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8"
# time="2019-04-17 07:13:24.754494445Z" level=debug msg="unmounted container "15566274909acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8""
# time="2019-04-17 07:13:24.754571745Z" level=debug msg="StopPodSandboxResponse<PHONE_NUMBER>9acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8: &StopPodSandboxResponse{}"
# Stopped sandbox<PHONE_NUMBER>9acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8
# time="2019-04-17 07:13:24.763803178Z" level=debug msg="RemovePodSandboxRequest &RemovePodSandboxRequest{PodSandboxId:15566274909acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8,}"
# time="2019-04-17 07:13:24.809412438Z" level=debug msg="Failed to unmount 5c4f6e20750cf8188310130934f10cb6e1e1b7e301a7bd00f8144d377cc69aca overlay: /tmp/tmp.O5Hg9WZrCA/crio/overlay/5c4f6e20750cf8188310130934f10cb6e1e1b7e301a7bd00f8144d377cc69aca/merged - invalid argument"
# time="2019-04-17 07:13:24.847987273Z" level=debug msg="unmounted container "15566274909acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8""
# time="2019-04-17 07:13:24.912303498Z" level=debug msg="RemovePodSandboxResponse &RemovePodSandboxResponse{}"
# Removed sandbox<PHONE_NUMBER>9acd2a564de3552eda1abcd6663448a474a61611b81eaeec1867d8
# time="2019-04-17 07:13:24.914445206Z" level=debug msg="Caught SIGTERM"

power8 feels like something has gotten stuck with a file open. @nitkon - any thoughts, or maybe a reboot is in order.
Having said that, I just went to look at the power8 CI slave build history:
http://jenkins.katacontainers.io/computer/Power8_slave01/builds
It looks to me like we have not had a good build for 1 month and 18 days.
@nitkon - are you able to find resource to fix/maintain this? If not, I think it's heading to be disabled.
thanks.


Upgrade auth client to 1.3.0

Codecov Report

Merging #131 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master   #131   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files          33     33
  Lines         683    683
  Branches       83     83
=====================================
  Hits          683    683

Flag
Coverage Δ

#builder
100% <ø> (ø)
:arrow_up:

#runtime
100% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 39e122b...aef9025. Read the comment docs.


Update MD file on new branch 2017-28-20_17-11-47

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestCon.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Replacing get_if_addrs-sys with local-ip-address

README.md states that if an IP address isn't listed in a column that it will check each gateway until one reports success.
On Windows, you can end up with a whole lot of different network interfaces added through things like WSL, Bluestacks, Hyper-V, VPNs, and so on.
It might be better to use the local-ip-address crate instead, which is compatible with "Linux, Windows, and macOS (and other BSD-based systems)", according to its documentation.
https://crates.io/crates/local-ip-address
https://github.com/EstebanBorai/local-ip-address

Hi again!
The point here is, if you don't give an IP address, then how should the program know on what interface it should send the UPnP request? Say you have two legit network interfaces, wlan and eth. Actually, even Hyper-V and VPNs and so on can be included here, for a program that uses these interfaces it just doesn't matter what "type" of network interface it is, they just see a bunch of IP addresses. On which one should we send the request? eth? wlan? vpn? Even using the local-ip-address crate, we could never be sure we get the correct address that you intended to use.
By providing the "use the first interface that gives a positive response" approach, I help people in "simple" scenarios, where there actually is only one network interface that responds successfully.
In your case, how about I support giving the IP address in CIDR notation? This way, if your desired network's DHCP gives you an address between <IP_ADDRESS> and <IP_ADDRESS>, you could give the IP address as <IP_ADDRESS>/24 and I only send the request via the interface that matches this CIDR range. Is this something that would fit your use case?

The current development branch supports IP addresses in CIDR notation. See https://github.com/FloGa/upnp-daemon/blob/1f1c2d5a723bda6a54c17465fd757c06b52d5704/README.md#fields.
If nothing comes up in the next days, I'll create a new release.

Release 0.4.0 includes the noted changes.
I'm closing this issue for now. If you still have problems, don't hesitate to re-open this or open a new issue!


Webpack should not modify bundles on disk unless changed

Do you want to request a feature or report a bug?
Feature

What is the current behavior?
Webpack emits (overwrites) files even if they are unchanged. This updates the file modification time and can break caching mechanisms.
If the current behavior is a bug, please provide the steps to reproduce.
I think any webpack config will do this, but I can provide a specific example if needed.

What is the expected behavior?
Webpack should check whether the created bundle hash and filename matches the one on disk, and not emit the bundle if so.
If this is a feature request, what is motivation or use case for changing the behavior?
HTTP servers will send the file modification date to the client, which can use it for a conditional GET request. I appreciate that setting long cache times combined with hashes in the filename partially solve this issue, but supporting conditional GET would be useful too.
I also move bundles to my web server using Django's collectstatic functionality, which relies on file modification dates. This means that all of the emitted bundles are copied even if their contents has not changed.
Please mention other relevant information such as the browser version, Node.js version, webpack version and Operating System.
Webpack 3.0.0

any update on this? if not then I will write a plugin for this

I'm not aware of any update that fixes this, but a plugin would be a great help.

check this
https://github.com/kambing86/ignore-unchanged-webpack-plugin
feel free to contribute based on your needs

Thanks @kambing86, that seems to do the job! Only caveats I've found are:

Source maps are still emitted by SourceMapDevToolPlugin (not much of a problem, since they're only for developers)
Compressed assets are still emitted by CompressionPlugin, but this can be corrected by setting cache: true

Since this plugin covers my needs, I'll close the issue. Thanks for creating the plugin!


cartodb.js build 3.15.8 broken

The build is broken with the following output:
==> default: >> Destination not written because minified CSS was empty.
==> default: Running "imagemin:distCSSImages" (imagemin) task
==> default: Fatal error: Cannot read property 'contents' of undefined

Ran HOME=~ubuntu grunt build returned 3

We should generate a new one. @alonsogarciapablo

Fixed on new 3.15.9 version.


host and dig commands do not work

Besides development functionality, these two tools are probably my most frequently used tools on the command line.
root@localhost:~# host google.com
socket.c:2447: setsockopt(20, SO_TIMESTAMP) failed: Invalid argument
socket.c:1915: internal_send: <IP_ADDRESS>#53: Invalid argument
socket.c:2447: setsockopt(21, SO_TIMESTAMP) failed: Invalid argument
socket.c:2476: setsockopt(21, IPV6_RECVPKTINFO) failed: Invalid argument
socket.c:1915: internal_send: fec0:0:0:ffff::1#53: Invalid argument
socket.c:2447: setsockopt(22, SO_TIMESTAMP) failed: Invalid argument
socket.c:2476: setsockopt(22, IPV6_RECVPKTINFO) failed: Invalid argument
socket.c:1915: internal_send: fec0:0:0:ffff::2#53: Invalid argument
root@localhost:~# dig
socket.c:2447: setsockopt(20, SO_TIMESTAMP) failed: Invalid argument
socket.c:1915: internal_send: <IP_ADDRESS>#53: Invalid argument
socket.c:2447: setsockopt(21, SO_TIMESTAMP) failed: Invalid argument
socket.c:2476: setsockopt(21, IPV6_RECVPKTINFO) failed: Invalid argument
socket.c:1915: internal_send: fec0:0:0:ffff::1#53: Invalid argument

See issue #69.
(And maybe try searching next time.)

Yes, any network tools that rely on NETLINK or ICMP do not currently work and we are aware of this. We will be tracking\prioritizing which features to light up next by looking at the feedback provided at the wpdev portal. We appreciate your feedback and please make sure to provide it through the wpdev portal as well. Looks like there is already a post tracking this which you can up vote (or add a new one):
https://wpdev.uservoice.com/forums/266908-command-prompt-console-bash-on-ubuntu-on-windo/suggestions/13383789-enable-network-interface-enumeraration


Apple/user block pagination

Description
Implenment pagination for user block
close #495
Checklist

[x] Targeted PR against correct branch.
[x] Linked to Github issue with discussion and accepted design OR link to spec that describes this work.
[x] Wrote unit tests.
[ ] Wrote integration tests (simulation & CLI).
[x] Updated the documentation.
[x] Added an entry to the CHANGELOG.md file.
[x] Re-reviewed Files changed in the Github PR explorer.

@HarleyAppleChoi
There are still some build errors plus the files are not properly formatted.
After you've fixed build errors try to run make lint it will show what the problems are

I see from the failing coverage's checks that tests related to userBlocks for GRPC query, keeper and alias functions are missing. Can you add some tests for them? There are other similar tests in the profiles folder. You can take them as an example


Implement Capabilities, Get, Set, Subscribe RPCs and convenience functions

All RPCs implemented for usage with Python. get_xpaths, set_json, and subscribe_xpaths to ease usage of RPCs.
Not sure what to call it yet, hesitant to publish as gnmi directly - but don't want to completely call it cisco_gnmi as it's not a specific Cisco interface. Might look at donating library to OpenConfig.
Not merging until naming is determined.

There is some platform-specific behavior which is going to be frustrating to figure out. Closing until determined.

ping


Switch to tag based releases

Switch to using a tag based release system rather than having to commit the release version to the repository.
Version number is now calculated based on the most recent tag using git describe.  So the current latest master is 0.2.0+28-g03e8904 - last release was 0.2.0 and this is 28 commits after that tag with the git hash 03e8904 (git prefixes with the -g).  Builds from master are published under the develop version (ie web3signer-develop.tar.gz) which provides a stable download URL for the latest binaries inline with the docker develop tag.
Releases are performed by tagging a commit in the repo and the name of the tag is used as the version number.
Also switched to using grgit plugin to work with git during the build instead of parsing the git data files manually.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


feat added chrM to chr20 fasta file and removed the original

Added chrM to Homo_sapiens_assembly38_chr20.fasta and renamed it to Homo_sapiens_assembly38_chr20_chrM.fasta. This was done to be able to use the sarek test-data to test the rare-disease pipeline, which includes a MT workflow.

@maxulysse @ramprasadn do you think I should add any other files containing chrM (.fai, .dict...) ?

@FriederikeHanssen what do you think of this PR?

I realised that the issue with file size happened because I had tried to make the PR on raredisease test-data directly through GitHub. It works through terminal, so I will just update raredisease test-data.


-myScripts parameter not working?

Issue
Wanting to override the standard HelperFunctions.ps1 I have created my own version of it and have added a file reference to the -myScripts parameter of New-BCContainer; see following script.
The purpose is to get the following two test apps deployed as these are excluded by the standard HelperFunctions.ps1, but are contained in the artefacts:

Tests-Marketing
Tests-SINGLESERVER

Even though my HelperFunctions.ps1 is copied to c:\run\my folder is seems not to be executed as these two extensions are not deployed. See below a zipped version of my HelperFunctions.ps1.
Reading your blog post NavContainerHelper – Overriding scripts in NAV containers did not show me what I might be doing wrong.
Should I be able to see whether it did execute my replacement script?
Scripts used to create container and cause the issue
New-BCContainer -accept_eula:$accept_eula `
                -accept_outdated:$accept_outdated `
                -containerName $containerName `
                -artifactUrl $artifactUrl `
                -licenseFile $licenseFile `
                -auth UserPassword `
                -credential $credential `
                -memoryLimit:10GB `
                -updateHost `
                -shortcuts StartMenu `
                -isolation process `
                -includeTestToolkit `
                -myScripts @("C:\Users\lvvugt\OneDrive\Documenten\WindowsPowerShell\BcContainerHelper\myScripts\HelperFunctions.ps1")

Full output of scripts
BcContainerHelper is version 1.0.18
BcContainerHelper is running as administrator
Host is Microsoft Windows 10 Pro - 20H2
Docker Client Version is 20.10.0
Docker Server Version is 20.10.0
Removing container Bc17w1UserPw
Removing Bc17w1UserPw from host hosts file
Removing Bc17w1UserPw-* from host hosts file
Removing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw
Fetching all docker images
Using image mcr.microsoft.com/dynamicsnav:10.0.19042.630-generic-dev
Creating Container Bc17w1UserPw
Version: 17.2.19367.19735-w1
Style: onprem
Multitenant: No
Platform: 17.0.19353.19730
Generic Tag: <IP_ADDRESS>
Container OS Version: 10.0.19042.630 (20H2)
Host OS Version: 10.0.19042.685 (20H2)
WARNING: Host OS and Base Image Container OS doesn't match and process isolation is specified. If you encounter issues, you could try to specify -isolatio
n hyperv
Using process isolation
Using locale en-US
Disabling the standard eventlog dump to container log every 2 seconds (use -dumpEventLog to enable)
Using license file https://www.dropbox.com/s/74kn52tkz08kybn/BC17%20-%20Lvvugt.flf
Downloading C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\my\license.flf
Files in C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\my:
- AdditionalOutput.ps1
- HelperFunctions.ps1
- license.flf
- MainLoop.ps1
- SetupVariables.ps1
- updatehosts.ps1
Creating container Bc17w1UserPw from image mcr.microsoft.com/dynamicsnav:10.0.19042.630-generic-dev
b445d032a3b1d07a9798341c16da029c6d578eb0a874545bbb88e7f6fd6fc4c0
Waiting for container Bc17w1UserPw to be ready
Using artifactUrl https://bcartifacts.azureedge.net/onprem/17.2.19367.19735/w1
Using installer from C:\Run\150-new
Installing Business Central
Installing from artifacts
Starting Local SQL Server
Starting Internet Information Server
Copying Service Tier Files
Copying PowerShell Scripts
Copying dependencies
Copying ReportBuilder
Importing PowerShell Modules
Determining Database Collation from c:\dl\onprem\17.2.19367.19735\w1\database\Demo Database NAV (17-0).bak
Restoring CRONUS Demo Database
Setting CompatibilityLevel for CRONUS on localhost\SQLEXPRESS
Modifying Business Central Service Tier Config File for Docker
Creating Business Central Service Tier
Installing SIP crypto provider: 'C:\Windows\System32\NavSip.dll'
Copying Web Client Files
Copying Client Files
Copying ModernDev Files
Copying additional files
Copying ConfigurationPackages
Copying Test Assemblies
Copying Applications
Starting Business Central Service Tier
Importing license file
Stopping Business Central Service Tier
Installation took 80 seconds
Installation complete
Initializing...
Setting host.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting gateway.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting kubernetes.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting host.containerhelper.internal to <IP_ADDRESS> in container hosts file
Starting Container
Hostname is Bc17w1UserPw
PublicDnsName is Bc17w1UserPw
WARNING: DNS resolution not working from within the container.
Using NavUserPassword Authentication
Creating Self Signed Certificate
Self Signed Certificate Thumbprint C449BF730622FDB1D2774E927B3C7B3CD1C791BD
Modifying Service Tier Config File with Instance Specific Settings
Starting Service Tier
Registering event sources
Creating DotNetCore Web Server Instance
Using license file 'c:\run\my\license.flf'
Import License
Creating http download site
Setting SA Password and enabling SA
Creating Lucas as SQL User and add to sysadmin
Creating SUPER user
Container IP Address: <IP_ADDRESS>
Container Hostname  : Bc17w1UserPw
Container Dns Name  : Bc17w1UserPw
Web Client          : http://Bc17w1UserPw/BC/
Dev. Server         : http://Bc17w1UserPw
Dev. ServerInstance : BC
Setting Bc17w1UserPw to <IP_ADDRESS> in host hosts file

Files:
http://Bc17w1UserPw:8080/ALLanguage.vsix

Container Total Physical Memory is 31.9Gb
Container Free Physical Memory is 15.7Gb

Initialization took 131 seconds
Ready for connections!
Reading CustomSettings.config from Bc17w1UserPw
Creating Desktop Shortcuts for Bc17w1UserPw
Copy from container Bc17w1UserPw (C:\Applications\TestFramework\TestLibraries\Any\Microsoft_Any.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1
UserPw\_Microsoft_Any.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Any.app
Synchronizing Any on tenant default
Installing Any on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\TestFramework\TestLibraries\Assert\Microsoft_Library Assert.app) to C:\ProgramData\BcContainerHelper\Ext
ensions\Bc17w1UserPw\_Microsoft_Library Assert.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Library Assert.app
Synchronizing Library Assert on tenant default
Installing Library Assert on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\TestFramework\TestLibraries\Variable Storage\Microsoft_Library Variable Storage.app) to C:\ProgramData\B
cContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Library Variable Storage.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Library Variable Storage.app
Synchronizing Library Variable Storage on tenant default
Installing Library Variable Storage on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\TestFramework\TestRunner\Microsoft_Test Runner.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w
1UserPw\_Microsoft_Test Runner.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Test Runner.app
Synchronizing Test Runner on tenant default
Installing Test Runner on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\system application\test\Microsoft_System Application Test Library.app) to C:\ProgramData\BcContainerHelp
er\Extensions\Bc17w1UserPw\_Microsoft_System Application Test Library.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_System Application Test Library.app
Synchronizing System Application Test Library on tenant default
Installing System Application Test Library on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-TestLibraries.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1Use
rPw\_Microsoft_Tests-TestLibraries.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-TestLibraries.app
Synchronizing Tests-TestLibraries on tenant default
Installing Tests-TestLibraries on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Bank.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micr
osoft_Tests-Bank.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Bank.app
Synchronizing Tests-Bank on tenant default
Installing Tests-Bank on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Cash Flow.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\
_Microsoft_Tests-Cash Flow.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Cash Flow.app
Synchronizing Tests-Cash Flow on tenant default
Installing Tests-Cash Flow on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Cost Accounting.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1U
serPw\_Microsoft_Tests-Cost Accounting.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Cost Accounting.app
Synchronizing Tests-Cost Accounting on tenant default
Installing Tests-Cost Accounting on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-CRM integration.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1U
serPw\_Microsoft_Tests-CRM integration.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-CRM integration.app
Synchronizing Tests-CRM integration on tenant default
Installing Tests-CRM integration on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Data Exchange.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1Use
rPw\_Microsoft_Tests-Data Exchange.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Data Exchange.app
Synchronizing Tests-Data Exchange on tenant default
Installing Tests-Data Exchange on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Dimension.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\
_Microsoft_Tests-Dimension.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Dimension.app
Synchronizing Tests-Dimension on tenant default
Installing Tests-Dimension on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-ERM.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micro
soft_Tests-ERM.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-ERM.app
Synchronizing Tests-ERM on tenant default
Installing Tests-ERM on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Fixed Asset.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserP
w\_Microsoft_Tests-Fixed Asset.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Fixed Asset.app
Synchronizing Tests-Fixed Asset on tenant default
Installing Tests-Fixed Asset on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-General Journal.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1U
serPw\_Microsoft_Tests-General Journal.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-General Journal.app
Synchronizing Tests-General Journal on tenant default
Installing Tests-General Journal on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Graph.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Mic
rosoft_Tests-Graph.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Graph.app
Synchronizing Tests-Graph on tenant default
Installing Tests-Graph on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Integration.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserP
w\_Microsoft_Tests-Integration.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Integration.app
Synchronizing Tests-Integration on tenant default
Installing Tests-Integration on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Invoicing.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\
_Microsoft_Tests-Invoicing.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Invoicing.app
Synchronizing Tests-Invoicing on tenant default
Installing Tests-Invoicing on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Job.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micro
soft_Tests-Job.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Job.app
Synchronizing Tests-Job on tenant default
Installing Tests-Job on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Local.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Mic
rosoft_Tests-Local.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Local.app
Synchronizing Tests-Local on tenant default
Installing Tests-Local on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Misc.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micr
osoft_Tests-Misc.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Misc.app
Synchronizing Tests-Misc on tenant default
Installing Tests-Misc on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Monitor Sensitive Fields.app) to C:\ProgramData\BcContainerHelper\Extension
s\Bc17w1UserPw\_Microsoft_Tests-Monitor Sensitive Fields.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Monitor Sensitive Fields.app
Synchronizing Tests-Monitor Sensitive Fields on tenant default
Installing Tests-Monitor Sensitive Fields on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Permissions.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserP
w\_Microsoft_Tests-Permissions.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Permissions.app
Synchronizing Tests-Permissions on tenant default
Installing Tests-Permissions on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Physical Inventory.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17
w1UserPw\_Microsoft_Tests-Physical Inventory.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Physical Inventory.app
Synchronizing Tests-Physical Inventory on tenant default
Installing Tests-Physical Inventory on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Prepayment.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw
\_Microsoft_Tests-Prepayment.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Prepayment.app
Synchronizing Tests-Prepayment on tenant default
Installing Tests-Prepayment on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Rapid Start.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserP
w\_Microsoft_Tests-Rapid Start.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Rapid Start.app
Synchronizing Tests-Rapid Start on tenant default
Installing Tests-Rapid Start on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Report.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Mi
crosoft_Tests-Report.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Report.app
Synchronizing Tests-Report on tenant default
Installing Tests-Report on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Resource.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_
Microsoft_Tests-Resource.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Resource.app
Synchronizing Tests-Resource on tenant default
Installing Tests-Resource on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Reverse.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_M
icrosoft_Tests-Reverse.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Reverse.app
Synchronizing Tests-Reverse on tenant default
Installing Tests-Reverse on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-SCM.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micro
soft_Tests-SCM.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-SCM.app
Synchronizing Tests-SCM on tenant default
Installing Tests-SCM on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-SMB.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micro
soft_Tests-SMB.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-SMB.app
Synchronizing Tests-SMB on tenant default
Installing Tests-SMB on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-SMTP.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micr
osoft_Tests-SMTP.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-SMTP.app
Synchronizing Tests-SMTP on tenant default
Installing Tests-SMTP on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Upgrade.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_M
icrosoft_Tests-Upgrade.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Upgrade.app
Synchronizing Tests-Upgrade on tenant default
Installing Tests-Upgrade on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-User.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micr
osoft_Tests-User.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-User.app
Synchronizing Tests-User on tenant default
Installing Tests-User on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-VAT.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Micro
soft_Tests-VAT.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-VAT.app
Synchronizing Tests-VAT on tenant default
Installing Tests-VAT on tenant default
App successfully published
Copy from container Bc17w1UserPw (C:\Applications\BaseApp\Test\Microsoft_Tests-Workflow.app) to C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_
Microsoft_Tests-Workflow.app
Publishing C:\ProgramData\BcContainerHelper\Extensions\Bc17w1UserPw\_Microsoft_Tests-Workflow.app
Synchronizing Tests-Workflow on tenant default
Installing Tests-Workflow on tenant default
App successfully published
TestToolkit successfully imported
Container Bc17w1UserPw successfully created

Use:
Get-BcContainerEventLog -containerName Bc17w1UserPw to retrieve a snapshot of the event log from the container
Get-BcContainerDebugInfo -containerName Bc17w1UserPw to get debug information about the container
Enter-BcContainer -containerName Bc17w1UserPw to open a PowerShell prompt inside the container
Remove-BcContainer -containerName Bc17w1UserPw to remove the container again
docker logs Bc17w1UserPw to retrieve information about URL's again

My HelperFunctions.ps1
HelperFunctions.zip

My bad
That piece of code inside the container is only used when building images or running containers without bccontainerhelper.
The same function exists in C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper<version>\HelperFunctions.ps1
Search for tests-singleserver and remove the ones you don't want to exclude - and try again.

My bad
That piece of code inside the container is only used when building images or running containers without bccontainerhelper.
The same function exists in C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper<version>\HelperFunctions.ps1
Search for tests-singleserver and remove the ones you don't want to exclude - and try again.

OK, did abandon the -myScript option and updated function GetTestToolkitApps in file C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\ [version] \HelperFunctions.ps1
Before
if (!$includeTestLibrariesOnly) {
    # Add Tests
    $apps += @(get-childitem -Path "C:\Applications\*.*" -recurse -filter "Microsoft_Tests-*.app") | Where-Object { $_ -notlike "*\Microsoft_Tests-TestLibraries.app" -and $_ -notlike "*\Microsoft_Tests-Marketing.app" -and $_ -notlike "*\Microsoft_Tests-SINGLESERVER.app" }
 }

After
if (!$includeTestLibrariesOnly) {
    # Add Tests
    $apps += @(get-childitem -Path "C:\Applications\*.*" -recurse -filter "Microsoft_Tests-*.app") | Where-Object { $_ -notlike "*\Microsoft_Tests-TestLibraries.app"  }
 }

Ran my script (see above) again, but no difference.
I even added this line to GetTestToolkitApps to see if it was called:
Write-Host -ForegroundColor Yellow "GetTestToolkitApps"
Did not show, unfortunately.

OK, did abandon the -myScript option and updated function GetTestToolkitApps in file C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\ [version] \HelperFunctions.ps1
Before
if (!$includeTestLibrariesOnly) {
    # Add Tests
    $apps += @(get-childitem -Path "C:\Applications\*.*" -recurse -filter "Microsoft_Tests-*.app") | Where-Object { $_ -notlike "*\Microsoft_Tests-TestLibraries.app" -and $_ -notlike "*\Microsoft_Tests-Marketing.app" -and $_ -notlike "*\Microsoft_Tests-SINGLESERVER.app" }
 }

After
if (!$includeTestLibrariesOnly) {
    # Add Tests
    $apps += @(get-childitem -Path "C:\Applications\*.*" -recurse -filter "Microsoft_Tests-*.app") | Where-Object { $_ -notlike "*\Microsoft_Tests-TestLibraries.app"  }
 }

Ran my script (see above) again, but no difference.
I even added this line to GetTestToolkitApps to see if it was called:
Write-Host -ForegroundColor Yellow "GetTestToolkitApps"
Did not show, unfortunately.

Did you restart PowerShell?

Did you restart PowerShell?

Nope. Doing right now.

Nope. Doing right now.

Yessss

So it does allow them to be deployed. Not technical issue. Now the question is whether I can run them. Will test that right now.

Yessss

So it does allow them to be deployed. Not technical issue. Now the question is whether I can run them. Will test that right now.

Tests-SINGLESERVER tests run without technical issues (625 successes - 103 failures)

Tests-SINGLESERVER tests run without technical issues (625 successes - 103 failures)

Conclusion
-myScripts seems to work, but when used to replace the HelperFunctions.ps1 is operates only on this HelperFunctions.ps1 and not on HelperFunctions.ps1.

Conclusion
-myScripts seems to work, but when used to replace the HelperFunctions.ps1 is operates only on this HelperFunctions.ps1 and not on HelperFunctions.ps1.


Acroform ComboBox, ChoiceBox, CheckBox values are not printed

When printing generated PDFs the selected "ComboBox options" are not getting displayed.
(Already visible in print preview)
Same applies to CheckBoxes where CheckBoxes are always looking like unchecked when printing.
The issue is also reproducible with this reference pdf.
/tests/acroform/reference/combobox.pdf
To ensure that this is not a local (ie. PDF viewer) issue i have manually created a PDF form using LibreOffice writer. These PDF forms can be printed without issues.

Can you provide the PDF you generated with libreOffice?

ComboBox-libreoffice.pdf
This is a sample PDF created with LibreOffice.

The file is compressed. Can you provide a a non-compressed PDF?

I see no option to enable/disable PDF compression in LibreOffice

Maybe letting it processed by pdfSam it will remove the compression?

Hi, @arasabbasi .
A checkbox isn't printing even on the demo page. You can reproduce it by printing pdf from https://rawgit.com/MrRio/jsPDF/master/# , (Select AcroForms).
Looks like something went wrong with sybmol in createMK() .   Can we use own symbol for CheckBox? Something like Cross (x), for instance.
Thanks.

Hello,
i need some working example of a pdf which is not encrypted to know how I can solve it.
Refering to something what doesnt work, doesnt help.

Looks like something went wrong with sybmol in createMK() . Can we use own symbol for CheckBox? Something like Cross (x), for instance.

Should be possible.

Did you print pdf from https://rawgit.com/MrRio/jsPDF/master/# , (Select AcroForms). ? Just print that pdf and you will see. CheckBox isn't displayed on the print

I need a working example, not a not-working example.

I got it. Will try to find working solution

Hi, @arasabbasi . Just created working pdf. Should it help? https://github.com/OleksiiZubko/acroFormsPdf/blob/master/formWithCheckbox-uncompressed.pdf

Thank you. Did a quick hack into #1825
Probably have to refresh the tests for the unit tests.

Super, Thank you!

Works for me too, thanks!

Will be part of 1.4.2

Hi , I am using Angular4 and jsPDF i am able to use jsPDF for normal text colors etc. But i am not able to use acroform checkboxes. I searched all over the web but there is no example for what should i import.

I just want to show checbox , radio button etc..


OoObjectObserver callbacks null

it's difficult to reproduce but i'm getting an error at:
OoObjectObserver.prototype.unsubscribe = function unsubscribe(propertyName, callback) {
      var callbacks = this.callbacks[propertyName],

where this.callbacks is null.
stacktrace:
unsubscribe (aurelia-binding.js:3403)
updateRight (aurelia-binding.js:822)
(anonymous function) (aurelia-binding.js:809)
notify (aurelia-binding.js:847)
(anonymous function) (aurelia-binding.js:830)
call (aurelia-binding.js:3220)
check (aurelia-binding.js:3176)
(anonymous function) (aurelia-binding.js:3164)
this happens after an input value which is binded to a vm value which became null (through breeze revert())

this is fixed in the upcoming release.  There's a workaround here:
https://github.com/aurelia/binding/issues/150

@jdanyow hi, i did copy your workaround from that issue correctly but still getting the same error:
Uncaught TypeError: Cannot read property 'indexOf' of null at unsubscribe

ok- apologies- it will be fixed in the upcoming release.
Go ahead and add a if (callbacks === null) return; as a temporary work-around.

@jdanyow, same issue here.  After removing the original workaround, then adding null check per your recommendation ( snippet below ), the issue is resolved on my end. Thanks!
OoObjectObserver.prototype.unsubscribe = function unsubscribe(propertyName, callback) {
      var callbacks = this.callbacks[propertyName],
          index = callbacks ? callbacks.indexOf(callback) : -1;
      if (index === -1) {
        return;
      }

yes that fixed it:
i puted it like this
 OoObjectObserver.prototype.unsubscribe = function unsubscribe(propertyName, callback) {
         if (this.callbacks === null) return;

      var callbacks = this.callbacks[propertyName],
          index = callbacks.indexOf(callback);


Change bitfields from enum to uint64

Implements spec change https://github.com/open-telemetry/opamp-spec/pull/125
In some languages enum fields are strongly typed and it is impossible to assigned OR-ed values to the enum field. This makes impossible to compose the bit fields properly.
This changes all bit field declarations from enum to uint64. The enum declarations stay, so that bit definitions are clear.

@andykellr can you please review so that we can merge this?
We want to move the protos and I want to make sure we don't have outstanding proto changes in this repo.


Everest: duplicated txs

Ortelius returns duplicated txs on asset detail:

https://explorerapi.avax.network/x/transactions?assetID=nznftJBicce1PfWQeNEVBmDyweZZ6zcM3p78z9Hy9Hhdhfaxm
https://explorer.avax.network/asset/nznftJBicce1PfWQeNEVBmDyweZZ6zcM3p78z9Hy9Hhdhfaxm

The cause of this issue is a faulty JOIN when filtering transactions by asset and/or address.
Relevant schema:
Transactions has many Outputs
Outputs has many OutputAddresses.

Outputs has asset_id property
OutputAddresses has address property

Bug analysis:
We JOIN Outputs and OutputAddresses to Transactions to enable a WHERE clause restricting asset_id and/or address, so transactions with multiple outputs or multiple addresses on an output  become duplicated.
Code: https://github.com/ava-labs/ortelius/blob/40ca1f3237a5914f1417c0bf8a342aab66e77113/services/indexes/avm/params.go#L202-L214


refactor(EVBackendConnection): access url property properly

This pull request adds getter methods for the connection property in the EVBackendClient class and the url property in the EVBackendConnection class. It also updates the MainPanel.vue file to use the new getter method for accessing the connection URL.
It is necessary for strict typesafety

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#198  👈
#177
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @lukas-mertens and the rest of your teammates on  Graphite

Merge activity

Oct 15, 4:25 AM EDT: A user merged this pull request with Graphite.


Version 3.4.3

Hmm, that's odd. Looks like it's failing due to a change in the order of returned rows from a SQL statement.
I guess perhaps the test should be changed to give a deterministic result, as a) my understanding is that order is not guaranteed from a simple select statement, and b) the order isn't really relevant for anything here (in fact the failing assert isn't really teting splink directly, but more just an additional sense-check on the test logic).

☝ suggested fix, but feel free to revert if any disagreement


Support for overriding servers feature

Description
OpenAPI 3 comes with overriding servers feature:

The global servers array can be overridden on the path level or operation level. This is handy if some endpoints use a different server or base path than the rest of the API. Common examples are:

Different base URL for file upload and download operations,
Deprecated but still functional endpoints.

OAS3 usage example:
servers:
  - url: https://api.example.com/v1

paths:
  /files:
    description: File upload and download operations
    servers:
      - url: https://files.example.com
        description: Override base path for all operations with the /files path
    ...
  /ping:
    get:
      servers:
        - url: https://echo.example.com
          description: Override base path for the GET /ping operation
      ...

Connexion does not seem to support this feature as of right now. I tried both the path level and operation level servers configuration with no success. The configuration seems to be ignored.
Expected behaviour
Setting servers under a path or an operation overrides the top-level servers configuration for that specific path or operation.
Actual behaviour
servers property configured under a path or an operation is ignored and the top-level config of servers is used instead.
Steps to reproduce
test_api.py:
import connexion
import pytest

app = connexion.App(__name__, specification_dir='./')
app.add_api('swagger.yml')

@pytest.fixture
def client():
    return app.app.test_client()

def test_list_pets(client):
    response = client.get("/example/pets")
    assert response.status_code == 200

def test_healthcheck(client):
    response = client.get("/other/healthcheck")
    assert response.status_code == 200  # this fails due to 404 being returned

api.py:
def list_pets():
    return [], 200

def healthcheck():
    return {'success': True}, 200

swagger.yml:
openapi: 3.0.0
info:
  version: 1.0.0
  title: Override servers example
servers:
  - url: /example
paths:
  /pets:
    get:
      summary: List all pets
      operationId: api.list_pets
      tags:
        - pets
      responses:
        200:
          description: A paged array of pets
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Pets'
        default:
          description: unexpected error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Error'
  /healthcheck:
    servers:
      - url: /other
        description: Override base path
    get:
      summary: Perform a health check
      operationId: api.healthcheck
      tags:
        - health
      responses:
        200:
          description: Expected response to a valid request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Healthcheck'
        default:
          description: unexpected error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Error'
components:
  schemas:
    Pet:
      type: object
      properties:
        id:
          type: integer
          format: int64
        name:
          type: string
    Pets:
      type: array
      items:
        $ref: '#/components/schemas/Pet'
    Error:
      type: object
      required:
        - detail
        - status
        - title
      properties:
        detail:
          type: string
        status:
          type: string
        title:
          type: string
        type:
          type: string
    Healthcheck:
      type: object
      required:
        - success
      properties:
        success:
          type: boolean

Additional info:
Output of the commands:

python --version
Python 3.7.3
pip show connexion | grep "^Version\:"
Version: 2.3.0

One thing that is tricky about the servers block is that it makes a lot of sense for clients (here are all the servers you can go to, all of the info is in one spec), but for the server it's unclear what to do.
If a spec has multiple server endpoints, which one is the current connexion app suppose to provide?
Sometimes the servers list is just different urls where the same functionality can be reached, but if we provide multiple non-overlapping functionality in the same file, it's not clear which endpoints connexion should be providing.
In your example, it looks like you would expect the single connexion app back all of the endpoints. This is not intuitive to me (it seems reasonable to expect that different servers would be different apps).
Let me know what you think.

openapi: 3.0.0
info:
  title: app demo
  description: |
    app demo
  version: 0.2.1
servers:
  - url: https://myURL.org/v1

paths:
  /login:
    get:
      summary: Establish the users identity using the OIDC provider
      description: Send the user agent to an identity provider selector and
        generate a user account to establish the user's identity. This is a
        redirect endpoint.
      operationId: api.oauth.login
      tags:
        - oauth
      parameters:
        - name: redirect_uri
          description: Where to redirect to once login is complete.
          in: query
          required: true
          schema:
            type: string
        - name: state
          description: An opaque parameter that is returned back to the `redirect_uri`.
          in: query
          schema:
            type: string
      responses:
        301:
          description: OK.
        default:
          description: Unexpected error.
      servers:
        - url: https://myURL.org
          description: Override base path for /login operations

What about the in the case where i want to use an override to remove the  basepath from the URL, is there a better way to perform something like this?

I ran into this issue today and feel it would be useful to reduce duplication and error.
Without the override feature implemented you need to explicitly update all path definitions to include the base path.

Do we have any progress regarding this feature?


RFC: Support char::encode_utf8 in const scenarios.

The encode_utf8 method in char should be marked const to support compile-time conversions.
Rendered

Changes this small don't require an RFC.

Oh, alright then. I'll just submit the implementation directly.
Should I just close this PR now?

libs-api needs to discuss all library-related API changes. A PR to rust-lang/rust with a libs-api reviewer is fine for anything relatively trivial (like this, adding const is pretty easy), an ACP is good for anything that requires a design or more thought (an ACP is just an issue template at rust-lang/libs-team), and RFCs are really only needed if it is a more fundamental change.
It looks like you already put a PR up at https://github.com/rust-lang/rust/pull/130511, so this can be closed. Thanks for putting in the effort!


Paranthesis Matching In C (application of stack)

💥 Proposal
I would like to add parenthesis matching as it is an application of stack in C and its not there in the folder of stack in directory of C. Kindly let me work on this.
Have you read the Contributing Guidelines on Pull Requests?
YES

/assign


esp32 - Spi Drivers freeze app and triggers TG1WDT_SYS_RESET

By esp32 -> classical esp32
Key observation is that it does work with gpio 15-18 for sclk,mosi,miso,cs and some minimal random other pin combinations, changing  one or two of them, but most combinations of pinnumbers will freeze the esp and trigger a reset after varying seconds.
Use default cargo generate template.
Minimal repo:
use esp_idf_svc::hal::peripherals::Peripherals;
use esp_idf_svc::hal::spi::{SpiDeviceDriver, SpiDriverConfig, SPI2};

fn main() {
    esp_idf_svc::sys::link_patches();
    esp_idf_svc::log::EspLogger::initialize_default();

    // Bind the log crate to the ESP Logging facilities
    let peripherals = Peripherals::take().unwrap();

    let sclk = peripherals.pins.gpio15;
    let miso = peripherals.pins.gpio12;
    let mosi = peripherals.pins.gpio11;
    let cs = peripherals.pins.gpio13;

    let driver_conf = SpiDriverConfig::new();
    let driver = SpiDeviceDriver::new_single::<SPI2>(
        peripherals.spi2,
        sclk,
        miso,
        Some(mosi),
        Some(cs),
        &driver_conf,
        &Default::default(),
    )
    .unwrap();

    loop {
        log::info!("Hello, world!");
        std::thread::sleep(std::time::Duration::from_secs(1));
    }
}

``

Does this mean that SPI will not work at all when assigned to different pins?
What pins actually can be used?
Those given in the esp-idf-hal/examples/loopback?

CLK on GPIO15
MISO on GPIO17
MOSI on GPIO16
CS1 on GPIO18

(PS, the example file comments are lying).
rust-esp32-demo uses these pins:

CLK GPIO13
MISO on GPIO12
MOSI on GPIO26
CS on GPIO14

The ESP-IDF docs suggests the use of these pins for SPI2

CLK on GPIO14
MISO on GPIO12
MOSI on GPIO13
CS1 on GPIO15

And finally, esp-idf C examples suggest these pins:

CLK on GPIO14
MISO on GPIO12
MOSI on GPIO13
CS on GPIO15

I had intended to connect to a KSZ8851SNL and an SD Card via SPI, and I don't want to get my pin assignments wrong when I submit to the PCB manufacturer

The recommendation is to use this special gpio's because of potential minimal latency gains, since this gpio's dont need to go through the gpio matrix. Though they claim that any gpio can be used for the SPI2 device. quote: "However, the signals can also be routed to any other available pins using the less direct GPIO matrix." And that should be certainly true. I tried to debug it a bit but for some unknown reason my esp hard crashes and it's hard to debug the issue currently. I only currently now that it happens somewhere in the initiation phase inside the gpio matrix code path.

I guess my question is, which special GPIOs actually do work? And which devices are affected?


Fix unicode issues in Nearly transformation

There is still a caveat: you can't use a unicode Nearley grammar transformed with python3 from python2. If you use python2 to do the transformation then the resulting grammar should be usable from both. The main issue is python3 repr won't put a u infront of unicode strings. A hacky solution would definitely be possible but I am not sure it's worth it.

Looks good, thanks!


Load Tests for the Instana nodeJS sensor

Adding a server taking load from jMeter
Instana nodeJS sensor can be enabled to track the additional load (if any)

Merged manually via da15c0ac2531212274586263416e0322cb9c2a04.
Thank you!


Fixed #22673 -- Added support for PostgreSQL schemas.

Add a feature for schemas, and an sql operation for schema SQL.
Modify base code to split table names that contain a '.' into schema.table.
For every table created, create the schema if it hasn't already been created.
Enable feature for postgres, fix quoting ("schema"."table"), and fix work-around for #7783.
Added simple test for creating and quering a table in a non-standard schema.
Added corresponding documentation.

Ok.  I give up.  I don't know what the tests are looking for.  Let me know what needs to be changed, if anything.  Thanks.

@jaapvermeulen I think you have referenced wrong PR?
2nd, don't give up. ask in the IRC for help/guidelines

Did you look at the approach in https://github.com/django/django/pull/6162?

I looked at #6162, but it approaches it in a different (and more complex) way.  This patch assumes a slightly more friendly approach where table names that include a period are assumed to be qualified.  The full qualification is 'db.schema.table'.  The reason the tests fail is that one of the tests uses a table with a period in it.  I think that should still be OK, but in that case the table name must be quoted to avoid interpreting it as a qualified 'schema.table' name.  Still working on that part; hopefully Monday I'll have some time to finish it.

IMHO rather then complicating things we should focus on db specific approach as every backend follows different definition of schema.

Is it even reasonable to have a table name with a period in it?  It's the inspectdb SpecialName Model that uses a table name with a period in it.  Other name spaces, like file system, don't allow the hierarchy separator in a name.

It's possible to have a period in table name, at least on PostgreSQL. The syntax is this:
create table "a.table"(id integer);
select * from "a.table";

Ok, I think I'm convinced that quoting is a lost cause.

I've thought this a bit, and to me it seems it would be best to move forward as a "stealth feature". That is, we add support for database schemas on PostgreSQL incrementally. The feature would be documented only when it's feature complete. The reason for this approach is that with volunteer effort doing the complete feature in one go has a big risk of failure.
I've not discussed this approach with other core developers, and I'm not sure it will receive all positive reactions, so better to bring this idea up on django-developers mailing list.
For the feature itself - I don't think it is a good idea to use "schema.table" in db_table for this, instead there should be a dedicated property db_schema in model's meta. For me the only strong reason supporting dotted notation is that it's easier to implement. But, doing so will break the existing hack for schema qualified tables, and internally it would be really nice if you had three different things in model's meta, that if db_table, db_schema and the qualified_name property. The ORM would mostly use the last one, while inspectb/migrations might need the first two.
The stealth feature plan could be something like:

Add db_schema to model.Meta, check that it works in ORM queries. Only usable for managed=False tables, that is Django doesn't yet have any support for creating schema qualified tables.
Incrementally add support for migrations and creating tables for tests
Add support for inspectdb
Make the feature fully public
Work on other database backends (can of course be done while in stealth mode, too)

The first item on the list shouldn't be impossible to achieve. If wanted, we could even publish the usage of db_schema for unmanaged tables. It's not unreasonable to think that users who want to use db schemas either want to create tables by hand crafted SQL, or are using an existing database.

No problem.


Update Google Analytics to track events on Disease and Target Association pages

Currently, we only track events related to the facets on the Associations pages. To get a better sense of the user journey, I'd like to understand which view(s) users select on the page and how they interact with the content (e.g. on-hover and on-click events).
Can we please update the Associations and Prioritisation Views to track the events listed in this spreadsheet?

Added tracking as per spreadsheet.
Missing specific bubble and tree view tracking: this is non essential and would require changes to external npm modules.
Some (non essential) tracking might be fired inconsistently due to DataTables handling of certain events and we'll monitor this.

Perfect - thanks @LucaFumis


Remove cabal revision non-determinism

Currently if someone mutates the Hackage cabal in-place, generated Nix expressions will have a different output for the same previous inputs.
We could prevent that by specifying all-cabal-hashes (index of cabal files) and bump them in controllable fashion.
Possible implementation
Using flag --cabal-hashes specify what version of hackage to use to deterministically.

Expose stack2nix --hackage-db PATH via cabal2nix .. --hackage-db PATH.
For more context see https://github.com/haskell/cabal/issues/2707
That alone won't be enough, we also need to provide a way to pinpoint what revisions to use since the tarball is append-only (ever changing).

Upstream issue: https://github.com/NixOS/cabal2nix/issues/297

cabal2nix support was added in https://github.com/NixOS/cabal2nix/pull/312


cda downloading not working

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.05.29
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'https://www.cda.pl/video/1506887ce/vfilm']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.05.29
[debug] Python version 2.7.17 (CPython) - Linux-4.15.0-101-generic-x86_64-with-LinuxMint-19.3-tricia
[debug] exe versions: avconv 3.4.6, avprobe 3.4.6, ffmpeg 3.4.6, ffprobe 3.4.6
[debug] Proxy map: {}
[CDA] 1506887ce: Downloading webpage
WARNING: unable to extract rating; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[CDA] 1506887ce: Downloading 360p version information
WARNING: Unable to download webpage: HTTP Error 404:
WARNING: [CDA] Unable to download 360p version information
[CDA] 1506887ce: Downloading 720p version information
WARNING: Unable to download webpage: HTTP Error 404:
WARNING: [CDA] Unable to download 720p version information
WARNING: "url" field is missing or empty - skipping format, there is an error in extractor
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/bin/youtube-dl/__main__.py", line 19, in <module>
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 474, in main
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 464, in _real_main
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2019, in download
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 808, in extract_info
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 863, in process_ie_result
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1589, in process_video_result
IndexError: list index out of range

Description

cda downloading not working

i have 2<IP_ADDRESS> version and i confirm:
ytdl --verbose https://www.cda.pl/video/4267274ad
[debug] System config: ['--prefer-free-formats']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.cda.pl/video/4267274ad']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2<IP_ADDRESS>
[debug] Python version 3.7.7 (CPython) - Linux-5.6.16-200.fc31.x86_64-x86_64-with-fedora-31-Thirty_One
[debug] exe versions: ffmpeg 4.2.3, ffprobe 4.2.3
[debug] Proxy map: {}
[CDA] 4267274ad: Downloading webpage
WARNING: unable to extract rating; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[CDA] 4267274ad: Downloading 360p version information
[CDA] 4267274ad: Downloading 720p version information
[CDA] 4267274ad: Downloading 1080p version information
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl", line 10, in <module>
    sys.exit(main())
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/__init__.py", line 474, in main
    _real_main(argv)
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/__init__.py", line 464, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 2019, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 808, in extract_info
    return self.process_ie_result(ie_result, download, extra_info)
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 863, in process_ie_result
    return self.process_video_result(ie_result, download=download)
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 1582, in process_video_result
    format['http_headers'] = self._calc_headers(full_format_info)
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 1396, in _calc_headers
    cookies = self._calc_cookies(info_dict)
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 1408, in _calc_cookies
    pr = sanitized_Request(info_dict['url'])
  File "/home/kompowiec2/.local/lib/python3.7/site-packages/youtube_dl/utils.py", line 2157, in sanitized_Request
    return compat_urllib_request.Request(sanitize_url(url), *args, **kwargs)
  File "/usr/lib64/python3.7/urllib/request.py", line 328, in __init__
    self.full_url = url
  File "/usr/lib64/python3.7/urllib/request.py", line 354, in full_url
    self._parse()
  File "/usr/lib64/python3.7/urllib/request.py", line 383, in _parse
    raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'G86C_ce%5Db452%5DA%3D%5E2FK%3A65%21%7BHh%3B2%60%24d%7Er%26b3rH%5E%60dhace%60ebc%5EG%3D443b76fhea%60hac4526c%60aac6_25_6hhgac35%60_6_ebhdc7a74b2%60b_5h542ad55%60_Q5'

Duplicate of #25477

Fixed in haruhi-dl, a libre fork of youtube-dl.


Closes: #1

Updated validations.py python script.
Fixed the behavior of validate_user function in validations.py.
Fixes #<issue_number_goes_here>

It's a good idea to open an issue first for discussion.

[x] Tests pass
[x] Appropriate changes to README are included in PR

Part of Google automation course.


Add Contributing.md and update gen-docs task

Description of change
A brief description of the change, what it is and why it was made.
Fixes https://meroxa.atlassian.net/browse/PLATFORM-232
You can check it out from our updated README.
Type of change

[ ]  New feature
[ ]  Bug fix
[ ]  Refactor
[x]  Documentation

@anaptfox shipped this one, but feel free to make any changes to anything you feel it should be changed.


145: Adding searchTerms and lastModifiedBy to model - updated stream.

The corresponding ticket appears to be done/closed. I do see above that the 'branch had an error being deployed' - is that something we should be aware of? Is that why this PR still looks to be open? @marklise advice?
cc: @Dianadec


adias/fix tag filtering

Fix nil pointers when trying to access resources that may not be present due to filtering

I noticed a different bug,
this is checked after it is actually checked:

if !cfg.IsVcenterAPIType && cfg.Args.EnableVsphereEvents {
cfg.IsVcenterAPIType = cfg.VMWareClient.ServiceContent.About.ApiType == "VirtualCenter"

@paologallinaharbur ah yes i see the issue.


fix(mis-server, mis-web): 补充处理认证系统创建用户报非409错误遗漏回滚数据库， 修改创建已存在于认证系统用户时的提示信息

之前关于插入公钥失败错误处理，是直接catch掉的不上报，此时添加一个已经存在于认证系统的用户，如果密码输错，此时输入的密码就会变得无意义。这个pr主要修改提示，另外发现之前认证系统创建用户报非409错误时，回滚数据库操作没了，这里修改。
查询到要添加的用户已存在于认证系统时：

认证系统不支持查询，但支持创建时：

认证系统不支持查询，不支持创建时：

Codecov Report
Base: 64.54% // Head: 64.49% // Decreases project coverage by -0.04% :warning:

Coverage data is based on head (b9bc163) compared to base (f3be5f8).
Patch coverage: 0.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #376      +/-   ##
==========================================
- Coverage   64.54%   64.49%   -0.05%
==========================================
  Files         103      103
  Lines        2905     2907       +2
  Branches      363      364       +1
==========================================
  Hits         1875     1875
- Misses        986      988       +2
  Partials       44       44

Impacted Files
Coverage Δ

apps/mis-server/src/services/init.ts
75.00% <0.00%> (ø)

apps/portal-server/src/clusterops/slurm/app.ts
16.17% <0.00%> (-0.25%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


implement more drop stuff

I haven't touched TyClosure and TyAnon, not even sure where to start for those...
TyAnon could probably be solved by a MirPass that replaces all of them with the actual type

You can't see TyAnon in a monomorphized type.

I think a TyClosure just drops its fields like any tuple, array, or univariant.