Initialization of container xxx failed--ReportBuilder Error

PLEASE DO NOT INCLUDE ANY PASSWORDS OR TOKENS IN YOUR ISSUE!!!
Describe the issue
Have been creating containers with BcContainerHelper and following along with the recent fixes for BC 19. Webroot antivirus and Windows Defender scan are both OFF.  For a day or two they seemed to work. Now container initialization consistently fails at the same point. Have tried with isolation 'process' and isolation 'hyperv'
Scripts used to create container and cause the issue
$artifactUrl = Get-BcArtifactUrl -type 'OnPrem' -country 'us' -version '19.0.29894.30693';
$Credential = [PSCredential]::new('$(user_name)',(ConvertTo-SecureString '$(password)' -AsPlainText -Force));
New-BcContainer -accept_eula `
  -accept_outdated `
  -containerName '$(container_name)'
  -auth UserPassword `
  -credential $Credential `
   -useGenericImage "$(Get-BestGenericImageName)-dev" `
  -process isolation `
  -artifacturl $artifactUrl `
  -licenseFile $(license_file) `
  -doNotExportObjectsToText  `
  -restart no `
  -shortcuts None `
  -useBestContainerOS   `
  -updateHosts `
   -additionalParameters @("--volume ""C:\agent\appfiles\:C:\shareddata""")

[section]Starting: Create build container

[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent\_work\_temp\1a36a463-5f12-4ee7-933b-d7a0c40bc88a.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
WARNING: Container name should not exceed 15 characters
BcContainerHelper is version 3.0.7
BcContainerHelper is running as administrator
Hyper-V is Enabled
Host is Microsoft Windows 11 Pro - 21H2
Docker Client Version is 20.10.14
Docker Server Version is 20.10.14
Fetching all docker images
Fetching all docker volumes
Using image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
Creating Container UpstateCoinBuild
Style: onprem
Multitenant: No
Version: 19.0.29894.30693
Platform: 19.0.29884.30666
Generic Tag: <IP_ADDRESS>
Container OS Version: 10.0.20348.643 (ltsc2022)
Host OS Version: 10.0.22000.613 (21H2)
Using process isolation
Using locale en-US
Disabling the standard eventlog dump to container log every 2 seconds (use -dumpEventLog to enable)
Using license file C:\_CAI Licenses\CAIv19.flf
Additional Parameters:
--volume "C:\agent\appfiles\:C:\shareddata"
Files in C:\ProgramData\BcContainerHelper\Extensions\UpstateCoinBuild\my:
- AdditionalOutput.ps1
- license.flf
- MainLoop.ps1
- SetupVariables.ps1
- updatehosts.ps1
Creating container UpstateCoinBuild from image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
2ab704a80f124a4411f282bc26200402c877d049bc0211385047ada83c91f80d
Waiting for container UpstateCoinBuild to be ready
Adding UPSTATECOINBUIL to hosts file
Using artifactUrl https://bcartifacts.azureedge.net/onprem/19.0.29894.30693/us
Using installer from C:\Run\150-new
Installing Business Central
Installing from artifacts
Starting Local SQL Server
WARNING: Waiting for service 'SQL Server (SQLEXPRESS) (MSSQL$SQLEXPRESS)' to
start...
Starting Internet Information Server
Copying Service Tier Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\Program Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\System64Folder
Copying PowerShell Scripts
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\Cloud\NAVAdministration
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\WebSearch
Copying Web Client Files
c:\dl\onprem\19.0.29894.30693\platform\WebClient\Microsoft Dynamics NAV
Copying Client Files
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\systemFolder
Copying ModernDev Files
c:\dl\onprem\19.0.29894.30693\platform
c:\dl\onprem\19.0.29894.30693\platform\ModernDev\program files\Microsoft Dynamics NAV
Copying additional files
Copying ConfigurationPackages
C:\dl\onprem\19.0.29894.30693\us\ConfigurationPackages
Copying Test Assemblies
C:\dl\onprem\19.0.29894.30693\platform\Test Assemblies
Copying Applications
C:\dl\onprem\19.0.29894.30693\us\Applications
Copying dependencies
**Copying ReportBuilderError**
Container Exited, ExitCode<PHONE_NUMBER>
New-BcContainer Telemetry Correlation Id: 732a782e-0711-488c-9cf3-57cd2def60d4
Initialization of container UpstateCoinBuild failed
At C:\Windows\ServiceProfiles\NetworkService\Documents\WindowsPowerShell\Modules\BcContainerHelper\3.0.7\ContainerHandl
ing\Wait-NavContainerReady.ps1:60 char:21
+ ...             throw "Initialization of container $containerName failed" ...
+                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : OperationStopped: (Initialization ...oinBuild failed:String) [], RuntimeException
    + FullyQualifiedErrorId : Initialization of container UpstateCoinBuild failed

##[error]PowerShell exited with code '1'.
##[section]Finishing: Create build container
NavContainerHelper is version <IP_ADDRESS>
NavContainerHelper is running as administrator
Host is Microsoft Windows 10 Enterprise - 2004
Docker Client Version is 19.03.8
Docker Server Version is 19.03.8
...

Additional context
Used to work; now happens every time

Could you remove -restart no and add -alwayspull (to get the latest generic just once)
You can also remove -usebestcontaineros - that parameter has no function anymore

Thank you, that ran without error first time. I can test on two other repositories. Couple of questions:

should I leave the -alwayspull in place going forward, after the first run?
If I removed the references to test libraries in the build script, would I still see these log outputs? Is it safe to do that?

Publishing C:...\Microsoft_System Application Test Library.app
Synchronizing System Application Test Library on tenant default
Installing System Application Test Library on tenant default
App Microsoft_System Application Test Library.app successfully published
Publishing C:...\Microsoft_Tests-TestLibraries.app
Synchronizing Tests-TestLibraries on tenant default
Installing Tests-TestLibraries on tenant default
App Microsoft_Tests-TestLibraries.app successfully published
TestToolkit successfully imported

on 1. - you don't have to have the alwayspull in place always
on 2. - I don't see how you are importing the test toolkit - what reference are you talking about here?

I had removed these: includeTestToolkit, includeTestLibrariesOnly, includeTestFrameworkOnly

Two repositories run without error; a third gets this error during compile:
Generating script.
========================== Starting Command Output ===========================
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\54ff2a7c-fb60-4411-87b9-6027dcdd6e65.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
container cb89bef2b71d1d9f9824967943f2092d4ce5c497c94d543bcae589fe857c1272 encountered an error during hcsshim::System::CreateProcess: failure in a Windows system call: The RPC server is unavailable. (0x6ba)
Compile-AppInNavContainer Telemetry Correlation Id: 0971dd5b-27d5-45fe-8b01-25058d8d8d8e
ScriptHalted
At C:\Windows\ServiceProfiles\NetworkService\Documents\WindowsPowerShell\Modules\BcContainerHelper\3.0.7\ContainerHandl
ing\Invoke-ScriptInNavContainer.ps1:114 char:17

            throw

            ~~~~~

CategoryInfo          : OperationStopped: (:) [], RuntimeException
FullyQualifiedErrorId : ScriptHalted

##[error]PowerShell exited with code '1'.
##[section]Finishing: Compile app

Full output of the failing script?
On the test framework - if you are running tests, then you will need those.

We are not running tests, so we don't need those libraries. I don't think I can reproduce the full output of the failing script, unfortunately. The point may be moot, as now all three repositories are running successfully on the same script. I will remove the -alwayspull and confirm that they run successfully without it.

Ok, thanks

Interesting. I removed only the -alwayspull parameter, and got the RPC error again. So maybe this is intermittent? Here is the full output:
##[section]Starting: Build
##[section]Starting: Initialize job
Agent name: 'DockerBuild2'
Agent machine name: 'DockerBuild1'
Current agent version: '2.202.1'
Agent running as: 'DockerBuild1$'
Prepare build directory.
Set build variables.
Download all required tasks.
Checking job knob settings.
Finished checking job knob settings.
Start tracking orphan processes.
##[section]Finishing: Initialize job
##[section]Starting: Checkout CAI365BC@master to s
Task         : Get sources
Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
Version      : 1.0.0
Author       : Microsoft
Help         : More Information
Syncing repository: CAI365BC (Git)
Prepending Path environment variable with directory containing 'git.exe'.
##[command]git version
git version 2.30.2.windows.1
##[command]git lfs version
git-lfs/2.13.3 (GitHub; windows amd64; go 1.16.2; git a5e65851)
##[command]git config --get remote.origin.url
##[command]git clean -ffdx
##[command]git reset --hard HEAD
HEAD is now at 2a5675b Update azure-pipelines.yml for Azure Pipelines
##[command]git config gc.auto 0
##[command]git config --get-all<EMAIL_ADDRESS>##[command]git config --get-all http.extraheader
##[command]git config --get-regexp .*extraheader
##[command]git config --get-all http.proxy
##[command]git config http.version HTTP/1.1
##[command]git -c http.extraheader="AUTHORIZATION: bearer ***" fetch --force --tags --prune --prune-tags --progress --no-recurse-submodules origin
remote: Azure Repos
remote:
remote: Found 6 objects to send. (3 ms)
From https://dev.azure.com/CAISoftBC/CAI365BC/_git/CAI365BC
2a5675b..0e32413  master     -> origin/master
##[command]git -c http.extraheader="AUTHORIZATION: bearer ***" fetch --force --tags --prune --prune-tags --progress --no-recurse-submodules origin  +0e324134af45f4cc05334a5ecdddefbdda7c09f9
From https://dev.azure.com/CAISoftBC/CAI365BC/_git/CAI365BC

branch            0e324134af45f4cc05334a5ecdddefbdda7c09f9 -> FETCH_HEAD
##[command]git checkout --progress --force 0e324134af45f4cc05334a5ecdddefbdda7c09f9
Previous HEAD position was 2a5675b Update azure-pipelines.yml for Azure Pipelines
HEAD is now at 0e32413 Update azure-pipelines.yml for Azure Pipelines
##[section]Finishing: Checkout CAI365BC@master to s
##[section]Starting: Install BCContainerHelper module
==============================================================================
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
==============================================================================
Generating script.
========================== Starting Command Output ===========================
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\78377366-c2c0-45dc-bc18-54b79a5d527d.ps1'"

Name                           Version          Source           Summary

nuget                          <IP_ADDRESS>        https://onege... NuGet provider for the OneGet meta-package manager
##[section]Finishing: Install BCContainerHelper module
##[section]Starting: Create build container
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
========================== Starting Command Output ===========================
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\ff7f29aa-0c84-4fce-9005-a30dc3232bb8.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
BcContainerHelper is version 3.0.7
BcContainerHelper is running as administrator
Hyper-V is Enabled
Host is Microsoft Windows 11 Pro - 21H2
Docker Client Version is 20.10.14
Docker Server Version is 20.10.14
Fetching all docker images
Fetching all docker volumes
Using image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
Creating Container CAI365BCBuild
Style: onprem
Multitenant: No
Version: 19.0.29894.30693
Platform: 19.0.29884.30666
Generic Tag: <IP_ADDRESS>
Container OS Version: 10.0.20348.643 (ltsc2022)
Host OS Version: 10.0.22000.613 (21H2)
Using process isolation
Using locale en-US
Disabling the standard eventlog dump to container log every 2 seconds (use -dumpEventLog to enable)
Using license file C:_CAI Licenses\CAIv19.flf
Additional Parameters:
--volume "C:\agent\appfiles:C:\shareddata"
Files in C:\ProgramData\BcContainerHelper\Extensions\CAI365BCBuild\my:

AdditionalOutput.ps1
license.flf
MainLoop.ps1
SetupVariables.ps1
updatehosts.ps1
Creating container CAI365BCBuild from image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
19942fc6ba3f374ea3849d0c7023507e8016f8ebd0abfff420380518d9417b69
Waiting for container CAI365BCBuild to be ready
Using artifactUrl https://bcartifacts.azureedge.net/onprem/19.0.29894.30693/us
Using installer from C:\Run\150-new
Installing Business Central
Installing from artifacts
Starting Local SQL Server
Starting Internet Information Server
Copying Service Tier Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\Program Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\System64Folder
Copying PowerShell Scripts
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\Cloud\NAVAdministration
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\WebSearch
Copying Web Client Files
c:\dl\onprem\19.0.29894.30693\platform\WebClient\Microsoft Dynamics NAV
Copying Client Files
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\systemFolder
Copying ModernDev Files
c:\dl\onprem\19.0.29894.30693\platform
c:\dl\onprem\19.0.29894.30693\platform\ModernDev\program files\Microsoft Dynamics NAV
Copying additional files
Copying ConfigurationPackages
C:\dl\onprem\19.0.29894.30693\us\ConfigurationPackages
Copying Test Assemblies
C:\dl\onprem\19.0.29894.30693\platform\Test Assemblies
Copying Applications
C:\dl\onprem\19.0.29894.30693\us\Applications
Copying dependencies
Copying ReportBuilder
Importing PowerShell Modules
Restoring CRONUS Demo Database
Using artifactUrl https://bcartifacts.azureedge.net/onprem/19.0.29894.30693/us
Using installer from
Installing Business Central
Installing from artifacts
Starting Local SQL Server
Starting Internet Information Server
Copying Service Tier Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\Program Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\System64Folder
Copying PowerShell Scripts
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\Cloud\NAVAdministration
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\WebSearch
Copying Web Client Files
c:\dl\onprem\19.0.29894.30693\platform\WebClient\Microsoft Dynamics NAV
Copying Client Files
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\systemFolder
Copying ModernDev Files
c:\dl\onprem\19.0.29894.30693\platform
c:\dl\onprem\19.0.29894.30693\platform\ModernDev\program files\Microsoft Dynamics NAV
Copying additional files
Copying ConfigurationPackages
C:\dl\onprem\19.0.29894.30693\us\ConfigurationPackages
Copying Test Assemblies
C:\dl\onprem\19.0.29894.30693\platform\Test Assemblies
Copying Applications
C:\dl\onprem\19.0.29894.30693\us\Applications
Copying dependencies
Copying ReportBuilder
Importing PowerShell Modules
Removing database CRONUS
Removing Database CRONUS from localhost\SQLEXPRESS
Restoring CRONUS Demo Database
Setting CompatibilityLevel for CRONUS on localhost\SQLEXPRESS
Modifying Business Central Service Tier Config File for Docker
Creating Business Central Service Tier
Installing SIP crypto provider: 'C:\Windows\System32\NavSip.dll'
Starting Business Central Service Tier
Importing license file
Stopping Business Central Service Tier
Installation took 185 seconds
Installation complete
Initializing...
Setting host.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting gateway.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting kubernetes.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting host.containerhelper.internal to <IP_ADDRESS> in container hosts file
Starting Container
Hostname is CAI365BCBuild
PublicDnsName is CAI365BCBuild
Using NavUserPassword Authentication
Creating Self Signed Certificate
Self Signed Certificate Thumbprint CD5154FAA4FA8584DD1F730C7353DE3A170F358D
DNS identity CAI365BCBuild
Modifying Service Tier Config File with Instance Specific Settings
Starting Service Tier
Registering event sources
Creating DotNetCore Web Server Instance
Using application pool name: BC
Using default container name: NavWebApplicationContainer
Copy files to WWW root C:\inetpub\wwwroot\BC
Create the application pool BC
Create website: NavWebApplicationContainer without SSL
Update configuration: navsettings.json
Done Configuring Web Client
Using license file 'c:\run\my\license.flf'
Import License
Creating http download site
Setting SA Password and enabling SA
Creating admin as SQL User and add to sysadmin
Creating SUPER user
Container IP Address: <IP_ADDRESS>
Container Hostname  : CAI365BCBuild
Container Dns Name  : CAI365BCBuild
Web Client          : http://CAI365BCBuild/BC/
Dev. Server         : http://CAI365BCBuild
Dev. ServerInstance : BC
Setting CAI365BCBuild to <IP_ADDRESS> in host hosts file

Files:
http://CAI365BCBuild:8080/ALLanguage.vsix
Container Total Physical Memory is 8.0Gb
Container Free Physical Memory is 2.3Gb
Initialization took 121 seconds
Ready for connections!
Reading CustomSettings.config from CAI365BCBuild
Container CAI365BCBuild successfully created
Use:
Get-BcContainerEventLog -containerName CAI365BCBuild to retrieve a snapshot of the event log from the container
Get-BcContainerDebugInfo -containerName CAI365BCBuild to get debug information about the container
Enter-BcContainer -containerName CAI365BCBuild to open a PowerShell prompt inside the container
Remove-BcContainer -containerName CAI365BCBuild to remove the container again
docker logs CAI365BCBuild to retrieve information about URL's again
##[section]Finishing: Create build container
##[section]Starting: Copy source into container folder
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
========================== Starting Command Output ===========================
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\af8768bd-4ce0-430a-bff4-9cee4b9f0271.ps1'"
 Directory: C:\ProgramData\BcContainerHelper\Extensions\CAI365BCBuild

Mode                 LastWriteTime         Length Name

d-----         5/11/2022   9:47 AM                Source
##[section]Finishing: Copy source into container folder
##[section]Starting: Compile app
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
========================== Starting Command Output ===========================
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\0e02a779-2380-472c-8afb-dd4e449765f8.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
container 19942fc6ba3f374ea3849d0c7023507e8016f8ebd0abfff420380518d9417b69 encountered an error during hcsshim::System::CreateProcess: failure in a Windows system call: The RPC server is unavailable. (0x6ba)
Compile-AppInNavContainer Telemetry Correlation Id: c86e4e7a-6358-44c1-8103-bd200f573e23
ScriptHalted
At C:\Windows\ServiceProfiles\NetworkService\Documents\WindowsPowerShell\Modules\BcContainerHelper\3.0.7\ContainerHandl
ing\Invoke-ScriptInNavContainer.ps1:114 char:17

            throw

            ~~~~~

CategoryInfo          : OperationStopped: (:) [], RuntimeException
FullyQualifiedErrorId : ScriptHalted

##[error]PowerShell exited with code '1'.
##[section]Finishing: Compile app
##[section]Starting: Remove build container
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
========================== Starting Command Output ===========================
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\421d0d76-fef5-4bd1-9e52-5a27923bb922.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
Removing container CAI365BCBuild
Removing CAI365BCBuild from container hosts file
Removing CAI365BCBuild-* from container hosts file
Removing C:\ProgramData\BcContainerHelper\Extensions\CAI365BCBuild
##[section]Finishing: Remove build container
##[section]Starting: Checkout CAI365BC@master to s
Task         : Get sources
Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
Version      : 1.0.0
Author       : Microsoft
Help         : More Information
Cleaning any cached credential from repository: CAI365BC (Git)
##[section]Finishing: Checkout CAI365BC@master to s
##[section]Starting: Finalize Job
Cleaning up task key
Start cleaning up orphan processes.
##[section]Finishing: Finalize Job
##[section]Finishing: Build

So, I assume that if you run this a number of times, it will fail sometimes but not always?

Apparently. I just added -alwayspull back in, and it failed with the RPC error.

Can you check whether the build agent is exhausted?

Out of memory or disk space

Neither, it is a dedicated machine. CPU goes high, but does not stay there. I can run again and watch the meters. 78 GB of space free on the C: drive. 8GB RAM.

I can see you have a step to copy the source into the container.
Some of the problems I have seen with containers have been in connection with copying files because defender goes crazy.
Have you tried to share the files with the container instead of copying? (would also be faster)

Yes, you can share any number of volumes or shares.

-additionalParameters @("--volume ""C:\agent\appfiles:C:\shareddata""", "--volume ""C:\agent\sources:C:\sources""")
and then compile in sources

It took me a while to work out the actual syntax for the yaml, because it ended up being simpler than I thought.
The container builds, the shared volumes are created, and the source code ends up in C:\Sources in the container. But the compile consistently fails with the RPC error during the compile step.  I will try this modified script with one of the other repositories to see if it only fails on this one (why that would be I don't know)
Here is the current yaml, followed by the log output:
`trigger:
branches:
include:
- master
pool:
name: Default
variables:

name: image_name
value: mcr.microsoft.com/businesscentral
name: container_name
value: CAI365BCBuild
name: company_name
value: CAI
name: user_name
value: admin
name: password
value: P@ssw0rd
name: license_file
value: '"C:_CAI Licenses\CAIv19.flf"'
name: appSymbolsFolder
value: 'C:\agent\appfiles'
name: destinationFolder
value: 'C:_BC App Files'
stages:
stage: build
displayName: Build
jobs:

job: Build
timeoutInMinutes: 60
pool:
name: Default
steps:

task: PowerShell@2
displayName: Install BCContainerHelper module
inputs:
targetType: inline
script: >
Install-PackageProvider -Name NuGet -Force -Scope CurrentUser; Install-Module -Name BCContainerHelper -Scope CurrentUser -force;

task: PowerShell@2
displayName: Create build container
inputs:
targetType: inline
script: >
$mySources = '$(appProjectFolder)';
$artifactUrl = Get-BcArtifactUrl -type 'OnPrem' -country 'us' -version '19.0.29894.30693'; $Credential = [PSCredential]::new('$(user_name)',(ConvertTo-SecureString '$(password)' -AsPlainText -Force)); New-BcContainer -accept_eula -accept_outdated -containerName '$(container_name)' -auth UserPassword -credential $Credential      -useGenericImage "$(Get-BestGenericImageName)-dev"  -process hyperv -artifacturl $artifactUrl -licenseFile $(license_file) -doNotExportObjectsToText
-shortcuts None  -alwayspull -updateHosts `
-additionalParameters @("--volume ""C:\agent\appfiles:C:\shareddata""", "--volume ""$(Build.SourcesDirectory):C:\Sources""")

task: PowerShell@2
displayName: Compile app
inputs:
targetType: inline
script: >
$Credential = [PSCredential]::new('$(user_name)',(ConvertTo-SecureString '$(password)' -AsPlainText -Force));
Compile-AppInNavContainer -containerName '$(container_name)' -appProjectFolder '$(Build.SourcesDirectory)' -appSymbolsFolder '$(appSymbolsFolder)'  -credential $Credential -AzureDevOps -FailOn 'error';`

`##[section]Starting: Build
##[section]Starting: Initialize job
Agent name: 'DockerBuild2'
Agent machine name: 'DockerBuild1'
Current agent version: '2.202.1'
Agent running as: 'DockerBuild1$'
Prepare build directory.
Set build variables.
Download all required tasks.
Checking job knob settings.
Finished checking job knob settings.
Start tracking orphan processes.
##[section]Finishing: Initialize job
##[section]Starting: Checkout CAI365BC@master to s
Task         : Get sources
Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
Version      : 1.0.0
Author       : Microsoft
Help         : More Information
Syncing repository: CAI365BC (Git)
Prepending Path environment variable with directory containing 'git.exe'.
##[command]git version
git version 2.30.2.windows.1
##[command]git lfs version
git-lfs/2.13.3 (GitHub; windows amd64; go 1.16.2; git a5e65851)
##[command]git config --get remote.origin.url
##[command]git clean -ffdx
##[command]git reset --hard HEAD
HEAD is now at 73d7291 Update azure-pipelines.yml for Azure Pipelines
##[command]git config gc.auto 0
##[command]git config --get-all<EMAIL_ADDRESS>##[command]git config --get-all http.extraheader
##[command]git config --get-regexp .*extraheader
##[command]git config --get-all http.proxy
##[command]git config http.version HTTP/1.1
##[command]git -c http.extraheader="AUTHORIZATION: bearer ***" fetch --force --tags --prune --prune-tags --progress --no-recurse-submodules origin
remote: Azure Repos
remote:
remote: Found 3 objects to send. (8 ms)
From https://dev.azure.com/CAISoftBC/CAI365BC/_git/CAI365BC
73d7291..f347ee2  master     -> origin/master
##[command]git -c http.extraheader="AUTHORIZATION: bearer ***" fetch --force --tags --prune --prune-tags --progress --no-recurse-submodules origin  +f347ee2e4c65bebc295ce68f5beacbe115207ebf
From https://dev.azure.com/CAISoftBC/CAI365BC/_git/CAI365BC

branch            f347ee2e4c65bebc295ce68f5beacbe115207ebf -> FETCH_HEAD
##[command]git checkout --progress --force f347ee2e4c65bebc295ce68f5beacbe115207ebf
Previous HEAD position was 73d7291 Update azure-pipelines.yml for Azure Pipelines
HEAD is now at f347ee2 Update azure-pipelines.yml for Azure Pipelines
##[section]Finishing: Checkout CAI365BC@master to s
##[section]Starting: Install BCContainerHelper module

Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
Starting Command Output =
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\ed30cdb9-5ae3-4524-8b33-163e93fc528c.ps1'"
Name                           Version          Source           Summary

nuget                          <IP_ADDRESS>        https://onege... NuGet provider for the OneGet meta-package manager
##[section]Finishing: Install BCContainerHelper module
##[section]Starting: Create build container
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
Starting Command Output =
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\745c5d42-5a02-4d0a-bb0e-79b6adf6b3cc.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
BcContainerHelper is version 3.0.7
BcContainerHelper is running as administrator
Hyper-V is Enabled
Host is Microsoft Windows 11 Pro - 21H2
Docker Client Version is 20.10.14
Docker Server Version is 20.10.14
Removing CAI365BCBuild from container hosts file
Removing CAI365BCBuild-* from container hosts file
Removing C:\ProgramData\BcContainerHelper\Extensions\CAI365BCBuild
Fetching all docker images
Fetching all docker volumes
Pulling image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
10.0.20348.643-dev: Pulling from businesscentral
Digest: sha256:dc9169a40fb72bfafb10ce70bba1a162c58c20a9af32bbe6518467b9f4537d80
Status: Image is up to date for mcr.microsoft.com/businesscentral:10.0.20348.643-dev
mcr.microsoft.com/businesscentral:10.0.20348.643-dev
Using image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
Creating Container CAI365BCBuild
Style: onprem
Multitenant: No
Version: 19.0.29894.30693
Platform: 19.0.29884.30666
Generic Tag: <IP_ADDRESS>
Container OS Version: 10.0.20348.643 (ltsc2022)
Host OS Version: 10.0.22000.613 (21H2)
Using process isolation
Using locale en-US
Disabling the standard eventlog dump to container log every 2 seconds (use -dumpEventLog to enable)
Using license file C:_CAI Licenses\CAIv19.flf
Additional Parameters:
--volume "C:\agent\appfiles:C:\shareddata"
--volume "C:\agent2_work\2\s:C:\Sources"
Files in C:\ProgramData\BcContainerHelper\Extensions\CAI365BCBuild\my:

AdditionalOutput.ps1
license.flf
MainLoop.ps1
SetupVariables.ps1
updatehosts.ps1
Creating container CAI365BCBuild from image mcr.microsoft.com/businesscentral:10.0.20348.643-dev
2dc8907df0e81a9ceb71535fb82dc05017d9d565e533f91ecb176596e33e622f
Waiting for container CAI365BCBuild to be ready
Using artifactUrl https://bcartifacts.azureedge.net/onprem/19.0.29894.30693/us
Using installer from C:\Run\150-new
Installing Business Central
Installing from artifacts
Starting Local SQL Server
Starting Internet Information Server
Copying Service Tier Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\Program Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\System64Folder
Copying PowerShell Scripts
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\Cloud\NAVAdministration
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\WebSearch
Copying Web Client Files
c:\dl\onprem\19.0.29894.30693\platform\WebClient\Microsoft Dynamics NAV
Copying Client Files
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\systemFolder
Copying ModernDev Files
c:\dl\onprem\19.0.29894.30693\platform
c:\dl\onprem\19.0.29894.30693\platform\ModernDev\program files\Microsoft Dynamics NAV
Copying additional files
Copying ConfigurationPackages
C:\dl\onprem\19.0.29894.30693\us\ConfigurationPackages
Copying Test Assemblies
C:\dl\onprem\19.0.29894.30693\platform\Test Assemblies
Copying Applications
C:\dl\onprem\19.0.29894.30693\us\Applications
Copying dependencies
Copying ReportBuilder
Using artifactUrl https://bcartifacts.azureedge.net/onprem/19.0.29894.30693/us
Using installer from
Installing Business Central
Installing from artifacts
Starting Local SQL Server
WARNING: Waiting for service 'SQL Server (SQLEXPRESS) (MSSQL$SQLEXPRESS)' to
start...
Starting Internet Information Server
Copying Service Tier Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\Program Files
c:\dl\onprem\19.0.29894.30693\platform\ServiceTier\System64Folder
Copying PowerShell Scripts
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\Cloud\NAVAdministration
c:\dl\onprem\19.0.29894.30693\platform\WindowsPowerShellScripts\WebSearch
Copying Web Client Files
c:\dl\onprem\19.0.29894.30693\platform\WebClient\Microsoft Dynamics NAV
Copying Client Files
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\program files\Microsoft Dynamics NAV
c:\dl\onprem\19.0.29894.30693\platform\LegacyDlls\systemFolder
Copying ModernDev Files
c:\dl\onprem\19.0.29894.30693\platform
c:\dl\onprem\19.0.29894.30693\platform\ModernDev\program files\Microsoft Dynamics NAV
Copying additional files
Copying ConfigurationPackages
C:\dl\onprem\19.0.29894.30693\us\ConfigurationPackages
Copying Test Assemblies
C:\dl\onprem\19.0.29894.30693\platform\Test Assemblies
Copying Applications
C:\dl\onprem\19.0.29894.30693\us\Applications
Copying dependencies
Copying ReportBuilder
Importing PowerShell Modules
Restoring CRONUS Demo Database
Setting CompatibilityLevel for CRONUS on localhost\SQLEXPRESS
Modifying Business Central Service Tier Config File for Docker
Creating Business Central Service Tier
Installing SIP crypto provider: 'C:\Windows\System32\NavSip.dll'
Starting Business Central Service Tier
Importing license file
Stopping Business Central Service Tier
Installation took 195 seconds
Installation complete
Initializing...
Setting host.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting gateway.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting kubernetes.docker.internal to <IP_ADDRESS> in container hosts file (copy from host hosts file)
Setting host.containerhelper.internal to <IP_ADDRESS> in container hosts file
Starting Container
Hostname is CAI365BCBuild
PublicDnsName is CAI365BCBuild
Using NavUserPassword Authentication
Creating Self Signed Certificate
Self Signed Certificate Thumbprint D244963F79849552B6203276074865AABBC663A8
DNS identity CAI365BCBuild
Modifying Service Tier Config File with Instance Specific Settings
Starting Service Tier
Registering event sources
Creating DotNetCore Web Server Instance
Using application pool name: BC
Using default container name: NavWebApplicationContainer
Copy files to WWW root C:\inetpub\wwwroot\BC
Create the application pool BC
Create website: NavWebApplicationContainer without SSL
Update configuration: navsettings.json
Done Configuring Web Client
Using license file 'c:\run\my\license.flf'
Import License
Creating http download site
Setting SA Password and enabling SA
Creating admin as SQL User and add to sysadmin
Creating SUPER user
Container IP Address: <IP_ADDRESS>
Container Hostname  : CAI365BCBuild
Container Dns Name  : CAI365BCBuild
Web Client          : http://CAI365BCBuild/BC/
Dev. Server         : http://CAI365BCBuild
Dev. ServerInstance : BC
Setting CAI365BCBuild to <IP_ADDRESS> in host hosts file

Files:
http://CAI365BCBuild:8080/ALLanguage.vsix
Container Total Physical Memory is 8.0Gb
Container Free Physical Memory is 1.5Gb
Initialization took 117 seconds
Ready for connections!
Reading CustomSettings.config from CAI365BCBuild
Container CAI365BCBuild successfully created
Use:
Get-BcContainerEventLog -containerName CAI365BCBuild to retrieve a snapshot of the event log from the container
Get-BcContainerDebugInfo -containerName CAI365BCBuild to get debug information about the container
Enter-BcContainer -containerName CAI365BCBuild to open a PowerShell prompt inside the container
Remove-BcContainer -containerName CAI365BCBuild to remove the container again
docker logs CAI365BCBuild to retrieve information about URL's again
##[section]Finishing: Create build container
##[section]Starting: Compile app
Task         : PowerShell
Description  : Run a PowerShell script on Linux, macOS, or Windows
Version      : 2.200.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
Generating script.
Starting Command Output =
##[command]"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent2_work_temp\51c45ce2-47f6-488d-a42c-02273b2a00af.ps1'"
BcContainerHelper version 3.0.7
BcContainerHelper emits usage statistics telemetry to Microsoft
container 2dc8907df0e81a9ceb71535fb82dc05017d9d565e533f91ecb176596e33e622f encountered an error during hcsshim::System::CreateProcess: failure in a Windows system call: The RPC server is unavailable. (0x6ba)
Compile-AppInNavContainer Telemetry Correlation Id: b2b3f44e-49aa-4414-9612-812d7fd37b28
ScriptHalted
At C:\Windows\ServiceProfiles\NetworkService\Documents\WindowsPowerShell\Modules\BcContainerHelper\3.0.7\ContainerHandl
ing\Invoke-ScriptInNavContainer.ps1:114 char:17

            throw

            ~~~~~

CategoryInfo          : OperationStopped: (:) [], RuntimeException
FullyQualifiedErrorId : ScriptHalted

##[error]PowerShell exited with code '1'.
##[section]Finishing: Compile app
##[section]Starting: Checkout CAI365BC@master to s
Task         : Get sources
Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.
Version      : 1.0.0
Author       : Microsoft
Help         : More Information
Cleaning any cached credential from repository: CAI365BC (Git)
##[section]Finishing: Checkout CAI365BC@master to s
##[section]Starting: Finalize Job
Cleaning up task key
Start cleaning up orphan processes.
##[section]Finishing: Finalize Job
##[section]Finishing: Build`

I am thinking this is not a BCContainerHelper issue. Same script fails on other repositories with the same RPC error. I can actually generate the error by trying to run a command manually in the container with docker exec  .  I will try to find out more about debugging and fixing this problem with a Docker container.

In your parameter set you have  -process hyperv
If you want to use hyperv - the parameter is called: -isolation hyperv

I don't know how that got switched, thank you. Had no effect on the build. I am going to back off from trying to compile in the shared folder. I cannot imagine there is something different about RPC in the container, so I am going to assume there is something wrong with they way I am trying to run the compile. For now I will go back to compiling in a folder on the C: drive. And then I will turn my attention to AL-GO for Github. Thank you.

Will close this one


Update INK_VERSION_CURRENT to 20

INK_CURRENT_VERSION is currently defined as 19 but ink's inkVersionCurrent is 20

Hey @bkmeneguello inkgd doesn't support stories compiled with inklecate 1.0.0 yet. I'll update the version once I port over all the changes!

I'm using this version without problems (yet), I can even run "The Intercept" compiled by Inklecate 1.0.0 with all flows. I didn't tested newer features yet.

I think we need to bump this version to 20. While doing some test runs of Inkgd I'm getting this same error.
I'd say we bump the version, and if there are incompatibilities between Ink and Inkgd they should be filed as bugs.

I'd say we bump the version, and if there are incompatibilities between Ink and Inkgd they should be filed as bugs.

I'm not keen on doing this because it sounds like a maintenance nightmare down the line.
Fortunately, the migration to 1.0.0 is nearly completed. I just have to dig into the codebase and find why 2 tests are crashing and 4 tests are not passing. I should be able to release the next version over the weekend or early next week.

Fixed by #28.


[bug] Data node editor id mechanism solve

this PR is under #2017
This project implements a locking mechanism for data nodes in a Taipy-based application. It ensures that data nodes cannot be written to or appended to if they are currently being edited by another process. The repository includes:
Enhanced DataNode and FileDataNode classes with lock checks for write(), append(), and _upload() methods. Custom exception handling via DataNodeIsBeingEdited. Unit tests to ensure full code coverage for the locking functionality.
Modified DataNode class: Added locking mechanism to write(), append(), and _upload() methods.
New FileDataNode class: Added lock check to _upload() method.
Test Cases:
test_write_locked_data_node(): Verifies the write() method respects the lock.
test_append_locked_data_node(): Verifies append() method respects the lock.
test_append_non_list_data(): Ensures append() only works on list data.
test_file_data_node_upload_locked(): Verifies _upload() respects the lock.

Hi there!
Thank you so much for your contribution! I noticed that there seems to be a bit of confusion regarding issue #2017. It looks like you've submitted a new file with classes that already exist in Taipy, and the unit tests and feature code are mixed in the same file, which isn't the best practice. For these reasons, I'll be closing this PR.
Feel free to reach out if you'd like any clarification or if you have any questions. We'd love to see your future contributions!
Thanks again! 😊

@joaoandre-avaiga so i need to stop doing further on this project ? . thank you next time i will try best . i might be too inexperience for it , i feel the same


Domain blocked in india?

I got this report via email:

...to my surprise, your website is blocked in India. I'm really not sure why, Is there a source I can read up to know what happened?
I then had to use a VPN to open up your page.
I've attached a screenshot for your reference.

After doing a bit of research, it looks like the most likely cause is some sort of copyright / trademark infringement:

Most of these bans are instigated under copyright and trademark infringement without proper security measures and lists that they provide without proper research or professional technical services.

I'm not aware of any blatant copyright/trademark infringement on my domain. The closest thing might be the after-dark-in-css project, of which legal status I describe in detail here.
If anyone knows how to find out why a domain gets blocked like this or how to get it unblocked, please let me know!

Update: here's an interesting twitter thread reaching out to network provider customer support: https://twitter.com/w3Abhishek/status/1425857478252584961

Another update: If you live in India and your ISP is blocking this site, you can report the issue here: https://savetheinternet.in/report.
I'm not too familiar with the https://savetheinternet.in organization (which makes me a little skeptical), but I checked out the other details on the site and it seems pretty legit to me. Feel free to do your own research and before submitting the form.

Hi,
I'm not even getting the form to fill, anyway even if there was any form to fill these things rarely work now. There's no one who'll take action. Under current govt, there nothing can be done, unless you're of any use to them. I wouldn't stress about it.

Regards
Ayush

This isn't a copyright or even a legal block.
Why it is happening: https://github.com/captn3m0/hello-cloudflare
How to Fix: https://github.com/captn3m0/hello-cloudflare#help-my-website-is-blocked

It sounds like resolving #40 could fix this then. Very good to know!


[hotfix] Fix various NOTICE file issues

This PR fixes some NOTICE file issues encountered while verifying the latest Flink 1.11.0 RC.
cc @zentol.

Thanks for the quick review @zentol and @rmetzger. Merging this PR now.


Network module does not detect disconnected state

Hi,
using git master here. I noticed that the network module incorrectly detects my Ethernet device as 'linked', even though the interface is down and the cable is disconnected.
This is the output of ip:
2: enp4s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast state DOWN group default qlen 1000
link/ether 80:fa:5b:24:a6:69 brd ff:ff:ff:ff:ff:ff
I haven't checked how the network module sources its information, but sysfs provides an operstate and carrier (which can only be read when the interface is UP). I have used this information in my custom Bash script to get the correct information about the if.
--- Tobias

I had another look at this, and I think we already have the required information available. In handleEvents() we already copy some fields of the ifi object. My suggestion is to also copy ifi_flags and evaluate it in getNetworkState(). ifi_flags seems to provide exactly the information that ip presents in angle brackets (for my example above the BROADCAST and MULTICAST flags are set). For connections of ethernet type UP and LOWER_UP should be present.
Also netlink seems to provide more fine grained carrier state, see section 3.5.9 here:
https://www.infradead.org/~tgr/libnl/doc/route.html

@marcplustwo Was #568 supposed to fix this issue?

@marcplustwo Was #568 supposed to fix this issue?

No, the PR has nothing to do with wired network connections.

I have a little(but not a lot) similar issue
In case of disabling Wi-Fi via hardware button (status accessible via rfkill) network module shows that is already connected to the last Wi-Fi network
netctl-auto list shows that it is not connected to any network in this case


Flesh out encounter creatures

Roll hit points
Determine weapons (if they wield weapons and are not characters)

This is CreatureGen


Get LoRA script to work for single gpus

This is my first pull request in 7 yrs or something so apologies in advance if I do anything wrong.
This pull request will add single gpu support to the LoRA script.

I added an additional boolean parameter to the script that represents whether to use a single gpu or not.
Not sure if this is the best way to go.


JSON error running command hassio network info

Home Assistant release with the issue:

0.73.2
Last working Home Assistant release (if known):
Not known
Operating environment (Hass.io/Docker/Windows/etc.):

Raspberry Pi 3 B+
hass.io 115
Resin OS 2.3.0+rev1
Connected via WiFi
Component/platform:

hass.io
Description of problem:
Running the command hassio network info doesn't work and return the error
Error decoding json invalid character ':' after top-level value: 404: Not Found

Problem-relevant configuration.yaml entries and (fill out even if it seems unimportant):
https://github.com/shortbloke/home_assistant_config
Traceback (if applicable):

Additional information:

Issue also occurs using HassOS 1.7 (64bit) with Hass.io 115 and HASS 0.74.0

/move to home-assistant/hassio


Python: Memory store upgrades for Milvus 2.3

Milvus 2.3 was recently released; the current memory store connectors currently target Milvus 2.2 (both Python and .NET), and this issue tracks leveraging new 2.3 features to make them better:

Upsert, which should map nicely to the equivalent SK IMemoryStore API (we currently do delete-then-insert)
Range search, which can be used to execute the minRelevanceScore parameter to GetNearestMatchAsync (this is currently done client-side, which is problematic especially in its interaction with limit).
Raw Vectors in Search Returns: when withEmbeddings is true for GetNearestMatchesAsync, the connector currently does an extra Query roundtrip to Milvus to fetch the vectors, since they couldn't be returned from Search; it seems that this is now at least partially possible.

Note: figure out the backwards compat and versioning story, i.e. would a new version of the connector that's compatible with 2.3 be expected to also work with 2.2.
/cc @filip-halt @stephentoub @luisquintanilla

@roji - feel free to do a PR to update this to the latest version.  Thanks for bringing this up.

All .Net issues prior to 1-Dec-2023 are being closed. Please re-open, if this issue is still relevant to the .Net Semantic Kernel 1.x release. In the future all issues that are inactive for more than 90 days will be labelled as 'stale' and closed 14 days later.

Note that this isn't a .NET issue - it's a Python one (wrong labeling).

@roji this is a little bit tricky as Milvus doesn't always have the latest builds for Windows. There is a way to handle various versions in our poetry file, but the memory related upgrades aren't our highest priority right now as we move to getting other base functionality ready for Python v1.

Closing as we support Milvus 2.3 in Python.


Added DayViewProvider option for extra customization

Being able to set a custom DayViewProvider which will provide the CalendarView with your custom DayView's

Waiting for this to be merged... It's a really nice feature!

Hello?

Is maintenance going to be continued in the future?

@martinusslomp Thank you for your PR, 👍 LGTM. Could you provide an example in samples that demonstrate how to create a custom DayView? I would be testing and merging after. Thanks

@quentin41500  What we need to merge this, it's really a nice feature that need to be merged 😊.
I'm ready to help 👍
Thanks,


Install FindSecBugs build plugin

(and also update to the latest build conventions)
Reviewer checklist

[ ] Read the contributing guide
[ ] PR should be motivated, i.e. what does it fix, why, and if relevant, how
[ ] Ensure relevant issues are linked (description should include text like "Fixes #")
[ ] Ensure any appropriate documentation has been added or amended

Coverage: 98.238%. Remained the same when pulling 4d9aeb8a9c3752c19ea505dbf67f4576898f3ed6 on sec into 155e9aa2073f37e60c9e2e69e4c328a96cc113f2 on main.


WSL error: "Unable to detect if server is already installed: Error: self signed certificate in certificate chain"

System Info

VSCode Version: 1.37.0-insider
OS Version: Windows 10 18362

Steps to reproduce

Open VSCode on a corporate network that uses a firewall and attaches its own certificate.
Attempt to start a WSL session.

Does this issue occur when all extensions are disabled?: N/A - WSL specific error.
Error message
[2019-08-05 08:21:10.180] Starting VS Code Server inside WSL (ubuntu)
[2019-08-05 08:21:10.180] Extension version: 0.39.1, Windows build: 18362. Multi distro support: enabled. WSL path support: enabled
[2019-08-05 08:21:10.871] Probing if server is already installed: C:\WINDOWS\System32\wsl.exe -d ubuntu -e sh -c "[ -d ~/.vscode-server-insiders/bin/0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b ] && echo found || echo missing"
[2019-08-05 08:21:11.175] No server install found on WSL, downloading server on client side: C:\Users\{user}\AppData\Local\Temp\vscode-remote-wsl\0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b\vscode-server-linux-x64.tar.gz
[2019-08-05 08:21:11.659] Unable to detect if server is already installed: Error: self signed certificate in certificate chain
[2019-08-05 08:21:11.659] Launching C:\WINDOWS\System32\wsl.exe -d ubuntu -e sh -c "\"$(wslpath -u 'c:/Users/{user}/.vscode-insiders/extensions/ms-vscode-remote.remote-wsl-0.39.1/scripts/wslServer.sh')\" '0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b' 'insider' '.vscode-server-insiders' '' 0  --disable-telemetry" in c:\Users\{user}\.vscode-insiders\extensions\ms-vscode-remote.remote-wsl-0.39.1
[2019-08-05 08:21:12.084] WSL version: 4.4.0-18362-Microsoft Ubuntu
[2019-08-05 08:21:12.084] Updating server...
[2019-08-05 08:21:12.383] Updating VS Code Server to version 0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b
[2019-08-05 08:21:12.383] Removing previous installation...
[2019-08-05 08:21:12.383] Downloading:
[2019-08-05 08:21:12.684]
[2019-08-05 08:21:12.984] Failed
[2019-08-05 08:21:12.984] Will not apply HSTS. The HSTS database must be a regular and non-world-writable file.
[2019-08-05 08:21:12.984] ERROR: could not open HSTS store at '/home/LinuxUser/.wget-hsts'. HSTS will be disabled.
[2019-08-05 08:21:12.984] --2019-08-05 09:21:12--  https://update.code.visualstudio.com/commit:0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b/server-linux-x64/insider
[2019-08-05 08:21:12.984] Resolving update.code.visualstudio.com (update.code.visualstudio.com)...
[2019-08-05 08:21:13.285] <IP_ADDRESS>
[2019-08-05 08:21:13.285] Connecting to update.code.visualstudio.com (update.code.visualstudio.com)|<IP_ADDRESS>|:443... connected.
[2019-08-05 08:21:13.491] ERROR: cannot verify update.code.visualstudio.com's certificate, issued by ‘CN=Fireware HTTPS Proxy (SN XXXXXXXXXXXX 2019-04-18 08:03:51 UTC) CA,OU=Fireware,O=WatchGuard_Technologies’:
[2019-08-05 08:21:13.491]   Self-signed certificate encountered.
[2019-08-05 08:21:13.491] To connect to update.code.visualstudio.com insecurely, use `--no-check-certificate'.
[2019-08-05 08:21:13.491] ERROR: Failed to download https://update.code.visualstudio.com/commit:0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b/server-linux-x64/insider to /home/LinuxUser/.vscode-server-insiders/bin/0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b-1564993272.tar.gz
[2019-08-05 08:21:13.491] Please install missing certificates.
[2019-08-05 08:21:13.491] Debian/Ubuntu:  sudo apt-get install ca-certificates
[2019-08-05 08:21:13.491] VS Code Server for WSL closed unexpectedly.
[2019-08-05 08:21:13.491] For help with startup problems, go to
[2019-08-05 08:21:13.491] https://code.visualstudio.com/docs/remote/troubleshooting#_wsl-tips

Steps attempted
I have tried the following and these didn't work:

Setting "http.proxyStrictSSL" : false in settings.json
Installing the win-ca extension
Adding update.code.visualstudio.com to the list of exceptions, so we don't apply our own certificate to this

Unknowns

The message says I can connect to update.code.visualstudio.com insecurely by supplying --no-check-certificate as an argument - where would I do this?

Workarounds

Use the hotspot on my phone!

All help appreciated!

See https://code.visualstudio.com/docs/setup/network#_ssl-certificates
We first try to make the download on the windows side. See the message
No server install found on WSL, downloading server on client side: C:\Users\{user}\AppData\Local\Temp\vscode-remote-wsl\0bd57ac9efae79f9eb1aedc3818ebbb570b9bf6b\vscode-server-linux-x64.tar.gz
[2019-08-05 08:21:11.659] Unable to detect if server is already installed: Error
Unable to detect if server is already installed: Error: self signed certificate in certificate chain
```.

So if the windows settings are right it should work.

Closing because this is no longer happening, so it was likely either an issue specific to my network or something I was doing wrong.


Tax data are not applied correctly when adding a promo code

Thank you for the wonderful plugin!
While playing with promo codes I have discovered the following bug.
Expected: upon adding a promocode, checkout taxes are (re)calculated correctly.
Actual: FlatTaxPlugin taxes calculation is skipped. In my case, I get a completely wrong tax applied of ~4.5% and I still cannot understand where that number came from. I thought that the recalculation would happen on adding a promo code but noticed it got skipped.
Possible cause:
fetch_checkout_prices_if_expired has this code:
    tax_data = manager.get_taxes_for_checkout(
        checkout_info,
        lines,
    )
    if tax_data:
        _apply_tax_data_from_app(checkout, lines, tax_data)

however FlatTaxPlugin doesn't have method get_taxes_for_checkout, that's why _apply_tax_data_from_app is not invoked.
I have also noticed that FlatTaxPlugin v0.5.1 has added get_taxes_for_order to counter regression related to Saleor 3.6.0 tax changes however the peer method get_taxes_for_checkout was not added to FlatTaxPlugin.
Help to reproduce the issue
Payload to the /graphql (mutation AddCheckoutPromoCode):
[{"operationName":"AddCheckoutPromoCode","variables":{"checkoutId":"Q2hlY2tvdXQ6NGY5ZmJjMDktNTNlYS00ZWNhLWE4MzctODk2N2NjYjM4YTNh","promoCode":"Sale!!!"},"query":"fragment Price on TaxedMoney {\n  gross {\n    amount\n    currency\n    __typename\n  }\n  net {\n    amount\n    currency\n    __typename\n  }\n  __typename\n}\n\nfragment ProductVariant on ProductVariant {\n  id\n  name\n  sku\n  quantityAvailable\n  pricing {\n    onSale\n    priceUndiscounted {\n      ...Price\n      __typename\n    }\n    price {\n      ...Price\n      __typename\n    }\n    __typename\n  }\n  attributes {\n    attribute {\n      id\n      name\n      __typename\n    }\n    values {\n      id\n      name\n      value: name\n      __typename\n    }\n    __typename\n  }\n  product {\n    id\n    name\n    slug\n    thumbnail {\n      url\n      alt\n      __typename\n    }\n    thumbnail2x: thumbnail(size: 510) {\n      url\n      __typename\n    }\n    productType {\n      id\n      isShippingRequired\n      __typename\n    }\n    __typename\n  }\n  __typename\n}\n\nfragment CheckoutLine on CheckoutLine {\n  id\n  quantity\n  totalPrice {\n    ...Price\n    __typename\n  }\n  variant {\n    ...ProductVariant\n    __typename\n  }\n  __typename\n}\n\nfragment Address on Address {\n  id\n  firstName\n  lastName\n  companyName\n  streetAddress1\n  streetAddress2\n  city\n  postalCode\n  country {\n    code\n    country\n    __typename\n  }\n  countryArea\n  phone\n  isDefaultBillingAddress\n  isDefaultShippingAddress\n  __typename\n}\n\nfragment ShippingMethod on ShippingMethod {\n  id\n  name\n  price {\n    currency\n    amount\n    __typename\n  }\n  __typename\n}\n\nfragment PaymentGateway on PaymentGateway {\n  id\n  name\n  config {\n    field\n    value\n    __typename\n  }\n  currencies\n  __typename\n}\n\nfragment Checkout on Checkout {\n  token\n  id\n  totalPrice {\n    ...Price\n    __typename\n  }\n  subtotalPrice {\n    ...Price\n    __typename\n  }\n  billingAddress {\n    ...Address\n    __typename\n  }\n  shippingAddress {\n    ...Address\n    __typename\n  }\n  email\n  availableShippingMethods {\n    ...ShippingMethod\n    __typename\n  }\n  shippingMethod {\n    ...ShippingMethod\n    __typename\n  }\n  shippingPrice {\n    ...Price\n    __typename\n  }\n  lines {\n    ...CheckoutLine\n    __typename\n  }\n  isShippingRequired\n  discount {\n    currency\n    amount\n    __typename\n  }\n  discountName\n  translatedDiscountName\n  voucherCode\n  availablePaymentGateways {\n    ...PaymentGateway\n    __typename\n  }\n  __typename\n}\n\nfragment CheckoutError on CheckoutError {\n  code\n  field\n  message\n  __typename\n}\n\nmutation AddCheckoutPromoCode($checkoutId: ID!, $promoCode: String!) {\n  checkoutAddPromoCode(checkoutId: $checkoutId, promoCode: $promoCode) {\n    checkout {\n      ...Checkout\n      __typename\n    }\n    errors: checkoutErrors {\n      ...CheckoutError\n      __typename\n    }\n    __typename\n  }\n}\n"}]

Callstack:
fetch_checkout_prices_if_expired (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/checkout/calculations.py:260)
checkout_total (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/checkout/calculations.py:125)
calculate_checkout_total_with_gift_cards (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/checkout/calculations.py:96)
calculate_total_price (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/checkout/types.py:532)
execute_graphql_request (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/views.py:332)
get_response (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/views.py:205)
<listcomp> (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/views.py:147)
_handle_query (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/views.py:147)
handle_query (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/views.py:189)
dispatch (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/graphql/views.py:108)
wrapper (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/webhook/observability/utils.py:183)
middleware (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/core/middleware.py:111)
_plugins_middleware (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/core/middleware.py:103)
_site_middleware (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/core/middleware.py:85)
_discounts_middleware (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/core/middleware.py:65)
_stamp_request (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/core/middleware.py:53)
health_check_wrapper (/home/ivan/de/rel/sal/saleor-platform-3.0/saleor-platform/saleor/saleor/wsgi/health_check.py:6)

I have figured out why the tax got calculated incorrectly.
The product I was trying to buy had not have a check "Charge taxes on this product" hence only shipping fee had the tax applied. That's why total net and total gross differed only in ~4.4% (because the product was 0% tax and shipping fee was 21% tax). So the calculation is actually correct.
I am wondering why there are so many tax related methods in base_plugin.py and which ones are safe to be skipped.
Again, Carlos, thank you for the wonderful plugin.

Hey @ivanakcheurov 👋
Thanks, I'm glad that this plugin is helping you!
The reason I didn't implemented the get_taxes_for_checkout is because the tax will be calculated in this code just above the code you mentioned:
    # Taxes are applied to the discounted prices
    _apply_tax_data_from_plugins(
        checkout, manager, checkout_info, lines, address, discounts
    )

I'm keeping an eye at this PR which will add support for flat taxes out of the box in Saleor and I think it will help you as well later


Set file on windows

Discussed in https://github.com/helmfile/helmfile/discussions/889

Originally posted by henkaa June  8, 2023
Me and my colleague are trying to get helmfile working for our helm charts, but we both run into trouble when using files in folders in the set file section.
We are both running helm and helmfile on a Windows 10 system (have tried both cmd and Powershell with same result) and both helm and helmfile is installed and maintained via scoop. helmfile is latest version.
Example from the helmfile.yaml
releases:
  - name: timespan-rest
    namespace: cda2-test
    installed: true
    createNamespace: true
    chart: cda2/timespan-rest
    values:
      - image:
          tag: "develop"
    set:
      - name: applicationyaml
        file: local/timespan-application.yml

When I run lint on it I get this output
ARGS:
0: helm (4 bytes)
1: lint (4 bytes)
2: C:\Users\henand2\AppData\Local\Temp\helmfile3968896767\cda2-test\timespan-rest\cda2\timespan-rest\latest\timespan-rest (118 bytes)
3: --namespace (11 bytes)
4: cda2-test (9 bytes)
5: --values (8 bytes)
6: C:\Users\henand2\AppData\Local\Temp\helmfile2343919300\cda2-test-timespan-rest-values-574f6f4f6d (96 bytes)
7: --set-file (10 bytes)
8: applicationyaml=local\timespan-application.yml (46 bytes)
ERROR:
exit status 1
EXIT STATUS
1
STDERR:
Error: failed parsing --set-file data: open localtimespan-application.yml: The system cannot find the file specified.
COMBINED OUTPUT:
Error: failed parsing --set-file data: open localtimespan-application.yml: The system cannot find the file specified.

There seems to be a "transformation" of slashes made, and on windows, one backslash is not enough. We have tried using following variants, all with the same outcome:
local/timespan-application.yml
local\/timespan-application.yml
local\timespan-application.yml
local\\timespan-application.yml
Are we doing something wrong or have we run into a bug here?

see: https://github.com/helm/helm/issues/9537.
I'll try to be compatible

@xiaomudk cool. maybe we can reference https://github.com/GoogleContainerTools/skaffold/pull/5648, WDYT?

@yxxhero  I have fixed it, and the test passed on the window.
helmfile.yaml:
releases:
  - name: prometheus-adapter
    namespace: cda2-test
    installed: true
    createNamespace: true
    chart: public/prometheus-adapter
    values:
      - image:
          tag: "develop"
    set:
      - name: applicationyaml
        file: local/timespan-application.yml

helmfile_windows_amd64.exe -f .\helmfile.yaml template --debug

exec: helm template prometheus-adapter public/prometheus-adapter --namespace cda2-test --values C:\Users\xiaomudk\AppData\Local\Temp\helmfile1939855288\cda2-test-prometheus-adapter-values-78b7695785 --set-file applicationyaml=local\\timespan-application.yml --debug


docs (for development)

In GitLab by @psimyn on Oct 23, 2017, 14:22
null

In GitLab by @gtsiolis on Jan 4, 2019, 04:08
@psimyn do you think we can close this, too?

In GitLab by @gtsiolis on Jan 4, 2019, 04:08
assigned to @psimyn

In GitLab by @tauriedavis on Jan 4, 2019, 04:26
I think so!

In GitLab by @tauriedavis on Jan 4, 2019, 04:26
closed

In GitLab by @gtsiolis on Jan 4, 2019, 04:30
Thanks @tauriedavis!


Arceuus teleport spell sprites are broken with the latest game update

Due to some sprite shuffling, all the Arceuus teleport spells are using the Kingdom Divided beta spells

Never mind, turns out Jagex themselves forgot to update the nexus. Apologies


Make file associations directly in the program

Is it possible to make file associations directly in the program, similar to video players and other image viewers?
I apologize if such an issue has already been created, and thank you very much for Tacent View, it may not open everything I need, but it does it super fast and without lagging.

I assume Windows? I do sorta wonder if that's best left to the OS and just choosing the app you want to open a particular extension... especially since there's no real installer for windows (it only comes as a portable zip). This could end up with the registry being out of wack if a new portable release is installed to a different directory.

Yes, Windows. If you leave it to the OS, you will get tired of selecting each format yourself, I would like to see something like in 7-Zip and Media Player Classic to make associations with files with one button


ARROW-6024: [Java] Provide more hash algorithms

Provide more hash algorithms to choose for different scenarios. In particular, we provide the following hash algorithms:

Simple hasher: A hasher that calculates the hash code of integers as is, and do not perform any finalization. So the computation is extremely efficient, but the quality of the produced hash code may not be good.

Murmur finalizing hasher: Finalize the hash code by the Murmur hashing algorithm. Details of the algorithm can be found in https://en.wikipedia.org/wiki/MurmurHash. Murmur hashing is computational expensive, as it involves several integer multiplications. However, the produced hash codes have good quality in the sense that they are uniformly distributed in the universe.

Jenkins finalizing hasher: Finalize the hash code by Bob Jenkins' algorithm. Details of this algorithm can be found in http://www.burtleburtle.net/bob/hash/integer.html.  Jenkins hashing is less computational expensive than Murmur hashing, as it involves no integer multiplication. However, the produced hash codes also have good quality in the sense that they are uniformly distributed in the universe.

Non-negative hasher: Wrapper for another hasher, to make the generated hash code non-negative. This can be useful for scenarios like hash table.

Codecov Report

Merging #4934 into master will increase coverage by 1.1%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #4934      +/-   ##
==========================================
+ Coverage   88.51%   89.61%    +1.1%
==========================================
  Files         908      660     -248
  Lines      115478    96707   -18771
  Branches     1418        0    -1418
==========================================
- Hits       102218    86667   -15551
+ Misses      12898    10040    -2858
+ Partials      362        0     -362

Impacted Files
Coverage Δ

cpp/src/arrow/json/converter.cc
90.53% <0%> (-1.78%)
:arrow_down:

cpp/src/arrow/json/chunked-builder.cc
79.91% <0%> (-1.68%)
:arrow_down:

cpp/src/arrow/csv/parser-test.cc
98.61% <0%> (-1.39%)
:arrow_down:

python/pyarrow/__init__.py
67.04% <0%> (-0.4%)
:arrow_down:

cpp/src/arrow/csv/parser.h
100% <0%> (ø)
:arrow_up:

cpp/src/arrow/csv/options.h
100% <0%> (ø)
:arrow_up:

r/src/recordbatch.cpp

r/R/Table.R

go/arrow/math/uint64_amd64.go

r/src/symbols.cpp

... and 249 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ff8c63b...a22892d. Read the comment docs.

I'm a little concerned on the direction this is taking. Having multiple hash functions that only differ on finalization doesn't make sense to as they are probably only good for smaller inputs.
The nonnegative implementations seem like they constrain hashes in a suboptimal way and if they really are needed should be done with composition.   I think it might pay to take a step back and write a clearer description of what you are trying to accomplish with different implementation s

@emkornfield Thanks a lot for your comments. Please see my reply in line.

I'm a little concerned on the direction this is taking. Having multiple hash functions that only differ on finalization doesn't make sense to as they are probably only good for smaller inputs.

I am not sure if I fully understand your question. For large inputs, the finalization is also critical. If the hash code produced by the previous steps is not good enough, the finalization is the last chance to improve it.

The nonnegative implementations seem like they constrain hashes in a suboptimal way and if they really are needed should be done with composition. I think it might pay to take a step back and write a clearer description of what you are trying to accomplish with different implementation s

Good suggestion about composition for non-negative implementations. In addition, I have also provided additional descriptions for each hash algorithm, and will update the description of this PR accordingly.

I am not sure if I fully understand your question. For large inputs, the finalization is also critical. If the hash code produced by the previous steps is not good enough, the finalization is the last chance to improve it.

My point is we have two implementations of hash functions that only differ in finalization.  This does nothing to actually provide good hash function implementation (from a  randomness/collision perspective).
We should be spelling out the use-cases we are trying to satisfy and have a limited set of good quality hash functions to use in those scenarios.  One of those scenarios might be a very cheap hash function, in which case only a more complicated finalization step is needed.  Using something like the results of https://github.com/rurban/smhasher as a guide might be useful.

I am not sure if I fully understand your question. For large inputs, the finalization is also critical. If the hash code produced by the previous steps is not good enough, the finalization is the last chance to improve it.

My point is we have two implementations of hash functions that only differ in finalization. This does nothing to actually provide good hash function implementation (from a randomness/collision perspective).
We should be spelling out the use-cases we are trying to satisfy and have a limited set of good quality hash functions to use in those scenarios. One of those scenarios might be a very cheap hash function, in which case only a more complicated finalization step is needed. Using something like the results of https://github.com/rurban/smhasher as a guide might be useful.

I think I kind of understand your point. You mean two classes with different finalization implementations are duplicated, right?
IMO, Simple hasing is in one extreme, that provides simple implementation for finalization; Murmur hashing is in the other extreme, that provides expensive implementation, since it involves several multiplications. Jenkins hashing is the trade-off between the two. It produces hash codes with no so good quality, but much less expensive than Murmur hashing, since it has no multiplication.
I think with the 3 hash algorithms, we can satisfy a wide range of use cases.

@liyafan82 I'll try to take another look and reply tomorrow.  (same with other PRs).  Sorry for the delay.

@liyafan82 I'll try to take another look and reply tomorrow. (same with other PRs). Sorry for the delay.

@emkornfield Don't worry. Just take your time.
It may be late for you. So please take good care of your health :-)

@liyafan82 I'll try to take another look and reply tomorrow. (same with other PRs). Sorry for the delay.

@emkornfield Don't worry. Just take your time. Thanks.

I think I kind of understand your point. You mean two classes with different finalization implementations are duplicated, right?

Yes, we should implement good hash algorithms from the start not rely on different finalization for differentiation/performance.

IMO, Simple hasing is in one extreme, that provides simple implementation for finalization; Murmur hashing is in the other extreme, that provides expensive implementation, since it involves several multiplications. Jenkins hashing is the trade-off between the two. It produces hash codes with no so good quality, but much less expensive than Murmur hashing, since it has no multiplication.

The issue I have is we aren't actually providing Murmur or Jenkins hashing we are only using them for finalization, based on the link to flink it seems like this pattern was adapted from the MathUtils which is used for post-processing for specific use-cases (partitioning within a machine and across a cluster), not mention is made of actual performance.

I think with the 3 hash algorithms, we can satisfy a wide range of use cases.

I think we should be clearer on the use-case and try to provide better all around hashes.  In my mind we probably want just 2:

Something fast but not necessarily great  (based on some light research FNV or DJB2) seem to be reasonable, that is good for short values.
Something better but possible slower (Murmur Hash or xxHash or whatever the latest thinking is here) and performs better on longer values.

I'm not convinced that we need 3 hash functions.  Without clear guidelines on how to choose them, it seems like it just adds noise to the code-base.

Yes. A use case is here:
https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/util/MathUtils.java

I would lean against, this but I don't feel too strongly here.

@emkornfield Thanks for all your comments.
The initial purpose of this issue is to support our (open addressing) hash table (for hash join & hash aggregate). The methods introduced in this PR represent the requirements for our use cases.
We want to contribute such methods to the Arrow community, because:

we believe such requirements are general enough in big data/distributed computing.
we have some experience in tuning the hash algorithms, and have some knowledge about the performance implications of these methods.

It seems you want to provide something more fundamental. That sounds good. Let's work on it.

@pravindra I'd like your thoughts on this (see conversation above).

I agree with @emkornfield - having too many hash functions can lead to confusion.
Here's an example - drill uses the complete murmur hash (not just for finalize), and still there have been cases with non-uniform partitioning.

@emkornfield @pravindra Thanks a lot for your valuable feedback.
I have significantly revised the PR according to my understanding of your comments.
Brief change log:

Making ArrowBufHasher an interface (instead of an abstract class), leaving only two essential methods.
Move the code to traverse the memory area to SimpleHasher.
Implement a full Murmur hasher.
Remove other hasher implementations (Jenkins hashing & Non-negative hashing).

Please take a look. Thanks you in advance.

Overall looks OK to me (didn't look carefully at the Murmur implementation because @pravindra did).  @pravindra if you don't have any other concerns I think we can merge this.  We might want to document the expected stability of the hash functions (do we guarantee they will be the same across versions).

made some minor corrections to the algo - please check if it's okay.

It looks good.
rotateRight is not extracted as a separate method, because it is an arithmetic shift, right?

made some minor corrections to the algo - please check if it's okay.

It looks good.
rotateRight is not extracted as a separate method, because it is an arithmetic shift, right?

yes - the murmur algo requires only arithmetic right shifts.

+1, LGTM.  Thank you for addressing the feedback and the contribution.


[Feature request] Add Inline Editors feature, just like brackets

This is a very useful function. No matter it appears in another pane or in a pop-up, or exactly like brackets.

There's already an issue for tracking this request: https://github.com/atom/atom/issues/2802.


next_wizard_path and previous_wizard_path randomly hitting #update instead of #show

I have a series of ~10 pages, and there are "Next" and "Back" link_to buttons to next_wizard_path and previous_wizard_path respectively. I've been running into really strange misrouting problems, where clicking on a link_to doesn't bring me to the right step.
I've been able to repro by just trying to go back and forth between two pages. About 1/10 times, instead of hitting the #show controller action, the #update action is hit. Is there something I'm doing wrong? Both link_to's do not have a method set on them, but there is a form on each page.

Looked into the Wicked code and can't find any reason why it's hitting #update (https://github.com/schneems/wicked/blob/master/lib/wicked/controller/concerns/path.rb#L24).
    %div.button-nav-container
      %button.btn.btn-default
        = link_to 'Back', wizard_path(:education)
      = submit_tag 'Next', class: "btn btn-default"

^I've noticed problems with these nav buttons. Could the form_tag be interfering with the link_to backwards somehow? When trying to go back from this page, it randomly hits #update and goes forward instead

Narrowed this down. I believe it only happens with links to previous_wizard_path.


Hackage release

Thanks for writing this! Have you got any plans to release mousebox to hackage?

We have nothing against it!  I would like to take a look and see if the docs are good enough though, and releases to hackage and stackage require a bit of love....

Thanks @alcidesv! Looking forward to this. I'm usually on nixos-unstable so cabal would mostly do - atleast for my usecase.


We'd need a way to import our custom designed animated icons into flutter

Use case
The only way to use AnimatedIcons on flutter is to use the pre-compiled ones provided with the framework.
https://shapeshifter.design is a tool made for animating icons and create beautiful results as shown in the material guidelines:
https://material.io/design/iconography/animated-icons.html#transitions
Ironically enough, most of the transitions shown in the guidelines are not even provided among the AnimatedIcons presets.
The AnimatedIcon widget can only use AnimatedIconData objects as provided by the few constants inside the AnimatedIcons class.
If we design some animated icons ourselves, there's no way of using them within the flutter framework through the AnimatedIcon widget.
Proposal
As I understand it, the original animated icons provided by the flutter team are converted as pure dart files through this "vitool" tool:
https://github.com/flutter/flutter/tree/master/dev/tools/vitool
But it seems to be intended for private use and don't support all SVG commands, so it was used for the few constants provided by Flutter's material library but it doesn't aim to let any developer bring their custom animated icons to their flutter apps.
I think we would greatly benefit from a way to import our own custom designs into flutter, just like the FlutterIcon website (https://www.fluttericon.com) can grab our static SVG files, and compile them into a font file and a dart file file we can use to import our custom icons as a flutter IconData object.
A tool that is able of grabbing animated vector drawables (or an equivalent kind of file format) and convert them to dart files we can import in our flutter projects and use through the AnimatedIcon widget, would make for way nicer applications.
EDIT: I understand that there might be performance implications in using any svg as source, and I think I understand that the vitool tool I was talking about earlier offers limited support because of that?
Anyway, an user friendly implementation that could import even just a subset of svg animations (like in its current state) and convert them into usable dart files for any dev to import and use in their flutter apps, would be more than enough.

@pedromassangocode duplicate #19404 ?

I think this is a duplicate of https://github.com/flutter/flutter/issues/19404.
@MasiaVittorio (and anyone interested in this) please follow up on that issue, I'm closing the current one as a duplicate.
If you disagree, please write in the comments and I will reopen it.
Thank you
Thanks @MrBirb

You're right, @pedromassangocode sorry about that.
I will elaborate on the topic on the original issue.


[Bug]: when config.yaml is stored in a kubernetes secret certain values are ignored

Preflight Checklist

[X] I could not find a solution in the documentation, the existing issues or discussions
[X] I have joined the ZITADEL chat

Version
7.6.1
App version
2.45
Describe the problem caused by this bug
Seems that certain values such as "FirstInstance" are ignored when they need to be picked up from a kubernets secret.
I tend to exclude any running condition as the value "host" for the postgres database is picked up correctly.
This is my secret deployed through External Secret Operator
apiVersion: external-secrets.io/v1beta1
kind: ExternalSecret
metadata:
  annotations:
    argocd.argoproj.io/hook: PreSync
  creationTimestamp: '2024-02-17T11:21:57Z'
  generation: 1
  labels:
    app.kubernetes.io/instance: zitadel
  name: zitadel-config-secrets
  namespace: zitadel
spec:
  data:
    - remoteRef:
        conversionStrategy: Default
        decodingStrategy: None
        key: zitadel/zitadel-credentials
        metadataPolicy: None
        property: username
      secretKey: user
    - remoteRef:
        conversionStrategy: Default
        decodingStrategy: None
        key: zitadel/zitadel-credentials
        metadataPolicy: None
        property: password
      secretKey: password
  refreshInterval: 1h
  secretStoreRef:
    kind: SecretStore
    name: zitadel-vault
  target:
    creationPolicy: Owner
    deletionPolicy: Retain
    name: config-secrets
    template:
      data:
        config.yaml: |
          Database:
            Postgres:
              Host: "{{ `{{ .host }}` }}"

          Machine:
            Identification:
              Hostname:
                Enabled: true
              Webhook:
                Enabled: false
          FirstInstance:
            InstanceName: ZITADEL
            DefaultLanguage: en
            Org:
              Name: Org
              Human:
                UserName: "{{ `{{ .user }}` }}"
                FirstName: Name
                LastName: Surname
                NickName: nickname
                DisplayName: name surname
                Email:
                  Address<EMAIL_ADDRESS>                  Verified: true
                PreferredLanguage: en
                Password: "{{ `{{ .password }}` }}"
                PasswordChangeRequired: false

          CorrectCreationDate:
            FailAfter: 5m

          AddEventCreatedAt:
            BulkAmount: 100
      engineVersion: v2
      mergePolicy: Replace
status:
  binding:
    name: config-secrets
  conditions:
    - lastTransitionTime: '2024-02-17T11:21:59Z'
      message: Secret was synced
      reason: SecretSynced
      status: 'True'
      type: Ready
  refreshTime: '2024-02-17T11:21:58Z'
  syncedResourceVersion: 1-d88088a664abfc0f705ff670bb528ddb

this is my chart values.yaml file (adding only the relevant chunk)
zitadel:
  # The ZITADEL config under configmapConfig is written to a Kubernetes ConfigMap
  # See all defaults here:
  # https://github.com/zitadel/zitadel/blob/main/cmd/defaults.yaml
  configmapConfig:
    ExternalDomain: zitadel.mydomain.com

    TLS:
      Enabled: false

    ExternalSecure: true
    ExternalPort: 443
    Database:
      Postgres:
        Port: 5432
        Database: zitadel
        MaxOpenConns: 20
        MaxIdleConns: 10
        MaxConnLifetime: 30m
        MaxConnIdleTime: 5m
        User:
          Username: zitadel
          SSL:
            Mode: verify-full
        Admin:
          Username: postgres
          SSL:
            Mode: verify-full

  # The ZITADEL config under secretConfig is written to a Kubernetes Secret
  # See all defaults here:
  # https://github.com/zitadel/zitadel/blob/main/cmd/defaults.yaml
  secretConfig:

  # Annotations set on secretConfig secret
  secretConfigAnnotations:
    helm.sh/hook: pre-install,pre-upgrade
    helm.sh/hook-delete-policy: before-hook-creation
    helm.sh/hook-weight: "0"

  # Reference the name of a secret that contains ZITADEL configuration.
  configSecretName: config-secrets
  # The key under which the ZITADEL configuration is located in the secret.
  configSecretKey: config.yaml

Looking in the DB only the zitadel-admin user is created while there should be another user created with the FIrstInstance values provided in the secret

As you can also see the different timestamp values between the secret synchronisation and the user creation.
To reproduce
Use this example chart from https://github.com/zitadel/zitadel-charts/tree/main/examples/5-referenced-secrets
and then add to the referenced secret this:
FirstInstance:
  InstanceName:
  DefaultLanguage: en
  Org:
    Name: ZITADEL
    Human:
      UserName: my-personal-username
      Email:
        Address: emailaddress
        Verified: false
      Password: password

tested both with ArgoCD deployment and HELM cli from local
Logs
No response
Expected behavior
The user from FIrstInstance being created correctly
Relevant Configuration
Configuration is taken from here https://github.com/zitadel/zitadel/blob/main/cmd/defaults.yaml
Additional Context
K8s version: rke2 1.27.10
ArgocCD: 2.10.6

Any update on this?

I haven not had time to look at it, but I am sure somebody will soon.


Health check port

Image Setup Details

Image Tag: v1.6.0
Docker Host OS: Amazon Linux

Description of Issue
AWS NLBs used with ECS require IP-based target groups. These groups require that health checks must be enabled. The only type of health check available is TCP. The only port I can currently run these against is the RCON port, but I don't want to expose that to the public.
TCP checks run every 30 seconds and the max count that can be specified is 10 so a service should be added that can get into a healthy state in less than 5m.

Something like this: https://github.com/thmhoag/arkserver/pull/31

Something like this: https://github.com/thmhoag/arkserver/pull/31


Invalid type expression for shorthand array [] of object declared with Closure Compiler's syntax

I found out that the JSDoc type {{attr1: String, attr2: Number}[]} is not supported and throws the error : Invalid type expression "{attr1: String, attr2: Number}[]": Expected "!", "=", "?", "|" or end of input but "[" found.
But the following expression is supported : {Array.<{attr1: String, attr2: Number}>}.
Is that expected ? Is the shorthand [] only made to be used with primitive types or already defined typedefs ?

The [] shorthand dates back to before Closure Compiler type expressions. As you discovered, it's not really meant to be mixed with Closure Compiler's more complex syntax. In this case, {Array.<{attr1: String, attr2: Number}>} is the right choice.


[Task]: Document Jinja templatization for yaml

What needs to happen?
This is mentioned nowhere in https://beam.apache.org/documentation/sdks/yaml/ or our other yaml docs.
Issue Priority
Priority: 2 (default / most normal work should be filed as P2)
Issue Components

[ ] Component: Python SDK
[ ] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[ ] Component: IO connector
[X] Component: Beam YAML
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[X] Component: Website
[ ] Component: Infrastructure
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

@Polber

@robertwb @Polber can I take this issue ?

@robertwb @Polber can I take this issue ?

@mravi Feel free to take this on! Thanks

.take-issue

Sorry, @mravi , I just now saw that you had signed up to do this. (I started writing the docs when I realized there was no place to document the new datetime availability I had just added.)

thanks for the heads-up @robertwb !  please feel free to take the issue


Support a remote specific files.dialog.defaultPath setting

          As the message tries to explain, this setting in your local user-level settings.json will have no effect on the remote WSL workspace you currently have open. You need to set it at the remote workspace level. The Settings Editor tabs can help you do this.

Also, please edit the title of this issue so it summaries your new problem instead of just repeating the comment from @alexr00 in your original issue.
Originally posted by @gjsjohnmurray in https://github.com/microsoft/vscode/issues/213345#issuecomment-2128577946
Sorry, I opened issue in 3rd time :-) you right that "this setting in your local user-level settings.json will have no effect on the remote WSL workspace you currently have open", and as I understand, this parameter worked only for local, and not for WSL, perhaps there is an alternative parameter “Files.dialog.default Path” for WSL?

This feature request is now a candidate for our backlog. The community has 60 days to upvote the issue. If it receives 20 upvotes we will move it to our backlog. If not, we will close it. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!

This feature request has not yet received the 20 community upvotes it takes to make to our backlog. 10 days to go. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!


Info page redesign

What was the feature/problem?
https://github.com/homedepot/infinite-wish-board/issues/114
How does this PR address the above feature/problem?
added new background and redesigned the page
Check lists (check x in [ ] of list items)

[x] Test passed
[x] Coding style (indentation, etc)

Additional Comments (if any)
Added in the header as well, I guess the new logos are being updated as part of another story. So, I didn't update any logos.

Codecov Report

Merging #122 into master will not change coverage.
The diff coverage is 94.11%.

@@           Coverage Diff           @@
##           master     #122   +/-   ##
=======================================
  Coverage   95.39%   95.39%
=======================================
  Files          28       28
  Lines         391      391
  Branches       37       37
=======================================
  Hits          373      373
  Misses         15       15
  Partials        3        3

Flag
Coverage Δ

#api
97.12% <ø> (ø)
:arrow_up:

#ui
94% <94.11%> (ø)
:arrow_up:

Impacted Files
Coverage Δ

ui/src/childinfo/ChildInfo.js
92.85% <94.11%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ec8be84...d08e6bc. Read the comment docs.


Setting SpeechServiceResponse_RequestSnr does not give SNR in detailed results json

Describe the bug
From the c++ sdk, I am setting RequestSNR but never receiving SNR values back.
To Reproduce
Steps to reproduce the behavior:

Create a SpeechConfig with the RequestSNR property:

        auto speechConfig = SpeechConfig::FromSubscription(key, region);
        speechConfig->SetSpeechRecognitionLanguage("en-US");
        speechConfig->SetOutputFormat(OutputFormat::Detailed);
        speechConfig->SetServiceProperty("SpeechServiceResponse_RequestSnr", TrueString, ServicePropertyChannel::UriQueryParameter);
        speechConfig->SetProperty(PropertyId::Speech_LogFilename, "c:\\junkyard\\speechlog.txt");

In either the Recognizing or Recognized signal from  SpeechRecognizer, print the response json results e.Result->Properties.GetProperty(PropertyId::SpeechServiceResponse_JsonResult);
I get great output of the fragment, offset, duration and some per word confidence scores, but no SNR value appears.

Expected behavior
Somehow I should be able to read the current SNR value for 'recognizing' and maybe an overall one for the finished "Recognized" text. The comment for this field may be misleading me? A boolean value specifying whether to include SNR (signal to noise ratio) in the response result. Added in version 1.18.0
Version of the Cognitive Services Speech SDK
v1.21.0
Platform, Operating System, and Programming Language

OS: Windows 10, also reproduces on Ubuntu linux
Hardware - x64
Programming language: C++
Browser: N/A

Additional context
speechlog.txt
Cheers
!

Hi dubajj, I am closing this issue as internal implementation is completed and will be released with 1.23.0

thank you!!


[SPARK-8038][SQL][PySpark] Fix when function of PySpark SQL Column definition

The chaining of when functions was broken in PySpark SQL.
This fix is only changing the Column.py file to fix the when function accordingly.
Regards,
Olivier.

Merged build triggered.

Merged build started.

Test build #33977 has started for   PR 6580 at commit 0d52b89.

Test build #33977 has finished for   PR 6580 at commit 0d52b89.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Build seems to have failed because of something else...

Mind adding a regression test?

Jenkins, retest this pleaas.e

Jenkins, retest this please.

Merged build triggered.

Merged build started.

Test build #33998 has started for   PR 6580 at commit 0d52b89.

Test build #33998 has finished for   PR 6580 at commit 0d52b89.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test build #869 has started for   PR 6580 at commit 0d52b89.

Test build #869 has finished for   PR 6580 at commit 0d52b89.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Thanks for working on this, I'd create another PR #6590 based on yours, also find another bug in otherwise, adding tests for them.


Open directories in File Explorer when it's already open

Description
Files appears to crash (closes and reopens) when File Explorer is opened.
Thank you for your continued support of Files
Steps To Reproduce

Open Files
Enable "Set Files as the default file manager" in Settings
Leaving Files opened, also open a File Explorer window
Files then crashes and relaunches

Expected behavior
Files should not close and reopen (crash) when File Explorer is opened.
Files Version
Version: <IP_ADDRESS> OS Version: 10.0.22000.376
Windows Version
Windows 11 22000.376
Relevant Assets/Logs

This is the intended behavior, you might notice the same thing when you open Control Panel. The reason this happens is that the registry keys we change to set Files as the default prevents users from opening File Explorer. To accommodate situations where the user wants to open explorer, we redirect back to File Explorer and close Files.

I completely understand what you're saying, but in that case shouldn't Files stay closed? It doesn't re-open previously open tabs/windows.

@Gryzle Files needs to open long enough to detect that the user was trying to open Explorer and to handle the logic.

@gave92 is it posible to do something similar to what you did with Control Panel?

@Gryzle how do you manage to open Files Explorer when Files is set as default? Where do you open in from?

You can open it from the search box

Typing "explorer.exe" opens a new tab in Files for me

Are you pressing enter or are you clicking on the search result?

Tried both with the same result (Files opens)

Tried both with the same result (Files opens). Do you see something different then? And you can reproduce this issue? Note: I've only tried Debug version.

I can reproduce on Windows 11, it's the same issue we had with control panel and ideally we can do a similar fix so that people can still use File Explorer.

This requires switching to separate Win32 launcher.

@gave92 is this possible to implement now that we use a separate launcher?


Update charsheet_3-5.html

Changed all camps with {value="class"} to {value="1"}, this can make the macros work with a binary answer to classskill checks.
Stopped doing changes on skillcheck macros at the diplomacy skill (line 972), must kepp it on until last skill.

I'm not comfortable merging in changes to only part of the sheet. Also, I'm not sure about your interpretation of the rules. You should reach out to the sheet's origin author and compare notes.


Improve CI speed

CI takes about 20 minutes to run, it be nice to cut this down back to 10-15 minutes.
The slowest part seems to be downloading NVIDIA libraries, which are listed here:

https://github.com/CesiumGS/cesium-omniverse/blob/main/extern/nvidia/deps/kit-sdk.packman.xml
https://github.com/CesiumGS/cesium-omniverse/blob/main/extern/nvidia/deps/target-deps.packman.xml

We could do some things to improve that like not downloading kit-sdk-debug in CI builds. Or we could cache the download with GitHub Actions (assuming we can download it faster from GitHub's servers than Nvidia's servers).

After https://github.com/CesiumGS/cesium-omniverse/pull/543, CI now finishes in 10-12 minutes. :+1:


fix: MD038/no-space-in-code

Spaces inside code span elements

@lomayor @dansimp @manikadhiman @msfttracyp @greg-lindsay @dulcemontemayor @levinec
Please review and merge this PR that introduces minor whitespace improvements.
Names of multiple authors have been referenced as multiple documents within the PR are owned by multiple authors.
Thanks.