Could not load file or assembly 'Cesium.Runtime' in tests

Occasionally Codegen tests in Visual Studio (at least where I work) fails with following exception
System.IO.FileNotFoundException : Could not load file or assembly 'Cesium.Runtime, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.

How often does it happen? What do you do at that moment? Do you start from clean bin directory?

It’s happens pretty consistently. Never touch artifacts or bin formers. Just add new tests and run them from. Editor.

Visual studio was not even closed, same editor session

It is very strange then, where could the files go and why :(

I add <AccelerateBuildsInVisualStudio>false</AccelerateBuildsInVisualStudio> and issue is still persists.

I had the same issue in Rider. After updating on 2024.3 the problem disappeared.

Can confirm I have just reproduced the same problem in Rider 243.23349. So, it is not VS-specific at all.

The problem was solved by dotnet build.
Some interesting info I got while running that:
PowerShell 7.4.6
Loading personal and system profiles took 1097ms.
G:\Projects\Cesium git:[refactor/718.small-fixes]
dotnet build -bl

Restore complete (2.3s)
  Cesium.Solution.Metadata succeeded (0.6s) → artifacts\bin\Cesium.Solution.Metadata\debug\Cesium.Solution.Metadata.dll
  Cesium.Templates.CSharp succeeded (0.7s) → artifacts\bin\Cesium.Templates.CSharp\debug\Cesium.Templates.CSharp.dll
  Cesium.Core succeeded (1.5s) → artifacts\bin\Cesium.Core\debug\Cesium.Core.dll
  Cesium.Runtime net6.0 succeeded with 1 warning(s) (0.9s) → artifacts\bin\Cesium.Runtime\debug_net6.0\Cesium.Runtime.dll
    G:\Projects\Cesium\Cesium.Runtime\StdIoFunctions.cs(732,13): warning CS0219: The variable 'bytesConsumed' is assigned but its value is never used
  Cesium.Runtime netstandard2.0 succeeded with 1 warning(s) (1.8s) → artifacts\bin\Cesium.Runtime\debug_netstandard2.0\Cesium.Runtime.dll
    G:\Projects\Cesium\Cesium.Runtime\StdIoFunctions.cs(732,13): warning CS0219: The variable 'bytesConsumed' is assigned but its value is never used
  Cesium.Runtime.Tests net48 succeeded (0.6s) → artifacts\bin\Cesium.Runtime.Tests\debug_net48\Cesium.Runtime.Tests.dll
  Cesium.Sdk succeeded (1.8s) → artifacts\bin\Cesium.Sdk\debug\Cesium.Sdk.dll
  Cesium.Ast succeeded with 2 warning(s) (3.0s) → artifacts\bin\Cesium.Ast\debug\Cesium.Ast.dll
    C:\Program Files\dotnet\sdk\9.0.100\Sdks\NuGet.Build.Tasks.Pack\build\NuGet.Build.Tasks.Pack.targets(221,5): warning NU5104: A stable release of a package should not have a prerelease dependency. Either modify the version spec of dependency "Yoakke.SynKit.C.Syntax [2024.12.4-18.22.20-nightly, )" or update the version field in the nuspec.
    C:\Program Files\dotnet\sdk\9.0.100\Sdks\NuGet.Build.Tasks.Pack\build\NuGet.Build.Tasks.Pack.targets(221,5): warning NU5104: A stable release of a package should not have a prerelease dependency. Either modify the version spec of dependency "Yoakke.SynKit.Lexer [2024.12.4-18.22.20-nightly, )" or update the version field in the nuspec.
  Cesium.Runtime.Tests net8.0 succeeded (1.9s) → artifacts\bin\Cesium.Runtime.Tests\debug_net8.0\Cesium.Runtime.Tests.dll
  Cesium.Preprocessor succeeded (3.2s) → artifacts\bin\Cesium.Preprocessor\debug\Cesium.Preprocessor.dll
  Cesium.Parser succeeded (2.8s) → artifacts\bin\Cesium.Parser\debug\Cesium.Parser.dll
  Cesium.CodeGen succeeded with 2 warning(s) (0.8s) → artifacts\bin\Cesium.CodeGen\debug\Cesium.CodeGen.dll
    G:\Projects\Cesium\Cesium.CodeGen\Ir\Expressions\Constants\IntegerConstant.cs(59,14): warning CS0219: The variable 'i64Parse' is assigned but its value is never used
    G:\Projects\Cesium\Cesium.CodeGen\Ir\Types\StructType.cs(15,28): warning CS0169: The field 'StructType.AnonType' is never used
  Cesium.TestFramework succeeded (0.7s) → artifacts\bin\Cesium.TestFramework\debug\Cesium.TestFramework.dll
  Cesium.Compiler succeeded with 1 warning(s) (1.5s) → artifacts\bin\Cesium.Compiler\debug\Cesium.Compiler.dll
    G:\Projects\Cesium\Cesium.Compiler\IndentedTextWriter.cs(357,26): warning CS3021: 'IndentedTextWriter.WriteLine(uint)' does not need a CLSCompliant attribute because the assembly does not have a CLSCompliant attribute
  Cesium.Sdk.Tests succeeded (0.8s) → artifacts\bin\Cesium.Sdk.Tests\debug\Cesium.Sdk.Tests.dll
  Cesium.Parser.Tests succeeded (0.8s) → artifacts\bin\Cesium.Parser.Tests\debug\Cesium.Parser.Tests.dll
  Cesium.TestFramework.Tests succeeded (1.5s) → artifacts\bin\Cesium.TestFramework.Tests\debug\Cesium.TestFramework.Tests.dll
  Cesium.IntegrationTests succeeded (1.6s) → artifacts\bin\Cesium.IntegrationTests\debug\Cesium.IntegrationTests.dll
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesium.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 1 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
  Cesium.Compiler.Tests succeeded with 1 warning(s) (1.3s) → artifacts\bin\Cesium.Compiler.Tests\debug\Cesium.Compiler.Tests.dll
    G:\Projects\Cesium\Cesium.Compiler.Tests\CommandLineParsingTest.cs(127,13): warning xUnit2029: Do not use Assert.Empty to check if a value does not exist in a collection. Use Assert.DoesNotContain instead. (https://xunit.net/xunit.analyzers/rules/xUnit2029)
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 1 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 1 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 1 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 2 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 2 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 2 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 2 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 3 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 3 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 3 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 3 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 4 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 4 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 4 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 4 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 5 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 5 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 5 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 5 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 6 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 6 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 6 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 6 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 7 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 7 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 7 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 7 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 8 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 8 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 8 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 8 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 9 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 9 in 1000ms. The process c
annot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 9 in 1000ms. The
process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 9 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning retry
 10 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 10 in 1000ms. The process
cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 10 in 1000ms. The
 process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\Cesi
um.Solution.Metadata\debug\Cesium.Solution.Metadata.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll". Beg
inning retry 10 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Solution.Metadata.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
  Cesium.CodeGen.Tests failed with 8 error(s) and 40 warning(s) (12.7s)
    C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\
Cesium.TestFramework\debug\Cesium.TestFramework.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll". Beginning r
etry 1 in 1000ms. The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.TestFramework.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
    C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\
Cesium.Core\debug\Cesium.Core.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll". Beginning retry 1 in 1000ms. The proce
ss cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.Core.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"
    C:\Program Files\dotnet\sdk\9.0.100\Microsoft.Common.CurrentVersion.targets(5035,5): warning MSB3026: Could not copy "G:\Projects\Cesium\artifacts\bin\
Cesium.CodeGen\debug\Cesium.CodeGen.dll" to "G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll". Beginning retry 1 in 1000ms.
The process cannot access the file 'G:\Projects\Cesium\artifacts\bin\Cesium.CodeGen.Tests\debug\Cesium.CodeGen.dll' because it is being used by another process. The file is locked by: ".NET Host (34276)"

It looks like our assemblies are locked by something on disk.
I suspect that there's a msbuild leak from the build host we create during the tests.


Support for Compose Multiplatform

It'll be really nice to have these in compose multiplatform as dialog is now supported in compose common code v1.5.0-beta01: https://github.com/JetBrains/compose-multiplatform/releases/tag/v1.5.0-beta01

Any consideration to support compose multiplatform? For example ios.


n_cpus flag not respecting max cpus

We have found that on our linux cluster the singularity image (pulled from docker) of mriqc does not respect the maximum number of CPUs passed with the flag n_cpus. Mriqc takes the maximum number of CPUs in an individual compute node regardless of the value of this flag. Any suggestions on how to handle this?

We also have observed this using singularity on our cluster

So how do you deal with that @mattcieslak ? Something we observed is that the "high" hyperthreading occurs only in about 10% of a typical mriqc run. So I don't know if it makes sense to just request a large number of cpus within a run. Still, it would be useful to have an idea of why the n_cpus flag does not work. Or perhaps it is intended to work in a different way?

Seems to be a bug. From a quick glance, it's not clear why it's not being set correctly.

I think that I'm running into this same issue (running 21.0.0rc2 with Singularity). Looks like #961 will solve it. Until that's merged, perhaps a workaround could be to rely on --use-plugin. e.g.,
mriqc bids-root/ output-folder/ participant --use-plugin plugin.yml

where plugin.yml contains
plugin : "MultiProc"
plugin_args:
 n_procs: 6

(note spaces) Running this at a local cluster, it seems like mriqc ends up restricted to the specified number of cores rather than the cores on the compute node, based on seeing
220116-21:27:07,534 nipype.workflow DEBUG:
[MultiProc] Starting (n_procs=6, [...]

in a run with debug-level verbosity.

Thanks for the tip @psadil. #961 has been merged and this issue can be closed.


Fix typos and improve grammar in resources.mdx, validator-node.mdx, and validator-node.md

Description
This pull request includes fixes and updates for three files: resources.mdx, validator-node.mdx, and validator-node.md. Below are the changes made:

resources.mdx:

Fixed grammar: changed "their own storage space" to "its own storage space" for consistency with singular subject agreement.
Improved clarity and consistency in descriptions of resource storage and API references.

validator-node.mdx:

Corrected grammar: updated "has been setup" to "has been set up" for proper verb usage.

validator-node.md:

Fixed a typo: corrected "Valdiator" to "Validator" in the Chinese title.

These changes ensure improved accuracy and clarity in documentation.

@gregnazario @vusirikala Hello! Can someone take a look at this pull request and merge it if everything looks good? Let me know if any adjustments are needed. Appreciate it!


[Issue]: GPU Crashes During LSTM Training on Radeon 7900 XTX with ROCm 6.0.2

Problem Description
Environment
GPU: Radeon 7900 XTX
CPU: AMD Ryzen 5 5500
OS: Ubuntu 22.04.4 LTS
Kernel Version: 6.5.0-26-generic
ROCm Version: <IP_ADDRESS>002-115~22.04
Python Version: 3.10.12
PyTorch Version: 2.1.2

Issue Description
When training LSTMs with text categorization using my implementation here, the GPU crashes within the first few epochs as I increase dimensions. Sometimes I see overheating, sometimes the crashes happen at low reported junction temperatures. Attempts to capture detailed logs using AMD_LOG_LEVEL and HSAKMT_DEBUG_LEVEL either fail to produce sufficient logs to pinpoint the issue or throttled the GPU to about a third of its speed making it difficult to trigger the issue.
Attempted Solutions and Debugging
Setting AMD_LOG_LEVEL=4 and HSAKMT_DEBUG_LEVEL=7 to capture debug information, which throttled the GPU and prevented crashes but did not identify the issue.

Error Messages and Logs
I captured logs with AMD_LOG_LEVEL=2 and HSAKMT_DEBUG_LEVEL=4, which generated a 64KB file prior to a crash. The logs contained numerous entries like:
:1:hip_code_object.cpp :616 :<PHONE_NUMBER>3 us: [pid:144693 tid:0x7f15caa3d000] Cannot find the function: Cijk_Alik_Bljk_SB_MT16x16x8_SN_1LDSB0_APM1_ABV0_ACED0_AF0EM1_AF1EM1_AMAS0_ASE_ASGT_ASLT_ASAE01_ASCE01_ASEM1_AAC0_BL1_BS1_DTLA0_DTLB0_DTVA0_DTVB0_DVO0_ETSP_EPS1_FSSC10_FL0_GRPM1_GRVW1_GSU1_GSUAMB_GLS0_ISA1100_IU1_K1_KLA_LBSPP0_LPA0_LPB0_LDL1_LRVW1_LWPMn1_LDW0_FMA_MIAV0_MDA2_MO40_MMFGLC_NTA0_NTB0_NTC0_NTD0_NEPBS0_NLCA1_NLCB1_ONLL1_OPLV0_PK0_PAP0_PGR1_PLR1_SIA1_SS0_SU32_SUM3_SUS128_SCIUI1_SPO0_SRVW0_SSO0_SVW4_SNLL0_TSGRA0_TSGRB0_TT2_2_TLDS0_UMLDSA0_UMLDSB0_USFGROn1_VAW1_VSn1_VW1_WSGRA0_WSGRB0_WS32_WG8_8_1_WGM4

:1:hip_module.cpp :83 :<PHONE_NUMBER>0 us: [pid:144693 tid:0x7f15caa3d000] Cannot find the function: Cijk_Alik_Bljk_SB_MT16x16x8_SN_1LDSB0_APM1_ABV0_ACED0_AF0EM1_AF1EM1_AMAS0_ASE_ASGT_ASLT_ASAE01_ASCE01_ASEM1_AAC0_BL1_BS1_DTLA0_DTLB0_DTVA0_DTVB0_DVO0_ETSP_EPS1_FSSC10_FL0_GRPM1_GRVW1_GSU1_GSUAMB_GLS0_ISA1100_IU1_K1_KLA_LBSPP0_LPA0_LPB0_LDL1_LRVW1_LWPMn1_LDW0_FMA_MIAV0_MDA2_MO40_MMFGLC_NTA0_NTB0_NTC0_NTD0_NEPBS0_NLCA1_NLCB1_ONLL1_OPLV0_PK0_PAP0_PGR1_PLR1_SIA1_SS0_SU32_SUM3_SUS128_SCIUI1_SPO0_SRVW0_SSO0_SVW4_SNLL0_TSGRA0_TSGRB0_TT2_2_TLDS0_UMLDSA0_UMLDSB0_USFGROn1_VAW1_VSn1_VW1_WSGRA0_WSGRB0_WS32_WG8_8_1_WGM4 for module: 0x1391e270

Welcome any insights on what might be happening here, or suggestions for further debugging steps, or relations to any other known issues.
Operating System
Ubuntu 22.04.4 LTS
CPU
AMD Ryzen 5 5500
GPU
AMD Radeon RX 7900 XTX
ROCm Version
ROCm 6.0.0
ROCm Component
No response
Steps to Reproduce
This is straightforward to consistently reproduce using the research project I'm working on, but I have not boiled this down to a minimal program that triggers these.

Clone the repository:
git clone https://github.com/brownbat/cipher_classifier_factory.git
Install required packages:
pip install -r requirements.txt
Run the training script with settings that trigger crash:
python3 researcher.py --num_samples 1000000 --num_layers 256 --batch_size 256 --embedding_dim 512 --hidden_dim 512

Lower intensity settings also triggered crashes, the above are probably overkill, but more reliably crash more quickly, in the first epoch. I also received crashes with:
--num_samples 50000 --num_layers 64 --batch_size 64 --embedding_dim 32 --hidden_dim 256
But it might take 4-5 epochs with those.
You can instead set various dimensions and hyperparameters by changing the defaults stored at the top of researcher.py as "default_params" -- that would let you then just run python3 researcher.py without arguments.
(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support
=====================
HSA System Attributes
=====================
Runtime Version:         1.1
System Timestamp Freq.:  1000.000000MHz
Sig. Max Wait Duration:<PHONE_NUMBER>3709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count)
Machine Model:           LARGE
System Endianness:       LITTLE
Mwaitx:                  DISABLED
DMAbuf Support:          YES

==========
HSA Agents
==========
*******
Agent 1
*******
  Name:                    AMD Ryzen 5 5500
  Uuid:                    CPU-XX
  Marketing Name:          AMD Ryzen 5 5500
  Vendor Name:             CPU
  Feature:                 None specified
  Profile:                 FULL_PROFILE
  Float Round Mode:        NEAR
  Max Queue Number:        0(0x0)
  Queue Min Size:          0(0x0)
  Queue Max Size:          0(0x0)
  Queue Type:              MULTI
  Node:                    0
  Device Type:             CPU
  Cache Info:
    L1:                      32768(0x8000) KB
  Chip ID:                 0(0x0)
  ASIC Revision:           0(0x0)
  Cacheline Size:          64(0x40)
  Max Clock Freq. (MHz):   4267
  BDFID:                   0
  Internal Node ID:        0
  Compute Unit:            12
  SIMDs per CU:            0
  Shader Engines:          0
  Shader Arrs. per Eng.:   0
  WatchPts on Addr. Ranges:1
  Features:                None
  Pool Info:
    Pool 1
      Segment:                 GLOBAL; FLAGS: FINE GRAINED
      Size:                    65619552(0x3e94660) KB
      Allocatable:             TRUE
      Alloc Granule:           4KB
      Alloc Alignment:         4KB
      Accessible by all:       TRUE
    Pool 2
      Segment:                 GLOBAL; FLAGS: KERNARG, FINE GRAINED
      Size:                    65619552(0x3e94660) KB
      Allocatable:             TRUE
      Alloc Granule:           4KB
      Alloc Alignment:         4KB
      Accessible by all:       TRUE
    Pool 3
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED
      Size:                    65619552(0x3e94660) KB
      Allocatable:             TRUE
      Alloc Granule:           4KB
      Alloc Alignment:         4KB
      Accessible by all:       TRUE
  ISA Info:
*******
Agent 2
*******
  Name:                    gfx1100
  Uuid:                    GPU-af80fc06fd8c76ab
  Marketing Name:          Radeon RX 7900 XTX
  Vendor Name:             AMD
  Feature:                 KERNEL_DISPATCH
  Profile:                 BASE_PROFILE
  Float Round Mode:        NEAR
  Max Queue Number:        128(0x80)
  Queue Min Size:          64(0x40)
  Queue Max Size:          131072(0x20000)
  Queue Type:              MULTI
  Node:                    1
  Device Type:             GPU
  Cache Info:
    L1:                      32(0x20) KB
    L2:                      6144(0x1800) KB
    L3:                      98304(0x18000) KB
  Chip ID:                 29772(0x744c)
  ASIC Revision:           0(0x0)
  Cacheline Size:          64(0x40)
  Max Clock Freq. (MHz):   2482
  BDFID:                   768
  Internal Node ID:        1
  Compute Unit:            96
  SIMDs per CU:            2
  Shader Engines:          6
  Shader Arrs. per Eng.:   2
  WatchPts on Addr. Ranges:4
  Coherent Host Access:    FALSE
  Features:                KERNEL_DISPATCH
  Fast F16 Operation:      TRUE
  Wavefront Size:          32(0x20)
  Workgroup Max Size:      1024(0x400)
  Workgroup Max Size per Dimension:
    x                        1024(0x400)
    y                        1024(0x400)
    z                        1024(0x400)
  Max Waves Per CU:        32(0x20)
  Max Work-item Per CU:    1024(0x400)
  Grid Max Size:<PHONE_NUMBER>(0xffffffff)
  Grid Max Size per Dimension:
    x<PHONE_NUMBER>(0xffffffff)
    y<PHONE_NUMBER>(0xffffffff)
    z<PHONE_NUMBER>(0xffffffff)
  Max fbarriers/Workgrp:   32
  Packet Processor uCode:: 550
  SDMA engine uCode::      19
  IOMMU Support::          None
  Pool Info:
    Pool 1
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED
      Size:                    25149440(0x17fc000) KB
      Allocatable:             TRUE
      Alloc Granule:           4KB
      Alloc Alignment:         4KB
      Accessible by all:       FALSE
    Pool 2
      Segment:                 GLOBAL; FLAGS: EXTENDED FINE GRAINED
      Size:                    25149440(0x17fc000) KB
      Allocatable:             TRUE
      Alloc Granule:           4KB
      Alloc Alignment:         4KB
      Accessible by all:       FALSE
    Pool 3
      Segment:                 GROUP
      Size:                    64(0x40) KB
      Allocatable:             FALSE
      Alloc Granule:           0KB
      Alloc Alignment:         0KB
      Accessible by all:       FALSE
  ISA Info:
    ISA 1
      Name:                    amdgcn-amd-amdhsa--gfx1100
      Machine Models:          HSA_MACHINE_MODEL_LARGE
      Profiles:                HSA_PROFILE_BASE
      Default Rounding Mode:   NEAR
      Default Rounding Mode:   NEAR
      Fast f16:                TRUE
      Workgroup Max Size:      1024(0x400)
      Workgroup Max Size per Dimension:
        x                        1024(0x400)
        y                        1024(0x400)
        z                        1024(0x400)
      Grid Max Size:<PHONE_NUMBER>(0xffffffff)
      Grid Max Size per Dimension:
        x<PHONE_NUMBER>(0xffffffff)
        y<PHONE_NUMBER>(0xffffffff)
        z<PHONE_NUMBER>(0xffffffff)
      FBarrier Max Size:       32
*** Done ***

Additional Information
No response

An internal ticket has been created for investigation.

Hi @brownbat, I've tried reproducing your example

python3 researcher.py --num_samples 1000000 --num_layers 256 --batch_size 256 --embedding_dim 512 --hidden_dim 512

with three configurations:

ROCm 5.7.3 + Torch 2.4 (Nightly Rocm 5.7 build)
ROCm 6.1.2 + Torch 2.4 (Nightly Rocm 5.7 build)
ROCm 6.1.2 + Torch 2.3.1 + (Stable Rocm 6.0 build)

And I'm able to run at least 2 epochs on all configurations without crashing before manually terminating the programs. I ran 4.5 epochs on config#1 as an extended test and was still unable to reproduce your crash, and I note that the GPU junction temperature never exceeds ~85C.
Example:

Additionally, I've installed Pytorch through python wheels on a baremetal machine and an RX7900XT (also gfx1100) per the most recent rocm documentation - https://rocm.docs.amd.com/projects/install-on-linux/en/develop/how-to/3rd-party/pytorch-install.html#using-a-wheels-package
If you're able to upload more of your crash logs, I may be able to provide further help.

Thanks for your help. I'll do a full rebuild soon and hopefully that will address the issue.


Pull only a known image in util_test TestMain - breaks nightly build

The Problem:
The nightly build failed last night:
2017/05/25 01:21:03 failed to pull test image API error (404): {"message":"manifest for drud/nginx-proxy:v0.4-16-g2ca92ae5-nightly.20170525011408 not found"}
This was a result of the TestMain in util_test.go trying to do a pre-emptive pull on an image it assumed would have been pushed (but for the nightly build is built but not pushed).
The Fix:
Pull an image that we know should exist on dockerhub. In this case drud/nginx-proxy:test-do-not-delete
The Test:
Automation Overview:

Related Issue Link(s):
Release/Deployment notes:

Updated to use busybox:1


How to use RSC devtools chrome extension?

Hi, i have downloaded extension, but never figured out how to use it. When i press on it it simply opens chrome marketplace page.

Ah found it in devtools tabs... like classic react devtools

@skorphil I have the same problem but dont see it in the devtools. Where exactly do you see it?


Installation fails

The installation (and probably uninstall) fails when managing folders for the test scripts (specifically when creating deleting the ./test/output folder)
The failure happens on the Windows platform, where '/' needs to be ''
This causes an Electron Fiddle which uses this module to hang indefinitely during installation.

Fixed in PR!6


Goofys errors out when source file removed during decompress

Wanted to get this captured ... will add more detail as I dig into debugging process.
We are observing that the goofys process exits (I think seg faults, but can't be sure at this point) under the following, otherwise reasonable conditions:

Place a large, gzipped file into a goofys mount
begin to gunzip the file to another file in the mount (gunzip -c file.gz > file.out)
While the gunzip is in progress, rm -f the source file (rm -f file.gz)

On goofys 0.0.18 this appears to cause the goofys process to exit abnormally. The expected behavior is that this woud be a safe operation, and that IO errrors would be passed on to the client process (gunzip) instead of causing goofys to exit.
I plan to run the latest release in debug mode to get detailed logs shortly.
I suggest that a test for this be added to the testing harness for goofys, since it appears that there is a failure code path that is not properly handled by the error handling.

This appears fixed in v0.19.0.


feat: add arn outputs for: igw, cgw, vgw, default vpc, acls

Description

Add ARN outputs for igw, cgw, vgw, default vpc, acls
Motivation and Context

Allows creating IAM policies to restrict certain actions for resources created by the module.
Breaking Changes

No
How Has This Been Tested?

Simple VPC example ran.

On a side note, i have a few more pending PRs to add ARNs to some other resources in the AWS provider (that are related to the module).
I'm thinking of when these go through, ill and an example on constructing a policy to deny altering/deleting the resources
created by the module (in the boundaries of what IAM actions there are to do this) to have better "security" savvy documentation/examples.

Thanks, guys for the review!
v2.47.0 has been just released.


Add PropTypes validations to make XO happy

This PR includes PropTypes validation so we can remove the XO's react/prop-types from the package.json file as described in the issue #730.
Note: Please do a careful review of this PR since I could made a mistake figuring out the prop types.

Awesome. Should we wrap them with if checks so they're not included in the production bundle?

@rauchg just to leave them out the bundle code? Because the PropTypes are only checked on development.

Yep. Less code in prod = better

Might require some webpack wizardry. I believe the constant is DEV ?

Instead of doing it by hand, I'd recommend oliviertassinari/babel-plugin-transform-react-remove-prop-types which does all that work for you.

That's exactly what I did @pcalves, thanks!

@pcalves very interesting! cc @bvaughn

I agree with @ekmartin that this is not the better way to handle the proptypes and is a pain to maintain. I don't like Flow either xD.
Good catch on the isRequired part.

// @thejameskyle

and no further development has been planned for the latter in part because of this.

@ekmartin PropTypes is not going to go away, but we do use Flow extensively for this purpose at Facebook
Flow is far more useful for validation as it catches way more and does so statically, meaning that you don't need to go searching for propType invalidations

So what about the XO's rule?
Any plans to make it disappear from XO @sindresorhus?
Or should we get rid of this, make the change to Flow and live with the rule exception?

PropTypes are better than nothing for those that don't use Flow, right?

@davegomez do you want to rebase this PR? 😄

Closing this, feel free to re-open when it's up to date and we shall merge it right away 🎉


Revert "[WIP - DO NOT MERGE] dev"

Reverts stanfordnmbl/opencap-api#1
API was down. Need to migrate prod database first, I think. @AlbertoCasasOrtiz, @antoinefalisse

I just migrated the database.


Migrate [prometheus operator] [kube-prometheus] to official stable chart

CoreOs moved prometheus operator charts development to official helm chart
https://github.com/coreos/prometheus-operator/tree/master/helm
https://github.com/helm/charts/tree/master/stable/prometheus-operator

With coreos now being discontinued, this should probably get prioritized.  I'm seeing this using your kube-prometheus helmfile.
...Unable to get an update from the "coreos-stable" chart repository (https://s3-eu-west-1.amazonaws.com/coreos-charts/stable/):
	Failed to fetch https://s3-eu-west-1.amazonaws.com/coreos-charts/stable/index.yaml : 403 Forbidden

Looks like they've already taken stuff down.


Can log_probs be torch.float16?

@HawkAaron
I'm trying to add the mixed precision of (apex)[https://github.com/NVIDIA/apex] into the training. But I found that the rnntloss need log_probs must be torch.float32. Can it be torch.float16?
I tried to comment [this line], there is an error:
File "/ssd4/exec/sqdong/environments/anaconda3/lib/python3.7/site-packages/warprnnt_pytorch-0.1-py3.7-linux-x86_64.egg/warprnnt_pytorch/__init__.py", line 100, in forward
    return self.loss(acts, labels, act_lens, label_lens, self.blank, self.reduction)
  File "/ssd4/exec/sqdong/environments/anaconda3/lib/python3.7/site-packages/warprnnt_pytorch-0.1-py3.7-linux-x86_64.egg/warprnnt_pytorch/__init__.py", line 40, in forward
    grads /= minibatch_size
  File "/ssd4/exec/sqdong/environments/anaconda3/lib/python3.7/site-packages/apex-0.1-py3.7.egg/apex/amp/wrap.py", line 53, in wrapper
RuntimeError: CUDA error: an illegal memory access was encountered

Is there some method to solve it?

@Marcovaldong
Since not familiar with float16, I can only give you a suggestion this time:
You may refer to pytorch cpp extension, and move the rnnt loss code into pytorch binding. And use AT_DISPATCH_FLOATING_TYPES to check datatype.

@HawkAaron  Thanks for your reply, I'll try it.

@Marcovaldong did you manage to do some progress with mixed-precision topic?

@marekrydlewski I am sorry that I didn't train transducer since the last month, so I didn't do some progress for mixed-precision topic.


Can't prepareRecordingAtPath on ios rn0.60.5 audio 4.3.0

Version
react-native-audio :  4.3.0
react-native : 0.60.5
react :  16.8.6
using react-native-sound ? Yes
System: ios
Expected behaviour :
const audioPath = AudioUtils.DocumentDirectoryPath + "/tempAudio.aac"
AudioRecorder.prepareRecordingAtPath(audioPath, {
SampleRate: 22050,
Channels: 1,
AudioQuality: "Low",
AudioEncoding: "aac",
})
l wan't record audio
Actual behaviour
When call prepareRecordingAtPath will Error
Steps to reproduce
l don't do any thing before call prepareRecordingAtPath function

l has resolve this. In ios , this function don't have return value.


Add new category: development browsers

Development browsers help designers and developers create websites faster, and offers a better way to test and validate designs. They're upcoming and I think they deserve their own category :) Full disclosure: I built Polypane.

😃
С уважением, Шикин Андрей
On May 28, 2019, 21:21 +0300, Kilian Valkhof<EMAIL_ADDRESS>wrote:

Development browsers help designers and developers create websites faster, and offers a better way to test and validate designs. They're upcoming and I think they deserve their own category :) Full disclosure: I built Polypane.
You can view, comment on, or merge this pull request online at:
https://github.com/LisaDziuba/Awesome-Design-Tools/pull/202
Commit Summary
• Add new category of development browsers
• capitalisation
• Add free designation to Firefox
File Changes
• M README.md (13)
Patch Links:
• https://github.com/LisaDziuba/Awesome-Design-Tools/pull/202.patch
• https://github.com/LisaDziuba/Awesome-Design-Tools/pull/202.diff
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

wow, it's great! Thank you soo much for adding a new section :)


Add structured patch support to gh-pages

It's the most common use case for diffs, so made sense to add one for  easily generating one.
The other change was debating whether to make it the default behaviour for the demo or not.

Thanks - great idea! I wanted to make a couple of minor stylistic tweaks and didn't have write access to the branch, so I modified the commit a bit and pushed https://github.com/kpdecker/jsdiff/commit/5de776689a7e9d2862fbdda1af7b6cd7adff787b.
(Hopefully I have properly/politely represented authorship information there; I have never had much cause to familiarise myself with the options Git & GitHub offer for indicating coauthorship when squashing multiple people's work into one commit. Let me know if I'm guilty of any kind of faux pas!)


WindowState won't work if window's size is set

Describe the bug
If I set the size (Width or Width) and the WindowState of a window before Show(), the WindowState will return to Normal after Show().
To Reproduce
Change the code of the SandBox to this:
using Avalonia;
using Avalonia.Controls.ApplicationLifetimes;
using Avalonia.Controls;
using Avalonia.Markup.Xaml;

namespace Sandbox
{
    public class App : Application
    {
        public override void Initialize()
        {
            AvaloniaXamlLoader.Load(this);
        }

        public override void OnFrameworkInitializationCompleted()
        {
            if (ApplicationLifetime is IClassicDesktopStyleApplicationLifetime desktopLifetime)
            {
                Window window = new Window();
                window.Width = 1000;
                window.WindowState = WindowState.Maximized;
                window.Show();
            }
        }
    }
}

Run the SandBox, the window will show in Normal state.
Expected behavior
The window should be maximized.
Desktop (please complete the following information):
Windows 10 19044
Avalonia 10.18 (I can't compile the latest version)
Additional context
If Width or Height are not set or set the WindowState after Show(), the WindowState  will take effect.

In the ShowCore method from src\Avalonia.Controls\Window.cs, it checks the desired size and resize the window without consider the WindowState. It will make the window return to nomal.
            var initialSize = new Size(
                double.IsNaN(Width) ? Math.Max(MinWidth, ClientSize.Width) : Width,
                double.IsNaN(Height) ? Math.Max(MinHeight, ClientSize.Height) : Height);

            if (initialSize != ClientSize)
            {
                PlatformImpl?.Resize(initialSize, PlatformResizeReason.Layout);
            }

I'm also encountering this issue on 0.10.18, but with MinWidth and MinHeight instead (which makes sense based on the code snippet from Window.cs). For the time being, I'm working around this by setting MinWidth and MinHeight in an event handler for the Opened event.
FWIW, it was working fine on 0.10.17 - I get the expected output where the window is maximized.


Federation request signing is easily broken by proxies

I recently came across this issue with synapse: https://github.com/matrix-org/synapse/issues/3294#issuecomment-462199951
It basically comes down to how reverse-proxies in front of synapse handle things. So far, I checked the spec which doesn't really specify whenever or things have to be url-encoded or not, but all example url-encode strings.
So far one could make assumptions on this, but HTTP explicitly states that URL encoded URLs, should be decoded before using them and make no difference.

Characters other
than those in the "reserved" set are equivalent to their
percent-encoded octets: the normal form is to not encode them (see
Sections 2.1 and 2.2 of [RFC3986]).
For example, the following three URIs are equivalent:
 http://example.com:80/~smith/home.html
 http://EXAMPLE.com/%7Esmith/home.html
 http://EXAMPLE.com:/%7esmith/home.html

https://tools.ietf.org/html/rfc7230#section-2.7.3
When we use HTTP as a standard, we should make sure we don't contradict it. Therefore we should fix the examples and implementations in this perspective.
For some cases, where things might contain special characters, that interfere with the HTTP standard like / we might want to explicitly disallow them in the spec. Because if we don't do this, it'll cause harm to the protocol in the long term perspective (as it already does with various WAF solutions in front of Synapse, when they canonicalize URLs).

I'm not sure there's much we can do to fix this considering our sigil for aliases is # and event IDs can have / in them.

I don't think that we do contradict the RFC here.  Is says that "Characters other than those in the "reserved" set are equivalant to their percent-encoded octets" (emphasis mine).  However, "/" and "#" are both in the reserved set, so the server does not have to treat "/" and %2F as equal.  "~" is not in the reserved set, so "~" and %7E are equivalent.

@uhoreg: The problem, I think, is that a proxy is within its right to switch between %-encoding and unencoded text, for unreserved characters. In other words, a reverse-proxy might switch %3A to : or vice-versa, which then breaks the Authorization on the header.
One solution to this would be for us to specify that all unreserved characters must be unencoded when the signature is made, or something - and for the receiving server to unencode any encoded reserved characters before it checks the signature.

I am currently running into this problem in Conduit. I think the only real solution for me is to do what richvdh hinted at and convert all unreserved characters to the percent-encoded version, because that seems to work in my tests


Feature request bigger text input

Hi! I have made the necessary changes regarding the issue, by adding a text area, since i don't know if you actually want a WYSIWYG editor.
The result is as follows:

It seems that the font and height needs to be dynamically changed, based on how many texts lines are there, please tell me if this is an acceptable solution to the feature request.

A WYSIWYG editor is defo a end goal however as a quick feature enhancement this looks perfect! Thanks

No problem! Happy to help!

Hi DimK10,
We are updating Stirling-PDF's license to MPL 2.0 (Mozilla Public License Version 2.0) to continue fostering our open-source commitment while introducing more flexible usage of the project.
What We Need From You:
In order to transition to the MPL 2.0 license, we need the explicit consent of all our contributors.

If you're comfortable relicensing your contributions for this specific PR under MPL 2.0, please respond with:
I, DimK10, grant permission to relicense my contributions from this PR to Stirling-PDF under the Mozilla Public License 2.0.
If you'd prefer to give blanket permission for all of your contributions to Stirling-PDF (be it through pull requests, commits, or any other form of contribution) rather than on a PR-by-PR basis, please respond with:
I, DimK10, grant permission to relicense all my contributions to Stirling-PDF under the Mozilla Public License 2.0.

What does this do and why?
As your old code was contributed under a different license it legally cannot move to a new license without your permission, and since we dont want to lose your code we wanted to reach out. Remember this project is remaining open-source!.
Deadline:
If we dont receive a response, or if you decline, unfortunately, we will have to remove your contributions from Stirling-PDF before the license change, which is scheduled  in coming months.
Thank You!
Your contributions are invaluable, and we hope to continue having them in Stirling-PDF under the new license. Feel free to ask if you have any questions or concerns about this change.
Best,
Frooodle
Stirling-PDF Maintainer


disable sign up

It's great that stringer now has a multi user system, but I would love to have the ability to disable sign up for new users on my private instance :)

@bitboxer I considered adding a single-user configuration, but it seemed to me like it was pretty low risk for somebody to find your instance and sign up without you providing them a link. Is there a particular concern I'm missing? I suppose there is an off chance of bots crawling the web and signing up with spam accounts.

I once had a thing running just for me that had an open sign up. Somehow google found it...no idea how, and then people started using it. I only noticed after I got a "disk full" email. Sadly it was too late. I could not log in to that machine any more because the disk was filled to the max. But in the OS Snapshot from a week earlier, I saw nearly a thousand users 😱.

That's a pretty compelling case! I'll look into it.

@bitboxer I've added a setting so you can enable or disable user signups at your whim. It should default to disabled.

Thanks!


Check installed BaGet version via web interface

The BaGet website interface doesn't seem to show the installed version of the software anywhere. This would be good to know in order to rule out any bugs we may encounter are because we're using an older release.

Thanks for the suggestion! This feature has been super useful for debugging issues on NuGet.org, so I should definitely add this to BaGet.


As a big-picture thinker I would like to see some simple summary statistics

In 'Scribes" I read:

182 people who have attributed natural history specimens to their peers, mentors, and role models

I woud like to read:

182 people who have attributed 999,999,999 natural history specimens to 888888 of their peers, mentors, and role models

In 'Datasets" I read:

22,491 datasets from GBIF

I would like to read:

22,491 datasets from GBIF, 7,000 touched by Bionomia, 6000 untouched

I'm not sure if "touched" is the word to use, I'm looking for those given any ORCiD id vs. those not.

This would help me find datasets with zero (are there such) ORCiD ids

I would like to see:

Each dataset is heatmapped to show the proportion of records that "Bionomia" identifiers

In 'Profiles I read on each card:

10 specimens claimed

I would like to read:

10 specimens claimed from 5 different datasets

In a new tab 'Summary' I would like to see:

Plots of of claims / day
Plots of new roles vs. total roles (unique people) added per day
Plots of datasets touched vs. total datasets  per day
Plots of scribes active vs. roles added per day
Perhaps these could be served, to start, as a summarizing JSON endpoint

Thanks, @mjy these are great suggestions. Some of these will be a bit tricky to do realtime for performance reasons as well for reasons of i18n. So, it's likely that the best bet is to compute them once a day.
Instead of "datasets", which I've become less and less enamoured with, I may be instead look at institutionCode – there's greater possibility for links to wikidata, though still quite messy.
FWIW, there are now 30M actions taken between occurrence (~specimen) record and collector/determiner, with ~2M of these from sources via identifiedByID or recordedByID.

Took a reasonable crack at this in the spirit of the big-picture, though not precisely the same as what you hand in mind. I've not done anything with datasets until I figure out what is most meaningful. One thing I may do is provide a list of datasets that have recordedByID or identifiedByID populated. Will close for now and revisit later. https://bionomia.net/statistics


Holding Problems

Hi,
I don't know if you know but some objects having the ancient holding system. Can you fix that please ? ;)
If you don't understand me there is 2 pictures with the news holding system and the problem of your mod items ;)
Normal : http://i.imgur.com/QIhRqfu.png
Your items : http://i.imgur.com/OjaSJKP.png
Thank you for your work and have a nice day :)

I see what you mean, how its flipped the wrong way, i can see it in f5 mode as well.
I will see what i can do.

Fixed in 1.7.6 https://minecraft.curseforge.com/projects/cyclic/files/2332155


Use pydantic model as a scalar with strawberry.auto

Add way of using pydantic model scalars without manually defining fields - just by using strawberry.auto
Feature Request Type

[x] Alteration (enhancement/optimization) of existing feature(s)

Description
I have a pydantic model, lets say:
class SomeNameModel(pydantic.BaseModel):
    name: str
    number: int

And I have a scalar:
@strawberry.scalar(
    name='SomeName',
    serialize=marshal_some_name,
    parse_value=unmarshal_some_name,
)
class SomeName(SomeNameModel):
    """SomeName scalar."""

I have a model which has uses that scalar:
class User(pydantic.BaseModel):
    some_name: SomeNameModel

When I'm trying to create a type from it:
@strawberry.experimental.pydantic.type(
    model=User,
)
class UserType:
    some_name: strawberry.auto

I'm getting an error:
Cannot find a Strawberry Type for <class 'SomeNameModel'> did you forget to register it?

If I change User to:
class User(pydantic.BaseModel):
    some_name: SomeName

I have a pydantic error:
RuntimeError: error checking inheritance of <strawberry.custom_scalar.ScalarWrapper object at 0x10adc2ce0> (type: ScalarWrapper)

However, this works (manual annotation of type):
@strawberry.experimental.pydantic.type(
    model=User,
)
class UserType:
    some_name: SomeName

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

I am also encountering the same issue because strawberry.auto is not working, and setting the flag all_field=True in strawberry.experimental.pydantic.type has also failed.
Even when scalar_overrides are set, strawberry.auto still fails to resolve the type.
def create_schema() -> strawberry.Schema:
    return strawberry.Schema(
        query=Query,
        mutation=Mutation,
        scalar_overrides={SomeNameModel: SomeName},
    )


(PDB-2482) Add ability to configure PE with token auth

This commit refactors our authentication middleware and related code
such that now PE PuppetDB can wrap cert-whitelist and token
authentication middleware.

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/632/
Test FAILed.

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/636/
Test PASSed.

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/637/
Test PASSed.

@senior Not sure quite where to go with this, we need the dependency update but it fails mysteriously on Java7

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/638/
Test PASSed.

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/643/
Test PASSed.

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/646/
Test FAILed.

@puppetlabs-jenkins retest this please

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/649/
Test FAILed.

@ajroetker Oh wait, we can just roll back to 2.4.3 of Hikari? I thought we were forced to upgrade that?

@puppetlabs-jenkins test this please

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/651/
Test PASSed.

@senior fixed for your comments

:+1:  will merge once the tests pass

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/654/
Test PASSed.

Refer to this link for build results (access rights to CI server needed):
http://jenkins-enterprise.delivery.puppetlabs.net/job/enterprise_puppetdb_init-multijob_githubpr-master/656/
Test PASSed.


refactor: Remove redundant View castings in Android projects

Software and hardware versions
Latest code from development branch.
Problem description
Currently there are a lot of instances of redundant View castings in the project.
For eg.
infoPane = (LinearLayout) view.findViewById(R.id.sync_info_pane);

can be replaced by
infoPane = view.findViewById(R.id.sync_info_pane);

They were required before but aren't required now and Android studio suggests removing them.
Steps to reproduce the problem
NA
Expected behavior
They should be removed.
Other information
NA
@jbeorse Views ?
Quick win for first timers may be :smile:

Oh that is interesting. Does this reduce the amount of lint warnings we will get?

@jbeorse
Yes i think so. Code inspection shows 65 instances of Redundant type casts in the project. A large number of those are these findViewById castings.
Here is a stackoverflow discussion on this.

Our compileVersion is 27, so it does seem like this should work. Good find! I'll mark it as a quick win, certainly contributor friendly. Go ahead and claim it if you like. 😄

Your title mentions only Services, but I imagine this is true in Survey, Tables, and Scan as well. I think we should extend it to all 4 apps.

@opendatakit-bot claim

Hi @srv-twry thank you for your pull requests!
There are some more redundant casts in androidlibrary, after those are fixed I will close this issue.


webpack not recognized as an internal command

I can't create a custom build, due to this error:
"webpack" is not recognized as an internal or external command, executable program or batch file.
Could you give me a guide on how to fix it?

Did you install it?

I think there should be some installation instructions. I added a PR for it after struggling for a while.
https://github.com/hiukim/mind-ar-js/pull/251/commits/92f4d634b1918c35ea568de5dfd5ef3e54bb5c66


Seeing duplicated logs when registering multiple pluggable components into the same container with ILogger

Expected Behavior
Logs to not be duplicated when using multiple registered components in a single container.
Actual Behavior
As soon as the second pluggable component is registered, all calls to the ILogger instance are duplicated in the k8s logs.
Steps to Reproduce the Problem
Create a pluggable component and utilize the Multiple services in a .NET Dapr pluggable component
Use the implementation as defined in the samples for each service. Observe that if both services are used within a single application then logs are duplicated.
Release Note

RELEASE NOTE:

Never mind, user error :(


Linking error

I thought I'd try this out, but immediately ran into a linking error:
⇒  cargo build
   Compiling ruru v0.5.0
   Compiling libc v0.1.12
/Users/craig.hills/.cargo/registry/src/github.com-88ac128001ac3a9a/libc-0.1.12/rust/src/liblibc/lib.rs:81:21: 81:39 warning: lint raw_pointer_derive has been removed: using derive with raw pointers is ok
/Users/craig.hills/.cargo/registry/src/github.com-88ac128001ac3a9a/libc-0.1.12/rust/src/liblibc/lib.rs:81 #![allow(bad_style, raw_pointer_derive)]
                                                                                ^~~~~~~~~~~~~~~~~~
/Users/craig.hills/.cargo/registry/src/github.com-88ac128001ac3a9a/ruru-0.5.0/src/types.rs:16:1: 16:85 warning: trait bounds are not (yet) enforced in type definitions [E0122]
/Users/craig.hills/.cargo/registry/src/github.com-88ac128001ac3a9a/ruru-0.5.0/src/types.rs:16 pub type Callback<I: Object, O: Object> = extern fn(Argc, *const AnyObject, I) -> O;
                                                                                ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/Users/craig.hills/.cargo/registry/src/github.com-88ac128001ac3a9a/ruru-0.5.0/src/types.rs:16:1: 16:85 help: run `rustc --explain E0122` to see a detailed explanation
error: linking with `cc` failed: exit code: 1
note: "cc" "-m64" "-L" "/Users/craig.hills/.multirust/toolchains/stable-x86_64-apple-darwin/lib/rustlib/x86_64-apple-darwin/lib" "/Users/craig.hills/code/bruw/target/debug/deps/ruru-89284decc76f4754.0.o" "-o" "/Users/craig.hills/code/bruw/target/debug/deps/libruru-89284decc76f4754.dylib" "/Users/craig.hills/code/bruw/target/debug/deps/ruru-89284decc76f4754.metadata.o" "-Wl,-dead_strip" "-nodefaultlibs" "-L" "/Users/craig.hills/code/bruw/target/debug/deps" "-L" "/Users/craig.hills/code/bruw/target/debug/deps" "-L" "/usr/local/opt/rbenv/versions/2.3.0/lib" "-L" "/Users/craig.hills/.multirust/toolchains/stable-x86_64-apple-darwin/lib/rustlib/x86_64-apple-darwin/lib" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-l" "ruby" "-Wl,-force_load,/var/folders/0j/s2tz5nh135325kr5czrkq_0m274bbw/T/rustc.sQqN26Zd1r6K/liblibc-dd3420cb049117bb.rlib" "-L" "/Users/craig.hills/.multirust/toolchains/stable-x86_64-apple-darwin/lib/rustlib/x86_64-apple-darwin/lib" "-l" "std-4fda350b" "-l" "c" "-l" "m" "-l" "System" "-l" "pthread" "-l" "c" "-l" "m" "-dynamiclib" "-Wl,-dylib" "-l" "compiler-rt"
note: Undefined symbols for architecture x86_64:
  "_rb_funcallv", referenced from:
      binding::util::call_method::h19b8a2c489e1971cRia in ruru-89284decc76f4754.0.o
  "_rb_sym2id", referenced from:
      binding::symbol::sym_to_id::hfeed45964b43a6ffRha in ruru-89284decc76f4754.0.o
  "_rb_id2sym", referenced from:
      binding::symbol::id_to_sym::h4480ba545371b02cnha in ruru-89284decc76f4754.0.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

error: aborting due to previous error
Could not compile `ruru`.

⇒  rbenv version
2.3.0 (set by /usr/local/opt/rbenv/version)
⇒  rustc -V
rustc 1.8.0 (db2939409 2016-04-11)
⇒  cc --version
Apple LLVM version 7.3.0 (clang-703.0.29)
Target: x86_64-apple-darwin15.4.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

Hi @chills42!
It turned out that one additional step was missing in the Readme. For now the crate cannot be used as static library, but MRI is built without any dynamic libraries by default (rbenv/ruby-build#35)
Please run
CONFIGURE_OPTS=--enable-shared rbenv install 2.3.0

to build ruby along with dylibs and rebuild the crate.
I've updated Readme. Thanks for creating the issue!

Thanks! Built fine this time!


Working with the main branch.io plugin

Will this plugin work nicely with the main branch.io cordova plugin, or will I need to do some work to get them to work together or does one include the features of the other?
https://github.com/BranchMetrics/Cordova-Ionic-PhoneGap-Deferred-Deep-Linking-SDK

Never tried them together, so can't tell. You are free to experiment :) But I think it is totally possible.
UL plugin just prepares your application to work with universal links by executing some hooks on the build phase. Plus, it has some native code to process the links, that you open. Hooks should not conflict, since according to branch.io plugin documentation developer should do this by hand. The only problem can be with the native code. But I think this is solvable.

ok, I'll experiment and if I need to adjust either plugin's native code, I'll pull request it back :)

I tried to add both plugins into the project, and then branch.io plugin failed to get the deep link data in callbacks. It turned out that the both plugins tries to override the AppDelegate's application:continueUserActivity method and caused the conflict. I'm not sure how to solve this issue.

As a workaround you can mix implementation from both plugins.

Install both plugins.

In the AppDelegate+BNCDevice.m include header for UL plugin on line 4:

#import "CULPlugin.h"

In the AppDelegate+BNCDevice.m modify swizzleApplication:(UIApplication *)application method like so:

- (BOOL)swizzleApplication:(UIApplication *)application continueUserActivity:(NSUserActivity *)userActivity restorationHandler:(void (^)(NSArray * _Nullable))restorationHandler {
  if (![userActivity.activityType isEqualToString:NSUserActivityTypeBrowsingWeb]) {
      if (swizzled) {
          return [self swizzleApplication:application continueUserActivity:userActivity restorationHandler:restorationHandler];
      }

      return NO;
  }

  // get instance of the UL plugin
  CULPlugin *ulPlugin = [self.viewController getCommandInstance:PLUGIN_NAME];
  if (ulPlugin == nil) {
      return NO;
  }

  BNCDevice *device = [self.viewController getCommandInstance:@"BranchDevice"];

  return [device handleUserActivity:userActivity] && [ulPlugin handleUserActivity:userActivity];
}

Delete AppDelegate+CULPlugin.h and AppDelegate+CULPlugin.m files from the project.

As a result, branch's AppDelegate will call both UL plugin and his own implementation.


Allow ability to get and set state objects via strings

Description
API improvement.
I'd like to use the same on_edit() function on different tables.  But the way to access the associated pandas DataFrame requires you to know the name of the variable used to create the table, because the variable name becomes an attribute of the passed in State object.
I'd like to propose that you add set and get methods to the API for State.
So instead of having to write  table = state.df.copy(), I could write table = state.get("xxx").copy(), and instead of having to write state.xxx = table, I could write state.set("xxx", table).

You can already use

getattr(state, "xxx")
setattr(state, "xxx", value)

You can already use

getattr(state, "xxx")
setattr(state, "xxx", value)

Thanks.  That worked.


2x compilation slowdown when upgrading from TS1.8 => TS2.0

Is this expected? Are there ways to mitigate this?
If this is not expected, I will try to post a synthetic test case.

We have a ~400 file TS project (without counting imported libs), and it will take some time to create a repro case.
My question is a high level question before I try to make that repro case: given that TS2's compiler does more than TS1.8's compiler, from your guys' tests, what kind of slowdown in cold and incremental compilation should I expect to see as a user? Is it 0? 10%? 50%?

2x slowdown is not something we'd expect; 10-15% is more representative from the codebases we've seen. It's possible you're using some particular patterns that we don't have similar benchmarks for.

Ok, will try to put together a repro case.

I wasn't able to distill our codebase down to a repro case; maybe we can leave this issue open, in case someone runs into the same thing.
At a high level, our structure is not typical - for historical reasons, instead of a well formed dependency graph, our code is a shallow graph - we have 400+ entrypoints, which we build into a single bundle with browserify + tsify.
The dependency graph looks something like this:

Have you tried benchmarking a project structure like this?

We would love to get access to the project to investigate more. we would be happy to sign any NDA's required.
We do have a set of bench marks for large projects, any where between 200 KLOC to 1 MLOC. we have not see such increase.

@mhegazy Unfortunately I don't think it will be possible to share our code.
We had a few contributing factors that slowed down our build a lot already (both before and after upgrading to TS2): we were building 3 separate JS bundles from TS, with 3 gulp watchers running in parallel, often triple-watching the same file, and hogging the same thread.
Additionally:

We have ~400 TS files (~40k LOC), compiling to 3 3MB bundles (lots of crossover and a few other libs are included in the bundles too)
Each file is its own entry point: because it's a legacy Angular 1.x project, many files don't use imports, and register themselves with the global Angular injector instead
We use browserify/watchify + tsify to compile, though we saw a similar slowdown when using rollup + rollup-typescript, and then with using tsc directly (browserify was the largest slowdown it turns out)

The fix in our case was to dynamically generate an index.js that requires every file. So before, we had 400 entry points, some of which imported each other; now, we have a single entry point that requires each of those 400 original entry points (the visualization in my comment above is accurate).
Our incremental build time dropped from ~4-5s to ~500ms.
Hope that's helpful.

@mhegazy I see massive slow down as well. Change in one file takes 9-10 seconds to compile (in --watch mode), in 1.8 was much much faster.
Our project is Angular2/Ionic2 app. We made a switch to newest release of Ionic, which uses latest Angular2. Can I run tsc in verbose mode, to see what is going on there and what takes so much time?

I just made a simple test. Created new file (test.ts), with class declaration class A {prop: number} and added to my project. I run tsc --watch --traceResolution and after initial compilation I made a change in test.ts - thanks to trace resolution I've noticed, that compiler is checking all the files in my project and trying to resolve modules, that are used in those files. Obviously that takes time - I don't know whether that should work like this and if that didn't change from 1.8, but it looks a bit weird.

@mhegazy I see massive slow down in incremental compilation (tsc --watch). Change in one file takes 9-10 (or even more) seconds to compile, in 1.8 was much much faster.
Our project is Angular2/Ionic2 app. We made a switch to newest release of Ionic, which uses latest Angular2.
I just made a simple test. Created new file (test.ts), with class declaration class A {prop: number} and added to my project. I run tsc --watch --traceResolution and after initial compilation I made a change in test.ts - thanks to trace resolution I've noticed, that compiler is checking all the files in my project and trying to resolve modules, that are used in those files. Obviously that takes time - I don't know whether that should work like this and if that didn't change from 1.8, but it looks a bit weird.

There has been no changes to --watch behavior. what was the total compilation time using 1.8 vs 2.0 (tsc --diagnostics)? can you share a sample project we can look at?

Diagnostics typescript 2.0.3:
$ tsc --watch --diagnostics
Files:             862
Lines:          101292
Nodes:          381541
Identifiers:    127844
Symbols:        179132
Types:           38178
Memory used:   227997K
I/O read:        0.37s
I/O write:       0.06s
Parse time:      2.59s
Bind time:       1.12s
Check time:     12.17s
Emit time:       0.73s
Total time:     16.61s
18:37:47 - Compilation complete. Watching for file changes.
18:38:24 - File change detected. Starting incremental compilation...
Files:             862
Lines:          101292
Nodes:          381533
Identifiers:    127842
Symbols:        179132
Types:           38178
Memory used:   279647K
I/O read:        0.00s
I/O write:       0.04s
Parse time:      1.07s
Bind time:       0.02s
Check time:     10.73s
Emit time:       0.39s
Total time:     12.21s
18:38:36 - Compilation complete. Watching for file changes.

Diagnostics 1.8.10:
tsc --watch --diagnostics
Files:             831
Lines:          107757
Nodes:          344268
Identifiers:    115490
Symbols:      32590129
Types:           26693
Memory used:   174845K
I/O read:        0.35s
I/O write:       0.03s
Parse time:      2.42s
Bind time:       1.16s
Check time:      3.63s
Emit time:       0.63s
Total time:      7.84s
18:51:56 - Compilation complete. Watching for file changes.
18:53:55 - File change detected. Starting incremental compilation...
Files:             831
Lines:          107757
Nodes:          344275
Identifiers:    115492
Symbols:      32605151
Types:           26694
Memory used:   200667K
I/O read:        0.00s
I/O write:       0.04s
Parse time:      1.04s
Bind time:       0.03s
Check time:      3.83s
Emit time:       0.59s
Total time:      5.50s
18:54:01 - Compilation complete. Watching for file changes.

Just looking at the numbers - 2.0 compilation is at least 7 seconds slower than 1.8 and all because "check" process. Isn't that because of the switch from typings to npm ?

@lleevvyy is it possible to get your repro code so we can find the crux of the problem. We can sign NDA if necessary

@vladima Sure, how to send the code?

you can send it to vladima <at> microsoft <dot> com.

@vladima I've analyzed my code and I found, that typescript 2.0 is processing/checking much longer files, that are huge - in my app I have a few autogenerated files, and those are between 40-250KB. Each file contains few methods and inside each method there is big switch statement with hundreds of cases and each case returns new instance of some objects. Small sample below:
export class VsiItemFactoryImpl extends VsiItemFactory {

	protected  create0 (item: number) : VsiItem {
		switch(item) {
			case 3: return new VsiItemString(item, "PRODUCTION_COUNTRY", 44, [1049], null, false, false, false, null, null, undefined, VEHICLE_TYPES_CAR_CV, null);
			case 5: return new VsiItemString(item, "VERSION_NAME", 25, [1049], null, false, false, false, null, null, undefined, VEHICLE_TYPES_CAR_CV, null);
			case 6: return new VsiItemList(item, "FUEL", 119, [138], [7, 8, 9, 10, 11], false, false, true, null, [25], undefined, VEHICLE_TYPES_CAR_CV, 0, null, false, false);
			case ...
		}
	}

	protected create500 (item: number): VsiItem {
		switch(item) {
			case...
		}
	}

}

When I clear the biggest file (240KB) check time drops from 9sec to 3sec. Note, that typescript 1.8 check time is 2sec, no difference whether that big file is empty or filled.

@lleevvyy can you try to build compiler from this branch to check if it addresses your problem?

@vladima Yes, I confirm - much better now:
Files:           917
Lines:        105093
Nodes:        433987
Identifiers:  133966
Symbols:      183500
Types:         50668
Memory used: 265612K
I/O read:      0.08s
I/O write:     0.05s
Parse time:    2.97s
Bind time:     1.38s
Check time:    4.74s
Emit time:     1.31s
Total time:   10.39s
00:04:25 - Compilation complete. Watching for file changes.
00:05:29 - File change detected. Starting incremental compilation...
Files:           917
Lines:        105093
Nodes:        433987
Identifiers:  133966
Symbols:      183500
Types:         50668
Memory used: 331592K
I/O read:      0.00s
I/O write:     0.02s
Parse time:    0.96s
Bind time:     0.03s
Check time:    5.08s
Emit time:     0.65s
Total time:    6.73s

As you can see it is faster, however still slower for about 2 sec from 1.8. Is there any chance that it might be as fast as 1.8? If not, should I change my code to have better compilation time?
@vladima Thanks for your time and work!


Lack of Navigation Options for Locations

Currently, our project includes photos of various places, but it lacks an integrated map feature for easy navigation. Implementing a map integration would greatly enhance the user experience by allowing users to click on a photo and be directed to the corresponding geographical location on Google Maps.

working on it

Updated the code for maps

Great work!


sphinx_lm_convert -i chinese.lm -o chinese.lm.bin error on Mac X EI Capitan 10.11.6

Steps to reproduce

ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" < /dev/null 2> /dev/null
brew install cmu-sphinxbase
sphinx_lm_convert -i zh_broadcastnews_64000_utf8.DMP -o chinese.lm -ofmt arpa
sphinx_lm_convert -i chinese.lm -o chinese.lm.bin

Expected behaviour
step 1-3 succeeded. step 4 should generate chinese.lm.bin.
Actual behaviour
sphinx_lm_convert -i chinese.lm -o chinese.lm.bin
INFO: cmd_ln.c(691): Parsing command line:
sphinx_lm_convert
-i chinese.lm
-o chinese.lm.bin
Current configuration:
[NAME]		[DEFLT]	[VALUE]
-case
-debug			0
-help		no	no
-i			chinese.lm
-ienc
-ifmt
-logbase	1.0001	1.000100e+00
-mmap		no	no
-o			chinese.lm.bin
-oenc		utf8	utf8
-ofmt
INFO: ngram_model_arpa.c(477): ngrams 1=63944, 2=16600781, 3=20708460
INFO: ngram_model_arpa.c(135): Reading unigrams
INFO: ngram_model_arpa.c(516):    63944 = #unigrams created
INFO: ngram_model_arpa.c(195): Reading bigrams
.............................................................................................................................................................................................................................................................INFO: ngram_model_arpa.c(533): 16600781 = #bigrams created
INFO: ngram_model_arpa.c(534):    32337 = #prob2 entries
INFO: ngram_model_arpa.c(542):    24468 = #bo_wt2 entries
INFO: ngram_model_arpa.c(292): Reading trigrams
...........................................................................................................................................................................................................................................................................................................................INFO: ngram_model_arpa.c(555): 20708460 = #trigrams created
INFO: ngram_model_arpa.c(556):    27937 = #prob3 entries
ERROR: "ngram_model.c", line 183: language model file type not supported
ERROR: "sphinx_lm_convert.c", line 212: Failed to write language model in format (null) to chinese.lm.bin
System information
(Delete all the statements that don't apply.)
My system is <Mac OS X EI Capitan 10.11.6>. (For example, "Ubuntu 16.04 LTS x64", "Windows 10 x64", or "macOS Sierra".)
My Python version is <Python 3.5.2 :: Anaconda custom (x86_64)>. (You can check this by running python -V.)
My Pip version is <pip 8.1.1 from /anaconda/lib/python3.5/site-packages (python 3.5)>. (You can check this by running pip -V.)
My SpeechRecognition library version is <3.6.5>. (You can check this by running python -c "import speech_recognition as sr;print(sr.__version__)".)
I installed PocketSphinx from . (For example, from the Debian repositories, from Homebrew, or from the source code.)

I tried to install from the source code, and it works!
Thank you!

Hi,
I am getting the same error as well.  I have built sphinxbase from source code as given the docs.
My system is also Mac OS .
INFO: ngram_model_arpa.c(292): Reading trigrams
INFO: ngram_model_arpa.c(555):    21488 = #trigrams created
INFO: ngram_model_arpa.c(556):      144 = #prob3 entries
ERROR: "ngram_model.c", line 183: language model file type not supported
ERROR: "sphinx_lm_convert.c", line 212: Failed to write language model in format (null) to hindi.lm.bin
which sphinx_lm_convert
/usr/local/bin/sphinx_lm_convert
Please advise.

Hi,
I was able to get this working.  Had to remove --force from the command to build and make.
Regards,
Ashok


Add docker-compose files for stat collection

This PR adds docker-compose files that build containers containing InfluxDB, Grafana, and local Sawtooth files.
Note: Prior to running either docker-compose file, a user must create the sawtooth_stats Docker network with the command: $ docker network create sawtooth_stats. This allows communication between the containers.
The metrics.yaml docker compose file automatically run scripts that will set up a framework for stat collection:

After InfluxDB is started, a post to the InfluxDB HTTP API is made that creates a database called "metrics"

After Grafana is started, a post to the Grafana HTTP API is made that establishes a connection between the InfluxDB "metrics" database. Other datasources and dashboards can be added by adding json files to the stat_collection/docker/grafana/datasources or stat_collection/docker/grafana/dashboards directories

When attempting to run this locally, I get an error using the following steps.

Create the sawtooth_stats network, as described

Start the local validator:
$ docker-compose -f docker/compose/sawtooth-local.yaml up

Start the influx/grafana combo:
$ docker-compose -f stat_collection/docker/metrics.yaml up
... docker related output....
Step 3/8 : COPY dashboards /etc/grafana/dashboards
ERROR: Service 'grafana' failed to build: lstat dashboards: no such file or directory

Ah there should be an empty stat_collection/docker/grafana/dashboards directory in the filesystem. I will figure out how to add that.


Improved UI and functionality of EndDayDisplay

Description
This update enhances the EndDayDisplay component by adding a coin icon that appears next to the gold count label on the same line. The purpose of this change is to improve the user interface by visually associating the gold count with a coin symbol, making it easier for users to identify the value being represented.
Motivation:
The addition of a coin icon next to the gold count improves the clarity of the UI and ensures that the player can easily associate the numerical value with the visual representation of a coin.
Fixes / Closes # (issue)
This feature addresses feedback related to the visual clarity of the gold count and the need for an intuitive association between the number and its meaning. No specific issue number was assigned to this task.
Type of change
Please delete options that are not relevant.

[x] New feature (non-breaking change which adds functionality)

Changes Made

[x] Added a coin icon (coin.png) to the EndDayDisplay UI.
[x] Modified the layout so that the coin icon appears next to the gold count label in the same row.
[x] Adjusted the alignment and size of the icon to ensure it matches the overall design and does not disrupt the layout.
[x] Ensured the coin icon is properly loaded and displayed using the correct Texture and Image components.
[x] Refactored the UI to ensure that the EndDayDisplay table includes the coin and gold label side by side, centered horizontally on the screen.

How Has This Been Tested?
The changes were tested locally using the following methods:

[x] Test A: Verified that the coin icon and gold count appear in the correct position on the UI across different screen resolutions.
[x] Test B: Confirmed that the coin icon is displayed correctly after gold values are updated during gameplay.
[x] Test C: Ensured that other parts of the EndDayDisplay component were unaffected by the layout changes, such as the bird and point images.

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Any dependent changes have been merged and published in downstream modules

#105 End of Day Extended

#105

Description
This update enhances the EndDayDisplay component by adding a coin icon that appears next to the gold count label on the same line. The purpose of this change is to improve the user interface by visually associating the gold count with a coin symbol, making it easier for users to identify the value being represented.
Motivation:
The addition of a coin icon next to the gold count improves the clarity of the UI and ensures that the player can easily associate the numerical value with the visual representation of a coin.
Fixes / Closes # (issue)
This feature addresses feedback related to the visual clarity of the gold count and the need for an intuitive association between the number and its meaning. No specific issue number was assigned to this task.
Type of change
Please delete options that are not relevant.

[x]  New feature (non-breaking change which adds functionality)

Dependencies
End Day Display Extended (#105)
Milestones

[x]  Added a coin icon (coin.png) to the EndDayDisplay UI.
[x]  Modified the layout so that the coin icon appears next to the gold count label in the same row.
[x]  Adjusted the alignment and size of the icon to ensure it matches the overall design and does not disrupt the layout.
[x]  Ensured the coin icon is properly loaded and displayed using the correct Texture and Image components.
[x]  Refactored the UI to ensure that the EndDayDisplay table includes the coin and gold label side by side, centered horizontally on the screen.

How Has This Been Tested?
The changes were tested locally using the following methods:

[x]  Test A: Verified that the coin icon and gold count appear in the correct position on the UI across different screen resolutions.
[x]  Test B: Confirmed that the coin icon is displayed correctly after gold values are updated during gameplay.
[x]  Test C: Ensured that other parts of the EndDayDisplay component were unaffected by the layout changes, such as the bird and point images.

Checklist:

[x]  My code follows the style guidelines of this project
[x]  I have performed a self-review of my code
[x]  I have commented my code, particularly in hard-to-understand areas
[x]  I have made corresponding changes to the documentation
[x]  My changes generate no new warnings
[x]  I have added tests that prove my fix is effective or that my feature works
[x]  New and existing unit tests pass locally with my changes
[x]  Any dependent changes have been merged and published in downstream modules

Documentation
Main description of feature JavaDoc ...
Member
Name (GitHub Username) (Slack Handle) Lei Su (@ImLeiSu) (Sui)

#105


Let --download-archive file contain list of URLs

[X] I've verified and I assure that I'm running youtube-dl 2018.08.04
[X] At least skimmed through the README, most notably the FAQ and BUGS sections
[X] Searched the bugtracker for similar issues including closed ones
[X] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser
[X] Question / Request for Change

I was very happy to find the --download-archive option, but why does it store things in the non-intuitive format (source) (id) rather than the simple and intuitive (url)?
This makes it harder to read and manually handle the list, if necessary. For example to add URLs to the list, or copy URLs to share with other people.
Is it possible to change this to containing the downloaded URLs themselves? (While maintaining backwards compatibility with the old format for a good while at least...)

In general URL does not identify the video in a unique way. Several URLs may point to the same video so that storing URLs will break the whole point of download archive.


feat(minifier): implement folding String.prototype.replaceAll

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#6871  👈
#6870
#6869
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @camc314 and the rest of your teammates on  Graphite

Merge activity

Oct 24, 9:27 PM EDT: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.


Unable to launch tuning jobs on google colab

Hi
I run the  Auto-tuning a Convolutional Network for NVIDIA GPU tutorial on google colab, and i met an error as below:
[Task 1/16] Current/Best: 0.00/ 0.00 GFLOPS | Progress: (0/2000) | 0.00 sProcess Process-6: Traceback (most recent call last): File “/usr/lib/python3.6/multiprocessing/process.py”, line 258, in _bootstrap self.run() File “/usr/lib/python3.6/multiprocessing/process.py”, line 93, in run self._target(*self._args, **self._kwargs) File “/usr/local/lib/python3.6/dist-packages/tvm-0.8.dev423+g93d79bafc-py3.6-linux-x86_64.egg/tvm/rpc/tracker.py”, line 362, in _tracker_server handler.run() File “/usr/local/lib/python3.6/dist-packages/tvm-0.8.dev423+g93d79bafc-py3.6-linux-x86_64.egg/tvm/rpc/tracker.py”, line 357, in run self._ioloop.start() File “/usr/local/lib/python3.6/dist-packages/tornado/platform/asyncio.py”, line 132, in start self.asyncio_loop.run_forever() File “/usr/lib/python3.6/asyncio/base_events.py”, line 425, in run_forever raise RuntimeError(‘This event loop is already running’) RuntimeError: This event loop is already running
Thanks in advance~

Thsnks @dandingol03 for bringing this up. This may have things to do with colab restrictions(that the env is already implemented via an event loop). A separate process might be necessary to start the rpc server. Please open a new thread on https://discuss.tvm.apache.org/ for followup discussions.