[tensorflow[*]:x64-windows] build failure

Host Environment

OS: Windows10
Compiler: revision

To Reproduce
Steps to reproduce the behavior:
.\vcpkg install  tensorflow[*]:x64-windows
Failure logs
PS C:\Users\mmd> cd I:\src\vcpkg
PS I:\src\vcpkg> .\vcpkg install  tensorflow[*]:x64-windows
Computing installation plan...
The following packages will be built and installed:
tensorflow[core]:x64-windows -> 2.3.1
Detecting compiler hash for triplet x64-windows...
Could not locate cached archive: C:\Users\mmd\AppData\Local\vcpkg\archives\c8\c8aefe826d775ca4566c1699efad6683737daba0.zip
Starting package 1/1: tensorflow:x64-windows
Building package tensorflow[core]:x64-windows...
-- Using msys root at I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b
-- Using cached I:/src/vcpkg/downloads/tensorflow-tensorflow-v2.3.1.tar.gz
-- Applying patch ../tensorflow-common/fix-build-error.patch
-- Applying patch ../tensorflow-common/fix-dbg-build-errors.patch
-- Applying patch ../tensorflow-common/fix-more-build-errors.patch
-- Using source at I:/src/vcpkg/buildtrees/tensorflow/src/v2.3.1-3bb65f15d0.clean
-- Configuring TensorFlow (dbg)
-- Warning: Building TensorFlow can take an hour or more.
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:145 (message):
Command failed: I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/usr/bin/bash.exe --noprofile --norc -c "'I:/src/vcpkg/downloads/tools/bazel/3.7.0-windows/bazel.exe' build --verbose_failures --compilation_mode=dbg --features=fastbuild    --python_path='I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe' --define=no_tensorflow_py_deps=true ///tensorflow:tensorflow.dll ///tensorflow:install_headers"
Working Directory: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg
See logs for more information:
I:\src\vcpkg\buildtrees\tensorflow\build-x64-windows-dbg-err.log
Call Stack (most recent call first):
ports/tensorflow-common/tensorflow-common.cmake:219 (vcpkg_execute_build_process)
ports/tensorflow/portfile.cmake:7 (include)
scripts/ports.cmake:136 (include)
Error: Building package tensorflow:x64-windows failed with: BUILD_FAILED
Please ensure you're using the latest portfiles with .\vcpkg update, then
submit an issue at https://github.com/Microsoft/vcpkg/issues including:
Package: tensorflow:x64-windows
Vcpkg version: 2020.11.12--unknownhash
Additionally, attach any relevant sections from the log files above.
Additional context
$TEST_TMPDIR defined: output root default is 'i:\src\vcpkg\buildtrees.bzl' and max_idle_secs default is '15'.
Starting local Bazel server and connecting to it...
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Options provided by the client:
'build' options: --python_path=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python.exe
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc:
'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.tf_configure.bazelrc:
'build' options: --action_env PYTHON_BIN_PATH=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe --action_env PYTHON_LIB_PATH=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/lib/python3.8/site-packages --python_path=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe --define=override_eigen_strong_inline=true --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:windows in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --copt=/w --copt=/D_USE_MATH_DEFINES --host_copt=/D_USE_MATH_DEFINES --cxxopt=/std:c++14 --host_cxxopt=/std:c++14 --config=monolithic --copt=-DWIN32_LEAN_AND_MEAN --host_copt=-DWIN32_LEAN_AND_MEAN --copt=-DNOGDI --host_copt=-DNOGDI --linkopt=/DEBUG --host_linkopt=/DEBUG --linkopt=/OPT:REF --host_linkopt=/OPT:REF --linkopt=/OPT:ICF --host_linkopt=/OPT:ICF --experimental_strict_action_env=true --verbose_failures --distinct_host_configuration=false
INFO: Found applicable config definition build:monolithic in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --define framework_shared_object=false
Loading:
Loading: 0 packages loaded
Analyzing: 2 targets (1 packages loaded)
Analyzing: 2 targets (1 packages loaded, 0 targets configured)
Analyzing: 2 targets (66 packages loaded, 161 targets configured)
WARNING: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/BUILD:1749:11: in linkstatic attribute of cc_library rule //tensorflow/core:lib_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
Analyzing: 2 targets (135 packages loaded, 7697 targets configured)
WARNING: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/BUILD:2161:16: in linkstatic attribute of cc_library rule //tensorflow/core:framework_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'tf_cuda_library', the error might have been caused by the macro implementation
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
INFO: Repository aws instantiated at:
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/WORKSPACE:19:16: in
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/workspace.bzl:108:27: in tf_repositories
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/workspace.bzl:49:8: in initialize_third_party
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/aws/workspace.bzl:9:29: in repo
Repository rule third_party_http_archive defined at:
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/repo.bzl:219:43: in
WARNING: Download from https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class java.io.IOException Tried to reconnect at offset 1,336,497 but server didn't support it
ERROR: An error occurred during the fetch of repository 'aws':
Traceback (most recent call last):
File "I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/repo.bzl", line 188, column 33, in _third_party_http_archive
ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz, https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz] to I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp829777694932992011/1.7.336.tar.gz: Tried to reconnect at offset 1,336,497 but server didn't support it
ERROR: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/platform/s3/BUILD:76:11: //tensorflow/core/platform/s3:s3_file_system depends on @aws//:aws in repository @aws which failed to fetch. no such package '@aws//': java.io.IOException: Error downloading [https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz, https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz] to I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp829777694932992011/1.7.336.tar.gz: Tried to reconnect at offset 1,336,497 but server didn't support it
ERROR: Analysis of target '//tensorflow:tensorflow.dll' failed; build aborted: Analysis failed
INFO: Elapsed time: 133.026s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (174 packages loaded, 11226 targets configured)
FAILED: Build did NOT complete successfully (174 packages loaded, 11226 targets configured)
//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
So i know whats wrong with it,  vcpkg cannot dowload 1.7.336.tar.gz using the links
[https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz,
https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz]
so i download the file 1.7.336.tar.gz  using other tools,  but how can  i do to make vcpkg continue to compile?
Thanks in advance.

Hi @kuelite
It seems this issue has been solved in recent commits. I cannot reproduce this on my machine now.
Could you please try to update vcpkg to the latest version to rebuild this port?
Thanks.

Hi @kuelite
It seems this issue has been solved in recent commits. I cannot reproduce this on my machine now.
Could you please try to update vcpkg to the latest version to rebuild this port?
Thanks.

i used git pull to update vcpkg and rebuild this port, but...still doesnt work.
PS I:\src\vcpkg> .\vcpkg version
Vcpkg package management program version 2020.11.12--unknownhash
See LICENSE.txt for license information.
PS I:\src\vcpkg> .\vcpkg install  tensorflow[*]:x64-windows
Computing installation plan...
The following packages will be built and installed:
tensorflow[core]:x64-windows -> 2.3.1#1

tensorflow-common[core]:x64-windows -> 2.3.1#1
Additional packages (*) will be modified to complete this operation.
Detecting compiler hash for triplet x64-windows...
Could not locate cached archive: C:\Users\mmd\AppData\Local\vcpkg\archives\61\6116b2e1977f71d193a848d5d619519f571a928d.zip
Could not locate cached archive: C:\Users\mmd\AppData\Local\vcpkg\archives\a0\a097cb8518b6a580902ab39dd5f556338c5d670d.zip
Starting package 1/2: tensorflow-common:x64-windows
Building package tensorflow-common[core]:x64-windows...
-- Installing: I:/src/vcpkg/packages/tensorflow-common_x64-windows/share/tensorflow-common/copyright
-- Performing post-build validation
-- Performing post-build validation done
Stored binary cache: C:\Users\mmd\AppData\Local\vcpkg\archives\61\6116b2e1977f71d193a848d5d619519f571a928d.zip
Building package tensorflow-common[core]:x64-windows... done
Installing package tensorflow-common[core]:x64-windows...
Installing package tensorflow-common[core]:x64-windows... done
Elapsed time for package tensorflow-common:x64-windows: 2.666 s
Starting package 2/2: tensorflow:x64-windows
Building package tensorflow[core]:x64-windows...
-- Using msys root at I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b
-- Using cached I:/src/vcpkg/downloads/tensorflow-tensorflow-v2.3.1.tar.gz
-- Applying patch I:/src/vcpkg/installed/x64-windows/share/tensorflow-common/fix-build-error.patch
-- Applying patch I:/src/vcpkg/installed/x64-windows/share/tensorflow-common/fix-dbg-build-errors.patch
-- Applying patch I:/src/vcpkg/installed/x64-windows/share/tensorflow-common/fix-more-build-errors.patch
-- Using source at I:/src/vcpkg/buildtrees/tensorflow/src/v2.3.1-3bb65f15d0.clean
-- Configuring TensorFlow (dbg)
-- Warning: Building TensorFlow can take an hour or more.
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:145 (message):
Command failed: I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/usr/bin/bash.exe --noprofile --norc -c "'I:/src/vcpkg/downloads/tools/bazel/3.7.0-windows/bazel.exe' build --verbose_failures --compilation_mode=dbg --features=fastbuild    --python_path='I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe' --define=no_tensorflow_py_deps=true ///tensorflow:tensorflow.dll ///tensorflow:install_headers"
See logs for more information:
I:\src\vcpkg\buildtrees\tensorflow\build-x64-windows-dbg-err.log

Call Stack (most recent call first):
installed/x64-windows/share/tensorflow-common/tensorflow-common.cmake:219 (vcpkg_execute_build_process)
ports/tensorflow/portfile.cmake:7 (include)
scripts/ports.cmake:136 (include)
Error: Building package tensorflow:x64-windows failed with: BUILD_FAILED
Please ensure you're using the latest portfiles with .\vcpkg update, then
submit an issue at https://github.com/Microsoft/vcpkg/issues including:
Package: tensorflow:x64-windows
Vcpkg version: 2020.11.12--unknownhash
Additionally, attach any relevant sections from the log files above.
////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
$TEST_TMPDIR defined: output root default is 'i:\src\vcpkg\buildtrees.bzl' and max_idle_secs default is '15'.
Starting local Bazel server and connecting to it...
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Options provided by the client:
'build' options: --python_path=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python.exe
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc:
'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.tf_configure.bazelrc:
'build' options: --action_env PYTHON_BIN_PATH=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe --action_env PYTHON_LIB_PATH=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/lib/python3.8/site-packages --python_path=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe --define=override_eigen_strong_inline=true --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:windows in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --copt=/w --copt=/D_USE_MATH_DEFINES --host_copt=/D_USE_MATH_DEFINES --cxxopt=/std:c++14 --host_cxxopt=/std:c++14 --config=monolithic --copt=-DWIN32_LEAN_AND_MEAN --host_copt=-DWIN32_LEAN_AND_MEAN --copt=-DNOGDI --host_copt=-DNOGDI --linkopt=/DEBUG --host_linkopt=/DEBUG --linkopt=/OPT:REF --host_linkopt=/OPT:REF --linkopt=/OPT:ICF --host_linkopt=/OPT:ICF --experimental_strict_action_env=true --verbose_failures --distinct_host_configuration=false
INFO: Found applicable config definition build:monolithic in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --define framework_shared_object=false
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
currently loading: tensorflow
Analyzing: 2 targets (1 packages loaded, 0 targets configured)
Analyzing: 2 targets (7 packages loaded, 11 targets configured)
Analyzing: 2 targets (81 packages loaded, 1659 targets configured)
Analyzing: 2 targets (98 packages loaded, 2377 targets configured)
Analyzing: 2 targets (122 packages loaded, 3416 targets configured)
Analyzing: 2 targets (140 packages loaded, 3958 targets configured)
Analyzing: 2 targets (159 packages loaded, 5647 targets configured)
Analyzing: 2 targets (162 packages loaded, 7179 targets configured)
WARNING: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/BUILD:1749:11: in linkstatic attribute of cc_library rule //tensorflow/core:lib_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
Analyzing: 2 targets (173 packages loaded, 10218 targets configured)
WARNING: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/BUILD:2161:16: in linkstatic attribute of cc_library rule //tensorflow/core:framework_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'tf_cuda_library', the error might have been caused by the macro implementation
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
INFO: Repository aws instantiated at:
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/WORKSPACE:19:16: in
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/workspace.bzl:108:27: in tf_repositories
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/workspace.bzl:49:8: in initialize_third_party
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/aws/workspace.bzl:9:29: in repo
Repository rule third_party_http_archive defined at:
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/repo.bzl:219:43: in
WARNING: Download from https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class java.io.IOException Tried to reconnect at offset 12,729,763 but server didn't support it
ERROR: An error occurred during the fetch of repository 'aws':
Traceback (most recent call last):
File "I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/repo.bzl", line 188, column 33, in _third_party_http_archive
ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz, https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz] to I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp1096286104503363444/1.7.336.tar.gz: Tried to reconnect at offset 12,729,763 but server didn't support it
ERROR: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/platform/s3/BUILD:76:11: //tensorflow/core/platform/s3:s3_file_system depends on @aws//:aws in repository @aws which failed to fetch. no such package '@aws//': java.io.IOException: Error downloading [https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz, https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz] to I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp1096286104503363444/1.7.336.tar.gz: Tried to reconnect at offset 12,729,763 but server didn't support it
ERROR: Analysis of target '//tensorflow:install_headers' failed; build aborted: Analysis failed
INFO: Elapsed time: 1100.858s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (174 packages loaded, 11226 targets configured)
FAILED: Build did NOT complete successfully (174 packages loaded, 11226 targets configured)
///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
the point is the folder (I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp1096286104503363444) is randomly generated , i cant  copy 1.7.336.tar.gz to this folder.

i used git pull to update vcpkg and rebuild this port, but...still doesnt work.
PS I:\src\vcpkg> .\vcpkg version
Vcpkg package management program version 2020.11.12--unknownhash
See LICENSE.txt for license information.
PS I:\src\vcpkg> .\vcpkg install  tensorflow[*]:x64-windows
Computing installation plan...
The following packages will be built and installed:
tensorflow[core]:x64-windows -> 2.3.1#1

tensorflow-common[core]:x64-windows -> 2.3.1#1
Additional packages (*) will be modified to complete this operation.
Detecting compiler hash for triplet x64-windows...
Could not locate cached archive: C:\Users\mmd\AppData\Local\vcpkg\archives\61\6116b2e1977f71d193a848d5d619519f571a928d.zip
Could not locate cached archive: C:\Users\mmd\AppData\Local\vcpkg\archives\a0\a097cb8518b6a580902ab39dd5f556338c5d670d.zip
Starting package 1/2: tensorflow-common:x64-windows
Building package tensorflow-common[core]:x64-windows...
-- Installing: I:/src/vcpkg/packages/tensorflow-common_x64-windows/share/tensorflow-common/copyright
-- Performing post-build validation
-- Performing post-build validation done
Stored binary cache: C:\Users\mmd\AppData\Local\vcpkg\archives\61\6116b2e1977f71d193a848d5d619519f571a928d.zip
Building package tensorflow-common[core]:x64-windows... done
Installing package tensorflow-common[core]:x64-windows...
Installing package tensorflow-common[core]:x64-windows... done
Elapsed time for package tensorflow-common:x64-windows: 2.666 s
Starting package 2/2: tensorflow:x64-windows
Building package tensorflow[core]:x64-windows...
-- Using msys root at I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b
-- Using cached I:/src/vcpkg/downloads/tensorflow-tensorflow-v2.3.1.tar.gz
-- Applying patch I:/src/vcpkg/installed/x64-windows/share/tensorflow-common/fix-build-error.patch
-- Applying patch I:/src/vcpkg/installed/x64-windows/share/tensorflow-common/fix-dbg-build-errors.patch
-- Applying patch I:/src/vcpkg/installed/x64-windows/share/tensorflow-common/fix-more-build-errors.patch
-- Using source at I:/src/vcpkg/buildtrees/tensorflow/src/v2.3.1-3bb65f15d0.clean
-- Configuring TensorFlow (dbg)
-- Warning: Building TensorFlow can take an hour or more.
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:145 (message):
Command failed: I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/usr/bin/bash.exe --noprofile --norc -c "'I:/src/vcpkg/downloads/tools/bazel/3.7.0-windows/bazel.exe' build --verbose_failures --compilation_mode=dbg --features=fastbuild    --python_path='I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe' --define=no_tensorflow_py_deps=true ///tensorflow:tensorflow.dll ///tensorflow:install_headers"
See logs for more information:
I:\src\vcpkg\buildtrees\tensorflow\build-x64-windows-dbg-err.log

Call Stack (most recent call first):
installed/x64-windows/share/tensorflow-common/tensorflow-common.cmake:219 (vcpkg_execute_build_process)
ports/tensorflow/portfile.cmake:7 (include)
scripts/ports.cmake:136 (include)
Error: Building package tensorflow:x64-windows failed with: BUILD_FAILED
Please ensure you're using the latest portfiles with .\vcpkg update, then
submit an issue at https://github.com/Microsoft/vcpkg/issues including:
Package: tensorflow:x64-windows
Vcpkg version: 2020.11.12--unknownhash
Additionally, attach any relevant sections from the log files above.
////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
$TEST_TMPDIR defined: output root default is 'i:\src\vcpkg\buildtrees.bzl' and max_idle_secs default is '15'.
Starting local Bazel server and connecting to it...
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Options provided by the client:
'build' options: --python_path=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python.exe
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc:
'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.tf_configure.bazelrc:
'build' options: --action_env PYTHON_BIN_PATH=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe --action_env PYTHON_LIB_PATH=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/lib/python3.8/site-packages --python_path=I:/src/vcpkg/downloads/tools/msys2/7030ad0251a2377b/mingw64/bin/python3.exe --define=override_eigen_strong_inline=true --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:windows in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --copt=/w --copt=/D_USE_MATH_DEFINES --host_copt=/D_USE_MATH_DEFINES --cxxopt=/std:c++14 --host_cxxopt=/std:c++14 --config=monolithic --copt=-DWIN32_LEAN_AND_MEAN --host_copt=-DWIN32_LEAN_AND_MEAN --copt=-DNOGDI --host_copt=-DNOGDI --linkopt=/DEBUG --host_linkopt=/DEBUG --linkopt=/OPT:REF --host_linkopt=/OPT:REF --linkopt=/OPT:ICF --host_linkopt=/OPT:ICF --experimental_strict_action_env=true --verbose_failures --distinct_host_configuration=false
INFO: Found applicable config definition build:monolithic in file i:\src\vcpkg\buildtrees\tensorflow\x64-windows-dbg.bazelrc: --define framework_shared_object=false
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
currently loading: tensorflow
Analyzing: 2 targets (1 packages loaded, 0 targets configured)
Analyzing: 2 targets (7 packages loaded, 11 targets configured)
Analyzing: 2 targets (81 packages loaded, 1659 targets configured)
Analyzing: 2 targets (98 packages loaded, 2377 targets configured)
Analyzing: 2 targets (122 packages loaded, 3416 targets configured)
Analyzing: 2 targets (140 packages loaded, 3958 targets configured)
Analyzing: 2 targets (159 packages loaded, 5647 targets configured)
Analyzing: 2 targets (162 packages loaded, 7179 targets configured)
WARNING: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/BUILD:1749:11: in linkstatic attribute of cc_library rule //tensorflow/core:lib_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
Analyzing: 2 targets (173 packages loaded, 10218 targets configured)
WARNING: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/BUILD:2161:16: in linkstatic attribute of cc_library rule //tensorflow/core:framework_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'tf_cuda_library', the error might have been caused by the macro implementation
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
Analyzing: 2 targets (174 packages loaded, 11226 targets configured)
INFO: Repository aws instantiated at:
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/WORKSPACE:19:16: in
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/workspace.bzl:108:27: in tf_repositories
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/workspace.bzl:49:8: in initialize_third_party
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/aws/workspace.bzl:9:29: in repo
Repository rule third_party_http_archive defined at:
I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/repo.bzl:219:43: in
WARNING: Download from https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class java.io.IOException Tried to reconnect at offset 12,729,763 but server didn't support it
ERROR: An error occurred during the fetch of repository 'aws':
Traceback (most recent call last):
File "I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/third_party/repo.bzl", line 188, column 33, in _third_party_http_archive
ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz, https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz] to I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp1096286104503363444/1.7.336.tar.gz: Tried to reconnect at offset 12,729,763 but server didn't support it
ERROR: I:/src/vcpkg/buildtrees/tensorflow/x64-windows-dbg/tensorflow/core/platform/s3/BUILD:76:11: //tensorflow/core/platform/s3:s3_file_system depends on @aws//:aws in repository @aws which failed to fetch. no such package '@aws//': java.io.IOException: Error downloading [https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz, https://github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz] to I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp1096286104503363444/1.7.336.tar.gz: Tried to reconnect at offset 12,729,763 but server didn't support it
ERROR: Analysis of target '//tensorflow:install_headers' failed; build aborted: Analysis failed
INFO: Elapsed time: 1100.858s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (174 packages loaded, 11226 targets configured)
FAILED: Build did NOT complete successfully (174 packages loaded, 11226 targets configured)
///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
the point is the folder (I:/src/vcpkg/buildtrees/.bzl/_bazel_mmd/gedkvm5a/external/aws/temp1096286104503363444) is randomly generated , i cant  copy 1.7.336.tar.gz to this folder.

@kuelite Do you have a proxy configured on your machine? This unfortunately breaks things because there are several (build) systems nested in each other (Windows -> vcpkg -> MSYS2 -> Bazel -> Java) and not all correctly "forward" proxy configurations and CA root certificates to each other (CA root certificates might be needed if your antivirus solution does https scanning).
To fix this, I added support for several environment variables. If you have a proxy on IP <IP_ADDRESS> and port 8080, you need to set the following before calling vcpgk.exe (note that it's http:// both times, not https:// for the second variable):
set HTTP_PROXY=http://<IP_ADDRESS>:8080/
set HTTPS_PROXY=http://<IP_ADDRESS>:8080/

If your antivirus solution installed a CA root certificate on your machine to scan https traffic, you need to export it in PEM format (run mmc, add snap-in "certificates", find the certifcate in "trusted root CAs" folder and export it); find the cacerts file inside your Java installation (or the temporary Java installation inside the buildtrees\.bzl folder, or download Java and extract it), copy it somewhere, e.g. C:\my_cacerts, and add the exported certificate in the PEM file via the keytool utility that is part of Java, e.g.:
keytool -keystore C:/my_cacerts -import -alias MyAntivirusSolutionName -file exported_certificate.pem

The default password of cacerts seems to be "changeit" on most Java installations. When done, set the following variables to convince Bazel to tell Java to use your cacerts file, and convince vcpkg to pass the variables to Bazel. Please pay attention to use forward slashes (not backslashes) in the BAZEL_CUSTOM_CACERTS variable because backslashes would get messed up on their way through all the (build) systems:
set BAZEL_CUSTOM_CACERTS=C:/my_cacerts
set BAZEL_CUSTOM_CACERTS_PASSWORD=changeit
set VCPKG_KEEP_ENV_VARS=BAZEL_CUSTOM_CACERTS;BAZEL_CUSTOM_CACERTS_PASSWORD

When done, you might run into the next error (like me): the innermost build system eventually invokes git to download dependencies; it doesn't use its own git but your Windows git installation; unfortunately, not all git installations can deal with being called via Windows -> vcpkg -> MSYS2 -> Bazel -> Java -> git (I had git installed from https://git-scm.com, which didn't work. I switched to https://gitforwindows.org, which worked. Apparently they both have the same code base, but are obviously built/linked slightly differently...). Finally, when we're so fed up at some point that you just want to suppress the SSL verification, you might stumble upon other pitfall: When git is invoked via Windows -> vcpkg -> MSYS2 -> Bazel -> Java -> git, it "thinks" that your home is below the MSYS2 installation, so it doesn't use C:\Users\yourusername\.gitconfig but C:\path\to\vcpkg\downloads\tools\msys2\some_hex_code\home\yourusername\.gitconfig, which doesn't exist, so you need to copy it there.

@NancyLi1013 maybe it's worth to copy my how-to in the previous comment to some documentation section as it might affect more users?

Thanks @jgehw for the details!
@kuelite, does this solve your problem?

thank you in advance, i will take a look later
------------------ 原始邮件 ------------------
发件人: @.>;
发送时间: 2021年5月25日(星期二) 下午2:39
收件人: @.>;
抄送: @.>; @.>;
主题: Re: [microsoft/vcpkg] [tensorflow[*]:x64-windows] build failure (#15542)
Thanks @jgehw for the details!
@kuelite, does this solve your problem?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

Ping @kuelite for response, does this issue still exist?

@kuelite Is still work for this issue? I will close this issue, please open it if there is any progress。


[CALCITE-600] Create UnionFactory and use in rules containing Union operator

There's already a SetOpFactory that can create union, intersect, minus. To create a union, you just need to pass in SqlKind.UNION as the first argument. Can you use that please?

Thanks @julianhyde , I changed the code to use SetOpFactory instead.


"npm install" always hangs on https://registry.npmjs.org/run-applescript

Which @angular/* package(s) are the source of the bug?
Don't known / other
Is this a regression?
Yes
Description
npm install always hangs at https://registry.npmjs.org/run-applescript during npm install.
My system
WSL2 on Windows 11
32g ram
Intel i7-8700
npm 10.8.1
node v20.15.0 (also tried on 18 and 16 to no avail)
Ubuntu 22.04.2 LTS
Also, my globally installed packages
npm list -g --depth=0
/usr/local/lib
├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>
I will test this some more once I get home on a more beefed up system running Ubuntu nativly.
Procedures to replicate

Attempted to start a new project via ng new my-proj (SASS, no SSR/SSG/Prerendering)
ng new hangs after selecting n to SSR on CREATE test/public/favicon.ico (15086 bytes)
ctrl-c out of ng new and rm -rf my-proj
Repeat steps 1-3 until it does not hang mysteriously?
Some time shortly after development project stops working - says missing packages and whatnot. (Validated this happened 2x now after recreating project)
Attempt to rm -rf node_modules and  npm install again.
Attempt step 6 again, this time also deleting package.lock
Attempt step 7 again after npm cache clean --force and npm cache verify
Always hangs on package run-applescript
MFW

Please note, it's so borked on the npm install that I have to sudo kill -9 it's PID every time. Can't quit out like normal, it just hangs. I have left it running for upwards of 20 minutes, and it is still hanging.
Also, during the process of writing this, I did get it to finish a hung ng new, but it took over 45 minutes. It looks the same as my previous ng new which did not hang.
My package.json
The only difference from a new install is that I also installed angular material, but I would assume that my issue is probably related to the same one I had with my initial creation of the project, so I am posting it here and not in the angular material issues.
{
  "name": "my-proj",
  "version": "0.0.0",
  "scripts": {
    "ng": "ng",
    "start": "ng serve",
    "build": "ng build",
    "watch": "ng build --watch --configuration development",
    "test": "ng test"
  },
  "private": true,
  "dependencies": {
    "@angular/animations": "^18.0.0",
    "@angular/cdk": "^18.0.4",
    "@angular/common": "^18.0.0",
    "@angular/compiler": "^18.0.0",
    "@angular/core": "^18.0.0",
    "@angular/forms": "^18.0.0",
    "@angular/material": "^18.0.4",
    "@angular/platform-browser": "^18.0.0",
    "@angular/platform-browser-dynamic": "^18.0.0",
    "@angular/router": "^18.0.0",
    "rxjs": "~7.8.0",
    "tslib": "^2.3.0",
    "zone.js": "~0.14.3"
  },
  "devDependencies": {
    "@angular-devkit/build-angular": "^18.0.5",
    "@angular/cli": "^18.0.5",
    "@angular/compiler-cli": "^18.0.0",
    "@types/jasmine": "~5.1.0",
    "jasmine-core": "~5.1.0",
    "karma": "~6.4.0",
    "karma-chrome-launcher": "~3.2.0",
    "karma-coverage": "~2.2.0",
    "karma-jasmine": "~5.1.0",
    "karma-jasmine-html-reporter": "~2.1.0",
    "typescript": "~5.4.2"
  }
}

Attempts to remedy
Removing node_modules and reinstalling
Removing package.lock and reinstalling
npm cache clean --force
npm cache validate
Restarting my machine
Removing angular material from the list of packages
Installing tslib myself
Installing run-applescript myself
Complaining to my boss
Praying
Please provide a link to a minimal reproduction of the bug
https://github.com/ihormelgp/ng18-npm-i-brokey
Please provide the exception or error you saw
npm install --verbose always stuck on the following line

...
npm http fetch GET 200 https://registry.npmjs.org/eastasianwidth 4ms (cache hit)
npm http fetch GET 200 https://registry.npmjs.org/fast-json-stable-stringify 4ms (cache hit)
npm http fetch GET 200 https://registry.npmjs.org/bundle-name 5ms (cache hit)
npm http fetch GET 200 https://registry.npmjs.org/default-browser-id 6ms (cache hit)
npm http fetch GET 200 https://registry.npmjs.org/run-applescript 3ms (cache hit)
⠇

Please provide the environment you discovered this bug in (run ng version)
Angular CLI: 18.0.5
Node: 20.15.0
Package Manager: npm 10.8.1
OS: linux x64

Angular: <error>
... animations, common, compiler, compiler-cli, core, forms
... platform-browser, platform-browser-dynamic, router

Package                         Version
---------------------------------------------------------
@angular-devkit/architect       0.1800.5 (cli-only)
@angular-devkit/build-angular   <error>
@angular-devkit/core            18.0.5 (cli-only)
@angular-devkit/schematics      18.0.5 (cli-only)
@angular/cli                    18.0.5 (cli-only)
@schematics/angular             18.0.5 (cli-only)
rxjs                            7.8.1 (cli-only)
typescript                      <error>
zone.js                         <error>

Anything else?
Prolly a good idea to add that feature --verbose to ng new so people like me can give more details, but I think what I got is still pretty decent.

This sounds like an NPM issue, especially if it also happens if you just invoke npm install outside of the CLI.

This sounds like an NPM issue, especially if it also happens if you just invoke npm install outside of the CLI.

I have no issues with angular 11, 13, and 17 from previous projects. I do however, have issues with this angular project. I have even tried installing the package it gets stuck on standalone in a new repo and it works fine.
Eg.
npm init -y
npm i run-applescript

No errors there. I am assuming there is something else funky going on here? Maybe it is an npm error, but this would have to be a weird edgecase for me to only have it here.
I did even try upgrading my npm version to the latest before I made this post. I don't remember what I had installed before, but I still had the same issue then.

Closing this issue as it is not caused by Angular CLI. According to the NPM status page (https://status.npmjs.org/), there are no reported issues. The problem likely lies either with your registry (if you are using an NPM registry proxy) or something within your environment.

Did you manage to get it running from the repo I provided?

I apologize. Somehow, somewhere, I 100% have a npm install that is broken just enough to not work on angular 18, but good enough for all previous versions. Not sure how this is poss since this is a relativly new install, but it is. What a great excuse for me to dockerize our apps!


Created contribution.md file issue #142

Closed issue #142.

 Here is an overview of what got changed by this pull request:

Issues
======
+ Solved 1
- Added 44

See the complete overview on Codacy

@Antaripa your fork is not updated properly. Please update your fork forcefully and then create a new fresh PR. :)

@Antaripa take reference from this https://stackoverflow.com/questions/9646167/clean-up-a-fork-and-restart-it-from-the-upstream


Planning ROS Hardware Interface

The structure to implement ROS client-based control onto the the P1AM-100 controller setup, but not fully implemented.
Design Decisions remaining:

should we allow both Serial and ROS -based remote connections to be open at the same time
hydraulic motor power status. There's an open channel in the power button, I'd like to have a connection to the PLC which checks for whether it's open or closed to have remote motion requests rejected if power is off

Controller Hardware Interface Design
I am considering the code on the PLC to be the controller hardware interface and build in the option for a true controller on ROS (not implemented on the PLC). This is standard practice for the ros_control package and most all ROS robots.
The h_controller.ino interface method is heavily dependent on how the hydraulic value operates. Switching out the valve will change most of the code in this file and need to be rewritten.
Current situation is weird from a controller standpoint because it is a 3-state control: up, off, down. It's effectively a position-based controller, but not a very good one because how poorly we can control the position of the actuator.
It might be useful if the new valve can be treated as an effort based controller, or minimally a more accurate position-based controller. This may simplify the hardware interface.
End of day: I think getting rid of overshoot is going to be important from a control perspective. Even for the forging setup.
Force Application Method
I think the 'set target position inside of material' method of applying force is still the right path to follow. I don't know of any other way yet.

Development for this Issue is underway in branch ros_client_interface

Notes on types of controllers:

Controllers are defined by the type of control input and the type of output they use to drive the joint.

The position-based JointTrajectoryController of ros_control is an open-loop controller. Position commands are forwarded to the hardware interface and the deviation is measured inside the controller’s feedback. If the path deviation gets too large, the action sent to the controller will simply fail, there won’t be any corrections.

Effort controllers control the force of a linear actuator. They are named effort as the interface agnostic to the joint type.

hydraulic motor power status. There's an open channel in the power button, I'd like to have a connection to the PLC which checks for whether it's open or closed to have remote motion requests rejected if power is off

In the PLC we can devote digital input pins 4 & 5 to checking if the power is on or off

should we allow both Serial and ROS -based remote connections to be open at the same time
If it is not creating a problem, I suggest keeping both for now.

hydraulic motor power status. There's an open channel in the power button, I'd like to have a connection to the PLC which checks for whether it's open or closed to have remote motion requests rejected if power is off
Sounds like a good idea, as long as we're sure about the wiring. I'm happy to assist.

Switching out the valve will change most of the code in this file and need to be rewritten.
We are not planning to switch out the valve. We are adding a flow control valve that will allow us to slow the press, but the existing solenoid valve will continue to control up/down/off behavior.

We are adding a flow control valve that will allow us to slow the press, but the existing solenoid valve will continue to control up/down/off behavior.

Will the flow control valve be mechanically or electronically controlled? Ie, can we control the speed from the PLC?
Idea for the Remote Connections
How about using the onboard toggle switch to change between remote modes? Selecting either ROS or Serial

Will the flow control valve be mechanically or electronically controlled? Ie, can we control the speed from the PLC?

The flow control valve takes a 12V PWM signal (max 1A). I believe there is an available PWM output on the PLC, but we may need to add a solid state relay to handle the current.

Idea for the Remote Connections How about using the onboard toggle switch to change between remote modes? Selecting either ROS or Serial

Not sure what toggle switch you're referring to. Also, I don't know what problem with the existing setup the toggle switch is meant to correct. If it fixes something and it's easy to implement, it sounds like a great idea.

Toggle switch is on the body of PLC.
Per Manufacturer: The toggle switch be can used like a normal digital input. It doesn't alter any behavior on it's own so make sure to write code to include any desired functionality.
pinMode(SWITCH_BUILTIN, INPUT);	 //Set switch to digital input
digitalRead(SWITCH_BUILTIN);     //Read switch state. 1-up, 0-down.

Why do this?
Mostly code design simplicity. Since both interfaces are actively waiting to receive a motion request, I need a way to set which has priority. Assuming all three connections are 'enabled' at once, I recognize these options..

Opt 1. Strict ladder priority. 1-Manual,  2-Serial,  3-ROS
Opt 2. Tree priority. 1-Manual,  2-Serial or ROS based on a state variable

I think Opt 1 would programmatically annoying to implement and I can't think of a use case.
We should go for Opt2. Only annoying part would be the need to open the cabinet to flip switch if you want to change control states. Further, if we put a digital readout screen on the cabinet, we can show a symbol indicating the current state.
For clarity, the ROS joint_state publisher will always report the position regardless of the control mode. This behavior mimics that of the ROS industrial packages.
I'm planning to hold off on any further development until new flow control valve is installed, but we can continue discussion here.

PR #3 deploys the SWITCH_BUILTIN as a ethernet network connection ON/OFF mode switch.
This effectively enables/disables ROS, though a ROS node handle is still initialize on the system regardless of switch state.

#11 formalizes ROS interface. Closing this Issue with the release of v0.2.0


uint8 retrieval fails with _UFuncOutputCastingError when running on :memory:.

When retrieving data from a collection of dtype uint8, it fails if client is initialized on :memory:.
This does not happens when connecting to a server on localhost.
Using qdrant-client 1.12.1.
Minimal reproducible example:
import numpy as np
from qdrant_client import QdrantClient
from qdrant_client.http import models
from qdrant_client.http.models import Distance, VectorParams, Datatype

# Generate random int8 vectors
vectors = np.random.randint(0, 256, (256, 512), dtype=np.uint8)

# Initialize client
client = QdrantClient(":memory:")
collection_name = "test_int8"

# Delete collection if exists
if client.collection_exists(collection_name):
    client.delete_collection(collection_name)

# Create collection with int8 vectors
client.create_collection(
    collection_name=collection_name,
    vectors_config=VectorParams(
        size=512,
        distance=Distance.COSINE,
        datatype=Datatype.UINT8
    ),
    on_disk_payload=False
)

# Upload vectors
points = [
    models.PointStruct(
        id=idx,
        vector=vector.tolist(),
        payload={"metadata": f"point_{idx}"}
    )
    for idx, vector in enumerate(vectors)
]

client.upsert(collection_name=collection_name, points=points)

# Try to retrieve vectors - this will raise an error
client.search(
    collection_name=collection_name,
    query_vector=vectors[0].tolist(),
    limit=10
)
print("Search successful")

If you use :memory: is not a real qdrant engine, but python implementation of the API. If you are looking for performance, please use docker or cloud


Core Data Components: Place Details sidebar and 'Related Media' Gallery

In this PR
This PR adds two more components to the geospatial package.

The "place details" sidebar component from the Peripleo-based Core Data client
The Clover-IIIF-based gallery viewer that is used by the sidebar

Note #1: the sidebar is effectively headless, without styling. The component has Tailwind style classes included. But I wasn't sure how set up tailwind in Storybook (or if this is even desired).
Note #2: all Core Data components depend on some general TypeScript types, which I have included in this PR, in the CoreDataTypes file.

Closing in favor of #252.


Will add BEVDet ? Thanks

here, https://github.com/open-mmlab/mmdetection3d/pull/1952. We'll appreciate it if you can continue to implement this PR.


Add instrumentation for redis.asyncio in redis-py

Is your feature request related to a problem? Please describe.
No timings are reported when using redis.asyncio client in redis-py >= 4.2.0-rc1
Feature Description
Add instrumentation for the async client of py-redis that was added on 4.2.0-rc1
Describe Alternatives

Additional context
aioredis has been moved to redis-py starting on version 4.2.0-rc1. Only redis-py will be maintained going forward.
Priority
Please help us better understand this feature request by choosing a priority from the following options:
[Nice to Have, Really Want, Must Have, Blocker]
Really Want

Added with v8.6.0


Added retry around writing cache

Fixes #71 by adding a retry around writing to the token cache. It retries the write every 250 milliseconds for 1 second.

@weinong We've been running this for the last week within the team and have not had this error happen once.


Request for improved details surrounding Envoy stats and metrics documentation

Title: Request for improved details surrounding stats and metrics documentation
Description:
When customers are debugging issues such as connection resets failures (Contour/Envoy) deployment there have been requests for more in depth descriptions for metrics and statistics that are available in Envoy and documented on the Envoy page.
One example of this is the “upstream_cx_destroy_with_active_rq” metric. It is defined as "Total connections destroyed with 1+ active request". Also found an older issue where a similar request was made, specific to this metric, https://github.com/envoyproxy/envoy/issues/6455
A second example is the "upstream cx_open" stat, but it is not clear how connections are managed, when are they closed when are the reused, etc.
This request is general but provides two examples.
[optional Relevant Links:]
https://www.envoyproxy.io/docs/envoy/latest/configuration/upstream/cluster_manager/cluster_stats
https://www.envoyproxy.io/docs/envoy/v1.15.0/configuration/http/http_conn_man/stats#config-http-conn-man-stats

@MCCoyAle I would like to take up this issue. Although I am beginner but with a little guidance and support, I believe I can rectify this issue.

Oh wow. Just saw this in my backlog. I may try to tackle since I have newly added time to my schedule.


cli for linux?

Hi there,
landed here from alienfx github issue page. I am wondering how hard would it be to compile alienfx-tools, or a subset of it, under linux? You have solved the hid interfacing, may be a simple cli tool working under linux would render all folks@alienfx happy, me included!
Cheers,
Chris.

Well... I only use Linux in VM or cross-translation for ARM, so i can't do it myself.
But you can port CLI/SDK yourself, if you wish.
What you need to do:

I use Windows types (like WORD, DWORD). It needs to be mapped to Linux ones.
Modify detection functions (AlienFXCheckDevice, AlienFXInitialize) to scan HID Linux way.
Modify PrepareAndSend to use Linux USB IOCTRLs, not Windows.

After this step, basic functions like "set one light"/"set one light effect" will work.
But for mass-updates, you also need to convert Mappings class - it's using registry now, and needs to be altered to /etc config file - mass-updates require light ID's list.

Thanks for the details. I'll certainly try to include this within openrgb, it detects some subsets of the hid associated with the alienware keyboards.

Feel free to use my SDK - check how i detect various Alienware chips (BTW, it's not only Alienware) and interfaces will be the same (but keep in mind - some controlled by report, some by feature, some by direct data!).
AW keyboards can have both Alienware and Chicony IDs (or even Darfon one for internal notebook RGB keyboards), it's listed into alienfx-controls.h


Diksha ETB - Summary rollup data set to get for one day data [Day before yesterday's data from current date]

Purpose of the Feature
As of now cQube is getting 6 days of data from Disha in each API call. As API call will be triggered every day, Not required to get the past 6 data as it is duplicate data.
So, the proposed changes is for ETB - Summary rollup data set API call should be happened for one day that should be Day before yesterday's data from current date.
Described the solution
Need to alter the API call and set to get the data for one day from NIFI processor.
**Effected code areas **
Nifi - Update attribute processor (From and To dates has to be changed)

Updated the data flow.


UI thread waits on connect method

Hello,
We are using your project in our application and it works great except for one issue:
When connecting to server with very slow network the application freeze on connection method for few seconds (sometime more than 10!).
I would expect the connection functionality to be totally (and real) asynchronous so no matter how long it take to get connected it won't stuck the application.
There is nothing special in our code for connecting - very similar to your sample code.
Please advise
Thanks
Zvi Agmon
Lexifone

Yes this is a big problem on highly latent networks.  You seem to be doing the createSocket on the main thread and this is what blocks

After further investigation it is not the createSocket that is blocking but rather the wait/notify block you have around the THREAD calling createSocket.  zviag a fix for now would be to have a separate HandlerThread that you delegate all interactions with autobahn to.

Thanks for your response. I did try to run autobahn in different thread but had to make some changes to autobahn code in order for that to work:

I added to ThreadHandler and  WebSocketConnection constructors a Looper parameter. The WebSocketConnection  just pass it to  ThreadHandler.
then creating  WebSocketConnection with Looper.getMainLooper() as the Looper parameter.
With these changes I could run  autobahn in different thread.
Is this the kind of solution you suggest?

same problem i am also facing . i am binding the data in listview on message recieve  and it is freezing the application

yes, this is an issue that will be addressed as part of https://github.com/crossbario/autobahn-android/issues/92
the issue is: while actual socket IO already happens off the main thread, the initial connect not. and Android got stricter on that ..
closing this one, as it'll be addressed as part of above linked issue. thanks


I can't install any extensions

Type: Bug
When I try to install any extention any error shows Error while installing 'Python' extension. Please check the log for more details.
Some extention which i installed earlier and due to personal eason i'm not able to use so it shows This extension is deprecated as it is no longer being maintained. Please use the built-in Settings Sync functionality instead.
Setting in vs code shows The editor could not be opened due to an unexpected error: Unexpected token 'i', "import ran"... is not valid JSON.
please help me with it.
VS Code version: Code 1.88.1 (e170252f762678dec6ca2cc69aba1570769a5d39, 2024-04-10T17:41:02.734Z)
OS version: Windows_NT x64 10.0.22621
Modes:

Hi @IamNayana
Thank you for reaching out to the VS Marketplace Team. We were unable to reproduce the issue. Could you please share more details about the issue so that we can take a look quickly.
VS Marketplace Team

we have not heard any response, we are closing the issue. If the issue still persists, please recreate a new issue or reactivate the existing one.
Regards,
VS Marketplace Team


1.0: Ignored Pylint issue 'consider-using-f-string' in new Pylint 2.11

Rolls back PR #230 into 1.0.2.

Coverage remained the same at 35.922% when pulling 09a887ecbbde8d888cb82c5b1d954050abbc705f on 1.0/andy/fix-pylint-f-string into f041bfac5aaef7045d32ebd1ee21c220ce7903b2 on stable_1.0.


z/OSMF Lite and sysreq reorg

Refactored the system requirements
Refactored Node.js install.
Added z/OSMF Lite doc that Cathy completed.

Hi Nayer, Zhi, @NayerNajafi @lilzhi
As mentioned in the email, this file https://github.com/zowe/docs-site/blob/zosmf-updates/docs/user-guide/systemrequirements-zosmf-lite.md is the one that needs to be reviewed particularly. Other edits were organization changes made to fit in the z/OSMF Lite section. Thanks!


Update to Bootstrap 3.3.4

http://blog.getbootstrap.com/2015/03/16/bootstrap-3-3-4-released/

Point of this is...?


calculate weights for on_initialize

on_initialize needs to return its consumed weight.
currently, there's no upper bound on the amount of ongoing matches.
since on_initialize iterates over all matches, there's no upper bound on the maximum possible weight to be consumed.
todo:

a new Config type MaxOngoingMatches: Get<u32>
a new StorageValue called MatchCounter
logic increasing or decreasing MatchCounter when appropriate
a check inside create_match verifying whether MatchCounter <= MaxOngoingMatches::get()

Suggestion to get rid of the on_initialize  hook: add an extrinsic that a player can call to win the game and retrieve the deposit from both players, if the opponent's time to make a move has expired.

closed via #15 and #16


allow separate event store and snapshot stores

Minimal set of changes to allow different storage for events and snapshots. If you don't care there's no impact, as IProvider implements both.
Arguably makes the Persistence API and internal code a little cleaner
closes https://github.com/AsynkronIT/protoactor-dotnet/issues/186

@tomliversidge can this be ready to merge soon?

Looks like there's a problem needs fixing first:
error CS0246: The type or namespace name 'Provider' could not be found (are you missing a using directive or an assembly reference?) [C:\projects\protoactor-dotnet\tests\Proto.Persistence.Tests\Proto.Persistence.Tests.csproj]


Pool protocol

I think this one should be postponed. Not enough input here.

Closing this due to inactivity.


chore(krew-crm-api): remove API project from workspace

The Krew CRM API (GraphQL) will be removed from this monorepo. A more generic API implementation (CRM) have been moved to https://github.com/move4mobile/coders-workspace

:tada: This PR is included in version 0.6.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


taskSetup - Install the tool AzureSignTool to the local machine using the dotnet CLI

On our OnPrem- BuildAgent-Machines AzureSignTool is already installed. (And if not it will be after the first run of this task.)
So using this task we always get the error message:
....
Running Pre Signing Activities
"C:\Program Files\dotnet\dotnet.exe" tool install --global azuresigntool
##[error] "azuresigntool" is already installed.
Is it possible to configure this pre-signing installation using a variable?

Hi @mkossiek
We already try to handle this behavior silently on this line https://github.com/PowerON-UK/AKV-Code-Sign/blob/88b30703aad8fc791916f681643189d7c7c8e033/task/taskSetup.ts#L12C110-L12C110 but it looks like the output your getting is slightly different which is then tripping up as I believe the output in your case doesn't start with the word Tool.
This should be a simple enough fix by changing it from a startsWith to a contains and handling both single and double quotes. I'll try and get some time this week to test and push an updated version

Thanks for the update and for posting the workaround. The fact that the server is in German is likely the issue as the check won't be translating the string. It should be an easy enough fix by just adding the German string to the check 😄

@mkossiek I've just pushed version 1.0.3 to the marketplace which includes a bypass for that error in German as well, could you test and let me know if it fixes your issue please?

@mkossiek I've just pushed version 1.0.3 to the marketplace which includes a bypass for that error in German as well, could you test and let me know if it fixes your issue please?

Looks very good! Runs without my workaround. Thank you very much!

Wonderful News!


adding description for support of product arrays with Snap CAPI

Proposed changes
Snap CAPI Destination needs to allow customers to pass arrays of products in conversion events.
This capability is being added with this action-destinations PR.
Once deployed, this docs update explains the change.
Merge timing

Merge only after the PR above has been deployed.

Related issues (optional)
https://segment.atlassian.net/browse/PE-88

@joe-ayoub-segment - Is this PR ready to merge?

Hi @forstisabella , we just deployed the Snap change a moment ago, so yes you can deploy this doc change please!


revert PointLightBundle to DirectionalLightBundle change made to asset_loading example between 0.12.1 and 0.13.0

Objective

revert a single-line change made to examples/asset/asset_loading example between v0.12.1 release and v0.13.0 release which resulted in a too-bright, washed-out rendering

Solution

reverted the changes made to this example between v0.12.1 and v0.13.0

Complete diff of this example between v0.12.1 and v0.13.0
diff --git a/examples/asset/asset_loading.rs b/examples/asset/asset_loading.rs
index 6a931dc62..24b912597 100644
--- a/examples/asset/asset_loading.rs
+++ b/examples/asset/asset_loading.rs
@@ -79,8 +79,8 @@ fn setup(
         ..default()
     });
     // light
-    commands.spawn(PointLightBundle {
-        transform: Transform::from_xyz(4.0, 5.0, 4.0),
+    commands.spawn(DirectionalLightBundle {
+        transform: Transform::from_xyz(4.0, 5.0, 4.0).looking_at(Vec3::ZERO, Vec3::Y),
         ..default()
     });
     // camera

Rendered example as of v0.12.1

Rendered example as of v0.13.0

Rendered example with the changes in this PR (revert to v0.12.1)


CFY-5509 Allow uploading plugins from a URL

The infrastructure was already there - I just made sure the local validation wouldn't be triggered in case the plugin path is a URl

@nir0s regarding tests, I see that the cli_runner isn't up and running, and all the tests seem to be using it, so I'm not sure whether I should write tests that would use it, or what.

Commited directly to cfy-redo


Wayland backend xdg

A few notes:

I made a new list for protos to only generate some as client headers, we might want to always generate them and simplify that.
as described in 2nd commit message, failing to create any display does not fail the backend, it probably should.
I didn't find how to set a class, closest I could find was app_id. Should I? (there is a comment in the code)

Rest looks like it works ok.

If there is a wayland compositor (i.e. WAYLAND_DISPLAY set in the current env) but it does not implement xdg shell it's ok to simply fail IMO, using the drm backend will probably not work anyways in this case (since there is a wayland compositor).
But we could at least add an error log (i don't think there is currently one) e.g. simply check in wlr_wl_registry_poll if all globals we need (and assume to be present later on) are present and output an error (or warning depending on the importance of the global) if it is not there so we know at least what went wrong from looking into a log.

Oh and this does not work for on weston.
It outputs
zxdg_surface_v6@12: error 3: xdg_surface has never been configured

and does not show anything.
xdg_surface is a pain to implement correctly for all compositors.
We should test this on all major compositors.

Ah, only tested with sway. Will test others.. But not sure what to change, I used weston-terminal as xdg example heh. Will have a look later.

Soo.. the way wayland works is that their xdg shell struct ('window') has a inhibit_redraw flag, and they're setting that to inhibit on shell surface creation and back to 0 on xdg_surface_handle_configure...
I guess we're going to need something similar :/
Didn't look far but gnome wayland seems to have a similar error ("wl_surface@10: error 3: buffer committed to unconfigred xdg_surface")

hm I'm actually confusing our test compositor code with that, no clue where in the wayland compositor output code we say that we want draw the surface. Will try to figure what exactly prints that message and see if we can delay it somehow.

Haven't/not able to test kde or enlightenment, but it's finally starting to shape up.
Regarding fail, we could fail in wlr_wl_registry_poll but does having the global guarantee that it will work later? I'd rather check if an output has been init in attempt_wl_backend really.
The problem as I said is that this function is called twice during our init, and the first time will not set up outputs (it's just counting the number of requested outputs the first time) so I need a way to tell which pass it is.

Thanks!


Added function video info

I need this function in this package because I found my issue #94 and hope this can also help another issue like #92
thanks

Hi @ferdhika31,
Whilst I appreciate you taking your time to submit this PR, I wouldn't be looking to implement these methods since there are already packages that have this functionality.
I know a lot of people are using this package and alaouy/youtube which offers lots of methods (such as the one in your PR).
Thanks!


[JN-714] fixing test transaction wrapping

DESCRIPTION
There was a test that wasn't transactionally wrapped with rollback, which I think might have been causing the increase in test failures due to race conditions
TO TEST:  (simple manual steps for confirming core behavior -- used for pre-release checks)

reset your local database local-dev/run_postgres.sh start
run java tests ./gradlew test
log into test database.  psql -U test_dbuser -d pearl_test -h localhost.  (password is dbpwd)
confirm select * from study; returns no results

@connorlbark   adding you for a review, since the test steps are something you probably haven't done yet.  And it's a good thing to know how we wrap tests in transactions and what happens when someone (me) forgets to wrap one correctly :)

Hmm... that makes me nervous that it failed a couple of times.  I wonder if there are some more missing transactions we'll have to hunt down in the future


565 adjustment to the dropdown component

Description
Now the select function depends on the current state of the option and the type of dropdown. It checks if the dropdown is single select, and if so, it deselects all options before selecting the current option. If the dropdown is multiple, the option is selected or deselected, depending on its current state. Upon selection or deselection, the function calls setClearButtonIsVisible to update the clear button's visibility. The setClearButtonIsVisible function checks if the dropdown is of type multiple and updates the state of the clear button based on the currently selected options.
Screenshots
https://user-images.githubusercontent.com/106749260/230892853-e829a071-7ccc-4c66-812b-d0b139c15929.mp4
View Storybook
https://62eab350a45bdb0a5818520e-tnhbkilpmz.chromatic.com/
Compliance

[x] I have verified that this change complies with our code and contribution policies.
[x] I have verified that this change does not cause regressions and does not affect other parts of the code.

@Deeved

@PedroMiguel7 it would be good for components with dropdown to check in the test that the button is being called correctly to avoid this. The select component made by @Deeved is the only one that does this check and that's why it's returning an error


View > Expression Type

For Java code IDEA offers a way to pop up the type of a selected expression.
In the Eclipse IDE we do that by hovering a selection.
I don't really care how we do this, but we need some way.

Actually I think we should do this the IntelliJ way, i.e. bind it to ⌃⇧P.

Done, but I wonder if it's possible to highlight the result. Should be.

I guess we just need to extent com.intellij.lang.ExpressionTypeProvider and add it to IdeaPlugin.xml.
I'll try to do it : )


add set to bld.bat to take a look at env vars that are set

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.


Create a logging module.

It would be usefull to get a logging module, able to log when contacts (dis)connect, receiving messages, etc.
Logging would be done in a sqlite database, as it would be easier to query it.

A good thing is to at least know the total number of entries, and apply pagination.


updated See also article names

Docs Build status updates of commit 577b36d:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

mixed-reality-docs/hands-and-tools.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Incorrect result when running the README example

Hello! I think I've encountered a bug. When running this example from the readme:
def sum(depth, x):
  switch depth:
    case 0:
      return x
    case _:
      fst = sum(depth-1, x*2+0) # adds the fst half
      snd = sum(depth-1, x*2+1) # adds the snd half
      return fst + snd

def main:
  return sum(30, 0)

The output is 0. I've tried bend run, bend run-c, and bend gen-cu (bend run-cu says cuda is not available, so I manually compile it with nvcc).
The output on my machine when running sum(24, 0) is 8388608, but on equivalent Haskell and Python programs the programs return<PHONE_NUMBER>66720. The results start to diverge when depth>=13.
I was wondering what could be causing these issues, both the incorrect result when depth>=13, and the result=0 when depth>=25.
My computer specs:

OS: Pop_OS 22.04
CPU: AMD Ryzen 5 2600x (12 cores)
GPU: NVIDIA RTX 4060 ti (16GB)

This is not a bug, but a limitation: Bend only has 24-bit numbers, so, results are always mod 2^24. We will, not in a far future, add u32 and u64. Thanks for reporting!

re-openning the issue regarding this problem:

(bend run-cu says cuda is not available, so I manually compile it with nvcc)

can you tell me which version of the cuda toolkit are you using?

I'm facing the same issue, FWIW - run-cu says CUDA not available, but I do have CUDA and nvcc installed.
$ nvidia-smi
Fri May 17 02:10:24 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.103                Driver Version: 537.13       CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce RTX 2070 ...    On  | 00000000:01:00.0  On |                  N/A |
| 28%   55C    P0              70W / 215W |   5308MiB /  8192MiB |     38%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Sun_Jul_28_19:07:16_PDT_2019
Cuda compilation tools, release 10.1, V10.1.243

oh sorry, can you try installing a newer version of the cuda toolkit to see if it works? (not the one from apt, apt's one is pretty old and lacks a lot of features)

@pema99 oh sorry, can you try installing a newer version of the cuda toolkit to see if it works? (not the one from apt, apt's one is pretty old and lacks a lot of features)

Installed 12.4, same thing
$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Mar_28_02:18:24_PDT_2024
Cuda compilation tools, release 12.4, V12.4.131
Build cuda_12.4.r12.4/compiler.34097967_0```
```$ nvidia-smi
Fri May 17 03:12:29 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.76.01              Driver Version: 552.44         CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 2070 ...    On  |   00000000:01:00.0  On |                  N/A |
|  0%   58C    P0             55W /  215W |     684MiB /   8192MiB |      1%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

@pema99 can you try decreasing the number of TPB and/or BPG on src/hvm.cu to see if it works please? maybe the TPB to like, you do a kinda of binary search on it to see which values work.

(i'm assuming this is the root cause of the problem, considering we only catered to the 4090, since that is the best GPU there is currently, and the one we have)

re-openning the issue regarding this problem:

(bend run-cu says cuda is not available, so I manually compile it with nvcc)

can you please tell me which version of the cuda toolkit you're using?

Currently using cuda 12.4, and the 550.67 NVIDIA drivers.

Closing this and continuing in the HVM repo, considering this is an HVM issue.


avoids creating path object for GC refs

In #3500 it was observed that GC spends a lot of time creating Path objects for each Reference.  This changes avoids creating Path objects for the GC case.
Currently have tested these changes without issue against tests matching the pattern *GC*IT and *Garb*IT.  Looking into doing some further performance test to see if there is an observable difference.

The StoredTabletFile is still a somewhat nicer API than going back to using String again (especially when it's a collection of pairs of strings, which gets quite confusing). If the problem is that StoredTabletFile is doing unnecessary validation, can we have a specific kind of TabletFile that is lighter weight, but still more expressive than strings?

I looked into refactoring StoredTabletFile first and decided against that as I could not see an easy way to do it.  I think the changes @cshannon  has made in 3.0 branch would be a prereq for doing this refactoring.

@keith-turner - I can do a follow on issue to do lazy validation because I agree with @ctubbsii that keeping the new API is a lot nicer than strings so being able to revert these changes in 3.0 would be nice.

I added a PR accumulo-jmh-test so it can now run on the command line.

At it's core, Path is a URI. The Path constructors perform validation on the input, then create and set the URI. Except, when you use the constructor Path(URI), that does not occur and does not incur the cost of the validation. If we used the Path constructors (and the validation) when writing to the metadata table, but used Path(URI) when reading from the metadata table, then we could still keep the Path object vs going back to String.

At it's core, Path is a URI. The Path constructors perform validation on the input, then create and set the URI. Except, when you use the constructor Path(URI), that does not occur and does not incur the cost of the validation. If we used the Path constructors (and the validation) when writing to the metadata table, but used Path(URI) when reading from the metadata table, then we could still keep the Path object vs going back to String.

The primary bottleneck does not appear to be he actual creation of the Path(). It turns out it's the call to Path.getParent() that is the main problem which is only done in our validation logic.

PR to fix this in main is up: https://github.com/apache/accumulo/pull/3502

At it's core, Path is a URI. The Path constructors perform validation on the input, then create and set the URI. Except, when you use the constructor Path(URI), that does not occur and does not incur the cost of the validation. If we used the Path constructors (and the validation) when writing to the metadata table, but used Path(URI) when reading from the metadata table, then we could still keep the Path object vs going back to String.

The primary bottleneck does not appear to be he actual creation of the Path(). It turns out it's the call to Path.getParent() that is the main problem which is only done in our validation logic.

Right, so we call Path.getParent(), with calls new Path(String, String, String). Here's Path.getParent:
  /**
   * Returns the parent of a path or null if at root.
   * @return the parent of a path or null if at root
   */
  public Path getParent() {
    String path = uri.getPath();
    int lastSlash = path.lastIndexOf('/');
    int start = startPositionWithoutWindowsDrive(path);
    if ((path.length() == start) ||               // empty path
        (lastSlash == start && path.length() == start+1)) { // at root
      return null;
    }
    String parent;
    if (lastSlash==-1) {
      parent = CUR_DIR;
    } else {
      parent = path.substring(0, lastSlash==start?start+1:lastSlash);
    }
    return new Path(uri.getScheme(), uri.getAuthority(), parent);
  }

The issue is the last line of the method, right? Could we not create a URI from (String, String, String) and then call Path(URI)?

Is the plan to merge this to 2.1, and omit this change when merging to 3.0 (-s ours), in favor of #3502 fixing it there? Or is there something from this that would still be desirable to keep when going forward?

Is the plan to merge this to 2.1, and omit this change when merging to 3.0 (-s ours), in favor of #3502 fixing it there? Or is there something from this that would still be desirable to keep when going forward?

The only thing to merge forward would be the change to Pair so maybe that should be a separate PR.

Is the plan to merge this to 2.1, and omit this change when merging to 3.0 (-s ours), in favor of #3502 fixing it there? Or is there something from this that would still be desirable to keep when going forward?

The only thing to merge forward would be the change to Pair so maybe that should be a separate PR.

Or just commit the change to Pair, because it's so trivial. If you want it "reviewed", consider this comment my +1 for the Pair changes.

The issue is the last line of the method, right? Could we not create a URI from (String, String, String) and then call Path(URI)?

@dlmarion  do you think we might be able to optimize the validation instead of avoid it?

Pushed the pair changes to 2.1 and main in fbb54c371e9d76f87bc10a4dfa5d3cc28b4519dd

The issue is the last line of the method, right? Could we not create a URI from (String, String, String) and then call Path(URI)?

@dlmarion do you think we might be able to optimize the validation instead of avoid it?

You mean like override getParent() in a subclass, copy the method contents and change the last line to use Path(URI) ?

https://github.com/apache/accumulo/blob/b759a14912b13bade86660c8ba266aec192ab82d/core/src/main/java/org/apache/accumulo/core/metadata/TabletFile.java#L61-L78
Seems like we could just change the validation code to operate on the metaPath constructor argument differently. Maybe instead of calling Path.getParent(), just use metaPath.toURI() and parse the path?

You mean like override getParent() in a subclass, copy the method contents and change the last line to use Path(URI) ?

I am not sure, I have not looked into optimizing what is there.  When I made this PR I was working under the assumption that it was the path object in general that was causing problems.  However after making this PR it was discovered it was the way Accumulo  using the path object.  So I was wondering if we should pursue optimizing the validation instead of avoiding it.  If we are going to avoid validating on read in 2.1.2, then I am wondering if we should validate on write in 2.1.2 as proposed in #3504.

@keith-turner  - see #3509

If we merged in #3509 then I would not be opposed to reverting #3502, but I could see an argument either way. Lazy loading and lazy validation helps performance if you don't need to validate but there is always the issue of a mistake being made and you do lose the immediate check on creation so you may cause a runtime exception later. Adding validation to MetadataContraints would help prevent that in #3504 and #3506 but no guarantee future changes wouldn't invalid metadata be passed and not caught until later . It would make the changes in #3504 simpler if we reverted the lazy load as I had to do some extra work to specifically not lazy load to ensure validation.

Given the comment above, do we still need the changes in this and https://github.com/apache/accumulo/pull/3502?

I am hoping we do not. I do not plan on merging this and hope to close it w/o merging if the perf of #3509 is sufficient.

Closing based on last comment because #3509 is merged and the performance numbers look good on that PR. Can re-open to address this as follow-on, if still needed.


Add Enrollments to the hardcoded genesis blocks

Depends on #821
Our genesis blocks need to have Enrollments in themselves in order to be valid and usable.
Currently the lack of Enrollment means we have to come up with weird workaround for our tests.
Issues such as #822 ended up being slowed down by this.

Not yet

Solved in https://github.com/bpfkorea/agora/pull/984

Not really solved.


WinForms: How to have two plots share a common X axis

To plot two data buffers with different time scales and synchronize them on a common X-axis in ScottPlot:
ScottPlot Version: 5.0.45
I have two different time stamp data buffers with different times in msecs, one with 1k size and the other with 5k. Now I want to have common x axis for this in WinForms scottplot graph

I want to have common x axis for this in WinForms scottplot graph

This should help!
https://scottplot.net/demo/5.0/#shared-axes

I want to have common x axis for this in WinForms scottplot graph

This should help!
https://scottplot.net/demo/5.0/#shared-axes

No, my requirement is to plot the two different x-axis on a single graph

Does this example help solve your problem? It shows a second Right axis, but the code can be modified to enable the Top axis and it should produce the result you're expecting.
https://scottplot.net/cookbook/5.0/MultiAxis/RightAxis/
If not, it may be that I'm misunderstanding your goal. If you could share a screenshot or mspaint drawing of the type of graph you're trying to create, I'd be happy to help you reach your goal.

I have enclosed the screen shot below for your reference. Here the Y-axis has different parameters. And also each parameter having a different X-axis. But here all the parameters X-axis is synchornizing into a single X-axis and plotting the graph


Unable to change position of a role.

Using the newest dev build. Bot has the top role in the server and has administrator. inputRole is somewhere near the middle of the role list.
IRole newRole = await Context.Guild.CreateRoleAsync(inputRole.Name, new GuildPermissions(0), inputRole.Color);
await newRole.ModifyAsync(x => x.Position = inputRole.Position);
I was able to change the name and permissions in a similar way, but position doesn't work.

I made a manual HTTP request with postman and the api seems to just ignore the position parameter. The way the client modifies positions is by using the modify guild roles positions endpoint.

Position is defined by Snowflake and Position, fyi

Is this still an issue? I'm unable to repro


FATAL Could not parse modules: No modules provided

Tried to use this action and failed instantly:

Run fossa-contrib/fossa-action@v1
  with:
    fossa-api-key: ***
    github-token: ***
    skip-test: true
  env:
    GOROOT: /Users/runner/hostedtoolcache/go/1.12.17/x64
/usr/bin/tar xz -C /Users/runner/work/_temp/7d29c9ab-3897-45e0-8692-9c8aff6ccbe4 -f /Users/runner/work/_temp/130d8735-53d8-4807-9e50-04711814f2cc
/Users/runner/hostedtoolcache/fossa-cli/1.1.3/darwin_amd64/fossa init
INFO Initializing...
/Users/runner/hostedtoolcache/fossa-cli/1.1.3/darwin_amd64/fossa analyze
FATAL Could not parse modules: No modules provided
(node:1906) UnhandledPromiseRejectionWarning: Error: The process '/Users/runner/hostedtoolcache/fossa-cli/1.1.3/darwin_amd64/fossa' failed with exit code 1
    at ExecState._setResult (/Users/runner/work/_actions/fossa-contrib/fossa-action/v1/dist/index.js:866:19)
    at ExecState.CheckComplete (/Users/runner/work/_actions/fossa-contrib/fossa-action/v1/dist/index.js:852:14)
    at ChildProcess.<anonymous> (/Users/runner/work/_actions/fossa-contrib/fossa-action/v1/dist/index.js:755:19)
    at ChildProcess.emit (events.js:210:5)
    at maybeClose (internal/child_process.js:1021:16)
    at Socket.<anonymous> (internal/child_process.js:430:11)
    at Socket.emit (events.js:210:5)
    at Pipe.<anonymous> (net.js:659:12)
(node:1906) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)
(node:1906) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

If you use it with a particular Go version, you may need to include these steps. Have you tried it?
https://github.com/fluxcd/flux2/blob/afe0ddcd8400532da5225bb0efc1fc9002c9db42/.github/workflows/fossa.yml#L16-L19

The error is not as reader-friendly as we'd expect, but it's probably not a problem with the action itself.
At least that error is from fossa-cli: https://github.com/fossas/fossa-cli/blob/fc60c6631a5d372d5a45fea35e31665b338f260d/cmd/fossa/cmd/analyze/analyze.go#L243

The error message is improved in the latest release.

Thanks for your help @smorimoto
I've managed to track down the issues thanks to your links.

I'm glad it solved! It's always a good idea to scan licenses. Feel free to ping me if you are stuck again :)

By the way, you can set skip-test to false to find out which code has licensing issues before merging them: https://github.com/fossa-contrib/fossa-action#inputs


Request: "carried define"

So, for specific reasons I don't want to get into, the OpenGL part of an engine I'm working on has a very specific naming convention I need to use (basically, I have only a number to deduce the name of the uniform I'm setting a value to - OpenGL 3.3 Core, cannot use Compatibility).
The only way I've found to do this and use XSC, is to manually change the output's uniform names, from (for example)
uniform mat4 vreg_0;
#define ModelToWorld vreg_0

And then the meat of the code translated via XSC can be used as-is.
My request: Can we somehow have a way to tell XSC to "carry a define through"?

Silly implementation idea: "@#define" forces the define to be carried through

Do you have these macros (i.e. 'defines') in your HLSL code that you'd like to preserve in the output code?
Or do you want to add those macros afterwards, so that Xsc inserts them after the #version directive?
Anyways, have you tried to use the shader reflection to automatically generate the macros using the ReflectionData::uniforms member?

Do you have these macros (i.e. 'defines') in your HLSL code that you'd like to preserve in the output code?

That's the short version of it, yes. Technically, we may want to generate the macros through macros :P (a macro that would generate both a variable definition, and another macro defining the name)

Anyways, have you tried to use the shader reflection to automatically generate the macros using the ReflectionData::uniforms member?

That looks interesting. How can I do that?

Xsc is currently does not support macro preservation, because all macors must be evaluated before the input shader is parsed and analyzed.
So I think the only option right now is to insert your macros afterwards.
Using the shader reflection could look like this:
Xsc::Reflection::ReflectionData myReflect;
if (Xsc::CompileShader(myInputDesc, myOutputDesc, nullptr, &myReflect)) {
    for (const std::string& uniform : myReflect.uniforms) {
        /* Use 'uniform' string to append macro ... */
    }
}

The uniform wvpMatrix in the following HLSL vertex shader will be contained in the shader reflection:
uniform float4x4 wvpMatrix;
float4 main(float4 p : POS) : SV_POSITION {
    return mul(wvpMatrix, p);
}

However, the shader reflection in general is still some how restricted, but maybe it'll work for you.

Those uniforms are only described as Strings and not have "more data"; basically, I can't change their names to match our spec (as I need to change their names AND guess the new names easily). Reflection is unfortunately a nope in this case :(
This may end up becoming a "new feature" of sorts for XSC: Annotations. I'm not "officially" requesting it, but if you could consider it for your personal backlog, it would be grand. (I don't exactly have a clue about how to help implement it, to be honest, or where to throw experimental code for it.)

Does my previous suggestion work for you, or is this still an open issue?

Can you share such a String please? I still have trouble to understand the situation you are in.

No need, we're kind of abandoning the reflection. I managed to get some data "into" reflection, but it doesn't get into the outgoing GLSL (yet anyway), so it doesn't serve our purposes. We've managed to code a post-processing script for our purposes, so you can consider the issue "somewhat" resolved.
I'd love to discuss the intricacies of what we're trying to accomplish over an IM session!

OK, alternatively you can maybe add the macro output to the GLSL backend in your fork (i.e. the GLSLGenerator.cpp source file).
BTW: what was "IM" again?

Instant Messaging :P

Ok, just use the EMail on my homepage, if you want to go into more details.


Fix calculate Residual and Jacobian in rans3p

In the last merge, some new parameters are added to the RANS3P 2D case. In this PR, we add same parameters for entropy method and 3D cases in order to keep the interface of calculateResidual and calculateJacobian consistent.

@arnsong and @Milad-Rakhsha this also changes to our new convention on signed distance and solid normal for level set representation of the solid (negative inside solid, normal pointing out of solid, so n=grad(phi_s)). Thanks @wacyyang .