allows anyone to post vesting schedules

Here's the context why we need it: https://github.com/moleculeprotocol/IPNFT/pull/86/files#diff-20be5947c268129925fab9554891087bbe730779d8c5d38c7592388784dbd05bR52
transfers the needed vesting amount before the schedule is created

think the major issue with this approach might be an attacker that spams an arbitrary amount of minimal schedules for another party. Resolving these with releaseAvailableTokensForHolder might run into an endless loop. That's actually taken care of by the creation function (        if (holdersVestingScheduleCount[_beneficiary] >= 100) revert TooManySchedulesForBeneficiary(); ) but an attacker can still try to utilize this for a DDoS

uses AccessControl to gate the schedule creation function


Test API calls of auth methods for availability in current step

For example, if someone calls /auth/mtoken/operation/detail endpoint before the login (via username / password), we currently do not do any check that would stop the call.

Handle in both Next Step and Web Flow auth methods.


Create Klusterlet CR after importing cluster as ManagedCluster

Looks good to me. Just sonar report low test code coverage. If it's urgent I think we can merge.

/lgtm


add keep-trailing-newline option

This is my use case:
fancy_echo "Updating Homebrew formulae ..."
brew update
brew bundle --file=- <<EOF
{% include 'Brewfile' %}
EOF

{% include 'setup-zsh.sh.j2' %}
{% include 'setup-ruby.sh.j2' %}
{% include 'setup-python.sh.j2' %}
{% include 'setup-node.sh.j2' %}

Without this option I have to insert newlines all over my shell script.


ChromaDB installation problem

CMake Error at C:/Program Files/CMake/share/cmake-3.26/Modules/CMakeTestCCompiler.cmake:67 (message):
The C compiler
"C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.35.32215/bin/Hostx64/x64/cl.exe"

is not able to compile a simple test program.
It fails with the following output:
Change Dir: C:/Users/sraj03/Desktop/FlaskCWH/sentencepiece/build/CMakeFiles/CMakeScratch/TryCompile-gtv4rs

Run Build Command(s):C:/Program Files/CMake/bin/cmake.exe -E env VERBOSE=1 nmake -f Makefile /nologo cmTC_79b47\fast &&   "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.35.32215\bin\Hostx64\x64\nmake.exe"  -f CMakeFiles\cmTC_79b47.dir\build.make /nologo -L                  CMakeFiles\cmTC_79b47.dir\build
Building C object CMakeFiles/cmTC_79b47.dir/testCCompiler.c.obj
    "C:\Program Files\CMake\bin\cmake.exe" -E cmake_cl_compile_depends --dep-file=CMakeFiles\cmTC_79b47.dir\testCCompiler.c.obj.d --working-dir=C:\Users\sraj03\Desktop\FlaskCWH\sentencepiece\build\CMakeFiles\CMakeScratch\TryCompile-gtv4rs --filter-prefix="Note: including file: " -- C:\PROGRA~2\MICROS~3\2022\BUILDT~1\VC\Tools\MSVC\1435~1.322\bin\Hostx64\x64\cl.exe @C:\Users\sraj03\AppData\Local\Temp\nm3498.tmp
testCCompiler.c
Linking C executable cmTC_79b47.exe
    "C:\Program Files\CMake\bin\cmake.exe" -E vs_link_exe --intdir=CMakeFiles\cmTC_79b47.dir --rc=rc --mt=CMAKE_MT-NOTFOUND --manifests -- C:\PROGRA~2\MICROS~3\2022\BUILDT~1\VC\Tools\MSVC\1435~1.322\bin\Hostx64\x64\link.exe /nologo @CMakeFiles\cmTC_79b47.dir\objects1.rsp @C:\Users\sraj03\AppData\Local\Temp\nm3787.tmp
Visual Studio Incremental Link with embedded manifests
Create CMakeFiles\cmTC_79b47.dir/manifest.rc
Create empty: CMakeFiles\cmTC_79b47.dir/embed.manifest
RC Pass 1:
rc /fo CMakeFiles\cmTC_79b47.dir/manifest.res CMakeFiles\cmTC_79b47.dir/manifest.rc
RC Pass 1: command "rc /fo CMakeFiles\cmTC_79b47.dir/manifest.res CMakeFiles\cmTC_79b47.dir/manifest.rc" failed (exit code 0) with the following output:
The system cannot find the file specifiedNMAKE : fatal error U1077: '"C:\Program Files\CMake\bin\cmake.exe" -E vs_link_exe --intdir=CMakeFiles\cmTC_79b47.dir --rc=rc --mt=CMAKE_MT-NOTFOUND --manifests -- C:\PROGRA~2\MICROS~3\2022\BUILDT~1\VC\Tools\MSVC\1435~1.322\bin\Hostx64\x64\link.exe /nologo @CMakeFiles\cmTC_79b47.dir\objects1.rsp @C:\Users\sraj03\AppData\Local\Temp\nm3787.tmp' : return code '0xffffffff'
Stop.
NMAKE : fatal error U1077: '"C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.35.32215\bin\Hostx64\x64\nmake.exe"  -f CMakeFiles\cmTC_79b47.dir\build.make /nologo -L                  CMakeFiles\cmTC_79b47.dir\build' : return code '0x2'
Stop.

CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
CMakeLists.txt:18 (project)
-- Configuring incomplete, errors occurred!

@shivamatkearney thanks for reporting this! What version of Windows are you running? What version of Python? Thank you!

@jeffchuber I am using Windows 11 and Python version 3.11.2

Facing the same issue on macosx with python 3.9.6
Below is the output of pip install chromadb
Defaulting to user installation because normal site-packages is not writeable
Collecting chromadb
  Using cached chromadb-0.3.14-py3-none-any.whl (45 kB)
Collecting duckdb>=0.7.1
  Downloading duckdb-0.7.1-cp39-cp39-macosx_10_9_x86_64.whl (14.6 MB)
     |████████████████████████████████| 14.6 MB 12.7 MB/s eta 0:00:01   |███████▎                        | 3.3 MB 1.5 MB/s eta 0:00:08
Requirement already satisfied: requests>=2.28 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from chromadb) (2.28.2)
Collecting uvicorn[standard]>=0.18.3
  Using cached uvicorn-0.21.1-py3-none-any.whl (57 kB)
Collecting posthog>=2.4.0
  Using cached posthog-2.4.0-py2.py3-none-any.whl (36 kB)
Collecting sentence-transformers>=2.2.2
  Using cached sentence-transformers-2.2.2.tar.gz (85 kB)
Collecting fastapi>=0.85.1
  Using cached fastapi-0.95.0-py3-none-any.whl (57 kB)
Requirement already satisfied: numpy>=1.21.6 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from chromadb) (1.23.5)
Collecting hnswlib>=0.7
  Using cached hnswlib-0.7.0.tar.gz (33 kB)
  WARNING: Value for prefixed-purelib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/normal/lib/python3.9/site-packages
  sysconfig: /Library/Python/3.9/site-packages
  WARNING: Value for prefixed-platlib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/normal/lib/python3.9/site-packages
  sysconfig: /Library/Python/3.9/site-packages
  WARNING: Additional context:
  user = False
  home = None
  root = None
  prefix = '/private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/normal'
  WARNING: Value for prefixed-purelib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/overlay/lib/python3.9/site-packages
  sysconfig: /Library/Python/3.9/site-packages
  WARNING: Value for prefixed-platlib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/overlay/lib/python3.9/site-packages
  sysconfig: /Library/Python/3.9/site-packages
  WARNING: Additional context:
  user = False
  home = None
  root = None
  prefix = '/private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/overlay'
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Requirement already satisfied: pandas>=1.3 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from chromadb) (1.5.3)
Collecting clickhouse-connect>=0.5.7
  Downloading clickhouse_connect-0.5.17-cp39-cp39-macosx_10_9_x86_64.whl (235 kB)
     |████████████████████████████████| 235 kB 29.3 MB/s eta 0:00:01
Requirement already satisfied: pydantic>=1.9 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from chromadb) (1.10.7)
Requirement already satisfied: certifi in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from clickhouse-connect>=0.5.7->chromadb) (2022.12.7)
Collecting zstandard
  Downloading zstandard-0.20.0-cp39-cp39-macosx_10_9_x86_64.whl (456 kB)
     |████████████████████████████████| 456 kB 32.9 MB/s eta 0:00:01
Requirement already satisfied: urllib3>=1.26 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from clickhouse-connect>=0.5.7->chromadb) (1.26.15)
Collecting lz4
  Downloading lz4-4.3.2-cp39-cp39-macosx_10_9_x86_64.whl (254 kB)
     |████████████████████████████████| 254 kB 30.0 MB/s eta 0:00:01
Requirement already satisfied: pytz in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from clickhouse-connect>=0.5.7->chromadb) (2023.3)
Collecting starlette<0.27.0,>=0.26.1
  Using cached starlette-0.26.1-py3-none-any.whl (66 kB)
Requirement already satisfied: python-dateutil>=2.8.1 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from pandas>=1.3->chromadb) (2.8.2)
Requirement already satisfied: six>=1.5 in /Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/site-packages (from posthog>=2.4.0->chromadb) (1.15.0)
Requirement already satisfied: monotonic>=1.5 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from posthog>=2.4.0->chromadb) (1.6)
Requirement already satisfied: backoff>=1.10.0 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from posthog>=2.4.0->chromadb) (2.2.1)
Requirement already satisfied: typing-extensions>=4.2.0 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from pydantic>=1.9->chromadb) (4.5.0)
Requirement already satisfied: idna<4,>=2.5 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from requests>=2.28->chromadb) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from requests>=2.28->chromadb) (3.1.0)
Collecting transformers<5.0.0,>=4.6.0
  Using cached transformers-4.27.4-py3-none-any.whl (6.8 MB)
Requirement already satisfied: tqdm in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from sentence-transformers>=2.2.2->chromadb) (4.65.0)
Collecting torch>=1.6.0
  Downloading torch-2.0.0-cp39-none-macosx_10_9_x86_64.whl (139.8 MB)
     |████████████████████████████████| 139.8 MB 40 kB/s s eta 0:00:01   |▉                               | 3.5 MB 33.7 MB/s eta 0:00:05     |█                               | 4.8 MB 33.7 MB/s eta 0:00:05     |█▉                              | 8.0 MB 33.7 MB/s eta 0:00:04     |██                              | 9.1 MB 33.7 MB/s eta 0:00:04     |██▉                             | 12.6 MB 33.7 MB/s eta 0:00:04     |███▎                            | 14.2 MB 7.0 MB/s eta 0:00:18     |████▊                           | 20.5 MB 7.0 MB/s eta 0:00:18     |█████                           | 21.6 MB 7.0 MB/s eta 0:00:17     |██████▏                         | 27.1 MB 11.6 MB/s eta 0:00:10     |██████▍                         | 28.1 MB 11.6 MB/s eta 0:00:10     |█████████                       | 39.5 MB 11.9 MB/s eta 0:00:09     |█████████▊                      | 42.4 MB 11.9 MB/s eta 0:00:09     |███████████                     | 48.4 MB 11.9 MB/s eta 0:00:08     |███████████▎                    | 49.0 MB 11.4 MB/s eta 0:00:08     |███████████▍                    | 49.7 MB 11.4 MB/s eta 0:00:08     |███████████▉                    | 51.7 MB 11.4 MB/s eta 0:00:08     |████████████▊                   | 55.8 MB 11.4 MB/s eta 0:00:08     |█████████████▏                  | 57.4 MB 11.4 MB/s eta 0:00:08     |███████████████                 | 65.1 MB 11.8 MB/s eta 0:00:07     |████████████████                | 70.1 MB 11.8 MB/s eta 0:00:06     |█████████████████               | 74.6 MB 12.1 MB/s eta 0:00:06     |███████████████████▋            | 85.6 MB 12.5 MB/s eta 0:00:05     |███████████████████▉            | 86.9 MB 12.5 MB/s eta 0:00:05     |████████████████████▋           | 90.0 MB 12.5 MB/s eta 0:00:04     |█████████████████████▏          | 92.4 MB 12.5 MB/s eta 0:00:04     |█████████████████████▎          | 93.0 MB 12.5 MB/s eta 0:00:04     |█████████████████████▋          | 94.3 MB 12.5 MB/s eta 0:00:04     |██████████████████████▊         | 99.5 MB 10.7 MB/s eta 0:00:04     |███████████████████████         | 100.8 MB 10.7 MB/s eta 0:00:04     |████████████████████████        | 104.7 MB 10.7 MB/s eta 0:00:04     |████████████████████████▍       | 106.7 MB 10.7 MB/s eta 0:00:04     |█████████████████████████▏      | 110.0 MB 10.0 MB/s eta 0:00:03     |█████████████████████████▎      | 110.7 MB 10.0 MB/s eta 0:00:03     |█████████████████████████████   | 127.1 MB 10.2 MB/s eta 0:00:02     |███████████████████████████████▊| 138.4 MB 65.9 MB/s eta 0:00:01     |███████████████████████████████▉| 139.0 MB 65.9 MB/s eta 0:00:01
Collecting torchvision
  Downloading torchvision-0.15.1-cp39-cp39-macosx_10_9_x86_64.whl (1.5 MB)
     |████████████████████████████████| 1.5 MB 14.1 MB/s eta 0:00:01
Collecting scikit-learn
  Downloading scikit_learn-1.2.2-cp39-cp39-macosx_10_9_x86_64.whl (9.1 MB)
     |████████████████████████████████| 9.1 MB 15.5 MB/s eta 0:00:01     |███▏                            | 901 kB 15.5 MB/s eta 0:00:01     |█████████▎                      | 2.6 MB 15.5 MB/s eta 0:00:01
Collecting scipy
  Downloading scipy-1.10.1-cp39-cp39-macosx_10_9_x86_64.whl (35.2 MB)
     |████████████████████████████████| 35.2 MB 13.4 MB/s eta 0:00:01    |█████▊                          | 6.3 MB 18.3 MB/s eta 0:00:02     |██████████▏                     | 11.2 MB 18.3 MB/s eta 0:00:02     |████████████▌                   | 13.7 MB 2.4 MB/s eta 0:00:09     |█████████████                   | 14.4 MB 2.4 MB/s eta 0:00:09     |███████████████████             | 21.0 MB 2.4 MB/s eta 0:00:06     |███████████████████▋            | 21.6 MB 2.4 MB/s eta 0:00:06     |████████████████████▎           | 22.2 MB 2.4 MB/s eta 0:00:06     |███████████████████████         | 25.2 MB 13.4 MB/s eta 0:00:01     |███████████████████████████████▎| 34.3 MB 13.4 MB/s eta 0:00:01
Requirement already satisfied: nltk in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from sentence-transformers>=2.2.2->chromadb) (3.8.1)
Collecting sentencepiece
  Downloading sentencepiece-0.1.97-cp39-cp39-macosx_10_9_x86_64.whl (1.2 MB)
     |████████████████████████████████| 1.2 MB 10.9 MB/s eta 0:00:01
Collecting huggingface-hub>=0.4.0
  Using cached huggingface_hub-0.13.3-py3-none-any.whl (199 kB)
Collecting filelock
  Using cached filelock-3.10.7-py3-none-any.whl (10 kB)
Requirement already satisfied: pyyaml>=5.1 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from huggingface-hub>=0.4.0->sentence-transformers>=2.2.2->chromadb) (6.0)
Requirement already satisfied: packaging>=20.9 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from huggingface-hub>=0.4.0->sentence-transformers>=2.2.2->chromadb) (23.0)
Requirement already satisfied: anyio<5,>=3.4.0 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from starlette<0.27.0,>=0.26.1->fastapi>=0.85.1->chromadb) (3.6.2)
Requirement already satisfied: sniffio>=1.1 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from anyio<5,>=3.4.0->starlette<0.27.0,>=0.26.1->fastapi>=0.85.1->chromadb) (1.3.0)
Collecting jinja2
  Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting networkx
  Using cached networkx-3.0-py3-none-any.whl (2.0 MB)
Collecting sympy
  Using cached sympy-1.11.1-py3-none-any.whl (6.5 MB)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1
  Downloading tokenizers-0.13.2-cp39-cp39-macosx_10_11_x86_64.whl (3.8 MB)
     |████████████████████████████████| 3.8 MB 26.1 MB/s eta 0:00:01     |█████████████████▎              | 2.0 MB 26.1 MB/s eta 0:00:01
Requirement already satisfied: regex!=2019.12.17 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers>=2.2.2->chromadb) (2023.3.23)
Requirement already satisfied: h11>=0.8 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from uvicorn[standard]>=0.18.3->chromadb) (0.14.0)
Requirement already satisfied: click>=7.0 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from uvicorn[standard]>=0.18.3->chromadb) (8.1.3)
Collecting watchfiles>=0.13
  Using cached watchfiles-0.19.0-cp37-abi3-macosx_10_7_x86_64.whl (405 kB)
Collecting websockets>=10.4
  Downloading websockets-10.4-cp39-cp39-macosx_10_9_x86_64.whl (97 kB)
     |████████████████████████████████| 97 kB 12.7 MB/s eta 0:00:01
Collecting uvloop!=0.15.0,!=0.15.1,>=0.14.0
  Downloading uvloop-0.17.0-cp39-cp39-macosx_10_9_x86_64.whl (1.5 MB)
     |████████████████████████████████| 1.5 MB 24.3 MB/s eta 0:00:01
Collecting httptools>=0.5.0
  Downloading httptools-0.5.0-cp39-cp39-macosx_10_9_x86_64.whl (161 kB)
     |████████████████████████████████| 161 kB 18.6 MB/s eta 0:00:01
Collecting python-dotenv>=0.13
  Using cached python_dotenv-1.0.0-py3-none-any.whl (19 kB)
Collecting MarkupSafe>=2.0
  Downloading MarkupSafe-2.1.2-cp39-cp39-macosx_10_9_x86_64.whl (13 kB)
Requirement already satisfied: joblib in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from nltk->sentence-transformers>=2.2.2->chromadb) (1.2.0)
Collecting threadpoolctl>=2.0.0
  Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting mpmath>=0.19
  Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /Users/ayush.sharma/Library/Python/3.9/lib/python/site-packages (from torchvision->sentence-transformers>=2.2.2->chromadb) (9.4.0)
Building wheels for collected packages: hnswlib, sentence-transformers
  Building wheel for hnswlib (PEP 517) ... error
  ERROR: Command errored out with exit status 1:
   command: /Library/Developer/CommandLineTools/usr/bin/python3 /Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py build_wheel /var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/tmp21hiv7a7
       cwd: /private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-install-ru_z39pa/hnswlib_1880f842f28b4e0ea92b979d054ed33a
  Complete output (16 lines):
  running bdist_wheel
  running build
  running build_ext
  creating var
  creating var/folders
  creating var/folders/pt
  creating var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq
  creating var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -I/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/include/python3.9 -c /var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/tmpi4l126lq.cpp -o var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/tmpi4l126lq.o -std=c++14
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -I/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/include/python3.9 -c /var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/tmpqz4b8g3g.cpp -o var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/tmpqz4b8g3g.o -fvisibility=hidden
  creating build
  creating build/temp.macosx-10.9-universal2-3.9
  creating build/temp.macosx-10.9-universal2-3.9/python_bindings
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -I/private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/overlay/lib/python3.9/site-packages/pybind11/include -I/private/var/folders/pt/5z09lb6n7psd9yl73dgmfzyr0000gq/T/pip-build-env-vg3l1_mn/overlay/lib/python3.9/site-packages/numpy/core/include -I./hnswlib/ -I/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/include/python3.9 -c ./python_bindings/bindings.cpp -o build/temp.macosx-10.9-universal2-3.9/./python_bindings/bindings.o -O3 -march=native -stdlib=libc++ -mmacosx-version-min=10.7 -DVERSION_INFO=\"0.7.0\" -std=c++14 -fvisibility=hidden
  clang: error: the clang compiler does not support '-march=native'
  error: command '/usr/bin/clang' failed with exit code 1
  ----------------------------------------
  ERROR: Failed building wheel for hnswlib
  Building wheel for sentence-transformers (setup.py) ... done
  Created wheel for sentence-transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125938 sha256=e245648e57769253b74beca554c41ccf8ef6cb6b98f66354fc6fd8a6915fe2a3
  Stored in directory: /Users/ayush.sharma/Library/Caches/pip/wheels/71/67/06/162a3760c40d74dd40bc855d527008d26341c2b0ecf3e8e11f
Successfully built sentence-transformers
Failed to build hnswlib
ERROR: Could not build wheels for hnswlib which use PEP 517 and cannot be installed directly
WARNING: You are using pip version 21.2.4; however, version 23.0.1 is available.
You should consider upgrading via the '/Library/Developer/CommandLineTools/usr/bin/python3 -m pip install --upgrade pip' command.
Note: you may need to restart the kernel to use updated packages.

Same problem for python 3.9.6 on Mac OS 13.1

3.10.10 is actually the only python version that's allowing me to pip install chromadb, fyi.

I have this problem with Python 3.10.3 on macOS 13.2

@ayush-vibrant I was able to resolve this issue by setting export HNSWLIB_NO_NATIVE=1 and running pip install again. Would be good to have this issue resolved though.

for me I get a different error then:
$ export HNSWLIB_NO_NATIVE=1
$ pip install hnswlib
Collecting hnswlib
  Using cached hnswlib-0.7.0.tar.gz (33 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [16 lines of output]
      Traceback (most recent call last):
        File "/virtualenvs/experiments-langchain-FPovFLPB-py3.10/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 351, in <module>
          main()
        File "/virtualenvs/experiments-langchain-FPovFLPB-py3.10/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 333, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/virtualenvs/experiments-langchain-FPovFLPB-py3.10/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/private/var/folders/w1/_vgkxyln4c7bk8kr29s1y1k00000gn/T/pip-build-env-pt4qsunf/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/private/var/folders/w1/_vgkxyln4c7bk8kr29s1y1k00000gn/T/pip-build-env-pt4qsunf/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/w1/_vgkxyln4c7bk8kr29s1y1k00000gn/T/pip-build-env-pt4qsunf/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 74, in <module>
        File "<string>", line 91, in BuildExt
      ValueError: list.remove(x): x not in list
      [end of output]

I have tried via both pip install and poetry add
Both have same error, but Poetry also appends a message:

Note: This error originates from the build backend, and is likely not a problem with poetry but with hnswlib (0.7.0) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "hnswlib (==0.7.0)"'.

If I run pip wheel --use-pep517 "hnswlib (==0.7.0)" I get the same error
If PEP-517 is the problem, I tried this:
$ pip install --no-use-pep517 hnswlib
Collecting hnswlib
  Using cached hnswlib-0.7.0.tar.gz (33 kB)
ERROR: Disabling PEP 517 processing is invalid: project specifies a build backend of setuptools.build_meta in pyproject.toml

I had the same issue and I am not using Conda, with Windows. I fixed it in following way:

Download latest VS Build Tools 2022 here: https://visualstudio.microsoft.com/downloads/#build-tools-for-visual-studio-2022
From 'Desktop development with C++'  workload, select 'MSVC v143 - VS 2022 C++ x64/x86 build tools'
Modify/ install it.
You may have to restart
Install Chromadb on vscode. If there's a permission issue, use 'pip install chromadb --user'

This appears to be related to https://github.com/nmslib/hnswlib/issues/442

Same problem (with hnswlib~=0.7.0) in cPanel.
Do you know what can I do?

for me I get a different error then:
$ export HNSWLIB_NO_NATIVE=1
$ pip install hnswlib
Collecting hnswlib
  Using cached hnswlib-0.7.0.tar.gz (33 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [16 lines of output]
      Traceback (most recent call last):
        File "/virtualenvs/experiments-langchain-FPovFLPB-py3.10/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 351, in <module>
          main()
        File "/virtualenvs/experiments-langchain-FPovFLPB-py3.10/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 333, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/virtualenvs/experiments-langchain-FPovFLPB-py3.10/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/private/var/folders/w1/_vgkxyln4c7bk8kr29s1y1k00000gn/T/pip-build-env-pt4qsunf/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/private/var/folders/w1/_vgkxyln4c7bk8kr29s1y1k00000gn/T/pip-build-env-pt4qsunf/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/w1/_vgkxyln4c7bk8kr29s1y1k00000gn/T/pip-build-env-pt4qsunf/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 74, in <module>
        File "<string>", line 91, in BuildExt
      ValueError: list.remove(x): x not in list
      [end of output]

I have tried via both pip install and poetry add
Both have same error, but Poetry also appends a message:

Note: This error originates from the build backend, and is likely not a problem with poetry but with hnswlib (0.7.0) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "hnswlib (==0.7.0)"'.

If I run pip wheel --use-pep517 "hnswlib (==0.7.0)" I get the same error
If PEP-517 is the problem, I tried this:
$ pip install --no-use-pep517 hnswlib
Collecting hnswlib
  Using cached hnswlib-0.7.0.tar.gz (33 kB)
ERROR: Disabling PEP 517 processing is invalid: project specifies a build backend of setuptools.build_meta in pyproject.toml

I had the same error.
xcode-select -s /Library/Developer/CommandLineTools solved my issue.

I solved the issue by giving up on Chromadb and just using FAISS... pip install worked first time, zero problems 😜
seriously though... I just tried this:

xcode-select -s /Library/Developer/CommandLineTools solved my issue.

and it worked for me too, chromadb 0.3.22 installed successfully this time
there seems to be an annoying thing with xcode tools where each time there is an OS update you have to re-run that command for things to work properly again

3.10.10 is actually the only python version that's allowing me to pip install chromadb, fyi.

May I ask if this is still true? Chromadb is only compatible with Python 3.10.10? I'm also having issues with Langchain <> chromadb <> pybind11 on a Windows machine, Python 3.9.

3.10.10 is actually the only python version that's allowing me to pip install chromadb, fyi.

May I ask if this is still true? Chromadb is only compatible with Python 3.10.10? I'm also having issues with Langchain <> chromadb <> pybind11 on a Windows machine, Python 3.9.

I used Chromadb and Langchain in a Windows PC with Python 3.9. No problem.

I am also having trouble getting a dockerimage build up and running with chromadb intallation with the same errors as previous partcipants here.
Setting the env variable export HNSWLIB_NO_NATIVE=1 did not solve this issue as well. switch to faiss for now

export HNSWLIB_NO_NATIVE=1 did not solve the issue.
installing on python 3.10.10 also did not solve the issue.

So I was able to solve this error by:
pip install "pybind11[global]"
And finding it's location in C drive and adding it to PATH environment variable.
For me the path was : 'C:\Users\HP\anaconda3\Lib\site-packages\tensorflow\include\external\pybind11_virtual_includes\pybind11\pybind11'

For me the issue was with hnswlib on Apple silicon (M1). Installing the develop version solved the problem and I could then install chromadb without any issues
pip install git+https://github.com/nmslib/hnswlib.git@develop

For me the issue was with hnswlib on Apple silicon (M1). Installing the develop version solved the problem and I could then install chromadb without any issues
pip install git+https://github.com/nmslib/hnswlib.git@develop

32 warnings generated.       creating build/lib.macosx-11.0-arm64-cpython-310       clang++ -bundle -undefined dynamic_lookup -Wl,-rpath,/opt/homebrew/Caskroom/miniforge/base/envs/flywheel/lib -L/opt/homebrew/Caskroom/miniforge/base/envs/flywheel/lib -Wl,-rpath,/opt/homebrew/Caskroom/miniforge/base/envs/flywheel/lib -L/opt/homebrew/Caskroom/miniforge/base/envs/flywheel/lib build/temp.macosx-11.0-arm64-cpython-310/./python_bindings/bindings.o "-L/opt/homebrew/opt/portaudio/lib/ " -L -o build/lib.macosx-11.0-arm64-cpython-310/hnswlib.cpython-310-darwin.so -stdlib=libc++ -mmacosx-version-min=10.7       clang: error: no such file or directory: 'build/lib.macosx-11.0-arm64-cpython-310/hnswlib.cpython-310-darwin.so'       error: command '/usr/bin/clang++' failed with exit code 1       [end of output]
It's still not working for me. I'm using an M1 Pro with Ventura. :(

I have this problem with Python 3.10.3 on macOS 13.2 (M1)
...
        /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/c++/v1/__memory/unique_ptr.h:610:45: error: unknown type name 'nullptr_t'
        operator!=(const unique_ptr<_T1, _D1>& __x, nullptr_t) _NOEXCEPT
                                                    ^
        fatal error: too many errors emitted, stopping now [-ferror-limit=]
        20 errors generated.
        error: command '/usr/bin/clang' failed with exit code 1
        [end of output]

    note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for hnswlib
  Failed to build hnswlib
  ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects

could you solve it??

conda install -c conda-forge chromadb solved it for me.

I have this problem with Python 3.10.3 on macOS 13.2 (M1)
...
        /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/c++/v1/__memory/unique_ptr.h:610:45: error: unknown type name 'nullptr_t'
        operator!=(const unique_ptr<_T1, _D1>& __x, nullptr_t) _NOEXCEPT
                                                    ^
        fatal error: too many errors emitted, stopping now [-ferror-limit=]
        20 errors generated.
        error: command '/usr/bin/clang' failed with exit code 1
        [end of output]

    note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for hnswlib
  Failed to build hnswlib
  ERROR: Could not build wheels for hnswlib, which is required to install pyproject.toml-based projects

could you solve it??

conda install -c conda-forge chromadb solved it for me.

I had tried all the above solutions but finally installed Microsoft C++ build tools. It finally worked for me. https://visualstudio.microsoft.com/visual-cpp-build-tools/

Working Solution for me on Windows 11
Python version : 3.10.11

STEP-1
Install the following microsoft tools and install C++ required packages
https://aka.ms/vs/17/release/vs_BuildTools.exe
STEP-2
Restart the PC and install chromadb

https://www.partitionwizard.com/partitionmanager/microsoft-visual-c-14-is-required.html

FWIW, on windows 10 I had to install all of these, rather than just the first option MSVC v143 before the pip install chromadb would work

thanks everyone for continuing to post fixes here! 💃

Closing this out as we now ship precompiled binaries #993

With Windows11, Python3.11.5 (not working on Python 3.12) :
This is simply what I did to solve chromdb installation:
set HNSWLIB_NO_NATIVE=1
pip install chromdb
(I have tried before this,  pip install hnswlib but it shows the pyproject.toml error)

I found the error on windows 10 Python 3.12
I already install  MSVC v143.
`× Building wheel for chroma-hnswlib (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [12 lines of output]
running bdist_wheel
running build
running build_ext
building 'hnswlib' extension
creating build
creating build\temp.win-amd64-cpython-312
creating build\temp.win-amd64-cpython-312\Release
creating build\temp.win-amd64-cpython-312\Release\python_bindings
"C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.40.33807\bin\HostX86\x64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\pitsanur\AppData\Local\Temp\pip-build-env-ktyshf97\overlay\Lib\site-packages\pybind11\include -IC:\Users\pitsanur\AppData\Local\Temp\pip-build-env-ktyshf97\overlay\Lib\site-packages\numpy_core\include -I./hnswlib/ -IC:\Developments\CHATBOT\iollamaAPI.venv\include -IC:\Users\pitsanur\AppData\Local\Programs\Python\Python312\include -IC:\Users\pitsanur\AppData\Local\Programs\Python\Python312\Include "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.40.33807\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.40.33807\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Auxiliary\VS\include" /EHsc /Tp./python_bindings/bindings.cpp /Fobuild\temp.win-amd64-cpython-312\Release./python_bindings/bindings.obj /EHsc /openmp /O2 /DVERSION_INFO=\"0.7.3\"
bindings.cpp
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.40.33807\include\yvals.h(20): fatal error C1083: Cannot open include file: 'crtdbg.h': No such file or directory
error: command 'C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Tools\MSVC\14.40.33807\bin\HostX86\x64\cl.exe' failed with exit code 2
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for chroma-hnswlib
Failed to build chroma-hnswlib
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (chroma-hnswlib)`

I struggled a lot to get this up and running ChromaDB on my brand new Windows laptop. As @RamziRebai mentioned, I had to downgrade my Python from 3.12.X to 3.11 to fix this issue.
OS Details
Edition	Windows 11 Home Single Language
Version	24H2


[fluent] More target support

[ ]  wasm

Is there a chance that this PR will be merged soon? I have been waiting for the appearance of WASM target for almost half a year and almost lost hope.

Is there a chance that this PR will be merged soon? I have been waiting for the appearance of WASM target for almost half a year and almost lost hope.

I need refactor the DatePicker that make it support js & wasm target

https://github.com/Konyaco/compose-fluent-ui/pull/74
(DatePicker works as expected)


Add TLS/SSL support to the web application

It would be good to support a means of using custom SSL/TLS certificates with the web app- perhaps supporting both self-signed certs, certbot integration to the docker container, and the option to add custom certificates from another source should be supported.
This feature is NON-CRITICAL, however the encryption and message authentication/tamper protection provided by https is likely a good idea, and is considered fairly standard in modern times.
The rest of the system is not necessarily in a position where such things could be easily and fully tested at the present moment, so this is currently labeled as on-hold.

Resolved by using Cloudflare tunneling with a shared tls cert


fix: handle invalid cookies

Description
if a cookie has an invalid character then cookie returned by decode is null and this throws a silent null pointer exception with existing code

Relevant Issues : (compulsory)
Relevant PRs : (optional)
Type of change :

Bug fix for existing feature

closing as i notice this issue is fixed in develop already, but not in master

@dillippattnaik that's right, I think this is s duplicate of #1759


"Local" cluster changes for graph/collectl (on bcbio-nextgen collectl part)

Parses local nodes/hostnames from the bcbio logfile when running with "-c local" cluster flag/option.
Related to PR https://github.com/chapmanb/bcbio-nextgen-vm/pull/111

Are there any plans to allow graphing resources also with vanilla Bcbio (bon-signatures) on a ipython cluster if the cluster nodes have collectl installed?

Roman -- brilliant, thanks for all these fixes.
Sven-Eric -- we'd like to support it, although are a bit worried about the challenges of getting ti working reliably across a large number of clusters. Right now it requires ssh access to nodes. It also needs to have the ability to only pull collectl files in the timestamp region. Currently it grabs everything from the collectl logs which works okay for AWS where the cluster is up for the time of the run, but won't be practical for long running collectl processes. Beyond that we can see how well it works for people and define the conditions a cluster needs to meet to run it. Thanks much.

Both @chapmanb and @schelhorn, really good points and feedback.
If we were to work further on this front, I would say that having a "phone home" feature to track execution/results of the pipeline would be super useful and interesting... perhaps also controversial as with the GATK:
http://gatkforums.broadinstitute.org/discussion/1250/what-is-phone-home-and-how-does-it-affect-me
@ohofmann

Thanks for the very good points; I wasn't so much thinking about a true "phone home" than having a more transparent way to see what step the pipeline is in, and where the current bottlenecks are. Tracking the resource manager and the debug/command log can give you that, but it's not very convenient for production purposes where there isn't a need for detailed debugging. But it's of secondary importance, there are more important things to do such as CWL.

Roman and Sven-Eric;
I'm against having a phone-home feature outside of locally populating some type of database that provides run information and query. I wouldn't want this to leak outside a user installation.
This would all be cool to have but does complicate the setup and administration on remote clusters. Practically I'm hoping bcbio can move to CWL then users can decide what underlying infrastructure they would want: something like Arvados that provides tracking and monitoring, or something more lightweight that is easier to install. Building this up right is a lot of work and it would be better to collaborate with someone doing this infrastructure work than try to do it ourselves.

Thanks Brad, also my thoughts regarding infrastructure work/efforts to support analytics on bcbio, perhaps too much time would end up there. I thought about the phone-home as an opt-in (do no evil) instead of GATK default behavior... think launchpad's apport reporting system, for instance:
https://launchpad.net/apport
Would be useful to assist in debugging and/or fixing issues faster or even in advance, but it's also fine as it is now :+1:

@schelhorn, I accidentally reached your wish/milestone ;)... I have a running ipython notebook server in the cluster and I can now examine/zoom the interactive plots (using pandas-highcharts) from collectl from Glasgow's cluster 2 :)

Wow, that sounds nice! Any chance I could replicate that or is the setup too complex?

@schelhorn you could merge my last commits from my branch:
https://github.com/brainstorm/bcbio-nextgen-vm/commits/master
Then open up the notebook:
https://github.com/brainstorm/bcbio-nextgen-vm/blob/vardict_graph_steps/bcbiovm/graph/collectl_plots.ipynb
Quite beta stuff, handle with care ;)


[4.3 beta 1] Global Shader Uniforms of Type Sampler2D are not saved

Tested versions
v4.3.beta1.official [a4f2ea91a]
System information
Godot v4.3.beta1 - openSUSE Tumbleweed 20240610 - Wayland - Vulkan (Forward+) - dedicated AMD Radeon RX 580 Series (RADV POLARIS10) () - Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz (8 Threads)
Issue description
After setting a global Shader Uniform of type Sampler2D, you can see it affect shaders in the editor. Starting the game, the shader uniform stops having an effect. Restarting the engine clears the uniform in the "Global Shader Uniforms" tab in the project settings.
It seems that this is a regression of #60805
Steps to reproduce

add a shader global of type sampler2d
give it a texture
save & restart the editor
check the shader globals tab
your sampler2d global is unset :(

Minimal reproduction project (MRP)
na

This is a duplicate of #92178. Also the link in issue description is another issue so i assume the author means the pr that fixed this issue is the cause of this regression, but i tested the pr, reverted and both cases this bug continues. I also tested alpha 1, 10 and 15 and all of them is broken too so that looks a thing that was broken from the start


Fix: Quote path to terraform in terraform_fmt hook

Put an x into the box if that apply:

[ ] This PR introduces breaking change.
[x] This PR fixes a bug.
[ ] This PR adds new functionality.
[ ] This PR enhances existing functionality.

Description of your changes
Add quotes around variable containing path to terraform so ti works when the path contains a space.
Fixes #713
How can we test changes

@robinbowes Thanks for the contribution. It looks like we'd better quote all instances of $tf_path. Would you be up to update your PR accordingly? See https://github.com/antonbabenko/pre-commit-terraform/issues/713#issuecomment-2332555888 just in case to avoid race condition =)
> sift -n '[^"]\$tf_path'
hooks/terraform_validate.sh:121:  $tf_path validate "${args[@]}" &> /dev/null && {
hooks/terraform_validate.sh:135:    validate_output=$($tf_path validate "${args[@]}" 2>&1)
hooks/terraform_validate.sh:139:    validate_output=$($tf_path validate -json "${args[@]}" 2>&1)
hooks/terraform_validate.sh:162:      validate_output=$($tf_path validate "${args[@]}" 2>&1)
hooks/terraform_providers_lock.sh:158:  $tf_path providers lock "${args[@]}"
hooks/_common.sh:539:      init_output=$($tf_path init -backend=false "${TF_INIT_ARGS[@]}" 2>&1)
hooks/_common.sh:545:        init_output=$($tf_path init -backend=false "${TF_INIT_ARGS[@]}" 2>&1)
hooks/terraform_fmt.sh:52:  $tf_path fmt "${args[@]}"

@robinbowes Thanks for the contribution. It looks like we'd better quote all instances of $tf_path. Would you be up to update your PR accordingly? See #713 (comment) just in case to avoid race condition =)
> sift -n '[^"]\$tf_path'
hooks/terraform_validate.sh:121:  $tf_path validate "${args[@]}" &> /dev/null && {
hooks/terraform_validate.sh:135:    validate_output=$($tf_path validate "${args[@]}" 2>&1)
hooks/terraform_validate.sh:139:    validate_output=$($tf_path validate -json "${args[@]}" 2>&1)
hooks/terraform_validate.sh:162:      validate_output=$($tf_path validate "${args[@]}" 2>&1)
hooks/terraform_providers_lock.sh:158:  $tf_path providers lock "${args[@]}"
hooks/_common.sh:539:      init_output=$($tf_path init -backend=false "${TF_INIT_ARGS[@]}" 2>&1)
hooks/_common.sh:545:        init_output=$($tf_path init -backend=false "${TF_INIT_ARGS[@]}" 2>&1)
hooks/terraform_fmt.sh:52:  $tf_path fmt "${args[@]}"

Heh, I fixed all the occurrences you listed before I saw your comment.
I made one additional change in terraform_providers_lock.sh to use $tf_path instead of the text "terraform" to match the style used in other files.
Should be good to go now.

This PR is included in version 1.94.2 :tada:

This caused a breaking change, FYI.
My CI job calls pre-commit run --all-files, and it started failing with 1.94.2.
I found that terraform was not installed on the CI environment. Before 1.94.2, the pre-commit job would pass anyway. Now it fails for terraform being missing.
It did expose that terraform wasn't actually installed, so it was helpful in that way. But I wanted to call out the breaking change.

I don't see how changes in this PR could affect your CI

Improving checks which prevents unexpected behavior (from your description, previously it just bypassed checks) is fix by definition, not breaking change.

Also, it should be checked here - https://github.com/antonbabenko/pre-commit-terraform/blob/89f45610a846f56273a6c4290b3c42534175949e/hooks/_common.sh#L450-L500
@pcarn Please open an issue if you can provide minimum reproduction example via GH workflows etc, as I not sure how it was even possible to out for function above without error, if there is no binary, and you didn't specify path in configuration explicitly

To be clear, I’m glad this change was made. When terraform was not installed, it was not actually doing any checks or doing any formatting. It succeeded silently.
I’m mentioning it because when it started failing with no changes of my own, I looked at the changelog and nothing looked related. I went version by version to find that it was this that changed it.
minimal steps to reproduce:

set up a repo with terraform files that are unformatted.
do not have terraform installed.
use this hook

Before this commit, it would pass, and make no formatting changes.
After this commit, it fails, and says terraform is not installed. (Which is probably the better behavior)

Okay, it's actually asked for terraform binary before < 1.90.0.
But somehow check start bypass in 1.90.0 (https://github.com/antonbabenko/pre-commit-terraform/pull/670)
And this regression fixed in some magical way in 1.94.2
I'll add this to release notes
And we need tests here -_-


Add thin thread petrinet modelsupport

Add support for petrinet model format to the generalized encoding branch changes (after they get merged)

In 93c01ee6b4f18304925ddffc1ec180945c8acb3d


Copy buttons no longer work

The Copy buttons in the Tasks are now above the formatted boxes - but the text does not update  to Copied and the text is not added to the clipboard.  Tried on Safari and Firefox

Clicking the buttons produces:
clipboard.min.js:1 Uncaught Error: Invalid "target" value, use a valid Element
    at a.set (clipboard.min.js:1)
    at a.resolveOptions (clipboard.min.js:1)
    at new a (clipboard.min.js:1)
    at b.onClick (clipboard.min.js:1)
    at HTMLBodyElement.<anonymous> (clipboard.min.js:1)

PR submitted for this


Revert "Roll engine 77c5812d48b8..84dc383b6428 (16 commits)"

Reverts flutter/flutter#51072
This caused a regression in cull_opacity_perf__timeline_summary bad enough to where it times out -and if it doesn't timeout, it's just way worse.
/cc @iskakaushik @jmagman @jason-simmons
Will land TBR

Landing on red to fix build.


Ported MtApi5 to .Net Core

This PR will add support for .Net Core on the client side (for MtApi5) as requested in #134. Contract files are linked from MtApiService to prevent duplicated code. Only duplicated some files due to required changes (unsupported functionality of the doftnet/wcf dependencies).

added .net core based MtApiService (MtApiServiceNetCore)
based on https://github.com/dotnet/wcf
only client side is available in .Net Core
piping removed, only tcp connection possible
ported MtApi5 and MtApi5TestClient to .Net Core

@lazou Hi.
First of all I want to say thank you for your help in support MtApi.
I would like to ask you to change destination branch of PR to dev. I will review deep your changes and will try to merge it.
I have first remark: piping is using for local connection when user does not define IP address for connection. In my opinion, it must be more faster then using local TCP connection. If both connections have similar connection characteristics then we can use only one TCP and it will not be blocker for merging the PR.

Hi @vdemydiuk ,
I changed the target branch like requested to dev. In this PR the use case for using a local connection is still possible, I only call the basic ctor with localhost as IP. I used it now for around 4 months without any issues for normal trading and also for the tester. It could be possible that the tcp connection is not that fast as the piping one, but it was no requirement for me. But there is already a NamedPipeTransportBindingElement class within the dotnet wcf repo and obviously there will be piping support in the future (see TransportBindingElementImporter L153)

@lazou Hi.
First of all I want to say thank you for your help in support MtApi.
I would like to ask you to change destination branch of PR to dev. I will review deep your changes and will try to merge it.
I have first remark: piping is using for local connection when user does not define IP address for connection. In my opinion, it must be more faster then using local TCP connection. If both connections have similar connection characteristics then we can use only one TCP and it will not be blocker for merging the PR.

Maybe it helps for the decision to kick out pipes
https://stackoverflow.com/questions/10872557/how-slow-are-tcp-sockets-compared-to-named-pipes-on-windows-for-localhost-ipc

@KptKuck Thank you Cristian for good link.
@lazou I will merge your PR soon. First I will make  next release and then I will work on .Net Core adaptation.

@lazou After some discussions in telegram's chat I decided to postpone merging the PR into branch. Some users are using pipe mode and have comparative information that pipe is working faster.

@vdemydiuk Ok, no problem. Let`s see if the piping support will be added soon to the WCF library of .net core. I will try to keep the branch up to date.

@vdemydiuk Ok, no problem. Let`s see if the piping support will be added soon to the WCF library of .net core. I will try to keep the branch up to date.

@lazou  Thank you very much.

@vdemydiuk
Slightly OT, but...

After some discussions in telegram's chat I decided to postpone merging the PR into branch. Some users are using pipe mode and have comparative information that pipe is working faster.

Is piping also available in the Python API? If so, how is the connection set when not specifying IP, like here:
client = mt.MtApiClient()
...
client.BeginConnect(ip, port)

Yes !
https://stackoverflow.com/questions/48542644/python-and-windows-named-pipes

There is no Python-API
Python loads the .NET Assambly MtApi5.dll  via the package pythonnet

Ok, I think I got it. Not sure how to implement it though.
Seem like this might be the correct way (??)...
client = mt.MtApiClient()
...
# To use a TCP based (host:port) connection:
client.BeginConnect(ip, port)

# To use a pipe based (port only?) connection:
# (Note: a named pipe port is located on the `localhost` interface.)
client.BeginConnect(port)

OT ...

HI!
Do you have any updates on this PR?

@vyacheslav-skvortsov Updates in which regard? Merging it into dev or updating this branch to newer dependency versions? You can already use this .net port by compiling the sources of this branch at your end. I think not that this PR will be merged in the next couple of months since @vdemydiuk is obviously not active or has no time anymore.
I am using this .net port quite some time now without any issues.

Hi @supermomonga, I tested the named pipes some months ago (when at preview stage), but was not impressed by the performance. This was the PR I used: https://github.com/lazou/mtapi/pull/21. But maybe I did something wrong :wink:

@lazou Thanks, I'll check it!


Remove most of the PTQ receipe

Summary:
We want to decouple PTQ and torchtune, to avoid headaches of torchao API changes breaking torchtune. Also curernt PTQ APIs in torchtune is not the most up to date ones, by removing them we could deprecate these API in torchao as well.
8da4w ptq is kept because it's used in QAT, but it can be removed after QAT is refactored as well.
User should use torchao directly after torchtune finetuning: https://github.com/pytorch/ao/blob/main/torchao/quantization/README.md to quantize their model
and do eval/benchmark in torchao as well: https://github.com/pytorch/ao/tree/main/torchao/_models/llama
Test Plan:
CI
Reviewers:
Subscribers:
Tasks:
Tags:
Context
What is the purpose of this PR? Is it to

[ ] add a new feature
[ ] fix a bug
[ ] update tests and/or documentation
[x] other (please add here)

Deprecate old APIs
Changelog
What are the changes made in this PR?
Test plan
Please make sure to do each of the following if applicable to your PR. (If you're not sure about any one of these just ask and we will happily help.)

[ ] run pre-commit hooks and linters (make sure you've first installed via pre-commit install)
[ ] add unit tests for any new functionality
[ ] update docstrings for any new or updated methods or classes
[ ] run unit tests via pytest tests
[ ] run recipe tests via pytest tests -m integration_test
[ ] manually run any new or modified recipes with sufficient proof of correctness

[ ] include relevant commands and any other artifacts in this summary (pastes of loss curves, eval results, etc.)

Can you also update our live docs to account for this? See e.g. here and here

should I remove quantization walk through and just point to torchao there?

Does this also mean that we no longer support generation with quantized models? E.g. what about this portion of our generation recipe? Is it possible to just load in the AO quantized checkpoint directly or no?

yeah we'll remove this part as well, but currently it's kept for the last PTQ quantizer Int8DynActInt4WeightQuantizer, that will be removed after the QAT refactor. cc @andrewor14

we expect people to run accuracy eval and perf benchmark in torchao as well (see updated doc as well)

Is it possible to just load in the AO quantized checkpoint directly or no?

I think this could be yes, but I haven't tested in torchtune, here are some tests in torchao: https://github.com/pytorch/ao/blob/e5df48e1033611d6433dc3fd1de7923e0f555ebc/test/quantization/test_quant_api.py#L643-L677

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 27.23%. Comparing base (7eb89e2) to head (1f6d12c).
Report is 4 commits behind head on main.

:exclamation:  There is a different number of reports uploaded between BASE (7eb89e2) and HEAD (1f6d12c). Click for more details.
HEAD has 4 uploads less than BASE

Flag
BASE (7eb89e2)
HEAD (1f6d12c)

5
1

Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1219       +/-   ##
===========================================
- Coverage   67.81%   27.23%   -40.59%
===========================================
  Files         219      221        +2
  Lines        9908     9999       +91
===========================================
- Hits         6719     2723     -3996
- Misses       3189     7276     +4087

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


replace maintainer field in debian/control with customer engineering.

script that created this pull request.
#!/bin/bash

# put all files called "control" into a file list
filelist=`find -name "*control"`
homebase=`pwd`
new_maintainer='Maintainer: Customer Engineering<EMAIL_ADDRESS>for entry in $filelist; do
  fullpath="${homebase}/${entry}"
  sed -i s/"Maintainer.*"/"$new_maintainer"/ $fullpath
done

awesome!


Torch requirement makes installing mmdet impossible ias part of a package

Hi all, I've recently installed mmdet in a project I'm working on.
This project needds to be packed up as a package so it can be used in other projects.
The problem is, in order to make it into a package, you have to provide a build script (I am doing mine with Poetry, but this idea would be true regardless of which approach to making a package I might be using). The problem there is that the installation  instructions for mmdet require using openmim, but openmim requires torch, which is not available in most default environements from which the package will be installed. This leads to a failure when building the environement with the classic ModuleNotFoundError: No module named 'torch'.
To clarify, torch is a requirement of the package of course, and it will be installed as part of the installation of the package, but it cannot be installed BEFORE the package, since requirements needs to be resolved with other requirements.
Here's the full output:
poetry install
Warning: Found deprecated priority 'secondary' for source 'private' in pyproject.toml. Consider changing the priority to one of the non-deprecated values: 'default', 'primary', 'supplemental', 'explicit'.
Installing dependencies from lock file

No dependencies to install or update

Preparing build environment with build-system requirements poetry-core>=1.0.0, openmim>=0.1.1
Traceback (most recent call last):
  File "/local-scratch2/aharell/CFM-Task-Models/src/split_utils/miminstaller.py", line 9, in <module>
    install_mmdet()
  File "/local-scratch2/aharell/CFM-Task-Models/src/split_utils/miminstaller.py", line 4, in install_mmdet
    install('mmengine')
  File "/tmp/tmpu0ao7bdo/.venv/lib/python3.9/site-packages/mim/commands/install.py", line 128, in install
    install_args += ['-f', get_mmcv_full_find_link(mmcv_base_url)]
  File "/tmp/tmpu0ao7bdo/.venv/lib/python3.9/site-packages/mim/commands/install.py", line 165, in get_mmcv_full_find_link
    torch_v, cuda_v = get_torch_cuda_version()
  File "/tmp/tmpu0ao7bdo/.venv/lib/python3.9/site-packages/mim/utils/utils.py", line 340, in get_torch_cuda_version
    raise err
  File "/tmp/tmpu0ao7bdo/.venv/lib/python3.9/site-packages/mim/utils/utils.py", line 338, in get_torch_cuda_version
    import torch
ModuleNotFoundError: No module named 'torch'

In short, I think that there is an urgent need to either remove torch as a requirement for openmim or to provide instructions on how to install mmdet (and other similar packages like mmseg etc.) without relying on openmim

I am encountering the same error. Could you let me know if you managed to fix the issue?

Same problem here...

I managed to fix this issue by downgrading my Python version to 3.8.19

I managed to fix this issue by downgrading my Python version to 3.8.19

It didn't work for me.... Instead, I had to install PyTorch and chardet before running mim install mmcv-full:
conda install pytorch==1.11.0 torchvision==0.12.0 torchaudio==0.11.0 cudatoolkit=11.3 -c pytorch
conda install -c conda-forge chardet

That did the trick for me.


How to get full 'text' for tweets using filtered streams

This field currently seems to be truncated (with ellipses) for longer tweets

Can you provide any Tweet IDs where this is the case?
Are they Retweets?
Are you using any other parameters beyond the ones provided in the sample code, to get additional fields or expansions?

Thanks for the reply. So they do seem to be retweets (example: #1296315656623681537), though I was attempting to explicitly eliminate retweets.
This is the rule and URL (used w' the example code):
const rules = [  { 'value': '"global warming" OR "climate change" -is:retweet', 'tag': 'ecb1' } ];
const streamURL = 'https://api.twitter.com/2/tweets/search/stream?expansions=author_id&user.fields=location';

Thanks for confirming, will need to check on the expectations here.

Do let me know if there is some other way I should be filtering out retweets...

I’m going to close this issue in favour of this thread on our developer forums, which is a better location to have a more wide-ranging conversation on the API in general. Thank you so much.


fix typo ?

PVs are not volume plugins but have volume plugins.

Please reopen this PR after signing the CLA so that we can accept it.

cla signed ;-)


Angband updated to 4.0.1

Updating the Angband cask to 4.0.1 from 4.0.0.
URL pathing changed again, so had to modify that as well.

Changed as requested.

Looks good, then. Could you please squash your commits and @mention me after?

@Ngrd All squashed.  Let me know if there's anything else needing changed.

Everything looks good, thank you! :+1:
It was merged directly as c0724cd8815efed92944a74724327b4b05177d7a to keep commit history cleaner. Your contribution is still credited to you.


Fast & lightweight dry run

Context
Dry run was heavy and slow.
This PR makes it significantly lighter, enough to cope with any circuit size while attempting to accurately estimating the number of synapses.
With it, the 75M cell circuit, can be estimated even on a single core, taking a few minutes.
Scope

Counted the number of synapses from a sample of 50 cells per block of 5000 cells, per metype
The block size will increase by 20% on each iteration
Skipped loading all the nodes info for every cell

Load only for the first 100 cells (in principle we require instantiating only 50)
Load only mandatory properties: etype+mtype+morphology+hoc_file

Note: The last commit introduces a fix to the sampling technique so that it correctly handles skewed datasets.
Testing
$ time srun -n4 --exclusive -Aproj16 neurodamus ./sim_config_massive.json --dry-run --verbose
...
[INFO] Out of 74124987 cells, found 245 unique mtype+emodel combination
...
[INFO] No matching Connection blocks. Loading all synapses...
[VERB]  -> L1_DAC-bNAC. Syn count:<PHONE_NUMBER>
[VERB]  -> L1_DAC-cNAC. Syn count:<PHONE_NUMBER>
[VERB]  -> L1_LAC-cNAC. Syn count: 539669101
[VERB]  -> L1_NGC-DA-cSTUT. Syn count: 553057296
[VERB]  -> GIN_mtype-GIN_etype. Syn count:<PHONE_NUMBER>85
[VERB]  -> L1_HAC-bNAC. Syn count:<PHONE_NUMBER>
[VERB]  -> L1_HAC-cNAC. Syn count:<PHONE_NUMBER>
...
[VERB]  -> +========================== Synapse Count ===========================+
[VERB]  -> |               Synapse Type               |   Family   |   Count    |
[VERB]  -> +--------------------------------------------------------------------+
[VERB]  -> |                                      100 | EXC        |<PHONE_NUMBER>38 |
[VERB]  -> +--------------------------------------------------------------------+
[INFO]    - Inhibitory: 0.00 MB
[INFO]    - Excitatory: 931.96 TB
[INFO]  - TOTAL : 931.96 TB
[INFO] +================================================ TIMEIT STATS =================================================+
[INFO] |                       Event Label                        | Avg.Time | Min.Time | Max.Time | Hits R0 / Total   |
[INFO] +---------------------------------------------------------------------------------------------------------------+
[INFO] | Cell creation                                            |   123.17 |   123.17 |   123.17 |       1 / 4       |
[INFO] | Synapse creation                                         |    96.00 |    96.00 |    96.00 |       1 / 4       |
[INFO] | finished Run                                             |     0.00 |     0.00 |     0.00 |       1 / 4       |
[INFO] +---------------------------------------------------------------------------------------------------------------+
real	3m46.590s
user	0m0.026s
sys	0m0.018s

Review

[x] PR description is complete
[x] Coding style (imports, function length, New functions, classes or files) are good
[ ] Unit/Scientific test added
[ ] Updated Readme, in-code, developer documentation

The last commit solves the overestimation issue. It was due to the number of connections being skewed, concentrated in lower gids. We now Weight each sample group according to its block size.


Still can't make white background on SceneView with 1.6

As title says,
still can't make complete white background with the latest version.
If transparent background possible, then I may make the container's background white but that's not the case here either.
issue #251 has a bug label for which I though that it will be fixed in the later version (= Version 1.6).
But apparently it hasn't been.
Is there any plan to fix it?
If not, as the final resort for this issue, I may have to create the view from activity directly.
Thanks.

@romainguy
material.baseColor.rgb = vec3(1.0, 1.0, 1.0); So it makes gray color.
Did you mean to do it via white texture?

I figured out that material.baseColor.rgb = vec3(5.0, 5.0, 5.0); gives a white color
but still waiting for a standard way of doing this

Should now be resolved on 1.8.0 as the bug fixes state:
https://github.com/google-ar/sceneform-android-sdk/releases/tag/v1.8.0

It doesn't look like it's been resolved. I'm using Sceneform 1.10.0 and I'm still seeing a difference in the color applied to the scene's background.

@afeozzz
Hi!
As far as standard way still doesn't work, could you please explain how to use the material to change the background of SceneView?

I figured out that material.baseColor.rgb = vec3(5.0, 5.0, 5.0); gives a white color


Add code coverage report for each PR, block PRs if coverage decreases

Reference:
https://coverage.readthedocs.io/en/7.4.4/
https://pypi.org/project/pytest-cov/
https://github.com/marketplace/actions/code-coverage-summary
https://github.com/marketplace/actions/code-coverage-report-difference

Addressed in https://github.com/georgian-io/LLM-Finetuning-Toolkit/pull/184

Set a hard floor of 80%


winePackages.{unstable,staging}: 8.14 -> 8.17

Description of changes
https://www.winehq.org/announce/8.15
https://www.winehq.org/announce/8.16
https://www.winehq.org/announce/8.17
While I didn't test Wine 8.17 specifically, I did test a version between 8.16 and 8.17 (before the latter released).

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

I’m going to merge this. I was hoping for an approval from someone on Linux, but I don’t want to leave it open indefinitely.

This broke wine-staging on Linux.


feat: settings to hide selected warnings/infos

Closes #35
Summary of Changes
Add settings to hide

code style infos,
experimental language feature warnings,
experimental library element warnings,
name convention warnings.

:tada: This PR is included in version 0.5.0 :tada:
The release is available on:

npm package (@latest dist-tag)
npm package (@latest dist-tag)
v0.5.0
GitHub release

Your semantic-release bot :package::rocket:


fix(DIA-898): tidy-up validation for new sign-up flow

This PR tidies up validation for the new sign-up flow.

Adds a Yup schema for the required checkbox
Disables the continue button until the form is valid

android.webm
PR Checklist

[x] I have tested my changes on iOS and Android.
[x] I hid my changes behind a feature flag, or they don't need one.
[x] I have included screenshots or videos, or I have not changed the UI.
[x] I have added tests, or my changes don't require any.
[x] I added an app state migration, or my changes do not require one.
[x] I have documented any follow-up work that this PR will require, or it does not require any.
[x] I have added a changelog entry below, or my changes do not require one.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

iOS user-facing changes

Android user-facing changes

Dev changes

tidied-up validation for new sign-up flow - iskounen

Need help with something? Have a look at our docs, or get in touch with us.

This PR contains the following changes:

Dev changes (tidied-up validation for new sign-up flow - iskounen)

  Generated by :no_entry_sign: dangerJS against 11630dd95b73b64cb5a1aa8563f3f0d4070aa79d


Applied dynamic gas pricing and burning mechanism

This PR introduces appliance of dynamic gas pricing and burning mechanism for Magma hard fork.
From Magma hard fork, Klaytn will burn half of the transaction fee.
Also depends on base fee, we need to decide what to use between gasPrice and baseFee when calculate transaction fee.
I will update Klaytn version when Klaytn release v1.9.0

Don't we need to change KIP71 to Magma?

This test will be failed until Klaytn version is updated.

@kjhman21 I added a commit separately for main logic.
You can take a look https://github.com/klaytn/rosetta-klaytn/pull/115/commits/e2bb2d7cc47b70c5bc511cb34f61d8140b5af680 mainly.
The others are test data or READMD modification.

I have read the CLA Document and I hereby sign the CLA


Sandbox issue

Sandbox issue: ssh can not access /var/mobile/Containers/Data

same here, and also with Filza

5.0.1 fix this issus.


fix: failed to locate @import file ./colors.styl

I was getting the following error:
[vite] SFC style compilation error:
<EMAIL_ADDRESS>?type=style&index=0:4:11
   1|
   2| @import './themes/default/index.styl'
   3| .v--default-css
   4|   @import './colors'
----------------^
   5|   @import './toast'
   6|

failed to locate @import file ./colors.styl
    at ".v--default-css" (/Users/simon/Documents/GitHub/slash-commands-gui-v2/node_modules/@meforma/vue-toaster/src/Toaster.vue?type=style&index=0:4:1)

I fixed it by fixing the import path. Maybe these files should be imported from the index.styl file?


Deprecated videoanalyzer and retract v0.4.1

[ ] The purpose of this PR is explained in this or a referenced issue.
[ ] The PR does not update generated files.

These files are managed by the codegen framework at Azure/autorest.go.

[ ] Tests are included and/or updated for code changes.
[ ] Updates to CHANGELOG.md are included.
[ ] MIT license headers are included in each file.

Wait for final deprecation message.

please also deprecate packages under profiles

/azp run

/azp run Azure.azure-sdk-for-go


Getting runtime error.

Hi, @Ki6an  it's great work. But while executing below code
from fastT5 import export_and_get_onnx_model
from transformers import AutoTokenizer

model_name = 't5-small'
model = export_and_get_onnx_model(model_name)

tokenizer = AutoTokenizer.from_pretrained(model_name)
t_input = "translate English to French: The universe is a dark forest."
token = tokenizer(t_input, return_tensors='pt')

tokens = model.generate(input_ids=token['input_ids'],
               attention_mask=token['attention_mask'],
               num_beams=2)

output = tokenizer.decode(tokens.squeeze(), skip_special_tokens=True)
print(output)

I'm getting this error.
RuntimeError: output with shape [5, 12, 1, 2] doesn't match the broadcast shape [5, 12, 2, 2]

@abhinavsp0730 that's a known issue in transformers library while exporting t5 to onnx. the issue can be fixed by following the guide in this notebook.
or you can make the following changes in the modeling_t5.py file of your local transformers library  and save it:

I've already created PR for this issue here

@Ki6an thanks for the help. Is this method is supported for GPU or CPU?

@Ki6an thanks for the help. Is this method is supported for GPU or CPU?

I'm guessing it's not using onnxruntime-gpu package.So is fastT5 compatable with Gpu if we install
onnxruntime-gpu in place of onnxruntime?

@abhinavsp0730 currently fastT5 doesn't support GPU yet, will be working on this in the future.
onnxruntime-gpu doesn't support  quantization & for the onnx model to perform better than the PyTorch models on GPU need to implement IObinding.


How to generate the PDF

Hi,
Great idea for a tool to generate PDF from RAML, the only project I've found so far.
I'm trying to use this to convert a RAML file I generated. I used the raml2html and it works.
I wanted to generate a PDF but I don't know how to do that. I followed the steps and installed everything. Thanks for any help.

I cannot get the pdf generated and getting no response from postman


⚠ Bofrost.be has degraded performance

In 319c2f1, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1348 ms

Resolved: Bofrost.be performance has improved in fbde39f after 1 hour, 8 minutes.


[Identity] potentially fix min-max tests

Packages impacted by this PR
@azure/identity
Issues associated with this PR

None documented

Describe the problem that is addressed by this PR

Fix min-max tests in live test pipeline. The failures occur due to references to non-public constants of the sdk code through the public tests. So fixing these references will potentially solve the pipeline failures.

Checklists

[x] Added impacted package name to the issue description

API change check
API changes are not detected in this pull request.


the request could not be performed because of a device I/O error

I can mount the Google Cloud Storage within the project I previously connected to using rclone command line. I see the Buckets within the project via Windows Explorer. However, when I click on a Bucket to open it I get the above error.
Any suggestions?

file io screen shot
I can see all of the buckets within the project but cannot access them
![rclonetray file io error](https://user-images.githubusercontent.com/1082625/62839143-f75ebf80-bc53-11e9-81cb-fa72def

97379.png)


running the examples on windows after cloning the repository throws an error

trying to run the demo examples on windows -using intellij- after cloning the repository throws the following error
Exception in thread "main" java.lang.UnsatisfiedLinkError: Native library crossterm.dll (/native/x86_64-windows/crossterm.dll) cannot be found on the classpath.
the IDE isn't reporting any errors and running the command "bleep run demo@jvm213 " on the contribution page runs all the examples but when trying to run them from the IDE it throws the error above

Thanks for reporting. I should note that running the examples in intellij doesn't work very well in any case, because the terminal you get there does not allow you to enter into raw mode. All the demos require that, though the library can be used to write applications without raw mode.
That said, this should work up until where it fails to enter raw mode.
Can you ensure that you have ran bleep generate-jni-library first? And the perhaps try a BSP reload in intellij after it has been produces?
I don't have windows myself, so if I don't get more information it'll likely take long to solve

I'll just have to guess this was not running bleep generate-jni-library for now. This will be automatic from now on


vips: 8.13.3 -> 8.14.1

Description of changes
Diff: https://github.com/libvips/libvips/compare/v8.13.3...v8.14.1
Changelog: https://github.com/libvips/libvips/blob/v8.14.1/ChangeLog

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[x] x86_64-darwin
[x] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

I am assuming tests are not passing on darwin without __darwinAllowLocalNetworking = true;? assuming it is required, I do not oppose it, but I have not tested it with and without myself.
also, are we sure that the imaginary change should not be a separate pr?

No. It is a separate commit, that is fine.
But ideally it should be one commit per package for an upgrade with details being part of commit message.

Result of nixpkgs-review pr 215074 run on x86_64-linux 1

1 package failed to build:

photoflow

18 packages built:

faircamp
grafana-image-renderer
haskellPackages.gi-vips
imaginary
imgproxy
joplin
nip2
python310Packages.pyvips
python310Packages.pyvista
python310Packages.scooby
python310Packages.sfepy
python311Packages.pyvips
python311Packages.scooby
rubyPackages.ruby-vips (rubyPackages_2_7.ruby-vips)
rubyPackages_3_0.ruby-vips
rubyPackages_3_1.ruby-vips
vips
vipsdisp

Yup, just the photoflow failure on macos 10.15 too


Added hugo bootstrap

Addresses #644

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


pfe-audio-player

Component name: PFE Audio Player

An audio player is a set of interactive playback controls used to play audio clips.

Design specification
Need to consult with Aaron Williamson for use cases for Podcasts and Kelsey Cannon for analytics needs
Accessibility
TBD
Interaction
TBD
Analytics
Custom events needed. Need to consult with Kelsey Cannon on tracking.

Possible tool we can extend: https://github.com/elmsln/lrnwebcomponents/tree/master/elements/a11y-media-player

Some example components:

https://github.com/davatron5000/podcast-player/tree/lit-version
https://github.com/LRNWebComponents/a11y-media-player

TODO Research SRT format for transcript

What formats does https://www.rev.com/ provide and how can we consume those outputs directly?

Look to https://simplecast.com for what kind of analytics they provide

RSS feed https://feeds.pacific-content.com/commandlineheroes

@castastrophe Do you have what you need to get started on the pfe-audio-player MVP? From my interpretation, it seems like the following are the most important features that are being requested.
[X] = ranking number (spreadsheet)

Support for compact player [20]
Basic controls (play, pause) [20]
Time (current, remaining) [18]
Adjust volume via slider [17]
Mute/volume on [16]
Subscribe (links to podcast platforms, if applicable) [16]
Support for full player [15]
Metadata (title, description, supporting text) [15]
Advanced controls (rewind by X seconds, fast forward by X seconds) [15]
Support for mini player [14]
Thumbnail image [14]

I can put together more designs with these features only if that would be helpful.

@castastrophe @heyMP See link below for detailed specs.
https://xd.adobe.com/view/6f46d2c1-deb2-4f6e-a8e3-7b92b06c2cad-3a15/

@bennypowers @marionnegp does it make sense to transfer this issue over into our RHDS space and update with relevant links, etc?

@methomps, I think so. I don't see an audio player as a component in PatternFly.

Yes, let's do this in RHDS -> https://github.com/RedHat-UX/red-hat-design-system/issues/317


Freezing

Is there any way to disable the water in Godot's editing mode because for me the editor freezes now

Sorry, it was my own fault, it was my own code that was inefficient


Make better use of PSRAM

We're low on RAM in the VDP, so we should do our best to use PSRAM for our data.
Dave Plummer had mentioned in one of his videos that for his ESP32 code he uses a custom C++ memory allocator that will prefer to place objects in PSRAM.
The allocator in question can be found here:
https://github.com/PlummersSoftwareLLC/NightDriverStrip/blob/2f85b588cea27af81002811734e0f4f0198422b3/include/types.h#L203
Examples of that allocator in use can be seen throughout the codebase for NightDriverStrip

Allocator has been added, and is now quite widely used


Feature request: add a confirmation to /nextron:rl

Defeats the purpose of the command not having a confirmation, unlike bukkit:rl


Thread safe global configs

We run tests in different threads, frequently threads modify global configuration. Is it possible to use my implementation configurations class? Now this is not possible because you uses static fields in config class and it is not thread safe.
If you can create an interface+provider for the configuration will be comfortable and will allow users to modify the behavior of the test in runtime. But it will result in many changes in the existing user code. It would be good to announce it now and commited in selenide 3.0

@admizh It's not a bad idea at all. But.. I guess it would require too many changes. We cannot force all Selenide users to modify all their tests.
Though, it would be acceptable if we only need to modify Selenide code itself.

@admizh Hi!
We discussed this issue with @yashaka and agreed that it would be possible.
Look for issue https://github.com/codeborne/selenide/issues/354, it's about the same.
I am going to implement it at some moment.
(just for your information)

Great news!

It seems to me that it's impossible do fix this problem in place without breaking backward compatibility.
I can propose following scenario:

Create a new ConfigurationOld class, mark it as @Deprecated
Make Configuration class to extend ConfigurationOld
Move all static parameters from Cinfiguration to ConfigurationOld (for backward compatibility)
Create nested class Configuration.ConfigurationContainer and declare a method ConfigurationContainer ConfigurationOld.get() which will return an instance of ConfigurationContainer from ThreadLocal (to make sure that each thread works with it's own version of configuration.
For each static variable from ConfigurationOld create a non-static variable in ConfigurationContainer with the same name/type/doc. Mark static variable as @Deprecated and add a comment with a link to a new non-static config variable.

Eventually all old-style static variables will become deprecated as not thread safe and users will migrate to a newer configuration after a while, especially if we will add new configuration parameters to the new ConfigurationContainer only.

@jane-ryabchenko I agree, we will do something like this.
But I suggest a little bit another implementation:

Leave Configuration class as is. Users who don't parallelize tests,  or parallelize with processes (like me), will not need to change anything.
Create another ThreadSafeConfiguration class that will take all its initial values from Configuration. It will allow users to set all default values in Configuration and customize them on demand in ThreadSafeConfiguration instances.

Got it. I see two options here

When thread calls ThreadSafeConfiguration.get for the first time, we
will copy current values from Configuration as initial values for
every property.

We creating a thread local copy of each of the property from
Configuration only when thread tries to change its value.

Wdyt?
On 11-Sep-17 14:27, Andrei Solntsev wrote:

@jane-ryabchenko https://github.com/jane-ryabchenko I agree, we will
do something like this.
But I suggest a little bit another implementation:

Leave |Configuration| class as is. Users who don't parallelize
tests, or parallelize with processes (like me), will not need to
change anything.
Create another |ThreadSafeConfiguration| class that will take all
its initial values from |Configuration|. It will allow users to
set all default values in |Configuration| and customize them on
demand in |ThreadSafeConfiguration| instances.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/codeborne/selenide/issues/252#issuecomment-328663679,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AU8sMX07y4uaaFFY0CWtGWtB1Ff0n1okks5shaXKgaJpZM4G0pLo.


input with types other than text?

It would be cool to have input type as an option.
Right now I need inputs with type email, so keyboard on mobile devices shows with the @ key.

Oh for sure!


Update note to state app service plans with a different OS will be in a different webspace

We encountered an issue recently where we wanted to have a certificate that's in a resource-group-1, Australia Southeast, and Windows webspace added to an app service in resource-group-1, Australia Southeast, and Linux webspace.
This didn't work and we weren't sure why it wouldn't work as the documentation didn't mention that different OS would be bound to a different webspace.
Can we add a note to inform that different a Linux app service and a Windows app service will be bound to a different webspace even though they're in the same resource group and region combination? The certificate then needs to be imported to the correct webspace first before it can be used.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cc2ee874-df45-1de2-1b30-1fd75c7fd709
Version Independent ID: ee181722-8386-9842-407f-d0549012d2e9
Content: Add and manage TLS/SSL certificates - Azure App Service
Content Source: articles/app-service/configure-ssl-certificate.md
Service: app-service
GitHub Login: @cephalin
Microsoft Alias: cephalin

@stambunan, Thanks for the feedback! We are taking a look into this and will get back to you soon.

stambunan, Apologies for the delay in responding here! While I was discussing on this internally, when you say "This didn't work"- did you receive any specific error message? and you mentioned "The certificate then needs to be imported to the correct webspace first before it can be used." did you resolve this by moving to the intended RG-region?
-As noted in the Azure doc here  - " You can’t specify the webspace you want when creating a plan, but it’s possible to ensure that a plan is created in the same webspace as an existing plan. "
Also, as mentioned in Azure doc :  “Linux and Windows App Service plans can now share resource groups. This limitation has been lifted from the platform and existing resource groups have been updated to support this.”

Hey @AjayKumar-MSFT , it did not import the key vault certificate properly and instead showed the Successfully imported Key Vault Certificate: /subscription/etcetc message instead. This was attempted through the Azure portal and no matter how many tries we attempted, it was still the same message.
When I tried to attach the certificate using a bicep template, it gave me a different warning, something along the likes of a 404 certificate not found. I can't remember the exact error message but it was definitely different than the Successfully imported key vault certificate message.
After raising this issue with the support team, they suggested that we needed to import the web app certificate first to the correct webspace by running the following command:
az webapp config ssl import --name my-linux-app-service-1 --resource-group my-resource-group-1 --key-vault my-key-vault --key-vault-certificate-name my-certificate-2

That seemed to do the trick and it did create a new certificate under the resource group for the correct webspace. I can see the certificate is in a Linux webspace when I query resources.azure.com
With your second point that Linux and Windows App Service can now share resources groups and then I'm assuming be in a single webspace, when was this implemented? Would our issue with importing a certificate be related to this if the resource groups were created a long time ago?

stamdunan, Thanks for the follow-up and sharing additional info.
As mentioned by btardif (our App Service PM) on a similar discussion thread, (around Jul 29, 2021 - timeframe)
"Any new resource group since Jan 2021 is enabled to allow Windows/Linux sharing.
We have migrated >99% of all other existing resource groups to enable sharing. " - if the RG was created prior to Jan 2021, it's a possible cause for the error.


Deployment Guide for vanilla "Ready to Go" Azure Arc Data Services environment (AKS)

Describe the solution you'd like
Documentation on how to deploy a "Ready to Go" Azure Arc Data Services environment with Azure Kubernetes Service (AKS)
Describe alternatives you've considered
N/A
Additional context
N/A

Closed
https://github.com/microsoft/azure_arc/blob/master/azure_arc_data_jumpstart/docs/aks_dc_vanilla_arm_template.md


Automate project management

This PR if merged allows the automation of project management to move card between "In Review" and "Approved for Merging" when the "Passed" label is added/removed

This change is

Codecov Report

Merging #3355 into develop will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop    #3355   +/-   ##
========================================
  Coverage    70.46%   70.47%
========================================
  Files          684      684
  Lines        55001    55001
========================================
+ Hits         38759    38762    +3
+ Misses       16242    16239    -3

Impacted Files
Coverage Δ

src/ripple/basics/DecayingSample.h
86.48% <0.00%> (+8.10%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4f422f6...f53dee9. Read the comment docs.

Need to be squashed down into a single commit prior to merging.

Need to be squashed down into a single commit prior to merging.

Updated and squashed

It is a false positive that the automation failed. This automation uses a token which is not passed to a PR that is submitted via a fork - so failure is expected. Once merged, it will have access to the token. see the screenshot.


Clarify the Active Users per Day and Version graph

From what I understand from the curves, when you say v0.x in the legend it actually means v0.x and older cumulated, since the pattern of beta / release is clearly identifiable. It would be good to clarify it, or best imho to change it to a cumulated graph of each version, that would allow a clearer picture.

It is a stacked graph of each version. I'm not sure how to clarify this better?


feat: UNIT_TEST UDC

Description
Adding a UNIT_TEST UDC . This UDC will run unit tests and produce code coverage info using LLVM instrumentation-based coverage with the help of cargo-llvm-cov that supports nextest. The code coverage info will be printed on the stout after the test results as a support for the devs and will be also saved as an artifact to be used in CI.
Nextest will also create a test report in junit format that can be saved as artifact and used in CI.
The unit test alias and the testci alias have been removed as they will be substitute with a earthly target
Related Issue(s)
List the issue numbers related to this pull request.

e.g., Closes #123, Resolves #456  Fixes #367

Please confirm the following checks

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream module

@kukkok3 lgtm. Feel free to merge.


customHeaders not available for "InternalApplicationInsightsEndpoint"

Hi,
We are using Service Workers on Angular. I would like to by-pass service worker for application insights tracking calls. An easy way to do this is to specify the ngsw-bypass header for those requests.
I am setting this header via the customHeaders configuration variable, but the header is not included in the resulting call.
After tracing the code, it seems to be due to https://github.com/microsoft/ApplicationInsights-JS/blob/master/channels/applicationinsights-channel-js/src/Sender.ts#L265 and !isInternalApplicationInsightsEndpoint(_self._senderConfig.endpointUrl()) evaluating to false.
Would there be issues in allowing "internal endpoints" to use custom headers?

Yes, as if a customer header is included (sent) the browser will perform an OPTIONS call and when that header is not included in the response the browser will block the call from being sent.

I see. I am working with servers which AllowAnyHeader and therefore include this one in their response, but I can see how the App Insights servers would be more tightly locked down.
May I ask then:

What is the purpose of the customHeaders configuration? I would assume this SDK would only communicate with the Application Insights systems and therefore it wouldn't be useful.
Do you have a recommendation for configuring the SDK for usage with service worker?

We actually have some customers that don't directly send the request to AzureMonitor, but rather send to themselves so they can either add more information or do some additional authentication etc. So the customHeaders allow them to populate / provide any additional headers they need.
In terms of running in a service worker environment, this is supported by the SDK. So (in theory) you shouldn't need to do anything special (some environments (react comes to mind) where you (previously) needed to provide a polyfill for XMLHttpRequest, but we now support using fetch(). I think the issue here is the addition of the ngsw-bypass header which is not "specifically" a service worker issue.
I think for what your trying to do (if I'm understanding correctly) is to use the excludeRequestFromAutoTrackingPatterns config option to specify the URL's you want to ignore. It's documented in the README but the main automatic readme inclusion is truncating the description column, so here is a link to the file directly

Thank you for the background and details.
What I am trying to do is actually a bit different. There are XHR requests which are tracked via App Insights tracking requests which is what I want. All requests (XHR and the AI ones) first go through the Service Worker by default, unless I set the magic header. I am able to do that for my XHR, but not for the AI requests.
It's not a huge deal, but I thought I would ask. Thanks for your help.


Accessing attributes of Held Class sometimes raises

Appears to be okay if we load the instance into a temporary variable, but not if we access attributes on the same line the instance is constructed.
See test_printAttributesShouldWork in date_time_test.py in 9af7203d8fb11862df9fa48aef2339876a270726

On what branch?
On Mon, Jan 30, 2023 at 11:28 AM aaronmlevy @.***>
wrote:

Appears to be okay if we load the instance into a temporary variable, but
not if we access attributes on the same line the instance is constructed.
See test_printAttributesShouldWork in date_time_test.py
—
Reply to this email directly, view it on GitHub
https://github.com/APrioriInvestments/typed_python/issues/421, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AB6OHBFANN2MLDUAFP24XX3WU7T4TANCNFSM6AAAAAAULLQX2U
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Branch is aaron_timestamp.
Commit hash is 9af7203d8fb11862df9fa48aef2339876a270726.

Here's a simple test:
def test_printAttributesShouldWork():
    # This is okay.
    dt = DateTime(2023, 1, 2, 18, 10, 1.0)
    dt.date

    # This is not.
    DateTime(2023, 1, 2, 18, 10, 1.0).date