Error with nccl_mpi_all_reduce on multinode system

Hi all,
What is the command line to run nccl_mpi_all_reduce on a multi-node system (2 nodes with 4 GPUs each one)?, and I am getting the below error when typing this command:

DeepBench/code$ mpirun -np 8 bin/nccl_mpi_all_reduce

WARNING: There is at least non-excluded one OpenFabrics device found, but there are no active ports detected (or Open MPI was unable to use them).  This is most certainly not what you wanted.  Check your cables, subnet manager configuration, etc.  The openib BTL will be ignored for this job.
Local host: C4-1
terminate called after throwing an instance of 'std::runtime_error'
what():  Failed to set cuda device
When running only with 4 ranks, I get this output:

DeepBench/code$ mpirun -np 4 bin/nccl_mpi_all_reduce

WARNING: There is at least non-excluded one OpenFabrics device found,
but there are no active ports detected (or Open MPI was unable to use
them).  This is most certainly not what you wanted.  Check your
cables, subnet manager configuration, etc.  The openib BTL will be
ignored for this job.
Local host: C4-1
NCCL MPI AllReduce
Num Ranks: 4
# of floats    bytes transferred    Avg Time (msec)    Max Time (msec)

[C4130-1:04094] 3 more processes have sent help message help-mpi-btl-openib.txt / no active ports found
[C4130-1:04094] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
100000         400000            0.148489            0.148565
3097600       12390400             2.63694             2.63695
4194304       16777216             3.57147             3.57148
6553600       26214400             5.59742             5.59744
16777217       67108868             81.9391             81.9396
38360000      153440000             32.6457             32.6462
Thanks

@mpatwary , can you help with this?

It looks like you are using the right command and I think the problem is unrelated to nccl_mpi_all_reduce. Do the other MPI implementations run well like ring_all_reduce and osu_allreduce? I suspect the problem could be the setup. Does any other code with MPI run well in your system?

hi @mpatwary, my system has 2 nodes,each with 4 P100 GPUs (total 8 gpus) connected using infiniband, I was wonder how mpirun communicates between the nodes to implement the distributed benchmark?
ring_all_reduce and osu_allreduce are throwing errors when I compile the DeepBench benchmarks:
Compilation:
make CUDA_PATH=/usr/local/cuda-9.1 CUDNN_PATH=/usr/local/cuda/include/ MPI_PATH=/home/dell/.openmpi/ NCCL_PATH=/home/$USER/.openmpi/ ARCH=sm_60
Normal outputs and errors:
mkdir -p bin
make -C nvidia
make[1]: Entering directory '/home/dell/DeepBench/code/nvidia'
mkdir -p bin
/usr/local/cuda-9.1/bin/nvcc gemm_bench.cu -DUSE_TENSOR_CORES=0 -DPAD_KERNELS=1 -o bin/gemm_bench -I ../kernels/ -I /usr/local/cuda-9.1/include -L /usr/local/cuda-9.1/lib64 -lcublas -L /usr/local/cuda-9.1/lib64 -lcurand --generate-code arch=compute_60,code=sm_60 -std=c++11
mkdir -p bin
/usr/local/cuda-9.1/bin/nvcc conv_bench.cu -DUSE_TENSOR_CORES=0 -DPAD_KERNELS=1 -o bin/conv_bench -I ../kernels/ -I /usr/local/cuda-9.1/include -I /usr/local/cuda/include//include/ -L /usr/local/cuda/include//lib64/ -L /usr/local/cuda-9.1/lib64 -lcurand -lcudnn --generate-code arch=compute_60,code=sm_60 -std=c++11
mkdir -p bin
/usr/local/cuda-9.1/bin/nvcc rnn_bench.cu -DUSE_TENSOR_CORES=0 -o bin/rnn_bench -I ../kernels/ -I /usr/local/cuda-9.1/include -I /usr/local/cuda/include//include/ -L /usr/local/cuda/include//lib64/ -L /usr/local/cuda-9.1/lib64 -lcurand -lcudnn --generate-code arch=compute_60,code=sm_60 -std=c++11
mkdir -p bin
/usr/local/cuda-9.1/bin/nvcc nccl_single_all_reduce.cu -o bin/nccl_single_all_reduce -I ../kernels/ -I /home/root/.openmpi//include/ -I /usr/local/cuda/include//include/ -L /home/root/.openmpi//lib/ -L /usr/local/cuda/include//lib64 -lnccl -lcudart -lcurand --generate-code arch=compute_60,code=sm_60 -std=c++11
mkdir -p bin
/usr/local/cuda-9.1/bin/nvcc nccl_mpi_all_reduce.cu -o bin/nccl_mpi_all_reduce -I ../kernels/ -I /home/root/.openmpi//include/ -I /usr/local/cuda/include//include/ -I /home/dell/.openmpi//include -L /home/root/.openmpi//lib/ -L /usr/local/cuda/include//lib64 -L /home/dell/.openmpi//lib -lnccl -lcurand -lcudart -lmpi --generate-code arch=compute_60,code=sm_60 -std=c++11
make[1]: Leaving directory '/home/dell/DeepBench/code/nvidia'
cp nvidia/bin/* bin
rm -rf nvidia/bin
mkdir -p bin
make -C osu_allreduce
make[1]: Entering directory '/home/dell/DeepBench/code/osu_allreduce'
mkdir -p bin
gcc -o bin/osu_coll.o -c -O2 -pthread -Wall -march=native -I/usr/local/cuda-9.1/include -I/home/dell/.openmpi//include osu_coll.c
gcc -o bin/osu_allreduce.o -c -O2 -pthread -Wall -march=native -I ../kernels/ -I/usr/local/cuda-9.1/include -I/home/dell/.openmpi//include osu_allreduce.c
gcc -o bin/osu_allreduce -pthread -Wl,--enable-new-dtags -Wl,-rpath=/usr/local/cuda-9.1/lib64 -Wl,-rpath=/home/dell/.openmpi//lib bin/osu_allreduce.o bin/osu_coll.o -L/usr/local/cuda-9.1/lib64 -L/home/dell/.openmpi//lib -lstdc++ -lmpi_cxx -lmpi -lcuda
/usr/bin/ld: cannot find -lmpi_cxx
collect2: error: ld returned 1 exit status
Makefile:17: recipe for target 'build' failed
make[1]: *** [build] Error 1
make[1]: Leaving directory '/home/dell/DeepBench/code/osu_allreduce'
Makefile:6: recipe for target 'osu_allreduce' failed
make: *** [osu_allreduce] Error 2
I have recompiled, and ran it again with 4 and 8 gpus but now I got another the below error:
mpirun --allow-run-as-root -np 8 bin/nccl_mpi_all_reduce
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
bin/nccl_mpi_all_reduce: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
Process name: [[41026,1],0]
Exit code:    127

Looks like the code is not getting the path to the mpi lib directory. You can try exporting that.

@mpatwary, thanks for your prompt reply. I exported that and have gotten other errors.  My system has 2 nodes, each with 4 P100 GPUs (total 8 gpus) connected using infiniband, I was wonder how mpirun communicates between the nodes to implement the distributed benchmark?. It looks like the command mpirun --allow-run-as-root -np 8 bin/nccl_mpi_all_reduce is just considering one the host node;  my understanding is that mpirun should receive the flag -H with the ib address of both servers (I tried this option but got errors too).  Can you share the command line you have used implemented DeepBench with multinode and multi gpus systems?

I have a problem here as well. Normal single version works fine. All other MPI applications are working. But i get this one here:
NCCL MPI AllReduce
Num Ranks: 2
# of floats    bytes transferred    Avg Time (msec)    Max Time (msec)

terminate called after throwing an instance of 'std::runtime_error'
terminate called after throwing an instance of 'std::runtime_error'
what():  NCCL failure: unhandled cuda error in nccl_mpi_all_reduce.cu at line: 86 rank: 0
[jetson-3:29969] *** Process received signal ***
[jetson-3:29969] Signal: Aborted (6)
[jetson-3:29969] Signal code:  (-6)
what():  NCCL failure: unhandled cuda error in nccl_mpi_all_reduce.cu at line: 86 rank: 1
[jetson-2:08669] *** Process received signal ***
[jetson-2:08669] Signal: Aborted (6)
[jetson-2:08669] Signal code:  (-6)
[jetson-2:08669] *** End of error message ***
[jetson-3:29969] *** End of error message ***
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.

mpiexec noticed that process rank 0 with PID 0 on node jetson-3 exited on signal 6 (Aborted).


Add readline functionality to Entry and TextEdit

This PR introduces a rune buffer (inspired by chzyer/readline to add basic readline functionality to Entry and TextEdit.
Fixes #17 and #51

There is still an issue when moving through a TextEdit across newlines, but I believe to solve it properly we need a better library for wrapping text that doesn't strip whitespaces. I'm merging this and creating another issue for fixing it.

Created #59


BSF pull access

Dear @herlesupreeth
Hi,
I've tested the latest Code with BSF, but when i try building docker-compose face an error:
$ docker-compose build --no-cache

.
.
.
Successfully tagged docker_open5gs_pcf:latest
Building bsf
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs
pull access denied for docker_open5gs, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
ERROR: Service 'bsf' failed to build : Build failed

I've also tested it with Logged in to docker, but same results happen!
P.S test with and Without Docker login  in both branches "Master & Cx_test"
Thanks
Best regards

There is no access restriction on any branch of this repo. You are not inside docker_open5gs repository when compiling the BSF thats the reason its throwing that error

I've been there, but did not copy the Whole command line
you can also see that pcf has tagged successfully
if i weren't there, there whole no docker-compose file!
Thanks

Here is the Full Log:
ubuntu@dv:~/docker_open5gs$ set -a && source .env
ubuntu@dv:~/docker_open5gs$ docker-compose build --no-cache
Building mongo
Sending build context to Docker daemon  6.144kB
Step 1/4 : FROM ubuntu:bionic
 ---> 81bcf752ac3d
Step 2/4 : ENV DEBIAN_FRONTEND=noninteractive
 ---> Running in 7e1c9af54c0f
Removing intermediate container 7e1c9af54c0f
 ---> c96ae43cc552
Step 3/4 : RUN apt-get update &&     apt-get install -y --no-install-recommends mongodb &&     apt-get autoremove -y && apt-get autoclean
 ---> Running in 8ca1fbcd78a9
Get:1 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:4 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:9 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2185 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [33.5 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [480 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2184 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2616 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [11.4 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [11.3 kB]
Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [24.7 kB]
Get:17 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1414 kB]
Get:18 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [450 kB]
Fetched 22.8 MB in 17s (1344 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libboost-filesystem1.65.1 libboost-iostreams1.65.1
  libboost-program-options1.65.1 libboost-system1.65.1 libgoogle-perftools4
  libpcrecpp0v5 libsnappy1v5 libssl1.1 libstemmer0d libtcmalloc-minimal4
  libunwind8 libyaml-cpp0.5v5 mongodb-clients mongodb-server
  mongodb-server-core
Recommended packages:
  mongo-tools
The following NEW packages will be installed:
  libboost-filesystem1.65.1 libboost-iostreams1.65.1
  libboost-program-options1.65.1 libboost-system1.65.1 libgoogle-perftools4
  libpcrecpp0v5 libsnappy1v5 libssl1.1 libstemmer0d libtcmalloc-minimal4
  libunwind8 libyaml-cpp0.5v5 mongodb mongodb-clients mongodb-server
  mongodb-server-core
0 upgraded, 16 newly installed, 0 to remove and 5 not upgraded.
Need to get 42.6 MB of archives.
After this operation, 152 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.9 [1301 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libboost-system1.65.1 amd64 1.65.1+dfsg-0ubuntu5 [10.5 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libboost-filesystem1.65.1 amd64 1.65.1+dfsg-0ubuntu5 [40.3 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 libboost-iostreams1.65.1 amd64 1.65.1+dfsg-0ubuntu5 [29.2 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 libboost-program-options1.65.1 amd64 1.65.1+dfsg-0ubuntu5 [137 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 libtcmalloc-minimal4 amd64 2.5-2.2ubuntu3 [91.6 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libunwind8 amd64 1.2.1-8 [47.5 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libgoogle-perftools4 amd64 2.5-2.2ubuntu3 [190 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libpcrecpp0v5 amd64 2:8.39-9 [15.3 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libstemmer0d amd64 0+svn585-1build1 [62.5 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libyaml-cpp0.5v5 amd64 0.5.2-4ubuntu1 [150 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 mongodb-clients amd64 1:3.6.3-0ubuntu1.1 [20.2 MB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 mongodb-server-core amd64 1:3.6.3-0ubuntu1.1 [20.3 MB]
Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 mongodb-server all 1:3.6.3-0ubuntu1.1 [12.6 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 mongodb amd64 1:3.6.3-0ubuntu1.1 [9968 B]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 42.6 MB in 13s (3372 kB/s)
Selecting previously unselected package libssl1.1:amd64.
(Reading database ... 4045 files and directories currently installed.)
Preparing to unpack .../00-libssl1.1_1.1.1-1ubuntu2.1~18.04.9_amd64.deb ...
Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ...
Selecting previously unselected package libboost-system1.65.1:amd64.
Preparing to unpack .../01-libboost-system1.65.1_1.65.1+dfsg-0ubuntu5_amd64.deb ...
Unpacking libboost-system1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Selecting previously unselected package libboost-filesystem1.65.1:amd64.
Preparing to unpack .../02-libboost-filesystem1.65.1_1.65.1+dfsg-0ubuntu5_amd64.deb ...
Unpacking libboost-filesystem1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Selecting previously unselected package libboost-iostreams1.65.1:amd64.
Preparing to unpack .../03-libboost-iostreams1.65.1_1.65.1+dfsg-0ubuntu5_amd64.deb ...
Unpacking libboost-iostreams1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Selecting previously unselected package libboost-program-options1.65.1:amd64.
Preparing to unpack .../04-libboost-program-options1.65.1_1.65.1+dfsg-0ubuntu5_amd64.deb ...
Unpacking libboost-program-options1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Selecting previously unselected package libtcmalloc-minimal4.
Preparing to unpack .../05-libtcmalloc-minimal4_2.5-2.2ubuntu3_amd64.deb ...
Unpacking libtcmalloc-minimal4 (2.5-2.2ubuntu3) ...
Selecting previously unselected package libunwind8:amd64.
Preparing to unpack .../06-libunwind8_1.2.1-8_amd64.deb ...
Unpacking libunwind8:amd64 (1.2.1-8) ...
Selecting previously unselected package libgoogle-perftools4.
Preparing to unpack .../07-libgoogle-perftools4_2.5-2.2ubuntu3_amd64.deb ...
Unpacking libgoogle-perftools4 (2.5-2.2ubuntu3) ...
Selecting previously unselected package libpcrecpp0v5:amd64.
Preparing to unpack .../08-libpcrecpp0v5_2%3a8.39-9_amd64.deb ...
Unpacking libpcrecpp0v5:amd64 (2:8.39-9) ...
Selecting previously unselected package libstemmer0d:amd64.
Preparing to unpack .../09-libstemmer0d_0+svn585-1build1_amd64.deb ...
Unpacking libstemmer0d:amd64 (0+svn585-1build1) ...
Selecting previously unselected package libyaml-cpp0.5v5:amd64.
Preparing to unpack .../10-libyaml-cpp0.5v5_0.5.2-4ubuntu1_amd64.deb ...
Unpacking libyaml-cpp0.5v5:amd64 (0.5.2-4ubuntu1) ...
Selecting previously unselected package libsnappy1v5:amd64.
Preparing to unpack .../11-libsnappy1v5_1.1.7-1_amd64.deb ...
Unpacking libsnappy1v5:amd64 (1.1.7-1) ...
Selecting previously unselected package mongodb-clients.
Preparing to unpack .../12-mongodb-clients_1%3a3.6.3-0ubuntu1.1_amd64.deb ...
Unpacking mongodb-clients (1:3.6.3-0ubuntu1.1) ...
Selecting previously unselected package mongodb-server-core.
Preparing to unpack .../13-mongodb-server-core_1%3a3.6.3-0ubuntu1.1_amd64.deb ...
Unpacking mongodb-server-core (1:3.6.3-0ubuntu1.1) ...
Selecting previously unselected package mongodb-server.
Preparing to unpack .../14-mongodb-server_1%3a3.6.3-0ubuntu1.1_all.deb ...
Unpacking mongodb-server (1:3.6.3-0ubuntu1.1) ...
Selecting previously unselected package mongodb.
Preparing to unpack .../15-mongodb_1%3a3.6.3-0ubuntu1.1_amd64.deb ...
Unpacking mongodb (1:3.6.3-0ubuntu1.1) ...
Setting up libboost-iostreams1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Setting up libstemmer0d:amd64 (0+svn585-1build1) ...
Setting up libboost-system1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Setting up libtcmalloc-minimal4 (2.5-2.2ubuntu3) ...
Setting up libunwind8:amd64 (1.2.1-8) ...
Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.9) ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libpcrecpp0v5:amd64 (2:8.39-9) ...
Setting up libyaml-cpp0.5v5:amd64 (0.5.2-4ubuntu1) ...
Setting up libboost-program-options1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Setting up libboost-filesystem1.65.1:amd64 (1.65.1+dfsg-0ubuntu5) ...
Setting up libgoogle-perftools4 (2.5-2.2ubuntu3) ...
Setting up mongodb-server-core (1:3.6.3-0ubuntu1.1) ...
Setting up mongodb-clients (1:3.6.3-0ubuntu1.1) ...
Setting up mongodb-server (1:3.6.3-0ubuntu1.1) ...
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up mongodb (1:3.6.3-0ubuntu1.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
Reading package lists...
Building dependency tree...
Reading state information...
0 upgraded, 0 newly installed, 0 to remove and 5 not upgraded.
Reading package lists...
Building dependency tree...
Reading state information...
Removing intermediate container 8ca1fbcd78a9
 ---> dfcb2e4cd25b
Step 4/4 : CMD /mnt/mongo/mongo_init.sh
 ---> Running in 6b2bd5171612
Removing intermediate container 6b2bd5171612
 ---> 04db192269c2
Successfully built 04db192269c2
Successfully tagged docker_open5gs_mongo:latest
Building webui
Sending build context to Docker daemon  6.144kB
Step 1/5 : FROM docker_open5gs_cx
 ---> 3c9774d4a158
Step 2/5 : ENV DEBIAN_FRONTEND=noninteractive
 ---> Running in 212027b0de76
Removing intermediate container 212027b0de76
 ---> c343d8673eeb
Step 3/5 : RUN apt-get update &&     apt-get install -y --no-install-recommends curl &&     apt-get autoremove -y && apt-get autoclean
 ---> Running in 532d96604b70
Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Fetched 252 kB in 2s (158 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libcurl4
The following NEW packages will be installed:
  curl libcurl4
0 upgraded, 2 newly installed, 0 to remove and 5 not upgraded.
Need to get 378 kB of archives.
After this operation, 1051 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libcurl4 amd64 7.58.0-2ubuntu3.13 [219 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 curl amd64 7.58.0-2ubuntu3.13 [159 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 378 kB in 1s (276 kB/s)
Selecting previously unselected package libcurl4:amd64.
(Reading database ... 7137 files and directories currently installed.)
Preparing to unpack .../libcurl4_7.58.0-2ubuntu3.13_amd64.deb ...
Unpacking libcurl4:amd64 (7.58.0-2ubuntu3.13) ...
Selecting previously unselected package curl.
Preparing to unpack .../curl_7.58.0-2ubuntu3.13_amd64.deb ...
Unpacking curl (7.58.0-2ubuntu3.13) ...
Setting up libcurl4:amd64 (7.58.0-2ubuntu3.13) ...
Setting up curl (7.58.0-2ubuntu3.13) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
Reading package lists...
Building dependency tree...
Reading state information...
0 upgraded, 0 newly installed, 0 to remove and 5 not upgraded.
Reading package lists...
Building dependency tree...
Reading state information...
Removing intermediate container 532d96604b70
 ---> 24eab5a8df54
Step 4/5 : RUN curl -fsSL https://deb.nodesource.com/setup_14.x | bash - && apt-get install -y nodejs &&     apt-get remove -y curl && apt-get autoremove -y && apt-get autoclean
 ---> Running in d9e22b353ef2
## Installing the NodeSource Node.js 14.x repo...
## Populating apt-get cache...
+ apt-get update
Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Fetched 252 kB in 2s (140 kB/s)
Reading package lists...
## Installing packages required for setup: lsb-release gnupg...
+ apt-get install -y lsb-release gnupg > /dev/null 2>&1
## Confirming "bionic" is supported...
+ curl -sLf -o /dev/null 'https://deb.nodesource.com/node_14.x/dists/bionic/Release'
## Adding the NodeSource signing key to your keyring...
+ curl -s https://deb.nodesource.com/gpgkey/nodesource.gpg.key | gpg --dearmor | tee /usr/share/keyrings/nodesource.gpg >/dev/null
## Creating apt sources list file for the NodeSource Node.js 14.x repo...
+ echo 'deb [signed-by=/usr/share/keyrings/nodesource.gpg] https://deb.nodesource.com/node_14.x bionic main' > /etc/apt/sources.list.d/nodesource.list
+ echo 'deb-src [signed-by=/usr/share/keyrings/nodesource.gpg] https://deb.nodesource.com/node_14.x bionic main' >> /etc/apt/sources.list.d/nodesource.list

## Running `apt-get update` for you...

+ apt-get update
Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:4 https://deb.nodesource.com/node_14.x bionic InRelease [4584 B]
Get:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:6 https://deb.nodesource.com/node_14.x bionic/main amd64 Packages [765 B]
Fetched 257 kB in 2s (112 kB/s)
Reading package lists...

## Run `sudo apt-get install -y nodejs` to install Node.js 14.x and npm
## You may also need development tools to build native addons:
     sudo apt-get install gcc g++ make
## To install the Yarn package manager, run:
     curl -sL https://dl.yarnpkg.com/debian/pubkey.gpg | gpg --dearmor | sudo tee /usr/share/keyrings/yarnkey.gpg >/dev/null
     echo "deb [signed-by=/usr/share/keyrings/yarnkey.gpg] https://dl.yarnpkg.com/debian stable main" | sudo tee /etc/apt/sources.list.d/yarn.list
     sudo apt-get update && sudo apt-get install yarn
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libpython-stdlib libpython2.7-minimal libpython2.7-stdlib python
  python-minimal python2.7 python2.7-minimal
Suggested packages:
  python-doc python-tk python2.7-doc binutils binfmt-support
The following NEW packages will be installed:
  libpython-stdlib libpython2.7-minimal libpython2.7-stdlib nodejs python
  python-minimal python2.7 python2.7-minimal
0 upgraded, 8 newly installed, 0 to remove and 5 not upgraded.
Need to get 28.9 MB of archives.
After this operation, 137 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpython2.7-minimal amd64 2.7.17-1~18.04ubuntu1.6 [335 kB]
Get:2 https://deb.nodesource.com/node_14.x bionic/main amd64 nodejs amd64 14.17.0-1nodesource1 [24.9 MB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python2.7-minimal amd64 2.7.17-1~18.04ubuntu1.6 [1291 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-minimal amd64 2.7.15~rc1-1 [28.1 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpython2.7-stdlib amd64 2.7.17-1~18.04ubuntu1.6 [1917 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python2.7 amd64 2.7.17-1~18.04ubuntu1.6 [248 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libpython-stdlib amd64 2.7.15~rc1-1 [7620 B]
Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python amd64 2.7.15~rc1-1 [140 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 28.9 MB in 12s (2420 kB/s)
Selecting previously unselected package libpython2.7-minimal:amd64.
(Reading database ... 8168 files and directories currently installed.)
Preparing to unpack .../0-libpython2.7-minimal_2.7.17-1~18.04ubuntu1.6_amd64.deb ...
Unpacking libpython2.7-minimal:amd64 (2.7.17-1~18.04ubuntu1.6) ...
Selecting previously unselected package python2.7-minimal.
Preparing to unpack .../1-python2.7-minimal_2.7.17-1~18.04ubuntu1.6_amd64.deb ...
Unpacking python2.7-minimal (2.7.17-1~18.04ubuntu1.6) ...
Selecting previously unselected package python-minimal.
Preparing to unpack .../2-python-minimal_2.7.15~rc1-1_amd64.deb ...
Unpacking python-minimal (2.7.15~rc1-1) ...
Selecting previously unselected package libpython2.7-stdlib:amd64.
Preparing to unpack .../3-libpython2.7-stdlib_2.7.17-1~18.04ubuntu1.6_amd64.deb ...
Unpacking libpython2.7-stdlib:amd64 (2.7.17-1~18.04ubuntu1.6) ...
Selecting previously unselected package python2.7.
Preparing to unpack .../4-python2.7_2.7.17-1~18.04ubuntu1.6_amd64.deb ...
Unpacking python2.7 (2.7.17-1~18.04ubuntu1.6) ...
Selecting previously unselected package libpython-stdlib:amd64.
Preparing to unpack .../5-libpython-stdlib_2.7.15~rc1-1_amd64.deb ...
Unpacking libpython-stdlib:amd64 (2.7.15~rc1-1) ...
Setting up libpython2.7-minimal:amd64 (2.7.17-1~18.04ubuntu1.6) ...
Setting up python2.7-minimal (2.7.17-1~18.04ubuntu1.6) ...
Setting up python-minimal (2.7.15~rc1-1) ...
Selecting previously unselected package python.
(Reading database ... 8917 files and directories currently installed.)
Preparing to unpack .../python_2.7.15~rc1-1_amd64.deb ...
Unpacking python (2.7.15~rc1-1) ...
Selecting previously unselected package nodejs.
Preparing to unpack .../nodejs_14.17.0-1nodesource1_amd64.deb ...
Unpacking nodejs (14.17.0-1nodesource1) ...
Setting up nodejs (14.17.0-1nodesource1) ...
Setting up libpython2.7-stdlib:amd64 (2.7.17-1~18.04ubuntu1.6) ...
Setting up python2.7 (2.7.17-1~18.04ubuntu1.6) ...
Setting up libpython-stdlib:amd64 (2.7.15~rc1-1) ...
Setting up python (2.7.15~rc1-1) ...
Processing triggers for mime-support (3.60ubuntu1) ...
Reading package lists...
Building dependency tree...
Reading state information...
The following package was automatically installed and is no longer required:
  libcurl4
Use 'apt autoremove' to remove it.
The following packages will be REMOVED:
  curl
0 upgraded, 0 newly installed, 1 to remove and 5 not upgraded.
After this operation, 396 kB disk space will be freed.
(Reading database ... 13892 files and directories currently installed.)
Removing curl (7.58.0-2ubuntu3.13) ...
Reading package lists...
Building dependency tree...
Reading state information...
The following packages will be REMOVED:
  libcurl4
0 upgraded, 0 newly installed, 1 to remove and 5 not upgraded.
After this operation, 654 kB disk space will be freed.
(Reading database ... 13883 files and directories currently installed.)
Removing libcurl4:amd64 (7.58.0-2ubuntu3.13) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
Reading package lists...
Building dependency tree...
Reading state information...
Removing intermediate container d9e22b353ef2
 ---> 51a7512e9128
Step 5/5 : CMD sleep 10 && /mnt/webui/webui_init.sh
 ---> Running in fe6d4b32acf0
Removing intermediate container fe6d4b32acf0
 ---> 062c65dbe9ff
Successfully built 062c65dbe9ff
Successfully tagged docker_open5gs_webui:latest
Building nrf
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs_cx
 ---> 3c9774d4a158
Step 2/2 : CMD /mnt/nrf/nrf_init.sh  &&     cd install/bin && ./open5gs-nrfd
 ---> Running in a52f915007e6
Removing intermediate container a52f915007e6
 ---> ac731c74b6b7
Successfully built ac731c74b6b7
Successfully tagged docker_open5gs_nrf:latest
Building ausf
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs_cx
 ---> 3c9774d4a158
Step 2/2 : CMD /mnt/ausf/ausf_init.sh  &&     cd install/bin && ./open5gs-ausfd
 ---> Running in bf65c155b14f
Removing intermediate container bf65c155b14f
 ---> ef2cf7d9db54
Successfully built ef2cf7d9db54
Successfully tagged docker_open5gs_ausf:latest
Building udr
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs_cx
 ---> 3c9774d4a158
Step 2/2 : CMD /mnt/udr/udr_init.sh && sleep 10 &&     cd install/bin && ./open5gs-udrd
 ---> Running in f2ffddc9c35a
Removing intermediate container f2ffddc9c35a
 ---> 807a06b4864a
Successfully built 807a06b4864a
Successfully tagged docker_open5gs_udr:latest
Building udm
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs_cx
 ---> 3c9774d4a158
Step 2/2 : CMD /mnt/udm/udm_init.sh  &&     cd install/bin && ./open5gs-udmd
 ---> Running in f15377a719b6
Removing intermediate container f15377a719b6
 ---> d9199e778118
Successfully built d9199e778118
Successfully tagged docker_open5gs_udm:latest
Building pcf
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs_cx
 ---> 3c9774d4a158
Step 2/2 : CMD /mnt/pcf/pcf_init.sh && sleep 10 &&     cd install/bin && ./open5gs-pcfd
 ---> Running in b5913ce4cd32
Removing intermediate container b5913ce4cd32
 ---> 4c1bbe96b73e
Successfully built 4c1bbe96b73e
Successfully tagged docker_open5gs_pcf:latest
Building bsf
Sending build context to Docker daemon  6.656kB
Step 1/2 : FROM docker_open5gs
pull access denied for docker_open5gs, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
ERROR: Service 'bsf' failed to build : Build failed
ubuntu@dv:~/docker_open5gs$

If you are planning to use cx_test branch then i would recommend pull the latest fix i gave just now (https://github.com/herlesupreeth/docker_open5gs/commit/2f69a1435b74ce8a1acbb180601d5b56848fa5c5) and try re-compiling only the BSF

Thanks
I did used this command " docker build --no-cache --force-rm -t docker_open5gs_cx ."
and the problem was appeared, i do not think this wil solve.
anyway  i would try this new one docker build --no-cache --force-rm -t docker_open5gs .
and let you know
One Note: before May 31, 2021 i used Cx-Test Branch and that was great and Ok but after this commit bf20c61b3b57394f7a1e109582067d7d56ad3319 the error appeard
Thanks

Is this Related to using JUST for NSA mode?

Just Tested the New fix, Its Solved
Thanks again


stats

find a way to render the stats and the tech used for the projects

tried to get stats from GitHub API. However,  I was only able to get the stats from basic languages like JavaScript, CSS, and HTML. The desired output was to render even the libraries used and the percentage of the amount of code used per library, moved this feature for future development to prioritize page deployment.


[feat] Cloning an object schema while stripping some props

I did not find any api for this, so i built it. it's not very clean but serves the purpose well. Please instruct if there's better way to do this:
import { z, ZodObject } from "zod";

type Cloned<T, K extends string | number | symbol> =
  T extends ZodObject<infer Shape, infer UnknownKeys, infer Catchall, infer Output, infer Input>
    ? ZodObject<Omit<Shape, K>, UnknownKeys, Catchall, Omit<Output, K>, Omit<Input, K>>
    : never

export function cloneSchema<
  T extends ZodObject<any>,
  K extends (keyof T['shape']),
>(schema: T, without: K[] = []) {
  const shape = Object.fromEntries(
    Object.keys(schema.shape)
      // @ts-ignore
      .filter(key => !without.includes(key))
      .map(key => [key, schema.shape[key]])
  )

  return z.object(shape) as Cloned<T, K>
}

usage:
const userSchema = z.object({
  userId: z.string(),
  email: z.string(),
})

const onlyEmail = cloneSchema(userSchema, ['userId'])

Is this any different from built-in .omit?

...no. 😅 thank you.


dnscrypt crashing

After following https://github.com/opnsense/docs/pull/169 and setting the listen address to :53, have setup to use cloudflares DoH servers only and due to my isp not supporting IPv6 yet I have blocked IPv6 in DNScrypt. Have setup overrides and enabled DNSBL/RPZ and have entries in the whitelist. It seems that DNScrypt keeps crashing or not responding as DNS lookups just stop working, only after restarting DNScrypt that things start working for a short amount of time and then back to square one
CC @mimugmail

This is what happens when dnscrypt stops responding

What do you see in General Log?

@mimugmail only

@mimugmail from my mobile as that is the only thing that I have now configured to use DNSCrypt it I get DNS_probe_finished_bad_config when trying to browse to any site

@mimugmail From the picture in General log that is from me clearing the log out after doing a complete stop of the service and and starting it back up, on Opnsense 19.1.7 amd64 LibreSSL

Do you have the chance to switch to OpenSSL for testing?

@mimugmail Yeah will give it ago

@mimugmail I rebooted after installing openssl and dnscrypt was not working at all, restarted it and it was working longer than it has previously but still ends up not responding

Also *.googleapis.com is in my whitelist

@mimugmail This is what I am using in my DNSBL

Can you send me the dnscrypt part of your config.xml so I can test here?

Where is the config.xml located?

@mimugmail I have found it, got an email I can send it to?

/config/config.xml

https://github.com/opnsense/plugins/blob/master/dns/dnscrypt-proxy/Makefile#L5

@mimugmail email sent

I was able to reproduce, can you try disabling "Use IPv6 Servers"?
Am Mo., 6. Mai 2019 um 20:18 Uhr schrieb J.Townsend <
<EMAIL_ADDRESS>
@mimugmail https://github.com/mimugmail email sent
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/opnsense/plugins/issues/1326#issuecomment-489721518,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE355IMFIBGYM5JZPWNRJ53PUBY6JANCNFSM4HLBGH5Q
.

Will try after work

From: Michael<EMAIL_ADDRESS>Sent: Tuesday, May 7, 2019 1:00:45 PM
To: opnsense/plugins
Cc: J.Townsend; Author
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
I was able to reproduce, can you try disabling "Use IPv6 Servers"?
Am Mo., 6. Mai 2019 um 20:18 Uhr schrieb J.Townsend <
<EMAIL_ADDRESS>
@mimugmail https://github.com/mimugmail email sent
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/opnsense/plugins/issues/1326#issuecomment-489721518,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE355IMFIBGYM5JZPWNRJ53PUBY6JANCNFSM4HLBGH5Q
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/opnsense/plugins/issues/1326#issuecomment-490049935, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AA3V2QWPCBXMSYI45FJXS6LPUFVO3ANCNFSM4HLBGH5Q.

@mimugmail After some long testing this seems to have fixed the issue

From: Jay Townsend
Sent: Tuesday, May 7, 2019 2:03:09 PM
To: opnsense/plugins
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
Will try after work

From: Michael<EMAIL_ADDRESS>Sent: Tuesday, May 7, 2019 1:00:45 PM
To: opnsense/plugins
Cc: J.Townsend; Author
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
I was able to reproduce, can you try disabling "Use IPv6 Servers"?
Am Mo., 6. Mai 2019 um 20:18 Uhr schrieb J.Townsend <
<EMAIL_ADDRESS>
@mimugmail https://github.com/mimugmail email sent
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/opnsense/plugins/issues/1326#issuecomment-489721518,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE355IMFIBGYM5JZPWNRJ53PUBY6JANCNFSM4HLBGH5Q
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/opnsense/plugins/issues/1326#issuecomment-490049935, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AA3V2QWPCBXMSYI45FJXS6LPUFVO3ANCNFSM4HLBGH5Q.

Great, can you close please.

@mimugmail Might be worth putting in a check or warning to say that if you do not have IPv6 from your ISP that having it on will cause it to break?

@mimugmail I have the issue again, this time the DNS is working but for some reason it is not blocking anything. I have removed the cloudflare ipv6 server even though I have the option to block ipv6 hosts ticked and am still using openssl instead of libressl

From: Jay Townsend
Sent: Wednesday, May 8, 2019 9:57:32 AM
To: opnsense/plugins
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
@mimugmail After some long testing this seems to have fixed the issue

From: Jay Townsend
Sent: Tuesday, May 7, 2019 2:03:09 PM
To: opnsense/plugins
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
Will try after work

From: Michael<EMAIL_ADDRESS>Sent: Tuesday, May 7, 2019 1:00:45 PM
To: opnsense/plugins
Cc: J.Townsend; Author
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
I was able to reproduce, can you try disabling "Use IPv6 Servers"?
Am Mo., 6. Mai 2019 um 20:18 Uhr schrieb J.Townsend <
<EMAIL_ADDRESS>
@mimugmail https://github.com/mimugmail email sent
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/opnsense/plugins/issues/1326#issuecomment-489721518,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE355IMFIBGYM5JZPWNRJ53PUBY6JANCNFSM4HLBGH5Q
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/opnsense/plugins/issues/1326#issuecomment-490049935, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AA3V2QWPCBXMSYI45FJXS6LPUFVO3ANCNFSM4HLBGH5Q.

I can not reproduce here, are you still experiencing issues?

After updating to the new version of opnsense and having access to the new lists it seems to be due to missing links to block from what I have observed. This can be closed now and thanks for your help
Get Outlook for Androidhttps://aka.ms/ghei36

From: Michael<EMAIL_ADDRESS>Sent: Saturday, June 8, 2019 6:35:53 AM
To: opnsense/plugins
Cc: J.Townsend; Author
Subject: Re: [opnsense/plugins] dnscrypt crashing (#1326)
I can not reproduce here, are you still experiencing issues?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/opnsense/plugins/issues/1326?email_source=notifications&email_token=AA3V2QXAVOVNXOJ5WOZ6IULPZNALTA5CNFSM4HLBGH52YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXHOEKI#issuecomment-500097577, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AA3V2QRRQL24DNN6DSQFD63PZNALTANCNFSM4HLBGH5Q.

Thanks for the update ❤


[RFC]theming: Theme-provided or theme-restricted Enumeration?

Theme-provided or theme-restricted Enumeration?
How can a theme restrict usage of possible variables, or provide a custom range of variables. And how can other theme-specific information be provided in a more abstract/customizable/flexible way?
Problem
Right now there are multiple enums which are defined in src. Specifically there are (for the Text component) Sizes and Weights. I can easily imagine there will soon be additional application-specific enums, such as AvatarSizes, PresenceStates and other components as well.
The basic questions are: What happens when the design team providing a theme wants to limit the number of Text sizes available, or wants to "outlaw" certain font weights? How do they do that? What happens if a size/weight becomes deprecated? What about making various combinations of sizes/weights allowed or disallowed?
Related question: What about things that are somewhat more application-specific, like in the case of Avatar, AvatarSizes and PresenceStates?  Would it be possible to make the theme (and business logic) provide the data for those? For AvatarSizes Stardust might say "we need S, M, L and XL avatar sizes" and it would be nice if the theme definition could say "M is not allowed, don't let M be used." But what about PresenceStates? Presence seems very specific, the idea of "Available" or "Away" is pretty heavily tied to a chat app... What if some other product that uses Stardust has representations of people and wants to use Avatar, but has very different ideas of what an avatar's "state" could be? If we've hard-coded "presence" enum to be specific to our application (available, away, etc) that doesn't seem to be a very open/flexible system.
Another related question: Would it be possible to streamline/simplify the amount of redundancy between the siteVariables and the multiple component-specific files? Using Text as an example again: siteVariables feeds into textVariables, which feeds into textStyles files? Having a more systematic way to provide/consume the styles might streamline the existing approach.

Possible solution:
Could an interface or json object format be a solution for this? Stardust could have an ITextStyle interface, and the theme could provide text style objects that conform to the interface. One of the properties the interface requires could be a "valid" or "deprecated" Boolean. Perhaps another "object" that the theme could provide is a "map to" which would tell stardust what sizes/weights are valid and/or what sizes/weights to substitute?
A similar approach could also be used for elements of avatar. AvatarType could include the name-type and shape of the avatar and the AvatarState could include the name-type, shape, and color of the "presence."
I do see that the TextVariables.ts file defines an Interface, but that file is within the theme, so it isn't exactly telling other themes how to interact with Stardust. Simultaneously the Text component in Stardust src has a pretty direct/explicit/inflexible relationship with what is defined in the various theme files for Text.
Comments please

@codepretty Let's normalize sizes before they get too far out of hand.  We currently have many ways of sizing components.  Let's see if we can normalize all components to:
largest
larger
large
medium
small
smaller
smallest
For themes that may want 5 sizes, just have the largest/smallest sizes use the same values as larger/smaller to limit them.


Early stopping best practice and examples

Hi, I've been looking around the Ray documents for a while, but not sure if XGBoost Ray can do or how to do early stopping based on the evaluation set metric score (either maximize or minimize).
Directly passing early stopping callbacks to XGBoost is not reasonable for the distributed training scenario without relevant measures I think.
Seems it is more likely to do with this?
Tune Stopping Mechanisms (tune.stopper) — Ray 2.8.0
[Train] Support for early stopping · Issue #21848 · ray-project/ray
How to Define Stopping Criteria for a Ray Tune Experiment — Ray 2.8.0
This seems kind of outdated
Tuning xgboost with early stopping - Ray Libraries (Data, Train, Tune, Serve) / Ray Tune - Ray
Maybe a brute force way is to do manual evaluation + incremental training?

After some experiments. Seems passing XGBoost built-in parameters can do the job.
Even though in the imagination some workers might quit and cause some communication error. (https://github.com/microsoft/LightGBM/issues/6197)
But somehow in the Ray framework, it works.
https://github.com/ray-project/xgboost_ray/blob/9081780c5826194b780fdad4dbe6872470527cab/xgboost_ray/main.py#L738
ray.train.xgboost.XGBoostTrainer — Ray 2.8.0
To be specific, listed some related arguments

early_stopping_rounds
custom_metric
callbacks + xgb.callback.EarlyStopping


Use default values for consignment so can alter consignment if data a…

Add columns, set default then make non null to allow new columns with existing data

Migration used on db with no consignments, no need for check.


Reg generating docs for components

Hi, How did you guys generated the documentation as like in http://react-native-material-design.github.io
Did you guys used any automation tools?
@bozzmob  @Ehesp  @Salakar Can you look into this?
Thank you :)

Nothing is used to generate them at the moment. All manual.
Would probably be best to move away from from site and keep them within the
repo
On 3 Apr 2017 7:01 am, "SanyasiraoM"<EMAIL_ADDRESS>wrote:
Hi, How did you guys generated the documentation as like in
http://react-native-material-design.github.io
Did you guys used any automation tools?
@bozzmob https://github.com/bozzmob @Ehesp https://github.com/Ehesp
@Salakar https://github.com/Salakar Can you look into this?
Thank you :)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/react-native-material-design/react-native-material-design/issues/151,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAzZXpwXQHMCCQ15l1jn0NOSNJ0SZhQIks5rsIsegaJpZM4MxHzh
.

Thanks for reply :)


Can ESP-S host mode be used to read data from serial device ? (IDFGH-12102)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
I have a 3D printer that exposes serial over USB. Can I use this library to read that data if printer is connected to an ESP S3's host mode port?

Hello @khayamgondal , yes, we have support for USB Host serial.
Here are some examples, that can help you started: https://github.com/espressif/esp-idf/tree/master/examples/peripherals/usb/host/cdc
But the chances are that you will need to implement a device driver specific for your device.
Could you please share USB descriptors of you 3D printer? You can find them by connecting the printer to PC and then lsusb -v on linux, or using USB Device Tree Viewer on windows

Closing this for now due to lack of feedback. Feel free to reopen


ctag generate problem

From @MarekLew on July 18, 2017 7:55
Environment data
VS Code version:  1.14.1
Python Extension version:  0.6.7
Python Version:  2.7.13
OS and version: Microsoft Windows 10 Home ,10.0.15063 Compile 15063
ctag Version:
Exuberant Ctags 5.8, Copyright (C) 1996-2009 Darren Hiebert
Compiled: Jul  9 2009, 17:05:35
Addresses<EMAIL_ADDRESS>http://ctags.sourceforge.net
Optional compiled features: +win32, +regex, +internal-sort
Actual behavior
ctag not generate when optionsFile have space
Expected  behavior
generate ctag when path have space
Steps to reproduce:

generate ctag Python: Build Workspace symbols
return in console
ctags.exe: cannot open option file ""C:\Users\User with space\.vscode\extensions\donjayamanne.python-0.6.7\resources\ctagOptions"" : Invalid argument

Settings
Your launch.json (if dealing with debugger issues):

Your settings.json:

Logs
Output from Python output panel
 ctags.exe: cannot open option file ""C:\Users\User with space\.vscode\extensions\donjayamanne.python-0.6.7\resources\ctagOptions"" : Invalid argument

Output from Console window (Help->Developer Tools menu)

In this moment I replace
@generator.js line 29
- const optionsFile = this.optionsFile.indexOf(' ') > 0 ? `"${this.optionsFile}"` : this.optionsFile;
+ const optionsFile = this.optionsFile;

and its work fine, ctag generated.
Copied from original issue: DonJayamanne/pythonVSCode#1097

From @MarekLew on July 24, 2017 10:13
In my computers on windows 10 child_process.spawn work correct without adding quotes to path with space

From @MarekLew on July 24, 2017 20:23
VS Code version: 1.14.2
Python Extension version: 0.6.9
Python Version: 2.7.12
OS and version: Ubuntu 14.04 LTS
ctag Version: Exuberant Ctags 5.9~svn20110310, Copyright (C) 1996-2009 Darren Hiebert
  Addresses<EMAIL_ADDRESS>http://ctags.sourceforge.net
  Optional compiled features: +wildcards, +regex

After delete quotes ctags generated but not sorted.
sort: cannot read: space/.vscode/tags: No such file or directory
ctags: cannot sort tag file : No such file or directory

From @MarekLew on September 23, 2017 12:30
Version 1.16.1
Python Extension version: 0.6.7
OS and version: Ubuntu 14.04 LTS
the same problem.
End https://github.com/DonJayamanne/pythonVSCode/pull/1213 don`t fixed this.

Closing as a duplicate of #44


Is project dead?

Subj.

Yes, I would say so.

Yes, I would say so.

@Tvaroh what about https://github.com/Yomguithereal/baobab ? It seems to be much closer solution to morearty.

@wertlex I don't know. I do program in Scala these days and don't follow JS libraries. I would you something Scala.js based for the frontend when needed for sure.


Django upgrade to 1.8 issue - Argparse option callback is not supported

I have been trying to move to django 1.8 and currently stuck with this issue:
lib/python2.7/site-packages/django_nose/runner.py", line 247, in add_arguments
(attr, value))
AssertionError: argparse option callback=<function _log at 0x114fd1c80> is not supported
Looked around, could not find a solution. Can someone point me in the right direction ?
I hit this issue when i try to run:
python manage.py test
django-nose version - 1.4.1
django version 1.8.3
Any help will be kindly appreciated.

Django 1.8 switched from optparse to argparse, however nose continues to use optparse.  django-nose 1.4 adds a translation layer from Django argparse options to nose's opt parse options.  None of the default plugins use the callback option, so it was left untranslated.
Which plugin includes a callback= option?  Run nosetests --plugins to get a list of available plugins.  Here's mine:
$ nosetests --plugins
Plugin capture
Plugin failuredetail
Plugin xunit
Plugin deprecated
Plugin skip
Plugin multiprocess
Plugin logcapture
Plugin coverage
Plugin attributeselector
Plugin doctest
Plugin profile
Plugin id
Plugin allmodules
Plugin collect-only
Plugin isolation
Plugin ipdb
Plugin pdb

I'm not sure how to see what plugins you are using - that may be set at the command line or a nose config file

Here's my list:
$ nosetests --plugins
Plugin capture
Plugin failuredetail
Plugin xunit
Plugin deprecated
Plugin skip
Plugin multiprocess
Plugin logcapture
Plugin coverage
Plugin sqlalchemy
Plugin attributeselector
Plugin doctest
Plugin profile
Plugin id
Plugin allmodules
Plugin collect-only
Plugin isolation
Plugin pdb
I did a
print(attr, option, value)

in the part of the code where its trying to Convert optparse attributes to argparse attributes.
callback --log-info <function _log at 0x110af2ed8>

It looks like it failing for these above values.

It doesn't appear to be a plugin - you have the default list as well.  This must be from some other code, either in your project or from a dependency.  I don't think there is a way to determine the source from the add_arguments call.
You could try skipping the assertion, and seeing what the result is.  Change the code to something like:
                    # Translating callbacks is not supported
                    if attr in cls._argparse_fail_if_not_none:
                         # assert value is None, (
                         #  'argparse option %s=%s is not supported' %
                         #   (attr, value))
                         continue  # Skip argument

Commented the lines as you mentioned.
I think this was expected:
/lib/python2.7/site-packages/django_nose/runner.py", line 261, in add_arguments
    parser.add_argument(opt_long, **option_attrs)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/argparse.py", line 1280, in add_argument
    raise ValueError('unknown action "%s"' % (action_class,))
ValueError: unknown action "callback"

I appreciate your quick response for the issue. Thank you again.

I'm sorry, this won't be an effective way to write this work around.  I'll either need to know the source of this option, so that I can reproduce locally, or you'll have to adjust the code until the issue goes away.

Thank you for all the help. For now, i have downgraded to 1.7.9. May need to revisit this when i eventually move to 1.8.x.

I've been looking into command line parsing some more, and currently the Django command line parsing is thrown out before it gets to nose.  It may be safe to remove the cls._argparse_fail_if_not_none checks.  I'm still looking for a way to reproduce this issue, rather than blindly making changes.


Update Android NDK to latest 25c

Tool name
Android NDK
Tool license
Apache
Add or update?

[ ] Add
[X] Update

Desired version
25c
Approximate size
No response
Brief description of tool
No response
URL for tool's homepage
No response
Provide a basic test case to validate the tool's functionality.
No response
Platforms where you need the tool

[ ] Azure DevOps
[X] GitHub Actions

Runner images where you need the tool

[ ] Ubuntu 18.04
[ ] Ubuntu 20.04
[X] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[ ] Windows Server 2019
[ ] Windows Server 2022

Can this tool be installed during the build?
No response
Tool installation time in runtime
No response
Are you willing to submit a PR?
No response

Hey @buttaface!
Latest Android 25 NDK will be shipped with next image any way. It should happen on the very next week. Thank you for participation!

updated


UnknownHostException with IPv6 (known bug in system libraries?)

Disclaimer:
This is actually not a bug in OkHttp, but a bug in the system libraries on smartphones/mobile devices.
A workaround is possible in OkHttp.
I considered this closer to a bug report than to a feature request.
Problem:
I run a private host with a DNS configured to return an IPv6-address (AAAA record) only, so no IPv4-address (A record).
I had to do so, because my internet provider migrated me from an IPv4 connection to a "IPv4/IPv6 dual stack lite" (DS lite) connection.
So although my host has a (provider-internal) IPv4 address, this address is not reachable form the internet. Only the IPv6 address is reachable.
It turned out, that some applications on smartphones fail to connect to that host.
While all the browsers I tested connected properly, other applications like DAVx5 (formerly Davdroid) or Nextcloud app for Android showed a "UnknownHostException".
I did trace back the UnknownHostException in both apps to a call to InetAddress.getAllByName() in the Dns interface of OkHttp.
I checked the DNS configuration via nslookup on a Laptop and with network tools for Android. Both show the correct IPv6 address.
The cause of the UnknownHostException from the call to InetAddress.getAllByName() seems to be a bug in the Android system libraries for DNS resolution. See oh-ipv6-where-art-thou:

Networking APIs, particularly in the area of host name lookups, are notoriously finicky and display subtly different behaviour on different platforms.
We did find a few bugs caused by these incompatibilities:

getaddrinfo() on Android does not return IPv6 results when the ‘hints’ parameter is NULL, as required by POSIX. A hints parameter with the field ai_flags set to PF_UNSPEC is required to get both IPv4 and IPv6 results.

I can reproduce this bug with a simplistic Android app, which tries to resolve the host in two different ways:

using the system library via InetAddress.getAllByName()
using the DNSJava library via Address.getAllByName()

The system call throws a UnknownHostException while the DNSJava library returns the correct IPv6 address (private information replayced by '*'):
System - InetAddress.getAllByName(host)
java.net.UnknownHostException: Unable to resolve host "**********************": No address associated with hostname

DNSJava - Address.getAllByName(host):
count: 1
**********************/****:****:****:****:****:****:****:****

When switching frequently between WiFi and Mobile Internet, I sometimes also get a UnknownHostException from DNSJava library.
I suspect that the DNSJava library may cache the DNS server to ask, and then fails after switching. But this is just a suspicion.
Workaround
In the end I did adapt the OkHttp library such that the default DNS lookup performs up to 3 steps:

try the system library
in case of UnknownHostException: try the DNSJava library using default lookup
in case of UnknownHostException: try the DNSJava library explicitly using DNS server "<IP_ADDRESS>" and explicitly asking for A and AAAA records, without further filtering/sorting - see new lookupFrom():

  fun lookupFrom(hostname: String, server: String): List<InetAddress> {
    var simpleResolver = SimpleResolver(server);
    var addresses = listOf<InetAddress>()

    var Alookup = Lookup(hostname)
    Alookup.setResolver(simpleResolver)
    var Arecords = Alookup.run()
    if (Arecords != null)
      for (record in Arecords)
        if (record.getType() == Type.A)
          addresses += ((record as ARecord).getAddress())

    var AAAAlookup = Lookup(hostname, Type.AAAA)
    AAAAlookup.setResolver(simpleResolver)
    var AAAArecords = AAAAlookup.run()
    if (AAAArecords != null)
      for (record in AAAArecords)
        if (record.getType() == Type.AAAA)
          addresses += ((record as AAAARecord).getAddress())

    if (addresses.size < 1)
      throw UnknownHostException("Host '$hostname' unknown to '$server'")
    return addresses
  }

  override fun lookup(hostname: String): List<InetAddress> {
    try {
      try {
        return InetAddress.getAllByName(hostname).toList()  // 1. try: original to system library
      } catch (e: UnknownHostException) {
        try {
          return Address.getAllByName(hostname).toList()  // 2. try: DNSJava default lookup
        } catch (e: UnknownHostException) {
          return lookupFrom(hostname, "<IP_ADDRESS>")  // fallback: tailored lookup via DNSJava
        }
      }
    } catch (e: NullPointerException) {
      throw UnknownHostException("Broken system behaviour for dns lookup of $hostname").apply {
        initCause(e)
      }
    }
  }

Disclaimer: This is just a proof of concept. I am not a Kotlin developer. And I am not a DNS specialist.
I did build DAVx5 and Nextcloud app using a patched OkHttp library as shown above.
Since a couple of days I saw no further connection problems.
I was able to reproduce this DNS resolution bug on Huawei P20 and Sony Xperia X Compact.
I use dynv6.net as dynamic DNS provider, which allows to configure IPv6-address (AAAA record) without insisting on configuring also an IPv4-address (A record).
Is it possible for others to reproduce this bug? (requiring specific IPv6 DNS configuration)
Is it possible for others to verify the work-around?
In the end, would you consider to include a work-around in the OkHttp library, so that all the depending Apps benefit from that automatically?

You shouldn't need to patch OkHttp.  You should be able to implement your own Dns provider that uses your logic.  But the dependency on DNSJava is a non starter for us. If the bug is as prevalent as you suggest, it should really be patched in the Android OS.
For reference we have other Dns implementation like DnsOverHttps https://github.com/square/okhttp/blob/cc3ce11fc455b2bf6790f66b6c5b417302c75f57/okhttp-dnsoverhttps/src/main/kotlin/okhttp3/dnsoverhttps/DnsOverHttps.kt

I have the same error on Android emulator.

Closing, as it's not clear we can feasibly implement this and it's much easier to write this yourself. It also feels like a dangerous game to put in any defaults that work around the system behaviour, better to get attention to fixing the root cause instead of additional work.

I see your point.
The work-around solves the issue for me in an easy way (just change OkHttp once and then re-build apps with changed library).
But for OkHttp I think it's a wise decision of yours, not to include something like that.
It's a pity, that my mobile devices will likely never see an update with this being fixed.
Thank you for your quick replies.


Update Kendra Index handler to map additional Kendra errors to a corresponding CFN errors

Issue #, if available:
N/A
Description of changes:
Currently, when creating an Index using Cloudformation (referring to as CF from now on), if the CF assumed role does not have sufficient permissions to run the CreateIndex action (see service-authorization/latest/reference/list_amazonkendra.html), the error will surface in the CF UI as GeneralServiceException.
Resource handler returned message: "Error occurred during operation 'CreateIndex'."
(RequestToken: <REDACTED>, HandlerErrorCode: GeneralServiceException)

To re-create this, create a role for cloudformation with insufficient permissions to create an Index
# trust relationship
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "",
            "Effect": "Allow",
            "Principal": {
                "Service": "cloudformation.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}

Set it as the IAM role for CF to use

Use the following template to attempt creating an Index
AWSTemplateFormatVersion: 2010-09-09
Resources:
  KendraIndexForDocs:
      Type: AWS::Kendra::Index
      Properties:
        Name: "Make-Search-Index"
        Description: "A Kendra Index"
        Edition: "DEVELOPER_EDITION"
        RoleArn: <ARN of separate role for Kendra to assume> See: https://docs.aws.amazon.com/kendra/latest/dg/iam-roles.html#iam-roles-index

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Converted to draft since this will need to be rebased after https://github.com/aws-cloudformation/aws-cloudformation-resource-providers-kendra/pull/104 is merged


Update README.md

Adding local Cloud code REST example, the required URL and HTTP verb (POST) were not obvious.

Cool. :+1:


How to solve the problem of garbled Chinese output

How to solve the problem of garbled Chinese output

Which version of picocli are you using, and which operating system (and version) and which shell application are you using?

Which version of picocli are you using, and which operating system (and version) and which shell application are you using?

The picocli version used is 4.7.5, the operating system is Windows11, and the programming language is java

The shell application is Command Prompt? (%windir%\system32\cmd.exe)?

Okay, Git Bash.
In the Git Bash (MINGW64) window, right-click on the title bar; this will bring up a pop-up menu.
Select Options... from the pop-up menu; this will show an Options dialog window.
In the Options dialog, select Text on the left, to show "Text and Font properties".
Select the desired Locale and perhaps also the desired Character set.
You can also try changing the font (if the selected font does not support Chinese characters).

@Afterlll did this resolve the issue?


Controller Events

Added controller events

Not sure what that conflict is saying. Maybe you can figure it out.

 Shall look at this later thanks.

Is this stable and ready for commit now?

It is stable but it could still use some tweaks to improve it.
Rob
On Mon, Mar 20, 2017 at 5:27 AM Ben Woodford<EMAIL_ADDRESS>wrote:

Is this stable and ready for commit now?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/BenWoodford/SteamVR-Webkit/pull/8#issuecomment-287709911,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABMroDJS_ASsatxkAY8cTMJDnBrwwfwjks5rnkaXgaJpZM4Ma20i
.

Good enough, shall finally merge this :P


Moved to containerized infrastrucutre and added testing with Python 3.5 to the build

Seems that the only tests that fail relate to invoking help() on docstrings. No idea why the fail though.

Thanks for the interest! sudo: false is already there, and while we're functional in 3.5, we can't add it to the list until all the tests pass (even if only docs tests fail).

Do you have an idea why the docs tests are failing? I looked into it and it doesn't make sense to me.

At a glance I'm not sure, but it might be partially due to the new OrderedDict implementation. Python 3 imposes no particular ordering on dictionaries by default, and so we use OrderedDicts where necessary. It could be that there are more dictionaries that need to be converted due to a change in the unspecified ordering from 3.4 to 3.5.

Ended up tracking this down.  This is due to a regression in python3.5.  We'll have to update our code to handle this.  Working on a PR.

Fixed via https://github.com/boto/botocore/pull/742.   Ended up needing to pull in a py3.5 version in the .travis.yml file for #742 to ensure the doc tests pass on py35.


Migrate jest-runner to jest-worker

This PR migrates jest-runner to use jest-worker, instead of worker-farm. As a consequence of this, some additional changes were done:

pify is not needed anymore as well.
Interfaces are now shared between parent and child processes, so we ensure they stay in sync.
Tests needed small adjustments as well.

This PR supersedes #4596, which was incorrect from a branch name, description and content point of view.

Codecov Report

Merging #4825 into master will increase coverage by 0.24%.
The diff coverage is 12.5%.

@@            Coverage Diff            @@
##           master   #4825      +/-   ##
=========================================
+ Coverage   59.15%   59.4%   +0.24%
=========================================
  Files         200     200
  Lines        6660    6643      -17
  Branches        4       3       -1
=========================================
+ Hits         3940    3946       +6
+ Misses       2720    2697      -23

Impacted Files
Coverage Δ

packages/jest-runner/src/test_worker.js
0% <0%> (ø)
:arrow_up:

packages/jest-runner/src/index.js
37.77% <25%> (-0.53%)
:arrow_down:

packages/jest-haste-map/src/worker.js
93.93% <0%> (-1.9%)
:arrow_down:

packages/jest-haste-map/src/index.js
96.8% <0%> (-0.71%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 25b4b15...b5674ab. Read the comment docs.


Process backfill_corrections with CI tools

Description
Adds backfill_corrections to Python linting and Jenkins CI build/package/deploy process
Changelog

Update the lists of indicators to process via CI tooling:

python-ci.yml
Jenkinsfile

Ah, we probably don't need all of this.


[BUG] - Battery drain, always running

App Version
SimpleMP-Beta-1.8.0
Bug
Unsure if this is a bug or a feature request. The app drains the battery on my Pixel 7 on Android 14. Not serious drain but noticeable. Even if I'm not using the app, often, I'll see the sync notification icon appear. That gives me the impression that the app is constantly working in the background which eats away at battery life. I'm not concerned with heavily optimizing the application but if it's always working in the background, that might not be the best behavior.
For a start, a setting for changing the sync process would be helpful. For instance, having the application only sync upon opening or upon manual request. For somebody like me, I can go weeks or months before I add new media and require a sync. Once syncing is resolved, as the app is developed, general optimizations may improve battery over time. I'm not concerned with battery wear as I use the app. Just the battery wear while the app is in the background not playing audio.
Granted, I am new to the app, so I may need my phone to get used to running the app or perform more tests.

I've got the same device with the same issue running beta 1.8.0, android 14, downloaded from fdroid. I see the syncing notification every few hours, but its not draining much battery for me (so far)


Candlestick chart support in event analytics

Add Candlestick chart as a dropdown option. Refer dropdown element on top right corner of image.
On selection of it, it should render a Candlestick chart based on data selected.
If data does not have timestamp information , show no record found message.

This issue contains the below tasks.

[ ] Adding Candlestick chart to the dropdown on the UI
[ ] Cypress testing(Automation)

Hey @mengweieric @anirudha - In one of our standups, we had decided to remove the candlestick chart and all its code from the repo, but I can see it listed in the chart types table in #670. Is it still an upcoming visualization or are we sure we want to remove it?
Thanks!
@abasatwar @spattnaik @pratibhapandey16


Proposal: Bring native NavigationView experience to XBox

Currently, XBox's NavigationView control has the same behaviors as the desktop. Like all the other controls, we have to customize their appearance to adapt to Xbox. Most of them are simple, but NavigationView is a special case.
Many behaviors and appearance of NavigationView seems perfect on desktop, but performs terribly on the Xbox platform. I tried to modify some of the xaml resource and behavior, but still not perfect, comparing to Android TV's hamburger menu.
For example:

Android TV's menu has the focus style, better than Xbox's rectangle border focus.

Android TV support navigates right to enter the selected page on the menu item. When the focus on the page, navigate left to open the menu.

Android TV's menu support sub menu, like
Item A
-- Item A1
-- Item A2
Item B
Item C
When open the menu, it shows like above. When closed, it shows below.
Item A
Item B
Item C

A UI/UX video on Xbox.👇👇👇

A UI/UX video on Android TV👇👇👇

It's not clear enough for me, what exactly wrong on this video and what can be improved.

@maxkatz6 I have updated the comment, thx.

Once WinUI 3.0 is out, I hope every control will get a ControlTemplate with all the typographic and metric changes needed so when running on Xbox, the controls will look and behave correctly.
I suspect Microsoft will push more towards ReactNative for Xbox, as the new Store uses it to render the native controls, and WinUI 3.0 wont be supported at launch on Xbox, or non Desktop/Tablet form factors.
#698

I have also noticed the new app store, seems better.

Android TV's menu support sub menu, like
And NavigationView too

A UI/UX video on Android TV
try PaneDisplayMode="Left" and SelectionFollowsFocus="Enabled"

Android TV support navigates right to enter the selected page on the menu item. When the focus on the page, navigate left to open the menu.

this is interesting

Android TV's menu has the focus style, better than Xbox's rectangle border focus.

ListView had same reveal focus style.

I believe NavigationViewItem shold have same reveal focus style. Since it has moved on ItemsRepeater it lost it.

@ad1Dima I also noticed SelectionFollowsFocus, but when set PaneDisplayMode="LeftCompact", there is a bug when opening NavigationView using NavigationView.IsPaneOpen=true. It closes immediately after opening.

but when set PaneDisplayMode="LeftCompact", there is a bug when opening NavigationView using NavigationView.IsPaneOpen=true. It closes immediately after opening.

@hupo376787 This is by design. See the discussion starting here. Feel free to voice your concerns in that issue (and perhaps include pinging YuliKI from the WinUI team) if you disagree with that design thought.
We also still need to add that info to the NavigationView IsPaneOpen documentation (if kept) and I plan to create a commit soon.


Browser's location.pathname gets overwritten when clicking on a URL

If you click on an link inside of your application, the browser's URL doesn't get updated until the route is finished rendering, it seems.
Example:

you are at the URL http://localhost/
you click a link on your app to http://localhost/route
Inside of your template you update the route:
FlowRouter.setParams({ id: 123 })

What happens in your browser's address bar is:

http://localhost/ (initial location)
http://localhost/route (click)
http://localhost/route/123 (template updates parameter)
http://localhost/route (??)

This is a known issues and fixed in the next major version 4.0, which is scheduled for end of this month.


[BUG] Backlash reversed in gear_dist for internal gears

Describe the bug
With an internal gear gear_dist(...) should decrease with increasing backlash, but it does not.
Code To Reproduce Bug
include <BOSL2/std.scad>
include <BOSL2/gears.scad>

gd = gear_dist(teeth1 = 20, teeth2 = 30,  internal1 = false, internal2 = true, backlash = 0, mod = 2);
gd_with_backlash = gear_dist(teeth1 = 20, teeth2 = 30,  internal1 = false, internal2 = true, backlash = 2, mod = 2);
assert(gd_with_backlash<gd,"with an internal gear gear_dist should decrease with increasing backlash");

Expected behavior
With an internal gear gear_dist(...) should decrease with increasing backlash, so there is a gap between
the gear and the ring.

Should have caught this when I fixed the other one.  Fixed in PR.


Add two blog posts

One for very beginners, one for NLP researchers

terry, its a little out of date because there is a duplicate, can you send a new cleaned up pull request please.


[prim_sha2,rtl] Add prim_sha2 RTL and instantiation in DMA and HMAC

This PR commits the RTL changes required to:

merge the 256-bit and multi-mode SHA-2 cores into a single compile-time configurable core
fix coding style issues in the earlier HMAC IP RTL
turn the SHA-2 engine into a prim
instantiate the 256-bit variant in the HMAC IP after passing regression
instantiate the multi-mode variant in the DMA IP after passing regression (DV tests that already pass now still pass)

With these changes, this PR checks out items 1-3 in this TODO list https://github.com/lowRISC/opentitan-integrated/issues/451
The first commit is the multi-mode RTL implementation as baseline, and second is the actual prim_sha2 RTL and lint waivers. The third commit are the changes in the HMAC IP RTL to instantiate the new SHA-2 prim in 256-bit mode, and the fourth commit are the changes in the DMA IP RTL to instantiate the new SHA-2 prim in multi-mode.
We will need to decide if this will be cherry-picked into discrete for PROD @moidx.

Hey @gdessouky ,
thanks for the PR. I haven't reviewed in depth yet. In principle, I don't mind the changes but I think we need to be careful regarding changing the HMAC hardware block. Because this block is at D3 already (so no RTL changes at this point other than bug fixes) and we need it for the production tapeout for Earl Grey. I fear if we merge this PR as is, it will be very hard to merge/cherry-pick integrated_dev into master before the next tapeout.
I think also @msfschaffner and @andreaskurth should weigh in on this (please wait for their feedback before making big changes to the PR). I see two options:

Either we should wait with updating HMAC at the moment. This would still allow merging the prim_sha2 and the DMA changes of this PR.
We merge also the HMAC IP changes but then you should maybe run a full coverage regression with DVSIM and ensure coverage as well as pass/fail rates stay the same.

I am in favor of the first option but others should weigh in as well. Related to this, we should discuss this in the Silicon working group, e.g., tomorrow evening. Can you please liaise with the Silicon WG chairs @GregAC and @msfschaffner to make sure it gets on the agenda?

Hey @gdessouky , thanks for the PR. I haven't reviewed in depth yet. In principle, I don't mind the changes but I think we need to be careful regarding changing the HMAC hardware block. Because this block is at D3 already (so no RTL changes at this point other than bug fixes) and we need it for the production tapeout for Earl Grey. I fear if we merge this PR as is, it will be very hard to merge/cherry-pick integrated_dev into master before the next tapeout.
I think also @msfschaffner and @andreaskurth should weigh in on this (please wait for their feedback before making big changes to the PR). I see two options:

Either we should wait with updating HMAC at the moment. This would still allow merging the prim_sha2 and the DMA changes of this PR.
We merge also the HMAC IP changes but then you should maybe run a full coverage regression with DVSIM and ensure coverage as well as pass/fail rates stay the same.

I am in favor of the first option but others should weigh in as well. Related to this, we should discuss this in the Silicon working group, e.g., tomorrow evening. Can you please liaise with the Silicon WG chairs @GregAC and @msfschaffner to make sure it gets on the agenda?

I feel like this is a significant enough change to warrant a new version of the HMAC IP (a v2), regardless of when this PR merges. Since it's a new version anyway, that ought to allow merging it into integrated_dev whenever. This PR should include that version change, though.
When we start bringing Darjeeling into the fold on master, we'll realistically be supporting both versions for quite awhile, unless we decide to upgrade earlgrey's for final silicon.

Hey @gdessouky , thanks for the PR. I haven't reviewed in depth yet. In principle, I don't mind the changes but I think we need to be careful regarding changing the HMAC hardware block. Because this block is at D3 already (so no RTL changes at this point other than bug fixes) and we need it for the production tapeout for Earl Grey. I fear if we merge this PR as is, it will be very hard to merge/cherry-pick integrated_dev into master before the next tapeout.
I think also @msfschaffner and @andreaskurth should weigh in on this (please wait for their feedback before making big changes to the PR). I see two options:

Either we should wait with updating HMAC at the moment. This would still allow merging the prim_sha2 and the DMA changes of this PR.
We merge also the HMAC IP changes but then you should maybe run a full coverage regression with DVSIM and ensure coverage as well as pass/fail rates stay the same.

I am in favor of the first option but others should weigh in as well. Related to this, we should discuss this in the Silicon working group, e.g., tomorrow evening. Can you please liaise with the Silicon WG chairs @GregAC and @msfschaffner to make sure it gets on the agenda?

Following up on this discussion and the consensus reached in the Silicon WG 12 Dec 2023, I've created a reduced PR https://github.com/lowRISC/opentitan/pull/20675 with the SHA-2 primitive RTL only. We will hold back the changes to instantiate this in DMA and HMAC RTL so close to tapeout for later - although I've confirmed regression pass/fail rates are unaffected, coverage metrics are different obviously.

Thanks @gdessouky - do we have an initial assessment of how big the impact on coverage metrics is?

Thanks @gdessouky - do we have an initial assessment of how big the impact on coverage metrics is?

Total Coverage Summary
SCORE 95.67
LINE  99.05
COND  96.32
TOGGLE 100.00
FSM   81.82  - all metrics are reduced a bit but FSM coverage the most and below 90
BRANCH 93.13
ASSERT 99.49
GROUP  99.86
But based on our discussions earlier, I've reorged the RTL and hope it improves coverage, besides running UNR for exclusion waivers, if we need to. Will update here on coverage after the nightly regression run concludes.

After reorganizing the RTL as suggested in #20675, coverage for HMAC did not improve significantly.  But after running UNR analysis, and updating the UNR exclusions, coverage has reached numbers on par with the current coverage.

SCORE
LINE
COND
TOGGLE
FSM
BRANCH
ASSERT
GROUP

99.62 %
99.55 %
98.65 %
100.00 %
100.00 %
99.78 %
99.49 %
99.86 %

Given this, I think it would be safe to update the HMAC IP with the instantiated SHA-2 primitive and clean up redundant code. WDYT @msfschaffner @vogelpi?

For DMA, pass rate is 100% with the instantiated primitive and coverage is pretty much the same.
Currently:

SCORE
LINE
COND
TOGGLE
FSM
BRANCH
ASSERT
GROUP

77.95 %
96.68 %
94.81 %
69.65 %
60.00 %
94.11 %
98.15 %
32.24 %

With the instantiated prim:

SCORE
LINE
COND
TOGGLE
FSM
BRANCH
ASSERT
GROUP

78.69 %
97.03 %
94.99 %
69.65 %
64.00 %
94.56 %
98.15 %
32.45 %

So again here, I'd say it's safe to update the DMA IP with the instantated SHA-2 primitive - @Razer6 @neeraj-rv @msfschaffner WDYT?

Thanks for this work and the extra effort for keeping DV maturity at the existing high level, @gdessouky! :+1:


Updated README.md

Description
Checklist

Do all Lints pass?

[] Have you ran pnpm spellcheck?
[] Have you ran pnpm fmt?
[] Have you ran pnpm lint?

Closing as spam


Add QtCore.QStandardPaths for PySide2/Qt5

Discovered this module wasn't available in a PySide2 environment, and would like to have as part of the official release so we don't have to maintain an internally-modified version.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Sorry, this one is only available to Qt 5 and would break anything written with Qt.py that runs on Qt 4 such as PyQt4 and PySide(1).
If you only need PyQt5 and PySide2, I would recommend Qt5.py

https://doc.qt.io/qt-5/qstandardpaths.html


⚠ Bofrost.lu has degraded performance

In c4e50e0, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 912 ms

Resolved: Bofrost.lu performance has improved in b1a3f58.


missing tostring()

Gets an error when tracing is enabled.
lua: /usr/share/lua/5.3/cassowary.lua:684: attempt to concatenate a table value (field '?')
stack traceback:
    /usr/share/lua/5.3/cassowary.lua:684: in method 'initializer'
    /usr/share/lua/5.3/cassowary.lua:662: in field '_init'
    /usr/share/lua/5.3/std/container.lua:174: in function </usr/share/lua/5.3/std/container.lua:156>
    (...tail calls...)
    main.lua:5: in main chunk
    [C]: in ?

Currently the line is:
      cassowary:tracePrint("objective expr == "..self.rows[self.objective])

It should be this instead:
      cassowary:tracePrint("objective expr == "..tostring(self.rows[self.objective]))

This actually got fixed with the penlight migration in 32ac9aef. Only four years late!

Welp. Now I don't recall what I was even doing at the time :P


dependencies: fix release_dates error behavior.

Previously was exiting 0, so failures still passed CI.
Signed-off-by: Harvey Tuch<EMAIL_ADDRESS>

Once this merges, I'll create a PR to upstream my updated date checker which validates the release_date against the Github release date vs. the current behavior which is to check against the latest commit for the release (which can be different from the release date).


Bootstrap 5 Renderer

This PR adds a new BootStrapRenderer which provides the necessary render functions to work with Bootstrap 5.
This is tested using the bootstrap_flask python package.
When initializing nav, you pass a bootstrap=True to the init.
nav = Nav()
nav.init_app(app, bootstrap=True)

Refactored as much as I can to meet flake8 requirements. Not sure where to go from here.

Seems like only two minor issues, left. I will see if I can tweak them. Curiously though, can you explain why this is needed a little better? I use this in a flask app of mine that also uses the flask_bootstrap package and it is working for me.

Thanks. If I remember correctly, the CSS for Bootstrap 5 changed a bunch of items causing the drop down sub navs to not work? I honestly started the work a while ago and only now put the final touches to get it all working as expected.

Closing.

First of all, I apologize. I thought we had discussed this earlier, but I must have confused it with another PR. I closed it mainly because I don't know off the top of my head how to implement the request you are making, however if you do I would happily accept a PR that doesn't break any existing functionality.

This doesn't break any current functionality. There is a configuration bool to turn on and use this code path.

When I build with your previous PR and tested with one of my flask projects, my navigation did not work correctly regardless of whether I specified bootstrap  = True, or bootstrap = False.

I only have this one PR.
I'll test again using the provided sample to see if I can see why it would not be working. Mind re-opening this PR for continued work?

I only have the one PR. I'll test with the existing example code to see if I can see why it wouldn't be working.
Mind re-opening for work to continue?

So, I just tried to use the example code out of the box as it sits in this repo. There is no nav bar, just the nav objects. This is because the example code doesn't include any CSS code what so ever to provide drop down or nav bar solutions. I'll investigate getting a working example working and apply to this PR.


can't select more lines.

Type: Bug
I can't select more lines with the help of mouse. the more selection isn't showing. I don't know what happened.
VS Code version: Code 1.81.1 (6c3e3dba23e8fadc360aed75ce363ba185c49794, 2023-08-09T22:22:42.175Z)
OS version: Windows_NT x64 10.0.19045
Modes:

System Info

Item
Value

CPUs
AMD Ryzen 9 5900HS with Radeon Graphics         (16 x 3294)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: enabled

Load (avg)
undefined

Memory (System)
15.41GB (6.12GB free)

Process Argv
C:\Users\User\OneDrive - eastdelta.edu.bd\C++ & DSA\CH 9 (2D arrays) --crash-reporter-id 39d6a7ee-093f-476f-a4c7-c996f4c05a58

Screen Reader
no

VM
0%

Extensions (16)

Extension
Author (truncated)
Version

doxdocgen
csc
1.4.0

gitlens
eam
14.2.1

code-runner
for
0.12.0

vscode-pull-request-github
Git
0.70.0

better-cpp-syntax
jef
1.17.2

remote-containers
ms-
0.304.0

remote-ssh
ms-
0.102.0

remote-ssh-edit
ms-
0.86.0

remote-wsl
ms-
0.81.0

cmake-tools
ms-
1.15.31

cpptools
ms-
1.16.3

cpptools-extension-pack
ms-
1.3.0

remote-explorer
ms-
0.4.1

material-icon-theme
PKi
4.29.0

pdf
tom
1.2.2

cmake
twx
0.0.17

(2 theme extensions excluded)

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
vserr242:30382549
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
vscod805:30301674
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
vsaa593:30376534
pythonvs932:30410667
py29gd2263cf:30792227
vscaat:30438848
vsclangdc:30486549
c4g48928:30535728
dsvsc012cf:30540253
pynewext54:30695312
azure-dev_surveyone:30548225
vsccc:30803844
2e4cg342:30602488
89544117:30613380
2i9eh265:30646982
showlangstatbar:30737416
vsctsb:30748421
03d35959:30757346
pythonfmttext:30731395
pythoncmv:30756943
fixshowwlkth:30771522
showindicator:30805244
pythongtdpath:30769146
i26e3531:30792625
gsofa:30804715
pythonnosmt12:30797651
pythonidxpt:30805730
pythonnoceb:30805159
dsvsc013:30795093
dsvsc014:30804076

/gifPlease

Thanks for reporting this issue! Unfortunately, it's hard for us to understand what issue you're seeing. Please help us out by providing a screen recording showing exactly what isn't working as expected. While we can work with most standard formats, .gif files are preferred as they are displayed inline on GitHub. You may find https://gifcap.dev helpful as a browser-based gif recording tool.
If the issue depends on keyboard input, you can help us by enabling screencast mode for the recording (Developer: Toggle Screencast Mode in the command palette). Lastly, please attach this file via the GitHub web interface as emailed responses will strip files out from the issue.
Happy coding!

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.
Happy Coding!