The second execution of the same code on the same 4 gpus will result in an OOM

System Info
- `Accelerate` version: 0.21.0
- Platform: Linux-3.10.0-1160.24.1.el7.x86_64-x86_64-with-glibc2.17
- Python version: 3.8.16
- Numpy version: 1.22.3
- PyTorch version (GPU?): 1.12.1+cu113 (True)
- PyTorch XPU available: False
- PyTorch NPU available: False
- System RAM: 251.39 GB
- GPU type: GeForce RTX 3090
- `Accelerate` default config:
        - compute_environment: LOCAL_MACHINE
        - distributed_type: MULTI_GPU
        - mixed_precision: bf16
        - use_cpu: False
        - num_processes: 4
        - machine_rank: 0
        - num_machines: 1
        - gpu_ids: all
        - rdzv_backend: static
        - same_network: True
        - main_training_function: main
        - downcast_bf16: no
        - tpu_use_cluster: False
        - tpu_use_sudo: False
        - tpu_env: []

Information

[ ] The official example scripts
[ ] My own modified scripts

Tasks

[ ] One of the scripts in the examples/ folder of Accelerate or an officially supported no_trainer script in the examples folder of the transformers repo (such as run_no_trainer_glue.py)
[ ] My own task or dataset (give details below)

Reproduction
CUDA_VISIBLE_DEVICES=0,1,2,3 accelerate launch ddpm_copy.py
CUDA_VISIBLE_DEVICES=0,1,2,3 accelerate launch  --config_file second_config.yaml   --main_process_port=52339    ddpm_copy.py
I ensure that the graphics memory is sufficient.
Expected behavior
Traceback (most recent call last):
File "ddpm_copy.py", line 278, in
train_loop(*args)
File "ddpm_copy.py", line 199, in train_loop
model, optimizer, train_dataloader, lr_scheduler = accelerator.prepare(
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/accelerate/accelerator.py", line 1202, in prepare
result = tuple(
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/accelerate/accelerator.py", line 1203, in
self._prepare_one(obj, first_pass=True, device_placement=d) for obj, d in zip(args, device_placement)
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/accelerate/accelerator.py", line 1030, in _prepare_one
return self.prepare_model(obj, device_placement=device_placement)
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/accelerate/accelerator.py", line 1293, in prepare_model
model = model.to(self.device)
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/torch/nn/modules/module.py", line 927, in to
return self._apply(convert)
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/torch/nn/modules/module.py", line 579, in _apply
module._apply(fn)
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/torch/nn/modules/module.py", line 602, in _apply
param_applied = fn(param)
File "/data2/lym/anaconda3/envs/diffusers/lib/python3.8/site-packages/torch/nn/modules/module.py", line 925, in convert
return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
RuntimeError: CUDA error: out of memory
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

The second time CUDA_VISIBLE_DEVICES=4,5,6,7 accelerate launch ddpm_copy.py is OK,but  CUDA_VISIBLE_DEVICES=0,1,2,3 is not OK

You can't use the same GPUs in two different training scripts running concurrently.


Home-brew formula

Could gym be published to the Homebrew package manager, to make it easier install?

+1

@BenKnigge this also can be a feature request

I'd love to have to as a formula.

Any update on this? it would help and make the installation a lot simpler for MacOS


Make write buffer size of HBase client configurable

Make write buffer size of HBase client configurable by adding a new property writebuffersize.

I was going to ask for an update to the HBase docs to include the new property, but I see that we have no README for the HBase bindings. :sob:


Installation not working on macOS after building the binaries

WARNING: Download from https://mirror.bazel.build/ftp.gnu.org/gnu/bison/bison-3.3.2.tar.xz failed: class java.io.FileNotFoundException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/github.com/jmillikin/rules_bison/releases/download/v0.1/bison-gnulib-788db09a9f88abbef73c97e8d7291c40455336d8.tar.xz failed: class java.io.FileNotFoundException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/ftp.gnu.org/gnu/m4/m4-1.4.18.tar.xz failed: class java.io.FileNotFoundException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/github.com/jmillikin/rules_m4/releases/download/v0.1/m4-gnulib-788db09a9f88abbef73c97e8d7291c40455336d8.tar.xz failed: class java.io.FileNotFoundException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/github.com/westes/flex/releases/download/v2.6.4/flex-2.6.4.tar.gz failed: class java.io.FileNotFoundException GET returned 404 Not Found
INFO: Analyzed target //:install (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
Target //:install up-to-date:
bazel-bin/_install_gen.sh
bazel-bin/install
INFO: Elapsed time: 0.742s, Critical Path: 0.48s
INFO: 1 process: 1 internal.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action
It says that it was successful but there is nothing being installed. Any help?

How did you invoke bazel ?

How did you invoke bazel ?

Cloned the verible repo.
Ran bazel build -c opt //...
Ran bazel run -c opt :install -- ~/bin
Ran all tests (all succeeded) with bazel test -c opt //...

@hzeller

Cloned the verible repo.
Ran bazel build -c opt //...
Ran bazel run -c opt :install -- ~/bin
Ran all tests (all succeeded) with bazel test -c opt //...

And then the binaries did not show up in ~/bin or /usr/local/bin (your two installation locations), so that it is not working ?

And then the binaries did not show up in ~/bin or /usr/local/bin (your two installation locations), so that it is not working ?

Correct. No binaries in either installation location.

Correct. There are no binaries showing in either installation location

Correct. There are no binaries showing in either installation location

the install routine should've been more resilient after https://github.com/chipsalliance/verible/pull/1396 because it uses the short options for the install program needed in BSD installations (such as macOS). Since you filed this after that was merged it sounds like there might be another reason why this is not working yet.
The strange thing is that there is no error message when you run install.
Question: does the directory ~/bin or /usr/local/bin pre-exist on your machine ? It could be that install does not create the directories on your machine and just creates a file with that name containing the binary...

The directories ~/bin and ~/usr/local/bin already exist on my machine.

I have a similar problem on m1 MacBook Air as well. Build and test works fine, but installation do not work. No related file is added to ~/bin or /usr/local/bin.
Below is the output:
-> bazel run -c opt :install -- ~/bin
WARNING: Ignoring JAVA_HOME, because it must point to a JDK, not a JRE.
WARNING: Ignoring JAVA_HOME, because it must point to a JDK, not a JRE.
INFO: Analyzed target //:install (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
INFO: From BazelWorkspaceStatusAction stable-status.txt:
fatal: No annotated tags can describe '694974a68f104ef5d13d1a105d5e29f5a5f2db61'.
However, there were unannotated tags: try --tags.
Target //:install up-to-date:
bazel-bin/_install_gen.sh
bazel-bin/install
INFO: Elapsed time: 0.173s, Critical Path: 0.04s
INFO: 1 process: 1 internal.
INFO: Build completed successfully, 1 total action
INFO: Build completed successfully, 1 total action

Ya, I just tried this myself. The problem happens at the very start of the install script:
# --- begin runfiles.bash initialization v2 ---
# Copy-pasted from the Bazel Bash runfiles library v2.
f=bazel_tools/tools/bash/runfiles/runfiles.bash
source "${RUNFILES_DIR:-/dev/null}/$f" 2>/dev/null || \
  source "$(grep -sm1 "^$f " "${RUNFILES_MANIFEST_FILE:-/dev/null}" | cut -f2- -d' ')" 2>/dev/null || \
  source "$0.runfiles/$f" 2>/dev/null || \
  source "$(grep -sm1 "^$f " "$0.runfiles_manifest" | cut -f2- -d' ')" 2>/dev/null || \
  source "$(grep -sm1 "^$f " "$0.exe.runfiles_manifest" | cut -f2- -d' ')" 2>/dev/null || \
  { echo>&2 "ERROR: cannot find $f"; exit 1; }; f=;
# --- end runfiles.bash initialization v2 ---

If you remove all of the redirects to /dev/null, then you get this output when running the install script:
$ ./bazel-bin/install ~/.local/bin
./bazel-bin/install: line 35: /dev/null/bazel_tools/tools/bash/runfiles/runfiles.bash: Not a directory
$ echo $?
1

Line 35 corresponds to that very first call to source. Not sure why, but it looks like the exit-code-chaining isn't working.
Changing this to supply RUNFILES_DIR gets a bit further:
$ RUNFILES_DIR=./bazel-bin/install.runfiles ./bazel-bin/install ~/.local/bin
install: illegal option -- T
usage: install [-bCcpSsv] [-B suffix] [-f flags] [-g group] [-m mode]
               [-o owner] file1 file2
       install [-bCcpSsv] [-B suffix] [-f flags] [-g group] [-m mode]
               [-o owner] file1 ... fileN directory
       install -d [-v] [-g group] [-m mode] [-o owner] directory ...

This looks like an issue with using BSD install vs GNU install. If you edit ./bazel-bin/install to use ginstall as the binary (the GNU binary, provided by the homebrew formula coreutils), then the script succeeds, and installs the binaries as desired.

Does it help to just remove the -T flag in the ./baze-bin/install ? Ideally that way we then can keep using the system install instead of relying on ginstall.
This is issue https://github.com/google/bazel_rules_install/issues/31 that I filed with bazel_rules_install a while back. Maybe pinging that could help.

Yup, removing the -T flag made it work. I still had to set that environment variable to make that source ... || ... chain work.

I've now automatically remove the -T in the install script.
I don't have a Mac to test; can  you try if now building and installing on MacOS works smoothly from latest git ?

Thanks @hzeller! That resolved the install: illegal option -- T error. At this point, we now still have to deal with the source issue in bazel-bin/install. This comment shows how I worked around that issue: https://github.com/chipsalliance/verible/issues/1404#issuecomment-1400726752
However, this does mean that I can't just run bazel run -c opt :install -- ~/.local/bin, that command still errors out. I have to use that workaround, manually running the command RUNFILES_DIR=./bazel-bin/install.runfiles ./bazel-bin/install ~/.local/bin. The good news now is that running RUNFILES_DIR=./bazel-bin/install.runfiles ./bazel-bin/install ~/.local/bin succeeds, and installs all of the binaries.

Unfortunately, I don't have access to a Mac, so can't really iterate on a solution here that works here and elsewhere.
Ideally, this is something that would be fixed https://github.com/google/bazel_rules_install by someone who knows their way around the MacOS environment.
The homebrew package of Verible  side-steps the installation by manually enumerating all the binaries to install:
https://github.com/chipsalliance/homebrew-verible/blob/46664b28ed8f0dfe2d709faf45691cf42d9628b6/Formula/verible.rb#L34-L44

I have tried to install from homebrew, or compile from the code. But neither works (same error during compilation). If you can compile one on the CI, I will be glad to help test the executable.

Hi @hzeller , thanks for you quick reply.
I recompiled today. It looks a bit different two days ago (still fail but other bugs). See below:

I am not familiar with Bazel/C++ compilation, so I have no idea to fix it. :(
I mean that, can we provide a prebuilt binary for homebrew (maybe one for intel and one for apple silicon)? Current installation from brew (i.e. compiling from code with Bazel) often fails.

Interesting, it looks like the compilation picks up a header from the system (/usr/local/include) in addition to the actual header it should use (external/com_google_boringssl/...). I have a suspicion, addressed in #1970

can you git pull and try again ?

can you git pull and try again ?

Hi @hzeller . I have cloned the latest repo, and rebuilt it. Still fails but other new bugs.
~/Workspace/linter/verible master ···········································································································  base 10:13:06
❯ bazel build --jobs=12 -c opt --//bazel:use_local_flex_bison //...
Starting local Bazel server and connecting to it...
INFO: Analyzed 1898 targets (142 packages loaded, 5966 targets configured).
INFO: Found 1898 targets...
INFO: From Linking external/com_google_absl/absl/types/libbad_optional_access.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/_objs/bad_optional_access/bad_optional_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/libbad_optional_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/debugging/libdebugging_internal.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/elf_mem_image.o has no symbols
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/vdso_support.o has no symbols
INFO: From Linking external/com_google_absl/absl/log/liblog_entry.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/log/_objs/log_entry/log_entry.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/log/liblog_entry.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/base/libbase.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/base/_objs/base/unscaledcycleclock.o has no symbols
INFO: From Linking external/com_google_absl/absl/types/libbad_any_cast_impl.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/_objs/bad_any_cast_impl/bad_any_cast.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/libbad_any_cast_impl.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/types/libbad_variant_access.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/_objs/bad_variant_access/bad_variant_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/libbad_variant_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/crc/libcrc32c.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/crc/_objs/crc32c/crc_memcpy_x86_64.o has no symbols
INFO: From Linking external/com_google_absl/absl/strings/libcord.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/strings/_objs/cord/cord_buffer.o has no symbols
INFO: From Linking external/com_google_absl/absl/flags/libflag.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/flags/_objs/flag/flag.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/flags/libflag.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/types/libbad_variant_access.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/_objs/bad_variant_access/bad_variant_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/libbad_variant_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/base/libbase.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/base/_objs/base/unscaledcycleclock.o has no symbols
INFO: From Linking external/com_google_absl/absl/crc/libcrc32c.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/crc/_objs/crc32c/crc_memcpy_x86_64.o has no symbols
INFO: From Linking external/com_google_absl/absl/strings/libcord.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/strings/_objs/cord/cord_buffer.o has no symbols
INFO: From Linking external/com_google_absl/absl/debugging/libdebugging_internal.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/elf_mem_image.o has no symbols
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/vdso_support.o has no symbols
INFO: From Linking external/com_google_absl/absl/log/liblog_entry.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/log/_objs/log_entry/log_entry.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/log/liblog_entry.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_protobuf/src/google/protobuf/io/libio_win32.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_protobuf/src/google/protobuf/io/_objs/io_win32/io_win32.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_protobuf/src/google/protobuf/io/libio_win32.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/types/libbad_optional_access.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/_objs/bad_optional_access/bad_optional_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/libbad_optional_access.a the table of contents is empty (no object file members in the library define global symbols)
ERROR: /Users/zhutmost/Workspace/linter/verible/verilog/parser/BUILD:94:8: Executing genrule //verilog/parser:verilog-y [for tool] failed: (Exit 1): bash failed: error executing command (from target //verilog/parser:verilog-y) /bin/bash -c ... (remaining 1 argument skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
/Library/Developer/CommandLineTools/usr/bin/bison: unrecognized option `--report-file=bazel-out/darwin-opt-exec-2B5CBBC6/bin/verilog/parser/verilog.output'
Try `/Library/Developer/CommandLineTools/usr/bin/bison --help' for more information.
INFO: Elapsed time: 166.806s, Critical Path: 25.50s
INFO: 1416 processes: 699 internal, 717 darwin-sandbox.
FAILED: Build did NOT complete successfully

Note that I used local bison & flex installed by brew.

Can you tell me the version number of flex and bison on your machine ?
flex --version
bison --version

OS:
Darwin XXXX-MacBookPro.local 22.5.0 Darwin Kernel Version 22.5.0: Thu Jun  8 22:22:22 PDT 2023; root:xnu-8796.121.3~7/RELEASE_X86_64 x86_64
bison: 3.8.2
flex: 2.6.4
I just downloaded them form homebrew and then added to PATH.
I have downloaded the prebuilt binary from the GITHUB Release page. I tried the verible-verlog-ls, and it looks good.

Ah good point. Now that I have added the macOS binaries in the release it should be possible to modify
verilog/tools/ls/vscode/src/download-ls.ts to not write the message anymore for macos, but downloads the published version instead.
Then build it locally to test it it now downloads.
Since I don't have a mac to test, would you like to get this going and then send a pull request ?

So are these messages just ignorable warning messages?!
I have added binary to PATH, but vscode do not use them in PATH.
Looks that the function checkIfBinaryExists(binaryPath: string) doesn't work on macOS?

Yes, if the binary is in your path, it would just work.
If it does not find verible in the $PATH, it attempts to download it, so that is when the message is happening.

ignore me. When I change the extension settings from the default “verible-verilog-ls” to a specific path “/...../...../...../bin/verible-verilog-ls”. it can use my downloaded one automatically.
Let me try your proposal. but tomorrow, it is too late today. :D

Yes, if the binary is in your path, it would just work.
If it does not find verible in the $PATH, it attempts to download it, so that is when the message is happening.

Ahh, but I have added them to PATH. and it cannot find it, until I tell vscode its complete path.
command -v works well.

I am not sure whether it is just due to my local environment. So you can ignore it temporarily, if nobody else reports.

@hzeller The situation is strange. I cloned the variable repo (master branch), and run bazel build:
bazel build --jobs=12 -c opt //...

and it failed. (still the multi header definition bug:
~/Workspace/linter/verible master ························································ 6s  base 01:01:36
❯ bazel build --jobs=12 -c opt //...
Starting local Bazel server and connecting to it...
INFO: Analyzed 1898 targets (146 packages loaded, 6269 targets configured).
INFO: Found 1898 targets...
INFO: From Linking external/com_google_absl/absl/base/libbase.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/base/_objs/base/unscaledcycleclock.o has no symbols
INFO: From Linking external/com_google_absl/absl/types/libbad_optional_access.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/_objs/bad_optional_access/bad_optional_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/libbad_optional_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/flags/libflag.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/flags/_objs/flag/flag.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/flags/libflag.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/debugging/libdebugging_internal.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/elf_mem_image.o has no symbols
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/vdso_support.o has no symbols
INFO: From Linking external/com_google_absl/absl/crc/libcrc32c.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/crc/_objs/crc32c/crc_memcpy_x86_64.o has no symbols
INFO: From Linking external/com_google_absl/absl/types/libbad_any_cast_impl.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/_objs/bad_any_cast_impl/bad_any_cast.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/libbad_any_cast_impl.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/types/libbad_variant_access.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/_objs/bad_variant_access/bad_variant_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/types/libbad_variant_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/log/liblog_entry.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/log/_objs/log_entry/log_entry.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_absl/absl/log/liblog_entry.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/strings/libcord.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_absl/absl/strings/_objs/cord/cord_buffer.o has no symbols
INFO: From Compiling gnulib/lib/vasnprintf.c [for tool]:
external/m4_v1.4.18/gnulib/lib/vasnprintf.c:3185:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf ((char *) p, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
external/m4_v1.4.18/gnulib/lib/vasnprintf.c:3193:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf (expbuf, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
external/m4_v1.4.18/gnulib/lib/vasnprintf.c:3336:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf ((char *) p, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
external/m4_v1.4.18/gnulib/lib/vasnprintf.c:3344:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf (expbuf, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
4 warnings generated.
INFO: From Compiling gnulib/lib/vasnprintf.c [for tool]:
external/bison_v3.3.2/gnulib/lib/vasnprintf.c:3185:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf ((char *) p, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
external/bison_v3.3.2/gnulib/lib/vasnprintf.c:3193:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf (expbuf, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
external/bison_v3.3.2/gnulib/lib/vasnprintf.c:3336:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf ((char *) p, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
external/bison_v3.3.2/gnulib/lib/vasnprintf.c:3344:35: warning: 'sprintf' is deprecated: This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead. [-Wdeprecated-declarations]
                                  sprintf (expbuf, "%+d", exponent);
                                  ^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdio.h:188:1: note: 'sprintf' has been explicitly marked deprecated here
__deprecated_msg("This function is provided for compatibility reasons only.  Due to security concerns inherent in the design of sprintf(3), it is highly recommended that you use snprintf(3) instead.")
^
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/sys/cdefs.h:215:48: note: expanded from macro '__deprecated_msg'
        #define __deprecated_msg(_msg) __attribute__((__deprecated__(_msg)))
                                                      ^
4 warnings generated.
INFO: From Compiling src/parse-gram.c [for tool]:
src/parse-gram.c:2029:9: warning: variable 'gram_nerrs' set but not used [-Wunused-but-set-variable]
    int yynerrs;
        ^
src/parse-gram.c:80:25: note: expanded from macro 'yynerrs'
#define yynerrs         gram_nerrs
                        ^
1 warning generated.
INFO: From Compiling src/misc.c [for tool]:
external/flex_v2.6.4/src/misc.c:515:40: warning: passing 'unsigned char *' to parameter of type 'const char *' converts between pointers to integer types where one is of the unique plain 'char' type and the other is not [-Wpointer-sign]
                        esc_char = (unsigned char) strtoul (array + 1, NULL, 8);
                                                            ^~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdlib.h:175:23: note: passing argument to parameter '__str' here
         strtoul(const char *__str, char **__endptr, int __base);
                             ^
external/flex_v2.6.4/src/misc.c:537:40: warning: passing 'unsigned char *' to parameter of type 'const char *' converts between pointers to integer types where one is of the unique plain 'char' type and the other is not [-Wpointer-sign]
                        esc_char = (unsigned char) strtoul (array + 2, NULL, 16);
                                                            ^~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/stdlib.h:175:23: note: passing argument to parameter '__str' here
         strtoul(const char *__str, char **__endptr, int __base);
                             ^
2 warnings generated.
INFO: From Executing genrule //verilog/parser:verilog-lex:
verilog/parser/verilog.lex:303: warning, rule cannot be matched
verilog/parser/verilog.lex:943: warning, rule cannot be matched
INFO: From Linking external/com_google_absl/absl/log/liblog_entry.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/log/_objs/log_entry/log_entry.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/log/liblog_entry.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/types/libbad_optional_access.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/_objs/bad_optional_access/bad_optional_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/libbad_optional_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/base/libbase.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/base/_objs/base/unscaledcycleclock.o has no symbols
INFO: From Linking verilog/CST/libverilog-matchers.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/verilog/CST/_objs/verilog-matchers/verilog_matchers.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/verilog/CST/libverilog-matchers.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/crc/libcrc32c.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/crc/_objs/crc32c/crc_memcpy_x86_64.o has no symbols
INFO: From Linking external/com_google_absl/absl/strings/libcord.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/strings/_objs/cord/cord_buffer.o has no symbols
INFO: From Linking external/com_google_absl/absl/types/libbad_variant_access.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/_objs/bad_variant_access/bad_variant_access.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/types/libbad_variant_access.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_absl/absl/debugging/libdebugging_internal.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/elf_mem_image.o has no symbols
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/debugging/_objs/debugging_internal/vdso_support.o has no symbols
INFO: From Linking external/com_google_absl/absl/flags/libflag.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/flags/_objs/flag/flag.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_absl/absl/flags/libflag.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Compiling verilog/parser/verilog-final.tab.cc:
bazel-out/darwin-opt/bin/verilog/parser/verilog.tab.cc:12998:9: warning: variable 'verilog_nerrs' set but not used [-Wunused-but-set-variable]
    int yynerrs;
        ^
bazel-out/darwin-opt/bin/verilog/parser/verilog-final.tab.cc:72:25: note: expanded from macro 'yynerrs'
#define yynerrs         verilog_nerrs
                        ^
1 warning generated.
INFO: From Executing genrule //verilog/parser:verilog-lex [for tool]:
verilog/parser/verilog.lex:303: warning, rule cannot be matched
verilog/parser/verilog.lex:943: warning, rule cannot be matched
INFO: From Compiling verilog/parser/verilog-final.tab.cc [for tool]:
bazel-out/darwin-opt-exec-2B5CBBC6/bin/verilog/parser/verilog.tab.cc:12998:9: warning: variable 'verilog_nerrs' set but not used [-Wunused-but-set-variable]
    int yynerrs;
        ^
bazel-out/darwin-opt-exec-2B5CBBC6/bin/verilog/parser/verilog-final.tab.cc:72:25: note: expanded from macro 'yynerrs'
#define yynerrs         verilog_nerrs
                        ^
1 warning generated.
INFO: From Executing genrule //common/analysis:command-file-lex [for tool]:
common/analysis/command_file.lex:77: warning, rule cannot be matched
INFO: From Linking verilog/CST/libverilog-matchers.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/verilog/CST/_objs/verilog-matchers/verilog_matchers.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/verilog/CST/libverilog-matchers.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Compiling verilog/parser/verilog-final.tab.cc:
bazel-out/darwin-opt/bin/verilog/parser/verilog.tab.cc:12998:9: warning: variable 'verilog_nerrs' set but not used [-Wunused-but-set-variable]
    int yynerrs;
        ^
bazel-out/darwin-opt/bin/verilog/parser/verilog-final.tab.cc:72:25: note: expanded from macro 'yynerrs'
#define yynerrs         verilog_nerrs
                        ^
1 warning generated.
INFO: From Linking external/com_google_protobuf/src/google/protobuf/io/libio_win32.a [for tool]:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_protobuf/src/google/protobuf/io/_objs/io_win32/io_win32.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/com_google_protobuf/src/google/protobuf/io/libio_win32.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Linking external/com_google_protobuf/src/google/protobuf/io/libio_win32.a:
/Library/Developer/CommandLineTools/usr/bin/libtool: file: bazel-out/darwin-opt/bin/external/com_google_protobuf/src/google/protobuf/io/_objs/io_win32/io_win32.o has no symbols
warning: /Library/Developer/CommandLineTools/usr/bin/libtool: archive library: bazel-out/darwin-opt/bin/external/com_google_protobuf/src/google/protobuf/io/libio_win32.a the table of contents is empty (no object file members in the library define global symbols)
INFO: From Executing genrule //common/analysis:command-file-lex:
common/analysis/command_file.lex:77: warning, rule cannot be matched
ERROR: /private/var/tmp/_bazel_zhutmost/26c0866f5dae2ba95d124db1b727a739/external/com_google_boringssl/BUILD:136:11: Compiling err_data.c failed: (Exit 1): cc_wrapper.sh failed: error executing command (from target @com_google_boringssl//:crypto) external/local_config_cc/cc_wrapper.sh -U_FORTIFY_SOURCE -fstack-protector -Wall -Wthread-safety -Wself-assign -Wunused-but-set-parameter -Wno-free-nonheap-object -fcolor-diagnostics ... (remaining 43 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
In file included from external/com_google_boringssl/err_data.c:18:
In file included from /usr/local/include/openssl/err.h:21:
/usr/local/include/openssl/e_os2.h:183:11: error: 'OPENSSL_EXPORT' macro redefined [-Werror,-Wmacro-redefined]
#  define OPENSSL_EXPORT extern
          ^
external/com_google_boringssl/src/include/openssl/base.h:135:9: note: previous definition is here
#define OPENSSL_EXPORT
        ^
In file included from external/com_google_boringssl/err_data.c:18:
In file included from /usr/local/include/openssl/err.h:28:
/usr/local/include/openssl/types.h:74:13: error: typedef redefinition with different types ('int' vs 'struct asn1_null_st')
typedef int ASN1_NULL;
            ^
external/com_google_boringssl/src/include/openssl/base.h:261:29: note: previous definition is here
typedef struct asn1_null_st ASN1_NULL;
                            ^
In file included from external/com_google_boringssl/err_data.c:18:
In file included from /usr/local/include/openssl/err.h:28:
/usr/local/include/openssl/types.h:106:26: error: typedef redefinition with different types ('struct evp_md_st' vs 'struct env_md_st')
typedef struct evp_md_st EVP_MD;
                         ^
external/com_google_boringssl/src/include/openssl/base.h:328:26: note: previous definition is here
typedef struct env_md_st EVP_MD;
                         ^
In file included from external/com_google_boringssl/err_data.c:18:
In file included from /usr/local/include/openssl/err.h:28:
/usr/local/include/openssl/types.h:107:30: error: typedef redefinition with different types ('struct evp_md_ctx_st' vs 'struct env_md_ctx_st')
typedef struct evp_md_ctx_st EVP_MD_CTX;
                             ^
external/com_google_boringssl/src/include/openssl/base.h:327:30: note: previous definition is here
typedef struct env_md_ctx_st EVP_MD_CTX;
                             ^
In file included from external/com_google_boringssl/err_data.c:18:
In file included from /usr/local/include/openssl/err.h:28:
/usr/local/include/openssl/types.h:133:34: error: typedef redefinition with different types ('struct evp_Encode_Ctx_st' vs 'struct evp_encode_ctx_st')
typedef struct evp_Encode_Ctx_st EVP_ENCODE_CTX;
                                 ^
external/com_google_boringssl/src/include/openssl/base.h:333:34: note: previous definition is here
typedef struct evp_encode_ctx_st EVP_ENCODE_CTX;
                                 ^
In file included from external/com_google_boringssl/err_data.c:18:
In file included from /usr/local/include/openssl/err.h:29:
In file included from /usr/local/include/openssl/bio.h:30:
/usr/local/include/openssl/crypto.h:308:3: error: typedef redefinition with different types ('struct crypto_threadid_st' vs 'int')
} CRYPTO_THREADID;
  ^
external/com_google_boringssl/src/include/openssl/base.h:257:13: note: previous definition is here
typedef int CRYPTO_THREADID;
            ^
external/com_google_boringssl/err_data.c:33:1: error: static_assert failed due to requirement '13 == 12' "library value changed"
static_assert(ERR_LIB_ASN1 == 12, "library value changed");
^             ~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:34:1: error: static_assert failed due to requirement '14 == 13' "library value changed"
static_assert(ERR_LIB_CONF == 13, "library value changed");
^             ~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:35:1: error: static_assert failed due to requirement '15 == 14' "library value changed"
static_assert(ERR_LIB_CRYPTO == 14, "library value changed");
^             ~~~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:36:1: error: static_assert failed due to requirement '16 == 15' "library value changed"
static_assert(ERR_LIB_EC == 15, "library value changed");
^             ~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:37:1: error: static_assert failed due to requirement '20 == 16' "library value changed"
static_assert(ERR_LIB_SSL == 16, "library value changed");
^             ~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:38:1: error: static_assert failed due to requirement '32 == 17' "library value changed"
static_assert(ERR_LIB_BIO == 17, "library value changed");
^             ~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:39:1: error: static_assert failed due to requirement '33 == 18' "library value changed"
static_assert(ERR_LIB_PKCS7 == 18, "library value changed");
^             ~~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:40:15: error: use of undeclared identifier 'ERR_LIB_PKCS8'
static_assert(ERR_LIB_PKCS8 == 19, "library value changed");
              ^
external/com_google_boringssl/err_data.c:41:1: error: static_assert failed due to requirement '34 == 20' "library value changed"
static_assert(ERR_LIB_X509V3 == 20, "library value changed");
^             ~~~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:42:1: error: static_assert failed due to requirement '36 == 21' "library value changed"
static_assert(ERR_LIB_RAND == 21, "library value changed");
^             ~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:43:1: error: static_assert failed due to requirement '38 == 22' "library value changed"
static_assert(ERR_LIB_ENGINE == 22, "library value changed");
^             ~~~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:44:1: error: static_assert failed due to requirement '39 == 23' "library value changed"
static_assert(ERR_LIB_OCSP == 23, "library value changed");
^             ~~~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
external/com_google_boringssl/err_data.c:45:1: error: static_assert failed due to requirement '40 == 24' "library value changed"
static_assert(ERR_LIB_UI == 24, "library value changed");
^             ~~~~~~~~~~~~~~~~
/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/assert.h:113:23: note: expanded from macro 'static_assert'
#define static_assert _Static_assert
                      ^
fatal error: too many errors emitted, stopping now [-ferror-limit=]
20 errors generated.
INFO: Elapsed time: 311.015s, Critical Path: 32.43s
INFO: 2936 processes: 1105 internal, 1831 darwin-sandbox.
FAILED: Build did NOT complete successfully

This is my path:
❯ echo $PATH
/Users/zhutmost/Software/verible/bin:/Users/zhutmost/Software/circt/bin:/Users/zhutmost/Software/mill:/Users/zhutmost/Software/svls:/Users/zhutmost/Software/jetbrains-toolbox/scripts:/usr/local/Cellar/openjdk/20.0.1/libexec/openjdk.jdk/Contents/Home/bin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/VMware Fusion.app/Contents/Public:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/Users/zhutmost/Software/verible/bin:/Users/zhutmost/Software/circt/bin:/Users/zhutmost/Software/mill:/Users/zhutmost/Software/svls:/Users/zhutmost/Software/jetbrains-toolbox/scripts:/usr/local/Cellar/openjdk/20.0.1/libexec/openjdk.jdk/Contents/Home/bin:/Library/Java/JavaVirtualMachines/temurin-17.jdk/Contents/Home/bin:/Users/zhutmost/Library/pnpm:/usr/local/Caskroom/miniforge/base/bin:/usr/local/Caskroom/miniforge/base/condabin

I am not sure which part is different from your CI environment.
And I also forked your repo, but the CI cannot run on my account, due to the deployment setting.

I am not sure whether it is just due to my local environment.

The issue about that vscode cannot find lang server from PATH, is  fixed. It is due to that VScode won't update its PATH environment, until its process is completely killed and restarted.
I still cannot compile from scratch.

Are you building from head ? The openssl issue should've been fixed with #1970

@hzeller yes I am sure.

Anyway we can change the homebrew rb setting to the prebuilt macOS binary now.

It looks good on my Mac.
Lint on the fly:

Format also works.


callable object combining mdf_reader, cdm_mapper, metmetpy and operations

We have to think about combining mdf_reader, cdm_mapper, metmetpy and operations.
-this is relevant for GLAMOD marine_processing release 8.0.

Hi @jtsiddons, there are some more breaking changes in PR #188:

New core CDM object including callable cdm_mapper, metmemtpy and operations methods
new list of imported submodules: [map_model, cdm_tables, read_tables, write_tables, duplicate_check and read_mdf]
removed list of imported submodules: [cdm_mapper, common, mdf_reader, metmetpy, operations]
remove imported submodules from cdm_mapper, mdf_reader
read_tables: returning CDM object
read_tables: resulting dataframe always includes multi-indexed columns
duplicates is now a direct submodule of cdm_reader_mapper
import read function from mdf_reader.read as read_mdf
read_mdf: returning CDM object

Probably I nedd another name for CDM. Unfortunately, I am not creative enough :disappointed_relieved: :smiley:.
Do you have any comments/suggestions?

Done in #188


Info popup: #80

Refernces issue #80
What I've done:
src/components/Shared/Form/index.js
1- imported popUp component and Modal provider which is a wrapper that popUp needs.
2- Made dummy data for each category and stored it in state.
3- Supplied the father component (form) of popUp component (child) with toggleOpen and toggleClose function to control the status of the child.
4- Stored categories in an array, looped through it to render each category without having to hardcode it.
5- For each category I made an array of values (see #2) and looped through it to render the 1st five values into the drop-down list.
6- in toggleOpen, I checked if the option clicked is “More…” and if it is, I update the property “selected” in state. Lastly I pass the data as a property to popUp by setting the state in accordance to what selected is. For example, if selected is conditions  will pass the array of conditions as data to the the component.
src/components/Shared/Popup/
1- imported { StyledModal, Category, CloseBtn } from "./popup.style".
2- on StyledModal :
isOpen is a property that shows the PopUp component when its true.
toggleClose is a function that closes it. (makes it false)
onBackgroundClick: it calls a function that closes the popUp when background is clicked.
onEscapeKeydown: it calls a function that closes the popUp when ESC is clicked.
3-  Passed data from props in an unordered list.

@m4v15 can you review this? I kinda feel quite proud of this lol.


Gelbooru 0.1 sites not opening

it says No result, Possible Reasons: servers offline even though its online. i tried every other version and downloaded the latest version of visual c++ nothing is working whats the problem? help please thank you

Seem to be a duplicate of #2214

Seem to be a duplicate of #2214

bro can you please tell me how to do user agents, cookies , or model.js files? or is there some tutorials on them? i searched it up but couldnt find any i would really appreciate if you help me man

bro can you please tell me how to do user agents, cookies , or model.js files? or is there some tutorials on them? i searched it up but couldnt find any i would really appreciate if you help me man

OK i fixed it. In case anyone having problems this is what you gotta do: add the gelbooru site to the sources, after that open options of the site you entered in the sources, get to headers, And put: ''User-Agent'' to the name and put:
''Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0'' to Value and that should fix it

OK i fixed it. In case anyone having problems this is what you gotta do: add the gelbooru site to the sources, after that open options of the site you entered in the sources, get to headers, And put: ''User-Agent'' to the name and put:
''Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0'' to Value and that should fix it


All  workbox-webpack-plugin code examples missing 'new'

Library Affected:
workbox-webpack-plugin
Node version affected: v8.9.4 (probably others too)
Issue or Feature Request Description:
Both plugins in the package (GenerateSW and InjectManifest) are classes, which means they need to be called with new. All of the code examples in the docs do not use this, causing them to raise a TypeError exception when run
> const { GenerateSW } = require('workbox-webpack-plugin');
undefined
> s = GenerateSW()
TypeError: Cannot call a class as a function
    at exports.default (node_modules/babel-runtime/helpers/classCallCheck.js:7:11)
    at GenerateSW (node_modules/workbox-webpack-plugin/build/generate-sw.js:76:34)
> s = new GenerateSW()
undefined
> s
GenerateSW {
  config:
   { chunks: [],
     exclude: [ /\.map$/, /^manifest.*\.js(?:on)?$/ ],
     excludeChunks: [],
     importScripts: [],
     importWorkboxFrom: 'cdn',
     swDest: 'service-worker.js' } }

Pages with this issue:

https://developers.google.com/web/tools/workbox/guides/generate-service-worker/webpack
https://developers.google.com/web/tools/workbox/modules/workbox-webpack-plugin

This will be fixed in https://github.com/google/WebFundamentals/pull/5941
Thanks for pointing it out!

Hi,
Came across same issue in another page:
https://developers.google.com/web/tools/workbox/guides/precache-files/webpack

Thanks. https://github.com/google/WebFundamentals/pull/5993


flyctl: 0.0.374 -> 0.0.377

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/superfly/flyctl/releases.
meta.description for flyctl is: "Command line tools for fly.io services"
meta.homepage for flyctl is: "https://fly.io/"
meta.changelog for flyctl is: ""
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.0.376 with grep in /nix/store/374jmsmg40vr9r1y95r86gs98ck2p1m3-flyctl-0.0.376
found 0.0.376 in filename of file in /nix/store/374jmsmg40vr9r1y95r86gs98ck2p1m3-flyctl-0.0.376

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
flyctl

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/374jmsmg40vr9r1y95r86gs98ck2p1m3-flyctl-0.0.376 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A flyctl https://github.com/r-ryantm/nixpkgs/archive/8cf96cad0368d7c9d21ae08044b6db6615a2ca71.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/374jmsmg40vr9r1y95r86gs98ck2p1m3-flyctl-0.0.376
ls -la /nix/store/374jmsmg40vr9r1y95r86gs98ck2p1m3-flyctl-0.0.376/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

flyctl

Maintainer pings
cc @aaronjanse @jsierles @techknowlogick @viraptor for testing.

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/superfly/flyctl/releases.
meta.description for flyctl is: "Command line tools for fly.io services"
meta.homepage for flyctl is: "https://fly.io/"
meta.changelog for flyctl is: ""
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.0.377 with grep in /nix/store/pwfrfbjqgv217rdafkkpwby211rwgh4j-flyctl-0.0.377
found 0.0.377 in filename of file in /nix/store/pwfrfbjqgv217rdafkkpwby211rwgh4j-flyctl-0.0.377

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
flyctl

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/pwfrfbjqgv217rdafkkpwby211rwgh4j-flyctl-0.0.377 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A flyctl https://github.com/r-ryantm/nixpkgs/archive/f4d9b1652217491c5485590f1d77d7b6f7bb861a.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/pwfrfbjqgv217rdafkkpwby211rwgh4j-flyctl-0.0.377
ls -la /nix/store/pwfrfbjqgv217rdafkkpwby211rwgh4j-flyctl-0.0.377/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

flyctl

Maintainer pings
cc @aaronjanse @jsierles @techknowlogick @viraptor for testing.

Result of nixpkgs-review pr 187437 run on x86_64-linux 1

1 package built:

flyctl


Bug schema to triggers

:shipit:

Comment accepted. Will treat it ASAP

Squashing and checks in progress.


[BUG] Unrelated frontmatter being modified when modifying via table

Selecting a personalRating:

Causes modifications to unrelated fields inside the note which breaks things:

Here's the settings for that personalRating column:

Using Ubuntu 21.04 with obsidian 0.14.15

hi @PaperOrb
After edit a cell, the plugin check every field inside the frontmatter and adds commas wrapping the text if it’s necessary.
In your image, those fields than lose their commas looks like they do not need it but url field cause it contains “:”
Could you attach the db file and some example with the original text to test it? I cant see what’s the problem

Hey @RafaelGB, here's the DB and a file to test it with:
folder db test.md
FINAL FANTASY VII (2013).md

thanks! Will be added to bugs in roadmap

The notes seem to be generated by my Media DB Plugin.
For that plugin, I wrote my own YAML stringifier that consistently adds quotation marks around strings. Mostly because I prefer it that way.
I am guessing that the db folder plugin replaces the entire frontmatter block and uses the obsidian API YAML stringifier for that.

hi @mProjectsCode . I am afraid that the plugin use the dataview parser with all the fields. I added a proxy between to give it some value with quotes in some cases. I can add more uses cases to fix your issue

thanks for the quick answer.
I personally think a setting to always add quotation marks to strings would be nice.
That also seems to be the simplest way to resolve the small "conflict" between our plugins. I will also work on an option to only add quotation marks only where it is necessary for my plugin.

We can collaborate to obtain the best parsing. In src/services/DataviewService.ts is the behaviour of the writing quotes:
private handleMarkdownBreaker(value: string, isInline?: boolean): string {
        if (isInline) {
            return value;
        }
        // Check possible markdown breakers of the yaml
        if (MarkdownBreakerRules.INIT_CHARS.some(c => value.startsWith(c)) ||
            MarkdownBreakerRules.BETWEEN_CHARS.some(rule => value.includes(rule)) ||
            MarkdownBreakerRules.UNIQUE_CHARS.some(c => value === c)) {
            value = value.replaceAll(`"`, `\\"`);
            return `"${value}"`;
        }

        return value;
    }

New property added to select your editing preferences
https://user-images.githubusercontent.com/11924043/174895284-bc49ad22-6077-4065-ae6c-9403b570086c.mov

Looks great, except that it also adds quotation marks around non-strings like booleans and numbers.

Fixed too :)


Integrate SSO with Google SAML

A clear and concise description of what you want to accomplish.

hi @greenpau ,
I don't know if this is a proper place to ask, but I'm seeking helps to configure SSO with Google SAML:
{
	debug
	order authenticate before respond
	order authorize before basicauth

	security {
		saml identity provider google {
			realm google
			driver generic
			idp_metadata_location /root/caddy/google/google-saml-metadata.xml
			entity_id https://accounts.google.com/o/saml2?idpid=C01k107kt
			idp_login_url https://accounts.google.com/o/saml2/idp?idpid=C01k107kt
			idp_sign_cert_location /root/caddy/google/certificate.pem
			application_name "Google SAML Auth"
			acs_url https://auth.quangpm.net/saml/google
		}

		authentication portal myportal {
			crypto default token lifetime 3600
			crypto key sign-verify 8x27pg7bbIB7mPi/1VjoeJxfDOfAGdZXKmEMqS7R6TE=
			enable identity provider google
			cookie domain quangpm.net
			ui {
				links {
					"Main Site" https://asset.quangpm.net/ icon "las la-star"
					"My Identity" "/whoami" icon "las la-user"
				}
			}
			transform user {
				match realm google
				action add role authp/user
			}
		}

		authorization policy mypolicy {
			set auth url https://auth.quangpm.net/
			allow roles authp/admin authp/user
			crypto key verify 8x27pg7bbIB7mPi/1VjoeJxfDOfAGdZXKmEMqS7R6TE=
		}
	}
}

(tls_config) {
	tls /root/caddy/server.crt /root/caddy/server.key
}

auth.quangpm.net {
	import tls_config
	authenticate with myportal
}

asset.quangpm.net {
	import tls_config
	authorize with mypolicy
	root * /srv/
	file_server
}

I try configuring Google SAML like this but it doesn't work, when I clicked on the Login button, it showed
Error parsing the request, No SAML message present in request That’s all we know.

Is there anything wrong here, it should be a POST or GET with URL params to Google SSO ?  I only see it redirected to https://accounts.google.com/o/saml2/idp?idpid=C01k107kt

@pmquang , please upload attach the file with the logs. I see you already have debug enabled.

@pmquang , please upload attach the file with the logs. I see you already have debug enabled.

Here you are sir @greenpau , logs from when I access to https://auth.quangpm.net to I meet the error
caddy.log


Use an enum instead of an integer for shadow atlas size values

By design, shadow atlases must use power-of-two sizes. Therefore, using an enum instead of an integer makes more sense and allows for providing better documentation.
This does not affect directional shadow size as there are plans to allow non-power-of-two values as directional shadow sizes.
Preview
https://user-images.githubusercontent.com/180032/152450116-d38ec041-cb65-46e2-9a43-e16d03852a3a.mp4

But by using an enum, one concern is that that could be making future changes to this value difficult, in terms of breaking compatibility? I.e. if you set the lowest value at 256 here, and we later decide to change this to 128 / 512, will this not break the previous project files?
Really to enforce the power of 2 it would be nicer to be able to save either the value directly in the project file (e.g. 2048), or the power of 2 (e.g. 8 = 256, 7=128 etc). That way it would be forward compatible. But on the other hand maybe storing the value directly as is already the case is better, in case non-power of 2 becomes viable in the future.
So overall it seems what would be nice to do is to enforce some presets in the inspector but to actually save these as straight values. And as an aside I'm not absolutely convinced it is a good idea to pass them as an enum to the VisualServer (for similar reasons), it can easily validate the values are power of 2, and ERR_FAIL otherwise.
If the inspector slider system does not support this already, perhaps we could add support?

But by using an enum, one concern is that that could be making future changes to this value difficult, in terms of breaking compatibility? I.e. if you set the lowest value at 256 here, and we later decide to change this to 128 / 512, will this not break the previous project files?

I'd be very surprised if we have to add any more options to this enum.

I'd be very surprised if we have to add any more options to this enum. The range covered by the new options is identical to the one provided by the old options in the project settings (except that it now lets you disable point light shadows entirely).

The point lawnjelly is making is that, with this PR, a change to the range becomes a breaking change. Whereas right now, we can easily adjust the range without breaking compatibility.
Moving to an enum is a good idea. We are trying to use enums for settings as much as possible, but we need to make sure we are happy with the set of exposed enums.

This is now to late for such compatibility breakage, and there wasn't a clear consensus.
One solution we just discussed (for 4.x) in the production team could be to actually go in the opposite direction: make these kind of power-of-two properties integers, but add a PROPERTY_HINT_POWER_OF_TWO that would be used by EditorProperty to display a nice slider that bumps in powers of two between two exponents configured as a range.
This would solve the usability problem in the editor, and the compatibility issue if we want to expand the range, as the serialized value is the actual integer value.


Dimensions must be equal, but are 44 and 45 for 'lanenet_loss/inference/decode/fuse_1' (op: Add)

Thank you for sharing your code! I've formatted the BDD dataset to train your model on, but I keep running into this error:

Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/common_shapes.py", line 654, in _call_cpp_shape_fn_impl
input_tensors_as_shapes, status)
File "/usr/lib/python3.5/contextlib.py", line 66, in exit
next(self.gen)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/errors_impl.py", line 466, in raise_exception_on_not_ok_status
pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors_impl.InvalidArgumentError: Dimensions must be equal, but are 44 and 45 for 'lanenet_loss/inference/decode/fuse_1' (op: 'Add') with input shapes: [4,44,80,64], [4,45,80,64].
My command is: python3 tools/train_lanenet.py --net vgg --dataset_dir ~/data/bdd100k/ --weights_path model/tusimple_lanenet/tusimple_lanenet_vgg_2018-05-21-11-11-03.ckpt-94000, and ~/data/bdd100k/ has the three image directories along with train.txt and val.txt as specified in the example. The only configuration I've changed is image height and width to 720 x 1280. Do you have any ideas on what may be the problem here?

@jess2422 Rescale your tensor shape which must be equal after applying transpose conv operation.

Does this happen because of the different training data or do you have to do this every time? I somewhat understand the conv_2d_tranpose operation, but do you mean to also pad the output of regular conv_2d to match the transpose?

j

Hi, I'm new to lane detection. I came cross the same problem.
How to adjust the input sensor shape?

@jess2422 You should adjust your input tensor shape to make sure the tensors which are added together have the same shape.


Any way to ignore Undocumentable?

i want to run yard doc --fail-on-warning --no-output in CI and confirm success
i have several instances of undocumentable code
one instance is this in a rails model, also the subject of this 12-year-old SO question which i just put a bounty on 😄
include Rails.application.routes.url_helpers

is there any way to ignore or document these so that there are no warnings?
i researched high and low before writing this, i hope i didn't miss something.
thanks for a great project!

in case helplful to someone finding this, here's what i'm trying in CircleCI
set +e # do not exit right away if a command fails https://circleci.com/docs/configuration-reference/#default-shell-options
yard doc --fail-on-warning --no-output &> yard_out
grep "\[warn\]" yard_out | grep -ivq undocumentable
if [ $? -eq 0 ]; then # grep found a warning that is not undocumentable? that's bad
  echo "IMPORTANT: Do not try to fix 'Undocumentable' errors, only fix the others"
  echo
  cat yard_out
  echo
  echo "IMPORTANT: Do not try to fix 'Undocumentable' errors, only fix the others"
  exit 1
fi
cat yard_out # all good! show output and exit success

is there any way to ignore or document these so that there are no warnings?

This is a bit of a loaded question. There is no way to retain the same syntax and not have YARD display warnings. By the same token, if you do not want warnings to fail your CI build, you should not use the built-in --fail-on-warning option. YARD's fail-on-warning option is intentionally simplistic, since YARD's core codebase itself is not a documentation linter; the fail on warning option is a convenience to provide an error code if any warning text was printed. tl;dr, fail-on-warning does not allow for customization.
In general, the solution to providing documentable code is to reduce your use of dynamic calls such as the one you've listed. In almost all cases, there is a non-dynamic alternative to dynamic Ruby syntaxes. In the case of your specific example, you could use Rails.application.routes.url_helpers.YOUR_ROUTE directly. Another Rails specific solution would be to wrap the include statement inside of a Concern:
module WithRoutes
  extend ActiveSupport::Concern

  included do
    include Rails.application.routes.url_helpers
  end
end

class MyController < ApplicationController
  include WithRoutes
end

This will bypass top-level inclusion in the YARD parser.
If you do not want to change your syntax, the solution you've come up with is basically the simplest "recommended" path as far as implementing simple custom linting in CI. If you want something a little more robust, you can consider using YARD extensions, like overriding YARD::Logger#warn to do this type of parsing in Ruby, or via an extension to specific handlers. The latter would afford you a lot more flexibility about what type of code is allowed and when, for example:
# yard_extensions/ignore_rails_mixin.rb
module IgnoreRailsMixin
  def process
    super
  rescue YARD::Parser::UndocumentableError => e
    raise e unless statement.last.source.start_with?("Rails.")
  end
end

YARD::Handlers::Ruby::MixinHandler.prepend(IgnoreRailsMixin)

You can use the above via yard -e yard_extensions/ignore_rails_mixin.rb or by adding -e yard_extensions/ignore_rails_mixin.rb to your .yardopts.

Wow, thank you so much for these solutions!

Here's what I came up with, I couldn't figure out a way to get it into the top level process method, since it's done with metaprogramming
# https://github.com/lsegal/yard/issues/1542
module YardIgnoreUndocumentable
  def process
    super
  rescue YARD::Parser::UndocumentableError => e
    puts '😎'
  end
end

YARD::Handlers::Ruby::MixinHandler.prepend(YardIgnoreUndocumentable)
YARD::Handlers::Ruby::AttributeHandler.prepend(YardIgnoreUndocumentable)
YARD::Handlers::Ruby::MethodHandler.prepend(YardIgnoreUndocumentable)

and then running this in CI
yard doc -e lib/yard_extensions/ignore_undocumentable.rb --fail-on-warning # do not add --no-output

I found this thread really useful. Here is a version that comes with a config file. Probably worth making it a plugin in the future.
Extension
# yard_extensions/ignore_warnings.rb
module IgnoreWarnings
  def process
    super
  rescue YARD::Parser::UndocumentableError => e
    raise e unless ::IgnoreWarnings::Registry.instance.ignore?(exception: e, statement: statement)
  end
end

require_relative "ignore_warnings/registry"

IgnoreWarnings::Registry.initialize_instance(File.join(File.dirname(__FILE__), "../yard.yml"))

YARD::Handlers::Ruby::ClassHandler.prepend(IgnoreWarnings)
YARD::Handlers::Ruby::MixinHandler.prepend(IgnoreWarnings)

# yard_extensions/ignore_warnings/registry.rb
class IgnoreWarnings::Registry
  attr_reader :rules
  attr_accessor :debug

  def initialize
    @debug = false
    @rules = []
  end

  def add_rule(hash = {})
    if hash.nil? || hash.empty?
      raise ArgumentError, "Invalid rule: #{hash}"
    end

    unknown_keys = hash.keys - %w[file line error_class source]

    unless unknown_keys.empty?
      raise ArgumentError, "Unknown rule keys #{unknown_keys.map(&:inspect).join(", ")} in #{hash}"
    end

    @rules << (hash.map { |k, v| [k.to_sym, v] }.to_h)
  end

  def ignore?(exception:, statement:)
    file = statement.last.file
    source = statement.last.source
    error_class = exception.class.name
    line = statement.last.line

    @rules.each do |r|
      next if r.key?(:error) && r[:error] != error_class
      next if r.key?(:file) && r[:file] != file
      next if r.key?(:line) && r[:line] != line
      next if r.key?(:source) && r[:source] != source

      if debug
        puts "* [IgnoreWarnings] Rule Matched:\n  rule: #{r}\n  error_class: #{error_class.inspect}\n  file: #{file}\n  line: #{line}\n  source: #{source.inspect}"
      end

      return true
    end

    if debug
      puts "* [IgnoreWarnings] No rules matched:\n  error_class: #{error_class.inspect}\n  file: #{file}\n  line: #{line}\n  source: #{source.inspect}"
    end

    false
  end

  private

  class << self
    def new_from_config(path)
      require "yaml"
      new.tap do |registry|
        config = YAML.safe_load_file(path)

        rules = config.dig("yard", "ignore_warnings", "rules")

        registry.debug = config.dig("yard", "ignore_warnings", "debug")

        if rules
          rules.each { |r| registry.add_rule(r) }
        else
          raise "No rules found in: #{config}"
        end
      end
    end

    def initialize_instance(config_path)
      @insance = new_from_config(config_path)
    end

    def instance
      @instance || raise("Did you forget to call IgnoreWarnings::Registry.initialize_instance?")
    end
  end
end

Configuration
# yard.yml
yard:
  ignore_warnings:
    # debug: true
    rules:
      - file: app/lib/route_helpers.rb
        error_class: YARD::Parser::UndocumentableError
        source: Rails.application.routes.url_helpers
      - file: lib/core_ext/to_bool.rb
        error_class: YARD::Parser::UndocumentableError
        line: 21

Hope it helps someone else!


Requirements are not Satisfied

Describe the bug
Does not satisfy the requirement
To Reproduce
Steps to reproduce the behavior:

PHP 8.0, Laravel 8.x
composer require pragmarx/tracker
Output:
'Problem 1

pragmarx/tracker v4.0.x-dev requires php ^7.0 -> your php version (8.0.6) does not satisfy that requirement.
pragmarx/tracker[v4.0.0, ..., v4.0.1] require doctrine/dbal ^2.6 -> found doctrine/dbal[v2.6.0, ..., 2.13.x-dev] but the package is fixed to 3.1.0 (lock file version) by a partial update and that version does not match. Make sure you list it as an argument for the update command.
Root composer.json requires pragmarx/tracker ^4.0 -> satisfiable by pragmarx/tracker[v4.0.0, v4.0.1, v4.0.x-dev].

Use the option --with-all-dependencies (-W) to allow upgrades, downgrades and removals for packages currently locked to specific versions.'
4. When installing with -W:
'Cloning failed using an ssh key for authentication, enter your GitHub credentials to access private repos
Head to https://github.com/settings/tokens/new?scopes=repo&description=Composer+on+abbasmashaddy72+2021-06-08+1656
to retrieve a token. It will be stored in "/home/abbasmashaddy72/.config/composer/auth.json" for future use by Composer.
Token (hidden):'
Expected behavior
Normal Installations without Errors
Screenshots
No Screen Shots
System

OS: Manjaro Linux
Browser: Chrome
Version: 90.0.4430.212

Additional context
Problem occurred in console with installing

Has anyone solved this issue or found a workaround for it?
In my case, the dependencies for laravel/framework (required: ^5.5, installed: ^8.40) and doctrine/dbal (required: ^2.6, installed: ^3.1) don't seem to be right when trying to install pragmarx/tracker.
When using specific version 4.0.1, only doctrine/dbal dependency is unsolved.

Has anyone solved this issue.. As I am tying to install the package on laravel 8 and getting the exact same issue

Delete your project vendor file
Remove "pragmarx/tracker":^xx line from your composer.json
Remove also the composer.lock file
Run composer i
then run composer require pragmarx/tracker

This worked for me

Solved.
Issue attached

Update your composer with following line
"doctrine/dbal": "^2.6",

composer require pragmarx/tracker -W

Solved.
Issue attached

Update your composer with following line
"doctrine/dbal": "^2.6",

composer require pragmarx/tracker -W

Nice

Laravel 9 and php 8.1 is not supported

Has anyone solved this issue? As I am trying to install the package on laravel 9 and getting the exact same issue


Redshift Data Editor-Editing of Date/Timestamp columns fails

System information:

Operating system (distribution) and version: Windows 10
DBeaver version: 21.1.4

Connection specification:

Database name and version: Redshift 1.0.29551
Driver name: https://s3.amazonaws.com/redshift-downloads/drivers/jdbc/<IP_ADDRESS>9/RedshiftJDBC42-no-awssdk-<IP_ADDRESS>9.jar
Do you use tunnels or proxies (SSH, SOCKS, etc) SSH

Describe the problem you're observing:
Data Editor doesn't work for insert or Update of Date/Timestamp columns in Redshift
Steps to reproduce, if exist:
Create below table
CREATE TABLE IF NOT EXISTS test_all_types
(
c1 SMALLINT   ENCODE az64
,c2 INTEGER   ENCODE az64
,c3 BIGINT   ENCODE az64
,c4 NUMERIC(18,0)   ENCODE az64
,c5 REAL   ENCODE RAW
,c6 DOUBLE PRECISION   ENCODE RAW
,c7 BOOLEAN   ENCODE RAW
,c8 CHAR(1)   ENCODE lzo
,c9 VARCHAR(256)   ENCODE lzo
,c10 DATE   ENCODE az64
,c11 TIMESTAMP WITHOUT TIME ZONE   ENCODE az64
,c12 TIMESTAMP WITH TIME ZONE   ENCODE az64
,c15 TIME WITHOUT TIME ZONE   ENCODE az64
,c16 TIME WITH TIME ZONE   ENCODE az64
,"-c10" VARCHAR(10)   ENCODE lzo
)
DISTSTYLE AUTO
;
Open Data Editor, try to add date/timestamp data. Following error occurs

I was fixing the PostgreDateTimeValueHandler but noticed the Redshift JDBC driver 1.x doesn't work for bind variables with timestamptz. It works for Date, Timestamp but not for timestamptz.
Probably we should have a skip bind value option for data editor too.
@ShadelessFox @serge-rider @LonwoLonwo Thoughts?


Segment silently fails to flush when a subsegment is created with a closed parent

If a subsegment is created where the parent segment has been closed, then the entire trace segment will fail to be flushed.
The underlying reason seems to be that Segment.openSegments becomes negative resulting in Segment.flush ignoring the segment because it will only handle a segment with exactly zero openSegments.
https://github.com/aws/aws-xray-sdk-go/blob/a0604c52d192cc836b6bfbdd7bdde6a1ba579746/xray/segment.go#L506-L507
The current silent loss of the entire trace segment is very surprising and difficult to diagnose.
Example
A more complete test case demonstrates this:
func TestSegment_Close_out_of_order(t *testing.T) {
	ctx, td := NewTestDaemon()
	defer td.Close()
	ctx, seg := BeginSegment(ctx, "test")

	ctxSubSeg1, subSeg1 := BeginSubsegment(ctx, "TestSubsegment1")
	subSeg1.Close(nil) // closed before it is used as a parent
	_, subSeg2 := BeginSubsegment(ctxSubSeg1, "TestSubsegment2")
	subSeg2.Close(nil)

	seg.Close(nil)

	assert.Zero(t, seg.openSegments)
	assert.True(t, seg.Emitted)
}

Currently, this will fail with the following:
=== RUN   TestSegment_Close_out_of_order
2024-03-08T01:31:26+11:00 [INFO] Emitter using address: <IP_ADDRESS>:32794
    segment_test.go:170:
        	Error Trace:	segment_test.go:170
        	Error:      	Should be zero, but was -1
        	Test:       	TestSegment_Close_out_of_order
    segment_test.go:171:
        	Error Trace:	segment_test.go:171
        	Error:      	Should be true
        	Test:       	TestSegment_Close_out_of_order
--- FAIL: TestSegment_Close_out_of_order (0.00s)

I'd be happy to open a PR, but I'm not entirely sure the right course of action.
The Java SDK seems to handle a similar situation with a "NoOp" segment.
Something like the following seems to fix both the test case in the description and the issue I'm seeing in practice:
diff --git a/xray/segment.go b/xray/segment.go
index 4e96b34..f9e1507 100644
--- a/xray/segment.go
+++ b/xray/segment.go
@@ -314,6 +314,9 @@ func BeginSubsegment(ctx context.Context, name string) (context.Context, *Segmen
        if !seg.ParentSegment.Sampled {
                seg.Dummy = true
        }
+       if !seg.parent.InProgress {
+               seg.Dummy = true
+       }

I'm not sure if this is the best way to express this or if it risks hiding the problem.


Added telemetry property to track bots opened via path or url

The bot_open telemetry event will now include a source property that will distinguish bots opened via url to bots opened via path (.bot file).

Coverage increased (+0.002%) to 66.952% when pulling 8d752252c78672932e8b5ee714828dab92ed36a4 on toanzian/telemetry into ffa96e83f58b8d87970448b62d1e8471c630ea25 on master.


Use PssCaptureSnapshot for memory dump

Use PssCaptureSnapshot for the memory dump feature. This API is what the Snapshot Debugger and procdump use to capture fast snapshots without impacting the running process.

@safihamid @puneet-gupta FYI

Looks good overall.  Have we tested with private site extension?   Also check if we have existing tests that need to be improved to cover this.

@suwatch I tested in my own site using DeployPrivateKudu.cmd, if that's what you mean.
There are three unit tests in ProcessApiFacts that have something to do with minidump:

MiniDumpDeleteOnDisposeTests
MiniDumpDeleteOnCloseTests
MiniDumpFreeModeTests
None of them actually tries to dump a process!
I'll see if I can add one that exercises the new code.

I added a unit test. I tested 32-bit already. I'll test 64-bit now.

Once done with 64 bits testing - could you?

Rebase with latest master (you might already have that).
Rebase to single commit if you can.

I will merge this in.  Let me know if you need help for any of these.

I verified that 64-bit snapshot+dump works.

@suwatch rebased and squashed. This is ready to merge.


Add joshua run which does joshua start + joshua tail

It'd be nice to have a single command which can start testing and wait on the results, instead of having to (manually or via scripting) feed the ensemble ID between the two commands.

Yes, this is nice to have. A work around is the following shell script:
j ()
{
    python3 -m joshua.joshua -C path/to/cluster_file "$@"
}

name=`j start --tarball input_dir/correctness.tar.gz | tail -n 1 | awk '{print $1}'` && j tail --errors --xml | tee output_dir/$name.xml


Allow to describe bitfields in a struct template

Not sure how the syntax should look like.
Maybe something like this:
my_struct {
  field_1  const[1, int8] : 4
  field_2  int8 : 4
  field_3  int16 : 3
  field_4  int16[0:20] : 13
}

Please also post here some examples of where it is necessary. E.g. do we need to support consts, flags? Something else?

A couple of examples:
ipv4 header:
http://lxr.free-electrons.com/source/include/uapi/linux/ip.h#L85
https://en.wikipedia.org/wiki/IPv4#Header
ipv6 header:
http://lxr.free-electrons.com/source/include/uapi/linux/ipv6.h#L114
https://en.wikipedia.org/wiki/IPv6_packet#Fixed_header

We probably need to support const, flags and general integers (int8, int16, ...).

Proposed syntax:
my_struct {
  field_1  const[1, bitfield[int8, 4]]
  field_2  bitfield[int8, 4]
  field_3  len[parent, bitfield[int16, 3]]
  field_4  bitfield[int16[0:4242], 13]
}


Add herschel_get_spec functionality to spectroscopy notebook

This new module downloads and extracts "reduced" Herschel spectroscopy for a set of sources.  It is completely functional, but not perfect.  Description of imperfections (with short rants included) below:

Some decisions had to be made as this is a complicated dataset with complicated sets of rules about when a final spectrum is generated and which fluxes of the many reported are the best to use for any given target.

only observations which produce a HPSSPEC directory are considered.  There seems to be no way to ascertain this in the archive search, so the code downloads all tar files for all observations and then checks to see if this directory exists.

source resolution matters, ie., recommendations for which reduced spectrum to use are based on wether or not it is a point source or how extended it is. I have followed the advice in https://www.cosmos.esa.int/documents/12133/996891/Product+decision+trees to use the flux column which has the largest sum.  It is beyond the scope of this notebook to calculate if the sources is extended in Herschel band or not.

The Herschel directory tree in the downloaded tar files is extensive, and there is no way to customize and only download the one file that I need, so there is a lot of code around tracking filenames and paths and searching paths for filenames.

The Herschel archive breaks the connection at some point (testing on Arp220 which has many observations > 50, will hit this error).  I cannot for the life of me figure out how to catch the specific exceptions, and have spent too long trying to do this. So I know that blanket exceptions are not good practice, but they are the only way I know how to get this to work.  I have opened an issue on this  both here (#282 ) and at astroquery (to try to fix this at the source).

I have written into the function an option to delete tar files after the spectrum is extracted.

I re-numbered the sections to account for the fact that Herschel data is being accessed through the ESA archive and not IRSA as was originally suggested in the outline.  The use of astroquery's ESA module  made this module possible in an automated fashion from python, so it is not possible to switch to IRSA.  IRSA only houses an API (which may even just access the ESA API???).

It works with the plotting function before Andreas's newest PR #281 , but probably needs to be checked for compatibility with new function.   I have opened an issue for this (#283 ).

Works. The only problem is that it takes ages (meaning hours) to get the Herschel data for only 5 sources.


OData implementation is not complete

Please complete the OData Implementation in the Open Manage API. It currently doesn't support $select, $expand, and other features, which would make the API calls smaller and faster. I would like to be able to access Devices/InventoryDetails without having to specify a device_id.

This is a side project of mine and not a fully supported by the OpenManage team. I will relay this FR onto them but I wouldn't set your expectations too high on ever seeing this feature added to the OME API.


Vending machine code needs splitting out

It has dozens of fields when it should be 3+ components.
The base one should just handle UI interactions and the others should handle shooting items and the likes instead of padding the component even more.

Hi. Did it in #17767


Unit Test Failure: testReadWrite(com.marklogic.client.test.BinaryDocumentTest

Asserts:
Binary range read wrong number of bytes expected:<10> but was:<11>

this is a dup of #99


Configurable Rest Collection Filters

Hi ,
I wonder, in apigility is there a way to configure filters that to be injected
into your rest collection based on configuration ?
At the moment I'm doing it programmatically like
public function fetchAll($criteria = [])
 {
     /** @var Paginator $paginator */
     $paginator = parent::fetchAll($criteria);

     $paginator->setFilter(
         $this->getServiceLocator()->get(PasswordCollectionFilter::class)
     );

     return $paginator;
 }

This filter injection can be done by configuration , smth like :
'zf-rest' => array(
 'Some\\Controller' => array(
    other configs ...
    'collection_class' => 'Some\\KerioEmailsCollection',
    'collection_filters' => [
          ExampleFilterCapitalLetters,
          AnotherExampleFilter
      ]
    other configs ..
)

There is, but not the way you're doing it!
First off, all filters are configured via the filters configuration key, which itself follows the semantics of a service manager: it has subkeys for services, aliases, invokables, factories, etc. You access filters via the Zend\Filter\FilterPluginManager, which is stored as the service FilterManager. In your example above, you'd do the following instead:
// This line:
$this->getServiceLocator()->get(PasswordCollectionFilter::class)

// becomes:
$this->getServiceLocator()->get('FilterManager')->get(PasswordCollectionFilter::class)

However, I don't recommend that! We have deprecated the usage of the ServiceLocatorAwareInterface, and, if you upgrade to the latest zend-mvc versions, it's not available at all! There's a good reason for that: pulling dependencies from the service locator is a form of dependency hiding, and makes understanding the requirements for a class harder to determine, and harder to test.
Instead, update your resource class to instead accept the filter(s) you want via its constructor, and then update the factory for your resource class to inject it. This allows you then to use any configuration scheme you want. As an example, based on your examples above:
<?php
// Your resource class would accept a filter to the constructor:
use Zend\Filter\FilterInterface;

class SomeResource extends AbstractResource
{
    private $filter;

    public function __construct(FilterInterface $filter)
    {
        $this->filter = $filter;
    }

    /* ... */

    public function fetchAll($criteria = [])
    {
        /** @var Paginator $paginator */
        $paginator = parent::fetchAll($criteria);
        $paginator->setFilter($this->filter);
        return $paginator;
    }

    /* ... */
}

// Your factory would inject the filter:
use Zend\Filter\FilterChain;

class SomeResourceFactory
{
    public function __invoke(ContainerInterface $container)
    {
        $config = $container->get('config');
        $filters = $config['zf-rest'][Some\\Controller::class]['collection_filters'];

        $chain = new FilterChain();
        $chain->setPluginManager($container->get('FilterManager'));
        array_walk($filters, function ($filter) use ($chain) {
            $chain->attachByName($filter);
        });

        return new SomeResource($chain);
    }
}

Is that means that currently Apigility haven't native support for filters injection into the resource-collection based on zf-rest configs?

Is that means that currently Apigility haven't native support for filters injection into the resource-collection based on zf-rest configs?

Yes; this has never been supported, other than via the zf-doctrine-querybuilder-filter, which only works for Doctrine-connected services, and is highly specific to how the ORM supports querying data.
Additionally, your code $paginator->setFilter() is non-standard; zend-paginator instances do not have filters, nor do our shipped Collection classes.
My point is: you are talking about application-specific features. Apigility can accommodate these features, but you need to write such functionality yourself. One way you can accomplish it is to write your own base Resource class that overrides fetchAll(), your own base Collection class that allows injection of a filter, and use either initializers or delegator factories to inject the filters into these resources.

https://github.com/zendframework/zend-paginator/blob/master/src/Paginator.php (486)

This repository has been closed and moved to laminas-api-tools/api-tools; a new issue has been opened at https://github.com/laminas-api-tools/api-tools/issues/3.