CUDA out of memory in GPU 0, when training in GPU different to 0

Thanks for your error report and we appreciate it a lot.
Checklist

I have searched related issues but cannot get the expected help.
The bug has not been fixed in the latest version.

Describe the bug
I choose any GPU different to 0, by exporting CUDA_VISIBLE_DEVICES and when I see the output of nvidia-smi it shows up that the process is starting to run on that GPU, but when the training is going to start, it tells that the GPU 0 is out of memory (because there is already a training in GPU 0). So when the GPU 0 is busy, I can't train in any other GPU because of this.
Reproduction

What command or script did you run?

export CUDA_VISIBLE_DEVICES=1
python tools/train.py .../configs/cascade.py --work-dir .../work_dirs/

Did you make any modifications on the code or config? Did you understand what you have modified?
I didn't modify the code. I modified the configs, but some minor changes and, yes, I understand what I modified.

What dataset did you use?
I use a CocoDataset with custom classes.

Environment

Please run python mmdet/utils/collect_env.py to collect necessary environment infomation and paste it here.

sys.platform: linux
Python: 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21) [GCC 7.3.0]
CUDA available: True
CUDA_HOME: /usr/local/cuda
NVCC: Cuda compilation tools, release 10.1, V10.1.105
GPU 0: GeForce GTX 1080 Ti
GCC: gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
PyTorch: 1.4.0
PyTorch compiling details: PyTorch built with:
  - GCC 7.3
  - Intel(R) Math Kernel Library Version 2020.0.1 Product Build 20200208 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v0.21.1 (Git Hash 7d2fd500bc78936d1d648ca713b901012f470dbc)
  - OpenMP 201511 (a.k.a. OpenMP 4.5)
  - NNPACK is enabled
  - CUDA Runtime 10.0
  - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_37,code=compute_37
  - CuDNN 7.6.3
  - Magma 2.5.1
  - Build settings: BLAS=MKL, BUILD_NAMEDTENSOR=OFF, BUILD_TYPE=Release, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -fopenmp -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Wno-stringop-overflow, DISABLE_NUMA=1, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, USE_CUDA=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_STATIC_DISPATCH=OFF,

TorchVision: 0.5.0
OpenCV: 4.2.0
MMCV: 0.5.9
MMDetection: 2.0.0+c77ccbb
MMDetection Compiler: GCC 7.5
MMDetection CUDA Compiler: 10.1

You may add addition that may be helpful for locating the problem, such as

How you installed PyTorch [e.g., pip, conda, source]
I have installed with conda, following the instructions of INSTALL.md
Other environment variables that may be related (such as $PATH, $LD_LIBRARY_PATH, $PYTHONPATH, etc.)

Error traceback
If applicable, paste the error trackback here.
2020-06-09 08:54:15.283 | ERROR    | __main__:<module>:211 - An error has been caught in function '<module>', process 'MainProcess' (3645), thread 'MainThread'<PHONE_NUMBER>77760):
Traceback (most recent call last):

> File "stages/run_experiment_mlflow.py", line 211, in <module>
    main()
  File "stages/run_experiment_mlflow.py", line 207, in main
    fire.Fire(run_experiment_mlflow)
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
                      │     │          │     │                 │        └ 'run_experiment_mlflow.py'
                      │     │          │     │                 └ {}
                      │     │          │     └ Namespace(completion=None, help=False, interactive=False, separator='-', trace=False, verbose=False)
           │         └ <attribute '__name__' of 'function' objects>
           └ <function run_experiment_mlflow at 0x7f63fde316a8>
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/fire/core.py", line 672, in _CallAndUpdateTrace
  File "stages/run_experiment_mlflow.py", line 161, in run_experiment_mlflow
    meta=meta)
         └ {'env_info': 'sys.platform: linux\nPython: 3.6.10 |Anaconda, Inc.| (default, May  8 2020, 02:54:21) [GCC 7.3.0]\nCUDA availab...

    │      │   └ [<torch.utils.data.dataloader.DataLoader object at 0x7f644c059940>]
    │      └ <function Runner.run at 0x7f6463f3f400>
    └ <mmcv.runner.runner.Runner object at 0x7f644c0599b0>
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmcv/runner/runner.py", line 384, in run
    epoch_runner(data_loaders[i], **kwargs)
    │            │            │     └ {}
    │            └ [<torch.utils.data.dataloader.DataLoader object at 0x7f644c059940>]
    └ <bound method Runner.train of <mmcv.runner.runner.Runner object at 0x7f644c0599b0>>
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmcv/runner/runner.py", line 283, in train
    self.model, data_batch, train_mode=True, **kwargs)
    │    │      │                              └ {}
    │    │      └ {'img_metas': DataContainer([[{'filename': '/media/VA/databases/DRONE_VS_BIRD/crops/DroneVsBird_train_SAMPLED_0.1_CROPS_720/i...
    └ <mmcv.runner.runner.Runner object at 0x7f644c0599b0>
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmdet/apis/train.py", line 74, in batch_processor
    losses = model(**data)
             │       └ {'img_metas': DataContainer([[{'filename': '/media/VA/databases/DRONE_VS_BIRD/crops/DroneVsBird_train_SAMPLED_0.1_CROPS_720/i...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
             │    │        │        └ {'img_metas': DataContainer([[{'filename': '/media/VA/databases/DRONE_VS_BIRD/crops/DroneVsBird_train_SAMPLED_0.1_CROPS_720/i...
                   (backbone): ResNeXt(
                     (conv1): Conv2d(3, 64, kernel_size=(7, 7), stride=(2,...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/parallel/data_parallel.py", line 150, in forward
    return self.module(*inputs[0], **kwargs[0])
           │            │            └ ({'img_metas': [{'filename': '/media/VA/databases/DRONE_VS_BIRD/crops/DroneVsBird_train_SAMPLED_0.1_CROPS_720/images/00_09_30...
                   (conv1): Conv2d(3, 64, kernel_size=(7, 7), stride=(2,...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
             │    │        │        └ {'img_metas': [{'filename': '/media/VA/databases/DRONE_VS_BIRD/crops/DroneVsBird_train_SAMPLED_0.1_CROPS_720/images/00_09_30_...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmdet/core/fp16/decorators.py", line 49, in new_func
    return old_func(*args, **kwargs)
           │         │       └ {'img_metas': [{'filename': '/media/VA/databases/DRONE_VS_BIRD/crops/DroneVsBird_train_SAMPLED_0.1_CROPS_720/images/00_09_30_...
           │         └ (CascadeRCNN(
           │             (backbone): ResNeXt(
           │               (conv1): Conv2d(3, 64, kernel_size=(7, 7), stride=(2, 2), padding=(3, 3), bias=False...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmdet/models/detectors/base.py", line 148, in forward
           │    │             └ tensor([[[[ 0.7591,  0.7591,  0.7419,  ..., -2.1179, -2.1179, -2.1179],
           │    │                         [ 0.7591,  0.7591,  0.7419,  ..., -2.1179, ...
           │    └ <function TwoStageDetector.forward_train at 0x7f640086bea0>
    x = self.extract_feat(img)
        │    │            └ tensor([[[[ 0.7591,  0.7591,  0.7419,  ..., -2.1179, -2.1179, -2.1179],
        │    │                        [ 0.7591,  0.7591,  0.7419,  ..., -2.1179, ...
        │    └ <function TwoStageDetector.extract_feat at 0x7f640086bd90>
        └ CascadeRCNN(
        │             └ tensor([[[[ 0.7591,  0.7591,  0.7419,  ..., -2.1179, -2.1179, -2.1179],
        │                         [ 0.7591,  0.7591,  0.7419,  ..., -2.1179, ...
        └ CascadeRCNN(
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
             │    │        │        └ {}
             │    │        └ (tensor([[[[ 0.7591,  0.7591,  0.7419,  ..., -2.1179, -2.1179, -2.1179],
             │    │                    [ 0.7591,  0.7591,  0.7419,  ..., -2.1179,...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmdet/models/backbones/resnet.py", line 601, in forward
    x = res_layer(x)
        │         └ tensor([[[[0.0000e+00, 0.0000e+00, 0.0000e+00,  ..., 0.0000e+00,
        │                      0.0000e+00, 0.0000e+00],
        │                     [0.0000e+00, 0...
        └ ResLayer(
              (bn1): BatchN...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
             │    │                     0.0000e+00, 0.0000e+00],
             │    │                    [0.0000e+00, ...
             │    └ <function Sequential.forward at 0x7f648a31fb70>
             └ ResLayer(
                 (0): Bottleneck(
                   (conv1): Conv2d(1024, 1024, kernel_size=(1, 1), stride=(1, 1), bias=False)
                   (bn1): BatchN...
            │      └ tensor([[[[0.9162, 1.3605, 1.4720,  ..., 0.9338, 1.0213, 1.5810],
            │                  [0.4824, 0.0918, 0.1627,  ..., 0.0000, 0.0462, 0....
            └ Bottleneck(
                (conv1): Conv2d(2048, 1024, kernel_size=(1, 1), stride=(1, 1), bias=False)
                (bn1): BatchNorm2d(1024, eps=1e-05...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
             │    │        │        └ {}
             │    │        └ (tensor([[[[0.9162, 1.3605, 1.4720,  ..., 0.9338, 1.0213, 1.5810],
             │    │                    [0.4824, 0.0918, 0.1627,  ..., 0.0000, 0.0462, 0...
             │    └ <function Bottleneck.forward at 0x7f6400d616a8>
             └ Bottleneck(
                 (conv1): Conv2d(2048, 1024, kernel_size=(1, 1), stride=(1, 1), bias=False)
                 (bn1): BatchNorm2d(1024, eps=1e-05...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmdet/models/backbones/resnet.py", line 280, in forward
    out = _inner_forward(x)
          │              └ tensor([[[[0.9162, 1.3605, 1.4720,  ..., 0.9338, 1.0213, 1.5810],
          │                          [0.4824, 0.0918, 0.1627,  ..., 0.0000, 0.0462, 0....
          └ <function Bottleneck.forward.<locals>._inner_forward at 0x7f6453a82598>
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/mmdet/models/backbones/resnet.py", line 258, in _inner_forward
    out = self.norm2(out)
          │    │     └ tensor([[[[-7.8127e-03, -8.7999e-03, -8.6583e-03,  ..., -7.1499e-03,
          │    │                  -7.6180e-03, -4.3470e-03],
          │    │                 [-7.3230...
          │    └ <property object at 0x7f6400d55db8>
          └ Bottleneck(
              (conv1): Conv2d(2048, 1024, kernel_size=(1, 1), stride=(1, 1), bias=False)
              (bn1): BatchNorm2d(1024, eps=1e-05...
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
             │    │        │        └ {}
             │    │        └ (tensor([[[[-7.8127e-03, -8.7999e-03, -8.6583e-03,  ..., -7.1499e-03,
             │    │                     -7.6180e-03, -4.3470e-03],
             │    │                    [-7.323...
             │    └ <function _BatchNorm.forward at 0x7f648a2ed620>
             └ BatchNorm2d(1024, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/modules/batchnorm.py", line 107, in forward
    exponential_average_factor, self.eps)
    │                           │    └ 1e-05
    │                           └ BatchNorm2d(1024, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    └ 0.1
  File "/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/nn/functional.py", line 1670, in batch_norm
    training, momentum, eps, torch.backends.cudnn.enabled
    │         │         │    │     │        │     └ <torch.backends.ContextProp object at 0x7f648a2369e8>
    │         │         │    │     │        └ <module 'torch.backends.cudnn' from '/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-...
    │         │         │    │     └ <module 'torch.backends' from '/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packag...
    │         │         │    └ <module 'torch' from '/opt/miniconda3/envs/mlflow-185b9c781ffde5765f6a22a12949cf7cfa347af5/lib/python3.6/site-packages/torch/...
    │         │         └ 1e-05
    │         └ 0.1
    └ False

RuntimeError: CUDA out of memory. Tried to allocate 18.00 MiB (GPU 0; 10.76 GiB total capacity; 9.81 GiB already allocated; 19.12 MiB free; 9.96 GiB reserved in total by PyTorch)

Bug fix
If you have already identified the reason, you can provide the information here. If you are willing to create a PR to fix it, please also leave a comment here and that would be much appreciated!
I haven't identified the reason, but if you can give me some hints about what the problem could be, I would be glad to help and send a PR if I can fix it.

Sorry. I think it's my fault. Although it says GPU 0 is out of memory, it looks like it is talking about the correct GPU. So with a lower batch size this error goes away. I close this issue, because it is not a bug.

HI @igonro  how did you change the batch size. Cant find an option to do that in the config file.


closure size: protobuf depends on C++ compiler

Describe the bug
Look at nixpkgs.protobuf:
$ nix-env -iA nixpkgs.protobuf
installing 'protobuf-3.7.1'
these paths will be fetched (2.14 MiB download, 17.78 MiB unpacked):
  /nix/store/mdybbfzbpdidmw95kj4r7z0cizrr3lfl-protobuf-3.7.1

How big is the closure? 700 MB
$ nix path-info -S /nix/store/mdybbfzbpdidmw95kj4r7z0cizrr3lfl-protobuf-3.7.1
/nix/store/mdybbfzbpdidmw95kj4r7z0cizrr3lfl-protobuf-3.7.1	  726819112

Why? Because it depends on clang (on macOS, at least)
$ nix why-depends /nix/store/mdybbfzbpdidmw95kj4r7z0cizrr3lfl-protobuf-3.7.1 /nix/store/h73a7xhf6l517dnk2sw0b4q64jbmaijn-clang-7.1.0

/nix/store/mdybbfzbpdidmw95kj4r7z0cizrr3lfl-protobuf-3.7.1
╚═══lib/libprotobuf.a: …:..................../nix/store/1vnw05l6bz30whmiang9i3156c064y7d
    => /nix/store/1vnw05l6bz30whmiang9i3156c064y7d-clang-wrapper-7.1.0
    ╚═══bin/clang: …k disable=SC2193.[[ "/nix/store/h73a7xhf6l517dnk2sw0b4q64jbmaijn-cla
        => /nix/store/h73a7xhf6l517dnk2sw0b4q64jbmaijn-clang-7.1.0

Metadata
 - system: `"x86_64-darwin"`
 - host os: `Darwin 18.7.0, macOS 10.14.6`
 - multi-user?: `no`
 - sandbox: `no`
 - version: `nix-env (Nix) 2.1.2`
 - channels(yom): `"nixpkgs-20.03pre200237.561b40dacbf"`
 - nixpkgs: `/Users/yom/.nix-defexpr/channels/nixpkgs`

The problem is most likely with -g being passed to clang, not sure where it happens though.

My solution:
# https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/libraries/protobuf/generic-v3.nix

  postConfigure = ''
    sed -i -e 's/ -g / /g' Makefile src/Makefile gmock/make/Makefile googletest/make/Makefile
  '';

Seems hacky.

It seems like upstream also doesn't want to use "-g":
https://github.com/protocolbuffers/protobuf/blob/a9f390f44e3d138e1e94fd17046f865517b3b62d/configure.ac#L39-L44
Must be a bug somewhere?

I also don't get why strip doesn't strip away the strings -g adds.

Hey all, on my system, I have protobuf in my store and:
$ nix-store -q --references /nix/store/n5h11njhx44x4hrl8zy4gbyq6z05i4sm-protobuf-3.7.1/ /nix/store/n687v0mblbkk0qi4lnw0vzbn01p5z2ln-protobuf-3.8.0/
/nix/store/an6bdv4phxsz14q2sk57iscl2dc7bnj1-glibc-2.30
/nix/store/jy89v2q2zv074mvw91jgqcvkmk7yqx69-gcc-9.3.0-lib
/nix/store/zsr1dksfh97yvb49k3rni00q5lppd9pd-zlib-1.2.11
/nix/store/n5h11njhx44x4hrl8zy4gbyq6z05i4sm-protobuf-3.7.1
/nix/store/n687v0mblbkk0qi4lnw0vzbn01p5z2ln-protobuf-3.8.0

gcc-lib is there but I don't think that's as bad as having clang there right?

I would very much like to NOT disable -g builds, which would make dontStrip surprisingly not work.
I have had various protobuf related crashes, and using dontStrip helps to quickly investigate that in production (especially due to protobufs reliance on 32-bit ints that can silently overflow and corrupt data, see https://github.com/protocolbuffers/protobuf/issues/5285 and https://github.com/google/proto-lens/issues/249). Making dontStrip work only sometimes would be detrimental in my opinion.
Alternative suggestion:
Both the issue description and @doronbehar's post above suggest that this problem exists only on Darwin, and that on Linux the closure is not big. Could we make this change a Darwin-only workaroud?

For completeness of linking issues, https://github.com/protocolbuffers/protobuf/issues/6941#issuecomment-611653149 suggests that upstream is not quite sure which flags they want.

The last time I checked, on Linux it included gcc, which was pretty bad too (130 MB): https://github.com/juspay/fencer/issues/31#issuecomment-535979923. Perhaps it's fixed now.

This said, "Making dontStrip work only sometimes" might be bad. Is there any other way to remove those -g-inserted paths without removing any other useful information added by -g?

The last time I checked, on Linux it included gcc, which was pretty bad too (130 MB):

That seems to be fixed now:
$ nix path-info -Sh $(nix-store -q --references /nix/store/rmwda8bcsjaim9ng68siavp0scx9ipkv-protobuf-3.7.1)
/nix/store/5zzgkw8f7p4514bbmr018fyyyvpd46kp-gcc-9.2.0-lib 	  32.8M
/nix/store/a3q9zl42d0hmgwmgzwkxi5qd88055fh8-zlib-1.2.11   	  27.0M
/nix/store/aag9d1y4wcddzzrpfmfp9lcmc7skd7jk-glibc-2.27    	  26.8M
# together
/nix/store/rmwda8bcsjaim9ng68siavp0scx9ipkv-protobuf-3.7.1	  56.7M

Only depends on gcc-lib, not gcc.

Needs update from @neongreen whether based on the findings above, it'd be acceptable for him to make this change Darwin-only.

I don't mind it being a Darwin-only workaround if it's not an issue on Linux anymore.

It's not:
$ nix-store --query --references /nix/store/p4dcl742wd5hf0dkjqbzh4h8bjx7dx00-protobuf-3.13.0/
/nix/store/9df65igwjmf2wbw0gbrrgair6piqjgmi-glibc-2.31
/nix/store/9sfmwj09ij65qnc8dgv8h56gf12b60nn-zlib-1.2.11
/nix/store/vran8acwir59772hj4vscr7zribvp7l5-gcc-9.3.0-lib
/nix/store/p4dcl742wd5hf0dkjqbzh4h8bjx7dx00-protobuf-3.13.0


[WIP] Navigation

Issue #168
Large changes, but this works - up until this point. Much more work to do...

[!TIP]
You will want to use squash and merge for this

Aren't you changing too many things yet again 😅 ?


Do you want to apply a CS ruleset in this repo?

Usually CakePHP plugins comply to the CS ruleset of https://github.com/cakephp/cakephp-codesniffer which is the same as a normal CakePHP app.
This can then of course be checked inside Github CI as well so that any incoming PR will comply to this as well.

yes, it would be good.
Will you add this to the workflow?

Then I will prepare this for you, yes


acorn login succeeds even when invalid credentials are used to login to private registry.

acorn version v0.7.0-alpha1-49-gf5e99d78+f5e99d78
Steps to reproduce the problem:
Stand up a private registry with auth enabled.
acorn login succeeds when invalid credentials are passed to it.
 acorn login <registry url>
? Username ss
? Password **
  ✔  Login to <registry url> as ss succeeded

 % acorn login <registry url>
? Username f4zk2pnd
? Password ****
  ✔  Login to<registry url>as f4zk2pnd succeeded

 % docker login <registry url>
Username: ss
Password:
login attempt to <registry url>/v2/ failed with status: 401 Unauthorized

Is this the case for docker.io and ghcr.io or just registries you standup yourself?

This is only in the case of registries that i create . docker.io and ghcr.io work as expected.

Low priority. moving out


Private pages are returning empty objects, even with Authorization Header, and user token.

Hey, this could just be a user error, but I've tried both approaches and can't get private pages to return any BlockMap from the Splitbee Notion worker, or a personal worker that I spun up.
Personal Worker:
I created the notion worker from a local clone and uploaded it to CloudFlare:

And this is what comes back when I search a private page

This is what that said paid looks like in Notion:

I got the token from the cookie in notion it's key was "token_v2" so I'm pretty sure I grabbed the right thing.
Please let me know if I'm doing something wrong. Thanks.

Oh also in my app, I'm trying this approach:

And still getting this:

same issue here.

You need to take the cookie as noted in the read me. Here is how to view cookies.
Also just so you know, images don't seem to be working on private pages.


Ion-input android bug

Ionic version:  (check one with "x")
[ ] 1.x
[x ] 2.x
I'm submitting a ...  (check one with "x")
[x ] bug report
[ ] feature request
[ ] support request => Please do not submit support requests here, use one of these channels: https://forum.ionicframework.com/ or http://ionicworldwide.herokuapp.com/
Current behavior:
I want my content to be centered and in my page html I have
<ion-content padding>
  <ion-item>
  <ion-input type="text"></ion-input>
  </ion-item>
</ion-content>

and in sccs
.scroll-content {
background-color: #737486;
align-items: center;
display: flex;
flex-direction: column;
justify-content: center;
}

On windows an ios everything seems to be working fine, but on Android (browser simulation, and actual device) when ion-input is focused everything goes to the top of the screen and sometimes everything disappears.
Expected behavior:
It should behave the same on android as in other platforms.
Steps to reproduce:
page html
<ion-content padding>
  <ion-item>
  <ion-input type="text"></ion-input>
  </ion-item>
</ion-content>

and in sccs
.scroll-content {
background-color: #737486;
align-items: center;
display: flex;
flex-direction: column;
justify-content: center;
}

Then tap on input and it should move to the top of the screen.
Related code:
insert any relevant code here

Other information:

Ionic info: (run ionic info from a terminal/cmd prompt and paste output below):
insert the output from ionic info here

Thanks for opening an issue, we will look into this.


"databricks.sql.exc.RequestError: Error during request to server" with versions 2.6 onwards

When running the quickstart example, I get errors initializing the connection unless I downgrade the package version to 2.5 .
With version 2.6 and above
Error Trace:
$ python example.py
Traceback (most recent call last):
  File "C:\Users\<username>\Databricks_SQL\example.py", line 8, in <module>
    connection = sql.connect(
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv_2\lib\site-packages\databricks\sql\__init__.py", line 50, in connect
    return Connection(server_hostname, http_path, access_token, **kwargs)
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv_2\lib\site-packages\databricks\sql\client.py", line 189, in __init__
    self._session_handle = self.thrift_backend.open_session(
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv_2\lib\site-packages\databricks\sql\thrift_backend.py", line 469, in open_session
    response = self.make_request(self._client.OpenSession, open_session_req)
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv_2\lib\site-packages\databricks\sql\thrift_backend.py", line 398, in make_request
    self._handle_request_error(error_info, attempt, elapsed)
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv_2\lib\site-packages\databricks\sql\thrift_backend.py", line 262, in _handle_request_error
    raise network_request_error
databricks.sql.exc.RequestError: Error during request to server

With downgraded version 2.5
Code works as expected
$ python example.py
Row(id=0)
Row(id=1)
Row(id=2)
Row(id=3)
Row(id=4)
Row(id=5)
Row(id=6)
Row(id=7)
Row(id=8)
Row(id=9)

Environment
It's a pretty standard environment, but for reproducibility:
OS - Windows 10
conda.yml:
name: databrickssqlenv

dependencies:
  - python=3.10
  - pip
  - pip:
    - databricks-sql-connector

Fix
Is there a known fix for this issue? I'd like to use the latest version to enable features such as Azure OAuth.
Thanks

Sorry for the late response here. I'm not able to reproduce this running any version since 2.5.0. The error you shared doesn't give much detail but I suspect it's a 404 of some kind, rather than a problem with the connector code.
If you add this snippet to the quickstart example you will see the precise logging output from databricks-sql-connector which should give you a better sense of what is wrong:
import logging, sys

logging.getLogger("databricks.sql").setLevel(logging.DEBUG)
logging.getLogger("databricks.sql").addHandler(logging.StreamHandler(sys.stdout))

For example, when I run the quickstart script with this snippet enabled I see the following in my console with connector version 2.7.0
retry parameter: _retry_delay_min given_or_default 1.0
retry parameter: _retry_delay_max given_or_default 60.0
retry parameter: _retry_stop_after_attempts_count given_or_default 30
retry parameter: _retry_stop_after_attempts_duration given_or_default 900.0
retry parameter: _retry_delay_default given_or_default 5.0
Sending request: OpenSession(<REDACTED>)
Received response: TOpenSessionResp(<REDACTED>)
Successfully opened session 01ee1f8b-7630-1b37-a3f6-f498f13b4c43
Sending request: ExecuteStatement(<REDACTED>)
Received response: TExecuteStatementResp(<REDACTED>)
Row(id=0)
Row(id=1)
Row(id=2)
Row(id=3)
Row(id=4)
Row(id=5)
Row(id=6)
Row(id=7)
Row(id=8)
Row(id=9)
Closing session 01ee1f8b-7630-1b37-a3f6-f498f13b4c43
Sending request: CloseSession(<REDACTED>)
Received response: TCloseSessionResp(<REDACTED>)

I'm closing this for now but feel free to reopen if the issue persists.

Hi, thanks for your response.
I've reran the code with the logging and the exact error is still pretty opaque when using 2.7.0 :
$ python example.py
retry parameter: _retry_delay_min given_or_default 1.0
retry parameter: _retry_delay_max given_or_default 60.0
retry parameter: _retry_stop_after_attempts_count given_or_default 30
retry parameter: _retry_stop_after_attempts_duration given_or_default 900.0
retry parameter: _retry_delay_default given_or_default 5.0
Sending request: OpenSession(<REDACTED>)
Error during request to server: {"method": "OpenSession", "session-id": null, "query-id": null, "http-code": 400, "error-message": "", "original-exception": "", "no-retry-reason": "non-retryable error", "bounded-retry-delay": null, "attempt": "1/30", "elapsed-seconds": "0.7410027980804443/900.0"}
Traceback (most recent call last):
  File "example.py", line 14, in <module>
    connection = sql.connect(
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv\lib\site-packages\databricks\sql\__init__.py", line 50, in connect
    return Connection(server_hostname, http_path, access_token, **kwargs)
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv\lib\site-packages\databricks\sql\client.py", line 189, in __init__
    self._session_handle = self.thrift_backend.open_session(
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv\lib\site-packages\databricks\sql\thrift_backend.py", line 506, in open_session
    response = self.make_request(self._client.OpenSession, open_session_req)
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv\lib\site-packages\databricks\sql\thrift_backend.py", line 435, in make_request
    self._handle_request_error(error_info, attempt, elapsed)
  File "C:\Users\<username>\AppData\Local\anaconda3\envs\databrickssqlenv\lib\site-packages\databricks\sql\thrift_backend.py", line 275, in _handle_request_error
    raise network_request_error
databricks.sql.exc.RequestError: Error during request to server

If it is a 404 - can you advice on how I can debug this further?
Thanks

I've just read the 2.6.0 release notes, https://github.com/databricks/databricks-sql-python/releases/tag/v2.6.0:
"Note: support for proxies is un-tested in this release. Please report any problems with proxies via GitHub issues.".
I'm running this code on a VM, using a proxy so I suspect this might be the root cause of this issue as version 2.5 still works for me.
Reopening the issue as I'm still having errors, and you've asked for this in the release notes : )

I've installed that version, and now the code works as expected : )
$ python example.py
retry parameter: _retry_delay_min given_or_default 1.0
retry parameter: _retry_delay_max given_or_default 60.0
retry parameter: _retry_stop_after_attempts_count given_or_default 30
retry parameter: _retry_stop_after_attempts_duration given_or_default 900.0
retry parameter: _retry_delay_default given_or_default 5.0
Sending request: OpenSession(<REDACTED>)
Received response: TOpenSessionResp(<REDACTED>)
Successfully opened session 01ee217e-2411-1c7c-b151-0204a9ed5827
Sending request: ExecuteStatement(<REDACTED>)
Received response: TExecuteStatementResp(<REDACTED>)
Sending request: GetOperationStatus(<REDACTED>)
Received response: TGetOperationStatusResp(<REDACTED>)
Sending request: GetOperationStatus(<REDACTED>)
Received response: TGetOperationStatusResp(<REDACTED>)
Sending request: GetResultSetMetadata(<REDACTED>)
Received response: TGetResultSetMetadataResp(<REDACTED>)
Sending request: FetchResults(<REDACTED>)
Received response: TFetchResultsResp(<REDACTED>)
Row(id=0)
Row(id=1)
Row(id=2)
Row(id=3)
Row(id=4)
Row(id=5)
Row(id=6)
Row(id=7)
Row(id=8)
Row(id=9)
Sending request: CloseOperation(<REDACTED>)
Received response: TCloseOperationResp(<REDACTED>)
Closing session 01ee217e-2411-1c7c-b151-0204a9ed5827
Sending request: CloseSession(<REDACTED>)
Received response: TCloseSessionResp(<REDACTED>)

I'm happy to reclose this issue, looks like it was a proxy issue after all!
Thanks for your help, I look forward to the release next week : )


i18n(fr): update reference/configuration

Description
This PR updates the French version of the reference/configuration page with the changes of #1874.

Lunaria Status Overview
🌕 This pull request will trigger status changes.

Learn more
By default, every PR changing files present in the Lunaria configuration's files property will be considered and trigger status changes accordingly.
You can change this by adding one of the keywords present in the ignoreKeywords property in your Lunaria configuration file in the PR's title (ignoring all files) or by including a tracker directive in the merged commit's description.

Tracked Files

Locale
File
Note

fr
reference/configuration.mdx
Localization changed, will be marked as complete.

Warnings reference

Icon
Description

🔄
The source for this localization has been updated since the creation of this pull request, make sure all changes in the source have been applied.


[✨] complex form should not flatten errors

Is your feature request related to a problem?
We have a complex Zod Type for cart.
If an error occurs in one of the fields at the lowest level like:
cart.invoiceAddress.firstName

The errors are flatten within cart:
invoiceAddress: string[]

Example multiple fields:
{
  "invoiceAddress": [
    "String must contain at least 2 character(s)",
    "String must contain at least 2 character(s)",
    "String must contain at least 2 character(s)",
    "String must contain at least 1 character(s)",
    "String must contain at least 2 character(s)",
    "String must contain at least 2 character(s)",
  ]
}[]

 {
    code: 'too_small',
    minimum: 2,
    type: 'string',
    inclusive: true,
    exact: false,
    message: 'String must contain at least 2 character(s)',
    path: [ 'invoiceAddress', 'street' ]
  },
  {
    code: 'too_small',
    minimum: 1,
    type: 'string',
    inclusive: true,
    exact: false,
    message: 'String must contain at least 1 character(s)',
    path: [ 'invoiceAddress', 'streetNumber' ]
  },
  {
    code: 'too_small',
    minimum: 2,
    type: 'string',
    inclusive: true,
    exact: false,
    message: 'String must contain at least 2 character(s)',
    path: [ 'invoiceAddress', 'zip' ]
  },

SEE: #4634
Describe the solution you'd like
We need to access the specific fields with the path.
action.fieldErrors.cart.invoiceAddress.firstName
// or
action.fieldErrors.get('cart.invoiceAddress.firstName)

Describe alternatives you've considered
We either have to overwrite the types so that the errors are not flattened for complex forms or we send the errors unflattened in a second field.
Additional context
No response

@ulic75 I created an issue so maybe someone can check this out.

@wmertens do you have an opinion on this?

@mhevery @wmertens
What we are doing is skipping zod and doing this:
export const useMyCoolAction = routeAction$(async (rawData, event) => {
  try {
    const data = someSchema.parse(rawData);
  } catch (error) {
    if (error instanceof z.ZodError) {
      event.fail(400, flattenZodIssues(error.issues));
    }
  }
});

The flattenZodIssue:
export default function flattenZodIssues(issues: z.ZodIssue | z.ZodIssue[]) {
  issues = Array.isArray(issues) ? issues : [issues];

  return issues.reduce((acc, issue) => {
    acc[issue.path.join('.')] = issue.message;
    return acc;
  }, {} as Record<string, string>);
}

export type FlattenZodIssues = ReturnType<typeof flattenZodIssues>;


Added validation that checks whether the node_id the Scheduler was in…

…itialized with matches the node_id extracted from the TlsConfig passed in to the 'schedule' call.

Good catch, this will prevent some really hard to debug issues further down the line :+1:

ACK https://github.com/Blockstream/greenlight/pull/367/commits/fb2bfc6b0f6d144ac0dfd0e19af08873eb38741b


Add Rome to dependecy/packet manager

Project URL
https://github.com/blender/Rome
Category
Dependency / Package Manager
Description
Add Rome to the list. Rome is cache manager for projects using Carthage.
Why it should be included to awesome-ios (optional)

It's a decent tool to speed up build times by caching build artifacts locally, remotely or both.
Supports CI workflow
Supports team setup

Checklist

[x] Only one project/change is in this pull request
[x] Addition in chronological order (bottom of category)
[x] Supports iOS 9 / tvOS 10 or later
[x] Supports Swift 4 or later
[x] Has a commit from less than 2 years ago
[x] Has a clear README in English

          1 Warning

:warning:
Found 3 link issues, a project collaborator will take care of these, thanks :)

Link issues by awesome_bot

Line
Status
Link

299
301
https://github.com/linkedin/RocketData redirects tohttps://github.com/plivesey/RocketData

1646
301
http://componentkit.org/ redirects tohttps://componentkit.org/

2918
302
http://mobilecouch.co/ redirects tohttps://mobilecouch.co/

  Generated by :no_entry_sign: Danger

Nice project!

Thanks!


Infusers Can't stack outputs

Only 1 output can be stored in the infuser

already on pixelmon tracker https://pixelmonmod.com/tracker.php?p=2&t=18767


England, Scotland and Wales

App omits users from England, Scotland, Wales and Northern Ireland - there are a lot of people missing from your list including myself.
Don't forget UK is a union of countries, similar to the EU. Nobody puts "EU" as their location.

Thanks! Sorry for the long delay :+1:


No sidebar highlighting with the extension

Describe the bug
Whenever someone @'s you or sub it doesn't show the highlight on the sidebar.
Chatterino version
2.1.2

Do you mean the scrollbar?

Yes


Antialiasing only works via plugin draw overlays in GLES3, doesn't work in other cases (neither at run-time nor editor)

Godot version:
3.2.4 beta 8dde60d13
Somewhat similar to #38872.
OS/device including version:
Windows 10
NVIDIA GeForce GTX 750 Ti (driver version <IP_ADDRESS>48)
GLES3
Issue description:
This seems to happen with any kind of geometry drawing where antialiasing property/parameter is exposed:
draw_line

draw_colored_polygon

Antialiasing works fine in GLES2 (both in editor and at run-time). Tried with batching on and off, same results.
Steps to reproduce:
This does not work:
tool
extends Node2D

var points = [Vector2(90, 100), Vector2(100, 230), Vector2(250, 200), Vector2(300, 105)]

func _draw():
	for i in points.size() - 1:
		draw_line(points[i], points[i + 1], Color.white, 1.0, true)

#	draw_colored_polygon(points, Color.white, [], null, null, true)

This works:
tool
extends EditorPlugin

var points = [Vector2(90, 100), Vector2(100, 230), Vector2(250, 200), Vector2(300, 105)]

func _enter_tree():
	update_overlays()

func handles(object):
	# To trigger `forward_canvas_draw_over_viewport`
	return object is Node2D

func forward_canvas_draw_over_viewport(overlay):
	# Same as in main.gd
	for i in points.size() - 1:
		overlay.draw_line(points[i], points[i + 1], Color.white, 1.0, true)

#	overlay.draw_colored_polygon(points, Color.white, [], null, null, true)

Minimal reproduction project:
draw_antialiased_gles3.zip

I haven't looked yet but I suspect the same line drawing code is used in both cases. Anti-aliasing via GL_LINE_SMOOTH is just a hint, not a command, it can be ignored by the driver or only used when it decides. It is also only issued when GLES_OVER_GL is set, so there would be no anti-aliasing on e.g. mobile.
In your case it looks possible that it only implements GL_LINE_SMOOTH when drawing in certain situations (maybe to the main framebuffer? I don't really know how the editor handles separation of the windows in terms of multiple frame buffers). Assuming that hypothesis is correct of course and there isn't something else obvious.
If it is any consolation, on mine, when I load your project, neither line is anti-aliased. :grin: Such is the joy of GL hints.
Some alternatives which are more likely to give consistent behaviour include drawing lines with a shader, or using polys and frame anti-aliasing. At some point a contributor might do an implementation using e.g. a shader, but it is just not a priority at the moment for the main rendering team.
https://mattdesl.svbtle.com/drawing-lines-is-hard
GL lines is generally a minefield anyway and I believe most hardware guys recommending steering clear. I think it is one of those things that is far more difficult for them to implement than you would expect.

Implementing MSAA support in 2D would could resolve this issue (for lines thicker than 1 pixel since they're tesselated). It has a higher performance cost compared to using proper smooth line drawing methods though. Still, this cost should be acceptable on desktop and some mobile devices.

I presume the same applies for polygon antialising?
So technically it's a bug but also a feature request then. 😃
But yeah, at least it would be nice to figure out the reason why this does work while drawing via EditorPlugin.forward_canvas_draw_over_viewport() specifically, perhaps there's some Viewport configuration which increases the "chances" of antialiasing to be enabled on some devices/drivers.

Still, this cost should be acceptable on desktop and some mobile devices.

Could also be fine to enable this just for the editor, because a lot of stuff looks too sharp in GLES3 if you do draw custom geometry (without reverting to drawing with plugins over the viewport).

So, I've just reset the settings in NVIDIA Control Panel now (which I changed some years ago!), and now get this antialiased:

But the result is different in GLES3, so I suspect that we have some different editor viewport vs canvas viewport configurations here?

That's GLES3, and the result is different for plugin editor overlay drawing vs simple _draw() in tool scripts, so I suspect that we have some different editor viewport (root) vs canvas viewport configurations here?

Try disabling HDR in the Project Settings and restart the editor.

FXAA is definitely not intended to be used on 2D elements, which is why Godot only applies it in 3D.


UFBX Multiple animation clips  do not start at frame 0

Tested versions
4.3.dev4
System information
Windows 10
Issue description
UFBX plugin is great!
I export with animations as you can see here using Maya. I created multiple animation clips:

So it seems that the keyframes start at the original timeframe. instead of all starting at  0:

Obviously this one starts at 0, it is the first animation

This one has keys at the beginning:

Steps to reproduce
Import this:
issue_animation_clips.zip
Minimal reproduction project (MRP)
Import this:
issue_animation_clips.zip

Hi, would it be possible to try again using the "Trimming" checkbox under Animation in the import dock? This is what it is designed for.

The thing that I assume could be improved here is for Godot to make use of the LocalStartTime field in the FBX AnimStack to automatically select the start frame. The question is: should this setting be on by default, and how can it be done without making the system fragile.
There is a way to control the start and end frame precisely, if you input the starting and stopping frame number manually in the import settings:

But it would be nice if Godot can help out perhaps by showing a range or prefilling these.

Here is the better file containing the mesh:
issue_animation_clips.zip
The frame range without slicing is different from the export, if you look at the "action" clip.

@shafnaz based on a conversation with bqq, the correct way to account for time offsets is the Trimming checkbox in the import dock. Slicing should not be necessary. Have you tried enabling trimming?

I see. There is trimming, and there is slicing. Trimming is just a checkbox and auto offsets the key. Thanks guys!

I think we need to discuss turning trimming on my default for fbx or ufbx. There clearly was a change in behavior here, so it would be good to have an open issue tracking this

The behaviour for trimming off is suprising so it is a argument for making trimming on the default.


Fixed export of enums (fixes #17)

This PR adds a rewrite rule check for exported constants, which allows enums to be exported from the wasm-pack bundle.
They appear in the pkg file like this:
export const MyEnum = Object.freeze({ Bar:0,Zot:1, });

And now get exported correctly in the output:
__exports.MyEnum = Object.freeze({
  Bar: 0,
  Zot: 1
});

thanks for the PR

Thanks for merging!! 😎


IE11 svg output bug

IE11 does not output any paths in the generated svg.
See sample output.
undefined
no error message in IE 11 console.
off topic: could you possibly provide a trim feature for svg?

Turns out that IE doesn't support innerHTML property on SVG elements. Because why should it :/
Anyway, I found a workaround:
  let body = svg.innerHTML;

  // IE hack for missing innerHTML property on SVG elements
  if (body === undefined) {
    const paths = svg.childNodes;
    const serializer = new XMLSerializer();
    body = '';
    for (let i = 0; i < paths.length; i += 1) {
      body += serializer.serializeToString(paths[i]);
    }
  }

I tested it only in IE11, but XMLSerializer is supported since IE9. I'll publish a new beta version with this workaround later today.

great news! thanks!

Closed by ff3dffffc9ba5149f45a5d6bbdbe85bc975db77d.

hi szimek. what happened to the signature_pad.min.js? it's not there anymore. thanks

I removed built files from the repo. They're available in npm package or cdnjs (though it looks like only stable builds are available there).

yes. you are right. npm does not contain the latest, also not minimized. thanks

hi @szimek. the output svg has a problem. all the path tags have an xmlns attribute
e.g.
<path xmlns="http;//www.w3.org/2000/svg"
only the first path tag should have it.

@chitgoks

npm package does contain all 3 built files. If you install it with npm install signature_pad@beta you have the minified version in ./node_modules/signature_pad/dist/signature_pad.min.js

no they don't. If you run something like this on the demo page:

atob(signaturePad.toDataURL('image/svg+xml').split(',')[1])

you should get output like this:
<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 1300 1076"><path d="M 170.000,213.500 C 170.000,214.500 170.000,214.500 170.000,215.500" stroke-width="5.519" stroke="black" fill="none" stroke-linecap="round"></path><path d="M 170.000,215.500 C 170.000,219.500 170.000,219.500 170.000,223.500" stroke-width="3.115" stroke="black" fill="none" stroke-linecap="round"></path><path d="M 170.000,223.500 C 170.000,224.000 170.000,224.000 170.000,224.500" stroke-width="4.263" stroke="black" fill="none" stroke-linecap="round"></path><path d="M 170.000,224.500 C 170.000,225.500 170.000...

I tried it in Chrome and FF.

hi. sorry i was not clear. yes, only in IE does it output all path tags with xmnls attribute.
it's ok i am in no rush. i will wait.

@chitgoks Can you check out the version at http://szimek.github.io/signature_pad ? It still has xmlns attribute for <circle> elements (no idea why), but doesn't seem to have it for <path> elements anymore.

@szimek: i am not sure when  will appear. i have not experienced that.
But as for . it is now visible in IE.
Thanks. Hope there will be a min version as well.

@chitgoks <circle> appears in the generated SVG when you make a single dot. I'll release it as beta 8 (though I still need to fix #219 and #221 before the final release), as soon as I can confirm both <path> and <circle> show up properly.

@chitgoks Hey, I've just released 1.6.0-beta.8, which should fix it. Could you check it out?

hi @szimek  Confirmed working.


BUG: In the footer section, the copyright year should be dynamically generated instead of being statically hardcoded.

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?

@dakshsinghrathore Right now, the copyright year is written manually, which means someone has to change it whenever a new year begins. However, with just a few lines of code in JavaScript, we can make it automatic. This means that the copyright year will always be up-to-date without anyone having to change it manually. For example, if the current year is 2023, the copyright section will show 2023. And when the year changes to 2024, the copyright section will automatically update to 2024.
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a Hacktoberfest'23 contributor
[X] I want to work on this issue

@gauravsingh1281 assigned!


collapse all cassandra-stress parameters into stress_options

This PR is an attempt to handle #22 by using one variable stress_options to capture all the options handled by:

threads
command
command_options
populate
stress-options

This make the command syntax closer to the original cassandra-stress, but require explicit setting of command, rate etc
Examples:
Before the change:
./ec2-stress.sh 1 -e "load_name=cassandra.v1" -e "server=Cassandra" -e "stress_options='-errors ignore'"

After
./ec2-stress.sh 1 -e "load_name=cassandra.v1" -e "server=Cassandra" -e "stress_options='write -rate threads=500 -errors ignore'"

@dorlaor @nirmaayan @glommer as users, does this make life easier or harder?


Add missing Cocoa framework for stack cabal package on osx.

Building stack through nix with the latest changes to master on OS X Yosemite ends up with stack not being able to link its binary due to the Cocoa framework not being found by the linker.
For OS X add this as an explicit dependency, for non OS X stack builds as normal.
If there is a better way of doing this in the nix language let me know. New to nix the language so I may have gone about this wrong but it generates a working stack binary on OS X with these changes.

PR 10605 fixed this, closing.


Use SWIFTCI_USE_LOCAL_DEPS to check whether to clone swift-docc-plugin

Only SwiftSyntax’s build-script sets SWIFT_BUILD_SCRIPT_ENVIRONMENT. Once we migrate other projects into the unified SwiftPM build, the environment variable is not set and SwiftPM tries to download swift-docc-plugin in CI.
Use SWIFTCI_USE_LOCAL_DEPS as an indicator whether the remote plugin should be loaded.

@swift-ci Please test


Error occurred when executing IPAdapterAdvanced:  'Attn2Replace' object has no attribute 'set_new_condition'

Error occurred when executing IPAdapterAdvanced:
'Attn2Replace' object has no attribute 'set_new_condition'
File "D:\StableDiffusion\ComfyUI-aki-v1\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\StableDiffusion\ComfyUI-aki-v1\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\StableDiffusion\ComfyUI-aki-v1\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\StableDiffusion\ComfyUI-aki-v1\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 698, in apply_ipadapter
work_model, face_image = ipadapter_execute(work_model, ipadapter_model, clip_vision, **ipa_args)
File "D:\StableDiffusion\ComfyUI-aki-v1\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 393, in ipadapter_execute
set_model_patch_replace(model, patch_kwargs, ("input", id, index))
File "D:\StableDiffusion\ComfyUI-aki-v1\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 146, in set_model_patch_replace
to["patches_replace"]["attn2"][key].set_new_condition(**patch_kwargs)
I use the pulid+ipa workflow and encountered the above error. Please help me resolve it. Thank you!

guys, please read the documentation. You need to update ipadapter and this extension


Run CI build pipelines only when needed

🚀 The feature
Run CI build pipelines only when any changes are done to the /embedchain and/or /tests directory.
Motivation, pitch
This will remove unnecessary build calls while contributing to docs or examples etc

Yeah, sounds like a good idea but we should be careful since we will add tests for the examples as well going forward to make sure that the examples are compatible and working with the embedchain version.

For now, I think we can skip tests if there are changes only in /docs dir


Upgrade to m112

Unfortunately after trying quite hard to upgrade to m113, I had to ask for help on skia-discuss: https://groups.google.com/g/skia-discuss/c/2hA_8Fcfih4
This m112 upgrade seems to be working well and has a new method in SkCanvas which of interest to us.
Also since we didn't upgrade in a year, this might be appropriate to do so.

@chrfalch sorry for the back and forth on this. Closing since I'm not able to build m114


chore(deps): upgrade dev dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-dev-dependencies-1.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 2697

Questions ?
Please refer to the Backport tool documentation


LEGO: Pull request from lego/hb_a13bbffa-1136-4930-9ebe-33895240f846_20210121232145695 to master

LEGO: Pull request from lego/hb_a13bbffa-1136-4930-9ebe-33895240f846_20210121232145695 to master with localized lcls

Closing this PR since it overwrites the existing files that have already been translated with ne files that don't are not translated.

Closing this PR since it overwrites the existing files that have already been translated with ne files that don't are not translated.


[Feature] 내 정보의 설정 페이지 뷰를 구현하라

Install npm dependencies bable/core, preset-env
MyInfo setting page의 view 부분을 간단하게 구현

Codecov Report

Merging #225 (498945a) into main (8681c8b) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main     #225   +/-   ##
=======================================
  Coverage   99.66%   99.66%
=======================================
  Files         102      104    +2
  Lines        1179     1193   +14
  Branches      134      140    +6
=======================================
+ Hits         1175     1189   +14
  Misses          4        4

Impacted Files
Coverage Δ

src/components/myInfo/MyInfoTab.jsx
100.00% <ø> (ø)

src/components/myInfo/ProfileSettingForm.jsx
100.00% <100.00%> (ø)

src/containers/myInfo/ProfileSettingContainer.jsx
100.00% <100.00%> (ø)

src/pages/myInfo/ProfileSettingPage.jsx
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8681c8b...498945a. Read the comment docs.


Github is not merging dart-lang pull requests

Is there an existing issue for this?

[X] I have searched the existing infra issues

Type of Request
bug
Infrastructure Environment
Github - specifically merging of pull requests.
What is happening?
Github is currently refusing to merge pull requests as not mergeable.
Here is an example: https://github.com/dart-lang/sse/pull/90
This pull request passed all of the CI checks and validations and there were no issues found. We then attempted to merge the pull request and each time Github refused to accept the merge.
Initially I found that there were 3 states for mergeability but this pull request did not report a bad state.
Steps to reproduce
Not sure, seems to be a transient issue with dart-lang.
Expected results
I would have expected Github to merge the pull request without issue.

Leaving open but removing from the queue for now.

Closing as this is not an issue any longer. Miscommunication with label as the label is removed on CI failures. But no other issues were observed.


Dismissal animation sometimes doesn’t work - the popover disappears instantly

I’ve noticed this happening maybe 1 in 30 times. I can’t get it to reproduce yet, but will attach code as soon as I figure out what’s the cause.
I think it has something to do with SwiftUI transitions in ZStack, but am not sure.

Fixed in https://github.com/aheze/Popovers/releases/tag/1.3.2.


gcc compilation problem on pip install

Hello
I'm struggling with the 'pip install' approach to getting pysteps installed on my Mac (OS Mojave 10.14.2).  I've tried:

pip install numpy
(which was successful)
pip install git+https://github.com/pySTEPS/pysteps
after progressing some way, it fails with the following message:
:
:
creating build/temp.macosx-10.9-x86_64-3.7/pysteps/motion
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -arch x86_64 -g -I/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/numpy/core/include -I/Library/Frameworks/Python.framework/Versions/3.7/include/python3.7m -c pysteps/motion/_vet.c -o build/temp.macosx-10.9-x86_64-3.7/pysteps/motion/_vet.o -fopenmp
clang: error: unsupported option '-fopenmp'
error: command 'gcc' failed with exit status 1

Any thoughts as to why this fails?
Thanks

It looks like you are using an old C compiler that doesn't support OpenMP. We recommend installing a more recent version from the Anaconda repository. For OS X users, the correct package is clang_osx-64. See https://www.anaconda.com/utilizing-the-new-compilers-in-anaconda-distribution-5.

Hi Luigi, as @pulkkins said, it seems that the macOS the default compiler (clang LLVM) does not support openmp yet.
One possible solution is to use Anaconda to create the Pysteps environment and install the following packages:
conda install llvm gcc libgcc

And then install Pysteps in that environment.
Another option is to update the compilers:
xcode-select --install
export CC=clang ; export CXX=clang
pip install git+https://github.com/pySTEPS/pysteps

Hope this helps.

Thanks!   I'll give it a try and confirm success one way or another.  Regards!

Reference to this Another option is to update compilers
For me the above command didn't worked but this one worked.
export CC=/usr/local/Cellar/gcc/8.2.0/bin/gcc-8

Hi @m-anand, thanks for the other solution. Did you update the compilers using homebrew? Can you share the commands that you used so they can be used as reference?
Thanks!

Hi @m-anand, thanks for the other solution. Did you update the compilers using homebrew? Can you share the commands that you used so they can be used as reference?
Thanks!

I used :
brew install gcc
export CC=/usr/local/Cellar/gcc/8.2.0/bin/gcc-8
and it worked.

I've update gcc using brew as suggested by @m-anand but it didnt work.   I get slightly further than last time, but invariably:
creating build/temp.macosx-10.9-x86_64-3.7/pysteps/motion
clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -arch x86_64 -g -I/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/numpy/core/include -I/Library/Frameworks/Python.framework/Versions/3.7/include/python3.7m -c pysteps/motion/_vet.c -o build/temp.macosx-10.9-x86_64-3.7/pysteps/motion/_vet.o -fopenmp
clang: error: unsupported option '-fopenmp'
error: command 'clang' failed with exit status 1

----------------------------------------

Command "/Library/Frameworks/Python.framework/Versions/3.7/bin/python3.7 -u -c "import setuptools, tokenize;file='/private/var/folders/n_/1n0301tj0xv1nzcgmsn03qk40000gn/T/pip-req-build-mhfad__q/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" install --record /private/var/folders/n_/1n0301tj0xv1nzcgmsn03qk40000gn/T/pip-record-j83nr5ce/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/n_/1n0301tj0xv1nzcgmsn03qk40000gn/T/pip-req-build-mhfad__q/

I think I will end trying to get this installed on my mac.   It is successfully running under linux.  Thanks all for your help.

Luigi, I will try  borrow a Mac computer and try to reproduce your error.
I will keep the issue open until I add a the installation instructions for OSX to the documentation.

An alternative solution for anaconda users on OSX
On your anaconda environment (source activate my_environment_name) install the anaconda gcc compilers:
conda install gcc
Check that the conda gcc version is going to be used:
which gcc
The output should look something like this:
/path/to/the/anaconda/distribution/envs/my_environment_name/bin/gcc
Then, unset the CC variable to make sure that it is not using the system's gcc:
unset CC
Finally, install pysteps as usual. Now, the installer should use the conda gcc compiler that supports openmp.
Thanks @bernatp3rs trying this out!

Thanks.  Unfortunately resulted in a new error message.
This is the sequence of steps I followed:

conda env create -f environment.yml
conda activate pysteps

Checked that the gcc had correct path:

which gcc
it returned:
/anaconda3/envs/pysteps/bin/gcc

The I tried:

pip install git+https://github.com/pySTEPS/pysteps

but ended up with the following:
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -arch x86_64 -g -I/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/numpy/core/include -I/Library/Frameworks/Python.framework/Versions/3.7/include/python3.7m -c pysteps/motion/_vet.c -o build/temp.macosx-10.9-x86_64-3.7/pysteps/motion/_vet.o -fopenmp
In file included from /anaconda3/envs/pysteps/lib/gcc/x86_64-apple-darwin11.4.2/4.8.5/include-fixed/syslimits.h:7:0,
                 from /anaconda3/envs/pysteps/lib/gcc/x86_64-apple-darwin11.4.2/4.8.5/include-fixed/limits.h:34,
                 from /Library/Frameworks/Python.framework/Versions/3.7/include/python3.7m/Python.h:11,
                 from pysteps/motion/_vet.c:30:
/anaconda3/envs/pysteps/lib/gcc/x86_64-apple-darwin11.4.2/4.8.5/include-fixed/limits.h:168:61: fatal error: limits.h: No such file or directory
 #include_next <limits.h>  /* recurse down to the real one */
                                                             ^
compilation terminated.
error: command 'gcc' failed with exit status 1

I updated the README file with the installations instructions based on @m-anand solution. I tried them myself and they worked correctly.
Commit 8e8fd808f583fc08b57bff7a0f17013cfc536976 closes this issue.


new_filename_and_folder_for_outputs

will write to /ssnew and /sso folders if they exist and should write separate report and compreport files in mceval (not tested).

Kelli, Chantel and Ian - could I get you opinion on what to do with the data.ss_new while I work to get report for each mceval working.
options are:
a.  status quo (Rick hates it)
b.  status quo but to a sub-folder if subfolder exists
c.  separate files for data_echo.ss_new, data_expval.ss_new, the all bootstraps appended in 3rd file
d.  all in separate files
Right now the branch does (b) and (d)
@kellijohnson-NOAA @chantelwetzel-noaa @iantaylor-NOAA

(a) - lots of workflows depend on it
(b) - I think the overhead of changing everyone's simulation code is not worth it for this option. What is the difference if the file is in the main directory versus a subdirectory, the structure is still the same? Are you trying to get at the point that the output file is not the same as the input file where the other ss_new files are?
(c) - I would change the extension of anything that is not the echoed data to something different than ss_new. So my proposal here would be data.ss_new, data_expected.ss, data_boot.ss where the .ss could be changed to something different for the latter two files.
(d) - has anyone checked the overhead of writing 100 bootstrap files versus 1 file with 100 data sets?

I think (d) would be my ideal, but in the simulations I've worked on (long ago), I wanted to the expected recdev time series for each bootstrap so never wrote more than 1 per model run in which case (c) and (d) are essentially the same.
For (c) and (d), I like the filenames proposed by @kellijohnson-NOAA in the comment above https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-965414356.
I know that past workflows have all used the status-quo approach but don't have a good sense of how many of those are likely to ever be repeated. Adapting to any of these options also shouldn't be very hard, so I'm not sure that backward compatibility is important if it adds complexity to the code.
As for run time, I would guess that the bootstrap and file-writing process is much faster than the model estimation step that is surely part of almost all bootstrap analyses so it's not worth trying to hard to optimize the run time.

Lets clarify what we mean by bootstrap.  There is the bootstrap process
inside of SS3 that is post-estimation and the only slow part of it is doing
the multinomial sampling for all the comps.  We are talking about the
output from that process.  Then there is the ss3sim process that repeatedly
calls the entire ss3 process, that takes longer and each of the ss3sim
calls creates the entire set of ss3 outputs.
On Wed, Nov 10, 2021 at 1:35 PM Ian Taylor @.***> wrote:

I think (d) would be my ideal, but in the simulations I've worked on (long
ago), I wanted to the expected recdev time series for each bootstrap so
never wrote more than 1 per model run in which case (c) and (d) are
essentially the same.
For (c) and (d), I like the filenames proposed by @kellijohnson-NOAA
https://github.com/kellijohnson-NOAA in the comment above #218 (comment)
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-965414356
.
I know that past workflows have all used the status-quo approach but don't
have a good sense of how many of those are likely to ever be repeated.
Adapting to any of these options also shouldn't be very hard, so I'm not
sure that backward compatibility is important if it adds complexity to the
code.
As for run time, I would guess that the bootstrap and file-writing process
is much faster than the model estimation step that is surely part of almost
all bootstrap analyses so it's not worth trying to hard to optimize the run
time.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-965763893,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABPV4IA27D6H56IVINYQYYLULLQQVANCNFSM5GPK63LA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

I generally agree with Ian and Kelli's suggestions.  I would prefer option
c or d with the naming structure proposed by Kelli for clarity.  Similar to
Ian, I have only done simulations where I generate a single bootstrap at a
time, so don't have much of an opinion on generating all bootstraps in a
single file or generating separate files.
Chantel Wetzel, PhD
*Pronouns: she/her *
Fishery Resource Analysis and Monitoring DivisionNorthwest Fisheries
Science Center
National Marine Fisheries Service
National Oceanic and Atmospheric Administration
On Wed, Nov 10, 2021 at 1:43 PM Richard Methot @.***>
wrote:

Lets clarify what we mean by bootstrap. There is the bootstrap process
inside of SS3 that is post-estimation and the only slow part of it is doing
the multinomial sampling for all the comps. We are talking about the
output from that process. Then there is the ss3sim process that repeatedly
calls the entire ss3 process, that takes longer and each of the ss3sim
calls creates the entire set of ss3 outputs.
On Wed, Nov 10, 2021 at 1:35 PM Ian Taylor @.***> wrote:

I think (d) would be my ideal, but in the simulations I've worked on
(long
ago), I wanted to the expected recdev time series for each bootstrap so
never wrote more than 1 per model run in which case (c) and (d) are
essentially the same.
For (c) and (d), I like the filenames proposed by @kellijohnson-NOAA
https://github.com/kellijohnson-NOAA in the comment above #218
(comment)
<
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-965414356
.
I know that past workflows have all used the status-quo approach but
don't
have a good sense of how many of those are likely to ever be repeated.
Adapting to any of these options also shouldn't be very hard, so I'm not
sure that backward compatibility is important if it adds complexity to
the
code.
As for run time, I would guess that the bootstrap and file-writing
process
is much faster than the model estimation step that is surely part of
almost
all bootstrap analyses so it's not worth trying to hard to optimize the
run
time.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-965763893
,
or unsubscribe
<
https://github.com/notifications/unsubscribe-auth/ABPV4IA27D6H56IVINYQYYLULLQQVANCNFSM5GPK63LA
.
Triage notifications on the go with GitHub Mobile for iOS
<
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
<
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-965772920,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABPC3TQO2ASACAPIF3AOQODULLROTANCNFSM5GPK63LA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

We will let this one sit for a bit, as we don't want to change the subfolder and file structure in the main branch yet. However, we plan to merge in before the 3.30.19 release.

Kelli,    @kellijohnson-NOAA
this branch now produces a separate report and compreport file for each mceval.  Files have names like:
Report_mce_25.sso for the 25th mceval iteration. These reports will be found in the runfile directory unless the user creates a ./sso subdirectory. Please take a look and let me know if this meets the needs of the hake assessment. The branch also implements the previously discussed changes to data.ss_new.  These go to subfolder ./ssnew if it exists and have names of:
data_echo.ss_new, data_expval.ss, and data_boot_1.ss through data_boot_N.ss.
Rick

I am testing this out today.

@Rick-Methot-NOAA is the functionality intentional to have posteriors.sso be a blank file? Also, as written the system works when I run it with standard MCMC but @cgrandin was having trouble when using @Cole-Monnahan-NOAA's adnuts. Chris is looking into this more as will I.

Nothing intentional was done to change posteriors, so I will check on that.
No idea how adnuts would be affected.
On Tue, Dec 14, 2021 at 3:53 PM Kelli Johnson @.***>
wrote:

@Rick-Methot-NOAA https://github.com/Rick-Methot-NOAA is the
functionality intentional to have posteriors.sso be a blank file? Also, as
written the system works when I run it with standard MCMC but @cgrandin
https://github.com/cgrandin was having trouble when using
@Cole-Monnahan-NOAA https://github.com/Cole-Monnahan-NOAA's adnuts.
Chris is looking into this more as will I.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-994148105,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABPV4IGZNEZ37PUL62SQ5WDUQ7KIJANCNFSM5GPK63LA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

@kellijohnson-NOAA  code is now writing correctly to posteriors.sso.  I do not know how to investigate the adnuts issue.

Great. I will distribute the new executable to the team.
I checked with Chris and he said that it ended up being fine with adnuts. I think he panicked because the files are not written until the end. Sorry for the false alarm there.

@k-doering-NOAA  Please merge this into main after you are able to adjust the workflow to deal with the new filenames.

Ok, sounds good, Rick. I'm working on this now; hope to finish by end of the day monday at the latest!

Hi all,
Thanks for getting this done and so quickly!
One little thing though is that the posteriors.sso, deriver_posteriors.sso, etc files are located in the sso folder. This may break some other folks code if they try to run with an sso folder and have current code that reads those files from the parent mcmc folder. Would it be possible to move those files back to the parent directory of sso?
Thanks

Hi Chris.
That would be possible, but it seems overly complicated to have some sso
files in the main folder and others in the sso folder. Do you have a
complete list of which you would want where?
All sso files go to the main folder if the sso folder has not been created
by the user prior to the ss3 run starting.
Rick
On Fri, Dec 17, 2021 at 7:50 PM Chris Grandin @.***>
wrote:

Hi all,
Thanks for getting this done and so quickly!
One little thing though is that the posteriors.sso, deriver_posteriors.sso,
etc files are located in the sso folder. This may break some other folks
code if they try to run with an sso folder and have current code that
reads those files from the parent mcmc folder. Would it be possible to
move those files back to the parent directory of sso?
Thanks
—
Reply to this email directly, view it on GitHub
https://github.com/nmfs-stock-synthesis/stock-synthesis/pull/218#issuecomment-997137387,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABPV4IGEUKLV75HSHKDBJUDURQAIDANCNFSM5GPK63LA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

Some observations on this PR:

Tests are fixed in the main branch, so when this gets merged in, the checks should work again. I tested by making a new branch from this one, then pulling in the main branch and running the tests. They were passing, as indicated by the blue arrow of the last commit (https://github.com/nmfs-stock-synthesis/stock-synthesis/tree/output_to_separate_files_check)
I tested the code locally and manually again to see what happens under various folder scenarios. I learned that if a subfolder called sso exists, then sso files are written there; if a folder called ssnew exists, then the .ss_new filew are written there.
The new data files are called data_echo.ss_new, data_expval.ss, and dat_boot_x.ss . I know that Kelli liked the expval and boot not to have ss_new extensions, but I wonder if it is then confusing that the filse do not have the .ss_newextension but live in the folder labeled ssnew anyway? I personally think it is less confusing to have the files with the ss_new extension since they are (sometimes) written to the ssnew folder.
A picky thing about bootstrap file names: the first is called dat_boot_1.ss ; the 10th would be dat_boot_10.ss; we could potentially add leading zeros instead to help order them (e.g., dat_boot_001.ss; dat_boot_010.ss). This would assume most people don't have more than 999 bootstrap files. I'm ok with either, just wanted you to think about which names you prefer, Rick.
@kellijohnson-NOAA , when you have the chance, could you list the steps on how to test this out with mcmc (for people who don't really use mcmc in admb, like me? :) ) I tried running, but wasn't successful at getting the files to show up as they should. I'm guessing this is user error on my part

Hi @Rick-Methot-NOAA ,
I've broken down my logic here, maybe I am missing something. If so, my apologies!
If I run this:
ss -mcmc 8000 -nuts, and there is no sso directory, the behaviour is that the posteriors.sso, derived_posteriors.ss, etc files are created in the directory in which the mcmc was called.
If I run this (same thing):
ss -mcmc 8000 -nuts, and I have an sso directory, the posteriors.sso, derived_posteriors.ss, etc files are not created in the directory in which the mcmc was called. Instead, they are located in the sso directory.
My question is, if I'm correct, is this how you really want it, considering they will be in two different places depending on how SS was run?
One other thing is that if the user is using Windows File explorer (not fluent with the command line), they have to scroll through thousands of files to find the files. They could filter the results but they would have to do that for each file one by one to see that they exist and have some size after the run. It's not an issue for me but I can see that it would be for some.
For Hake we are good like it is, I already our code working with this, I'm just trying to help other users.
Thanks Rick

Hi Chris,
Now I am confused as this option was created in order to help organize the many new files requested by the hake team.
There is no change to posteriors.sso, etc. so I do not see why that is an issue, especially the user can choose a workflow in which they create a sso folder and hence know to look there for output, or not create the folder and look for the output in the same place they always looked for it.
The specific request from the hake team was for report.sso and compreport.sso from each mceval call.  Appending all of these into one file each seemed very unwieldy, very large, and very difficult to see if a particular run existed. Hence I have put each into separate named files, with the name representing the mceval index number.  Having this output is new, so some new workflow was needed anyway for you to use them.
What do others think about this approach?

I think it's totally fine, we have everything working the way it is.
The way the file structure is laid out is fine for our team.
Thanks!

@Rick-Methot-NOAA I just noticed that the option 2 for MCMC detail is not yet described in starter.ss_new comments:
2 # MCMC output detail: integer part (0=default; 1=adds obj func components); and decimal part (added to SR_LN(R0) on first call to mcmc)

I will fix that.

In my final push on this issue I revised the numbered file names to have leading digits.
example:
data_boot_005.ss
Report_mce_0025.sso

Thanks Rick, I checked and was able to successfully get 1002 samples ✔.
One last mystery that is only happening in MCMC mode with this executable is in AGE_SELEX report:32 the final year for sel*wt is wrong, it ends up being 2020 instead of 2021. If I run the executable in MLE mode everything is fine.
sel*wt 1 2020 1 1 1 2020_1_sel*wt 0 0.000112571 0.0109621 0.0703895 0.5076 0.280687 0.530073 0.549706 0.558731 0.59539 0.601531 0.651961 0.589622 0.780642 0.813207 0.869964 0.869964 0.869964 0.869964 0.869964 0.869964

are you seeing that discrepancy in report.sso, or in one of the mce reports?
The order of operations is getting quite complex, hence the problem with dynamic Bzero.

@Rick-Methot-NOAA the problem with sel*wt... happens in both Report.sso and Report_mce_xxxx.sso if running in with -mcmc. If I just run .\ss.exe then those rows have the correct year.

Kelli,
Alas, I'm not going to solve the missing dynamic Bzero (and other things) today.  Some change I made in order to produce report.sso in the procedure section for mceval has messed with the code logic in a way that has disabled things (like dynamic Bzero) that get appended to the report.  So, your  holiday gift will be late.

Found the solution. Now I can relax

Thanks Rick. I will look at this tomorrow. Merry Christmas 🎄 🎁 🎄

Glad to see all these new fixes! Congrats. I am rerunning the checks on this branch : https://github.com/nmfs-stock-synthesis/stock-synthesis/tree/out_to_sep_check, which merged into the main branch so the newer gh action files could be used (which is the reason for the failing tests on this branch).

Unfortunately, I am not able to get the latest fix to work with the hake model that I am testing it on. If I run in MLE I get dynamic bzero but there are still no values even though I have it turned on when running in MCMC. As well as the final year for the sel* output is final year - 1 not final year. Rick, is there something special that I should be doing in starter.ss? I tried turning on all output and turning on minimal output but calling dynamic bzero specifically and neither worked.

The simple lorenzen model has a change in results when run with estimation, I think because the se for the forecast catch value decreased see these model results
).
Rick, I think you remember you fixing something to do with forecast SE not too long ago, so I wonder if that is the reason? Perhaps the change is expected?

Kelli - you need only make this change in starter:
2 # MCMC output detail: integer part (0=default; 1=adds obj func components; 2= +write_report_for_each_mceval); and decimal part (added to SR_LN(R0) on first call to mcmc)


feat: create a bucket for dataplex

Created a bucket for Dataplex and copied a parquet file using Workflow.

/gcbrun

/gcbrun

/gcbrun

LGTM, thanks!


'Macro recorder' doesn't click when in scrcpy

Is there any alternative to start macro's on scrypy?

Could you try with SDL 2.0.9 (see #1033)?

@GuusDeKroon Is macro recorder running on a TouchScreen PC maybe?

hi sir,
i have tried to downgrade to 1.9&1.10, and have also tried to overwrite SDL 2.0.9 to scrcpy 1.23. however, when the jitbit macro is executed, the touch does not match the recorded one. any advice sir?


Improve language service performance

Prevent RequestDiagnostics from producing events when other language services are running
Produce diagnostics only on last command handling

A couple of minor comments that could be resolved in a future PR. If this is helping perf, let's merge it.


As/add focal loss

Adding focal loss as per discussion: https://github.com/deepmind/optax/issues/525

[x] Implementation of the loss
[x] Documentation string
[x] Test code
[ ] execute bash test.sh

Currently, One test fails
Traceback:
/usr/lib/python3.10/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
/tmp/optax-env/lib/python3.10/site-packages/optax/_src/equivalence_test.py:21: in <module>
    from flax import optim
/tmp/optax-env/lib/python3.10/site-packages/flax/__init__.py:19: in <module>
    from . import linen as linen
/tmp/optax-env/lib/python3.10/site-packages/flax/linen/__init__.py:47: in <module>
    from .attention import (
/tmp/optax-env/lib/python3.10/site-packages/flax/linen/attention.py:22: in <module>
    from flax.linen.linear import default_kernel_init
/tmp/optax-env/lib/python3.10/site-packages/flax/linen/linear.py:30: in <module>
    from jax import ShapedArray
E   ImportError: cannot import name 'ShapedArray' from 'jax' (/tmp/optax-env/lib/python3.10/site-packages/jax/__init__.py)

@mtthss Any suggestion on how to fix this error?

I want to suggest a change to the alpha parameter. Please give me a minute to create a PR.

Can you sync so we get this CL merged?

PR #599 proposes to implement the same loss (if I understood it correctly)

PR #599 proposes to implement the same loss (if I understood it correctly)

Hi, thanks for the response.
Yes, the other PR proposes a similar functionality but focuses on a single class case (sigmoid).
I think, a unified approach which handles both multi class and single class would be ideal. Or, having two different functions clearly identifying the differences could also work.
Looking forward to hearing your thoughts.

Thanks @paganpasta . Given the other function has 'sigmoid' in the name (which is consistent with the original implementation https://github.com/facebookresearch/fvcore/blob/main/fvcore/nn/focal_loss.py), I think implementing a non-sigmoid one would make more sense API-wise as a different function

Closing this issue PR, please reopen or open a new one if you contribute the general focal loss


Add Textadept version 9.6

This adds Textadept to scoop-extras.
I couldn't figure out automatic updates here, since the download URL only has "LATEST" in it (and not the actual version number).

Why not make something like:
"checkver": "Download v\\(((\\d+\\.?){2})\\)",
"autoupdate": {
    "url": "https://foicica.com/textadept/download/textadept_LATEST.win32.zip"
}

Link will be same, but hash will be recalculated on update

Also when you go here there are version numbers for files (etc: https://foicica.com/textadept/download/textadept_9.6.win32.zip)


[do-not-merge-before-28] Enable updates for ScalableTarget and ScalingPolicy

Issue #, if available:
https://github.com/aws-controllers-k8s/community/issues/867
Description of changes:

Enable updates based on changes to code generator made in this PR - https://github.com/aws-controllers-k8s/code-generator/pull/166
Add an integration test to check for updates
Update Runtime to v0.12.0
Allows use of adopted resource (test in next PR)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Will create a new pull request since runtime update is in a separate PR now and there have been other changes since.


Option to include failed tests and test summary in pipeline script

Your checklist for this issue

[x] Jenkins version

[x] Plugin version

[x] OS

Jenkins version: 2.156
Slack Notification Plugin version: 2.27
Jenkins runs on Linux
Description
Hi all,
I'm trying to send the Slack notification in the pipeline script that would include test summary and failed tests. I can't find anything in the logs on how to do that. I would appreciate some guidance.
Thanks in advance.

There's nothing easy that I'm aware of currently, but this would be a good feature to add.

With the support for file uploads you could grab the log, or partial log and attach it to the Slack notification.

I need the same feature.

would love to have this feature as well.

would love to have this feature as well.

This feature would be very beneficial to my department's automated test run pipeline.

+1


Trying to add swaggerwcf to a WCF Service Application

Hello and thank you for developing and sharing swaggerwcf!
I am currently trying to add swaggerwcf to a WCF Service Application. Therefore I followed all the steps in the Getting Started doku. I have tried both, the ASP.NET and Self Hosted approach, but none work until now.
The ASP.NET approach works locally with the limitation, that I have to call at least one service function to trigger its Constructor where I call RouteTable.Routes.Add(...); . If I try to deploy the dlls to my server, call one function and try to call http://host:port/service/api-docs I receive the error message that there is another protocolMapping-entry with the key=http. This is necessary for the service. If I remove the entry the error message is replaced by an error 404.
On the other hand, when I try the Self Hosted approach I am confronted with the error message "The contract name 'SwaggerWcf.ISwaggerWcfEndpoint' could not be found in the list of contracts implemented by the service 'DCI4FileHandlerService'."
I already searched the forum for any solutions but none helped. Can you give me any advice?
Regards

Download the sample service, does it work when you start it?
If so, start changing it to match what you want and you'll figure out what's the issue

closing, please reopen if still having issues

tried to implement the swagger for wcf but unable to implement. Could you help me to implement swagger for my wcf applicaton.
Thanks,
Abhi


Timestamp format in OSM export changes when modifying objects

Open http://level0.osmz.ru/?url=node/93515942
Download osm file
Delete a few tags
Download osm file

File from step 2:
  <node id='93515942' version='5' lat='47.2357170' lon='11.2999641' user='simon04' uid='57945' changeset='10975714' timestamp='2012-03-14T09:18:29Z'>

File from step 4:
  <node id='93515942' version='5' lat='47.2357170' lon='11.2999641' action='modify' timestamp='2016-09-26T06:45:49+0000'>

Instead of writing timestamp='2016-09-26T06:45:49+0000', write timestamp='2016-09-26T06:45:49Z' since +0000 is invalid according to https://www.w3.org/TR/xmlschema-2/#dateTime-timezones
This behavior breaks reading the OSM file in JOSM, see https://josm.openstreetmap.de/ticket/13690

Oh my, php indeed rulez.
Fixed in c293dcd0fdb9727e15ef60fcca3451a6b2a450d3
Thanks, Simon!

Thank you a lot for the quick fix, Ilya!


Ensuring order of bulk operations to avoid data loss or inconistent

Solving this issue: https://github.com/hpgrahsl/kafka-connect-mongodb/issues/98

Many thx for providing a quick fix for this @victorgp. Highly appreciated. I think in future version this might even be something that should be available as configuration option with ordered of course to be the default here.


Milestone interactive form

Hi kind reviewer, in the following list you'll find more information about what features I added:

Interactive Form
Remove Books

Thanks in advance

Hi @SantiagoGuerra
Please make sure that your repo looks professional before review.
Please take a step back and read a lesson here
Then add a descriptive readme file with relevant information about your project, you can use this template as a guide
This Code Review Request will be marked as invalid in your Dashboard, so please submit a new one once you are ready!


What is the difference between management and workload clusters?

I am looking at the documentation at https://anywhere.eks.amazonaws.com/docs/getting-started/production-environment/ and see there are two different clusters you can spin up. One is a management cluster and the other a workload cluster.
Would someone be able to tell me the difference in these two and why the workload cluster spins up etcd and control plane nodes? I was thinking that the workload cluster would talk back to the management cluster for those.

The installer creates or uses a management cluster to create a workload cluster. The management cluster could just be a KinD cluster. If you use thye KinD cluster option, it tears it down when the workload cluster is up. The management cluster is set up to start up Cluster API to create the workload.
As far as etcd goes, the default is to create 3 etcd nodes I think for a production cluster. You can run etcd on the control plane if you like.

Hey Brandon, here's an overview of what we are doing when we spin up these clusters: https://anywhere.eks.amazonaws.com/docs/overview/
To summarize, we create the workload cluster in vSphere, by creating a temporary bootstrap cluster to direct the workload cluster creation. Once the workload cluster is created, the cluster management resources are moved to the workload cluster and the local bootstrap cluster is deleted.
You can also take a look at the workflow here.


[#52] Remove irods_query.hpp

File now resides in main irods repo and is included in the irods-dev
package. Requires build of iRODS no earlier than this SHA:
9eb8435f29e1a2737d468bcb11f08105ac116c5f

CI tests passed

looks good to me - add some #


Variant Characters

Changes

Cleaned up unused .PNG files from previous update.
Added a section on Variant Characters.  This needs close review. There seems to be little effective IBM documentation on PASE environment variables.  From what I can deduce, ILE variables get copied to PASE when the shell starts, so I'm not sure why you need to restart the IBM i, and perhaps this should not be mentioned.

Checklist

[x ] have tested my change
[x ] updated relevant documentation
[ ] Remove any/all console.logs I added
[ ] eslint is not complaining
[ ] have added myself to the contributors' list in the README
[ ] for feature PRs: PR only includes one feature enhancement.

@benetti-smeup what do you think of this change to the documentation?
Perhaps we should also add links to IBM documentation about this topic.

the readme seems clear to me.
the problem with IBM documentation is that there are different links and the solution is difficult to understand.

I did a lot of searching for something definitive on IBM.COM but did not succeed.  I would really like to have included a link. Basically I wrote up the trial and error results from the issues.
Wonder if asking on Ryver would come up with anything?

@SJLennon Feel free to ask.. otherwise I will likely give a merge a bit later!

Still figuring out Ryver, but I see there is a ILE-PASE Interop forum, though it doesn't seem particularly active.
There is also PASE development forum that seem more alive.  I think I'll try a question there.

@SJLennon
Might be worth noting these simple steps:

end sshd, 2. WRKENVVAR *JOB set PASE_LANG to the correct local and QIBM_PASE_CCSID to 1208, 3. start sshd?

https://www.ibm.com/docs/en/i/7.2?topic=ssw_ibm_i_72/apis/pase_locales.htm

I'll do some more research and revise the help. Not sure WRKENVVAR *JOB will work, as it applies to the current job.  You probably need a CL with either ADDENVVAR or a CHGENVVAR and then starts SSHD.

@SJLennon please let me know when this is ready for review again.

@worksofliam Here's a revised versions, based on Kevin Adler's comments. This has taken a lot of time, possibly for relatively few users. Let me know what you think.

There is no mention of PASE CCSID variable, based on the last comment from Kevin.
"I did a bunch of digging and cannot come up with any reason changing the PASE CCSID should make any difference"

Whats a Variant Character?

This page probably does a better job of explaining it than anything I can do, even though it is not IBM i specific:
https://www.ibm.com/docs/en/db2-for-zos/11?topic=ccsids-variant-characters
See also this page, the section "Code page layout":
https://en.wikipedia.org/wiki/EBCDIC
And here's another one that might help shed light on the issue:
https://www.ibm.com/support/pages/what-impact-changing-qccsid-shipped-65535-another-ccsid

I'd never heard that term before, but I have a list of the "Variant characters" between CP 37 and CP 285 on a wiki page at work entitled "CCSID Issues".
Do you think telling people not to use Variant characters without stating what they are (or which characters are invariant and should be used) is a big ask?
For instance in my experience (of 37 vs 285) Hash (#) and At (@) are not variant characters, and I would therefore not know that they should not be used.

I don't think I'm telling people not to use variant characters, just saying, as IBM is, that it is not a good practice. Clearly some people have done it, and it occasionally causes problems.  Would it be better/clearer if the heading was "Variant Characters/CCSID Issues"?

I think saying something is not good practice strongly implies that you should not do it, but in this case the bad practice is not clearly defined... or even a good practice well defined.
I think it just needs a bit more explination, do we have a list of variant (or invariant) characters which could be supplied?

@worksofliam I have made some changes to remove text about bad practice, based on comments from @priceaj . Also changes the heading and added some links to background info on Variant characters.

@SJLennon I can see images have been deleted in this PR. Is that intentional?

Yes.  I added new, replacement images in the prior PR.  This clears out the old, unused images.

Thanks @SJLennon !


Dom mutation was not happening for elements with dangerouslySetInnerHTML.

For elements with dangerouslySetInnerHTML attr,
initial rendering will take place correctly. ( only Test case for initial render is present in the unit tests ).
after that, after some updating, if we are again rendering the same element, It was not working.
This pull request fixes that issue. ( Unit test also included )

Coverage increased (+0.004%) to 97.518% when pulling 264e073360fc66e3274b7f594ba39ef747c444ab on harish2704:master into 75acb15ff7f9439ed89b8e1fd82d39961fdfa84d on developit:master.

[INFO] This bug can be visualized by simply running the project.
https://github.com/harish2704/preact-router5-boilerplate
If we repeat the same with react library, ( just comment resolve part in webpack config ) it will work properly
-Thanks

Hi @harish2704! Thanks for the bug report, repro and PR (all in one)!
I need to check if this will cause excessive recycling, and if so might have to change the technique a little bit.  Regardless of that though, the tests and reproduction will help make sure any tweaks I have to make keep the functionality working :)
FWIW, I was hoping this would be fixed by the fix for #446.  I'll try to pull your tests in to see if that's the case, since that would be a super quick solution :)

Coverage increased (+0.004%) to 97.518% when pulling 0fb05a3f1ab23cf14e7ef2bd20011a5bb375d89f on harish2704:master into d685c124d55dad18956f2f42ae1261b9a4f3d90b on developit:master.

Hi,
In a quick test, the issue didn't seems to be resolved even after the merge.
I tested using this sample code against current master branch (bc84e2a6a41e4cfd033f5497a7d7fa9d99c9e486).
-info

@harish2704 what should I be looking for when I run the example?

I was able to get your repo running, just not really sure what I'm looking for.

Hi,
In the demo , the home route rendering using  dangerouslySetInnerHTML
If you try to goback to home route after visiting any other routes, You can see the problem.
It was not rendering