Can not build setup.py with cuda 11

Checklist

I have searched related issues #2882  and some issues in Detectron2 but still can not fix the problem

My problem is: The setup.py file can not recognize my GPU
What did I try?
Follow this issue, after install pytorch, I check with this code:
python -c 'import torch; from torch.utils.cpp_extension import CUDA_HOME; print(torch.cuda.is_available(), CUDA_HOME)'
and it return True, then I install mmcv by pip install mmcv-full==latest+torch1.7.0+cu110 -f https://download.openmmlab.com/mmcv/dist/index.html and install requirement then run setup.py. It's false.
I delele the repo, remove enviroment and try again with comment of @sanjmohan in this issue, this time I test with
CUDA_VISIBLE_DEVICES=0 python setup.py develop
It still false, after remove all, I do that again, follow #2882 , I put these lines inside setup.py
print('\n\n\n\n\n=======')
print(torch.cuda.is_available())
print('=======\n\n\n\n')

And it return True
In mmdetection, I create my custom dataset and custom configs
Environment
sys.platform: linux
Python: 3.7.9 (default, Aug 31 2020, 12:42:55) [GCC 7.3.0]
CUDA available: True
GPU 0: GeForce RTX 3090
CUDA_HOME: /usr
NVCC: Build cuda_11.0_bu.TC445_37.28540450_0
GCC: gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
PyTorch: 1.7.0
PyTorch compiling details: PyTorch built with:

GCC 7.3
C++ Version: 201402
Intel(R) Math Kernel Library Version 2020.0.2 Product Build 20200624 for Intel(R) 64 architecture applications
Intel(R) MKL-DNN v1.6.0 (Git Hash 5ef631a030a6f73131c77892041042805a06064f)
OpenMP 201511 (a.k.a. OpenMP 4.5)
NNPACK is enabled
CPU capability usage: AVX2
CUDA Runtime 11.0
NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_37,code=compute_37
CuDNN 8.0.3
Magma 2.5.2
Build settings: BLAS=MKL, BUILD_TYPE=Release, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DUSE_VULKAN_WRAPPER -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, USE_CUDA=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON,

TorchVision: 0.8.1
OpenCV: 4.4.0
MMCV: 1.2.0
MMCV Compiler: GCC 7.3
MMCV CUDA Compiler: not available
MMDetection: 2.6.0+8179440
Error traceback
  File "tools/test.py", line 208, in <module>
    main()
  File "tools/test.py", line 178, in main
    args.show_score_thr)
  File "/home/giang/Desktop/test/mmdetection/mmdet/apis/test.py", line 27, in single_gpu_test
    result = model(return_loss=False, rescale=True, **data)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/mmcv/parallel/data_parallel.py", line 42, in forward
    return super().forward(*inputs, **kwargs)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/parallel/data_parallel.py", line 159, in forward
    return self.module(*inputs[0], **kwargs[0])
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/mmcv/runner/fp16_utils.py", line 84, in new_func
    return old_func(*args, **kwargs)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/detectors/base.py", line 182, in forward
    return self.forward_test(img, img_metas, **kwargs)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/detectors/base.py", line 159, in forward_test
    return self.simple_test(imgs[0], img_metas[0], **kwargs)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/detectors/two_stage.py", line 191, in simple_test
    x = self.extract_feat(img)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/detectors/two_stage.py", line 82, in extract_feat
    x = self.backbone(img)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/backbones/detectors_resnet.py", line 283, in forward
    outs = list(super(DetectoRS_ResNet, self).forward(x))
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/backbones/resnet.py", line 635, in forward
    x = res_layer(x)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/container.py", line 117, in forward
    input = module(input)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/backbones/resnet.py", line 296, in forward
    out = _inner_forward(x)
  File "/home/giang/Desktop/test/mmdetection/mmdet/models/backbones/resnet.py", line 273, in _inner_forward
    out = self.conv2(out)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/mmcv/ops/saconv.py", line 104, in forward
    self.dilation, self.groups, 1)
  File "/home/giang/anaconda3/envs/four/lib/python3.7/site-packages/mmcv/ops/deform_conv.py", line 98, in forward
    im2col_step=cur_im2col_step)
RuntimeError: DeformConv is not compiled with GPU support

Your MMCV is not successfully compiled in your environment. You need to re-install your MMCV in the environment with a GPU, with the command MMCV_WITH_OPS=1 pip install -e ..

/Desktop/mmdetection$ MMCV_WITH_OPS=1 pip install -e .
Obtaining file:///home/giang/Desktop/mmdetection
Requirement already satisfied: matplotlib in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmdet==2.6.0) (3.3.3)
Requirement already satisfied: mmpycocotools in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmdet==2.6.0) (12.0.3)
Requirement already satisfied: numpy in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmdet==2.6.0) (1.19.2)
Requirement already satisfied: six in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmdet==2.6.0) (1.15.0)
Requirement already satisfied: terminaltables in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmdet==2.6.0) (3.1.0)
Requirement already satisfied: kiwisolver>=1.0.1 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from matplotlib->mmdet==2.6.0) (1.3.1)
Requirement already satisfied: pillow>=6.2.0 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from matplotlib->mmdet==2.6.0) (8.0.1)
Requirement already satisfied: cycler>=0.10 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from matplotlib->mmdet==2.6.0) (0.10.0)
Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.3 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from matplotlib->mmdet==2.6.0) (2.4.7)
Requirement already satisfied: python-dateutil>=2.1 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from matplotlib->mmdet==2.6.0) (2.8.1)
Requirement already satisfied: setuptools>=18.0 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmpycocotools->mmdet==2.6.0) (50.3.1.post20201107)
Requirement already satisfied: cython>=0.27.3 in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmpycocotools->mmdet==2.6.0) (0.29.21)
Installing collected packages: mmdet
  Attempting uninstall: mmdet
    Found existing installation: mmdet 2.6.0
    Uninstalling mmdet-2.6.0:
      Successfully uninstalled mmdet-2.6.0
  Running setup.py develop for mmdet
Successfully installed mmdet

It is success but the problem still there: RuntimeError: DeformConv is not compiled with GPU support

You should go to the directory of MMCV, and install MMCV by MMCV_WITH_OPS=1 pip install -e ..

I try and it return new problem, can you take a look
Obtaining file:///home/giang/Desktop/mmcv
Requirement already satisfied: addict in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmcv-full==1.2.2) (2.4.0)
Requirement already satisfied: numpy in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmcv-full==1.2.2) (1.19.2)
Requirement already satisfied: Pillow in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmcv-full==1.2.2) (8.0.1)
Requirement already satisfied: pyyaml in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmcv-full==1.2.2) (5.3.1)
Requirement already satisfied: yapf in /home/giang/anaconda3/envs/working/lib/python3.7/site-packages (from mmcv-full==1.2.2) (0.30.0)
Installing collected packages: mmcv-full
  Attempting uninstall: mmcv-full
    Found existing installation: mmcv-full 1.2.0
    Uninstalling mmcv-full-1.2.0:
      Successfully uninstalled mmcv-full-1.2.0
  Running setup.py develop for mmcv-full
    ERROR: Command errored out with exit status 1:
     command: /home/giang/anaconda3/envs/working/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/giang/Desktop/mmcv/setup.py'"'"'; __file__='"'"'/home/giang/Desktop/mmcv/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps
         cwd: /home/giang/Desktop/mmcv/
    Complete output (111 lines):
    running develop
    running egg_info
    creating mmcv_full.egg-info
    writing mmcv_full.egg-info/PKG-INFO
    writing dependency_links to mmcv_full.egg-info/dependency_links.txt
    writing requirements to mmcv_full.egg-info/requires.txt
    writing top-level names to mmcv_full.egg-info/top_level.txt
    writing manifest file 'mmcv_full.egg-info/SOURCES.txt'
    reading manifest file 'mmcv_full.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    writing manifest file 'mmcv_full.egg-info/SOURCES.txt'
    running build_ext
    building 'mmcv._ext' extension
    creating /home/giang/Desktop/mmcv/build
    creating /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7
    creating /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv
    creating /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops
    creating /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc
    creating /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch
    Emitting ninja build file /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/build.ninja...
    Compiling objects...
    Using envvar MAX_JOBS (4) as the number of workers...
    [1/40] /usr/bin/nvcc -DMMCV_WITH_CUDA -I/home/giang/Desktop/mmcv/mmcv/ops/csrc -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/TH -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/THC -I/home/giang/anaconda3/envs/working/include/python3.7m -c -c /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/psamask_cuda.cu -o /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/psamask_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=sm_86 -std=c++14
    FAILED: /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/psamask_cuda.o
    /usr/bin/nvcc -DMMCV_WITH_CUDA -I/home/giang/Desktop/mmcv/mmcv/ops/csrc -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/TH -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/THC -I/home/giang/anaconda3/envs/working/include/python3.7m -c -c /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/psamask_cuda.cu -o /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/psamask_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=sm_86 -std=c++14
    nvcc fatal   : Unsupported gpu architecture 'compute_86'
    [2/40] /usr/bin/nvcc -DMMCV_WITH_CUDA -I/home/giang/Desktop/mmcv/mmcv/ops/csrc -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/TH -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/THC -I/home/giang/anaconda3/envs/working/include/python3.7m -c -c /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/carafe_cuda.cu -o /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/carafe_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=sm_86 -std=c++14
    FAILED: /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/carafe_cuda.o
    /usr/bin/nvcc -DMMCV_WITH_CUDA -I/home/giang/Desktop/mmcv/mmcv/ops/csrc -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/TH -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/THC -I/home/giang/anaconda3/envs/working/include/python3.7m -c -c /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/carafe_cuda.cu -o /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/carafe_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_86,code=sm_86 -std=c++14
    nvcc fatal   : Unsupported gpu architecture 'compute_86'
    [3/40] c++ -MMD -MF /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/nms_rotated.o.d -pthread -B /home/giang/anaconda3/envs/working/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DMMCV_WITH_CUDA -I/home/giang/Desktop/mmcv/mmcv/ops/csrc -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/TH -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/THC -I/home/giang/anaconda3/envs/working/include/python3.7m -c -c /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/nms_rotated.cpp -o /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/nms_rotated.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    In file included from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/ATen/Parallel.h:149:0,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:12,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                     from /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch_cpp_helper.hpp:3,
                     from /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/nms_rotated.cpp:4:
    /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/ATen/ParallelOpenMP.h:84:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
     #pragma omp parallel for if ((end - begin) >= grain_size)

    [4/40] c++ -MMD -MF /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/tin_shift.o.d -pthread -B /home/giang/anaconda3/envs/working/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DMMCV_WITH_CUDA -I/home/giang/Desktop/mmcv/mmcv/ops/csrc -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/TH -I/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/THC -I/home/giang/anaconda3/envs/working/include/python3.7m -c -c /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/tin_shift.cpp -o /home/giang/Desktop/mmcv/build/temp.linux-x86_64-3.7/mmcv/ops/csrc/pytorch/tin_shift.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    In file included from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/ATen/Parallel.h:149:0,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:12,
                     from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                     from /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch_cpp_helper.hpp:3,
                     from /home/giang/Desktop/mmcv/mmcv/ops/csrc/pytorch/tin_shift.cpp:1:
    /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/include/ATen/ParallelOpenMP.h:84:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
     #pragma omp parallel for if ((end - begin) >= grain_size)

    ninja: build stopped: subcommand failed.
    Traceback (most recent call last):
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/utils/cpp_extension.py", line 1522, in _run_ninja_build
        env=env)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/subprocess.py", line 512, in run
        output=stdout, stderr=stderr)
    subprocess.CalledProcessError: Command '['ninja', '-v', '-j', '4']' returned non-zero exit status 1.

    The above exception was the direct cause of the following exception:

    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/home/giang/Desktop/mmcv/setup.py", line 213, in <module>
        zip_safe=False)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/setuptools/__init__.py", line 153, in setup
        return distutils.core.setup(**attrs)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/dist.py", line 966, in run_commands
        self.run_command(cmd)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/setuptools/command/develop.py", line 34, in run
        self.install_for_development()
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/setuptools/command/develop.py", line 136, in install_for_development
        self.run_command('build_ext')
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/dist.py", line 985, in run_command
        cmd_obj.run()
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/setuptools/command/build_ext.py", line 79, in run
        _build_ext.run(self)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/Cython/Distutils/old_build_ext.py", line 186, in run
        _build_ext.build_ext.run(self)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/command/build_ext.py", line 340, in run
        self.build_extensions()
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/utils/cpp_extension.py", line 653, in build_extensions
        build_ext.build_extensions(self)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/Cython/Distutils/old_build_ext.py", line 195, in build_extensions
        _build_ext.build_ext.build_extensions(self)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/command/build_ext.py", line 449, in build_extensions
        self._build_extensions_serial()
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/command/build_ext.py", line 474, in _build_extensions_serial
        self.build_extension(ext)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/setuptools/command/build_ext.py", line 196, in build_extension
        _build_ext.build_extension(self, ext)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/distutils/command/build_ext.py", line 534, in build_extension
        depends=ext.depends)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/utils/cpp_extension.py", line 482, in unix_wrap_ninja_compile
        with_cuda=with_cuda)
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/utils/cpp_extension.py", line 1238, in _write_ninja_file_and_compile_objects
        error_prefix='Error compiling objects for extension')
      File "/home/giang/anaconda3/envs/working/lib/python3.7/site-packages/torch/utils/cpp_extension.py", line 1538, in _run_ninja_build
        raise RuntimeError(message) from e
    RuntimeError: Error compiling objects for extension
    ----------------------------------------
  Rolling back uninstall of mmcv-full
  Moving to /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/mmcv/
   from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/~mcv
  Moving to /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/mmcv_full-1.2.0.dist-info/
   from /home/giang/anaconda3/envs/working/lib/python3.7/site-packages/~mcv_full-1.2.0.dist-info
ERROR: Command errored out with exit status 1: /home/giang/anaconda3/envs/working/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/giang/Desktop/mmcv/setup.py'"'"'; __file__='"'"'/home/giang/Desktop/mmcv/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps Check the logs for full command output.

I had the same problem
GPU 0: GeForce RTX 3080
CUDA:11.1

@sundaykingg  yes, my process raises a lot of bugs since I change to the 30XX series, even some bug with windows and Pytorch, I guess we have to wait until all the hardware match together, maybe this problem is out of MMDetection team's scope. If I was you I will downgrade to CUDA 11, it seems like there is not so much software support CUDA 11.1 now

hi,can you try this way? https://github.com/open-mmlab/mmdetection/issues/4165

@sundaykingg  I meet the bug above while trying to build mmcv from the source.

It is caused by the 30xx GPUs. Please see the issue https://github.com/open-mmlab/mmdetection/issues/4165 and our FAQ about this problem.


Add istio.io/rev label to istio-cni

Q
A

Bug fix?
yes

New feature?
no

API breaks?
no

Deprecations?
no

Related tickets
fixes image pull failure when used with imps-controller

License
Apache 2.0

What's in this PR?
Add istio.io/rev label to istio-cni which can match with imps-controller rules to allow pull-secrets to be used by istio-system namespace
Why?
istio-cni image pull failure issue will be resolved in Calisti
Checklist

[x] Implementation tested
[x] Error handling code meets the guideline
[x] Logging code meets the guideline
[x] User guide and development docs updated (if needed)

This doesn't seem to be justified based on the conversation here so far: https://github.com/istio/istio/pull/43715
(For our internal use case, I suggested a different solution in our appropriate Jira ticket.)

This doesn't seem to be justified based on the conversation here so far: istio/istio#43715
(For our internal use case, I suggested a different solution in our appropriate Jira ticket.)

This PR is still in Draft which was done last week. So making the changes today ask per your review request on Jira. Thanks, Laci.

Fixed this in the downstream repo, so this PR is not required anymore for Cisco Calisti


Add bazel build configs for cpu type 'x64_windows_msvc'

Without this fix, the final generated whl file will contain a '_pywrap_tensorflow_internal.so' instead of '_pywrap_tensorflow_internal.pyd'

Can one of the admins verify this patch?

@snnn This change looks good to me, but after https://github.com/tensorflow/tensorflow/commit/08ed32dbb9e8f67eec9efce3807b5bdb3933eb2f, with Bazel 0.5.0 or later version you don't need --cpu=x64_windows_msvc to build TensorFlow anymore.
And it will be deprecated in future.

got it.


Does ZMQ support communication between multi-machines ?

Thanks for your amazing A3C examples~
I want to expand this algorithm between machines, which means I want to launch many simulators in different machines and collect their data and run batch version A3C.So I have to solve the data communication between machines.
Does ZMQ support communication between multi-machines ?

Yes, ZMQ can works well with windows and mac.
but the latency between machine is the biggest issues as far as I can tell

Yes.
This is not a tensorpack question. I'll close it if there is no more questions.


Content definition IDs section is unclear

The purpose of the "Content definition IDs" section at https://docs.microsoft.com/en-us/azure/active-directory-b2c/contentdefinitions#content-definition-ids is unclear. Is it saying that the standard downloadable BasePolicy file includes these definitions (it only includes some of them, FWIW)? Or that you do not need these elements in your policy file hierarchy because the IEF runtime auto-declares them (doubtful)? Or if you're trying to accomplish one of these actions, you are strictly REQUIRED to use these IDs?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5da541cb-72b5-7971-3c58-8bd3fe546369
Version Independent ID: 377d8d53-cf44-5a3a-d431-1823bdd17be0
Content: ContentDefinitions - Azure Active Directory B2C
Content Source: articles/active-directory-b2c/contentdefinitions.md
Service: active-directory
Sub-service: b2c
GitHub Login: @mmacy
Microsoft Alias: marsma

@dotnetgator
Thanks for the feedback! I have assigned the issue to the content author to investigate further and update the document as appropriate.

The table lists the most common of content definition Ids used by custom policy, and the page types that relate to them. You don't need to create content definitions, since the starter pack contains most of them. But as mention in the doc The following table describes the set of content definition IDs that is recognized by the Identity Experience Framework, and the page types that relate to them. You can create your own content definitions with an arbitrary ID..

Content definitions provide the ability to modify the page content. Thus if a technical profile references a content definition, you are telling IEF that it will be customized based off of one. In that case, you must supply the content definition. That is why the starter pack does include the use of all of these, because none of the technical profiles reference it.
"Or if you're trying to accomplish one of these actions, you are strictly REQUIRED to use these IDs?"
This is more correct, if for example you are using the Multi Factor page (technical profile), you'd want to reference the phonefactor content definition to begin with.
We will link sample usage which better describes the usage for this reference.

#please-close


PythonJob use task name as process label

Provide an input process_label so that the user can set the process label manually. In case of WorkGraph, the process label will be set as: PythonJob<{task['name']}

Very nice! Unfortunately, you missed a closing bracket 😅
inputs = {
        "process_label": f"PythonJob<{task['name']}",    <------------------ missing >
        "function_source_code": orm.Str(function_source_code),
        "function_name": orm.Str(function_name),
        "code": code,
        "function_kwargs": function_kwargs,
        "upload_files": new_upload_files,
        "output_info": orm.List(output_info),
        "metadata": metadata,
        **kwargs,
    }


MSTransferor fails to send alerts through Alertmanager

Impact of the bug
MStransferor
Describe the bug
Following the lead from this Jira ticket [1] we figured out that in some cases MSTransferor fails to send alerts through the newly established mechanism with the AlertManager as a mediator for the alerts.
Based on the trace provided in the Jira ticket [3] the MSTransferror is just trying to generate an alert for a big dataset (nothing unusual so far), but the url to the Alertmanager itself has been lost somewhere on the way. As mentioned also in this stackoverflow reply [2] this type of badly expressed error is generated by pycurl when the url is None. I hope this is lost somewhere up in the chain but not in the @portForward decorator.
Another critical question that needs to be answered is whether MSTransferor keeps creating input rules over and over for the same input data, similarly to a previously observed cases.
How to reproduce it
To be investigated what exactly has triggered the bug.
Expected behavior
A clear and concise description of what you expected to happen.
Additional context and error message
[1]
https://its.cern.ch/jira/browse/CMSCOMPPR-18772
[2]
https://stackoverflow.com/a/34402229
[3]
2021-04-21 06:14:09,570:ERROR:MSTransferor: Unknown exception while making Transfer Request for pdmvserv_task_TOP-RunIISummer20UL17MiniAODv2-00043__v1_T_210414_061607_9526     Error: unsetopt() is not supported for this option
Traceback (most recent call last):
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/MicroService/MSTransferor/MSTransferor.py", line 208, in execute
    success, transfers = self.makeTransferRequest(wflow)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/MicroService/MSTransferor/MSTransferor.py", line 628, in makeTransferRequest
    blocks, dataSize, nodes, idx)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/MicroService/MSTransferor/MSTransferor.py", line 727, in makeTransferRucio
    self.notifyLargeData(aboveWarningThreshold, transferId, wflow.getName(), dataSize, dataIn)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/MicroService/MSTransferor/MSTransferor.py", line 755, in notifyLargeData
    self.alertManagerApi.sendAlert(alertName, alertSeverity, alertSummary, alertDescription, self.alertServiceName)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/Services/AlertManager/AlertManagerAPI.py", line 93, in sendAlert
    res = self.mgr.getdata(self.alertManagerUrl, params=params, headers=self.headers, verb='POST')
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/Services/pycurl_manager.py", line 316, in getdata
    encode=encode, decode=decode, cookie=cookie)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/Utils/PortForward.py", line 69, in portMangle
    return callFunc(callObj, url, *args, **kwargs)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/Services/pycurl_manager.py", line 280, in request
    verbose, verb, doseq, encode, cainfo, cookie)
  File "/data/srv/HG2104e/sw/slc7_amd64_gcc630/cms/reqmgr2ms/0.4.7.pre8/lib/python2.7/site-packages/WMCore/Services/pycurl_manager.py", line 221, in set_opts
    curl.setopt(pycurl.URL, encodeUnicodeToBytes(url))
TypeError: unsetopt() is not supported for this option

The bad news is that the so mentioned Error is repeated every 10 min. If it is preceded  by any and what type of rule creation is still to be investigated.

Todor, I still can't understand the real issue here, but looking at traceback I can see that your codebase is stateful, e.g. it uses  self.alertManagerUrl member data. If you run multithreaded code, or pass object around its member data may be overwritten, lost, whatever. Without knowing default constructor of the class and how you initialize it, it is hard to say what is the value of url you trying to reach. My suggestion check the class itself and how it is initialized. Better, do not create class with url which makes it stateful. Instead make class that it will accept url and input data to send to. Then you can use stateless class instance and pass around url and JSON payload.

Hi @vkuznet ,
Thanks for the feedback. This:

If you run multithreaded code, or pass object around its member data may be overwritten, lost, whatever

is kind of surprising to me. I was not aware it may happen for a uniquely defined value in the object. I may expect other kind of conditions that could lead to such member data loss regarding volatile data in the object, but this is a value set at the construction time and never attempted to be changed any more [1].

Better, do not create class with url which makes it stateful. Instead make class that it will accept url and input data to send to

IIUC our case is more or less what you mean here. The AlerManagerUrl is supposed to be fetched from msConfig in our case. And indeed that is the cause of the error in the current case. The url is missing from the configuration: [2], because we somehow forgot that configuration change during the last deployment. Which leads me to my next question. What should that url be? :smile:
[1]
https://github.com/dmwm/WMCore/blob/5da7f3c898bb39cdb7efb64070af182419501602/src/python/WMCore/Services/AlertManager/AlertManagerAPI.py#L22-L23
[2]
https://gitlab.cern.ch/cmsweb-k8s/services_config/-/blob/prod/reqmgr2ms-transferor/config-transferor.py


pip3 installation issue

face_recognition version: latest
Python version: 3
Operating System:  Ubuntu 16.04 LTS

Description
Trying to install on Ubuntu
What I Did
Simply installing using pip3
CMake Warning at /usr/share/cmake-3.5/Modules/FindBoost.cmake:725 (message):
      Imported targets not available for Boost version
    Call Stack (most recent call first):
      /usr/share/cmake-3.5/Modules/FindBoost.cmake:763 (_Boost_COMPONENT_DEPENDENCIES)
      /usr/share/cmake-3.5/Modules/FindBoost.cmake:1332 (_Boost_MISSING_DEPENDENCIES)
      /tmp/pip-build-2ug_z9pf/dlib/dlib/cmake_utils/add_python_module:61 (FIND_PACKAGE)

You probably need to install boost. There should be specific instructions for Ubuntu/Linux on their site but I found installation instructions next to error itself.


[QUESTION] Replicating HEAD without snapshot to avoid 2x disk usage?

Question
Hello, I'm running Longhorn on my cluster, and I have a PVC which holds prometheus data (let's say 100GiB). This volume has a replica count of 3. I wonder why does Longhorn need to create a snapshot of my data. Can't Longhorn be configured so that it only keeps the head, and replicate that on the other nodes? Apparently this is how it works until the first replica failure, when Longhorn automatically creates a system/hidden snapshot, which might use another 100 GiB and can not be deleted.
I understand that Longhorn has it's way of doing things, but I'm thinking about MySQL replication for example. If I have a 100GiB database replicated on 3 nodes, it only takes 100 GiB on each node, not 200 GiB on each node.
I'm not sure what am I missing, why Longhorn needs to keep a snapshot instead of just replicating the head. Sure, I understand that snapshots are required in some situations, but in my case(keeping historical data), I don't need snapshots - historical data will not change.
Environment

Longhorn version: 1.2.3
Kubernetes version: 1.23.5
Underlying Infrastructure: Baremetal

Thank you !

It seems I managed to better understand how this works, and I think I have a good enough answer to my question.
It seems that the HEAD is only holding "new" data, after the last snapshot. When there is no snapshot, all the data is in the HEAD. When a snapshot is created, all the data is moved from the HEAD into the snapshot, and the HEAD size drops to 0 bytes. The fact that HEAD size drops to 0 is an important aspect for me, because that means that I had a poor understanding / bad image in my head.
It seems that what I wanted (only store 1x the data, not 2x) can be achieved but not by removing the snapshot from the picture. But, by creating a snapshot more often. Because all "new data" accumulated in the last 5 minutes or so, will be applied to the last snapshot, and the HEAD will drop back to 0. Thus, staying (possibly) just a bit over 100% actual size. For example the actual size of a 100GiB volume, with a snapshot of 99.8 GiB and a HEAD of 2 GiB, might be ~102%, but it will drop back to ~100% as soon as I recreate (and merge) a snapshot.
So, when a snapshot is created, all the data is moved from the HEAD into a snapshot, and head is recreated from 0 bytes. Then this newly created snapshot will have exactly the same size as the HEAD. Be it 2GiB, to continue the previous example. But, when we merge this new snapshot with the old/previous snapshot(99.8GiB), the new, resulting snapshot will not be of size (99.8 + 2) GiB, but instead it will probably be 99.9 GiB or so. That is because a huge part of the data/sectors/bytes(not sure) from the new snapshot will overwrite part of the old snapshot. Thus, these will not increase the snapshot size, when applied on the old snapshot. And only a very tiny amount of data from the new snapshot will be appended, will increase the old(newly created by merge) snapshot. And it's important to notice that both the snapshot(s) and the HEAD are limited to your original allocation(100GiB in my case) - so neither can grow above that amount.
So, a recap. Even if I end up using 2x the disk space, 2 x 100GiB, once for the 100GiB snapshot and another piece of 100GiB for the HEAD, this whole 200GiB can easily be reduced to just 100GiB by creating a snapshot. A new snapshot(merged with the previous one) will result in a snapshot of 100GiB and a HEAD of ~0bytes(continuously increasing).
So, it's best to schedule snapshots often, to keep your actual disk usage as close as possible to the original allocated disk space. Also, keeping a retention of only 1 will make sure to merge your snapshots into only 1 instance. On the other hand you might want to avoid taking snapshots too often, as this might create a pressure on the CPU/disk/etc (not sure). I started with a snapshot every 10 minutes, but I'll adjust it as needed in time.
I thought I'd let "my" explanation here for the future, if someone else might be in my position and understand it.
Thank you!

Hi @paul-grozav
The system snapshots are usually created when one of the replicas of the volume crash. Longhorn will take a system snapshot to rebuild the failed replica. Longhorn needs to take a system snapshot before rebuilding because it is not possible to copy the live volume head which is being written by the application layer.
I do see your concern about space usage. Something you can do to mitigate this issue:

Create a snapshot recurring snapshot job that have retain count set 1 (instruction). This will periodically take/delete snapshots so that the volume has 2 snapshots. This mean that 100Gb volume may go up to 200Gb but not more than that.

We are also working on another feature that allows the users to collapse the volume head with its parent snapshot. This might further improve space usage. But it is not here yet


split confusion

I'm unclear about what the docs are saying about 'splitting'. Can someone explain better? This doesn't seem grammatical to me

The separator option allows you to change what the key gets split via for nested objects. It also allows you to stop counterpart splitting keys if you have a flat object structure:

Hi Max,
let's assume you have the following translation registered:
{
  en: {
    foo: {
      bar: 'baz'
    }
  }
}

As the dot (.) is the default separator, you can get the value of the translation by simply calling
translate('foo.bar', { locale: 'en' }) //=> 'baz'

If for whatever reason you cannot use the dot character (perhaps because you already use it as part of the individual (sub)keys), you can switch to a different separator character like this:
translate('foo/bar', { locale: 'en', separator: '/' }) //=> 'baz'

I hope this answers you question. If not, please let me know!


Appstudio update test-component-pac-yimf

Pipelines as Code configuration proposal
To start the PipelineRun, add a new comment with content /ok-to-test
For more detailed information about running a PipelineRun, please refer to Pipelines as Code documentation Running the PipelineRun
To customize the proposed PipelineRuns after merge, please refer to Build Pipeline customization

Pipelines as Code CI/test-component-pac-yimf-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
8 seconds
init

✅ Succeeded
18 seconds
clone-repository

✅ Succeeded
34 seconds
build-container

✅ Succeeded
29 seconds
inspect-image

✅ Succeeded
29 seconds
deprecated-base-image-check

✅ Succeeded
1 minute
clamav-scan

✅ Succeeded
2 minutes
clair-scan

✅ Succeeded
11 seconds
sbom-json-check

✅ Succeeded
37 seconds
label-check

✅ Succeeded
8 seconds
show-sbom

✅ Succeeded
10 seconds
show-summary


:books: Correct on-the-fly event creation documentation

Problem:

The documentation for creating an event on the fly contains a typo,
which causes confusion on the part of new users.

Solution:

Correct the typo.

thanks, @cmotl :+1:


Hotstar downloading is not working properly

When i was trying to download video from hotstar manually by Youtubedl is getting 403 error.
Here is the complete youtube-dl output for hotstar video:
(venv) [root@103-211-219-47 vd]# youtube-dl --verbose https://www.hotstar.com/sports/cricket/vivo-ipl-2018/chennai-super-kings-vs-sunrisers-hyderabad-m186561/match-clips/mighty-csk-boss-srh-for-third-title/2001614574
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.hotstar.com/sports/cricket/vivo-ipl-2018/chennai-super-kings-vs-sunrisers-hyderabad-m186561/match-clips/mighty-csk-boss-srh-for-third-title/2001614574']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.03.18
[debug] Python version 3.6.6 (CPython) - Linux-3.10.0-862.3.2.el7.x86_64-x86_64-with-centos-7.6.1810-Core
[debug] exe versions: none
[debug] Proxy map: {}
[hotstar]<PHONE_NUMBER>: Downloading webpage
[hotstar]<PHONE_NUMBER>: Downloading JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/root/vd/venv/lib64/python3.6/site-packages/youtube_dl/extractor/common.py", line 626, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/root/vd/venv/lib64/python3.6/site-packages/youtube_dl/YoutubeDL.py", line 2225, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib64/python3.6/urllib/request.py", line 532, in open
response = meth(req, response)
File "/usr/lib64/python3.6/urllib/request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib64/python3.6/urllib/request.py", line 570, in error
return self._call_chain(*args)
File "/usr/lib64/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/usr/lib64/python3.6/urllib/request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)

It's geo restricted.

But some days ago it was working. Suddenly it is not working now.
There are 2-3 geo restriction which is working good.


Add author organization

Add the author organization to the pull requests mart table and use it in the dashboard for the filter. Resolve #39

Soda scan seems to fail @JCZuurmond


feat: add type and status mappings to jira plugin

Summary
Key Points

[ ] This is a breaking change
[ ] New or existing documentation is updated

Description

Added tag inputs for Type Mapping and Status Mapping sections in jira plugin
Modified plugin/component layout (plugins are now in folders ex: /plugins/jira/index.jsx) - this way we can contain all relevant components inside as well
Added ability for custom status mappings (ex: add "Epic" status to env with custom rejected and resolved tags)
Ability to read from env file type/status/custom status into ui

Does this close any open issues?
Closes, aside from missing validation and some tests which are next
https://github.com/merico-dev/lake/issues/399
Current Behavior
Type/status mappings are done in text inputs, and hard to interpret
New Behavior
Type/status mappings done in a new way in tag inputs, with additional dynamic custom tags for status
Screenshots

@joncodo @hezyin updated text and labels on here, ready for review


Add github actions oidc client

Signed-off-by: Appu Goundan<EMAIL_ADDRESS>I don't think will work yet, might need to make the oidc token available in test

You mean it won't work locally?

You mean it won't work locally?
yes and also not in CI cause I'm not sure what I'm doing, this needs to be a draft.

I did it, I'm a genius


Why you not use javaassist or asm to slove inject problem

Now i dev function about route in android with apt, i find many work  about apt to solve inject problem with reflect.Perhaps this will affect the performance, and use proguard.

For example,In ButterKnife

I Use javaassist in route link this,

Many People not use this,Maybe there is a reason，Please tell me
PS：Sorry，Forgive my poor English，My opinion may be  clear

Annotation processors cannot modify existing class files. That requires a Gradle plugin which I don't want to build.
There's an even easier zero-reflection mechanism for using Butter Knife: reference the generated code directly via new YourClass_ViewBinding(..).

I search about java reflection performance with google http://stackoverflow.com/questions/435553/java-reflection-performance
so only one object  instantiate，just more than 3ms，so it's  zero-reflection mechanism.
By the way, can  I use java assist  gradle plugin to solve this problem：

apt generate A class manager every sub module generate class in main module.

It bring other problems？or solve in other way?
Waiting for your Help,Thank Yout


add go mod to test to enable import from library repo

Add go.mod for the test directory to enable library repository tests to import from it.

@amisevsk the library repository needs to import from test/v200/utils/common as that is shared code with the library repository tests

the library repository needs to import from test/v200/utils/common as that is shared code with the library repository tests

Can't the library just import it from github.com/devfile/api/v2/test/v200/utils/common?

the library repository needs to import from test/v200/utils/common as that is shared code with the library repository tests

Can't the library just import it from github.com/devfile/api/v2/test/v200/utils/common?

Not unless the tests are moved under the pkg directory. What I added is similar to the /api/generator directory

not sure why we're vendoring the repo, is there a reason?

Just copied what other directories with go.mod do

I am held up by this, please approve, if you can't approve we better go back and revisit the generator directory.

@maysunfaisal the vendor directory has been removed.

Creating a new project with the go mod file
module test

go 1.14

require github.com/devfile/api/v2 v2.0.0-20210223145532-81859eaef987 // the current main commit

allows me to e.g. import commonUtils no problem:
package main

import (
	commonUtils "github.com/devfile/api/v2/test/v200/utils/common"
)

func main() {
	commonUtils.GetDevFileName()
}

No idea why this isn't importing automatically, I suspect it's a stale goproxy.

Playing with it a bit more, running go get -u github.com/devfile/api/v2@81859eaef987 in the library repo will fix the problem.

Playing with it a bit more, running go get -u github.com/devfile/api/v2@81859eaef987 in the library repo will fix the problem.

Thx, I switched to a new command window and that seem to fix the library issue importing validation too.

Creating a new project with the go mod file
module test

go 1.14

require github.com/devfile/api/v2 v2.0.0-20210223145532-81859eaef987 // the current main commit

allows me to e.g. import commonUtils no problem:
package main

import (
	commonUtils "github.com/devfile/api/v2/test/v200/utils/common"
)

func main() {
	commonUtils.GetDevFileName()
}

No idea why this isn't importing automatically, I suspect it's ~a stale goproxy.~ because the highest tagged release is https://github.com/devfile/api/releases/tag/v2.0.0, from Jan 18th. Making a submodule will have the same problem until a new tag is created or consumers manually set the version via commit (which is what we do in the DevWorkspace Operator)

OK, I have changed the module in go.sum to be just "test" and locally import from "api/v2/test" and everything appears to work for the tests in the api repository. Not sure I can test import into the library repository until this is merged.

After discussions with Angel (thank you) it appears that this PR is redundant, the api test directory does not need to create a module for the library repository to import it. Testing now, but closing this PR.


Custom Pricing Not Working on Product View

Custom pricing is working on the list view for products, but not on the actual product page.
List View Product Pricing:

Product View Pricing:

This is using the base Magento 2 Luma Theme.
If you hook into the catalog_product_load_after event it works.
<?xml version="1.0"?>
<config xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="urn:magento:framework:Event/etc/events.xsd">
    <event name="catalog_product_get_final_price">
        <observer name="customer_specific_pricing" instance="JustBetter\CustomerPricing\Observer\FinalPrice" />
    </event>
    <event name="catalog_product_collection_load_after">
        <observer name="custom_price_override_category" instance="JustBetter\CustomerPricing\Observer\CategoryPricing" />
    </event>
    <event name="catalog_product_load_after">
        <observer name="customer_specific_pricing" instance="JustBetter\CustomerPricing\Observer\FinalPrice" />
    </event>
</config>

Thank you for your feedback, could you make a PR to fix this?

Fixed by #4


Improves the dynamic providers docs page examples to reflect how to pass creds via env variables and configuration.

Proposed changes

The dynamic providers page has examples that do not show best practices for passing in secrets. This update modifies the github example to use the (new) configure() interface.
It also removes the simple configure() example that was added with the docs update to add the interface.
Unreleased product version (optional)

Related issues (optional)

@MitchellGerdisch and @julienp ... does this PR take the place of this previous PR: https://github.com/pulumi/docs/pull/13276 ? or should they both be merged?

I built this PR on top of Julien's branch, so I think we don't need to or want to merge PR #13276

Happy to merge this and close my PR, thanks @MitchellGerdisch !


Add caching for kernel compilations to decrease compile times for duplicated devices.

Good for initialization performance and development time.

Use kernel code as key and the generated binary as value.


fix Fix incorrect _max_thread_num in scanner context when many queries are running.

Minor refactor for scanner constructor, calculation of _max_thread_num is moved to init method
The expected value of _max_thread_num is changed. There is no need to submit too many scan task to scan scheduler, since thread num is limited.
Calculation of _max_bytes_in_queue is changed. _max_bytes_in_queue for each scan instance is limited to 100MB by default.

mysql [tpch]>select count(*) from supplier;
--------------
select count(*) from supplier
--------------

+----------+
| count(*) |
+----------+
|  1000000 |
+----------+
1 row in set (0.04 sec)

mysql [tpch]>select count(*) from revenue0;
--------------
select count(*) from revenue0
--------------

+----------+
| count(*) |
+----------+
|  1000000 |
+----------+
1 row in set (0.19 sec)

To illustrate the effect, we need to create much scanners, so
set global experimental_parallel_scan_min_rows_per_scanner=29715

default value is 2097152,  we can make scanner num almost equal to experimental_parallel_scan_max_scanners_count which is 48.
Lets use mysqlslap to do concurrent test.
Current master:
[hezhiqiang@VM-10-8-centos be_1]$ mysqlslap -hxxxx -uroot -Pyyyy  --create-schema=tpch -c 20 -i 5 -q "select     s_suppkey,     s_name,     s_address,     s_phone,     total_revenue from     supplier,     revenue0 where     s_suppkey = supplier_no     and total_revenue = (         select             max(total_revenue)         from             revenue0     ) order by     s_suppkey;"
Benchmark
	Average number of seconds to run all queries: 12.480 seconds
	Minimum number of seconds to run all queries: 12.159 seconds
	Maximum number of seconds to run all queries: 12.843 seconds
	Number of clients running queries: 20
	Average number of queries per client: 1

[hezhiqiang@VM-10-8-centos be_1]$ mysqlslap -hyyyy -uroot -Pyyyy  --create-schema=tpch -c 25 -i 5 -q "select     s_suppkey,     s_name,     s_address,     s_phone,     total_revenue from     supplier,     revenue0 where     s_suppkey = supplier_no     and total_revenue = (         select             max(total_revenue)         from             revenue0     ) order by     s_suppkey;"
mysqlslap: Cannot run query select     s_suppkey,     s_name,     s_address,     s_phone,     total_revenue from     supplier,     revenue0 where     s_suppkey = supplier_no     and total_revenue = (         select             max(total_revenue)         from             revenue0     ) order by     s_suppkey;
ERROR : errCode = 2, detailMessage = (<IP_ADDRESS>)[TOO_MANY_TASKS]Failed to submit scanner to scanner pool reason:Thread pool Scan_normal is at capacity (192/192 tasks running, 102400/102400 tasks queued)|type:0

After this pr
[hezhiqiang@VM-10-8-centos lib]$ mysqlslap -hxxx -uroot -Pxxx  --create-schema=tpch -c 50 -i 5 -q "select     s_suppkey,     s_name,     s_address,     s_phone,     total_revenue from     supplier,     revenue0 where     s_suppkey = supplier_no     and total_revenue = (         select             max(total_revenue)         from             revenue0     ) order by     s_suppkey;"
Benchmark
	Average number of seconds to run all queries: 31.520 seconds
	Minimum number of seconds to run all queries: 30.164 seconds
	Maximum number of seconds to run all queries: 34.131 seconds
	Number of clients running queries: 50
	Average number of queries per client: 1

The max concurrency increased from 25 to 50.


Document the integration test framework

Summary

Document the integration test framework's API in order to provide context and guidance on how to use it to write tests.
Acceptance Criteria

[ ] The test-framework has preliminary documentation that provides guidance on how to use it to write tests.

For Admin Use

[x] Not duplicate issue
[x] Appropriate labels applied
[ ] Appropriate milestone (priority) applied
[ ] Appropriate contributors tagged
[x] Contributor assigned/self-assigned

Will the integration test framework become superseded due to the new Hermes (context-generic-based) architecture? If so, not sure we should beef up the docs at this point.
Copying @soareschen and @ljoss17.

We could write new tests for the new relayer with more abstract tests, and probably even do model checking using Kani. But the current priority is on the relayer implementation, so new testing infrastructure will likely take at least half year to complete, and existing code will still need to be tested with the current test framework. So it might still be worthwhile to add some documentation and have more dev sessions on it.

Let's kick off this? At least a first iteration.


Strip Path Enabled on creation of Route

When creating a new route in Konga 11.2 if you toggle the 'Strip Path' to NO, upon submitting changes the 'Strip Path' setting will be submitted as YES (Default). If  you then modify the existing route and set the toggle back to NO the settings save correctly. There does not appear to be a problem with the "Preserve Host" toggle just below it.

@rnoons , thanks for the heads up.
Will be fixed in the upcoming version


serve-static looking in incorrect path for file (on Windows 10 anyway)

I am having a weird problem, which I can reproduce using the standard express skeleton project as well as my own project.  I am using the latest version of serve-static and express
If I pass 'public' in as in
app.use(express.static(path.join(__dirname, 'public')));
Then serve-static will append another 'public' to the file path it uses to grab the file.  So if my node project is in C:\MyNodeApp and I request the file http://localhost/public/myImage.jpg then serve-static will look for the file C:\MyNodeApp\public\public\myImage.jpg (not double 'public' in the directory path)
I am using Windows 10 64 bit
My work-around is to create a 'public' folder within my 'public' folder.
Thanks
Chris

Hi! Yes, this is how Express app.use works. Based on what you are trying to do, have public actually be in the URL, you want to use this app.use statement instead of what you are using above:
app.use('/public', express.static(path.join(__dirname, 'public')));


Populate the "osm_param-species.csv" config file

@jhpoelen Please make sure that the API now provides estimates for the following parameters of the "osm_param-species.csv" config file:
(1) species.egg.size.sp*
(2) species.egg.weight.sp*
(3) species.relativefecundity.sp*
(4) species.sexratio.sp*

re: species.egg*: In fishbase-mapping.csv, a non-existent table eggs is referenced. Could it be that this table has not yet been published through fishbase api ?
re: relativefecundity - the mapping in fishbase-mapping.csv includes fecundity,RelFecundityMean and SpawningCycles,species.relativefecundity.sp. The term "and" is not yet supported by the configuration api. What do you mean when you say: fecundity,RelFecundityMean and SpawningCycles ?
re: sexratio - according to a recently generated osmose config.zip, the values are being populated:
e.g. for default Gulf of Mexico
species.sexratio.sp0;52.2
species.sexratio.sp1;75
species.sexratio.sp2;0.5
species.sexratio.sp3;70
species.sexratio.sp4;0.5
species.sexratio.sp5;0.5
species.sexratio.sp6;0.5
species.sexratio.sp7;0.5
species.sexratio.sp8;0.5
species.sexratio.sp9;0.5
species.sexratio.sp10;0.5
species.sexratio.sp11;0.5
species.sexratio.sp12;50
species.sexratio.sp13;52.3
species.sexratio.sp14;0.5
species.sexratio.sp15;50
species.sexratio.sp16;50
species.sexratio.sp17;0.5
species.sexratio.sp18;52
species.sexratio.sp19;0.5
species.sexratio.sp20;0.5
species.sexratio.sp21;50

@FIN-JBarile @Dengaloo Please address the following comment from Jorrit: "re: species.egg*: In fishbase-mapping.csv, a non-existent table eggs is referenced. Could it be that this table has not yet been published through fishbase api ?"
Moreover, please have a look at the estimates of female:male sex ratios copied/pasted by Jorrit above. Those seem to be extremely high to me. But, perhaps, they make sense based on the ecology of the functional groups/species under consideration. Please analyze this issue and let @jhpoelen and me know. Based on your thoughts, I may decide to set the female:male sex ratio of all focal functional groups to the default value of 0.5. Thanks a lot!

@FIN-JBarile @Dengaloo Please address the following comment from Jorrit: "re: species.egg*: In fishbase-mapping.csv, a non-existent table eggs is referenced. Could it be that this table has not yet been published through fishbase api ?"
Moreover, please have a look at the estimates of female:male sex ratios copied/pasted by Jorrit above. Those seem to be extremely high to me. But, perhaps, they make sense based on the ecology of the functional groups/species under consideration. Please analyze this issue and let @jhpoelen and me know. Based on your thoughts, I may decide to set the female:male sex ratio of all focal functional groups to the default value of 0.5. Thanks a lot!

also see #108 .

@agruss2 species.relativefecundity.sp should now be calculated. Please verify.

@jhpoelen Indeed, species.relativefecundity.sp is now being calculated; many thanks!
However, I will soon alter the default value of this parameter in the "fishbase-mapping.csv" file, because it cannot be 0.0.
More generally, I will rework the "fishbase-mapping.csv" file this weekend to make sure that all the default values provided there are coherent.

Glad to hear that the relativefecundity is now calculated. I've opened a separate issue #109 to document the single remaining issue: the missing eggs fishbase table and am closing this issue.


TypeError: Cannot read properties of undefined

I have this error:
TypeError: Cannot read properties of undefined (reading 'push')
at Object.on (/app/node_modules/nostr-tools/lib/nostr.cjs.js:524:34)
at file:///app/src/relay.js:108:15
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

from this file: https://github.com/GaloyMoney/galoy-nostr/blob/main/src/relay.js#L108
the error is not systematic. appears maybe on 50% of the relays.
any clue why that is?

Hi Nicolas,
The seen event was removed from nostr-tools a few versions ago. I think fiatjab said something like it didn't work fine, or something.
The problem will go away when you remove lines 108 to 111 in that file :)


LSM/Compaction: Table Scale

Background
Currently, all tables are 64MiB size (max).
When the immutable table is flushed, we rewrite up to lsm_growth_factor * table_size_max = 8 * 64MiB of level 0 (for each tree!).
Solution
To [minimize write amplification](see https://github.com/tigerbeetledb/tigerbeetle/pull/244):

Each tree has its own max table size.
A tree's table size max is equivalent to the size of the immutable table (measured in number of values — the actual on-disk table is larger due to index/filter blocks and padding).

Last Level
Reducing the table size makes the metadata cost (manifest overhead in-memory and on-disk) proportionally higher — we would either have to increase memory requirements (to accommodate many more tables in the ManifestLevel) or reduce the capacity of the tree.
Instead, let the last level of the tree keep a 64MiB table size. Since the table count of each level increases exponentially, the last level holds the majority of the tree's capacity. Since the last level is only ever the output of a compaction (never input), it benefits from the granularity of the smaller input tables — compactions to the last level will rewrite fewer than lsm_growth_factor tables.

https://github.com/tigerbeetledb/tigerbeetle/pull/485 implemented the varying size per tree.
Making the tables on the last level bigger has some open design questions (see https://github.com/tigerbeetledb/tigerbeetle/pull/485#issuecomment-1440666732). On slack we estimated that the current metadata cost per 1e9 transfers is only 2-3mb, so we can likely get away without the additional complexity of a larger last level for now.


Reusing existing layouts

Do not repaint layouts if they are already visible

May not be as useful as generally conceived, although this would be useful in case you augment the layout outside of a View, and then want that to persist, while the partial View's change out.  Sort of like changing the theme of the application in a session.

This is incredibly hard considering partial is overridable.  I'd say if you want this feature, you can write it into the existing API.  Reconsider approach for future version.


Issue with extensions

When I use the library in the main target, everything is fine. But when I import it in an extension, for example in Notification Service Extension, during compile time I get this error:
Missing required module '_AtomicsShims'
Do you know what could be the issue?

Hi, do you have SplunkOtel in your Frameworks and Libraries list?

Hi, ah yes, now I realise it's a brain fart on my side...
Not sure I didn't check this there first. Thanks for the answer though, I will close this.


Support brotli encoding in HAR capture

When capturing responses for a HAR, response content that is brotli-compressed (identified by a Content-Encoding header with value "br") is not decompressed. This results in the HAR containing base64-encoded content for those responses where it would be helpful to have plain text. Scripts and stylesheets are frequently served with brotli compression.
Currently, the ServerResponseCaptureFilter class only supports decompressing gzip-compressed response content in the decompressContents() method:
protected void decompressContents() {
    if (contentEncoding.equals(HttpHeaders.Values.GZIP)) {
        try {
            fullResponseContents = BrowserMobHttpUtil.decompressContents(getRawResponseContents());
            decompressionSuccessful = true;
        } catch (RuntimeException e) {
            log.warn("Failed to decompress response with encoding type " + contentEncoding + " when decoding request from " + originalRequest.getUri(), e);
        }
    } else {
        log.warn("Cannot decode unsupported content encoding type {}", contentEncoding);
    }
}

It would be helpful to support decompression of brotli-compressed content in this class, and moreover, it would be helpful to support creation of a custom ServerResponseCaptureFilter in the HarCaptureFilter constructor, perhaps by providing a factory as a constructor parameter.
There are some other technically valid content encodings that are not supported by the current server response filter; for example, the Content-Encoding header might be "identity" or might specify multiple encodings. The factory approach would allow Browsermob users to implement their own response content manipulations as needed.
The library org.brotli:dec:0.1.1 provides a pure-Java brotli decompression implementation that could be used for this purpose. I'd be glad to try out a patch to support brotli and submit a pull request for the functionality suggested here.
(Tested with version 2.1.5.)

Hi @mike10004 ,
I saw this right now. I saw the brotli problem because I wanted to get some Facebook data and I did this patch: https://github.com/lightbody/browsermob-proxy/pull/742 :+1:  You can try if it works for you, works fine on my side :)

It seems that development on the browsermob proxy has ceased. We have a fork, the browserup proxy that has merged brotli support. It should be a drop in replacement. https://github.com/browserup/browserup-proxy


remove and ignore rebar.lock

Removing locks across the board.  This is causing continuous issues with getting a stable build as we change.  We will not .gitignore the rebar.lock in the root riak repo.


Fixed import error for AutoGPT e.g. from langchain.experimental.auton…

…omous_agents import AutoGPT
Fix: AutoGPT import statement error in autonomous_agents marathon times notebook
from langchain.experimental.autonomous_agents.autogpt.agent import AutoGPT results in an import error as AutoGPT is not defined in the init.py file
https://python.langchain.com/en/latest/use_cases/autonomous_agents/marathon_times.html
An Alternate, way would be to be directly update the import statement to be from langchain.experimental import AutoGPT

Fixes # (issue)
Before submitting

Who can review?
Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested:

thanks @ankitarya1019!


Feature/rewire shortest path

Scope & Purpose
Move over Shortest Path variants to the new graph refactored framework.

[ ] :hankey: Bugfix
[ ] :pizza: New feature
[ ] :fire: Performance improvement
[x] :hammer: Refactoring/simplification

Checklist

[ ] Tests

[ ] Regression tests
[ ] C++ Unit tests
[ ] integration tests
[ ] resilience tests

[ ] :book: CHANGELOG entry made
[ ] :books: documentation written (release notes, API changes, ...)
[ ] Backports

[ ] Backport for 3.9: (Please link PR)
[ ] Backport for 3.8: (Please link PR)
[ ] Backport for 3.7: (Please link PR)

Related Information
(Please reference tickets / specification / other PRs etc)

[ ] Docs PR:
[ ] Enterprise PR:
[ ] GitHub issue / Jira ticket:
[ ] Design document:

Closed: Obsolete.


Replace getWorkflowsByNamesAndCorrelationIds by a better named method

There is a PR linked, I'm not sure if we should merge it though, also agreed with @v1r3n that it might get confusing.


Added ability to update data through an update method

I have quite frequently ran into a situation where I was using the "data" object on a node for various reasons. I ran into a situations where I wanted to update the X amount of nodes at the same time so I would first have to find them, loop through them and update a specific value and this approach felt cumbersome.
So I thought it would be nice to have a method to update the data object on a given node. The reason why it's just the data object and not other things is because that's the only object that can be safely updated without unintended consequences + we already have other helpers for nodes like select, unselect etc to update the state.
The way you use it is like this:
this.$refs.tree.update('Item 1', node => {
    return { path: '/path/to/node' }
});

The first argument of the update method is exactly the same as the argument in the find method where it's the criteria. So it can be RegExp or just a string to match the text. Second argument is callback which gives you access to each of the nodes that matched the criteria. The return statement in the callback is what is added to the data object of the node. So you could even override the text by simply doing:
this.$refs.tree.update('Item 1', node => {
    return { text: 'Item 2' }
});

It is not obvious that this method updates the data property. Would be better to rename as updateData?

@amsik Good point. That may be a good idea.
Unless we add the ability to also update the state in the same method and it would be like this:
this.$refs.tree.update('Item 1', node => {
    return {
        data: { text: 'Item 2' },
        state: { selected: true }
    };
});

What do you think? This way, if there was ever more "updatable" properties in the Node object, we could easily allow that and have one method for them all instead of updateData, updateState, updateXYZ etc. The docs would have to state which properties can be updated this way and which can't.
Just to make it even more clear, if you just do:
this.$refs.tree.update('Item 1', node => {
    return {
        data: { text: 'Item 2' }
    };
});

The state of that particular node will not be modified. Only the properties you stated.

Please take a look at the next code:
  select (extendList) {
    if (!this.selectable() || this.selected()) {
      return this
    }

    this.tree.select(this, extendList)

    this.state('selected', true)
    this.$emit('selected')

    return this
  }

Code above shows how select method works. Your method will need to take into account the events, selectedNodes, checkedNodes and so on... a lot of logic :) Do you have a solution in this case?

@amsik - I'll look into this as soon as I have some spare time :)

Thanks for your contributing! I'll do as well :)

Thumbs up for this. updateNode  is better naming, and I'd also select updateAllNodes(node=>node) where we can iterate all nodes. Using setModel is not as powerful as those.

Looking forward to this. I agree that updateData is a better name. It should modify only changed properties, e.g. if expanded is not updated expanded should stay as the same as before.
For now I wrote a workaround where I iterate current model and and call setModel for by only changing of changed properties recursively. I can work on the pull request when I have time to make it as I described if you agree. But do not depend on me and feel free to complete it as you want as I may have time not very soon.

Jeeez I totally forgot about this. I'll try to look into this in the next few days but no promises 🤣

I have updated the PR. I decided to take your advice and rename the method to updateData. I decided to drop the idea of supporting state because we can easily change it using this method like so to change the selected state:
this.$refs.tree.updateData('Item 1', node => {
    node.select();

    return { text: 'Item 2' };
});

Any feedback @amsik?


youtube-dl-gui only downloads half the videos on a certain channel hand hangs

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

WARNING
All the invalid issues will be rejected!!

Before going further

If your problem is a bug with the youtube-dl program or a request for new site support please report it here

Make sure you are using the latest youtube-dl-gui version: Options > About tab. If it's not please download & install the latest version for your OS and check if your issue still persists

Make sure you are using the latest youtube-dl version: Click the Update button on the main screen and check if your issue still persists

Make sure you searched the bugtracker for similar issues including closed ones

[ ] I assure that my problem is NOT with youtube-dl
[ ] I've verified and I assure that I'm running youtube-dl-gui 0.3.8
[ ] I assure that i am using the latest version of youtube-dl
[ ] Searched bugtracker

What is the purpose of your issue?

[x] Bug during the download process (encountered problems after hitting the Download button)
[ ] Bug other (encountered other problems with youtube-dl-gui)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

Please remove the following section between the (---) if your problem does not belong to the bug during the download process category
Provide the full verbose output as follows:

Add -v flag to Options > Commands tab
Re-try to download the URL
Go to Options > Log tab and click the View Log button
Copy the whole content of the log file and insert it between the triple ``` part

[delete me and insert your log content here]

Please remove the following section between the (---) if your problem does not belong to the first two categories (bug report)
What operating system do you use ?
List of actions to perform to reproduce the problem:

..
..
..

What is the expected behaviour ?
What happens instead ?

Description of your issue, suggested solution and other information. Please make sure the description is worded well enough to be understood.

Thanks for taking a moment to look at this. Also I could not fill out the bug report properly. I don't know why. I use firefox and when it didn't work I switched to chrome but still it would not let me insert the log above so I will insert it below and try explaining my issues as good as I can.
I am using Youtube-dl-gui 0.3.8, I am running windows 10.
Here is the situation. I am trying to download all the videos from the following channel on youtube:
https://www.youtube.com/user/FIKITEnSUP/videos
the download process will begin. It says there are 131 video to download. dl-gui gets 76 of them and stalls. I checked the log and it says the following:
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
This is not a mistake, it is listed twice. I am also including a attatchment with a screenshot
Hope you can help me.
Thanks,
<EMAIL_ADDRESS>

@eldergamer webm. isn't suitable for mp4.

Thanks for your response. I'm not sure what do next. I changed the video setting from default to mp4 1920x1080. I updated the FFmpeg by overwriting the older ones in the YoutubeDLG. I testing it now. It's getting stuck in preprocessing on 108/132. The same channel as before:
https://www.youtube.com/user/FIKITEnSUP/videos

@eldergamer
The inconstancy in number of fragments that you're able to fetch in the two separate goes at it makes me think it might be something completley unrelated to the application.
Are you using a unstable wireless internet connection?
Do you have strict firewall settings that might interfere with the application?

My internet is solid, I'm not wireless, and I am not using a proxy. In fact
I installed youtube-dl-gui on my machine at work and had the same result. I
put it on a machine that is outside the firewall at work so I know it
wasn't firewall related. I'm stumped...
Thanks
eldergamer
https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon
Virus-free.
www.avast.com
https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
On Thu, Apr 27, 2017 at 6:40 AM, MR-2<EMAIL_ADDRESS>wrote:

@eldergamer https://github.com/eldergamer
The inconstancy in number of fragments that you're able to fetch in the
two separate goes at it makes me think it might be something completley
unrelated to the application.
Are you using a unstable wireless internet connection?
Do you have strict firewall settings that might interfere with the
application?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MrS0m30n3/youtube-dl-gui/issues/168#issuecomment-297716217,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AarqrTCkmJyteIBq6IXBFs98tpJRbvUDks5r0JrfgaJpZM4NGxmA
.


How to use Bedrock with LiteLLM

Issue #, if available:
Description of changes:
How to use Bedrock with LiteLLM
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Please re do this PR following the new layout and the process for creating the required file . We request all files to have a presence on the Cookbook / Recipes Website which is fronting this github repo now. Some of the mandatory sections of the notebook need to include

Overview.
What are we demonstrating .
What use case .
What will you learn.
What is the architectural pattern and why we select this. With a diagram
What are the libraries to install
What model did we choose and why this model
Every cell needs to have a markup


Update deploy-edge.md to note that the content location for the application must be empty when using the wizard to create the application.

Added note that the location for the content must be empty. When the specified directory is not empty the application wizard for 1910 will not proceed until it is empty or a empty location is specified.
Summarize the change in the pull request title
Describe your change, specifically why you think it's needed.
Fixes #Issue_Number (if necessary)

Hi @mestew - Could you review this pull request? Thanks.

@mestew : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@mrbodean thanks for your contribution. I made minor style and wording tweaks to it since we rarely use exclamation points in docs.
#sign-off


How to unzip the trained weights?

How to unzip the trained weights?

you can unzip it on windows.

Or with 7zip (do not forget to install p7zip-full and p7zip-rar):
7z x  FasterRCNN_20180515_DOTA_v3.part1.rar


fud execution outputs nothing to console upon error.

When using fud e <input>, it prints nothing to console when an error occurs. However, if no error occurs, then it prints the lowered program.

Two more things:

-v also doesn't work correctly (error or otherwise)
-vv fixes the problem

@sgpthomas one of your recent changes probably broke this? I couldn't figure it out quickly.

Two more things:

-v also doesn't work correctly (error or otherwise)
-vv fixes the problem

@sgpthomas one of your recent changes probably broke this? I couldn't figure it out quickly.


Encountering the problem of too few SNPs

When I finished training with default totalPhysLen:1100000 and numSubWins:11, I tried to predict using a single sample from human vcf file. But during vcf->fvec process, it seems that for human chromosomes, SNPs are just too few such that there are few "good" subwindows to write out statistics, which results in empty diploid.fvec file.
Any suggestion to improve this?

And when I trained a numSubWins=5 version model, when "fvecvcf', there are always 50 statistics value being 0.2.
E.g. 21	45450001	45550000	45300001-45800000	0.04347795840815315	0.04347795840815315	0.34783062387770275	0.1739118336326126	0.39130162567337834	0.04347795840815315	0.04347795840815315	0.34783062387770275	0.1739118336326126	0.39130162567337834	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2	0.2

do you mean a single human genome here?

Yes. It's a vcf file containing a single human's gene (from chr1 - chrx/y, etc.).

diploSHIC isn't meant to be run on a single genome-- it calculates summaries from population level samples, for instance n=10+ genomes

do you mean a single human genome here?

Yes. It's a vcf file containing a single human's gene (from chr1 - chrx/y, etc.).

diploSHIC isn't meant to be run on a single genome-- it calculates summaries from population level samples, for instance n=10+ genomes
I see. And how about numSubWins? What are your standards for choosing it for value other than 11?

Ok I used multiple samples and it worked perfectly. Thank you


Remove @microsoft/api-documenter depencency

Removes a no longer needed dependency. Replaces PR #14436.

Just curious... what command did you use to get the changes in the lock file?

Interesting... according to https://github.com/Azure/azure-sdk-for-js/issues/11789, recheck should have done the trick...

I didn't try rush update --full, will do that next time.


Bump dynamiclistener to v0.3.5

v0.3.5 fixes some regressions in the version of dynamiclistener that we're currently using. We should update.

Validated standard checks have passed in v1.25.4-rc3+k3s1 as part of patch validation


build: remove type checking CI from pre-commit.

Pull Request Checklist

[ ] New code has 100% test coverage
[ ] (If applicable) The prose documentation has been updated to reflect the changes introduced by this PR
[ ] (If applicable) The reference documentation has been updated to reflect the changes introduced by this PR
[ ] Pre-Commit Checks were ran and passed
[ ] Tests were ran and passed

Description

This PR changes our workflow for type checking, moving it outside of pre-commit. It removes mypy and pyright from pre-commit, adds extra CI steps for running them, and updates the make file to add commands for both tools and adds them to the "lint" command.
Initially, my goal was to make it so that there should be no difference between running via pre-commit and directly via cli, while maintaining a single centralized configuration. However, I ran into multiple challenges with this.

When running a command like $ pre-commit run --all-files, all of the file names in the repository are passed to the mypy cli as arguments. This causes mypy to ignore configs from the [tool.mypy] section of pyproject, such as packages, meaning that we'd need to duplicate the configuration across both tools in order to specify the parts of the code base we want mypy to check.
Maintaining multiple lists of dependencies. The dependencies we require via core deps and extras had already drifted from the list we were maintaining in pre-commit config. I addressed this in #2457.
We can run the type checkers in parallel in CI - should give us a small win with CI times.
Running via pre-commit automatically adds --ignore-missing-imports, which we don't want because we are explicitly passing the full environment via additional-dependencies.
Removing the type checkers from pre-commit makes the hook run faster, making it less disruptive to workflow and therefore less likely to remain enabled in contributors local environments.
Overall running via pre-commit makes using the tool and reasoning about it harder than it needs to be. For example, it took a while to work out why the issues named in 1. and 4. of this list were what they are.

Why not a local hook? This doesn't solve 1., the files are still going to be passed to the command line, sidestepping our packages config  in pyproject. Also, we'd need to modify the pre-commit step in CI to include PDM steps and build the environment for the local hook to run within.
Close Issue(s)

Maybe we should add an optional recommendation to run make lint or pdm run lint in the CONTRIBUTING guide?

I've added a section. This will need to be updated when I implement this .


JSON response for Expression validation

The /api/expressions/{bel}/validation API only returns a text/plain response at the moment.

Changed to JSON structure


Where to find full source of the library (TZ-1325)

Question
I want to create a custom device which will follow my water consumption and send it through zigbee.
I think that it should be very similar to a temperature sensor in the code, with just some cluster ID to change.
That's why I try to start from the ZigbeeTempSensor, where the function esp_zb_temperature_sensor_clusters_create is used.
I found the header for this function here : link
But I am unable to find the implementation of the function.
Is this available .

Hi @hatch01 ,
The source code of the esp-zigbee-sdk is in a closed state. If you wish to obtain it, please contact our business team via technical inquiries to request access to the source code.

Okay, I will ask for it.
Is it planned to make the esp-zigbee-sdk open later, or will this stay in this state?

The current esp-zigbee-sdk is based in ZBOSS, per the agreement of ZOI, we can't make it opensource, but it's possible to give private access to customers under below rule:

Free annual source code access passes (to a vendor branch) — customer receiving Free Annual Pass shall have a contractual commitment to a minimal shipment of 5M copies of product with ZOI software in it — like chipsets, and etc.


Better to add component type into the component listing table

Description:
See below. It is a schedule task type of component.

+1
An icon would also do.


Fixed the intermittent test in #3035.

The problem was that iris.util.format_array was stateful (via np.set_printoptions).
Follow up to: #3019
Closes: #3035

Oh dear... this has had a bit of a knock on. @bjlittle is going to take the baton on...

@pelson Okay, a bunch of changes that I banked due to this stateful behaviour... not to worry.
I'll fix them on your branch, since I've recently been in this space.

Hopefully this will now pass 🤞

You may need to rebase given the flurry of connected PRs that have just been banked.
We'll see what travis says...

:+1: Lovely, thanks @pelson


Feature Request: Make Tabs Optional Per Backoffice User

It would be nice if after installing this Umbraco Package (or via Nuget) that we were able to toggle this on/off on a per user basis.
Has anyone found themselves with some editors who want them turned on, some with turned off?
Any thoughts about this feature request and how it would be best implemented?

It's am interesting idea. For this to work, we need somewhere to store the toggle. Also consider Umbraco Cloud / uSync in this.
How should the group separator work? Especially the ones with anchors, when you don't have a tab to navigate through?


IR card scheduling

Hello,
I am trying to figure out how to schedule my IR cards effectively. Basically, I want to be able to randomize the card order once and then maintain their position. Then I can see a card and choose to review it "soon", "later" or "much later" while still having the card order be initially randomized. If I could select all the cards in my reading organizer and hit "randomize" I think It would solve my problem. Also If i could somehow choose how to set scheduling for text that I extract from articles that would be amazing. Does that makes sense?

Yes, that makes sense, and it sounds like a good idea. Over the next few weeks, I need to overhaul the scheduling code in general, since there are some other issues with it.
I've barely touched that part of the code since I took over development of the add-on, so I can't say how long it'll take me. But I'll leave this issue open, and I'll post here again when I've got something for you.

I've implemented a randomisation feature in the rewritten organiser. Let me know if it works for you. I intend to add the "move to position" feature that the old organiser had, when I get some time.
As for setting the scheduling of extracted text, I'm not absolutely sure that would be useful. Unless someone can convince me that a decent use-case exists, it probably won't be implemented.
Feel free to open another issue if you have any trouble with this update.

Was that update applied to version 4? I haven't upgraded to 2.1 because many addons that are vital to me (image occlusion) aren't supported there yet.
My thought with the scheduling of extracted cards was that.. at least for me.. If i am extracting from an article I want to see that portion of the article before I see the full one again.  So I was thinking if there was a setting like "move all extracted cards to 20% of the deck" that would let me do that.
I experimented with removing IR and using my IR3 deck with custom set scheduling thru regular anki. This was great because I could really fine tune how I saw my cards. However, I lost many of the key aspects like extracting etc. Is it even remotely possible for me to remove the organizer and scheduling info from my IR addon, allowing me to handle that thru regular anki, yet still retain extraction and those aspects?

Okay, I can see the use in that. I thought you meant keying in a position for each card as you review it, which I don't think would be useful. I'll add that to my to-do list. I'll also think about back-porting some of this to v3 - but no promises.
At some stage I might add an option to disable the IR scheduler. Until then, you can comment out all of the lines from 468 to 473 in main.py. Just add a # character to the start of each line. That will leave you will the highlight, extract and delete keys, but the cards will be scheduled as regular Anki cards.

When you are done, the last few lines of main.py should look like this:
#Reviewer._answerButtonList = wrap(Reviewer._answerButtonList,
#                                  answerButtonList,
#                                  'around')

#Reviewer._answerCard = wrap(Reviewer._answerCard, answerCard, 'around')
#Reviewer._buttonTime = wrap(Reviewer._buttonTime, buttonTime, 'around')
Reviewer._keyHandler = wrap(Reviewer._keyHandler, keyHandler, 'around')

I haven't tested it, but I don't see any reason it wouldn't work.

Awesome. This appears to be working perfectly. Thanks!

I've back-ported the scheduler and organiser rewrite to v3, since that turned out to be remarkably easy. The IR scheduling should be more consistent now, and the organiser has the randomise feature.
I would appreciate any comments you have on it. I haven't updated it on AnkiWeb, but you can download it as a zip file here.

In the development code for v4, you can now control the initial scheduling of extracts (e.g., move to 20% of deck). I may back-port this to v3 - but again, no promises.


Update tag on master to 7.2.0-preview.4

Could you update the tags on master again? The v7.2.0-preview.5 is going to be released soon but the tag on master is still set to v7.2.0-preview.3 which causes my daily builds to end with following string:

It's follow up to #14439

I don't know what was wrong in v7.2.0-preview.3 release but I caught the same and @rjmholt suggested me git fetch -tags -all - this helped.

I don't know what was wrong in v7.2.0-preview.4 release but I caught the same and @rjmholt suggested me git fetch -tags -all - this helped.

It does not work for me:

This is strange since the git tag -n shows that they are present:

But today I rebased to latest and last tag is v7.2.0-preview.4 - not v7.2.0-preview.5.

I guess it's because the preview.5 is not released yet. I was just referencing it because I saw new commits that are preparing for the preview.5 release and the last tag is set to preview.3.

 git describe shows v7.2.0-preview.3-99-g658837323 for me too.

Having a look.
/cc @TravisEz13

I am not seeing them after git fetch either, but seem on the github.com. Trying to root cause.

Fixed for preview.5 now. Please pull again and try. Thanks for reporting. We are going to give up fixing preview 4 though as a more recent tag is pushed now.

I merged the tag into master.  This step is our instructions for finalizing the release.  I'll emphasize the importance of it to the other maintainers.  Otherwise, you must sync tags.  Build.psm1 has Sync-PSTags to resolve this issue (although it requires a remote to powershell/powershell over https).

Thanks! I see new tag.

Yep, it works. Thanks gents!


Throttle with maximum time overload.

Like this:
http://stackoverflow.com/a/30761373/1069200

Sounds like https://github.com/dotnet/reactive/issues/395 .

Similar but slightly different semantics. For practical purposes #395 would be fine.
I often use this for things like buffering saving state to disk.

Assuming that #395 would do the trick, I close this. @JohanLarsson Please reopen if still relevant and elaborate on the difference of semantics of your proposal.


How to use

How do open the GUI

Just double click on the jar 🤔
If nothing happens check if you've taken the -all.jar or run through a terminal with 'java -jar filename.jar`


Check a range on BaccoemuBaryons

Quick fix for #1107. I haven't checked if that's an issue for the other emulators as well.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

12 of 13 (92.31%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.01%) to 97.425%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

pyccl/baryons/baccoemu_baryons.py
12
13
92.31%

Totals

Change from base Build<PHONE_NUMBER>:
-0.01%

Covered Lines:
5676

Relevant Lines:
5826

💛  - Coveralls


feat: add filter options

Codecov Report

Merging #66 into master will increase coverage by 0.09%.
The diff coverage is 94.11%.

@@            Coverage Diff            @@
##           master     #66      +/-   ##
=========================================
+ Coverage   98.21%   98.3%   +0.09%
=========================================
  Files           2       2
  Lines          56      59       +3
=========================================
+ Hits           55      58       +3
  Misses          1       1

Impacted Files
Coverage Δ

lib/plugin.js
98.27% <94.11%> (+0.09%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d7792d7...745cb51. Read the comment docs.