Signature extraction failed

alt@LM85:~/Музыка/YouTube$ ./youtube-dl --verbose -x https://www.youtube.com/watch?v=iyTTX6Wlf1Y
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', '-x', 'https://www.youtube.com/watch?v=iyTTX6Wlf1Y']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2<IP_ADDRESS>
[debug] Python version 2.7.6 - Linux-3.13.0-44-generic-x86_64-with-Ubuntu-14.04-trusty
[debug] exe versions: avconv 9.16-6, avprobe 9.16-6, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] Confirming age
[youtube] iyTTX6Wlf1Y: Downloading webpage
[youtube] iyTTX6Wlf1Y: Downloading video info webpage
[youtube] iyTTX6Wlf1Y: Extracting video information
[youtube] iyTTX6Wlf1Y: Encrypted signatures detected.
[youtube] {22} signature length 41.41, html5 player en_US-vfl19kCnd
[youtube] iyTTX6Wlf1Y: Downloading js player vfl19kCnd
ERROR: Signature extraction failed: Traceback (most recent call last):
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 539, in _decrypt_signature
video_id, player_url, s
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 453, in _extract_signature_function
res = self._parse_sig_js(code)
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 514, in _parse_sig_js
'Initial JS player signature function name')
File "./youtube-dl/youtube_dl/extractor/common.py", line 436, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
(caused by RegexNotFoundError(u'Unable to extract \x1b[0;34mInitial JS player signature function name\x1b[0m; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.',)); please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
Traceback (most recent call last):
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 539, in _decrypt_signature
video_id, player_url, s
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 453, in _extract_signature_function
res = self._parse_sig_js(code)
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 514, in _parse_sig_js
'Initial JS player signature function name')
File "./youtube-dl/youtube_dl/extractor/common.py", line 436, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
Traceback (most recent call last):
File "./youtube-dl/youtube_dl/YoutubeDL.py", line 536, in extract_info
ie_result = ie.extract(url)
File "./youtube-dl/youtube_dl/extractor/common.py", line 199, in extract
return self._real_extract(url)
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 934, in _real_extract
encrypted_sig, video_id, player_url, age_gate)
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 549, in _decrypt_signature
'Signature extraction failed: ' + tb, cause=e)
ExtractorError: Signature extraction failed: Traceback (most recent call last):
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 539, in _decrypt_signature
video_id, player_url, s
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 453, in _extract_signature_function
res = self._parse_sig_js(code)
File "./youtube-dl/youtube_dl/extractor/youtube.py", line 514, in _parse_sig_js
'Initial JS player signature function name')
File "./youtube-dl/youtube_dl/extractor/common.py", line 436, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
(caused by RegexNotFoundError(u'Unable to extract \x1b[0;34mInitial JS player signature function name\x1b[0m; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.',)); please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.

Sorry works on new version.


Compound power cost display

Show a 12 for "Supermage Costume", the details would look better with a gray number.  Careful when adding up totals.

Improved:


[v0.3 DENAS] Fix the search process issues in the BERT

This PR is updated with the followings:

Updating the latency calculation part in the DENAS BERT search process.
Fix the errors when using distributed training.

which is tested well in the local env:

Please help review this PR. Thx. @xuechendi

@zigzagcai , CI/CD is not triggered.


Does not find brew installed versions

I just upgraded to version 4.3.1 and it lost all my configuration. I go to the PHP tab and I click the reload button but it cannot find my installed version of PHP. I installed PHP using the standard Homebrew location.
❯ which php
/opt/homebrew/bin/php

I go to settings and try to change Brew Source Switch to Default but I get an error that just says "Failed".  I am using macOS Sonoma 14.7
I tried to manually add the path of /opt/homebrew/bin but it still did not find a php version to use.

Have you changed your computer password?  If you have, you need to change it in PWS Settings->Reset Computer Password

@xpf0000 yes, I did change my password. I updated my password in PWS and now it works. Thanks! You should try to improve the error messages for when that happens.


Enable all ECI encodings

Some ECI Encodings do not work correctly with the test cases. Some research needs to be done into why this is the case.
At the moment those ECI and CharacterSet encodings are disabled.

Fixed with 921b51a405558b49dda2193011234165d9863dec


setup.py issue

Hi, I was trying to install Chamfer distance & emd & PointNet++, and faced a couple of errors:
# Chamfer Distance & emd
cd ./extensions/chamfer_dist
python setup.py install --user
cd ./extensions/emd
python setup.py install --user

# PointNet++
pip install "git+https://github.com/erikwijmans/Pointnet2_PyTorch.git#egg=pointnet2_ops&subdirectory=pointnet2_ops_lib"
# GPU kNN
pip install --upgrade https://github.com/unlimblue/KNN_CUDA/releases/download/0.2/KNN_CUDA-0.2-py3-none-any.whl

To be clear, I was using the same version as #22 suggested. pip install torch==1.8.1+cu111 torchvision==0.9.1+cu111 torchaudio==0.8.1 torchstat==0.0.7 -f https://download.pytorch.org/whl/torch_stable.html
Chamfer distance:
/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during:
            instantiation of class "std::is_same<_Tp, _Up> [with _Tp=std::__remove_cv_t<std::string>, _Up=c10::in_place_t]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/c10/util/Optional.h(447): here
            instantiation of class "c10::optional<T> [with T=std::string]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(107): here

/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during:
            instantiation of class "std::is_same<_Tp, _Up> [with _Tp=std::__remove_cv_t<std::string>, _Up=c10::in_place_t]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/c10/util/Optional.h(447): here
            instantiation of class "c10::optional<T> [with T=std::string]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(107): here

/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=c10::optional<std::string>, _Up=c10::in_place_t]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(107): here

/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=c10::optional<std::string>, _Up=c10::in_place_t]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(107): here

/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=c10::optional<std::string>, _Up=c10::optional<std::string>]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(107): here

/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=c10::optional<std::string>, _Up=c10::optional<std::string>]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(107): here

/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=std::function<c10::optional<std::string> (const c10::ConstTypePtr &)>, _Up=std::function<c10::optional<std::string> (const c10::ConstTypePtr &)>]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(111): here

Error limit reached.
100 errors detected in the compilation of "chamfer.cu".
Compilation terminated.
error: command '/usr/local/cuda/bin/nvcc' failed with exit code 1

emd:
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
building 'emd_cuda' extension
creating build
creating build/temp.linux-x86_64-cpython-37
creating build/temp.linux-x86_64-cpython-37/cuda
gcc -pthread -B /home/q84sun/miniconda3/envs/pointgpt_py3.7/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include -I/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/TH -I/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/q84sun/miniconda3/envs/pointgpt_py3.7/include/python3.7m -c cuda/emd.cpp -o build/temp.linux-x86_64-cpython-37/cuda/emd.o -g -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=emd_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
cc1plus: warning: command-line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
In file included from /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/Parallel.h:140,
                 from /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                 from /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                 from /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                 from /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:13,
                 from /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                 from cuda/emd.cpp:5:
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/ParallelOpenMP.h:83: warning: ignoring ‘#pragma omp parallel’ [-Wunknown-pragmas]
   83 | #pragma omp parallel for if ((end - begin) >= grain_size)
      |
...
/usr/include/c++/11/type_traits(1406): error: type name is not allowed
          detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=std::function<c10::optional<std::string> (const c10::ConstTypePtr &)>, _Up=std::function<c10::optional<std::string> (const c10::ConstTypePtr &)>]"
/home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(111): here

Error limit reached.
100 errors detected in the compilation of "cuda/emd_kernel.cu".
Compilation terminated.
error: command '/usr/local/cuda/bin/nvcc' failed with exit code 1

PointNet++
Requirement already satisfied: torch>=1.4 in /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages (from pointnet2_ops) (1.8.1+cu111)
Requirement already satisfied: numpy in /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages (from torch>=1.4->pointnet2_ops) (1.21.6)
Requirement already satisfied: typing-extensions in /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages (from torch>=1.4->pointnet2_ops) (4.7.1)
Building wheels for collected packages: pointnet2_ops
  Building wheel for pointnet2_ops (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [508 lines of output]
      running bdist_wheel
...

      /usr/include/c++/11/type_traits(1406): error: type name is not allowed
                detected during instantiation of class "std::is_same<_Tp, _Up> [with _Tp=std::function<c10::optional<std::string> (const c10::ConstTypePtr &)>, _Up=std::function<c10::optional<std::string> (const c10::ConstTypePtr &)>]"
      /home/q84sun/miniconda3/envs/pointgpt_py3.7/lib/python3.7/site-packages/torch/include/ATen/core/jit_type_base.h(111): here

      Error limit reached.
      100 errors detected in the compilation of "pointnet2_ops/_ext-src/src/ball_query_gpu.cu".
      Compilation terminated.
      error: command '/usr/local/cuda/bin/nvcc' failed with exit code 1
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> pointnet2_ops

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

Environment:

Python 3.8
torch 1.8.1+cu111
torchaudio 0.8.1
torchstat 0.0.7
torchvision 0.9.1+cu111
nvcc --version: Cuda compilation tools, release 11.2, V11.2.152
nvidia-smi: Driver Version: 535.183.01   CUDA Version: 12.2
ubuntu 20.04

any thoughts?

Hello, I also encountered the same problem in EMD. Have you solved it? How did you solve it?

@luogkr Hi, the ultimate solution is to increase CUDA version to exact 11.7. And problem solved.


Add new test wdl files

I modified the code to include 'InitialWorkDirRequirement', but the resultant cwl file cannot be run using cwltool. I have included the resultant cwl inside tests/cwl_files/NoResult.cwl. Result.cwl is a working version for the corresponding cwl file.

resultant cwl file cannot be run using cwltool.

Okay. What error do you get?

ERROR Tool definition failed validation:
Cresult.cwl:1:1:   Object Cresult.cwl#CollectQualityYieldMetrics is not valid because
tried CommandLineTool but
Cresult.cwl:17:1:     the requirements field is not valid because
tried array of  but
Cresult.cwl:20:3:         item is invalid because
Cresult.cwl:21:3:           the listing field is not valid because
value is a CommentedMap, expected array of  or string or Expression
This is the error I got

Fixed the error after the introduction of 'InitialWorkDirRequirement', changed the resultant cwl file in tests

Added a new test case. Issues a warning for skipping parameter_meta

Parameterizing test function, code refinements and additions to get_command()

Handling array type inputs/outputs. New wdl file including a workflow was added.

Added workflow input parameters, new wdl files

It is great to see the progress!
However, this PR is doing a lot. Can you pull out one piece of new functionality and make a separate PR (with simplified test case) for that?

@dinithiW is there anything left in this branch that isn't part of some other pull request?

@dinithiW is there anything left in this branch that isn't part of some other pull request?

Except for one feature the others are implemented, but that's fine we can close this.

@dinithiW is there anything left in this branch that isn't part of some other pull request?

Except for one feature the others are implemented, but that's fine we can close this.

Cool. Which feature? Is there an issue for it?

@dinithiW is there anything left in this branch that isn't part of some other pull request?

Except for one feature the others are implemented, but that's fine we can close this.

Cool. Which feature? Is there an issue for it?

Yes. #25

Okay, I'm closing this as the the other PRs and issues cover everything here.


Version bump for v6.0.8 parity

Version bump for v6.0.8 parity

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 96.879%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
737

Relevant Lines:
755

💛  - Coveralls


Unable to reconstruct dynamic objects？

When I train on the KITTI dataset again, the algorithm is unable to reconstruct dynamic objects, such as cars. What is the reason for this?
For instance: Cars in motion are automatically removed。

Hello, I feel sorry that f2-nerf can only reconstruct static scenes. For reconstructing dynamic objects you may need to find some dynamic NeRF methods.


YWeather showing wildly inaccurate high temp data

Home Assistant release (hass --version):
0.50.1
Python release (python3 --version):
3.4.2
Component/platform:
yweather/weather panel
Description of problem:
High temps displayed are ridiculously high and forecast icons are inaccurate.
Weather Panel:

Yahoo Weather Site:

Expected:
WX Panel matching info at Yahoo Weather
Config:
weather:
  platform: yweather
  name: weather_today
  woeid: 2489882

Tried with and without optional woeid, no change.

Also would suggest changing "Visual" to "Visibility"

Still showing temperatures from planet Mercury.  Forecasted High today in my town is 185 degrees.
Any ideas?

That seems a temperature convert problem. 88°C is about 190°F.
The condition problem is that some weather code was put in wrong weather class.


sortOrderIndex is mentioned as response value in v1.0

sortOrderIndex is mentioned as response value in v1.0 .
But its only in the response of the beta endpoint

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: feddb622-23f9-430a-1235-c72e614f455b
Version Independent ID: 349d6f59-c24d-94e7-ca5e-7b660d8a5345
Content: Add tab to channel - Microsoft Graph v1.0
Content Source: api-reference/v1.0/api/channel-post-tabs.md
Product: microsoft-teams
Technology: microsoft-graph
GitHub Login: @nkramer
Microsoft Alias: MSGraphDocsVteam

Thank you for reporting this, we will check this and update the doc.

Updated the doc through pull request https://github.com/microsoftgraph/microsoft-graph-docs/pull/23449.

Document has been updated, hence closing this issue.


Cannot add product when creating an order

What I'm trying to achieve
Add product in Orders
Steps to reproduce the problem

Click Orders in Dashboard left bar
Add product to create an order

What I expected to happen
I can select a  product in order to create an order but i cannot search any product
Screenshots

System information
Operating system:
Browser:

I am so sorry when missing the product variant


bugfix panic on Terminate

closeFunc() will set ww to null

Or we shall not reset the ww in the closeFunc?

updated

After looking into it, it makes more sense to swap the order in the Terminate while keeping the nil set statement still in the closeFunc. I've made the change in https://github.com/magodo/go-wasmww/commit/f3c0741624294af1d170860169f31029f96ac275, with some minor changes in the example code.


Rename everything from hu to ghu

One last time (ha), go through the superturboduperfun process of renaming the project and packages. We agreed on Global Humanitarians Unite, not Humanitarians United, so rename the app accordingly like we've already rename the repo and the toolkits app

Renaming the submodule was a pain for me (I ended up having to re-clone the repo), so I'd play it safe and merge this only after you've merged whatever branches you're working on, Schuyler

Alright, I rebased, but fair warning: renaming the ghu_toolkits submodule might break the hecking heck out of your local repo, or at least more than I'm qualified to fix.
So if it gets confused when you pull after we merge this, I'd just re-clone the repo (I did)


[newrelic] Add missing "newrelic_set_user_id" function definition

Hi!
We've figured out that the New Relic function newrelic_set_user_id was missing in the stubs.
Here is the related documentation.
Thanks!

@xserrat Thank you for the PR! Could you please make one more small change and update stubs map. Please read how to do it at https://github.com/JetBrains/phpstorm-stubs?tab=readme-ov-file#how-to-update-stub-map

Thanks for the feedback @isfedorov . I'm going to add it right now!

I've added it manually because running the script I get this error:
Fatal error: Uncaught Error: Failed opening required '/opt/project/phpstorm-stubs/tests/Tools/../../vendor/autoload.php' (include_path='.:/usr/local/lib/php') in /opt/project/phpstorm-stubs/tests/Tools/generate-stub-map on line 37

Error: Failed opening required '/opt/project/phpstorm-stubs/tests/Tools/../../vendor/autoload.php' (include_path='.:/usr/local/lib/php') in /opt/project/phpstorm-stubs/tests/Tools/generate-stub-map on line 37

Call Stack:
    0.0086     585104   1. {main}() /opt/project/phpstorm-stubs/tests/Tools/generate-stub-map:0
    2.2668     585680   2. JetBrains\PHPStormStub\{closure:/opt/project/phpstorm-stubs/tests/Tools/generate-stub-map:36-291}() /opt/project/phpstorm-stubs/tests/Tools/generate-stub-map:291


docker-exec regression in 1.6: DNS queries in container cause long time out

I'm doing some weird networking stuff in my container so that the default route no longer reaches anywhere particularly useful.  Docker 1.5 used to work great, but a recent upgrade to docker 1.6 has started to cause docker-exec to hang for a 20 second timeout before proceeding.  Removing the default route or have the default route go somewhere useful allows docker-exec to run at normal speed.  Removing (or in this case unmounting) /etc/resolv.conf "fixes" the delay problem.
strace shows that it (docker using the process name "native") is attempting to resolve the name docker.io.example.com
141   socket(PF_INET, SOCK_DGRAM|SOCK_NONBLOCK, IPPROTO_IP) = 5
141   connect(5, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("<IP_ADDRESS>")}, 16) = 0
141   poll([{fd=5, events=POLLOUT}], 1, 0) = 1 ([{fd=5, revents=POLLOUT}])
141   sendmmsg(5, {{{msg_name(0)=NULL, msg_iov(1)=[{"\303\1\1\0\0\1\0\0\0\0\0\0\6docker\2io\texampl"..., 41}], msg_controllen=0, msg_flags=0}, 41}, {{msg_name(0)=NULL, msg_iov(1)=[{"\253\361\1\0\0\1\0\0\0\0\0\0\6docker\2io\texampl"..., 41}], msg_controllen=0, msg_flags=0}, 41}}, 2, MSG_NOSIGNAL) = 2

after that tries a few times, it gives up and then docker-exec executes the desired program and quickly exits.
Please stop docker from making gratuitous DNS queries in the container, of if there is some non-obvious good reason, please provide a way to disable it when necessary from outside the container.
I can provide a recipe for reproducing the problem, if necessary.
Docker version 1.6.0, build 350a636/1.6.0
Linux 3.19.5-200.fc21.x86_64 #1 SMP Mon Apr 20 19:51:56 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
Fedora 21

Hi!
If you are reporting a new issue, PLEASE make sure that does not have any duplicates already open.
We would like to take this time to remind you of the information we need to debug the problem you are seeing. This is an automated response so if this ticket is not about a bug, do not fret.
If you fail to provide this information within 7 days, we will close this because we cannot debug your issue. We can reopen whenever the information is provided.
Thank you.
Please see:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues
Description of problem:

`docker version`:

`docker info`:

`uname -a`:

Environment details (AWS, VirtualBox, physical, etc.):

How reproducible:

Steps to Reproduce:
1.
2.
3.

Actual Results:

Expected Results:

Additional info:

#ENEEDMOREINFO

Appears to be fixed sometime before docker 1.6.2, so I guess all is well (except for Fedora users who use the default install).


CustomExceptionHandler switch more readable and remove duplicate code

CustomExceptionHandler switch more readable and remove duplicate code

use mapper in create product for less and cleaner code structure
extract functions in AuditableEntityIntercepterceptor into smaller functions
reduce nesting in seed db


Support constants in switch

Currently, I'm getting Expecting a literal expression.

What did you put in the case?  switch cases can only be literal constants.

const VALUE = 42;

switch 5 {
    VALUE => print("yes"),
    _ => print("no").
}

It doesn't support constants in the case position... It must be a literal, like 42.

This is a pretty serious limitation. I have to use if for such cases.

You may do standard text processing on the script to replace the constants with values...
Just a thought.

But really, it is probably simpler to do:

Collect all lines starting with const
Run those lines as a script into eval_with_scope, getting values for the constants
Iterate the scope, for each constant value, replace $(name)\s*=>\s* with the actual value inside the script
Evaluate the modified script as normal

I will think about this "solution" 😄

An alternative is to simply embed a minimal C preprocessor (like https://github.com/Kestrer/gpp) into your project.  Then you can really do some wacky things:
#define VALUE 42

switch 5 {
     VALUE => print("yes"),
    _ => print("no")
}

Closing this for now.  Putting a wont fix for now.


Unittests

I added a unit test for note_distributio.py

I am not deleting the unittests branch in case people want to add more tests to that branch, rather than creating a new branch.


[shell] volume.check.disk missed all entries

Describe the bug
Until I figured out how I got it
      DataNode slow-volume-1.dc1:8080 hdd(volume:17/28 active:17 free:11 remote:0)
          volume id:295  size:11608883608  collection:"devexp"  file_count:2265  replica_placement:100  version:3  compact_revision:1  modified_at_second:1616062145
      DataNode slow-volume-15.dc2:8080 hdd(volume:11/28 active:11 free:17 remote:0)
          volume id:295  size:8  collection:"devexp"  replica_placement:100  version:3  compact_revision:1  modified_at_second:1616061848

> volume.fix.replication -n
>
> volume.check.disk
slow-volume-3.dc1:8080 has 701 entries, slow-volume-0.dc2:8080 missed 0 entries
slow-volume-0.dc2:8080 has 702 entries, slow-volume-3.dc1:8080 missed 1 entries
slow-volume-6.dc1:8080 has 725 entries, slow-volume-4.dc2:8080 missed 13 entries
slow-volume-4.dc2:8080 has 712 entries, slow-volume-6.dc1:8080 missed 0 entries
slow-volume-1.dc1:8080 has 696 entries, slow-volume-8.dc2:8080 missed 11 entries
slow-volume-8.dc2:8080 has 688 entries, slow-volume-1.dc1:8080 missed 3 entries
slow-volume-5.dc2:8080 has 322 entries, slow-volume-3.dc1:8080 missed 0 entries
slow-volume-3.dc1:8080 has 323 entries, slow-volume-5.dc2:8080 missed 1 entries
slow-volume-15.dc2:8080 has 1409 entries, slow-volume-1.dc2:8080 missed 3 entries
slow-volume-1.dc2:8080 has 1406 entries, slow-volume-15.dc2:8080 missed 0 entries
slow-volume-0.dc2:8080 has 26 entries, slow-volume-13.dc2:8080 missed 13 entries
slow-volume-13.dc2:8080 has 13 entries, slow-volume-0.dc2:8080 missed 0 entries
slow-volume-14.dc2:8080 has 33764 entries, slow-volume-6.dc1:8080 missed 0 entries
slow-volume-6.dc1:8080 has 33766 entries, slow-volume-14.dc2:8080 missed 2 entries
slow-volume-11.dc2:8080 has 27 entries, slow-volume-1.dc2:8080 missed 9 entries
slow-volume-1.dc2:8080 has 18 entries, slow-volume-11.dc2:8080 missed 0 entries
slow-volume-6.dc2:8080 has 14 entries, slow-volume-7.dc2:8080 missed 0 entries
slow-volume-7.dc2:8080 has 21 entries, slow-volume-6.dc2:8080 missed 7 entries
slow-volume-5.dc1:8080 has 34079 entries, slow-volume-1.dc2:8080 missed 0 entries
slow-volume-1.dc2:8080 has 34081 entries, slow-volume-5.dc1:8080 missed 2 entries
slow-volume-12.dc2:8080 has 714 entries, slow-volume-3.dc1:8080 missed 1 entries
slow-volume-3.dc1:8080 has 713 entries, slow-volume-12.dc2:8080 missed 0 entries
slow-volume-7.dc2:8080 has 12 entries, slow-volume-9.dc2:8080 missed 12 entries
slow-volume-9.dc2:8080 has 0 entries, slow-volume-7.dc2:8080 missed 0 entries
slow-volume-10.dc2:8080 has 342 entries, slow-volume-0.dc1:8080 missed 1 entries
slow-volume-0.dc1:8080 has 341 entries, slow-volume-10.dc2:8080 missed 0 entries
slow-volume-9.dc2:8080 has 316 entries, slow-volume-1.dc1:8080 missed 0 entries
slow-volume-1.dc1:8080 has 317 entries, slow-volume-9.dc2:8080 missed 1 entries
slow-volume-3.dc2:8080 has 10 entries, slow-volume-12.dc2:8080 missed 0 entries
slow-volume-12.dc2:8080 has 12 entries, slow-volume-3.dc2:8080 missed 2 entries
slow-volume-13.dc2:8080 has 345 entries, slow-volume-0.dc1:8080 missed 0 entries
slow-volume-0.dc1:8080 has 346 entries, slow-volume-13.dc2:8080 missed 1 entries
slow-volume-15.dc2:8080 has 2 entries, slow-volume-5.dc2:8080 missed 0 entries
slow-volume-5.dc2:8080 has 4 entries, slow-volume-15.dc2:8080 missed 2 entries
slow-volume-10.dc2:8080 has 658 entries, slow-volume-4.dc1:8080 missed 3 entries
slow-volume-4.dc1:8080 has 655 entries, slow-volume-10.dc2:8080 missed 0 entries
slow-volume-4.dc2:8080 has 1279 entries, slow-volume-11.dc2:8080 missed 1 entries
slow-volume-11.dc2:8080 has 1278 entries, slow-volume-4.dc2:8080 missed 0 entries
slow-volume-5.dc1:8080 has 38383 entries, slow-volume-10.dc2:8080 missed 0 entries
slow-volume-10.dc2:8080 has 38385 entries, slow-volume-5.dc1:8080 missed 2 entries
slow-volume-8.dc2:8080 has 18 entries, slow-volume-13.dc2:8080 missed 6 entries
slow-volume-13.dc2:8080 has 12 entries, slow-volume-8.dc2:8080 missed 0 entries
slow-volume-2.dc1:8080 has 357 entries, slow-volume-7.dc1:8080 missed 0 entries
slow-volume-7.dc1:8080 has 359 entries, slow-volume-2.dc1:8080 missed 2 entries
slow-volume-11.dc2:8080 has 702 entries, slow-volume-7.dc1:8080 missed 0 entries
slow-volume-7.dc1:8080 has 703 entries, slow-volume-11.dc2:8080 missed 1 entries
slow-volume-8.dc2:8080 has 29954 entries, slow-volume-6.dc1:8080 missed 0 entries
slow-volume-6.dc1:8080 has 29955 entries, slow-volume-8.dc2:8080 missed 1 entries
slow-volume-2.dc2:8080 has 5 entries, slow-volume-11.dc2:8080 missed 0 entries
slow-volume-11.dc2:8080 has 6 entries, slow-volume-2.dc2:8080 missed 1 entries
load collection devexp volume 295 index size 38505 from slow-volume-1.dc1:8080 ...
load collection devexp volume 295 index size 0 from slow-volume-15.dc2:8080 ...
slow-volume-1.dc1:8080 has 2265 entries, slow-volume-15.dc2:8080 missed 2265 entries

System Setup
8000GB 2.35 f315eb2b
Expected behavior
if index size 0 or idx (not exist/err copy) skip idx

I deleted the empty volume and try again and everything was fine
> volume.delete -node slow-volume-15.dc2:8080 -volumeId=295
> volume.fix.replication -n
replicating volume 295 100 from slow-volume-1.dc1:8080 to dataNode slow-volume-10.dc2:8080 ...
> volume.check.disk -v

@chrislusf The logic is also broken after checking
first run
volume.check.disk -v -force
load collection logs-prod volume 344 index size 509592 from slow-volume-8.dc2:8080 ...
load collection logs-prod volume 344 index size 509609 from slow-volume-6.dc1:8080 ...
slow-volume-8.dc2:8080 has 29954 entries, slow-volume-6.dc1:8080 missed 0 entries
slow-volume-6.dc1:8080 has 29955 entries, slow-volume-8.dc2:8080 missed 1 entries
read 344,31633138633965 slow-volume-6.dc1:8080 => slow-volume-8.dc2:8080

second run
volume.check.disk -v
load collection logs-prod volume 344 index size 509609 from slow-volume-8.dc2:8080 ...
load collection logs-prod volume 344 index size 509609 from slow-volume-6.dc1:8080 ...
slow-volume-8.dc2:8080 has 29955 entries, slow-volume-6.dc1:8080 missed 0 entries
slow-volume-6.dc1:8080 has 29955 entries, slow-volume-8.dc2:8080 missed 0 entries

volume.list
      DataNode slow-volume-6.dc1:8080 hdd(volume:16/28 active:16 free:12 remote:0)
          volume id:344  size:105051475504  collection:"logs-prod"  file_count:29965  delete_count:12  deleted_byte_count:824647  replica_placement:100  version:3  modified_at_second:1615384471
      DataNode slow-volume-8.dc2:8080 hdd(volume:11/28 active:11 free:17 remote:0)
          volume id:344  size:105051475504  collection:"logs-prod"  file_count:29966  delete_count:11  deleted_byte_count:824647  replica_placement:100  version:3  modified_at_second:1616420609

It seems that these statistics are not reliable.
Maybe you should remove the condition altogether ? https://github.com/chrislusf/seaweedfs/blob/master/weed/shell/command_volume_check_disk.go#L78
Works pretty fast
time sh -c 'echo -e "lock\nvolume.check.disk -v" | weed shell'
real	0m 8.18s
user	0m 2.30s
sys	0m 0.27s

Maybe you should remove the condition altogether ? https://github.com/chrislusf/seaweedfs/blob/master/weed/shell/command_volume_check_disk.go#L78

you can think it is just a shortcut. If the file counts are the same, it is very likely the files are the same already.


Knit-created RemoteProperties will sometimes not be available during controller initialization

There's a very low chance of my service's RemoteProperties being nil (not the value, but the object itself) as seen from the controller/client. There are no reproduction steps and it will occur seemingly spontaneously without code alterations between tests.

We're running version 1.4.7

@Sleitnick
See: https://github.com/Sleitnick/RbxUtil/issues/155

Thanks @ambergamefam and @enricomfg. I'll give this a look this weekend and see if I can resolve it.

#248


Update the notebooks for the v0.2.0 online lab

small code style improvements in the new example dataset notebooks
updated compression to use the new fcbench.compressor.compress_decompress API
updated Markdown admonitions to use the newly installed jupyterlab-myst in the online lab

@SF-N These updates should now be good to go (if I manage to fix the loading messages, I'll do that as a follow-up PR). Mostly the PRs update the admonitions so that jupyterlab-myst, a new extension installed in the online lab, can render them.
I also included some small code style improvements.

@SF-N I've now also fixed the missing package loading messages and they are now back

@SF-N I'd like to merge this PR now as-is (unless you find anything else that should be changed), we can add further fixes (incl. the ICON-XPP licensing info) in small follow-up PRs

If you're ok with the merge, could you give an approving review?


Bump dev version to 0.3.12-dev

@oesteban Made this a PR just in case I've forgotten how we do this...

Actually, you just reminded me that I've been releasing without updating versions.


Documentation/license 3rdparty

[x] Update C/C++ Library license information
[x] Update Program license information
[ ] Update JavaScript license information
[x] Add back V8 gyp license file
[ ] Adjust utils/generateLicense.py
[ ] Clean up & formatting

Are all dependencies of dependencies (Node) supposed to be listed?
(js\node\package-lock.json)


Updated storybook to 5.0.0 (WIP)

LiveURL: https://orbit-components-update-storybook.surge.sh

Waiting to fix this shit: https://github.com/storybooks/storybook/issues/5974#issuecomment-473016908


latest run that includes a relaxed check for "skipping GO annotations made by GO_Central, GOC, and GO_REF:0000033 increased output by 200K

created from issue #38

Should this be closed? (since it's in the DONE column)


[Feature Request] Drop the double gymnasium/gym dependency

Motivation
When installing the lib, both gym and gymnasium get installed.
This is a disaster for libs like torchrl which support both and need to choose a backend depending on the libraries that are installed in the virtual env.
For instance, running
if isinstance(spec, gym.spaces.discrete.Discrete):
   etc

will return False if gym does not point to the right library.
I think that one should avoid at all cost to have multiple versions of the same library installed at the same time in a venv. The renaming of gym in gymnasium is already a major pain point, but we should make everything we can to avoid adding an extra level of complexity.

@Markus28 @vwxyzjn what's the best practice here?

@vmoens I'm not completely sure I correctly understand: In your example, would gym be either OpenAI Gym or Gymnasium, depending on what is installed?
I think it is quite realistic to assume that many users of Gymnasium will simultaneously have Gym installed, e.g. to use legacy environments (I'm not 100% sure whether this has been fixed but Atari required Gym, for instance).  That's why I think it might be more sustainable to accommodate these cases.
In Tianshou we took the approach of only using Gymnasium environments internally. If a Gym environment is passed to tianshou, it is immediately wrapped in a compatibility layer. This might be a viable approach on your side.
On the envpool side, one possibility would be to make gym/gymnasium an extra that does not install the other dependency.

I think it is quite realistic to assume that many users of Gymnasium will simultaneously have Gym installed, e.g. to use legacy environments (I'm not 100% sure whether this has been fixed but Atari required Gym, for instance). That's why I think it might be more sustainable to accommodate these cases.

I tend to disagree. I think that renaming the library to gymnasium wasn't a bright idea exactly because of this. The fact that they follow the versioning of gym demonstrates that it is indeed the same library.
One thing is to support multiple versions of gym (which we do) another is to encourage the installation of multiple versions at the same time or worse, put them in the library requirements.
I have no problem against wrapping one with the other if that solves problems, but I would not put both in the library requirements.
Something like
try:
    import gym
except ImportError as err:
    GYM_ERR=err
else:
    GYM_ERR=None
try:
    import gymnasium
except ImportError as err:
    GYMNASIUM_ERR=err
else:
    GYMNASIUM_ERR=None

and then the rest of the code would follow as needed.
The contentious point on our side is that if we do a check like if isinstance(foo, gym.something) we will need to adapt the entire code base since one could import both libraries at the same time, hence this will become
if isinstance(foo, (gym.something, gymnasium.something, ))

This hampers code readability and, it boils down to supporting something that should never happen (IMHO).
Using the example above, we can do
try:
    from gymnasium import something
except:
    try:
        from gym import something
    except:
        etc

Does that make sense?
I can see multiple settings where having these two libs installed will cause headaches to the users and I would strongly recommend against it personally.
Also I'm curious about what could gymnasium not support that gym does? To me gymnasium follows the lifecycle of gym and any deprecation is done to improve the library. You can't use features from gym 0.23 in gymnasium for the same reason that you can't install both torch 1.10 and torch 1.11 in the same virtual env.

@vmoens you might have a look at https://github.com/DLR-RM/stable-baselines3/blob/feat/gymnasium-support/stable_baselines3/common/vec_env/patch_gym.py
With this piece of code, we support gym 0.21/0.26 and gymnasium (using Gymnasium/vec env as primary backend).

Thanks
We support gym and gymnasium through this
My point isn't that this is a problem, but that a library should not be shipped with 2 versions of a same library (since gym and gymnasium are the same library).

@vmoens I hope there was an excellent reason for renaming the gym package to gymnasium, such as access rights to the old pypi package were lost or something like that.
Gym 0.26 upgrade was a huge pain already, and mostly unnecessary. The community already figured out ways to do everything the new API supports. But at least I can get behind the reasoning for it, the new API IS more transparent and clear.
This renaming does not add any value at all as far as I can tell, and adds a bunch of new complexity: basically, every single RL library needs to carry and maintain this compatibility layer, a new dependency on "shimmy", etc. As a community, we should do everything to prevent these things from happening in the future.

Indeed,
All my envs now have 2 libraries with the same capability. Funny enough: if I install gymnasium, it requires mujoco AND mujoco-py, which requires mujoco 2.1.0 and... gym!
so gymnasium requires gym!
We've gone full circle now... it's a pure engineering disaster

I very much understand your frustration. The hacks that are required to accommodate the recent changes make me feel uneasy, too. I don't know what the long-term perspective looks like, but I will bring this discussion up with the Gymnasium maintainers.
For envpool, I have looked into a solution where we provide one extra for gymnasium, one for gym, then enforce that the user specifies exactly one of these extras during installation. Unfortunately, I'm not really familiar with bazel or the intricacies of envpools build system in general, so if someone else could look into this, that would be great. I'd probably miss something (@Trinkle23897).
I still believe that the simultaneous installation of Gym and Gymnasium is something that will happen all the time (as @vmoens has pointed out, too). Of course, I agree that it's not something that should happen, but it will. It's a good idea to fix this double dependency for envpool, but  ultimately, it will be out of your control what your users install, so (imo) you shouldn't make assumptions about that in your code.

Hi all, Im only now looking at this thread and will try to respond to each problem individually

Indeed, All my envs now have 2 libraries with the same capability. Funny enough: if I install gymnasium, it requires mujoco AND mujoco-py, which requires mujoco 2.1.0 and... gym! so gymnasium requires gym! We've gone full circle now... it's a pure engineering disaster

I don't seem to be replicate this issue. Installing gymnasium[mujoco-py] or gymnasium[mujoco] doesn't include gym as any of the installs or sub-packages. Could you provide some code to replicate this issue?

For envpool, I have looked into a solution where we provide one extra for gymnasium, one for gym, then enforce that the user specifies exactly one of these extras during installation.

I agree with @Markus28 and I think most people in this thread that this is the easiest solution to fix the issue. Or at least, have gymnasium as a core dependency (if the internal backend requires it as I understand) with gym as an optional extra.

Indeed, All my envs now have 2 libraries with the same capability. Funny enough: if I install gymnasium, it requires mujoco AND mujoco-py, which requires mujoco 2.1.0 and... gym! so gymnasium requires gym! We've gone full circle now... it's a pure engineering disaster

I don't seem to be replicate this issue. Installing gymnasium[mujoco-py] or gymnasium[mujoco] doesn't include gym as any of the installs or sub-packages. Could you provide some code to replicate this issue?

You are right I edited my comment :)

Just to offer a brief comment- the solution we're encouraging packages to adopt (and at least most packages I'm personally aware of are planning to adopt) is to only have a dependency on Gymnasium and to point users towards our compatibility wrappers for when they still need Gym.


build(deps): migrate to nx 13

migrate to nx 13
migrate to angular 13
migrate to nest 8
migrate  svelte

Fixes #534
Provided by:

PixelBook
Codespaces

:tada: This PR is included in version 0.6.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Cant compile SoftEther on Debian 9

Prerequisites

[ x] Can you reproduce?
[ x] Are you running the latest version of SoftEtherVPN?

SoftEther version: [5.1]
Component: [Server]
Operating system: [Windows, Linux, BSD, macOS, etc.]
Architecture: [64 bit]
Description
Can't make and install the SoftEtherVPN even though i installed all dependencies mentioned in issue #301.
Expected behavior:
./configure
make
Actual behavior:
Error:
tmp/objs/Mayaqua/Encrypt.o: In function Enc_tls1_P_hash': Encrypt.c:(.text+0x175d): undefined reference to HMAC_CTX_new'
Encrypt.c:(.text+0x1765): undefined reference to HMAC_CTX_new' Encrypt.c:(.text+0x1882): undefined reference to HMAC_CTX_free'
Encrypt.c:(.text+0x188a): undefined reference to HMAC_CTX_free' tmp/objs/Mayaqua/Encrypt.o: In function FreeMd':
Encrypt.c:(.text+0x2006): undefined reference to HMAC_CTX_free' tmp/objs/Mayaqua/Encrypt.o: In function NewMd':
Encrypt.c:(.text+0x2060): undefined reference to HMAC_CTX_new' tmp/objs/Mayaqua/Encrypt.o: In function RsaPublicToBuf':
Encrypt.c:(.text+0x2442): undefined reference to EVP_PKEY_get0_RSA' Encrypt.c:(.text+0x2458): undefined reference to RSA_get0_key'
tmp/objs/Mayaqua/Encrypt.o: In function NewExtendedKeyUsageForX509': Encrypt.c:(.text+0x2ca7): undefined reference to OPENSSL_sk_new_null'
Encrypt.c:(.text+0x2d40): undefined reference to OPENSSL_sk_pop_free' tmp/objs/Mayaqua/Encrypt.o: In function LoadXDates':
Encrypt.c:(.text+0x33fd): undefined reference to X509_get0_notBefore' Encrypt.c:(.text+0x3411): undefined reference to X509_get0_notAfter'
tmp/objs/Mayaqua/Encrypt.o: In function RsaVerifyEx': Encrypt.c:(.text+0x3579): undefined reference to EVP_PKEY_get0_RSA'
tmp/objs/Mayaqua/Encrypt.o: In function RsaSignEx': Encrypt.c:(.text+0x3665): undefined reference to EVP_PKEY_get0_RSA'
tmp/objs/Mayaqua/Encrypt.o: In function NewX509.part.13': Encrypt.c:(.text+0x4520): undefined reference to X509_getm_notBefore'
Encrypt.c:(.text+0x452c): undefined reference to X509_getm_notAfter' tmp/objs/Mayaqua/Encrypt.o: In function NewRootX509':
Encrypt.c:(.text+0x4836): undefined reference to X509_getm_notBefore' Encrypt.c:(.text+0x4843): undefined reference to X509_getm_notAfter'
tmp/objs/Mayaqua/Encrypt.o: In function X509ToX': Encrypt.c:(.text+0x4fdf): undefined reference to OPENSSL_sk_num'
Encrypt.c:(.text+0x4fed): undefined reference to OPENSSL_sk_value' tmp/objs/Mayaqua/Encrypt.o: In function InitCryptLibrary':
Encrypt.c:(.text+0x5a45): undefined reference to OPENSSL_init_ssl' Encrypt.c:(.text+0x5a51): undefined reference to OPENSSL_init_crypto'
Encrypt.c:(.text+0x5a5d): undefined reference to OPENSSL_init_crypto' Encrypt.c:(.text+0x5a69): undefined reference to OPENSSL_init_crypto'
Encrypt.c:(.text+0x5a75): undefined reference to OPENSSL_init_ssl' tmp/objs/Mayaqua/Encrypt.o: In function DhNew':
Encrypt.c:(.text+0x6d24): undefined reference to DH_set0_pqg' Encrypt.c:(.text+0x6d3c): undefined reference to DH_get0_key'
tmp/objs/Mayaqua/Encrypt.o: In function AddKeyUsageX509': Encrypt.c:(.text+0x2c8d): undefined reference to OPENSSL_sk_push'
tmp/objs/Mayaqua/Secure.o: In function WriteSecKey': Secure.c:(.text+0x12e4): undefined reference to EVP_PKEY_get0_RSA'
Secure.c:(.text+0x1304): undefined reference to RSA_get0_key' Secure.c:(.text+0x131a): undefined reference to RSA_get0_factors'
Secure.c:(.text+0x133b): undefined reference to `RSA_get0_crt_params'
collect2: error: ld returned 1 exit status

How did you Download the source code?? From this git repo??
On Thu 24. May 2018 at 16:39, Adrian Völker<EMAIL_ADDRESS>wrote:

Prerequisites

[ x] Can you reproduce?
[ x] Are you running the latest version of SoftEtherVPN?

SoftEther version: [5.1]
Component: [Server]
Operating system: [Windows, Linux, BSD, macOS, etc.]
Architecture: [64 bit]
Description
Can't make and install the SoftEtherVPN even though i installed all
dependencies mentioned in issue #301
https://github.com/SoftEtherVPN/SoftEtherVPN/issues/301.
Expected behavior:
./configure
make
Actual behavior:
Error:
tmp/objs/Mayaqua/Encrypt.o: In function Enc_tls1_P_hash':
Encrypt.c:(.text+0x175d): undefined reference toHMAC_CTX_new'
Encrypt.c:(.text+0x1765): undefined reference to HMAC_CTX_new'
Encrypt.c:(.text+0x1882): undefined reference toHMAC_CTX_free'
Encrypt.c:(.text+0x188a): undefined reference to HMAC_CTX_free'
tmp/objs/Mayaqua/Encrypt.o: In functionFreeMd':
Encrypt.c:(.text+0x2006): undefined reference to HMAC_CTX_free'
tmp/objs/Mayaqua/Encrypt.o: In functionNewMd':
Encrypt.c:(.text+0x2060): undefined reference to HMAC_CTX_new'
tmp/objs/Mayaqua/Encrypt.o: In functionRsaPublicToBuf':
Encrypt.c:(.text+0x2442): undefined reference to EVP_PKEY_get0_RSA'
Encrypt.c:(.text+0x2458): undefined reference toRSA_get0_key'
tmp/objs/Mayaqua/Encrypt.o: In function NewExtendedKeyUsageForX509':
Encrypt.c:(.text+0x2ca7): undefined reference toOPENSSL_sk_new_null'
Encrypt.c:(.text+0x2d40): undefined reference to OPENSSL_sk_pop_free'
tmp/objs/Mayaqua/Encrypt.o: In functionLoadXDates':
Encrypt.c:(.text+0x33fd): undefined reference to X509_get0_notBefore'
Encrypt.c:(.text+0x3411): undefined reference toX509_get0_notAfter'
tmp/objs/Mayaqua/Encrypt.o: In function RsaVerifyEx':
Encrypt.c:(.text+0x3579): undefined reference toEVP_PKEY_get0_RSA'
tmp/objs/Mayaqua/Encrypt.o: In function RsaSignEx':
Encrypt.c:(.text+0x3665): undefined reference toEVP_PKEY_get0_RSA'
tmp/objs/Mayaqua/Encrypt.o: In function NewX509.part.13':
Encrypt.c:(.text+0x4520): undefined reference toX509_getm_notBefore'
Encrypt.c:(.text+0x452c): undefined reference to X509_getm_notAfter'
tmp/objs/Mayaqua/Encrypt.o: In functionNewRootX509':
Encrypt.c:(.text+0x4836): undefined reference to X509_getm_notBefore'
Encrypt.c:(.text+0x4843): undefined reference toX509_getm_notAfter'
tmp/objs/Mayaqua/Encrypt.o: In function X509ToX':
Encrypt.c:(.text+0x4fdf): undefined reference toOPENSSL_sk_num'
Encrypt.c:(.text+0x4fed): undefined reference to OPENSSL_sk_value'
tmp/objs/Mayaqua/Encrypt.o: In functionInitCryptLibrary':
Encrypt.c:(.text+0x5a45): undefined reference to OPENSSL_init_ssl'
Encrypt.c:(.text+0x5a51): undefined reference toOPENSSL_init_crypto'
Encrypt.c:(.text+0x5a5d): undefined reference to OPENSSL_init_crypto'
Encrypt.c:(.text+0x5a69): undefined reference toOPENSSL_init_crypto'
Encrypt.c:(.text+0x5a75): undefined reference to OPENSSL_init_ssl'
tmp/objs/Mayaqua/Encrypt.o: In functionDhNew':
Encrypt.c:(.text+0x6d24): undefined reference to DH_set0_pqg'
Encrypt.c:(.text+0x6d3c): undefined reference toDH_get0_key'
tmp/objs/Mayaqua/Encrypt.o: In function AddKeyUsageX509':
Encrypt.c:(.text+0x2c8d): undefined reference toOPENSSL_sk_push'
tmp/objs/Mayaqua/Secure.o: In function WriteSecKey':
Secure.c:(.text+0x12e4): undefined reference toEVP_PKEY_get0_RSA'
Secure.c:(.text+0x1304): undefined reference to RSA_get0_key'
Secure.c:(.text+0x131a): undefined reference toRSA_get0_factors'
Secure.c:(.text+0x133b): undefined reference to `RSA_get0_crt_params'
collect2: error: ld returned 1 exit status
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/SoftEtherVPN/SoftEtherVPN/issues/541, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AEQBxXOqgt23WYEK4uFF9o_FvMlVgj1Uks5t1sY2gaJpZM4UMYbZ
.

Yes I did.

It looks like you are missing openssl somehow.
Could you please tell me the output of openssl version and also paste the output of ./configure command

./configure
make

does not work after cmake:
https://gitlab.com/chipitsine/SoftEtherVPN/-/jobs/70356321
however, error message is different from you observe

@davidebeatrici , we should update BUILD_WINDOWS with "make -C tmp"

@chipitsine What do you think about creating a new script called build, which calls make in the tmp folder?

I think about more traditional
./configure
make

without "-C tmp"

./configure
cd tmp
make

?

@Adrian-Voelker I just created a digital ocean instance with debian 9 installed and successfully compiled SoftEther.
Here's what I did on a brand new machine:
sudo apt-get update
sudo apt -y install cmake gcc libncurses5-dev libreadline-dev libssl-dev make zlib1g-dev git
git clone https://github.com/SoftEtherVPN/SoftEtherVPN.git
cd SoftEtherVPN
./configure
make -C tmp

@davidebeatrici  , I mean something like that
https://github.com/chipitsine/SoftEtherVPN/commit/6557532b1316e04655965f928af214a07ddd5d72

@chipitsine I don't think it's a good idea, because all of the build files are created into the source code folders.

well, anyway BUILD_UNIX is incosistent, we should update "make" with "make -C tmp"
if you do not like my idea, let follow your way

You guys agree on an approach and proceed. I've seen both solutions quite often, but make without extra arguments is definitely more popular.
The decision will affect PR #530. Also this issue is not the right place to have this discussion (in my opinion). Please create an issue for that if necessary.

@Adrian-Voelker  Has your problem been solved?

Hey Guys. Please excuse my belated answer.
After i did it like @moatazelmasry2  did on a brand new maschine, it worked!
Thank you for helping.


Moment overwrites itself and all extensions

Describe the bug
Apologies in advance if this belongs in moment timezone. When working on a large application, there are a lot of dependencies that are loaded through various means. In this case, a plugin that depends on moment is loaded to a large application that uses moment and moment timezone. The plugin only requires moment, but is loading moment with itself. When this happens, the extensions on the original moment are overwritten. See this jsfiddle for example https://jsfiddle.net/uth41pnk/1/
To Reproduce
Steps to reproduce the behavior:

Create an application
Load moment.js
Load moment.js timezone
Load a plugin that depends and includes moment.js
Use moment.js timezone after the plugin has been loaded

Expected behavior
I should expect moment.tz to be defined and work as intended.
Screenshots

Moment-specific environment

The time zone setting of the machine the code is running on
The time and date at which the code was run
Other libraries in use (TypeScript, Immutable.js, etc)

Please run the following code in your environment and include the output:
Fri Jan 24 2020 13:04:18 GMT-0600 (Central Standard Time)
1/24/2020, 1:04:18 PM
360
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.117 Safari/537.36
2.10.2

Additional context
While I know we are currently working on a very old version of moment (2.10.2), I would expect moment to check if it has already been defined. Currently, I have monkey patched the plugin not to include moment.

@DrkCloudStrife You should import moment-timezone. See https://momentjs.com/timezone/.

@Alanscut Thanks for the reference. In the steps I provided I stated I'm using moment-timezone, albeit I wrote it as moment.js timezone.
To give more context, I'm not using webpack and I'm using a rails application with sprockets 3. The problem is with a third party plugin that depends on moment.js. This plugin is overwriting my moment.js configuration. What I'm asking is for moment.js to detect if it has already been defined prior to defining itself. Similar to how polyfills behave, so that the original pre-defined class isn't overwritten.

Thanks for opening this request.
I think the plugin should handle this. I'm not comfortable only defining moment if it does not exist.


Link Error with CMake

Before reporting an issue please first check the
troubleshooting guide. If
the issue you're encountering is not solved thereby please state the following in your bugreport:

Windows 10 2004
vcpkg - also installed llvm per readme.
opencv 4.1.1
Attach the full output of the following command from your project directory:

Dependency block as so:
opencv = {git = "https://github.com/twistedfall/opencv-rust/", features = ["buildtime-bindgen"]}

Abridged: https://gist.github.com/carbotaniuman/c47a6e689610cb03b61fca118ea321ca
Raw: https://gist.github.com/carbotaniuman/c8f66d1b1e5fb3bcae2e1f18b88b1f46
With $env:OPENCV_DISABLE_PROBES="cmake" and $env:VCPKGRS_DYNAMIC=1, the code compiles and works.

I see, I’ll bump the priority of vcpkg, it should come before cmake at least on Windows.

Will you please check the current master to see if it fixes the problem for you? You should no longer need the OPENCV_DISABLE_PROBES env variable, but VCPKGRS_DYNAMIC might still be needed (out of my control).

That appears to have fixed it. Thanks!

Fixed in 0.40.1


defineRouteRules CSP headers not taken into account

Version
nuxt-security: 2.0.0-beta.5
nuxt: 3.11.2
Reproduction Link
Steps to reproduce
What is Expected?
The following config isn't taken into account when placed in one of the pages:
defineRouteRules({
    security: {
        headers: {
            contentSecurityPolicy: {
                'connect-src': [
                    'https://*.googleapis.com',
                    '*.google.com',
                    'https://*.gstatic.com'
                ],
                'frame-src': [
                    '*.google.com'
                ],
                'font-src': [
                    'https://fonts.gstatic.com'
                ],
                'style-src': [
                    'https://fonts.googleapis.com'
                ],
                'img-src': [
                    'https://*.googleapis.com',
                    'https://*.gstatic.com',
                    '*.google.com'
                ]
            }
        }
    }
})

What is actually happening?
Clearly only the default values declared in nuxt.config file are displayed:

(I do have experimental.inlineRouteRules enabled.)

Hi @DamianGlowala
The inline definitions of defineRouteRules work correctly on my side.
Are you navigating on the client-side or are you hard-reloading the page from the server ? Cf https://nuxt-security.vercel.app/documentation/advanced/strict-csp#per-route-csp

Hi @vejja,
Thank you for checking them on your side! I think I'll need to provide a minimal reproduction; I hope I'll manage to make one.
Headers are absent in both cases - after a client-side navigation and when entering the page after a reload.

Edit: Is your page pre-rendered ? This might actually be a corner case

Nope, it's an SSR app with no prerendered pages.

OK, let me know if you can provide a repro. There might be something to fix.

(I'll reopen if I manage to provide a reproduction.)


Fix module build command

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)

/test pull-nats-module-build


Add option to right-click with no item

suwako99Today at 02:15
whatisthis can add a config “right-click-without-anything”to let player can click without stick or other block to use plugins.

This has been added in version 2.4 - item can be set to AIR or NONE in the config.yml.


fix(spec): do not include unpackaged rendezvous-info.yml file

Removes rendezvous-info.yml from the install list for the aio command,
the contents of this file are already embedded into the manufacturing-server.yml file,
so aio does not need it.
This fixes the following error when trying to make rpm locally:
Checking for unpackaged file(s): /usr/lib/rpm/check-files fido-device-onboard-rs/rpmbuild/BUILDROOT/fido-device-onboard-0.4.7-1.20230207gitdaa4a6c.el9.x86_64
error: Installed (but unpackaged) file(s) found:
   /usr/share/doc/fdo/rendezvous-info.yml

should we then just remove the file altogether if it's merged into the manufacturing config and hence unused?

should we then just remove the file altogether if it's merged into the manufacturing config and hence unused?

No because it is referenced in the HOWTO. You need this file in order to generate an OV and a device_credential, so we should provide with an example.

Can we drop the fdo and space so it's just %{buildroot}%{_docdir}/examples/ (also no spaces).

Let me know if the latest change makes sense


⚠ Bofrost.fr has degraded performance

In 53ecd49, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1171 ms

Resolved: Bofrost.fr performance has improved in f7e6075 after 6 minutes.


Impossible to load not well-formed GPX

I want to show on the map a GPX, which is being recorded right now. This GPX does not have closing tags, of course. So I have a "XML Parsing Error: no root element found".

what is the solution for this


It seems to be a style bug

描述这个Bug
Env
Acro Design Pro
Node v18.19.1
Vue 3
Desc
When the editor component is put in a modal, the bug happens like the following pic

版本号
Acro Design Pro ; Node v18.19.1; Vue 3
问题重现链接
No response

I don't think this is an issue with the component.


close popup

When we have a datetime, we must set close-on-select to false to let users time to select both a date and a time. But the only way to close the popup afterwards seems when clicking with the mouse somewhere outside the popup. It would be good to have other possibilities such as when Escape is clicked. Also when the blur event occurs on the input (through a tab for instance).

Thanks for using this module.
Added Escape key.
Tried blur event, but was not successful.

maybe blur event does not make too much sense after all. Because there are several input in the popup itself so it would be hard to monitor all of them ...
Some additional ideas:

an icon (X) or an "OK" button (or both) could also be there to help hiding the popup
keyCode 13 (enter) may make sense too

I am going to discuss more about this topic, which will not be implemented immediately.


PATCH /session/account

follow up for #54, closes #53

@gr2m cool I will check through it thx !!- - -

@ianstalter123 is this good for review, or are you still working on it?
For trailing whitespace, most editors have a configuration where you can ask it to remove trailing slashes. Most editors also support editorconfig. I have one in my home directory so it always applies as default, it looks like this:
$ cat ~/.editorconfig
root = true

[*]
end_of_line = lf
insert_final_newline = true
indent_size = 2
trim_trailing_whitespace = true
[*.md]
trim_trailing_whitespace = false
insert_final_newline = false
[*.txt]
trim_trailing_whitespace = false
insert_final_newline = false
[*.hbs]
trim_trailing_whitespace = false
insert_final_newline = false
[*.json]
trim_trailing_whitespace = false
insert_final_newline = false
indent_size = 4
[package.json]
indent_size = 2

@gr2m I installed editor config, not sure how it works (is there a shortcut or does it automatically just set) -> if you can fix this and close please do otherwise I will try to get rid of trailing line spaces again tommorow

You need to download a plugin for your editor here:
http://editorconfig.org/#download
I’ve update your PR, I only did minor adjustments for standard and a little simplification for the double route mocking. Thanks, great work @ianstalter123 :+1:


arm64 Mac download needed

At https://github.com/ericchiang/pup/releases/tag/v0.4.0 there are downloads for i386 and x86_64 Macs but not arm64 Macs.

arm64 builds are available on brew. using it currently on M1

Hi. Came across the same issue and DID NOT want to use Homebrew. Here is my workaround... somewhat overkill as it can be used to rebuild all targets. I only used the darmin/arm64 output as this was my requirement; other targets have not been tested.
#! /bin/ksh
typeset version="0.4.0"

# Download the master repository (or the release tarball as desired)
git clone https://github.com/ericchiang/pup pup-$version
cd pup-$version

[[ -d dist ]] && rm -rf dist; mkdir dist

# Get all dependencies
for dependency in \
    github.com/{fatih/color,mattn/go-colorable} \
    golang.org/x/{net/{html,html/atom,html/charset},text/transform}
do GO111MODULE=auto go get $dependency; done

# List all platforms (exception list taken from release.sh)
go tool dist list | sed '/android|darwin\/arm|s390x|plan9\/arm/d; s/\// /' |\
while read os arch; do

    # Construct the target binary's name
    typeset binary=pup; [[ $os == windows ]] && binary+=.exe
    typeset arname=pup-$version-$os-$arch

    [[ $os == @(darwin|linux) && $arch == @(arm|amd)64 ]] || continue

    print -- "- building for operating system\`$os\` running on a \`$arch\` architecture"
    #go -- build -v -a -o dist/$binary github.com/ericchiang/pup &&
    GO111MODULE=auto GOOS=$os GOOARC=$arch CGO_ENABLED=0 \
    go build -v -a -o dist/$binary 1>&2 2>dist/$arname.log &&
    (cd dist; tar zcf $arname.tgz $binary && rm $binary)

done


prod CAS in staging env, interpolated rails environment to sql server

New Feature

CAS is now pointing to production on our staging environment so we can test Tableau pass through authentication on the staging env
Sql Server connection is now interpolating the Rails Env in the connection secret variables so we can custom define them for each environment

Coverage remained the same at 93.079% when pulling 6f18bf0175d6b2d3337fd028cee0b3c8ef4030ea on dev into 45a1cf19807694aae33cc4d81ee6cc39c5e76ead on master.


More practical?

There was a function for this  so  i made it more practical

Hi @Swifu69 , please pull the latest of master and comment here when done so we can check the CI :)

thanks @Swifu69 !


extend timeout and more logging

Also, we were not disposing the (disposable) WebSocket in the Autobahn Test app.
NOTE: use https://github.com/aspnet/WebSockets/pull/183/files?w=1 to review, indentation changes :)
/cc @ryanbrandenburg

:up: :date: Reacted to PR feedback, also added a "pinger" that sends standard HTTP requests to the server while the test is running so we can identify if the server or client is hanging, when they hang.


Prevent sending goroutine to block after timeout

The channel ch needs a buffer size of 1. If it were an unbuffered
channel and the response took more than timeoutInSeconds, the channel
send statement [e.g. ch <- g.Location()] would block forever as there
is no receiver anymore.
See: https://github.com/golang/go/wiki/Timeouts

Thank you Stani for the heads up.


Fix some go report issues

Coverage decreased (-0.01%) to 60.625% when pulling 0088526da736b89cc713a607b6657a973130aec4 on development into 10b98244e33efa1e4df8b52be14b9208e90360e1 on master.


http ClientResponse does not exist

Hi,
ClientResponse line seems to have been renamed to IncomingMessage perhaps because no ClientResponse exists in the docs anymore.  I don't know if this is an issue for lower versions of node but would be an issue for current versions.
Thank you for developing this handy package.
I use Typescript and I had forked this repository and created a ts version. While doing so I had discovered the above mentioned issue and also an issue with edchCurve passed into request options. The latter appears to be unspecified in the request Typescript Type Definitions file and is the reason.
My changes pass all tests.
Would gladly PR if requested to do so.
Please let me know about the ClientResponse*.
For an implementation example with typescript checkout getVideo
Good day!

@Kikobeats any idea on this?

@JaysQubeXon
That's a really good catch, thanks for that!
Please go ahead with the PR, happy to merge is asap 🙂


Switched to using GNU standard

Extra fix for #14211, This PR is to make sure the whole page at https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/ follows the GNU standard.

/assign @steveperry-53

/lgtm
/approve


ADI upload

Not linking upload to callsign.

User issue all sorted

Worth raising as a feature request though... Ask for ability to add callsign when ADIF imports QSOs but the callsign doesn't exist yet.


followStats() function missing

Problem explanation
Stream supports getting follower count for a feed via followStats() function in JS, but it's not yet available in the python/django server side libs.
Here's the mention for followStats() in official docs: https://getstream.io/activity-feeds/docs/node/following/?language=javascript#reading-follow-stats
Is there a plan to expose this feature in python/django?
Without this it's impossible to get follower count for a feed group with more than 1,000 members
TIA

Whoops its already added in 4.0.0, closing this issue


implement login & error pages

Codecov Report

Merging #8 into master will increase coverage by 3.11%.
The diff coverage is 36.36%.

@@             Coverage Diff              @@
##             master       #8      +/-   ##
============================================
+ Coverage     72.69%   75.81%   +3.11%
+ Complexity      696      674      -22
============================================
  Files            79       79
  Lines          1670     1600      -70
============================================
- Hits           1214     1213       -1
+ Misses          456      387      -69

Impacted Files
Coverage Δ
Complexity Δ

src/Controller/Api/Base/BaseApiController.php
90.9% <ø> (+11.96%)
14 <0> (-1)
:arrow_down:

src/Entity/Email.php
0% <ø> (ø)
20 <0> (ø)
:arrow_down:

src/Controller/Api/IssueController.php
87.14% <ø> (ø)
54 <0> (ø)
:arrow_down:

src/Enum/Base/BaseEnum.php
0% <0%> (ø)
10 <0> (ø)
:arrow_down:

src/Api/Response/ErrorResponse.php
0% <0%> (ø)
1 <1> (ø)
:arrow_down:

src/EventListener/ExceptionListener.php
18.75% <0%> (ø)
3 <0> (ø)
:arrow_down:

src/Controller/SupportController.php
0% <0%> (ø)
1 <1> (?)

src/Controller/Base/BaseFormController.php
16.66% <0%> (+14.1%)
5 <0> (-17)
:arrow_down:

src/Controller/Base/BaseLoginController.php
12% <0%> (ø)
9 <7> (ø)
:arrow_down:

src/Api/Response/Base/AbstractMessageResponse.php
100% <100%> (ø)
4 <3> (+1)
:arrow_up:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c1c5fa9...f8b59e5. Read the comment docs.


Feature: DECIMAL type

DECIMAL(P,D)
For accurate time fields

Hey @aight8 and thanks for opening this issue.
This is duplicate of #277 and we plan to address this soon.
Closing. Let's continue the discussion there.


Size OpenSearch Domain based on Expected traffic

Description
Currently, the size of the OpenSearch Domain (number of nodes, instance type) is static and not configurable by the user.  We should enable the user to indicate an expected traffic volume/data retention policy and provision OpenSearch capacity according to the user's specification.
Considerations:

@awick provided the following equations based on his experience.

SessionsGB = ($replicas + 1) * ($spiDays * 24 * 60 * 60) * $ExpectedGbps/8 * 0.03
NodesByGB = $SessionsGB/$GBPerOSNode
Nodes = MAX($NodesByGB, $replicas + 1)

Most interestingly is the metadata sizing factor (0.03) which is used as a constant relative to the total raw packet volume.  According to @awick, it also incorporates three factors called out in the OpenSearch sizing docs [1] that impact how much of the EBS capacity is actually usable - indexing overhead (10%), linux system reserved space (5%), and OpenSearch Service overhead (20%).
Each OpenSearch Domain can have a maximum of 5 dedicated master nodes [2].  These nodes are not used to serve write requests or store data.  The best practice guide [3] recommends using Multi-AZ Standby, which creates 3 of these nodes.  The guide also provides heuristics for the correct instance type based on the number of shards, with shards count being related to the amount of data.  The sizing guide [1] recommends using ~40 GB/shard for write-heavy applications like Arkime.
Per convo w/ @awick, we'll support a few different data node instance types out of the box and fit out capacity into those type rather than trying to optimize the intersection of instance-type/storage-volume/performance/cost.  The service limits doc [2] has a good chart of the min/max EBS volume size for the different node types.

[1] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/sizing-domains.html
[2] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/limits.html
[3] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/managedomains-dedicatedmasternodes.html
Note: This is a sub-task of https://github.com/arkime/cloud-demo/issues/34
Acceptance Criteria

Domain sizing is highly complex and use-case dependent; an optimal solution is not expected in terms of efficiency or cost.  A reasonable solution is expected, and we can iterate from there.
The "default" options should result in a very minimal OS Domain being created to minimize costs when testing, etc.
The user should be able to specify an expected traffic volume when calling create-cluster, along with a SPI data retention period and a number of replicas
The instance type of the Master Nodes should adapt to the amount SPI data expected
The number and type of Data Nodes should adapt to the amount of SPI data expected
Demonstrate the ability of the CLI to set and update the OpenSearch Domain size.

Those values are already included in the "magic formula"

@awick Ah - thanks for letting me know.  We would have been seriously over-provisioning.

Here's a couple scenarios for how much storage we'll need based on the traffic amount.  The minimum/maximum traffic were figures established in (https://github.com/arkime/aws-aio/issues/52), and represent the range of traffic the user can specifically configure as expected.  The minimum traffic amount represents a single capture node instance, and the max represents the most that can sent over a single GWLB endpoint.
MIN TRAFFIC, DEFAULT OPTIONS:
Scenario: 2 Gibps traffic, 30-day SPI retention, 1 replica
SPI data to store = 2 copies * 2592000 retention seconds * 0.25 GB/sec * 0.03 = 38,880 GB of storage

MAX TRAFFIC, DEFAULT OPTIONS:
Scenario: 100 Gibps traffic, 30-day SPI retention, 1 replica
SPI data to store = 2 copies * 2592000 retention seconds * 25 GB/sec * 0.03 = 3,888,000 GB of storage

The max-traffic scenario actually exceeds the maximum allowable storage for a single OpenSearch domain of 3 PiB [1].  This brings up a few considerations.

2 Gibps is a lot of storage, and using it as our quanta for capture capacity is probably not right.  Moving to a smaller amount will give us much more flexibility in matching the user's traffic volume to a reasonable amount of cloud capacity.  Taking a brief look, m5.large is half the capacity and price of our current capture node choice, m5.xlarge.  We could easily bump down to the smaller instance type and make our quanta 1 Gibps.
By default, OpenSearch Service hands out the r5.* family of instances for master and data nodes, so we'll probably start with those ourselves.  r5.large is the smallest instance of that family and can handle EBS volumes from 1-2 TB.  r5.4xlarge will handle 6-12 TB, r5.12xlarge will handle 12-24 TB.
We will want a way to provision a "toy" Domain that doesn't assume completely maxed out traffic for the specified capture capacity.  Alternatively, we could give users more levers to configure the OpenSearch Domains.
We will need a way to inform the user they've exceeded the storage limit of a single Domain

[1] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/limits.html

Yes we should be using what is passed in for the OS sizing, and not basing it on what capture COULD generate. If possible we should also allow folks to pass in Gbps floats. I agree there will be some tuning we need to do, especially at the low and high bans, and right now we are already over estimating (with the 0.03). This will be another opportunity for learning.

Per convo w/ @awick, it sounds like we have alignment.

Drop the capture node size to m5.large
Accept floats for the expected traffic.  Quantize this for capture capacity and respect the real value for OS Domain sizing.
Update our "minimum" traffic in the code to a much smaller number so users don't end up with like 20 OpenSearch Domain nodes just for turning this thing on with default values.
Have a "toy-tier" data node instance type we can use for the default/minimal configuration.

Ah - made a mistake above.  100 Gbps is 12.5 GBps, not 25 GBps.  That means the max storage example would be 1,944,000 GB.  Still a lot, but not over the max for a single domain.
t3.small will hold 10-100 GB and is 1/6 the price of a r5.large; t3.medium will hold 10-200 GB and is 1/3 the price of a r5.large.  Unclear on the performance of these two nodes for write-heavy use cases, we'll have to experiment.  But one of them might be a good pick for our "toy tier" data node.  Inclined to go with the smaller one until we hear otherwise.
Reversing our calculation, we get something like the following to predict the traffic a given amount of storage can handle:
Gbps traffic per GB storage = 8 / ($replicas + 1) / ($spiDays * 24 * 60 * 60) / 0.03

8 / (1 + 1) / (30 * 24 * 60 * 60) / 0.03 => 5.144 x 10 ^ (-5) Gbps traffic / GB storage

Some proposed heuristics for our data node selection algorithm:

We should always have at least two data nodes
To simplify our lives, we'll just max out the storage for a given instance type if it has a range.
We'll calculate our instance type spread using the default retention and replica options as our starting point.
We can apparently choose between gp2 and gp3 EBS volume types.  It's unclear what offers the better overall value, but gp3 is apparently more complex to configure so we'll use gp2 to start off with.
The gp2 EBS volumes pricing scales linearly ($0.14/TB-hr).  The cost ratio between the instance and the storage for the instance increases as the instance size increases (large instances cost more for the same storage).  Additionally, having more, smaller instances provides better resiliance and decreases the cost delta for adding another node of storage.  Therefore, there seems to be an incentive to have more smaller instances than fewer large ones.
There's a maximum of 10 t2/t3 instances per domain, and a default limit of 80 instances for a domain total (expandable up to 200 instances).
It's implied that dedicated master nodes don't count against the instance limit

Therefore, we end up with something like:
 Traffic      | Storage   | Instance Type  | Storage/Node | Published Price/hr (us-east-2)
-----------------------------------------------------------------------------
0-0.5 Gbps    | 0-1 TB    | t3.small       | 100 GB       | $0.0208
0.5-4 Gbps    | 1-80 TB   | r5.large       | 1 TB         | $0.126
4-24.6 Gbps   | 80-480 TB | r5.4xlarge     | 6 TB         | $1.008
24.6+ Gbps    | 480-960 TB| r5.12xlarge    | 12 TB        | $3.024

If a user needs more than that maximum, they'll need to manually request an instance limit increase and we can just keep adding more of the largest instance type.

Looking at the suggestions for dedicated master node instance types [1], it seems there's a both a recommendation based on instance type and number of shards, with shards being a function of total data stored.  The smallest instance type recommended (m5.large) can handle 10k shards, with each shard being around 40 GB [2], for a total of 400 TB of data (before replication), and the next size up able to handle 1.2 PB.  Therefore, the driving factor is the number of instances in the domain.  We can simply do this scheme to fit the dedicated master nodes:

Always have 3, per recommendations
If pre-replication data amount over threshold, use larger size
Otherwise, base it on the number of data instances

[1] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/managedomains-dedicatedmasternodes.html
[2] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/sizing-domains.html#bp-sharding

A couple comments.

The pricing in the table above is for the EC2 variant of these instances.  OpenSearch runs its own instance variants with their own pricing [1].
We should be using the Graviton instances (e.g. r6g.*) for the non-toy instance types.  They provide better prices for the same EBS storage capacity.

[1] https://aws.amazon.com/opensearch-service/pricing/

Finally got to the point of trying this stuff out for real in a cluster, got an interesting error from CloudFormation on OS Domain spinnup:
Resource handler returned message: "Invalid request provided: Cannot use graviton instances with non-graviton instances. Please use graviton instances as data nodes or use non-graviton instances as master nodes. (Service: OpenSearch, Status Code: 400, Request ID: 4ae4cee6-c8fd-465b-aaba-58caa0ddf048)" (RequestToken: 2579f6f0-36ea-d88c-41bf-7cddcd5b9652, HandlerErrorCode: InvalidRequest)

Ugh, of course, there are no "toy"-sized Graviton Data Node instance types.  So we'll need to have an additional check for really small clusters to switch their Master Node instance type to non-gGaviton.

Double-ugh! Plus a YUCK!  New, delightful edge case to deal with:
Invalid request provided: You must choose an even number of data nodes for a two Availability Zone deployment (Service: OpenSearch, Status Code: 400, Request ID: 618481cf-7273-4fe5-b41c-95ff50fff155)


Fix V10 deprecation warnings

Changes

Use new data model
Use isEmpty instead of isObjectEmpty

Couldn't figure out what exactly is causing the handlebars helper content option deprecation notice, will have to look into that later

can you update the manifest to signify v10 only as well here? or is it already that way?

I had kept the V9 required manifest entries, but those can certainly be removed yeah


use lowercase svg

i'm sure there's a reason for naming the class SVG (all caps), but i would really like to use lowercase instead, like in react

The caps are to switch from string to component. However, I agree and I'm working in an elegant patch style solution, similar to how it works in preact-compat.

@aeosynth There's currently a discussion about bundling SVG support into Preact itself, which would mean just using normal <svg> tags, with Preact handling the differences.  Would love your opinion there: https://github.com/developit/preact/issues/195

@aeosynth Since SVG support is now built into Preact itself as of<EMAIL_ADDRESS>this now works!  Let me know if you run into anything.

neat, thanks


implement graphql UnmarshalGQL/MarshalGQL funcs

For easy integration with https://github.com/99designs/gqlgen

Sorry for the delay.  I have a concern about adding every possible marshaling function to this package.  While the code is not great in size, there are a number of other marshaling interface types as well.  There have been other marshalers also requested.  I am concerned about opening the flood gates and having a large number of these get added.  It seems like the better idea would be for the gqlgen package to be able to use the MarshalText interface for types that do not directly implement MarshalGQL.  This is how JSON marshals uuids without requiring the JSON specific methods.


docs: Sync internal documentation

The doc structure was adjusted and many new documentation files were added. Note that index.md files were changed to README.md files.
Some files related to Operator were left out. The monitoring.md file was also left out for now as it seemed too OpenShift/ServiceMonitor specific.

/lgtm


add string strip text operator

Equivalent to tf.strings.strip
For issue #459

/azp run extensions.ci

aborting, will open again from correct account


Fixed instructions for configuring social logins

Fixes #648

Fixes instructions on how to dnvm use 1.0.0-beta 8
Fixes instructions on how to install user-secrets

Will have to update these instructions for RC too, but can deal with that after it's released.

Hi @bitcrazed, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no Contribution License Agreement is required at this point. Real humans will now evaluate your PR.

TTYL, DNFBOT;

@rustd @Rick-Anderson Please review

Looks good :shipit:

Thanks! 05fc5fd2b5d92dc48f89cb696e1adedc522dad76


OSA [1579612]: heat domain setup fails with keystone using self signed certs Edit

What version (commit) do you encounter this issue on?
Master
What type of issue is this (bug, feature, documentation, regression)?
Bug
What is the expected behavior?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
What is actually happening?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
What were you attempting to do when you encountered this error (give as much detail as possible)?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
How can we reproduce this issue?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
How can we verify your issue is addressed?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
If this is a large issue, what can be done immediately to alleviate the issue while working on a longer-term solution?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
What is your evaluation on the importance of this issue, and why?
See https://bugs.launchpad.net/openstack-ansible/+bug/1579612
What branches / milestones do you believe this issue should target?
The list below is what is currently supported for backports
Remove branches (lines) you do not wish to target.

[ ] Master
[ ] liberty-12.2
[ ] liberty-12.1
[ ] kilo

@mancdaz Can you please add details to this card so that we can get the backport prioritized.

@b3rnard0 the patch has been committed to master and stable/mitaka branches in OSA. Someone will need to rework the patch for liberty (a straight cherry-pick won't work due to the change in role structure between liberty and stable/mitaka).  Once that's done and merged, a SHA bump will need to happen to include the OSA fix in rpc-o

Back-port to Liberty submitted for review upstream
https://review.openstack.org/#/c/347564/

@nategraf I made some comments.

@nategraf I've make some comments on the latest patch set

Reviews that need to be completed in order:

https://review.openstack.org/#/c/348964/
https://review.openstack.org/#/c/348533/
https://review.openstack.org/#/c/348330/

Once all three of these patches are merged, this bug will be closed


New branch for source and sink boundary implementation

This PR contains the draft implementation for source and sink boundaries, as needed for the miniapp proposed by UKAEA.
So far this contains just a kernel definition, and the PIR nodes to represent them in the tree. Next is to add the tree to PIR converted, and then add support for them in Cabana_PIR backend.
Miniapps showing example implementions with Cabana are done, so hopefully it shouldn't be too complex to do this.

I think the required implementation is now in the code.
Remaining thing I need is:

Way to define user headers to include (which I need for the inverse error function since this isn't in C++ standard).

For random number then we need something in get_extra_symbols to add a new structure if random_number is found, and to return generator, which needs to be of type auto and set to an initial value somewhere/how, the setting up and removal of generator is more difficult.

Created a new AutoSymbol for creating auto style C++ types. This I can use for the generator maybe.

Support for random number is "done". Testing etc. still required.

add_include already exist and works for 2) anyway.

Ok, a basic implementation now works.
One issue I seem to have atm is the regeneration of the slices before the source boundary has extra newline characters.

I think ideally we don't want to do MPI communication for deletion flags but thats is not yet implemented.

Source boundaries are now just done by rank 0 for now if MPI is enabled.

I created a very naive test for this and current issues:

core_part_slice is being generated instead of core_part_velocity_slice I think.

The rest all seem related to that issue.

I'm going to add another "particle_core_reference" node to Particle_IR to handle elements which are part of the core particle structure, but are not the position. The way these are described in the code differs from how general particle accesses work, so they're not currently handled correct by codegen.

Alternatively an "add writeable array" is doable, and write to it with atomic add maybe works.

Added writable arrays options, need to add atomic add functionality perhaps or some other way to handle it.

Ok, it now uses the () operator for a view instead. Some of this code is not super nice but it works for now.

Probably need a global particle count accessible through the config?

Setting of nparts is wrong.

Issue seemingly with inverse error function.

Missing a fence after sink boundary call, and also after source boundary call.

Small bug in the code that generated the deletion section, should check for == 0 instead of <= 0 I think. Also probably inserting 100k is enough to test for now as it reaches a steady state at around 1M parts - maybe 200k is better but not 1M.

Still not working with GPU though.

Shit the GPU kernels just don't work :(

Super stupid, super easy fix. Don't forgot the KOKKOS_INLINE_FUNCTION before operators...else it breaks with CUDA :)

Still an issue in the magnetic field not loading for the PIC case.

Ok, this is pretty much ready to be merged in its current state i think. Tested fully, and runs on machines - performance of sink is bad but thats hard to resolve atm.


zmon-agent KeyError

zmon-agent version: 0.46 running on AWS
Error inside the application.log
Traceback (most recent call last):
File "/zmon-agent.py", line 543, in
main()
File "/zmon-agent.py", line 423, in main
apps = get_running_apps(region)
File "/zmon-agent.py", line 162, in get_running_apps
ins['resource_id'] = tags['aws:cloudformation:logical-id']
KeyError: 'aws:cloudformation:logical-id'
sleeping...

Closed in latest commit.


Documentation website

Working on it: https://peco.upa.sh

Is there any dev on it again or ? If Yes let me time to take in hand the project i will try to help :)


Fix Issue 8190

Added documentation to multiple functions in torchvision.ops.boxes as proposed by https://github.com/pytorch/vision/issues/8190 .

I implemented the requested changes.


Choose one of stable or nightly clippy.

Description
Currently, our CI runs both stable and nightly clippy. This means that it can be hard to pre-check code, because the local clippy may not match the CI.  In addition, new lints are sometimes added to nightly clippy.  This can cause a frustrating experience, where some code fails the clippy pass for an unrelated reason, or for a reason that couldn't be checked in advance.  In addition, it means that we duplicate work for the CI server.
Instead, I think we should pick one or the other of stable or nightly.

I think we should pick stable clippy, because:

nightly clippy changes often
nightly clippy lints are sometimes removed or revised
we can't guarantee that developers will have the latest version of nightly clippy installed - but CI always uses the latest

If we pick stable clippy, then all developers should also use stable clippy locally.
If they decide to use nightly, they'll need to fix or ignore any nightly clippy bugs themselves.

I'd go with Clippy on stable

When we try to ignore new nightly clippy lints, stable clippy complains about unknown lint names:
error: unknown clippy lint: clippy::from_iter_instead_of_collect
 --> zebra-test/src/lib.rs:3:10
  |
3 | #![allow(clippy::from_iter_instead_of_collect)]
  |          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  |
  = note: `-D clippy::unknown-clippy-lints` implied by `-D warnings`
  = help: for further information visit https://rust-lang.github.io/rust-clippy/master/index.html#unknown_clippy_lints

https://github.com/ZcashFoundation/zebra/pull/1303/checks?check_run_id=1404428631#step:4:1324
So we really do need to choose one or the other.

I removed nightly clippy in #1358 because I ran into this problem again


Examples in the C++ docs are for C#

In the C++ docs, the examples are for C#.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: c8db3fc6-e90c-175b-fe68-e7ac8fa314ca
Version Independent ID: dca31f22-5a40-3de0-2845-3b6afbd8af84
Content: DispatcherQueue.TryEnqueue Method (Windows.System) - Windows UWP applications
Content Source: winrt-api-build/xml/Windows.System/DispatcherQueue.xml
Product: uwp
Technology: winrt-reference
GitHub Login: @alvinashcraft
Microsoft Alias: aashcraft

Thanks, @minfrin. The language drop-down on API reference topics controls only the language used in the syntax block. And in this case it's functioning correctly. That picker isn't meant to pick between languages for Examples sections. Most topics have only C# code examples, and this is one of them.
To determine the C++ equivalent code in this case, you could have a look at the C++/WinRT docs, especially Move to C++/WinRT from C#.
Thanks!
-Steve


[5.3] Make logging out a POST request

Register logout as POST in Router auth method.
Remove getLogout method from AuthenticatesUsers trait.
Continuation of #13204.

Logging out should be a POST request, not GET.
http://stackoverflow.com/questions/3521290/logout-get-or-post

Will break a lot of applications and people are already free to do this if they want.

@taylorotwell I always make logging out a POST request.
We toyed a lot with the web middleware thing and have seen quite a lot of frustration because of it. This one also has certain security implications.

The result of GET logout can be summed up at http://superlogout.com.
Many services changed logging out to POST request, so it may not work as good as it used to.
But yeah, it will work for most Laravel apps!


mWeb/Chrome - Room - Header is hidden when creating a new room

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Go to staging.new.expensify.com
Log i with expensifail account
Tap on Plus button
Select New Room
Put name and select Workspace
Tap create room

Expected Result:
Room header should be visible
Actual Result:
Header is hidden when creating a new room
Workaround:
Unknow
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / Chrome

Version Number: <IP_ADDRESS>
Reproducible in staging?: Yes
Reproducible in production?: Yes
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://user-images.githubusercontent.com/93399543/211177994-25751489-588e-4ebe-bfbf-9ba4683c2158.mp4
Expensify/Expensify Issue URL:
Issue reported by: Applause - Internal Team
Slack conversation:
View all open jobs on GitHub

@kbecciv I wasn't able to follow the reproduction steps because there is no "new room" button. Could you please clarify which one you meant?

@kadiealexander New Room option is available only for Expensifail account.

@kbecciv I was logged in with<EMAIL_ADDRESS>

@kadiealexander New Room option is available for me ( used expensifail account)

@kadiealexander Do you have a Workspace created? You will need a workspace o be able to create a room


Ignore the threadstest_fips executable

Add a new executable that isn't caught by existing .gitignore rules

This pull request is ready to merge


Travis CI: Upgrade testing to Python 3.7 again

In alignment with travis-ci/travis-ci#9069 and https://blog.travis-ci.com/2018-11-08-xenial-release

已经手动处理，非常感谢


VencordInstaller: Add version 1.4.0

Adds the GUI variant of Vencord/Installer (CLI is #13201).
Relates to https://github.com/ScoopInstaller/Extras/issues/13200

[x] I have read the Contributing Guide.

/verify

VirusTotal report: https://www.virustotal.com/gui/file/dc0826657a005009f43bdc3a0933d08352f8b22b2b9b961697a2db6e9913e871/detection
There was only one false positive. The community score is low because people mistakenly blame Vencord when their Discord account gets compromised due to external scams.

/verify


pull request for e2e test at 11/25/2016 01:26:08

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

optest/docs/updated_at.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


This is the Vertical layout Working Version with plots on top of each other

This one is the one we showed Firas in the Lab session where we started working on the Horizontal Version

Merging the pull since its to the "second version" of our app, but i think we will be sticking with the tabs option for this milestone


Bump version and update changelog

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #110 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #110   +/-   ##
=======================================
  Coverage   96.32%   96.32%
=======================================
  Files          18       18
  Lines         707      707
  Branches       53       53
=======================================
  Hits          681      681
  Misses         17       17
  Partials        9        9

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ec6c00e...620c2ce. Read the comment docs.