Invalid string length

Just got this error randomly after using hard-source-webpack-plugin for a few days:
RangeError: Invalid string length
    at formatError (/myproject/node_modules/webpack/lib/Stats.js:221:30)
    at Array.map (<anonymous>)
    at Stats.toJson (/myproject/node_modules/webpack/lib/Stats.js:229:56)
    at Compiler.<anonymous> (/myproject/node_modules/html-webpack-plugin/index.js:68:44)
    at Compiler.applyPluginsAsyncSeries (/myproject/node_modules/tapable/lib/Tapable.js:206:13)
    at Compiler.emitAssets (/myproject/node_modules/webpack/lib/Compiler.js:354:8)
    at onCompiled (/myproject/node_modules/webpack/lib/Compiler.js:58:19)
    at applyPluginsAsync.err (/myproject/node_modules/webpack/lib/Compiler.js:510:14)
    at next (/myproject/node_modules/tapable/lib/Tapable.js:202:11)
    at Compiler.<anonymous> (/myproject/node_modules/webpack/lib/CachePlugin.js:78:5)
    at next (/myproject/node_modules/tapable/lib/Tapable.js:204:14)
    at /myproject/node_modules/hard-source-webpack-plugin/index.js:2062:7
    at <anonymous>

We have started experiencing the exact same issue.
The "Invalid string length" error seems to actually mean that node ran out of memory.
Broad overview of our setup:
Webpack, Awesome TS-loader, React
Here's what we've found so far:

We do not receive this error on an initial build with webpack, but only after saving changes when running webpack in watch mode.
The error does not always occur, but about 70% of the time
The error appears at the very end of webpack's bundling step: Asset optimization
Webpack is stuck on "Asset optimization" for about 30 seconds before the error appears.

Can confirm
"react": "^15.3.2",
"hard-source-webpack-plugin": "^0.5.18",
"webpack": "^3.10.0",

@pawelkondraciuk @DerJacques Are you getting the EXACT SAME error? This is a common symptom for hard-source but with an endless number of causes from other plugins, loaders, es2015 module syntax in specific npm packages, etc. If you have a different error please open a separate issue.
If you're getting the same issue, if any of you can create a reproduction project that would be really helpful.
TLDR of the symptom, something being stringified is trying to make a string larger than ~130MB (javascript implementation detail for node/v8). A previous example of the bug was webpack dependencies that created a tree that refered to each non-recursively to the point that what was <1MB in memory grew past the string limit when stringified because stringifing doesn't remove duplicate memory values.

The example I'm mentioning was caused by a deeply nested npm dependency in another user's project. Its hard to find the causes for this symptom without a reproduction project.


make guis not suck

please i made the current ones in like 2 mins
the admin could use some actually nice guis, custom to this admin

yay memorypenguin!


'Undefined reference to symbol' error while building caffe2

Hi,
I am getting an error while running make in Caffe2. This is what it says:
/usr/bin/ld: CMakeFiles/mpi_test.dir/mpi/mpi_test.cc.o: undefined reference to symbol '_ZN3MPI8Datatype4FreeEv'
/usr/lib/libmpi_cxx.so.1: error adding symbols: DSO missing from command line
collect2: error: ld returned 1 exit status
caffe2/CMakeFiles/mpi_test.dir/build.make: 100: recipe for target 'bin/mpi_test' failed
make[2]: *** [bin/mpi_test] Error 1
CMakeFiles/Makefile2:2518: recipe for target 'caffe2/CMakeFiles/mpi_test.dir/all' failed
make[1]: *** [caffe2/CMakeFiles/mpi_test.dir/all] Error 2
Makefile:138: recipe for target 'all' failed
make: *** [all] Error 2
Any idea how I can fix it? Any help will be appreciated.
Thanks!!
 Have you found a resolution?

me too, if you find a solution, please tell me ,thanks

I removed openmpi ( including  libopenmpi-dev, openmpi-bin and openmpi-doc) in my ubuntu ,then it works fine.
use
sudo apt remove
libopenmpi-dev
openmpi-bin
openmpi-doc

it doesn't work in my computer

delete the folder 'build'  and retry

i did ,and the error is still there
/usr/bin/ld: CMakeFiles/mpi_test.dir/mpi/mpi_test.cc.o: undefined reference to symbol '_ZN3MPI8Datatype4FreeEv'
//usr/lib/libmpi_cxx.so.1: error adding symbols: DSO missing from command line
collect2: error: ld returned 1 exit status
caffe2/CMakeFiles/mpi_test.dir/build.make:100: recipe for target 'bin/mpi_test' failed
make[2]: *** [bin/mpi_test] Error 1
CMakeFiles/Makefile2:2614: recipe for target 'caffe2/CMakeFiles/mpi_test.dir/all' failed
make[1]: *** [caffe2/CMakeFiles/mpi_test.dir/all] Error 2
Makefile:138: recipe for target 'all' failed
make: *** [all] Error 2

Sorry, I forgot. You should also change 'option(USE_MPI "Use MPI" ON)' to'option(USE_MPI "Use MPI" OFF)' in the file 'CMakeLists.txt'

yes, it works, thank you!

you're welcome : )

MPI is not essential for only GPU mode?

It's optional

@yourlovedu   hello, i used your method today.
but,something was wrong when i test the caffe2 as the installation guide.
i found that there was no gpu support,and then i checked the cmake summay.
it looked like cudnn support was not installed properly,and i make things right and complie again with openmpi .
finally,caffe2 can pass the test perfectly.:)
i just wonder this problem caused by the wrong cudnn installtation rather than the openmpi?
thanks a lot !!

@zkself Actually, I did the same steps as you did. After removing openmpi ,the caffe can be successfully installed. However the gpu number that the test gave is 0.
At the beginning I thought that caffe2  can work with only cuda, and without cudnn. But after running the  test and seeing the number 0, I thought cudnn may be essential. So I installed cudnn and reinstalled caffe2 ,then the number detected by test is 1.
Based on the search on the internet ,here is my idea: Firstly ,the openmpi error is because of ubuntu16 (the error doesn't happen on ubuntu 14). But as mpi is not essential, we can just remove it .Secondly, caffe2 needs both cuda and cudnn for gpu detection.
Actually I'm wondering whether caffe2 can work without cudnn. Because the capability of my gpu is 2.1. T-T

@yourlovedu
thanks for your idea and help !!!
by the way, are you chinese?
becasue my english is pool and you can understand my words.

@zkself 哈哈哈，俩中国文用英文交流了半天233333

@yourlovedu  别扭半天23333，不过为了外国友人也是不错的。 老哥能加个QQ/微信吗  我主页有我邮箱

Thank you everyone for helping sort this issue.
I tried installing Caffe2 on AWS EC2 using Deep Learning AMI which has CUDA and CuDNN pre-installed. It worked fine without any compile issues or errors. I didn't have to disable MPI feature.
Looks like the original error may have been a CuDNN issue or just a Caffe2-CuDNN compatibilty mismatch.
Unless anyone else has anything else to add to it, I am going to close this thread later today.
Thanks!

To add a little more to this, Caffe2 with GPU does require both CUDA and CuDNN, but does not require MPI. MPI is used for training across multiple machines, such as in a cluster environment. Thanks everyone for helping each other out! I will close this now as everything is resolved.

I just got the same error building on Ubuntu 17.10 with USE_CUDA              : OFF
I notice the issue has been closed. Is there really nothing that can be done to improve this or better explain the configuration, instead of letting it break with a link error? (This is one of many build issues I've had with Caffe2. A focus on improving build behaviour wouldn't be amiss.)
root@w8pc:~/caffe2/build# cmake .. -DUSE_CUDA=OFF
-- Does not need to define long separately.
-- std::exception_ptr is supported.
-- NUMA is available
-- Current compiler supports avx2 extention. Will build perfkernels.
-- Caffe2: Found protobuf with old-style protobuf targets.
-- Caffe2 protobuf include directory: /usr/include
-- The BLAS backend of choice:Eigen
-- Could NOT find NNPACK (missing: NNPACK_INCLUDE_DIR NNPACK_LIBRARY PTHREADPOOL_LIBRARY CPUINFO_LIBRARY)
-- Brace yourself, we are building NNPACK
-- Found PythonInterp: /usr/bin/python (found version "2.7.14")
-- Caffe2: Found gflags with new-style gflags target.
-- Caffe2: Cannot find glog automatically. Using legacy find.
-- Caffe2: Found glog (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libglog.so)
-- git Version: v0.0.0
-- Version: 0.0.0
-- Performing Test HAVE_STD_REGEX
-- Performing Test HAVE_STD_REGEX
-- Performing Test HAVE_STD_REGEX -- success
-- Performing Test HAVE_GNU_POSIX_REGEX
-- Performing Test HAVE_GNU_POSIX_REGEX
-- Performing Test HAVE_GNU_POSIX_REGEX -- failed to compile
-- Performing Test HAVE_POSIX_REGEX
-- Performing Test HAVE_POSIX_REGEX
-- Performing Test HAVE_POSIX_REGEX -- success
-- Performing Test HAVE_STEADY_CLOCK
-- Performing Test HAVE_STEADY_CLOCK
-- Performing Test HAVE_STEADY_CLOCK -- success
-- Found lmdb    (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/liblmdb.so)
-- Found LevelDB (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libleveldb.so)
-- Found Snappy  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libsnappy.so)
-- Found Numa  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libnuma.so)
-- OpenCV found (/usr/share/OpenCV)
CMake Warning at cmake/Dependencies.cmake:256 (find_package):
  By not providing "FindEigen3.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "Eigen3", but
  CMake did not find one.

  Could not find a package configuration file provided by "Eigen3" with any
  of the following names:

    Eigen3Config.cmake
    eigen3-config.cmake

  Add the installation prefix of "Eigen3" to CMAKE_PREFIX_PATH or set
  "Eigen3_DIR" to a directory containing one of the above files.  If "Eigen3"
  provides a separate development package or SDK, be sure it has been
  installed.
Call Stack (most recent call first):
  CMakeLists.txt:101 (include)

-- Did not find system Eigen. Using third party subdirectory.
-- Found PythonInterp: /usr/bin/python (found suitable version "2.7.14", minimum required is "2.7")
-- NumPy ver. 1.14.1 found (include: /usr/local/lib/python2.7/dist-packages/numpy/core/include)
-- Could NOT find pybind11 (missing: pybind11_INCLUDE_DIR)
-- MPI support found
-- MPI compile flags:
-- MPI include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include
-- MPI LINK flags path:
-- MPI libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so
CMake Warning at cmake/Dependencies.cmake:310 (message):
  OpenMPI found, but it is not built with CUDA support.
Call Stack (most recent call first):
  CMakeLists.txt:101 (include)

CMake Warning at cmake/Dependencies.cmake:360 (message):
  If not using cuda, one should not use NCCL either.
Call Stack (most recent call first):
  CMakeLists.txt:101 (include)

-- Could NOT find Gloo (missing: Gloo_INCLUDE_DIR Gloo_LIBRARY)
-- MPI include path: /usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/x86_64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/x86_64-linux-gnu/openmpi/include
-- MPI libraries: /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so
CMake Warning at cmake/Dependencies.cmake:443 (message):
  mobile opengl is only used in android or ios builds.
Call Stack (most recent call first):
  CMakeLists.txt:101 (include)

CMake Warning at cmake/Dependencies.cmake:519 (message):
  Metal is only used in ios builds.
Call Stack (most recent call first):
  CMakeLists.txt:101 (include)

-- GCC 7.2.0: Adding gcc and gcc_s libs to link line
-- NCCL operators skipped due to no CUDA support
-- CUDA RTC operators skipped due to no CUDA support
-- Including image processing operators
-- Excluding video processing operators due to no opencv
-- Excluding mkl operators as we are not using mkl
-- Include Observer library
-- Using lib/python2.7/dist-packages as python relative installation path
-- Automatically generating missing __init__.py files.

 This works because MPI is an optional feature that is only used for distributed training across multiple machines, which many people do not need.
If you do need MPI and are running into this problem, then please help me debug by giving me
mpirun --version and nvidia-smi , how you installed Caffe2, the full output of your cmake command, and find /usr -name 'libmpi*'.

same issue
here are some of the test results
jtang@1032:~$ mpirun --version
mpirun (Open MPI) 1.10.2
I installed caffe2 according to instructions on caffe2 website:
git clone --recursive https://github.com/pytorch/pytorch.git && cd pytorch
git submodule update --init
mkdir build && cd build
cmake ..
make install
cmake result:
jtang@1032:~/pytorch/build$ cmake ..
-- Does not need to define long separately.
-- std::exception_ptr is supported.
-- NUMA is available
-- Current compiler supports avx2 extention. Will build perfkernels.
-- Building using own protobuf under third_party per request.
-- Use custom protobuf build.
-- Caffe2 protobuf include directory: $<BUILD_INTERFACE:/home/jtang/pytorch/third_party/protobuf/src>$<INSTALL_INTERFACE:include>
-- The BLAS backend of choice:Eigen
-- Brace yourself, we are building NNPACK
-- Found PythonInterp: /usr/bin/python (found version "2.7.12")
-- Caffe2: Cannot find gflags automatically. Using legacy find.
-- Caffe2: Found gflags  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libgflags.so)
-- Caffe2: Cannot find glog automatically. Using legacy find.
-- Caffe2: Found glog (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libglog.so)
-- Failed to find LLVM FileCheck
-- git Version: v0.0.0
-- Version: 0.0.0
-- Performing Test HAVE_STD_REGEX -- success
-- Performing Test HAVE_GNU_POSIX_REGEX -- failed to compile
-- Performing Test HAVE_POSIX_REGEX -- success
-- Performing Test HAVE_STEADY_CLOCK -- success
-- Found lmdb    (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/liblmdb.so)
-- Found LevelDB (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libleveldb.so)
-- Found Snappy  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libsnappy.so)
-- Found Numa  (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libnuma.so)
-- OpenCV found (/usr/share/OpenCV)
CMake Warning at cmake/Dependencies.cmake:309 (find_package):
By not providing "FindEigen3.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "Eigen3", but
CMake did not find one.
Could not find a package configuration file provided by "Eigen3" with any
of the following names:
Eigen3Config.cmake
eigen3-config.cmake

Add the installation prefix of "Eigen3" to CMAKE_PREFIX_PATH or set
"Eigen3_DIR" to a directory containing one of the above files.  If "Eigen3"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
CMakeLists.txt:188 (include)
-- Did not find system Eigen. Using third party subdirectory.
-- Found PythonInterp: /usr/bin/python (found suitable version "2.7.12", minimum required is "2.7")
-- NumPy ver. 1.14.3 found (include: /usr/local/lib/python2.7/dist-packages/numpy/core/include)
-- Could NOT find pybind11 (missing: pybind11_INCLUDE_DIR)
-- MPI support found
-- MPI compile flags:
-- MPI include path: /usr/lib/openmpi/include/openmpi/opal/mca/event/libevent2021/libevent/usr/lib/openmpi/include/openmpi/opal/mca/event/libevent2021/libevent/include/usr/lib/openmpi/include/usr/lib/openmpi/include/openmpi
-- MPI LINK flags path:  -Wl,-rpath  -Wl,/usr/lib/openmpi/lib  -Wl,--enable-new-dtags
-- MPI libraries: /usr/lib/openmpi/lib/libmpi_cxx.so/usr/lib/openmpi/lib/libmpi.so
CMake Warning at cmake/Dependencies.cmake:364 (message):
OpenMPI found, but it is not built with CUDA support.
Call Stack (most recent call first):
CMakeLists.txt:188 (include)
-- Caffe2: CUDA detected: 8.0
-- Found cuDNN: v5.1.10  (include: /usr/local/cuda/include, library: /usr/local/cuda/lib64/libcudnn.so)
-- Automatic GPU detection returned 6.1 6.1 6.1 6.1 6.1 6.1 6.1 6.1.
-- Added CUDA NVCC flags for: sm_61
-- Could NOT find NCCL (missing: NCCL_INCLUDE_DIRS NCCL_LIBRARIES)
-- Could NOT find CUB (missing: CUB_INCLUDE_DIR)
-- Could NOT find Gloo (missing: Gloo_INCLUDE_DIR Gloo_LIBRARY)
-- MPI include path: /usr/lib/openmpi/include/openmpi/opal/mca/event/libevent2021/libevent/usr/lib/openmpi/include/openmpi/opal/mca/event/libevent2021/libevent/include/usr/lib/openmpi/include/usr/lib/openmpi/include/openmpi
-- MPI libraries: /usr/lib/openmpi/lib/libmpi_cxx.so/usr/lib/openmpi/lib/libmpi.so
-- CUDA detected: 8.0
-- Found libcuda: /usr/lib/x86_64-linux-gnu/libcuda.so
-- Found libnvrtc: /usr/local/cuda/lib64/libnvrtc.so
-- GCC 5.4.0: Adding gcc and gcc_s libs to link line
-- Include NCCL operators
-- Excluding ideep operators as we are not using ideep
-- Including image processing operators
-- Excluding video processing operators due to no opencv
-- Excluding mkl operators as we are not using mkl
-- Include Observer library
-- Using lib/python2.7/dist-packages as python relative installation path
-- Automatically generating missing init.py files.
-- A previous caffe2 cmake run already created the init.py files.
CMake Warning at CMakeLists.txt:318 (message):
Generated cmake files are only fully tested if one builds with system glog,
gflags, and protobuf.  Other settings may generate files that are not well
tested.


Update to 11.00

With the new release of the pppwn exploit 11.00 is now jailbreakable and as such maybe you should add support for it

The only changes that need to be made is for the offsets in the save memory patches to be changed, i did not find theese and got them off save mounter https://github.com/AGraber/Playstation-4-Save-Mounter, so we will have to wait untill someone finds the new offsets

could this be of any help? https://github.com/bucanero/apollo-ps4

could this be of any help? https://github.com/bucanero/apollo-ps4

yes it could, if it does indeed support ps4 jailbreak for 11.00

progress has been started, i just need someone with the firmwares of ps4s to test


Clarify that path filters are supported only for VSTS Git

I wanted to clarify this caveat since I tripped on this earlier.

Thanks.  That link is here: https://docs.microsoft.com/azure/devops/pipelines/build/triggers


[DOC] update readme for 2.6.0

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.PaddleCI seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


CAD data of open_manipulator.

Hi, Lim-san. I have questions.
(1) Is CAD data of open_manipulator exposed on OnShape?
(2) The shape of the end effector of the manipulator changes according to the application.
Can you Branch data of user created frame or end effector?

Hi, shibata san.
Open_manipulator will be exposed OnShape when we test it over. Users can export it in near the future :)
The end-effector can be changed depending on application. We have plan to support other tool tips but ,if they want, they can create their own grippers what they need.
Thanks.

Hi, Lim-san.
Thanks.
I also do design improvement of manipulator. I want to share it.
For example, a lightweight hinge cover :)==>https://cad.onshape.com/documents/6037ebcd9a4306846b0618c9/w/c9f93c4e1150c41885db4dad/e/de27c63cab5c7ae541ba66ab


HTML Input Type Date Not Supported

WATIR v6.1.0, Selenium v3.4.3, chromedriver 2.30, chrome v59.0.3071.115
pry(main)> @browser = Watir::Browser.new :chrome
pry(main)> @browser.goto("https://www.w3schools.com/html/tryit.asp?filename=tryhtml_input_date")
=> "https://www.w3schools.com/html/tryit.asp?filename=tryhtml_input_date"
pry(main)> @browser.text_field(:name =>"bday").exists?
=> false
pry(main)> @browser.button(:text=>"Submit").exists?
=> true

Using watir I navigated to the w3schools.com test page for input date type.  Upon checking if the input type date exists I get false.  To make sure the page was working I followed it up by checking the Submit button is present and it came back as expected; true.
The date type is new to HTML5 so I believe this type may not be currently supported.

There's an iframe in there :)
@browser.iframe(id: 'iframeResult').text_field(name: 'bday').exists?
=> true

D'oh always forget about iframe as I don't often interact with them.  However, I get an error upon trying to set the value of that text field.
@browser.iframe(id: 'iframeResult').text_field(name: 'bday').set "08/01/2017"
Selenium::WebDriver::Error::InvalidElementStateError: invalid element state: Element must be user-editable in order to clear it.
  (Session info: chrome=59.0.3071.115)
  (Driver info: chromedriver=2.30.477690 (c53f4ad87510ee97b5c3425a14c0e79780cdf262),platform=Mac OS X 10.11.6 x86_64)

There is a workaround I can use, but would really like to see the date type supported in the future if possible.
@browser.iframe(id: 'iframeResult').input(name: 'bday').send_keys "08/01/2017"

Oh interesting. Yes, we should see about explicitly supporting date type differently. It would be nice if we can find a way to send a DateTime to that element instead of a String, but I'm not sure how compatible that is with all date elements.

Ok, so this is a chromedriver bug: https://bugs.chromium.org/p/chromedriver/issues/detail?id=1319
Also, unfortunately, I don't think there is a way to get the format of the html5 date type since it is based on the browser / OS locale.
So, I'm going to close this again as something we can't do anything about at this time.


Reduce "14" to "10" where it corresponds to the days of the risk calculation

Where to find the issue
e.g. https://www.coronawarn.app/de/faq/results/#new_device :
Falls Sie innerhalb der 14 Tage auf COVID-19 getestet wurden, tragen Sie den PCR-Test-QR-Code auf Ihrem neuen Gerät ein. Ist das Testergebnis positiv, sollten Sie das Testergebnis auf beiden Geräten teilen. Für das Teilen eines Testergebnisses auf mehreren Geräten beachten Sie bitte den FAQ Eintrag Wie teile ich ein positives Testergebnis auf mehreren Geräten?.

Describe the issue
Only 10 days are relevant now.
Suggested change
Change everywhere "14 days" to "10 days" (of course in both languages).

@DerVogel2020
Thanks for bringing this up!

https://www.coronawarn.app/en/faq/results/#new_device unfortunately was not changed at all.
https://www.coronawarn.app/de/faq/results/#new_device was already changed in the first paragraph:

"Damit Sie trotzdem über mögliche Risiko-Begegnungen informiert werden, empfehlen wir Ihnen, den Risikostatus auf dem alten Gerät noch mindestens 14 Tage (10 Tage ab Version 2.20) zu beobachten, nachdem Sie die Corona-Warn-App auf dem neuen Gerät installiert haben."
So I suggest that instead of changing 14 days to 10 days, it needs to list both. To simplify the text, the first mention defines the version differences and thereafter write 14 or 10 days (EN)  14 bzw. 10 Tage (DE) without mentioning the version.

@MikeMcC399
Hello! I'm working with @ahodzic2 and I'd like to resolve this issue if you'd like it done.

@amouzayanni
@DerVogel2020 has contributed in the past, so might also want to provide a PR. Other than that I suggest waiting for feedback from the Open Source Team. I'm not the one to decide, since I am a community contributor with no official capacity.

@amouzayanni From my point of view, it seems difficult to determine all relevant code lines. So feel free to provide a PR.

Will do! I'll get that pull request ready ASAP.

After reviewing the German FAQ, I no longer feel comfortable making changes to it since I fear the language barrier would prevent me from being accurate. I've finished the English FAQ and I'm ready to make the pull request. Will someone else be able to complete the German FAQ?

@amouzayanni
For sure.
Will you invite me to access your repo so that I can push the changes there?

@Ein-Tim
Just sent the invitation. Thanks for the help! I'd be happy to get in touch, how should I do so?

@amouzayanni
You can use this invitation link to join our Slack channel: https://join.slack.com/t/covidapps/shared_invite/zt-1704ve9qo-XI_1bKwa2eHle4g44AepHw

Regarding my comment  about considering the case of changing the app during the 14 or 10 days, I went through two scenarios:

a person goes on vacation to another EU country
a person moves permanently to another EU country

where the other EU country has their own app and the move happens during this period. I think in both cases that it would be quite unlikely that the user would install a different app on the old phone during these two weeks. So I would ignore this case.
Sorry for making this more complicated than it need have been. I was just trying to make sure we didn't give users incorrect information.

I believe with the PR merged this issue can be closed?


Validation rule "in_array" returns failure when success expected

Laravel Version: 5.2,5.3
PHP Version: 7.08
Database Driver & Version: Not Relevant

Description:
By Laravel documentation the validation rule "in_array", should validate whether a fields value under validation exist as an array value in a different field:
"The field under validation must exist in anotherfield's values."
By checking a simple case it does not seem to do so, in any case I have no understanding what this validation rule actually does. Now, this may be just me misunderstanding something, bet here are the steps to reproduce
Steps To Reproduce:
$input = [
	'locales' => ['EN', 'FR', 'RU'],
	'locale' => 'EN'
];

$validation = Validator::make($input, [
   'locale' => 'in_array:locales',
]);
$validation->fails(); /* returns true, expected false */

(v5.3.20/src/Illuminate/Validation/Validator.php  in line 1053)
By taking a look at the source, the problem arises in calling Arr::dot on $attributeData
which produces an array like this ['locales.0.' => 'EN', ..., ...], that will never be
equal to "locales", therefore the closure of Arr::where will return an empty array;

use in_array:locale.*


unreasonable furitens

playing MC 1.19.2, and this mod 0.3.7
i'm not good at english and chinese, so i'm gonna replace report to link.
https://imgur.com/a/EyPHrbQ
and kyuushu kyuuhai counts all of 幺九牌
anyway, i really appreciate for good mod. looking forward to play mahjong with my friend in MC

Thanks for reporting the error.
Enjoy playing Mahjong with your friends in Minecraft!


Update config.go

Since tile-generator has deprecated using hyphens in names and Kubernetes requires a DNS compliant name (without underscores), convert underscores to hyphens for the service name.

I can't think of any issues this would cause.
Worth tossing in a test?
https://github.com/cf-platform-eng/kibosh/blob/8b86dea09b49a83e9b7b4a5c62aff357c872fb6e/config/config_test.go#L51


stack.yaml default file

I wanted to give the project a try and figure out the bindings with the example language server. The instructions (stack install :lsp-hello --flag haskell-lsp:demo) won't work because there is no stack.yaml actually named that way. To have the project working by default with stack an existing stack.yaml might be helpful.
Otherwise we could extend the instructions to clarify that a stack-.yaml has to be copied or provided as argument.

This was a deliberate choice. Before hie could support cabal projects, you had to use a stack project, but could not choose a non-standard stack file.  So I would symlink a local stack.yaml to whichever one I was working on.
hie-bios / hie now supports cabal, so this is no longer needed.

So are we closing the PR or should I add the symlink?


Fix broken link to npm's original immutable package

The link in the README (this one: https://www.npmjs.com/package/immutable/1.4.1) is a 404. I suggest linking to the repository itself, at your convenience.

Good idea


Grammarly shows improvements

If you copy and paste the text section by section Grammarly will offer you suggestions.
https://www.grammarly.com/grammar-check
A new star 🌟 is born: https://www.deepl.com/write

Thanks, I'll put all the text through it!

@szepeviktor I've been heavily using deepl and other AI based tools, but I haven't heard about deepl/write. Thanks!
So many new AI tools, every product is not backed by generative LMs


add transmit 4

Recently Panic released Transmit 5, this brings in Transmit 4 for those of us who don't want to upgrade.

Thank you for your contribution!


Google earth engine；deep learning

1.Hello, I am learning how to combine Google earth engine with tensorflow for windmill recognition, but I don’t know how to start? Do you have any good suggestions?
2.Is your code all written in python?

This repo should provide functionality for just that to get your started on just such a task. It works best with a GCP storage account to export and store data, but could be modified to use google drive.
It is all written in python


Uploading Errors to CMSMONIT

We can look into uploading information for each workflow to CMSMONIT. This will allow us to use Grafana to:

Generate the displays
Store information for long terms to study and model in the future

Ticket with Valentin to get the information and table dashboard is here: https://its.cern.ch/jira/browse/CMSMONIT-45

@phylsix Let me know if you have questions about the information in the ticket. I can make a first script that puts the JSON file together. We can track progress here.

Yeah, that is one thing that Valentin pointed out as different from our general use case. I think the time series can still be useful to see how errors are reported (especially for ACDCs), and we can still make tables with just the latest timestamped information.
I don't know if there's an easy way to display strings with Grafana, but Valentin said we can also run python scripts directly on the Spark cluster to do whatever analysis we want later. I think it's worth saving some of the relevant string data until then. In particular, Sharad uses the log snippets to make decisions.

Ok, so there is no problems in saving strings. That would be good for now.

I'm going to spend some time trying to learn Grafana through the tutorial here: http://docs.grafana.org/guides/getting_started/
For a first pass, I will just try to push the information here: https://github.com/dabercro/WorkflowWebTools/commit/d0a81f92c853127ba0e378e20909dd3270b4de5a

During the query to get consistent failure rate of a workflow with the number showed up in wmstats page, I noticed two differences on how to treat error counts with respect to workflowwebtools:

'NotReported' are not treated as errors (interpreted as -1 in workflowwebtools)
Errors happened in 'LogCollect' or 'Cleanup' type step are also included into rate calculation. (not in workflowwebtools)

I followed the same route as wmstats on these two points, and extracted relevant information of a workflow that could potentially be useful for OSDroid to a JSON, which includes failure rate, failure keywords, status, tasks and error codes, counts, site etc. An example can be found on vocms0116:/home/wsi/WorkflowWebTools/bin/vomit.json.
Do you think this would be a good information to be stored/monitored on periodical/hourly basis?

Yeah, I think this all would be interesting to keep.
Good catches. The LogCollect and Cleanup were asked to be filtered out from the webpage, but it probably doesn't hurt to keep the data around. Also, the NotReported errors are retrieved from CouchDB: https://github.com/CMSCompOps/WorkflowWebTools/blob/master/workflowwebtools/workflowinfo.py#L278 We should probably include those in the information we save too.

Ok, I saved NotReported sites list as siteNotReported for each task of a workflow now.

@phylsix To get the list of workflows to cycle through, you can connect to the Unified database like this: https://github.com/CMSCompOps/WorkflowWebTools/blob/b9eb16f687ce6dcd892b37f0fdb034f890d72436/workflowwebtools/errorutils.py#L56-L61
You won't need the STATUS constraint, I think.
I will send you over Skype where the connection parameters can be found.

@vlimant If we want to use this for OS Driod also, what statuses should we be looking at? I'm guessing it's more than just "manual", but we can't loop over all 100k workflows in the database either. Is 'STATUS NOT LIKE "%unlock%"' a good subset?

@phylsix Can you link to a workflow JSON at this ticket? https://its.cern.ch/jira/browse/CMSMONIT-45

@dabercro OK, I just added a comment with an link.
One question: I tried to access the oracle db with the parameters you provided after pulling the latest master branch on vocms0116, but failed. It shows the following message:
oracle_db_conn = cx_Oracle.connect(*config_dict['oracle']) # pylint:disable=c-extension-no-member
cx_Oracle.DatabaseError: DPI-1047: 64-bit Oracle Client library cannot be loaded: "libclntsh.so: cannot open shared object file: No such file or directory". See https://oracle.github.io/odpi/doc/installation.html#linux for help
I wonder if this is related with environment issue or something else? Do you happen to know?

Ah, there's another package I had to install to get it to work (oracle-instantclient-basic). It's on vocms0116 now. Let me know if it still doesn't work for you.

Valentin's last comment at https://its.cern.ch/jira/browse/CMSMONIT-45 was about how we would like to aggregate/display error data of interesting workflows (An example can be seen at http://wsi.web.cern.ch/wsi/public/toSaveExample3.json). As it can affect storage strategy and document structure, I guess.
Below it's my thought:

Data collection, what to save:
Periodically launch (0.5h),

For a certain workflow, aggregate snapshot, until the status is changed to "completed".
For a new workflow, insert as a new entry.

Data display, how to aggregate:

Divide all workflows in database into 2 categories: status != "completed" and status == "completed", all sorted by either current failure rate or total error from high to low.
For each category, we want a current status overview, including:

Main error code distribution (x: main error code; y: number of workflows)
Secondary error code distribution (x: secondary error code; y: number of workflows)
Site error counts distribution (x: site name; y: error counts of all workflows)
For a certain workflow, would like to see its all JSON content.

We also want a history tracking, including:

For each workflow, total errors and failure rate evolution as a function of time. (x: time; y: total error/failure rate)

@dabercro Do you have any suggestions/ideas?

This looks like a pretty good list of monitoring plots to have!
One more thing which the monitoring team already knows about is the table (example table https://monit-grafana.cern.ch/d/XcvyO_-mk/_demo-table?orgId=11) which would have error codes on one axis, site names on the other, and number of errors in the cell. From your example JSON, we should be able to make that.
Do you know how long it takes to put together a JSON file? Running over everything every half hour sounds ambitious to me, but I could be wrong.
One more thing that might be worth saving is the job parameters (https://dabercro.web.cern.ch/dabercro/data/jsondumps/params.json), but these won't change over time, so they should probably be in a separate collection anyway. Related to this, I have a quick question: Do you calculate the failure rate or is that given directly somewhere in WMStats?

I did a test, by connecting the oracle db you provided, it costs about 8min15s to parse 245 workflows, while only handing the ones whose failure rate > 20%.
Yeah, I think job parameters can be saved in a separate collection, which can be queried in some way. The failure rate is a number one can see in WMStats page, but I cannot find an api for it. So I work out a way to calculate it from number of success and number or errors and be able to be consistent. If you know a way to get the number directly, let me know and I can use that for sure.

Okay, so if I do the following:
select count(*) from CMS_UNIFIED_ADMIN.workflow WHERE lower(STATUS) NOT LIKE '%unlock%';

I get 3323 workflows right now. I think we will probably want to run this every two or three hours then.
Also, does CMSMONIT include the timestamp for you when you upload info, or should we add a timestamp member (just something like int(time.time()))?

Ok, that sounds good. Does lower(STATUS) NOT LIKE '%unlock%' only select those that are on-going? Will workflows that are completed also go into that selection as well?
I am not sure if they would add timestamp automatically for us, if not, yeah, we should add a timestamp member.

I pinged P&R and it turns out that the best query would actually be:
SELECT count(*) FROM CMS_UNIFIED_ADMIN.WORKFLOW WHERE WM_STATUS LIKE 'running%';

(Replace count(*) with NAME or whatever you need)

That's coming out to 2760 workflows right now.

I uploaded the script here: https://github.com/phylsix/WorkflowWebTools/tree/master/workflowmonit

This is working now: https://its.cern.ch/jira/browse/CMSMONIT-45


fix: auth window performance

What is the purpose of this pull request?

What problem is this solving?

Types of changes

[ ] Feat: (new functionality)
[ ] Bug fix: ([#ref number] non-breaking change which fixes an issue)
[ ] Chore: (improvements that will not reflect in production behaviour)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Requires change to documentation, which has been updated accordingly.

#161
#160  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @keeganpotgieter and the rest of your teammates on  Graphite

Merge activity

Sep 26, 4:46 AM EDT: @keeganpotgieter started a stack merge that includes this pull request via Graphite.


Not picking up network config from configdrive2

RancherOS Version: (ros os version)
v1.4.2
Where are you running RancherOS? (docker-machine, AWS, GCE, baremetal, etc.)
Proxmox/KVM
Proxmox supports cloud-init as of version 5.2. By default it uses NoCloud which doesn't seem to be supported by RancherOS but can be set to configdrive2. When I change my VM to configdrive2 RancherOS picks up everything from cloud-init except networking, it uses dhcp instead.
When I mount the configdrive it has the following.
openstack
  |-- content
  |   `-- 0000
  `-- latest
      |-- meta_data.json
      `-- user_data

openstack/latest/user_data:
#cloud-config
hostname: hostname_set_in_proxmox
manage_etc_hosts: true
fqdn: hostname_set_in_proxmox_with_fqdn
user: rancher
ssh_authorized_keys:
  - ssh-rsa key_set_in_proxmox
chpasswd:
  expire: False
users:
  - default
package_upgrade: true

openstack/latest/meta_data.json:
{
     "uuid": "c7e51b981c9df5019a45ccbf66c3b5e2c2ef71bb",
     "network_config": { "content_path": "/content/0000" }
}

openstack/content/0000:
auto lo
iface lo inet loopback

        dns_nameservers x.x.x.2
        dns_search domain.com
auto eth0
iface eth0 inet static
        address x.x.x.10
        netmask <IP_ADDRESS>
        gateway x.x.x.1

/var/lib/rancher/conf/cloud-config.yml only includes:
rancher:
  console: fedora

I see. Unfortunately the format of the data isn't configurable, just the values.
Is there any cloud-init data source that uses the rancher style?

I ran into the same problem and solved it for me by doing the following.
Create VM (id 1001 in this example)
vi /mnt/pve/cephfs/snippets/user-1001.yml (swap mnt/pve/cephfs with the desired snippets storage).
Put in the following:
#cloud-config
hostname: rancheros
manage_etc_hosts: true
ssh_authorized_keys:
  - ssh-rsa YOUR-PUBLIC-KEY
  - ssh-rsa ANOTHER-PUBLIC-KEY
chpasswd:
  expire: False
users:
  - default
package_upgrade: true
rancher:
  network:
    interfaces:
      eth0:
        address: <IP_ADDRESS>/24
        mtu: 9000
        dhcp: false

Register the config in the machine: qm set 1001 --cicustom user=cephfs:snippets/user-1001.yml

Hi,
I tried to autoinstall RancherOS inside a VM in Proxmox but I have problem.
Can you help me on this issue ?
I create a VM and mount rancheros-proxmox-ve iso in CDRom
and via Cloud-init I create this file:
`#cloud-config
rancher:
network:
interfaces:
eth0:
address: <IP_ADDRESS>/24
gateway: <IP_ADDRESS>
mtu: 1500
dhcp: false
dns:
nameservers:

<IP_ADDRESS>
<IP_ADDRESS>
write_files:
path: /opt/rancher/bin/install.yml
permissions: "0700"
content: |
#cloud-config
rancher:
network:
interfaces:
eth0:
address: <IP_ADDRESS>/24
gateway: <IP_ADDRESS>
mtu: 1500
dhcp: false
dns:
nameservers:
- <IP_ADDRESS>
ssh_authorized_keys:

ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAu+cJj5HKIb7P9tTM9KE+9Zj5L+jWBh4KcCovonJvv9NwUPykEp4iSzATwrPr/8QtQEnsSuoZiQldt+XuAs7gOhMksrhPFNmS7C3efxwWLJvPqbXrSIBGkDFNss64bL+lhyDZvZ6jkihS+QuI9D4gKhKfcdjrgyWSe7OwAgrfsw5thZ9l2i/tG6yTjqhrPIsyUzPYtfn5QUcLuCd1+vO5J0TX0a8JZtob0bzHX4kJcCh44LWO7aA0wL7ti6BPNOEGISRk2VhyFuhCTCNZTznMplPcpqdTDEd1T0YAvS2nQNXcFGVgb0m04Abj61FRKUBBHXFZS6X5wEC98B5e5CtTvDlw== rsa-key-20190921

path: /opt/rancher/bin/start.sh
permissions: "0700"
content: |
#!/bin/bash
echo Y | sudo ros install -f -c /opt/rancher/bin/install.yml -d /dev/sda`

qm set 1001 --cicustom user=cephfs:snippets/config-1001.yml
When I boot the machine its not used the config file.

@mizbanpaytakht Try clicking on "Rebuild ISO" on the cloud-init drive in proxmox web ui. Maybe this will resolve your problem (the config might not have been absorbed into the iso fs used for cloud-init)

@mizbanpaytakht Try clicking on "Rebuild ISO" on the cloud-init drive in proxmox web ui. Maybe this will resolve your problem (the config might not have been absorbed into the iso fs used for cloud-init)

@discordier No this not fixed my problem, Maybe since I mount rancheros.iso file in CDRom cause this problem !
How can I get rancheros .img file to import it into server disk.

Don't know, I boot from the iso (first CD-ROM drive) and have my config as mentioned above in the cloud-init drive (second CD-ROM) in my VM and it boots correctly.
Did you follow above steps correctly?
Did you double check paths and settings?

@discordier Which ISO did you used ? Are you working on Proxmox VE 6 ?
Cloudinit create metadata and userdata from YML file and I import it but Rancher didnt use it

I use rancheros-proxmoxve-autoformat.iso


MetricsQueryClient returns empty results

[Enter feedback here]
Hello, we tried to use Azure.Monitor.Query package to retrieve metrics data for our resources. We were seeing empty results in MetricResult.TimeSeries in the response, when using below code. No error.
string resourceId = "/subscriptions/SUB_ID/resourceGroups/RESOURCE_GROUP/providers/Microsoft.Storage/storageAccounts/STORAGE_ACCOUNT";
MetricsQueryClient metricsClient = new MetricsQueryClient(new DefaultAzureCredential());
var blobCount = (decimal)0.0;

var blobCountResult = metricsClient.QueryResource(resourceId, new[] { "BlobCount" },
  new MetricsQueryOptions
  {
      MetricNamespace = "Blob",
      Aggregations =
      {
          MetricAggregationType.Average
      },
      Granularity = TimeSpan.FromMinutes(10),
      TimeRange = new QueryTimeRange(TimeSpan.FromMinutes(60))
  });

After troubleshooting multiple times, capturing requests through Fiddler and comparing it with REST API we figured out the values we were passing in the code were not correct.
Correct usage:
string resourceId = "subscriptions/SUB_ID/resourceGroups/RESOURCE_GROUP/providers/Microsoft.Storage/storageAccounts/STORAGE_ACCOUNT/blobServices/default";
MetricsQueryClient metricsClient = new MetricsQueryClient(new DefaultAzureCredential());
var blobCount = (decimal)0.0;

var blobCountResult = metricsClient.QueryResource(resourceId, new[] { "BlobCount" },
  new MetricsQueryOptions
  {
      MetricNamespace = "Microsoft.Storage/storageAccounts/blobServices",
      Aggregations =
      {
          MetricAggregationType.Average
      },
      Granularity = TimeSpan.FromHours(1),
      TimeRange = new QueryTimeRange(TimeSpan.FromMinutes(60))
  });

We had referred to multiple documentation:
Documentation reference for the package
List of supported metrics & resource providers
Monitoring Storage account
Only after we used Metrics List API and compared it to the request Azure.Monitor.Query package was sending (captured details through fiddler), we were able to understand we were passing the wrong the values.
Queries:

Using 'BlobCount' as metric with 'Blob' as namespace should have thrown error. But we did not see any error instead we could see success response with empty result.

Can we update the documentation of Azure.Monitor.Query package MetricsQueryClient to include some more examples so that we understand what values to use in the options.

Thanks.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9c6e1b7d-47c1-f897-9178-4d32c113bf71
Version Independent ID: 639e3ecd-deec-d327-f826-03ed36d7efe1
Content: MetricsQueryOptions Class (Azure.Monitor.Query) - Azure for .NET Developers
Content Source: xml/Azure.Monitor.Query/MetricsQueryOptions.xml
Service: azure
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

Thank you for your feedback.  Tagging and routing to the team member best able to assist.


Pretty profiles doesn't work

I tried to move pretty to a separate profile as recommended by the docs, but the injections I'm doing only work I do them from my dev profile. I can a class not found exception for io.aviso.repl if I use a pretty profile. Maybe I'm just doing something unsupported by having two injection keys, but in any case:
lein with-profiles +pretty repl fails with:
{:user {:plugins      [[cider/cider-nrepl "0.11.0-SNAPSHOT"]
                       [refactor-nrepl "2.0.0"]
                       [lein-license "0.1.6"]
                       [lein-midje "3.2"]]
        :dependencies [[alembic "0.3.2"]
                       [spyscope "0.1.5"]
                       [org.clojure/tools.nrepl "0.2.12"]
                       [org.clojure/tools.namespace "0.2.11"]
                       [org.clojure/tools.logging "0.3.1"]
                       [leiningen #=(leiningen.core.main/leiningen-version)]
                       [im.chit/vinyasa "0.4.2"]
                       [aprint "0.1.3"]]
        :injections   [(require 'spyscope.core)
                       (require '[vinyasa.inject :as inject])

                       (inject/in [vinyasa.inject :refer [inject [in inject-in]]]

                                  [alembic.still [distill pull] lein [load-project pull-project]]

                                  [clojure.tools.namespace.repl refresh]
                                  [clojure.repl doc source]
                                  [clojure.java.shell sh]
                                  [aprint.core aprint ap]

                                  clojure.core
                                  [vinyasa.reflection .> .? .* .% .%> .& .>ns .>var])]}
 :pretty {:plugins      [[io.aviso/pretty "0.1.24"]]
          :dependencies [[io.aviso/pretty "0.1.24"]]
          :injections   [(require 'io.aviso.repl)
                         (require 'io.aviso.logging)

                         (io.aviso.repl/install-pretty-exceptions)
                         (io.aviso.logging/install-pretty-logging)
                         (io.aviso.logging/install-uncaught-exception-handler)]}}

lein repl works with:
{:user {:plugins      [[cider/cider-nrepl "0.11.0-SNAPSHOT"]
                       [refactor-nrepl "2.0.0"]
                       [lein-license "0.1.6"]
                       [lein-midje "3.2"]
                       [io.aviso/pretty "0.1.24"]]
        :dependencies [[alembic "0.3.2"]
                       [spyscope "0.1.5"]
                       [org.clojure/tools.nrepl "0.2.12"]
                       [org.clojure/tools.namespace "0.2.11"]
                       [org.clojure/tools.logging "0.3.1"]
                       [leiningen #=(leiningen.core.main/leiningen-version)]
                       [im.chit/vinyasa "0.4.2"]
                       [aprint "0.1.3"]
                       [io.aviso/pretty "0.1.24"]]
        :injections   [(require 'spyscope.core)
                       (require '[vinyasa.inject :as inject])
                       (require 'io.aviso.repl)
                       (require 'io.aviso.logging)

                       (inject/in [vinyasa.inject :refer [inject [in inject-in]]]

                                  [alembic.still [distill pull] lein [load-project pull-project]]

                                  [clojure.tools.namespace.repl refresh]
                                  [clojure.repl doc source]
                                  [clojure.java.shell sh]
                                  [aprint.core aprint ap]

                                  clojure.core
                                  [vinyasa.reflection .> .? .* .% .%> .& .>ns .>var])

                       (io.aviso.repl/install-pretty-exceptions)
                       (io.aviso.logging/install-pretty-logging)
                       (io.aviso.logging/install-uncaught-exception-handler)]}}

io.aviso.repl no longer exists since a few releases back.  The plugin code now makes its own injections.


Move over last failing tests

Lock ember data at a specific SHA
remove uneeded test directory.

@Bestra Locking it down to the sha seems to be breaking on semaphore.
Also, might be worth looking into components/ember-data

@tonywok I got it to work by changing the format of the resolution slightly.  Everything else was on the right track.


resample-dpi: use long form for flags

Short flags are great when typing a command, but are less useful in a script, where comprehension is more important than speed.
Perhaps a matter of preference, but I’d say when you can understand what a command is doing without having to open the man page and check every flag because they consist of a single letter, you have a better experience, and might be more inclined to fix bugs if an outsider to the code.

Closing for lack of interest, as part of personal cleanup of old pull requests and issues.


529 mock issue

Fixes #529
Checklist

[x] I have read the Contribution & Best practices Guide and my PR follows them.
[x] My branch is up-to-date with the Upstream master branch.
[x] I have added necessary documentation (if appropriate)

Changes proposed in this pull request:

Added search for query on pressing enter.
By default JSON format is displayed but we can select any other type if we want and then press enter.

Should I remove the Submit button as well?

Hey @rohitjain00
It looks good!
Also, if you are trying to solve #516 (Removing Submit Button)with this PR, Please update your fork branch with fossasia/query-server as the UI was changed in PR #527 and your branch is not up to date with it.
Cheers!

I'll add another PR with Removing submit button and change UI in accordance with #527

The linked issue is closed already.


Publish Bitcoin docker images to use in local docker compose

Building docker images for Bitcoin local setup takes much more than 30 minutes, which is annoying to set up. With this PR we publish the images to GitHub Container Registry and use them in local docker compose.

This is so cool!

merge conflicts!

Just ran this locally. So cool to see it pull our images from the internet. It feels so official!

@beaushinkle conflicts were solved, would you do the honors?


Help for installation pg_activity 3.0.1

Hi
I want install pg_activity 3.0.1 on RheL 8.6
I have this error :

I install python39 with yum command
sudo yum install python39

I have the same error when I want to install yet pg_activity 3.0.1
Thx for your help.
Emmanuel

Hi,
Thanks for the report.
There is a packaging problem on Redhat 8 (see https://github.com/dalibo/pg_activity/issues/319)

The install with pip works (I you have the required access)

I have similar error on Rocky 9
Last metadata expiration check: 0:24:52 ago on Thu 10 Nov 2022 05:07:34 PM +03.
Error:
Problem: cannot install the best candidate for the job

nothing provides python3.9dist(blessed) needed by pg_activity-3.0.0-1.rhel9.noarch
nothing provides python3-blessed needed by pg_activity-3.0.0-1.rhel9.noarch
nothing provides python3-humanize >= 2.6.0 needed by pg_activity-3.0.0-1.rhel9.noarch
nothing provides python3.9dist(humanize) >= 2.6 needed by pg_activity-3.0.0-1.rhel9.noarch
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)

@bagafoot if release 2.3.1 is enough for you, it should be available in EPEL9 next week. You can test the build with this update https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2022-89a5b2ec98

pg_activity 3.x.x is giving errors on Almalinux as well. I think it was not the best to publish such package to PGDG that requires dependencies that will not be provided so soon to AppStream RPM repository:
nothing provides python3-attrs >=18.1 needed by pg_activity-3.1.1-1.rhel8.noarch
nothing provides python3-humanize >= 2.6.0 needed by pg_activity-3.1.1-1.rhel8.noarch

Probably alternative would be to provide also required python packages in PGDG-common.

nothing provides python3-attrs >=18.1 needed by pg_activity-3.1.1-1.rhel8.noarch

This one is a packaging bug, we have no such lower bound on our side.

nothing provides python3-humanize >= 2.6.0 needed by pg_activity-3.1.1-1.rhel8.noarch

This is being worked around in #345.
In any case, EPEL would probably be required.

EPEL is not enough on RHEL8. On RHEL8 I doubt they will provide required packages in upstream.

Latest package available in AppStream is python3-humanize-0.5.1-13.el8.noarch.rpm

With which we'll restore compatibility from #354.

For python3-attrs, the same thing, not available in EPEL, and latest available in AppStream is python3-attrs-17.4.0-6.el8.noarch.rpm

With which we already are compatible; but for which there is a buggy constraint in PGDG packaging as reported here.
Sorry; I apparently confused_ appstream and EPEL. But in any case, I think this can be sorted out.

I tried install through pip but pip installing 2.3.1 too for now.

Which Python version are you using? If you want a recent version of pg_activity, you need at least Python 3.7.

I tried install through pip but pip installing 2.3.1 too for now.

Which Python version are you using? If you want a recent version of pg_activity, you need at least Python 3.7.

hmm, I got Python 3.6, ok thanks


Help with saving a row

When I save a cell into base I use editor:save event
grid.events.on("editor:save", function (data, $cell) {
console.info("Column:", '@'+grid.getCellColumn($cell)+'@');
jQuery.ajax({
type: "POST",
url: "upd.php",
dataType:"text",
data:'ID='+grid.getRowData(grid.getCellRow($cell))["ID"]+'&Val='+grid.activeEditor.getValue()+'&Pole='+grid.getCellColumn($cell)+'&Text='
});
});
What is the best solution to save a new row to DB? When I add a new row I type something cell by cell. So it use editor:save event instead others.

I really need your help. please...

The event editor:save should be used to save single cell value (e.g., for an UPDATE statement), but to save a whole row, you should use row:save event (e.g., for an INSERT statement).
Check out the example.js file for an example on how to use row:save event.


Interface

how do i interface with the bot like Friskytool
how to get level of a specific person is it via role or some other way

Friskytool uses a private API and level roles can be done with :?rlevel you can get help for rlevel with :?help rlevel


Crunchyroll

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.03.24
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl -v -s https://www.crunchyroll.com/case-closed/episode-927-the-scarlet-school-trip-bright-red-arc-779983
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-s', 'https://www.crunchyroll.com/case-closed/episode-927-the-scarlet-school-trip-bright-red-arc-779983']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2020.03.24
[debug] Python version 3.8.0 (CPython) - Windows-10-10.0.18362-SP0
[debug] exe versions: ffmpeg 4.2, ffprobe git-2019-12-24-287620f
[debug] Proxy map: {}
[crunchyroll] 779983: Downloading webpage
ERROR: Unable to extract video_title; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "c:\users\davfa\appdata\local\programs\python\python38-32\lib\site-packages\youtube_dl\YoutubeDL.py", line 797, in extract_info
    ie_result = ie.extract(url)
  File "c:\users\davfa\appdata\local\programs\python\python38-32\lib\site-packages\youtube_dl\extractor\common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "c:\users\davfa\appdata\local\programs\python\python38-32\lib\site-packages\youtube_dl\extractor\crunchyroll.py", line 444, in _real_extract
    video_title = self._html_search_regex(
  File "c:\users\davfa\appdata\local\programs\python\python38-32\lib\site-packages\youtube_dl\extractor\common.py", line 1014, in _html_search_regex
    res = self._search_regex(pattern, string, name, default, fatal, flags, group)
  File "c:\users\davfa\appdata\local\programs\python\python38-32\lib\site-packages\youtube_dl\extractor\common.py", line 1005, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract video_title; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

So I use mpv to stream Crunchyroll, and when I was trying to play it kept giving
mpv https://www.crunchyroll.com/case-closed/episode-927-the-scarlet-school-trip-bright-red-arc-779983 --demuxer-max-back-bytes=1000000
Warning: option --display-fps was replaced with --override-display-fps and might be removed in the future.
Warning: option --video-aspect was replaced with --video-aspect-override and might be removed in the future.
Auto-loading profile 'protocol.https'
[ytdl_hook] ERROR: Unable to extract video_title; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
[ytdl_hook] youtube-dl failed: unexpected error ocurred
Failed to recognize file format.

Exiting... (Errors when loading file)

So I tried running a skip download test on youtube-dl and had the same issue.
Thank you,
davFaithid

Have a look at issue #25047 and PR #25060 :)

Thank you very much! @OhNiice
Now all I have to fix is
Auto-loading profile 'protocol.https'
 (+) Video --vid=1 (h264 1920x1080 23.976fps)
 (+) Audio --aid=1 (aac 2ch 44100Hz)
     Subs  --sid=1 --slang=enUS 'ass' (ass) (external)
Using hardware decoding (nvdec).
AO: [wasapi] 48000Hz stereo 2ch float
VO: [gpu] 1920x1080 cuda[nv12]
[vo/gpu/cuda-nvdec] cuda_ext_vk_init failed

but I'm sure I can figure it out. =)


app scripts

are there any build time scripts that are triggered early on? (on the core?)
epecially in this steps would be awesome (as they are before the tests)
 V -----> Preparing runtime environment...
 | -----> Discovering process types
 |        Procfile declares types -> web
 |        Default process types for PHP -> web
 | -----> Releasing php ...
 | -----> Deploying php ...
 ^ -----> Running pre-flight checks
 ? -----> Running post-deploy

and is post-deploy only accessible via plugins?
I know this feature probably departs the heroku default, but it seams that node.js apps have it, it should be nice to have this feature across the board.

What do you mean by app scripts?

I had similar requirements (I think) and ended up writing the predeploy-tasks plugin here (michaelshobbs/dokku-app-predeploy-tasks).

You can write your own custom plugin to have hooks for different settings. For instance, I think with PHP apps you can use the extra.compile key in your composer.json.
For the pluginhook, you'll want to hook into pre-deploy.


Application Stops Responding

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the bug
Hi, I have an issue where my application just stops or takes a long time to respond to the requests.
The application is working fine and all of a sudden we can see and downfall on the rps, the CPU also drops.
Response time:

Throughput:

CPU:

Memory:

This started happening when we migrated from version 11 to 12, also this is happening from time to time and we have yet to identify the root problem.
On version 12.3.2 we had the same behavior but we also had this error
at System.Threading.CancellationToken.ThrowOperationCanceledException()
   at System.Threading.SemaphoreSlim.WaitUntilCountOrTimeoutAsync(TaskNode asyncWaiter, Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at HotChocolate.Execution.RequestExecutorProxy.GetRequestExecutorAsync(CancellationToken cancellationToken)

On version 12.5.0 we don't see any error but like I said before have the same behavior as on the previous version.
We were able to perform a thread profiler but it doesn't give much info.

Performing some search for something similar we stumbled upon this on Github https://github.com/mgravell/Pipelines.Sockets.Unofficial/issues/28 that references this post https://blog.marcgravell.com/2019/02/fun-with-spiral-of-death.html
The application is a gateway with a local schema and with federated schema with polling on with only one domain service.
Can someone help?
.Net Version - 3.1
HotChocolateVersion - 12.5.0

It seems this is related to a bug in .NET Core 3.1. Have you tried to update to .NET 6?

We are in the process of migrating to .Net 6 and that can take some time.
Still, I find it hard to believe that it's an issue with .Net Core 3.1 like I said before when with were using version 11 of HotChocolate this didn't happen, maybe we were just lucky don't know.
I think that the problem is somewhere with the use of the SemaphoreSlim that we use on our application and also if I'm not mistaken the HotChocolate engine also uses.

Just read the blog you posted and there he stated that the issue was a bug in the SemaphoreSlim. I have not looked into this specific issue yet since I thought that kind was your conclusion :)

https://github.com/ChilliCream/hotchocolate/blob/main/src/HotChocolate/Core/src/Execution/RequestExecutorProxy.cs


build: bump upload-artifact to v4 and fix mkcert.exe in tarball/zipball [skip ci]

The Issue

upload-artifact is deprecated and needs to bump to v4
mkcert.exe in tarball/zipball is wrong.

I will test it, the previous attempt to bump upload-artifact@v4 was not successful:

#5662

They're really putting the pressure on to upgrade now, so I guess we'll try it. We'll back it out if we fail again. I thought there had been a previous attempt.

Tested both changes with #6263
The artifacts are fine and the mkcert.exe binary inside all-ddev-executables.zip is correct.

Thanks!


Android support

One idea would be to wrap existing compose navigation in ScreensNavigation.
This would encourage to reuse same navigation code on Android but would not allow to use Android specific features like deep links.
Also ViewModel should integrate with Android ViewModel.

Moreover currently screen rotation resets navigation to startRoute

While it's possible to use current implementation on Android, its not recommended.
This library needs to migrate to use the official compose navigation underneath with common interface.
It's necessary in order to respect the lifecycle and properly react to configuration changes.
Currently any configuration change, like screen rotation resets navigation to the start screen, same happens when app is resumed after being killed.
Additionally popping last screen from the stack with back button is not handled out of the box


[WIP] Redesign GenericNamedGraph type

Closes #70.

Codecov Report
Attention: Patch coverage is 75.49020% with 25 lines in your changes are missing coverage. Please review.

Project coverage is 75.16%. Comparing base (254e4cd) to head (188f800).
Report is 4 commits behind head on main.

Files
Patch %
Lines

src/abstractnamedgraph.jl
78.04%
9 Missing :warning:

src/lib/GraphsExtensions/src/abstracttrees.jl
36.36%
7 Missing :warning:

src/namedgraph.jl
84.61%
6 Missing :warning:

.../PartitionedGraphs/src/abstractpartitionedgraph.jl
66.66%
3 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #73      +/-   ##
==========================================
- Coverage   78.82%   75.16%   -3.66%
==========================================
  Files          34       37       +3
  Lines        1190     1329     +139
==========================================
+ Hits          938      999      +61
- Misses        252      330      +78

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


hal_test binary not created when TARGET=linux is passed to ./build.sh or to make

Observed that hal_test binary is not created while building ut when the command is ./build.sh TARGET=linux or make TARGET=linux. However same works fine w/o TARGET=linux.
The issue is in makefile:(https://github.com/rdkcentral/rdk-halif-test-device_settings/blob/main/Makefile#L32)
ifeq ($(TARGET),)
$(info TARGET NOT SET )
$(info TARGET FORCED TO Linux)
TARGET=linux
SRC_DIRS += $(ROOT_DIR)/skeletons/src
endif

This part of the code runs only when TARGET is empty and sets the SRC_DIRS. However when TARGET=linux, SRC_DIRS is not set and hence the error.
build.sh TARGET=linux.pdf

Changed merged to develop


Move project load out of config validate

This separates the concerns of locating and parsing the config file.
This will allow us to better isolate the Config class as a whole.
Config.validate now returns a string to the location of the config file.
Consumers of Config.validate are now responsible for executing their own
Project.load.
This was branched from #701 and is slightly dependent thereof. It can easily be extricated from that dependency if needed.
Any conflicts should resolve once #701 is merged.

Let me know what you think!

See: https://github.com/tmuxinator/tmuxinator/pull/700#issuecomment-489096929


add aliases - dependencies and dependents

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[ ] Have you successfully run brew tests with your changes locally?

Description:
Add aliases for deps ← dependencies and uses ← dependents
Motivation:
Why not? 😛 But to give an actual reason, the deps command is easy to find, but uses is not obvious; brew help uses does not mention the word "dependent"
Alternatives considered:
Not adding these aliases as the distinction between the words "dependencies" and "dependents" might (somehow) be confusing or not obvious

For the CI issue, you just need to run brew man locally and commit the changes

Why not? 😛 But to give an actual reason, the deps command is easy to find, but uses is not obvious; brew help uses does not mention the word "dependent"

I'd rather we didn't add aliases to "improve" discoverability (as I'm not convinced they do and they will just result in more and more alias requests that we need to support indefinitely). Instead: how about adding dependents to the help/man text?


[Feature] support compress apprevision using gzip or zstd

Is your feature request related to a problem? Please describe.
AppRevision could be large as the default number is 10 for every application. It could cause list-watch time out when the number is too large.
Describe the solution you'd like
We need to compress it just like the resourceTracker (https://github.com/kubevela/kubevela/issues/4392).
Describe alternatives you've considered

Additional context

/assign


feat(connector-corda): add enterprise flavor support

Is your feature request related to a problem? Please describe.
Right now what we have for the Corda connector is all based on the open source (OS) flavor, but we need to support the enterprise one as well.
Describe the solution you'd like
Tests verifying that the connector works the same way for both OS (existing tests) and enterprise (tests to be added, missing things to be implemented)
Describe alternatives you've considered
Considered for a moment to have a separate connector for Corda Enterprise, but quickly discarded that idea because my hope is that on the technical level they are both the same and Enterprise just comes with additional bells and whistles but it does not break compatibility with the OS edition in the lower level details such as how flows can be invoked, etc.
Additional context
This issue could be as easy as just adding a new AIO image with the enterprise build and then copying the tests to use that image. If that all works then that's all that needed to be done. On the other hand it has the potential to blow up in complexity based on the exact technical differences between the OS and Enterprise editions.
cc: @takeutak @sfuji822 @hartm @jonathan-m-hamilton @AzaharaC @jordigiam @kikoncuo @petermetz @arnab-roy

At the moment, in the enterprise corda, the latest is v1.5 which still uses the old corda v4 jars. Thus we need to wait till the enterprise support for corda v5 is in place.
I will contact the Corda support team and post the official update from them here


Only destroy process and track cancellation if process is alive

fixes #887
@patflynn
@chanseokoh (since this affects metrics)
@meltsufin (since I think you helped with the original code)

@meltsufin (since I think you helped with the original code)
Helped cause the issue that is :)

@meltsufin I put it much more gently :)  I'm not actually sure when the issue surfaced though since there was a lot of refactoring here.

LGTM, other than documentation comment

LGTM about metrics.

@paflynn are are ok with this change? I can merge it in if so and then begin the release process. I'd like this fix to go in for the release.

@etanshaul Don't forget to include https://github.com/GoogleCloudPlatform/gcloud-intellij/pull/854 when you make a release.

This next release will have everything in master so yes it will be included. Thanks.


ngProgress injected is not the service but the factory

That is weird I have installed it that way:
package.json
"ngprogress": "VictorBjelkholm/ngProgress#v1.1.3",

then include resources:
            "node_modules/ngprogress/build/ngProgress.min.js",
            "node_modules/ngprogress/ngProgress.css",

app.js
angular.module('swif.framework', [...
    'ngProgress',
]);

the controller is on the screen shot
Was working on 1.0.7, do not work on 1.1.3 (also tried on 1.1.1)
Any idea ? I think this has to be with the way you handle injection.
You should name the function and then add $inject property on it.
function ngProgressFactory(x,y,z) {}
ngProgressFactory.$inject('x','y','z');
Because you use a factory and return ['x', f(x) {}] I get that array instead of the service.

I'd need to see your controller to find out what is going wrong
You should inject the ngProgressFactory to create an instance:
var MainCtrl = function($scope, $timeout, ngProgressFactory) {}

Then in your controller's function, create an instance of ngProgress:
$scope.progressbar = ngProgressFactory.createInstance();

I think it's more a bug than a question because it works on 1.0.
I have injected 'ngProgress' into the controller:
function msgService($uibModal, notificationService, ngProgress, errorMsgService, gettextCatalog) {
    'ngInject';
    ...
    cf capture for the code

If I look to the source: https://github.com/VictorBjelkholm/ngProgress/blob/master/src/provider.js#L3
.service('ngProgress', function () {

So It should be possible to use 'ngProgress' but it's not.
Because it returns something that is not a service:
return ['$document', '$window', '$compile', '$rootScope', '$timeout', function($document, $window, $c

And as I said It works on the 1.0 but not on the 1.1
and I have found the commit that broke my code:
https://github.com/VictorBjelkholm/ngProgress/commit/f888e28b2f3dd8c917c1b2c7a416c4b7787db537
So it means 'ngProgress' is not a service anymore ?
Now I need to change from 'ngProgress' to 'ngProgressFactory', create an instance and put it into the scope. You may add a note for this migration path from 1.0 to 1.1
or fix it to be usable as a service.

Yeah, it may be worthwhile as a note in the readme for upgrading.  I have a feeling it was changed to allow multiple instances of ngProgress at any given time.

A question, do that work on 1.0 ?
--- a/src/framework/messages.js
+++ b/src/framework/messages.js
@@ -106,9 +106,10 @@
     * @name swif.framework.msgService
     * @description this service provide an API to display feedback to the user.
     **/
-    function msgService($uibModal, notificationService, ngProgress, errorMsgService, gettextCatalog) {
+    function msgService($uibModal, notificationService, ngProgressFactory, errorMsgService, gettextCatalog) {
         'ngInject';
         var messages = [];
+        var ngProgress = ngProgressFactory.createInstance();

I understand, adding features is always great but breaking changes are bad
(at least 1.0 -> 1.1 should be minor changes).
To handle this I'm using https://github.com/semantic-release/semantic-release which pump major release depending on your commit message and that is great !

Yep, agree.  This was before my time.  Glad to have solved the mystery though.


Rollback creds-init removal in 0.14 branch

Changes
In https://github.com/tektoncd/pipeline/pull/2671 I removed the creds-init initContainer from Task Pods so that credentials could be used by containers running with non-root users.  The intention was for this change to be free of any side-effects to end-users.  Unfortunately a backwards incompatible issue has cropped up with this change:
When a user does not specify the known_hosts field in a creds-init Secret, the credential code will perform an ssh-keyscan of the remote server to get its public key.  The problem is that previously we could guarantee ssh-keyscan was available since the code ran in our own creds-init container with our own docker image. Since we've now moved that code into Steps' entrypoint a Step's container is required to provide ssh-keyscan.  This is a change in container contract and therefore backwards-incompatible.
In this PR I've reverted the creds-init change for the 0.14 branch rather than attempt to fix the ssh-keyscan issue and possibly introduce more problems.
Before 0.15 I'd like to get a better, backwards-compatible, fix organized.  So I plan to leave the creds-init change in place in the master branch for the time being.
Submitter Checklist
These are the criteria that every PR should meet, please check them off as you
review them:

[x] Commit messages follow commit message best practices
[x] Release notes block has been filled in or deleted (only if no user facing changes)

Release Notes
The removal of the creds-init initContainer that occurred in 0.14.0 has been rolled back. The change introduced an unintended backwards-incompatibility that needs to be resolved.

So, if I got it right, the plan is rollback on the branch only, and fix on master for v0.15 instead, right?

That's my guess too, @sbwsg are we right ?

So, if I got it right, the plan is rollback on the branch only, and fix on master for v0.15 instead, right?

Yup, exactly right.  I'm working on a fix now that should hopefully be ready in time for 0.15.

So, if I got it right, the plan is rollback on the branch only, and fix on master for v0.15 instead, right?

Yup, exactly right. I'm working on a fix now that should hopefully be ready in time for 0.15.

Let's add the refered issue in the milestone then :angel:
/lgtm

Let's add the refered issue in the milestone then 👼

Good thinking, thanks for doing that!