Move k8s.io/kubernetes/pkg/kubectl/apply to k8s.io/kubectl/pkg/apply

And make sure it's properly tested, documented, with nice examples, few dependencies.

@apelisse
Hey, I'll try to move it. I hope, it's not urgent and I can take my time to get familiar with codebase.

Thanks @AlexKhotian ! Feel free to let me know how I can help!

@apelisse  Hey, small update here. We'll try to do it over this weekend.

Great @AlexKhotian ! Let me know if you need any help/tips/whatever, and feel free to ping me on slack too!

You'll realize quickly, but I think it might depend on #137 being completed first. Feel free to start with that one if needed.

@apelisse Okay, Thx =)! Currently looking into /util/openapi. Will try to move it before that issue.

This issue has been raised a long time, Is @AlexKhotian  still concerned about it?
May I try to move it?
@apelisse thx

/assign

@exploitht @apelisse
I think, that this issue is still blocked by architecture discussion in #169. And also, as we discussed before, this issue requires #137(currently also blocked by #169) to be completed first. I'm not sure, if we can continue with this issue. Maybe @apelisse has some new info about current status.

Yeah, I don't think it's stall because Alex doesn't work on it, but because we're not sure that's something we want to do yet. I'll keep you posted.


Fix firefox file upload

Summary
Fix firefox file upload not working. Refactor code slightly to improve code quality
Changed

Moved part of the form logic to its own component. Cleans up the code slightly.

Fixed

File upload not working for Firefox. Firefox uses default browser behaviour where the button click inside a form triggers the onsubmit event

i like these changes and how you solved using the correct reference for emitting the event. useImperative is a good one. Also using the ref instead of a hook around the whole form was a good choice. thats where i got stuck the other day. i pushed two small changes to reduce the lines of code and unused block.


feat: support params in isState filter

Patch & test look good. Please see http://prjs.radify.io/#/angular-ui/ui-router/pulls/2269.

@nateabele all fixed


Updating format version for Delete records

./gradlew build &&  ./gradlew test succeeded
(contains lot of formatting changes)

@cgtz @zzmao build and test succeeded so this can be merged


FEAT-#6574: UserWarning no longer displayed when Series/DataFrames are small

What do these changes do?
When creating a DataFrame or Series, no longer display UserWarning: Distributing <class 'NoneType'> object. This may take some time. when the size of the DataFrame or Series is small.

[x] first commit message and PR title follow format outlined here

NOTE:  If you edit the PR title to match this format, you need to add another commit (even if it's empty) or amend your last commit for the CI job that checks the PR title to pick up the new PR title.

[x] passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] signed commit with git commit -s
[x] Resolves #6574
[x] tests added and passing
[x] module layout described at docs/development/architecture.rst is up-to-date

Apparently this fails this test https://github.com/modin-project/modin/blob/main/modin/tests/pandas/test_series.py#L3430-L3439 because there is no longer a UserWarning being given in this case. I think changing this test to the following would solve this and still test the same thing, although we will have to import warnings since that is not included in this file. Does this seem reasonable?
Relevant pull request
def test_6782():
    datetime_scalar = datetime.datetime(1970, 1, 1, 0, 0)
    match = "Adding/subtracting object-dtype array to DatetimeArray not vectorized"
    with warnings.catch_warnings():
        warnings.filterwarnings("error", match, UserWarning)
        pd.Series([datetime.datetime(2000, 1, 1)]) - datetime_scalar

Does this seem right?

@Jayson729 yes, it looks great! Only the category should be different (PerformanceWarning):
https://github.com/pandas-dev/pandas/blob/c46fb76afaf98153b9eef97fc9bbe9077229e7cd/pandas/core/arrays/datetimelike.py#L1316
Note:  It looks like 6782 test no longer worked as originally planned since pandas changed the warning category.


Multiple Speech-Type Generation   API  support

I wish

Multiple reference audio could be load at beginning.
api could call 1 style at 1 api call.
make this api call almost real time ,  generation delay < 1s  for 1 short sentence, I thought the train step may take most time. the generating step would take less time.

@jpgallegoar might help~

The problem with 1) is that it would make it much more hardware intensive since you have to store all reference audios in VRAM instead of just one reference audio (I might be wrong on this). One optimization I did think of is generating all of the audios with the same speech type consecutively to save time, and then stitching them together accordingly. Either way, this is something I'd like to look into but unfortunately I don't have time to do it today.

Is possible, but I don't see the benefit of adding Multi-speech type to api in this manner since it's the same as generating the audios the regular way. It could be interesting to add it to the api, but by doing everything in one single api call instead of 1 style per api call.

I'm not sure how we could improve upon this step.

All ideas and help are appreciated.

@jpgallegoar, consider this scenario:
You are playing a galgame, and most galgames nowadays do not have voice acting. There are multiple characters, and each character has a specific voice type. Even a single character can have multiple emotional expressions.
Here’s what I would like to achieve:
Pre-load all audio: All audio should be loaded at the beginning, and the relevant parameters for each should be pre-calculated.
API calls: During gameplay, the galgame should call the API based on the character and their current emotion.
Fast audio generation: Audio should be generated in a very short time, ideally within 2 seconds per sentence. This is why step 1 is important—step 3’s time cost should only involve audio generation, not loading or other processes.

@jpgallegoar，请考虑以下场景：
你正在玩一款galgame，现在大多数galgame都没有语音配音。这类游戏中有多个角色，每个角色都有一个特定的音色。即使是同一个角色，也会有多种情感表达。
我希望实现以下功能：
预加载所有音频：在游戏开始时，所有音频都应该被加载，并且相关的参数都应该预先计算好。
调用API：在游戏过程中，根据角色和当前的情感状态，游戏应调用相应的API。
快速生成音频：音频应在非常短的时间内生成，理想情况下每句话的生成时间应在2秒以内。这就是为什么第1步很重要——第3步的时间开销应该仅限于音频生成，而不包括加载或其他过程。

I will look into this once I finish with the spanish finetune I'm doing. Thanks for the idea!

@jpgallegoar  多谢， 下面这些link 会帮助到你
galgame 翻译器和tts外挂  https://github.com/HIllya51/LunaTranslator
情绪的简单设计方案           https://github.com/2DIPW/gpt_sovits_infer_with_emotion
语音素材   https://www.bilibili.com/read/cv23965717/


Compile a list of who uses overflow

BarterYardClub
flow-hydraulics/flow-pds will soon use it

Gaia - accoding to j00lz

iaNFT @hichana

Flowty

BusinessCitadel: On-chain multi sig wallet and enterprise identity management system. Using overflow for project setup and testing.
[TO BE NAMED]: Web-based Cadence editor for emulator, testnet, and mainnet. Using overflow for project setup and testing as well as for deploying emulators/contracts for users.

MyNFT

OneFootball - laguitte

Bl0x - rob

green-goo-dao : flow-contracts-bot

Daybreak - Flow Analytics Platform
daybreak.so(Under development)


bump mlir-aie

@fifield This PR should make the test to pass: https://github.com/Xilinx/mlir-air/pull/703


change in cy-panzoom location

Hi,
I was using this extension with cytoscape.js 2.5.0 and some older versions. For this versions cy-panzoom was located on the top-left and inside of div containing the cy-network.

Now, I am using cytoscape.js 2.5.4 and the cy-panzoom is located under the cy-network div as following,

I think that with the latest version of cytoscape.js the location of cy-panzoom of this extension would be changed unintentionally.
And also I was wondering is there any option enabling us to set the position of the cy-panzoom?

Thanks for letting me know; fixed in 2.1.4

@maxkfranz
Thanks, I think that you prepended the panzoom instead of appending it and made the position of container absolute. Making the position absolute was problematic for me, but when I remove the following line "$container.css('position', 'absolute');" it worked fine.

You're right.  It should be on the panzoom container, not the cy container.  Let me know if it works for you.  Thanks

Thanks, it seems to be working for me now.


Licence ?

Hey hello, that looks great.
Could you licence this work ?
Many thanks

I believe Apache-2.0 is in the repo


input label truncated

If truncated show full in tooltip or title should show full form on hover or focus.
A tooltip will show only it truncated.

tooltip added


0.2.x fixes

There were just so many things wrong. But a lot of it is fixed now! Like the tests! The commits are really messy too. But, here's what needs to be done from here:

Needs to call next properly (it doesn't exactly right now)
Needs to actually have a default 404 page
Behavior for error pages vs next needs to be set up (it kind of is now)
showdir needs to be fixed
fix behavior without a 404.html page

Anything else?
Here, have fun with where I am now.

Awesome! I'll try to take a look tonight and see how much further I can push it.
Thanks a ton!

Yep, fixed all of those things I listed except the showdir one.

% npm test
npm info it worked if it ends with ok
npm info using<EMAIL_ADDRESS>npm info using<EMAIL_ADDRESS>npm info pretest<EMAIL_ADDRESS>npm info test<EMAIL_ADDRESS>
><EMAIL_ADDRESS>test /home/josh/dev/ecstatic
> tap test/*.js

ok common.js ........................ 1/1
ok express.js ..................... 35/35
ok router.js ...................... 19/19
total ............................. 58/58

ok
npm info posttest<EMAIL_ADDRESS>npm info ok

Rebased into the 0.2.x branch. I'll try to push it the rest of the way this week!


RevisionHistoryLimit has a default value of 25

Signed-off-by: Amir Mofasser<EMAIL_ADDRESS>
What this PR does / why we need it:

Changes the default value of RevisionHistoryLimit to 25
If set to 0 then certificate requests are not garbage collected
If set to nil then RevisionHistoryLimit is set to 25 by default

There needs to be a default value to prevent clusters from filling up with CR's which is very likely. With this, the default behaviour is to garbage collect old CR's
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged):
Fixes #4071
Special notes for your reviewer:
Release note:

RevisionHistoryLimit now has a default value of 25

/remove-lifecycle stale

/assign @meyskens

Hi! How can I help moving this PR forward?
/ok-to-test

Hi! How can I help moving this PR forward?
/ok-to-test

@maelvls I think we need a decision from the cert-manager team on how to move forward. There is clearly a need for a default value here however I need input. Is the PR good as-is or do I need to  change something?

@munnerz any way to move forward on this? We only found out that CRs and orders are piling up because of seeing #5188 in the changelog.
@irbekrm since you reviewed #5188 could you weigh in on this similar PR which fixes the issue for the general case instead of per-ingress?

@munnerz any way to move forward on this? We only found out that CRs and orders are piling up because of seeing #5188 in the changelog.
@irbekrm since you reviewed #5188 could you weigh in on this similar PR which fixes the issue for the general case instead of per-ingress?

So there is some work going on already to move our flag options to be driven by a config file instead. I think as we make these changes, we'll also be able to change the default values for these flags too (as this is a new API revision of our configuration API surface). So as we move the controller component to use a config file and move fields across, we should also be able to make this change to a more sensible default.

/reopen
/remove-lifecycle rotten

/remove-lifecycle rotten

/kind feature


Performance Drop

Did anyone attempt to replicate the results in the paper? Just learning a no-parts single component model on pascal with a sliding window SVM gives me about 33% mAP, as opposed to the papers' 39% mAP (before addition of multiple aspect ratio models). Anyone tried this or can Ross share why this might happen/code for training?
Thank you!

@Tar12   hello ,have you run the code of dp-dpm?,the mAP=33% is which project


 Thank you.

Can you please do cm pull repo and retry the same command?

Still the same error:
(cm) ubuntu@scw-nice-noether:~$ cm pull repo
=======================================================
Alias:    mlcommons@cm4mlops

Local path: /home/ubuntu/CM/repos/mlcommons@cm4mlops

git pull

Already up to date.

CM alias for this repository: mlcommons@cm4mlops
=======================================================

Reindexing all CM artifacts. Can take some time ...
 If so, please do
cd $HOME/CM/repos/mlcommons@cm4mlops && git checkout mlperf-inference

Are you on the master branch of cm4mlops repository? If so, please do
cd $HOME/CM/repos/mlcommons@cm4mlops && git checkout mlperf-inference

No, it seems that I am already on the mlperf-inference branch:
ubuntu@r:~$ cd $HOME/CM/repos/mlcommons@cm4mlops && git checkout mlperf-inference
Already on 'mlperf-inference'
Your branch is up to date with 'origin/mlperf-inference'.
ubuntu@r:~/CM/repos/mlcommons@cm4mlops$ git pull
Already up to date.

I have tried git pull. I then re-run the cm command but it still fails with the same error ...

oh. strangely git pull shows "up to date". Can you please share the output of git log ? Also cm rm cache -f can help if there are some stale cache entries.

Sure. Here are few lines of the output of git log:
(cm) ubuntu@r:~/CM/repos/mlcommons@cm4mlops$ git log
commit 29aa072edcb5bc06643d3d53bdaac9dedc735eed (HEAD -> mlperf-inference, origin/mlperf-inference)
Merge: a4067b4be 1c8f6a8e5
Author: Arjun Suresh<EMAIL_ADDRESS>Date:   Tue Jul 9 18:54:40 2024 +0100

    Merge pull request #102 from GATEOverflow/mlperf-inference

    Merge from go

commit 1c8f6a8e5b2633bd29b782c986efe9d6d142225e
Author: Arjun Suresh<EMAIL_ADDRESS>Date:   Tue Jul 9 13:27:17 2024 +0000

    Add Intel mlperf inference stable diffusion (WIP)

commit f2aa787efbc99d5c16fa61eca399fd8cc833d825
Author: Arjun Suresh<EMAIL_ADDRESS>Date:   Mon Jul 8 12:39:32 2024 +0000

    Fixes for mlperf inference intel dlrmv2 (run starts)

I have tried to run cm rm cache -f. I then re-run the same command and still get the same error:
  File<EMAIL_ADDRESS>line 16, in postprocess
    env['CM_MLPERF_INFERENCE_NVIDIA_CODE_PATH'] = os.path.join(env['CM_MLPERF_INFERENCE_RESULTS_PATH'], "closed", "NVIDIA")
KeyError: 'CM_MLPERF_INFERENCE_RESULTS_PATH'

Can you please try cm pull repo and retry the command once more? This change should hopefully fix the issue for you.

Can you please try cm pull repo and retry the command once more? This change should hopefully fix the issue for you.

That helped; thanks! However, after that, I am hitting another problem (I tried to run cm twice and has the same error):
Downloading flatbuffers-24.3.25-py2.py3-none-any.whl (26 kB)
Building wheels for collected packages: rouge_score
  Building wheel for rouge_score (setup.py) ... done
  Created wheel for rouge_score: filename=rouge_score-0.1.2-py3-none-any.whl size=24933 sha256=124d1054ce4a1a57d830f1c82f92fc4845a0f235bbb719c14003a448c76fcbc3
  Stored in directory: /tmp/pip-ephem-wheel-cache-et58ul6e/wheels/5f/dd/89/461065a73be61a532ff8599a28e9beef17985c9e9c31e541b4
Successfully built rouge_score
Installing collected packages: sentencepiece, flatbuffers, distlib, xxhash, virtualenv, tqdm, safetensors, requests, pyproject_hooks, pynvml, pybind11-stubgen, pyarrow, py, pbr, parameterized, nodeenv, mypy-extensions, lark, janus, identify, humanfriendly, graphviz, dill, coverage, colored, cfgv, stevedore, pytest-forked, pre-commit, onnx-graphsurgeon, nltk, mypy, multiprocess, huggingface-hub, coloredlogs, build, tokenizers, rouge_score, pytest-cov, onnxruntime, diffusers, bandit, accelerate, transformers, datasets, nvidia-ammo, evaluate, optimum
  Attempting uninstall: tqdm
    Found existing installation: tqdm 4.66.1
    Uninstalling tqdm-4.66.1:
      Successfully uninstalled tqdm-4.66.1
  Attempting uninstall: requests
    Found existing installation: requests 2.31.0
    Uninstalling requests-2.31.0:
      Successfully uninstalled requests-2.31.0
  Attempting uninstall: pynvml
    Found existing installation: pynvml 11.4.1
    Uninstalling pynvml-11.4.1:
      Successfully uninstalled pynvml-11.4.1
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 12.0.1
    Uninstalling pyarrow-12.0.1:
      Successfully uninstalled pyarrow-12.0.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
dask-cuda 23.10.0 requires pynvml<11.5,>=11.0.0, but you have pynvml 11.5.0 which is incompatible.
Successfully installed accelerate-0.25.0 bandit-1.7.7 build-1.2.1 cfgv-3.4.0 colored-2.2.4 coloredlogs-15.0.1 coverage-7.5.4 datasets-2.20.0 diffusers-0.15.0 dill-0.3.8 distlib-0.3.8 evaluate-0.4.2 flatbuffers-24.3.25 graphviz-0.20.3 huggingface-hub-0.23.4 humanfriendly-10.0 identify-2.6.0 janus-1.0.0 lark-1.1.9 multiprocess-0.70.16 mypy-1.10.1 mypy-extensions-1.0.0 nltk-3.8.1 nodeenv-1.9.1 nvidia-ammo-0.7.4 onnx-graphsurgeon-0.5.2 onnxruntime-1.16.3 optimum-1.21.2 parameterized-0.9.0 pbr-6.0.0 pre-commit-3.7.1 py-1.11.0 pyarrow-16.1.0 pybind11-stubgen-2.5.1 pynvml-11.5.0 pyproject_hooks-1.1.0 pytest-cov-5.0.0 pytest-forked-1.6.0 requests-2.32.3 rouge_score-0.1.2 safetensors-0.4.3 sentencepiece-0.2.0 stevedore-5.2.0 tokenizers-0.15.2 tqdm-4.66.4 transformers-4.36.1 virtualenv-20.26.3 xxhash-3.4.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

[notice] A new release of pip is available: 23.3.1 -> 24.1.2
[notice] To update, run: python3 -m pip install --upgrade pip
-- The CXX compiler identification is GNU 11.4.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- NVTX is disabled
-- Importing batch manager
-- Building PyTorch
-- Building Google tests
-- Building benchmarks
-- Looking for a CUDA compiler
-- Looking for a CUDA compiler - /usr/local/cuda/bin/nvcc
-- CUDA compiler: /usr/local/cuda/bin/nvcc
-- GPU architectures: 89
-- The C compiler identification is GNU 11.4.0
-- The CUDA compiler identification is NVIDIA 12.3.107
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Found CUDAToolkit: /usr/local/cuda/include (found version "12.3.107")
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- CUDA library status:
--     version: 12.3.107
--     libraries: /usr/local/cuda/lib64
--     include path: /usr/local/cuda/targets/x86_64-linux/include
-- ========================= Importing and creating target nvinfer ==========================
-- Looking for library nvinfer
-- Library that was found /usr/local/tensorrt/targets/x86_64-linux-gnu/lib/libnvinfer.so
-- ==========================================================================================
-- CUDAToolkit_VERSION 12.3 is greater or equal than 11.0, enable -DENABLE_BF16 flag
-- CUDAToolkit_VERSION 12.3 is greater or equal than 11.8, enable -DENABLE_FP8 flag
-- Found MPI_C: /opt/hpcx/ompi/lib/libmpi.so (found version "3.1")
-- Found MPI_CXX: /opt/hpcx/ompi/lib/libmpi.so (found version "3.1")
-- Found MPI: TRUE (found version "3.1")
-- COMMON_HEADER_DIRS: /code/tensorrt_llm/cpp;/usr/local/cuda/include
-- Found Python3: /usr/bin/python3.10 (found version "3.10.12") found components: Interpreter Development Development.Module Development.Embed
-- USE_CXX11_ABI is set by python Torch to 1
-- TORCH_CUDA_ARCH_LIST: 8.9+PTX
CMake Warning at CMakeLists.txt:295 (message):
  Ignoring environment variable TORCH_CUDA_ARCH_LIST=5.2 6.0 6.1 7.0 7.2 7.5
  8.0 8.6 8.7 9.0+PTX

-- Found Python executable at /usr/bin/python3.10
-- Found Python libraries at /usr/lib/x86_64-linux-gnu
-- Found CUDA: /usr/local/cuda (found version "12.3")
-- Found CUDAToolkit: /usr/local/cuda/include (found version "12.3.107")
-- Caffe2: CUDA detected: 12.3
-- Caffe2: CUDA nvcc is: /usr/local/cuda/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda
-- Caffe2: Header version is: 12.3
-- /usr/local/cuda-12.3/targets/x86_64-linux/lib/libnvrtc.so shorthash is e150bf88
-- USE_CUDNN is set to 0. Compiling without cuDNN support
-- USE_CUSPARSELT is set to 0. Compiling without cuSPARSELt support
-- Added CUDA NVCC flags for: -gencode;arch=compute_89,code=sm_89;-gencode;arch=compute_89,code=compute_89
CMake Warning at /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
  static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
  /usr/local/lib/python3.10/dist-packages/torch/share/cmake/Torch/TorchConfig.cmake:127 (append_torchlib_if_found)
  CMakeLists.txt:328 (find_package)

-- Found Torch: /usr/local/lib/python3.10/dist-packages/torch/lib/libtorch.so
-- TORCH_CXX_FLAGS: -D_GLIBCXX_USE_CXX11_ABI=1
-- Building for TensorRT version: 9.2.0, library version: 9
-- Using MPI_C_INCLUDE_DIRS: /opt/hpcx/ompi/include;/opt/hpcx/ompi/include/openmpi;/opt/hpcx/ompi/include/openmpi/opal/mca/hwloc/hwloc201/hwloc/include;/opt/hpcx/ompi/include/openmpi/opal/mca/event/libevent2022/libevent;/opt/hpcx/ompi/include/openmpi/opal/mca/event/libevent2022/libevent/include
-- Using MPI_C_LIBRARIES: /opt/hpcx/ompi/lib/libmpi.so
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- Operating System: ubuntu, 22.04
CMake Error at tensorrt_llm/CMakeLists.txt:101 (message):
  The batch manager library is truncated or incomplete.  This is usually
  caused by using Git LFS (Large File Storage) incorrectly.  Please try
  running command `git lfs install && git lfs pull`.

-- Configuring incomplete, errors occurred!
Traceback (most recent call last):
  File "/code/tensorrt_llm/scripts/build_wheel.py", line 319, in <module>
    main(**vars(args))
  File "/code/tensorrt_llm/scripts/build_wheel.py", line 160, in main
    build_run(
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command 'cmake -DCMAKE_BUILD_TYPE="Release" -DBUILD_PYT="ON" -DBUILD_PYBIND="ON" "-DCMAKE_CUDA_ARCHITECTURES=89" -DTRT_LIB_DIR=/usr/local/tensorrt//targets/x86_64-linux-gnu/lib -DTRT_INCLUDE_DIR=/usr/local/tensorrt//include  -S "/code/tensorrt_llm/cpp"' returned non-zero exit status 1.
make: *** [Makefile:102: devel_run] Error 1
make: Leaving directory '/root/CM/repos/local/cache/243ebcfde713428e/repo/docker'

CM error: Portable CM script failed (name = get-ml-model-gptj, return code = 256)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Note that it is often a portability issue of a third-party tool or a native script
wrapped and unified by this CM script (automation recipe). Please re-run
this script with --repro flag and report this issue with the original
command line, cm-repro directory and full log here:

https://github.com/mlcommons/cm4mlops/issues

The CM concept is to collaboratively fix such issues inside portable CM scripts
to make existing tools and native scripts more portable, interoperable
and deterministic. Thank you!

'git-lfs' seems missing. Even though the run happens inside docker the model download is done on the host as it needs quantization using a separate docker container. I have added a change to install this in CM. Can you please redo 'cm pull repo` ?

Yes, git-lfs solved the issue. Thank you. However, I just ran out of CUDA memory and can't check it further. I will try to find another GPU:
Calibrating batch 511
Quantization done. Total time used: 387.46 s.
torch.distributed not initialized, assuming single world_size.
torch.distributed not initialized, assuming single world_size.
torch.distributed not initialized, assuming single world_size.
torch.distributed not initialized, assuming single world_size.
torch.distributed not initialized, assuming single world_size.
torch.distributed not initialized, assuming single world_size.
torch.distributed not initialized, assuming single world_size.
Cannot export model to the model_config. The AMMO optimized model state_dict (including the quantization factors) is saved to /mnt/models/GPTJ-6B/fp8-quantized-ammo/GPTJ-FP8-quantized/ammo_model.0.pth using torch.save for further inspection.
Detailed export error: CUDA out of memory. Tried to allocate 128.00 MiB. GPU 0 has a total capacity of 21.95 GiB of which 28.12 MiB is free. Process 8143 has 21.92 GiB memory in use. Of the allocated memory 21.67 GiB is allocated by PyTorch, and 32.42 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ammo/torch/export/model_config_export.py", line 307, in export_model_config
    for model_config in torch_to_model_config(
  File "/usr/local/lib/python3.10/dist-packages/ammo/torch/export/model_config_export.py", line 185, in torch_to_model_config
    build_decoder_config(layer, model_metadata_config, decoder_type, dtype)
  File "/usr/local/lib/python3.10/dist-packages/ammo/torch/export/layer_utils.py", line 944, in build_decoder_config
    config.mlp = build_mlp_config(layer, decoder_type, dtype)
  File "/usr/local/lib/python3.10/dist-packages/ammo/torch/export/layer_utils.py", line 764, in build_mlp_config
    config.fc = build_linear_config(layer, LINEAR_COLUMN, dtype)
  File "/usr/local/lib/python3.10/dist-packages/ammo/torch/export/layer_utils.py", line 591, in build_linear_config
    weight = torch_weight.type(dtype)
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 128.00 MiB. GPU 0 has a total capacity of 21.95 GiB of which 28.12 MiB is free. Process 8143 has 21.92 GiB memory in use. Of the allocated memory 21.67 GiB is allocated by PyTorch, and 32.42 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
Quantized model exported to /mnt/models/GPTJ-6B/fp8-quantized-ammo/GPTJ-FP8-quantized
Total time used 35.41 s.
make: Leaving directory '/root/CM/repos/local/cache/f50b4df1b7424441/repo/docker'
/home/ubuntu/cm/bin/python3: can't open file '/root/CM/repos/local/cache/55918655d7a54368/repo/closed/NVIDIA/code/gptj/tensorrt/onnx_tune.py': [Errno 2] No such file or directory

CM error: Portable CM script failed (name = get-ml-model-gptj, return code = 256)


az artifacts universal download fails

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az artifacts universal download Extension Name: azure-devops. Version: 0.13.0.
Errors:
## Following lines are manually added to provide better context.
An error occurred while extracting the Universal Packages tooling: [WinError 5] Access is denied: '~$HOME\\azure\\azuredevops\\cli\\tools\\artifacttool\\xxxxxxx-x-xxxx' -> '~$HOME\\.azure\\azuredevops\\cli\\tools\\artifacttool\\ArtifactTool_win10-x64_0.2.128'

[WinError 2] The system cannot find the file specified
Traceback (most recent call last):
pip-install-p8t_6awn\knack\knack\cli.py, ln 206, in invoke
cli\core\commands\__init__.py, ln 603, in execute
cli\core\commands\__init__.py, ln 661, in _run_jobs_serially
cli\core\commands\__init__.py, ln 652, in _run_job
azext_devops\dev\common\exception_handler.py, ln 31, in azure_devops_exception_handler
    reraise(*sys.exc_info())
Temp\pip-install-p8t_6awn\six\six.py, ln 693, in reraise
cli\core\commands\__init__.py, ln 631, in _run_job
...
Azure\CLI2\lib\subprocess.py, ln 709, in __init__
    restore_signals, start_new_session)
Azure\CLI2\lib\subprocess.py, ln 997, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] The system cannot find the file specified

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Freshly install 'azure-devops' extension
az artifacts universal download --organization {} --feed {} --name {} --version {} --path {}

Expected Behavior
Environment Summary
Windows-10-10.0.19002-SP0
Python 3.6.6
Shell: cmd.exe

azure-cli 2.0.75

Extensions:
azure-devops 0.13.0

Additional Context

I have the same problem, in my case I want to publish an artifact. Did you find a way around this issue ?

This bug occurs when some other process might interfere with the download artifact tool. The process could be an antivirus, some other process which is sharing the same location. We are in the process of adding a retry to escape this.
Also, this issue looks like a duplicate of #798 . Closing this one and tracking it there.


Skip commenting memory/perf benches on draft PRs

This should help reduce some of the comment noise until we have time to customize that action some more.
I tested that this works on this PR -- the benches are not run when the PR is a draft.
I had to pull the two relevant jobs out into a different workflow file, because the triggers are different. For the reporting benches stage (the memory and perf comments that show up on PRs), they'll only run if the PR is in a draft. But, and this is the different part that required them being in a separate file, they also need to trigger when a PR is marked "ready for review".

It looks like the tests for the npm package got stuck for the last two hours on macos-14... @billti have you seen anything like this before?


rules/klayout/lvs: try multiple netlist formats

Related: https://github.com/google/globalfoundries-pdk-libs-gf180mcu_fd_pr/pull/99 https://github.com/google/globalfoundries-pdk-libs-gf180mcu_fd_pr/issues/101 https://github.com/google/globalfoundries-pdk-libs-gf180mcu_fd_pv/issues/39 https://github.com/RTimothyEdwards/open_pdks/issues/346
This allow to discover LVS netlists generated by xschem with their default extension (.spice).

PTAL


Remove an explicit UseDotNet step when .NET 5 would be available on Devops machines

actions/virtual-environments#1891

The associated pull requests have been merged; closing this out.   Please feel free to reopen if this is still tracking active work.

Still needed. https://github.com/Azure/azure-sdk-for-net/pull/17281 is the real PR.

Sorry about that.   Sliding the milestone for compliance.

No problem at all. Being more aggressive with the cleanup is something I wholeheartedly support.


lua: update example to verify the multiple lua filter can be configured simultaneously

Commit Message: lua: update example to verify the multiple lua filter can be configured simultaneously
Additional Description:
Simple example updates.
Risk Level: low.
Testing: n/a.
Docs Changes: n/a.
Release Notes: n/a.
Platform Specific Features: n/a.

@phlax Thanks. But, sorry, I didn't get it.
To configured same filter repeatedly is a common feature that added after #21030 #21525 #22002. This feature can be used by all the filters. But we have no a good example for that.
Because I think the lua filter is a filter that most likely users need to configured repeatedly, so I update the example of lua filter to also as a example of repeated filters.
So, I am not clear what's you mean by the tests for the docs.
Should I create a complete new example for this?

the verify.sh script that you are editing here is a test for this page:
https://www.envoyproxy.io/docs/envoy/latest/start/sandboxes/lua
in general, neither the script nor the docs should change without a corresponding change in the other

May I create a complete new sandbox and example, e.g. multiple_lua, to be example of repeated filters?

if you think it necessary - i would probably more suggest just  adding some additional steps (and possibly config if required)

May I create a complete new sandbox and example, e.g. multiple_lua, to be example of repeated filters?

if you think it necessary - i would probably more suggest just adding some additional steps (and possibly config if required)

get it.

Is it looks ok?

will review this afternoon - just going through my PR backlog atm

@wbpcode thanks for updating
lets land and iterate - my slight reservation is that ideally these sandboxes have short/simple/discreet steps that exemplify different things - whereas this is doing everything at once
that said, i think this is a useful addition so lets land

May be I can add some new config to use different curl command to test different functions.

friendly ping @phlax

@wbpcode i think you will need to force push to resolve DCO - otherwise lgtm

cc @phlax Hi, may be this PR can be land?


Roadmap for 2020 - Scripting API

👋 CUE Authors,
What does the roadmap look like in 2020 for CUE? Any wikis or docs on this?
Specifically, are there any detailed docs about what's planned with the Scripting API etc.?
❤

We plan to role out a roadmap soon. What exactly did you have in mind with the Scripting API?

Mainly more documentation on how to extend it, API changes that are planned in the next quarter and so on. As of right now, detailed docs about the scripting layer are missing.

So IIUC, you mean the CUE API part of scripting.
Our plan in this direction is to replace cue cmd with cue run (the former will stay around for bw compatibility) and document that. We believe there is a lot of room for simplification while making things more flexible and orthogonal.
Our next focus will be on an evaluator rewrite and getting in some breaking language changes (with migration path). We don't have a specific timeline, but the cue run part is relatively critical, so it will probably slip in a release before the next tooling-specific release.
We've started creating roadmap issues. See https://github.com/cuelang/cue/issues/337.

@mpvl that's what I meant, thank you! :)

This issue has been migrated to https://github.com/cue-lang/cue/issues/333.
For more details about CUE's migration to a new home, please see https://github.com/cue-lang/cue/issues/1078.


Use the correct endpoint for uploads

According to the Flickr API docs, upload and replace API requests should be made to the https://up.flickr.com/services endpoint. They're currently being made to https://api.flickr.com/services, which worked until very recently, but something must have changed with the recent migration to AWS and now upload & replace only work when made against up.flickr.com.
This PR switches upload & replace to that endpoint. This addresses #110.

Thanks !


Bug: TypeAliases/NewTypes ignored in Provider Map

Description
Pydantic v2 makes heavy use of annotated types and type aliases when defining custom validators for types. From their documentation:
from typing import Annotated

from pydantic import BaseModel, AfterValidator, ValidationError

MyInt = Annotated[int, AfterValidator(lambda v: v + 1)]

class Model(BaseModel):
    a: MyInt

print(Model(a=1).a)
# > 2

From what I understand, polyfactory makes no effort to natively keep up with the custom validation functions that pydantic offer, but instead lets the user define a custom provider map to override the default handling of user-defined types. Drilling down into polyfactory's code, I've found that the provider_map does not support "unwrappable" types because all annotations, newtypes, optionals, and unions are removed or "unwrapped" before any attempt is made to find a type alias in the provider map. This means even if I add MyInt to the provider_map with a custom factory method, polyfactory will always treat MyInt as just an int because Annotated will be stripped by the unwrap_annotation method.
URL to code causing the issue
https://github.com/litestar-org/polyfactory/blob/e4daf5f6e4f7e17cad6bb75d8ff81fbb3145958a/polyfactory/factories/base.py#L636
https://github.com/litestar-org/polyfactory/blob/e4daf5f6e4f7e17cad6bb75d8ff81fbb3145958a/polyfactory/field_meta.py#L131
MCVE
from dataclasses import dataclass
from typing import NewType
from polyfactory.factories import DataclassFactory

MyType = NewType("MyType", str)

@dataclass
class MyModel:
    my_type: MyType

class MyModelFactory(DataclassFactory):
    __model__ = MyModel

    @classmethod
    def get_provider_map(cls):
        base_provider_map = super().get_provider_map()
        return {
            MyType: lambda: "constant",  # Any MyType value *should* always be populated with "constant"
            **base_provider_map
        }

if __name__ == "__main__":
    my_model = MyModelFactory.build()
    print(my_model.my_type)

Results in:

```text
# stdout
ddtJwRSSJdmQZPLLcuuq  # expected value is "constant"

Release Version
2.8.0
Platform

[ ] Linux
[X] Mac
[ ] Windows
[ ] Other (Please specify in the description above)

Funding

If you would like to see an issue prioritized, make a pledge towards it!
We receive the pledge once the issue is completed & verified

I've taken a brief stab at fixing this with the following code, which basically hijacks the unwrap_annotation function. However, I've found that even at this point the annotation has already gone through a couple passes of normalization of the NewType and Optional types, particularly when initializing the FieldMeta object, so this code works marginally better, but only for a subset of (more complex) custom types.
from dataclasses import dataclass, asdict
from typing import Any, Generator, Annotated, Optional, NewType
from polyfactory.factories import DataclassFactory
from polyfactory.field_meta import FieldMeta

MyType1 = NewType("MyType1", str)
MyType2 = Optional[Annotated[str, "metadata"]]

@dataclass
class MyModel:
    my_type1: MyType1
    my_type2: MyType2

class MyModelFactory(DataclassFactory):
    __model__ = MyModel

    @classmethod
    def get_provider_map(cls):
        base_provider_map = super().get_provider_map()
        return {
            MyType1: lambda: "constant1",  # Any MyType1 value *should* always be populated with "constant1"
            MyType2: lambda: "constant2",  # Any MyType2 value *should* always be populated with "constant2"
            **base_provider_map
        }

    @classmethod
    def get_field_value(cls, field_meta: FieldMeta, field_build_parameters: Any = None) -> Any:
        for annotation in cls.unwrap_annotation(field_meta.annotation):
            if provider := cls.get_provider_map().get(annotation):
                return provider()
        return super().get_field_value(field_meta, field_build_parameters)

    @classmethod
    def unwrap_annotation(cls, annotation: Any) -> Generator:
        # There is a bug in the polyfactory library where type detection for TypeAliases and NewTypes drill down all
        # the way to the base type before checking if the user provided a factory method for that type in the provider
        # map. This custom loop builds from their existing logic for unwrapping annotations in
        # polyfactory.utils.helpers.unwrap_annotation and exposes every intermediary type so that we can check
        # that type against the user-specified provider map.
        from polyfactory.utils.helpers import (
            is_optional, is_union, is_annotated, is_new_type
        )
        from typing_extensions import get_args
        while is_optional(annotation) or is_union(annotation) or is_new_type(annotation) or is_annotated(annotation):
            yield annotation
            if is_new_type(annotation):
                annotation = annotation.__supertype__
            elif is_optional(annotation) or is_annotated(annotation):
                annotation = next((arg for arg in get_args(annotation) if arg not in (type(None), None)))
            elif is_union(annotation):
                args = list(get_args(annotation))
                annotation = cls.__random__.choice(args)
            else:
                break

if __name__ == "__main__":
    my_model = MyModelFactory.build()
    print(asdict(my_model))

# stdout
{'my_type1': 'zvivkqTnOUXPsWRnYEzZ', 'my_type2': 'constant2'}

So this partial fix addresses my_type_2, but not my_type_1

Thanks for reporting this :)
I agree that overriding the provider map for a NewType should be properly considered since that is, for all practical purposes, a new type. However, I'm not so sure about the type aliases. In my opinion, type aliases are not user defined types, and the provider map is for handling cases of user defined types that polyfactoey can't create instances of.
@Goldziher what do you think about this?

Thanks for reporting this :)
I agree that overriding the provider map for a NewType should be properly considered since that is, for all practical purposes, a new type. However, I'm not so sure about the type aliases. In my opinion, type aliases are not user defined types, and the provider map is for handling cases of user defined types that polyfactoey can't create instances of.
@Goldziher what do you think about this?

i agree. A new type is a new type, and we have some logic to handle it. We obviously should allow it being overridden as in the bug issue.
As for type aliases - these are not actually distinct types, and we cannot handle this type of logic like this. I would say this goes onto the user to handle. Also note-- if you actually want to have a type alias idiomatically, you should type it using TypeAlias exported from typing.

Thanks for reporting this :)
I agree that overriding the provider map for a NewType should be properly considered since that is, for all practical purposes, a new type. However, I'm not so sure about the type aliases. In my opinion, type aliases are not user defined types, and the provider map is for handling cases of user defined types that polyfactoey can't create instances of.
@Goldziher what do you think about this?

Thank you both for your timely replies - I see your points and think supporting NewTypes in the provider map would unlock the functionality I’m after and is a reasonable compromise. I also see how supporting type aliases in the provider map could have unintended consequences and is best steered clear of.


Watermelon Problem.

One hot summer day Jaya and her friend Rekha decided to buy watermelons. They chose the biggest crate. They rushed home, dying of thirst, and decided to divide their loot, however they faced a hard problem.
Jaya and Rekha are great fans of odd numbers, that's why they want to divide the number of watermelons in such a way that each of the two parts consists of an odd number of watermelons. However, it is not obligatory that the parts are equal.
Example: the girls can divide a stack of 8 watermelons into 1 + 7 melons, or 3 + 5 melons.
The girls are extremely tired and want to start their meal as soon as possible, that's why you should help them and find out, whether they can divide the fruits in the way they want. For sure, each of them should get a part of positive weight.
Task
Given an integral number(Taken from user) of watermelons w (1≤w≤100; 1 ≤w in Haskell), check whether Jaya and Rekha can divide the melons so that each of them gets an even amount.
Examples of expected output
divide(2) == true // 2 = 1 + 1
divide(3) == false // 3 = 1 + 2
divide(8) == true // 8 = 3 + 5 or 8 = 1+ 7

Please assign me this issue.
Isha Godse

Sanika Chavan
I would like to work on this issue

@sanikachavan18  all the issues labeled easy are only for FY's. You can try the medium and hard level issues


MetadataReportService 使用Class.forName  loadclass

[ ] I have searched the issues of this repository and believe that this is not a duplicate.
[ ] I have checked the FAQ of this repository and believe that this is not a duplicate.

Environment

Dubbo version: xxx
Operating System version: centos 7
Java version: 1.8.0

Steps to reproduce this issue
Class.forName 使用的MetadataReportService 的classloader 来加载interface,
但是这个interface 可能是另外的class loader 加载的，会报找不到class.
2019-08-01 12:15:26,110 ERROR org.apache.dubbo.metadata.integration.MetadataReportService[106] -  [DUBBO] publishProvider getServiceDescriptor error. providerUrl: dubbo://<IP_ADDRESS>:20880/com.wdk.SpiTes?anyhost=true&application=wdk-plugin-engine&dubbo=2.0.2&generic=false&group=dubbo&interface=com.wdk.SpiTes&methods=speak&proxy=jdk&release=2.7.1-SNAPSHOT&revision=1.0.0-SNAPSHOT&side=provider&version=1.0.0.wdk-serverless-bundle.1.0.0, dubbo version: 2.7.1-SNAPSHOT, current host: <IP_ADDRESS>
java.lang.ClassNotFoundException: com.wdk.SpiTes
Pls. provide [GitHub address] to reproduce this issue.
Expected Result
What do you expected from the above steps？
Actual Result
What actually happens?
If there is an exception, please attach the exception trace:
Just put your stack trace here!

I think I will add some code such as Thread.getContextClassLoader to fix this issue.
You should add some code java.lang.Thread#setContextClassLoader.  Please make sure you can do it.

yean , now I had change the code with 2.7.0 source code . use Thread context class loader

yean , now I had change the code with 2.7.0 source code . use Thread context class loader

@fangxiaorui Let me know if you are interested in fixing this particular issue by submitting a pull request.


Will a 'Microsoft 365 Apps for business' license and SCA work with this method?

Apologies if this was answered in a different pull req. I honestly hope I'm just missing something crucial, but I am investigating an ongoing issue with SCA that was previously implemented as "working", though I have found no evidence to that claim. The document here, as of 10/24/2022, states the following for license requirements:

Where I lose the plot is that after assigning a Microsoft 365 Apps for business license

Implementing the Reg_SZ key of 'SharedComputerLicensing' at the location 'HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office\ClickToRun\Configuration', after a fresh install of Office (now M365), and logging in with the credentials of the account with the mentioned license, I receive a message that states the following in some effect:

Note: Removal of the key and a restart of Office has this message not appear, but Shared Licensing is then not enacted (which should not be the case according to the doc). This would seem to indicate that the flag/key is being read, but the licensing is noted of being at issue. If I log in with my E3 enabled license, Shared Activation is shown without problems in the About section of any Office app.
The chief question would be, does the lone license of Microsoft 365 Apps for business work with SCA?
I would really appreciate the clarification/confirmation and thank you for the time in advance.

@MJP-MSFT   Can you help with this?  Thanks.

@Dustrega   Which plan do you have enabled?  Just underneath the content you shared there's a note calling out support for SCA only with Business Premium SKU's
NOTE:
The Microsoft 365 Business Premium plan is the only business plan that includes support for shared computer activation. There are other business plans, such as Microsoft 365 Business Standard, that include Microsoft 365 Apps for business, but, those business plans don't include support for shared computer activation.

@MJP-MSFT When we run into the issue of SCA not being allowed, we are using the Microsoft 365 Apps for business standalone license (not Microsoft 365 Business Premium; picture below).

If my guess is correct, based on your explanation and that of the documentation, only the following work with SCA:
Easily understood:

Office 365 E3 and E5 licensing (tried and tested)
Project Plan 3 or Visio Plan 2

Semi-ambiguous:

The Microsoft 365 Business Premium plan, which includes Microsoft 365 Apps for business. (Does this mean the standalone license is included or excluded; According to the note below the license requirements, it is plain to me that a standalone Microsoft 365 Apps for business license alone will not cut it.)

Will absolutely not work with SCA:

Microsoft 365 Basic or Standard (fairly obvious)
Microsoft 365 Apps for business license (need confirmation/clarification)

I appreciate your diligence and please let me know of any further information required.

@Dustrega
It is my understanding that it is tied to the plan. Even through the Premium plan includes the bits for Microsoft 365 Apps for Business it does not allow the capability of using SCA.  In order to use SCA you would need to move the users over to the premium plan.

@MJP-MSFT - Masterful! Thank you, once again, for all your time and diligence.


Inconsistency between documentation and column validation step

Hi,
So based on the updated ragas documentation, it says that ground_truth is a list[list]. (here).
However, even if I converted the evaluation dataset to use such a key, I got the following error:
ValueError: Dataset feature "ground_truth" should be of type string

I did a bit of investigation, and it seems in the step to validate the types of the columns, ground_truth is added to the same check as question and answer, which are expected to be strings. See image and I also link the code line here.
Therefore, I am a bit confused now. I open a similar issue (#655 ) previously, but I believe I was not clear there.
Am I missing something? 🤔

I am using ragas==0.1.3.
Thanks!!

Hey @lsantosq thanks for sharing this with us. Ground truth in an older version of ragas was list[str] but now we use str. The doc was out of date. Just raised a PR to fix this.

If you think the PR resolves your confusion, feel free to close the issue @lsantosq


Compilation error fix

At the moment, when attempting to compile KTemplate, several errors occur:

Insufficient arguments when calling the array_splice function.
Error in using the constant KPHP_COMPILER_VERSION.

The PR addresses the locations where the errors occurred. Now KTemplate compiles and works without issues.

Could you describe how you tried to run it?
It's supposed to be used along with kphp stubs library that should define KPHP_VERSION constant:
https://github.com/VKCOM/kphp-polyfills/blob/fd09f5532ffa3770a9f458fefe8cdb0729bc1f92/kphp_polyfills.php#L29
The array_splice has default arguments that should be supported by both PHP and KPHP.
https://www.php.net/manual/en/function.array-splice.php

The error with the constant KPHP_COMPILER_VERSION occurs because kphp now works with modulite.
The error message looks like this: [modulite] restricted to use KPHP_COMPILER_VERSION, it does not belong to package #quasilyte/ktemplate
The default value for the parameter length in array_splice was introduced only in PHP8, which is not yet supported by kphp.


Doesn't work when root

Sometimes you have to be root (RunPod, for example). Any sudo calls need to be removed (use a helper). For the install script, maybe add a message like "dotfiles: Don't run as root". Finally, create a lib function to create a new user (with a home folder, without a password, with passwordless sudo).

Closed by 705d737.
Closed by 08f58ec.


[Question] best way to track history of task instances

Dear Airflow Maintainers,
We are migrating our ETL over to Airflow and had a question about tracking the history of task instances.  We log run information in our data for data lineage purposes (audit_id is a tracking column in all of our tables).
A use case would be a task that populates table A with some records.  Say a task instance for simple_dag, populate_A_task, 20160405 runs on 4/6 and populates table A with some records with an audit id of 123.  On 4/7 we notice a bug, modify populate_A_task and then clear simple_dag, populate_A_task, 20160405 for a rerun.  The rerun fails and does not change the data in the table.  The audit id of the data is still 123 and should still refer to that first successful attempt that populated the table.
We first thought of using the task instance key for the audit_id, but this does not track which attempt of the task instance populated the data - it only tracks the latest attempt of the task instance.  In the use case above the task instance key is tied to the latest task instance attempt (the failed rerun) instead of the previous succeeded attempt.
(I should also note that task_instance_key_str is said to be unique in the documentation - though it is not since it truncates the execution date to the day.  Two externally triggered dag runs with user chosen run ids can generate two different task instances with the same task_instance_key_str.
example:
airflow trigger_dag -r test_0 basic_flow
airflow trigger_dag -r test_1 basic_flow)
We then thought to use the job_id - but the job table does not include task instance information and in the use case above there is no record in task instance to tie back to the successful job since that was not the latest attempt.
We'd like to keep a TaskInstanceHistory which tracks all attempted runs of TaskInstances and were wondering if you had any thoughts on the best way to do this?
thanks much,
Jennie

@jenelecc can you create a Jira for this and also have a look at AIRFLOW-20? There is some lineage in there and we can use multiple opinions on it. Thanks!


Fix escapce character catch in TCPGet + support 0x?? sequences

Coverage decreased (-0.1%) to 88.186% when pulling 1541e382e490b21406317fc9bacce70e7b3ce60b on natcl:master into 1d9488d24f106092b5d0d5ab5f800c01ad2b08d1 on node-red:master.

Thanks !


Full installation guide

If any of you have the full guide of magoware installation....  It would be great to share it here!!!

Hello @aprokopas
https://magoware.freshdesk.com/a/solutions/articles/35000124356
Here you can find a step by step guide for the installation
Regards


Update database software requirement

Added known postgres limitation

Can we add a note about MySQL limitations as well?

@lindy65 Good idea, yes, indicating that postgres should be an enterprise feature so it does not come as a surprise to those who are looking to enable it.

@lfbrock I don't know what the MySQL limitations are. Feel free to update, or let me know and I can make the update.  Same with updating the additional postrgres limitation on dashes

@james-mm we have some notes from the search doc that might be helpful:
https://docs.mattermost.com/help/getting-started/searching.html?highlight=searching#technical-notes

Updates done

Update done per @esethna 's proposed changes


Figure out how to install Elastic APM on Wildfly

I have a Wildfly application server 26.1.3 and I want to use Elastic APM to collect data.

The first step is to install Wildfly application server. I'll use my tiny old Intel NUC running Ubuntu 20.04.6 LTS, but I think the OS doesn't matter that much from the APM perspective.

I'll use the following guide: https://linux.how2shout.com/install-wildfly-application-server-on-ubuntu-20-04-22-04-lts/

Pick a Wildfly release version:
export WILDFLY_RELEASE="26.1.3.Final"

Install OpenJDK 11
sudo apt install default-jdk

$ java -version
openjdk version "<IP_ADDRESS>" 2023-08-24
OpenJDK Runtime Environment (build <IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04)
OpenJDK 64-Bit Server VM (build <IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04, mixed mode, sharing)

Download Wildfly:
wget https://github.com/wildfly/wildfly/releases/download/${WILDFLY_RELEASE}/wildfly-${WILDFLY_RELEASE}.tar.gz

The tarball size is 207M.
Extract the Tar file and move it to the target dir:
tar -xf wildfly-*.Final.tar.gz

sudo mv wildfly-*Final /opt/wildfly

Created a dedicated WildFly user:
sudo groupadd -r wildfly

sudo useradd -r -g wildfly -d /opt/wildfly -s /sbin/nologin wildfly

Ownership:
sudo chown -RH wildfly:wildfly /opt/wildfly

Configure:
sudo mkdir -p /etc/wildfly

sudo cp /opt/wildfly/docs/contrib/scripts/systemd/wildfly.conf /etc/wildfly/

sudo cp /opt/wildfly/docs/contrib/scripts/systemd/wildfly.service /etc/systemd/system/

sudo cp /opt/wildfly/docs/contrib/scripts/systemd/launch.sh /opt/wildfly/bin/

Make the script executable:
sudo chmod +x /opt/wildfly/bin/*.sh

Start and Enable the Service:
sudo systemctl enable --now wildfly

sudo systemctl daemon-reload

systemctl status wildfly

Create WildFly Management Console and Application user:
sh /opt/wildfly/bin/add-user.sh

Access WildFly Remotely:
# replace <IP_ADDRESS> with <IP_ADDRESS> in the following file (this is for testing only, no security concerns here, but don't to in production environments):
sudo vi /opt/wildfly/standalone/configuration/standalone.xml


match rdf type iri

Find a clean way to match any rdf type IRI.
Example:  http://www.w3.org/1999/02/22-rdf-syntax-ns#type and http://www.w3.org/2000/01/rdf-schema#type should both be valid IRIs for type.

Issue solved: http://www.w3.org/1999/02/22-rdf-syntax-ns#type  is the official and only IRI that should be used


Add default end date/time for events with no end time or duration

Hey! Looking to fix #257.
Before this change, some events would be parsed and result in a ValueError. According to RFC 5545 section 3.6.1, there are default behaviors to be assumed in these cases - namely that events with a starting date should assume the event is one full day, while events with a starting time and date should assume zero duration.
Please let me know if there's any style conventions or test conventions to fix, I'm no Python expert.

Looks great overall, thank you for the fix and I see where this was missed from the rfc.
Would you also be up for adding an ICS file in tests/testdata and verifying test_calendar_stream.py? You can refresh the snapshots with py.test tests/test_calendar_stream.py --snapshot-update. The unit tests are great, though i also like building up the collection of ics files to test with as part of fixing the bugs, and this will also show that the behavior when serializing the content back out to disk (your change doesn't explicitly set an end field the ics content, which seems like the right behavior)

I gave you the wrong instructions here. I thought I had upgraded this library to use syrup snapshots, but i got it mixed up with another library. It's --update-goldens

Looks great overall, thank you for the fix and I see where this was missed from the rfc.
Would you also be up for adding an ICS file in tests/testdata and verifying test_calendar_stream.py? You can refresh the snapshots with py.test tests/test_calendar_stream.py --snapshot-update. The unit tests are great, though i also like building up the collection of ics files to test with as part of fixing the bugs, and this will also show that the behavior when serializing the content back out to disk (your change doesn't explicitly set an end field the ics content, which seems like the right behavior)

I gave you the wrong instructions here. I thought I had upgraded this library to use syrup snapshots, but i got it mixed up with another library. It's --update-goldens

Actually -- we already have an example test file that does not have a duration, however the existing tests don't catch this. In I  https://github.com/allenporter/ical/pull/259 i just added a test that coincidentally failed due to the error that you are fixing here, but i had to exclude it since your fix is not in yet. If you sync to head and remove the guard for rrule-yearly.yaml that I just added we should be good to go without you need to add another example ics file.

Thanks for the quick feedback. Just pushed those changes.

Some of the tests are failing because ical is not preserving the extended attributes (not really supported yet) and some other sort orders change. You can either remove that yaml test (given we have another test covering some cases), remove the attributes, or add to the yaml (like some other tests have) where it has a different ordering for the serialized output.

I'll drop them for now since we already have the other test. :)


Urr Recv: Timeout value

https://github.com/ultimatepp/ultimatepp/blob/3260799d6efbfe835ee4d447a06881b849aaa205/bazaar/Urr/Urr.cpp#L14-L15
It seems that timeout value can be Upp:Null. But if this is not intended to represent "blocking" behavior (ln:18 seems to suggests that it is not), then it should be as follows:
int t = Nvl(timeout, 0);
time_out.tv_sec = t / 1000;
time_out.tv_usec = t % 1000 * 1000;

Ok this was false alarm, sorry. select() isn't called on timeout = Null value.
Closing the issue.


CLI command to rebuild Sarif "TODO list" based on @rehearsal comments in the file.

As we already know there is an issue with line numbers in a Sarif report.
But even if lines are correct in the Sarif they can become invalid once an engineer fixes the error and will remove the @ts-expect-error comment or just modify the code manually.
The idea is to create a tool to quickly refresh (not rebuild with re-running compilation) "TODO" errors in the report and update lines for the rest, during the time an engineer works on @ts-expect-error cleaning.
--
We can create CLI commands to rebuild the Sarif report (or its TODO part) based on all @rehearsal comments in all projects or in a particular file.
The command has to search for @rehearsal in the comments and updated the Sarif file with actual comments and line numbers.
We can also build this as an IDE plugin to rebuild Sarif once a file is modified.

See #438

Closing this as duplicate to. This issue is linked.


TWP-22 metrics prometheus client endpoint

Codecov Report

Merging #64 (175003f) into master (c04136a) will decrease coverage by 0.00%.
The diff coverage is 85.00%.

@@            Coverage Diff             @@
##           master      #64      +/-   ##
==========================================
- Coverage   84.25%   84.25%   -0.01%
==========================================
  Files          66       67       +1
  Lines        4325     4362      +37
==========================================
+ Hits         3644     3675      +31
- Misses        681      687       +6

Flag
Coverage Δ

unittests
84.25% <85.00%> (-0.01%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

base/signals.py
97.82% <ø> (ø)

rest_api/permissions.py
73.33% <57.14%> (-15.56%)
:arrow_down:

rest_api/views.py
67.74% <71.42%> (-0.05%)
:arrow_down:

tribal_wars_planer/middlewares.py
95.83% <95.83%> (ø)

base/forms.py
100.00% <100.00%> (ø)

tribal_wars_planer/settings.py
98.24% <100.00%> (+0.03%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c04136a...175003f. Read the comment docs.


💄 Add splash animation within web index file

Is this something we're interested in? Any concerns or improvements? we could support more themes if needed!
https://github.com/user-attachments/assets/d90c7fa3-8044-444b-8386-7e67652e314a

I actually think that rocks!


React project

The Cryptocurrency website is built using React, Redux, CoinStats APIs, and it allows you to:

See list of 100 crypto currencies.
Check latest information of the currencies.

Built With

HTML
CSS
JavaScript
iconscouts
Gitflow
React
Redux
CoinStats APIs

Status: Invalid 🔴
Hi @ 🙋♀,
While you made a great effort in this project, unfortunately, I cannot proceed to review your code.
Invalid Code Review Request
You have submitted a project, that is failing to compile and Therefore I cannot run your application.

Also please update your README using the new Microverse template.

Your Code Review Request will be marked as invalid in your Dashboard, so please submit a new one once you are ready 🙏
Cheers 🥂  and Happy coding!!! 👯
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Remember to tag me @KDlamini  in your question so I can receive the notification.
Please, do not open a new Pull Request for re-reviews. You should use the same Pull Request submitted for the first review, either valid or invalid unless it is requested otherwise.

Invalid Code Review Request does not count into the code reviews limit.


New Stock 💹🧦 Dehradun Call Girls 📿🏺🚬ಡ7O7^88 ͜ ʖ92^601  ಡ 📿🏺🚬Admiring Call Girls Dehradun

🗞📩⁙⁑⁙◕ᴗ7O788༒926OI ⁙⁑⁙(M.A.Y.A) Dehradun Call Girls Phone No ༒☄🟰Elite Dehradun Escort Service #26957 #26960 #26961
New Stock 💹🧦 Dehradun Call Girls 📿🏺🚬ಡ7O7^88 ͜ ʖ92^601  ಡ 📿🏺🚬Admiring Call Girls Dehradun  only for you call girls in Dehradun

Russian Escorts In Dehradun without a worry @ Maya 📞 93I579IO9O Dehradun Call Girls Agency


Request for Access to test-scaleway-x64-ubuntu-16.04-1

The test-scaleway-x64-ubuntu-16.04-1 machine is full and needs cleaned up.  Either someone with access needs to clean it, or I can if I have temp access.
Since we started running system tests, it seems this machine is full, we should follow-up and make sure we are cleaning the workspace properly after the system test runs.

closing as access should already be in place for the jenkins user

Cleaned up  16G  free


[Feature][DataSource] Query all data source columns, modify the query list interface

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Problem Description
Query all data source columns, modify the query list interface
/solidui/datasource/info   according to the reverse query of dataSourceTypeId in the list, dataSourceTypeName is displayed
Description
No response
Use case
No response
Solutions
No response
Anything else
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

I want to address this issue.


Adapters should be passed config-in-effect, not config-as-set

Currently, with configuring gzip extensions, both ember-deploy and (in my case) ember-deploy-azure have to check config.assets.gzipExtensions ? config.assets.gzipExtensions : ['js', 'css', 'svg'].
It would be much cleaner and less prone to error (e.g. for when ember-deploy changes something in its default settings and an old ember-deploy-addon is not updated) to have ember-deploy augment the configuration file with default settings and passing that on to underlying deploy-addons. Possibly ideally in the configuration reader.
As I don't have a clear picture of which implications it has for existing infrastructure, just thought I'd open an issue to get some feedback first.

yeah. the config object (i.e.) configuration reader should be responsible to know of the sane defaults. totally agree on that.

Approach
Here's a rough idea of what could happen to the configuration-reader to default the values.  This is simplistic, but I wanted to further the discussion on how this should look:
var path       = require('path');

// Set a value on the object if it is not already set.
// => Will not override any configuration values from deploy.json, but will set them if they are not present.
// => Code reference: http://stackoverflow.com/questions/13719593/how-to-set-object-property-of-object-property-of-given-its-string-name-in-ja
var defaultValue = function(obj, prop, value) {
    if (typeof prop === "string")
        prop = prop.split(".");

    if (prop.length > 1) {
        var e = prop.shift();
        defaultValue(obj[e] =
                 Object.prototype.toString.call(obj[e]) === "[object Object]"
                 ? obj[e]
                 : {},
               prop,
               value);
    } else
      prop = prop[0];
      if (typeof obj[prop] === 'undefined')
        obj[prop] = value;
}

function ConfigurationReader(options) {
  var envConfig, root = process.cwd();

  this._options      = options || {};
  this._environment  = this._options.environment || 'development';
  this._deployConfig = this._options.configFile || 'deploy.json';
  this._config       = require(path.join(root, this._deployConfig));
  this._envConfig    = this._config[this._environment];

  defaultValue(this._envConfig,'assets.type','s3');
  defaultValue(this._envConfig,'assets.gzip',true);
  defaultValue(this._envConfig,'assets.gzipExtensions',['js', 'css', 'svg']);
  defaultValue(this._envConfig,'store.type','redis');
  defaultValue(this._envConfig,'buildEnv','production');

  this.store    = this._envConfig.store;
  this.assets   = this._envConfig.assets;
  this.buildEnv = this._envConfig.buildEnv;
}

module.exports = ConfigurationReader;

gist
Notes
This will break two of the tests that are expecting the configuration to not have certain keys, as they are set via an 'or' instead of in the configuration-reader.  If the approach we take is something like the above, the test version of deploy.json will need to be updated to include the newly present keys.
We could theoretically make this a CoreObject extension, but I'm not sure if that provides any additional benefits at this point.
Moving Forward
@duizendnegen, @LevelbossMike -- any feedback on this approach?  If we can come up with how we want it to be handled, I can write it and fix the tests, remove defaulting in adapters, etc.

That would probably be the best approach - as I see it now also with the least effort & best future possibilities to extend upon.

@duizendnegen please take a look at #37 -- I think it tackles most of what you proposed here, albeit a little differently. Would love to hear your thoughts.

I have just merged #37. I think this fixes the issue and does this in a clean way.

#37 is great - glad to see we got something merged in!


Form post cube animation

Hi,
I'd like to have a simple slide effect on post submit. Using the main demo when I submit a post ajax request I get a cube animation. Can I change it?
Thanks

Recently fixed.


template not found: goodwe-wifi

I think the problem is caused because the template is new in the evcc.
Can you please import it to hassio-addon.
Thanks

Seems like this is not related to the add-on but maybe to the main project https://github.com/evcc-io/evcc.


Change 'meet the Team' into 'Team'

Description
Clearly and concisely explain the problem.
You can mention unclear or missing information, typos, grammatical mistakes, etc.
Any contributions and suggestions are welcome!
Let's make it shorter. We save space in the bar which helps in smaller viewports. It was something that I wanted to do but as long as development went on I forgot about this.
Website Section URL
Website live preview, paste the page URL or section name (eg. Docs, if it happens on all docs page) below.

See https://github.com/dreamonkey/quasar/issues/83
Scott

Fixed in b0f53cc590ec12b39da08c4c776010207aaf6dff


Optimize retrieving Domain instance attributes

Reduce array allocations by replacing identical calls to [@trd, @sld, @tld] with instance method.
Memoize methods to ensure computation once per PublicSuffix::Domain instance

Profiler script
The following script can be used to compare allocations from current master and this pull request.
# frozen_string_literal: true

$LOAD_PATH.unshift File.expand_path("../../lib", __dir__)

require "memory_profiler"
require "public_suffix"

PublicSuffix::List.default

report = MemoryProfiler.report do
  domain = PublicSuffix::Domain.new("com", "example", "wwww")
  1000.times do
    domain.to_s
    domain.domain
    domain.subdomain
  end
end

report.pretty_print

@ashmaroli can you explain the use case?
I honestly don't expect those accessor to be a problem in most consumers. If you need specific performances, you likely want to get the data out of the lib and into a custom data struct tailored to your needs.

The use-case is hypothetical. I just came across the code smell and thought I'd propose a fix.

Thanks. I'll close this changeset, it introduces complexity without a real benefit.

At minimum however, I'd recommend replacing duplicate [@trd, @sld, @tld] with calls to #to_a

I'm fine to use to_a in def name, I'd rather keep domain and subdomain alike.


[BUG] syzbotCrawler is unable to correctly parse the syzbot fixed pages and causes AttributeError

Hi, I am using Syzscope from the ready2go docker and got the following Error:
root@ea0c0bd44dff:~/SyzScope# python3 syzscope -k="INFO:" -RP -KF --timeout-kernel-fuzzing 3 -SA --timeout-static-analysis 3600 -pm 8 --debug
[+] Building image
[+] Building gcc and clang
[+] Building llvm
[+] Build static analysis tool
[+] Download pwndbg
[+] Setup golang environment
[+] Setup syzkaller
[+] Clean unfinished jobs
rm: cannot remove 'linux-*/.git/index.lock': No such file or directory
Removing index.lock
rm: cannot remove 'linux-*/THIS_KERNEL_IS_BEING_USED': No such file or directory
All set
[*] hash: None
[*] url: https://syzkaller.appspot.com/upstream/fixed
[*] max: 9999
[*] key: ['INFO:']
[*] deduplicate: []
[*] alert: ['']
root : root kvm
KVM is ready to go
debug mode runs on single thread
INFO    | 2023-03-22 07:16:27,727 | syzscope.modules.syzbotCrawler | Get table from https://syzkaller.appspot.com/upstream/fixed
DEBUG   | 2023-03-22 07:16:42,409 | syzscope.modules.syzbotCrawler | [0] Find a suitable case:
INFO: rcu detected stall in ext4_file_write_iter (6)
ext4

Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "syzscope/__main__.py", line 316, in <module>
    crawler.run()
  File "/root/SyzScope/syzscope/modules/syzbotCrawler.py", line 68, in run
    cases_hash, high_risk_impacts = self.gather_cases()
  File "/root/SyzScope/syzscope/modules/syzbotCrawler.py", line 195, in gather_cases
    href = title.next.attrs['href']
  File "/usr/local/lib/python3.6/dist-packages/bs4/element.py", line 742, in __getattr__
    self.__class__.__name__, attr))
AttributeError: 'NavigableString' object has no attribute 'attrs'

Test envrironment: etenal/syzscope:ready2go with git pull
Test command: python3 syzscope -k="WARNING" -k="INFO:" -RP -KF --timeout-kernel-fuzzing 3 -SA --timeout-static-analysis 3600 -pm 8 --debug

(Note that, the simpler command: python3 syzscope -k="INFO:" has the same error as well)

I briefly analyze the error trace and the syzbot page printed by debug mode. I think maybe the code href = title.next.attrs['href'] in syzbotCrawler.py:195 no longer fits the current format of the syzbot pages. Not sure about this, I guess there may be some compatibility issues in other format parsers which are hard-encoded in the crawler.

Fixed in the latest commit.


Remove React markdown div wrapper.

We can use fragments instead.

Thanks for sending a PR! This will be a breaking change (The root div is intended to provide a single root consistently)
Is there any problem in your end by having <div>?

The div interferes with child selectors. Is there currently a way to set className for the div?

I'd love to hear more!

The div interferes with child selectors

could you elaborate the actual troublesome situation for instance?

Is there currently a way to set className for the div?

no, but this approach should be appropriate, rather than getting rid of the root I think atm.

.markdown > p {
  /* ... */
}

This rule does not work because there is a div wrapping the markdown. The div would have to be removed, given the markdown class, or the rule edited. I figured removing it was the easiest option, but I wasn't aware this would break anything. Some way to add classes would be good, but what breaks as a result of using fragments? Is there something I can fix?

In that case, I think there are many workarounds (e.g. don't use > and scope the selector).
The change is just a "breaking change" as an npm module. If any implementation which uses this lib and expects div is a root element, may get unintentional breaking. this sounds really conservative for you since It's should not be a serious problem but I'd like to consider more about use-cases before making a "major" version update.
I appreciate your PR and feedback definitely. And mostly leaning toward getting rid of the div 😉


weibo_data 表中爬取不到数据

系统Ubuntu 16.04, 项目使用1.7.2.
运行celery -A tasks.workers -Q login_queue,user_crawler,fans_followers,search_crawler,home_crawler worker -l info -c 1 后可以看到在爬取。显示信息如下：
[2018-07-13 09:48:01,247: INFO/MainProcess] Connected to redis://:**@<IP_ADDRESS>:6379/5
[2018-07-13 09:48:01,260: INFO/MainProcess] mingle: searching for neighbors
[2018-07-13 09:48:02,288: INFO/MainProcess] mingle: all alone
[2018-07-13 09:48:02,458: INFO/MainProcess] Received task: tasks.user.crawl_person_infos[2caeeb1e-768b-4028-8e20-b9bff1deefc7]
[2018-07-13 09:48:02,464: INFO/MainProcess] Received task: tasks.user.crawl_follower_fans[b08c0c70-3817-4fa1-8bbd-19de4924f3ba]
[2018-07-13 09:48:02,470: INFO/MainProcess] Received task: tasks.login.login_task[e28ae926-261b-4839-9a1f-adfd8960a453]
[2018-07-13 09:48:02,477: INFO/MainProcess] Received task: tasks.user.crawl_person_infos[2ca25e57-8734-4133-b5ba-13349b683b60]
[2018-07-13 09:48:02,480: INFO/MainProcess] Received task: tasks.user.crawl_follower_fans[e2783e3d-7018-4b4f-8f33-2337ba11b38f]
2018-07-13 09:48:02 - crawler - INFO - the crawling url is http://weibo.com/p/1005051718704174/info?mod=pedit_more
[2018-07-13 09:48:02,515: INFO/ForkPoolWorker-1] the crawling url is http://weibo.com/p/1005051718704174/info?mod=pedit_more
[2018-07-13 09:48:03,173: WARNING/ForkPoolWorker-1] /home/zcao/.local/lib/python3.5/site-packages/requests/packages/urllib3/connectionpool.py:852: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecureRequestWarning)
查看seed_ids 表中，发现添加了很多要爬取的id。但检查weibo_data 表并无任何数据，是空表。
mysql 版本是 mysql  Ver 14.14 Distrib 5.7.22
SQLAchemy 已按你的建议改成 1.1.15.
celery 的版本我改成了4.1.1，最初requirements.txt中celery 是4.1.0. 此时会有Celery AttributeError: async error 的报错，网上查询建议升级版本，升级到4.1.1后可以使用。
可否帮我查看下原因，不胜感激。

１.抓一下包吧，看看响应是啥。
2.如果响应没问题，在数据插入之前，打印一下数据是否正常解析出来了。

在执行celery -A tasks.workers -Q login_queue,user_crawler,fans_followers,search_crawler,home_crawler worker -l info -c 1 后应该只会显示到
......
......
task.user.excute_user_task 吧？
应该是在运行 “celery beat -A tasks.workers -l info”后显示登录信息 以及开始爬取数据。（这是我再另一台服务器配置正常使用的情况）
但现在是执行celery -A tasks.workers -Q login_queue,user_crawler,fans_followers,search_crawler,home_crawler worker -l info -c 1后就开始显示
[2018-07-13 09:48:01,247: INFO/MainProcess] Connected to redis://:**@<IP_ADDRESS>:6379/5
[2018-07-13 09:48:01,260: INFO/MainProcess] mingle: searching for neighbors
[2018-07-13 09:48:02,288: INFO/MainProcess] mingle: all alone
[2018-07-13 09:48:02,458: INFO/MainProcess] Received task: tasks.user.crawl_person_infos[2caeeb1e-768b-4028-8e20-b9bff1deefc7]
[2018-07-13 09:48:02,464: INFO/MainProcess] Received task: tasks.user.crawl_follower_fans[b08c0c70-3817-4fa1-8bbd-19de4924f3ba]
[2018-07-13 09:48:02,470: INFO/MainProcess] Received task: tasks.login.login_task[e28ae926-261b-4839-9a1f-adfd8960a453]
[2018-07-13 09:48:02,477: INFO/MainProcess] Received task: tasks.user.crawl_person_infos[2ca25e57-8734-4133-b5ba-13349b683b60]
[2018-07-13 09:48:02,480: INFO/MainProcess] Received task: tasks.user.crawl_follower_fans[e2783e3d-7018-4b4f-8f33-2337ba11b38f]
2018-07-13 09:48:02 - crawler - INFO - the crawling url is http://weibo.com/p/1005051718704174/info?mod=pedit_more
[2018-07-13 09:48:02,515: INFO/ForkPoolWorker-1] the crawling url is http://weibo.com/p/1005051718704174/info?mod=pedit_more
[2018-07-13 09:48:03,173: WARNING/ForkPoolWorker-1] /home/zcao/.local/lib/python3.5/site-packages/requests/packages/urllib3/connectionpool.py:852: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecureRequestWarning)
。然后ctrl +C 把启动worker 和启动celery beater 的命令取消。再次执行
celery -A tasks.workers -Q login_queue,user_crawler,fans_followers,search_crawler,home_crawler worker -l info -c 1 后显示：
“. tasks.comment.crawl_comment_by_page
. tasks.comment.crawl_comment_page
. tasks.comment.excute_comment_task
. tasks.home.crawl_ajax_page
. tasks.home.crawl_weibo_datas
. tasks.home.excute_home_task
. tasks.login.excute_login_task
. tasks.login.login_task
. tasks.repost.crawl_repost_by_page
. tasks.repost.crawl_repost_page
. tasks.repost.excute_repost_task
. tasks.search.excute_search_task
. tasks.search.search_keyword
. tasks.user.crawl_follower_fans
. tasks.user.crawl_person_infos
. tasks.user.excute_user_task
[2018-07-13 14:35:20,890: ERROR/MainProcess] consumer: Cannot connect to redis://:**@<IP_ADDRESS>:6379/5: MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error..
Will retry using next failover.
[2018-07-13 14:35:20,900: ERROR/MainProcess] consumer: Cannot connect to redis://:**@<IP_ADDRESS>:6379/6: MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error..
Trying again in 2.00 seconds...
[2018-07-13 14:35:22,933: ERROR/MainProcess] consumer: Cannot connect to redis://:**@<IP_ADDRESS>:6379/5: MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error..
Will retry using next failover.”
抓包是用wireshark抓包吗？没太懂1.  数据插入在哪里检查? 谢谢。

你这不是连Redis都没连上吗？？？？？去仔细看看配置文件把，这种问题文档都写清楚了


[0.8.x] fxmaster scene controls are overridden

Due to how scene controls work on Foundry 0.8.x, the change I made apparently breaks the fxmaster scene controls.
https://github.com/wrycu/StarWarsFFG-Enhancements/blob/a785ff8c1fc4e31ac2d846b27dd9e67e403f3573/ffg-star-wars-enhancements.js#L118

Fixed; will be released in 0.2.1.


Remove obsolete KCP installation

Description
Changes proposed in this pull request:

remove installation directory,
remove installation section from readme,
remove kcp-installer tool.

Related issue(s)

Resolves #2693

/test all


PopUp not open in the appwindow in UWP

Describe the bug
I have updated the uwp build version 19401 and I have a button in the window and by click i have opened new appwindow. Now i have another button in the AppWindow to open the popup. Here comes the issue.
PopUp opens in the primary window and it not shown on the secondary window. Please refer the below gif
Note :
This issue do not occurs when opened in the normal window. And this issue occurs only in the AppWindow
Steps to reproduce the bug
Steps to reproduce the behavior:

Run the sample
Click the OpenNewWindow Button
New window opens and click the button open the popup.

Observed behavior
Popup opens in the primary window.
Expected behavior
Popup Should open in the window where the button to show popup is clicked.
Screenshots

Version Info

VS Version:

OS Version

Uwp Target Version

Windows app type:
This issue occurs in the UWP platforms.
Sample :
UwpAppWindowSample.zip

@sampathnarine what version of winui are you using for this?

Hi @StephenLPeters ,
This issue occurs in the normal uwp project and not in the win ui version. Please refer the below version of Uwp project.

@codendone and @kmelmon fyi

The Popup needs to know which XamlRoot it being shown for. Try adding this line before opening the popup:
   mypop.XamlRoot = this.XamlRoot;

Hi @codendone,
Thanks for the replay.
I have tried out your solution and it works fine for one case. But for another case it is not fixed. Please find case below.
I have created the custom Contentcontrol(PopupHostExt). I have customized the control by loading the popup. I have shown the PopupHostExt when the button is clicked. Now the same issue occurs. The popup shown in the primary window. I have tried out by setting xamlroot to the popup but it not works. Please find the below gif for the replication. I have also attached the sample here. Please help me to sort out this issue.

Sample :
Sample.zip
Regards,
Sampath Narayanan.S

The problem is that the popup is being opened before it is added to the tree, so it can't lookup the right XamlRoot. This happens because while applying the style template the IsOpen binding already evaluates as True, so the popup immediately opens even though its remaining markup properties (IsLightDismissEnabled="True" in this sample) haven't yet been set and the popup hasn't been added to its parent element. We could consider delaying the IsOpen action, and there is another issue discussing that potential change for WinUI3.
The solution is to ensure the template is applied prior to having IsOpen bind to True. You could do that by having the template be there well in advance, or delay setting the binding until after the template has been applied, or just force creating the template:
    popUpHostExt.ApplyTemplate();

Note that the two-way binding to old PopUpHostExt objects in the sample makes the button only work once. Avoiding recreating at the start of the function is one possible solution, so this version combines both fixes to get a good result:
        private void Open_Click(object sender, RoutedEventArgs e)
        {
            if (this.PopUpPresenter.Child != null)
                return;

            popUpHostExt = new PopUpHostExt();
            this.PopUpPresenter.Child = popUpHostExt;
            Windows.UI.Xaml.Data.Binding binding = new Windows.UI.Xaml.Data.Binding
            {
                Source = OpenButton,
                Path = new PropertyPath("IsChecked"),
                Mode = BindingMode.TwoWay
            };
            popUpHostExt.ApplyTemplate();
            popUpHostExt.SetBinding(PopUpHostExt.IsOpenProperty, binding);
        }

Hi @codendone,
The provided solution works fine for me. Thanks for your update.
Regards,
Sampath Narayanan.S

I'm glad that's working for you. I'm closing this issue since this has been solved.


Show when was the last database update

0/,
today I was marking some cameras, but I noticed that there was not any of my yesterday marks,
I don't know if this is a bug, or if the local db was not updated. I think you can show in options when was the last update.

That's very odd. Cameras are only removed under very specific circumstances, and I didn't modify the database on the server side.
Do your cameras show up if you restart the app?
We only store the date cameras were added to the nearest half-day, to make tracking our users harder. So we could add when the database was last updated, but it won't be very accurate.

I think I misunderstood what you were asking for before. Displaying when the mobile app last refreshed its data should be trivial. We could add an option to display it in the status bar at the top of the screen, or could display the last database update on the 'help' page. We probably can't put it in the options screen because iOS limits how we can interact with that screen.
This is a client-only change, and looks like:

Keep a static status variable tracking "last database update" on the client
Display this information somewhere (probably the help screen, so it's out of the way), IFF we have loaded any data from the server

Let's make this change for v1.4, since it's so small and could be helpful.


Thank you for your contribution

It's perfect.
The performance is also outstanding and perfectly matches DOTS.
NativeOctree Constructor bounds argument It doesn't seem to work.
It also has no ability to delete or update points or AABB locations
Otherwise I have to keep clearing it
Thank you

Can you clarify about the bounds not working?
And yes, there is no update by design. You have to clear and rebuild the tree. But it can be done quite fast in most cases.

Closing this issue for now


Replicating Nanobody 7F5H

I'm using the Colab notebook to find the prediction for RCSB PDB 7F5H (https://www.rcsb.org/structure/7F5H). The RCSB website says that the FASTA file is:
>7F5H_1|Chains A, B|SARS-CoV-2 Spike Receptor-Binding Domain (RBD)|Severe acute respiratory syndrome coronavirus 2 (2697049)
AGSPNITNLCPFGEVFNATRFASVYAWNRKRISNCVADYSVLYNSASFSTFKCYGVSPTKLNDLCFTNVYADSFVIRGDEVRQIAPGQTGKIADYNYKLPDDFTGCVIAWNSNNLDSKVGGNYNYLYRLFRKSNLKPFERDISTEIYQAGSTPCNGVEGFNCYFPLQSYGFQPTNGVGYQPYRVVVLSFELLHAPATVCGPKKSTGTLEVLFQ
>7F5H_2|Chains C, D|Nanobody DL28|Vicugna pacos (30538)
GSSSQVQLQESGGGLVQAGGSLRLSCAASGSDFSSSTMGWYRQAPGKQREFVAISSEGSTSYAGSVKGRFTISRDNAKNTVYLQMNSLEPEDTAVYYCNVVDRWYDYWGQGTQVTVSAGRAGEQKLISEEDLNSAVDHHHHHH

I tried using that as sequence_1 and sequence_2 in the Colab notebook.
When I review the output in pyMol, it appears that is correctly predicts only part of the nanobody structure. I admit that I haven't done this before so it's entirely possible that I am doing something wrong.
What I would like to do is to take experimentally confirmed 3D PDBs from RCSB nanobodies and use TMScore to compare the prediction with the experimental structure.
Could you give me an idea of how to do this?

In the figure above the "green" is the whole nanobody and the "cyan" is the prediction. The prediction looks pretty close, but it only covers part of the nanobody structure.

Hi Tony,
Thanks for your interest in NanobodyBuilder2!!
NanobodyBuilder2 is a nanobody specific structure predictor. In the FASTA you have provided there is a nanobody and another protein (Covid RBD). As NanobodyBuilder2 only models nanobodies, it will ignore all other proteins and only model the nanobody. It also will only model one nanobody at a time.
If you do want a model for the nanobody bound to the antigen you will need to use some other methods. As far as I am aware, currently available tools are not very successful at modelling nanobody-antigen complexes. Your best chance is probably AlphaFold-Multimer or to model them separately and then dock them.
I hope this makes sense.
All the best,
Brennan

@brennanaba
I was running another nanobody prediction and am seeing something similar but this time it's definitely missing part of the nanobody.

Heavy chain is:
H: QVQLQQSGAEVKKPGSSVKVSCKASGGTFSSYTISWVRQAPGQGLEWMGGITPILGIANYAQKFQGRVTITTDESTSTAYMELSSLRSEDTAVYYCARDTVMGGMDVWGQGTTVTVSSASTKGPSVFPLAPSSKSTSGGTSALGCLVKDYFPEPVTVSWNSGALTSGVHTFPAVLQSSGLYSLSSVVTVPSSSLGTQTYICNVNHKPSNTKVDKKVEPKSCDKTSPLFVHHHHHHGDYKDDDDKG
Running sequence through deep learning model...
Nanobody modelled succesfully, starting refinement.
Refinement finished. Saving final structure to NanoBodyBuilder2_output.pdb

If I pull up NanoBodyBuilder2_output.pdb into pyMol I only see the first part of the sequence:
QVQLQQSGAEVKKPGSSVKVSCKASGGTFSSYTISWVRQAPGQGLEWMGGITPILGIANYAQKFQGRVTITTDESTSTAYMELSSLRSEDTAVYYCARDTVMGGMDVWGQGTTVTVSS

So it is showing only the bold in the PDB file:
QVQLQQSGAEVKKPGSSVKVSCKASGGTFSSYTISWVRQAPGQGLEWMGGITPILGIANYAQKFQGRVTITTDESTSTAYMELSSLRSEDTAVYYCARDTVMGGMDVWGQGTTVTVSSASTKGPSVFPLAPSSKSTSGGTSALGCLVKDYFPEPVTVSWNSGALTSGVHTFPAVLQSSGLYSLSSVVTVPSSSLGTQTYICNVNHKPSNTKVDKKVEPKSCDKTSPLFVHHHHHHGDYKDDDDKG
The command-line output shows that it is reading everything, but the pyMol structure is just part of the sequence.
Am I doing something wrong?
Thanks in advance.
-Tony

Hi Tony,
The PDB entry 2G75 contains the structure of two antibody Fabs. The Fab in antibodies is built from two constant and two variable domains (one of each for the heavy chain and one of each for the light chain). Nanobodies have a similar sequence and global structure to the variable domain of the heavy chain. The sequence you are feeding into NanobodyBuilder2 contains both the constant and variable domains of the heavy chain. NanobodyBuilder2 therefore truncates the sequence using ANARCI to just the variable domain before feeding it into the deep learning model.
I agree it is a bit confusing that it prints the whole sequence before truncating, I may try and fix this in the future.
I hope that helps and all the best,
Brennan

Thanks so much for the explanation. That makes sense.
What I am working on at present is to run NanobodyBuilder against a list of nanobody PDBs from RCSB and then use TMScore/TMAlign to get a measure of the accuracy of the prediction.
Is there a way that I can use ANARCI (or something different) to extract the part of the PDB file with just the variable region that is being predicted by NanoBodyBuilder?

Hi Tony,
Yes, you can use ANARCI for that. Here is an example of how you could do so.
from anarci import number

seq = """QVQLQQSGAEVKKPGSSVKVSCKASGGTFSSYTISWVRQAPGQGLEWMGGITPILGIANYA
QKFQGRVTITTDESTSTAYMELSSLRSEDTAVYYCARDTVMGGMDVWGQGTTVTVSSASTKGPSVFPLAP
SSKSTSGGTSALGCLVKDYFPEPVTVSWNSGALTSGVHTFPAVLQSSGLYSLSSVVTVPSSSLGTQTYIC
NVNHKPSNTKVDKKVEPKSCDKTSPLFVHHHHHHGDYKDDDDKG"""

numbering, chain = number(seq)
truncated_seq = "".join(x[1] for x in numbering if x[1]!= "-")

This issue is not related to ImmuneBuilder however, and should be opened on the ANARCI repo.
All the best,
Brennan


Using filtering while on page 2 will return wrong number of results

The issue happens when you for example are on a page is different than page 1 and you try to filter the items.
https://github.com/mediakular/gridcraft/blob/3bf26399db673e833b145efd7422504df6e53177/src/lib/GridFunctions.ts#L149-L162
Possible solution
processPaging(groupBy: string, columns: GridColumn<T>[]): GridFunctions<T> {
    this.dataUnpaged = [...this.data]; // <= this.dataUnpaged = Object.assign({}, this.data) maybe this is faster than spread to clone object with big data

    const currentPage = this.pagingData.currentPage;
    const itemsPerPage = this.pagingData.itemsPerPage;

    if (!groupBy) {
        if (this.dataLength > itemsPerPage) { // do paging only if needed, if filtering returns less results than a page, this will probably fix the bug
            const startIndex = (currentPage - 1) * itemsPerPage;
            const endIndex = startIndex + itemsPerPage;

            this.data = this.data.slice(startIndex, endIndex);
         }

Thanks for reporting this issue. That must have happened when I changed the paging(-stores). I will investigate what's wrong.

this.dataUnpaged = [...this.data]; // <= this.dataUnpaged = Object.assign({}, this.data) maybe this is faster than spread to clone object with big data

Do you have a reference that confirms that Object.assign({}, this.data) is faster? Your "maybe" made me skeptical :). I spent a little bit of time but didn't find any answer on what is faster.

if (this.dataLength > itemsPerPage) { // do paging only if needed, if filtering returns less results than a page, this will probably fix the bug

This might be also an improvement, thanks for pointing it out! It might also "hide" the issue, but I think there is a different bug in there which I would like to find first.

Do you have a reference that confirms that Object.assign({}, this.data) is faster? Your "maybe" made me skeptical :). I spent a little bit of time but didn't find any answer on what is faster.

Hm..not really, but I think that was the case in the past, but now I see in newer benchmarks that all the JS runtimes optimized it heavily in the last years and it seems that spread is faster than Object.assign with newer versions of V8 and Node.js runtimes, but for very bigger data can't find proper benchmarks.

The filtering should work now after the latest commit


Individual sheet protection

Hi,
Is it possible to protect individual worksheets with a password so that the spreadsheet could be opened without the need for a password but would still require a password to edit the contents of protected sheets?
Thanks,
Kevin

+1


SyntaxError: Missing initializer in const declaration

Hi, I am pretty new to React Native and Detox and facing some issue debugging the root cause of this issue.
Basically for our test environment we first run our docker using
npm run e2e -- --docker start
e2e script is defined in package.json as
"e2e": "ts-node e2e/runner.ts",
The error that I get is:

<EMAIL_ADDRESS>e2e /Users/rishabhharit/Documents/GitHub/clearbook/packages/cb-mobile
ts-node e2e/runner.ts "--docker" "start"

/Users/rishabhharit/Documents/GitHub/clearbook/packages/cb-mobile/node_modules/react-native/Libraries/Utilities/warnOnce.js:15
const warnedKeys: {[string]: boolean} = {};
^^^^^^^^^^

SyntaxError: Missing initializer in const declaration
at wrapSafe (internal/modules/cjs/loader.js:891:16)
at Module._compile (internal/modules/cjs/loader.js:941:27)
at Module._extensions..js (internal/modules/cjs/loader.js:1011:10)
at Object.require.extensions. [as .js] (/Users/rishabhharit/Documents/GitHub/clearbook/packages/cb-mobile/node_modules/ts-node/src/index.ts:807:44)
at Module.load (internal/modules/cjs/loader.js:822:32)
at Function.Module._load (internal/modules/cjs/loader.js:730:14)
at Module.require (internal/modules/cjs/loader.js:864:19)
at require (internal/modules/cjs/helpers.js:74:18)
at Object. (/Users/rishabhharit/Documents/GitHub/clearbook/packages/cb-mobile/node_modules/react-native/Libraries/react-native/react-native-implementation.js:14:18)
at Module._compile (internal/modules/cjs/loader.js:971:30)
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>e2e: ts-node e2e/runner.ts "--docker" "start"
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>e2e script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!      /Users/rishabhharit/.npm/_logs/2020-05-07T08_58_41_483Z-debug.log

2020-05-07T08_58_41_483Z-debug.log
runner.ts.zip
Now I am unsure where to look at. Will provide more info as per request.

This issue looks totally out of scope of the Detox project, closing.


Replace deprecated react-popper

Popperjs along with react-popper has moved to floating-ui and is now deprecated/maintenance-mode as further development is done on floating-ui.
Actions

Figure out best way to update to use floating-ui

Do we still use our wrapper hook or use it directly in our components?

Replace popperjs & react-popper with floating-ui

After having a look at floating-ui and how its used it differs quite a lot from react-popper (in a good way).
Elevating this to an epic as we need to do the conversion for each step by step for component using usePopper separately.
Updating description with detailed information.

In short term we will upgrade existing react-popper to latest as it should fix some errors people have been having when using React 18. #2341