Enhancing the Efficacy of MoE Offloading with Speculative Prefetching Strategies

Dear Mixtral Offloading Contributors,
I hope this message finds you well. I have been thoroughly engrossed in the intricacies of your project and commend the strides you have made in the efficient inference of Mixtral-8x7B models. The combination of mixed quantization with HQQ and the MoE offloading strategy is indeed a testament to the innovative spirit of your team.
Having perused your technical report and the repository with great interest, I am particularly intrigued by the prospect of speculative expert prefetching. This feature, as mentioned in the "Work in progress" section, promises to further optimise the inference process by potentially reducing the latency associated with expert loading times.
I am writing to inquire about the theoretical underpinnings and the practical considerations that are guiding the development of this feature. Specifically, I am curious about the following aspects:

The criteria used to determine which experts to prefetch, considering the dynamic nature of token dependencies.
The impact of speculative prefetching on the overall memory footprint, given the limited GPU memory and the need to balance between the LRU cache size and the prefetching mechanism.
The strategies in place to mitigate the overhead that may arise from prefetching experts that are not subsequently utilised within the inference process.

Furthermore, I would be interested to know if there are any preliminary results or simulations that shed light on the expected performance improvements from incorporating speculative prefetching. Such insights would be invaluable for those of us keenly following the project and considering contributing to its development.
I appreciate the open-source ethos that underpins your work and the invitation for contributions. It is my hope that by engaging in this dialogue, we can collectively enhance the functionality and robustness of the Mixtral offloading framework.
Thank you for your dedication to advancing the state of the art in model inference. I eagerly await your response and the continued evolution of this exciting project.
Best regards,
yihong1120

https://redccshop.mysellix.io/product/xchkrobot-source-code


[FFI/Jtreg] Exclude TestResourceScope in JDK17

The change is to disable the test suite as the issue with the test code still exists in JDK17.
Signed-off-by: ChengJin01<EMAIL_ADDRESS>

Reviewer: @llxia, @Mesbah-Alam
FYI: @ShelleyLambert, @tajila, @pshipton


[FEATURE REQUEST] Metadata OpenEXR

Is your feature request related to a problem? Please describe.
OpenEXR files store metadata in attributes.
Additional context
add Metadata OpenEXR:
Position and Orientation
Camera ID
Camera State
Lens ID
Lens State
Editorial
Encoded Image Color Characteristics

I'm not sure I understand the request. Can you please clarify? Do these not already get read and stored in the ImageSpec? Can you provide an example OpenEXR file with attributes that OIIO overlooks or doesn't allow you to retrieve?

Closing, was an unclear request


Komplexity and Strategia

in ref: https://github.com/zer0Kerbal/Komplexity/issues/57
Can Strategia handle more than three levels of administration building? more than three strategies?
@jrossignol

Answer is yes, issue is #66 displaying incorrect number of max strategies.


FR: better pagination

I ended up fixing this by just using MUI's Pagination component instead, so we don't have to keep mucking around with this custom one :)


When rancher-compose removes all services from the stack, the stack state ends up as Started-Once

Rancher Version:
v1.1.0-dev4
Environment Type: (Cattle/Kubernetes/Swarm/Mesos)
Cattle
Steps to Reproduce:

Create a service using rancher-compose
Remove the service from rancher-compose using rancher-compose rm --force

Results:
The stack is empty (as expected), but the state of the stack is now "Started-Once"
Expected:
The state of the stack to remain "Active".

Verified that this is working with master build and rancher-compose v0.8.4-rc2

Was it fixed in 1.1.0? or will it be fixed in 1.2.0?

This was fixed in 1.1.0 where the stack will remain as Active instead of Started-Once
Currently, there is no way to remove the stack completely. We have an enhancement request for it to delete a stack when removing services.
https://github.com/rancher/rancher/issues/1723

After I create and delete hundreds of stacks, it becomes a big problem. Hundreds of empty stacks left in Rancher and the rancher server slows down a lot, almost not working.


1.3.0 Got warning "changing a controlled input of type checkbox to be uncontrolled", and failed in setAllValues on dict field.

Hi, I just upgraded to 1.3.0 from 1.2.8, but there's something broken. I have a webpackbin for this:
https://www.webpackbin.com/bins/-KpZ8CHU6WKnV0wQsqZw
In case that page would be outdated, here is the test code and test steps:
import React from 'react'
import { render } from 'react-dom'
import { Form, Checkbox } from 'react-form'

const defaultValues = {
  checkbox0: { a: true }
}

render(<Form defaultValues={defaultValues}>{
  ({setAllValues, values}) => <form>

1. open developer tools

2. check "b" (got a warning)

3. click "reset" ("a" is still checked)

    <Checkbox field={['checkbox0', 'a']} />a

    <Checkbox field={['checkbox0', 'b']} />b

{JSON.stringify(values, null, 2)}

    <button type='button' onClick={() => setAllValues({checkbox0: {}})}>reset</button>
  </form>
}</Form>,
document.getElementById('root'))

So the problem with is:
First I got a waring from React after I checked a <Checkbox/>:

and when I want to use setAllValues with nested fields like field={['checkboxs', 'a']}, the form just change to its initial state.
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>Thanks!

This is fixed in latest version of V2.


auv_msgs: 0.1.1-1 in 'kinetic/distribution.yaml' [bloom]

Increasing version of package(s) in repository auv_msgs to 0.1.1-1:

upstream repository: https://github.com/oceansystemslab/auv_msgs.git
release repository: https://github.com/oceansystemslab/auv_msgs-release.git
distro file: kinetic/distribution.yaml
bloom version: 0.9.7
previous version for package: 0.1.0-0

auv_msgs
* Bump CMake version to prevent CMP0048
* Contributors: Bence Magyar

Holding for sync.


Add docs to the images on Docker Hub

We should have a description of each of the images that we are publishing and the instructions for how to use it.
Example: https://hub.docker.com/_/cassandra

Doug did it.


Allow for newer phpunit versions

To work with global installations of PHPUnit 5+

Something weird is going on with that build... every single version seems to have failed simply by changing versions. That shouldn't happen.

@shadowhand it's due to a bug in PHPUnit. See #158, #162. The current version of Humbug is unstable because PHPUnit introduced a bug between 4.7 and 4.8.

Is there any crossover here with https://github.com/padraic/humbug/pull/162???

#162 only fixed a bug in PHPUnit 4.8 that is also present in 5.*.
It should be safe to merge this PR (either now, or once it's rebased so that travis can check it), however padraic/phpunit-extensions requires ~4.0 so that should also be updated.

I've tagged a new version of the extensions also.

All checks now passing.


Vb 1491 spike   api for the admin

What does this pull request do?
This is a spike to investigate various problems that may occur with the VSiP api n admin of groups / levels in regards to session templates.
What is the intent behind these changes?
This is a spike, it should not me merged with main

Need to write some more tests for this code..


fix: move go installation step

Proposed changes
Based on the changes from https://github.com/nginx/agent/pull/208
Move the Go installation step to a different section.

@Dean-Coakley @dhurley I don't'have the required rights to merge this PR. Please someone assist or provide me with the required rights.


Remove Held Write Acks

This merges all the held write ACK PRs. All tests are passing.

I lied - I had to fix an integration test: https://github.com/firebase/firebase-ios-sdk/pull/2029/commits/b50d8548bfd4d857befcaf53cd995bcc4b2e9b85


fixed release notes gradle task

look up CHANGES from correct location
this has been fixed on 1.1 and 1.2 already but not on master

Codecov Report

Merging #5378 into master will decrease coverage by 0.15%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #5378      +/-   ##
============================================
- Coverage     82.59%   82.43%   -0.16%
+ Complexity    11295    11260      -35
============================================
  Files          1356     1356
  Lines         44265    44265
  Branches       5572     5572
============================================
- Hits          36560    36490      -70
- Misses         5094     5146      +52
- Partials       2611     2629      +18

Impacted Files
Coverage Δ
Complexity Δ

.../main/java/io/crate/planner/PositionalOrderBy.java
41.02% <0%> (-41.03%)
9% <0%> (-4%)

...arch/indices/recovery/BlobStartPrefixResponse.java
66.66% <0%> (-33.34%)
3% <0%> (-2%)

...in/java/io/crate/lucene/match/CrateRegexQuery.java
43.47% <0%> (-30.44%)
4% <0%> (-4%)

.../operation/udf/DropUserDefinedFunctionRequest.java
77.14% <0%> (-17.15%)
8% <0%> (-3%)

...rc/main/java/io/crate/analyze/UnboundAnalyzer.java
85% <0%> (-15%)
2% <0%> (ø)

...crate/executor/transport/TransportShardAction.java
72.97% <0%> (-13.52%)
8% <0%> (-1%)

...a/io/crate/operation/join/NestedLoopOperation.java
82.85% <0%> (-11.43%)
14% <0%> (-1%)

...ration/reference/doc/lucene/IpColumnReference.java
77.27% <0%> (-9.1%)
4% <0%> (-1%)

...crate/planner/projection/MergeCountProjection.java
63.63% <0%> (-9.1%)
5% <0%> (-1%)

...o/crate/planner/node/dql/join/NestedLoopPhase.java
73.49% <0%> (-7.23%)
19% <0%> (-4%)

... and 21 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1d3128c...a9d063d. Read the comment docs.


This implementation yields shape mismatch errors for Semantic Segmentation when Radix > 1

Instructions To Reproduce the Issue:

what changes you made (git diff) or what code you wrote

I just moved the keys specific to ResNeSt under MODEL.RESNEST for better clarity.

what exact command you run:
Standard training using this config file :

_BASE_: "Base-SemSeg.yaml"

MODEL:
  WEIGHTS: "https://hangzh.s3-us-west-1.amazonaws.com/encoding/models/resnest200_detectron-02644020.pth"
  BACKBONE:
    NAME: "build_resnest_fpn_backbone"
  RESNEST:
    RADIX: 2
  RESNETS:
    DEPTH : 50
    STRIDE_IN_1X1: False
    NORM: "SyncBN"
  FPN:
    NORM: "SyncBN"
  ROI_HEADS:
    NAME: CascadeROIHeads
  ROI_BOX_HEAD:
    NAME: "FastRCNNConvFCHead"
    NUM_CONV: 4
    NUM_FC: 1
    NORM: "SyncBN"
    CLS_AGNOSTIC_BBOX_REG: True
  SEM_SEG_HEAD:
    NORM: "SyncBN"
    NUM_CLASSES: 3
  RPN:
    POST_NMS_TOPK_TRAIN: 2000
  PIXEL_MEAN: [123.68, 116.779, 103.939]
  PIXEL_STD: [58.393, 57.12, 57.375]
SOLVER:
  IMS_PER_BATCH: 16
  BASE_LR: 0.02
  STEPS: (240000, 255000)
  MAX_ITER: 270000
TEST:
  PRECISE_BN:
    ENABLED: True
  AUG:
    ENABLED: True

Base-SemSeg.yaml contains the data registration and the "SemanticSegmentor" related entries.

what you observed (including full logs):

Traceback (most recent call last):
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/detectron2/engine/train_loop.py", line 132, in train
    self.run_step()
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/detectron2/engine/train_loop.py", line 215, in run_step
    loss_dict = self.model(data)
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/detectron2/modeling/meta_arch/semantic_seg.py", line 81, in forward
    results, losses = self.sem_seg_head(features, targets)
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/detectron2/modeling/meta_arch/semantic_seg.py", line 167, in forward
    F.cross_entropy(x, targets, reduction="mean", ignore_index=self.ignore_value)
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/torch/nn/functional.py", line 2021, in cross_entropy
    return nll_loss(log_softmax(input, 1), target, weight, None, ignore_index, None, reduction)
  File "/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/torch/nn/functional.py", line 1840, in nll_loss
    ret = torch._C._nn.nll_loss2d(input, target, weight, _Reduction.get_enum(reduction), ignore_index)
RuntimeError: input and target batch or spatial sizes don't match: target [16 x 544 x 800], input [16 x 3 x 800 x 544] at /pytorch/aten/src/THCUNN/generic/SpatialClassNLLCriterion.cu:23

Environment:
Provide your environment information using the following command:
sys.platform              linux
Python                    3.6.7 | packaged by conda-forge | (default, Nov 21 2018, 02:32:25) [GCC 4.8.2 20140120 (Red Hat 4.8.2-15)]
numpy                     1.18.3
detectron2                0.1.1 @/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/detectron2
detectron2 compiler       GCC 7.3
detectron2 CUDA compiler  10.0
detectron2 arch flags     sm_35, sm_37, sm_50, sm_52, sm_60, sm_61, sm_70, sm_75
DETECTRON2_ENV_MODULE     <not set>
PyTorch                   1.4.0+cu100 @/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/torch
PyTorch debug build       False
CUDA available            True
GPU 0                     Tesla T4
CUDA_HOME                 /usr/local/cuda
NVCC                      Cuda compilation tools, release 10.0, V10.0.130
Pillow                    6.2.1
torchvision               0.5.0+cu100 @/home/jupyter-cyril/venv_detectron2/lib/python3.6/site-packages/torchvision
torchvision arch flags    sm_35, sm_50, sm_60, sm_70, sm_75
cv2                       4.2.0
------------------------  ----------------------------------------------------------------------------------------------------------
PyTorch built with:
  - GCC 7.3
  - Intel(R) Math Kernel Library Version 2019.0.4 Product Build 20190411 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v0.21.1 (Git Hash 7d2fd500bc78936d1d648ca713b901012f470dbc)
  - OpenMP 201511 (a.k.a. OpenMP 4.5)
  - NNPACK is enabled
  - CUDA Runtime 10.0
  - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_37,code=compute_37
  - CuDNN 7.6.3
  - Magma 2.5.1
  - Build settings: BLAS=MKL, BUILD_NAMEDTENSOR=OFF, BUILD_TYPE=Release, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -fopenmp -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Wno-stringop-overflow, DISABLE_NUMA=1, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, USE_CUDA=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_STATIC_DISPATCH=OFF,

Ok the error seems to be because of Random Rotate data augmentation


nydus-image: add unit test for setting default compression algorithm

Relevant Issue (if applicable)
Add unit test for da501f758e3c0b5754b37cf8b5d5fd32b3ad4470.
Upgrade openssl to 0.10.55 to avoid RUSTSEC-2023-0044(https://rustsec.org/advisories/RUSTSEC-2023-0044.html).
Details
Please describe the details of PullRequest.
Types of changes
What types of changes does your PullRequest introduce? Put an x in all the boxes that apply:

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Documentation Update (if none of the other choices apply)

Checklist
Go over all the following points, and put an x in all the boxes that apply.

[ ] I have updated the documentation accordingly.
[x] I have added tests to cover my changes.

Please help to open a PR for master branch too,
Also please cargo fmt your changes.

/retest


add lifecycle support for bundle source type - artifacts

[ ] All tests passed. If this feature is not already covered by the tests, I added new tests.
[ ] All static analysis checks passed.
[ ] This pull request is on the dev branch.
[ ] I used gofmt for formatting the code before submitting the pull request.

@yahavi need your help in review on merge of this. Appreciate prompt response and help to unblock on this feature.

@RobiNino please check https://github.com/jfrog/jfrog-client-go/blob/1c352a93c23dcae0ef286e045854c68493af00c4/lifecycle/manager.go#L51
lifecycle.RbPromotionParams shows up as undefined.

@yahavi @RobiNino merge conflicts with dev branch are now resolved.
Appreciate prompt review and subsequent release, so we can update our tooling. Thanks in advance!

@yahavi @RobiNino when can I expect this PR to be reviewed?
I'm not clear what are the next steps for contributers - anything else required from my side?

Thanks for your contribution @ns-kbhat ! I'll go over your PR tomorrow.
Nothing else is required, I'll leave any comments as part of the CR.

@RobiNino did you have a chance to review today?

Much appreciated @ns-kbhat ! The changes will be included in our next release in the upcoming days


add in env flag for drone exec

When running drone exec there isn't a way that I have found to specify environment variables when running.  Our current use-case for this is to support specifying an AWS profile when running drone exec locally.
Additional Notes

This requires the env vars presented to drone to either use -e, --env (cli flags), or DRONE_ENV (environment variable)
This does not pull environment variables that are defined outside of the Drone flags

Simple Example
.drone.yml
pipeline:
  printenv:
    image: busybox
    commands:
      - echo $MY_ENV

Negative Testing
-> drone exec
[printenv:L0:0s] + echo $MY_ENV
[printenv:L1:0s]
ruby-2.3.3@all ~/code/tmp/droneexectesting $
-> MY_ENV=test drone exec
[printenv:L0:0s] + echo $MY_ENV
[printenv:L1:0s]

Positive Testing
-> drone exec --env MY_ENV=test
[printenv:L0:0s] + echo $MY_ENV
[printenv:L1:0s] test
ruby-2.3.3@all ~/code/tmp/droneexectesting $
-> drone exec -e MY_ENV=test
[printenv:L0:0s] + echo $MY_ENV
[printenv:L1:0s] test
ruby-2.3.3@all ~/code/tmp/droneexectesting $
-> DRONE_ENV=MY_ENV=test drone exec
[printenv:L0:0s] + echo $MY_ENV
[printenv:L1:0s] test

Practical Example

When executing terraform locally, use an AWS profile.  When it is pushed to Git, use the IAM permissions associated with the drone server.

Set environment variables:
DRONE_VOLUMES=$HOME/.aws/credentials:/root/.aws/credentials
DRONE_ENV=AWS_PROFILE=dev

.drone.yml
pipeline:
  printenv:
    image: hashicorp/terraform
    commands:
      - terraform init
      - terraform plan

test.tf
provider "aws" {
  region = "us-east-1"
}

resource "aws_security_group" "test" {
  name = "test"
}

-> drone exec
[printenv:L0:0s] + terraform init
...
[printenv:L34:2s]
[printenv:L35:2s] Terraform will perform the following actions:
[printenv:L36:2s]
[printenv:L37:2s]   + aws_security_group.test
[printenv:L38:2s]       id:                     <computed>
[printenv:L39:2s]       description:            "Managed by Terraform"
[printenv:L40:2s]       egress.#:               <computed>
[printenv:L41:2s]       ingress.#:              <computed>
[printenv:L42:2s]       name:                   "test"
[printenv:L43:2s]       owner_id:               <computed>
[printenv:L44:2s]       revoke_rules_on_delete: "false"
[printenv:L45:2s]       vpc_id:                 <computed>
[printenv:L46:2s]
[printenv:L47:2s]
[printenv:L48:2s] Plan: 1 to add, 0 to change, 0 to destroy.

to pass environment variables to drone you can do this:
FOO=bar drone exec

or you can create a .env file in the working directory which it will read from automatically:
cat <<EOF > .env
FOO=bar
EOF
drone exec

@bradrydzewski That doesn't appear to work, see:
pipeline:
  printenv:
    image: busybox
    commands:
      - echo $FOO

-> FOO=bar drone exec
[printenv:L0:0s] + echo $FOO
[printenv:L1:0s]

With my pr:
-> DRONE_ENV=FOO=bar drone exec
[printenv:L0:0s] + echo $FOO
[printenv:L1:0s] bar

ah right, it works for passing secrets from the command line:
pipeline:
  printenv:
    image: busybox
    secrets: [ FOO ]
    commands:
      - echo $FOO

or for yaml interpolation:
pipeline:
  printenv:
    image: busybox
    commands:
-     - echo ${FOO}
+     - echo ${FOO}

but will not inject into the environment


Multiple Recurrence widgets on the same page cause a JS mess

I think I can work around this in my app, but I think it should be known that if one has multiple recurrence widgets on the same page, you get JS errors in the console and only the first one functions. I'm not a JS developer, so I don't know how hard this would be to fix. Here's the error you get, seemingly once for each widget past the first:
Uncaught SyntaxError: Identifier 'callback' has already been declared (at recurrence-widget.init.js:1:1)
This error also seems to occur when an ajax request (such as HTMX replacing the element containing a recurrence widget) adds another recurrence widget to the page. In that case, neither widget works until the page is fully reloaded.

Wow. That was a journey.
As it turns out, the issue I was having was not due to a fault in this widget, but rather ID collision on my page. It's a list of objects with the ability to edit them inline, and somehow I never noticed that when I have multiple instances of the same ModelForm on a page, their IDs overlap. Duh.
The browser doesn't care about that when it goes to process forms, but it appears that this widget's JS will silently fail to recognize multiple widgets if they share an ID.
I'm no longer worried about getting this fixed, as you have to do something non-compliant to run into this problem in the first place.


SSL configuration is Running - Custom Domain works but not for the root domain

App Id: d993zris8blhl
Region: us-east-1
Step: SSL configuration
Status: Running

Note: Do not include information that is sensitive in nature such as your domain name, company etc.

Issue/question
I added a custom domain with two records CNAME pointing at www but my Domain name provider does not allow ANAME records but allows A or AAAA records and in both cases it must point to an IP not a FQDN, so I resolved the IP address to which the domain is pointing and added it instead, but it did not work.
Now when I go to www I see the website but when I go to the root domain I get 504 error
Error message
If there is an error message, please include it here.
Note: Be sure to check the message for sensitive information.
Additional information
Please add any other relevant information. Please feel free to include screenshots.

Refer to our documentation to troubleshoot domain setup.
https://docs.aws.amazon.com/amplify/latest/userguide/custom-domain-troubleshoot-guide.html
https://docs.aws.amazon.com/amplify/latest/userguide/custom-domain-troubleshoot-guide.html#i-get-a-cnamealreadyexistsexception-error
Let us know if you're still facing issues.


ci: add docusaurus-prince-pdf generation

What type of PR is this? (check all applicable)

[ ] ♻ Refactor
[ ] ✨ Feature
[ ] 🐛 Bug Fix
[ ] 👷 Optimization
[ ] 📝 Documentation Update
[ ] 🔖 Release
[x] 🚩 Other

Description

This PR creates a pdf handbook out of the docs site.
Related Tickets & Documents

Example:

run: https://github.com/0-vortex/docs.opensauced.pizza/actions/runs/1419249575
pdf: https://github.com/0-vortex/docs.opensauced.pizza/suites/4250649674/artifacts/110302064

Mobile & Desktop Screenshots/Recordings

Added tests?

[ ] 👍 yes
[x] 🙅 no, because they aren't needed
[ ] 🙋 no, because I need help

Added to documentation?

[ ] 📜 readme
[ ] 📜 contributing.md
[ ] 📓 docs
[ ] 📕 storybook
[x] 🙅 no documentation needed

[optional] Are there any post-deployment tasks we need to perform?
[optional] What gif best describes this PR or how it makes you feel?

alpha and beta tested this in 0-vortex/open-sauced-docs-test


Use deferred factory parameters in Combined

@yhmtsai If you want, you can also put that into your PR.
I've not seen any other instance, where the old style parameters could be replaced by the deferred ones.

Already in #1439


Fix build script and README

Description of changes:
The build-s3-dist.sh script was expecting 4 input parameters while only 3 were used inside the script (the second parameter was never used in the script).
The doc was referring to ./dist folder that is not generated by the script and I guess the correct value is ./regional-s3-assets (where all the code, lambda are placed by the script)
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

lgtm

This issue has been fixed in 3.0.2.. Closing the PR


feat(build): add strict checkstyle on file header

What this PR changes/adds
Add strict checks on file header format
Why it does that
Headers consistency
Linked Issue(s)
Closes #60
Checklist

[ ] added appropriate tests?
[x] performed checkstyle check locally?
[ ] added/updated copyright headers?
[ ] documented public classes/methods?
[ ] added/updated relevant documentation?
[ ] added relevant details to the changelog? (skip with label no-changelog)
[x] formatted title correctly? (take a look at the CONTRIBUTING and styleguide for details)

IMO it should fail the build. The existing check is a bit annoying because it requires a blank space after the header, perhaps there is a way to express that in the Regex?

@paullatzelsperger  that was an override for RegexpHeader check of the parent setting which is set with severity error.
So now also the check on headers makes the build fail if the regex don't match


how do you make it to work lol

how do you inject?

Hi vqcate,
For all the installation instructions, visit the install.md


test_cmp_http: decrease risk of timeouts due to delays by underlying system

Hopefully fixes #22870 for most situations (such as high load on the system running the test suite),
~while this comes at the cost that some connection-oriented test cases will take longer~.

Should this be backported?

I'd put it on 3.2 branch at least.

Fuzzing CI failure must be unrelated.

I've just fixed a typo and simplified the approach.

How to resolve fuzzer build failure?

24 hours has passed since 'approval: done' was set, but as this PR has been updated in that time the label 'approval: ready to merge' is not being automatically set.  Please review the updates and set the label manually.

@shahsb The fuzzer build failures are due to /usr/bin/ld: final link failed: No space left on device. To fix this would require larger executors, which would cost (more), or splitting the fuzzing job(s) somehow.

Merged to master and 3.2 - thanks for the swift approvals.


Additional implementation details for key override

This adds a helpful note to the change key format section in case someone REALLY wants to change the way keys are formatted.

@kortirso ☝


Help users identify the path to the file for broken charts

Output of helm version:
version.BuildInfo{Version:"v3.5.2", GitCommit:"167aac70832d3a384f65f9745335e9fb40169dc2", GitTreeState:"dirty", GoVersion:"go1.15.7"}
Output of kubectl version:
Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.2", GitCommit:"faecb196815e248d3ecfb03c680a4507229c2a56", GitTreeState:"clean", BuildDate:"2021-01-14T05:14:17Z", GoVersion:"go1.15.6", Compiler:"gc", Platform:"darwin/amd64"}
Cloud Provider/Platform (AKS, GKE, Minikube etc.):
GKE

We're using argocd to apply helm charts (which are composed of fairly deeply nested helm charts), and periodically we get fairly unhelpful messages of the form:

Error: cannot load Chart.yaml: error converting YAML to JSON: yaml: line 6: did not find expected '-' indicator

cannot load values.yaml: error converting YAML to JSON: yaml: line 49: did not find expected key

https://github.com/helm/helm/issues/8657#issuecomment-693780516
It'd be really helpful if errors included some path-ish information for files, full paths, relative paths, anything.

@mattfarina: Can you please explain what I'm supposed to do to cause these issues / PRs to not rot?

Sigh


E2E Tests -- flush out

https://github.com/andrebriggs/bedrock-end-to-end-dx/blob/master/Integration-Test-CLI.md

@bnookala @mtarng @bnookala thoughts on https://github.com/andrebriggs/bedrock-end-to-end-dx/blob/master/Integration-Test-CLI.md as a plan? The first test is using the service create scenario


How commands?

How can i process message text to detect user commands? I visited the URL but it speak about the commands for BotFather not for the ruby file..
Can you help me? (i'm new in ruby)

Probably the easiest way is to use a case statementto check for the strings that you accept as commands. Something like:
bot.get_updates do |message|
  case message.text
    when '/mycommand'
      # Some actions
    when '/myothercommand'
      # Some other actions
    else
      # Unrecognized command
      bot.send_message(chat_id: message.chat.id, text: "Sorry, I do not understand you.")
  end
end

You can learn more about the case statement in this link:
http://ruby-doc.org/docs/keywords/1.9/Object.html#method-i-case.
I hope this helps you.

Thanks so much, its works! so the keyboard (reply_markup) auto close before the user answer, how can i do? thanks in advance

You can see the usual flow for custom keyboards in the documentation examples:
https://github.com/mayoral/telegrammer/wiki/API-methods-examples#sending-messages

`  when "/command"
bot.send_message(chat_id: message.chat.id, text: "This is a text")
reply_markup = Telegrammer::DataTypes::ReplyKeyboardMarkup.new(
  keyboard: [
    ["Top Left", "Top Right"],
    ["Center"],
    ["Bottom Left", "Bottom Center", "Bottom Right"]
  ],
  resize_keyboard: false,
  one_time_keyboard: true
)

# This message will activate a custom keyboard...
bot.send_message(
  chat_id: message.chat.id,
  text: "Select an option",
  reply_markup: reply_markup
)

reply_markup = Telegrammer::DataTypes::ReplyKeyboardHide.new(
  hide_keyboard: true
)

if coming_message == "Top Left"
  case coming_message
  when "Top Left"
    bot.send_message(chat_id: message.chat.id, text: "TOP BUTTON", reply_markup: reply_markup)
  else
    bot.send_message(chat_id: message.chat.id, text: "Sorry", reply_markup: reply_markup)
  end
end

else
bot.send_message(chat_id: message.chat.id, text: "Sorry, invalid input")
end
end
`
I did it like these but the bot doesn't answer to the user and give directly "Sorry, invalid input".
What's wrong? Please have patience and thanks in advance.

I can't check the code at this moment, but seems to be OK. What's the output you are receiving? Is it sending the "invaliding input" message since the first message?

Also note, the flow for custom keyboard are several messages, not just one:

You receive a message from the user with a command.
Then you send a message with the custom keyboard layout to the user.
You receive a message from the user with the option chosen in the custom keyboard.
Then you send a message for hiding the keyboard. After that message, another with the answer to the user.

so i send
First This :
  case coming_message
  when "/command"
    bot.send_message(chat_id: message.chat.id, text: "This is a text")

    reply_markup = Telegrammer::DataTypes::ReplyKeyboardMarkup.new(
      keyboard: [
        ["Top Left", "Top Right"],
        ["Center"],
        ["Bottom Left", "Bottom Center", "Bottom Right"]
      ],
      resize_keyboard: false,
      one_time_keyboard: true
    )

    # This message will activate a custom keyboard...
    bot.send_message(
      chat_id: message.chat.id,
      text: "Select an option",
      reply_markup: reply_markup
    )

and then then the if with when and the option of the keyboard?
Something like this:
bot.get_updates(fail_silently: true) do |message|

  time = Time.new

  coming_message = "#{message.text}" #incoming user message

  puts ""
  puts "Message from > @#{message.from.first_name} A.K.A #{message.from.username}"
  puts "MESSAGE TEXT = #{message.text}"
  puts ""

  case coming_message
  when "/command"
    reply_markup = Telegrammer::DataTypes::ReplyKeyboardMarkup.new(
      keyboard: [
        ["Top Left", "Top Right"],
        ["Center"],
        ["Bottom Left", "Bottom Center", "Bottom Right"]
      ],
      resize_keyboard: false,
      one_time_keyboard: true
    )

    # This message will activate a custom keyboard...
    bot.send_message(
      chat_id: message.chat.id,
      text: "Select an option",
      reply_markup: reply_markup
    )

    if coming_message == "Top Left"
      case coming_message
      when "Top Left"

        reply_markup = Telegrammer::DataTypes::ReplyKeyboardHide.new(
          hide_keyboard: true
        )

        bot.send_message(chat_id: message.chat.id, text: "HELLO WORLD")
        bot.send_message(chat_id: message.chat.id, text: "TOP BUTTON", reply_markup: reply_markup)
      else
        bot.send_message(chat_id: message.chat.id, text: "Sorry", reply_markup: reply_markup)
      end
    end
  else
    bot.send_message(chat_id: message.chat.id, text: "Sorry, invalid input")
  end
end

because this give me the output like

USER: /command
BOT: Select an option (and this activate the keyboard)
USER: Top Left
BOT: Sorry, invalid input.

What's wrong? Thanks in advance


Created mandatory argument 'validated task name' when running MongoDB migrations...

Created mandatory argument 'validated task name' when running MongoDB migrations to force prior validations.
Added mongo to mongo online as a scenario handled by the extension
Minor cleanup
Bumped version to 0.7.1

This checklist is used to make sure that common guidelines for a pull request are followed.

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

If this PR is for a new extension or change to an existing extension, use the following to try out the changes in this PR:
docker run -it microsoft/azure-cli:latest
export EXT=<NAME>
pip install --upgrade --target ~/.azure/cliextensions/$EXT "git+https://github.com/vchske/azure-cli-extensions.git@master#subdirectory=src/$EXT&egg=$EXT"

@temandr can you review as codeowner?

@vchske can you merge with the master branch?

@williexu  Merged with latest and looks good for merging into the master branch.


Fix options() docblock in HasOptions.php

Description
I have the following code that PHPStan level 5 falsely say is error
public function filtersForm(Form $form): Form
    {
        $currentYear = (int) date('Y');
        $years = range(2020, $currentYear);
        if ($this->filters['year'] === null) {
            $this->filters['year'] = $currentYear;
        }

        return $form
            ->schema([
                Select::make('year')
                    ->required()
                    ->default($currentYear)
                    ->options(
                        //  Parameter #1 $options of method Filament\Forms\Components\Select::options() expects array<array<string>|string>|Closure|Illuminate\Contracts\Support\Arrayable|string|null, array<int, int>  given.
                        array_combine($years, $years)
                    ),
            ]);
    }

 Parameter #1 $options of method Filament\Forms\Components\Select::options() expects
array<array<string>|string>|Closure|Illuminate\Contracts\Support\Arrayable|string|null, array<int, int>
         given.

So this attempt to fix it by changing the docblock to allow both string & int array

Thanks for bringing this up, @ziming!
I'm not sure if this is by design (anything to do with int to string conversions?), so will assign this to Dan for review. 🙂

Okay will do although it is not very convenient


Duration colorization

Addresses #35 - Created a property in models.py for Log model to pass color based on duration. If finished is present, then there is no color returned in the property. This property is called within the status.html page in the "Duration" cell.

I didn't mean to make the last PR for master.  It was late!

@bahadasx no problem - don't worry!

I have to say - pull requests make more sense to me on the command line then they do in the web application!

Oh - and you should do a pull from develop since I had to resolve a minor merge conflict.


Update to latest version of Packable

Related: #610.
We need to adapt to Packable's new visitor functionality. This also means updating bee-inx.

We need to wait for this PR to be merged: https://github.com/iotaledger/bee/pull/1501

This has been done.


Failed to  change website extension

I'm submitting a ...
[ ] bug report
[*] feature request
[ ] question about the decisions made in the repository
[ ] question about how to use this project

Summary
I was willing to change the website address extension of my token.
I have created a new PR with the name "Changed Website Extension" #15106.
This request seems not to be eligible for automerge, ... still It wasn't about duplicating the token.

What should I do to push this change from my repository to the main without an "automerge error" ?
Thanks for your help.

added comment on PR


Bump version of sbt-coursier plugin

Scalaz version used by previous version of that plugin wasn't compatible with sbtclipse
plugin, so bumping version of sbt-coursier plugin that uses newer version of scalaz,
resolved the issue

Thanks!


chore(docs): improve compute_note_hash_and_nullifier docs page

Docs Preview
Hey there! 👋 You can check your preview at https://66167eef9d205b24cfd20305--aztec-docs-dev.netlify.app

Benchmark results
Metrics with a significant change:

note_trial_decrypting_time_in_ms (32): 112 (+159%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit aa0d2e4b and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
676
676
676

l1_rollup_calldata_gas
6,424
6,412
6,424

l1_rollup_execution_gas
585,757
585,745
585,757

l2_block_processing_time_in_ms
1,289 (-1%)
4,662 (-1%)
9,279 (-2%)

note_successful_decrypting_time_in_ms
242 (-2%)
605 (+14%)
1,029 (-2%)

note_trial_decrypting_time_in_ms
39.7 (-16%)
:warning: 112 (+159%)
27.4 (-61%)

l2_block_building_time_in_ms
11,894 (+1%)
43,280 (+1%)
85,230 (+1%)

l2_block_rollup_simulation_time_in_ms
11,861 (+1%)
43,163 (+1%)
85,005 (+1%)

l2_block_public_tx_process_time_in_ms
6,230 (+1%)
24,378 (+1%)
49,123 (+2%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
14,249 (-2%)
27,203 (-1%)

note_history_successful_decrypting_time_in_ms
1,299 (-1%)
2,389 (-1%)

note_history_trial_decrypting_time_in_ms
65.7 (+5%)
99.3 (-3%)

node_database_size_in_bytes
18,632,784
35,041,360 (+1%)

pxe_database_size_in_bytes
29,859
59,414

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
180
44,377
26,164

private-kernel-ordering
162
50,830
39,026

base-parity
3,888 (+2%)
128
311

root-parity
1,072 (-2%)
1,244
311

base-rollup
14,263 (+1%)
110,464
861

root-rollup
49.9 (+1%)
4,359
725

private-kernel-inner
218
71,744
26,164

public-kernel-app-logic
120 (-2%)
47,695
40,661

public-kernel-tail
164
53,372
7,125

merge-rollup
10.3 (-3%)
2,568
861

public-kernel-teardown
117
47,695
40,661

public-kernel-setup
116 (+1%)
47,695
40,661

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.1 (+1%)
16.2 (+1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.6
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.589 (+1%)
0.502 (+1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
46.0
72.8
231
447
870
1,733
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
96.0
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.472
0.449
0.421
0.418
0.413 (-1%)
0.414
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
54.1
107
335
660
1,311
2,616 (-1%)
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
105
207
691
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.478
0.483 (+1%)
0.456
0.455
0.454
0.455 (-1%)
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
61.1

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
109

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.534

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
40,372
496,534

Transaction size based on fee payment method

Metric
native fee payment method
fpc_public fee payment method
fpc_private fee payment method

tx_with_fee_size_in_bytes
905
1,161
1,377

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes
2 new note hashes

tx_pxe_processing_time_ms
1,698 (+1%)
1,081
5,483 (+2%)

Metric
1 public data writes
2 public data writes
3 public data writes
4 public data writes
5 public data writes
8 public data writes

tx_sequencer_processing_time_ms
575 (-1%)
400 (+1%)
1,065
519 (+5%)
1,761 (+1%)
586 (+1%)


2021-09-14 equity dashboard chart data update

Equity dashboard stats updates in this PR may be reviewed on staging - here.
After reviewing, if all looks well, approve and merge this Pull Request.
If there are issues with the data:

Note concerns or issues here by commenting on this PR
Work with Triston directly to resolve data issues
Alert the COVID19 site team in Slack (in the Equity page channel)

Good morning everyone - Below is my preliminary data review. @tomasleon, off to you!
:heavy_check_mark: Everything seems normal, and I observe no major red flags!
:chart_with_downwards_trend: SUMMARY STATEMENT: Death Rates/100K by R&E generally increase, while Case Rates/100K by R&E & median annual household income generally decrease. Changes in testing Rates/100K are group-specific.
:bulb: Noticeable highlight: HE Quartile positivity is now back to being greater than Statewide Positivity, no longer less than or equal to, (as it has been for the past three weeks).
Thank you!
1. Blue Box Updates:
:heavy_check_mark: All percentage values are unchanged and appear reasonable — Only Case Rate for Pacific Islanders (Blue Box 2) increases by 1% from last week, to 43%
2. Death Rate/100K by R&E:
:heavy_check_mark: Statewide COVID Deaths/100K remains unchanged at 4.
:heavy_check_mark: Like last week, NHPI continues to hold the greatest COVID Deaths/100K rate (9.3x lowest rate), but is the only category that shows a decrease in death rate (14.7/100K to 11.8/100K). This rate of decrease is larger than that observed last week.
:heavy_check_mark: All other categories show rate increases. Multi-Race is now the lowest COVID Deaths/100K rate, no longer tied with Asian American.
3. Case Rate/100K by R&E:
:heavy_check_mark: Similar to last week, this week shows decreases in all Case/100K rates. All values appear reasonable. NHPI Cases/100K remains the highest rate. Multi-Race Cases/100K is the lowest rate.
4. Testing Rate/100K by R&E:
:heavy_check_mark: Deviating with recent increasing trends across all categories, testing rate/100K shows mixed, category-dependent changes this week. While Statewide, NHPI and Black decrease, White and Multi-Race increase in Testing/100K rates. All values appear reasonable. NHPI Testing/100K remains the highest rate, Multi-Race Testing/100K remains the lowest rate.
5. Sanity Checks
:heavy_check_mark: Mortality rate/100K < Case rate/100K for all categories (as expected).
:heavy_check_mark: % of state population remains consistent across all categories for Cases/Deaths/Testing by R&E
6. Community case rate/100K by median annual household income bracket:
:heavy_check_mark: Like last week, income brackets’ case rate & statewide case all decrease this week. Values are reasonable, and align with R&E trends.
:heavy_check_mark: Identical to last week, $0-40K case rate > $40-60K > $60-80K, and so on. Statewide case rate is now between $0-40K and $40-60K bracket cases/100K rates.
7. HE Metric:
:bulb: HE Quartile positivity is now back to being greater than Statewide Positivity, no longer less than or equal to, (as it has been for the past three weeks).
:heavy_check_mark: X-Axis (Dates) successfully extended. Both Statewide & HE Quartile Positivity appear to decrease, consistent with recent trends.
8. Data completeness (DC):
:heavy_check_mark: DC values did not show significant changes (≥0.6%) this week.


Crash with ESP32

The example in the LIS2DW12 get acceleration crashes with a panic dump on an ESP32.
The library is useless.

i have been using for a long time now without issues.


:bomb: PRE-release 1.3.1-alpha.0

Great!
Please visit https://github.com/tinkoff-ai/etna-ts/releases/edit/1.3.1-alpha.0 to describe release notes!
Also you can find publishing task here https://github.com/tinkoff-ai/etna-ts/actions/workflows/publish.yml

Codecov Report

Merging #272 (9037523) into master (d1256ab) will decrease coverage by 31.53%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master     #272       +/-   ##
===========================================
- Coverage   87.19%   55.66%   -31.54%
===========================================
  Files          92       92
  Lines        4522     4522
===========================================
- Hits         3943     2517     -1426
- Misses        579     2005     +1426

Impacted Files
Coverage Δ

etna/commands/__init__.py
0.00% <0.00%> (-100.00%)
:arrow_down:

etna/commands/backtest_command.py
0.00% <0.00%> (-96.43%)
:arrow_down:

etna/commands/forecast_command.py
0.00% <0.00%> (-92.00%)
:arrow_down:

etna/commands/__main__.py
0.00% <0.00%> (-87.50%)
:arrow_down:

etna/commands/resolvers.py
0.00% <0.00%> (-80.00%)
:arrow_down:

etna/analysis/outliers/density_outliers.py
22.72% <0.00%> (-75.00%)
:arrow_down:

etna/transforms/statistics.py
27.50% <0.00%> (-71.67%)
:arrow_down:

etna/analysis/outliers/median_outliers.py
25.00% <0.00%> (-70.84%)
:arrow_down:

etna/datasets/datasets_generation.py
26.47% <0.00%> (-70.59%)
:arrow_down:

etna/transforms/special_days.py
28.75% <0.00%> (-70.00%)
:arrow_down:

... and 52 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d1256ab...9037523. Read the comment docs.


Freeze manually

Hi, thank you for your great work.
I want to use yours for my experiment.
I wonder get_lora_params() would load parameters to optimizer, but if the model itself can compute gradient, wouldn't the model still compute gradient?
Would be freezing the model enough for using minlora without the get_lora_params?
Also, when merging lora to the model to have another lora module, should I have to set lora_A and lora_B requires_grad=False before merging?
Thank you.

Hi, thanks!

I wonder get_lora_params() would load parameters to optimizer, but if the model itself can compute gradient, wouldn't the model still compute gradient?
Would be freezing the model enough for using minlora without the get_lora_params?

Probably yes, but you need to make sure you don't accidentally freeze the lora parameters.

Also, when merging lora to the model to have another lora module, should I have to set lora_A and lora_B requires_grad=False before merging?

Probably not. After merging, lora_A and lora_B will no longer exist.

Thank you for your kind reply.
However, in the example in https://github.com/cccntu/LoRAnanoGPT/blob/master/train.py, line 236, it uses DDP without 'find_unused_parameters=True' argument.
When I work on my own experiment on other setting with DDP, since backbone model has requires_grad=False, I get error message since backbone model parameters are not used for gradient computation when not specifying 'find_unused_parameters=True'.
Is there something that I missed? I believe this API works with DDP.
Thnak you!

Honestly I don't know. Can you solve it by simply adding 'find_unused_parameters=True'?
I've only used it on one GPU.
Or does using get_lora_parameter solve this issue?

It looks like this method is correct in the sense that it only updates the parameters you pass in to the optimizer, but Torch will still compute gradients for all weights, as requires_grad is still True, according to this thread:
https://discuss.pytorch.org/t/passing-a-subset-of-the-parameters-to-an-optimizer-equivalent-to-setting-requires-grad-of-subset-only-to-true/42866/2


Added New game called Trivia Cards

PR Description 📜
Please include summary related to the issue you have fixed and describe your PR in brief over here by specifying the issue number on which you were working below
Fixes #1651

Mark the task you have completed ✅

[x] I follow CONTRIBUTING GUIDELINE & CODE OF CONDUCT of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I have followed proper naming convention showed in CONTRIBUTING GUIDELINE
[x] I have added screenshot for website preview in assets/images
[x] I have added entries for my game in main README.md
[x] I have added README.md in my folder
[ ] I have added working video of the game in README.md (optional)
[x] I have specified the respective issue number for which I have requested the new game.

Add your screenshots(Optional) 📸

Thank you soo much for contributing to our repository 💗

Thank you @shreyaslax ,for creating the PR and contributing to our GameZone 💗
Review team will review the PR and will reach out to you soon! 😇
Make sure that you have marked all the tasks that you are done with ✅.
Thank you for your patience! 😀

Hey @shreyaslax,
You can't work on a closed issue 👀!
Follow the proper guideline and make a new PR again 😀.
Happy Hacking 💗

Thank you  @shreyaslax , for your valuable time and contribution in our GameZone 💗.
It’s our GameZone, so Let’s build this GameZone altogether !!🤝
Hoping to see you soon with another PR again 😇
Wishing you all the best for your journey into Open Source🚀


[AutoPR] iothub/resource-manager

Created to accumulate context: iothub/resource-manager

Codecov Report

Merging #5219 into master will decrease coverage by 4.3%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #5219      +/-   ##
==========================================
- Coverage   53.54%   49.24%   -4.31%
==========================================
  Files       10484     6331    -4153
  Lines      217043   179279   -37764
==========================================
- Hits       116224    88286   -27938
+ Misses     100819    90993    -9826

Impacted Files
Coverage Δ

...afactory/azure/mgmt/datafactory/models/__init__.py
50.67% <0%> (-49.33%)
:arrow_down:

...ights/azure/applicationinsights/models/__init__.py
51% <0%> (-49%)
:arrow_down:

...e/cognitiveservices/vision/face/models/__init__.py
51.08% <0%> (-48.92%)
:arrow_down:

...services/language/textanalytics/models/__init__.py
51.16% <0%> (-48.84%)
:arrow_down:

...iveservices/search/entitysearch/models/__init__.py
51.25% <0%> (-48.75%)
:arrow_down:

azure-eventgrid/azure/eventgrid/models/__init__.py
51.25% <0%> (-48.75%)
:arrow_down:

...ration/azure/mgmt/datamigration/models/__init__.py
51.27% <0%> (-48.73%)
:arrow_down:

...ure/mgmt/recoveryservicesbackup/models/__init__.py
51.46% <0%> (-48.54%)
:arrow_down:

...ce/azure/mgmt/containerinstance/models/__init__.py
51.8% <0%> (-48.2%)
:arrow_down:

...tiveservices/search/videosearch/models/__init__.py
52.08% <0%> (-47.92%)
:arrow_down:

... and 4345 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 27bed2b...0cd6fc4. Read the comment docs.

(message created by the CI based on PR content)


fix: optimization judge svg

use sel.startsWith('svg') replace sel[0] === s && sel[1] === v &&
sel[2] === g

this is more compact and, if the regexp is memoized, faster
/^svg[#.]/.test(sel)

Thanks for the PR @jingjing20. Apologies for never taking a look at this. I'm closing this PR as this change has now been merged as part of another PR.

Ok

Thanks for the PR @jingjing20. Apologies for never taking a look at this. I'm closing this PR as this change has now been merged as part of another PR.

OK


net: ip: net_if: bypassing IP stack with SOCK_RAW sockets

Continuation to https://github.com/zephyrproject-rtos/zephyr/pull/54664
Bypass the IP stack and go directly to L2 with SOCK_RAW/IPPROTO_RAW sockets in net_if_send_data().

Just rebased (no actual chenged compared the original PR) because there waskind of a complaint of it. But seems that it removed the approvals, apologies about hashlings, so can you please recheck. @rlubos / @jukkar


Refactor autocomplete

Should we switch the 'autocomplete' api's name with 'getUsersByTerm'?

what do you think searchByTerm?
users is duplicating the context:
usersService.getUsersByTerm(...)

Yeah that's pretty good, but what for the autocompleteUsernames?
autocompelte --> List
autompleteUsernames --> List

nice question, tbh idk, maybe getUsernameSuggestions maybe?
usersService.getUsernameSuggestions(term: 'ricc');

What about
usersService.searchByTerm(...) and usersService.searchNamesByTerm(...)?

seems pretty good, gotta update to this then.
autocomplete -> searchByTerm.
autocompleteUsernames -> searchNamesByTerm.


Feature: Show Extensions for statically served sites

Hi, I ran into a problem where my statically served application was not generating the correct path for the urls that were being served. Basically, the path was never taking into the account the extension of the file which for statically served nextjs applications matters because there is no server-side routing.
You can see the issue I reported, https://github.com/IlusionDev/nextjs-sitemap-generator/issues/74, which this PR should now fix.
This PR provides a way for a user to tailor their configuration to show the extensions within the generated sitemap.
Note: I disabled this feature in the code if the exportTrailingSlash boolean is false. However, we could easily support these two at the same time by always adding index.html if exportTrailingSlash was true. I decided not to do this as this may not be the direction we want to take this package in, furthermore, it will still work for some websites

sorry to be late I will check this tomorrow ;)

sorry to be late I will check this tomorrow ;)

I created a new pr #78 with some changes. :)
So I hope you like and I will close this pr to continue with that one.

I created a new pr #78 with some changes. :)
So I hope you like and I will close this pr to continue with that one.

Thanks for taking the feature request :)

Thanks for taking the feature request :)


Update k8s.md

For installing forklift, kubectl apply command is provided. The https url in that command is incorrect, it is pointing to old /konveyor/forklift-operator/... repo. This PR is to modify that url to point to new artifacts from /kubev2v/forklift/.. repo.
Users directly use the kubectl command and then the artifacts from the old archived repo gets installed.

@cniket hi, welcome to the contributor :tada:
we ask contributor to sign there commits, ( DCO ) do you need help signing the commit ?

@cniket hi, welcome to the contributor 🎉
we ask contributor to sign there commits, ( DCO ) do you need help signing the commit ?

Hello @yaacov , Thank you!
I have added the sign off.
Thanks.

@mnecas PTAL


vector-system: scrape prometheus metris from aggregator and agent pods

Add PodMonitor, and supporting RBAC rules, to scrape the prometheus metrics exported by Vector in both the aggregator and agent pods.
In a simpler world, we'd just use podMonitor.enable = true in the chart values.  Unfortunately, that does not address the missing RBAC role binding or allow us to put the PodMonitors into the monitoring namespace where our prometheus instances will notice it.

bors r+


Write Tests

We should get some unittests for this project for several reasons

It will help us avoid regression generally
It's hard to do manual testing since there is no user interface
It's a good tool for a programmer to know

Just barely started this. There is a tiny bit in the readme about it, and one test-like item in the tests directory. I think this issue should stay open for now until we have a better test structure in place then it can be split out into smaller and more focused issues asking for specific coverage.

We'll probably need to mock at least our socket objects if not more to get our tests working properly without leaving lots of security holes open and system resources tied up.
https://docs.python.org/3/library/unittest.mock.html

I've written some decent tests for the Peer class. We should still write them for Message and Network at some point.


Searching for component broken on static build

Describe the bug
I recently upgraded to v5. I have a relatively simple storybook setup.  I can search components and everything
But when I use build-storybook and host the assets using http-server, everything loads up fine and all of my stories show, however when I try to search, the components do not get filtered and if I peak in the console  I can see a couple errors:
TypeError: t.parameters.fileName.includes is not a function. (In 't.parameters.fileName.includes(e)', 't.parameters.fileName.includes' is undefined)

TypeError: e.toLocaleLowerCase is not a function. (In 'e.toLocaleLowerCase()', 'e.toLocaleLowerCase' is undefined)

To Reproduce
Steps to reproduce the behavior:

Create a static build: STORYBOOK_ON=true build-storybook -c .storybook -o .storybook-dist
Host the build http-server .storybook-dist
Search anything
Open console and see error with no search on components

Expected behavior
I should be able to search components by name when using a static build.
Screenshots

Code snippets
My webpack:

const path = require('path');
const { existsSync } = require('fs');

const pkgPath = path.join(__dirname, '../../package.json');
const { theme } = existsSync(pkgPath) ? require(pkgPath) : {}; // eslint-disable-line import/no-dynamic-require

module.exports = {
  mode: 'development',

  // In production, we skip all hot-reloading stuff
  entry: [path.join(process.cwd(), 'src')],

  module: {
    rules: [
      {
        test: /\.less$/,
        use: [
          'style-loader',
          'css-loader',
          `less-loader?{"sourceMap":true,"modifyVars":${
            JSON.stringify(theme)}, "javascriptEnabled":true}`,
        ], // compiles Less to CSS
      },
    ],
  },
  plugins: [
  ],
  resolve: {
    modules: ['src', 'node_modules'],
    extensions: [
      '.ts',
      '.tsx',
      '.js',
      '.jsx',
      '.react.js',
    ],
  },
};

my babel.config.js
module.exports = {
  presets: [
    '@babel/preset-env',
    '@babel/preset-react',
  ],
  plugins: [
    '@babel/plugin-proposal-class-properties',
    'babel-plugin-styled-components',
    ['import', {
      libraryName: 'antd',
      libraryDirectory: 'lib',
      style: true,
    }],
  ],
  env: {
    test: {
      plugins: [
        'require-context-hook',
      ],
    },
  },
};

System:

OS: MacOs and Netlify (linux)
Device: Macbook Pro 2018 and Netlify
Browser: chrome and safari
Framework: react
Addons:
"@storybook/addon-actions": "^5.0.0",
"@storybook/addon-links": "^5.0.0",
"@storybook/addon-storyshots": "^5.0.0",
"@storybook/addons": "^5.0.0",
Version: 5.0.0

Additional context
Add any other context about the problem here.

I just also recently discovered this. thanks @michaelfarrell76

Thanks for the report! This is duplicate to #5907 where there's also a solution PR pending. Closing for now 👍


Document comptable Containerd versions in README.md

Containerd is still evolving quickly, interfaces and behaviors may change between Cotnainerd versions. It would be great to document compatible Containerd versions for each version of rust crates in the README.md.

Yeah，it's better to release the extensions version the same to the latest compatible containerd version, thus the extension users can easily know that their programs compatible with which containerd version.

We usually don't do changes that break compatibility but rather deprecate things.
Shim runtime v2 expected to work with newer versions of containerd.
(we have an issue to add CI tests to track binary compatibility - https://github.com/containerd/containerd/issues/3757).
So I'm not sure there is strong need to keep up with containerd releases.
I'd rather do (somewhere on my list) integration tests for the rust extensions. I believe we can do a matrix on containerd versions similarly to how it's done in nerdctl (example https://github.com/containerd/nerdctl/runs/4518724866) to make sure no things broken.

It's a great idea to setup CI tests to ensure compatibility between shim and Containerd.
The goal is to guarantee  compatibility:)


"/dev/stdin: No such device or address" message when running Bash Debug in VSCode

OS: Ubuntu 18.04
Bash Debug 0.3.7
I am running VScode on my Ubuntu 18.04. When I run the program with in the debug console I get the following error message

/home/kumar/.vscode/extensions/rogalmic.bash-debug-0.3.7/bashdb_dir/command/source.sh: line 41: /dev/stdin: No such device or address
test
test2
bash: line 1: 19997 Killed                  "bash" "/home/kumar/.vscode/extensions/rogalmic.bash-debug-0.3.7/bashdb_dir/bashdb" --quiet --tty "/tmp/vscode-bash-debug-fifo-15522" --tty_in "/tmp/vscode-bash-debug-fifo-15522_in" --library "/home/kumar/.vscode/extensions/rogalmic.bash-debug-0.3.7/bashdb_dir" -- "/home/kumar/DevWrkSpc/bashwrkspace/test.sh"

Is this expected message or have I configured it wrong?
Please note I am new to Linux development and VSCode might be a dumb question.
Thanks

There is terminalKind setting in launch. Json. Please try different options, since default 'debugconsole' does not support stdin, as mentioned in Readme.

For anyone else encountering this issue, this launch.json worked for me:
{
    "version": "0.2.0",
    "configurations": [
        {
            "type": "bashdb",
            "request": "launch",
            "terminalKind": "integrated" ,
            "name": "Bash-Debug (simplest configuration)",
            "program": "${file}"
        }
    ]
}

thank you,useful


need help

giveaway\node_modules\discord-giveaways\src\Manager.js:76
            .setTitle(typeof giveaway.messages.title === 'string' ? giveaway.messages.title : giveaway.prize)
                                               ^

TypeError: Cannot read properties of undefined (reading 'title')
    at GiveawayManagerCustom.generateMainEmbed (C:\Users\sixpa\OneDrive\Desktop\giveaway\node_modules\discord-giveaways\src\Manager.js:76:48)
    at C:\Users\sixpa\OneDrive\Desktop\giveaway\node_modules\discord-giveaways\src\Manager.js:596:39
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

This is not an error from the code. It's a issue on the giveaways npm package. Either you tried to customize it and broke it or genuine issue on the giveaway package. Try reinstalling the package or check the discord-giveaways package code for any known issue.


Updated your link as its invalid

Unfortunately I clicked on your link and its giving 404, I have updated correct link. Thank you.

=> https://github.com/tapaswenipathak/Women-GitHubers/pull/154.


Fix: e2e tests

This PR fixes e2e tests by removing the grunt-protractor-webdriver module and manually installing and running the selenium webdriver.

@jamesjwarren this PR should fixes your failing branch

looks good :+1:


There are repeated word/occurrence pairs in the tWL

v0.2.0 build cbad9c9
This looks like it is probably a content error, and that the occurrence number is incorrect for the second instance of both Isaac and Jacob is incorrect.

@cckozie - but if you removed the extra occurrences of brother, how would the user see where/how each occurrence of the word is translated?  Also do you just highlight all occurrences of the word in the scripture?  And then how should we handle if some words have differing Original Language Quotes?

@PhotoNomad0 - I'm pretty sure this is fundamentally a content problem. I'm not sure what, if anything, should be done about it in gatewayEdit, but we should probably have a plan.

@cckozie What is the reference for this example?

@cckozie Yes, this is a content issue, but we want to note that we didn't create that issue. Whatever script was used to add in the occurrence numbers was not able to do them correctly.
The question of how to fix it is more complicated. It does not seem efficient for the Content team to go through tens of thousands of these manually to correct them. It seems like there needs to be a software solution that would find all multiple occurrence in the same verse and increment the occurrence number sequentially.
As a content guy, I have to ask, "How hard can that be…". :)

@RobH123 does your script add in the occurrence number for TWL?

Yes, I checked my code and it indeed attempts to get the correct occurrence number as you'll see with υἱοῦ in Mat 1:1.
If you look carefully at the spelling of the words that are claimed to have the wrong occurrence numbers (and particularly look at the accent on the last vowel), the same word does NOT occur more than once in Mat 1:2 except for ἐγέννησεν which has the correct occurrence numbers on it.
In other words, I think this issue is a side-track. What was the actual problem that led to it?

@cckozie ^^

My bad. Closing the issue.

@RobH123 Do you know if the occurrences field has been checked in the latest script?

Not sure what you mean @birchamp .
And as for Perry's apparent comment @cckozie, perhaps he was thinking at a different level or asked the wrong question. TWLs are currently in the UHB and UGNT, i.e., they're connected to Heb and Greek words at file level. So also for the new TSV TWLs.


Custom InputView dismissing keyboard when chat view is tapped

Using the example to build my own custom input view, I'm having a hard time understanding how I would dismiss the keyboard when the user taps on the chat view
I notice the internal implementation of the ChatView has
 @StateObject private var globalFocusState = GlobalFocusState()
.environmentObject(globalFocusState)

but that is not something I can access inside inputViewBuilder. I tried defining my own
@FocusState private var isChatFocus: Bool

but i don't have a handler to use to dismiss it when the user taps on the chat view. I tried onTapGesture on the chat view, but it doesn't fire.
ChatView(messages: viewModel.messages) { draft in
    viewModel.send(draft: draft)
} inputViewBuilder: { textBinding, attachments, state, style, actionClosure in
    Group {
        switch style {
        case .message: // input view on chat screen
            VStack {
                HStack {
                    Button("Send") { actionClosure(.send) }
                    Button("Attach") { actionClosure(.photo) }
                }
                TextField("Write your message", text: textBinding)
            }
        case .signature: // input view on photo selection screen
            VStack {
                HStack {
                    Button("Send") { actionClosure(.send) }
                }
                TextField("Compose a signature for photo", text: textBinding)
                    .background(Color.green)
            }
        }
    }
}```

Taking a look at the existing code, it looks like there already exists an @FocusState that keeps track of the uid currently being focused, which determines whether the keyboard is displayed or hidden.
`import SwiftUI
struct TextInputView: View {
@Environment(\.chatTheme) private var theme

@EnvironmentObject private var globalFocusState: GlobalFocusState

@Binding var text: String
var inputFieldId: UUID
var style: InputViewStyle

var body: some View {
    TextField("", text: $text, axis: .vertical)
        .customFocus($globalFocusState.focus, equals: .uuid(inputFieldId))
        .placeholder(when: text.isEmpty) {
            Text(style.placeholder)
                .foregroundColor(theme.colors.buttonBackground)
        }
        .foregroundColor(style == .message ? theme.colors.textLightContext : theme.colors.textDarkContext)
        .padding(.vertical, 10)
        .onTapGesture {
            globalFocusState.focus = .uuid(inputFieldId)
        }
}

}`
This is from the default input view TextInputView.swift, and shows that when the text field is tapped, the globalFocusState.focus is set toward its corresponding uid. And in the root body of code, ChatView.swift, whenever the user taps elsewhere, the globalFocusState.focus is set to nil (hiding the keyboard).
I think if you build your custom input around the existing globalFocusState.focus in the project, your custom implementation should be able to work.

Thanks @2brandonh !!! Looks like it can work, the problem i have is that a lot of the internals are not visible outside the module (e.g. the GlobalFocusState has a default internal access modifier), so I'm kind of limited with what I have to work with provided by the closure.
final class GlobalFocusState: ObservableObject {
    @Published var focus: Focusable?
}

May need to fork this or download it as a local repository to open up the visibility level

Hey @bennettl @2brandonh, I've added dismissKeyboardClosure into inputViewBuilder, I hope that helps. Please let me know if you have any other mechanism of keyboard dismissing you'd like me to implement. You can also use this UIApplication.shared.sendAction(#selector(UIResponder.resignFirstResponder), to: nil, from: nil, for: nil) if you can use UIKit in your projects

Hi @f3dm76
I hope you are doing well.
I have a ChatView with custom Message and InputView.
How can I do something like tapping around to dismiss the keyboard?


Export Issues in 5.8.1 with new AE 22.0 version

Can't Export all the images from the project, there are 15+ images from which only 10 images are exported, every time at the end of the render it throws an error code 517 or something which says "Null is not an object", and when i check the folder it doesn't export all the images,
i have "Allow script to access network" option enabled in preference,
tried many ways but looks like it doesn't perfectly works with AE 22.0 ?
bcz i tried 2018 version and it works fine

can you share the project and needed assets?

can you share the project and needed assets?

sorry, it's a client work so i can't really share the assets,
it's a simple slideshow video with 20 images, nulls are there affecting some images and one text field.
in bodymovin settings, i wanted editable texts so "Glyphs" is disabled, i want the images without compression so "Copy Original Assets" is enabled, "Original Assets Name" is also needed, and other prefs are as it is,
these same prefs are working fine with older version of bodymovin(5.7.13) and After effects(2018)
but in newer version as i said not all the images are exported

I can't reproduce it with those instructions.
Could you share a simple example without using the client work?


add support for circleci in ci subcommand

Addresses #201

Hello @UjjwalAyyangar! Thanks for submitting the PR.

In the file cli/popper/commands/cmd_ci.py, following are the PEP8 issues :

Line 20:13: E203 whitespace before ':'
Line 35:1: E122 continuation line missing indentation or outdented
Line 38:1: E122 continuation line missing indentation or outdented
Line 39:1: E122 continuation line missing indentation or outdented
Line 44:1: E122 continuation line missing indentation or outdented
Line 45:1: E122 continuation line missing indentation or outdented
Line 46:1: E122 continuation line missing indentation or outdented
Line 63:1: E901 TokenError: EOF in multi-line statement

thanks a lot!


Twitter auth doesn't work on Netlify previews.

this is not fixable at the moment, but probably should hide twitter auth on that


Importing no indexes results with success

When running php bin/console meili:import it returns a successful Done! even if no indexes are defined via cli or via yaml file.
It should print a warning that no indices are defined, as it does when providing indices via cli but none is found.

Seems like a great fix! :)


homework-11

Metric
Value

alert_status
:white_check_mark: OK

bugs
0

code_smells
1

reliability_rating
A (0 Bugs)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0


Doesnt work

Hi.
Doesnt work this plugin in Vue 2.6.10.
I think the problem is that they dont work correctly path in vue-loader.

Currently using it on a project with 2.6.10 and it works like a charm.
With no additional information, it’s really hard to help...


do  you have a plan to build a version which  only support .NET CORE?

the framework 4.8 is the lastest version for framework ,microsoft will  not update framework  after 4.8, it call .NET 5 next year which is build on .NET CORE.so i think the project had support .NET Stardard1.X and  framework3.x framework4.x is to fat.thanks

v5


feat(card): heading typography

What I did

add new css props for heading typography
update the variants.html demo (likely to conflict with promo pr)

Testing Instructions

compare all demos to main branch
https://deploy-preview-1701--red-hat-design-system.netlify.app/elements/card/demo/
https://deploy-preview-1701--red-hat-design-system.netlify.app/elements/card/demo/color-context/

Notes to Reviewers
Some users may consider this breaking, as it adds !important to heading css.
cc @OneEightyFirst @zhawkins. Note that this is scheduled for Charmander (2.0)

@marionnegp PTAL. I observed that - maddeningly - the computed value in dev tools was 1.5, however, it actually displayed with 1.3.
I confirmed that by inspecting the heading element and running this in the console:
getComputedStyle($0).lineHeight
"31.2px"

@marionnegp I'm going to merge this into the staging/charmander branch. If line height remains problematic, let's open a new issue. TY!

@marionnegp I'm going to merge this into the staging/charmander branch. If line height remains problematic, let's open a new issue. TY!

Looks like it's working now. Thanks!


keep prefix after glob?

I often use glob to get a list of files. I may loop over this to do similar operations over a file. It'll be nice if I could keep the prefix e.g. (s3://) instead of adding that back in myself:
import s3fs
fs = s3fs.S3FileSystem()

files = fs.glob("s3://bucket/YYYYMM*")
# files = [bucket/path/YYYYMM01, bucket/path/YYYYMM02] ...

Would like
# files = [s3://bucket/path/YYYYMM01, s3://bucket/path/YYYYMM02] ...

Easy to add a user but common enough that it would be nice if I could avoid this step. e.g. have a keep_prefix=True kwarg?
Current work arounds
for file in files:
    pd.read_parquet("s3://" + file)

or
files = ["s3://" + file for file in files]

I agree that this would be a nice feature to have, although preferably at the fsspec level for consistency with other providers.  I am not sure how well that would work with various chained schemes like fsspec supports.
You could maybe achieve a similar approach using UPath, a nifty package that builds on pathlib using fsspec for the underlying filesystem interactions.  Using that, you could do something like:
from upath import UPath

upath = UPath("s3://bucket/YYYYMM")

for file in upath.glob("*"):
    pd.read_parquet(file)

Hurray for UPath! I didn't know it had gone so far. Is it ready to be generally recommended?
Getting back into the specific question, it's not totally unreasonable, but I think would break other things, and is especially tricky for implementations that may have multiple protocols.
I was thinking that it might be a good idea (e.g., https://github.com/intake/filesystem_spec/pull/723 ) to have a general-purpose API, so you would do fsspec.glob("s3://...") and expect "s3://..." paths back.

Hurray indeed!  I think UPath is awesome and well designed, thanks, of course, to s3fs and fsspec, so hurray for those too!  :)
Not sure if it is ready for general recommendation yet, I will defer to the author @andrewfulton9 on that.
There is an s3fs specific implementation that seems to have been around for some time and to my knowledge seems stable, which is why I thought it might be fitting for this particular scenario.


Powerbi Updates

I have been using PowerBI for over 2 years now and updating almost each month. the last few updates on a windows 10 pro system almost never go through without issues. and the last one just wont install! i have tried uninstalling the previous version, deleting registry entries, deleting folders of powerbi, running the uninstall fix utility, cleaning temp folders, program file directory, app data. just about everything. the error message is "the feature you are trying to use is on a network resource that is unavailable. click ok to try again or enter an alternative path to a folder containing the install package..... Note i also run my Powerbi on Citrix on the same the same computer (office computer)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ba6a76e2-8d94-5e76-bfb6-971c3b2c7c85
Version Independent ID: f7bd2111-3bb0-fb08-0f23-a31efd407f66
Content: What's new in the latest Power BI Desktop update? - Power BI
Content Source: powerbi-docs/desktop-latest-update.md
Service: powerbi
GitHub Login: @davidiseminger
Microsoft Alias: davidi

@Bluetaurean - thanks for your feedback. That's an engineering issue, rather than docs, so please check in with support.powerbi.com and submit there, so hopefully someone can help you there.


Review and adjust the "DocuSign" integration for EasyCLA

In August, DocuSign will be officially removing its old-style authentication strategy (currently it’s deprecated).  This will likely impact our DocuSign workflow. We need to update, and test this.
It may be related to this Python bits: https://github.com/communitybridge/easycla/blob/main/cla-backend/cla/models/docusign_models.py#L36-L40

Story implementation will be tracked on the below issue, So moving status Done

Upgrade DocuSign Integration for EasyCLA #4002

We switched to Golang instead of Python so this ticket in no longer relevant, so closing. Ticket related to Golang is here: https://github.com/communitybridge/easycla/issues/4002


feat: uniswap private flow

Part of #2167 - create the private flow for uniswap
This is already a large PR so omitted failure cases and public flow.

UniswapPortal.sol -> has a separate flow for public and private. Updated relevant tests too
Uniswap aztec-nr contract -> just the private flow for now.
Deleted the sandbox example
Updated e2e uniswap test with the private flow. Failure cases and public flow will be in a separate PR
Update the canary test

Also comments out base rollup check on public data reads as explained in #2521

PSA - updated the getL1ContractAddresses() in 62fcb01 which was looking for the HTTP router to fetch info and therefore causing the sandbox to timeout
H/t @spypsy


FormatEntity returns string for SCPI command. Would like it to return double array.

I have configured a node in my dripline runtime-config like so
      - name: na_s21_iq_data
        module: FormatEntity
        get_str: ":CALC:PAR:DEF S21; :CALC1:DATA:SDAT?"
        calibration: "[{}]"
        log_routing_key_prefix: 'na_sensor_double_precision_arr'
        log_interval: 30

The raw value is in a string array, and this is really problematic for inserting into my database. Is there a way to have this FormatEntity log a double array instead of a text array?
I looked into the source code for FormatEntity.
https://github.com/driplineorg/dripline-python/blob/master/dripline/implementations/entity_endpoints.py#L90
I don't understand whatget_reply_floatdoes.

Um...:

get_reply_float doesn't look like it does anything and should be removed (there was a dripline2 features that used it but it wasn't done well).
You may be able to use extract_raw_regex, this uses a regular expression to extract the raw value from the full device return content. We don't support arbitrary content there though, it needs to get pulled in a single match.

The usual expectation is that the "value_raw" is either exactly the raw result reported from the devices, or extremely close to it. One question is if you're trying to log value_raw or value_cal? It looks like your value_cal is just the value raw wrapped in square braces; and like you're using a dedicated logger (per the existence of a custom log prefix). You could instead use the calibration to do the type conversion; if you're getting back ['1','2','3'] as value raw, your calibration could be '{float(item) for item in {}}' for example. Then when you configure the logger, map the value_cal payload key into your desired database column.
Other options would be to either write a custom class inheriting FormatEntity and have it do your extra conversion/parsing, or modify the logger to support type casting. I believe that sqlalchemy and/or postgres support a certain amount of implicit type casting, (if you had a string representation of a number in a variable and used that to populate a double precision column I think it would get cast for you, but I'm not sure if it goes as far as to try and convert array contents. The number of possibilities there is getting quite large and it is a bit hard to imagine how to add something in a generic way. But I'm open to suggestions.

I'm putting my value_raw I think I'm going to use the calibration to caste the raw output into what I need it to be. I was also thinking about a keyword argument that would let me cast the output to whatever I needed it to be, but I don't know how I would implement that or if that would be good design.
'value_raw': '-1.04600565594E-004,+4.57950993568E-004,-1.69978202812E-004,-1.63903595102E-004,+1.15204875394E-004,+4.52699172091E-005,-4.66801287504E-005,-2.56885523173E-004,-4.43908296390E-004,-2.70173888709E-004,-1.69204512470E-004,+1.04284868153E-004,-3.36453185906E-004,-1.93761346585E-005,+1.31158410390E-004,-1.46643710047E-004,+1.09289097877E-004,-1.74496870971E-004,+6.94236533998E-005,-1.05078962205E-004,-4.24703851163E-004,+6.81723096335E-005,+1.47371161813E-004,+2.28639984725E-004,+2.33325816961E-005,-5.04767511731E-005,-4.32081529939E-005,+2.37072043893E-004,+3.89962617351E-005,-5.80958774181E-005,-2.26477899758E-004,-1.94973554986E-004,+3.31197736323E-005,-5.85429569946E-006,+6.57294426792E-005,+6.65448343615E-005,-3.51664571861E-004,+2.37102859173E-004,+2.82527599623E-004,+3.62836476544E-004,-8.07725444568E-004,+3.03516395873E-004,+2.71173655897E-004,-2.60293000281E-004,+4.13029014963E-004,+9.04426024893E-005,-1.34687418683E-004,-4.66330743418E-004,+2.41016626193E-004,-8.17540125593E-005,+6.72094557523E-005,-4.58820888574E-004,-5.10870773135E-004,+7.02939119036E-005,+1.14638252749E-004,-1.88264912369E-004,+1.86092747072E-004,-3.64314308693E-004,+4.02216253447E-004,-1.61101402716E-004,+1.52671712246E-004,-1.76391894274E-005,-1.66462288496E-005,+1.28070325568E-004,-1.62026097983E-004,-2.57254683930E-004,+3.81101619576E-004,-6.51343924624E-005,+9.40168867004E-005,-2.80493552323E-004,-9.05927190783E-005,+3.44904346016E-004,-1.35416374212E-004,+1.47461327690E-004,-5.22831722973E-005,-5.80053862050E-006,+7.81561014265E-005,-2.00181125645E-004,+1.84542173475E-004,-1.56195643139E-004,-9.40823616346E-005,+1.10828973116E-004,+2.02317260929E-004,-3.42752340051E-004,-1.61148840502E-004,+8.21317507462E-005,+1.51716424797E-004,-2.92013139693E-004,+2.36438704116E-004,+3.04451917629E-004,-2.27841158274E-004,+3.43830705205E-004,+1.10622844180E-004,+1.14376773068E-004,+6.67321752457E-005,-1.50778223599E-004,+1.97506953322E-005,+1.53606029148E-004,+9.64969734361E-005,+8.40308364134E-005,+3.32735025430E-004,-1.70396781469E-004,-1.64716743374E-004,-7.29721824862E-006,-3.04097380928E-004,-2.57060103533E-004,-1.18629744549E-004,+1.77476255331E-004,+5.16368773770E-004,+3.77057805156E-005,+3.90186885417E-005,-6.09286327267E-005,+1.34410104739E-005,+2.21727391503E-004,+2.65201227229E-005,+7.98855489708E-006,+6.43802900723E-005,-2.92946267316E-004,-6.19817879087E-006,+4.88606336206E-004,+1.67712298871E-004,+2.58661685627E-004,-1.38006856818E-004,+2.44081189123E-005,+3.27397575678E-004,-1.74054060967E-004,-2.59466060585E-005,-5.91154357068E-004,-2.69849750011E-004,-5.34190848097E-005,+6.37639754728E-005,-3.06714824513E-004,+2.93110021653E-004,+1.57546823997E-004,-3.83509112563E-005,+2.48870510032E-004,+4.66046152891E-004,+5.37255274526E-005,-2.19825123817E-004,-1.94204242999E-004,-3.61401895951E-004,-2.62308452043E-004,+2.95106843906E-004,-2.09152900316E-004,-2.05019939410E-004,-3.57323100417E-004,+2.22124289824E-004,-1.71387638378E-005,+1.09851794262E-005,+1.65558842999E-004,-2.35793335631E-005,-1.05706572763E-004,-4.82394872162E-004,+1.91961198299E-004,+2.62683537792E-004,-2.32812934593E-006,-6.28026088963E-005,-6.89377426421E-005,-2.25028848468E-004,-6.11049126689E-005,+1.94295459372E-005,-3.91233851473E-004,+3.08134434977E-004,+3.03583874782E-004,+2.48059502607E-004,-1.19282164390E-004,+1.81497864630E-005,-2.60972517744E-004,+2.43367112150E-004,-5.41505656235E-005,+1.91052550701E-004,-1.49667420225E-004,-1.97449119760E-004,-5.16781653562E-004,+1.70129252567E-005,+5.94268030272E-005,+2.93927679567E-004,-2.11549901164E-004,+2.32987458731E-005,-3.31140737757E-004,-2.29748575375E-004,+5.20189114871E-005,-2.14524750952E-004,-6.71379611022E-005,+2.96509401539E-004,-5.56906452473E-004,+1.91470490354E-004,-4.28275080676E-004,-1.08395884097E-004,-1.63520584956E-004,-1.85279560283E-004,-2.31539954844E-004,-1.66356224168E-004,-8.94490589840E-005,-7.36538462919E-005,-7.19794312360E-004,-9.80899626241E-005,-3.31162842369E-005,+1.90449240406E-004,-2.92110322099E-004,-6.77342146336E-004,-8.16708839139E-005,+1.21132266887E-004,-3.81501427871E-004,+3.70957688718E-005,-3.97091090680E-004,-5.57927281420E-005,+1.89870497151E-004,-2.73392681753E-004,+1.18500229272E-004,-3.11724776094E-004,-2.22875256682E-004,+6.78777484239E-005,+3.25106193310E-004,+9.45591349793E-005,+2.16744914974E-004,-1.31363505780E-004,+5.88122256394E-005,-5.06400475608E-004,+4.35080443060E-004,+1.97262335191E-004,+4.57093018500E-005,-1.25959680100E-004,+1.55671395372E-004,-1.80751951619E-004,-2.66808052946E-004,-1.78419504256E-004,-6.05807990443E-004,-3.52640015920E-004,+2.52416929691E-004,+3.10521517443E-004,-7.16179103117E-005,+3.63199626064E-004,+3.83259288789E-004,+1.74781807665E-004,+2.96512530051E-004,-4.65031277389E-004,+1.50602031628E-004,+3.42880748380E-004,-9.45545295711E-005,-6.80931387259E-004,+7.20823081499E-005,-2.65439266766E-004,+1.08952147549E-004,+1.00023141488E-003,-4.59002350635E-004,-2.58155045641E-004,-4.44452887741E-004,+1.50049677574E-004,+1.37216273963E-004,+2.03123856890E-004,+3.69738556136E-004,-2.52269778956E-004,+9.86254203073E-005,+2.42602000912E-005,-2.68173435267E-004,+1.97548696638E-004,-1.08093139834E-004,+4.58341643710E-004,+8.05680495339E-005,-8.24457731919E-004,-8.84272322468E-004,-6.45756760166E-004,-2.00322590441E-004,+1.41491079800E-004,+4.41070649131E-004,+3.35187805984E-004,-1.86960516847E-004,+5.15401688494E-004,+6.99166063286E-005,+3.99416725214E-004,+2.10891823179E-004,+6.84480425585E-004,-1.27353217439E-004,-3.54972932568E-004,-1.63535347202E-004,+2.34387385164E-004,-8.12777207714E-005,+3.24300281676E-004,+1.34578128937E-004,-7.68559129416E-005,+3.96600037328E-004,+7.32522756822E-005,-7.63588594293E-004,+1.91093100020E-004,+1.28181411665E-005,-1.91761446983E-005,+2.24644915500E-004,+1.25627953181E-004,-1.59897972593E-004,-2.26687532322E-004,-2.60474829340E-004,-4.49839310183E-004,-2.13466595069E-004,-1.21916890485E-004,+2.41636095545E-004,+1.06074438735E-005,+6.82107238636E-005,-2.86867708062E-005,-1.41560513069E-004,-7.38120736930E-004,-2.52241200909E-004,+3.46569659128E-004,-5.33252943434E-005,-6.41399906701E-005,+2.95717129532E-004,-4.26665310631E-004,+1.39521677470E-004,-7.82817816298E-005,+3.54129813180E-004,+8.07560369657E-005,-2.86148135718E-004,-2.45360708011E-004,-3.19062506537E-004,+1.02081786669E-004,+6.69456506664E-005,+2.18596120698E-004,-2.95197228515E-004,-3.91843119114E-004,+1.92183615334E-004,-5.89089585393E-004,-2.84163516053E-004,+3.47874347598E-004,-4.44310391669E-004,-1.26799291878E-004,+2.50547682956E-004,-2.48168001075E-005,+2.73930702833E-004,+1.89568338925E-004,+1.73028749953E-004,-1.68676928853E-004,-7.75401130221E-004,+2.00912483052E-004,+1.27324083097E-004,-1.77043009601E-004,-2.68704897606E-004,+1.06850859883E-004,-2.26832762511E-004,+2.88448270535E-004,-1.53044637974E-004,+3.04697917724E-004,+1.28872601435E-004,+1.57744252421E-004,-3.98160072717E-004,+2.43497021412E-004,+1.67425807868E-005,+2.05729430335E-004,-4.45906657831E-004,+1.11124555763E-004,+3.29210940064E-004,+2.62710014821E-005,-4.98754727091E-004,-1.62262735818E-005,+6.20150843493E-005,+1.87541083537E-004,+7.48402151150E-004,-3.27175946167E-004,+4.49505561660E-004,-5.77606813653E-004,+3.43866354319E-004,-9.44671737638E-006,+4.71272936663E-004,+1.00844934685E-004,+5.38075522098E-005,+4.17214239368E-004,+4.69314277671E-004,+6.10755677395E-004,+2.55006533737E-004,+6.90471845050E-004,+4.86611790829E-005,+1.92548482196E-004,-3.99394580219E-004,+2.05217896600E-004,+5.74769792575E-004,-6.37091253086E-004,-1.60040368536E-004,+1.02229281753E-004,+3.65655148156E-005,+7.15881778367E-004,-3.56156609547E-005,-5.40992745802E-004,-2.11408847504E-004,+1.26413984155E-004,+2.26424984447E-005,+6.11961950117E-004,+1.87747485016E-004,-2.73956129739E-004,-7.17072872042E-004,+5.45591271399E-004,+3.83086313981E-004,-3.54048057189E-004,-1.24618848651E-004,+1.81528576227E-004,-7.69284995946E-004,-4.88247470071E-004,-5.35006797721E-004,+2.68121207441E-004,+1.78873513963E-004,-2.15658295155E-004,+5.30290974173E-005,+9.04428985035E-005,-9.52146920144E-005'}


How to bind hiredis-vip client to a particular IP and port?

I see from the code that hiredis automatically pick the client ip for tcp connection. Is there any option to specify the same?

I'm not sure if you can do that or not, but I think you want this repo


Workspaces cause incorrect linker args

For crates built upon pyo3, you need different linker args for binaries and libraries. Binaries need to link libpython, while libraries are forbidden by PEP 513 to link libpython. By default pyo3's build script add emits the arguments to link libpython and libraries use a feature called extension-module to deactivate those flags.
When building in a workspace with --all, cargo seems to conflate the linker args, causing linker errors. Pyo3 itself for example has a main crate with tests and an example that is an extension module. cargo test works fine and cd examples/word-count/ && cargo test also works fine, but cargo build --all --tests fails to compile the tests with linker errors missing libpython: Output of cargo build --all --tests -vvv. This seems to mean that cargo uses the linker args of the word count example with the extension module feature for the tests of pyo3 itself instead of using those for the pyo3 crate without the extension module feature.
This bug also occurs in dependent crate, e.g. rust-numpy. Building and testing works fine until you add a workspace with "example/extensions" in it, after which cargo test --all will fail with linker errors.
In summary, cargo seems to use the linker args of one crate in the workspace for all crates instead of using the correct ones for each crate.
Used Versions

cargo -V: cargo 1.29.0-nightly (6a7672ef5 2018-08-14)
pyo3: 3e7d5280ca18c38b8afc6eb75290b545743253df
rust-numpy: 6b6c70cde10a6d620e607fb8e9f1aee48ebbdf40

This is a conflation of a number of preexisting bugs. They're not super well indexed unfortunately. Cargo unions all features which means with --all it would union all the features requested by anything, and a different bug means that Cargo never compiles multiple versions of a crate with different sets of features meaning that a crate is only compiled once with one set of features.
In that sense it's not compatible with features today in Cargo to have a set of binaries that only work with a feature and a set that only work without, and then build them all at once.

As this is caused by feature unification, I'm closing this in favor of #4463. If there is a reason for us to keep this specific issue open, let us know!


Something wrong with CORS in v2.5?

Maybe it's on my side, however in http://stage.sofiadigital.fi/dvb/dvb-i-reference-application/frontend/android/player.html when pressing "Filter" I just get a CORS error in the console trying to open https://devel.sofiadigital.fi/home/tsa/dvb-i-reference-application/backend/servicelist_registry.php.
Cloning it on a local server, while trying to open [https://<IP_ADDRESS>/dash/dvbi/DVB-I-Reference-Client-master/backend/servicelist_registry.php] I just get an "HTTP Error 500".
Any clue?

I seem to have some similar issue. Menu items not showing up on Android

looks like there's a development server leftover in the public release. We'll fix this asap.

Development URL for the provider list was accidentally committed, fixed in a08c210b107b607087d121c40fc38f287b0608b8
The button issue was caused by a failure in selecting the default language, fixed in 6bacb458636d38b1d4bbb3f75def2991d2c31b8c

It works  now, thanks.
Would it be possible to replace PROVIDER_LIST with a relative URL instead of absolute?
It would allow a local deployment (without the need of manually updating dvbi-common.js)

Should be possible. The reason for the absolute url was that the relative URL isn't the same for HbbTV and Android clients because of the different directory structure. But it should be possible to determine the path of the dvbi-common.js and using that as the base for the relative provider lisrt URL.

Alternatvely, we could just have a config.js file that contains configurable items for local installations, with some comments about what these configurable items are for

I seem to have some similar issue. Menu items not showing up on Android

This is ow fixed!

Issue fixed. If the provider list URL needs to be changed to a relative URL, please make a new issue.


Router.pushI18n and Router.replaceI18n does not append lang with a custom server

Hello,
First thanks to next-translate, it provided me the solution to translate my serverless nextjs application.
I met this issue when I try to navigate using the pushI18n or replaceI18n methods:

Unhandled Rejection (Error): The provided as value (/es/article/my-random-article-2) is incompatible with the href value (/article/[id]). Read more: https://err.sh/zeit/next.js/incompatible-href-as

To reproduce it, I created the page article/[id].js under the pages directory of the example app examples/with-server:
import { useState } from 'react';
import Router from 'next-translate/Router';

export const getServerSideProps = async ({ query }) => {
  const { id } = query;

  return {
    props: {
      id,
    },
  };
};

export default function Article({ id }) {
  const [articleId, setArticleId]= useState(id);

  const onClick = () => Router.replaceI18n('/article/[id]', `/article/${articleId}`, { shallow: true });

  return (
    <>

Article {id}

        <input type='text' value={articleId} onChange={(e) => setArticleId(e.target.value)} />
        <button onClick={() => onClick()}>Redirect</button>

    </>
  )
}

It seems that the current lang is not prepended to the href.
Thanks for any help.

Hi @sbekaert, I'm not sure if this error it's from next-translate:

Unhandled Rejection (Error): The provided as value (/es/article/my-random-article-2) is incompatible with the href value (/article/[id]). Read more: https://err.sh/zeit/next.js/incompatible-href-as

As I see, you are using an incorrect syntax to navigate to a dynamic route. You should pass the id on the href. Something like:
function onClick() {
  Router.replaceI18n(`/article/[id]?id=${articleId}`, `/article/${articleId}`, {
    shallow: true,
  })
}

Can you try if this solves your problem? The Router.replaceI18n should add the lang for you.
Let me know 😄 And if is something from this lib, we are going to fix it! Thanks 😊

Hi @aralroca, my bad, it works!
Thanks a lot because I was convinced it was the right way to use replace with dynamic routes.
Thanks again.


Add Bloomberg footer image

Needs https://github.com/python/pypi-theme/pull/44

This can be completed using the features in #9512

This is blocked on creating an upload functionality for images in PyPI admin.