code can not achieve result in paper

I run some script in ‘script.txt’, but get result far away from result reported in paper.
Here are some result:
Office-home
Pr->Cl:52.37
Cl->Pr:78.64
Cl->Ar:72.39
Office-31
AD:94.98
AW:94.21
DW:76.78
Visda17
Train->Val:80.78
ps: apex didn't work well for some installation error, but i think it have no effect on result.(have effect on GPU memory and accumulation.)
（【fused_weight_gradient_mlp_cuda module not found. gradient accumulation fusion with weight gradient computation disabled.】 I didn't find a resolution for this error）

did you change any thing in the script? Can you show me the script you used for Visda? Thanks.

So, I think it's important to releasing baseline script/code for your backbone is different from standard ViT backbone

what do you mean by "baseline script/code"?

did you change any thing in the script? Can you show me the script you used for Visda? Thanks.

I change data_loader to my dataload function, which include
{transforms.Resize([256, 256]),
transforms.RandomCrop(args.img_size),
transforms.RandomHorizontalFlip(),
transforms.ToTensor(),
transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])
} operation.
others are as your script.
by the way, I think the result on visda17 is acceptable. results on office-31/office-home aren't.
CUDA_VISIBLE_DEVICES=7 python main.py --train_batch_size 64 --dataset visda --name visda --source_name train --target_name target --root_path /home/wendong/dataset/Vis2017 --source_list data/office/webcam_list.txt --target_list data/office/amazon_list.txt --test_list data/office/amazon_list.txt --num_classes 12 --model_type ViT-B_16 --pretrained_dir checkpoin
t/ViT-B_16.npz --num_steps 20000 --img_size 256 --beta 1.0 --gamma 0.01 --use_im

what do you mean by "baseline script/code"?

sorry, it was a misexpression. I mean code for implementing 【source only】 result.

Thanks. Let me test office-31 and office-home and let you know the result soon.
The code for [source only] will be released today. Will send you a message once I upload it.

Thanks. Let me test office-31 and office-home and let you know the result soon. The code for [source only] will be released today. Will send you a message once I upload it.

Thanks for your work. code for [source only] is important for implementing a transformer backbone network😂（especially for office datasets）.

Hi, the source-only code is uploaded, please let me know if you might need further information.
I tested the dw of Office-31, the result at the epoch 300 is below (the code is still running):

Result at epoch 500:

Result at epoch 500:

thanks, I will try it again, and paste result later.

Result at epoch 500:

I run the srouce-only code in office d-w and a->d task, in d->w task, performance is the same as you reported, however, in d->a, only 74.14

here is my cmd:
python train.py --train_batch_size 64 --dataset office --name da_source_only --train_list data/office/dslr_list.txt --test_list data/office/amazon_list.txt --num_classes 31 --model_type ViT-B_16 --pretrained_dir checkpoint/ViT-B_16.npz --num_steps 5000 --img_size 256
ps:use my dataloader,, which include
{transforms.Resize([256, 256]),
transforms.RandomCrop(256),
transforms.RandomHorizontalFlip(),
transforms.ToTensor(),
transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])
}

I use python3 train.py --train_batch_size 64 --dataset office --name da_source_test --train_list data/office/dslr_list.txt --test_list data/office/amazon_list.txt --num_classes 31 --model_type ViT-B_16 --pretrained_dir checkpoint/ViT-B_16.npz --num_steps 5000 --img_size 256 and get the following result:

I'm running the sourceOnly code on both office and office-home datasets and will post my results here once finished.

This is so weird. I will double check it and let you know ASAP. Thanks.

I just tested these two experiments. Not sure why you get quite different result. Let me upload the environment I used today.
da_source_only:

wa_source_only:

I just tested these two experiments. Not sure why you get quite different result. Let me upload the environment I used today.
da_source_only:

wa_source_only:

Thanks for your patience, I will re-download the database you paste in this repo and entirely use your dataloader to train later. (In a day or two，I will re-upload the results at that time)

I'm running the sourceOnly code on both office and office-home datasets and will post my results here once finished. --update-- On the office dataset, I got A->D: 89.36%; A->W: 90.06%; D->A: 76.36%; D->W: 98.49%; W->A: n/a; W->D: n/a For office-home, I got A->C: 60.85%; A->P: 78.01%; A->R: 83.61%; C->A: 70.29%; C->P: 78.06%;
The script I use is like this: python train.py --train_batch_size 64 --dataset office --name da_source_only --train_list data/office/dslr_list.txt --test_list data/office/amazon_list.txt --num_classes 31 --model_type ViT-B_16 --pretrained_dir checkpoint/ViT-B_16.npz --num_steps 5000 --img_size 256
The results are far from what are reported in the paper, please advise potential reasons for the failure of reproduction.

Hi, can you @hellowangqian @ShiyeLi follow the following requirement to rebuild your environment and try again? Thanks.
https://github.com/uta-smile/TVT/blob/main/README.md#environment-python-3812

I'm running the sourceOnly code on both office and office-home datasets and will post my results here once finished. --update-- On the office dataset, I got A->D: 89.36%; A->W: 90.06%; D->A: 76.36%; D->W: 98.49%; W->A: n/a; W->D: n/a For office-home, I got A->C: 60.85%; A->P: 78.01%; A->R: 83.61%; C->A: 70.29%; C->P: 78.06%;
The script I use is like this: python train.py --train_batch_size 64 --dataset office --name da_source_only --train_list data/office/dslr_list.txt --test_list data/office/amazon_list.txt --num_classes 31 --model_type ViT-B_16 --pretrained_dir checkpoint/ViT-B_16.npz --num_steps 5000 --img_size 256
The results are far from what are reported in the paper, please advise potential reasons for the failure of reproduction.

Hi, can you @hellowangqian @ShiyeLi follow the following requirement to rebuild your environment and try again? Thanks. https://github.com/uta-smile/TVT/blob/main/README.md#environment-python-3812

Sure, I'll setup a new environment following yours and re-run the experiments to see what happens.

I'm running the sourceOnly code on both office and office-home datasets and will post my results here once finished. --update-- A->D: 89.36%; A->W: 90.06%; D->A: 76.36%; D->W: 98.49%; W->A: 75.1%; W->D: 100%. For office-home, I got A->C: 60.85%; A->P: 78.01%; A->R: 83.61%; C->A: 70.29%; C->P: 78.06%; C->R: 80.3%; P->A: 67.5%; P->C: 52.5%; P->R: 83.0%; R->A:73.4%; R->C:

The script I use is like this: python train.py --train_batch_size 64 --dataset office --name da_source_only --train_list data/office/dslr_list.txt --test_list data/office/amazon_list.txt --num_classes 31 --model_type ViT-B_16 --pretrained_dir checkpoint/ViT-B_16.npz --num_steps 5000 --img_size 256
The results are far from what are reported in the paper, please advise potential reasons for the failure of reproduction.

Hi, can you @hellowangqian @ShiyeLi follow the following requirement to rebuild your environment and try again? Thanks. https://github.com/uta-smile/TVT/blob/main/README.md#environment-python-3812

Sure, I'll set up a new environment following yours and re-run the experiments to see what happens. ---Update---- I use the same environment as yours, unfortunately, there is no difference from what I got before (i.e. the quoted results).
May I ask @viyjy if you use the same code in the repo (e.g., cloning from the repo as I did) to reproduce the results above? I ask this to check the possibility that some unnoticed changes have been made when you uploaded your code to GitHub.

Yes, the result in https://github.com/uta-smile/TVT/issues/5#issuecomment-1064369287 is obtained by downloading the code from this repo and run it again. Which machine are you using?
BTW, please directly add a new comment below to discuss your issue. I don't receive the email reminder if you update your previous comment. Thanks.

Ubuntu 20.04 + Nvidia Titan RTX GPU

Titan RTX GPU

Are you using a single GPU to train the model?

Titan RTX GPU

Are you using a single GPU to train the model?

Yes.

Titan RTX GPU

Are you using a single GPU to train the model?

Yes.

The only difference is that my ubuntu version is 18.04, but I don't think it makes a difference to the result.

Titan RTX GPU

Are you using a single GPU to train the model?

Yes.

The only difference is that my ubuntu version is 18.04, but I don't think it makes a difference to the result.

Thanks for clarifying the details. I'll spend more time investigating the issue.

I'm running the sourceOnly code on both office and office-home datasets and will post my results here once finished. --update-- A->D: 89.36%; A->W: 90.06%; D->A: 76.36%; D->W: 98.49%; W->A: 75.1%; W->D: 100%. For office-home, I got A->C: 60.85%; A->P: 78.01%; A->R: 83.61%; C->A: 70.29%; C->P: 78.06%; C->R: 80.3%; P->A: 67.5%; P->C: 52.5%; P->R: 83.0%; R->A:73.4%; R->C:

The script I use is like this: python train.py --train_batch_size 64 --dataset office --name da_source_only --train_list data/office/dslr_list.txt --test_list data/office/amazon_list.txt --num_classes 31 --model_type ViT-B_16 --pretrained_dir checkpoint/ViT-B_16.npz --num_steps 5000 --img_size 256
The results are far from what are reported in the paper, please advise potential reasons for the failure of reproduction.

Hi, can you @hellowangqian @ShiyeLi follow the following requirement to rebuild your environment and try again? Thanks. https://github.com/uta-smile/TVT/blob/main/README.md#environment-python-3812

Sure, I'll set up a new environment following yours and re-run the experiments to see what happens. ---Update---- I use the same environment as yours, unfortunately, there is no difference from what I got before (i.e. the quoted results).
May I ask @viyjy if you use the same code in the repo (e.g., cloning from the repo as I did) to reproduce the results above? I ask this to check the possibility that some unnoticed changes have been made when you uploaded your code to GitHub.

Yes, the result in #5 (comment) is obtained by downloading the code from this repo and run it again. What kind of machine are you using? BTW, please directly add a new comment below to discuss your issue. I don't receive the email reminder if you update your previous comment. Thanks.

hi , I download the code and dataset again from this repo and run it without any modification. however , still can not reproduce baseline result in paper.
here is my result in office31(srconly,best result after 5000epoch):
W->A:75.29%
D->A:76.67%
A->D:89.56%
A->W:89.94%
My environment is a little bit different from yours.(caused by my CUDA version in servers.) But i don't think it's the primary cause.
*pytorch==1.12.0.dev20220224+cu111 (to use apex provide by https://github.com/NVIDIA/apex , can only install pytorch >=1.12)
*torchvision==0.12.0.dev20220224+cu111
*torchaudio==0.13.0.dev20220224+cu111
tqdm==4.50.2
tensorboard==2.8.0
*apex == 0.1 (command 'conda install -c conda-forge nvidia-apex' will attempt to install torch 1.4.0 as follow picture shows, which will conflict with torchvision in later running. So I install apex from https://github.com/NVIDIA/apex)
scipy==1.5.2
ml-collections==0.1.0
scikit-learn==0.23.2

Thanks, let check this.

@ShiyeLi Hi, would you please send the data.zip in Datasets to<EMAIL_ADDRESS>I wrongly deleted it from my google drive yesterday. Thanks.

<EMAIL_ADDRESS>
I have send this zip file, have you receive that?

<EMAIL_ADDRESS>
I have send this zip file, have you receive that?

Yes, thanks.

Sorry for the late reply, I still cannot reproduce your results. May I know which pre-trained ViT are you using? Thanks.

I use the pre-trained model 'ViT-B_16.npz' you provided in this repo.

Thanks. I will test this on another machine and will let you know by the end of today.

@hellowangqian @ShiyeLi which Pretrained ViT are you using?

Thanks. I have tested this code on another machine by downloading the repo, building the environment, and downloading the dataset all from scratch, but still cannot reproduce the issues you reported.

I guess all results reported in the paper are based on the ImageNet21K_ViT-B_16.npz pre-trained model, right? If so, It's expected to have lower performance when ViT-B_16.npz (pre-trained on ImageNet1K) is used. If you can get better results than what I shared above using ViT-B_16.npz (ImageNet1K), could you please share them here for reference? Thanks.

Right. Please check the following tables, where TVT* means the results by using ViT-B_16.npz (ImageNet1K).

Thanks, I haven't tried reproducing TVT* yet. What I got was for SourceOnly* (sourceOnly with ViT-B_16.npz). Since I've managed to reproduce SourceOnly results, my SourceOnly* results above should be close to yours if you have these results.

Sure, please let me know if you have any questions. BTW, I will upload the swin-T and swin-S version soon, which are more comparable to ResNet-50 and ResNet-101.


added spark orchestration using the azure data managed airflow

added HDInsight on AKS Apache spark orchestration using the azure data managed airflow

#assign: @JasonWHowell

@JasonWHowell - this is a new page

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

NOTE: If you approve the content, the commits in this PR will need to be moved to the private repo for a full review there.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@Jak-MS  - I have requested HDI on AKS team (@yeturis) to review the same.

@Jak-MS  - I have requested HDI on AKS team (@yeturis ) to review the same.

#please-close Microsoft employees should use the private repo for new pages. Please work with the content vendor if you need help.


Time ... is from a different process group

Occasionally seen in compliance test Starting chaos converges with clones starting from snapshot:
Failures:
1) Starting chaos converges with clones starting from snapshot
  Message:
    Unhandled promise rejection: Error: Error: Time [1,0,[3]] is from a different process group @ [0,"kwOTApEDAAM="]
  Stack:
        at /Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/clone.js:209:20
        at runMicrotasks (<anonymous>)
        at processTicksAndRejections (node:internal/process/task_queues:96:5)
        at async checkStatus (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/clone.js:208:11)
        at async send (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/clone.js:185:15)
        at async ChaosClone.transact (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/clone.js:123:22)
        at async time (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/2-chaos/chaos.js:39:18)
        at async ChaosClone.transact (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/2-chaos/chaos.js:82:30)
        at async ChaosClone.start (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/2-chaos/chaos.js:71:7)
        at async ChaosTest.<anonymous> (/Users/george/m-ld-js/node_modules/@m-ld/m-ld-spec/compliance/2-chaos/3-starting-chaos.spec.js:20:9)

Log:
2023-04-07T07:35:39.133Z Error: Time [1,0,[3]] is from a different process group @ [0,"kwOTApEDAAM="]
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:372:23)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at Object.next (/Users/george/m-ld-js/ext/engine/journal/JournalState.js:66:76)
    at SuSetDataset.<anonymous> (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:224:58)
    at Generator.next (<anonymous>)
    at fulfilled (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:11:58)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-04-07T07:35:39.155Z 82878718 SuSetDataset Error: Time [1,[5],0] is from a different process group @ [0,"kwOTApEDAAM="]
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:372:23)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at Object.next (/Users/george/m-ld-js/ext/engine/journal/JournalState.js:66:76)
    at SuSetDataset.OperationApplication.<anonymous> (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:491:33)
    at Generator.next (<anonymous>)
    at fulfilled (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:11:58)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5) [{},{"@id":"entity8","@type":"Entity","prop0":"3"}]
2023-04-07T07:35:39.156Z 82878718 DatasetEngine Shutting down due to Error: Time [1,[5],0] is from a different process group @ [0,"kwOTApEDAAM="]
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:372:23)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at Object.next (/Users/george/m-ld-js/ext/engine/journal/JournalState.js:66:76)
    at SuSetDataset.OperationApplication.<anonymous> (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:491:33)
    at Generator.next (<anonymous>)
    at fulfilled (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:11:58)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-04-07T07:35:39.156Z Error: Time [1,[5],0] is from a different process group @ [0,"kwOTApEDAAM="]
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:372:23)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at Object.next (/Users/george/m-ld-js/ext/engine/journal/JournalState.js:66:76)
    at SuSetDataset.OperationApplication.<anonymous> (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:491:33)
    at Generator.next (<anonymous>)
    at fulfilled (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:11:58)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-04-07T07:35:39.156Z 82878718 SuSetDataset Shutting down due to Error: Time [1,[5],0] is from a different process group @ [0,"kwOTApEDAAM="]
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:372:23)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at Object.next (/Users/george/m-ld-js/ext/engine/journal/JournalState.js:66:76)
    at SuSetDataset.OperationApplication.<anonymous> (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:491:33)
    at Generator.next (<anonymous>)
    at fulfilled (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:11:58)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
/Users/george/m-ld-js/node_modules/rxjs/dist/cjs/internal/util/reportUnhandledError.js:13
            throw err;
            ^

Error: Time [1,[5],0] is from a different process group @ [0,"kwOTApEDAAM="]
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:372:23)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at GlobalClock.set (/Users/george/m-ld-js/ext/engine/clocks.js:374:58)
    at Object.next (/Users/george/m-ld-js/ext/engine/journal/JournalState.js:66:76)
    at SuSetDataset.OperationApplication.<anonymous> (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:491:33)
    at Generator.next (<anonymous>)
    at fulfilled (/Users/george/m-ld-js/ext/engine/dataset/SuSetDataset.js:11:58)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
82878718 Error: read ECONNRESET
    at TCP.onStreamRead (node:internal/stream_base_commons:217:20) {
  errno: -54,
  code: 'ECONNRESET',
  syscall: 'read'
}

Analysis

A new clone is getting a new clock which includes a certain message
The snapshot request goes to a different collaborator, which has not received that message, and therefore does not include it in the GWC
The new clone accepts the snapshot, but rejects the message as outdated, since its clock includes it
When a message after the missed message is accepted, the GWC may see the clock's fork as invalid – actually this is a better outcome than the alternative, which is that messages are accepted without their causes.


Switch to GOV.UK design system

MTP apps used to use a combination of govuk-template, govuk-elements and govuk-frontend-toolkit. These are deprecated in favour of the more modern, flexible and accessible govuk-frontend.
Switching to the new framework involves changing ~pretty much~ every template, style and javascript module because govuk-frontend uses completely different patterns. It was decided that, during this upgrade, we should minimise our use of customised MTP-specific components where possible in favour of those provided by GDS.
MTP-1307

@Staberinde i have no idea why github is saying that the mtp_noms_ops/assets-static/images/sender-profile--*.png images are 0 bytes or empty files. i just checked out this branch freshly in a different path and i can see the images are between 500 and 3000 bytes, so they must have committed correctly :/


Page based offers

Short description

For offer providers for which support in the app has been added, add the option to embed offers in a page.
Proposed changes

add required fields to the OfferTemplate and Page models and forms
amend API response
amend fixture to utilize the feature and corresponding test cases

Side effects

not sure what is going on with the reformatting in the test_data.json, this is prettiers output 😦

Resolved issues

Fixes: #2360

Pull Request Review Guidelines

Great, thanks a lot! 👍
Now I wonder whether we should apply the same principle to the supported_by_app_in_content checkbox in the offer template form – maybe we should prevent unchecking this when the offer is embedded in at least one page? 😅 But I'd also be fine with merging this first and opening a new issue for this...

Hm, good point. The only situation I see this ever being an issue is if an offer provider changes/breaks their API and the app is no longer able to display the content.
Not sure what should happen in that situation though.
Maybe the reverse could work: allowing unchecking "supported by app in content" but then showing "warning: some previously embedded offers can currently not be displayed in the app" above the offer selection in the page form?


Deep wrapping of streams

The zstream(...) conversion doesn't work with certain types of streams, particularly older streams that are not streams2 compliant.  These need to be deep-wrapped in a way similar to RequestStream .  Ideally this would be detected and done automatically in the conversion code.

Fixed in #47


Release Toolium 1.5.6

Coverage increased (+0.03%) to 87.552% when pulling 930e9d0dcd74d9b66c102f4388445adf6a5efb38 on release/1.5.6 into 35644992b2cd8e719222c3bf5ceba9d30f4718b3 on master.

Coverage increased (+0.03%) to 87.552% when pulling 930e9d0dcd74d9b66c102f4388445adf6a5efb38 on release/1.5.6 into 35644992b2cd8e719222c3bf5ceba9d30f4718b3 on master.


github actions error

it looks that our team run out of the free github action time. The possible solutions are

open source the repository
add payment options
self-host the runners on akira

repo was made public


RDK-52297: Core system supports dynamic partner configuration

Reason for change: Invoke IARM event for RFC initialisation complete
Test Procedure: Build and Verify
Risks: low
Priority: P1
Signed-off-by: Naveenkumar<EMAIL_ADDRESS>

PR raised on behalf of<EMAIL_ADDRESS>CC: @tdeva14, @anand-ky


hugo: LHS nav: show active item in tree

Ignore the param 'toc_hide: true' for active items so the active item shows up in the nav-tree again because:

In order the see the table of contents the item needs to show in the left hand nav
To make clear where the active item lives in the current tree.

To test:

Click on How-To guides: The page 'Encode JSON or YAML with CUE' doesn't show up here because toc_hide is set to true.
Now go to this page  (/docs/howto/encode-json-yaml-with-cue/): the page now does show up in the lhs nav because it's active and also the table of contents is showing again (in current alpha when going to the same page it does not show up in the nav and therefore the table of contents is also not visible)

For https://linear.app/usmedia/issue/CUE-282

Closed via ac3925d5c0ea0560679f84aaf19046995ad919bc


Get rid of Nix dependency

As @Ma27 said in https://github.com/teozkr/Sbtix/pull/26#issuecomment-315321196, not everyone can (Windows users) or wants to use Nix (yet, hopefully). Thus, being able to generate Nix builds without having it installed would help make it easier for upstreams to provide up-to-date build files.

[ ] Hash it ourselves instead of using nix-prefetch-scripts if it's not installed
[ ] Make sbt genNix the main entry point, rather than sbtix-gen
[ ] Teach genNix about the "project" build, replacing sbtix-gen-all
[ ] Drop the sbtix-gen* scripts
[ ] Publish to Maven Central! (eventually)

just though a little bit about a possible implementation: we might want to generate a package set which contains the name of the derivation and the src (which consists of URL and hash).
Instead of nix-prefetch-* scripts we could fetch the data using Scala and compute the hashes on our side (I just checked it - node2nix does the same for instance).
Then we need to refactor our sbtix.nix expressions to do things like the download when running nix-build or nix-shell.
Would you be fine with such an approach?

All of that already works, nix-build should work without having ran sbtix-gen-* on the same machine. The only difference should be that we download it and calculate the hash in Scala, if nix-prefetch-* is not available.

if nix-prefetch-* is not available.

yeah that's why I want to compute the hash (optionally) on our side
but nix-prefetch-* stores the download artifacts in the Nix storewhich is immutable so we can't (and shouldn't) modify it, no?

but nix-prefetch-* stores the download artifacts in the Nix storewhich is immutable so we can't (and shouldn't) modify it, no?

We can add stuff to it by running nix-store --add $PATH. It might be better to use that instead of nix-prefetch-*, since

nix-prefetch-* is not included with core Nix
It means a smaller behaviour difference between running genNix on computers with and without Nix, which makes testing easier9

Also, in preparation for this, we should probably rename genComposition to something less likely to cause conflicts. genNixDerivation perhaps? Or just merge it into genNix.


20 user agent version

Issue #, if available: 20
Description of changes: has useragent report the version number from package.json
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

somehow package.lock got modified. undoing that.

fixed the package-lock thing

Thanks for the contribution!


Separate packages per platform and distribution

The nearest plan is to:

[x] create separate packages per platform (like tdlib.native.win-x64, tdlib.native.macos-x64, tdlib.native.ubuntu-20.04-x64

[x] the default package tdlib.native will include references to tdlib.native.win-x64, tdlib.native.osx-x64, tdlib.native.ubuntu-20.04-x64 (note only Ubuntu 20.04 for compatibility reasons) and won't include the binaries anymore

[x] create a new package for ubuntu-22.04-x64, separate for now (#66), as it'll conflict with ubuntu-20.04 if we include it into the default set
[x] create new packages for macos-arm64 (#74), this one it's safe to include into the default set

All this will have a downside that the user will have to explicitly collect the correct packages for their purposes, and there won't be an universally-accepted version anymore (we'll omit compat for Ubuntu 22.04 for now).
So, for the future, we should also do this, to have a version that just works out of the box and will include new distributions if required:

[ ] #118

repack the incompatible binaries into different directories (like the outdated RID graph model, linux/ubuntu-20.04 + linux/ubuntu-22.04)
add a special method, like TdLibNative.SetUpRuntimeResolver(), that the user will have to call manually to correctly resolve this
also expose constants with locations of binaries, for the users to use them in custom resolve scenarios if required

The remaining work has been extracted into #118.


depend on tensorflow instead of tensorflow-gpu

The smoke-test still runs with tensorflow==2.6.3

Checking...


Error while importing .IGS files

Hello all,
After converting an APDL script into a Python code using:
pymapdl.convert_script(apdl_inputfile, pyscript, macros_as_functions=True)

, I keep running into this error when I am trying to import an IGS file using:
mapdl.igesin("'Part1'","'IGS'","'OneDrive\Desktop\Simulation\'")

[Where 'Part1' is the name of the file, and the third argument is its path]
Error:
igesin() takes from 1 to 3 positional arguments but 4 were given
All I am seeing is 3 given arguments in the function. Am I missing something? Or is there another way of importing IGS files other than this?
Regards,
Ahmed Zeid

Seems that the function call is IGESIN, Fname, Ext, --
https://www.mm.bme.hu/~gyebro/files/ans_help_v182/ans_cmd/Hlp_C_IGESIN.html
It might be that the final arg is a path, but when these functions were created within MAPDL, any "unused" arguments were left out under the assumption that they wouldn't be used.  If you really want to run the command with three arguments, you can use:
mapdl.run('...')

Let me know if you encounter any issues with either approach.

Seems that the function call is IGESIN, Fname, Ext, --
https://www.mm.bme.hu/~gyebro/files/ans_help_v182/ans_cmd/Hlp_C_IGESIN.html
It might be that the final arg is a path, but when these functions were created within MAPDL, any "unused" arguments were left out under the assumption that they wouldn't be used.  If you really want to run the command with three arguments, you can use:
mapdl.run('...')

Let me know if you encounter any issues with either approach.

Hi @akaszynski , thanks a lot for your reply.
As you recommended, I followed the proper function call, and merged the file path into the filename argument. It works perfectly!
mapdl.igesin(r"'C:......\Part1'","'IGS'")
Thank you for your help!

Hi @akaszynski , thanks a lot for your reply.
As you recommended, I followed the proper function call, and merged the file path into the filename argument. It works perfectly!
mapdl.igesin(r"'C:......\Part1'","'IGS'")
Thank you for your help!


Generic int conformance issue

RWStructuredBuffer<int> outputBuffer;

struct GenericStruct<A : int>
{
};

struct AnotherGenericStruct<A : int>
{
    GenericStruct<A> a;
};
[numthreads(4, 1, 1)]
void computeMain(uint3 dispatchThreadID : SV_DispatchThreadID)
{
    int index = dispatchThreadID.x;
    AnotherGenericStruct<1> a;
	outputBuffer[index] = index;
}

Does not compile because...
slang(9): error 38029: type argument 'A' does not conform to the required interface 'int'
    GenericStruct<A> a;

Note that if A is a type this does compile.

This is just the let issue again... closing.


Add latest dask-ml to upstream testing

Adds an install of the latest dask-ml to our upstream testing, which should enable us to test out fixes in / breakage caused by dask-ml.
cc @ayushdg

Codecov Report

Merging #354 (101bb51) into main (98c38cf) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #354      +/-   ##
==========================================
- Coverage   95.56%   95.55%   -0.02%
==========================================
  Files          67       67
  Lines        2933     2924       -9
  Branches      547      547
==========================================
- Hits         2803     2794       -9
  Misses         79       79
  Partials       51       51

Impacted Files
Coverage Δ

dask_sql/server/responses.py
97.77% <0.00%> (-0.10%)
:arrow_down:

dask_sql/physical/rex/core/call.py
99.11% <0.00%> (-0.01%)
:arrow_down:

dask_sql/utils.py
100.00% <0.00%> (ø)

dask_sql/context.py
100.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 98c38cf...101bb51. Read the comment docs.


Rotating certificates causes worker node to become unavailable / kubelet not restarted

What kind of request is this (question/bug/enhancement/feature request): bug
Steps to reproduce (least amount of steps as possible):

On a HA setup, on rancher v - custom image(2.1.9), create an RKE cluster. (cert expiry - 30 minutes)
Upgrade to rancher:v2.1.9-rc2
wait for the certs to expire.
On expiration of certs, do a Rotate Certificates action.

Expected Result: the cluster should come back Active, and the nodes - should be Active.
Actual Result : Rotating certificates on a cluster causes the worker node to become unavailable with message Kubelet stopped posting node status.
The kubelet, kube-proxy and nginx-proxy pods on the worker nodes, did not restart after rotating the certs.
Other details that may be helpful:
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): rancher v2.1.9-rc2
Installation option (single install/HA): HA

Cluster information

Cluster type (Hosted/Infrastructure Provider/Custom/Imported): rke AWS cluster

Verified on rancher:v2.1.9-rc3.
Worker nodes come to Active state after rotating the certs. The kubelet, kube-proxy and nginx-proxy pods on the worker nodes, restarted after rotating the certs.


[Autocomplete] Warning message when option is not on the dropdown list.

I'm getting warning message regarding invalid autocomplete value

Material-UI: The value provided to Autocomplete is invalid.
None of the options match with {"id":1,"name":"OptionOne"}.

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
Hey guys. I'm using autocomplete component with a little bit customized asynchronous behavior. The difference between the standard example which you can find in the documentation and my is that it's connected to the paginated api which respond with new list on every debounced inputValue change.

Assume already selected option, for example OptionOne (may be the default one, but it's not necessary). I'm clicking on autocomplete component to select something else -> dropdown appears with paginated results (4 options from the beginning of the paginated list for example OptionOne, OptionTwo, OptionThree, OptionFour)) -> instead of picking something from the list I'm starting to type in the input for example "OptionTwo" -> as long as there is common part between the currently selected option and the word in the input (in that case word "Option") everything is fine (because it still appears on the dropdown list) -> as soon as input value is more specific ("OptionT") and there is no common part with currently selected option I get the warning about invalid input value. Of course I'm using "getOptionSelected" but for some reason it doesn't work as expected. I tried the same without using debounced input value (which I use for limit api calls) but nothing change.
  const getOptionSelected = (     option: BasicOption,     value: BasicOption,   ): boolean => {     return option.name === value.name;   };
Expected Behavior 🤔
No warning messages regarding invalid value.

Steps to Reproduce 🕹

Steps:

From option list (OptionOne, OptionTwo, OptionThree) choose OptionOne
Type in input "OptionTwo" -> warning appears

Here is my code - I would love to make it work on codesandbox but I can't find free api with pagination and quering and the same time
Link to the code
Context 🔦

Your Environment 🌎

Tech
Version

Material-UI
v4.9.1

React
16.8.6

Browser
Brave

TypeScript
3.7.2

I think it is more like a feature request. Using Autocomplete with async filtering, it is possible that the previously selected option will not be present in fetched options in more detailed filtering.

@jagin You would have to add this option back into the list. We cover the heart of the tradeoff in https://github.com/mui-org/material-ui/issues/18514#issuecomment-607277041.


zenith-nvidia: 0.13.1 -> 0.14.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/bvaisvil/zenith/releases.
meta.description for zenith-nvidia is: Sort of like top or htop but with zoom-able charts, network, and disk usage, and NVIDIA GPU usage
meta.homepage for zenith-nvidia is: https://github.com/bvaisvil/zenith
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.14.0 with grep in /nix/store/8xvny90w48izvg0p4bgdxb2cp1iyw0b0-zenith-0.14.0
found 0.14.0 in filename of file in /nix/store/8xvny90w48izvg0p4bgdxb2cp1iyw0b0-zenith-0.14.0

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath
zenith
zenith-nvidia

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/8xvny90w48izvg0p4bgdxb2cp1iyw0b0-zenith-0.14.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A zenith-nvidia https://github.com/r-ryantm/nixpkgs/archive/1e18b0b197f08a0206b0fa836c58654777ba4998.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/8xvny90w48izvg0p4bgdxb2cp1iyw0b0-zenith-0.14.0
ls -la /nix/store/8xvny90w48izvg0p4bgdxb2cp1iyw0b0-zenith-0.14.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages built:

zenith
zenith-nvidia

Maintainer pings
cc @bbigras for testing.

Result of nixpkgs-review pr 219291 run on aarch64-linux 1

2 packages built:

zenith
zenith-nvidia


Palindrome index problem:C# solution

Added a new solution for palindrome index problem using C# programming language

Hi @RyanFehr
Space complexity of this problem needs discussion. I think it should be O(n) and I've changed readme to reflect the same. The algorithm requires two pointers in which move simultaneous from start and end together. That is possible only when we've entire string present in memory. I think you're also doing the same in your Java solution. Quoting your code:
 String s = input.nextLine();
Please let me know your thoughts on the same.


Swift 2 version?

Do you have by any chance a swift 2 version?

Do you have by any chance a swift 2 version?

Sorry, Please Convert and PullRequest...! :sweat_smile:

I have just submitted a Pull Request for Swift 2 support with Xcode 7.
It works fine for me, if you try it out please let me know how it works for you, @eeschimosu and @a11enwong .

Thanks!!
I merged it!!

Swift 2.1 and Xcode 7.1 just came out. I just installed those... and of course there was another tiny modification needed. I just sent an additional Pull Request for that one too.

Thanks!!!!!!!!!!!! :pray:


Test for issue with attachments

@FynnBe there is still some issue with attachments: they are always empty in the serialized model and consequently the content of attachments:files is not copied. See also the comments in build_model.
This would be important to fix as the deepiamgej exporter relies on this to copy the pre/postprocessing macros!
(There is a test now that checks for this and currenttly fails.)

main tests pass...


Kubernetes Security and Disclosure Information

On https://kubernetes.io/docs/reference/issues-security/security/ a link is offered to subscribe to an RSS feed (https://groups.google.com/forum/feed/kubernetes-security-announce/msgs/rss_v2_0.xml?num=50) for the kubernetes-security-announce group.
However, the RSS feed link results in a 404 error. Will the ability to subscribe to an RSS feed for kubernetes-security-announce be restored anytime soon, or replaced with something else?

/kind bug
/sig security

I'm pretty sure Google Groups no longer supports RSS feeds.

Slightly related to https://github.com/kubernetes/website/issues/30051

KEP is in review for fixing this issue: https://github.com/kubernetes/enhancements/pull/3204. happy to get any feedback you may have on this!


nan values in output

For some inputs, nan values can appear in the output. From the few tests I did, it seems to happen with floating values and isolated points in the mask.
Minimal example:
#include "itkImage.h"
#include "itkVectorImage.h"
#include "itkCoocurrenceTextureFeaturesImageFilter.h"

typedef itk::Image<float, 2> ImageType;
typedef itk::Image<unsigned char, 2> MaskType;
typedef itk::VectorImage<float, 2> VectorType;
typedef itk::Statistics::CoocurrenceTextureFeaturesImageFilter<ImageType, VectorType> TextureType;

template<typename TImage>
typename TImage::Pointer createImage()
{
	typename TImage::Pointer image = TImage::New();
	typename TImage::RegionType region;
	region.SetIndex({{0, 0}});
	region.SetSize({{5, 5}});
	image->SetRegions(region);
	image->Allocate(true);
	return image;
}

int main()
{
	ImageType::Pointer image = createImage<ImageType>();
	MaskType::Pointer mask = createImage<MaskType>();
	mask->SetPixel({{2, 2}}, 1);
	TextureType::Pointer texture = TextureType::New();
	texture->SetInput(image);
	texture->SetMaskImage(mask);
	texture->Update();

	std::cout << texture->GetOutput()->GetPixel({{2, 2}}) << std::endl;
}

Output:
[nan, 0, nan, nan, nan, nan, nan, nan]

What happens is that, on line 325, the variable totalNumberOfFreq is zero. Which makes sense since the frequency of coocurrences in a window of one pixel is undefined.

Thanks @maekclena! Feel free to open a PR introducing a check for that precondition: assert(totalNumberOfFreq != 0) or similar.


Create initial API keys

Problem:
Apparently, valid API keys are a table in the database. I don't know how to seed the database with an API key.
Solution:
You could create a seeder script, so I can docker-compose exec db ./seed.sh and have some API keys in the log output maybe.

@matthib ah, there is already an issue for this.

As mentioned by @roschaefer, the creation of API keys need to be mentioned in the Readme.md - whether they need to be created manually or automatically.


Implement a CodeHighlighter for .yarn scripts

Not sure the priority of this, but if you add "yarn" to the "Text File Extensions" setting in EditorSettings, you can go to File > Open from the Script panel and open a yarn file. It would be interesting to try to have syntax highlighting in the Godot Editor. However personally I think the best experience will probably still be using the VS Code extension.
https://docs.godotengine.org/en/stable/classes/class_codehighlighter.html

I wonder if the language server used by the VS Code plugin could be useful to implement this.


Action Required: Your app is not compliant with Google Play Policies

I recently received the message:

Issue with your app
Your app contains content that doesn’t comply with the Device and Network Abuse policy. We found your app is using a non-compliant version of Huawei Mobile Services SDK which contains code to download or install applications from unknown sources outside of Google Play.Given the nature of the SDK, please remove it from the version of your app submitted to the Play Store.

from Google Play, which seems caused by outdated versions of Huawei SDK Libraries. Can you check e solve the problem upgrading used libraries in the projects.
For reference see this:
https://forums.developer.huawei.com/forumPortal/en/topic/0202931731760590092
and this:
https://forums.developer.huawei.com/forumPortal/en/topic/0202930818103450086
Many thanks.

I have the same issue,
Choice SDK don't use the latest Huawey SDK
Ex : in choicesdk-location folder ; we have : implementation 'com.huawei.hms:location:<IP_ADDRESS>3'
instead of latest : com.huawei.hms:location:<IP_ADDRESS>0

My first attempt to solve this issue was:
    implementation "at.bluesource.choicesdk:choicesdk-location:0.3.0"
    implementation "com.huawei.hms:location:<IP_ADDRESS>0"

    implementation("at.bluesource.choicesdk:choicesdk-maps:0.3.0)
    implementation "com.huawei.hms:maps:<IP_ADDRESS>0"

App passed the review on Google Play Store but it broke the maps functionality on Huawei devices.
I had to limit the library update to just Google build flavor.
    implementation "at.bluesource.choicesdk:choicesdk-location:0.3.0"
    googleImplementation "com.huawei.hms:location:<IP_ADDRESS>0"

    implementation("at.bluesource.choicesdk:choicesdk-maps:0.3.0)
    googleImplementation "com.huawei.hms:maps:<IP_ADDRESS>0"


chore: update graal-sdk version  and downstream check to 22.3.2

Thank you for opening a Pull Request! For general contributing guidelines, please refer to contributing guide
Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

[ ] Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
[ ] Ensure the tests and linter pass
[ ] Code coverage does not decrease (if any source code was changed)
[ ] Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> ☕

Confirmed that check is running with GraalVM 22.3.2:
[1/7] Initializing...                                                                                (14.1s @ 0.55GB)
 Version info: 'GraalVM 22.3.2 Java 17 CE'
 Java version info: '17.0.7+7-jvmci-22.3-b18'
 C compiler: gcc (redhat, x86_64, 4.8.5)
 Garbage collector: Serial GC
 6 user-specific feature(s)
 - com.google.api.gax.grpc.nativeimage.GrpcNettyFeature
 - com.google.api.gax.grpc.nativeimage.ProtobufMessageFeature
 - com.google.api.gax.nativeimage.GoogleJsonClientFeature
 - com.google.api.gax.nativeimage.OpenCensusFeature
 - com.oracle.svm.thirdparty.gson.GsonFeature
 - org.graalvm.junit.platform.JUnitPlatformFeature


add aws secrets manager action

Add a new AWS scaffolder action to create a secret in AWS Secrets Manager. Also, it includes an AWS profile input to support creation of secrets in multiple AWS accounts, as required in my scenario

:heavy_check_mark: Checklist

[x] Added tests for new functionality and regression tests for bug fixes
[x] Added changeset (run yarn changeset in the root)
[ ] Screenshots of before and after attached (for UI changes)
[x] Added or updated documentation (if applicable)

Thank you for your contribution. Overall it looks good! However, you'll need to rebase because we bumped the package versions of the plugins.

@kissmikijr did the rebase

Let's ship it! Thank you for the contribution


"Dealu Geoagiului" is listed in the drop-down menu

Description:
"Dealu Geoagiului" is listed in the drop-down menu alongside its corresponding county and commune, according to the law
Precondition:
The website is up an running.

Step 1
Type "Dealu Geoagiului" in the search bar.

Expected results
The location is listed in the drop-down menu as "Dealu Geoagiului, Alba (Întregalde)".


Name is not being removed if I reauth in local auth

Version - master 3/18
Steps to Reproduce:

Log in using Local authentication (fill out both username and name)
Go to Accounts and see that Login Username and Name are filled out
Disable local auth
Log back into Local auth but change the username and leave the name blank
Go to Accounts page

Results: Notice that the Name field has old information in it.
Expected: Name field should be blank

Closing and added to #5450 for single point of reference


CORS Variable

Changing the base URL for the UI over a variable should be possible.  The base URL is hard coded so it is not possible to access it, if it is running on an remote machine.
https://github.com/OktopUSP/oktopus/blob/816262a3b857f2c6b05f7aa67d2e3b8aa4e8ab4c/backend/services/socketio/server.js#L10
https://github.com/OktopUSP/oktopus/blob/816262a3b857f2c6b05f7aa67d2e3b8aa4e8ab4c/backend/services/controller/internal/api/cors/cors.go#L11

same here, the cors is allowing only localhost, if try to acess with <IP_ADDRESS> literal not working as expected


Custom State store doesn't seems to propagate correctly

Hi, I believe I found an bug on the library and here's a bit of a context.
My team created a wrapper around this library so we can have a consolidated way to provide authentication through our react apps. On react apps, this wrapper works fine, but I started to look into a new mobile app (react-native) and wanted to use the wrapper, but I keep getting:
 ERROR  ReferenceError: Can't find variable: localStorage

So I started to dig a bit and the wrapper essentially receives an extended version of  UserManagerSettings interface, which then is passed into the UserManager class.
const useAuthState = (props: AuthProviderProps) => {
  const { onSigninCallback, onRemoveUser, ...config } = props;
  const [userManager] = useState(() => new UserManager(config));
  const [state, dispatch] = useReducer(reducer, initialAuthState);

  const api = useUserManager(userManager, dispatch, state, onRemoveUser);
  useSigninCallback({ userManager, dispatch, onSigninCallback });
  useUserManagerEvents(userManager, dispatch);

  return { ...state, ...api };
};

On the implementation side:
  <AuthProvider {...AUTH_CONFIG}>
    <StatusBar barStyle="dark-content" />
    <SafeAreaView style={styles.safeAreaView}>
      <AppContent />
    </SafeAreaView>
  </AuthProvider>

AUTH_CONFIG:
export const AUTH_CONFIG: UserManagerSettings = {
  ...
  userStore: new WebStorageStateStore({ store: new InMemoryWebStorage() }),
};

So I believe the bug comes when setting the userStore property from the UserManager. The UserManager class consumes the value provided by the config. However, internally on the UserManager, it creates a new instance of OidcClient with the same config and on its constructor, creates an instance of OidcClientSettingsStore, again, with the same settings, except that at this stage, the property is no longer called userStore and it's now stateStore and since its value is not manually set from the userStore prop, it comes as undefined and therefore, the following logic will always fall into the default implementation:
https://github.com/authts/oidc-client-ts/blob/b3337c85c1a4e412a5077e20efd2217280fc8a51/src/OidcClientSettings.ts#L275
	// OidcClientSettings.ts
	...
    if (stateStore) {
        this.stateStore = stateStore;
    }
    else {
        const store = typeof window !== "undefined" ? window.localStorage : new InMemoryWebStorage();
        this.stateStore = new WebStorageStateStore({ store });
    }

Unless I mis-read something, I believe that's the cause for my wrapper not to work on my mobile as the window object does exist, but the localStorage doesn't thus throwing the error.
Please let me know if you need more information about it.

I think you are confused with userStore and stateStore. userStore is where the user (id token, access token) is stored. stateStore is only used transient for the authorization process, such that the library knows which data were initially sent to the authz server and now when the authz server calls back we need to match...

This issue (question) staled, closing it for now.


napalm not installing due to broken procees

@JoranHonig  whenever i run pip3 install napalm-toolbox it ran succesfully but facing this issue when running $ pip3 install napalm-base
 ModuleNotFoundError: No module named 'pip'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

I subbed to this Issue earlier as I thought about contributing to napalm, but also ran into the same error.
The issue is that there's no napalm-base package on pypi available. Did you guys make it public? napalm-base-1.0.0 is an old package that uses python 3.4.

Apologies I'd forgotten to update the docs.
Can you try pip install napalm-core?

I subbed to this Issue earlier as I thought about contributing to napalm, but also ran into the same error.
The issue is that there's no napalm-base package on pypi available. Did you guys make it public? napalm-base-1.0.0 is an old package that uses python 3.4.
(venv) user@nest:~/Github/Bugz/napalm$ pip install napalm-base
Collecting napalm-base
  Using cached napalm-base-1.0.0.tar.gz (35 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "/home/user/Github/Bugz/napalm/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/user/Github/Bugz/napalm/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/user/Github/Bugz/napalm/venv/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-36tztpq3/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 325, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-36tztpq3/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 295, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-36tztpq3/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 480, in run_setup
          super().run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-36tztpq3/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 311, in run_setup
          exec(code, locals())
        File "<string>", line 5, in <module>
      ModuleNotFoundError: No module named 'pip'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

@JoranHonig this error in full

I think there's still some naming confusion in cli
(venv) user@nest:~/Github/Bugz/napalm$ python --version
Python 3.12.2
(venv) user@nest:~/Github/Bugz/napalm$ napalm collections show
Usage: napalm collections show [OPTIONS] COLLECTION
Try 'napalm collections show --help' for help.
Error: Missing argument 'COLLECTION'.
(venv) user@nest:~/Github/Bugz/napalm$ napalm collections list
Installed collections:
  - napalm-base/optimisations
  - napalm-base/detectors
  - napalm-base/indicators
(venv) user@nest:~/Github/Bugz/napalm$ napalm collections show napalm-core/detectors
Collection napalm-core/detectors not found!
(venv) user@nest:~/Github/Bugz/napalm$ napalm collections show napalm-base/detectors
int-cast-block-timestamp - [WARNING] Casting block.timestamp can lead to reduced precision and unexpected behavior, consider not casting instead.
use-of-unsafe-erc20-functions - [INFO] The ERC20 implementation does not automatically include checks that ensure the success of the operation. Using the OpenZeppelin's SafeERC20 library is
recommended.
block-timestamp-swap - [WARNING] Passing block.timestamp as the deadline effectively removes the deadline functionality which prevents malicious validators from holding back transactions to
execute them at a later time.

napalm-base/detectors summary:
  - 3 semgrep rules

Notice that I needed to use napalm-base/detectors. I also successfully did it only on locally installed package, as in
(venv) user@nest:~/Github/Bugz/napalm$ pip freeze
napalm-core==0.1.1
-e git+https://github.com/ConsenSysDiligence/napalm.git@6304e6dfd5d8407fa67cb8a7052eb80d6614b9f5#egg=napalm_toolbox

napalm-toolbox from pypi seems to throw other cli error.
(venv) user@nest:~/Github/Bugz/temp$ napalm collections show
Traceback (most recent call last):
  File "/home/user/Github/Bugz/temp/venv/bin/napalm", line 8, in <module>
    sys.exit(cli())
             ^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/click/core.py", line 1685, in invoke
    super().invoke(ctx)
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/napalm/cli/base/main.py", line 25, in cli
    auto_install_hook(ctx.obj["storage"])
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/napalm/cli/base/auto.py", line 27, in auto_install_hook
    _removed_collections(storage_provider)
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/napalm/cli/base/auto.py", line 31, in _removed_collections
    removed_collections = list(_get_removed_collections(storage_provider))
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/napalm/cli/base/auto.py", line 155, in _get_removed_collections
    used_collections = pipe(
                       ^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/toolz/functoolz.py", line 628, in pipe
    data = func(data)
           ^^^^^^^^^^
  File "/home/user/Github/Bugz/temp/venv/lib/python3.12/site-packages/toolz/functoolz.py", line 304, in __call__
    return self._partial(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: reduce() of empty iterable with no initial value

Fixed the naming issue in napalm-core!
The reduce bug should also be resolved in the latest napalm version.

Yep, all of the previously mentioned are now working! I opened the PR with some of other things that were stopping successfully running workflows. I also opened another issue in relation to slither modules that are still failing but it's outside of the scope of this issue.

Awesome!
I'll close this issue 🚀


Parenting a script to StarterCharacterScripts or StarterPlayerScripts does not show any code when importing to roblox

Fixed in 0.5.3. Thanks for reporting!


@Secured annotation not working correctly for namespaced controllers v3.0.1+

Same issue as https://github.com/grails-plugins/grails-spring-security-core/issues/212
v3.0.0.M1 works fine with namespaced controller.
Update:
The functional tests covered namespaced controller with user that does not login, while the current issue is the user logs in with a different role e.g. Operator, it can still view pages for Admin.

We have functional tests to cover namespaced controllers, eg: https://github.com/grails-plugins/grails-spring-security-core/blob/master/functional-test-app/grails-app/controllers/namespaced/secure/NamespacedController.groovy and its test: https://github.com/grails-plugins/grails-spring-security-core/blob/master/functional-test-app/src/integration-test/groovy/specs/NamespaceSecuritySpec.groovy#L125-L131
Can you please upload an example that reproduces the issue?

Hi alvaro,
@Secured(['ROLE_ADMIN'])
class ConfigController {
    def index() {
        render view: "index"
    }
}

@Secured(['ROLE_ADMIN'])
class TestController {
    static namespace = 'config'

    def index() {
        render view: "index"
    }
}

We have admin and user roles, if I login with user role, it can not visit url/config, but url/config/test still could be viewed.

We need to see configuration, URL mappings, etc.

UrlMappings:
        "/$controller/$action?/$id?(.$format)?" {
            constraints {
            }
        }

        "/config/$controller/$action?/$id?(.$format)?" {
			constraints {
			}
        }

application.yml
grails:
  plugin:
    springsecurity:
      debug:
        useFilter: true
      rejectIfNoRule: false
      fii:
        rejectPublicInvocations: true
      userLookup:
        userDomainClassName: 'com.test.User'
        usernamePropertyName: 'username'
        authorityJoinClassName: 'com.test.UserRole'
      authority:
        className: 'com.test.Role'
      logout:
        postOnly: false
      controllerAnnotations:
        staticRules:
          - pattern: '/error'
            access: 'permitAll'
          - pattern: '/assets/**'
            access: 'permitAll'
          - pattern: '/**/js/**'
            access: 'permitAll'
          - pattern: '/**/css/**'
            access: 'permitAll'
          - pattern: '/**/images/**'
            access: 'permitAll'
          - pattern: '/**/favicon.ico'
            access: 'permitAll'
          - pattern: '/**'
            access: 'isFullyAuthenticated()'

I've also tried adding
          - pattern: '/config/**'
            access: 'ROLE_ADMIN'

with v3.0.0.M1, only staticRules are in different format:
                staticRules:
                    /error:           ['permitAll']
                    /login:           ['permitAll']
                    /logout:          ['permitAll']
                    /assets/**:       ['permitAll']
                    /**/js/**:        ['permitAll']
                    /**/css/**:       ['permitAll']
                    /**/images/**:    ['permitAll']
                    /**/favicon.ico:  ['permitAll']
                    /**:              ['IS_AUTHENTICATED_FULLY']

Thanks for your time.

Any updates?

Any updates? I have had the same problem for more than two weeks and it is still not solved.

The plugin currently expects all namespaced controllers to also be mapped via their namespace in UrlMappings.groovy. When namespacing a controller only for the namespace to be added to the default view folder however, you don't usually do this (because then the namespace would have to be repeated for every createLink, too). And the ioriginal reporter seems to be having difficulties with wildcard routes.
We need to either add a new test (a controller not being mapped by its namespace explicitly) or decide that this is expected behaviour.

I believe this not a bug and is expected behavior.
The documentation does state that

When defining url mappings which should be associated with a namespaced controller, the namespace variable needs to be part of the URL mapping.

So, in order for this to work properly, the namespace needs to be included in:

UrlMappings.groovy
the controller

and uses of the <g:link> tag referencing a name-spaced controller also need to include the namespace.
http://docs.grails.org/3.0.0/guide/theWebLayer.html#namespacedControllers
Please let me know your thoughts.  ✨


[Restart Raycast] Init Extension

Description

Restart Raycas

Screencast

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Hi @koinzhang 👋
What's the reason for making this extension? Do you struggle with Raycast 😊

Hi @pernielsentikaer
When I was developing extensions, if I needed to change the extension's icon, I needed to restart the Raycast app for it to take effect, so I created this extension
Also, I've had problems with Raycast's memory usage spiking, which can be temporarily solved by restarting Raycast

Sorry for the longer response time than usual. I had to discuss it internally.
We have decided not to add this to the store as it is right now, but feel free to use it as a local extension, I hope you understand.

Regarding extensions, the icon cache is something we're looking into.
Memory usage spiking is something we want to fix rather than having users restart

That's okay. I hope you can get these issues resolved sooner rather than later.

I agree 🙂


Can´t deploy Web App

D:\squizzy>now
Now CLI 19.2.0
??  The name property in now.json is deprecated (https://vercel.link/name-prop)
Error! Environment Variable "SQUIZZY_WRITE_TOKEN" references Secret "squizzy_write_token", which does not exist.

How did you solve this?


Set and document icon naming standard

Should icon constants be named after the icon display or the icon purpose?
For example, should the constant for the subscribe icon, currently a heart, be HEART or SUBSCRIBE?
Typically (e.g. FontAwesome), icons are named after the display. But I'd actually argue that for a single application, the icons should be named after the purpose (i.e. SUBSCRIBE would be a better name than HEART).
Traditionally icons are named after the display, but I think once you are in a specific application, naming for purpose is superior since it helps encourage you to use the icon in one and only one way.
Either way, I'd like a choice made here and a short comment added to the top of the file indicating which you should do.

I'm beginning to think it should be based on the purpose. Mainly to prevent the same icon being used for two different actions.
Ex: If we had a like button, maybe someone would just see the HEART icon and use that. If it was called SUBSCRIBE instead the chance of that happening is much lower.


replicate external links for orthology resources

replicate external links for orthology resources in the  ortholog section
https://github.com/pombase/website/issues/1241

What should the titles be on the links and where should they be?  Underneath?

Resource: Ensembl Fungal Compara
Description Alignments, gene trees, orthologs, families
Link format: http://fungi.ensembl.org/Schizosaccharomyces_pombe/Gene/Compara?db=core;g=SPAC227.07c;r=I:507522-509960;t=SPAC227.07c.1
Resource: Ensembl Pan taxonomic Compara
Description: Gene tree, orthologs
Link format: http://fungi.ensembl.org/Schizosaccharomyces_pombe/Gene/PanCompara?db=core;g=SPAC227.07c;r=I:507522-509960;t=SPAC227.07c.1
Resource: Panther Orthologs, Gene trees, Alignments
Link Format: http://www.pantherdb.org/genes/gene.do?acc=SCHPO|PomBase%3DSPCC18B5.04|UniProtKB%3DQ9USL7

Sorry, missed from
https://github.com/pombase/website/issues/1242
under 2 headers:
Manually assigned orthologs
Predicted orthologs

So have "Manually assigned orthologs" as a header at the top of the current ortholog table and then have a "Predicted orthologs" below the current table?

Or just have a single table and have these as sub headers
(like Population phenotype, in phenotypes)

I've added those links.  Let me know if you'd like any changes.

A small one tweak. Could you also include the existing ortholog resources:

Orthologs
DIOPT
SPCC18B5.03
DRSC Integrative Ortholog Prediction Tool

Orthologs
HCOP
SPCC18B5.03
Integrated human orthologs

Also,

Could we make this links available in the ortholog section for genes with no orthologs listed? (I.e every gene will now have an ortholog section and the set of prediction links). This will enable people to access  orthologs when no fungal or human ortholog reported.....

Panther links are broken. I'm not sure why, I will look into this...

links should be
http://www.pantherdb.org/genes/gene.do?acc=SCHPO|PomBase%3DSPCC18B5.03|UniProtKB%3DP07527
we have
http://www.pantherdb.org/genes/gene.do?acc=SCHPO|PomBase%3DSPCC18B5.04|UniProtKB%3DP07527

Could you also include the existing ortholog resources:

What do you mean by existing resources?  Do you mean include the other two ortholog external references?

Do you mean include the other two ortholog external references?

yep. all ortholog resources should be int eh ortholog section, I think

links should be

Thanks for checking that.  The problem was that the Panther URLs need a UniProt ID and a PomBase ID.  I didn't notice the PomBase ID in the URL when I configured it so all our links to Panther had the same gene ID, "SPCC18B5.04" in the link.  I've fixed that now.

yep. all ortholog resources should be int eh ortholog section, I think

OK, done.

Could we make this links available in the ortholog section for genes with no orthologs listed?

Done.

announced


Should Lilt be optional in the installer?

The installer script halts if Lilt or Decker binaries are not found. Should Lilt be required or should the installer continue, just noting that the Lilt binary was missing?

Probably the latter: lilt and decker are each usable on their own.
If you're planning on making more tweaks to the install script, you might also want to update the uninstall script to reflect the installation of the decker binary.

Good. I'll update the install script and add decker to the uninstall script as well.


Async cache, best practices (python3.10)?

First Check

[X] I added a very descriptive title to this issue.
[X] I used the GitHub search to find a similar issue and didn't find it.
[X] I searched the FastAPI documentation, with the integrated search.
[X] I already searched in Google "How to X in FastAPI" and didn't find any information.
[X] I already read and followed all the tutorial in the docs and didn't find an answer.
[X] I already checked if it is not related to FastAPI but to Pydantic.
[X] I already checked if it is not related to FastAPI but to Swagger UI.
[X] I already checked if it is not related to FastAPI but to ReDoc.

Commit to Help

[X] I commit to help with one of those options 👆

Example Code
from aiocache import cached
from fastapi.concurrency import run_in_threadpool

from our.schemas import OrganisationSchema
from our.services import crm

router = APIRouter()

@router.get("/organisations", response_model=list[OrganisationSchema])
@cached(alias="crm")
async def organisations() -> list[dict]:
    return await run_in_threadpool(crm.get_organisations)

Description
We (my dev team At SURF) use an async cache solution in a couple of FastAPI apps. It caches complete endpoints and generally works ok for our use cases. But as we upgraded our code base to python3.10 the cache solution broke and aiocache seems to be struggling to find a new maintainer.
So for now we created a fork that works with 3.10. A couple of options seem to exists:

we decide to start maintaining the aiocache lib
switch to another cache solution that support our use cases and has a higher chance of continued maintenance

This Question is mostly aimed at 2: Does someone use async caching on an endpoint level? If so are you satisfied with it? Can you elaborate on some best practices?
Operating System
Linux
Operating System Details
No response
FastAPI Version
0.75.0
Python Version
3.10
Additional Context
No response

@acidjunk actively looking at this, not for fastapi but some other asyncio python server

we're especially interested in LRU + TLRU. TLRU is usually expiry defined by insertion time (imagine a expiry header), but we're also interested in expiring based on time since last read, so we can more aggressively drain anything not accessed recently, vs just when maxsize is hit

race / reentrancy: our servers are generally multiple share-nothing processes, and each process is an asyncio greenthreaded event loop. where this gets a bit funny is if there is something like await slow_route('some_key'), two concurrent requests may ask for 'some_key', and you want to make sure only the first is dispatched, and the second knows to wait . Likewise, should be safe for a concurrent 'some_key2' to proceed

some flexibility questions like whether to cache at route level or across routes, and external controls for tuning specific routes

our world is a bit more interesting b/c we're dealing with both GPU + CPU buffers as part of multi-stage compute, so we might have a nesting where we do N GPU cached objects and 5 * N CPU cached objects

@imeyerov Thanks!
Will leave the ticket open for a couple of weeks; we will probably decide to put some own efforts in aiocache for the time being.

Closing it. Not sure yet on the best path forward.

We decided to write our own implementation:
https://github.com/workfloworchestrator/nwa-stdlib/pull/11


add priorysouthsea.org

@aaskl First stage of verification passed, official domain is priorysouthsea.org as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

This comment is to add more information and evidence regarding an educational institution license.
Official Domain: priorysouthsea.org
Official Website: https://www.priorysouthsea.org/
Official Email Format<EMAIL_ADDRESS>(e.g<EMAIL_ADDRESS>indicates John Doe joined in 2024)
Page 9 of this prospectus provides evidence that Computer Science is a topic learnt in this educational institution: https://www.priorysouthsea.org/wp-content/uploads/2023/03/SCHOOL-PROSPECTUS.pdf


SEBAL did not run line 2 fully

**
Hi @spareeth,
PySEBAL ran the test_data without any problems. But when I run PySEBAL with my own data, I get the same error as @janardanroy in the "log" file. I made the necessary changes. My file path in Run_py.3 does not seem to be a problem. As you can see, it produces a few outputs, but does not run after the "Meteo Part1" section. (I got my Meteo_Input data from Eddy Covariance Flux Tower)
What should I do for this error? I would be glad if you help.
Have a nice day.
**

Hello @spareeth,
If I can't get an answer to my question for 15 days, why does such a platform exist?

@cartographer16 Most of these libraries are maintained voluntarily, contributors have other full time jobs.
You could also send "Gentle reminders" in a weeks time to get attention.
Your issue is similar to other issue reported.
If the test data ran with out issues, then that means this happens due to your excel sheet entries, mainly path related.
Could you recheck the excel sheet entries?
In Sheet 1, check if the paths exists.
I understand, you have used numeric values for meteo so thats fine.
In soil , is it also numeric?
Also in sheet 4 where Landsat the landsat name should be the prefix before the band numbers.
https://pysebal-doc.readthedocs.io/en/version3.7.3/
https://pysebal-doc.readthedocs.io/en/version3.7.3/run.html#input-data-preparation
If it still doesnt work, I can have look at your excel sheet.

https://drive.google.com/drive/folders/1VDvLTrBjkTW2dlFhn35HFKb7frOrDUmk?usp=sharing I've done all the checks again. I made the same mistake again.  I would appreciate it if you could help.

@spareeth :)

I tested your data.
For PySEBAL the DEM data should be LatLong WGS84 (EPSG:4326), now the dem is in utm. Convert dem to EPSG:4326
I saw that you have also edited the pysebal_py3.py, especially commented some lines: 696-701.
I suggest you download the pysebal_py3.py from https://github.com/spareeth/PySEBAL_dev , try it with DEM in EPSG:4326 and the script should run.

The issue was with the input data preparation


Create a monolith version  for development purposes and small deployemnt

right now we have an application that is a collection of micro services which is very good and i like it a lot.
Without loosing this feature we should be able to compose each microservice and run the application as monolith. It can be good for development purposes or for small deployments.  With a monolith debugging the app will be very easy.
The idea is to have a subproject that is able to start all the micro services as one application.

Will you be able to describe initial design of such monolithic system?
Please not that currently you can start whole system with just one command: vagrant up (executed in e2e-tests folder). I will update Readme asap.

I thought about this and it adds too much complexity for an example project.  In my project instead to have every micro service in its own package i implemented under 1 package and created several offices.
we can close this for now.


Update canonical-transaction-index-network.md

Thank you very much for the prompt review. As I currently lack the merge privileges, would it be possible for someone to assist in merging the PR?


BUG: scipy.stats.wilcoxon in 1.13 fails on 2D array with nan -- 1D works

Describe your issue.
A regression seemingly introduced in 1.13. A 2D array with NaNs in some columns ValueErrors out as soon as it reaches a column with a NaN. It must be truly 2D, i.e. A.shape[1] > 1 is True. It also only occurs when there are more than 50 rows, i.e. A.shape[0] > 50.
Passing just that column with the NaNs, i.e. passing it as 1D, operates as expected. For example, stats.wilcoxon(A[:50,:] or stats.wilcoxon(A[:,1]) after the code example below runs fine.
Reproducing Code Example
from scipy import stats
import numpy as np

rng = np.random.default_rng(123)
A = rng.normal(size=(51,2))
A[5,1] = np.nan
stats.wilcoxon(A)

Error message
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/isilon/LFMI/VMdrive/Jonathan/PriorWeightingMooney/Visual/ECoG/Code/.venv/lib/python3.11/site-packages/scipy/_lib/_util.py", line 794, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File "/isilon/LFMI/VMdrive/Jonathan/PriorWeightingMooney/Visual/ECoG/Code/.venv/lib/python3.11/site-packages/scipy/stats/_axis_nan_policy.py", line 603, in axis_nan_policy_wrapper
    res = np.apply_along_axis(hypotest_fun, axis=0, arr=x)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/isilon/LFMI/VMdrive/Jonathan/PriorWeightingMooney/Visual/ECoG/Code/.venv/lib/python3.11/site-packages/numpy/lib/shape_base.py", line 402, in apply_along_axis
    buff[ind] = asanyarray(func1d(inarr_view[ind], *args, **kwargs))
    ~~~~^^^^^
ValueError: could not broadcast input array from shape (2,) into shape (3,)

SciPy/NumPy/Python version and system information
>>> import sys, scipy, numpy; print(scipy.__version__, numpy.__version__, sys.version_info); scipy.show_config()

1.13.0 1.26.4 sys.version_info(major=3, minor=11, micro=5, releaselevel='final', serial=0)
Build Dependencies:
  blas:
    detection method: pkgconfig
    found: true
    include directory: /usr/local/include
    lib directory: /usr/local/lib
    name: openblas
    openblas configuration: USE_64BITINT=0 DYNAMIC_ARCH=1 DYNAMIC_OLDER= NO_CBLAS=
      NO_LAPACK= NO_LAPACKE= NO_AFFINITY=1 USE_OPENMP= ZEN MAX_THREADS=64
    pc file directory: /usr/local/lib/pkgconfig
    version: 0.3.26.dev
  lapack:
    detection method: pkgconfig
    found: true
    include directory: /usr/local/include
    lib directory: /usr/local/lib
    name: openblas
    openblas configuration: USE_64BITINT=0 DYNAMIC_ARCH=1 DYNAMIC_OLDER= NO_CBLAS=
      NO_LAPACK= NO_LAPACKE= NO_AFFINITY=1 USE_OPENMP= ZEN MAX_THREADS=64
    pc file directory: /usr/local/lib/pkgconfig
    version: 0.3.26.dev
  pybind11:
    detection method: config-tool
    include directory: unknown
    name: pybind11
    version: 2.12.0
Compilers:
  c:
    commands: cc
    linker: ld.bfd
    name: gcc
    version: 10.2.1
  c++:
    commands: c++
    linker: ld.bfd
    name: gcc
    version: 10.2.1
  cython:
    commands: cython
    linker: cython
    name: cython
    version: 3.0.10
  fortran:
    commands: gfortran
    linker: ld.bfd
    name: gcc
    version: 10.2.1
  pythran:
    include directory: ../../tmp/pip-build-env-ilw0s1wu/overlay/lib/python3.11/site-packages/pythran
    version: 0.15.0
Machine Information:
  build:
    cpu: x86_64
    endian: little
    family: x86_64
    system: linux
  cross-compiled: false
  host:
    cpu: x86_64
    endian: little
    family: x86_64
    system: linux
Python Information:
  path: /opt/python/cp311-cp311/bin/python
  version: '3.11'

I'll fix this shortly.

I'll fix this shortly. In the meantime, please use:
stats.wilcoxon(A, method='approx')

The problem is just with method='auto' (and method='exact' if there are zeros).

Should I expect this to have worse performance than 1.12 in some situations? This is what I'm seeing, tho haven't set up a formal test. 1.12 using method='auto' is about 35% faster than 1.13 using method='approx'.

What is the shape of the input, and does it have NaNs?
Try with stats.wilcoxon(A, _no_deco=True).

I went ahead and tried _no_deco=True since omitting NaNs is my desired behavior, and I'm not seeing a slight benefit, I'm seeing almost two orders of magnitude speed up! I had to double check I had actually turned parallelism in my setup off for the speed test.
Nice job on this update!

Great to hear : ) Hopefully it will get array API support before too long, too.


Use security in webspace settings

Currently the webspace settings are lacking the use of Sulu's security feature. Especially the default snippets should not be editable by everyone, but only by a small group of users.

this also should be implemeted for analytics, introduced in https://github.com/sulu-io/sulu/pull/1912


ADS: GPC screen migration

Task/Issue URL:
Description
Steps to test this PR
Feature 1

[ ]
[ ]

UI changes

Before
After

!(Upload before screenshot)
(Upload after screenshot)

Current dependencies on/for this PR:

feature/david/ads_release

PR #2557   👈

This comment was auto-generated by Graphite.


mem leak

Hello,
possible you will add this fix to your fork
https://github.com/lwthiker/curl-impersonate/issues/196

Yeah, sure.

Fixed in #20


fix "Android - Keyboard is not dismissed after tapping outside of email input"

Details

replace TouchableDismissKeyboard with ScrollView
set keyboardShouldPersistTaps="handled" to fix the main issue
add flex:1 to contentContainerStyle to take full height of screen

Fixed Issues
$ https://github.com/Expensify/App/issues/14569
PROPOSAL: https://github.com/Expensify/App/issues/14569#issuecomment-1427069784
Tests
Same as QA step

[x] Verify that no errors appear in the JS console

Offline tests
Same as QA step
QA Steps

Open NewDot app
Logout if already logged in
Tap email input box on Login page
Tap outside of email input
Verify that keyboard is dismissed
(Regression test)
Tap email input box again
Tap language picker at the bottom
Verify that language dropdown shows directly

[ ] Verify that no errors appear in the JS console

PR Author Checklist

[x] I linked the correct issue in the ### Fixed Issues section above
[x] I wrote clear testing steps that cover the changes made in this PR

[x] I added steps for local testing in the Tests section
[x] I added steps for the expected offline behavior in the Offline steps section
[x] I added steps for Staging and/or Production testing in the QA steps section
[x] I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[x] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
[x] I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).

[x] I included screenshots or videos for tests on all platforms
[x] I ran the tests on all platforms & verified they passed on:

[x] Android / native
[x] Android / Chrome
[x] iOS / native
[x] iOS / Safari
[x] MacOS / Chrome / Safari
[x] MacOS / Desktop

[x] I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
[x] I followed proper code patterns (see Reviewing the code)

[x] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
[x] I verified that comments were added to code that is not self explanatory
[x] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[x] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method

[x] If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:

[x] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[x] I verified any copy / text that was added to the app is correct English and approved by marketing by adding the Waiting for Copy label for a copy review on the original GH to get the correct copy.
[x] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[x] I verified the JSDocs style guidelines (in STYLE.md) were followed

[x] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[x] I followed the guidelines as stated in the Review Guidelines
[x] I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
[x] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[x] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[x] I verified that if a function's arguments changed that all usages have also been updated correctly
[x] If a new component is created I verified that:

[x] A similar component doesn't exist in the codebase
[x] All props are defined accurately and each prop has a /** comment above it */
[x] The file is named correctly
[x] The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
[x] The only data being stored in the state is data necessary for rendering and nothing else
[x] For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
[x] Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
[x] All JSX used for rendering exists in the render method
[x] The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions

[x] If any new file was added I verified that:

[x] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[x] If a new CSS style is added I verified that:

[x] A similar style doesn't already exist
[x] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(themeColors.componentBG)

[x] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[x] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[x] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[x] I have checked off every checkbox in the PR author checklist, including those that don't apply to this PR.

Screenshots/Videos

Web
https://user-images.githubusercontent.com/108292595/219657329-7f60f762-0219-4d9b-a1ef-de794f01b8df.mov

Mobile Web - Chrome
https://user-images.githubusercontent.com/108292595/219657644-4a59955b-9d3a-428a-8600-1c9d18c427c0.mp4

Mobile Web - Safari
https://user-images.githubusercontent.com/108292595/219658401-a247017f-4e58-494a-bf78-65b13507741a.mp4

Desktop
https://user-images.githubusercontent.com/108292595/219657750-aa785673-9870-4f1f-9990-da8d5849b179.mov

iOS
https://user-images.githubusercontent.com/108292595/219657806-8a217406-88a1-49cb-9e2e-a48a3502139b.mp4

Android
https://user-images.githubusercontent.com/108292595/219657873-3fd4dc54-5dd2-4de6-be38-16a021efc94f.mp4

@thienlnam @mollfpr One of you needs to copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

Reviewer Checklist

[x] I have verified the author checklist is complete (all boxes are checked off).
[x] I verified the correct issue is linked in the ### Fixed Issues section above
[ ] I verified testing steps are clear and they cover the changes made in this PR

[ ] I verified the steps for local testing are in the Tests section
[ ] I verified the steps for Staging and/or Production testing are in the QA steps section
[ ] I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[ ] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)

[ ] I checked that screenshots or videos are included for tests on all platforms
[ ] I included screenshots or videos for tests on all platforms
[ ] I verified tests pass on all platforms & I tested again on:

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[ ] MacOS / Chrome / Safari
[ ] MacOS / Desktop

[ ] If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
[ ] I verified proper code patterns were followed (see Reviewing the code)

[ ] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
[ ] I verified that comments were added to code that is not self explanatory
[ ] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[ ] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
[ ] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[ ] I verified any copy / text that was added to the app is correct English and approved by marketing by adding the Waiting for Copy label for a copy review on the original GH to get the correct copy.
[ ] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[ ] I verified the JSDocs style guidelines (in STYLE.md) were followed

[ ] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[ ] I verified that this PR follows the guidelines as stated in the Review Guidelines
[ ] I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
[ ] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[ ] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[ ] If a new component is created I verified that:

[ ] A similar component doesn't exist in the codebase
[ ] All props are defined accurately and each prop has a /** comment above it */
[ ] The file is named correctly
[ ] The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
[ ] The only data being stored in the state is data necessary for rendering and nothing else
[ ] For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
[ ] Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
[ ] All JSX used for rendering exists in the render method
[ ] The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions

[ ] If any new file was added I verified that:

[ ] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[ ] If a new CSS style is added I verified that:

[ ] A similar style doesn't already exist
[ ] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(themeColors.componentBG)

[ ] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[ ] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[ ] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[ ] If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
[ ] I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Web

Mobile Web - Chrome

Mobile Web - Safari

Desktop

iOS

Android

🚀 Deployed to staging by https://github.com/thienlnam in version: 1.2.75-0 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

🚀 Deployed to production by https://github.com/melvin-bot[bot] in version: 1.2.75-0 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅