How can I get the data?

First, I downloaded 'Transformer-en' and renamed it like './model/syngec/english_transformer_baseline.pt'.
Then, I downloaded the preprocessed data.
And I run the code './pipeline_gopar.sh'.
But the error is:
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../src/src_gopar/parse.py", line 17, in
input_sentences = load(sys.argv[1])
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../src/src_gopar/parse.py", line 9, in load
with open(filename, 'r') as f:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/tgt.txt'
Loading resources...
Processing parallel files...
Traceback (most recent call last):
File "/opt/conda/bin/errant_parallel", line 8, in
sys.exit(main())
File "/opt/conda/lib/python3.10/site-packages/errant/commands/parallel_to_m2.py", line 16, in main
in_files = [stack.enter_context(open(i)) for i in [args.orig]+args.cor]
File "/opt/conda/lib/python3.10/site-packages/errant/commands/parallel_to_m2.py", line 16, in
in_files = [stack.enter_context(open(i)) for i in [args.orig]+args.cor]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/tgt.txt'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../src/src_gopar/convert_gec_data_to_parsing_data_english.py", line 153, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/tgt.txt.conll_predict'
/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py:181: FutureWarning: The module torch.distributed.launch is deprecated
and will be removed in future. Use torchrun.
Note that --use-env is set by default in torchrun.
If your script expects --local-rank argument to be set, please
change it to read from os.environ['LOCAL_RANK'] instead. See
https://pytorch.org/docs/stable/distributed.html#launch-utility for
further instructions
warnings.warn(
WARNING:torch.distributed.run:

Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed.

/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 30676) of binary: /opt/conda/bin/python
Traceback (most recent call last):
File "/opt/conda/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/opt/conda/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py", line 196, in
main()
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py", line 192, in main
launch(args)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py", line 177, in launch
run(args)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/run.py", line 785, in run
elastic_launch(
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
supar.cmds.biaffine_dep FAILED
Failures:
[1]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 1 (local_rank: 1)
exitcode  : 1 (pid: 30677)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[2]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 2 (local_rank: 2)
exitcode  : 1 (pid: 30678)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[3]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 3 (local_rank: 3)
exitcode  : 1 (pid: 30679)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[4]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 4 (local_rank: 4)
exitcode  : 1 (pid: 30680)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[5]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 5 (local_rank: 5)
exitcode  : 1 (pid: 30681)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[6]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 6 (local_rank: 6)
exitcode  : 1 (pid: 30682)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[7]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 7 (local_rank: 7)
exitcode  : 1 (pid: 30683)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
Root Cause (first observed failure):
[0]:
time      : 2023-08-24_08:10:36
host      : 309e7fc0781e
rank      : 0 (local_rank: 0)
exitcode  : 1 (pid: 30676)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
How can I fix it? plz help me...

I notice that the file path in your error message seems strange, such as ``/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../src/src_gopar/parse.py''.
Please try to enter the corresponding directory and then re-run the bash file.

Ok, I'll try soon
Then, I wonder that the how can I get the data like:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/tgt.txt'

You should download the preprocessed data, unzip them, and put them into https://github.com/HillZhang1999/SynGEC/tree/main/data

Is that preprocessed data same the link of data:
https://drive.google.com/file/d/1dIDfYhELrh3BEKgGpsPYAy5ehcobmMov/view
So I downloaded the data and unzip ./data/
but I got the error like
Apply BPE...
./preprocess_syngec_transformer.sh: line 22: ../../data/clang8_train/src.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 23: ../../data/clang8_train/tgt.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 24: ../../data/bea19_dev/src.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 25: ../../data/bea19_dev/tgt.txt: No such file or directory
Align subwords and words...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/clang8_train/src.txt'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt'
cp: cannot stat '../../data/clang8_train/src.txt': No such file or directory
cp: cannot stat '../../data/clang8_train/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/clang8_train/tgt.txt': No such file or directory
cp: cannot stat '../../data/clang8_train/tgt.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_dev/tgt.txt': No such file or directory
cp: cannot stat '../../data/bea19_dev/tgt.txt.bpe': No such file or directory
cp: cannot stat '../../data/clang8_train/src.txt.swm': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.swm': No such file or directory
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/clang8_train/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/clang8_train/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.swm'
cp: cannot stat '../../data/clang8_train/src.txt.conll_predict_gopar_np': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np': No such file or directory
Calculate dependency distance...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/clang8_train/src.txt.conll_predict_gopar'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.conll_predict_gopar'
cp: cannot stat '../../data/clang8_train/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/clang8_train/src.txt.conll_predict_gopar_np.probs': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np.probs': No such file or directory
Preprocess...
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
usage: preprocess.py [-h] [--no-progress-bar]
[--log-interval LOG_INTERVAL]
[--log-format LOG_FORMAT]
[--tensorboard-logdir TENSORBOARD_LOGDIR]
[--seed SEED] [--cpu] [--tpu] [--bf16]
[--memory-efficient-bf16] [--fp16]
[--memory-efficient-fp16]
[--fp16-no-flatten-grads]
[--fp16-init-scale FP16_INIT_SCALE]
[--fp16-scale-window FP16_SCALE_WINDOW]
[--fp16-scale-tolerance FP16_SCALE_TOLERANCE]
[--min-loss-scale MIN_LOSS_SCALE]
[--threshold-loss-scale THRESHOLD_LOSS_SCALE]
[--user-dir USER_DIR]
[--empty-cache-freq EMPTY_CACHE_FREQ]
[--all-gather-list-size ALL_GATHER_LIST_SIZE]
[--model-parallel-size MODEL_PARALLEL_SIZE]
[--checkpoint-suffix CHECKPOINT_SUFFIX]
[--checkpoint-shard-count CHECKPOINT_SHARD_COUNT]
[--quantization-config-path QUANTIZATION_CONFIG_PATH]
[--profile]
[--criterion {label_smoothed_cross_entropy,composite_loss,ctc,masked_lm,legacy_masked_lm_loss,wav2vec,sentence_prediction,label_smoothed_cross_entropy_with_alignment,cross_entropy,nat_loss,adaptive_loss,sentence_ranking,vocab_parallel_cross_entropy}]
[--tokenizer {space,moses,nltk}]
[--bpe {characters,bert,subword_nmt,fastbpe,byte_bpe,bytes,sentencepiece,gpt2,hf_byte_bpe}]
[--optimizer {adafactor,nag,adam,adagrad,adamax,lamb,sgd,adadelta}]
[--lr-scheduler {cosine,triangular,inverse_sqrt,tri_stage,fixed,reduce_lr_on_plateau,polynomial_decay}]
[--scoring {wer,sacrebleu,bleu,chrf}]
[--task TASK] [-s SRC] [-t TARGET]
[--source-lang-with-nt SRC] [--trainpref FP]
[--validpref FP] [--testpref FP]
[--align-suffix FP] [--conll-suffix FP [FP ...]]
[--dpd-suffix FP [FP ...]]
[--probs-suffix FP [FP ...]] [--swm-suffix FP]
[--destdir DIR] [--thresholdtgt N]
[--thresholdsrc N] [--tgtdict FP] [--srcdict FP]
[--labeldict FP [FP ...]] [--nwordstgt N]
[--nwordssrc N] [--alignfile ALIGN]
[--dataset-impl FORMAT] [--joined-dictionary]
[--only-source] [--padding-factor N]
[--workers N]
preprocess.py: error: argument --user-dir: invalid Optional value: '../../src/src_syngec/syngec_model'
Finished!
Apply BPE...
./preprocess_syngec_transformer.sh: line 112: ../../data/error_coded_train/src.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 113: ../../data/error_coded_train/tgt.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 114: ../../data/bea19_dev/src.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 115: ../../data/bea19_dev/tgt.txt: No such file or directory
Align subwords and words...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/error_coded_train/src.txt'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt'
cp: cannot stat '../../data/error_coded_train/src.txt': No such file or directory
cp: cannot stat '../../data/error_coded_train/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/error_coded_train/tgt.txt': No such file or directory
cp: cannot stat '../../data/error_coded_train/tgt.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_dev/tgt.txt': No such file or directory
cp: cannot stat '../../data/bea19_dev/tgt.txt.bpe': No such file or directory
cp: cannot stat '../../data/error_coded_train/src.txt.swm': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.swm': No such file or directory
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/error_coded_train/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/error_coded_train/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.swm'
cp: cannot stat '../../data/error_coded_train/src.txt.conll_predict_gopar_np': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np': No such file or directory
Calculate dependency distance...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/error_coded_train/src.txt.conll_predict_gopar'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.conll_predict_gopar'
cp: cannot stat '../../data/error_coded_train/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/error_coded_train/src.txt.conll_predict_gopar_np.probs': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np.probs': No such file or directory
Preprocess...
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
usage: preprocess.py [-h] [--no-progress-bar]
[--log-interval LOG_INTERVAL]
[--log-format LOG_FORMAT]
[--tensorboard-logdir TENSORBOARD_LOGDIR]
[--seed SEED] [--cpu] [--tpu] [--bf16]
[--memory-efficient-bf16] [--fp16]
[--memory-efficient-fp16]
[--fp16-no-flatten-grads]
[--fp16-init-scale FP16_INIT_SCALE]
[--fp16-scale-window FP16_SCALE_WINDOW]
[--fp16-scale-tolerance FP16_SCALE_TOLERANCE]
[--min-loss-scale MIN_LOSS_SCALE]
[--threshold-loss-scale THRESHOLD_LOSS_SCALE]
[--user-dir USER_DIR]
[--empty-cache-freq EMPTY_CACHE_FREQ]
[--all-gather-list-size ALL_GATHER_LIST_SIZE]
[--model-parallel-size MODEL_PARALLEL_SIZE]
[--checkpoint-suffix CHECKPOINT_SUFFIX]
[--checkpoint-shard-count CHECKPOINT_SHARD_COUNT]
[--quantization-config-path QUANTIZATION_CONFIG_PATH]
[--profile]
[--criterion {label_smoothed_cross_entropy,composite_loss,ctc,masked_lm,legacy_masked_lm_loss,wav2vec,sentence_prediction,label_smoothed_cross_entropy_with_alignment,cross_entropy,nat_loss,adaptive_loss,sentence_ranking,vocab_parallel_cross_entropy}]
[--tokenizer {space,moses,nltk}]
[--bpe {characters,bert,subword_nmt,fastbpe,byte_bpe,bytes,sentencepiece,gpt2,hf_byte_bpe}]
[--optimizer {adafactor,nag,adam,adagrad,adamax,lamb,sgd,adadelta}]
[--lr-scheduler {cosine,triangular,inverse_sqrt,tri_stage,fixed,reduce_lr_on_plateau,polynomial_decay}]
[--scoring {wer,sacrebleu,bleu,chrf}]
[--task TASK] [-s SRC] [-t TARGET]
[--source-lang-with-nt SRC] [--trainpref FP]
[--validpref FP] [--testpref FP]
[--align-suffix FP] [--conll-suffix FP [FP ...]]
[--dpd-suffix FP [FP ...]]
[--probs-suffix FP [FP ...]] [--swm-suffix FP]
[--destdir DIR] [--thresholdtgt N]
[--thresholdsrc N] [--tgtdict FP] [--srcdict FP]
[--labeldict FP [FP ...]] [--nwordstgt N]
[--nwordssrc N] [--alignfile ALIGN]
[--dataset-impl FORMAT] [--joined-dictionary]
[--only-source] [--padding-factor N]
[--workers N]
preprocess.py: error: argument --user-dir: invalid Optional value: '../../src/src_syngec/syngec_model'
Finished!
Apply BPE...
./preprocess_syngec_transformer.sh: line 202: ../../data/wi_locness_train/src.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 203: ../../data/wi_locness_train/tgt.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 204: ../../data/bea19_dev/src.txt: No such file or directory
./preprocess_syngec_transformer.sh: line 205: ../../data/bea19_dev/tgt.txt: No such file or directory
Align subwords and words...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/src.txt'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt'
cp: cannot stat '../../data/wi_locness_train/src.txt': No such file or directory
cp: cannot stat '../../data/wi_locness_train/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/wi_locness_train/tgt.txt': No such file or directory
cp: cannot stat '../../data/wi_locness_train/tgt.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_dev/tgt.txt': No such file or directory
cp: cannot stat '../../data/bea19_dev/tgt.txt.bpe': No such file or directory
cp: cannot stat '../../data/wi_locness_train/src.txt.swm': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.swm': No such file or directory
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.swm'
cp: cannot stat '../../data/wi_locness_train/src.txt.conll_predict_gopar_np': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np': No such file or directory
Calculate dependency distance...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/src.txt.conll_predict_gopar'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_dev/src.txt.conll_predict_gopar'
cp: cannot stat '../../data/wi_locness_train/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/wi_locness_train/src.txt.conll_predict_gopar_np.probs': No such file or directory
cp: cannot stat '../../data/bea19_dev/src.txt.conll_predict_gopar_np.probs': No such file or directory
Preprocess...
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
usage: preprocess.py [-h] [--no-progress-bar]
[--log-interval LOG_INTERVAL]
[--log-format LOG_FORMAT]
[--tensorboard-logdir TENSORBOARD_LOGDIR]
[--seed SEED] [--cpu] [--tpu] [--bf16]
[--memory-efficient-bf16] [--fp16]
[--memory-efficient-fp16]
[--fp16-no-flatten-grads]
[--fp16-init-scale FP16_INIT_SCALE]
[--fp16-scale-window FP16_SCALE_WINDOW]
[--fp16-scale-tolerance FP16_SCALE_TOLERANCE]
[--min-loss-scale MIN_LOSS_SCALE]
[--threshold-loss-scale THRESHOLD_LOSS_SCALE]
[--user-dir USER_DIR]
[--empty-cache-freq EMPTY_CACHE_FREQ]
[--all-gather-list-size ALL_GATHER_LIST_SIZE]
[--model-parallel-size MODEL_PARALLEL_SIZE]
[--checkpoint-suffix CHECKPOINT_SUFFIX]
[--checkpoint-shard-count CHECKPOINT_SHARD_COUNT]
[--quantization-config-path QUANTIZATION_CONFIG_PATH]
[--profile]
[--criterion {label_smoothed_cross_entropy,composite_loss,ctc,masked_lm,legacy_masked_lm_loss,wav2vec,sentence_prediction,label_smoothed_cross_entropy_with_alignment,cross_entropy,nat_loss,adaptive_loss,sentence_ranking,vocab_parallel_cross_entropy}]
[--tokenizer {space,moses,nltk}]
[--bpe {characters,bert,subword_nmt,fastbpe,byte_bpe,bytes,sentencepiece,gpt2,hf_byte_bpe}]
[--optimizer {adafactor,nag,adam,adagrad,adamax,lamb,sgd,adadelta}]
[--lr-scheduler {cosine,triangular,inverse_sqrt,tri_stage,fixed,reduce_lr_on_plateau,polynomial_decay}]
[--scoring {wer,sacrebleu,bleu,chrf}]
[--task TASK] [-s SRC] [-t TARGET]
[--source-lang-with-nt SRC] [--trainpref FP]
[--validpref FP] [--testpref FP]
[--align-suffix FP] [--conll-suffix FP [FP ...]]
[--dpd-suffix FP [FP ...]]
[--probs-suffix FP [FP ...]] [--swm-suffix FP]
[--destdir DIR] [--thresholdtgt N]
[--thresholdsrc N] [--tgtdict FP] [--srcdict FP]
[--labeldict FP [FP ...]] [--nwordstgt N]
[--nwordssrc N] [--alignfile ALIGN]
[--dataset-impl FORMAT] [--joined-dictionary]
[--only-source] [--padding-factor N]
[--workers N]
preprocess.py: error: argument --user-dir: invalid Optional value: '../../src/src_syngec/syngec_model'
Finished!
Apply BPE...
./preprocess_syngec_transformer.sh: line 290: ../../data/conll14_test/src.txt: No such file or directory
Align subwords and words...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/conll14_test/src.txt'
cp: cannot stat '../../data/conll14_test/src.txt': No such file or directory
cp: cannot stat '../../data/conll14_test/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/conll14_test/src.txt.swm': No such file or directory
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/conll14_test/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/conll14_test/src.txt.swm'
cp: cannot stat '../../data/conll14_test/src.txt.conll_predict_gopar_np': No such file or directory
Calculate dependency distance...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/conll14_test/src.txt.conll_predict_gopar'
cp: cannot stat '../../data/conll14_test/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/conll14_test/src.txt.conll_predict_gopar_np.probs': No such file or directory
Preprocess...
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
usage: preprocess.py [-h] [--no-progress-bar]
[--log-interval LOG_INTERVAL]
[--log-format LOG_FORMAT]
[--tensorboard-logdir TENSORBOARD_LOGDIR]
[--seed SEED] [--cpu] [--tpu] [--bf16]
[--memory-efficient-bf16] [--fp16]
[--memory-efficient-fp16]
[--fp16-no-flatten-grads]
[--fp16-init-scale FP16_INIT_SCALE]
[--fp16-scale-window FP16_SCALE_WINDOW]
[--fp16-scale-tolerance FP16_SCALE_TOLERANCE]
[--min-loss-scale MIN_LOSS_SCALE]
[--threshold-loss-scale THRESHOLD_LOSS_SCALE]
[--user-dir USER_DIR]
[--empty-cache-freq EMPTY_CACHE_FREQ]
[--all-gather-list-size ALL_GATHER_LIST_SIZE]
[--model-parallel-size MODEL_PARALLEL_SIZE]
[--checkpoint-suffix CHECKPOINT_SUFFIX]
[--checkpoint-shard-count CHECKPOINT_SHARD_COUNT]
[--quantization-config-path QUANTIZATION_CONFIG_PATH]
[--profile]
[--criterion {label_smoothed_cross_entropy,composite_loss,ctc,masked_lm,legacy_masked_lm_loss,wav2vec,sentence_prediction,label_smoothed_cross_entropy_with_alignment,cross_entropy,nat_loss,adaptive_loss,sentence_ranking,vocab_parallel_cross_entropy}]
[--tokenizer {space,moses,nltk}]
[--bpe {characters,bert,subword_nmt,fastbpe,byte_bpe,bytes,sentencepiece,gpt2,hf_byte_bpe}]
[--optimizer {adafactor,nag,adam,adagrad,adamax,lamb,sgd,adadelta}]
[--lr-scheduler {cosine,triangular,inverse_sqrt,tri_stage,fixed,reduce_lr_on_plateau,polynomial_decay}]
[--scoring {wer,sacrebleu,bleu,chrf}]
[--task TASK] [-s SRC] [-t TARGET]
[--source-lang-with-nt SRC] [--trainpref FP]
[--validpref FP] [--testpref FP]
[--align-suffix FP] [--conll-suffix FP [FP ...]]
[--dpd-suffix FP [FP ...]]
[--probs-suffix FP [FP ...]] [--swm-suffix FP]
[--destdir DIR] [--thresholdtgt N]
[--thresholdsrc N] [--tgtdict FP] [--srcdict FP]
[--labeldict FP [FP ...]] [--nwordstgt N]
[--nwordssrc N] [--alignfile ALIGN]
[--dataset-impl FORMAT] [--joined-dictionary]
[--only-source] [--padding-factor N]
[--workers N]
preprocess.py: error: argument --user-dir: invalid Optional value: '../../src/src_syngec/syngec_model'
Finished!
Apply BPE...
./preprocess_syngec_transformer.sh: line 358: ../../data/bea19_test/src.txt: No such file or directory
Align subwords and words...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/subword_align.py", line 41, in
with open(file_word, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_test/src.txt'
cp: cannot stat '../../data/bea19_test/src.txt': No such file or directory
cp: cannot stat '../../data/bea19_test/src.txt.bpe': No such file or directory
cp: cannot stat '../../data/bea19_test/src.txt.swm': No such file or directory
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_test/src.txt.swm'
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/syntax_information_reprocess.py", line 37, in
swm_list = [[int(i) for i in line.rstrip("\n").split()] for line in open(swm_file, "r").readlines()]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_test/src.txt.swm'
cp: cannot stat '../../data/bea19_test/src.txt.conll_predict_gopar_np': No such file or directory
Calculate dependency distance...
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../utils/calculate_dependency_distance.py", line 126, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/bea19_test/src.txt.conll_predict_gopar'
cp: cannot stat '../../data/bea19_test/src.txt.conll_predict_gopar_np.dpd': No such file or directory
cp: cannot stat '../../data/bea19_test/src.txt.conll_predict_gopar_np.probs': No such file or directory
Preprocess...
/opt/conda/lib/python3.10/site-packages/torch/cuda/init.py:546: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
usage: preprocess.py [-h] [--no-progress-bar]
[--log-interval LOG_INTERVAL]
[--log-format LOG_FORMAT]
[--tensorboard-logdir TENSORBOARD_LOGDIR]
[--seed SEED] [--cpu] [--tpu] [--bf16]
[--memory-efficient-bf16] [--fp16]
[--memory-efficient-fp16]
[--fp16-no-flatten-grads]
[--fp16-init-scale FP16_INIT_SCALE]
[--fp16-scale-window FP16_SCALE_WINDOW]
[--fp16-scale-tolerance FP16_SCALE_TOLERANCE]
[--min-loss-scale MIN_LOSS_SCALE]
[--threshold-loss-scale THRESHOLD_LOSS_SCALE]
[--user-dir USER_DIR]
[--empty-cache-freq EMPTY_CACHE_FREQ]
[--all-gather-list-size ALL_GATHER_LIST_SIZE]
[--model-parallel-size MODEL_PARALLEL_SIZE]
[--checkpoint-suffix CHECKPOINT_SUFFIX]
[--checkpoint-shard-count CHECKPOINT_SHARD_COUNT]
[--quantization-config-path QUANTIZATION_CONFIG_PATH]
[--profile]
[--criterion {label_smoothed_cross_entropy,composite_loss,ctc,masked_lm,legacy_masked_lm_loss,wav2vec,sentence_prediction,label_smoothed_cross_entropy_with_alignment,cross_entropy,nat_loss,adaptive_loss,sentence_ranking,vocab_parallel_cross_entropy}]
[--tokenizer {space,moses,nltk}]
[--bpe {characters,bert,subword_nmt,fastbpe,byte_bpe,bytes,sentencepiece,gpt2,hf_byte_bpe}]
[--optimizer {adafactor,nag,adam,adagrad,adamax,lamb,sgd,adadelta}]
[--lr-scheduler {cosine,triangular,inverse_sqrt,tri_stage,fixed,reduce_lr_on_plateau,polynomial_decay}]
[--scoring {wer,sacrebleu,bleu,chrf}]
[--task TASK] [-s SRC] [-t TARGET]
[--source-lang-with-nt SRC] [--trainpref FP]
[--validpref FP] [--testpref FP]
[--align-suffix FP] [--conll-suffix FP [FP ...]]
[--dpd-suffix FP [FP ...]]
[--probs-suffix FP [FP ...]] [--swm-suffix FP]
[--destdir DIR] [--thresholdtgt N]
[--thresholdsrc N] [--tgtdict FP] [--srcdict FP]
[--labeldict FP [FP ...]] [--nwordstgt N]
[--nwordssrc N] [--alignfile ALIGN]
[--dataset-impl FORMAT] [--joined-dictionary]
[--only-source] [--padding-factor N]
[--workers N]
preprocess.py: error: argument --user-dir: invalid Optional value: '../../src/src_syngec/syngec_model'
Finished!

please enter the directory of this bash file, then run  cat ../../data/clang8_train/src.txt, check whether there is actually a file. If not, please check the way you unzip the data.

Processing parallel files...
Traceback (most recent call last):
File "/opt/conda/bin/errant_parallel", line 8, in
sys.exit(main())
File "/opt/conda/lib/python3.10/site-packages/errant/commands/parallel_to_m2.py", line 16, in main
in_files = [stack.enter_context(open(i)) for i in [args.orig]+args.cor]
File "/opt/conda/lib/python3.10/site-packages/errant/commands/parallel_to_m2.py", line 16, in
in_files = [stack.enter_context(open(i)) for i in [args.orig]+args.cor]
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/tgt.txt'
Traceback (most recent call last):
File "/mnt/ssd_mnt/pyj/SynGEC/bash/english_exp/../../src/src_gopar/convert_gec_data_to_parsing_data_english.py", line 153, in
with open(conll_file, "r") as f1:
FileNotFoundError: [Errno 2] No such file or directory: '../../data/wi_locness_train/tgt.txt.conll_predict'
/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py:181: FutureWarning: The module torch.distributed.launch is deprecated
and will be removed in future. Use torchrun.
Note that --use-env is set by default in torchrun.
If your script expects --local-rank argument to be set, please
change it to read from os.environ['LOCAL_RANK'] instead. See
https://pytorch.org/docs/stable/distributed.html#launch-utility for
further instructions
warnings.warn(
WARNING:torch.distributed.run:

Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed.

/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
/opt/conda/bin/python: No module named supar.cmds.biaffine_dep
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 34107) of binary: /opt/conda/bin/python
Traceback (most recent call last):
File "/opt/conda/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/opt/conda/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py", line 196, in
main()
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py", line 192, in main
launch(args)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launch.py", line 177, in launch
run(args)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/run.py", line 785, in run
elastic_launch(
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
supar.cmds.biaffine_dep FAILED
Failures:
[1]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 1 (local_rank: 1)
exitcode  : 1 (pid: 34108)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[2]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 2 (local_rank: 2)
exitcode  : 1 (pid: 34109)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[3]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 3 (local_rank: 3)
exitcode  : 1 (pid: 34110)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[4]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 4 (local_rank: 4)
exitcode  : 1 (pid: 34111)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[5]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 5 (local_rank: 5)
exitcode  : 1 (pid: 34112)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[6]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 6 (local_rank: 6)
exitcode  : 1 (pid: 34113)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[7]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 7 (local_rank: 7)
exitcode  : 1 (pid: 34114)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
Root Cause (first observed failure):
[0]:
time      : 2023-08-25_12:30:09
host      : 309e7fc0781e
rank      : 0 (local_rank: 0)
exitcode  : 1 (pid: 34107)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
nohup: appending output to 'nohup.out'
what's the problem and how can I fix it?

If you don't want to re-train the parser, you can directly skip the data preprocess step. The preprocessed file can be directly downloaded from our Google Drive.
If you want to re-train the parser, you must download the required datasets from their official websites, and put them into the corresponding director (src.txt, tgt.txt, one sentence one line).

您好，请问您解决了这个问题吗，我解压缩后也没有明确的src.txt和tgt.txt，解压缩的文件是这样的，请问该如何做呢

您好，请问您解决了这个问题吗，我解压缩后也没有明确的src.txt和tgt.txt，解压缩的文件是这样的，请问该如何做呢

由于版权问题，我们没有提供文本文件，只有处理好的二进制文件，可以直接拿来训练


[proposal] Capturing step exit codes in Tasks

Expected Behavior
It should be possible to use easily use off-the-shelves (OTS) images as steps in Tekton tasks.
Actual Behavior
When using OTS images, a step / task author does not control the error case behaviour of the image. It may be desirable for the pipeline to continue even if there was a failure.
One way to achieve this could be to wrap the original image into a custom image, but that does not scale well if the number of images grows.
An alternative way would be to allow a Task to fail without having the whole pipeline failing. We discussed this a lot in the past. Finally tasks will help a bit, cloud events also provide a way around this, however neither solution provide a solution that feels natural for the problem.
Proposed Solution
We could optionally capture the exit code from steps and expose it as test results.
This could be achieved using entrypoint image, which already wraps around all steps images.
This feature could be enabled by setting a flag in the task spec (I would not consider this decision a runtime one).
The benefits would be:

the exit code becomes available as a result to following tasks and conditions, allowing for branching based on the result, using conditions as they exists today
limited change to the task execution logic:

once a step fails, no more steps are executed (like before)
if the exit code is captured, the step failure does not cause a task failure

no change to the pipeline logic: once a task fails, the pipeline fails
the solution could co-exist with any future development in terms of conditionals and workflow capabilities

/kind feature

@afrittoli I can not think of any use case at this moment, but would be beneficial to pipeline level exception or onFailure

The use case that triggered this is being able to use off-the-shelves images and control the exit code, so that the pipeline can be branched based on the outcome of the task.
If would allow implementing something like onFailure without forcing the task do define the logic to be taken on failure, leaving it to the next tasks to decide.

Yes I'm not interested in having to create/maintain another thing outside of tekton for capturing/monitoring for events and then making additional calls against tekton to react to those events.
I just need a simple way to get access to a task's exit code. Right now I'm hacking this with something like the below (only for off the shelf images that I can wrap). I obviously can't do this with an off the shelf image that I am not wrapping in my own script task etc.
        <something that can fail, but should not halt the entire execution>
        LAST_EXIT_CODE=$?
        echo -n $LAST_EXIT_CODE > /tekton/results/last-exit-code

Then I can reference the task's exit code in the results from a subsequent pipeline condition.
This of course makes the failing task still look like it's succeeding because the echo exit code is zero... hacky but it works.

/remove-lifecycle rotten
/remove-lifecycle stale
/reopen

@skaegi I believe this would partly help with your use case of failing tests that should not fail a pipeline :)

/assign
I will start writing TEP for @skaegi's use case.

I'm wondering how this relates to https://github.com/tektoncd/pipeline/issues/1559 ? (if it does? they feel like similar features to me?)
@afrittoli is it possible to add more detailed use cases? (maybe you are already doing this in the TEP) - as usual I feel skeptical about new features, particularly when they are changing the meaning of failure - but a few use cases can definitely bring me around pretty easily!

I'm wondering how this relates to https://github.com/tektoncd/pipeline/issues/1559 ? (if it does? they feel like similar features to me?)
@afrittoli is it possible to add more detailed use cases? (maybe you are already doing this in the TEP) - as usual I feel skeptical about new features, particularly when they are changing the meaning of failure - but a few use cases can definitely bring me around pretty easily!

I'm wondering how this relates to #1559 ? (if it does? they feel like similar features to me?)

It seems related, even though #1559 puts control on the step after the one that might fail.
I filed this issue to reply to a specific request, and I missed #1559 when doing so, sorry about that.

@afrittoli is it possible to add more detailed use cases? (maybe you are already doing this in the TEP) - as usual I feel skeptical about new features, particularly when they are changing the meaning of failure - but a few use cases can definitely bring me around pretty easily!

The use case is being able to have a task in your pipeline that generates useful information (often by running some kind of test / information) which should not prevent a successful execution of the pipeline.  Exposing the original exit code allows tools to visually highlight the fact that an error code was captured.
The only way to achieve something similar today is to use a script that wraps the execution of the tool and captures the original exit code in a result. The limitations of these approach are:

it requires wrapping off-the-shelve images with a script
there is no standard way to expose the original exit code, which makes it impossible for the tools (cli, dashboard) to build any functionality on top

This change has a very limited impact on the code base (see PoC) and rest of Tekton functionality; personally I feel it would be an easy win which would make a few users happy. It would be released in alpha state, so nothing would prevent us from taking a different approach in the future if we see this can be achieved better as part of a different feature.

I'm wondering how this relates to #1559 ? (if it does? they feel like similar features to me?)

It seems related, even though #1559 puts control on the step after the one that might fail.
I filed this issue to reply to a specific request, and I missed #1559 when doing so, sorry about that.

@afrittoli is it possible to add more detailed use cases? (maybe you are already doing this in the TEP) - as usual I feel skeptical about new features, particularly when they are changing the meaning of failure - but a few use cases can definitely bring me around pretty easily!

The use case is being able to have a task in your pipeline that generates useful information (often by running some kind of test / information) which should not prevent a successful execution of the pipeline.  Exposing the original exit code allows tools to visually highlight the fact that an error code was captured.
The only way to achieve something similar today is to use a script that wraps the execution of the tool and captures the original exit code in a result. The limitations of these approach are:

it requires wrapping off-the-shelve images with a script
there is no standard way to expose the original exit code, which makes it impossible for the tools (cli, dashboard) to build any functionality on top

This change has a very limited impact on the code base (see PoC) and rest of Tekton functionality; personally I feel it would be an easy win which would make a few users happy. It would be released in alpha state, so nothing would prevent us from taking a different approach in the future if we see this can be achieved better as part of a different feature.

Exposing the original exit code allows tools to visually highlight the fact that an error code was captured.

I'm guessing these tools would probably want the logs too, right? I'm not sure the exit code alone is enough information.

Exposing the original exit code allows tools to visually highlight the fact that an error code was captured.

I'm guessing these tools would probably want the logs too, right? I'm not sure the exit code alone is enough information.

This change could be used also to achieve a series of steps like: running tests, post-process and upload logs and test results, all as part of the same task.  In cases where a test failure should fail the pipeline, it would require the last step to exit with the exit code that was captured from the test-running step.
This specific use case could probably be implemented by introducing pre/post steps, or finally at task level, or by allowing a pipeline to be executed as a task (i.e. on a single node, with no need for extra I/O) thus leveraging the pipeline workflow capabilities in a task. But this will require more time and effort to design and implement.

This change could be used also to achieve a series of steps like: running tests, post-process and upload logs and test results, all as part of the same task.  In cases where a test failure should fail the pipeline, it would require the last step to exit with the exit code that was captured from the test-running step.
This specific use case could probably be implemented by introducing pre/post steps, or finally at task level, or by allowing a pipeline to be executed as a task (i.e. on a single node, with no need for extra I/O) thus leveraging the pipeline workflow capabilities in a task. But this will require more time and effort to design and implement.

Exposing the original exit code allows tools to visually highlight the fact that an error code was captured.

I'm guessing these tools would probably want the logs too, right? I'm not sure the exit code alone is enough information.

Yeah, sure, but logs would still be available the same way they are today? The exit code should be enough info to make a step or task as "yellow".

Exposing the original exit code allows tools to visually highlight the fact that an error code was captured.

I'm guessing these tools would probably want the logs too, right? I'm not sure the exit code alone is enough information.

Yeah, sure, but logs would still be available the same way they are today? The exit code should be enough info to make a step or task as "yellow".

The exit code should be enough info to make a step or task as "yellow".

Would it be a situation like certain exit codes are yellow and some are red?
I'm also wondering: isn't this information available in the container statuses in a taskrun already, if a system really wanted to use it?
(I might be able to understand better if you could explain the use case in more detail)

The exit code should be enough info to make a step or task as "yellow".

Would it be a situation like certain exit codes are yellow and some are red?
I'm also wondering: isn't this information available in the container statuses in a taskrun already, if a system really wanted to use it?
(I might be able to understand better if you could explain the use case in more detail)

For exit codes I think we should stick with just...

exit code == 0 (success)
exit code != 0 (failure)

A warn or yellow state is something that can get layered later by somehow tagging the step or even by searching the logs for [WARN] or similar. It might be nice to have smarts to mark a step as being "yellow" but there still are lots of cases where a step's success is not critical to the success of the task.
Some real world examples where you don't "necessarily" want to fail a build...

Linting
Localization checks
Unit tests for experimental features typically behind a feature flag
"clean" operations where it's possible there's nothing to clean-up
"create" operations where it's possible the entity is already created

--
Here's an old school example from makefiles ... https://www.gnu.org/software/make/manual/html_node/Errors.html

For exit codes I think we should stick with just...

exit code == 0 (success)
exit code != 0 (failure)

A warn or yellow state is something that can get layered later by somehow tagging the step or even by searching the logs for [WARN] or similar. It might be nice to have smarts to mark a step as being "yellow" but there still are lots of cases where a step's success is not critical to the success of the task.
Some real world examples where you don't "necessarily" want to fail a build...

Linting
Localization checks
Unit tests for experimental features typically behind a feature flag
"clean" operations where it's possible there's nothing to clean-up
"create" operations where it's possible the entity is already created

--
Here's an old school example from makefiles ... https://www.gnu.org/software/make/manual/html_node/Errors.html

So I am a bit torn about this feature (wasn't sure to comment here or on the TEP).
I tend to think, as it can definitely be done using the feature set (aka wrapping the binary/command/process run in a step and write in a result), I would advocate towards not adding it. That said, as @afrittoli, this would mean, to display things like a "yellow" task (similar to a yellow build/job in Jenkins), external tooling (dashboard, cli, …) would need to rely on some conventions rather than a "contract" from the API.

So I am a bit torn about this feature (wasn't sure to comment here or on the TEP).
I tend to think, as it can definitely be done using the feature set (aka wrapping the binary/command/process run in a step and write in a result), I would advocate towards not adding it. That said, as @afrittoli, this would mean, to display things like a "yellow" task (similar to a yellow build/job in Jenkins), external tooling (dashboard, cli, …) would need to rely on some conventions rather than a "contract" from the API.

I agree with @vdemeester  - im gonna try to concentrate my feedback on the TEP PR (https://github.com/tektoncd/community/pull/302) - I think there are a few features we're discussing simultaneously here (maybe? e.g. allowing a step to fail, exposing exit codes), I'm hoping we can narrow it down a bit in the TEP.

I agree with @vdemeester  - im gonna try to concentrate my feedback on the TEP PR (https://github.com/tektoncd/community/pull/302) - I think there are a few features we're discussing simultaneously here (maybe? e.g. allowing a step to fail, exposing exit codes), I'm hoping we can narrow it down a bit in the TEP.

/assign

/assign

/remove-lifecycle stale
Problem statement (TEP-0040) is merged, working on the proposal.

/lifecycle frozen

oooo I think maybe this can be closed now that @pritidesai has implemented onError?

yes please 🙏 , this can be closed now since we have onError in a step now.
Implemented in https://github.com/tektoncd/pipeline/pull/4106 ✅


Sometimes DEP buttons don't work

Sometimes clicking the dependency buttons don't jump to the package.  If you click DEP and REQ-BY links enough it will eventually get stuck.  The problem can be seen on the sample https://pacvis.farseerfc.me tree by following the DEP buttons on the list below.
base-devel
pacman
curl
ca-certificates
When 'curl' is selected the ca-certificates button does not work.  Also the package cannot be searched for in this state.

I think i fixed this in 1edbeac7e9fe91a3bd8dea299db0c9818e28923e
the problem was node.label was being set to undefined for distant nodes


fix: MD039/no-space-in-links

Remove leading/trailing spaces in Markdown links

@nschonni : Thanks for your contribution! The author, @jeevansd, has been notified to review your proposed change.

We're reviewing this pull request.

@ktoliver : Thanks for your contribution! The author, @jeevansd, has been notified to review your proposed change.

@nschonni @jeevansd - Private repo PR 67646 replaces this pull request. We moved the commit to the private repo so we can validate suggested formatting changes by using automated validation and staging.


fix documentation

Coverage remained the same at 81.971% when pulling c287f6463f3379cfcba55275b1ae9941751a4d8e on quangtdn:master into 1a45b0b532be78ad21ec767bff167abdeb89ea5b on CS2103AUG2017-W10-B4:master.

Coverage remained the same at 81.971% when pulling c287f6463f3379cfcba55275b1ae9941751a4d8e on quangtdn:master into 1a45b0b532be78ad21ec767bff167abdeb89ea5b on CS2103AUG2017-W10-B4:master.


Feature/bags expand

Adds arrow next to the main bag to show/hide rest of the bags

Hey,
looks nice!
I would merge it, but i made a major refactor in the last two days, tl:dr: using Ace3 with modules.
The code is nearly identical, i copied most of it over (with minor cleanup, removed old comments etc), and integrated it into the Ace3 module system. It was the first time using Ace3, so it's still a work in progress.
The goal was better customization, so i merged a few of my old modules into less, bigger modules; e.g. Micromenu.lua is now in Modules/Actionbar.lua . Merging your PR into this would be a bit of a nightmare (the files you worked in are gone etc), so i would close this after i push the refactor to the main branch. You could rewrite and make an new PR, should be no problem with a few infos:
I guess you haven't used Ace3 either (you said this was your first LUA experience), so some of it might be a bit confusing, but after a few days it makes sense. I implemented the default profile and interface options system, which looks a bit like magic, but you could start like this:
Modules/Actionbar.lua line 10: defaults holds default settings for that module, so you can add a variable with
local defaults  = {  ... ,  bagsExpanded= true, }
and call your Module.BagBarExpandToggled(bagsExpanded) (add the Module.) under  line 147: function Module:ApplySettings(), e.g. Module.BagBarExpandToggled(db.bagsExpanded)
This function gets called everytime some config value is updated/loaded.
function CreateBagExpandButton() should be created as  function Module.CreateBagExpandButton() and called under Line 1417: function Module.Wrath()  (code is only duplicated under Module.Era() if Era needs something different, so not in this instance), which gets called in line 134: function Module:OnEnable().
The OnClick() needs to update the variable, so i think the best way would be to just call setOption({'bagsExpanded'}, not Module.db.profile.bagsExpanded).
Let me know if you need anything.
PS: I could have integrated the feature in less time than typing this comment took, but i didn't want to remove your contribution from the code history!

The problem is that if don't wait for BAG_UPDATE_DELAYED on the start when bags were hidden it looks like this:

and I'm not sure what shows keyring

Adjusted to new version. It looks quite powerful!

The problem is that if don't wait for BAG_UPDATE_DELAYED on the start when bags were hidden it looks like this:  and I'm not sure what shows keyring

Ah ok, but it might be something with the load order.
Will review later!
Btw, are you using VS Code? I'm using this plugin to auto format .lua on save, so the style will be consistent, so e.g. your line 1379 or 1405-1407 might get a formatting commit soon^^
This is also nice.

I guess frame:UnregisterEvent('BAG_UPDATE_DELAYED') after first setup would be the easiest solution; seems to work.


Support for custom labels and annotations to Server, repo, application set and application controller

Is your feature request related to a problem? Please describe.
Hi! I need a feature that allows the addition of custom labels and annotations to pods deployed by the operator, specifically in the server, repos, application set and application controller components. This is required to enable direct metric scraping within the pod using Vector in my environment.
Describe the solution you'd like
Something like that:
spec:
  server:
    customPodLabels:
      custom: label
      asdf: server
    customPodAnnotations:
      asdf: server
      custom: annotation
  repo:
    customPodLabels:
      custom: label
      asdf: repo
    customPodAnnotations:
      asdf: repo
      custom: annotation
  controller:
    customPodLabels:
      custom: label
      asdf: controller
    customPodAnnotations:
      asdf: controller
      custom: annotation
  applicationSet:
    customPodLabels:
      custom: label
      asdf: applicationSet
    customPodAnnotations:
      asdf: applicationSet
      custom: annotation

Additional context
When I saw that the operator doesn´t support this feature, I found this issue and this PR.  Inspired by the code that @AlexanderThaller did in his branch, I started working on my own version, i have a branch tfor testing and I accidentally opened a PR. I want to make another branch with diferent commits for a better review.

I'm nooby with go and makefiles, sorry for the unnecessary commits  😅
I included all the important changes in the first commit; the others were just to pass the CI.


enhancement: Publish JSON schemas for nested messages

Description
I'd previously assumed we only needed to generate schemas for top-level messages, but actually the TestFixture doesn't reference its nested messages AuxData, Principals, and Resources, so those schemas weren't generated.
This PR generates standalone schemas for nested messages as well, so we have cerbos/policy/v1/TestFixture/AuxData.schema.json etc.

Can we exclude them?

Done!

Codecov Report

Merging #778 (2832704) into main (b33c1b4) will increase coverage by 0.21%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #778      +/-   ##
==========================================
+ Coverage   54.50%   54.72%   +0.21%
==========================================
  Files          96       96
  Lines       10168    10168
==========================================
+ Hits         5542     5564      +22
+ Misses       4148     4128      -20
+ Partials      478      476       -2

Impacted Files
Coverage Δ

internal/engine/engine.go
69.97% <0.00%> (+0.80%)
:arrow_up:

internal/storage/index/builder.go
83.90% <0.00%> (+5.17%)
:arrow_up:

internal/compile/errors.go
55.55% <0.00%> (+15.87%)
:arrow_up:


Lets begin button on main page don't work

The Lets Begin button on main page does nothing

Can you tell where do it needs to redirect, I can create a PR fixing it

Currently, It works correctly. It needs to scroll bottom.

Notify me button needs to redirect to the contact us page. so you can work on that.

Okay I will work on it


Previous version just checked option support, but not enable it.
Also OpenCV tests reports invalid AVX and AVX2 support status.

@vpisarev Please look at it.

:+1:


Provide an UMD bundle

Currently, the react-confirm-bootstrap is provided as a CommonJS module, but I'd like to be able to use it in an AMD environment.

@gregthebusker, would you mind creating a new release that includes this change?

@jochenberger Done

Thanks, but I think something went wrong. There's a 3.1.5 tag in git, but only a 4.0.0 release on npm.

@jochenberger Sorry about that. You should use the 4.0.0 release


Please invite me to the GitHub Community Organization

Name
Charles Berry
Discord Username (if applicable)
No response
Additional Context
I'd like to join and contribute here

Invitation sent for the GitHub Organisation. Welcome to the community 🎉#
Don't forget after accepting to make it public so it appears on your GitHub profile for everyone else to see, you can do this by finding your name in the GitHub organisation list and change the dropdown to public https://github.com/orgs/jaidevstudio/people
Like this

Tips for practising:
Remember contributing to open source is not just about code, its about collaboration, communication and adding value
I hope that helps

Please check your email or organisation page 🙏


Add Card component

[x] Card component
[x] Card.Header component
[x] Card.Body component
[x] Card.Footer component

Usage
import { Card, ButtonLink } from '@fuel-js/react';

export default () => (
  <Card>
    <Card.Header>Some Title</Card.Header>
    <Card.Body>Image a long and beautiful text here!</Card.Body>
    <Card.Footer>
      <ButtonLink variant="link">More info</ButtonLink>
    </Card.Footer>
  </Alert>
);

Custom props

boxShadow: BoxShadowSizes
direction: 'row' | 'column'

closed on commit 979e6c3421f42e5ef92a2ea0c3d1badf9c5d1102

closed on commit 979e6c3421f42e5ef92a2ea0c3d1badf9c5d1102


Can't use FactoryGirl with my Rails Engine

Hi guys,
I opened this SO question http://stackoverflow.com/questions/15717431/rails-engine-with-rspec-and-factorygirl.
Briefly, I followed a few tutorials, and tried to change bits and pieces of my engine, but still getting " uninitialized constant GenericRecipe" error.
The repo is here: https://github.com/valk/edible-recipe
Thank you.

etdsoft comment was very useful. Specifically, there is a know 'feature' of FactoryGirl that it does not define its paths in exactly the same way as rspec, so when using an engine you need to add to the rails_helper the following
FactoryGirl.definition_file_paths << File.join(File.dirname(__FILE__), 'factories')
FactoryGirl.find_definitions

assuming the helper is at engine_root/spec.


[BUG] - Multiplayer Hunting Road - Expected values do not appear

What happened?
When running the Hunting Road in a multiplayer session, none of the HP values for monsters in the road will appear without repeated overlay restarts (even then. the HP values usually won't appear). Similar issues exist for status ailment buildup.
This issue does not appear to occur in standard LR/HR/GR quests - only in the hunting road. Perhaps the overlay is not able to find monster statistics in that location?
What version of the program are you using?
Latest version
What version of the game are you using?
High-Grade Edition

I got a problem with a friend and me on road I'm with same config than Tolly, sometime we saw on road, I got his stats with a totally different set


[Plank Sack] Counter desyncs when repairing bridges in the Hallowed Sepulchre

This issue is for the external plugin: {Plank Sack}
When repairing bridges in the Hallowed Sepulchre to reach coffins, the plank sack counter does not change until manually checking the sack. Repairing bridges consumes two of any plank type.

Ah that would make sense, I didn't remember that there was something like that in the Sepulchre. I'll have to go look at that, might not be too hard.

I built my own local version a while back to fix this. The code I added is just copying the format of the MH handling, I avoided condensing the code for clarity. I'm pretty sure this code would fail if you are building a bridge and run out of nails without succeeding, but I haven't tested it since it doesn't apply to me. Might be a useful starting point
Diff: https://github.com/andmcadams/external-plugins/compare/plank-sack..plank_sack_sepulchre_patch

I built my own local version a while back to fix this. The code I added is just copying the format of the MH handling, I avoided condensing the code for clarity. I'm pretty sure this code would fail if you are building a bridge and run out of nails without succeeding, but I haven't tested it since it doesn't apply to me. Might be a useful starting point Diff<EMAIL_ADDRESS>(compare)

That does look like it would cover most of it, though the animations being limited looks odd. You're also probably right that it would break if you ran out of nails, but you could probably check if the delta'd item was a plank (probably).

I've noticed the same issue and would love to see this updated. This would be a very nice (and greatly appreciated) QoL! 😄

This will be fixed in v1.3.0, which is awaiting review. I'll close this issue when it's merged and available.

Should now be live (https://github.com/runelite/plugin-hub/commit/89044db72b04e82eae52beb1a522af965be386ef), thank you once again.


Code not compiling due to syntax errors after updating to version v0.970.1

Description:
Updated Ballerina to v0.970.1, one ballerina file is not able to compile due to syntax
Steps to reproduce:
Update Ballerina to v0.970.1
Affected Versions:
v0.970.0
v0.970.1
OS, DB, other environment details and versions:
Windows 10, Java 1.8.0
Related Issues (optional):
Suggested Labels (optional):
Suggested Assignees (optional):

Issue resolved. Using IntelliJ idea over composer


Added parameters signupsAllowed and invitationsAllowed

I'm using Vaultwarden in my private homelab and I don't want new users to register in my instance. All users on my instance are created from the admin page. Vaultwarden supports this setup by setting the environment variables signupsAllowed and invitationsAllowed to false, so I've added them to the Helm chart as well.

hey @luca-heitmann, thanks for the MR!


Minor code cleanup in controllers

Use WaitForNamedCacheSync instead of WaitForCacheSync when possible, as
recommended by the K8s documentation. This leads to code which is
slightly less verbose. When we wrote the first controllers for Antrea,
we used a version of client-go which did not have WaitForNamedCacheSync
yet.

Codecov Report

Merging #1630 (b939169) into master (9d3d10b) will decrease coverage by 22.82%.
The diff coverage is 20.39%.

@@             Coverage Diff             @@
##           master    #1630       +/-   ##
===========================================
- Coverage   63.31%   40.49%   -22.83%
===========================================
  Files         170      106       -64
  Lines       14250    12885     -1365
===========================================
- Hits         9023     5218     -3805
- Misses       4292     7200     +2908
+ Partials      935      467      -468

Flag
Coverage Δ

kind-e2e-tests
?

unit-tests
40.49% <20.39%> (-0.79%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.


Document rasa data validate in CLI docs

Proposed changes:

Add content for the rasa data validate command by adapting existing content from docs/rasa/setting-up-ci-cd#validating-data-and-stories

Status (please check what you already did):

[ ] added some tests for the functionality
[x] updated the documentation
[ ] updated the changelog (please check changelog for instructions)
[x] reformat files using black (please check Readme for instructions)

I still need to link from the CI/CD page to the CLI one but I'm unsure how to best go about this because on the CI/CD page there's a lot of places where CLI commands are used -- @erohmensing should I link each time to the relevant part of the CLI page?


(557) Admin users can add new user

We need an interface that allows them to add new report-mi users
Form fields has been created and styled to add new report-mi user in the user details page
Styling the actions to add a new user.
This will also create the user on Auth0

@isratc looks loads better, thank you! @leeky should look over the Rails bits still.


updated sitl_gazebo to latest

Codecov Report

Merging #5 into master will increase coverage by 0.03%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master       #5      +/-   ##
==========================================
+ Coverage   33.29%   33.32%   +0.03%
==========================================
  Files         600      600
  Lines       50342    50342
==========================================
+ Hits        16759    16776      +17
+ Misses      33583    33566      -17

Flag
Coverage Δ

#mavsdk
33.32% <ø> (+0.03%)
:arrow_up:

Impacted Files
Coverage Δ

...er/include/lockstep_scheduler/lockstep_scheduler.h
66.66% <0.00%> (-22.23%)
:arrow_down:

...der/Arming/PreFlightCheck/checks/airspeedCheck.cpp
59.25% <0.00%> (-14.82%)
:arrow_down:

src/modules/mavlink/mavlink_parameters.cpp
31.57% <0.00%> (-0.41%)
:arrow_down:

src/modules/ekf2/ekf2_main.cpp
58.71% <0.00%> (+0.29%)
:arrow_up:

...mc_pos_control/PositionControl/PositionControl.cpp
98.03% <0.00%> (+0.98%)
:arrow_up:

src/modules/mc_pos_control/mc_pos_control_main.cpp
59.90% <0.00%> (+3.71%)
:arrow_up:

...flight_tasks/tasks/Offboard/FlightTaskOffboard.cpp
61.00% <0.00%> (+5.00%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0a8949b...e4103f7. Read the comment docs.


Fix link to dcfurs micropython

The URL was a placeholder until we got around to uploading the micropython firmware for this year's badge. This should now be resolved.


`require': cannot load such file -- expo-server-sdk (LoadError)

Hello,
Thanks for improving on the exponent-server-sdk and creating this package.
I'm new to Ruby and I've been running into an issue when attempting to require the gem.
Environment
macOS Monterey 12.14
$ ruby --version
ruby 2.7.3p183 (2021-04-05 revision 6847ee089d) [x86_64-darwin21]

$ gem --version
3.3.20

$ bundle --version
Bundler version 2.3.20

Setup & Issue
I followed the instructions in the README and created:
Gemfile
source "https://rubygems.org"

gem 'expo-server-sdk'

app.rb
require 'expo-server-sdk'

# Create a new Expo SDK client optionally providing an access token if you
# have enabled push security
client = Expo::Push::Client.new(accessToken: '<access-token>');

# Create the messages that you want to send to clients
messages = [];

# ...

Upon running:
$ ruby app.rb

I receive the following error:
~/.rbenv/versions/2.7.3/lib/ruby/site_ruby/2.7.0/rubygems/core_ext/kernel_require.rb:85
:in `require': cannot load such file -- expo-server-sdk (LoadError)

I noticed that, compared to other gems (exponent-server-sdk, for example) this gem doesn't have a file matching the gem name at lib/.
Instead it opts to construct it via a path: lib/expo/server/sdk.
I found that if I just modify the gem locally and create:
lib/expo-server-sdk.rb
# frozen_string_literal: true

require_relative 'expo/server/sdk/version'
require_relative 'push/client'

module Expo
  module Server
    module SDK # rubocop:disable Style/Documentation
      def self.push
        Expo::Push::Client
      end
    end
  end
end

Requiring the gem works without issue.
Question
As I said, I'm new to Ruby, so I'm not sure if there's a different way to require this gem so that it will load as-is?

Hi there! I understand your question. You're absolutely right that the instructions are currently incorrect. The reason I didn't notice before is that I am relying on zeitwerk to do the requiring for me, which is by default used in frameworks such as Rails.
However, the require path was meant to be
require 'expo/server/sdk'

Which can be seen in the following example. I will update the README right away.
# [start bundler]
require 'bundler/inline'

gemfile(true) do
  source 'https://rubygems.org'
  gem 'expo-server-sdk'
end
# [end bundler]

# Everything above is similar to creating a Gemfile and then running bundle
# install, but this lets you do it inline!

require 'expo/server/sdk'

# Create a new Expo SDK client optionally providing an access token if you
# have enabled push security
client = Expo::Push::Client.new(access_token: '<access-token>');

puts client

Great, I had a feeling I was missing something! Thanks for being attentive to this repo, it's very appreciated!


Add Support for Azure Cosmos DB DataStream

The objective of this improvement is to add Azure Cosmos DB [2] as an unbounded source and sink for the DataStream connectors [1]
[1] https://beam.apache.org/documentation/io/built-in/
[2] https://docs.microsoft.com/en-us/azure/cosmos-db/change-feed
Imported from Jira BEAM-10440. Original Jira may contain additional context.
Reported by: iekpo.

But with what api? Mongo? Cassandra?


adding testing features

Adding to the mock_client to support testability of Moov backend's ability to retry SFTP operations after certain failure scenarios. Now the mock_client tracks the number of calls, and how many errors it should return on a series of calls

@adamdecaf what do you think about creating a retryablegosftp - wrapper for client that will check if it's a retryable error aka isNetworkError, etc. and will just retry the call? If it sounds good, I'll create an issue and maybe we will find time to implement it as well.
Something like https://github.com/hashicorp/go-retryablehttp

it can retry, but I thought creating a wrapper (not a separate package) would simplify change. But maybe I'm mistaken.

@adamdecaf one more thing, what do you think about adding type ErrorFunc func() error that can be used instead of fixed Err error. With ErrorFunc we can create function that returns errors randomly, N errors, etc. Here is the working example (POC) https://go.dev/play/p/OhjJFbY0RsL:
package main

import (
	"errors"
	"fmt"
	"math/rand"
	"time"
)

type ErrorFunc func() error

func (f ErrorFunc) Error() error {
	// if the function is not set, we don't panic, just return nil
	if f == nil {
		return nil
	}

	return f()
}

func RandomErrorFunc() error {
	rand.Seed(time.Now().UnixNano())
	if rand.Intn(2) == 0 {
		return errors.New("Random error occurred")
	}
	return nil
}

func LimitedErrorFunc(N int, err error) ErrorFunc {
	counter := 0
	return func() error {
		if counter < N {
			counter++
			return fmt.Errorf("Error %d: %w", counter, err)
		}
		return nil
	}
}

type mock struct {
	ErrFn    ErrorFunc
	Response string
}

func (m *mock) Do() (string, error) {
	if err := m.ErrFn.Error(); err != nil {
		return "", err
	}

	return m.Response, nil
}

func main() {
	m := &mock{
		Response: "Hello World",
		ErrFn:    LimitedErrorFunc(3, errors.New("permission error")),
	}

	for i := 0; i < 5; i++ {
		str, err := m.Do()
		if err != nil {
			fmt.Println("error:", err)
			continue
		}

		fmt.Println(str)
	}
}

Having a function makes sense to me. It lets the caller specify exactly what they want.

Closing PR, as its not needed anymore


Backport "Refactor some tuple methods" to LTS

Backports #19032 to the LTS branch.
PR submitted by the release tooling.
[skip ci]

No regressions detected in the community build up to lts-19356.
Reference


Add changelog when publishing

As a user I want to see, what has changed in the current release of a Sketch plugin before installing it. For that I can refer to the "embedded changelog" feature of the appcast.xml, to a CHANGELOG file inside the plugin repository or to the page of each release on GitHub.
As a developer I'd like skpm to automatically generate changelog entries based on the commits created between the new release and the prior release upon publishing the new release. Commits should only be enclosed in the changelog if the commit message sticks to the [conventional commits specification].
The changelog should be added to a repository-local CHANGELOG file, to the release comment on GitHub and to the Appcast.xml file.

Sketch doesn't handle changelog yet so it wouldn't useful for skpm to generate it

But still it would be usable for users. 😉 And perhaps some day Sketch (or something like Runner) might use it.

possibly yes, but for now there wouldn't be much value and there are already tons of tools to generate a changelog. You could totally use one of them at the same time as skpm

Okay. Should we still keep this issue open for future?

yes, it's something I'll think about


[Steam Version] Aura slot from dragon freezes game.

Hi, As soon you unlock the aura slot from the dragon, the game freezes.

Here's a dev console screen
Dragon.js

This is a duplicate of #960


export type ButtonsArray for external use

Enable the use the ButtonsArray by flowtype in projects that make use of react-native

By analyzing the blame information on this pull request, we identified @caabernathy and @corbt to be potential reviewers.

Thank you for your pull request and welcome to our community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. In order for us to review and merge your code, please sign up at https://code.facebook.com/cla - and if you have received this in error or have any questions, please drop us a line at<EMAIL_ADDRESS>Thanks!

@lprhodes updated the pull request - view changes

Thanks for submitting a pull request! Please provide enough information so that others can review your pull request:

Can you please explain why you'd use them and how? A good way is a good sample.

Sure, we have a convenience method for showing alerts in our iOS RN app where we can optionally provide buttons (of type ButtonsArray)
type ShowAlertProps = {
  title?: string,
  message: string,
  buttons?: ButtonsArray
}

export const showAlert = function (props: ShowAlertProps) {
  let { title, message, buttons } = props

  if (!title) title = 'Some Default Title'

  if (!buttons) buttons = [ { text: 'OK' } ]

  AlertIOS.alert(
    title,
    message,
    buttons
  )
}

This change looks good to me, can you resolve the merge conflict though?

Ping @lprhodes, we can ship once the conflict is resolved.

@facebook-github-bot shipit

I will be able to merge this once the conflicts are resolved. I am not sure why this can't be done automatically.

Okay... I will merge it manually.

Was fixed in 4e437c1232771f1bce90340cc2ecd1deb0c90278.


Update ruby gem and python pip packages to reflect release change

Subj.
And I'd like internal note on procedure how to update releases there. We have a very good one for iOS (hats off to ms. @vixentael), but none for ruby gem and for pip. Can I have one in my e-mail?

It was done.


Support for .NET6

Opening an issue to track supporting .NET 6.
Their milestone is listed for Nov 12: https://github.com/dotnet/runtime/milestone/69

We need to club this (https://github.com/microsoft/ApplicationInsights-dotnet/issues/2273) as well for the .NET 6 support, as .NET6  removes support for net452,net46.


Many will support chain writing

I don't think it supports chain writing. It's very inconvenient. I hope the boss can support it

under consideration, maybe increase in the next iteration


Update docs for BlazeClientBuilder

Make it explicit that ExecutionContext.global should be used
Based on the discussion in https://github.com/http4s/http4s/pull/3330, it sounds to me that http4s requires this parameter because of a leaky implementation detail in Blaze, and that the right answer always is ExecutionContext.global. It doesn't hurt to point this out in the scaladoc.
A side note here: I see that the execution context is used to submit tasks to an ExecutorService. If ExecutionContext.global only has one thread, is it still safe to use it without risking deadlocks?  I assume this is one of the reasons cats-effect/IOApp defaults to minimum two threads backing the ContextShift.

At this point BlazeClientBuilder could just take Blocker as a parameter instead of ExecutionContext though. As long as we're not fixing the underlying problem with Blaze requiring an ExecutionContext. It's safe to assume that most clients will have a ContextShift and a Blocker. It would be less ergonomic to advice them to construct a (most likely) blaze-specific lower-bounded-2 thread pool just to cater to this implementation detail. Clients would most likely pass Blocker down to the call site anyway and pass the underlying thread pool to BlazeClientBuilder.
Also, if we advice clients not to use global, we should update the http4s docs to not use it also.
What do you think?

Blocker[F] gives a cached (unbounded) thread pool, which is not intended for the CPU-intensive work that happens here.  I think a great deal of apps don't have a blocker at all.  I wish we could just use the ContextShift, but there is no way to turn that back into an ExecutionContext.
So the two options:

global

ergonomic
plays nicely with other Future libraries
dangerous on a single-core machine
could generate warning on those, but it still doesn't prevent runtime calamity

fixed thread pool with lower bound

not ergonomic, though typelevel/cats-effect#755 would help
maybe better: typelevel/cats-effect#509
would be an easier sale if IOApp exposed its default.  Maybe we should float that idea?

In practice, I've always used global and never had a problem, but I think it's good that we're thinking about this more critically.

I think recommending ExecutionContext.global is fine, it will work in most cases. We've had some deadlocks using global in high scale execution environments, like Spark or Beam jobs, where the number of VMs is large, but the size of each VM is on the cheaper end of the cloud provider's machine type spectrum. I've also encountered it when testing various cloud services, then also on cheap machine types.
It sounds to me like an upstream change in cats-effect is the only way to make this ergonomic and safe.


Comment metacode in index2.html

I commented the following metacode:

""

Hello,
Why did you choose to add the comment only in those 3 files?
Your contribution is greatly appreciated.

If you need them in some more files i'll do it for them too, no problem!
I think those three files are the startpoints for every developer who downloads your template. So i guess this line should be commented at least there. Should i do it for the other ones as well?

Thank you for that. But you have a couple grammatical errors. The comment should be similar to:
<!-- Tell the browser to be responsive to screen width -->

It will also be more appropriate if the comment was placed in all HTML pages except the documentation. If you find that a hassle, I can add the line at a later time.
Thanks!


docs site down?

https://triton-lang.org seems down

Yes! I'm upgrading the docs to support multiple versions :) ALmost done

closing this as the website is back up -- and supports multiple versions!


GHC 9.2.1 support

I am using HMock and explainable-predicates with GHC 9.2.1 without issue, using allow-newer configuration to ignore the upper bound constraints on the base and template-haskell dependencies.  I investigated bumping these constraints so that the next releases will work without the allow-newer configuration.
The explainable-predicates tests all pass with GHC 9.2.1 with the following changes:
diff --git a/explainable-predicates.cabal b/explainable-predicates.cabal
index 1861e7a..9adc77b 100644
--- a/explainable-predicates.cabal
+++ b/explainable-predicates.cabal
@@ -56,9 +56,9 @@ library
                          Test.Predicates.Internal.FlowMatcher
     other-modules:       Test.Predicates.Internal.Util
     build-depends:       array >= 0.5.2 && < 0.6,
-                         base >=4.12.0 && < 4.16,
+                         base >=4.12.0 && < 4.17,
                          syb >= 0.7.2 && < 0.8,
-                         template-haskell >= 2.13.0 && < 2.18,
+                         template-haskell >= 2.13.0 && < 2.19,
     hs-source-dirs:      src
     default-language:    Haskell2010
     ghc-options:         -Wall -Wcompat -Wincomplete-uni-patterns

The following changes also need to be made:

[ ] .travis.yml - Update ghc
[ ] explainable-predicates.cabal - Update tested-with
[ ] README.md - Update "Which GHC versions are supported?"
[ ] CHANGELOG.md - Add entry?

I've released a new version that fixes this.


Incorrect version release

We incorrectly released 3.0.1 instead of 3.1.0, because new release contains API changes. Please see https://semver.org/
It is extremely important to follow conventions precisely, because package management tools rely on it to decide what version to use and when.
We cannot completely fix it now, since cargo does not allow to yank versions. However, we need to publish 3.1.0.

Hey Max, thanks for pointing this out. Version 3.1.0 has been published now.
https://crates.io/crates/near-sdk/3.1.0


⚠ Bofrost.fr has degraded performance

In 803761c, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 899 ms

Resolved: Bofrost.fr performance has improved in f0b1036.


spinup-destroy.yml file and azure-configuration branch missing

Describe the bug
Step 3, Activity 1, subheading "Configuring your Azure environment" instructs to review the new workflow file spinup-destroy.yml in azure-configuration branch.  However, I cannot see neither the file nor the branch being mentioned.
To Reproduce
Follow the lab manual to the section indicated at Describe the bug section of this issue.
Expected behavior
I am expeting to see both the file and the branch being mentioned at Describe the bug section of this issue.
Screenshots
(no relevant screenshot; left empty intentionally)
Device information
The issue isn't related to the device I am using.
Additional context

Nothing I can think of that I can make it more clear. There seem to be some discussion that this file existed before, and some describing the reason for the absence of the file being contributed from not committing before or something.  I couldn't quite understand it. If it can be explained in simpler terms, that'd be much appreciated.
I tried following the lab twice from the top with fresh new sessions but I've failed on both occasions.

+1

+1

I have the same issue. Going into the logs for the GitHub Action that (I believe) is supposed to create the azure-configuration I can see the following:
Create pull request for azure-configuration into main
pull request create failed: GraphQL: Head sha can't be blank, Base sha can't be blank, No commits between main and azure-configuration, Head ref must be a branch (createPullRequest)
Error: Process completed with exit code 1.

Thank you for opening this issue. I'm closing this issue out per https://github.com/skills/continuous-delivery-azure/pull/20#issuecomment-1445303419


Heroku Deployment Broken for heroku-18 Stack

Heroku Deployment Broken for heroku-18 Stack
Issue
https://devcenter.heroku.com/changelog-items/1414
All staging builds are failing due to upgrade of Heroku Stack to "heroku-18"
Expected Behavior:
Expect successful demployment
Actual Behavior:

-----> Swift app detected
Submodule 'swiftenv' (http://github.com/kylef/swiftenv) registered for path 'swiftenv'
Cloning into '/app/tmp/buildpacks/e15e25a82e1ea1eeac34ea89cfe34fce9324ea31df181d9607e3a071884cea49e35492ce81bb256f7550e3100f81b9cdd156c4f7f5970137a0d66dc5bb1077fd/swiftenv'...
warning: redirecting to https://github.com/kylef/swiftenv/
-----> Building Package
/app/tmp/cache/swiftenv/versions/3.1.1/usr/bin/swift-build: error while loading shared libraries: libicuuc.so.55: cannot open shared object file: No such file or directory
 !     Push rejected, failed to compile Swift app.
 !     Push failed

Reproduction Steps:

Commit changes to dvcs/gitignore or joeblau/gitignore io.
Wait for CI attempt to deploy to Heroku
System fails deploy

This was resolved by using a new dyno with the vapor community build pack.
https://github.com/vapor-community/heroku-buildpack


2.0.4300 introduces error: "disconnected: invalid packet: user information"

uMod 2.0.4300 introduces connection error "disconnected: invalid packet: user information" immediately upon clicking the 'connect' button. Rolled back uMod to 2.0.4297 and issue goes away.

Hello, this repository is not used, but our GitHub is for development only. If you are having a general issue with a build, please use our forums at umod.org. There were no changes in Oxide though, so would be unlikely from our side. The difference between the versions you are using is the patched Rust files from the Rust update.

Ok, sorry about that. Just so you're aware, the uMod git page links to this specific "Issues tracker" section for support at the bottom of the page.

Sorry, that readme is outdated; I'll remove it for now.


Massiv Lag in editor when working with tile maps / tile map layers (Godot 4.3 stable release, Windows 11)

Tested versions

reproducable in godot 4.3 stable (the version i used, did not test in beta versions of 4.3)

System information
Windows 11, Godot 4.3 (stable release), Components: intel i5 6600K, NVIDEA GEFORCE GTX 1060 6GB, Vulcan supported
Issue description
I turned my Godot 4.2.2 stable project into a Godot 4.3 stable project following the recommended steps. This also included converting the old TileMap instances into TileMap layer instances using the extractor tool. When I was done extracting, I wanted to experiment a bit with these new TileMap layers.
However, when I try to interact with the TileMap layers (move them in the explorer, place or remove tiles, zoom in or out), the game engine freezes, crashes, or lags massively.
One thing I might want to add is that my game currently consists of multiple TileMaps with several layers (background, foreground, and so on). Before Godot 4.3, everything related to tiles worked perfectly fine.
Another thing I noticed is that even without converting the TileMaps to the new TileMap layer instances, the old TileMaps also lag massively when interacting with them. I had no lag at all in Godot 4.2.2 (the version I converted to Godot 4.3 stable) when working with TileMaps.

Steps to reproduce
I dont know if this realy is a problem of my machine only but here are my steps which produced it:

first converting a larger 2d game to godot 4.3 (must have a lot of tilemaps)
extract the tile map layers from the tilemaps
interacting with the tilemap instances causes massiv lag, freezes or crashses

Minimal reproduction project (MRP)
At this state i dont know if the problem is related to my specific engine or has something to do with the game engine itself

Does it freeze only when the bottom TileSet/TileMap panel is shown? If yes, then it might be a duplicate of #72405.

the visibility of the panels isnt necesary for the lag, i just need to select the tilemap / tilemap layer and it lags
i had this bug/problem in no other version

when it is related to the TileSets, why did everything work in Godot 4.2 smoothly

There were some changes to TileMap internals. TileSet was just a guess, the issue might be caused by scene layout or some other factors. It would be helpful if you could make a minimal project.

alright i will post a minimal 4.3 version with only the tilemaps

Another info: moving something in a scene in the editor while the scene has some tilemap/tilemap layer isntances creates lag (even if the scene is small)

As mentioned:

It would be helpful if you could make a minimal project.

Otherwise we can be pretty much only guessing.

i tryed to solve it myself... anyways because i have rly no clue what could cause it i basicly attached the whole project (excluding android build)
the file is toom big so here is the link to the download: https://github.com/Brakatuta/Terra-Tales/releases/tag/tets

the rellevant trouble makers are the scenes called test_level and prolog_level, both have a diffrent scene structure

I found the problem: some files inside of  res.godot\editor where broken. I deleted the folder and the project now runs smooth again


Support for pandas NAType

Copied from @xinyuejohn's issue on scikit-hep/awkward#2931:
Description of new feature
Hi, I was creating an awkward array using pandas dataframe and I found awkward doesn't support pandas._libs.missing.NAType()
It would be great if this NAType could be supported.
To replicate:
import awkward as ak
import pandas

a = ["a", "b", pandas._libs.missing.NAType()]
ak.Array(a)

Traceback:
ValueError: cannot convert <NA> (type NAType) to an array element

(https://github.com/scikit-hep/awkward/blob/awkward-cpp-26/awkward-cpp/src/python/content.cpp#L191)

This error occurred while calling

    ak.to_layout(
        ['a', 'b', <NA>]
        allow_record = False
        regulararray = False
        primitive_policy = 'error'
    )

See scikit-hep/awkward#2931 for more information, in particular

https://github.com/scikit-hep/awkward/issues/2931#issuecomment-1885589171
https://github.com/scikit-hep/awkward/issues/2931#issuecomment-1887634255

I was creating an awkward array using pandas dataframe

So we should intercept the data before conversion to ak.
Question: does arrow support this NA type? I suspect no, they alway use masks, and so we're only really concerned with 1-D regular series.


Automated Package Upgrade

:tada: This PR is included in version 6.0.17 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Notebook editors have an undefined viewColumn

VSCode Version:  1.53.0-insider
OS Version: Windows 10

The editors in the list of vscode.window.visibleNotebookEditors do not have a defined viewColumn. The cells included in the list of vscode.window.visibleTextEditors also have undefined view columns. Therefore, there is no way to figure out where the notebook is open for the user. This value should be defined.

cc @daytonellwanger @rebornix

YEs - this isn't implemented. Only the API has been spec'd for some reason

This will be working in next insiders but we don't have the equivalent of onDidChangeTextEditorViewColumn and I am not yet planning on adding that


Notifications bell highlight is missed after full page load

STR:

Create a Poll proposal
Allow transaction in a Near Wallet

ER:

Notification bell highlight after Near Wallet page is closed
Notification bell is not missing after full page load
User doesn't need to reload the page to see notifications bell highlight

AR:

Notification bell highlighted after Near Wallet page is closed and right after that is disappeared after full page load
User need to reload the page to see notifications bell highlight

Verified on dev. Fixed