[BUG] Does not work with pnpm

Describe the bug
When using pnpm as a package manager reassure binary cannot be found.
After running command pnpm reassure i get:
 ERR_PNPM_RECURSIVE_EXEC_FIRST_FAIL  not found: reassure
I noticed that reassure binary is missing in the node_modules/.bin folder.
To Reproduce
Steps to reproduce the behavior:

Create react project with create-react-app
Add reassure to the project using pnpm add reassure -D
run pnpm reassure

@mczapkowicz you are right, we did not test pnmp compatibility. That the issue you are facing should be relatively easy to work around: you can set TEST_RUNNER_PATH env variable to proper reassure CLI path.

Yes, the error is exactly the same:
 ERR_PNPM_RECURSIVE_EXEC_FIRST_FAIL  not found: reassure

I think we've confusing two things here. One is TEST_RUNNER_PATH which should have path to test runner, e.g. Jest
While you issue seems to be about executing Reassure CLI itself. Since this is a simple node executable you should be able to run it using:

node node_modules/reassure/node_modules/.bin/reassure
or: node node_modules/.bin/reassure
or  ./node_modules/reassure/node_modules/.bin/reassure

TEST_RUNNER_PATH=node_modules/.bin/jest node node_modules/reassure/node_modules/.bin/reassure

gives me:
 /Users/user/Desktop/test-project/node_modules/.pnpm/reassure@0.6.0_react@18.2.0/node_modules/reassure/node_modules/.bin/reassure:2
basedir=$(dirname "$(echo "$0" | sed -e 's,\\,/,g')")
          ^^^^^^^

SyntaxError: missing ) after argument list
    at Object.compileFunction (node:vm:352:18)
    at wrapSafe (node:internal/modules/cjs/loader:1033:15)
    at Module._compile (node:internal/modules/cjs/loader:1069:27)
    at Object.Module._extensions..js (node:internal/modules/cjs/loader:1159:10)
    at Module.load (node:internal/modules/cjs/loader:981:32)
    at Function.Module._load (node:internal/modules/cjs/loader:822:12)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12)
    at node:internal/main/run_main_module:17:47

node node_modules/.bin/reassure, gives:
Cannot find module '/Users/user/Desktop/test-project/node_modules/.bin/reassure
which makes sense because, like I said there is no reassure in node_modules/.bin folder
./node_modules/reassure/node_modules/.bin/reassure gives

node:internal/modules/cjs/loader:936
  throw err;
  ^

Error: Cannot find module '/Users/user/Desktop/test-project/@callstack+reassure-cli<EMAIL_ADDRESS>    at Function.Module._resolveFilename (node:internal/modules/cjs/loader:933:15)
    at Function.Module._load (node:internal/modules/cjs/loader:778:27)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12)
    at node:internal/main/run_main_module:17:47 {
  code: 'MODULE_NOT_FOUND',
  requireStack: []
}

@mczapkowicz:

what OS are you using? Another used reported the first error (=$(dirname "$(echo "$0" | sed -e 's,\\,/,g')")) for Windows env.
could you try to use it with yarn or npm? I wonder if this is more OS-specific of package manager specific?

I'm using macOS. Everything works fine with yarn and npm so I belive this is package manager specific.

@mczapkowicz do you have some available time and would like to bring PNMP support to Reassure? 😀
The issue here seems to be specific to  how PNPM works then the actual Reassure code.

I will take a look at this.

Same problem here using on macOS, seems related to pnpm indeed.

For anyone that may benefit, i was able to make this work with pnpm in a slightly ugly but temporarily acceptable way like this:
TEST_RUNNER_PATH=node_modules/jest/bin/jest ../../node_modules/.pnpm/reassure<EMAIL_ADDRESS>Will try to submit a PR so that hacking like this is not required for pnpm

To properly fix this problem it is better to use .pnpmfile.cjs. Create that file with the following contents (or modify your existing file accordingly):
module.exports = {
  hooks: {
    readPackage: (pkg) => {
      if (pkg.name === "reassure") {
        pkg.bin = {
          reassure: "./node_modules/.bin/reassure",
        }
      }
      if (pkg.name === "@callstack/reassure-measure") {
        pkg.peerDependencies["@testing-library/react"] = "*"; // change to /react-native if you are using it instead
      }
    }
  }
}

This hook modifies package.json of the packages on-the-fly when pnpm resolves dependencies. It adds missing dependencies and .bin field, because currently they are not correctly set (as they always should be, because packages shouldn't rely on fantom dependecies!).
The PR therefore should be straightforward: just add missing dependencies and .bin field to the actual package.json files...

It seems the issue has been resolved. I successfully installed and ran Reassure in a pnpm + Vite + ts-jest environment, and it worked perfectly 👌
Can someone involved confirm this?


⚠ Bofrost.be has degraded performance

In bdec0cf, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 852 ms

Resolved: Bofrost.be performance has improved in d6e24ff after 26 minutes.


Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
ds_report output
Please run ds_report to give us details about your setup.
`[WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
[WARNING]  async_io: please install the libaio-dev package with apt
[WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.2
[WARNING]  using untested triton version (2.2.0), only 1.0.0 is known to be compatible
DeepSpeed C++/CUDA extension op report
NOTE: Ops not installed will be just-in-time (JIT) compiled at
runtime if needed. Op compatibility means that your system
meet the required dependencies to JIT install the op.
JIT compiled ops requires ninja
ninja .................. [OKAY]
op name ................ installed .. compatible
[WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
[WARNING]  async_io: please install the libaio-dev package with apt
[WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
async_io ............... [NO] ....... [NO]
fused_adam ............. [NO] ....... [OKAY]
cpu_adam ............... [NO] ....... [OKAY]
cpu_adagrad ............ [NO] ....... [OKAY]
cpu_lion ............... [NO] ....... [OKAY]
[WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
evoformer_attn ......... [NO] ....... [NO]
fp_quantizer ........... [NO] ....... [OKAY]
fused_lamb ............. [NO] ....... [OKAY]
fused_lion ............. [NO] ....... [OKAY]
inference_core_ops ..... [NO] ....... [OKAY]
cutlass_ops ............ [NO] ....... [OKAY]
transformer_inference .. [NO] ....... [OKAY]
quantizer .............. [NO] ....... [OKAY]
ragged_device_ops ...... [NO] ....... [OKAY]
ragged_ops ............. [NO] ....... [OKAY]
random_ltd ............. [NO] ....... [OKAY]
[WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.2
[WARNING]  using untested triton version (2.2.0), only 1.0.0 is known to be compatible
sparse_attn ............ [NO] ....... [NO]
spatial_inference ...... [NO] ....... [OKAY]
transformer ............ [NO] ....... [OKAY]
stochastic_transformer . [NO] ....... [OKAY]
DeepSpeed general environment info:
torch install path ............... ['/opt/conda/lib/python3.10/site-packages/torch']
torch version .................... 2.2.1
deepspeed install path ........... ['/home/jovyan/.local/lib/python3.10/site-packages/deepspeed']
deepspeed info ................... 0.14.4, unknown, unknown
torch cuda version ............... 12.1
torch hip version ................ None
nvcc version ..................... 12.1
deepspeed wheel compiled w. ...... torch 2.2, cuda 12.1
shared memory (/dev/shm) size .... 600.00 GB
`
Screenshots
If applicable, add screenshots to help explain your problem.
System info (please complete the following information):

OS: [e.g. Ubuntu 18.04]
GPU count and types [e.g. two machines with x8 A100s each]
Interconnects (if applicable) [e.g., two machines connected with 100 Gbps IB]
Python version
Any other relevant info about your setup
``Traceback (most recent call last):
File "/opt/conda/bin/accelerate", line 8, in
sys.exit(main())
File "/opt/conda/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 48, in main
args.func(args)
File "/opt/conda/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1082, in launch_command
deepspeed_launcher(args)
File "/opt/conda/lib/python3.10/site-packages/accelerate/commands/launch.py", line 786, in deepspeed_launcher
distrib_run.run(args)
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/run.py", line 803, in run
elastic_launch(
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 135, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/opt/conda/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 268, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
Launcher context
Are you launching your experiment with the deepspeed launcher, MPI, or something else?
accelerate launch --config_file  accelerate_ds3_config.yaml
/mft_peft_hf/src/pefts/mft_accelerate.py
--train_config  /mft_peft_hf/src/pefts/configs/llama_train_config.json
Docker context
Are you using a specific docker image that you can share?
absl-py                       2.1.0 accelerate                    0.32.1 aiohttp                       3.8.6 aiosignal                     1.3.1 annotated-types               0.7.0 anyio                         3.7.1 APScheduler                   3.10.4 archspec                      0.2.1 argon2-cffi                   23.1.0 argon2-cffi-bindings          21.2.0 asttokens                     2.0.5 astunparse                    1.6.3 async-timeout                 4.0.3 attrs                         23.1.0 autoawq                       0.2.5 autoawq_kernels               0.0.6 Babel                         2.15.0 bce-python-sdk                0.8.99 beautifulsoup4                4.12.2 bigcode-eval                  0.0.0 bitsandbytes                  0.43.1 bleach                        6.1.0 boltons                       23.0.0 boto3                         1.33.13 botocore                      1.33.13 Brotli                        1.0.9 certifi                       2024.2.2 cffi                          1.16.0 chardet                       4.0.0 charset-normalizer            2.0.4 click                         8.1.7 cloudpickle                   3.0.0 cmake                         3.30.0 cn2an                         0.5.22 colorama                      0.4.6 comm                          0.2.2 conda                         23.9.0 conda-build                   24.1.2 conda-content-trust           0.2.0 conda_index                   0.4.0 conda-libmamba-solver         23.7.0 conda-package-handling        2.2.0 conda_package_streaming       0.9.0 cryptography                  42.0.2 ctranslate2                   3.20.0 datasets                      2.20.0 debugpy                       1.8.2 decorator                     5.1.1 deepspeed                     0.14.4 defusedxml                    0.7.1 Deprecated                    1.2.14 detect-secrets                1.5.0 dill                          0.3.8 diskcache                     5.6.3 distro                        1.8.0 dnspython                     2.6.1 docker-pycreds                0.4.0 docopt                        0.6.2 docstring_parser              0.16 einops                        0.8.0 email_validator               2.2.0 et-xmlfile                    1.1.0 evaluate                      0.4.2 exceptiongroup                1.2.0 executing                     0.8.3 expecttest                    0.2.1 fastapi                       0.111.0 fastapi-cli                   0.0.4 fastjsonschema                2.20.0 filelock                      3.13.1 flash-attn                    2.6.0.post1 frozenlist                    1.4.1 fsspec                        2023.9.2 ftfy                          6.2.0 future                        1.0.0 fuzzywuzzy                    0.18.0 gibberish-detector            0.1.1 gitdb                         4.0.11 GitPython                     3.1.43 gmpy2                         2.1.2 greenlet                      3.0.3 grpcio                        1.64.1 h11                           0.14.0 hjson                         3.1.0 httpcore                      1.0.5 httptools                     0.6.1 httpx                         0.27.0 huggingface-hub               0.23.4 humanfriendly                 10.0 hypothesis                    6.98.10 idaas-sdk                     0.4.2 idna                          3.4 iniconfig                     2.0.0 interegular                   0.3.3 ipykernel                     6.29.5 ipython                       8.20.0 ipython-genutils              0.2.0 jedi                          0.18.1 Jinja2                        3.1.3 jmespath                      1.0.1 joblib                        1.4.2 json5                         0.9.25 jsonlines                     4.0.0 jsonpatch                     1.32 jsonpointer                   2.1 jsonschema                    4.19.2 jsonschema-specifications     2023.7.1 jupyter_client                8.6.2 jupyter_core                  5.7.2 jupyter-server                1.23.3 jupyterlab                    3.3.2 jupyterlab_pygments           0.3.0 jupyterlab_server             2.27.2 jwcrypto                      1.5.6 lark                          1.1.9 libarchive-c                  2.9 libmambapy                    1.5.3 lit                           18.1.8 llvmlite                      0.43.0 lm-format-enforcer            0.9.8 loguru                        0.7.2 lpai                          0.61.0 lpai-asset                    0.1.33 lxml                          5.2.2 Markdown                      3.6 markdown-it-py                3.0.0 MarkupSafe                    2.1.3 matplotlib-inline             0.1.6 mdurl                         0.1.2 menuinst                      2.0.2 minio                         7.2.7 mistune                       3.0.2 mkl-fft                       1.3.8 mkl-random                    1.2.4 mkl-service                   2.4.0 more-itertools                10.1.0 mosestokenizer                1.0.0 mpmath                        1.3.0 msgpack                       1.0.8 multidict                     6.0.5 multiprocess                  0.70.16 nbclassic                     0.5.6 nbclient                      0.10.0 nbconvert                     7.16.4 nbformat                      5.10.4 nest-asyncio                  1.6.0 networkx                      3.1 nibabel                       5.2.1 ninja                         <IP_ADDRESS> nltk                          3.8.1 notebook_shim                 0.2.4 numba                         0.60.0 numpy                         1.26.3 numpyencoder                  0.3.0 nvidia-ml-py                  12.555.43 openai                        1.35.13 openfile                      0.0.7 openpyxl                      3.1.5 optree                        0.10.0 orjson                        3.10.6 outlines                      0.0.34 packaging                     23.1 pandas                        2.2.2 pandocfilters                 1.5.1 parso                         0.8.3 peft                          0.11.1 pexpect                       4.8.0 pillow                        10.2.0 pip                           23.3.1 pkginfo                       1.9.6 platformdirs                  3.10.0 pluggy                        1.5.0 portalocker                   2.10.0 proces                        0.1.7 progress                      1.6 prometheus_client             0.20.0 prompt-toolkit                3.0.43 protobuf                      4.25.3 protocol                      0.37 psutil                        5.9.0 ptyprocess                    0.7.0 pure-eval                     0.2.2 py-cpuinfo                    9.0.0 pyarrow                       16.1.0 pyarrow-hotfix                0.6 pybind11                      2.13.1 pycosat                       0.6.6 pycparser                     2.21 pycryptodome                  3.20.0 pydantic                      2.8.2 pydantic_core                 2.20.1 pydicom                       2.4.4 pyext                         0.7 Pygments                      2.15.1 pynvml                        11.5.0 pyOpenSSL                     24.0.0 pypng                         0.20220715.0 PySocks                       1.7.1 pytest                        8.2.2 python-box                    7.2.0 python-dateutil               2.8.2 python-dotenv                 1.0.1 python-etcd                   0.4.5 python-multipart              0.0.9 pytz                          2023.3.post1 PyYAML                        6.0.1 pyzmq                         26.0.3 qrcode                        7.4.2 rank-bm25                     0.2.2 ray                           2.32.0 rclone-python-lp-asset        0.1.13 referencing                   0.30.2 regex                         2024.5.15 requests                      2.31.0 rich                          13.7.1 rpds-py                       0.10.6 ruamel.yaml                   0.17.21 ruamel.yaml.clib              0.2.6 s3transfer                    0.8.2 sacrebleu                     2.4.2 safetensors                   0.4.3 scikit-learn                  1.5.1 scipy                         1.14.0 Send2Trash                    1.8.3 sentence-transformers         3.0.1 sentencepiece                 0.2.0 sentry-sdk                    2.9.0 setproctitle                  1.3.3 setuptools                    67.7.2 shellingham                   1.5.4 shtab                         1.7.1 six                           1.16.0 smmap                         5.0.1 sniffio                       1.3.1 sortedcontainers              2.4.0 soupsieve                     2.5 SQLAlchemy                    2.0.31 stack-data                    0.2.0 starlette                     0.37.2 sympy                         1.12 tabulate                      0.9.0 tblib                         3.0.0 tensorboard                   2.17.0 tensorboard-data-server       0.7.2 terminado                     0.18.1 threadpoolctl                 3.5.0 tiktoken                      0.6.0 timeout-decorator             0.5.0 tinycss2                      1.3.0 tokenizers                    0.19.1 tomli                         2.0.1 toolwrapper                   2.1.0 toolz                         0.12.0 torch                         2.2.1 torchaudio                    2.2.1 torchelastic                  0.2.2 torchvision                   0.17.1 tornado                       6.4.1 tqdm                          4.66.4 traitlets                     5.7.1 transformers                  4.43.1 transformers-stream-generator 0.0.5 tree-sitter                   0.21.3 triton                        2.2.0 trl                           0.9.6 truststore                    0.8.0 typer                         0.12.3 types-dataclasses             0.6.6 typing_extensions             4.12.2 tyro                          0.8.5 tzdata                        2024.1 tzlocal                       5.2 ujson                         5.10.0 urllib3                       2.0.7 utils                         1.0.2 uvicorn                       0.30.1 uvloop                        0.19.0 vllm                          0.4.1 vllm-nccl-cu12                <IP_ADDRESS>.4.0 wandb                         0.17.4 watchfiles                    0.22.0 wcwidth                       0.2.13 webencodings                  0.5.1 websocket-client              1.8.0 websockets                    12.0 Werkzeug                      3.0.3 wheel                         0.41.2 wrapt                         1.16.0 xformers                      0.0.25 xorbits                       0.7.2 xoscar                        0.3.2 xxhash                        3.4.1 yarl                          1.9.4 zstandard                     0.19.0
Additional context
Add any other context about the problem here.
`compute_environment: LOCAL_MACHINE
deepspeed_config:
gradient_accumulation_steps: 1
gradient_clipping: 1.0
offload_optimizer_device: cpu
offload_param_device: cpu
zero3_init_flag: true
zero3_save_16bit_model: true
zero_stage: 3
distributed_type: DEEPSPEED
downcast_bf16: 'no'
dynamo_backend: 'NO'
fsdp_config: {}
machine_rank: 0
main_training_function: main
megatron_lm_config: {}

mixed_precision: 'bf16'
num_machines: 1
num_processes: 8
rdzv_backend: static
same_network: true
use_cpu: true
mixed_precision: bf16`

Error Description:
The error occurs during the evaluation and saving of the model, specifically in the reset_step method of the PartitionedParameterCoordinator class in DeepSpeed. There's a disagreement in the submodule order between rank 0 and rank 1.
Possible Causes:
a. Inconsistent model initialization across processes
b. Data loading discrepancies
c. Non-deterministic operations in the model or data pipeline
d. Issues with DeepSpeed's ZeRO Stage 3 optimization
Suggestions to resolve the issue:
a. Ensure Deterministic Behavior:
Set a fixed seed for all random number generators (PyTorch, NumPy, Python) at the beginning of your script.
Use torch.use_deterministic_algorithms(True) to enforce deterministic operations.
b. Check Data Loading:
Ensure that your data loading process is consistent across all ranks.
If using a custom dataset, make sure it's properly sharded or distributed.
c. Model Initialization:
Verify that the model is initialized identically across all processes.
If using a pretrained model, ensure it's loaded correctly on all ranks.
d. DeepSpeed Configuration:
Review your DeepSpeed configuration, particularly the ZeRO Stage 3 settings.
e. Gradient Accumulation:
If using gradient accumulation, ensure it's properly synchronized across processes.
f. Version Compatibility:
Check if there are any known issues with the specific versions of DeepSpeed, PyTorch, and other libraries you're using.
g. Simplified Test:
Try running a simplified version of your training loop with a smaller model and dataset to isolate the issue.
h. DeepSpeed Debug Options:
Enable DeepSpeed's verbose logging to get more information about the state of each rank.
i. Check for Non-replicated Operations:
Ensure that any custom operations or data preprocessing steps are replicated identically across all ranks.

@eonsparks, thanks for suggesting solutions!

Error Description:
The error occurs during the evaluation and saving of the model, specifically in the reset_step method of the PartitionedParameterCoordinator class in DeepSpeed. There's a disagreement in the submodule order between rank 0 and rank 1. Possible Causes: a. Inconsistent model initialization across processes b. Data loading discrepancies c. Non-deterministic operations in the model or data pipeline d. Issues with DeepSpeed's ZeRO Stage 3 optimization
Suggestions to resolve the issue: a. Ensure Deterministic Behavior: Set a fixed seed for all random number generators (PyTorch, NumPy, Python) at the beginning of your script. Use torch.use_deterministic_algorithms(True) to enforce deterministic operations.
b. Check Data Loading: Ensure that your data loading process is consistent across all ranks. If using a custom dataset, make sure it's properly sharded or distributed.
c. Model Initialization: Verify that the model is initialized identically across all processes. If using a pretrained model, ensure it's loaded correctly on all ranks.
d. DeepSpeed Configuration: Review your DeepSpeed configuration, particularly the ZeRO Stage 3 settings.
e. Gradient Accumulation: If using gradient accumulation, ensure it's properly synchronized across processes.
f. Version Compatibility: Check if there are any known issues with the specific versions of DeepSpeed, PyTorch, and other libraries you're using.
g. Simplified Test: Try running a simplified version of your training loop with a smaller model and dataset to isolate the issue.
h. DeepSpeed Debug Options: Enable DeepSpeed's verbose logging to get more information about the state of each rank.
i. Check for Non-replicated Operations: Ensure that any custom operations or data preprocessing steps are replicated identically across all ranks.

this bug is triggered  when using deepseek-v2-lite (moe) and deepseeed zero3 ,when traing others model(not moe) and depseed zero3,it is ok

Error Description:
The error occurs during the evaluation and saving of the model, specifically in the reset_step method of the PartitionedParameterCoordinator class in DeepSpeed. There's a disagreement in the submodule order between rank 0 and rank 1. Possible Causes: a. Inconsistent model initialization across processes b. Data loading discrepancies c. Non-deterministic operations in the model or data pipeline d. Issues with DeepSpeed's ZeRO Stage 3 optimization
Suggestions to resolve the issue: a. Ensure Deterministic Behavior: Set a fixed seed for all random number generators (PyTorch, NumPy, Python) at the beginning of your script. Use torch.use_deterministic_algorithms(True) to enforce deterministic operations.
b. Check Data Loading: Ensure that your data loading process is consistent across all ranks. If using a custom dataset, make sure it's properly sharded or distributed.
c. Model Initialization: Verify that the model is initialized identically across all processes. If using a pretrained model, ensure it's loaded correctly on all ranks.
d. DeepSpeed Configuration: Review your DeepSpeed configuration, particularly the ZeRO Stage 3 settings.
e. Gradient Accumulation: If using gradient accumulation, ensure it's properly synchronized across processes.
f. Version Compatibility: Check if there are any known issues with the specific versions of DeepSpeed, PyTorch, and other libraries you're using.
g. Simplified Test: Try running a simplified version of your training loop with a smaller model and dataset to isolate the issue.
h. DeepSpeed Debug Options: Enable DeepSpeed's verbose logging to get more information about the state of each rank.
i. Check for Non-replicated Operations: Ensure that any custom operations or data preprocessing steps are replicated identically across all ranks.

after I  add   "torch.use_deterministic_algorithms(True)" in the train file header, and  add "export CUBLAS_WORKSPACE_CONFIG=:4096:8 "  in ENV, it is still failed like before

Error Description:
The error occurs during the evaluation and saving of the model, specifically in the reset_step method of the PartitionedParameterCoordinator class in DeepSpeed. There's a disagreement in the submodule order between rank 0 and rank 1. Possible Causes: a. Inconsistent model initialization across processes b. Data loading discrepancies c. Non-deterministic operations in the model or data pipeline d. Issues with DeepSpeed's ZeRO Stage 3 optimization
Suggestions to resolve the issue: a. Ensure Deterministic Behavior: Set a fixed seed for all random number generators (PyTorch, NumPy, Python) at the beginning of your script. Use torch.use_deterministic_algorithms(True) to enforce deterministic operations.
b. Check Data Loading: Ensure that your data loading process is consistent across all ranks. If using a custom dataset, make sure it's properly sharded or distributed.
c. Model Initialization: Verify that the model is initialized identically across all processes. If using a pretrained model, ensure it's loaded correctly on all ranks.
d. DeepSpeed Configuration: Review your DeepSpeed configuration, particularly the ZeRO Stage 3 settings.
e. Gradient Accumulation: If using gradient accumulation, ensure it's properly synchronized across processes.
f. Version Compatibility: Check if there are any known issues with the specific versions of DeepSpeed, PyTorch, and other libraries you're using.
g. Simplified Test: Try running a simplified version of your training loop with a smaller model and dataset to isolate the issue.
h. DeepSpeed Debug Options: Enable DeepSpeed's verbose logging to get more information about the state of each rank.
i. Check for Non-replicated Operations: Ensure that any custom operations or data preprocessing steps are replicated identically across all ranks.

interesing point:   rank0 has many  large negative int ,while other rank has many normal int number

b. Check Data Loading: Ensure that your data loading process is consistent across all ranks. If using a custom dataset, make sure it's properly sharded or distributed.

Thanks for the tip. But could you elaborate "properly sharded or distributed" a little further? I encountered the same issue. In my case, everything works fine before I decided to assign different GPU different data. I noticed that the sizes of input data are different between different GPUs. Does that mean "properly sharded" data must have identical shapes on all GPUs?

b. Check Data Loading: Ensure that your data loading process is consistent across all ranks. If using a custom dataset, make sure it's properly sharded or distributed.

Thanks for the tip. But could you elaborate "properly sharded or distributed" a little further? I encountered the same issue. In my case, everything works fine before I decided to assign different GPU different data. I noticed that the sizes of input data are different between different GPUs. Does that mean "properly sharded" data must have identical shapes on all GPUs?

have you solved this problem?  can we have a wechat for communication?  my:yiyepiaoling0715

b. Check Data Loading: Ensure that your data loading process is consistent across all ranks. If using a custom dataset, make sure it's properly sharded or distributed.

Thanks for the tip. But could you elaborate "properly sharded or distributed" a little further? I encountered the same issue. In my case, everything works fine before I decided to assign different GPU different data. I noticed that the sizes of input data are different between different GPUs. Does that mean "properly sharded" data must have identical shapes on all GPUs?

have you solved this problem? can we have a wechat for communication? my:yiyepiaoling0715

Yes. My speculation is correct. Making data in all GPUs have identical shape can solve my problem. I guess some integers discribe the shape of input tensors, and that's why the direct error is "data disagreement". To be honest, I don't know how it works internally, deepspeed is a lot more complex than fairscale

Making data in all GPUs have identical shape

how to make data in all GPUs have identical shape ?

I'm having the same problem, how can I fix them，，，

I'm having the same problem, how can I fix them，，，

what is your base model?  deepseek-v2 series?


[DOCFIX] Improve docker doc

alluxio-bot, merge this please

alluxio-bot, cherry-pick this to branch-2.5 please


Upgrade openzeppelin to v5 and chainlink to v8

Hey @niccolopetti Thank you!
Looks like there are conflicts that needs to be resolved before merging.
Can you look into it?


SSL problem?

Hi,
I've got a problem with display unitegallery. When i've got http://domain.com/gallery/ everything its okay, but when i installed SSL certificate for domain (Let's Encrypt Certyficate), and the new adress is with https (https://domain.com/gallery/), the gallery doesn't display. Have you got any ideas what could be wrong?

Solved. I included jQuery libraries from google by http, not by https, and browser locked this. Now its ok.


datastax: add patch for 2.17.0

This change adds a patch based on 2.16.0 for driver 2.17.0. Notable
changes include:

Commented out enablement for options
enable_materialized_views:true and enable_user_defined_functions:true

Fixes #14
To do:

[x] Run a staging job with this version

Job is running now.

Job is running now.

Datastax part of the job is now green, all tests have passed


Notifications while app is suspended

I noticed that the Notifications will show (for sure on android, haven't tried to replicate on iOS yet) even if my app is not the currently active app.  It would be nice if the Notifications wouldn't popup when my app is not the one actively being used.

Hi @danda1man does it happen while going to the background (confirmed and just fixed), or also when your app is in the background for a while and it suddenly shows a (scheduled) toast?

It happens after a while as well, i was using a toast in the offline/online event callbacks and those would appear long after my app was in the background

Alright, with the new 2.0.3 release this should no longer happen on Android (didn't try others). Can you please verify and close this issue?
Thanks,
Eddy

Looks good!

Why is this not configurable?! The unique feature of toasts on Android is that they stick around no matter what. It's my only criteria for choosing a Toast over existing UI.


Fast tdf import

Need to chat with bruker if this works all the time before we mergen. also check if it makes sense to not import ms2 frame spectra, might have implications on other parts of mzmine

Ready for review now


[BUG] Multiple Line Block Math Formula is not rendered

Describe the bug 描述你遇到的错误
I have a KaTex formula as follows:
$$
\begin{aligned}
2 \times Area(a, b, c) =
\begin{vmatrix}
a_x & a_y & 1\\
b_x & b_y & 1\\
c_x & c_y & 1\\
\end{vmatrix}
= \\
\begin{vmatrix}
b_x - a_x & b_y - a_y \\
c_x - a_x & c_y - a_y \\
\end{vmatrix}
\end{aligned}
$$

It should be rendered as the screenshot shows, but it didn't, just stay the same.
Expected behavior 期待的行为
It should be rendered as the screenshot shows.
Screenshots 屏幕截图

Build Environment 构建环境

OS: Manjaro
Theme version/commit b3dc66e
Hugo version hugo v0.83.1-5AFE0A57+extended linux/amd64 BuildDate=2021-05-02T14:38:05Z VendorInfo=gohugoio

Please try to use Hugo extended version before opening the issue.
请在创建 issue 之前尝试使用 Hugo extended 版本.
Preview Environment 预览环境

OS: Manjaro
Browser Firefox

Additional Information 补充信息
Configuration files or front matter code...
配置文件或者前置参数的代码...
Just the same as the theme docs.

There are some small adjustments need to be made to the KaTeX formulae for it to compatible to the Markdown parser.

All \\ need to be entered as \\\\ to escape \ symbol
There must be a space at the end of the line which ends with \\\\

So, for your example, the formulae need to be changed into
$$
\begin{aligned}
2 \times Area(a, b, c) =
\begin{vmatrix}
a_x & a_y & 1\\\\
b_x & b_y & 1\\\\
c_x & c_y & 1\\\\
\end{vmatrix}
= \\\\
\begin{vmatrix}
b_x - a_x & b_y - a_y \\\\
c_x - a_x & c_y - a_y \\\\
\end{vmatrix}
\end{aligned}
$$

for it to work correctly.

Thanks, I will make such adjustments.
Closing it.

https://discourse.gohugo.io/t/use-goldmark-mathjax-extension/25721/20
There has been quite a lot of discussion around this issue. I will keep an eye on it if there is any updates from Hugo (quite unlikely) :(.

I have added a math shortcode to solve this issue.
You no longer need to escape special characters inside a math shortcode.
https://hugodoit.pages.dev/theme-documentation-extended-shortcodes/#14-math


Metadata minute text always has "s"

I made a small post and the metadata under the post said "0 minutes" but it should be "0 minute". There should be an if statement, I think. I don't know much more than that.

Apparently Hugo supports this directly https://gohugo.io/content-management/multilingual/#query-a-singularplural-translation
It should be done together with #13

Closing this issue as it is tracked in #13


Retry when DatabaseName is wrong

Driver version
12.4.0
SQL Server version
Microsoft SQL Server 2022 (RTM-GDR) (KB5021522) - 16.0.1050.5 (X64)   Jan 23 2023 17:02:42   Copyright (C) 2022 Microsoft Corporation  Developer Edition (64-bit) on Windows Server 2022 Standard 10.0  (Build 20348: ) (Hypervisor)
Client Operating System
Windows 10 22H2
JAVA/JVM version
AdoptOpenJDK jdk-8.0.292.10-hotspot
Table schema
(no schema)
Problem description
If you try to connect to SQL Server with the following URL, it will retry for 30 seconds.
(invalid_database_name is DatabaseName that does not exist)
jdbc:sqlserver://localhost:1433;DatabaseName=invalid_database_name;responseBuffering=adaptive

Expected behavior
Do not retry if DatabaseName is wrong.
(like mssql-jdbc-8.4.1.jre8.jar)
Actual behavior
If DatabaseName is wrong, retry until loginTimeout.
Error message/stack trace
このログインで要求されたデータベース "invalid_database_name" を開けません。ログインに失敗しました。 ClientConnectionId:***
com.microsoft.sqlserver.jdbc.SQLServerException: このログインで要求されたデータベース "invalid_database_name" を開けません。ログインに失敗しました。 ClientConnectionId:***
	at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:262)
	at com.microsoft.sqlserver.jdbc.TDSTokenHandler.onEOF(tdsparser.java:283)
	at com.microsoft.sqlserver.jdbc.TDSParser.parse(tdsparser.java:129)
	at com.microsoft.sqlserver.jdbc.TDSParser.parse(tdsparser.java:37)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.sendLogon(SQLServerConnection.java:5233)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.logon(SQLServerConnection.java:3988)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.access$000(SQLServerConnection.java:85)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection$LogonCommand.doExecute(SQLServerConnection.java:3932)
	at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7375)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:3206)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.connectHelper(SQLServerConnection.java:2713)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.login(SQLServerConnection.java:2362)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.connectInternal(SQLServerConnection.java:2213)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.connect(SQLServerConnection.java:1276)
	at com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:861)
        ......

Any other details that can be helpful
This problem appears to have occurred in #1669.
Specifically, I suspect this code deletion is the culprit. https://github.com/microsoft/mssql-jdbc/pull/1669/commits/ac78f50479ab2f33a4f3107d2f1608bf9eaf8fed#diff-5a8fd0ea202eb55761d2a24d0619f2f2bd602ebbfe8e005bf4d112cc7768d840L2722

Hi @Takuya-Soda,
loginTimeout is the number of seconds the driver should wait before timing out a failed connection. Because this isn't set in the connection string, the default is 30 seconds.
connectRetryCount is the number of reconnection attempts if there's a connection failure. Because this isn't set in the connection string, the default is a single (1) retry.
So, based on your settings, the driver will attempt to connect, attempt to reconnect once, and then, after 30 seconds, time out.
You said "If you try to connect to SQL Server with the following URL, it will retry for 30 seconds.". There should only be a single retry, the driver should not be continually retrying for the entire 30 seconds. If you enable driver tracing, you should see a single connection and a single reconnection attempt. The reason it takes 30 seconds to return an error is because of the default 30 seconds for loginTimeout.
You said "Expected behavior - Do not retry if DatabaseName is wrong.". You can disable retry by setting connectRetryCount to 0, but again, the default value for this property is 1, a single retry.
For the moment, I don't see an issue with how retry and loginTimeout is set up, but please let us know if we missed something regarding your issue.

hi @Takuya-Soda
The reason the driver retries on an invalid database name is because that is considered a transient fault error. There is no way for the driver to know that the database name is invalid it could simply be busy or other valid reasons and therefore resolvable. As Jeff mentioned if you do not want any retries at all then you can set connectRetryCount to 0 otherwise the driver will always retry in this scenario.

HI @lilgreenbird

The reason the driver retries on an invalid database name is because that is considered a transient fault error. There is no way for the driver to know that the database name is invalid it could simply be busy or other valid reasons and therefore resolvable.

I thought the SQL Server error code 4060 only happened when the DatabaseName was wrong. Does this error occur even when SQL Server is busy?

As Jeff mentioned if you do not want any retries at all then you can set connectRetryCount to 0 otherwise the driver will always retry in this scenario.

I tried it and it didn't work. I tried the following URL, but it will retry for 30 seconds.
jdbc:sqlserver://localhost:1433;DatabaseName=invalid_database_name;responseBuffering=adaptive;encrypt=false;connectRetryCount=0

I think this is a bug. The reason is that only the following comments remain and the actual code has been deleted.
https://github.com/microsoft/mssql-jdbc/blob/81b0ea8635cf87bf26bd4540a387e558c4c9d8b6/src/main/java/com/microsoft/sqlserver/jdbc/SQLServerConnection.java#L3252

Looking at the link below, it seems to return a different error code if it's busy.
(This article is about Azure SQL Database, but since the code base is the same, the error conditions should be similar.)
https://learn.microsoft.com/en-us/azure/azure-sql/database/troubleshoot-common-errors-issues?view=azuresql-db

Hi @Jeffery-Wasty

loginTimeout is the number of seconds the driver should wait before timing out a failed connection. Because this isn't set in the connection string, the default is 30 seconds. connectRetryCount is the number of reconnection attempts if there's a connection failure. Because this isn't set in the connection string, the default is a single (1) retry.
So, based on your settings, the driver will attempt to connect, attempt to reconnect once, and then, after 30 seconds, time out.

I would have liked that to be the case, but there are actually 31 retries.
(I checked the log of SQL Server.)
By the way, this number depends on the version of the driver, and is shown in the table below.

Driver
Retry

mssql-jdbc-8.4.1.jre8.jar
0

mssql-jdbc-9.4.1.jre8.jar
1

mssql-jdbc-10.2.3.jre8.jar
17

mssql-jdbc-11.2.3.jre8.jar
31

mssql-jdbc-12.4.1.jre8.jar
31

This bug entered between 9.4.1 and 10.2.3. And in 11.2.3, the initial value of loginTimeout has changed, and I think it has increased further.

You said "If you try to connect to SQL Server with the following URL, it will retry for 30 seconds.". There should only be a single retry, the driver should not be continually retrying for the entire 30 seconds. If you enable driver tracing, you should see a single connection and a single reconnection attempt. The reason it takes 30 seconds to return an error is because of the default 30 seconds for loginTimeout.
You said "Expected behavior - Do not retry if DatabaseName is wrong.". You can disable retry by setting connectRetryCount to 0, but again, the default value for this property is 1, a single retry.

Hmmm, sure. If anything, it might be more of a problem that the retry is repeated uselessly.

Hi @Takuya-Soda,
The results from the SQL Server log are interesting. I tried reproducing this on my end after your initial post, and found the driver was doing retries that were consistent with the value of connectRetryCount. So for now I can't reproduce the issue, but we'll look into our code changes surrounding version 10.2.3 (including the code you've highlighted for us) and see if there is something that can explain this behavior.
I see you tried connectRetryCount=0, but it still retried for 30 seconds. Was there any difference in the number of retries you saw? What about for connectRetryCount=1?
In the meantime, can you provide us the trace logs I mentioned above? These will really help in narrowing down the issue. You can either attach them to this thread or email us at<EMAIL_ADDRESS>

Hi @Takuya-Soda,
I've reproduced the issue you are seeing. For a single connection attempt, you will see multiple login attempts, about 1 per second, which gives you the 17 or 31 you were seeing this. This is because for transient errors we continually retry login until loginTimeout is reached (or the error is no longer seen). It's an interesting thought whether this behavior should be modified, but for now I would recommend the following actions:

If you set loginTimeout to a low value (try 1 or 2), then you should see a low number of login attempts. I don't think its possible to limit it to exactly 1, but you can at least reduce it from 31.
We're currently working on a feature, where, as part of the feature, you can disable retry on current transient errors. This would allow you to set the driver to automatically fail on 4060, without any login retry. This feature is still in development, but we will update this thread with progress, including potential release windows.

Let us know if these steps work for you, and whether you have any further questions.

@Jeffery-Wasty

I see you tried connectRetryCount=0, but it still retried for 30 seconds. Was there any difference in the number of retries you saw?

I tried a pattern with no value in connectRetryCount and a pattern with 0 and 1, about 5 times each, but all 30 retries were performed.

In the meantime, can you provide us the trace logs I mentioned above? These will really help in narrowing down the issue. You can either attach them to this thread or email us at<EMAIL_ADDRESS>
I'll have a chat with the team. However, today is a public holiday in Japan, so I don't think I can provide the log right away.

Thanks @Jeffery-Wasty
I am very happy that the issue has been reproduced.

I've reproduced the issue you are seeing. For a single connection attempt, you will see multiple login attempts, about 1 per second, which gives you the 17 or 31 you were seeing this. This is because for transient errors we continually retry login until loginTimeout is reached (or the error is no longer seen). It's an interesting thought whether this behavior should be modified, but for now I would recommend the following actions:

If you set loginTimeout to a low value (try 1 or 2), then you should see a low number of login attempts. I don't think its possible to limit it to exactly 1, but you can at least reduce it from 31.
We're currently working on a feature, where, as part of the feature, you can disable retry on current transient errors. This would allow you to set the driver to automatically fail on 4060, without any login retry. This feature is still in development, but we will update this thread with progress, including potential release windows.

Let us know if these steps work for you, and whether you have any further questions.

Certainly we can avoid this problem by reducing the loginTimeout.
Since this issue is only in test code, changing the loginTimeout is fine.
I created this issue because a JDBC update suddenly changed the behavior, and it was due to a weird code fix.
Therefore, it would be great if the mssql-jdbc development team could receive this issue and decide whether or not to fix it.

Sorry, @Jeffery-Wasty
Do you still need the logs? If you can reproduce it, I don't think you need it.
(Also, it will take some time for us to provide it.)

Yes, thank you for bringing this to our attention, and yes we will eventually have a way to avoid this behavior. No need to provide further logs.
Can I close this issue? I'll update the issue again when the above mentioned feature is released.

Okay, thank you for confirming such a small issue. Please close this issue.

We're currently looking into making changes to retry logic so that connectRetryCount and connectRetryInterval are always respected.

PR #2212 will make the above change.

With #2230 (reverts #2212), I believe this needs to be reopened until a new fix is found. Feel free to close if I'm mistaken.

Retry logic was rewritten in PR 2247, which will be available in driver release 12.5.


Fixed bitmap too large issue

Fixes #5387
Fixed the error by scaling down the images if it is too large to handle

the unit tests are failing due to some download issues

In order to fix the unit tests, would you mind rebasing (or pulling) from main? Thanks :-)

In order to fix the unit tests, would you mind rebasing (or pulling) from main? Thanks :-)

Done


Dash Cam unrecognized

Describe the bug
2023 Hyundai Santa Cruz, Dash Cam not recognized
Which car does this affect?
2023 Hyundai Santa Cruz
Provide a route where the issue occurs
all
openpilot version
Dont know
Additional info
No response

Can you provide your dongle id? It will be in device settings

Good morning,
Thank you for your response. Dongle and serial in attachment.
It is 617bb607e012533e
Serial Number bad7504c
Thank you,
Dan
On Tue, Apr 25, 2023, 11:47 PM Shane Smiskol @.***>
wrote:

Can you provide your dongle id? It will be in Device settings
—
Reply to this email directly, view it on GitHub
https://github.com/commaai/openpilot/issues/28023#issuecomment-1522775025,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A7NYMM4AVD6AQRIPC7MFYVDXDCSGZANCNFSM6AAAAAAXLUPWTE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Hi, your car's fingerprints were added here 2 months ago, but they are not in release yet: https://github.com/commaai/openpilot/pull/27395
Simply install the nightly branch to get up and running!
Installer URL: https://installer.comma.ai/commaai/nightly


在Debian下使用nbcli安装bison后报错

环境

nonebot-bison 版本：0.7.2
nonebot 版本：2.0.0rc4
安装方式：通过 nb-cli 安装
操作系统：Debian11(bullseye)  OpenStick

问题
无法加载nonebot_bison
日志
05-21 14:02:43 [ERROR] nonebot | Failed to import "nonebot_plugin_datastore"
Traceback (most recent call last):
File "", line 14, in
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 125, in load_from_toml
return load_all_plugins(plugins, plugin_dirs)
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 62, in load_all_plugins
return manager.load_all_plugins()
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 175, in load_all_plugins
return set(
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 176, in
filter(None, (self.load_plugin(name) for name in self.available_plugins))
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 141, in load_plugin
module = importlib.import_module(name)
File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1206, in _gcd_import
File "", line 1178, in _find_and_load
File "", line 1149, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 240, in exec_module
super().exec_module(module)
File "", line 940, in exec_module
File "", line 241, in _call_with_frames_removed
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot_bison/init.py", line 4, in     require("nonebot_plugin_datastore")
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 168, in require
plugin = load_plugin(name)
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 37, in load_plugin
return manager.load_plugin(module_path)

File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 141, in load_plugin
module = importlib.import_module(name)
File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1206, in _gcd_import
File "", line 1178, in _find_and_load
File "", line 1149, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 240, in exec_module
super().exec_module(module)
File "", line 940, in exec_module
File "", line 241, in _call_with_frames_removed
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot_plugin_datastore/init.py", line 5, in
from .db import create_session as create_session
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot_plugin_datastore/db.py", line 116, in
_engine = _make_engine()
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot_plugin_datastore/db.py", line 44, in _make_engine
return create_async_engine(url, **engine_options)
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/sqlalchemy/ext/asyncio/engine.py", line 85, in create_async_engine
sync_engine = _create_engine(url, **kw)
File "", line 2, in create_engine
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/sqlalchemy/util/deprecations.py", line 283, in warned
return fn(*args, **kwargs)  # type: ignore[no-any-return]
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 601, in create_engine
dbapi = dbapi_meth(**dbapi_args)
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/sqlalchemy/dialects/sqlite/aiosqlite.py", line 337, in import_dbapi
import("aiosqlite"), import("sqlite3")
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/aiosqlite/init.py", line 6, in
from sqlite3 import (  # pylint: disable=redefined-builtin
File "/usr/local/lib/python3.11/sqlite3/init.py", line 57, in
from sqlite3.dbapi2 import *
File "/usr/local/lib/python3.11/sqlite3/dbapi2.py", line 27, in
from _sqlite3 import *
ModuleNotFoundError: No module named '_sqlite3'

05-21 14:02:43 [ERROR] nonebot | Failed to import "nonebot_bison"
Traceback (most recent call last):
File "", line 14, in
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 125, in load_from_toml
return load_all_plugins(plugins, plugin_dirs)
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 62, in load_all_plugins
return manager.load_all_plugins()
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 175, in load_all_plugins
return set(
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 176, in
filter(None, (self.load_plugin(name) for name in self.available_plugins))

File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 141, in load_plugin
module = importlib.import_module(name)
File "/usr/local/lib/python3.11/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1206, in _gcd_import
File "", line 1178, in _find_and_load
File "", line 1149, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/manager.py", line 240, in exec_module
super().exec_module(module)
File "", line 940, in exec_module
File "", line 241, in _call_with_frames_removed
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot_bison/init.py", line 4, in     require("nonebot_plugin_datastore")
File "/home/user/Python-3.11.3/nbot/.venv/lib/python3.11/site-packages/nonebot/plugin/load.py", line 170, in require
raise RuntimeError(f'Cannot load plugin "{name}"!')
RuntimeError: Cannot load plugin "nonebot_plugin_datastore"!

日志显示找不到模块sqlite3，且无法加载nonebot_plugin_datastore
尝试直接安装后无果
nonebot_plugin_datastore版本为0.6.3

这个 python3.11 是怎么装的呢，自己编译安装的吗

是的

大概是编译的时候没有enable python的sqlite feature，建议尝试重新编译python

解决了，的确是编译时没把sqlite的选项写进去
感谢大佬指教！


ability to write to postgres db?

It seems like we can only get data from api's,  is this true? or will shinylive only ever fetch and render?
Would it be possible to send data? ex -  a s3 bucket or a hosted postgres db?
It seems like having the ability to send data would make this an amazing and simple webapp framework.
thoughts?

The limitations on Shinylive come from the web browser's security sandbox, so it will be able to do the same things as any other web application that runs in the browser. In addition to being able to talk to web APIs, it can use websockets, for example, but you'll need something running on the backend to receive messages from the browser.


Deployment error when changing DynamoDB model and force --allow-destructive-graphql-schema-updates

After make a change on the DynamoDB model by adding a sort key:
type Vote @model {
id: ID! @primaryKey(sortKeyFields: ["owner"])
rating: Int!
owner: String!
}
I pushed the changes using the following recommended command :
amplify publish --allow-destructive-graphql-schema-updates
And I always receive this error:
["Index: 1 State: {"deploy":"waitingForDeployment"} Message: Resource is not in the state stackUpdateComplete","Index: 0 State: {"rollback":"waitingForRollback"} Message: Resource is not in the state stackUpdateComplete"]
Once I got it is impossible deploy de environment again and I need to create a new environment an redeploy it again on the new env.

I have a similar error, not using sort keys. It first appeared when I added manytomany relationship, then I got this error, had to delete the entire project, and create again. Very annoying


fix: switch xdr dep for spec tools to see if it fixes CI issue

This change is intriguing. Switching to soroban-env-host to access XDR is equivalent to changing the stellar-xdr import to match the stellar-xdr import that soroban-env-common imports. So it's unclear to me how that will fix the issue. If soroban-spec-tools is importing the wrong stellar-xdr lib, we should be able to correct that by changing the version of stellar-xdr in the Cargo.toml, without changing what crates are imported.

I think this was a stab in the dark, and I'm not sure it was ever needed.

Can we close this?


✨ first shot at brew cask, works on mac only but has some structure in …

…place for all linux platforms we support

Summary
Related issue(s)
Fixes #908

/cc @MikeSpreitzer

/cc @KPRoche

I am not familiar with authoring brew.
In fact, I am a little confused about using it.  There are casks, bottles, kegs, and more.  And when I successfully install something in the easy case, it does not tell me that what I have done involves any of those words.  brew list output for me has a huge list of "Formulae" and one Cask.
I know that brew has a normal case and also things that are more hesitant or install in alternate places to avoid overwriting stuff from the user's OS vendor.
I am not sure of the words to use when authoring something for the normal case.
I think we should be using the normal case for installing KubeStellar.  kcp is more debatable, but I think it is practically OK to use the normal case for that too.
The next thing to be clear about is where things will go.  For brew on my Mac, the foobar package normally goes in /usr/local/Cellar/foobar/ and brew also adds symlinks to /usr/local/bin pointing to executables in /usr/local/Cellar/foobar/2.3.5/bin (if 2.3.5 is my current version of foobar).  A KubeStellar distribution has not only executables in bin/ but also related stuff in config/ and user/ that the executables expect to find adjacent to them.

I demonstrated how symlinks interact with current directory in exectables.  I made a symlink and then invoked it.  The script looked where I expected.
mspreitz@mjs12 ~ % ls -l /usr/local/bin/kubectl-kubestellar-deploy
lrwxr-xr-x  1 mspreitz  admin  88 Aug 18 17:05 /usr/local/bin/kubectl-kubestellar-deploy -> /Users/mspreitz/go/src/github.com/kubestellar/kubestellar/bin/kubectl-kubestellar-deploy

mspreitz@mjs12 ~ % kubectl-kubestellar-deploy -X --external-endpoint foo.bar:1234
...
+ helm upgrade -i kubestellar /usr/local/user/helm-chart --set clusterType=Kubernetes --set-string EXTERNAL_HOSTNAME=foo.bar --set EXTERNAL_PORT=1234 --set image.tag=built-2023-08-08-14-55-25

I'm not a MacOS user, so can't comment intelligently on the commands there.
Couple items:
I realize this is the first rough attempt, but I'd suggest your readme should mention/link to the install instructions for homebrew itself. (Only bringing it up because one of the instructors in the Cloud SGI presumed everyone already used brew, and that session got sidetracked significantly as a result.)
I see that in the section of the formula preceding the def install block you used the same kind of conditionals as you used inside def install, rather than the on_xxx blocks. Was this just for simplicity in your first run at a formula?
(I'm tearing through the brew documentation to understand better)

I'm not a MacOS user, so can't comment intelligently on the commands there. Couple items:
I realize this is the first rough attempt, but I'd suggest your readme should mention/link to the install instructions for homebrew itself. (Only bringing it up because one of the instructors in the Cloud SGI presumed everyone already used brew, and that session got sidetracked significantly as a result.)
I see that in the section of the formula preceding the def install block you used the same kind of conditionals as you used inside def install, rather than the on_xxx blocks. Was this just for simplicity in your first run at a formula? (I'm tearing through the brew documentation to understand better)

what are 'on_xxx blocks?

I am not familiar with authoring brew.
In fact, I am a little confused about using it. There are casks, bottles, kegs, and more. And when I successfully install something in the easy case, it does not tell me that what I have done involves any of those words. brew list output for me has a huge list of "Formulae" and one Cask.
I know that brew has a normal case and also things that are more hesitant or install in alternate places to avoid overwriting stuff from the user's OS vendor.
I am not sure of the words to use when authoring something for the normal case.
I think we should be using the normal case for installing KubeStellar. kcp is more debatable, but I think it is practically OK to use the normal case for that too.
The next thing to be clear about is where things will go. For brew on my Mac, the foobar package normally goes in /usr/local/Cellar/foobar/ and brew also adds symlinks to /usr/local/bin pointing to executables in /usr/local/Cellar/foobar/2.3.5/bin (if 2.3.5 is my current version of foobar). A KubeStellar distribution has not only executables in bin/ but also related stuff in config/ and user/ that the executables expect to find adjacent to them.

if I knew how to have that 'default' location to install to, I would use it.  The default behavior for brew is to "build" something that comes from a tar.gz - like our source tarball.  We are not compiling anything, we have binaries and shells in our tarball.  So we have to have a destination for them.  I don't know a way to get the 'cellar' location that comes from a brew install build.  I will research more.  The likelihood is to put files in some obscure location and then put a logical link to it to simulate what a "build" would do.

I see something called a bottle which is for binary-only installs.  I will experiment with it.

what are 'on_xxx blocks?

They are another way, in the section of the formula outside the def install block, to specify actions based on system configuration: https://docs.brew.sh/Formula-Cookbook#handling-different-system-configurations
`Often, formulae need different dependencies, resources, patches, conflicts, deprecations or keg_only statuses on different OSes and architectures. In these cases, the components can be nested inside on_macos, on_linux, on_arm or on_intel blocks. For example, here’s how to add gcc as a Linux-only dependency:
on_linux do
  depends_on "gcc"
end

`

@KPRoche read further on on_xxx - its for config, not install - https://docs.brew.sh/Formula-Cookbook#inside-def-install-and-test-do.
need to use the if, then, else in the install blocks.  So I am going to keep it consistent and use what I have now in both install and config.  Thank you for having a look and suggesting this approach though.

It would help me a lot to see the intended user documentation for this.  I see there is now a README with command lines in it.  It would help a lot to also see an explanation of what the installation command is intended to accomplish.  What it will put where, what it will run using systemd or Kubernetes or raw processes or whatever.

@MikeSpreitzer included some preliminary docs to get started.  Some of the KubeStellar commands make assumptions about where they are being executed.  "KubeStellar init" assumes it is being run in the directory along side the config path.  Also, "kubectl kubestellar deploy" assumes the helm chart is located alongside it in the helm path.  These should be updated to allow for the KubeStellar or kubectl KubeStellar to be run anywhere on the file system - taking the path for config or helm chart as a parameter

closing in favor of #1140


OpenBSD support

There's no separate package for just the libraries so you just have client and server packages.

Some small problems to fix:

The server package doesn't ship with any cn=config database or the schemas in LDIF format.
There's two openldap-server packages, one for 2.3.x and one for 2.4.x. If you just do ensure => present you end up with the older version package.
Dynamic module support is disabled so everything is compiled in.


Update pyproject.toml: rename license

IMPORTANT: Please do not create a Pull Request without creating an issue first.
Before submitting (must do checklist)

[x] Did you read the contribution guide?
[ ] Did you update the docs? We use Numpy format for all the methods and classes.
[ ] Did you write any new necessary tests?
[ ] Did you update the CHANGELOG?

Type of Change

[x] Examples / docs / tutorials / contributors update
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Improvement (non-breaking change which improves an existing feature)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Proposed Changes

Rename Apache 2.0 to Apache-2.0
Related Issue

Closing issues

As you can see short identifier for the license is Apache-2.0 (with dash)
https://www.apache.org/licenses/LICENSE-2.0
Poetry also recognise it as Apache-2.0
https://python-poetry.org/docs/pyproject/#license

Codecov Report

Merging #504 (7b5495f) into master (c777b30) will decrease coverage by 34.26%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master     #504       +/-   ##
===========================================
- Coverage   87.80%   53.53%   -34.27%
===========================================
  Files         115      115
  Lines        5454     5454
===========================================
- Hits         4789     2920     -1869
- Misses        665     2534     +1869

Impacted Files
Coverage Δ

etna/commands/__init__.py
0.00% <0.00%> (-100.00%)
:arrow_down:

etna/commands/backtest_command.py
0.00% <0.00%> (-96.43%)
:arrow_down:

etna/commands/forecast_command.py
0.00% <0.00%> (-92.00%)
:arrow_down:

etna/commands/__main__.py
0.00% <0.00%> (-87.50%)
:arrow_down:

etna/commands/resolvers.py
0.00% <0.00%> (-80.00%)
:arrow_down:

etna/analysis/outliers/density_outliers.py
22.44% <0.00%> (-75.52%)
:arrow_down:

etna/transforms/timestamp/time_flags.py
26.02% <0.00%> (-73.98%)
:arrow_down:

etna/transforms/timestamp/fourier.py
27.08% <0.00%> (-72.92%)
:arrow_down:

etna/transforms/feature_selection/filter.py
28.57% <0.00%> (-71.43%)
:arrow_down:

etna/analysis/outliers/median_outliers.py
25.00% <0.00%> (-70.84%)
:arrow_down:

... and 65 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c777b30...7b5495f. Read the comment docs.


[Snyk] Upgrade commons-io:commons-io from 2.14.0 to 20030203.000550

This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to upgrade commons-io:commons-io from 2.14.0 to 20030203.000550.
:information_source: Keep your dependencies up-to-date. This makes it easier to fix existing vulnerabilities and to more quickly identify and fix newly disclosed vulnerabilities when they affect your project.

Warning: This is a major version upgrade, and may be a breaking change.

The recommended version is 1 version ahead of your current version.
The recommended version was released 18 years ago, on 2005-10-15.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open upgrade PRs.
For more information:
🧐 View latest project report
🛠 Adjust upgrade PR settings
🔕 Ignore this dependency or unsubscribe from future upgrade PRs

Give me update is older one , hence closing it


Fix issue #909 - "Set many LEDs on the horizontal bottom crashes Hyperion"

Summary
Fix issue #909 - "Set many LEDs on the horizontal bottom of the layout causes Hyperion to crash forever"
Do Hight :Width ratio correction first and then scale to max 80px.
This will ensure the height is not zero and fix the divide by zero issue.
What kind of change does this PR introduce? (check at least one)

[X] Bugfix
[ ] Feature
[ ] Code style update
[ ] Refactor
[ ] Docs
[ ] Build-related changes
[ ] Other, please describe:

If changing the UI of web configuration, please provide the before/after screenshot:
Does this PR introduce a breaking change? (check one)

[ ] Yes
[X] No

If yes, please describe the impact and migration path for existing setups:
The PR fulfills these requirements:

[ ] When resolving a specific issue, it's referenced in the PR's body (e.g. Fixes: #xxx[,#xxx], where "xxx" is the issue number)

If adding a new feature, the PR's description includes:

[ ] A convincing reason for adding this feature
[ ] Related documents have been updated (docs/docs/en)
[ ] Related tests have been updated

PLEASE DON'T FORGET TO ADD YOUR CHANGES TO CHANGELOG.MD

[ ] Yes, CHANGELOG.md is also updated

To avoid wasting your time, it's best to open a feature request issue first and wait for approval before working on it.
Other information:
Fixes: #909

I tested it, it works well!


Duplicate items in List

Describe the bug
Hello @david-swift
I found strange issue with List, the Item is duplicated
To Reproduce
I want get "load more" functionality,
after load next portion of content i modify list like this:
@State var items: [Item] = []

func loadMore() {

    // fetch and decode here

    Idle {
             var items = self.items
             let loadMoreIndex = items.lastIndex(where: { $0.id == "load-more" })! // ! for simplify construction here
             self.items.insert(contentsOf: fetchedItems, at: loadMoreIndex) // for insert at the end but before load more item
    }
}

Current behavior:

items contains one object with id "load-more"
list contains two view with text "Load more..."

Expected behavior

items contains one object with id "load-more"
list contains one view with text "Load more..."

Additional context
No response

I'm not able to reproduce this and it looks like unexpected behavior, so I'd be very happy if you could provide more details about the situation it occured.
As far as I understand your idea, what you're trying to accomplish could be accomplished in a cleaner way using a computed property combined with the state property:
@State private var items: [Item] = []

var allItems: [Item] {
    items + [id: "load-more")]
}

var view: Body {
    List(allItems) { item in
        switch item.id {
            case "load-more":
                // Load more view
            default:
                // Other views
        }
    }
}

func loadMore() {
    // ...
    items += fetchedItems
    // ...
}

It may help looking at https://github.com/AparokshaUI/adwaita-swift/pull/37#issuecomment-2187911876 for more information about state. In general, if state management is complex, there's probably a simpler, more elegant solution. You can always open a discussion if you have questions!


RFC: Import and rename decorators from Marshmallow

I have some doubt about these changes, so I keep it as a undocumentated features so far. Basically, I change the name of the following decorators from Marshamallow:

validates -> validate
validates_schema -> validate_schema
pre_load -> before_load
post_load -> after_load
pre_dump -> before_dump
post_dump -> after_dump

Some ideas behind these changes:

validate and validate_schema are short and clear than validates and validates_schema. It also matches the validate keyword in field classes.
The change from pre_ to before_ and from post_ to after_ was trying to follow the name convention in Flask (before_request, etc.).

IMO, the new names are easier to understand and intuitive. However, this will definitely introduce "breaking" changes between APIFlask and Marshmallow. I can add a warning in the docs to inform user that they can continue import everything from marshmallow, but notice the name changes if they want to import from APIFlask.
Is it a good or bad idea? Feel free to leave any thoughts.

I also think marshmallow.validators is a better module name than marshmallow.validate (that's why I exposed them via apiflask.validators). The one thing I can't easily change is the validate keyword in field classes, if it can be validators, then everything is consistent.

As for #63, I wouldn't add such a layer for little benefit.
validate vs. validator was discussed in https://github.com/marshmallow-code/marshmallow/issues/645 and this could be reopened if you bring arguments to back up your case.
For pre/post I'd naturally stick to marshmallow's convention, but I understand the will to be close to Flask. There is no best convention. It depends how much you want to expose marshmallow. If you expect users to be familiar with marshmallow, perhaps you should use marshmallow namings. In any case, those names are not expected to change on marshmallow side so your aliases shouldn't break anytime soon.

The pre/post changes are not very necessary. But I do want to change validates/validates_schema to validate/validate_schema, the s is quite redundant for me... Any reasons behind these validates names in Marshmallow, is it just because the validate namespace is occupied by the marshmallow.validate module?

TBH, I didn't write that and I can only guess.
This is suited as a question / suggestion in our bugtracker. You may link to this issue.


Update cached package list

Fixes #5

Sorry, nit but since the diff is pretty much uninspectable, could you rephrase the commit message to state that it's the cdnjs package cache that you update?

@passy fixed.

Thank you! :sparkles:


Allow authenticated users to set anonymous donations

Changes before the launch. Allowing the authenticated users to set if they want to keep their donation anonymous.

testing on next.giveth.io
signed in on my autheticated account and donating to a project - I click donate anonymously and donate some ETH

the donation goes through and shows up as anonymous on the project's page - I also tested non-anonymous donation and it shows up properly as well!


Clipping Command

Please first make sure you have looked at:

Documentation: https://github.com/mkleehammer/pyodbc/wiki
Other issues

Environment
To diagnose, we usually need to know the following, including version numbers.  On Windows, be
sure to specify 32-bit Python or 64-bit:

Python: 3.12.0
pyodbc: '5.0.1'
OS: Windows 10 64-bit:
DB: SQL Server 2016
driver: 2<IP_ADDRESS>

Issue
I have done some trouble shooting and found that there is a length limitation in cursor I tried the csv and it worked but couldnt upload a PDF.
Code
import pyodbc,os
import pandas as pd

# Replace the following variables with your actual database connection details
server_name = 'DC3-SQLDEV-01\\VPNR'
database_name = 'Viewpoint'
def pdf_to_byte_array(pdf_file_path):
    with open(pdf_file_path, 'rb') as file:
        byte_array = bytearray(file.read())
    return byte_array

def insert_attachment(byte_data, file_type):#vendor,original_invoice_no,inv_date,description,inv_total):
    # Connect to the SQL Server database using Trusted Connection (Windows Authentication)
    conn_str = f'DRIVER={{SQL Server}};SERVER={server_name};DATABASE={database_name};Trusted_Connection=yes;'
    db_connection = pyodbc.connect(conn_str)
    cursor = db_connection.cursor()

    try:
        # Stored procedure parameters

        # Execute the stored procedure
        cursor.execute("EXEC dbo.uspInsertViewpointAttachment1 @AttachmentData=?, @FileType=? ",(byte_data,file_type))
        #Commit the transaction (if needed)
        cursor.commit()
        print("Stored procedure executed successfully.")
        # cursor.execute("SELECT * from bHQAF WHERE APCo=? AND APRef=?", (pyodbc.Binary(byte_data),file_type))
        # Commit the transaction (if needed)

        # result=cursor.fetchval()
        # cursor.commit()
        # keyID=result
        # cursor.commit()
        # print(f"Stored query executed successfully.{keyID}")

        # cursor.close()
        # db_connection.close()
        # return result
    except pyodbc.Error as ex:
        print("Error executing the stored procedure:", ex)

    finally:
        # Close the cursor and database connection
        cursor.close()
        db_connection.close()
        return True #keyID
def pdf_to_byte_array(pdf_file_path):
    with open(pdf_file_path, 'rb') as file:
        byte_array = file.read()
    return byte_array

os.chdir('B:/ReprocessF/test')
pdf_file_path=r'INV-0111.csv'
byte_array = pdf_to_byte_array(pdf_file_path)
file_type='.csv'
Attachment_ID=insert_attachment(byte_array, file_type)
print(type(byte_array))

print(pdf_file_path)
#print(Attachment_ID)

using a larger file causes the issue small file works fine

The version that you mentioned is the only one that I am using already, It
works with a dot net program so I see its the limitation of PYODBC library
that it is clipping off even the command part.
[image: image.png]
Regards,
Harsh Parekh
On Fri, 8 Dec 2023 at 01:43, v-chojas @.***> wrote:

SQL Server is the old driver that comes with Windows and only supports a
subset of current SQL features. According to the driver version you
mentioned, try using Driver=ODBC Driver 17 for SQL Server instead.
—
Reply to this email directly, view it on GitHub
https://github.com/mkleehammer/pyodbc/issues/1310#issuecomment-1845578767,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJUXQJR2BWTDWP4QEOJP25TYIHPZFAVCNFSM6AAAAABAKQACPCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBVGU3TQNZWG4
.
You are receiving this because you authored the thread.Message ID:
@.***>


Bug: Loading more relations does not update select list

It would be great if the relations dropdown was a bit smarter about filtering by user input. I currently have relations which aren't loaded in the first fetch. It would be awesome if the "Load More" button would filter based on the text input. (Even if it would be restricted to looking up by id). The ideal form though would filter by the name or title field I have defined.

https://user-images.githubusercontent.com/23691663/179259032-d5d24868-ecfc-4616-9a19-51878181ddc7.mov
Actually I think this might be a bug

I verified in the Networks tab that the next page is being fetched, but it isn't actually being loaded into what the select element searches/lists

 (For reference, there is a "author" 299)

The default search function for the Records dropdown is very generic and it practically searches client side only within the loaded options.
For the records, the dropdown is paginated and we are fetching up to 200 records on each "Load more" click, so my guess is that the 299 record is just not loaded yet.
I'll see try to improve the records search and will consider adding the same search filter support as on the listing page.

That's what I thought too, but the list seems to be the same after updating.

Actually, if I understand this right, I think actually page 1 is never loaded. Is that possible?

This is the response for the first record call after opening the overlay

I think it's specific to loading a relation with > 200 records

Ah, indeed there is a bug - here https://github.com/pocketbase/pocketbase/blob/master/ui/src/components/records/RecordSelect.svelte#L26 we need to use loadList(true) (the default is false) so that it can always start from page 1.
From the screenshot it seems that you have 400 items total. The first page that will be loaded in your case would be page 2, which is the last one. When you click on "Load more" we are sending request to the api for page=3, but there is no page=3 and the api returns the select for the max last page available.
Or in other words, every time when you click on "Load more" we are loading always page=2. The results are not duplicated in the dropdown list, because we are doing deduplication in case there was a insert/delete and the pagination list has changed from the last call.
I'll add shortly a hotfix for the loadList(true), but this in general will need to be reworked so that we can support proper search filtering and do the records filtering server-side.

Awesome! Would you consider writing up (or pointing to) some docs on contributing in code? I tried to figure out a couple of these on my own but it’s unclear to me how svelte and go interact during development

This should be now fixed in v0.2.8 release.
Yes, I'll add contribution notes in the README this weekend, but in general:

Navigate to examples/base and run: go run main.go serve
This will start the application on localhost:8090 with the embedded prebuilt UI from ui/dist.

To develop frontend features, you have to start in another terminal the UI's vite dev server,
by navigating to the ui directory and running npm run dev (after installing the node dependencies).
This will start a new server with only the UI at localhost:3000, configured to make requests to the api server at localhost:8090. Vite supports HMR so every you make you should see almost immediately without refresh.


Update readme, remove truffle and ganache instructions

What it solves
Resolves #325 #2329.
Truffle files were already removed in #2333.
How this PR fixes it
Removes outdated info from the readme.
How to test it
No effect on the code, so no need to test anything.

WDYT about moving the Environment Variables section, before running?

Good idea @fernandomg, moved it higher 👍


[REQ] Provide an fseek analogue

I'm not sure if this is out of scope for fcurl or not, but I figured it was worth asking.
Is there any plan to provide an fseek analogue, providing range request support, perhaps? (e.g. fseek to an offset N and read X bytes yields a N to N+X range request). It may be too compilcated to be worth in in this wrapper.
This would also allow fcurl to be registered with fopencookie or funopen, or various libraries which take such callbacks.
Hopefully that made some semblance of sense.
Also apologies if a GitHub issue is not the appropriate place to put this; It wasn't clear from the README if there was a separate mailing list or bug tracker.

Good question, thanks! I think an fseek equivalent will be really useful and almost required to provide a good "emulation" for the f family of functions. It could possibly be a bit hard to make it work in some situations but we should at least make a best effort.
I think the github issues is a sensible place to take these things, at least to start with. There's no dedicated mailing list or anything for fcurl (yet).
I added a few more functions to the README so they won't be forgotten.


Keep getting System null reference exeptions

With the new implementation of command handling i keep getting  System Null Reference Exceptions as soon as i'm building something. :)

Found bug in the implementation of the way the new script handles total_income & total_expense, commenting them out seems to solve the problem, making a bug fix now.


Change return value of ecdsa_sign_digest

Error codes were not being propagated, always returned as 0.

Good find!


MC Upload task should support UWP app symbols

@AlexRukhlin,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot


Running MoorDynV2 in matlab

Hello everybody,
I am trying to use MoordynV2 within matlab. I have compiled it as mentioned in : https://moordyn.readthedocs.io/en/latest/compiling.html#id4
But when I ran the test case in matlab, it told "_Invalid MEX-file 'C:\MoorDyn\MoorDyn.build\wrappers\matlab\MoorDynM_Create.mexw64': The specified
module could not be found.
Error in main (line 5)
system = MoorDynM_Create('Mooring/lines.txt');_".

I hope to know what I shoud do to fix it.
I would be grateful for any hints.
Best wishes

Hi @s-zhang20,
This error seems like your mex files were never made. Have you enabled the Matlab wrapper with CMake? A quick check would be to look at the content of your C:\MoorDyn\MoorDyn.build\wrappers\matlab\ folder. There should be a number of .mexw64 files in there, one for each function you can call.

@RyanDavies19 Thank you very much for your quick response, I appreciate it. I think I have enabled the Matlab wrapper with CMake, as shown in the following figure.

But when I call these functions in MATLAB, it says "Invalid MEX-file ...".

Hi @s-zhang20
This seems like a path error. If you are sure you have added the folder with the mexw64 files to the matlab path and you still get the error. I would suggest deleting your build directory (i.e. deleting the mexw64 files), and recompiling to build the mexw64 files again.


Add a new_release.md issue template

Fix: https://github.com/f3d-app/f3d/issues/524

Is it visible by anyone creating a new issue?

yes

Isn't it a problem?

Isn't it a problem?

We will see if we have users opening the wrong type of issue ? Maybe I can add "For maitainers only" in the description.
I did not find a way to restrict some issue template to maintainers


Remove redux wallet

Removes the old redux wallet.

Closing this for the time being. Given that it's now stale, it's probably easiest to recreate anyhow.


Add validator daily confirmation rate

Fixes #55

@vosi @shashanksinha89 The python3 manage.py initialize_validator command looks good to me. Can one of you review the Docker updates to check if everything looks good?

@vosi @shashanksinha89 The python3 manage.py initialize_validator command looks good to me. Can one of you review the Docker updates to check if everything looks good?


chore: check for INFURA_PROJECT_ID during setup

Should INFURA_PROJECT_ID really be required? I would expect the snap to be agnostic about the RPC provider and be usable with any API-compatible RPC endpoint?

In this case and in this early version of this snap, yes.
ENS resolution must start by querying mainnet (or supported testnets, if that's the case).
But snaps don't have a way of requesting a provider for a particular network, so we must default to something until the multi-network provider API is available.
It's my understanding that this is a temporary solution as this multi-network provider is planned


Roll engine a114659c4a83..90faf8531c00 (1 commits)

https://github.com/flutter/engine/compare/a114659c4a83...90faf8531c00
git log a114659c4a83..90faf8531c00 --no-merges --oneline
90faf8531 Roll src/third_party/skia f8592a69428e..8ff2f13f3817 (1 commits) (flutter/engine#6129)
The AutoRoll server is located here: https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md
If the roll is causing failures, please contact the current sheriff, who should
be CC'd on the roll, and stop the roller if necessary.

@rmistry @liyuqian : New roll has been created by https://autoroll.skia.org/r/flutter-engine-flutter-autoroll

Auto-roller completed checks. About to merge.


Add BACKSOLVED option to puzzle status

It could be helpful for reference when looking back on the hunt to know which puzzles we forward-solved vs. backsolved.

As per discussion in group chat, leaning towards doing this via a tagging system where "backsolved" can be one of (possibly many) tags that we can then filter by. Prefer this over adding "backsolved" to the STATUS enum since a puzzle can be both SOLVED and backsolved.

Filed #32 for general tagging functionality.

Duplicate of #32


Update the Lurker library dependency to ~1.1@dev

The Lurker library in version ~1.0 has an issue, where sometimes it is impossible to watch directories. I propose updating it to version ~1.1 where I did not encounter this problem.

:+1: I've been investigating this issue all afternoon. Just worked out where the issue is.

Do we know why Robo uses a fork of Lurker? flint/Lurker seems to be more up to date. It has a 1.1 tag, whereas henrikbjorn/Lurker doesn't.

Don't really know, I had to fork the Robo lib and use it in my project to make things work.

Do we know why Robo uses a fork of Lurker? flint/Lurker seems to be more up to date. It has a 1.1 tag, whereas henrikbjorn/Lurker doesn't.

In the days it was initially born, this version was the most stable one. Not sure, maybe its time to switch to other.

Done. Also updated symfony version to match 3.x as well


Resource file not found

Was using this plugin in a new project and the player character animations imported without issue. After that, trying to import any other Aseprite file from any other file location gives me a "Resource file not found: /ase_NameOfFile.png (expected type: Image) error. This results in the animations and frames being imported, but the texture doesn't generate for them. No edits were made to any of the scripts present in the addon. Disabling and reenabling the addon did not fix the problem, nor did deleting it and reinstalling.
This is in the Mono version of Godot v4.2 stable.

Interesting. That path is as if it's trying to read the file from the root. I haven´t seen this happening before. Which operation system are you using?
I will try to reproduce it. Also, if you are comfortable sharing your new project or any reproducible project (with .godot / .import folders) it might make it easier to identify the issue.

I'm using Windows 10 as my operating system. For whatever it's worth, the next day I tried again and each of the files that failed before, worked. As stated, I tried restarting Godot to fix the issue (a few times), so the only real difference is that I restarted my system.
If there's a way I can share my project with you privately, I'd be happy to (I love your plugin and would be happy to help), I just would rather not share it publicly.

Thank you. No problem. I guess if it's working now it will make it harder to debug. I think we can close the issue but feel free to re-open it in case it happens again. Good luck with your project. Cheers.


Website is down

Yes, we closed the website for the moment as we currently do not have funding for inference costs.

You should remove the link from the README.md file, it goes to a dangerous URL.

@manchuwook done


Odd failure in image.test.js

Ran into this error all of sudden (https://travis-ci.org/mapnik/node-mapnik/jobs/124285341#L1403). We've never seen it before. Failure is here: https://github.com/mapnik/node-mapnik/blob/c007bc511ab3ff65b3b4160cf6ebc89235e60160/test/image.test.js#L1540.
Seems like memory corruption is the only thing that could explain different pixels here.
  1) mapnik.Image  be able to create image with zero allocation / from raw buffer:
      AssertionError: 0 == 4
      + expected - actual
      -0
      +4

      at Context.<anonymous> (test/image.test.js:1540:16)

This did not happen on another travis run. So it is likely going to happen only extremely rarely. Keeping open for now to keep an eye.

Not seen since.


advice on how to accept nested form entry

I have looked at different solutions for accepting nested form entry in MongoMapper because we are considering a move from Mongoid. I even found a gem that provides MongoMapper support for 'accepts_nested_attributes':
https://github.com/mooktakim/mongo_mapper-accepts_nested_attributes
What is the best practices for supporting nested form entry in MongoMapper? If third party support is needed, are there any recommended solutions?
Best,
Andy

You'll have better luck getting an answer on the mailing list. We try to keep GitHub Issues for patches and confirmed bugs.


PubSub: Consider updating Grpc dependency

Hi,
I am debugging my application which subscribes to PubSub. I see that sometimes if there is an exception StartAsync method of SubscriberClient never returns.
I think that i am hitting https://github.com/grpc/grpc/issues/14777 because stacktrace in one of threads looks like this:
- Monitor.Enter() (!)
- Grpc.Core.Internal.AsyncCallBase.Cancel() (!)
- CancellationTokenSource stuff
- SubscriberClientImpl.StopCompletionAsync()

This issue was fixed in version 1.15 of Grpc.Core (https://github.com/grpc/grpc/pull/16440) but PubSub package is still on 1.13.1.
https://github.com/googleapis/google-cloud-dotnet/blob/e8f43966e271490bfbb612c714589c2897a769a9/apis/Google.Cloud.PubSub.V1/Google.Cloud.PubSub.V1/Google.Cloud.PubSub.V1.csproj#L28
Environment details

Linux
.NET Core 2.2
Google.Cloud.PubSub.V1 1.0.0

Steps to reproduce

Call SubscriberClient.StartAsync multiple times in environment where it will result in exception.

Is it possible to update the dependency?
Thanks.

Yes, I can do this, but i thought it is worth to create an issue.

Yup, absolutely - it just means it's not quite as urgent :)


Revert "ld (#317)"

This reverts commit bb6a570c13b28c4c0d9028d2878a064fbf6e52e1.

Velox to arrow and arrow to velox has been removed, so this PR is not needed, revert it, And we should guarantee the input arrow buffer is 16B aligned, this buffer origins from shuffle read, has maked it 16B align.

Can you help merge this one?  @zhejiangxiaomai https://github.com/oap-project/gluten/pull/2178