Module parse failed - webpack

Describe the bug
I cannot get the latest module to work, is there something I need to do for this to work with webpack?
react | ERROR in<EMAIL_ADDRESS>125:25
react | Module parse failed: Unexpected token (125:25)
react | File was processed with these loaders:
react |  * ./node_modules/babel-loader/lib/index.js
react | You may need an additional loader to handle the result of these loaders.
react | |         h(!1), s(!0);
react | |         try {
react | >           v = await r(O ?? t), P.isNull(v) || (g(v), H(void 0), s(!1));
react | |         } catch (Y) {
react | |           Y instanceof Error ? H(Y) : H(new Error("Unknown error")), g(void 0), s(!1);
react | ℹ ｢wdm｣: Failed to compile.

SDK Version

Version 2.0.0-alpha.8

To Reproduce
Steps to reproduce the behavior:

Run sample project with defaults

You need to configure webpack / babel to work with ES2020 standard (this is what we are targeting). I believe webpack is complaining about that optional chaining operator ??

@bshyong Were you able to solve it? I'm running into the same issue and I already have this in my tsconfig.json so not sure what else to change.
 "compilerOptions": {
    "target": "es2020",

@paintoshi Depending on which tools you use, adding this won't be enough. Usually it is within webpack / babel etc. where you need to add appropriate loaders or plugins to target modern js.
Latest versions of more modern tools like vitest / rollup etc. should work by default, I also think latest babel version also works with es2020.

@IljaDaderko Ok thank you for quick reply. The app was created with Create React App, and I have an old react-scripts package, which in turn uses an old babel-loader. Updating it created plenty of other issues in other packages, so I need to look into this more. Probably have to update a lot to get this working.

Any update with this?

@Edison4mobile TL;DR fix was to update babel to latest version that supports ES2020

@Edison4mobile
I can confirm that it works with the latest yarn create react-app wallet-demo --template typescript
I just had to add this line to a .env.local file GENERATE_SOURCEMAP=false
Or it creates hundreds of source file errors. It's something with the latest react-scripts 5. v4 does not have that problem but not sure if web3modal works with that. More info: https://github.com/mswjs/msw/issues/1030
The only problem for me is actually updating React in our live platform. It's tremendously complex with all our dependencies. I would not be sad if web3modal worked with lower versions..

@paintoshi In theory you should be able to get it working with v4 of create react app if you add babel loaders for some es2020 syntax, from the top of my head:

Optional chaining
Nullish coalescing

@0xAsimetriq I wonder if that's possible without ejecting the whole thing, which we probably won't do since it's a one-way operation.

@0xAsimetriq Dug some more into this. Everything works while running<EMAIL_ADDRESS>but that may not be an option for some since it requires React v18 which creates a lot of other problems with some dependent libraries (depending on the app).
But the problem above can be avoided without upgrading anything and without ejecting the app which cannot be reverted.

Install https://www.npmjs.com/package/react-app-rewired
Install https://www.npmjs.com/package/react-app-rewire-babel-loader
Add the following to your config-overrides.js

const path = require("path");
const fs = require("fs");

const rewireBabelLoader = require("react-app-rewire-babel-loader");
const appDirectory = fs.realpathSync(process.cwd());
const resolveApp = relativePath => path.resolve(appDirectory, relativePath);

module.exports = function override(config) {
  config = rewireBabelLoader.include(
    config,
    resolveApp("node_modules/wagmi"),
    resolveApp("node_modules/@web3modal"),
    resolveApp("node_modules/@wagmi"),
    resolveApp("node_modules/@walletconnect")
  );

  return config
}

Change the scripts in package.json to use rewired (all except eject)

"scripts": {
    "start": "react-app-rewired start",
    "build": "react-app-rewired build",
    "test": "react-app-rewired test",
    "eject": "react-scripts eject"
  },

@paintoshi awesome! Ty for the update, also I was under impression that react-scripts respects babel config file even when not ejected, but I guess that is wrong (been a while since I used it).

@0xAsimetriq Dug some more into this. Everything works while running<EMAIL_ADDRESS>but that may not be an option for some since it requires React v18 which creates a lot of other problems with some dependent libraries (depending on the app).
But the problem above can be avoided without upgrading anything and without ejecting the app which cannot be reverted.

Install https://www.npmjs.com/package/react-app-rewired
Install https://www.npmjs.com/package/react-app-rewire-babel-loader
Add the following to your config-overrides.js

const path = require("path");
const fs = require("fs");

const rewireBabelLoader = require("react-app-rewire-babel-loader");
const appDirectory = fs.realpathSync(process.cwd());
const resolveApp = relativePath => path.resolve(appDirectory, relativePath);

module.exports = function override(config) {
  config = rewireBabelLoader.include(
    config,
    resolveApp("node_modules/wagmi"),
    resolveApp("node_modules/@web3modal"),
    resolveApp("node_modules/@wagmi"),
    resolveApp("node_modules/@walletconnect")
  );

  return config
}

Change the scripts in package.json to use rewired (all except eject)

"scripts": {
    "start": "react-app-rewired start",
    "build": "react-app-rewired build",
    "test": "react-app-rewired test",
    "eject": "react-scripts eject"
  },

Validated running web3modal 2.0 together with old version of create-react-app and<EMAIL_ADDRESS>and<EMAIL_ADDRESS>
Thanks! I just had to remove the resolveApp("node_modules/@walletconnect") line inside config-overrides.js, otherwise I was getting a compile error from that dependency.


pyarray and pytensor names in auto-generated docstring

Pyarray and pytensor rely on pybind11 make_caster<T>::name() to determine the string representation of its value_type (which is then used for the auto-generated docstring). However, make_caster assigns the name "int" to every integral type and "float" to every floating type (except for "char"->"str" and "bool"->"bool").
While this makes perfect sens for vanilla Python, this becomes confusing with Numpy where the precise numeric type is important. For example, defining the two overloaded test functions in the module m:
m.def("test", [](xt::pyarray<int>&a){});
m.def("test", [](xt::pyarray<long>&a){});

leads to the following docstring:
    test(*args, **kwargs)
    Overloaded function.

    1. test(arg0: numpy.ndarray[int]) -> None
    2. test(arg0: numpy.ndarray[int]) -> None

where the two overloads seem to have an identical signature.
Would it be possible to bypass pybind11 make_caster for types that corresponds to numpy dtypes  such that we would get a correct docstring ? (something like: )
    1. test(arg0: numpy.ndarray[int32]) -> None
    2. test(arg0: numpy.ndarray[int64]) -> None

Thanks @PerretB I agree that specifying the int32 and int64 flavors in the python docstrings would make a lot more sense.

Done! :)


pangu draw 3.0 执行 ./run_sampling.sh 报错

Thanks for sending an issue!  Here are some tips for you:
If this is your first time, please read our contributor guidelines: https://github.com/mindspore-ai/mindspore/blob/master/CONTRIBUTING.md
Hardware Environment | 硬件环境

please tell us what kind of hardware can reproduce your error?
请告诉我们您报错的后端类型

[ 910 ] Ascend

Software Environment | 软件环境

MindSpore version:
请告诉我们您正在使用的MindSpore版本：

[ ] 2.2.10

Python version( 3.8.8):

OS(centOS 8.2)

GCC/Compiler version:8.5.0

Describe the current behavior | 目前输出
[root@n1 pangu_draw_v3]# ./run_sampling.sh
flash attention is available.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
Initialized embedder #0: FrozenCnCLIPEmbedder with 115972685 params. Trainable: False
Initialized embedder #1: FrozenOpenCLIPEmbedder2 with 694665770 params. Trainable: False
Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False
Loading model from ['/wanghuan/low_timestamp_model.ckpt']
[ERROR] ME(855962:281473315727456,MainProcess):2024-01-29-02:07:34.586.661 [mindspore/train/serialization.py:1261] Failed to read the checkpoint file /wanghuan/low_timestamp_model.ckpt. May not have permission to read it, please check the correct of the file.
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1253, in _parse_ckpt_proto
checkpoint_list.ParseFromString(pb_content)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/message.py", line 199, in ParseFromString
return self.MergeFromString(serialized)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1106, in MergeFromString
if self._InternalParse(serialized, 0, length) != length:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 703, in DecodeRepeatedField
raise _DecodeError('Truncated message.')
google.protobuf.message.DecodeError: Truncated message.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "pangu_sampling.py", line 454, in
sample(args)
File "pangu_sampling.py", line 322, in sample
model, filter = create_model(
File "/wanghuan/pangu_draw_v3/gm/helpers.py", line 160, in create_model
model = load_model_from_config(config.model, checkpoints, amp_level=amp_level)
File "/wanghuan/pangu_draw_v3/gm/helpers.py", line 285, in load_model_from_config
_sd_dict = ms.load_checkpoint(ckpt)
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1087, in load_checkpoint
checkpoint_list = _parse_ckpt_proto(ckpt_file_name, dec_key, dec_mode)
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1262, in _parse_ckpt_proto
raise ValueError(err_info) from e
ValueError: Failed to read the checkpoint file /wanghuan/low_timestamp_model.ckpt. May not have permission to read it, please check the correct of the file
Describe the expected behavior | 期望输出
please describe expected outputs or functions you want to have:
请告诉我们您期望得到的结果或功能

如何解决报错

Steps to reproduce the issue | 复现报错的步骤

code url | 代码链接:
command that can reproduce your error | 可以复现报错的命令
e.g. cd xx -> bash scripts/xx.sh --config xx
xx

Related log / screenshot | 完整日志
Special notes for this issue | 其他信息

根据报错：Failed to read the checkpoint file /wanghuan/low_timestamp_model.ckpt. May not have permission to read it, please check the correct of the file.和google.protobuf.message.DecodeError: Truncated message.，怀疑文件损坏，您可以检查一下本地ckpt文件的sha256和下载链接里ckpt文件名后缀是否一致

修改后依然报错，请问：
1、仍然是ckpt文件的问题吗？
2、出现了内存错误，是否跟运行环境有关？
目前采用了单卡910，32核64G，是否不满足运行要求？

重新下载了两个文件，检查了校验值
[root@n1 ckpt]# ll
总用量 27032600
-rwxr-xr-x. 1 root root<PHONE_NUMBER>6 12月 22 10:13 pangu_high_timestamp-c6344411.ckpt
-rwxr-xr-x. 1 root root<PHONE_NUMBER>6 12月 22 10:24 pangu_low_timestamp-127da122.ckpt
[root@n1 ckpt]# pwd
/wanghuan/ckpt
[root@n1 ckpt]# sha256sum pangu_high_timestamp-c6344411.ckpt
c6344411e5f889941e6f6b9653499c476adb598b0a520877cf1a86d931e6e041  pangu_high_timestamp-c6344411.ckpt
[root@n1 ckpt]# sha256sum pangu_low_timestamp-127da122.ckpt
127da12275180c72e82e6173b8dd80d099507dcf2546fa139cdf4bde1d196965  pangu_low_timestamp-127da122.ckpt
修改脚本路径：
"run_sampling.sh" 16L, 560C                                                                            15,69        全部
export MS_PYNATIVE_GE=1
export current_dir=/wanghuan/pangu_draw_v3
export PYTHONPATH=$current_dir:$PYTHONPATH
cd $current_dir
run script
When the device is running low on memory, the '--offload' parameter might be effective.
python pangu_sampling.py
--device_target "Ascend"
--ms_mode 1
--ms_amp_level "O2"
--config "configs/inference/pangu_sd_xl_base.yaml"
--high_solution
--weight "/wanghuan/ckpt/pangu_low_timestamp-c6344411.ckpt"
--high_timestamp_weight "/wanghuan/ckpt/pangu_high_timestamp-127da122.ckpt"
--prompts_file "prompts.txt"
报错信息：
[root@n1 pangu_draw_v3]# ./run_sampling.sh
flash attention is available.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
Initialized embedder #0: FrozenCnCLIPEmbedder with 115972685 params. Trainable: False
Initialized embedder #1: FrozenOpenCLIPEmbedder2 with 694665770 params. Trainable: False
Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False
Loading model from ['/wanghuan/ckpt/pangu_low_timestamp-127da122.ckpt']
[WARNING] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:12.705.028 [mindspore/train/serialization.py:1378] For 'load_param_into_net', 2 parameters in the 'net' are not loaded, because they are not in the 'parameter_dict', please check whether the network structure is consistent when training and loading checkpoint.
[WARNING] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:12.705.204 [mindspore/train/serialization.py:1383] conditioner.embedders.0.transformer.text_model.embeddings.position_ids is not loaded.
[WARNING] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:12.705.276 [mindspore/train/serialization.py:1383] conditioner.embedders.1.model.attn_mask is not loaded.
missing keys:
['conditioner.embedders.0.transformer.text_model.embeddings.position_ids', 'conditioner.embedders.1.model.attn_mask']
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
Loading model from ['/wanghuan/ckpt/pangu_high_timestamp-c6344411.ckpt']
[ERROR] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:37.590.458 [mindspore/train/serialization.py:1261] Failed to read the checkpoint file /wanghuan/ckpt/pangu_high_timestamp-c6344411.ckpt. May not have permission to read it, please check the correct of the file.
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1253, in _parse_ckpt_proto
checkpoint_list.ParseFromString(pb_content)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/message.py", line 199, in ParseFromString
return self.MergeFromString(serialized)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1106, in MergeFromString
if self._InternalParse(serialized, 0, length) != length:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 705, in DecodeRepeatedField
if value.add()._InternalParse(buffer, pos, new_pos) != new_pos:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 726, in DecodeField
if value._InternalParse(buffer, pos, new_pos) != new_pos:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 632, in DecodeField
field_dict[key] = buffer[pos:new_pos].tobytes()
MemoryError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "pangu_sampling.py", line 454, in
sample(args)
File "pangu_sampling.py", line 333, in sample
high_timestamp_model, _ = create_model(
File "/wanghuan/pangu_draw_v3/gm/helpers.py", line 160, in create_model
model = load_model_from_config(config.model, checkpoints, amp_level=amp_level)
File "/wanghuan/pangu_draw_v3/gm/helpers.py", line 285, in load_model_from_config
_sd_dict = ms.load_checkpoint(ckpt)
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1087, in load_checkpoint
checkpoint_list = _parse_ckpt_proto(ckpt_file_name, dec_key, dec_mode)
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1262, in _parse_ckpt_proto
raise ValueError(err_info) from e
ValueError: Failed to read the checkpoint file /wanghuan/ckpt/pangu_high_timestamp-c6344411.ckpt. May not have permission to read it, please check the correct of the file.

这是您的ckpt文件：
[root@n1 ckpt]# ll
总用量 27032600
-rwxr-xr-x. 1 root root<PHONE_NUMBER>6 12月 22 10:13 pangu_high_timestamp-c6344411.ckpt
-rwxr-xr-x. 1 root root<PHONE_NUMBER>6 12月 22 10:24 pangu_low_timestamp-127da122.ckpt
这是您运行的脚本：
python pangu_sampling.py
--device_target "Ascend"
--ms_mode 1
--ms_amp_level "O2"
--config "configs/inference/pangu_sd_xl_base.yaml"
--high_solution
--weight "/wanghuan/ckpt/pangu_low_timestamp-c6344411.ckpt"
--high_timestamp_weight "/wanghuan/ckpt/pangu_high_timestamp-127da122.ckpt"
--prompts_file "prompts.txt"
ckpt文件名似乎对不上？您可以检查一下两个ckpt文件是否正确命名和导入

脚本拷贝错误了，后来发现文件名称改错误，已经修改成正确的了，错误提示不太一样
[root@n1 pangu_draw_v3]# ./run_sampling.sh
flash attention is available.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
Initialized embedder #0: FrozenCnCLIPEmbedder with 115972685 params. Trainable: False
Initialized embedder #1: FrozenOpenCLIPEmbedder2 with 694665770 params. Trainable: False
Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False
Loading model from ['/wanghuan/ckpt/pangu_low_timestamp-127da122.ckpt']
[WARNING] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:12.705.028 [mindspore/train/serialization.py:1378] For 'load_param_into_net', 2 parameters in the 'net' are not loaded, because they are not in the 'parameter_dict', please check whether the network structure is consistent when training and loading checkpoint.
[WARNING] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:12.705.204 [mindspore/train/serialization.py:1383] conditioner.embedders.0.transformer.text_model.embeddings.position_ids is not loaded.
[WARNING] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:12.705.276 [mindspore/train/serialization.py:1383] conditioner.embedders.1.model.attn_mask is not loaded.
missing keys:
['conditioner.embedders.0.transformer.text_model.embeddings.position_ids', 'conditioner.embedders.1.model.attn_mask']
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 10 w/ 1280 channels and 20 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
constructing SpatialTransformer of depth 2 w/ 640 channels and 10 heads
Loading model from ['/wanghuan/ckpt/pangu_high_timestamp-c6344411.ckpt']
[ERROR] ME(1377551:281473775790176,MainProcess):2024-01-29-05:38:37.590.458 [mindspore/train/serialization.py:1261] Failed to read the checkpoint file /wanghuan/ckpt/pangu_high_timestamp-c6344411.ckpt. May not have permission to read it, please check the correct of the file.
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1253, in _parse_ckpt_proto
checkpoint_list.ParseFromString(pb_content)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/message.py", line 199, in ParseFromString
return self.MergeFromString(serialized)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1106, in MergeFromString
if self._InternalParse(serialized, 0, length) != length:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 705, in DecodeRepeatedField
if value.add()._InternalParse(buffer, pos, new_pos) != new_pos:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 726, in DecodeField
if value._InternalParse(buffer, pos, new_pos) != new_pos:
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/python_message.py", line 1173, in InternalParse
pos = field_decoder(buffer, new_pos, end, self, field_dict)
File "/usr/local/lib64/python3.8/site-packages/google/protobuf/internal/decoder.py", line 632, in DecodeField
field_dict[key] = buffer[pos:new_pos].tobytes()
MemoryError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "pangu_sampling.py", line 454, in
sample(args)
File "pangu_sampling.py", line 333, in sample
high_timestamp_model, _ = create_model(
File "/wanghuan/pangu_draw_v3/gm/helpers.py", line 160, in create_model
model = load_model_from_config(config.model, checkpoints, amp_level=amp_level)
File "/wanghuan/pangu_draw_v3/gm/helpers.py", line 285, in load_model_from_config
_sd_dict = ms.load_checkpoint(ckpt)
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1087, in load_checkpoint
checkpoint_list = _parse_ckpt_proto(ckpt_file_name, dec_key, dec_mode)
File "/usr/local/lib/python3.8/site-packages/mindspore/train/serialization.py", line 1262, in _parse_ckpt_proto
raise ValueError(err_info) from e
ValueError: Failed to read the checkpoint file /wanghuan/ckpt/pangu_high_timestamp-c6344411.ckpt. May not have permission to read it, please check the correct of the file.

64G的显存正常加载这两个ckpt是没有问题的。您可以试着单独写个脚本 from mindspore import load_checkpoint来load_checkpoint(high_timestamp_model_file.ckpt)看看是否能正常加载ckpt文件

910A是否需要用分布式推理？请问下运行方式是什么？
1、64G的内存。。。昇腾910A，显存32G，仍然内存错误
2、换了一台8卡Atlas800-9000的物理机，模型可以运行起来，报错信息如下：
Sampling with PanGuEulerEDMSampler for 40 steps: 100%|███████████████████████████████████| 40/40 [08:37<00:00, 12.93s/it]
Sample latent Done.
Decode latent Starting...
Traceback (most recent call last):
File "pangu_sampling.py", line 454, in
sample(args)
File "pangu_sampling.py", line 403, in sample
amp_level=args.ms_amp_level,
File "pangu_sampling.py", line 203, in run_txt2img
amp_level=amp_level,
File "/wanghuan/pangu_draw_v3/gm/models/diffusion.py", line 347, in pangu_do_sample
samples_x = self.decode_first_stage(samples_z)
File "/wanghuan/pangu_draw_v3/gm/models/diffusion.py", line 91, in decode_first_stage
out = self.first_stage_model.decode(z)
File "/root/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/common/api.py", line 718, in staging_specialize
out = _MindsporeFunctionExecutor(func, hash_obj, input_signature, process_obj, jit_config)(*args, **kwargs)
File "/root/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/common/api.py", line 121, in wrapper
results = fn(*arg, **kwargs)
File "/root/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/common/api.py", line 356, in call
output = self._graph_executor(tuple(new_inputs), phase)
RuntimeError:

Memory not enough:

Device(id:0) memory isn't enough and alloc failed, kernel name: Default/decoder-Decoder/up-CellList/0-UpCell/block-CellList/0-ResnetBlock/norm1-_OutputTo16/_backbone-GroupNorm/Cast-op52827, alloc size:<PHONE_NUMBER>B.

C++ Call Stack: (For framework developers)

mindspore/ccsrc/runtime/graph_scheduler/graph_scheduler.cc:682 Run

32G显存同时加载high/low_timestamp_model会面临显存问题，可以在推理脚本加入参数--offload

32G显存同时加载high/low_timestamp_model会面临显存问题，可以在推理脚本加入参数--offload

用fp16跑，实际上只用了14G显存


Scollector: Adding MySQL support

This is to add support to gather stats about MySQL. Testing on Windows and Linux.
Updated one html file, and other document files. Not sure what else may need to be done for that.
Welcome feedback

Screenshot of a two node MySQL NDB cluster. These are just a handful stats gather from the basic queries in documents.

I actually like this a lot. It provides a way to convert sql data into relational data. I have a couple of initial thoughts before I even look too close at the code:

I would probably like this to be as database agnostic as possible. If there was a config option for dbType or something that allowed is to target mysql or mssql by changing the string and selecting the appropriate driver that would be pretty cool. Even if we just support mysql initially, that would be nice to have.

I am a bit uncomfortable with the queries being stored in the database themselves. How about just putting a list of queries into the config?

I like the convention-based approach to converting result sets to datapoints, automatically detecting tags and so forth. Can we make it even simpler? Can we autodetect if a timestamp is present in the second column or not? Why is it limited to 5 tags (not that I would ever want to use more, but it seems odd)? That kind of thing. Just like to keep needed config to what we absolutely need for the feature set.

This looks like it could be a really nice addition to bridge the gap between relational data and time series data.

Awesome! :)

My thought was to add other databases after this one. Wanted to at least get something done and working so it could be presented. But now that you brought it up, was thinking as you, how much of the same code could be used? Besides the drivers of course, I don't think 100% of the same code can be used, however, probably most of the same code can be used. Was thinking of having a "base" agnostic database code then have smaller database particular code. Since it might change the current MS database code or etc., defiantly would like your detailed thoughts.

As a side note, wanted to add support for Oracle but that uses C drivers. This would mean additional setup for builds that may me unwanted. Not sure how you felt about that.

Why uncomfortable?

Each query needs to have name, query, description, and queryinterval at least. Maybe hastime as well. That started to be a very large config file depending on how many queries one wants. Plus also having to restart Scollector every time one wants to change them.
Just trying to think of the pros and cons of both. Not sure which place is "better". One of the pros of having the information in the conf file is if someone uses puppet for pushing changes out, that may be easier.

Not sure how one would automatically detect if it was a time stamp? Say that the first tag name can not be a number?

Limited to 5 tags because the default limit of OpenTSDB is 8 tags. The 3 other tags are host, db_name, and inst_id. Technically could remove the limit (remove the error check) and have it error somewhere else if there is an issue. Have not looked at all the code so was not sure what kind of error it would give.
Thank you for all your notes! :)

@captncraig
If you can provide some guidance, happy to recode it so it is more general.

Thought about this more, will move it over to the configuration file.

Could you please move the _third_party addition to a separate commit? (ideally before the new scollector code). Makes review and history diving easier.
I've also updated our contributing guidelines to reflect this.

Shouldn't need to close the PR to split the commits. Just repushing to your branch will update the PR.

@alienth
Sorry, not sure how to split it :/

Created new pull request #1391


fix stars

@yoichinak : Thanks for your contribution! The author, @stevestein, has been notified to review your proposed change.

Merging corrected markdown syntax


Add text view of log

To aid in debugging and compensate for any missing views.

This this functionality should already be offered by the command line client. Is there anything that's missing?

I'm refering to a text conversion of the log contents rather than text view of the collected profile results. I've hacked something together and will send a PR soon.

Ahh. That would make debugging easier and i would appreciate the pr. It
should be easy to implement something that piggybacks onto logparser and
implement logeventlistener.

Fixed by @nitsanw 's PR the other day.


pkgdev manifest: FETCHCOMMAND mishandled

from make.conf (at the bottom of it) , used with https://packages.gentoo.org/packages/app-portage/fetchcommandwrapper
FETCHCOMMANDWRAPPER_OPTIONS="--file-allocation=none --enable-http-pipelining --server-stat-of=/var/cache/distfiles/.server-stat --server-stat-if=/var/cache/distfiles/.server-stat"
FETCHCOMMAND="/usr/bin/fetchcommandwrapper ${FETCHCOMMANDWRAPPER_OPTIONS} \${URI} \${DISTDIR} \${FILE} -- ${FETCHCOMMANDWRAPPER_EXTRA}"
RESUMECOMMAND="/usr/bin/fetchcommandwrapper ${FETCHCOMMANDWRAPPER_OPTIONS} --continue \${URI} \${DISTDIR} \${FILE} -- ${FETCHCOMMANDWRAPPER_EXTRA}"

this is what I get:
pkgdev manifest
ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

 * failed fetching file: OpenJDK8U-jdk_aarch64_linux_hotspot_8u372b07.tar.gz, uri: https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u372-b07/OpenJDK8U-jdk_aarch64_linux_hotspot_8u372b07.tar.gz
 * failed fetching file: OpenJDK8U-jdk_arm_linux_hotspot_8u372b07.tar.gz, uri: https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u372-b07/OpenJDK8U-jdk_arm_linux_hotspot_8u372b07.tar.gz
 * failed fetching file: OpenJDK8U-jdk_ppc64le_linux_hotspot_8u372b07.tar.gz, uri: https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u372-b07/OpenJDK8U-jdk_ppc64le_linux_hotspot_8u372b07.tar.gz
 * failed fetching file: OpenJDK8U-jdk_x64_linux_hotspot_8u372b07.tar.gz, uri: https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u372-b07/OpenJDK8U-jdk_x64_linux_hotspot_8u372b07.tar.gz
 * failed fetching file: OpenJDK8U-jdk_x64_alpine-linux_hotspot_8u372b07.tar.gz, uri: https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u372-b07/OpenJDK8U-jdk_x64_alpine-linux_hotspot_8u372b07.tar.gz
 * failed fetching file: OpenJDK8U-jdk_x64_mac_hotspot_8u372b07.tar.gz, uri: https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u372-b07/OpenJDK8U-jdk_x64_mac_hotspot_8u372b07.tar.gz
 * failed fetching files for package dev-java/openjdk-bin::gentoo
pkgdev manifest: error: failed fetching required distfiles

PORTAGE_BZIP2_COMMAND error is a red herring, I did not change it at all.
commenting out my FETCHCOMMAND/RESUMECOMMAND solves it.
looks like some escapes break make.conf parsing?
possibly related:
https://github.com/pkgcore/pkgdev/issues/94

Well, it is a funny case, I managed to reproduce using this command:
$ PATH="" /usr/bin/fetchcommandwrapper --file-allocation=none --enable-http-pipelining --server-stat-of=/var/cache/distfiles/.server-stat --server-stat-if=/var/cache/distfiles/.server-stat https://github.com/Sigil-Ebook/Sigil/archive/1.9.30.tar.gz /tmp sigil-1.9.30.tar.gz --
ERROR PORTAGE_BZIP2_COMMAND setting is invalid: 'bzip2'
PORTAGE_BZIP2_COMMAND setting from make.globals is invalid: 'bzip2'

(notice I don't have anything after the -- since in your config addition I don't have FETCHCOMMANDWRAPPER_EXTRA defined)
Yes, it is because pkgcore cleans all of the env before calling the fetch command, which also cleans PATH env... lol


⚠ Jenkins Plugins Artifactory has degraded performance

In 434064a, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1317 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 9b73ce6 after 30 minutes.


implement million.js, supposed to makes react go zoom

Concerns with million.js

We use a lot of early returns, need to refactor codebase.
Difficult to observe the memory/perf improvements.
Significantly increase hmr rebuild time (~2.5s to ~15s), https://github.com/aidenybai/million/pull/587 should help with that?


Make sure to sync to upstream before changes

Since the merged commit will have a different hash, we need to make sure
to sync up the local branch before doing any additional changes.
Signed-off-by: Mike Kolesnik<EMAIL_ADDRESS>

The Linting/Shell check failed but it's not required... it seems it should be. There's other jobs that aren't required as well.

The Linting/Shell check failed but it's not required... it seems it should be. There's other jobs that aren't required as well.

I made other jobs required.

The Linting/Shell check failed but it's not required... it seems it should be. There's other jobs that aren't required as well.

Yes I fixed the bogus failure SC2153 and the general failure should be fixed

This seems to be causing an issue, see: https://kubernetes.slack.com/archives/C010RJV694M/p1639077817371400?thread_ts=1639068146.370500&cid=C010RJV694M

This seems to be causing an issue with #280, see: https://kubernetes.slack.com/archives/C010RJV694M/p1639077817371400?thread_ts=1639068146.370500&cid=C010RJV694M

No, the failure there isn’t related to this (see my comment there).


Ui,Ux

We have to design a good user interface for Lexi so users can communicate with it easily

From telegram or Lexi web ?

Tel

Tel

We have to design the bot messages and keyboard contents and arrangements

Yes
But I thinks it won't be simple
Plus it is very important

I agree with you
It is the only interface to communicate with users in this stage and is very important

Ok. So I think we have to have a design
I could be just some simple wireframes to start (like we can use Balsamiq)
As we go , we can have perfect Figma pages ;


add yodo banner ads on menu

its good af

Ah, I just noticed that you can select "game" directly inside of Godot. 👌

its good af

Ah, I just noticed that you can select "game" directly inside of Godot. 👌

i think this only applies in godot 4.0.


856 profile null column

name: '856_profile_null_column'
about:  '856_profile_null_column'
title:  '856_profile_null_column'
assignees: 'sama-ds'
Type of PR

[X] BUG
[ ] FEAT
[ ] MAINT
[ ] DOC

Is your Pull Request linked to an existing Issue or Pull Request?
https://github.com/moj-analytical-services/splink/issues/856
Give a brief description for the solution you have provided
Previously, if a null column was passed to profile columns it would cause an error. This PR checks whether the column is null, and if it is instead returns a warning message to say that the specific graph could not be made and returns the remaining graphs.
PR Checklist

[x] Added documentation for changes
[x] Added feature to example notebooks at tutorials in splink_demos (if appropriate)
[x] Added tests (if appropriate)
[x] Made changes based off the latest version of Splink
[x] Run the linter

Is this ready for review?

@sama-ds it's just the blank chart creation that needs a minor adjustment and then I will approve.


feat: Show category counts/percentages on ValueCounts hover

Great project idea!
This PR adds in some UX seen in the Observable Summary Table, where hovering over values in the ValueCountsPlot displays the corresponding row count/percentage (see demo of PR in action in video below).
Observable Example:
https://github.com/user-attachments/assets/73f44de0-62de-43b2-a06c-966151db08ec
Quak Example (this PR):
https://github.com/user-attachments/assets/8d95cd3d-d5b0-4f7f-b2ef-828d47b171ad
Two small differences here versus Observable:

I format the percentage via d3.format(".1%"), while they appear to use d3.format(".0%").  (A future improvement could use a ternary to check if the percentage is less than 1, if so, format via d3.format(".1%") or .2,, otherwise, d3.format(".0%").

On mouseout, they appear to show the JS data-type, while I show the type provided by the arrow.Field (as that's what was displayed by default in quak).

Note:

This PR also brings in some linting/formatting changes, which occurred after running deno lint + deno fmt.
This PR only affects the Value Counts plots (for categorical data). I can happily add another PR for the histogram as well 😄

Love it! Thanks for the contribution. I'll give a review tomorrow.
re: deno fmt... not sure what's going on there. My guess is that you may have some editor "format on save" setting, which likely uses prettier (creating new line indentation, etc) and and then the deno fmt formats that new-line delimited code with dprint.

sgtm! I just went ahead and reset the committed linting changes.


BooleanInput alters the label colour internally

BooleanInput alters the label colour internally - which is causing issues when used in a dark theme
No suitable way to update the Colour.

Can you update your issue using the Issue template please?

Please do not submit support requests or "How to" questions here. For that, go to StackOverflow.
What you were expecting:
BooleanInput control's Title should show up clearly like other controls when a custom DarkTheme is applied. Or I should be able to set the Label colour
What happened instead:
The label did not render correctly as it got merged with background - See code: https://github.com/marmelab/admin-on-rest/blob/0208d9d32d8ef9165ff9d23dca92f91e0156422f/src/mui/input/BooleanInput.js#L11
Steps to reproduce:

Related code:

insert short code snippets here

Other information:

Environment
Windows 7 OS

Admin-on-rest version: 1.4.0
Last version that did not exhibit the issue (if applicable): NA
React version:
"react": "^16.2.0",
"react-dom": "^16.2.0",
Browser: Chrome Version 64.0.3282.119 (Official Build) (64-bit)
Stack trace (in case of a JS error): NA

It's fixed in next. Must be fixed on master.


Some Ion imagery assets attempt to load from localhost instead of the correct URLs

As identified on the forums, Cesium for Unity (and potentially all cesium-native clients) attempts to load some Ion imagery overlays from the incorrect URLs. For example, for asset 2411391, the request to the Ion endpoint gives:
{
    "type": "IMAGERY",
    "externalType": "BING",
    "options": {
        "url": "//dev.virtualearth.net",
        "mapLayer": "Foreground",
        "mapStyle": "AerialWithLabelsOnDemand",
        "key": "<key removed>"
    },
    "attributions": [...]
}

Based on this information, Cesium for Unity should calculate the URL https://dev.virtualearth.net/REST/v1/Imagery/Metadata/AerialWithLabelsOnDemand?incl=ImageryProviders&key=<key removed>&uriScheme=https, as CesiumJS does. Instead it tries to make a request for the URL http://localhost/REST/v1/Imagery/Metadata/AerialWithLabelsOnDemand?incl=ImageryProviders&key=<key removed>&uriScheme=https, which obviously fails.

@azrogers is this fixed as of https://github.com/CesiumGS/cesium-native/pull/864?


Avoid error on order create when listPrice rule is empty

1. Why is this change necessary?
INFO: This is a pickup from https://github.com/shopware/platform/pull/2654 - since it was closed I reopend it. Hope this is okay this way
to prevent a WriteException when persisting an order with a promotion using the LineItemListPriceRule with the empty-operator.
2. What does this change do, exactly?
I added a missing Constraint for the "amount" field
3. Describe each step to reproduce the issue or behaviour.
create a new promotion (no promotion code to apply automatically)
add a new discount, only applied to certain products => rule "Item with liste price => at least one => is empty"
apply to all items
percentage => 10
=> the goal is to create a promotion that automatically applies to all non-discounted products
go to checkout and order a non discounted product (make sure the promotion applies)
the order cannot be saved => an error is thrown (WriteException)

Please link to the relevant issues (if any).

5. Checklist

[x] I have rebased my changes to remove merge conflicts
[x] I have written tests and verified that they fail without my change
[x] I have created a changelog file with all necessary information about my changes
[ ] I have written or adjusted the documentation according to my changes
[ ] This change has comments for package types, values, functions, and non-obvious lines of code
[x] I have read the contribution requirements and fulfil them.

Not sure why I get a platform error
https://github.com/shopware/platform/actions/runs/3226419147/jobs/5279911272#step:5:108

Hey, first of all, thanks for taking the time and effort to help solve this issue. This turned out to be a general issue with conditions allowing the empty operator. We'll fix the more deeply rooted cause of this issue. Unfortunately that means we're going to have to close your MR. Still your contribution is very much appreciated, as it brought attention to this issue and helped identifying the cause.

@dneustadt  thanks for the update. No worries, I was just adding a test regarding that ticket anyways -> https://github.com/shopware/platform/pull/2654
Could you maybe link the issue so we can keep track on it ?
@supus  fyi

Sure. https://issues.shopware.com/issues/NEXT-23652

@Isengo1989 sorry for the late reply. thank you so much for adding a test and tagging me 🙏


python-control  0.9.1 fails in test_nyquist_indent on aarch64

python-control  0.9.1 fails in test_nyquist_indent on aarch64:
[  132s] =================================== FAILURES ===================================
[  132s] _____________________________ test_nyquist_indent ______________________________
[  132s]
[  132s]     def test_nyquist_indent():
[  132s]         # FBS Figure 10.10
[  132s]         s = ct.tf('s')
[  132s]         sys = 3 * (s+6)**2 / (s * (s+1)**2)
[  132s]         # poles: [-1, -1, 0]
[  132s]
[  132s]         plt.figure();
[  132s]         count = ct.nyquist_plot(sys)
[  132s]         plt.title("Pole at origin; indent_radius=default")
[  132s]         assert _Z(sys) == count + _P(sys)
[  132s]
[  132s]         # first value of default omega vector was 0.1, replaced by 0. for contour
[  132s]         # indent_radius is larger than 0.1 -> no extra quater circle around origin
[  132s]         count, contour = ct.nyquist_plot(sys, plot=False, indent_radius=.1007,
[  132s]                                          return_contour=True)
[  132s]         np.testing.assert_allclose(contour[0], .1007+0.j)
[  132s]         # second value of omega_vector is larger than indent_radius: not indented
[  132s] >       assert np.all(contour.real[2:] == 0.)
[  132s] E       AssertionError: assert False
[  132s] E        +  where False = <function all at 0xffff92ec1d30>(array([0.1001..., 0.        ]) == 0.0
[  132s] E        +    where <function all at 0xffff92ec1d30> = np.all
[  132s] E           +array([0.1001835 , 0.10017386, 0.10016404, 0.10015404, 0.10014385,\n
[  132s] E           +       0.10013347, 0.1001229 , 0.10011213, 0.10010116, 0.10008998,\n
[  132s] E           +       0.10007859, 0.10006699, 0.10005517, 0.10004313, 0.10003086,\n
[  132s] E           +       0.10001837, 0.10000564, 0.09999267, 0.09997946, 0.099966  ,\n
[  132s] E           +       0.09995229, 0.09993832, 0.09992409, 0.0999096 , 0.09989483,\n
[  132s] E           +       0.09987978, 0.09986445, 0.09984884, 0.09983293, 0.09981672,\n
[  132s] E           +       0.09980021, 0.09978339, 0.09976625, 0.09974879, 0.099731  ,\n...
[  132s] E
[  132s] E           ...Full output truncated (195 lines hidden), use '-vv' to show)
[  132s]
[  132s] control/tests/nyquist_test.py:202: AssertionError

I think this is similar to https://github.com/python-control/Slycot/issues/156: There is a BLAS/LAPACK problem of aarch64 in openSUSE.

I was wrong. This test fails because it assumes that the default frequency vector calculation uses the poles at -1 to determine the logspace to start at 0.1. But some architectures return the floating point values of the poles as slightly closer to 0 and then the logspace starts one decade lower.


fix: add method to check presence of the embed.js script before adding it

Proposed fix for #4

@tboeckmann thank you!

plz send me code ...


build<EMAIL_ADDRESS>cannot find module for path<EMAIL_ADDRESS>

For go get "github.com/hegedustibor/htgo-tts" command, facing the following issue
go: finding github.com/hegedustibor/htgo-tts latest
build<EMAIL_ADDRESS>cannot find module for path<EMAIL_ADDRESS>

I pushed a fix commit. Please, try again. Thanks for sent this issue.


Update HTTP Status Code for User Verify required to be 403 instead of 401

401 is for authentication, 403 is for authorization. User Verification is about authorization, not authentication.
Also change the error name to be '403_verify_user'
See the error code description in the API documentation for more detail on how to name errors.

We agreed to keep this 401, but did change the string to 401_verify_user.


What is the goal of IngroupIndicesFunction?

As I can see, IngroupIndicesFunction from sst_ops.py is a random number generator. Why do you use it? I can imagine, that RNG can be useful for training, but you use it in the inference code...
I replaced
if len(torch.unique(batch_idx[fg_mask])) < batch_size:
    one_random_pos_per_sample = self.get_sample_beg_position(batch_idx, fg_mask)
    fg_mask[one_random_pos_per_sample] = True # at least one point per sample

to
if len(torch.unique(batch_idx[fg_mask])) < batch_size:
    one_random_pos_per_sample = 0
    fg_mask[one_random_pos_per_sample] = True # at least one point per sample

and inference results (FSDv2 with Argo2 config) seems to be identical (batch index is always 0 in my case).

It is designed to create a fake foreground point at the start position of each sample. So, if the inference batch_size is 1, they are the same.

作者大大您好，关于IngroupIndicesFunction这个方法，我没有太看懂。看结果似乎是生成0-35的长数组。想问下为什么会生成0-35呢，是哪块代码控制的呢？非常感谢！


Adds gitignore for dotnet

Any reason launchSettings.json is not included?
https://github.com/Azure/AppConfiguration/blob/main/.gitignore#L58C1-L64C40

Any reason launchSettings.json is not included?
https://github.com/Azure/AppConfiguration/blob/main/.gitignore#L58C1-L64C40

@rossgrambo @mrm9084 can we copy the gitignore from the AppConfiguration repo?

@zhenlan It was intentionally not added. launchSettings.json is no longer recommended to be ignored. It used to be but was removed from the recommended gitignore in github's PR. Apparently there's reasons why it should be checked in. Secrets should be done with the SecretManager instead.

This settings will be useful if shared among project member

We don't have any scenarios that need shared launch settings, but it is repeatedly causing leaked secrets. We force devs to remove it from PRs manually. We can add it when we have a need.


logging is not working as expected

I am not sure why are we redirecting process output to the log file in 'start()' function inside 'jmxtrans.sh' script.
I see output always going to stdout (even when I commented it out). If I am using StdoutWriter, I would like to separate jmxtrans logs from query results

StdoutWriter is probably not the best OutputWriter for a production setup. It is quite useful for testing purpose. I suggest you have a look at the Log4JWriter to route metrics to a specific file. We might want to implement a dedicated FileOutputWriter ...
While JmxTrans logs should go to a file (you can tune logging configuration for your specific needs) there are some cases where you will still get garbage on stdout (the first being error in the setup of the logging framework).
Does that make sense for you ?

I am using StdoutWriter for testing only. What I am wondering about is if
log file is already specified in log4j.xml then why is there a need to
redirect output of java process. If I remove the redirect I don't see
output being written to the file specified in log4j. Also, changing
LOG_LEVEL to info etc has no effect.
On Tue, Feb 3, 2015 at 5:26 PM, Guillaume Lederrey<EMAIL_ADDRESS>
wrote:

StdoutWriter is probably not the best OutputWriter for a production setup.
It is quite useful for testing purpose. I suggest you have a look at the
Log4JWriter
https://github.com/jmxtrans/jmxtrans/blob/master/src/com/googlecode/jmxtrans/model/output/Log4JWriter.java
to route metrics to a specific file. We might want to implement a dedicated
FileOutputWriter ...
While JmxTrans logs should go to a file (you can tune logging
configuration for your specific needs) there are some cases where you will
still get garbage on stdout (the first being error in the setup of the
logging framework).
Does that make sense for you ?
—
Reply to this email directly or view it on GitHub
https://github.com/jmxtrans/jmxtrans/issues/221#issuecomment-72749224.

Redirecting output when starting a service is a good practice. If you dont and there is some output (which will happen in some error cases) you'll loose that output.
Note that there might well be some problems in the current log4j configuration. #215 has been opened about similar problems. Some cleanup is required ...
If you have some free time, a pull request is always welcomed !

I did some digging and looks like as we have added logback to our dependencies, it now expects logback.xml instead of log4j.xml (I am not sure if there is a way to make log4j.xml to work with current library dependencies).
Even if it is possible to do so, we should either 'add classpath attribute to the manifest and explicitly add log4j.xml to the classpath or move log4j.xml outside the jar and add -Dlog4j.configuration=<path_to_log4j.xml> to VM arguments.
I will submit a patch for logback, however, I think most of us would hate to move to logback

As discussed in #215, the preferred solution would be to move everything we can to slf4j and make the choice of logback vs log4j as late as possible. But just having a correctly working logging system, whatever the solution, is of course a good first step anyway.

Agree the slf4j aproach with log4j as the target I this most robust approach and is what is used in many other large open source tools

@stevenbower
I looked through the details and found logback and work with slf4j just fine. More details available at http://logback.qos.ch/reasonsToSwitch.html

SLF4J work well both with logback and with log4j (they are all written by Ceki Gülcü so that's not much of a surprise). As our users are used to configure log4j.xml for jmxtrans logging, it make sense to use SLF4J with a log4j runtime. using SLF4J for internal logging will allow to switch easily to another backend at some point if we need to. Ceki has been pushing to deprecate log4j for quite some time ... but we're probably not ready to do that for this project.

Also will allow jmxtrans to be more easily embedded in other software
On Thursday, February 5, 2015, Guillaume Lederrey<EMAIL_ADDRESS>wrote:

SLF4J work well both with logback and with log4j (they are all written by
Ceki Gülcü so that's not much of a surprise). As our users are used to
configure log4j.xml for jmxtrans logging, it make sense to use SLF4J with a
log4j runtime. using SLF4J for internal logging will allow to switch easily
to another backend at some point if we need to. Ceki has been pushing to
deprecate log4j for quite some time ... but we're probably not ready to do
that for this project.
—
Reply to this email directly or view it on GitHub
https://github.com/jmxtrans/jmxtrans/issues/221#issuecomment-73116983.

In term of embedding, that's the role of embedded-jmxtrans, jmxtrans-agent and jmxtrans2. And there, the approach is even more radical : no dependency on any logging framework. Not even java.util.logging.

can this be closed now that logging is fixed

Thanks!


Geckolib is crashing without it even installed [1.18.2] [Fabric]

Pastebin: https://pastebin.com/Ht6dd0Te

Not sure what you are trying to report


QG 4 checks (Release 3.2)

QG checks
Please keep this issue open until QG 4 is concluded and will be managed by the Issue Creator!
We will inform you about finding and proposals in separated issues, this issue here is for the Overview of the Checks!
Please keep this issue open until QG 4 is concluded!
Product Name: Portal Frontend
Product Owner: @jjeroch
Dev SPOC: @evegufy
Helm Chart Version:
App Version:
QG5 Approval: yes/no
Check of Tractus-X Release Guidelines
This QG 4 Check is depending on the mandatory information from our current Release Guidelines.
TRG 1 Documentation

[x] TRG 1.01 appropriate README.md
[ ] TRG 1.02 appropriate INSTALL.md
[x] TRG 1.03 appropriate CHANGELOG.md

TRG 2 Git

[x] TRG 2.01 default branch is named main

[x] TRG 2.03 repository structure

Checks within TRG 2.03

[ ] TRG 2.03 /docs directory contains detailed product related documentation for the Tractus-X product
[ ] TRG 2.03 /charts directory contains the Helm chart for the Tractus-X product IF available
[ ] TRG 2.03 AUTHORS.md file (optional) (TRG 2.03)
[x] TRG 2.03 CODE_OF_CONDUCT.md file (TRG 2.03)
[x] TRG 2.03 CONTRIBUTING.md file (TRG 2.03)
[x] TRG 2.03 DEPENDENCIES file(s) with up to date content (Dash tool generated) (TRG 2.03)
[x] TRG 2.03 LICENSE file (TRG 2.03)
[x] TRG 2.03 NOTICE.md file (TRG 2.03)
[x] TRG 2.03 SECURITY.md file (TRG 2.03)

[x] TRG 2.04 Leading product repository

Checks within TRG 2.04

[x] TRG 2.04 repository name must be productname without prefix or suffix
[x] TRG 2.04 should contain the release
[x] TRG 2.04 references/urls to the product's other repositories
[x] TRG 2.04 might contain product helm chart(s)
[x] TRG 2.04 README.md: contains the urls for the underlying applications

[x] TRG 2.05 .tractusx metafile in a proper format

TRG 3 Kubernetes

[ ] TRG 3.02 PersistentVolume and PersistentVolumeClaim is used when needed

TRG 4 Container

[x] TRG 4.01 semantic versioning and tagging

[x] TRG 4.02 top level README.md file, that contains information about the used base image

[x] TRG 4.03 Image has USER command and Non Root Container

Checks within TRG 4.03

[x] TRG 4.03 deployment.yaml has runAsUser and allowPrivilegeEscalation: false properly set

[x] TRG 4.05 released image must be place DockerHub as mandatory container registry; remove GHCR references

[x] TRG 4.06 Notice File for DockerHub has all necessary information

Checks within TRG 4.06

[x] TRG 4.06 Link to the source of your base image (Container registry and GitHub if available)
[x] TRG 4.06 Link to your product image on DockerHub
[x] TRG 4.06 Link to your repository on GitHub
[x] TRG 4.06 Direct link to the Dockerfile used to build your image
[x] TRG 4.06 Link to LICENCE file in your repo as Project License (make clear, that this is the PROJECT licence, not an image license

TRG 5 Helm

[ ] TRG 5.01 Helm chart must be released

Checks within TRG 5.01

[ ] TRG 5.01 appropriate semantic versioning for version and appVersion has to be used in Chart.yaml
[ ] TRG 5.01 must not contain any environment specific values-xyz.yaml
[ ] TRG 5.01 values.yaml file must contain proper default values/placeholders
[ ] TRG 5.01 No hostname provided for ingress
[ ] TRG 5.01 Ingress is disabled
[ ] TRG 5.01 No references to any secret engine service (e.g.: Hashicorp Vault)
[ ] TRG 5.01 Dependencies should be prefixed with the nameOverride and/or fullnameOverride properties
[ ] TRG 5.01 Image tag is set to the Chart.yaml appVersion property
[ ] TRG 5.01 must be deployable to any environment without overwriting default values with a simple helm install command
[ ] TRG 5.01 dependencies have to be declared in Chart.yaml NOT requirements.yml

[ ] TRG 5.02 Helm chart location in /charts directory and correct structure

Checks within TRG 5.02

[ ] TRG 5.02 each file must contain the Apache 2.0 Licence
[ ] TRG 5.02 latest tag is not used in helm chart be default

charts/
    chartNameA/
      Chart.yaml
      ...
    chartNameB/
      Chart.yaml
      ...
AUTHORS.md
DEPENDENCIES.md
LICENCE
README.md

[ ] TRG 5.04 CPU and memory limits and requests are properly set

[ ] TRG 5.06 application must be configurable through the Helm chart

[ ] TRG 5.07 dependencies are present in the Chart.yaml they are properly configured

[ ] TRG 5.08 a product has a single deployable helm chart that contains all components

Checks within TRG 5.08

[ ] TRG 5.08 name of the Chart should be just the product-name without prefix or suffix
[ ] TRG 5.08 values file should contain all available variables (even from subcharts) with default values and comments about what they do
[ ] TRG 5.08 helm install command should successfully install the chart to any supported Kubernetes version cluster (without overwriting default values)
[ ] TRG 5.08 helm test runs without errors

[ ] TRG 5.09 Helm Test running properly

Checks within TRG 5.09

[ ] TRG 5.09 A GitHub action exist which builds or uses the helm chart which gets released
[ ] TRG 5.09 The GitHub action can be triggered manually through Github WebUI manually running a workflow
[ ] TRG 5.09 Helm test verifies that the application is up and running

[ ] TRG 5.10 Products need to support 3 versions at a time

Checks within TRG 5.10

[ ] TRG 5.10 latest (K8s version 1.25)
[ ] TRG 5.10 latest - 1 (K8s version 1.24)
[ ] TRG 5.10 latest - 2  (K8s version 1.23)

[ ] TRG 5.11 Upgradeability PRERELEASE

Checks within TRG 5.11

[ ] TRG 5.11 Based on the Helm test workflow, you must provide a GitHub action which takes the latest released helm chart, does an installation of it and then execute the upgrade to the current / new version.

TRG 6 Released Helm Chart

[ ] TRG 6.01 Released Helm Chart

TRG 7 Open Source Governance

[x] TRG 7.01 Legal Documentation

[x] TRG 7.02 License and copyright header

[x] TRG 7.03 IP checks for project content

[x] TRG 7.04 IP checks for 3rd party content

Checks within TRG 7.04

[x] TRG 7.04 DEPENDENCIES file is up-to-date and reflects the current use of the 3rd party content
[x] TRG 7.04 all libraries listed there should have the status "approved"
[x] TRG 7.04 no libraries with status "rejected"
[x] TRG 7.04 for libraries with status "restricted", the according IP issues must be present (issue number in the source column)

[x] TRG 7.05 Legal information for distributions

[x] TRG 7.06 Legal information for end user content

[x] TRG 7.07 Legal notice for documentation

Hints
Information Sharing

Hi @evegufy,
This issue is for portal frontend, please confirm on below:
Product Owner: @jjeroch
Dev SPOC: @evegufy
and provide following:
Helm Chart Version:
App Version:

Certain files missing copyright headers, created issue: https://github.com/eclipse-tractusx/portal-frontend/issues/218

Hey @evegufy, since it seems like a frontend component, can you please confirm you follow TRG 7.06 Legal information for end user content ?

Hey @evegufy, since it seems like a frontend component, can you please confirm you follow TRG 7.06 Legal information for end user content ?

Hi @tomaszbarwicki yes, I can confirm that, our team actually provided the preference implementation for this TRG:
https://github.com/eclipse-tractusx/eclipse-tractusx.github.io/pull/256
This also applies to portal-frontend-registration and portal-assets (also containing frontend components).
https://github.com/eclipse-tractusx/portal-frontend/pull/40
https://github.com/eclipse-tractusx/portal-frontend/pull/38
https://github.com/eclipse-tractusx/portal-frontend-registration/pull/22
https://github.com/eclipse-tractusx/portal-frontend-registration/pull/24
https://github.com/eclipse-tractusx/portal-assets/pull/26
https://github.com/eclipse-tractusx/portal-assets/pull/32

Portal-frontend repository is part of Portal product with portal-cd as leading repository which keeps main helm chart installing all required components hence skipping TRG 5.x & TRG 6.x for this specific repo.

Since https://github.com/eclipse-tractusx/portal-frontend/issues/218 is closed, considering QG4 for this component as completed.

Hi @tomaszbarwicki regarding final RC version for QG4:
Helm Chart Version: 1.6.0-RC8
App Version: 1.6.0-RC8


Add a tool to ask for a regression range when the bug has a STR

Coverage decreased (-0.3%) to 27.962% when pulling 9c662811f5b5d07ff084da31cb2a3e19b1ebaad8 on calixteman:improve_has_reg into 9cd84099ce478372e7a078669195ea75a1934021 on mozilla:master.

@calixteman did you review the results?

The results are not so bad...
BUT in working on bugs with STR and no has_str, I discover that few bugs are not really regression.
Few examples:
https://bugzilla.mozilla.org/show_bug.cgi?id=1532002
https://bugzilla.mozilla.org/show_bug.cgi?id=1531745
So in this case ask for regression-window-wanted is pretty meaningless.

We could restrict this to bugs that are regressions (using the regression keyword, maybe after the regression script runs so we have more regressions labeled)


Lexical error

I believe the last bullet point - "Prepare and transformation data in the source" - should be "Prepare and transform data in the source".

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: deda0833-832f-1984-4ca3-1b59b93bfc58
Version Independent ID: 78c23031-0096-8c95-e693-73c2ccbbc70d
Content: Query folding guidance in Power BI Desktop - Power BI
Content Source: powerbi-docs/guidance/power-query-folding.md
Service: powerbi
Sub-service: powerbi-resource
GitHub Login: @davidiseminger
Microsoft Alias: davidi

Thanks for your comment, @mtsanaissi. This issue has been assigned to the doc author for review.

Good catch! I've updated that error, thanks.


ERESOLVE unable to resolve dependency tree while running npm run packages

Describe the bug
I am trying to install deep locally and following the instruction from README, however, the npm run packages step fails
Expected Behavior
Successful initialization of submodules
Current Behavior
Error
[0] packages/npm-packager npm ci
[0] npm ERR! code ERESOLVE
[0] npm ERR! ERESOLVE unable to resolve dependency tree
[0] npm ERR!
[0] npm ERR! While resolving<EMAIL_ADDRESS>npm ERR! Found<EMAIL_ADDRESS>[0] npm ERR! node_modules/@deep-foundation/deeplinks
[0] npm ERR<EMAIL_ADDRESS>from the root project
[0] npm ERR!
[0] npm ERR! Could not resolve dependency:
npm ERR! peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>[0] npm ERR! node_modules/@deep-foundation/npm-automation
[0] npm ERR!   dev<EMAIL_ADDRESS>from the root project
[0] npm ERR!
[0] npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force, or --legacy-peer-deps
[0] npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
[0] npm ERR!
[0] npm ERR! See /home/denis/.npm/eresolve-report.txt for a full report.
[0]
[0] npm ERR! A complete log of this run can be found in:
[0] npm ERR!     /home/denis/.npm/_logs/2023-09-25T17_50_07_161Z-debug.log
[0] echo "packages/hasura npm ci" && cd /home/denis/dev/packages/hasura && npm ci && cd ../.. && echo "packages/deeplinks npm ci" && cd /home/denis/dev/packages/deeplinks && npm ci && cd ../.. && echo "packages/deepcase npm ci" && cd /home/denis/dev/packages/deepcase && npm ci && cd ../.. && echo "packages/deepcase-app npm ci" && cd /home/denis/dev/packages/deepcase-app && npm ci && cd ../.. && echo "packages/sdk npm ci" && cd /home/denis/dev/packages/sdk && npm ci && cd ../.. && echo "packages/gh-pages npm ci" && cd /home/denis/dev/packages/gh-pages && npm ci && cd ../.. && echo "packages/materialized-path npm ci" && cd /home/denis/dev/packages/materialized-path && npm ci && cd ../.. && echo "packages/store npm ci" && cd /home/denis/dev/packages/store && npm ci && cd ../.. && echo "packages/react-hasura npm ci" && cd /home/denis/dev/packages/react-hasura && npm ci && cd ../.. && echo "packages/js-docker-isolation-provider npm ci" && cd /home/denis/dev/packages/js-docker-isolation-provider && npm ci && cd ../.. && echo "packages/python-docker-isolation-provider npm ci" && cd /home/denis/dev/packages/python-docker-isolation-provider && npm ci && cd ../.. && echo "packages/workflows npm ci" && cd /home/denis/dev/packages/workflows && npm ci && cd ../.. && echo "packages/npm-packager npm ci" && cd /home/denis/dev/packages/npm-packager && npm ci && cd ../.. && echo "packages/deep-memo-app npm ci" && cd /home/denis/dev/packages/deep-memo-app && npm ci && cd ../.. && echo "packages/deep-memo npm ci" && cd /home/denis/dev/packages/deep-memo && npm ci exited with code 1
[21:50:07] 'packages:ci' errored after 5.52 min
[21:50:07] Error: [object Object]
    at formatError (/home/denis/dev/node_modules/gulp-cli/lib/versioned/^4.0.0/format-error.js:21:10)
    at Gulp.<anonymous> (/home/denis/dev/node_modules/gulp-cli/lib/versioned/^4.0.0/log/events.js:33:15)
    at Gulp.emit (node:events:529:35)
    at Gulp.emit (node:domain:489:12)
    at Object.error (/home/denis/dev/node_modules/undertaker/lib/helpers/createExtensions.js:61:10)
    at handler (/home/denis/dev/node_modules/now-and-later/lib/map.js:50:14)
    at f (/home/denis/dev/node_modules/once/once.js:25:25)
    at f (/home/denis/dev/node_modules/once/once.js:25:25)
    at tryCatch (/home/denis/dev/node_modules/async-done/index.js:24:15)
    at done (/home/denis/dev/node_modules/async-done/index.js:40:12)

Steps to reproduce
Check out commit 495b0556d4180504a6c980ba5bebb0d001630d4d of this repo (npm-packager submodule commit: 7f45ce339677274d589b58ab91893e66fcd3a8fb)
Run npm ci
Run npm run packages
Environment
## System:
 - OS: Linux 6.2 Ubuntu 22.04.3 LTS 22.04.3 LTS (Jammy Jellyfish)
 - CPU: (4) x64 Intel(R) Core(TM) i7-10610U CPU @ 1.80GHz
 - Memory: 5.56 GB / 7.75 GB
 - Container: Yes
 - Shell: 5.1.16 - /bin/bash
## npmPackages:
 - @deep-foundation/hasura: ^0.0.51 => 0.0.51
 - @types/gulp: ^4.0.8 => 4.0.14
 - commander: ^11.0.0 => 11.0.0
 - concurrently: ^5.3.0 => 5.3.0
 - cross-env: ^7.0.3 => 7.0.3
 - del: ^6.0.0 => 6.1.1
 - dequal: ^2.0.3 => 2.0.3
 - gulp: ^4.0.2 => 4.0.2
 - gulp-run-command: ^0.0.10 => 0.0.10
 - i: ^0.3.6 => 0.3.7
 - minimist: ^1.2.5 => 1.2.8
 - npm: ^7.5.4 => 7.24.2
 - prompt: ^1.2.0 => 1.3.0
 - rimraf: ^3.0.2 => 3.0.2
 - simple-git: ^2.45.0 => 2.48.0
 - subscriptions-transport-ws: ^0.11.0 => 0.11.0
 - ts-node: ^10.9.1 => 10.9.1
 - typescript: ^4.9.5 => 4.9.5

Fixed by https://github.com/deep-foundation/npm-packager/commit/a9dbe93fd049b1019fa05211e5078f82c20de9ce


Compilation fails on macOS High Sierra: "TypeError: The argument 'path' must be a string or Uint8Array without null bytes."

The latest builds of the release/2.2 release/2.1 branch fail on our macOS High Sierra agents.
[04:27:22]  SignalR               |   /Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/signalr-protocol-msgpack/dist/cjs/browser-index.js → ./dist/browser/signalr-protocol-msgpack.js...
[04:27:22]  SignalR               |   [!] TypeError [ERR_INVALID_ARG_VALUE]: The argument 'path' must be a string or Uint8Array without null bytes. Received '/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/signalr-protocol-msgpack/\u0000commonjs-e...
[04:27:22]  SignalR               |   TypeError [ERR_INVALID_ARG_VALUE]: The argument 'path' must be a string or Uint8Array without null bytes. Received '/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/signalr-protocol-msgpack/\u0000commonjs-e...
[04:27:22]  SignalR               |       at Object.stat (fs.js:794:3)
[04:27:22]  SignalR               |       at isFile (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:22:12)
[04:27:22]  SignalR               |       at loadpkg (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:118:9)
[04:27:22]  SignalR               |       at load (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:85:18)
[04:27:22]  SignalR               |       at loadAsFile (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:77:9)
[04:27:22]  SignalR               |       at processDirs (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:186:9)
[04:27:22]  SignalR               |       at loadNodeModules (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:201:9)
[04:27:22]  SignalR               |       at resolve (/Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/resolve/lib/async.js:43:12)
[04:27:22]  SignalR               |       at /Users/aspnetci/Documents/buildAgent/work/33bdfc1cae7b2a38/modules/SignalR/clients/ts/node_modules/rollup-plugin-node-resolve/dist/rollup-plugin-node-resolve.cjs.js:76:5
[04:27:22]  SignalR               |       at new Promise (<anonymous>)

http://aspnetci/viewLog.html?tab=buildLog&logTab=tree&filter=debug&expand=all&buildId=512264&_focus=8074

Sounds like a node version mismatch. What version of Node is running on the High Sierra agent?

10.5

It's just release/2.1. I was looking at the wrong thing when I filed the issue. I think @BrennanConroy's PR #2641 was supposed to address this.

Indeed it is.

I'll put this in 2.1.4 and we can resolve it with #2641

@Eilon for 2.1.4 consideration

there isn't a great way to be sure that it works the exact same across all scenarios.

To be clear, we do use the WebPack output when running our Functional Tests. So our Functional Tests currently pass with the new output JavaScript produced by WebPack. So while there's no reasonable way to confirm that the code is identical (because WebPack inserts different boilerplate and rewrites some things a little differently), our Functional Tests do give us some coverage on this new build.

Sorry for the delay, this is approved for 2.1.4, but let's not shipped the changed package (unless we end up doing a functional fix) because we're only doing this to fix the build.

FYI, we may want to consider #2692 for 2.1.4 which would result in shipping the package. Not directly relevant to this, but I just want to make it clear there's a possibility we'll be shipping this in 2.1.4 if that's approved.

Merged, should be fixed


Pagination does not work with signed requests

When enforcing signed requests, the sig param is included in the query string.  When using API that uses Pagination, the nextUrl contains the query params from the original call (as well as appropriate next_max_id param).
The current logic doesn't properly strip the old query string from the endpoint before signing, resulting in 403 failures when requesting the first paginated page.
The fix is to strip the query string from the nextUrl & pass that as the param map.  An additional step is to remove the old sig param from that map else it will get signed too, also leading to 403 failures.
Fix is implemented in #165

Will push a release to Maven Central on the weekend. Let me know if there are more bugs in the library.

@sachin-handiekar great thanks! There is a separate PR for handling special chars see #168

@sachin-handiekar It looks like this issue was fixed (#165, #167) and released. Can this be closed?


.nirc globalAgent flag doesn't seem to work.

I have a .nirc file in the same directory as my package.json, but the globalAgent is ignored when installing global packages, and is using npm instead of pnpm.
Here is the contents of my .nirc file:
defaultAgent=pnpm
globalAgent=pnpm

.nirc has to be under your home directory ~/.nirc

PowerShell 7 已删除别名 运行ni命令 还是出现异常报错

Is it possible to read from the NPM package so we could commit to GIT.
Was trying to make it as easy as possible for the whole team to switch to PNPM.

Is it possible to read from the NPM package so we could commit to GIT?

We could have a ni field in package.json.

I assumed/hoped that nt would run npm test. Is there any reason you couldn't add that shortcut?

You can set your local alias. See https://github.com/antfu/dotfiles/blob/main/.zshrc#L23-L37


Run tests using a simpler image

Currently, we run the tests using the following image:
https://github.com/canonical/charmed-kubeflow-uats/blob/53e0389f070a7d26e97e9eb81473693e526275dd/driver/test_kubeflow_workloads.py#L20
The above is the default image used when creating a Jupyter Notebook on Kubeflow, and it was used to ensure the most straightforward path between testing/developing the example notebooks from inside a Notebook server to actually running these as part of the UATs.
This image, however, comes with many packages installed, most of which aren't of any use when it comes to running the UATs. At the same time, it can tie the UATs indirectly to a specific Kubeflow version.
Goal
Although the above are not critical, it's worth investigating the use of a leaner image, where we manually install only the necessary dependencies.

Closing and reopening to trigger Jira automation.


Add VcPkg support.

Closes #526
Closes #172
Closes #575

Earlier, with the Storage Team, we had a conversation about producing dynamic vs static libs.
I was able to build the package in all these official triplets:

x64-windows (DLL, dynamic runtime)
x64-windows-static (static lib, static runtime)
x86-windows (DLL, dynamic runtime)

And these community triplets:

x86-windows-static (static lib, static runtime)
x86-windows-static-md (static lib, dynamic runtime)
x64-windows-static-md (static lib, dynamic runtime)

I can see that DLLs are produced in the corresponding configurations (/bin directory inside the package directory + corresponding lib files in the /lib directory). We probably need to do a bit more verifications, but so far it looks like we are where we wanted to be - we don't dictate which type of lib to produce, we can be built into both.
So then, the question comes to updating the docs and CI/CD build matrix.


Testing improvements and new replace_on_push parameter

DbtDepsOperator could have unintended side-effects if it were to
modify files outside of the packages directory. For this reason, we
added a new test, and extended existing tests to ensure no files are
changed in a dbt project outside of the dbt packages directory.
This should provide more guarantees about the behavior of the
operator, especially when looking to push back files to S3.
Moreover, this PR introduces a new parameter: replace_on_push.
Setting it to False will skip any S3 uploads when a key
already exists. This is useful to guarantee no unexpected files are
changed.
I'm still not super convinced about the solution as ideally
we would like partial replacing; only replacing changed files would be
ideal. This is hard to do with compressed projects, as it would
require downloading and uncompressing the project first. This has
been left for future work.

Closes #30


fix: sync effect by default

I thought it would be neat to fallback to async effect like Valtio's subscribe does.
But, it's actually confusing and not like other reactive libraries.
This makes it sync by default.

Published: https://www.npmjs.com/package/valtio-reactive/v/0.1.1
@transitive-bullshit


allow specifying a script to run in lieu of an entry point

If you build a simple flask app but don't want to go through the ceremony of defining a setup.py and the like, you should be able to just do 'pex -r flask_requirements.txt --entry_script=my_flask.py -o my_flask.pex' rather than have to keep the two separate.

sure, I see no reason why it couldn't be used to support that use-case.
I've been thinking for a while it'd be useful, as an example of how to use pex as a library, to write a small application that takes a .tar.gz or requirement and spits out pex files for each of its entry_points and scripts that you could then take and drop in ~/local/bin or what have you.

On Apr 05, 2015, at 10:51 AM, brian wickman wrote:

I've been thinking for a while it'd be useful, as an example of how to use
pex as a library, to write a small application that takes a .tar.gz or
requirement and spits out pex files for each of its entry_points and scripts
that you could then take and drop in ~/local/bin or what have you.

That would be pretty awesome :)

https://rbcommons.com/s/twitter/r/2074/

I see this issue is closed but when I try to do exactly what is described here pex fails:
⌂ ↬  pex -r requirements.txt --script git-branches.py -o git-branches2.pex
Traceback (most recent call last):
  File "/home/jdevera/.local/bin/pex", line 9, in <module>
    load_entry_point('pex==1.0.1', 'console_scripts', 'pex')()
  File "/home/jdevera/.local/lib/python2.7/site-packages/pex/bin/pex.py", line 509, in main
    pex_builder = build_pex(reqs, options, resolver_options_builder)
  File "/home/jdevera/.local/lib/python2.7/site-packages/pex/bin/pex.py", line 486, in build_pex
    pex_builder.set_script(options.script)
  File "/home/jdevera/.local/lib/python2.7/site-packages/pex/pex_builder.py", line 207, in set_script
    raise self.InvalidExecutableSpecification('Could not find script %s in PEX!' % script)
pex.pex_builder.InvalidExecutableSpecification: Could not find script git-branches.py in PEX!

It looks exactly like the use case mentioned in the first message, where I did not create a package for my little git-branches script, I just want to create a pex so I can run it with its dependencies.

is git-branches.py defined in a scripts=[] array in one of the project setup.py files?

No, there is no setup.py, just git-branches.py and requirements.txt, I assummed that

If you build a simple flask app but don't want to go through the ceremony of defining a setup.py and the like

meant this case.

I realise that I can create a minimal setup.py like this:
from setuptools import setup
setup(name='git-branches', scripts=['git-branches.py'])

Then run:
pex . -r requirements.txt --script git-branches.py -o git-branches
And get a runnable version of my script.
I thought this is what this issue was about. If not, is this something that could be somehow integrated? Shall I then open a new request?

I think opening a new issue for the more general enhancement of doing something sane when the requirement is a directory without a setup.py (whether or not --script is used), would make sense... iff you can supply some reasoning in the issue as to why / how a sane thing can be done.  Is recursively globbing *.py from that dir good enough?, are non *.py files handled as resources (package_data) or are you out of luck and must upgrade to writing a setup.py at that point, etc.
This general thing was asked about here: http://stackoverflow.com/questions/30654854/python-pex-loading/30678446

In case it helps anyone, I've used the latest pex 1.1.10 w/ python27 and had to create a valid setup.py with following content (which I now create dynamically as/when I build a new pex for my script/s)
from setuptools import setup
import os
del os.link # this is necessary if you run this inside a docker container as hard linking will not work
_version = os.getenv('BUILD_COUNTER', '1')
setup(
    name='script',
    scripts=['script.py'],
    author='you',
<EMAIL_ADDRESS>    url='http://github.com',
    version=_version
    )

it also needs a README file in the same directory..
The directory then looks like
build/setup.py
build/script.py
build/requirements.txt
build/README

I then use
cd build
pex --disable-cache --python-shebang='/usr/bin/python27' . -r requirements.txt -c script.py -o ../script.pex

Alex


Current year in reserve-cve-id

Um hi, I am bad at data entry and sometimes struggle with remembering what year it is.
For the command reserve-cve-id I think the --cveYear should default to the current year.

@colbyprior This functionality has been included in v1.4.0 which should go out tonight.


support locating multiple configuration files

configuration like this:
new Liftoff({
  configFiles: {
    '.app': {
      extensions: ['rc','.yml'],
      search: {
        cwd: {
          path: './',
          findUp: true
        },
        myHomeKey: '~',
        etc: '/etc'
      }
    },
    'appfile': {
      extensions: function () {
        return Object.keys(require.extensions)
      },
      searchPaths: {
        baseDir: {
          path: './',
          findUp: true
        },
        home: '~',
        alternate: '/path/to/alternate',
        multiple: ['/path/to/whatever', '/path/to/something', '/path/to/something/else']
      }
    }
  }
});

yields environment like this:
env.configFiles = {
  '.app': {
    cwd: '/var/www/project/code/.apprc',
    myHomeKey: '/Users/user/.apprc',
    etc: null
  },
  'appfile': {
    baseDir: '/var/www/project/code/appfile.js',
    home: null,
    alternate: null,
    multiple: ['/path/to/whatever/appfile.js', '/path/to/something/appfile.js']
  }
};

~ expands to process.env.HOME || process.env.HOMEPATH || process.env.USERPROFILE
searchPath entries which specify an array of paths should NOT perform findUp on each entry.

@tkellen I tried this issue and finished implementing it on my repository.
sttk/js-liftoff#support_multiple_config_files
But I changed a bit of your specification:

The properties searchPaths or searchPath are not necessary.
If the searchPath property is specified, the result is a string or null. Otherwise the result is always an array.
If the extensions property is an object, this module gets an sorted array of its property keys and uses it.

For the example in the top comment, the program outputs as follows:
(/Users/sttk/foo/bar/liftoff/tester.js)
var Liftoff = require('.');

var _require = {
  extensions: {
    '.js': null,
    '.json': null,
  },
};

var Tester = new Liftoff({
  name: 'app',
  configFiles: {
    '.app': {
      extensions: ['rc', '.yml'],
      searchPaths: {
        cwd: {
          path: './',
          findUp: true,
        },
        myHomeKey: '~',
        etc: '/etc',
      },
    },
    'appfile': {
      extensions: function() {
        return Object.keys(_require.extensions);
      },
      searchPaths: {
        baseDir: {
          path: './',
          findUp: true,
        },
        home: '~',
        alternate: '/tmp/path/to/alternate',
        multiple: ['/tmp/path/to/whatever', '/tmp/path/to/something', '/tmp/path/to/something/else'],
      },
    }
  },
});

Tester.launch({}, function(env) {
  var util = require('util');
  console.log(util.inspect(env, { depth: null }));
});

(output)
{ cwd: '/Users/sttk/foo/bar/liftoff',
  require: [],
  configNameSearch: [ 'appfile.js', 'appfile.json' ],
  configPath: null,
  configBase: undefined,
  modulePath: undefined,
  modulePackage: {},
  configFiles:
   { '.app':
      { cwd: [ '/Users/sttk/foo/bar/liftoff/.apprc' ],
        myHomeKey: [ '/Users/sttk/.apprc' ],
        etc: [] },
     appfile:
      { baseDir: [],
        home: [],
        alternate: [],
        multiple:
         [ '/tmp/path/to/whatever/appfile.js',
           '/tmp/path/to/something/appfile.js' ] } } }

@tkellen Thanks for giving me push access, but I want you to check whether my modification meets your specification before commit this to the repository.
And now, I'm considering that searched paths should be returned not like 'searched/file/path.json' but like { extension: '.json', path:'searched/file/path.json' } for applying require functions corresponding to their extensions after.
How do you think about it?

@sttk could you open a PR here so we can review the changes properly? :)

@tusbar I've open this PR. Please review.

Fully fleshed out idea from https://github.com/js-cli/js-liftoff/pull/67#discussion_r59125527
Possible new spec:
new Liftoff({
  // extensions are already supported by liftoff
  extensions: {
    '.js': null,
    '.yml': 'yml-loader-module'
  },
  configFiles: {
    '.app': {
      // value can be an object with `path`, `findUp` and `extensions` properties
      cwd: {
        path: './',
        findUp: true,
        // explicit extensions that override top-level extensions
        // extension overrides would be handled exactly the same as top-level extensions
        // everything else defaults to top-level extensions
        extensions: {
          'rc': 'some-special-rc-loader'
        }
      },
      // value can be a string that expands to `{ path: value }`
      // if extensions aren't passed using an object, top-level extensions are used
      myHomeKey: '~',
      etc: '/etc'
    },
    'appfile': {
      baseDir: {
        path: './',
        findUp: true
      },
      home: '~',
      alternate: '/path/to/alternate',
      // value can also be an array of strings or objects (strings get expanded)
      multiple: ['/path/to/whatever', '/path/to/something', '/path/to/something/else']
    }
  }
});

yields
env.configFiles = {
  '.app': {
    cwd: '/var/www/project/code/.apprc',
    myHomeKey: '/Users/user/.app.yml',
    etc: null
  },
  'appfile': {
    baseDir: '/var/www/project/code/appfile.js',
    home: null,
    alternate: null,
    multiple: ['/path/to/whatever/appfile.js', '/path/to/something/appfile.js']
  }
};

/cc @tkellen @sttk

I understand new spec as follows (and have some questions) :

searchPaths/searchPath properties are abolished.

Question: If multiple paths are hit with extensions, is the result an array of paths, or only a first path?
Question: If the result path can be a string or an array, do users have to check it before using it?

Each configFiles properties (e.g. .app) can be an object.

Question: Does it support a string and an array? (it is supported now.)

Each properties of configFiles properties (e.g. cwd and myHomeKey) can be an object, a string, a string array, or an object array. If an object (including an element of an array), path property is mandatory in it.
configFiles property (e.g. .app) is used as a part of path.

Question: Is it allowed to include '.' and '~' characters? (it is allowed now)

Thinking deeper about your questions, I think every result should be a singular string.  That would mean dropping the array syntax (and relying on the keyed object for fallbacks) or stopping traversal after the first match; which do you think is better?  I'm leaning towards dropping the array syntax.
Extensions: match the behavior that liftoff currently uses.  If there is a gulpfile.js and a gulpfile.babel.js in a project, which is used?
I don't think configFiles should accept an array or string and should only accept an object.
The properties of configFiles are supposed to be the file's basename, as it is currently written.  If we wanted to do away with that and use generic keys (like rc, etc), we would have to add a name property to the objects and I don't really like that.  I'm on the fence about using the key as the file's basename but it is probably for the best.  If it stays that way, all characters are part of the filename (and are appended with the extensions), nothing in the key is expanded (e.g. ~ is not expanded to home) and only valid path characters should be allowed as keys.
Hope that helps, but it might open up other questions.

@phated Thank you for answering my questions.

That would mean dropping the array syntax ... or stopping traversal after the first match; which do you think is better?

If every result is a singular string, I also think that dropping the array syntax is better because it makes less confusing for users and I can't think the cases in which the syntax is used.

... If there is a gulpfile.js and a gulpfile.babel.js in a project, which is used?

Liftoff preferentially uses an earlier extension in specified order. (Though it isn't guaranteed.)

I don't think configFiles should accept an array or string and should only accept an object.

I got it. I'll do so.

... nothing in the key is expanded (e.g. ~ is not expanded to home) and only valid path characters should be allowed as keys.

I got it. I'll implement not to expanded '~' and '.' but to use the key just as user specify.

Support for this was just published as 2.3.0


Model not saved

Hi,
I tried to train a model using rationale.py on a small dataset (with not rationale 'gold data'). It seems that the model is able to learn, and the loss decreases from one epoch to another. However, when the training ended the model wasn't saved and I wasn't able to use it.
How can I save the model? and how can it be loaded and used to classify new documents?
The command I use to train the model is:
python rationale\rationale.py --embedding  --train  --dev  --save_model model.pkl.gz --batch 50
Thanks,
Shai

Hi @shaihr
model saving for later usage is not implemented. I'm traveling during thanksgiving holidays. Let me get this back to you next week.

Hi @shaihr
I added code to save and load model in rationale/rationale.py and ratioanle/rationale_dependent.py. See this diff.
In particular, this part shows an example of using the saved model.
Note:
You still need to provide pre-trained word embeddings. The embeddings are fixed and are not saved to the model file.

Thanks for the quick solution!


API: onDidMaximizedGroupChange misspelled as onDidMaxmizedGroupChange

Describe the bug
The container api has onDidMaximizedGroupChange misspelt as onDidMaxmizedGroupChange (note the missing "i").
May seem minor, but just thought i'd raise as I didnt find it when i seached the api TS files for it with the correct spelling.
Amazing repo btw!
To Reproduce
component.api.d.ts line 459 on 1.9.2

Thanks for the pointer - will get that fixed on the next release!

Released in 1.10.0 https://dockview.dev/


Only show "start at" on share page for videos/audio

Right now we are showing it on the channel share page and for content that's non-video/audio

I'll take a look at this


newer Parboiled

(this came up because ConductR has a parboiled dependency) /cc @huntc

test run: https://scala-ci.typesafe.com/view/scala-2.12.x/job/scala-2.12.x-integrate-community-build/682/consoleFull (404 for a while til Jenkins catches up)


As a player I hear music during playtime to increase my immersion

We should add music to the game so it doesn't sound so lonely.

Things to consider:

Music on open license
AI generated music (suno :thinking: )
Creating music by myself

I didn't find matching music


module 'XXX' has a minimum deployment target of iOS 14.4

I have a swift package with multiple dependencies, from which I want to build a xcframework using this tool.
One of the dependencies is SwCrypt (https://github.com/soyersoyer/SwCrypt).
In the Package.swift file I declared it like this:
platforms: [
	.macOS(.v10_15), .iOS(.v11)
],
dependencies: [
	.package(url: "https://github.com/soyersoyer/SwCrypt.git", from: "5.1.4")
],

The problem is that when running swift create-xcframework, it fails with the following:

/Users/myUsername/Desktop/fts/NetService/MyPackage/Sources/MyPackage/MyPackage.swift:9:8: error: compiling for iOS 11.0, but module 'SwCrypt' has a minimum deployment target of iOS 14.4: /Users/myUsername/Desktop/fts/NetService/MyPackage/.build/swift-create-xcframework/build/Release-iphoneos/SwCrypt.framework/Modules/SwCrypt.swiftmodule/arm64-apple-ios.swiftmodule
import SwCrypt
^

I don't understand this error, as SwCrypt does not seem to declare iOS 14.4 as minimum deployment anywhere. In addition, I can include SwCrypt into a different iOS app project with minimum set to iOS 11, and it will compile of course.
swift-create-xcframework version: master branch from today
Swift version: Apple Swift version 5.3.2 (swiftlang-1200.0.45 clang-1<IP_ADDRESS>)
Target: arm64-apple-darwin20.3.0
Environment: Version 12.4 (12D4e), macOS 11.2.1 (M1 Macbook)
Checklist

[X] If possible, I've reproduced the issue using the master branch of this package
[X] I've searched for existing GitHub issues

Steps to Reproduce

Create a new Swift Package
Add the SwCrypt dependency as mentioned above into the Package.swift file
import SwCrypt in some Swift file
Declare iOS 11 as platform in Package.swift
Try to run swift-create-xcframework

Expected behavior
It should compile.
Actual behavior
Described above.

Hi @fritzfr,
This is an issue with SwiftPM's Xcode project generation. You can check this by running swift package generate-xcodeproj and trying to build the resultant project.
Fortunately, or unfortunately, depending on how you see these things, enabling BUILD_LIBRARY_FOR_DISTRIBUTION tends to mess with minimum deployment settings on the targets it is enabled on.
So you can get around this by including SwCrypt in the list of targets to build, eg:
swift create-xcframework <MyPackageProduct> SwCrypt
This has the added bonus of building SwCrypt.xcframework, which you would need to be able to distribute your package anyway.

@bok- Thanks for the quick reply. I'm very new to XCode's toolchain. Maybe you can help me understand a few things.
As described, I'm building a Module, let's say "MyModule". It depends on SwCrypt. My goal is to create a binary (in the form of xcframework), which I then want to distribute as a swift package.
If I understand you correctly, I would need to create an xcframework for "MyModule" and "SwCrypt". How can I then combine both of them into a Swift Package? It seems like a binaryTarget needs to be declared in the Package.swift of that final Swift Package, e.g.:
.binaryTarget(name: "MyModule", path: "./Sources/MyModule.xcframework"),

Would I need another binaryTarget for SwCrypt, or can this even be accomplished?


Update README.md

Hello there!
I fixed a small typo in the README.md

@ptrgast Thanks!

@ptrgast Thanks!


Update free-courses-ne.md

What does this PR do?
Add resource(s) | Remove resource(s) | Add info | Improve repo
For resources
Description
Class objective variable in java for Nepalis language
Why is this valuable (or not)?
this is valuable because it will be availed to the Nepalis community that I relate to and we will be able to succeed and be seen.
How do we know it's really free?
it is a YouTube video with now fees
For book lists, is it a book? For course lists, is it a course? etc.
Checklist:

[x] Read our contributing guidelines.
[x] Search for duplicates.
[x] Include author(s) and platform where appropriate.
[x] Put lists in alphabetical order, correct spacing.
[x] Add needed indications (PDF, access notes, under construction).
[x] Used an informative name for this pull request.

Follow-up

Check the status of GitHub Actions and resolve any reported warnings!

For youtube, we prefer "playlist" links and the name of the producer/creator. docs/CONTRIBUTING.md#platforms-and-access-notes
https://www.youtube.com/playlist?list=PLmZYUigljiyc-tf7oMmM-s832ibhGxTpT

For youtube, we prefer "playlist" links and the name of the producer/creator. docs/CONTRIBUTING.md#platforms-and-access-notes https://www.youtube.com/playlist?list=PLmZYUigljiyc-tf7oMmM-s832ibhGxTpT

finished


Add Graphics on the Video Flow

Hello,
Is it possible to add Graphics, like SVG or Skiasharp on the video flow with this component ?
Thank you;
Christophe

We just use out of the box APIs to launch the camera app so none of that is available.


Update Cages logging to use proper levels

Why
Cages logging all goes through println and eprintln without any filtering. Moving the logging to use the log crate lets us compile away any low log levels to avoid the IO overhead
How

Move logging to the log crate
Apply static levels to each log line using the log macros

too much drift with main, reimpl'd on a new branch.