Intel: SSD-MobileNet accuracy mAP=15.280%

We've meticulously reconstructed all components of Intel's MLPerf Inference v0.5 submission, including:

the Linux/CPU code without any modifications except for CMakeLists.txt;
the OpenVINO 2019_R3.1 release (The code doesn't build with the latest release or master.);
the symmetrically quantized SSD-MobileNet model converted using Intel's procedure;
and even their LoadGen branch.

Unfortunately, the reached accuracy (15.280%) is much lower than expected (22.627%):
Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.153
Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.236
Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.167
Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.012
Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.101
Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.361
Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.150
Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.178
Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.178
Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.014
Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.114
Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.423
mAP=15.280%

To reproduce, follow the instructions for the prebuilt Docker image.
You can also reproduce the same in a native Debian environment by following Collective Knowledge steps in the source Dockerfile.

If I remove the --reverse_input_channels flag from the conversion, I get a higher accuracy (20.798%):
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.208
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.320
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.226
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.016
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.145
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.472
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.192
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.237
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.238
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.021
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.167
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.536
mAP=20.798%

Using the other quantized model without --reverse_input_channels gives worse accuracy (20.150%):
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.201
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.312
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.219
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.016
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.138
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.463
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.187
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.231
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.232
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.021
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.159
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.530
mAP=20.150%

Using the other quantized model with --reverse_input_channels gives even worse accuracy (14.827%):
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.148
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.228
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.161
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.010
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.095
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.343
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.146
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.174
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.174
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.012
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.109
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.407
mAP=14.827%

Reverse input channels?
Quantized model
Accuracy (mAP)

yes
asymmetric
14.827%

symmetric
15.280%

no
asymmetric
20.150%

symmetric
20.798%

Here's the full conversion log:
/usr/bin/python3.6 /home/anton/CK_TOOLS/lib-openvino-gcc-8.4.0-2019_R3.1-linux-64/dldt/model-optimizer/mo.py --model_name converted_model --input_model /home/anton/CK_TOOLS/model-tf-mlperf-ssd-mobilenet-q
uantized-finetuned-for.openvino/ssd_mobilenet_v1_quant_ft_no_zero_point_frozen_inference_graph.pb --input_shape [1,300,300,3] --tensorflow_object_detection_api_pipeline_config /home/anton/CK_TOOLS/model-t
f-mlperf-ssd-mobilenet-quantized-finetuned-for.openvino/pipeline.config --tensorflow_use_custom_operations_config /home/anton/CK_TOOLS/lib-openvino-gcc-8.4.0-2019_R3.1-linux-64/dldt/model-optimizer/extens
ions/front/tf/ssd_v2_support.json
Model Optimizer arguments:
Common parameters:
        - Path to the Input Model:      /home/anton/CK_TOOLS/model-tf-mlperf-ssd-mobilenet-quantized-finetuned-for.openvino/ssd_mobilenet_v1_quant_ft_no_zero_point_frozen_inference_graph.pb
        - Path for generated IR:        /home/anton/CK_TOOLS/model-openvino-converted-from-tf-ssd-mobilenet/.
        - IR output name:       converted_model
        - Log level:    ERROR
        - Batch:        Not specified, inherited from the model
        - Input layers:         Not specified, inherited from the model
        - Output layers:        Not specified, inherited from the model
        - Input shapes:         [1,300,300,3]
        - Mean values:  Not specified
        - Scale values:         Not specified
        - Scale factor:         Not specified
        - Precision of IR:      FP32
        - Enable fusing:        True
        - Enable grouped convolutions fusing:   True
        - Move mean values to preprocess section:       False
        - Reverse input channels:       False
TensorFlow specific parameters:
        - Input model in text protobuf format:  False
        - Path to model dump for TensorBoard:   None
        - List of shared libraries with TensorFlow custom layers implementation:        None
        - Update the configuration file with input/output node names:   None
        - Use configuration file used to generate the model with Object Detection API:  /home/anton/CK_TOOLS/model-tf-mlperf-ssd-mobilenet-quantized-finetuned-for.openvino/pipeline.config
        - Operations to offload:        None
        - Patterns to offload:  None
        - Use the config file:  /home/anton/CK_TOOLS/lib-openvino-gcc-8.4.0-2019_R3.1-linux-64/dldt/model-optimizer/extensions/front/tf/ssd_v2_support.json
Model Optimizer version:        unknown version
The Preprocessor block has been removed. Only nodes performing mean value subtraction and scaling (if applicable) are kept.

[ SUCCESS ] Generated IR model.
[ SUCCESS ] XML file: /home/anton/CK_TOOLS/model-openvino-converted-from-tf-ssd-mobilenet/./converted_model.xml
[ SUCCESS ] BIN file: /home/anton/CK_TOOLS/model-openvino-converted-from-tf-ssd-mobilenet/./converted_model.bin
[ SUCCESS ] Total execution time: 38.25 seconds.

After my blunder with #29 where I didn't think of running the ImageNet accuracy script with another data type parameter, I decided to check the COCO accuracy script on the data from the v0.5 submission.
I discovered that for the clx_9282-2s_openvino-linux system the reported accuracy is mAP=22.627% while the script computes mAP=25.484%:
anton@velociti:/data/anton/inference_results_v0.5/closed/Intel/results$ for accuracy_txt in \
>   ./clx_9282-2s_openvino-linux/ssd-small/Server/accuracy/accuracy.txt \
>   ./clx_9282-2s_openvino-linux/ssd-small/Offline/accuracy/accuracy.txt \
>   ./clx_9282-2s_openvino-linux/ssd-small/SingleStream/accuracy/accuracy.txt \
> ; do \
>   echo "$accuracy_txt"; \
>   tail -1 $accuracy_txt; \
>   echo "" \
> ; done
./clx_9282-2s_openvino-linux/ssd-small/Server/accuracy/accuracy.txt
mAP=22.627%

./clx_9282-2s_openvino-linux/ssd-small/Offline/accuracy/accuracy.txt
mAP=22.627%

./clx_9282-2s_openvino-linux/ssd-small/SingleStream/accuracy/accuracy.txt
mAP=22.627%

anton@velociti:/data/anton/inference_results_v0.5/closed/Intel/results$ for mlperf_log_accuracy_json in \
  ./clx_9282-2s_openvino-linux/ssd-small/Server/accuracy/mlperf_log_accuracy.json \
  ./clx_9282-2s_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json \
  ./clx_9282-2s_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json \
; do \
  echo "$mlperf_log_accuracy_json"; \
  wc -l "$mlperf_log_accuracy_json"; \
  /usr/bin/python3.6 \
  /home/anton/CK_TOOLS/mlperf-inference-dividiti.v0.5-intel/inference/v0.5/classification_and_detection/tools/accuracy-coco.py \
  --coco-dir /datasets/dataset-coco-2017-val/ \
  --mlperf-accuracy-file $mlperf_log_accuracy_json; \
  echo "" \
; done

./clx_9282-2s_openvino-linux/ssd-small/Server/accuracy/mlperf_log_accuracy.json
31754 ./clx_9282-2s_openvino-linux/ssd-small/Server/accuracy/mlperf_log_accuracy.json
loading annotations into memory...
Done (t=0.54s)
creating index...
index created!
Loading and preparing results...
DONE (t=0.01s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *bbox*
DONE (t=0.68s).
Accumulating evaluation results...
DONE (t=0.47s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.255
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.369
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.286
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.010
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.186
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.580
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.218
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.272
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.272
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.012
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.194
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.616
mAP=25.484%

./clx_9282-2s_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
66074 ./clx_9282-2s_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
loading annotations into memory...
Done (t=0.55s)
creating index...
index created!
Loading and preparing results...
DONE (t=0.01s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *bbox*
DONE (t=0.60s).
Accumulating evaluation results...
DONE (t=0.45s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.255
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.369
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.286
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.010
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.186
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.580
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.218
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.272
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.272
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.012
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.194
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.616
mAP=25.484%

./clx_9282-2s_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json
4255 ./clx_9282-2s_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json
loading annotations into memory...
Done (t=0.46s)
creating index...
index created!
Loading and preparing results...
DONE (t=0.01s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *bbox*
DONE (t=0.61s).
Accumulating evaluation results...
DONE (t=0.46s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.255
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.369
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.286
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.010
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.186
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.580
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.218
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.272
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.272
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.012
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.194
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.616
mAP=25.484%

Note that the JSON logs for the Server, Offline and SingleScream scenarios have 31754, 66074 and 4255 lines, respectively, not 5002 as expected.

For the ICL-I3-1005G1_OpenVINO-Windows system, I get the accuracy and the number of lines as expected but also 21248 error lines like: ERROR: loadgen(800) and payload(2583339204608) disagree on image_idx for the SingleStream log:
anton@velociti:/data/anton/inference_results_v0.5/closed/Intel/results$ for mlperf_log_accuracy_json in \
  ./ICL-I3-1005G1_OpenVINO-Windows/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json \
  ./ICL-I3-1005G1_OpenVINO-Windows/ssd-small/Offline/accuracy/mlperf_log_accuracy.json \
; do \
  echo "$mlperf_log_accuracy_json"; \
  wc -l "$mlperf_log_accuracy_json"; \
  /usr/bin/python3.6 \
  /home/anton/CK_TOOLS/mlperf-inference-dividiti.v0.5-intel/inference/v0.5/classification_and_detection/tools/accuracy-coco.py \
  --coco-dir /datasets/dataset-coco-2017-val/ \
  --mlperf-accuracy-file $mlperf_log_accuracy_json; \
  echo "" \
; done
...
ERROR: loadgen(1871) and payload(2583339204608) disagree on image_idx
ERROR: loadgen(1871) and payload(2583339204608) disagree on image_idx
ERROR: loadgen(800) and payload(2583339204608) disagree on image_idx
Loading and preparing results...
DONE (t=0.13s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *bbox*
DONE (t=12.38s).
Accumulating evaluation results...
DONE (t=2.13s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.226
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.347
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.246
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.018
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.158
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.521
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.205
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.257
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.258
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.023
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.182
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.594
mAP=22.627%

./ICL-I3-1005G1_OpenVINO-Windows/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
5002 ./ICL-I3-1005G1_OpenVINO-Windows/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
loading annotations into memory...
Done (t=0.51s)
creating index...
index created!
Loading and preparing results...
DONE (t=0.10s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *bbox*
DONE (t=12.58s).
Accumulating evaluation results...
DONE (t=2.11s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.226
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.347
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.246
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.018
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.158
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.521
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.205
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.257
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.258
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.023
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.182
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.594
mAP=22.627%

No problems with the DellEMC's results (including OpenVINO and TensorRT):
anton@velociti:/data/anton/inference_results_v0.5/closed/DellEMC/results$ for mlperf_log_accuracy_json in \
>   ./DELLEMC_R740xd6248_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json \
>   ./DELLEMC_R740xd6248_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json \
>   ./DELLEMC_R740xd8276_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json \
>   ./DELLEMC_R740xd8276_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json \
>   ./R740_T4x4_tensorrt/ssd-small/Server/accuracy/mlperf_log_accuracy.json \
>   ./R740_T4x4_tensorrt/ssd-small/Offline/accuracy/mlperf_log_accuracy.json \
> ; do \
>   echo "$mlperf_log_accuracy_json"; \
>   wc -l "$mlperf_log_accuracy_json"; \
>   /usr/bin/python3.6 \
>   /home/anton/CK_TOOLS/mlperf-inference-dividiti.v0.5-intel/inference/v0.5/classification_and_detection/tools/accuracy-coco.py \
>   --coco-dir /datasets/dataset-coco-2017-val/ \
>   --mlperf-accuracy-file $mlperf_log_accuracy_json | tail -1; \
>   echo "" \
> ; done
./DELLEMC_R740xd6248_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
5002 ./DELLEMC_R740xd6248_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
mAP=22.627%

./DELLEMC_R740xd6248_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json
5002 ./DELLEMC_R740xd6248_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json
mAP=22.627%

./DELLEMC_R740xd8276_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
5002 ./DELLEMC_R740xd8276_openvino-linux/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
mAP=22.627%

./DELLEMC_R740xd8276_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json
5002 ./DELLEMC_R740xd8276_openvino-linux/ssd-small/SingleStream/accuracy/mlperf_log_accuracy.json
mAP=22.627%

./R740_T4x4_tensorrt/ssd-small/Server/accuracy/mlperf_log_accuracy.json
5002 ./R740_T4x4_tensorrt/ssd-small/Server/accuracy/mlperf_log_accuracy.json
mAP=22.911%

./R740_T4x4_tensorrt/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
5002 ./R740_T4x4_tensorrt/ssd-small/Offline/accuracy/mlperf_log_accuracy.json
mAP=22.912%

So the resolution seems to have two aspects to it:

To use the pre-release branch of OpenVINO, last committed to on 7 October 2019 just before the v0.5 deadline;
Not to use the reverse_input_channels flag during conversion.

This can be confirmed in a new Docker image version (tagged mlperf_inference_results_v0.5_issue_27_resolved on Docker Hub.

 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.226
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.347
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.246
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.018
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.158
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.520
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.205
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.257
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.258
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.023
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.183
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.594
mAP=22.617%

The 2019_R3 release is no good either:
$ ck install package --tags=lib,openvino,2019_R3
$ export NPROCS=`grep -c processor /proc/cpuinfo`
$ ck benchmark program:mlperf-inference-v0.5 --cmd_key=object-detection --repetitions=1 --skip_print_timers \
--env.CK_LOADGEN_MODE=Accuracy --env.CK_LOADGEN_SCENARIO=Offline \
--env.CK_OPENVINO_NIREQ=$NPROCS --env.CK_OPENVINO_NTHREADS=$NPROCS --env.CK_OPENVINO_NSTREAMS=$NPROCS \
--dep_add_tags.openvino=2019_R3 --dep_add_tags.loadgen=for.openvino --dep_add_tags.mlperf-inference-src=dividiti.v0.5-intel \
--dep_add_tags.compiler=v8 --dep_add_tags.cmake=v3.14 --dep_add_tags.opencv=v3.4.3
...
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.208
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.320
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.226
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.016
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.145
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.472
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.192
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.237
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.238
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.021
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.167
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.536
mAP=20.798%

... while the benchmark code doesn't build with 2020.1:
$ ck install package --tags=lib,openvino,2020.1
$ export NPROCS=`grep -c processor /proc/cpuinfo`
$ ck benchmark program:mlperf-inference-v0.5 --cmd_key=object-detection --repetitions=1 --skip_print_timers \
--env.CK_LOADGEN_MODE=Accuracy --env.CK_LOADGEN_SCENARIO=Offline \
--env.CK_OPENVINO_NIREQ=$NPROCS --env.CK_OPENVINO_NTHREADS=$NPROCS --env.CK_OPENVINO_NSTREAMS=$NPROCS \
--dep_add_tags.openvino=2020.1 --dep_add_tags.loadgen=for.openvino --dep_add_tags.mlperf-inference-src=dividiti.v0.5-intel \
--dep_add_tags.compiler=v8 --dep_add_tags.cmake=v3.14 --dep_add_tags.opencv=v3.4.3
...
[ 50%] Building CXX object CMakeFiles/ov_mlperf.dir/main_ov.cc.o
/usr/bin/g++-8   -I/home/anton/CK_TOOLS/lib-boost-1.67.0-gcc-8.4.0-compiler.python-3.6.10-linux-64/install/include -I/home/anton/CK_TOOLS/lib-mlperf-loadgen-static-gcc-8.4.0-compiler.python-3.6.10-for.ope
nvino-linux-64/include -I/home/anton/CK_TOOLS/lib-openvino-gcc-8.4.0-2020.1-linux-64/include -I/home/anton/CK_TOOLS/lib-openvino-gcc-8.4.0-2020.1-linux-64/dldt/inference-engine/src/extension -isystem /hom
e/anton/CK_TOOLS/lib-opencv-3.4.3-gcc-8.4.0-linux-64/install/include -isystem /home/anton/CK_TOOLS/lib-opencv-3.4.3-gcc-8.4.0-linux-64/install/include/opencv  -fPIE -fstack-protector-strong -Wno-error -fP
IC -fno-operator-names -Wformat -Wformat-security -Wall -O2 -std=c++14 -pthread -USE_OPENCV -DBOOST_ERROR_CODE_HEADER_ONLY -O3 -DNDEBUG   -o CMakeFiles/ov_mlperf.dir/main_ov.cc.o -c /home/anton/CK_REPOS/c
k-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/main_ov.cc
In file included from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/sut_ov.h:12,
                 from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/main_ov.cc:13:
/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h:5:10: fatal error: ext_list.hpp: No such file or directory
 #include <ext_list.hpp>
          ^~~~~~~~~~~~~~
compilation terminated.
CMakeFiles/ov_mlperf.dir/build.make:62: recipe for target 'CMakeFiles/ov_mlperf.dir/main_ov.cc.o' failed
make[2]: *** [CMakeFiles/ov_mlperf.dir/main_ov.cc.o] Error 1
make[2]: Leaving directory '/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/tmp'
CMakeFiles/Makefile2:72: recipe for target 'CMakeFiles/ov_mlperf.dir/all' failed
make[1]: *** [CMakeFiles/ov_mlperf.dir/all] Error 2
make[1]: Leaving directory '/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/tmp'
Makefile:83: recipe for target 'all' failed
make: *** [all] Error 2

I'm guessing new include paths need to be set for 2020.1:
diff --git a/program/mlperf-inference-v0.5/ov_mlperf_cpu/CMakeLists.txt b/program/mlperf-inference-v0.5/ov_mlperf_cpu/CMakeLists.txt
index ab50451..005fd67 100644
--- a/program/mlperf-inference-v0.5/ov_mlperf_cpu/CMakeLists.txt
+++ b/program/mlperf-inference-v0.5/ov_mlperf_cpu/CMakeLists.txt
@@ -42,6 +42,9 @@ set(OPENVINO_LIBRARY               "${OPENVINO_LIB_DIR}/libinference_engine.so")
 set(OPENVINO_CPU_EXTENSION_LIBRARY "${OPENVINO_LIB_DIR}/libcpu_extension.so")
 set(OPENVINO_INCLUDE_DIR           "${OPENVINO_DIR}/include")
 set(OPENVINO_EXTENSION_DIR         "${OPENVINO_DIR}/openvino/inference-engine/src/extension")
+set(OPENVINO_MKLDNN_NODES_DIR      "${OPENVINO_DIR}/openvino/inference-engine/src/mkldnn_plugin/nodes")^M
+set(OPENVINO_THIRDPARTY_MKLDNN_SRC_CPU "${OPENVINO_DIR}/openvino/inference-engine/thirdparty/mkl-dnn/src/cpu")^M
+set(OPENVINO_THIRDPARTY_MKLDNN_SRC_COMMON "${OPENVINO_DIR}/openvino/inference-engine/thirdparty/mkl-dnn/src/common")^M

 MESSAGE(STATUS "OPENVINO_DIR=${OPENVINO_DIR}")
 MESSAGE(STATUS "OPENVINO_LIB_DIR=${OPENVINO_LIB_DIR}")
@@ -83,6 +86,9 @@ include_directories(
     ${LOADGEN_DIR}
     ${OPENVINO_INCLUDE_DIR}
     ${OPENVINO_EXTENSION_DIR}
+    ${OPENVINO_MKLDNN_NODES_DIR}^M
+    ${OPENVINO_THIRDPARTY_MKLDNN_SRC_CPU}^M
+    ${OPENVINO_THIRDPARTY_MKLDNN_SRC_COMMON}^M
 )

 set(SOURCE_FILES backend_ov.h dataset_ov.h sut_ov.h infer_request_wrap.h item_ov.h main_ov.cc)

as well as modifying the program:
diff --git a/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h b/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h
index 8ea1de2..b0d2207 100644
--- a/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h
+++ b/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h
@@ -2,7 +2,7 @@
 #define BACKENDOV_H__

 #include <inference_engine.hpp>
-#include <ext_list.hpp>
+#include <list.hpp>

 #include "infer_request_wrap.h"

@@ -79,7 +79,7 @@ public:
         Core ie;
         const std::string device { "CPU" };
         if (device == "CPU") {
-            ie.AddExtension(std::make_shared<Extensions::Cpu::CpuExtensions>(),
+            ie.AddExtension(std::make_shared<Extensions::Cpu::MKLDNNExtensions>(),
                     "CPU");
             if (settings_.scenario == mlperf::TestScenario::SingleStream) {
                 ie.SetConfig(

but still doesn't build:
In file included from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/sut_ov.h:12,
                 from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/main_ov.cc:13:
/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h: In member function ‘void BackendOV::load(std::__cxx11::string)’:
/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h:82:81: error: no matching function for call to ‘make_shared<template<mkldnn::impl::cpu::cpu_isa_t Type> class Infe
renceEngine::Extensions::Cpu::MKLDNNExtensions>()’
             ie.AddExtension(std::make_shared<Extensions::Cpu::MKLDNNExtensions>(),
                                                                                ^

Also trouble is expected with 2020.2:
In file included from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/backend_ov.h:7,
                 from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/sut_ov.h:12,
                 from /home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/main_ov.cc:13:
/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/infer_request_wrap.h: In member function ‘void InferReqWrap::postProcessImagenet(std::vector<Item>&, std::vector<unsigned int>&
, std::vector<long unsigned int>&)’:
/home/anton/CK_REPOS/ck-openvino/program/mlperf-inference-v0.5/ov_mlperf_cpu/infer_request_wrap.h:129:42: warning: ‘void InferenceEngine::TopResults(unsigned int, InferenceEngine::Blob&, std::vector<unsig
ned int>&)’ is deprecated: InferenceEngine utility functions are not a part of public API. Will be removed in 2020 R2 [-Wdeprecated-declarations]
             TopResults(1, *(b.blob_), res);
                                          ^


Unable to create/update storage with --custom-domain

When I try to create storage account with custom domain
az storage account create -n hereisuniquename -g MyResourceGroupName -l australiaeast --sku Standard_RAGRS --custom-domain ***.storage.***.com --kind Storage

I get this error:

Storage custom domain name {'use_sub_domain': False, 'name': '.storage..com'} is not valid.

It's successful when I create it without --custom-domain. Later in azure portal in storage custom domain Blade I can set exactly the same domain ***.storage.***.com and it successfully saves (Use indirect CNAME validation is unchecked, my CNAME record is valid).
Also
az storage account update -n hereisuniquename -g MyResourceGroupName --custom-domain ***.storage.***.com

returns error:

Storage custom domain name {'use_sub_domain': None, 'name': '.storage..com'} is not valid.

Hi @JaPawel thank you for reporting this bug. I have indeed confirmed the problem and will get it fixed as soon as possible.


feat(object_lanelet_filter): add configurable margin for object lanel…

Description
Necessary changes for: pr

@YoshiRi Can you confirm this with PR https://github.com/autowarefoundation/autoware.universe/pull/9240?


Unbound: cleanup ACLs

Unbound comes packed with multiple ACLs, migrating the new unbound-plus into core doesn't help making this more transparent.
It's probably a good idea to merge all pages into one ACL and ditch the old ones or if some one has a valid use case for some of the partial ACL's, add only the relevant ones and one to fit the complete module.

Discussing with @AdSchellevis this does not seem to be related to access-control directive in Unbound so moving it over to next milestone for further discussion of scope.


Initial commit for network-ee integration jobs

Signed-off-by: Paul Belanger<EMAIL_ADDRESS>

Pull-request updated, HEAD is now dafea7c78b957e8396a358a5fb521e3ce280beb6

Pull-request updated, HEAD is now 70fb3d4d4368c1880653de66bfaefbd287903984

Pull-request updated, HEAD is now 1b17d1728edf419bf45ce295966a33d6992f40da

Pull-request updated, HEAD is now c033d6b505e6f72813b272d35fb1a0090de95c8c

Pull-request updated, HEAD is now 5a9574b014f1bb3da4541dbc12e46863b95a0316

Pull-request updated, HEAD is now 609986185c0887f2b7d5d983e5180ec633e05b13

Pull-request updated, HEAD is now 2f0a7c7d6030974aa80ea879cd8832561750a8d0

Pull-request updated, HEAD is now ffff286b129dd14f2c7e9d82f340ced16c4897ca

Pull-request updated, HEAD is now 1e1d05a0d0b15bd158bc5c688169dc14ec43255c

Pull-request updated, HEAD is now b8c582f79e52c8eb47b814d9a814937df407af48

Pull-request updated, HEAD is now 2319b728b48246b2efb041a457582852ca09a809

Pull-request updated, HEAD is now 1024e4033ed1de575d9a01564d348dd0e53895e4

Pull-request updated, HEAD is now 042c1a0aa1b28a4306fd6a02da2eb6b036a45a32

Pull-request updated, HEAD is now 72eb5adc9ed31da90da1a03b2c853d600848fc8a

Pull-request updated, HEAD is now 2f96cd3004611981beb9db1441489b71bf81e9ec

Pull-request updated, HEAD is now b8199f2c7f15b128361cfd3bce581c11d311e99c

Pull-request updated, HEAD is now d34a859fbfb59b21606581dca9430867846978f3


TypeError: Cannot read property 'getRangeFromSpan' of undefined

Issue Id: 38ef9451-7d4b-2f2f-e705-51738c6590baVersions - 0.10.2-  df352367df2efcfa9d602d471e4e2f42140a0f05Stack TypeError: Cannot read property 'getRangeFromSpan' of undefined/vs/languages/typescript/common/features/definitions.ts#L34:54 (findDeclaration)/vs/languages/javascript/common/javascriptWorker.ts#L156:27 (JavaScriptWorker._findTypeScriptDeclaration)/vs/languages/typescript/common/typescriptWorker2.ts#L237:14 (TypeScriptWorker2.findDeclaration)/vs/languages/typescript/common/typescriptMode.ts#L484:31 (TypeScriptMode.findDeclaration)vs/base/common/worker/vs/base/common/winjs.base.raw.js#L1826:0 (onComplete)/vs/editor/common/modes/abstractMode.ts#L122:35 (AbstractMode._worker)/vs/languages/typescript/common/typescriptMode.ts#L484:14 (TypeScriptMode.findDeclaration)/vs/platform/thread/common/workerThreadService.ts#L89:16 (WorkerThreadService.OneWorker)/vs/platform/thread/common/threadService.ts#L69:35 (OneWorker)vs/base/common/worker/vs/base/common/winjs.base.raw.js#L1826:0 (onComplete)

Code is gone


Include bootstrap-vue.css after bootstrap.css

According to the bootstrap-vue docs bootstrap-vue.css should be included after bootstrap.css.
However, in App.vue, they are included in the opposite order (bootstrap.css is included in ./scss/style)
<style>
  /* Import Font Awesome Icons Set */
  $fa-font-path: '~font-awesome/fonts/';
  @import '~font-awesome/css/font-awesome.min.css';
  /* Import Simple Line Icons Set */
  $simple-line-font-path: '~simple-line-icons/fonts/';
  @import '~simple-line-icons/css/simple-line-icons.css';
  /* Import Bootstrap Vue Styles */
  @import '~bootstrap-vue/dist/bootstrap-vue.css';
</style>
<style lang="scss">
  // Import Main styles for this application
  @import './scss/style';
</style>

Hi! Thank you for your report!
Although you are right with this suggestion, this is not the pure bootstrap that is included after bootstrap-vue css, but bootstrap based coreui library. There might be customizations that are broken by bootstrap-vue styles.


Error Code 13 on Mac OS

mysql8.0.12
mac os 10.12

in order to use load data infile, I add a my.cnf under /etc to set secure_file_priv=''
# Example MySQL config file for medium systems.
#
# This is for a system with little memory (32M - 64M) where MySQL plays
# an important part, or systems up to 128M where MySQL is used together with
# other programs (such as a web server)
#
# MySQL programs look for option files in a set of
# locations which depend on the deployment platform.
# You can copy this option file to one of those
# locations. For information about these locations, see:
# http://dev.mysql.com/doc/mysql/en/option-files.html
#
# In this file, you can use all long options that a program supports.
# If you want to know which options a program supports, run the program
# with the "--help" option.
# The following options will be passed to all MySQL clients
[client]
default-character-set=utf8
#password = your_password
port = 3306
socket = /tmp/mysql.sock
# Here follows entries for some specific programs
# The MySQL server
[mysqld]
character-set-server=utf8
init_connect='SET NAMES utf8
port = 3306
socket = /tmp/mysql.sock
skip-external-locking
key_buffer_size = 16M
max_allowed_packet = 1M
table_open_cache = 64
sort_buffer_size = 512K
net_buffer_length = 8K
read_buffer_size = 256K
read_rnd_buffer_size = 512K
myisam_sort_buffer_size = 8M
character-set-server=utf8
secure_file_priv=''
init_connect='SET NAMES utf8'
local-infile=1
# Don't listen on a TCP/IP port at all. This can be a security enhancement,
# if all processes that need to connect to mysqld run on the same host.
# All interaction with mysqld must be made via Unix sockets or named pipes.
# Note that using this option without enabling named pipes on Windows
# (via the "enable-named-pipe" option) will render mysqld useless!
#
#skip-networking

# Replication Master Server (default)
# binary logging is required for replication
log-bin=mysql-bin

# binary logging format - mixed recommended
binlog_format=mixed

# required unique id between 1 and 2^32 - 1
# defaults to 1 if master-host is not set
# but will not function as a master if omitted
server-id = 1

# Replication Slave (comment out master section to use this)
#
# To configure this host as a replication slave, you can choose between
# two methods :
#
# 1) Use the CHANGE MASTER TO command (fully described in our manual) -
# the syntax is:
#
# CHANGE MASTER TO MASTER_HOST=<host>, MASTER_PORT=<port>,
# MASTER_USER=<user>, MASTER_PASSWORD=<password> ;
#
# where you replace <host>, <user>, <password> by quoted strings and
# <port> by the master's port number (3306 by default).
#
# Example:
#
# CHANGE MASTER TO MASTER_HOST='125.564.12.1', MASTER_PORT=3306,
# MASTER_USER='joe', MASTER_PASSWORD='secret';
#
# OR
#
# 2) Set the variables below. However, in case you choose this method, then
# start replication for the first time (even unsuccessfully, for example
# if you mistyped the password in master-password and the slave fails to
# connect), the slave will create a master.info file, and any later
# change in this file to the variables' values below will be ignored and
# overridden by the content of the master.info file, unless you shutdown
# the slave server, delete master.info and restart the slaver server.
# For that reason, you may want to leave the lines below untouched
# (commented) and instead use CHANGE MASTER TO (see above)
#
# required unique id between 2 and 2^32 - 1
# (and different from the master)
# defaults to 2 if master-host is set
# but will not function as a slave if omitted
#server-id = 2
#
# The replication master for this slave - required
#master-host = <hostname>
#
# The username the slave will use for authentication when connecting
# to the master - required
#master-user = <username>
#
# The password the slave will authenticate with when connecting to
# the master - required
#master-password = <password>
#
# The port the master is listening on.
# optional - defaults to 3306
#master-port = <port>
#
# binary logging - not required for slaves, but recommended
#log-bin=mysql-bin

# Uncomment the following if you are using InnoDB tables
#innodb_data_home_dir = /usr/local/mysql/data
#innodb_data_file_path = ibdata1:10M:autoextend
#innodb_log_group_home_dir = /usr/local/mysql/data
# You can set .._buffer_pool_size up to 50 - 80 %
# of RAM but beware of setting memory usage too high
#innodb_buffer_pool_size = 16M
#innodb_additional_mem_pool_size = 2M
# Set .._log_file_size to 25 % of buffer pool size
#innodb_log_file_size = 5M
#innodb_log_buffer_size = 8M
#innodb_flush_log_at_trx_commit = 1
#innodb_lock_wait_timeout = 50

[mysqldump]
quick
max_allowed_packet = 16M

[mysql]
no-auto-rehash
# Remove the next comment character if you are not familiar with SQL
#safe-updates
default-character-set=utf8
local-infile=1

[myisamchk]
key_buffer_size = 20M
sort_buffer_size = 20M
read_buffer = 2M
write_buffer = 2M

[mysqlhotcopy]
interactive-timeout

However, I met another after restart mysql:
Error Code: 13. Can't get stat of '/Users/MasterHaoChen/Downloads/MySqlDemo/Hospitals.txt' (OS errno 13 - Permission denied)

I set /usr/local/mysql with chmod -R 755 but it still give error code 13.
I tried use load data local infile but it is not allowed in this version of mysql

I believe you have accidentally posted in the wrong place. This repo is for a Node.js language client driver for mysql.


running error

Problem encountered on https://dotnet.microsoft.com/en-us/learn/dotnet/hello-world-tutorial/run
Operating System: windows
C:\Users\johnn\MyApp>dotnet run
C:\Users\johnn\MyApp\Program.cs(2,1): error CS8802: Only one compilation unit can have top-level statem
ents. [C:\Users\johnn\MyApp\MyApp.csproj]
For some unknown reason my computer failed to run this even though I went through the tutorial as instructed.
Provide details about the problem you're experiencing. Include your operating system version, exact error
message, code sample, and anything else that is relevant.

Hi @smithersonian! I'm sorry you're running into some issues.
That error means you have two projects inside that directory. Usually, when I see that happen, the dotnet new command was run twice, once inside the MyApp folder.
You could try to check if you have two projects inside the MyApp folder (you'd see another folder named MyApp inside of it).
Or you can try to delete and run everything from the start again.
Let us know if this helps! And please share a screenshot of the contents of the MyApp folder if you continue to get that error. (you can run the dir command for example)


The URL to download the pre-training model is invalid, where should I go to download it? https://zenodo.org/records/10664666

Hi, I just retried, the supplemental data is still up and running. Maybe your browser/ISP is blocking it?


[dv,usbdev] DV sequence for packet buffer memory

This PR adds a DV test sequence for exercising the packet buffer memory:

Randomized IN and OUT transactions of random length/content, to randomized buffers and randomized endpoints.
CSR-side randomized packet buffer reads/writes, ensuring no collision with USB-side access.
Checking of all data transfers, in both directions and on both CSR and USB sides.
Aim to induce access collisions (same cycle, don't need to worry about same address); CSR side should be stalled because the packet buffer is implemented using a Single Port RAM now.
CSR-side access to the packet buffer memory only worked if the scoreboard/UVM was capable of predicting the memory contents; this is not the case when the DUT hardware may write to the packet buffer memory at any moment.
usbdev_scoreboard is therefore updated to avoid predictions, making writing possible and relying upon the vseq itself to check the returned read data.
Constraint on 4n packet length is eliminated, and the usbdev_base_vseq tasks 'write_buffer' and 'read_check_buffer' should now be as generic as required for any test sequence.

The changes in the 'usbdev_base_vseq' are more forward-thinking and some of the functionality is not yet required, but as the testing moves to being more thorough, covering more endpoints etc. these tasks should prove useful in the base sequences.
Note that some of the constants used within the DV environment should be lifted from the DUT package/constants in the RTL but presently non-essential changes to the RTL are to be discouraged.

Thanks the review, and sharing the usbdev burden! I think I've addressed everything.


Cookie page

Description
This page tells people how we use cookies.
It's linked to #87
Screenshot
To do
Research
Do all services use the same cookie message?
What is the user need for this?

Where do we list service specific cookie messages?

I am not sure we do. There is no accepted
https://www.tax.service.gov.uk/help/cookies is the page for the platform page.
I was told to have a specific employment intermediaries page so we wrote one based on cookies in the service and platform at that time. I found a lot on the platform page that we did not use so I removed them from the page. I do not think it has been updated since. See https://www.tax.service.gov.uk/employment-intermediary-report/cookies


collectionChanges is firing for every element on a single deletion

I have AngularFire/RxFire code similar to the following:
collectionChanges(
    collection(this.firestore, "col1/doc1/col2"))
.subscribe(changes => {
  console.log('RxFire changes', changes);
});

This generally works: When the page loads, I get added events for every document in the collection. When a document changes, a single modified event fires. However, when a document is deleted, the next change batch includes a removed event (good) and also a modified event for every other element in the collection (bad). 🤔
Any idea why these extra modify events are happening + how to avoid all the extra reads? or is this all from the cache?
I've verified there's no actual change to the other documents in the collection. A single modified change mentions oldIndex and newIndex so I wonder if it's maybe trying to update the index of every element, but there isn't a sort order so any index is undefined anyways.

If it's helpful, as a test I tried the equivalent Firebase code:
const q = query(collection(this.firestore, "collection1/doc1/collection2"));

onSnapshot(q, (snapshot) => {
  const docs = snapshot.docChanges();
  console.log("Changes received", docs);
});

This works as expected and only fires one removed event, which is why I think the bug is in RxFire.

rxfire ^6.0.0 and @angular/fire ^7.4.1 if helpful

@m-dierker Apologies on the delay here! I believe this is because collectionChanges() was updated sometime ago with the includeMetadataChanges option.  This changes the behavior significantly because it accounts for metadata changes within the cache. The Firebase code you provided isn't exactly equivalent because you'd need to include that configuration as well. It also appears that the function was update with some custom code to surface the changes within documents. I didn't make these changes so I'll have to do some testing and see how we should handle this in the upcoming version as it would be a breaking change to modify it at this point.

Any news about this @davideast ? With current SDK version, current version of @angular/fire, collectionChanges observable ticks multiple times on deletion (one updated event and one removed).


Enable globally turning off warnings about using directives in multiple files

We should add a global configuration enabling users to silence the warning about migrating directives to project.scala.  It should be settable with the config sub-command.
So something like:
scala-cli config ignore-directives-in-multiple-files true

Ticket motivated by a comment by @lbialy in https://github.com/VirtusLab/scala-cli/issues/1632#issuecomment-1369764141

what am I doing wrong...?
~ % scala-cli --version
Scala CLI version: 0.2.0
Scala version (default): 3.2.2
~ % scala-cli config ignore-directives-in-multiple-files true
Error: unrecognized key ignore-directives-in-multiple-files

It should be suppress-warning.directives-in-multiple-files


rerender

@conda-forge-admin please rerender

Hi! This is the friendly automated conda-forge-webservice.
I just wanted to let you know that I rerendered the recipe in conda-forge/simple-salesforce-feedstock#5.


Have 'Validating data received via the Mini App' ?

https://core.telegram.org/bots/webapps#validating-data-received-via-the-web-app

any func for ValidateWebAppQuery ? thks

I didn't find any func too

I didn't find any func too

https://github.com/PaulSonOfLars/gotgbot/blob/v2/ext/queryvalidation.go


Juno should log peerid on startup

Juno should display its libp2p peer id when Juno starts up.

I'm new to this repo. Could you please assign this task to me? I'm eager to give it a try

@JorikSchellekens It is already logged please look for the following log:
15:09:40.700 31/01/2024 +00:00  INFO    p2p/p2p.go:206  Listening on    {"addr": "/ip4/<IP_ADDRESS>/tcp/7777/p2p/<PeerID>"}
15:09:40.713 31/01/2024 +00:00  INFO    p2p/p2p.go:206  Listening on    {"addr": "/ip4/<IP_ADDRESS>/tcp/7777/p2p/<PeerID>"}


[epic] Elemental-toolkit next generation

This is a collection of all the tasks required in elemental-toolkit to better align it with upcoming SUSE distributions and other still pending improvements.

[ ] Create an upgrade test from an old installation to current PR
[ ] https://github.com/rancher/elemental-toolkit/issues/1848
[ ] Get rid of all COS references in the code (default labels, paths, etc.)
[ ] Finalize the mount command including discussion concepts (arranged with #1844)
[ ] Keep embedded file permissions on init
[ ] Refactor cloud-init-paths flag to some hooks specific concept
[ ] Default to squashfs for recovery partition
[ ] Refactor to snapshotter interface (including loopdevices implementation)
[ ] Implement btrfs/snapper/tukit snapshotter
[ ] Add --bootloader flag in upgrade command
[ ] Rethink some of the options for build-disk (probably we should assume all expandable disks are unpriviliged and all full disks are always privileged builds and only support for squashfs recovery for expandable images)
[ ] Rethink upgrade command, probably the --recovery flag should imply an active AND recovery image upgrade (also include bootloader upgrade?).

Get rid of all COS references in the code (default labels, paths, etc.)

Hi David, will this break the current running clusters or there will be an upgrade solution? Harvester nodes are all running with COS_ labels and we still need to support existing customers.

@bk201 we are in the process of aligning with the upcoming SUSE distributions, hence it will include relevant refactors of the code and likely to lead us to a v2 version of the toolkit. There are some challenging changes ahead. These are not immediate changes and we already added in high prio setting a proper upgrade test in our CI, so we can detect breaking changes and define proper backward compatibility considerations and constraints.
Regarding the COS_ labels they are configurable and tracked within the state.yaml file. So elemental client reads and applies the labels from there on installed systems. This was already put in place at a time to allow changing default labels without breaking backward compatibility.

@davidcassany Thanks for the explanation.

Closing this issue as we've reached 'v2' for toolkit

@davidcassany From https://github.com/rancher/elemental-toolkit/issues/1927, there seem to be some breaking changes. Does this mean we can't upgrade from v1 to v2? And is v1 going to be maintained in the future? Thanks!

@bk201 there shouldn't be breaking changes and you should be able to upgrade from v1 to v2.
We might do bug fixes in v1 (none are planned at this time) but actually want everyone to move to v2 in the future.

Thank you for the explanation!


IAssocHandler.IsRecommended doesn't return bool

Actual behavior
CsWin32 generates method signature void IsRecommended(); for
[Guid("F04061AC-1659-4A3F-A954-775AA57FC083"),InterfaceType(ComInterfaceType.InterfaceIsIUnknown),ComImport()]
public interface IAssocHandler

which is invalid per documentation:
/// Indicates whether the application is registered as a recommended handler for the queried file type.
/// <returns>
/// <para>Type: HRESULT Returns S_OK if the program is recommended; otherwise, S_FALSE.</para>
/// </returns>

Win32 metadata project contains only
HRESULT IsRecommended();

Expected behavior
IsRecommended correctly returns either HRESULT as-is or returns Windows.Win32.Foundation.BOOL or System.Boolean.
Repro steps

NativeMethods.txt content:

IAssocHandler

Context

CsWin32 version:  0.1.635-beta
Target Framework:  net472

This is a case where we should use [PreserveSig] behavior. You can achieve this now using NativeMethods.json:
{
  "$schema": "C:\\git\\CsWin32\\src\\Microsoft.Windows.CsWin32\\settings.schema.json",
  "comInterop": {
    "preserveSigMethods": [ "IAssocHandler.IsRecommended" ]
  }
}

We want to get this right by default though. https://github.com/microsoft/win32metadata/issues/559 talks about this.
I'll rename this bug and transfer to the metadata repo so they can mark this as preservesig by default.


Support for Alibaba's Qwen models

Describe the feature
hello, I want to using Qwen models in this project
Potential Solutions
I don't know

Open to the integration via litellm, see #64


Address apt loop deprecation

When running tasks

debian family package installation
debian family package removal
virtualbox package installation
vmware package installation

with Ansible 2.7.0 against Ubuntu 18.04, I get:
    ubuntu-1804: [DEPRECATION WARNING]: Invoking "apt" only once while using a loop via
    ubuntu-1804: squash_actions is deprecated. Instead of using a loop to supply multiple items
    ubuntu-1804: and specifying `name: {{ item }}`, please use `name: ['{{ packages_debian }}']`
    ubuntu-1804:  and remove the loop. This feature will be removed in version 2.11. Deprecation
    ubuntu-1804:  warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.

Thanks @mgoodness!
I'll add multiple Ansible versions when testing in the future.


Update JSON schema for plugin v2

Summary
Update JSON schema for Devbox Plugins
How was it tested?

It looks like that's possible: https://json-schema.org/understanding-json-schema/structuring
Can we fix that after the release?

Can we fix that after the release?

yep!


Use non-deprecation password function in acceptance tests

700d2c5bb54b7ea91d518de96e2c7a22318d0afa claimed to complete the work that c3b06d6093b0aab210ec06b11e92a731c608fccd started, but didn't migrate the acceptance tests. This avoids deprecation warnings in the output.

Thanks @ekohl for your contribution.Keeping our tests up-to-date with the changes.Thank you.


[BN] Translation for the Testing Chapter

added the translation for the Tetsting chapter.
@code-shoily and @masnun vai please check this pull request .

There are a few typos and punctuation issues but we can fix them in the second pass. So I say we can merge this :)
Thanks man.

Thank you @prio101 and @code-shoily!


Feature: Apply design changes to Select.tsx

Overview
This pull request addresses the issue #127 by updating the SelectContent, SelectLabel, and SelectItem components to adhere to the design specifications provided in Figma.
Changes

Replaced the caret icon with a new CheckIcon as per the Figma design.
Adjusted padding, border radius, font size, and font weight per Figma design guidelines.

Screen Captures

Assignee Checklist:

[x] The naming convention of the PR title is correct (See the comment at the top of this template)
[x] The base branch is correct (See: Types of Branches)
[x] The branch name follows the Branch Naming Conventions
[x] The correct assignees and reviewers have been designated for this PR
[x] The coding style follows the Coding Style Guide
[x] All the related issues are associated with this PR
[x] All criteria in the associated issues are met (please tick the checkboxes)
[x] My changes do not generate new warnings or errors (especially in the console)

Reviewer Checklist:

[ ] Double-check the "Assignee Checklist"
[ ] The code follows the generic best practices and our Coding Style Guide
[ ] The code is well-commented and easy to understand
[ ] The UI changes accurately reflect the provided design

@AnukratiMehta
Are you still in progress? If you are done with your change, please re-mention us to ask for a second review.
Currently, some errors are happening in the GitHub Actions. I think they will be solved if you merge the develop branch.

@nick-y-ito
No, the changes are done. The checks are passing too now. Hope this works!

@AnukratiMehta
Since there was a conflict with the base branch (develop), I resolved it in the newly created branch feature/127-apply-design-to-SelectContent-resolve-conflict and also fixed the issues I pointed out in the last comment.
Please utilize it as needed. I think you can merge the branch into yours or cherry-pick the commits.

@AnukratiMehta Since there was a conflict with the base branch (develop), I resolved it in the newly created branch feature/127-apply-design-to-SelectContent-resolve-conflict and also fixed the issues I pointed out in the last comment.
Please utilize it as needed. I think you can merge the branch into yours or cherry-pick the commits.

@nick-y-ito
Thanks. I have some questions. I've messaged you. Could you please check? I think it'll be quicker and easier to address them there :)


Throwable declaration must be compatible with ExceptionHandler

Laravel Version: 7.0.4
PHP Version: 7.2.28 and 7.3.15

Description:
app/Exceptions/Handler.php:

But the minimum allowed php version is - 7.2.5.
This section of the documentation does not help, since it does not apply to the php version.
PS: There are no problems with PHP 7.4 - it supports such typing.

Please read the upgrading guide. We fully support PHP 7.2, but you need to update your code as prescribed in the guide.

That phpstorm recommendation looks wrong. Look at the actual code file. It does not have "Exception" in it.

@GrahamCampbell, thanks!

@GrahamCampbell That is true, but any idea how could i now handle Exceptions like in the previous version.
I also think i found a mistake in documentation of laravel 7.x of method render (https://laravel.com/docs/7.x/errors#render-method) it is using old version of this method and i dont think we can still check throwables for exception types. If yes can you explain how please?

@Egzonrexhepi thanks for reporting that. I've sent in a PR to fix those docs: https://github.com/laravel/docs/pull/5866

@driesvints What about the workaround on handling cusotm exceptions now? Thanks for fast reply

@Egzonrexhepi I'm not sure what you mean. What's not working for you?

@driesvints Before the Handler.php was changed we could do something like this to handle custom http exceptions:
  public function render($request, Throwable $exception)     {         if ($exception instanceof  AuthenticationException) {             // handle here         } //        return parent::render($request, $exception);     }
But now that it accepts throwable, how can we do this?

Just like that? It should work exactly the same.

@driesvints My bad, i wass missing header params "Accept: application/json" so therefore the middleware was redirecting and not throwing exception. Thanks anyways!


Proposal: First class secrets support in dev containers implementations

Formal proposal based on https://github.com/devcontainers/spec/issues/219
This proposal do not change the devcontainers spec itself, rather it is a proposal on the implementation of secrets support in supporting tools such as the devcontainers CLI (which could serve as a potential reference implementation)

@chrmarti's major suggestions has been addressed, and the CLI implementation specific aspects has been moved to an issue in the CLI repo
Since he is on vacation dismissing the request for review from him


Extract Portuguese Definitions

Extract Regular Expressions, term lists and dictionaries into YAML for future re-use in future ports

@pcostantini,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by Microsoft. We will now review your pull request.
Thanks,
Microsoft Pull Request Bot

Waiting for folder re-structure PR. Will submit again later


Add WebCatalog v3.1.1

Closes https://github.com/webcatalog/desktop/issues/7
If there’s a checkbox you can’t complete for any reason, that's okay, just explain in detail why you weren’t able to do so.
After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} reports no offenses.
[x] The commit message includes the cask’s name and version.

Additionally, if adding a new cask:

[x] Named the cask according to the token reference.
[x] brew cask install {{cask_file}} worked successfully.
[x] brew cask uninstall {{cask_file}} worked successfully.
[x] Checked there are no open pull requests for the same cask.
[x] Checked the cask was not already refused in closed issues.
[x] Checked the cask is submitted to the correct repo.

Closes webcatalog/desktop#7

For reference, that won’t actually work seem you (don’t seem to) have write permissions to that repo.

Thx for merging @vitorgalvao.

I didn’t merge yet, just approved. Will merge after Travis passes.

Ah, yes. Thx for the heads-up.

@jottr @vitorgalvao  Yay, all passed!


Refstate switching on free kicks and penalties needs to be improved

On free kicks and penalties we need to run a seperate strategy to start it but at some point need to transition to normal play. Can be done through custom refstate but also a strategy that just succeeds.

Some ideas:
Idea 1 - Tree termination
Let a tree terminate and set a new tree (lets call it an 'after success tree') when the tree either succeeds or fails. This requires that free kick always succeeds after a given condition.
Pro's
Flexible when to switch to normal play
Con's
Can be hard to implement and hard to maintain --> even more difficulties while making behaviourtrees
How to determine when you should switch?
Idea 2 - Timing
Switch the tree after a given amount of second / ticks.
Pro's
Relatively easy to implement
Easy to maintain
Does not rely too much on behavior tree implementation to function properly
con's
Less flexible
Can give serious problems when playing real life
How to determine how much time is correct?

Another idea would be event based - as soon as the ball has moved according to the referee's standards, keep running the old tree for some time, for example.

fixed in #340


endorsement policies

I'm sorry to bother you . I want to add an endorsement policies to the code. What should I do?

@ZhiqiangGuo1994 - I want to make sure I understand - you want to add it to this code base? If so - open up a PR? Please clarify if that is not what you asking. tx

@ZhiqiangGuo1994 - I want to make sure I understand - you want to add it to this code base? If so - open up a PR? Please clarify if that is not what you asking. tx

Sorry, you may have misunderstood what I mean. At present, I am experimenting with this framework. I have encountered some problems in the process and would like to ask the author. I don't want to modify the entire framework.

@ZhiqiangGuo1994 We have not tried the endorsement policies part here. You might need to refer to the test code here - https://github.com/hyperledger/fabric-sdk-java/blob/master/src/test/java/org/hyperledger/fabric/sdk/ChaincodeEndorsementPolicyTest.java.


Traceability QR --> Alert

In the screen of Requirements, enable to visualize the alert (e.g. with a small screen visualizing the details of the alert).

we can use a modal window, like when the decisions are shown in the Alerts View, showing the information of the alert


Warning: Tap migration for tofuutils/tap/tofuenv points to itself, stopping recursion.

Original ticket: https://github.com/tofuutils/tofuenv/issues/56
Homebrew is presenting the following WARNING after upgrade or clean install.
brew tap tofuutils/tap
==> Tapping tofuutils/tap
Cloning into '/opt/homebrew/Library/Taps/tofuutils/homebrew-tap'...
remote: Enumerating objects: 107, done.
remote: Counting objects: 100% (107/107), done.
remote: Compressing objects: 100% (85/85), done.
remote: Total 107 (delta 44), reused 39 (delta 11), pack-reused 0
Receiving objects: 100% (107/107), 22.93 KiB | 1.91 MiB/s, done.
Resolving deltas: 100% (44/44), done.
Tapped 2 formulae (24 files, 42.9KB).
brew install tofuenv
==> Fetching tofuutils/tap/tofuenv
==> Downloading https://github.com/tofuutils/tofuenv/archive/refs/tags/v1.0.5.tar.gz
Already downloaded: /Users/xxxx/Library/Caches/Homebrew/downloads/308230ab939032d22db108b0065b9c195ad39b4a0233551e8933b86f966dcdfa--tofuenv-1.0.5.tar.gz
==> Installing tofuenv from tofuutils/tap
Warning: Tap migration for tofuutils/tap/tofuenv points to itself, stopping recursion.
🍺 /opt/homebrew/Cellar/tofuenv/1.0.5: 30 files, 737.1KB, built in 3 seconds
==> Running brew cleanup tofuenv...
Disable this behaviour by setting HOMEBREW_NO_INSTALL_CLEANUP.
Hide these hints with HOMEBREW_NO_ENV_HINTS (see man brew).
Warning: Tap migration for tofuutils/tap/tofuenv points to itself, stopping recursion.
Warning: Tap migration for tofuutils/tap/tofuenv points to itself, stopping recursion.

Fixed by @Nmishin


Fixed type with HapticService.SetMotor

Docs say this takes a tuple (which might actually be incorrect internally, but I can't be sure), so to be as accurate as possible I've changed thate.

You've made your change in generated/None.d.ts. As the name implies, this file shouldn't be edited by hand. For changing the auto-generation output, you can add types in customDefinitions.d.ts.
However, this change has come up before, and was found to likely be an inaccuracy in the API dump. See #595.


Flash attn

[x] compile flash attention
[x] perform fusion and flash-self/cross-attention on model state
[ ] get it to run
[ ] combine with LoRA
[ ] combine with 8-bit

Enabling Flash attention
GPTLMHeadModel(
  (transformer): GPTModel(
    (embeddings): GPT2Embeddings(
      (word_embeddings): Embedding(50400, 4096)
    )
    (layers): ModuleList(
      (0-27): 28 x ParallelBlock(
        (mixer): MHA(
          (rotary_emb): RotaryEmbedding()
          (Wqkv): FusedDense(in_features=4096, out_features=12288, bias=False)
          (inner_attn): FlashSelfAttention()
          (inner_cross_attn): FlashCrossAttention()
          (out_proj): FusedDense(in_features=4096, out_features=4096, bias=False)
        )
        (dropout1): Dropout(p=0.0, inplace=False)
        (norm1): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
        (mlp): FusedMLP(
          (fc1): Linear(in_features=4096, out_features=16384, bias=True)
          (fc2): Linear(in_features=16384, out_features=4096, bias=True)
        )
        (dropout2): Dropout(p=0.0, inplace=False)
      )
    )
    (drop_f): Dropout(p=0.0, inplace=False)
    (ln_f): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
  )
  (lm_head): Linear(in_features=4096, out_features=50400, bias=True)
)

Install GPT-NEOX
source ~/.bashrc.mamba
mamba create -n gptneox
conda activate gptneox
mamba install python=3.8 -y
mamba install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia -y
cd gpt-neox/
pip install -r requirements/requirements.txt
mamba install cudatoolkit-dev=11.7 cudatoolkit=11.7 -c conda-forge -c nvidia -y
unset CUDA_HOME
python ./megatron/fused_kernels/setup.py install
pip install -r ./requirements/requirements-flashattention.txt
cd ..
git clone https://github.com/EleutherAI/DeeperSpeed.git
cd DeeperSpeed
./install.sh
python prepare_data.py -d ./data
wget --cut-dirs=5 -nH -r --no-parent --reject "index.html*" https://the-eye.eu/public/AI/models/GPT-NeoX-20B/slim_weights/ -P 20B_checkpoints

Now can train, fine-tune, inference with Flash attention by changing the config file for neox to specify attention_type to flash.
diff --git a/configs/20B.yml b/configs/20B.yml
index 6595919..52dfbfb 100644
--- a/configs/20B.yml
+++ b/configs/20B.yml
@@ -14,12 +14,13 @@
   # parallelism settings ( you will want to change these based on your cluster setup, ideally scheduling pipeline stages
   # across the node boundaries )
   "pipe-parallel-size": 4,
-  "model-parallel-size": 2,
+  "model-parallel-size": 1,

   # model settings
   "num-layers": 44,
   "hidden-size": 6144,
   "num-attention-heads": 64,
+  "attention_config": [[["flash"], 44]],
   "seq-length": 2048,
   "max-position-embeddings": 2048,
   "norm": "layernorm",

The change to model parallel size is to use one pipeline per GPU, required to satisfy deep.py
Run generation like:
./deepy.py generate.py ./configs/20B.yml

Use fast attention with LLaMa from Vicunda/FastChat  repo:
Special transformers hash
Patch1
Patch2


[Run] Empty protocol handlers

Microsoft PowerToys version
0.49.0 RC
Running as admin

[X] Yes

Area(s) with issue?
PowerToys Run
Steps to reproduce
The addition of being able to handle protocols  to launch items is very cool. But it would be really nice to be able to "run" just an empty protocol handler. For example, I routinely use the address bar toolbar on the taskbar to run simply "mailto:" . This then launches an empty new email with my default client.
Would be sweet to have similar functionality in the Run power toy.
✔ Expected Behavior
Be able to run an empty protocol (ie. mailto: ) and it would launch the appropriate handler application (ie. Outlook ).
❌ Actual Behavior
It will not run an empty handler, but just does nothing when hitting  .
Other Software
No response

This is fixed in 0.51.  Please head over to our releases and get the update!  https://aka.ms/installpowertoys


fix DataTypeAggregateFunction deserialization

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en
Category (leave one):

Bug Fix

Short description (up to few sentences):
Try to fix 6575.
I have to enlarge DEFAULT_MAX_STRING_SIZE in dbms/src/IO/ReadHelpers.h, and max_query_size in users.xml.

Ok. But test is missing.
Could you please make a simple functional test
(it can involve remote('127.0.0.{2,3}', ... to emulate distributed queries, see examples around; it should contain shard in it's name as a tag that it performs distributed query)

@alexey-milovidov I don't understand how remote('127.0.0.{2,3}', ... to emulate distributed queries work. Could you provide document or code link?

The log indicates that the standalone node receives the query which aim to <IP_ADDRESS>, without listening on <IP_ADDRESS>.

We run ClickHouse that listen to :: (everything) to run tests with shard tag.


Fix deserialization bug

Fix for #45643
When the status code of RouteMatrix is not 200, the response is null now.

API change check
API changes are not detected in this pull request.


Use next_node blocks in register-a-death

We've agreed to consistently use next_node {} to define our next node rules. Having a single way of defining the rules will hopefully make Smart Answers easier to develop and maintain.
This will ultimately allow us to remove the predicate code (define_predicate, on_condition, next_node_if etc).

Looks good to me :+1:

I've rebased on master and force-pushed in preparation for merging.


Check description for null

Resolves #3.

Confirmed to work in https://github.com/sloede/test-add-pr-review-checklist/pull/3.


Detect the package names from the module description attribute

I added some tests from the WIP here
Related to #96

Coverage remained the same at 100.0% when pulling 53c3ae219490d4845594dc19294b2de506dc299c on Caligone:detect-names-from-attributes into a73f00e6ac119869267951e41b8d46d97feeb849 on stefanjudis:master.

Ahh... :( Sorry for the delay.
I think that's fine. Can you maybe resolve the conflicts?

Coverage remained the same at 100.0% when pulling 03adfbdcfb36de40fb3c646bd6e50fcf64525b4f on Caligone:detect-names-from-attributes into dc6ed4a56c5b51f4a0b525a3d14c38616fd8757b on stefanjudis:master.

Done

@Caligone Hey sir... I'm so sorry about the delay... currently I really have no time to check open source at GitHub. :)


[SPARK-50704][SQL] Support more pushdown functions for MySQL connector

What changes were proposed in this pull request?

This PR tries to implement more pushdown functions for MySQL connector.
ABS COALESCE GREATEST LEAST RAND LOG10 LOG2 LN EXP POWER SQRT SIN COS TAN COT ASIN ACOS ATAN
ATAN2 DEGREES RADIANS SIGN SUBSTRING UPPER LOWER SHA1 SHA2 MD5 CRC32 BIT_LENGTH CHAR_LENGTH CONCAT

Why are the changes needed?

There are Spark SQL functions having the same function signature and similar semantic in MySQL. This PR tries to support these SQL functions in pushdown and added integration tests to make sure it works for valid types.
Does this PR introduce any user-facing change?

'No'
How was this patch tested?

Integration tests added.
Was this patch authored or co-authored using generative AI tooling?

'No'

cc @beliefer


Allow overriding hermes-engine binary location

Summary:
My organization blocks/proxies MavenCentral to an internal nexus registry. Currently there is no way to use another url to get the Hermes binary from. This change would allow setting that url as an environment variable.
Changelog:
Adds an environment variable to override default Hermes binary location
Test Plan
Set environment variable for override, block mavencentral via /etc/hosts, successful pod install
tags: [IOS] [ADDED]

Hi @henrygrant, thank for this PR.
I start thinking that it could be time to change how Hermes is downloaded to give everyone more configurability without adding so many env variables and flags. Even internally, we are receiving various requests to change how Hermes is downloaded and from where. I'd rather wait to merge this PR until we figure out a better way to handle this.
How do you feel about the idea?

Also you can use HERMES_ENGINE_TARBALL_PATH to effectively circumvent this

Hi @henrygrant, thank for this PR.
I start thinking that it could be time to change how Hermes is downloaded to give everyone more configurability without adding so many env variables and flags. Even internally, we are receiving various requests to change how Hermes is downloaded and from where. I'd rather wait to merge this PR until we figure out a better way to handle this.
How do you feel about the idea?

Perfectly fine with this idea.

I don't believe I can, as file:// is hardcoded in the use_tarball() function.

I don't believe I can, as file:// is hardcoded in the use_tarball() function.

(I suppose this was related to my answer). You can download the tarball & re-host it inside your repo or your infrastructure. Agree that having file:// hardcoded is also also not great as it prevents to use arbitrary URIs which would probably allow you to just pass an https:// resource here.

Oh, yeah that's what we're doing now. Thanks for the suggestion regardless!


Argo CD + Istio Gitops tutorial

@sriumcp @kalantar @fabolive here's a draft of the GitOps tutorial. One caveat is this PR needs to be merged to the master branch of this repo for all the references/links to work properly.
The intention of this PR is to provide an initial point of view on how one would use Iter8 in a GitOps scenario, and it's specific for Argo CD + Istio. There are quite a few things that could be improved, e.g., using metrics collector instead of fortio, using a real CI pipeline tool instead of runCI.sh to simulate one, etc. These will be done in a follow up tutorial - to explore Iter8 in a full blown CI/CD pipeline, specifically using Openshift Pipeline and Openshift GitOps. In the process, we will figure out what we need to do to get Iter8 v2 to work in an Openshift cluster.

 I see other merged PRs are also failing checks...

@kalantar @sriumcp what's up with the failing build? I see other merged PRs are also failing checks...

Github was/may still be affected by the fastly outage this morning.

Re: failing build, it is due to a breaking change in mkdocs.
Part of the reason why my PR is big is because I pushed a fix for this (among other things :)

Part of the reason why my PR is big is because I pushed a fix for this (among other things :)

I great smaller PR that would have enabled others more quickly :)

Part of the reason why my PR is big is because I pushed a fix for this (among other things :)

If you could push the fix as a separate PR, that will help.
OTOH, If you have suggestions about making this GitOps PR smaller, please let me know. At the moment, this PR includes all the resource files in samples/gitops as well as the tutorial doc in mkdoc/tutorials/gitops. They need to be in sync to make the review possible. I don't know if it's possible to break them into separate PRs for them to still make sense.

@sriumcp @kalantar thanks for the feedbacks. I'll make the suggested changes soon


Create multitenancy.md

If the "What it is" section looks too verbose, the last 1 or even 2 paragraphs of it can be deleted, although I have re-read everything carefully and do believe that they provide important supplementary information that is not redundant.
I confirm that this is completely my own work, although in the world of term definitions you can always find fragments similar to each other even if they were developed independently.
Signed-off-by: Sergey Borovoy<EMAIL_ADDRESS>

The spellchecker says that multitenancy is not a word.  Apparently, it prefers "multi-tenancy".  Well, it's spelt without the dash in sources like Wikipedia, Gartner, RedHat, SAP, Google (https://cloud.google.com/datastore/docs/concepts/multitenancy) and many more.  (Spelling with the dash is also common, which I pointed out in the article. )
I believe that the spellchecker should be overridden.

Hi @sergeyborovoy
You can add multitenancy (also related new words if necessary) in https://github.com/cncf/glossary/blob/main/wordlist.txt
The commit for updated wordlist.txt also can be included in this PR. :)

Sorry I'm not a fluent github user so the best I could do is a new PR :)

Hi @iamNoah1 :)

it is better to have both in the same PR

I agree with you. But, since @sergeyborovoy already created a PR #1157 to update wordlist, let's proceed ..
@sergeyborovoy when you define a new term next time, please try to add updated wordlist with in the same PR. :)

force-push: added the word multitenant to wordlist.txt, which is also needed to pass spellcheck but not covered in the PR #1157.

@sergeyborovoy, looks like you closed comments and completely ignored my edits. You can still accept them and change whatever you think I might have gotten wrong and start a conversation (explain why you disagree). But please don't simply disregard feedback from Glossary maintainers. There are some stylistic improvements I would rather not lose.

Hi @sergeyborovoy
I think you don't have to click Resolve conversation
unless you are completely sure all folks involved in a review conversation are on a same page. (if a maintainer is involved, you'd better to wait until the maintainer agree with the result of a conversation. (because maintainers are highly responsible of all contents as well as the project itself)
I guess you are not familiar with Github and interactions in an opensource community yet. Please consider this is a learning curve.
Could you reopen closed conversations and re-initiate conversation ? (you can click Unresolve conversation button.

Hi @CathPag, hi @seokho-son
My apologies, I guess was under the impression that by clicking "Resolve conversation", I tell github to merge the suggested changes.  Like I said, I'm not a regular user of github.
I just unresolved everything and clicked "Sign off and committ suggestions" everywhere.

Hi @CathPag, hi @seokho-son My apologies, I guess was under the impression that by clicking "Resolve conversation", I tell github to merge the suggested changes. Like I said, I'm not a regular user of github. I just unresolved everything and clicked "Sign off and committ suggestions" everywhere.

No worries. Glad to hear you were not totally ignoring my 😅

@sergeyborovoy, just following up on this. I think it's pretty close! Would love to merge soon :)

Hi @CathPag sorry about the delay, I've been traveling.  Just signed off on your changes, thank you for your input!

Thanks, @sergeyborovoy!
@iamNoah1, can you please review this PR?

Awesome, thanks for your contribution, @sergeyborovoy. Any chance I could interest you in helping with the stateless app definition?

Hi @CathPag, I was about to respond with an enthusiastic "yes" but then I went to the GitHub issue page and saw that this article seems to have an (unusually?) painful history.  I'd like to figure out why before I commit to it.  I'm traveling right now but some time before the next wekend I hope to be able to carve out a free moment for this.
Should I delete the sergeyborovoy:patch-1 branch of Multitenancy?

It's just not an easy term, and we need someone with a strong technical background to work on it.  You seem to have one which is why I asked you :)
Yes, now that the term is merged, you can delete your branch.


The url property on share component doesn't seems to work

i put the url property and the components still goes for the window.location.href

This bug is confirmed and was fixed with an update to v0.3.0. Thanks.


added escape character

@Zino-ctrlZ what did you change here other than switching one element to have double quotes and reformatting the whole file?

fixed the formatting issue now


TLS weird hostname translation to IP

When configuring Skydive to use TLS I have found an strange behaviour.
The config file looks like:
tls:
  client_cert: /path/certs/client/client.pem
  client_key: /path/certs/client/client.key

  server_cert: /path/server.pem
  server_key: /path/server.key
  ca_cert: /path/ca.pem

analyzers:
  - foo.domain.com:8082

...

(foo.domain.com resolves to <IP_ADDRESS>)
If I start skydive analyzer it return an error, complainig because the invalid cert:
2020-07-09T11:45:05.079+0200    INFO    analyzer/analyzer.go:55 glob..func1     archer: Skydive Analyzer started !
2020-07-09T11:45:05.079+0200    INFO    hub/replication_endpoint.go:141 (*ReplicatorPeer).connect       archer: Connecting to peer: wss://<IP_ADDRESS>:8082/ws/replication
2020-07-09T11:45:05.080+0200    INFO    websocket/client.go:528 (*Client).Connect       archer: Connecting to wss://<IP_ADDRESS>:8082/ws/replication
2020-07-09T11:45:05.144+0200    ERROR   websocket/client.go:585 (*Client).Start.func1   archer: Unable to create a WebSocket connection wss://<IP_ADDRESS>:8082/ws/replication : x509: cannot validate certificate for <IP_ADDRESS> because it doesn't contain any IP SANs

Looking at the code I have found the function AddressFromString which is converting the hostname to an IP address.
Why is that needed?
Removing that translation from host to IP it works correctly.

The patch:
diff --git a/graffiti/service/address.go b/graffiti/service/address.go
index 882714be..81fd774c 100644
--- a/graffiti/service/address.go
+++ b/graffiti/service/address.go
@@ -61,10 +61,10 @@ func AddressFromString(addressPort string) (Address, error) {
        }

        // just take the first address returned
-       addr := normalizeIPForURL(ips[0])
+       _ = normalizeIPForURL(ips[0])

        return Address{
-               Addr: addr,
+               Addr: host, // NOCOMMIT prueba a ver si usa el hostname
                Port: portNum,
        }, nil
 }

You could try to send a PR remove the call of this function so that the CI will test the fix. The scale job tests TLS

#2257

Closed in #2257


Incorporating Browser Page to the Default App

a. Browser Page
b. Connect to Browser Page on Open WiFi Network Connections
c. TopBar User Control and applied across Pages
Minor fixes

@sukusuma,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

It seems like the merge in the first change should be a rebase rather than merge.

Looks good. Added a few comments. Also please rebase the changes on ms-iot/develop

👍


Validate: update email regex to not allow invalid email addresses

old regex allowed foo@foo

👍

👍

The old regex allowed<EMAIL_ADDRESS>The new regex doesn't allow it.
The PHP one also allows for<EMAIL_ADDRESS>XN—11B4C3D is a TLD taken from http://data.iana.org/TLD/tlds-alpha-by-domain.txt
This seems to fix it.
^[a-zA-Z0-9_.+\-]+@(?:[a-zA-Z0-9](?:[a-zA-Z0-9\-]*[a-zA-Z0-9])?\.)+[a-zA-Z0-9\-]{2,63}$

Did not know there was a tld list


[Python] support for complex32 and complex64 as primitive types for zero-copy interop with numpy

Describe the enhancement requested
Hello Arrow team,
First, I love Arrow - thank you so much for making this great project.
I am manipulating multi-dimensional array data (time-series like) that is produced from sensors as numpy arrays of type complex64. I would like to manipulate them in arrow for recording (feather and/or parquet formats) and distributed computing in the future (cu-df, dask, spark - most likely frameworks on top of arrow, but also cupy/scipy). This would also allow me to write column names and other schema metadata. I think it could be superior (and faster) than manipulating numpy arrays.
It would be great to just call pa.array(np.array([1 + 2 * 1j, 3 + 4 * 1j], dtype=np.complex64), type=pa.complex64()) but that type doesn't exist in Arrow. I haven't found a way to zero-copy a complex64 numpy array into a pyarrow array (my understanding is that only primitive types support zero-copy between arrow and numpy, and pa.binary(8) or struct attempts on top of numpy views so far have resulted in copies). I would also need to read it back from a feather/parquet format and potentially convert it to a numpy array if needed, and land back on np.complex64.
I think this has come up one or twice already: I found this thread<EMAIL_ADDRESS>and this PR: https://github.com/apache/arrow/pull/10452 and thought I would also +1 this request, just in case.
If no first class support, do you see an alternative way to get zero-copy behavior?
Thanks!
Component(s)
Python

My initial thought here is that we could represent it via an extension type, are complex32 and complex64 internally represented using 32-bit and 64-bit values respectively? Or are they larger than 4 and 8 byte values?
@lidavidm @pitrou @bkietz thoughts?

General issue about complex support:

https://github.com/apache/arrow/issues/16264

This indeed could be a canonical extension type.

complex64 is 8 bytes in numpy  - the dtype description is <c8.  Would a canonical extension type provide zero-copy interop?

Yes, a canonical extension type would provide zero-copy interop. The underlying representation could still be identical (a contiguous buffer of 8-byte values for example) which would have the underlying physical type of uint64 or something. Anything that recognizes the metadata and chooses to identify the extension type could then be able to interpret the values accordingly as complex64 values. I highly recommend putting together a proposal for these as canonical extension types.

got it - could the underlying type be binary(8) instead of uint64? feels a bit weird to represent a complex64 (2 32-bit floats) as a 64bit int? even if the underlying type representation doesn't end up getting used?

The only way for it to be zero-copy is if the underlying physical type matches the numpy representation. A struct of {real: float32, imag: float32} wouldn't be represented identically (it would be two separate buffers of float32s). A fixedList of floats makes sense and would provide the ability for zero-copy though. So that could work.
Personally, I think that representing as an extension type with fixed-size-list would be easier and better than creating entirely new primitive types. But that's just my thought, anyone else wanna chime in here?

Yes, I think fixed_size_list<float, 2> is a good start.

got it. Is there an example of an extension type PR/proposal that I could get inspiration from?

FixedShapeTensor is a canonical extension type which also uses fixed_size_list in its storage type. It was added in #8510, and mailing list discussion and vote is archived.
As for numpy zero copy: we don't currently have a canonical extension type which maps to a numpy type like this one would. In order to support this, it'd be necessary to modify functions like NumPyDtypeToArrow which maps from a numpy type to an arrow DataType. That might be sufficient for NumPyConverter::ConvertData to recognize zero-copy compatibility


add single-connection to tacacs_servers

Change Summary
Per the feature request submited:
"add single-connection knob to tacacs server"
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Code style update (formatting, renaming)
[ ] Refactoring (no functional changes)
[X] Documentation content changes
[ ] Other (please describe):

Related Issue(s)
Fixes #837
Component(s) name
arista.avd.eos_cli_config_gen
Proposed changes
Per the issue linked, I only updated the configuration generation and documentation related to tacacs-server config.
How to test
Molecule tests updated.
Checklist:

[X] My code has been rebased from devel before I start
[X] I have read the CONTRIBUTING document.
[X] My change requires a change to the documentation.
[X] I have updated the documentation accordingly.
[X] I have updated molecule CI testing accordingly
[X] All new and existing tests passed (pre-commit, make linting and make sanity-lint).

This one should be ready to review since it is passing CI.


Misc Refactoring

I completed some refactoring tasks in a single PR, so this is going to be rebased.
I used a single PR because it would take a lot longer to open 5 PRs and have them reviewed and the changes are small enough for them not to interfere with each other too much.
So here's what I did:

Made Release the default build type. This reduces the filesize from over 100M to 3. Fixes #1497
Removed the C compiler from the project because we don't actually use it, but it's still present in many scripts adding complexity
Cleaned up gitignore so that each directory that has some ignored files has its own .gitignore
Removed the useless Makefile from the project root
Completely removed icon_t because it's the same as label_t

If you'd rather have each change in its own PR, let me know.

Codecov Report

Merging #1553 into master will not change coverage.
The diff coverage is 0%.

@@          Coverage Diff           @@
##           master   #1553   +/-   ##
======================================
  Coverage    23.6%   23.6%
======================================
  Files          50      50
  Lines        2067    2067
======================================
  Hits          488     488
  Misses       1579    1579

Flag
Coverage Δ

#unittests
23.6% <0%> (ø)
:arrow_up:

Impacted Files
Coverage Δ

include/drawtypes/label.hpp
80% <ø> (ø)
:arrow_up:

include/components/builder.hpp
100% <ø> (ø)
:arrow_up:

src/drawtypes/label.cpp
2.23% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c3ef99b...55c41a7. Read the comment docs.

Hey @NBonaparte can we get this merged?


Strange behaviour for ColumnSeries

In the debug output I found this strange message:
Error: 5 : Value produced by BindingExpression is not valid for target property.; Value='' BindingExpression:Path=(0); DataItem='ColumnSeries' (Name=''); target element is 'TextBlock' (Name=''); target property is 'FontFamily' (type 'FontFamily')
How to reproduce?
I have a SeriesCollection with some ColumnSeries initialized with this properties:
ColumnSeries TestStats = new ColumnSeries
{
Values = new ChartValues { new ObservableValue(0) },
MaxColumnWidth = 250,
DataLabels = true,
LabelPoint = point => point.Y.ToString(),
Title = "Stats " + i.ToString(),
};
Extra notes
If I comment the Datalabel and LabelPoint, the message doesn't appear.
I am using

Live-Charts version
0.7.17

.Net Version
4.6.1

Windows
7

This should be already fixed in #363. I think it would become available in next release v 0.8

Thnak you @rusanov-vladimir I close this thread as duplicate.


Document API Worker

Idea: Maybe we can make a markdown file in this repo explaining the endpoints of the worker.
I can redirect http://metadata.speedcdnjs.com and http://metadata.speedcdnjs.com/help to that page.

Imo, we should probably keep it undocuemented to reduce the chances that folks become reliant on it. The app will (#32) have all the endpoints "documented" through methods, I don't think we should go further.

sgtm!


Setup documentation generation with Orchid

TODO

@mpgirro Can you expand on this?

Well I just created this issue as a reminder to play around with Orchid. Around the time I started this lib, I came across some project website that looked nice, and thought I could give Orchid a try here. At least from a quick look it seemed like an easy and automatic way to ship a project website GH pages that includes KDoc in a visual appeal that looks "natural". If this is true, Idk tbh, but this other project's website at least looked like that (I really can't remember anymore what the website was unfortunately).
Still haven't given it a try ever since, so maybe I am wrong. Nothing is a must. If you have a better idea or good experiences with another tool/setup, I am open.
We can also simply transform this issue into a "setup project website" thing.

No, I don't really have much experience with this kind of things at all, if I'm honest. But thanks for explaining me :)

I've added a basic setup in the orchid branch, mostly as a proof of concepts and to evaluate the technology for now.
Running on localhost:
./gradlew clean orchidServe -PorchidDiagnose=true

Current features:

Generates website based on the markdown files in src/orchid/resources/
Includes (for now) the GitHub Readme content in the homepage
Includes the Dokka API doc in the website structure.
Builds a change log page based on individual entries for each version in src/orchid/resources/changelog/
Includes the GitHub repository wiki. Just a dummy page in there for now. Could be used to write the documentation and have the website just mirror the entries.

Current issues:

The included Dokka documentation I missing the links between the API pages (classes, packages, etc). I've fixed all errors and warnings reported when running orchidServe with --diagnose. Yet the issue remains.


Generate WebAPK while installing PWA

Please show your interest here: https://crbug.com/1243583#c3.

Hello Alexey,
Done, and I've linked to the website of Maximiliano Firtman as well, so they can understand how and why PWAs are important.

Keeping the issue open

Edge + Samsung seems to have shown interest

Any progress?

Any progress?

Unfortunately not, we have to remain patient.

Any progress?


fix #19 Date Time Format for News Items

Fixes #19 Date Time Format for News Items
Changes
Used Date Time Formatter to Change the Simple Date Time received from the API to a customized one.
Screenshots

Great work 😀


This is very cool

Just wanted to say this is a cool project. I did something similar, but I created seeds with Faker. This seems like a much cleaner way to do it. That's all. No actual issues, just wanted to say, great job.

Issue closed to prepare for Repository Archival


chore: add missing build tag

What type of PR is this?
/kind chore

What this PR does / why we need it:

adds missing build tag

Which issue(s) this PR fixes:

Fixes #
Requirements:

[x] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+1.7%) to 44.391%

Totals

Change from base Build<PHONE_NUMBER>:
1.7%

Covered Lines:
186

Relevant Lines:
419

💛  - Coveralls


Export services in a single file for better code readability

Before
import { CentralServerService } from './services/central-server.service';
import { ComponentService } from './services/component.service';
import { ConfigService } from './services/config.service';
import { LocalStorageService } from './services/local-storage.service';
import { LocaleService } from './services/locale.service';
import { MessageService } from './services/message.service';
import { SpinnerService } from './services/spinner.service';
import { StripeService } from './services/stripe.service';
import { WindowService } from './services/window.service';

After
import {
  AuthorizationService,
  CentralServerService,
  ComponentService,
  ConfigService,
  LocalStorageService,
  LocaleService,
  MessageService,
  SpinnerService,
  StripeService,
  WindowService,
} from './services';

This can be done for other folders. (assets, pages etc...)

import { MessageService } from '../../../services/message.service';
import { SpinnerService } from '../../../services/spinner.service';
import { WindowService } from '../../../services/window.service';```

to

```import { CentralServerService, MessageService, SpinnerService, WindowService } from '@services';


Expected outcome needs to be changed for TC-DRLK-3.2 Steps 14, 16, 17

Summary Title:
For TC-DRLK-3.2, the expected outcome in the verifications sheet doesn't show the right commandID values for steps 14, 16 and 17
Description:
For TC-DRLK-3.2, step 14, the expected commandID is 0x1b. The verification sheet shows 0x1c. Here is the spec screenshot for the same showing 0x1b.

The same for step 16 and step 17. The expected outcome for these steps are 0x22 and 0x24.
Steps to reproduce:
Please execute steps 14, 16 and 17 with chip-tool and compare the commandIDs that are shown in the log with the Spec and the Verification Document expected outcome for that step. Observe that the commandIDs shown by the chip tool logs and Specs match but the same is different from what is shown in the Verification Document expected outcome.

It's a Verification steps issue. Now it has been updated in the Verification steps document. Issue: https://github.com/project-chip/matter-test-scripts/issues/50

@Garik098 fixed in PR 30120 please verify it and close the ticket.