[Remote Store] Performance test setup

Describe the solution you'd like
A performance test setup integrated with opensearch-benchmark which will run and report performance numbers on each commit. This will enable us to catch any performance regressions up-front.

Setup

Tool used: opensearch-benchmark
OpenSearch Benchmark Test: nyc_taxis
Cluster

3 node cluster with each node - r5.2xlarge

Benchmark node - r5.2xlarge
Non-optimized implementation of Remote Segment Store
Remote translog is not supported
GitHub Commit ID: https://github.com/sachinpkale/OpenSearch/commit/6c11fd60396f211d17ccc3a34f466af43ffcea53

Observations

Indexing latency and throughput are impacted
The quick first change would be to cache list of files in remote segment store in memory

Metric
Task
Without Remote Storage
With Remote Storage
Diff
Unit

Cumulative indexing time of primary shards

254.623
299.414
44.7913
min

Min cumulative indexing time across primary shard

254.623
299.414
44.7913
min

Median cumulative indexing time across primary shard

254.623
299.414
44.7913
min

Max cumulative indexing time across primary shard

254.623
299.414
44.7913
min

Cumulative indexing throttle time of primary shards

0
0
0
min

Min cumulative indexing throttle time across primary shard

0
0
0
min

Median cumulative indexing throttle time across primary shard

0
0
0
min

Max cumulative indexing throttle time across primary shard

0
0
0
min

Cumulative merge time of primary shards

95.0004
106.406
11.4051
min

Cumulative merge count of primary shards

221
201
-20

Min cumulative merge time across primary shard

95.0004
106.406
11.4051
min

Median cumulative merge time across primary shard

95.0004
106.406
11.4051
min

Max cumulative merge time across primary shard

95.0004
106.406
11.4051
min

Cumulative merge throttle time of primary shards

3.72203
4.29547
0.57343
min

Min cumulative merge throttle time across primary shard

3.72203
4.29547
0.57343
min

Median cumulative merge throttle time across primary shard

3.72203
4.29547
0.57343
min

Max cumulative merge throttle time across primary shard

3.72203
4.29547
0.57343
min

Cumulative refresh time of primary shards

2.32588
1.73848
-0.5874
min

Cumulative refresh count of primary shards

119
84
-35

Min cumulative refresh time across primary shard

2.32588
1.73848
-0.5874
min

Median cumulative refresh time across primary shard

2.32588
1.73848
-0.5874
min

Max cumulative refresh time across primary shard

2.32588
1.73848
-0.5874
min

Cumulative flush time of primary shards

5.48385
18.8994
13.4155
min

Cumulative flush count of primary shards

31
29
-2

Min cumulative flush time across primary shard

5.48385
18.8994
13.4155
min

Median cumulative flush time across primary shard

5.48385
18.8994
13.4155
min

Max cumulative flush time across primary shard

5.48385
18.8994
13.4155
min

Total Young Gen GC time

190.253
199.536
9.283
s

Total Young Gen GC count

20376
21046
670

Total Old Gen GC time

0
0
0
s

Total Old Gen GC count

0
0
0

Store size

23.4558
23.4502
-0.00567
GB

Translog size

5.12E-08
5.12E-08
0
GB

Heap used for segments

0
0
0
MB

Heap used for doc values

0
0
0
MB

Heap used for terms

0
0
0
MB

Heap used for norms

0
0
0
MB

Heap used for points

0
0
0
MB

Heap used for stored fields

0
0
0
MB

Segment count

27
27
0

Min Throughput
index
66289.9
58847.9
-7442.06
docs/s

Mean Throughput
index
69768.5
61950.5
-7818.04
docs/s

Median Throughput
index
68763
61035.3
-7727.71
docs/s

Max Throughput
index
75814.3
69285.9
-6528.36
docs/s

50th percentile latency
index
1032.17
1190.8
158.637
ms

90th percentile latency
index
1608.38
1801.82
193.443
ms

99th percentile latency
index
2900.14
3346.61
446.468
ms

99.9th percentile latency
index
4062.04
5071.4
1009.36
ms

99.99th percentile latency
index
5209.35
5894.15
684.797
ms

100th percentile latency
index
6027.82
6071.15
43.3313
ms

50th percentile service time
index
1032.17
1190.8
158.637
ms

90th percentile service time
index
1608.38
1801.82
193.443
ms

99th percentile service time
index
2900.14
3346.61
446.468
ms

99.9th percentile service time
index
4062.04
5071.4
1009.36
ms

99.99th percentile service time
index
5209.35
5894.15
684.797
ms

100th percentile service time
index
6027.82
6071.15
43.3313
ms

error rate
index
0
0
0
%

Min Throughput
wait-until-merges-finish
0.00676
0.00766
0.00089
ops/s

Mean Throughput
wait-until-merges-finish
0.00676
0.00766
0.00089
ops/s

Median Throughput
wait-until-merges-finish
0.00676
0.00766
0.00089
ops/s

Max Throughput
wait-until-merges-finish
0.00676
0.00766
0.00089
ops/s

100th percentile latency
wait-until-merges-finish
147827
130610
-17216.5
ms

100th percentile service time
wait-until-merges-finish
147827
130610
-17216.5
ms

error rate
wait-until-merges-finish
0
0
0
%

Min Throughput
default
3.01439
3.01761
0.00322
ops/s

Mean Throughput
default
3.02343
3.02867
0.00525
ops/s

Median Throughput
default
3.02131
3.02614
0.00483
ops/s

Max Throughput
default
3.04132
3.0506
0.00928
ops/s

50th percentile latency
default
6.64658
6.5142
-0.13238
ms

90th percentile latency
default
7.39876
7.28572
-0.11304
ms

99th percentile latency
default
7.85555
7.86881
0.01326
ms

100th percentile latency
default
7.88995
9.53959
1.64964
ms

50th percentile service time
default
5.54675
5.48905
-0.0577
ms

90th percentile service time
default
5.97729
5.96132
-0.01597
ms

99th percentile service time
default
6.52644
6.41277
-0.11366
ms

100th percentile service time
default
7.12074
8.73328
1.61253
ms

error rate
default
0
0
0
%

Min Throughput
range
0.70218
0.70223
5.00E-05
ops/s

Mean Throughput
range
0.70358
0.70366
7.00E-05
ops/s

Median Throughput
range
0.70326
0.70333
6.00E-05
ops/s

Max Throughput
range
0.70646
0.70659
0.00013
ops/s

50th percentile latency
range
632.281
652.068
19.7872
ms

90th percentile latency
range
634.706
659.184
24.4778
ms

99th percentile latency
range
639.423
661.863
22.4397
ms

100th percentile latency
range
642.279
700.012
57.7326
ms

50th percentile service time
range
630.697
650.13
19.4331
ms

90th percentile service time
range
632.97
657.669
24.6985
ms

99th percentile service time
range
637.634
659.641
22.0069
ms

100th percentile service time
range
640.541
698.549
58.0088
ms

error rate
range
0
0
0
%

Min Throughput
distance_amount_agg
2.0121
2.01191
-0.00019
ops/s

Mean Throughput
distance_amount_agg
2.0199
2.0196
-0.0003
ops/s

Median Throughput
distance_amount_agg
2.01807
2.0178
-0.00026
ops/s

Max Throughput
distance_amount_agg
2.03572
2.03525
-0.00047
ops/s

50th percentile latency
distance_amount_agg
5.32663
5.26678
-0.05985
ms

90th percentile latency
distance_amount_agg
6.02059
5.69067
-0.32991
ms

99th percentile latency
distance_amount_agg
6.59205
6.07883
-0.51321
ms

100th percentile latency
distance_amount_agg
6.89191
6.35985
-0.53206
ms

50th percentile service time
distance_amount_agg
4.11577
3.8171
-0.29868
ms

90th percentile service time
distance_amount_agg
4.61674
4.2864
-0.33034
ms

99th percentile service time
distance_amount_agg
5.11496
4.51019
-0.60477
ms

100th percentile service time
distance_amount_agg
5.71144
4.7327
-0.97874
ms

error rate
distance_amount_agg
0
0
0
%

Min Throughput
autohisto_agg
1.49802
1.49609
-0.00193
ops/s

Mean Throughput
autohisto_agg
1.49889
1.49782
-0.00107
ops/s

Median Throughput
autohisto_agg
1.49899
1.49802
-0.00098
ops/s

Max Throughput
autohisto_agg
1.49933
1.49866
-0.00067
ops/s

50th percentile latency
autohisto_agg
495.737
493.814
-1.92287
ms

90th percentile latency
autohisto_agg
505.387
503.649
-1.73756
ms

99th percentile latency
autohisto_agg
516.338
508.96
-7.37807
ms

100th percentile latency
autohisto_agg
516.401
509.453
-6.94745
ms

50th percentile service time
autohisto_agg
494.473
492.376
-2.09646
ms

90th percentile service time
autohisto_agg
504.339
502.783
-1.55646
ms

99th percentile service time
autohisto_agg
514.02
507.674
-6.34651
ms

100th percentile service time
autohisto_agg
515.307
508.029
-7.27823
ms

error rate
autohisto_agg
0
0
0
%

Min Throughput
date_histogram_agg
1.5019
1.50175
-0.00015
ops/s

Mean Throughput
date_histogram_agg
1.50309
1.50284
-0.00025
ops/s

Median Throughput
date_histogram_agg
1.50283
1.5026
-0.00023
ops/s

Max Throughput
date_histogram_agg
1.50549
1.50505
-0.00044
ops/s

50th percentile latency
date_histogram_agg
545.45
529.173
-16.2769
ms

90th percentile latency
date_histogram_agg
566.344
543.815
-22.5293
ms

99th percentile latency
date_histogram_agg
576.84
561.054
-15.7868
ms

100th percentile latency
date_histogram_agg
577.66
564.438
-13.2222
ms

50th percentile service time
date_histogram_agg
544.481
528.019
-16.4615
ms

90th percentile service time
date_histogram_agg
565.533
542.919
-22.614
ms

99th percentile service time
date_histogram_agg
575.487
559.642
-15.8453
ms

100th percentile service time
date_histogram_agg
577.184
563.161
-14.0223
ms

error rate
date_histogram_agg
0
0
0
%

Setup

Tool used: opensearch-benchmark
OpenSearch Benchmark Test: nyc_taxis
Cluster

3 node cluster with each node - r5.2xlarge

Benchmark node - r5.2xlarge
Non-optimized implementation of Remote Segment Store
Remote translog is not supported
GitHub Commit ID: https://github.com/opensearch-project/OpenSearch/commit/b1c36fa43e2b79614bfad95fe7e7bfea244cabde

Metric
Task
Baseline
Contender
Diff
Unit

Cumulative indexing time of primary shards

264.425
274.165
9.73973
min

Min cumulative indexing time across primary shard

264.425
274.165
9.73973
min

Median cumulative indexing time across primary shard

264.425
274.165
9.73973
min

Max cumulative indexing time across primary shard

264.425
274.165
9.73973
min

Cumulative indexing throttle time of primary shards

0
0
0
min

Min cumulative indexing throttle time across primary shard

0
0
0
min

Median cumulative indexing throttle time across primary shard

0
0
0
min

Max cumulative indexing throttle time across primary shard

0
0
0
min

Cumulative merge time of primary shards

98.8305
104.152
5.32185
min

Cumulative merge count of primary shards

223
195
-28

Min cumulative merge time across primary shard

98.8305
104.152
5.32185
min

Median cumulative merge time across primary shard

98.8305
104.152
5.32185
min

Max cumulative merge time across primary shard

98.8305
104.152
5.32185
min

Cumulative merge throttle time of primary shards

4.87898
3.31882
-1.56017
min

Min cumulative merge throttle time across primary shard

4.87898
3.31882
-1.56017
min

Median cumulative merge throttle time across primary shard

4.87898
3.31882
-1.56017
min

Max cumulative merge throttle time across primary shard

4.87898
3.31882
-1.56017
min

Cumulative refresh time of primary shards

2.31837
1.77452
-0.54385
min

Cumulative refresh count of primary shards

120
81
-39

Min cumulative refresh time across primary shard

2.31837
1.77452
-0.54385
min

Median cumulative refresh time across primary shard

2.31837
1.77452
-0.54385
min

Max cumulative refresh time across primary shard

2.31837
1.77452
-0.54385
min

Cumulative flush time of primary shards

5.4674
21.0137
15.5463
min

Cumulative flush count of primary shards

30
28
-2

Min cumulative flush time across primary shard

5.4674
21.0137
15.5463
min

Median cumulative flush time across primary shard

5.4674
21.0137
15.5463
min

Max cumulative flush time across primary shard

5.4674
21.0137
15.5463
min

Total Young Gen GC time

192.297
197.073
4.776
s

Total Young Gen GC count

20558
21042
484

Total Old Gen GC time

0
0
0
s

Total Old Gen GC count

0
0
0

Store size

23.504
23.3888
-0.11521
GB

Translog size

5.12227e-08
5.12227e-08
0
GB

Heap used for segments

0
0
0
MB

Heap used for doc values

0
0
0
MB

Heap used for terms

0
0
0
MB

Heap used for norms

0
0
0
MB

Heap used for points

0
0
0
MB

Heap used for stored fields

0
0
0
MB

Segment count

35
34
-1

Min Throughput
index
63955.4
62645.4
-1310.01
docs/s

Mean Throughput
index
67305.1
65964.4
-1340.75
docs/s

Median Throughput
index
66769.8
65206.2
-1563.56
docs/s

Max Throughput
index
73914.6
72205
-1709.58
docs/s

50th percentile latency
index
1071.02
1095.5
24.4867
ms

90th percentile latency
index
1654.87
1623.92
-30.9413
ms

99th percentile latency
index
2927.78
3155.27
227.482
ms

99.9th percentile latency
index
4328.65
4755.59
426.947
ms

99.99th percentile latency
index
5727.22
5940.48
213.256
ms

100th percentile latency
index
6513.29
6847.42
334.139
ms

50th percentile service time
index
1071.02
1095.5
24.4867
ms

90th percentile service time
index
1654.87
1623.92
-30.9413
ms

99th percentile service time
index
2927.78
3155.27
227.482
ms

99.9th percentile service time
index
4328.65
4755.59
426.947
ms

99.99th percentile service time
index
5727.22
5940.48
213.256
ms

100th percentile service time
index
6513.29
6847.42
334.139
ms

error rate
index
0
0
0
%

Min Throughput
wait-until-merges-finish
0.00765603
0.010543
0.00289
ops/s

Mean Throughput
wait-until-merges-finish
0.00765603
0.010543
0.00289
ops/s

Median Throughput
wait-until-merges-finish
0.00765603
0.010543
0.00289
ops/s

Max Throughput
wait-until-merges-finish
0.00765603
0.010543
0.00289
ops/s

100th percentile latency
wait-until-merges-finish
130615
94849.6
-35765.8
ms

100th percentile service time
wait-until-merges-finish
130615
94849.6
-35765.8
ms

error rate
wait-until-merges-finish
0
0
0
%

Min Throughput
default
3.0152
3.01476
-0.00044
ops/s

Mean Throughput
default
3.02476
3.02401
-0.00075
ops/s

Median Throughput
default
3.02254
3.02186
-0.00068
ops/s

Max Throughput
default
3.04364
3.04225
-0.00138
ops/s

50th percentile latency
default
5.90863
6.15986
0.25123
ms

90th percentile latency
default
6.72827
6.78001
0.05174
ms

99th percentile latency
default
7.37363
15.3913
8.01766
ms

100th percentile latency
default
22.6752
46.6763
24.0011
ms

50th percentile service time
default
4.76674
5.17224
0.40551
ms

90th percentile service time
default
5.53542
5.50183
-0.03359
ms

99th percentile service time
default
6.28249
14.7076
8.42512
ms

100th percentile service time
default
21.8673
45.4953
23.628
ms

error rate
default
0
0
0
%

Min Throughput
range
0.702156
0.702176
2e-05
ops/s

Mean Throughput
range
0.703541
0.703575
3e-05
ops/s

Median Throughput
range
0.703223
0.703254
3e-05
ops/s

Max Throughput
range
0.706383
0.706446
6e-05
ops/s

50th percentile latency
range
637.188
657.09
19.9017
ms

90th percentile latency
range
638.634
659.533
20.899
ms

99th percentile latency
range
644.456
663.588
19.1323
ms

100th percentile latency
range
665.882
668.514
2.63132
ms

50th percentile service time
range
635.583
655.421
19.8379
ms

90th percentile service time
range
637.046
657.92
20.8744
ms

99th percentile service time
range
642.73
662.286
19.5566
ms

100th percentile service time
range
663.889
667.296
3.40692
ms

error rate
range
0
0
0
%

Min Throughput
distance_amount_agg
2.01206
2.01212
6e-05
ops/s

Mean Throughput
distance_amount_agg
2.01983
2.01992
0.0001
ops/s

Median Throughput
distance_amount_agg
2.01801
2.01811
0.0001
ops/s

Max Throughput
distance_amount_agg
2.03566
2.03582
0.00016
ops/s

50th percentile latency
distance_amount_agg
4.96384
5.18359
0.21975
ms

90th percentile latency
distance_amount_agg
5.62081
5.92032
0.29952
ms

99th percentile latency
distance_amount_agg
5.83299
6.36963
0.53664
ms

100th percentile latency
distance_amount_agg
6.03247
6.69593
0.66346
ms

50th percentile service time
distance_amount_agg
3.5876
3.96316
0.37556
ms

90th percentile service time
distance_amount_agg
4.11206
4.29448
0.18242
ms

99th percentile service time
distance_amount_agg
4.54844
4.72471
0.17627
ms

100th percentile service time
distance_amount_agg
4.88947
5.30235
0.41288
ms

error rate
distance_amount_agg
0
0
0
%

Min Throughput
autohisto_agg
1.49617
1.49943
0.00326
ops/s

Mean Throughput
autohisto_agg
1.49787
1.49968
0.0018
ops/s

Median Throughput
autohisto_agg
1.49808
1.49971
0.00163
ops/s

Max Throughput
autohisto_agg
1.4987
1.4998
0.0011
ops/s

50th percentile latency
autohisto_agg
500.577
499.799
-0.77762
ms

90th percentile latency
autohisto_agg
520.263
510.169
-10.0944
ms

99th percentile latency
autohisto_agg
541.792
518.705
-23.0873
ms

100th percentile latency
autohisto_agg
551.72
526.043
-25.6774
ms

50th percentile service time
autohisto_agg
499.487
498.65
-0.83744
ms

90th percentile service time
autohisto_agg
519.24
509.204
-10.0364
ms

99th percentile service time
autohisto_agg
540.376
517.584
-22.7924
ms

100th percentile service time
autohisto_agg
550.986
524.701
-26.2854
ms

error rate
autohisto_agg
0
0
0
%

Min Throughput
date_histogram_agg
1.50188
1.50169
-0.00019
ops/s

Mean Throughput
date_histogram_agg
1.50308
1.50275
-0.00034
ops/s

Median Throughput
date_histogram_agg
1.5028
1.5025
-0.0003
ops/s

Max Throughput
date_histogram_agg
1.50543
1.50486
-0.00057
ops/s

50th percentile latency
date_histogram_agg
527.348
537.766
10.4178
ms

90th percentile latency
date_histogram_agg
537.853
544.917
7.06468
ms

99th percentile latency
date_histogram_agg
556.822
552.516
-4.30575
ms

100th percentile latency
date_histogram_agg
577.228
552.709
-24.5193
ms

50th percentile service time
date_histogram_agg
526.111
536.761
10.6499
ms

90th percentile service time
date_histogram_agg
537.003
543.767
6.76437
ms

99th percentile service time
date_histogram_agg
554.549
551.612
-2.93696
ms

100th percentile service time
date_histogram_agg
576.684
552.03
-24.6539
ms

error rate
date_histogram_agg
0
0
0
%

Setup

Tool used: opensearch-benchmark
OpenSearch Benchmark Test: nyc_taxis
Cluster

3 node cluster with each node - r5.2xlarge

Benchmark node - r5.2xlarge
Remote translog is not supported
GitHub Commit ID: https://github.com/opensearch-project/OpenSearch/pull/3620/commits/678196b140a2a48126f5ef4dd5144963b1d0055a

Observations

Indexing performance improved after deleting stale segment files in async flow

Metric
Task
Baseline
Contender
Diff
Unit

Cumulative indexing time of primary shards

289.998
268.33
-21.6682
min

Min cumulative indexing time across primary shard

289.998
268.33
-21.6682
min

Median cumulative indexing time across primary shard

289.998
268.33
-21.6682
min

Max cumulative indexing time across primary shard

289.998
268.33
-21.6682
min

Cumulative indexing throttle time of primary shards

0
0
0
min

Min cumulative indexing throttle time across primary shard

0
0
0
min

Median cumulative indexing throttle time across primary shard

0
0
0
min

Max cumulative indexing throttle time across primary shard

0
0
0
min

Cumulative merge time of primary shards

110.97
98.8038
-12.1664
min

Cumulative merge count of primary shards

231
201
-30

Min cumulative merge time across primary shard

110.97
98.8038
-12.1664
min

Median cumulative merge time across primary shard

110.97
98.8038
-12.1664
min

Max cumulative merge time across primary shard

110.97
98.8038
-12.1664
min

Cumulative merge throttle time of primary shards

3.59598
4.30827
0.71228
min

Min cumulative merge throttle time across primary shard

3.59598
4.30827
0.71228
min

Median cumulative merge throttle time across primary shard

3.59598
4.30827
0.71228
min

Max cumulative merge throttle time across primary shard

3.59598
4.30827
0.71228
min

Cumulative refresh time of primary shards

2.43273
1.90387
-0.52887
min

Cumulative refresh count of primary shards

120
89
-31

Min cumulative refresh time across primary shard

2.43273
1.90387
-0.52887
min

Median cumulative refresh time across primary shard

2.43273
1.90387
-0.52887
min

Max cumulative refresh time across primary shard

2.43273
1.90387
-0.52887
min

Cumulative flush time of primary shards

2.34747
16.7026
14.3551
min

Cumulative flush count of primary shards

29
29
0

Min cumulative flush time across primary shard

2.34747
16.7026
14.3551
min

Median cumulative flush time across primary shard

2.34747
16.7026
14.3551
min

Max cumulative flush time across primary shard

2.34747
16.7026
14.3551
min

Total Young Gen GC time

164.7
163.968
-0.732
s

Total Young Gen GC count

20282
20859
577

Total Old Gen GC time

0
0
0
s

Total Old Gen GC count

0
0
0

Store size

24.1938
24.1692
-0.02457
GB

Translog size

5.12227e-08
5.12227e-08
0
GB

Heap used for segments

0
0
0
MB

Heap used for doc values

0
0
0
MB

Heap used for terms

0
0
0
MB

Heap used for norms

0
0
0
MB

Heap used for points

0
0
0
MB

Heap used for stored fields

0
0
0
MB

Segment count

35
24
-11

Min Throughput
index
63244.4
64126.4
882.012
docs/s

Mean Throughput
index
66359.5
67222.9
863.428
docs/s

Median Throughput
index
65596.1
66170.6
574.448
docs/s

Max Throughput
index
71171.4
74217.5
3046.08
docs/s

50th percentile latency
index
1099.23
1082.77
-16.4617
ms

90th percentile latency
index
1495.49
1604.33
108.833
ms

99th percentile latency
index
3165.36
3002.2
-163.157
ms

99.9th percentile latency
index
4813.12
4312.74
-500.382
ms

99.99th percentile latency
index
6059.01
5235.1
-823.92
ms

100th percentile latency
index
6951.56
5254.57
-1696.99
ms

50th percentile service time
index
1099.23
1082.77
-16.4617
ms

90th percentile service time
index
1495.49
1604.33
108.833
ms

99th percentile service time
index
3165.36
3002.2
-163.157
ms

99.9th percentile service time
index
4813.12
4312.74
-500.382
ms

99.99th percentile service time
index
6059.01
5235.1
-823.92
ms

100th percentile service time
index
6951.56
5254.57
-1696.99
ms

error rate
index
0
0
0
%

Min Throughput
wait-until-merges-finish
0.00590094
0.010656
0.00476
ops/s

Mean Throughput
wait-until-merges-finish
0.00590094
0.010656
0.00476
ops/s

Median Throughput
wait-until-merges-finish
0.00590094
0.010656
0.00476
ops/s

Max Throughput
wait-until-merges-finish
0.00590094
0.010656
0.00476
ops/s

100th percentile latency
wait-until-merges-finish
169464
93843.5
-75620.4
ms

100th percentile service time
wait-until-merges-finish
169464
93843.5
-75620.4
ms

error rate
wait-until-merges-finish
0
0
0
%

Min Throughput
default
3.01482
3.01469
-0.00013
ops/s

Mean Throughput
default
3.02412
3.02389
-0.00023
ops/s

Median Throughput
default
3.02201
3.02173
-0.00028
ops/s

Max Throughput
default
3.04256
3.04214
-0.00043
ops/s

50th percentile latency
default
6.51366
6.36153
-0.15213
ms

90th percentile latency
default
7.20997
7.09638
-0.11358
ms

99th percentile latency
default
7.41239
7.47613
0.06374
ms

100th percentile latency
default
7.41943
7.88534
0.4659
ms

50th percentile service time
default
5.44065
5.34553
-0.09512
ms

90th percentile service time
default
5.90218
5.77231
-0.12987
ms

99th percentile service time
default
6.15507
5.94431
-0.21077
ms

100th percentile service time
default
6.30478
6.0734
-0.23138
ms

error rate
default
0
0
0
%

Min Throughput
range
0.703426
0.703413
-1e-05
ops/s

Mean Throughput
range
0.705635
0.705616
-2e-05
ops/s

Median Throughput
range
0.705126
0.705109
-2e-05
ops/s

Max Throughput
range
0.710174
0.710141
-3e-05
ops/s

50th percentile latency
range
224.783
221.128
-3.65573
ms

90th percentile latency
range
228.653
224.639
-4.01316
ms

99th percentile latency
range
232.82
229.7
-3.11918
ms

100th percentile latency
range
242.403
241.61
-0.79319
ms

50th percentile service time
range
222.638
218.961
-3.67666
ms

90th percentile service time
range
226.678
222.388
-4.2902
ms

99th percentile service time
range
230.777
227.545
-3.2316
ms

100th percentile service time
range
240.564
240.272
-0.29233
ms

error rate
range
0
0
0
%

Min Throughput
distance_amount_agg
2.01209
2.01217
8e-05
ops/s

Mean Throughput
distance_amount_agg
2.01991
2.02002
0.00011
ops/s

Median Throughput
distance_amount_agg
2.01811
2.01819
8e-05
ops/s

Max Throughput
distance_amount_agg
2.03576
2.03595
0.00019
ops/s

50th percentile latency
distance_amount_agg
5.20485
5.03798
-0.16687
ms

90th percentile latency
distance_amount_agg
5.77753
5.78017
0.00264
ms

99th percentile latency
distance_amount_agg
6.08824
6.43691
0.34867
ms

100th percentile latency
distance_amount_agg
6.10881
6.62686
0.51806
ms

50th percentile service time
distance_amount_agg
3.88096
3.86936
-0.0116
ms

90th percentile service time
distance_amount_agg
4.24333
4.22367
-0.01966
ms

99th percentile service time
distance_amount_agg
4.42331
4.63398
0.21067
ms

100th percentile service time
distance_amount_agg
4.76434
4.83351
0.06917
ms

error rate
distance_amount_agg
0
0
0
%

Min Throughput
autohisto_agg
1.49525
1.49763
0.00238
ops/s

Mean Throughput
autohisto_agg
1.49735
1.49869
0.00134
ops/s

Median Throughput
autohisto_agg
1.49759
1.49881
0.00123
ops/s

Max Throughput
autohisto_agg
1.49837
1.4992
0.00083
ops/s

50th percentile latency
autohisto_agg
477.122
498.969
21.8473
ms

90th percentile latency
autohisto_agg
496.159
504.817
8.65834
ms

99th percentile latency
autohisto_agg
519.172
515.122
-4.05064
ms

100th percentile latency
autohisto_agg
521.456
519.169
-2.28692
ms

50th percentile service time
autohisto_agg
476.051
497.961
21.9097
ms

90th percentile service time
autohisto_agg
494.691
504.309
9.61786
ms

99th percentile service time
autohisto_agg
517.719
514.138
-3.58115
ms

100th percentile service time
autohisto_agg
520.584
518.174
-2.40968
ms

error rate
autohisto_agg
0
0
0
%

Min Throughput
date_histogram_agg
1.50226
1.50123
-0.00102
ops/s

Mean Throughput
date_histogram_agg
1.50367
1.50201
-0.00166
ops/s

Median Throughput
date_histogram_agg
1.50335
1.50184
-0.00151
ops/s

Max Throughput
date_histogram_agg
1.50651
1.50357
-0.00294
ops/s

50th percentile latency
date_histogram_agg
517.022
506.548
-10.4741
ms

90th percentile latency
date_histogram_agg
527.516
518.748
-8.76788
ms

99th percentile latency
date_histogram_agg
554.282
526.616
-27.6665
ms

100th percentile latency
date_histogram_agg
556.719
529.8
-26.9185
ms

50th percentile service time
date_histogram_agg
515.843
505.707
-10.1364
ms

90th percentile service time
date_histogram_agg
526.035
517.954
-8.0809
ms

99th percentile service time
date_histogram_agg
553.328
525.882
-27.4458
ms

100th percentile service time
date_histogram_agg
555.488
528.781
-26.7067
ms

error rate
date_histogram_agg
0
0
0
%

Setup

Tool used: opensearch-benchmark
OpenSearch Benchmark Test: nyc_taxis
Cluster

3 node cluster with each node - r5.2xlarge

Benchmark node - r5.2xlarge
Branch - 2.x
GitHub Commit ID: 32258cf9cf960e227db3e8b95cb4059caf29d495

Metric
Task
Baseline
Contender
Diff
Unit

Cumulative indexing time of primary shards

275.189
286.681
11.4926
min

Min cumulative indexing time across primary shard

275.189
286.681
11.4926
min

Median cumulative indexing time across primary shard

275.189
286.681
11.4926
min

Max cumulative indexing time across primary shard

275.189
286.681
11.4926
min

Cumulative indexing throttle time of primary shards

0
0
0
min

Min cumulative indexing throttle time across primary shard

0
0
0
min

Median cumulative indexing throttle time across primary shard

0
0
0
min

Max cumulative indexing throttle time across primary shard

0
0
0
min

Cumulative merge time of primary shards

106.01
107.627
1.61695
min

Cumulative merge count of primary shards

222
206
-16

Min cumulative merge time across primary shard

106.01
107.627
1.61695
min

Median cumulative merge time across primary shard

106.01
107.627
1.61695
min

Max cumulative merge time across primary shard

106.01
107.627
1.61695
min

Cumulative merge throttle time of primary shards

5.14645
7.402
2.25555
min

Min cumulative merge throttle time across primary shard

5.14645
7.402
2.25555
min

Median cumulative merge throttle time across primary shard

5.14645
7.402
2.25555
min

Max cumulative merge throttle time across primary shard

5.14645
7.402
2.25555
min

Cumulative refresh time of primary shards

3.13458
2.72237
-0.41222
min

Cumulative refresh count of primary shards

139
113
-26

Min cumulative refresh time across primary shard

3.13458
2.72237
-0.41222
min

Median cumulative refresh time across primary shard

3.13458
2.72237
-0.41222
min

Max cumulative refresh time across primary shard

3.13458
2.72237
-0.41222
min

Cumulative flush time of primary shards

4.59315
16.957
12.3638
min

Cumulative flush count of primary shards

30
31
1

Min cumulative flush time across primary shard

4.59315
16.957
12.3638
min

Median cumulative flush time across primary shard

4.59315
16.957
12.3638
min

Max cumulative flush time across primary shard

4.59315
16.957
12.3638
min

Total Young Gen GC time

223.997
226.263
2.266
s

Total Young Gen GC count

31256
31463
207

Total Old Gen GC time

0
0
0
s

Total Old Gen GC count

0
0
0

Store size

29.9324
30.2096
0.27723
GB

Translog size

5.12227e-08
5.12227e-08
0
GB

Heap used for segments

0
0
0
MB

Heap used for doc values

0
0
0
MB

Heap used for terms

0
0
0
MB

Heap used for norms

0
0
0
MB

Heap used for points

0
0
0
MB

Heap used for stored fields

0
0
0
MB

Segment count

28
32
4

Min Throughput
index
55831.2
53973.5
-1857.77
docs/s

Mean Throughput
index
59637.9
58278.3
-1359.65
docs/s

Median Throughput
index
58406
57127.2
-1278.79
docs/s

Max Throughput
index
66284.7
65012.2
-1272.5
docs/s

50th percentile latency
index
1266.39
1312.58
46.1916
ms

90th percentile latency
index
1733.09
1790.96
57.8737
ms

99th percentile latency
index
3429.09
3542.78
113.688
ms

99.9th percentile latency
index
4664.53
4526.22
-138.307
ms

99.99th percentile latency
index
5804.83
5812.06
7.23372
ms

100th percentile latency
index
6813.85
6221.47
-592.376
ms

50th percentile service time
index
1266.39
1312.58
46.1916
ms

90th percentile service time
index
1733.09
1790.96
57.8737
ms

99th percentile service time
index
3429.09
3542.78
113.688
ms

99.9th percentile service time
index
4664.53
4526.22
-138.307
ms

99.99th percentile service time
index
5804.83
5812.06
7.23372
ms

100th percentile service time
index
6813.85
6221.47
-592.376
ms

error rate
index
0
0
0
%

Min Throughput
wait-until-merges-finish
0.00801719
0.0208435
0.01283
ops/s

Mean Throughput
wait-until-merges-finish
0.00801719
0.0208435
0.01283
ops/s

Median Throughput
wait-until-merges-finish
0.00801719
0.0208435
0.01283
ops/s

Max Throughput
wait-until-merges-finish
0.00801719
0.0208435
0.01283
ops/s

100th percentile latency
wait-until-merges-finish
124732
47976
-76755.6
ms

100th percentile service time
wait-until-merges-finish
124732
47976
-76755.6
ms

error rate
wait-until-merges-finish
0
0
0
%

Min Throughput
default
3.01314
3.01569
0.00255
ops/s

Mean Throughput
default
3.02139
3.02561
0.00422
ops/s

Median Throughput
default
3.0195
3.02332
0.00382
ops/s

Max Throughput
default
3.03766
3.04513
0.00747
ops/s

50th percentile latency
default
7.75753
7.23946
-0.51807
ms

90th percentile latency
default
9.85089
9.03646
-0.81443
ms

99th percentile latency
default
10.2704
10.411
0.14062
ms

100th percentile latency
default
10.2715
10.7091
0.43754
ms

50th percentile service time
default
6.57339
5.9749
-0.59849
ms

90th percentile service time
default
8.53501
8.03566
-0.49935
ms

99th percentile service time
default
9.06355
9.14273
0.07918
ms

100th percentile service time
default
9.207
9.48836
0.28136
ms

error rate
default
0
0
0
%

Min Throughput
range
0.702633
0.702882
0.00025
ops/s

Mean Throughput
range
0.704324
0.704733
0.00041
ops/s

Median Throughput
range
0.703935
0.704307
0.00037
ops/s

Max Throughput
range
0.707797
0.708531
0.00073
ops/s

50th percentile latency
range
370.18
283.882
-86.2972
ms

90th percentile latency
range
395.581
299.782
-95.7983
ms

99th percentile latency
range
430.759
312.857
-117.902
ms

100th percentile latency
range
444.906
320.408
-124.498
ms

50th percentile service time
range
368.185
281.428
-86.7576
ms

90th percentile service time
range
393.774
297.845
-95.9291
ms

99th percentile service time
range
428.358
310.804
-117.555
ms

100th percentile service time
range
442.984
317.373
-125.611
ms

error rate
range
0
0
0
%

Min Throughput
distance_amount_agg
2.01194
2.01212
0.00019
ops/s

Mean Throughput
distance_amount_agg
2.01962
2.01993
0.00031
ops/s

Median Throughput
distance_amount_agg
2.01783
2.01811
0.00029
ops/s

Max Throughput
distance_amount_agg
2.03529
2.03581
0.00053
ops/s

50th percentile latency
distance_amount_agg
5.27528
5.29516
0.01988
ms

90th percentile latency
distance_amount_agg
5.82886
5.90282
0.07396
ms

99th percentile latency
distance_amount_agg
7.12287
6.32954
-0.79333
ms

100th percentile latency
distance_amount_agg
7.13448
6.66176
-0.47272
ms

50th percentile service time
distance_amount_agg
4.00613
3.97121
-0.03491
ms

90th percentile service time
distance_amount_agg
4.36864
4.4508
0.08216
ms

99th percentile service time
distance_amount_agg
5.76243
5.08476
-0.67767
ms

100th percentile service time
distance_amount_agg
5.8741
5.15127
-0.72283
ms

error rate
distance_amount_agg
0
0
0
%

Min Throughput
autohisto_agg
1.49949
1.50016
0.00066
ops/s

Mean Throughput
autohisto_agg
1.49975
1.50026
0.0005
ops/s

Median Throughput
autohisto_agg
1.49978
1.50023
0.00045
ops/s

Max Throughput
autohisto_agg
1.49985
1.50046
0.00061
ops/s

50th percentile latency
autohisto_agg
540.717
492.289
-48.4284
ms

90th percentile latency
autohisto_agg
552.677
505.539
-47.1373
ms

99th percentile latency
autohisto_agg
563.944
524.723
-39.2215
ms

100th percentile latency
autohisto_agg
572.177
534.844
-37.3331
ms

50th percentile service time
autohisto_agg
539.733
490.876
-48.8573
ms

90th percentile service time
autohisto_agg
551.737
504.766
-46.9719
ms

99th percentile service time
autohisto_agg
562.965
523.733
-39.2318
ms

100th percentile service time
autohisto_agg
571.129
533.689
-37.4404
ms

error rate
autohisto_agg
0
0
0
%

Min Throughput
date_histogram_agg
1.50134
1.50176
0.00043
ops/s

Mean Throughput
date_histogram_agg
1.50217
1.50287
0.00069
ops/s

Median Throughput
date_histogram_agg
1.50197
1.50261
0.00063
ops/s

Max Throughput
date_histogram_agg
1.50383
1.50508
0.00125
ops/s

50th percentile latency
date_histogram_agg
548.604
518.739
-29.8654
ms

90th percentile latency
date_histogram_agg
561.162
530.808
-30.3538
ms

99th percentile latency
date_histogram_agg
580.846
536.375
-44.4707
ms

100th percentile latency
date_histogram_agg
581.092
540.434
-40.6584
ms

50th percentile service time
date_histogram_agg
547.694
517.559
-30.1353
ms

90th percentile service time
date_histogram_agg
560.438
529.282
-31.1564
ms

99th percentile service time
date_histogram_agg
579.805
535.513
-44.2919
ms

100th percentile service time
date_histogram_agg
580.587
539.957
-40.6297
ms

error rate
date_histogram_agg
0
0
0
%

Setup

Tool used: opensearch-benchmark
OpenSearch Benchmark Test: http_logs
Cluster

3 node cluster with each node - r5.2xlarge

Benchmark node - r5.2xlarge
Branch - 2.x
GitHub Commit ID: 32258cf9cf960e227db3e8b95cb4059caf29d495

Metric
Task
Baseline
Contender
Diff
Unit

Cumulative indexing time of primary shards

132.052
132.052
0
min

Min cumulative indexing time across primary shard

0
0
0
min

Median cumulative indexing time across primary shard

1.15807
1.15807
0
min

Max cumulative indexing time across primary shard

22.9152
22.9152
0
min

Cumulative indexing throttle time of primary shards

0
0
0
min

Min cumulative indexing throttle time across primary shard

0
0
0
min

Median cumulative indexing throttle time across primary shard

0
0
0
min

Max cumulative indexing throttle time across primary shard

0
0
0
min

Cumulative merge time of primary shards

97.4242
97.4242
0
min

Cumulative merge count of primary shards

1584
1584
0

Min cumulative merge time across primary shard

0
0
0
min

Median cumulative merge time across primary shard

0.34745
0.34745
0
min

Max cumulative merge time across primary shard

18.8673
18.8673
0
min

Cumulative merge throttle time of primary shards

37.3667
37.3667
0
min

Min cumulative merge throttle time across primary shard

0
0
0
min

Median cumulative merge throttle time across primary shard

0
0
0
min

Max cumulative merge throttle time across primary shard

9.58227
9.58227
0
min

Cumulative refresh time of primary shards

13.0921
13.0921
0
min

Cumulative refresh count of primary shards

3472
3472
0

Min cumulative refresh time across primary shard

0
0
0
min

Median cumulative refresh time across primary shard

0.115675
0.115675
0
min

Max cumulative refresh time across primary shard

2.01725
2.01725
0
min

Cumulative flush time of primary shards

2.66023
2.66023
0
min

Cumulative flush count of primary shards

111
111
0

Min cumulative flush time across primary shard

0
0
0
min

Median cumulative flush time across primary shard

0.00118333
0.00118333
0
min

Max cumulative flush time across primary shard

0.64785
0.64785
0
min

Total Young Gen GC time

40.439
40.439
0
s

Total Young Gen GC count

10022
10022
0

Total Old Gen GC time

0
0
0
s

Total Old Gen GC count

0
0
0

Store size

18.8249
18.8249
0
GB

Translog size

2.04891e-06
2.04891e-06
0
GB

Heap used for segments

0
0
0
MB

Heap used for doc values

0
0
0
MB

Heap used for terms

0
0
0
MB

Heap used for norms

0
0
0
MB

Heap used for points

0
0
0
MB

Heap used for stored fields

0
0
0
MB

Segment count

35
35
0

Min Throughput
index-append
293118
293118
0
docs/s

Mean Throughput
index-append
301576
301576
0
docs/s

Median Throughput
index-append
299820
299820
0
docs/s

Max Throughput
index-append
313648
313648
0
docs/s

50th percentile latency
index-append
101.514
101.514
0
ms

90th percentile latency
index-append
190.459
190.459
0
ms

99th percentile latency
index-append
389.89
389.89
0
ms

99.9th percentile latency
index-append
475.846
475.846
0
ms

99.99th percentile latency
index-append
569.517
569.517
0
ms

100th percentile latency
index-append
626.968
626.968
0
ms

50th percentile service time
index-append
101.514
101.514
0
ms

90th percentile service time
index-append
190.459
190.459
0
ms

99th percentile service time
index-append
389.89
389.89
0
ms

99.9th percentile service time
index-append
475.846
475.846
0
ms

99.99th percentile service time
index-append
569.517
569.517
0
ms

100th percentile service time
index-append
626.968
626.968
0
ms

error rate
index-append
0
0
0
%

Min Throughput
wait-until-merges-finish
0.00329353
0.00329353
0
ops/s

Mean Throughput
wait-until-merges-finish
0.00329353
0.00329353
0
ops/s

Median Throughput
wait-until-merges-finish
0.00329353
0.00329353
0
ops/s

Max Throughput
wait-until-merges-finish
0.00329353
0.00329353
0
ops/s

100th percentile latency
wait-until-merges-finish
303625
303625
0
ms

100th percentile service time
wait-until-merges-finish
303625
303625
0
ms

error rate
wait-until-merges-finish
0
0
0
%

Min Throughput
default
8.00149
8.00149
0
ops/s

Mean Throughput
default
8.00167
8.00167
0
ops/s

Median Throughput
default
8.00169
8.00169
0
ops/s

Max Throughput
default
8.00179
8.00179
0
ops/s

50th percentile latency
default
5.01027
5.01027
0
ms

90th percentile latency
default
5.38617
5.38617
0
ms

99th percentile latency
default
5.90608
5.90608
0
ms

100th percentile latency
default
9.21095
9.21095
0
ms

50th percentile service time
default
4.05074
4.05074
0
ms

90th percentile service time
default
4.26605
4.26605
0
ms

99th percentile service time
default
4.51007
4.51007
0
ms

100th percentile service time
default
8.30794
8.30794
0
ms

error rate
default
0
0
0
%

Min Throughput
term
49.8947
49.8947
0
ops/s

Mean Throughput
term
49.8987
49.8987
0
ops/s

Median Throughput
term
49.8987
49.8987
0
ops/s

Max Throughput
term
49.9027
49.9027
0
ops/s

50th percentile latency
term
5.37422
5.37422
0
ms

90th percentile latency
term
6.16806
6.16806
0
ms

99th percentile latency
term
9.00793
9.00793
0
ms

100th percentile latency
term
10.0282
10.0282
0
ms

50th percentile service time
term
4.68759
4.68759
0
ms

90th percentile service time
term
5.06819
5.06819
0
ms

99th percentile service time
term
8.23352
8.23352
0
ms

100th percentile service time
term
9.57217
9.57217
0
ms

error rate
term
0
0
0
%

Min Throughput
range
1.0047
1.0047
0
ops/s

Mean Throughput
range
1.00651
1.00651
0
ops/s

Median Throughput
range
1.00625
1.00625
0
ops/s

Max Throughput
range
1.00935
1.00935
0
ops/s

50th percentile latency
range
9.37687
9.37687
0
ms

90th percentile latency
range
11.0545
11.0545
0
ms

99th percentile latency
range
14.2521
14.2521
0
ms

100th percentile latency
range
14.4589
14.4589
0
ms

50th percentile service time
range
7.44582
7.44582
0
ms

90th percentile service time
range
9.33296
9.33296
0
ms

99th percentile service time
range
12.2837
12.2837
0
ms

100th percentile service time
range
13.0274
13.0274
0
ms

error rate
range
0
0
0
%

Min Throughput
200s-in-range
32.7725
32.7725
0
ops/s

Mean Throughput
200s-in-range
32.7849
32.7849
0
ops/s

Median Throughput
200s-in-range
32.7851
32.7851
0
ops/s

Max Throughput
200s-in-range
32.7972
32.7972
0
ops/s

50th percentile latency
200s-in-range
5.80845
5.80845
0
ms

90th percentile latency
200s-in-range
6.31589
6.31589
0
ms

99th percentile latency
200s-in-range
8.29093
8.29093
0
ms

100th percentile latency
200s-in-range
8.92723
8.92723
0
ms

50th percentile service time
200s-in-range
5.0347
5.0347
0
ms

90th percentile service time
200s-in-range
5.43639
5.43639
0
ms

99th percentile service time
200s-in-range
7.64143
7.64143
0
ms

100th percentile service time
200s-in-range
7.91627
7.91627
0
ms

error rate
200s-in-range
0
0
0
%

Min Throughput
400s-in-range
50.0104
50.0104
0
ops/s

Mean Throughput
400s-in-range
50.011
50.011
0
ops/s

Median Throughput
400s-in-range
50.011
50.011
0
ops/s

Max Throughput
400s-in-range
50.0115
50.0115
0
ops/s

50th percentile latency
400s-in-range
4.25956
4.25956
0
ms

90th percentile latency
400s-in-range
4.78588
4.78588
0
ms

99th percentile latency
400s-in-range
5.04351
5.04351
0
ms

100th percentile latency
400s-in-range
7.84099
7.84099
0
ms

50th percentile service time
400s-in-range
3.55511
3.55511
0
ms

90th percentile service time
400s-in-range
3.78818
3.78818
0
ms

99th percentile service time
400s-in-range
4.10627
4.10627
0
ms

100th percentile service time
400s-in-range
7.07565
7.07565
0
ms

error rate
400s-in-range
0
0
0
%

Min Throughput
hourly_agg
0.20061
0.20061
0
ops/s

Mean Throughput
hourly_agg
0.200843
0.200843
0
ops/s

Median Throughput
hourly_agg
0.20081
0.20081
0
ops/s

Max Throughput
hourly_agg
0.20121
0.20121
0
ops/s

50th percentile latency
hourly_agg
1724.8
1724.8
0
ms

90th percentile latency
hourly_agg
1762.52
1762.52
0
ms

99th percentile latency
hourly_agg
1786.21
1786.21
0
ms

100th percentile latency
hourly_agg
1812.62
1812.62
0
ms

50th percentile service time
hourly_agg
1721.65
1721.65
0
ms

90th percentile service time
hourly_agg
1760.51
1760.51
0
ms

99th percentile service time
hourly_agg
1784.07
1784.07
0
ms

100th percentile service time
hourly_agg
1810.91
1810.91
0
ms

error rate
hourly_agg
0
0
0
%

Min Throughput
scroll
24.7667
24.7667
0
pages/s

Mean Throughput
scroll
25.021
25.021
0
pages/s

Median Throughput
scroll
25.0218
25.0218
0
pages/s

Max Throughput
scroll
25.0433
25.0433
0
pages/s

50th percentile latency
scroll
495.845
495.845
0
ms

90th percentile latency
scroll
508.122
508.122
0
ms

99th percentile latency
scroll
2065.53
2065.53
0
ms

100th percentile latency
scroll
3078.64
3078.64
0
ms

50th percentile service time
scroll
493.921
493.921
0
ms

90th percentile service time
scroll
504.582
504.582
0
ms

99th percentile service time
scroll
732.363
732.363
0
ms

100th percentile service time
scroll
3076.89
3076.89
0
ms

error rate
scroll
0
0
0
%

Min Throughput
desc_sort_timestamp
0.500819
0.500819
0
ops/s

Mean Throughput
desc_sort_timestamp
0.500995
0.500995
0
ops/s

Median Throughput
desc_sort_timestamp
0.500982
0.500982
0
ops/s

Max Throughput
desc_sort_timestamp
0.501224
0.501224
0
ops/s

50th percentile latency
desc_sort_timestamp
905.569
905.569
0
ms

90th percentile latency
desc_sort_timestamp
944.914
944.914
0
ms

99th percentile latency
desc_sort_timestamp
974.091
974.091
0
ms

100th percentile latency
desc_sort_timestamp
979.53
979.53
0
ms

50th percentile service time
desc_sort_timestamp
903.647
903.647
0
ms

90th percentile service time
desc_sort_timestamp
942.995
942.995
0
ms

99th percentile service time
desc_sort_timestamp
972.585
972.585
0
ms

100th percentile service time
desc_sort_timestamp
977.826
977.826
0
ms

error rate
desc_sort_timestamp
0
0
0
%

Min Throughput
asc_sort_timestamp
0.499726
0.499726
0
ops/s

Mean Throughput
asc_sort_timestamp
0.501919
0.501919
0
ops/s

Median Throughput
asc_sort_timestamp
0.501904
0.501904
0
ops/s

Max Throughput
asc_sort_timestamp
0.50239
0.50239
0
ops/s

50th percentile latency
asc_sort_timestamp
85.3886
85.3886
0
ms

90th percentile latency
asc_sort_timestamp
99.9578
99.9578
0
ms

99th percentile latency
asc_sort_timestamp
2281.42
2281.42
0
ms

100th percentile latency
asc_sort_timestamp
4188.07
4188.07
0
ms

50th percentile service time
asc_sort_timestamp
82.8252
82.8252
0
ms

90th percentile service time
asc_sort_timestamp
96.2524
96.2524
0
ms

99th percentile service time
asc_sort_timestamp
144.666
144.666
0
ms

100th percentile service time
asc_sort_timestamp
4186
4186
0
ms

error rate
asc_sort_timestamp
0
0
0
%

Min Throughput
desc_sort_with_after_timestamp
0.501826
0.501826
0
ops/s

Mean Throughput
desc_sort_with_after_timestamp
0.504785
0.504785
0
ops/s

Median Throughput
desc_sort_with_after_timestamp
0.503332
0.503332
0
ops/s

Max Throughput
desc_sort_with_after_timestamp
0.518919
0.518919
0
ops/s

50th percentile latency
desc_sort_with_after_timestamp
1168.92
1168.92
0
ms

90th percentile latency
desc_sort_with_after_timestamp
1184.02
1184.02
0
ms

99th percentile latency
desc_sort_with_after_timestamp
1229.99
1229.99
0
ms

100th percentile latency
desc_sort_with_after_timestamp
1274.25
1274.25
0
ms

50th percentile service time
desc_sort_with_after_timestamp
1166.52
1166.52
0
ms

90th percentile service time
desc_sort_with_after_timestamp
1182.72
1182.72
0
ms

99th percentile service time
desc_sort_with_after_timestamp
1227.07
1227.07
0
ms

100th percentile service time
desc_sort_with_after_timestamp
1272.33
1272.33
0
ms

error rate
desc_sort_with_after_timestamp
0
0
0
%

Min Throughput
asc_sort_with_after_timestamp
0.502428
0.502428
0
ops/s

Mean Throughput
asc_sort_with_after_timestamp
0.506379
0.506379
0
ops/s

Median Throughput
asc_sort_with_after_timestamp
0.504428
0.504428
0
ops/s

Max Throughput
asc_sort_with_after_timestamp
0.525395
0.525395
0
ops/s

50th percentile latency
asc_sort_with_after_timestamp
937.226
937.226
0
ms

90th percentile latency
asc_sort_with_after_timestamp
963.721
963.721
0
ms

99th percentile latency
asc_sort_with_after_timestamp
982.259
982.259
0
ms

100th percentile latency
asc_sort_with_after_timestamp
1000.22
1000.22
0
ms

50th percentile service time
asc_sort_with_after_timestamp
935.637
935.637
0
ms

90th percentile service time
asc_sort_with_after_timestamp
961.928
961.928
0
ms

99th percentile service time
asc_sort_with_after_timestamp
979.948
979.948
0
ms

100th percentile service time
asc_sort_with_after_timestamp
998.734
998.734
0
ms

error rate
asc_sort_with_after_timestamp
0
0
0
%

Min Throughput
wait-until-merges-1-seg-finish
83.477
83.477
0
ops/s

Mean Throughput
wait-until-merges-1-seg-finish
83.477
83.477
0
ops/s

Median Throughput
wait-until-merges-1-seg-finish
83.477
83.477
0
ops/s

Max Throughput
wait-until-merges-1-seg-finish
83.477
83.477
0
ops/s

100th percentile latency
wait-until-merges-1-seg-finish
11.3196
11.3196
0
ms

100th percentile service time
wait-until-merges-1-seg-finish
11.3196
11.3196
0
ms

error rate
wait-until-merges-1-seg-finish
0
0
0
%

Min Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10214
1.10214
0
ops/s

Mean Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10297
1.10297
0
ops/s

Median Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10297
1.10297
0
ops/s

Max Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10393
1.10393
0
ops/s

50th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
102469
102469
0
ms

90th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
118470
118470
0
ms

99th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
122027
122027
0
ms

100th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
122450
122450
0
ms

50th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
898.261
898.261
0
ms

90th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
939.41
939.41
0
ms

99th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
993.814
993.814
0
ms

100th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
1104.74
1104.74
0
ms

error rate
desc-sort-timestamp-after-force-merge-1-seg
0
0
0
%

Min Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00556
2.00556
0
ops/s

Mean Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00674
2.00674
0
ops/s

Median Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00666
2.00666
0
ops/s

Max Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00828
2.00828
0
ops/s

50th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
82.6848
82.6848
0
ms

90th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
92.5229
92.5229
0
ms

99th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
98.1609
98.1609
0
ms

100th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
98.6338
98.6338
0
ms

50th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
81.1041
81.1041
0
ms

90th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
91.3304
91.3304
0
ms

99th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
96.9806
96.9806
0
ms

100th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
97.0005
97.0005
0
ms

error rate
asc-sort-timestamp-after-force-merge-1-seg
0
0
0
%

Min Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.501714
0.501714
0
ops/s

Mean Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.504485
0.504485
0
ops/s

Median Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.503126
0.503126
0
ops/s

Max Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.517677
0.517677
0
ops/s

50th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1244.57
1244.57
0
ms

90th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1274.46
1274.46
0
ms

99th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1363.05
1363.05
0
ms

100th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1388.51
1388.51
0
ms

50th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1242.67
1242.67
0
ms

90th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1273.25
1273.25
0
ms

99th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1361.55
1361.55
0
ms

100th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1387.09
1387.09
0
ms

error rate
desc-sort-with-after-timestamp-after-force-merge-1-seg
0
0
0
%

Min Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.502217
0.502217
0
ops/s

Mean Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.505823
0.505823
0
ops/s

Median Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.504046
0.504046
0
ops/s

Max Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.523112
0.523112
0
ops/s

50th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1029.79
1029.79
0
ms

90th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1050.97
1050.97
0
ms

99th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1080.42
1080.42
0
ms

100th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1087.54
1087.54
0
ms

50th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1027.87
1027.87
0
ms

90th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1048.44
1048.44
0
ms

99th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1077.71
1077.71
0
ms

100th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1084.46
1084.46
0
ms

error rate
asc-sort-with-after-timestamp-after-force-merge-1-seg
0
0
0
%

Metric
Task
Baseline
Contender
Diff
Unit

--------------------------------------------------------------:
-------------------------------------------------------:
------------:
------------:
---------:
--------:

Cumulative indexing time of primary shards

132.052
129.919
-2.1322
min

Min cumulative indexing time across primary shard

0
0
0
min

Median cumulative indexing time across primary shard

1.15807
1.1908
0.03272
min

Max cumulative indexing time across primary shard

22.9152
22.9782
0.06305
min

Cumulative indexing throttle time of primary shards

0
0.1302
0.1302
min

Min cumulative indexing throttle time across primary shard

0
0
0
min

Median cumulative indexing throttle time across primary shard

0
0
0
min

Max cumulative indexing throttle time across primary shard

0
0.1302
0.1302
min

Cumulative merge time of primary shards

97.4242
76.5158
-20.9083
min

Cumulative merge count of primary shards

1584
657
-927

Min cumulative merge time across primary shard

0
0
0
min

Median cumulative merge time across primary shard

0.34745
0.290858
-0.05659
min

Max cumulative merge time across primary shard

18.8673
15.0272
-3.84007
min

Cumulative merge throttle time of primary shards

37.3667
33.5271
-3.83963
min

Min cumulative merge throttle time across primary shard

0
0
0
min

Median cumulative merge throttle time across primary shard

0
0.032925
0.03293
min

Max cumulative merge throttle time across primary shard

9.58227
7.32488
-2.25738
min

Cumulative refresh time of primary shards

13.0921
11.5128
-1.57933
min

Cumulative refresh count of primary shards

3472
1665
-1807

Min cumulative refresh time across primary shard

0
0
0
min

Median cumulative refresh time across primary shard

0.115675
0.111717
-0.00396
min

Max cumulative refresh time across primary shard

2.01725
1.74898
-0.26827
min

Cumulative flush time of primary shards

2.66023
8.02617
5.36593
min

Cumulative flush count of primary shards

111
115
4

Min cumulative flush time across primary shard

0
0
0
min

Median cumulative flush time across primary shard

0.00118333
0.00348333
0.0023
min

Max cumulative flush time across primary shard

0.64785
1.69793
1.05008
min

Total Young Gen GC time

40.439
43.518
3.079
s

Total Young Gen GC count

10022
10946
924

Total Old Gen GC time

0
0
0
s

Total Old Gen GC count

0
0
0

Store size

18.8249
18.8316
0.00674
GB

Translog size

2.04891e-06
2.04891e-06
0
GB

Heap used for segments

0
0
0
MB

Heap used for doc values

0
0
0
MB

Heap used for terms

0
0
0
MB

Heap used for norms

0
0
0
MB

Heap used for points

0
0
0
MB

Heap used for stored fields

0
0
0
MB

Segment count

35
35
0

Min Throughput
index-append
293118
286077
-7040.36
docs/s

Mean Throughput
index-append
301576
297520
-4055.84
docs/s

Median Throughput
index-append
299820
296974
-2846.01
docs/s

Max Throughput
index-append
313648
307119
-6528.3
docs/s

50th percentile latency
index-append
101.514
95.3194
-6.19431
ms

90th percentile latency
index-append
190.459
158.315
-32.144
ms

99th percentile latency
index-append
389.89
661.29
271.4
ms

99.9th percentile latency
index-append
475.846
1300.61
824.763
ms

99.99th percentile latency
index-append
569.517
1858.35
1288.83
ms

100th percentile latency
index-append
626.968
2407.84
1780.87
ms

50th percentile service time
index-append
101.514
95.3194
-6.19431
ms

90th percentile service time
index-append
190.459
158.315
-32.144
ms

99th percentile service time
index-append
389.89
661.29
271.4
ms

99.9th percentile service time
index-append
475.846
1300.61
824.763
ms

99.99th percentile service time
index-append
569.517
1858.35
1288.83
ms

100th percentile service time
index-append
626.968
2407.84
1780.87
ms

error rate
index-append
0
0
0
%

Min Throughput
wait-until-merges-finish
0.00329353
0.0262604
0.02297
ops/s

Mean Throughput
wait-until-merges-finish
0.00329353
0.0262604
0.02297
ops/s

Median Throughput
wait-until-merges-finish
0.00329353
0.0262604
0.02297
ops/s

Max Throughput
wait-until-merges-finish
0.00329353
0.0262604
0.02297
ops/s

100th percentile latency
wait-until-merges-finish
303625
38079.7
-265545
ms

100th percentile service time
wait-until-merges-finish
303625
38079.7
-265545
ms

error rate
wait-until-merges-finish
0
0
0
%

Min Throughput
default
8.00149
8.00039
-0.0011
ops/s

Mean Throughput
default
8.00167
8.00048
-0.00119
ops/s

Median Throughput
default
8.00169
8.00048
-0.0012
ops/s

Max Throughput
default
8.00179
8.00056
-0.00123
ops/s

50th percentile latency
default
5.01027
5.00027
-0.00999
ms

90th percentile latency
default
5.38617
5.44592
0.05975
ms

99th percentile latency
default
5.90608
5.81678
-0.0893
ms

100th percentile latency
default
9.21095
6.1959
-3.01504
ms

50th percentile service time
default
4.05074
4.07387
0.02313
ms

90th percentile service time
default
4.26605
4.30322
0.03717
ms

99th percentile service time
default
4.51007
4.53482
0.02474
ms

100th percentile service time
default
8.30794
4.53601
-3.77193
ms

error rate
default
0
0
0
%

Min Throughput
term
49.8947
49.9288
0.03415
ops/s

Mean Throughput
term
49.8987
49.9317
0.03299
ops/s

Median Throughput
term
49.8987
49.9317
0.03299
ops/s

Max Throughput
term
49.9027
49.9346
0.03183
ops/s

50th percentile latency
term
5.37422
5.36566
-0.00856
ms

90th percentile latency
term
6.16806
5.86259
-0.30546
ms

99th percentile latency
term
9.00793
9.75104
0.74311
ms

100th percentile latency
term
10.0282
10.5292
0.501
ms

50th percentile service time
term
4.68759
4.49411
-0.19347
ms

90th percentile service time
term
5.06819
4.77322
-0.29497
ms

99th percentile service time
term
8.23352
9.00561
0.77209
ms

100th percentile service time
term
9.57217
9.45684
-0.11533
ms

error rate
term
0
0
0
%

Min Throughput
range
1.0047
1.00435
-0.00035
ops/s

Mean Throughput
range
1.00651
1.00602
-0.00049
ops/s

Median Throughput
range
1.00625
1.00578
-0.00047
ops/s

Max Throughput
range
1.00935
1.00864
-0.00071
ops/s

50th percentile latency
range
9.37687
8.75575
-0.62112
ms

90th percentile latency
range
11.0545
10.2652
-0.78926
ms

99th percentile latency
range
14.2521
13.7256
-0.52654
ms

100th percentile latency
range
14.4589
14.4831
0.02421
ms

50th percentile service time
range
7.44582
7.12708
-0.31874
ms

90th percentile service time
range
9.33296
8.79053
-0.54243
ms

99th percentile service time
range
12.2837
11.5455
-0.73824
ms

100th percentile service time
range
13.0274
12.7159
-0.31156
ms

error rate
range
0
0
0
%

Min Throughput
200s-in-range
32.7725
32.9535
0.18103
ops/s

Mean Throughput
200s-in-range
32.7849
32.956
0.17105
ops/s

Median Throughput
200s-in-range
32.7851
32.9561
0.17106
ops/s

Max Throughput
200s-in-range
32.7972
32.9583
0.16107
ops/s

50th percentile latency
200s-in-range
5.80845
5.5175
-0.29095
ms

90th percentile latency
200s-in-range
6.31589
6.11654
-0.19935
ms

99th percentile latency
200s-in-range
8.29093
11.2653
2.97441
ms

100th percentile latency
200s-in-range
8.92723
15.7465
6.81924
ms

50th percentile service time
200s-in-range
5.0347
4.56976
-0.46494
ms

90th percentile service time
200s-in-range
5.43639
4.97877
-0.45761
ms

99th percentile service time
200s-in-range
7.64143
10.8236
3.18215
ms

100th percentile service time
200s-in-range
7.91627
14.5724
6.65614
ms

error rate
200s-in-range
0
0
0
%

Min Throughput
400s-in-range
50.0104
49.998
-0.01249
ops/s

Mean Throughput
400s-in-range
50.011
49.9989
-0.01209
ops/s

Median Throughput
400s-in-range
50.011
49.9989
-0.01209
ops/s

Max Throughput
400s-in-range
50.0115
49.9998
-0.01169
ops/s

50th percentile latency
400s-in-range
4.25956
4.4095
0.14994
ms

90th percentile latency
400s-in-range
4.78588
4.89455
0.10867
ms

99th percentile latency
400s-in-range
5.04351
7.57248
2.52897
ms

100th percentile latency
400s-in-range
7.84099
8.26936
0.42837
ms

50th percentile service time
400s-in-range
3.55511
3.59765
0.04254
ms

90th percentile service time
400s-in-range
3.78818
3.79303
0.00485
ms

99th percentile service time
400s-in-range
4.10627
6.2953
2.18903
ms

100th percentile service time
400s-in-range
7.07565
7.90822
0.83256
ms

error rate
400s-in-range
0
0
0
%

Min Throughput
hourly_agg
0.20061
0.200571
-4e-05
ops/s

Mean Throughput
hourly_agg
0.200843
0.200789
-5e-05
ops/s

Median Throughput
hourly_agg
0.20081
0.200759
-5e-05
ops/s

Max Throughput
hourly_agg
0.20121
0.201133
-8e-05
ops/s

50th percentile latency
hourly_agg
1724.8
1789.06
64.2622
ms

90th percentile latency
hourly_agg
1762.52
1832.86
70.3438
ms

99th percentile latency
hourly_agg
1786.21
1864.49
78.2779
ms

100th percentile latency
hourly_agg
1812.62
1957.56
144.936
ms

50th percentile service time
hourly_agg
1721.65
1785.76
64.107
ms

90th percentile service time
hourly_agg
1760.51
1830.65
70.1318
ms

99th percentile service time
hourly_agg
1784.07
1863.41
79.3331
ms

100th percentile service time
hourly_agg
1810.91
1956.42
145.512
ms

error rate
hourly_agg
0
0
0
%

Min Throughput
scroll
24.7667
24.9684
0.2017
pages/s

Mean Throughput
scroll
25.021
25.0236
0.00255
pages/s

Median Throughput
scroll
25.0218
25.0215
-0.00028
pages/s

Max Throughput
scroll
25.0433
25.0432
-0.00014
pages/s

50th percentile latency
scroll
495.845
497.46
1.61492
ms

90th percentile latency
scroll
508.122
508.81
0.68777
ms

99th percentile latency
scroll
2065.53
737.906
-1327.62
ms

100th percentile latency
scroll
3078.64
1410.13
-1668.51
ms

50th percentile service time
scroll
493.921
495.638
1.71698
ms

90th percentile service time
scroll
504.582
506.773
2.19097
ms

99th percentile service time
scroll
732.363
530.614
-201.748
ms

100th percentile service time
scroll
3076.89
1407.97
-1668.92
ms

error rate
scroll
0
0
0
%

Min Throughput
desc_sort_timestamp
0.500819
0.500855
4e-05
ops/s

Mean Throughput
desc_sort_timestamp
0.500995
0.501039
4e-05
ops/s

Median Throughput
desc_sort_timestamp
0.500982
0.501025
4e-05
ops/s

Max Throughput
desc_sort_timestamp
0.501224
0.501279
5e-05
ops/s

50th percentile latency
desc_sort_timestamp
905.569
887.631
-17.9379
ms

90th percentile latency
desc_sort_timestamp
944.914
902.602
-42.3117
ms

99th percentile latency
desc_sort_timestamp
974.091
973.07
-1.02077
ms

100th percentile latency
desc_sort_timestamp
979.53
980.668
1.1375
ms

50th percentile service time
desc_sort_timestamp
903.647
885.814
-17.8326
ms

90th percentile service time
desc_sort_timestamp
942.995
900.976
-42.0192
ms

99th percentile service time
desc_sort_timestamp
972.585
971.159
-1.42632
ms

100th percentile service time
desc_sort_timestamp
977.826
978.675
0.84858
ms

error rate
desc_sort_timestamp
0
0
0
%

Min Throughput
asc_sort_timestamp
0.499726
0.501595
0.00187
ops/s

Mean Throughput
asc_sort_timestamp
0.501919
0.501938
2e-05
ops/s

Median Throughput
asc_sort_timestamp
0.501904
0.501913
1e-05
ops/s

Max Throughput
asc_sort_timestamp
0.50239
0.502386
-0
ops/s

50th percentile latency
asc_sort_timestamp
85.3886
83.2714
-2.11718
ms

90th percentile latency
asc_sort_timestamp
99.9578
89.857
-10.1009
ms

99th percentile latency
asc_sort_timestamp
2281.42
99.0244
-2182.4
ms

100th percentile latency
asc_sort_timestamp
4188.07
102.269
-4085.8
ms

50th percentile service time
asc_sort_timestamp
82.8252
80.5578
-2.2674
ms

90th percentile service time
asc_sort_timestamp
96.2524
87.6067
-8.64571
ms

99th percentile service time
asc_sort_timestamp
144.666
95.9738
-48.6923
ms

100th percentile service time
asc_sort_timestamp
4186
100.165
-4085.83
ms

error rate
asc_sort_timestamp
0
0
0
%

Min Throughput
desc_sort_with_after_timestamp
0.501826
0.501581
-0.00024
ops/s

Mean Throughput
desc_sort_with_after_timestamp
0.504785
0.504133
-0.00065
ops/s

Median Throughput
desc_sort_with_after_timestamp
0.503332
0.502881
-0.00045
ops/s

Max Throughput
desc_sort_with_after_timestamp
0.518919
0.516282
-0.00264
ops/s

50th percentile latency
desc_sort_with_after_timestamp
1168.92
1265.95
97.0292
ms

90th percentile latency
desc_sort_with_after_timestamp
1184.02
1281.05
97.0329
ms

99th percentile latency
desc_sort_with_after_timestamp
1229.99
1329.96
99.9676
ms

100th percentile latency
desc_sort_with_after_timestamp
1274.25
1468.32
194.064
ms

50th percentile service time
desc_sort_with_after_timestamp
1166.52
1264.27
97.747
ms

90th percentile service time
desc_sort_with_after_timestamp
1182.72
1279.8
97.078
ms

99th percentile service time
desc_sort_with_after_timestamp
1227.07
1328.74
101.671
ms

100th percentile service time
desc_sort_with_after_timestamp
1272.33
1466.68
194.358
ms

error rate
desc_sort_with_after_timestamp
0
0
0
%

Min Throughput
asc_sort_with_after_timestamp
0.502428
0.502262
-0.00017
ops/s

Mean Throughput
asc_sort_with_after_timestamp
0.506379
0.505939
-0.00044
ops/s

Median Throughput
asc_sort_with_after_timestamp
0.504428
0.504129
-0.0003
ops/s

Max Throughput
asc_sort_with_after_timestamp
0.525395
0.52358
-0.00182
ops/s

50th percentile latency
asc_sort_with_after_timestamp
937.226
1001.68
64.453
ms

90th percentile latency
asc_sort_with_after_timestamp
963.721
1024.4
60.6779
ms

99th percentile latency
asc_sort_with_after_timestamp
982.259
1046.68
64.4232
ms

100th percentile latency
asc_sort_with_after_timestamp
1000.22
1080.14
79.9225
ms

50th percentile service time
asc_sort_with_after_timestamp
935.637
999.842
64.2053
ms

90th percentile service time
asc_sort_with_after_timestamp
961.928
1022.7
60.7741
ms

99th percentile service time
asc_sort_with_after_timestamp
979.948
1045.03
65.081
ms

100th percentile service time
asc_sort_with_after_timestamp
998.734
1078.37
79.6313
ms

error rate
asc_sort_with_after_timestamp
0
0
0
%

Min Throughput
wait-until-merges-1-seg-finish
83.477
88.8963
5.41923
ops/s

Mean Throughput
wait-until-merges-1-seg-finish
83.477
88.8963
5.41923
ops/s

Median Throughput
wait-until-merges-1-seg-finish
83.477
88.8963
5.41923
ops/s

Max Throughput
wait-until-merges-1-seg-finish
83.477
88.8963
5.41923
ops/s

100th percentile latency
wait-until-merges-1-seg-finish
11.3196
10.8113
-0.50825
ms

100th percentile service time
wait-until-merges-1-seg-finish
11.3196
10.8113
-0.50825
ms

error rate
wait-until-merges-1-seg-finish
0
0
0
%

Min Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10214
1.13812
0.03598
ops/s

Mean Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10297
1.13898
0.03602
ops/s

Median Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10297
1.13898
0.03601
ops/s

Max Throughput
desc-sort-timestamp-after-force-merge-1-seg
1.10393
1.13978
0.03585
ops/s

50th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
102469
95138.5
-7330.87
ms

90th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
118470
110222
-8247.93
ms

99th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
122027
113348
-8678.58
ms

100th percentile latency
desc-sort-timestamp-after-force-merge-1-seg
122450
113722
-8728.12
ms

50th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
898.261
864.516
-33.7451
ms

90th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
939.41
922.126
-17.2845
ms

99th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
993.814
980.896
-12.9179
ms

100th percentile service time
desc-sort-timestamp-after-force-merge-1-seg
1104.74
990.016
-114.728
ms

error rate
desc-sort-timestamp-after-force-merge-1-seg
0
0
0
%

Min Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00556
2.00561
5e-05
ops/s

Mean Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00674
2.0068
6e-05
ops/s

Median Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00666
2.00671
6e-05
ops/s

Max Throughput
asc-sort-timestamp-after-force-merge-1-seg
2.00828
2.00835
7e-05
ops/s

50th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
82.6848
83.1094
0.42462
ms

90th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
92.5229
93.9711
1.44813
ms

99th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
98.1609
102.72
4.55922
ms

100th percentile latency
asc-sort-timestamp-after-force-merge-1-seg
98.6338
103.397
4.76297
ms

50th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
81.1041
81.3608
0.25675
ms

90th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
91.3304
92.8983
1.56797
ms

99th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
96.9806
100.542
3.5609
ms

100th percentile service time
asc-sort-timestamp-after-force-merge-1-seg
97.0005
101.419
4.41801
ms

error rate
asc-sort-timestamp-after-force-merge-1-seg
0
0
0
%

Min Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.501714
0.501385
-0.00033
ops/s

Mean Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.504485
0.503614
-0.00087
ops/s

Median Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.503126
0.502524
-0.0006
ops/s

Max Throughput
desc-sort-with-after-timestamp-after-force-merge-1-seg
0.517677
0.514206
-0.00347
ops/s

50th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1244.57
1304.22
59.6528
ms

90th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1274.46
1339.52
65.0636
ms

99th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1363.05
1399.85
36.8024
ms

100th percentile latency
desc-sort-with-after-timestamp-after-force-merge-1-seg
1388.51
1468.63
80.1218
ms

50th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1242.67
1302.31
59.6447
ms

90th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1273.25
1336.71
63.4593
ms

99th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1361.55
1398.44
36.883
ms

100th percentile service time
desc-sort-with-after-timestamp-after-force-merge-1-seg
1387.09
1467.37
80.2806
ms

error rate
desc-sort-with-after-timestamp-after-force-merge-1-seg
0
0
0
%

Min Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.502217
0.50186
-0.00036
ops/s

Mean Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.505823
0.504875
-0.00095
ops/s

Median Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.504046
0.503398
-0.00065
ops/s

Max Throughput
asc-sort-with-after-timestamp-after-force-merge-1-seg
0.523112
0.519269
-0.00384
ops/s

50th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1029.79
1077.89
48.0973
ms

90th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1050.97
1110.61
59.6473
ms

99th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1080.42
1186.89
106.465
ms

100th percentile latency
asc-sort-with-after-timestamp-after-force-merge-1-seg
1087.54
1199.35
111.813
ms

50th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1027.87
1075.95
48.084
ms

90th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1048.44
1108.52
60.0835
ms

99th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1077.71
1183.87
106.155
ms

100th percentile service time
asc-sort-with-after-timestamp-after-force-merge-1-seg
1084.46
1197.97
113.512
ms

error rate
asc-sort-with-after-timestamp-after-force-merge-1-seg
0
0
0
%


Mobile device soft keyboard 'Next' button does not shift focus to next input

Describe the bug
Creating an Input element with attribute/value TextInputOptions.ReturnKeyType="Next" correctly configures the soft keyboard with a 'Next' return key but the key does shift focus to the next input.
To Reproduce
Steps to reproduce the behavior:

Create an Avalonia cross-platfom app: dotnet new avalonia.xplat -o MyApp
Edit the non-boileplate content of MainView.xaml:

<StackPanel>
    <TextBox TextInputOptions.ReturnKeyType="Next"></TextBox>
    <TextBox TextInputOptions.ReturnKeyType="Next"></TextBox>
</StackPanel>

Deploy to an Android or iOS emulator
Click in first TextBox: soft keyboard is displayed. Select 'Next' or '->|' button: input focus does not change.

Expected behavior
Input focus should move to the second TextBox.
Desktop (please complete the following information):

OS: Windows/Android emulator, MacOS/iOS simulator
Version 11.0.4

Is it an expected behavior from iOS and android native apps?
IIRC, right now this property only affects visual key representation.

https://developer.android.com/reference/kotlin/androidx/compose/ui/text/input/ImeAction#Next()

More actions can be implemented here:
https://github.com/AvaloniaUI/Avalonia/blob/master/src/Android/Avalonia.Android/Platform/SkiaPlatform/TopLevelImpl.cs#L622
And here:
https://github.com/AvaloniaUI/Avalonia/blob/master/src/iOS/Avalonia.iOS/TextInputResponder.cs#L182

This appear to work on Android:
                case ImeAction.Next:
                    {
                        var focusedElement = FocusManager.GetFocusManager(_toplevel.InputRoot).GetFocusedElement();
                        KeyboardNavigationHandler.GetNext(focusedElement, NavigationDirection.Next)?.Focus();
                        break;
                    }

but I am complete noob to all of this.


Implement ReadDir() for SFTP & SMB

It's used by canary-checker folder check.

E2E tests using:

https://hub.docker.com/r/instantlinux/samba  / https://github.com/instantlinux/docker-tools/tree/main/images/samba/helm
https://github.com/fsouza/fake-gcs-server
https://hub.docker.com/r/atmoz/sftp/


schedule quick stand-up - tues/thurs - 5 mins w/Hanlun - support with issues/questions/blockers

Maribeth

Would you mind setting up 2 - 5 mins standups - Tuesday/Thursday - with Hanlun - please include me so we can help with issues/blockers/questions. Omid as optional.

You may want to set up a new series of check-ins with the team/same time/day  - it's currently under Anshu's calendar.

Suggested ops/improvements process:
Improvements/changes:
I will move all items ready to be worked into the sprint backlog and these items will be ranked in order - feel free to pick any of these items up at any time Wang, Hanlun CITZ:EX
Every item in the sprint backlog and product backlog will be in a ranked order
Hanlun to reach out directly to team members directly with questions
Business
UX
Thor
feel free to use the AR filing teams chat (I'll add you).
As new items come in, they will need to be assessed to determine priority - Wilson, Maribeth CITZ:EX to determine impact and urgency, then assess priority (now, next, later).
If now, move to top of sprint backlog

stand ups have been scheduled


Allow templates for custom error messages

To make more useful error messages it may be nice to have the requiredMessage or invalidMessage properties support a lightweight template mechanism. This could allow one to inject properties from the validation runtime into the error messages.
Maybe something like EntLib Validation Block?

Sounds good.
@shawnExplore can you help me define the spec for this feature? What runtime parameters would like to have available to fill in the template placeholder? Here's a start:
{0} - path (e.g. 'age')
{1} - keyword that failed (e.g. 'maximum')
{2} - keyword value (e.g. 60 as in { maximum: 60})
{3} - message, when a custom message for a keyword is defined

Wouldn't sprintf format for templates be more flexible and easy to use as it is already wide-spread?

I believe this requirement is out of scope for JSEN. Users can plug in their own formatting library when displaying error messages to users:
var format = require('util').format,
    schema = {
        properties: {
            username: {
                type: 'string',
                minLength: 10,
                invalidMessage: 'Field `%s` failed the `%s` rule.'
            }
        }
    },
    validate = jsen(schema),
    err, message;

validate({ username: 'someone' });

err = validate.errors[0];

message = format(err.message, err.path, err.keyword);

console.log(message);

/* Output: Field `username` failed the `minLength` rule. */


updated and now just get white screen (no chance to even login)

Hello,
I installed new BlingSetup.exe and now I after I click on bling desktop shortcut I just get a white screen and it doesn't even let me login...
I tried uninstalling and rebooting and reinstalling, but still just the white screen.
I am attaching latest crash report files.
Thanks for any help you can offer as to what may be going wrong...
8419152f-ecee-4941-b867-f6334f136132.zip

Please send Bling.log inside Documents\Bling.exe\Logs.
Do not worry, I will release a new version today for solving this.

Hello,
I uninstalled, deleted the zip files and html/viewer folder as you suggested.  Then reinstalled.  First it looked like it was going better because actually said "loading" and said something about new update or upgrade being available and did i want to load it (version 17).  i said ok and then it just seemed to get hung up again.  It generated a new crash report file so attaching that as well as the log,,,
Bling.log
bc5a8feb-26da-481d-b53d-13455e0763ae.zip
Thank you.

Seeing the same issues...
f5bc4639-226a-4444-839f-60cfd6ffeb7c.zip

Thanks for the help! Now I see what happens, it's actually the process of creating logs, included in new version. I will release a version in a few minutes with one correction. In case it does not solve your problem I will tell you how to disable logs in the ini file (I'm about to create it as it cannot be done now).

I have released 0.1.18, please install it. In case application hangs again create a Bling.ini file in %userprofile%/Documents/Bling.exe with
[Log]
Enabled=false

Or, copy there the one I attach here and rename to Bling.ini.
Bling.txt
This will disable logs so luckily you will be able to use it while I investigate the root cause. If everything works without having to disable logs, please confirm me how many log messages appear in Bling.log as the following:
Browser instance created
Seems that, for some reason, more than one browser instance was created in your case and I need to investigate further.
Thanks for your contribution!

hello, rename your Bling.txt file to BlinG.ini, not BlinK.ini?
I tried it with BlinG.ini but no luck, then noticed my old ini file was BlinK.ini.  going to retry as Blink.ini now and see if that makes any difference....

There are two ini files Blink.ini and Bling.ini. the first one for things related with Blink servers and the second one to the actual app. But remember this is plan B, first install 0.1.18 and let's see if it crashes. If you did so delete Bling.log inside logs and open app again, if it crashes and Bling.log file is generated It means bling.ini is not being detected.

Installed and still seeing issues... Here are the two scenarios I have tried so far:
Scenario 1: Uninstall Bling and delete Bling.exe from Documents.
Install latest Bling MSI file and start. White empty window displays and after a few seconds, Bling upgrade dialog is displayed. Click on No and login screen is displayed.
Login and application starts up. Close the application.
Bling.log and Blink.ini files are created. Ini file contains [SyncVideo] entry. I add the [Log] entry and save the file.
Restart the application and empty window just sits there. Upgrade dialog displays and click No. Application hangs.
Original Bling.log renamed to Bling.1.log and empty Bling.log file is created.
Scenario 2 After Uninstall & reinstall again, answer Yes to Bling upgrade and the application crashes and Crash Report log is created.
Hope this helps a little. See attached files...
Also the Bling.ini file is changed and looks like this:
[Log]Enabled=false[SyncVideo]LastUpdate=2020-01-29T13:10:18+00:00
15963095-0e1e-4e0a-b126-81cdaa1cf793.zip

Bling.1.log

Thanks! It really helps. I see you place [Log] info in Blink.ini and not Bling.ini. They are two config files with different purposes. Create Bling.ini in Bling.exe folder and open again. I see you app crashes presumably when instantiating logs so the disabling had no effect. The reason why appears again the message of Blink 0.1.18 to download is because it was manually downloaded and not automatically, you can dismiss it.
Let's see if creating Bling.ini and setting Log to disabled let's you at least use the app.

Oh, another thing, check on task manager there is no bling application running. I suspect this is the reason for this crash

One of these days I will follow directions properly...
Adding [Log] to Bling.ini did not help. Application hangs on second start after closing. I have Process Explorer up and Bling is not running after closing.
I deleted all files and folder from Bling.exe folder, except for Bling.ini and restarted. After a brief delay, it started up again. I closed and interestingly there is no Logs folder. Again restarting the app leaves it hung.

So it will start up the first time when there is no Bling.exe folder under Documents. But any other attempts to run and the app hangs.

here is what i did:
Uninstalled the application
Deleted the “Bling.exe” folder under Documents (want a fresh start)
Download and run BlingSetup.exe file
Run Bling.exe – which starts and asks if want to upgrade to version 18.  I say yes and it crashes.
There is a crash report (attached files) and under Bling.exe/Logs there is a Bling.log file but 0 kb and empty.
Checked task manager - no Bling application running
Now I am going to go add the Bling.ini file, delete the Bling.log file and try rerunning to see what happens.....
2aa5313d-1789-4f1b-984f-a61e69283ea1.zip
CrashRpt-Log-20200424-151227-{2aa5313d-1789-4f1b-984f-a61e69283ea1}.txt

just noticed there is no Blink.ini file in Blink.exe folder (not sure if there is supposed to be one, just FYI)

Ok we are almost there! Please do the following:
In Bling.ini file set
[UpgradeDesktop]
Host=localhost
You are having crashes while trying to execute the latest Desktop installer. This will prevent automatic downloads until I discover the reason. Please tell me if this solves the problem.

After about a six second delay on the white screen, it started up.

So, are you able to use the application as before? The delay may be related with downloading latest viewer.

Yes sir!
The captured videos are sorted strange, but that's for another time...

Great! Thanks for your patience you both paid the price of being betatesters of this version. I have reproduced the issue on my machine and will release a new version today. Just in case you want to have automatic desktop updates running you will have to manually install it and remove Bling.ini. I suggest enabling logs as will help in case you get any error in the future.
I have also seen this issue related with strange ordering but it's not always happening. I think it has to do with sending requests for all video pages asynchronously so order is not being respected.
Will take a look now that I know other people experience this.

after revising the Bling.ini file to add the [UpgradeDesktop] Host=localhost it is now working for me too!! Yay!! Thank you so much for this application and your super fast fixes :)

it doesn't seem to be automatically download videos though.  I've tried putting an earlier date in the .ini file but doesn't seem to make a difference.  I will close down the program (just click the x) and then reopen and the program (and it will reopen without me having to login by the way), and as soon as it opens it will download ONE video.  I wait a few minutes to see if any other videos download, but nothing.  So I close the program, and reopen (no login required) and BAM as soon as it opens, another video appears in the Download folder, but then no more videos download after that one..... until i close and reopen the program that is (then one more downloads)....
I've tried changing the date in the .ini file to an earlier date but the videos that are getting downloaded one at a time when i start the program are all from the 24th (and the ini file date changes back to the 24th as well).......
Don't know if this is because of the sorting issue mentioned......

It's not related, that issue belongs to the viewer. This issue I think happened before but with no logs we did not realize. I have identified the reason and tomorrow I will release the correction. Thanks for the feedback!

Great work on getting the videos sorted!


Changes  to be made to the button program to use esp-wifi-config library

What changes should i make (what all to be added and also what all lines to be removed) in the button program so that i can use esp-wifi-config for configuring wifi access point on initial boot. I have tried many times but every time one or the other error turns up

Have you looked at the wifi_config example..?

how should I change the highlighted portion of the code in the button program

It's pretty obvious isn't it...
void on_wifi_ready() {
homekit_server_init(&config);
}
void user_init(void) {
uart_set_baud(0, 115200);
wifi_config_init("my button", NULL, on_wifi_ready);
if (button_create(BUTTON_PIN, button_callback)) {
    printf("Failed to initialize button\n");
}

}
I haven't tested this but that should get you going...

Did that .. all was fine with compiling. when it came to the erase flash command it gave the error
make: Entering directory '/home/user/esp/esp-homekit-demo/examples/button'
make: *** No rule to make target 'erase'.  Stop.
make: Leaving directory '/home/user/esp/esp-homekit-demo/examples/button'
I used the command
make -C examples/button erase flash
in the esp-homekit-demo directory

I believe you're missing an underscore...

It’s erase_flash, not erase

ooo.. my my... thank you
everything worked ok
just that I am not able to get the double click working.. is there any particular timing between clicks.. will I be able to configure the click interval
I configured another esp8266 to respond to clicks
a single click turns on chip led
double click is supposed to turn it off
and long click to turn on the led for 1 minute and then turn off
single & long click works perfectly. but I am not able to get the double click working
I tried rapid clicking as well as 2 clicks with an interval of up to 1-2 secs.. but can't get it working

I had this problem.
See this: https://github.com/maximkulkin/esp-button
When updated the code it works flawlessly

oh..k
so should i be pulling a copy esp-button folder to esp-homekit-demo/examples
and then move to /esp-button/examples
and compile the button_example.c using Makefile
what about
`
homekit_characteristic_t name = HOMEKIT_CHARACTERISTIC_(NAME, "Sample LED");
homekit_accessory_t accessories[] = {
HOMEKIT_ACCESSORY(.id=1, .category=homekit_accessory_category_lightbulb, .services=(homekit_service_t[]){
HOMEKIT_SERVICE(ACCESSORY_INFORMATION, .characteristics=(homekit_characteristic_t*[]){
&name,
HOMEKIT_CHARACTERISTIC(MANUFACTURER, "HaPK"),
HOMEKIT_CHARACTERISTIC(SERIAL_NUMBER, "037A2BABF19D"),
HOMEKIT_CHARACTERISTIC(MODEL, "MyLED"),
HOMEKIT_CHARACTERISTIC(FIRMWARE_REVISION, "0.1"),
HOMEKIT_CHARACTERISTIC(IDENTIFY, led_identify),
NULL
}),
HOMEKIT_SERVICE(LIGHTBULB, .primary=true, .characteristics=(homekit_characteristic_t*[]){
HOMEKIT_CHARACTERISTIC(NAME, "Sample LED"),
HOMEKIT_CHARACTERISTIC(
ON, false,
.getter=led_on_get,
.setter=led_on_set
),
NULL
}),
NULL
}),
NULL
};
homekit_server_config_t config = {
.accessories = accessories,
.password = "111-11-111"
};
`
& other wifi hotspot initialisation portion

no.
in button example, you should change the current library "button.c" and "button.h" to the new one in "eps-button"
your code should look like this:
`#include <stdio.h>
#include <esp/uart.h>
#include <esp8266.h>
#include <FreeRTOS.h>
#include <task.h>
#include <homekit/homekit.h>
#include <homekit/characteristics.h>
#include <wifi_config.h>
#include "button.h"
#define BUTTON_PIN 0
#ifndef BUTTON_PIN
#error BUTTON_PIN is not specified
#endif
void button_identify(homekit_value_t _value) {
printf("Button identify\n");
}
homekit_characteristic_t button_event = HOMEKIT_CHARACTERISTIC_(PROGRAMMABLE_SWITCH_EVENT, 0);
void button_callback(button_event_t event, void* context) {
switch (event) {
case button_event_single_press:
printf("single press\n");
homekit_characteristic_notify(&button_event, HOMEKIT_UINT8(0));
break;
case button_event_double_press:
printf("double press\n");
homekit_characteristic_notify(&button_event, HOMEKIT_UINT8(1));
break;
case button_event_long_press:
printf("long press\n");
homekit_characteristic_notify(&button_event, HOMEKIT_UINT8(2));
break;
default:
printf("unknown button event: %d\n", event);
}
}
homekit_accessory_t accessories[] = {
HOMEKIT_ACCESSORY(
.id=1,
.category=homekit_accessory_category_programmable_switch,
.services=(homekit_service_t[]) {
HOMEKIT_SERVICE(
ACCESSORY_INFORMATION,
.characteristics=(homekit_characteristic_t*[]) {
HOMEKIT_CHARACTERISTIC(NAME, "Button"),
HOMEKIT_CHARACTERISTIC(MANUFACTURER, "HaPK"),
HOMEKIT_CHARACTERISTIC(SERIAL_NUMBER, "0012345"),
HOMEKIT_CHARACTERISTIC(MODEL, "MyButton"),
HOMEKIT_CHARACTERISTIC(FIRMWARE_REVISION, "0.1"),
HOMEKIT_CHARACTERISTIC(IDENTIFY, button_identify),
NULL
},
),
HOMEKIT_SERVICE(
STATELESS_PROGRAMMABLE_SWITCH,
.primary=true,
.characteristics=(homekit_characteristic_t*[]) {
HOMEKIT_CHARACTERISTIC(NAME, "Button"),
&button_event,
NULL
},
),
NULL
},
),
NULL
};
homekit_server_config_t config = {
.accessories = accessories,
.password = "111-11-111"
};
void on_wifi_ready() {
homekit_server_init(&config);
}
void user_init(void) {
uart_set_baud(0, 115200);
button_config_t config = BUTTON_CONFIG(
    button_active_low,
    .long_press_time = 1000,
    .max_repeat_presses = 3,
);

wifi_config_init("botao", "serasevai", on_wifi_ready);

int r = button_create(BUTTON_PIN, config, button_callback, NULL);
if (r) {
    printf("Failed to initialize a button\n");
}

}`

replace the "button.c" and "button.h" from the current folder in button example to those in "eps-button".
and try this code below in main.c
#include <stdio.h>
#include <esp/uart.h>
#include <esp8266.h>
#include <FreeRTOS.h>
#include <task.h>

#include <homekit/homekit.h>
#include <homekit/characteristics.h>
#include <wifi_config.h>
#include "button.h"

#define BUTTON_PIN 0
#ifndef BUTTON_PIN
#error BUTTON_PIN is not specified
#endif

void button_identify(homekit_value_t _value) {
    printf("Button identify\n");
}

homekit_characteristic_t button_event = HOMEKIT_CHARACTERISTIC_(PROGRAMMABLE_SWITCH_EVENT, 0);

void button_callback(button_event_t event, void* context) {
    switch (event) {
        case button_event_single_press:
            printf("single press\n");
            homekit_characteristic_notify(&button_event, HOMEKIT_UINT8(0));
            break;
        case button_event_double_press:
            printf("double press\n");
            homekit_characteristic_notify(&button_event, HOMEKIT_UINT8(1));
            break;
        case button_event_long_press:
            printf("long press\n");
            homekit_characteristic_notify(&button_event, HOMEKIT_UINT8(2));
            break;
        default:
            printf("unknown button event: %d\n", event);
    }
}

homekit_accessory_t *accessories[] = {
    HOMEKIT_ACCESSORY(
        .id=1,
        .category=homekit_accessory_category_programmable_switch,
        .services=(homekit_service_t*[]) {
            HOMEKIT_SERVICE(
                ACCESSORY_INFORMATION,
                .characteristics=(homekit_characteristic_t*[]) {
                    HOMEKIT_CHARACTERISTIC(NAME, "Button"),
                    HOMEKIT_CHARACTERISTIC(MANUFACTURER, "HaPK"),
                    HOMEKIT_CHARACTERISTIC(SERIAL_NUMBER, "0012345"),
                    HOMEKIT_CHARACTERISTIC(MODEL, "MyButton"),
                    HOMEKIT_CHARACTERISTIC(FIRMWARE_REVISION, "0.1"),
                    HOMEKIT_CHARACTERISTIC(IDENTIFY, button_identify),
                    NULL
                },
            ),
            HOMEKIT_SERVICE(
                STATELESS_PROGRAMMABLE_SWITCH,
                .primary=true,
                .characteristics=(homekit_characteristic_t*[]) {
                    HOMEKIT_CHARACTERISTIC(NAME, "Button"),
                    &button_event,
                    NULL
                },
            ),
            NULL
        },
    ),
    NULL
};

homekit_server_config_t config = {
    .accessories = accessories,
    .password = "111-11-111"
};

void on_wifi_ready() {
        homekit_server_init(&config);
}

void user_init(void) {
    uart_set_baud(0, 115200);

    button_config_t config = BUTTON_CONFIG(
        button_active_low,
        .long_press_time = 1000,
        .max_repeat_presses = 3,
    );

    wifi_config_init("botao", "serasevai", on_wifi_ready);

    int r = button_create(BUTTON_PIN, config, button_callback, NULL);
    if (r) {
        printf("Failed to initialize a button\n");
    }

}

Thank you so much.. Everything works perfectly now... Nd hey.. I took a copy of the those files from your github page.. @renandw


keyvi cli params fix for 0.2 branch

@hendrikmuhs
This PR includes:

keyvi cli params fix (memory limit)
switch to cmake: for --disable-deprecated option I thought there is no need to introduce another CMake build_type and we can specify it as using CMake's -D CMAKE_CXX_FLAGS=...  option

Please, let me know what you think about.

Coverage increased (+0.6%) to 88.202% when pulling 118643f60b5e7cf6f761979321f1fcc76c77962e on narekgharibyan:0_2_cleanup into 54d3b5c19123addbf9708688b9494fe08c5d0af2 on cliqz-oss:0_2_cleanup.

LGTM
I agree regarding the deprecation, this is simple and good, no need for a new build type.


13.5 update

you can find it in my github repo
https://github.com/Sheelia/R3nzSkin-v13.15

virus?
if no prove

virus? if no prove

compile it yourself

bro why you update the hpp like give directly the exe comon

can u help me how to make it work? it just downloads the hpp file and theres nothing to do with it can u explain it where to input it or something

thanks for the update big man

thanks for the update big man

does it work?

Yep it works

its like nobody understands github

how does it work can someone explain?

can you guys compile it please T.T

can you guys compile it please T.T

its already compiled just download it from his github

github says you've only updated memory.hpp but .exe file literally has your name everywhere

i don't know how to open the injector from this file can someone help :/

@Sheelia
how did you know you had to modify that string?
"48 8B 0D ? ? ? ? PF 15? ? ? ? E8? ? ? ? 48 8B"

Cuz if u run the old one it shows you as an error msg

i replaced memory myself still doesnt work since
,,String was not recognized as a valid DateTime"
any1 knows how to go ttrough this?

Please check out the new release.


[Bug] dbt run failure due to deprecated INTEGRATION table

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the issue

Our dbt cloud Daily Runner began failing after we did a full re-sync of our historical Klaviyo data.
The old Klaviyo data contained an INTEGRATION table, but this was replaced with the METRIC table according to the September 2023 release notes
Our existing klaviyo transformations rely upon the INTEGRATION table for making our various analytics marts

Relevant error log or model output
From dbt cloud
`ERROR creating view model analytics_stg_klaviyo.stg_klaviyo__integration_tmp [ERROR in 3.09s]`

`15:49:38  Completed with 1 error and 0 warnings:
15:49:38  Database Error in model stg_klaviyo__integration_tmp (models/tmp/stg_klaviyo__integration_tmp.sql)
15:49:38    SQL compilation error:
15:49:38    Object 'RAW.KLAVIYO.INTEGRATION' does not exist or not authorized.
15:49:38    compiled SQL at target/run/klaviyo_source/models/tmp/stg_klaviyo__integration_tmp.sql`

Expected behavior
When integration table was deprecated, the underlying queries should have been updated to point to the METRIC table
dbt Project configurations
version: "1.0.0"
vars:
klaviyo_database: RAW
klaviyo_schema: KLAVIYO
Package versions
packages:

package: dbt-labs/dbt_utils
version: 0.8.4
package: fivetran/klaviyo
version: 0.4.1
package: fivetran/klaviyo_source
version: 0.4.1

What database are you using dbt with?
snowflake
dbt Version
1.0.9
Additional Context
Fivetran Support Engineer suggested I make this PR
Are you willing to open a PR to help address this issue?

[ ] Yes.
[ ] Yes, but I will need assistance and will schedule time during our office hours for guidance
[X] No.

Hi @robertspragg! We've been made aware of the connector updates and are working this week to push out a new release for this package, which will address this!

Thank you for the update!

Hi @robertspragg , this has been addressed in the latest release of the package. As such we'll be closing this out! Let us know if there's anything else.

Thank you so much!


Extension asks for directory even after setting tensorBoard.logDirectory

Environment data

VS Code version: 1.92.2
Tensorboard Extension version: v2023.10.1002992421
Jupyter Extension version: v2024.7.0
Python Extension version: v2024.12.3
OS and version: Windows 11 version 22H2
Python and/or Anaconda version: Python 3.10.14
Type of virtual environment used: venv
Jupyter server running: N/A

Expected behaviour
When launching tensorboard, the extension should not ask for a directory when tensorBoard.logDirectory is set.
Actual behaviour
The extension asks for a directory even when tensorBoard.logDirectory is set.
Steps to reproduce:
[NOTE: Self-contained, minimal reproducing code samples are extremely helpful and will expedite addressing your issue]

Open settings JSON and edit tensorBoard.logDirectory.

{
  "tensorBoard.logDirectory": "/mnt/train/"
}

Open command palette and launch tensorboard Python: Launch Tensorboard

The extension opens a quickpick menu and asks for a directory.

Logs

Output for Jupyter in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Jupyter)

N/A

The reason I am using a release version (v2023.10.1002992421) and not a newer pre-release version is because I get an error when switching to a pre-release version (I tried v2024.3.1001511100).

Failed to start a TensorBoard session due to the following error: Extension 'ms-toolsai.tensorboard' CANNOT use API proposal: portsAttributes. Its package.json#enabledApiProposals-property declares: but NOT portsAttributes. The missing proposal MUST be added and you must start in extension development mode or use the following command line switch: --enable-proposed-api ms-toolsai.tensorboard

I can get the pre-release version to work without this issue but for that I need to run Preferences: Configure Runtime Arguments and edit argv.json to add a special exception for the extension.
"enable-proposed-api": [
  "ms-toolsai.tensorboard"
]

I found that it works with "python.tensorBoard.logDirectory": "/mnt/train/" (note the python.) even though a warning in the settings.json tells me this is wrong and it doesn't show up in the settings UI.
So this is a workaround, but the actual issue still persists.

this is a known bug for a while now. please see here for possible solution: https://github.com/microsoft/vscode-tensorboard/issues/18#issuecomment-2088237327