HADOOP-18762. Incorporate Qiniu Cloud Kodo File System Implementation

Description of PR
See HADOOP-18762
How was this patch tested?
See test.md
For code changes:

[x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[x] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[x] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m 12s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+0 :ok:
shelldocs
0m  1s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 23 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
17m 59s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
24m  2s

trunk passed

+1 :green_heart:
compile
19m  8s

trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
17m 19s

trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
4m 44s

trunk passed

+1 :green_heart:
mvnsite
23m 25s

trunk passed

+1 :green_heart:
javadoc
10m 34s

trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
8m  6s

trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 19s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

+0 :ok:
spotbugs
0m 20s

branch/hadoop-cloud-storage-project/hadoop-cloud-storage no spotbugs output file (spotbugsXml.xml)

+1 :green_heart:
shadedclient
55m 39s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
56m  5s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 35s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
21m 38s

the patch passed

+1 :green_heart:
compile
18m 15s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
18m 15s

the patch passed

+1 :green_heart:
compile
17m 25s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
17m 25s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 11 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-1 :x:
blanks
0m  0s
/blanks-tabs.txt
The patch 46 line(s) with tabs.

-0 :warning:
checkstyle
4m 55s
/results-checkstyle-root.txt
root: The patch generated 2735 new + 0 unchanged - 0 fixed = 2735 total (was 0)

+1 :green_heart:
mvnsite
15m 37s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

-1 :x:
javadoc
9m  0s
/results-javadoc-javadoc-root-jdkUbuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1.txt
root-jdkUbuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 generated 48 new + 1288 unchanged - 0 fixed = 1336 total (was 1288)

-1 :x:
javadoc
7m 42s
/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 generated 48 new + 1450 unchanged - 0 fixed = 1498 total (was 1450)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

-1 :x:
spotbugs
1m 14s
/new-spotbugs-hadoop-cloud-storage-project.html
hadoop-cloud-storage-project generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

-1 :x:
spotbugs
32m  1s
/new-spotbugs-root.html
root generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

+0 :ok:
spotbugs
0m 25s

hadoop-cloud-storage-project/hadoop-cloud-storage has no data from spotbugs

+1 :green_heart:
shadedclient
24m  8s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
434m 59s
/patch-unit-root.txt
root in the patch failed.

-1 :x:
asflicense
2m  3s
/results-asflicense.txt
The patch generated 89 ASF License warnings.

782m 55s

Reason
Tests

SpotBugs
module:hadoop-cloud-storage-project

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:[line 163]

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:[line 87]

SpotBugs
module:root

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:[line 163]

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:[line 87]

Failed junit tests
hadoop.hdfs.TestRollingUpgrade

hadoop.hdfs.server.datanode.TestDirectoryScanner

hadoop.yarn.server.resourcemanager.recovery.TestZKRMStateStore

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5725

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 397c247592d3 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 2b1ac061a79c47e3a02c1ea33dc729d15717abed

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/3/testReport/

Max. process+thread count
2373 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-cloud-storage-project/hadoop-qiniu hadoop-cloud-storage-project . hadoop-cloud-storage-project/hadoop-cloud-storage U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 41s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+0 :ok:
shelldocs
0m  1s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 23 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
18m 15s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 42s

trunk passed

+1 :green_heart:
compile
18m 20s

trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
17m 34s

trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
4m 46s

trunk passed

+1 :green_heart:
mvnsite
24m 10s

trunk passed

+1 :green_heart:
javadoc
10m 15s

trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
8m 30s

trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 21s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

+0 :ok:
spotbugs
0m 22s

branch/hadoop-cloud-storage-project/hadoop-cloud-storage no spotbugs output file (spotbugsXml.xml)

+1 :green_heart:
shadedclient
58m 37s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
59m  3s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 38s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
22m 37s

the patch passed

+1 :green_heart:
compile
19m 10s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
19m 10s

the patch passed

+1 :green_heart:
compile
18m 29s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
18m 29s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 11 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-1 :x:
blanks
0m  0s
/blanks-tabs.txt
The patch 46 line(s) with tabs.

-0 :warning:
checkstyle
5m 16s
/results-checkstyle-root.txt
root: The patch generated 2735 new + 0 unchanged - 0 fixed = 2735 total (was 0)

+1 :green_heart:
mvnsite
16m 51s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

-1 :x:
javadoc
9m 42s
/results-javadoc-javadoc-root-jdkUbuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1.txt
root-jdkUbuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 generated 48 new + 1288 unchanged - 0 fixed = 1336 total (was 1288)

-1 :x:
javadoc
8m 23s
/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 generated 48 new + 1450 unchanged - 0 fixed = 1498 total (was 1450)

+0 :ok:
spotbugs
0m 22s

hadoop-project has no data from spotbugs

-1 :x:
spotbugs
1m 25s
/new-spotbugs-hadoop-cloud-storage-project.html
hadoop-cloud-storage-project generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

-1 :x:
spotbugs
34m 39s
/new-spotbugs-root.html
root generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

+0 :ok:
spotbugs
0m 27s

hadoop-cloud-storage-project/hadoop-cloud-storage has no data from spotbugs

+1 :green_heart:
shadedclient
22m 35s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
755m  2s
/patch-unit-root.txt
root in the patch passed.

-1 :x:
asflicense
1m 44s
/results-asflicense.txt
The patch generated 89 ASF License warnings.

1111m 53s

Reason
Tests

SpotBugs
module:hadoop-cloud-storage-project

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:[line 163]

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:[line 87]

SpotBugs
module:root

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:[line 163]

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:[line 87]

Failed junit tests
hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.mapreduce.v2.TestMRJobs

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5725

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux ce0239726bea 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 5f7c1b9d3603622835917e9a3cc331b02115eb31

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/2/testReport/

Max. process+thread count
3714 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-cloud-storage-project/hadoop-qiniu hadoop-cloud-storage-project . hadoop-cloud-storage-project/hadoop-cloud-storage U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 54s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 23 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
18m 20s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
24m  8s

trunk passed

+1 :green_heart:
compile
18m 27s

trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
16m 53s

trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
4m 40s

trunk passed

+1 :green_heart:
mvnsite
21m  6s

trunk passed

+1 :green_heart:
javadoc
9m  0s

trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
7m 34s

trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 18s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

+0 :ok:
spotbugs
0m 19s

branch/hadoop-cloud-storage-project/hadoop-cloud-storage no spotbugs output file (spotbugsXml.xml)

+1 :green_heart:
shadedclient
55m 17s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
55m 40s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 36s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
21m 18s

the patch passed

+1 :green_heart:
compile
18m  7s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
18m  7s

the patch passed

+1 :green_heart:
compile
17m  5s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
17m  5s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 10 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-1 :x:
blanks
0m  0s
/blanks-tabs.txt
The patch 46 line(s) with tabs.

-0 :warning:
checkstyle
5m  0s
/results-checkstyle-root.txt
root: The patch generated 2735 new + 0 unchanged - 0 fixed = 2735 total (was 0)

+1 :green_heart:
mvnsite
15m 38s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

-1 :x:
javadoc
9m  3s
/results-javadoc-javadoc-root-jdkUbuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1.txt
root-jdkUbuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 generated 48 new + 1288 unchanged - 0 fixed = 1336 total (was 1288)

-1 :x:
javadoc
7m 55s
/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 generated 48 new + 1450 unchanged - 0 fixed = 1498 total (was 1450)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

-1 :x:
spotbugs
1m 16s
/new-spotbugs-hadoop-cloud-storage-project.html
hadoop-cloud-storage-project generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

-1 :x:
spotbugs
34m 19s
/new-spotbugs-root.html
root generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

+0 :ok:
spotbugs
0m 24s

hadoop-cloud-storage-project/hadoop-cloud-storage has no data from spotbugs

+1 :green_heart:
shadedclient
24m 32s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
816m 54s
/patch-unit-root.txt
root in the patch passed.

-1 :x:
asflicense
1m 45s
/results-asflicense.txt
The patch generated 89 ASF License warnings.

1160m 20s

Reason
Tests

SpotBugs
module:hadoop-cloud-storage-project

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:[line 163]

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:[line 87]

SpotBugs
module:root

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:org.apache.hadoop.fs.qiniu.kodo.blockcache.DiskCacheBlockReader.writeFile(Path, byte[]) due to return value of called method  Dereferenced at DiskCacheBlockReader.java:[line 163]

Possible null pointer dereference in org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:org.apache.hadoop.fs.qiniu.kodo.client.DownloadHttpClient.fetch(String, long, int) due to return value of called method  Method invoked at DownloadHttpClient.java:[line 87]

Failed junit tests
hadoop.mapred.TestMRTimelineEventHandling

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapred.TestSpecialCharactersInOutputPath

hadoop.mapred.TestJobName

hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.hdfs.server.namenode.ha.TestObserverNode

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5725

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux f78dd19b21af 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / cdc23a385f50dfbc04d4c48fc6548b9cc6db984d

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/1/testReport/

Max. process+thread count
2623 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-cloud-storage-project/hadoop-qiniu hadoop-cloud-storage-project . hadoop-cloud-storage-project/hadoop-cloud-storage U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5725/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


katydid 0.3 build failure with ghc 8.4

Related to the semigroup changes in ghc 8.4.
See also: https://ghc.haskell.org/trac/ghc/wiki/Migration/8.4#SemigroupMonoidsuperclasses
[ 3 of 23] Compiling Expr             ( src/Expr.hs, dist/build/Expr.o )

src/Expr.hs:283:39: error:
    Ambiguous occurrence ‘<>’
    It could refer to either ‘Prelude.<>’,
                             imported from ‘Prelude’ at src/Expr.hs:4:8-11
                             (and originally defined in ‘GHC.Base’)
                          or ‘Expr.<>’, defined at src/Expr.hs:276:1
    |
283 | cmp a b = compare (_hash a) (_hash b) <>
    |                                       ^^

src/Expr.hs:284:33: error:
    Ambiguous occurrence ‘<>’
    It could refer to either ‘Prelude.<>’,
                             imported from ‘Prelude’ at src/Expr.hs:4:8-11
                             (and originally defined in ‘GHC.Base’)
                          or ‘Expr.<>’, defined at src/Expr.hs:276:1
    |
284 |     compare (_name a) (_name b) <>
    |                                 ^^

src/Expr.hs:285:55: error:
    Ambiguous occurrence ‘<>’
    It could refer to either ‘Prelude.<>’,
                             imported from ‘Prelude’ at src/Expr.hs:4:8-11
                             (and originally defined in ‘GHC.Base’)
                          or ‘Expr.<>’, defined at src/Expr.hs:276:1
    |
285 |     compare (length (_params a)) (length (_params b)) <>
    |                                                       ^^

src/Expr.hs:286:11: error:
    Ambiguous occurrence ‘<>’
    It could refer to either ‘Prelude.<>’,
                             imported from ‘Prelude’ at src/Expr.hs:4:8-11
                             (and originally defined in ‘GHC.Base’)
                          or ‘Expr.<>’, defined at src/Expr.hs:276:1
    |
286 |     foldl (<>) EQ (zipWith cmp (_params a) (_params b)) <>
    |           ^^^^

src/Expr.hs:286:57: error:
    Ambiguous occurrence ‘<>’
    It could refer to either ‘Prelude.<>’,
                             imported from ‘Prelude’ at src/Expr.hs:4:8-11
                             (and originally defined in ‘GHC.Base’)
                          or ‘Expr.<>’, defined at src/Expr.hs:276:1
    |
286 |     foldl (<>) EQ (zipWith cmp (_params a) (_params b)) <>
    |                                                         ^^

I was able to reproduce this locally like so:
stack unpack katydid-<IP_ADDRESS> && cd katydid-<IP_ADDRESS>
echo 'resolver: nightly-2018-05-06' > stack.yaml
stack build --haddock --test --bench --no-run-benchmarks

Thank you so much for reporting and keeping stackage working.
As a user, I really appreciate your efforts.
I have made the fix
https://github.com/katydid/katydid-haskell/commit/4da99770778152f51f46717799cc39942c908388#diff-eabb24595c8402685912ea2aa891a4ce
and uploaded it to hackage and bumped the version to <IP_ADDRESS>
https://hackage.haskell.org/package/katydid-<IP_ADDRESS>
Thanks again


[ALLUXIO-3044] Improve Alluxio UFS modules

https://alluxio.atlassian.net/browse/ALLUXIO-3044

Classload all core UFS modules rather than having them boundled
Remove maven dependency relocation
Add Wasb as a UFS and fix the doc

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/17306/
Test PASSed.

Merged build finished. Test PASSed.


/git

git support
Hello, i wanted to ask about support for git for multiaddress.
Something like this:
/git/5a179104a6f9e9a2c95562496c88bf514871a1d3
multiaddr would point to a commit at this repository: https://github.com/multiformats/multiaddr/commit/5a179104a6f9e9a2c95562496c88bf514871a1d3 .
a client would receive the fetched data as a git repository, and even can verify the sha-1 or sha-256  of the repository.
A server implementation would require either one of those solutions

brute force through all his stored repositories to find this hash.
hold  mapping information between commit hashes and repositories for faster lookups.
store all git repositories within one merkle tree (?? i don't know enough details about this if this is possible and benefits the most - especially de-duplication ?!)

The Server would then either respond with the verifiable content, or with Not Found.
A P2P extension would be possible.
Security: Sha-256 vs Sha1
Since Sha1 (20 byte)  is  considered vulnerable and sha-256 (32 byte) is considered to be much more secure, Sha-256 seems the way to go.
Further Informations

https://git-scm.com/docs/hash-function-transition/
https://devclass.com/2023/08/22/git-2-42-released-sha-256-repositories-no-longer-an-experimental-curiosity/

But the reality is, that sha-1 is used in most repositories, therefore sha-1 would be required for compatibility support.
Every concern about backward compatibility would be gone, if Github and Co. would manage either go into the direction of dual hashing, or SHA-1 fades out as deprecated - but we know from other tech: this will take years...
sha-1 backward compatibility with sha-256 security extension.
the address scheme could get extended so sacrifice additional 32 bytes for delivering the sha-256 hash
i don't know exactly about the chaining rules of multiaddr, but it could look something like this:
/git/5a179104a6f9e9a2c95562496c88bf514871a1d3/123456789012345678901234567890123456789012345678901234567890abcd
(the provided hash in this example is incorrect, grateful if someone can provide the correct hash)
If you have a trusted platform that knows about the repository you want to secure,
it is possible to provide mappings for this in a multiaddr way.
Compatibility mapping for git: /git-sha1-sha256/5a179104a6f9e9a2c95562496c88bf514871a1d3 would result into a hash that could also be used for  the /git/ addressing.
this concept could also support other secure hash functions, but with sha-256 it's a step towards the general adoption of sha-256.
Also it is flexible extendable for other ciphers. example; sha3 with 512 bit security:  /git-sha1-sha3_512/5a179104a6f9e9a2c95562496c88bf514871a1d3
Mapping for IPFS Content Address that provides this repository: /git-ipfs/5a179104a6f9e9a2c95562496c88bf514871a1d3

Multiaddrs are for addressing endpoints (machines, processes, etc.), not data. A multiaddr is a sequence of recursive instructions for how to connect to some endpoint. For git commits, we'd just use a CID (there's even a multicodec for that). cc @aschmahmann who has played with this kind of thing.
Also see https://github.com/multiformats/multiformats/pull/55 (which I unfortunately no longer have the bandwidth to work on). There's no reason /git/CID can't be a thing (it really should be a thing), it just isn't a multiaddr (it would be a "namespace" like /ipfs, /ipns, etc...). One option is to register a git-namespace (search https://github.com/multiformats/multicodec/blob/master/table.csv for "namespace" to see what I mean).

Thanks @Stebalien for the callout. @SurfingNerd the below is longer than I intended, but I wanted to both try and disambiguate a few of the options here (for the /git case) as well as put a reference for others involved in multiformats and multiaddr to give their thoughts on some of the more general questions this brings up.
From what I can tell there are three main ways you might want to reference git data:

Machine addressing (i.e. refer to where a machine is):

You want to refer to the machine you want to interact with along with some information about the protocol you're using. For example, as an alternative to git clone git@github.com:multiformats/multiaddr perhaps having something roughly along the lines of git clone /dns/github.com/git/multiformats/git-path/multiaddr (and similar could be said for the various Git transfer protocols https://git-scm.com/book/en/v2/Git-Internals-Transfer-Protocols)

Resource addressing (i.e. refer to a resource including how to get it):

You want to refer to the machine you want to download the specific git object from in addition to the protocol you'd like to use to do so. For example, you want to download the single git object with SHA-1 hash 45a179104a6f9e9a2c95562496c88bf514871a1d3 from the machine <IP_ADDRESS> with a specific protocol. Maybe it's the "dumb git protocol" (their words not mine) that IIUC looks like curl https://<IP_ADDRESS>/multiformats/multiaddr/objects/45/a179104a6f9e9a2c95562496c88bf514871a1d3, the "smart protocol", or the new one you've proposed. Either way it ends up looking something like /dns/myendpoint.tld/<the-protocol-id-and-parameters> which for the dumb protocol are just HTTP, for the smart one likely would require a /git or /git-protocol name, and maybe the new one you've proposed would get another

Content addressing (i.e. refer to content independent of where it is):

You want to refer to the data by its hash and download + validate it. In this case something like /ipfs/f017811145a179104a6f9e9a2c95562496c88bf514871a1d3 would suffice (note: /ipfs is the namespace here not a multiaddr). You can see the breakdown of the CID example I listed at https://cid.ipfs.tech/#f017811145a179104a6f9e9a2c95562496c88bf514871a1d3.
A few notes here just to make sure people are on the same page about using /ipfs:

The IPFS namespace doesn't care about things like the hash function, data transfer protocols, or content routing systems in use. You can, for example, choose to refer to existing Git, BitTorrent or Ethereum data using IPFS CIDs.

I see the linked issue with Radicle, if they were interested in exposing objects, blobs, trees, etc. using their hashes I suspect the IPFS namespace would be fine even though they're using different data transfer and discovery protocols than others using the IPFS namespace today. If there were any issues here they could likely be tackled in https://github.com/ipfs/specs.

If someone came around with a new content addressing format and wanted a code in the table IMO that'd be fine assuming it made sense. I'm calling out IPFS here as an option because it means there's no need to introduce a new code, there's already a bunch of tooling here, etc. As a disclaimer I work on various IPFS implementations.

On Machine vs Resource Addressing
I don't recall seeing the distinction of "machine" vs "resource" addressing elsewhere and perhaps there are more standard words to use here but I don't think the concept is new. The point I'm trying to get across is the difference between referring to something you can use in a variety of ways (e.g. given an IP address there's all sorts of things you can ask the machine to do) vs something that has really one use (e.g. download the pile of bytes over HTTP from <IP_ADDRESS> using path /foo/bar).
From what I can tell historically multiaddr has focused primarily on machine addressing, although it seems like the idea of HTTP multiaddrs has been around for a long time and is now in use in a few places and so maybe resource addressing is really designed to have a place here if people want it. Something I've noticed is that being able to introduce new protocols by name rather than a global number in the table makes building new protocols much easier and so using multiaddrs for things lower down the stack like ip, dns, tcp, udp, onion, libp2p, etc. feels better than doing so for protocols closer to the end user. As an example, the system where these "transports" were introduced https://github.com/multiformats/multicodec/pull/260 currently has limited ability to deal with new "transports" not in the code table which is a pain for experimentation.
Some thoughts on what IMO currently makes sense

Use the /ipfs namespace for git hashes since it's already doable (and allows for SHA1, SHA2-256, etc.)
If someone is building an application that wants machine or resource addresses for Git so they can live alongside other multiaddrs then let's figure out how to make this work based on what's needed. Some examples will help make sure this ends up sensible.
If, as you alluded to, you're interested in a (new) Git retrieval protocol that works across many repos but allows hash-based access to the data I'd probably start a repo somewhere with a spec + basic implementation and probably talk to some folks in this space (e.g. the communities of Git, Radicle, IPFS, etc.) and reference this issue so people like me can follow along 😄. That spec will also come in handy if you end up wanting a code in the table later on.

If you just want some Git objects by hash as opposed to something more optimized (e.g. bulk requests for parts of the tree of git objects) you might consider using https://specs.ipfs.tech/http-gateways/trustless-gateway/. For fancier things a deeper discussion may be needed.

Hopefully this was helpful and I didn't miss too much of @SurfingNerd's point in filing this issue or go off on too much of a tangent 😅

Thanks a lot, for your time and very detailed answers, it took me quite some time to get through it. 🥵
I did not known that IPFS is already supporting git, i will give it a try.
Fetching a repo, by only knowing the hash is already a good thing.
I will close the issue, since the demand for it is very questionable.


Repo Rebuild

Im unsure if this is something to even report but wanted to know if it means anything. i have copied the repo and then done a rebuild on the release. its builds fine but i get this message in visual studio wanted to pcik your brains if possible please.

They are just warnings of potential issues that are not best practice, however they are all handled within the code so as far as I'm aware its fine.


Removing DemoteMaster from vtctl, and UI.

It is just a confusing command. The tabletmanager RPC command is still
there (and used during reparent). But no need to expose it.

@michael-berlin will rebuild the UI and squash after approval.

LGTM


Email plugin - not working in ionic view (ios10)

Hey @mhartington currently we are adding a email plugin to our app.I am using following cordova plugin [https://github.com/katzer/cordova-plugin-email-composer.git].We are testing the app in ionic view ios ipad with (version 10.0.2).
Problem: To use email we wrote a click function to open email plugin,when clicking the button the ionic view is closing.
Note:

Removed and added cordova plugins multiple times it didnt worked.
Added meta http-equiv="Content-Security-Policy" content="default-src *; script-src 'self' 'unsafe-inline' 'unsafe-eval' ; style-src 'self' 'unsafe-inline' " came to know that safari had more restrictions in new version(ios10).
Current ionic version using in my development is  1.7.7

It will helpful if you suggest if I am missing any?
My system information:
Cordova CLI: 5.4.0
Gulp version:  CLI version 3.9.1
Gulp local:
Ionic Version: 0.9.27
Ionic CLI Version: 1.7.7
Ionic App Lib Version: 0.6.3
OS: Windows 8.1
Node Version: v4.2.1

This issue was moved to driftyco/ionic-view-issues#198


Updating mgDoc?

I have received a similar issue where mgDoc is used to the one where I had used mkDoc (with regard to unnecessary capitalization of words built into the mkDoc function) which is now updated.
I attempted to make a customizable mgDoc'' using the following function based on the updated mkDoc':
type Topic = NWrapper
mgDoc'' :: NamedIdea c => c -> (NWrapper -> NWrapper -> Sentence) -> Sentence -> [Section] -> Document
mgDoc'' sys comb authors secs =
Document ((nw mg) comb (nw sys)) authors secs
and ran into the error not in scope: type constructor or class NWrapper.
How can this be fixed?

Seems like you're missing an import of the NWrapper data type.

Fixed as of 2c47be1.
Should I remove mgDoc and/or mgDoc' yet?

I would recommend you not remove mgDoc / mgDoc' as they are generating the Module Guide (as opposed to the SRS). That system is being overhauled, but until it's done, we don't want to break things.
Also, since you said this is fixed, I'm going to close the issue.


Async Validation

Adds the functionality to be able to return a promise from a custom validator.
Requires that req.asyncValidationErrors() is used which will return a promise, rather than req.validationErrors() otherwise async validators may not have completed. I added a console warning if you use an async validator and then use validationErrors, as it could be a common mistake...
asyncValidationErrors will resolve if there are no errors and will reject with any (a)synchronous validation errors!

This is awesome! Sorry, but I have been busy the past couple days or your other PR would've already been merged.

Just one small comment, but besides that, everything looks good from a code perspective. You'll need to resolve conflicts with master since I merged in your other PR.
Note: This should fix https://github.com/ctavan/express-validator/issues/122 and https://github.com/ctavan/express-validator/issues/94 :clap:

This feature is now available in 2.17.0


SCAN_FAILED_INTERNAL_ERROR on API21

Summary
Library throw "SCAN_FAILED_INTERNAL_ERROR" error on scan on phones with Android 5.0 (API21). Tested other bluetooth applications and they works fine so this is not the issue with the device itself. Furthermore, after updating to Android 6.0 problem gone and scan with library works fine.
Preconditions
Checked for 2 devices namely: Sony Xperia E3 with Android 5.0 and Sony XPERIA E3 with Android 5.0.  I do not know if other models experiencing error as well.
Library version
1.3.3 but experiencing the same issue on older releases as well.
Steps to reproduce actual result
Just clone RxAndroidBle sample and touch "START SCAN"
Logs from the application running with setting RxBleLog.setLogLevel(RxBleLog.VERBOSE)
07-23 16:40:54.077 16409-16409/com.polidea.rxandroidble.sample D/RxBle#Radio:   QUEUED RxBleRadioOperationScanApi21(780412642)
07-23 16:40:54.077 16409-17838/com.polidea.rxandroidble.sample D/RxBle#Radio:  STARTED RxBleRadioOperationScanApi21(780412642)
07-23 16:40:54.093 16409-17838/com.polidea.rxandroidble.sample D/RxBle#Radio: FINISHED RxBleRadioOperationScanApi21(780412642)
07-23 16:40:54.099 16409-16409/com.polidea.rxandroidble.sample D/BluetoothLeScanner: could not find callback wrapper
07-23 16:40:54.103 16409-16409/com.polidea.rxandroidble.sample E/THIS: tal
                                                                       BleScanException{reason=SCAN_FAILED_INTERNAL_ERROR}
                                                                           at com.polidea.rxandroidble.internal.operations.RxBleRadioOperationScanApi21$1.onScanFailed(RxBleRadioOperationScanApi21.java:76)
                                                                           at android.bluetooth.le.BluetoothLeScanner$1.run(BluetoothLeScanner.java:379)
                                                                           at android.os.Handler.handleCallback(Handler.java:739)
                                                                           at android.os.Handler.dispatchMessage(Handler.java:95)
                                                                           at android.os.Looper.loop(Looper.java:135)
                                                                           at android.app.ActivityThread.main(ActivityThread.java:5254)
                                                                           at java.lang.reflect.Method.invoke(Native Method)
                                                                           at java.lang.reflect.Method.invoke(Method.java:372)
                                                                           at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:898)
                                                                           at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:693)

Hello @dagi12
Why do you think it is an issue with the library and not native Android BLE stack? The library just starts a scan and translates the result from the OS which in this case was SCAN_FAILED_INTERNAL_ERROR.
Could you paste the exact code that you are using?
I do not have access to the said phone with 5.0 so I cannot test it myself. It is possible that the other  applications use either the legacy API. Which other applications have you checked against?

Closing due to inactivity. Feel free to add more info when possible


fix(general.pipe.ts):Changes variable declarations as there are never…

… reassigned, cleans redundant return of variable

Closed due to previous PR which has the same changes.


[SU-266] Automatically configure imported workflows with default outputs

Currently, when a workflow is imported from Dockstore, its outputs are not configured. This is rarely what users want and can lead to wasted time and money if the user forgets to configure outputs and runs the workflow without saving its outputs to a data table.
With this change, workflow outputs will be automatically configured as if the user had clicked the "Use defaults" button in the workflow outputs tab.
Before
https://user-images.githubusercontent.com/1156625/211585533-8597f84b-6daa-4617-b3cb-a9abcbe4e4e2.mov
After
https://user-images.githubusercontent.com/1156625/211585578-4fd0d8df-e447-476c-ae22-67c218f4e402.mov

@cjllanwarne is https://github.com/DataBiosphere/terra-ui/pull/3655/commits/7c0cf2620f82e3c6351594ff58e24f355b7e05fe better?

This is the thing Theiagen flagged during the Connect Day talk, right?

Yes, it is.


Remove multi-threading.

I don't think we need multi-threading in this project right now, our team is definitely not going to be needing the performance, and it adds unnecessary complexion.

Local caching on beefrontend will help with throughput issues as well


add a Chinese doc

Closes: #???
Description
To help more Chinese developers learn about the Flow project, I added Chinese documentation for it

For contributor use:

[x]  add a file 'README_Zh_CN.md'

Thanks @aturX, this is great!
I'm going to reach out to somebody on our team who can review this.

Thanks @aturX, this is great!
I'm going to reach out to somebody on our team who can review this.

Thanks！

@zhangchiqing  Thanks for your suggestion, the modification has been completed


When build CPP-Ethereum,Each download failed - Ubuntu 16.04

When I build CPP-Ethereum,I already executed:
sudo apt-get install mesa-common-dev
A fault still happened as following:
cmake ..
-- [hunter] Initializing Hunter workspace (8fe144d9490501d398777532e0c0f56bc7bb0ec7)
-- [hunter]   https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz
-- [hunter]   -> /home/dck/.hunter/_Base/Download/Hunter/0.19.71/8fe144d
CMake Error at Build/Hunter-prefix/src/Hunter-stamp/download-Hunter.cmake:157 (message):
  Each download failed!

    error: downloading 'https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz' failed
         status_code: 1
         status_string: "Unsupported protocol"
         log:
         --- LOG BEGIN ---
         Protocol "https" not supported or disabled in libcurl

  Closing connection -1

         --- LOG END ---
         error: downloading 'https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz' failed
         status_code: 1
         status_string: "Unsupported protocol"
         log:
         --- LOG BEGIN ---
         Protocol "https" not supported or disabled in libcurl

  Closing connection -1

         --- LOG END ---
         error: downloading 'https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz' failed
         status_code: 1
         status_string: "Unsupported protocol"
         log:
         --- LOG BEGIN ---
         Protocol "https" not supported or disabled in libcurl

  Closing connection -1

         --- LOG END ---
         error: downloading 'https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz' failed
         status_code: 1
         status_string: "Unsupported protocol"
         log:
         --- LOG BEGIN ---
         Protocol "https" not supported or disabled in libcurl

  Closing connection -1

         --- LOG END ---
         error: downloading 'https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz' failed
         status_code: 1
         status_string: "Unsupported protocol"
         log:
         --- LOG BEGIN ---
         Protocol "https" not supported or disabled in libcurl

  Closing connection -1

         --- LOG END ---
         error: downloading 'https://github.com/ruslo/hunter/archive/v0.19.71.tar.gz' failed
         status_code: 1
         status_string: "Unsupported protocol"
         log:
         --- LOG BEGIN ---
         Protocol "https" not supported or disabled in libcurl

  Closing connection -1

         --- LOG END ---

make[2]: *** [Hunter-prefix/src/Hunter-stamp/Hunter-download] Error 1
make[1]: *** [CMakeFiles/Hunter.dir/all] Error 2
make: *** [all] Error 2

[hunter ** INTERNAL **] Build project failed
[hunter ** INTERNAL **] [Directory:/home/dck/cpp-ethereum]

------------------------------ WIKI -------------------------------
    https://github.com/ruslo/hunter/wiki/error.internal
-------------------------------------------------------------------

CMake Error at cmake/HunterGate.cmake:82 (message):
Call Stack (most recent call first):
  cmake/HunterGate.cmake:92 (hunter_gate_wiki)
  cmake/HunterGate.cmake:346 (hunter_gate_internal_error)
  cmake/HunterGate.cmake:499 (hunter_gate_download)
  CMakeLists.txt:54 (HunterGate)

-- Configuring incomplete, errors occurred!

Protocol "https" not supported or disabled in libcurl

You need to build CMake with OpenSSL support. This instruction can be helpful:

https://github.com/ruslo/hunter/issues/328#issuecomment-198672048


Linter keeps timing out

https://github.com/ossf/allstar/blob/main/.github/workflows/pr.yaml#L7-L13
Anyone familiar with this?

Above pr is merged, we will see if that helps.


runelite-client: Make Skotizo widget layoutable

I haven't tested this

I will test it in few hours when I will be home


feat: BLS verification lib (BFT-404)

What ❔
Adding BLS library for verification of aggregated signatures.
Why ❔
To allow onchain verification of finalized blocks.
Notes

Tests contain static test vector, generated by era-consensus/node/libs/crypto.
Integration code was not added. This will be done in a separate PR.

TODOs:

[ ] Add documentation
[ ] Add more tests

We decided to use ECDSA instead, so this PR is no longer needed.


added bogosort algorithem

added bogosort algorithem

The Fisher-Yates shuffle and isSorted should get their own files (and tests); they are much more useful than bogosort. This will trivialize the bogosort.
Don't use var, use let and const instead.
The complexity analysis is wrong. The best case complexity is O(n), since a single isSorted check takes O(n). The (expected) average complexity is not "unbounded"; yes, it can in theory fail to find the correct permutation infinitely often, but the probability for that is 0: Each iteration has a probability of 1/n! of succeeding. You obtain an expected O(n!n) time complexity using the geometric distribution since each iteration takes O(n) time.
You need to add tests. Please try to do this without simply duplicating tests.

Thanks for reviewing so quickly, I refactored the code, added tests and change the time complexity in the latest commits.


odrviewer doesn't work when planview is defined using param_poly3....

File with_param_poly.xodr:
geometry: ParamPoly3
s_offset for object's outline: exceeds max s_offset of planview geometry
is odrviewer working: NO
File with_line.xodr:
Geometry: Line
s_offset for object's outline: exceeds max s_offset of planview geometry
is odrviewer working: YES
File with_param_poly3_soffset_within_limit.xodr:
Geometry: ParamPoly3
s_offset for object's outline: reduced s_offset so that It can fit within the limit of max s_offset of planview geometry
is odrviewer working: YES
param_poly_issue.zip

This is because the ParamPoly3 geometry doesn't support interpolation past the ends.  It's not so easy to fix this due to the way the ParamPoly3 is implemented.
As background: ParamPoly3 uses a CubicBezier under the hood. When the CubicBezier is created it gets sampled from the parametric t=[0.0, 1.0] and a lookup table arc length -> parametric t is created. So basically we can only get t-values for the range [0.0, arc length] and can't get any t-values for past-the-end values (s < 0.0 or s > arc length)
The next step would be extending CubicBezier::get_t to handle values that are not in the valid range. Probably by calculating the arc length for a given t on demand, which is an expensive operation. Alternatively ParamPoly3 could be extended to just linearly extend the ends (like adding Line geometries at the ends)


Missing-gst plugin when playing BBC news

When I say ‘alexa，play bbc news ’，the sampleAPP will crash by the missing plugin err.But I have used gst-inspect-1.0 to check the plugin is installed.
2017-09-04 11:17:52.906 [  2] 9 MediaPlayer:handleBusMessage:message=GST_MESSAGE_BUFFERING,percent=100
2017-09-04 11:17:52.923 [ 10] I DirectiveRouter:preHandleDirective:messageId=e660643c-7bd5-4e14-9e54-c928bd24d9c9,action=calling
2017-09-04 11:17:52.932 [  2] E MediaPlayer:handleBusMessageError:source=decoder,error=Your GStreamer installation is missing a p
lug-in.,debug=gsturidecodebin.c(998)\: no_more_pads_full ()\: /GstPipeline\:audio-pipeline/GstURIDecodeBin\:decoder\:
no suitable plugins found\:
gstdecodebin2.c(4600)\: gst_decode_bin_expose ()\: /GstPipeline\:audio-pipeline/GstURIDecodeBin\:decoder/GstDecodeBin\:decodebin4
\:
no suitable plugins found\:
Missing decoder\: text/uri-list (text/uri-list)

Hello NyxRockchip2017,
It looks like GStreamer is running in to a playlist that is not supported.  Unfortunately, the avs-device-sdk does not yet support playlists (just iHeartradio).  That will be coming in future releases.  Thank you for bringing this to our attention, it will make a good test case!
Thank you,
-SWH

ok，I hope you can solve it as soon as possible，thks.


Tutorial color theme for the love of god

I know it's a childish request but..
Please can you put dark color theme on the tutorial, http://learn.ractivejs.org/event-proxies/1
I understand the design is sleek but I want to gauge my eyes out and im on step 4.
https://41.media.tumblr.com/22d01faa8f5d7614c4513dd7f6857248/tumblr_mm13nbkGCO1qka8bio1_400.jpg
I might have crappy display, but i checked it on a decent dell display in the office and the colors are still subtle especially in the <> in the html. Most of the colors are not visible (on the pro tips and the top menu) on most of the displays in the office (except on the dell one), nor the highlights of the text or html/js editor.
Monokai would be nice. Or Dracula or whatever just not the current one. Or if it needs to be the light one make it a bit more readable. The tutorail is great, but maimed by the color theme.. Thanks

https://chrome.google.com/webstore/detail/stylish/fjnbnpbmkenffdnngjfgmeleoegfcffe?hl=en
Best bet is to probably use a Chrome Plugin to do it yourself.

Yea I thought of Stylish, the problem is that we inherited a project with ractive and other technologies, with very tight deadline and i discarded the idea of creating styles for the tutorial..I needed to go through it fast. This is more of a suggestion for some other guys that will be in similar situation. Thanks.

Just got home and yep, the design of the ractive website/tutorial doesn't look what you think it looks to the majority. :)

An overhaul of the docs is coming down the line. With that, we'll certainly take a look at the tutorials as well.

Thanks for the response guys.

the design of the ractive website/tutorial doesn't look what you think it looks to the majority

eek, thanks for the heads up! I'll close this in favour of https://github.com/ractivejs/learn.ractivejs.org/issues/26


Ambproxy

@keyki pls check the unit tests

Fixed

@keyki https.proxyHost and https.proxyPort can configurable only for both cb and periscope together but useProxyForClusterConnection is configurable separately. Is that make sense or should that be configurable also only together?

https.proxyHost and port are jvm standards, could be the same for useProxyForClusterConnection as well, but doesnt really matter since they are running in separate container and have different environment variables


Medium prio lockups in AgencyCache and Query shutdown, BTS-1475, BTS-1486

This PR addresses two BTS tickets:

https://arangodb.atlassian.net/browse/BTS-1475
https://arangodb.atlassian.net/browse/BTS-1486

which both describe failures and lockups actually seen in production.
The details of the problems are described in the above BTS tickets.
The solution is twofold:

for BTS-1475 we make it so that responses to agency poll calls are
handled without scheduler involvement, they just trigger a wakeup
in the thread of the AgencyCache, which does the actual processing then.
for BTS-1486 we use the lane CLUSTER_INTERNAL on the HIGH prio queue
to receive the response to the AQL shutdown requests to the dbservers.

Both achieve to avoid the deadlocks.
Scope & Purpose
(Please describe the changes in this PR for reviewers, motivation, rationale - mandatory)

[*] :hankey: Bugfix

Checklist

[*] Tests

[*] integration tests

[*] :book: CHANGELOG entry made
[ ] Backports

[ ] Backport for 3.11: https://github.com/arangodb/arangodb/pull/19260
[ ] Backport for 3.10: https://github.com/arangodb/arangodb/pull/19262
[ ] Backport for 3.9: ???
[ ] Backport for 3.10.6: https://github.com/arangodb/arangodb/pull/19263

Related Information
(Please reference tickets / specification / other PRs etc)

[*] Enterprise PR: none
[*] GitHub issue / Jira ticket: https://arangodb.atlassian.net/browse/OASIS-25311

CHANGELOG is missing.


List of targets empty when using ~/... instead of /home//... as build dir

Brief Issue Summary
I just used the CMake: Quick Start to generate the sample project. I had set the Cmake: Build Directory setting to ~/build/${workspaceRootFolderName}/${buildType}, then generated with Ninja. The CMAKE_BUILD_TYPE was set to Debug.
When trying to configure the Build target in the Project status, the selection dropdown is empty.

When trying to configure the Debug or Launch target, the dropdown doesn't even appear at all.

Everything works fine when I set the Cmake: Build Directory setting to /home/andreas/build/${workspaceRootFolderName}/${buildType}.
CMake Tools Diagnostics
{
  "os": "linux",
  "vscodeVersion": "1.85.1",
  "cmtVersion": "1.16.32",
  "configurations": [
    {
      "folder": "/home/andreas/src/cmake-quick",
      "cmakeVersion": "3.28.1",
      "configured": true,
      "generator": "Ninja",
      "usesPresets": false,
      "compilers": {}
    }
  ],
  "cpptoolsIntegration": {
    "isReady": true,
    "hasCodeModel": false,
    "activeBuildType": "",
    "buildTypesSeen": [],
    "requests": [],
    "responses": [],
    "partialMatches": [],
    "targetCount": 0,
    "executablesCount": 0,
    "librariesCount": 0,
    "targets": []
  },
  "settings": [
    {
      "communicationMode": "automatic",
      "useCMakePresets": "auto",
      "configureOnOpen": true
    }
  ]
}

Debug Log
No response
Additional Information
No response

I just realized: Workaround is to use ${userHome}/build/${workspaceRootFolderName}/${buildType}.
But it's still odd that there is no error message during configure. In my humble opinion it should either work or error out.

@haferburg Thanks for the workaround! In the meantime, I would agree that this scenario should be better handled by the extension. I'll mark this as a bug, and we will place this on the backlog, with the intention to, once we are able to prioritize this, we can reproduce the issue and see what it going on.
Thanks!


[Snyk] Security upgrade express from 4.19.2 to 4.21.1

Snyk has created this PR to fix one or more vulnerable packages in the `npm` dependencies of this project.
Changes included in this PR

Changes to the following files to upgrade the vulnerable dependencies to a fixed version:

package.json
package-lock.json

Vulnerabilities that will be fixed
With an upgrade:

Severity
Priority Score (*)
Issue
Breaking Change
Exploit Maturity

601/1000  Why? Recently disclosed, Has a fix available, CVSS 6.3
Cross-site Scripting (XSS) SNYK-JS-COOKIE-8163060
No
No Known Exploit

(*) Note that the real score may have changed since the PR was raised.

Commit messages

Package name: express
    The new version differs by 53 commits.

8e229f9 4.21.1
a024c8a fix(deps<EMAIL_ADDRESS>7e562c6 4.21.0
1bcde96 fix(deps<EMAIL_ADDRESS>(#5946)
7d36477 fix(deps<EMAIL_ADDRESS>(#5951)
40d2d8f fix(deps<EMAIL_ADDRESS>77ada90 Deprecate `"back"` magic string in redirects (#5935)
21df421 4.20.0
4c9ddc1 feat: upgrade to<EMAIL_ADDRESS>9ebe5d5 feat: upgrade to<EMAIL_ADDRESS>(#5928)
ec4a01b feat: upgrade to<EMAIL_ADDRESS>(#5926)
54271f6 fix: don't render redirect values in anchor href
125bb74<EMAIL_ADDRESS>(#5902)
2a980ad<EMAIL_ADDRESS>(#5781)
a3e7e05 docs: specify new instructions for `question` and `discuss`
c5addb9 deps<EMAIL_ADDRESS>(#5603)
e35380a docs: add @ IamLizu to the triage team (#5836)
f5b6e67 docs: update scorecard link (#5814)
2177f67 docs: add OSSF Scorecard badge (#5436)
f4bd86e Replace Appveyor windows testing with GHA (#5599)
2ec589c Fix Contributor Covenant link definition reference in attribution section (#5762)
4cf7eed remove minor version pinning from ci (#5722)
6d08471 📝 update people, add ctcpip to TC (#5683)
61421a8 skip QUERY tests for Node 21 only, still not supported (#5695)

See the full diff

Check the changes in this PR to ensure they won't cause issues with your project.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
🛠 Adjust project settings
📚 Read more about Snyk's upgrade and patch logic

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Cross-site Scripting (XSS)

coverage: 85.625%. remained the same
when pulling db14f27d14f3209f0e12632885aa8663e03aed6f on snyk-fix-8f8657533b5bed49d07cce2775d63819
into 603b0b81900a0eacaa0258f1363f0631471cc002 on main.


Add export to ONNX using in Triton server for Zipformer

Hi,
This PR supports exporting offline Zipformer model to ONNX format which can be used in Triton server.
Thanks!

Could you please add a --fp16 option? We could export onnx fp16 model using onnxmltools.


feat(components): add material style

Starting with the Switch component, this adds a style to match Material UI.
I wanted to put this PR up to gauge the interest in adding a new style like this. I can do the work but would rather know if we want it before putting in all of the time!
I've copied the new-york styles for everything but the Switch component if anyone is wanting to view this locally.
We obviously don't need to merge this work until all of the styles are done, I just wanted to start the conversation.
(Please ignore the generated content in registry/styles I did this on Windows lol)

Thanks for starting this. Let's see if we have interest.

Any update on this fabulous PR? @shadcn


[WIP]add support for auto-import and manager tls certs

The purpose of this PR:

fix #238
add support for automatically manage(import/update/delete) TLS certificates.
Test format of tls tls.crt must be the full certificate chain in reverse order as below:

-----BEGIN CERTIFICATE-----             // server cert
-----END CERTIFICATE-----
-----BEGIN CERTIFICATE-----             // intermediate cert
-----END CERTIFICATE-----
-----BEGIN CERTIFICATE-----             // root cert
-----END CERTIFICATE-----

Tests done:

tested self-signed certificates works.

openssl req -new -newkey rsa:2048 -days 365 -nodes -x509 -keyout server.key -out server.crt
kubectl create secret tls m00nf1sh-chain --key  server.key --cert server.r

tested certificate chain works:

openssl genrsa -out ca.key 2048
openssl req -x509 -new -nodes -subj "/CN=M00nF1sh CA" -days 3650 -key ca.key -out ca.crt
openssl genrsa -out intermediate.key 2048
openssl req -new -nodes -subj '/CN=M00nF1sh Intermediate' -key intermediate.key -out intermediate.csr
openssl x509 -req -sha256 -days 365 -CA ca.crt -CAkey ca.key -set_serial 01 -in intermediate.csr -out intermediate.crt
openssl genrsa -out server.key 2048
openssl req -x509 -new -nodes -subj "/CN=example.com" -days 3650 -key server.key -out server.crt
openssl x509 -req -sha256 -days 365 -CA intermediate.crt -CAkey intermediate.key -set_serial 01 -in server.csr -out server.crt
cat server.crt intermediate.crt ca.crt chain.crt
kubectl create secret tls m00nf1sh-chain --key  server.key --cert chain.crt

tested cert-manager with ca-issuer worked with exceptions.

If you are using an self-signed cert as root CA, it won't work. Since AWS requires you to upload a cert chain for non-self-signed cert. And cert-manager didn't bound self-signed root CA. An workaround maybe rely on the "ca.crt" generated by cert-manager, but it's not standard solution.
If you are using intermedia CA, it works pretty good. (Since aws didn't validate the entire cert chain, it only validated whether you provided a cert chain :D).

step to generate cert chain: https://gist.github.com/M00nF1sh/cf87982c68dbdc4a14bf8edc9d1378f8
you have to install the root CA to OSX keychain to make browser consider it as valid cert.

@M00nF1sh do you have plans to continue working on this?

@M00nF1sh mind if I take a stab at doing this again? Would love this feature to be merged.


Colors! 3D

Game Name (and version if necessary)
Colors! 3D (USA)
Hardware Specs (If necessary)
No response
Operating System
Windows 11 22H2
Game State
Title screen & menus work fine
When starting a new drawing, get this odd behavior shown in video below.
Switching zoom or layer to draw on brings up console message stating: "[Warning] [GSP::GPU VaddrToPaddr] Unknown virtual address 1F600000".
Screenshots

https://github.com/Panda3DS-emu/Panda3DS-Games-List/assets/5677214/da56e98c-2dda-4919-9a9d-224dd8c864ab
Additional information
The console states "[Warning] Ignoring mprotect! Hope nothing goes wrong but if the game accesses invalid memory or crashes then we prolly need to implement this" on startup.

Transferring from #143 to avoid duping


Out of memory on main.py startup

Running micropython on nodemcu.   Copied MicroWebServ.py and main.py using webrepl.
Upon restart of the board
Traceback (most recent call last):
File "main.py", line 2, in
MemoryError: memory allocation failed, allocating %u bytes
MicroPython v1.9.4-8-ga9a3caad0 on 2018-05-11; ESP module with ESP82
Any suggestions? THanks

The ESP8266 only has about 80KB of memory available before the Micropython Runtime is added, if you open a reply and do
import gc
gc.mem_free()

You should be able to see how much memory is available, my feeling is that its going to be very little. MicroWebSrv is very full featured and as such is going to have a large memory footprint. I'm using it on a Pycom LoPy4 which has about 2MB of memory (as it features an external SPI RAM).
You can try either using a .mpy file or by baking the MicroWebServ.py module in to ROM by freezing it during compile. Both will lower the load on working memory.
The first method, you will need to use mpy-cross, which takes a python file and compiles it to a binary format. Usually MicroPython does this at run time, but it needs enough RAM to load the raw .py file as well as the resulting binary. Your module during import is essentially in RAM twice during the compile step. By using mpy-cross on your machine and only uploading that file, you skip the compile step, and instead the .mpy file is loaded in to memory and run direction (not compiled on the NodeMCU)
The second method is freezing the module in to the firmware, which means compiling the firmware for NodeMCU yourself and giving it the MicroWebServ.py file to freeze. This will run mpy-cross, and burn this file in to the ROM. It will be read from the ROM at runtime and takes up 0 space in the RAM. The module will still use RAM for any dynamically allocated memory (strings, arrays, the usual python objects) but it will not occupy RAM for the code.
The last option which isn't really a solution, is don't use the NodeMCU or any 8266 board. The repo says ESP32 so I suggest using an ESP32 board. The Pycom devices (WiPy3) would be a good start there.

I am not wed to the nodemcu board, so will look at esp32 models.  Thanks
From: Josh Lloyd<EMAIL_ADDRESS>Sent: Tuesday, July 3, 2018 10:57 PM
To: jczic/MicroWebSrv
Cc: nobody102; Author
Subject: Re: [jczic/MicroWebSrv] Out of memory on main.py startup (#37)
The ESP8266 only has about 80KB of memory available before the Micropython Runtime is added, if you open a reply and do
import gc
gc.mem_free()
You should be able to see how much memory is available, my feeling is that its going to be very little. MicroWebSrv is very full featured and as such is going to have a large memory footprint. I'm using it on a Pycom LoPy4 which has about 2MB of memory (as it features an external SPI RAM).
You can try either using a .mpy file or by baking the MicroWebServ.py module in to ROM by freezing it during compile. Both will lower the load on working memory.
The first method, you will need to use mpy-cross, which takes a python file and compiles it to a binary format. Usually MicroPython does this at run time, but it needs enough RAM to load the raw .py file as well as the resulting binary. Your module during import is essentially in RAM twice during the compile step. By using mpy-cross on your machine and only uploading that file, you skip the compile step, and instead the .mpy file is loaded in to memory and run direction (not compiled on the NodeMCU)
The second method is freezing the module in to the firmware, which means compiling the firmware for NodeMCU yourself and giving it the MicroWebServ.py file to freeze. This will run mpy-cross, and burn this file in to the ROM. It will be read from the ROM at runtime and takes up 0 space in the RAM. The module will still use RAM for any dynamically allocated memory (strings, arrays, the usual python objects) but it will not occupy RAM for the code.
The last option which isn't really a solution, is don't use the NodeMCU or any 8266 board. The repo says ESP32 so I suggest using an ESP32 board. The Pycom devices (WiPy3) would be a good start there.
—
You are receiving this because you authored the thread.
Reply to this email directly, view https://github.com/jczic/MicroWebSrv/issues/37#issuecomment-402348840  it on GitHub, or mute https://github.com/notifications/unsubscribe-auth/Am7BsGdWszc4VZhuzJhSOVn8qTBTH0Kaks5uDC8TgaJpZM4VB2nz  the thread.  https://github.com/notifications/beacon/Am7BsGI7jRSGtE7IkN--tke7GuagQzjbks5uDC8TgaJpZM4VB2nz.gif

Hello again @nobody102.
If you've decided to go with an ESP32 board instead, would you agree this issue is closed?

Oky, so I'm closing this issue


WIP: 17.0.0.dev0

Checking if we can build before impending rc1

I don't think it's worth the effort, because to have a usable compiler stack we need to build llvmdev, clangdev, openmp, lld, compiler-rt, libcxx, cctools-and-ld64, plus the activation feedstock and perhaps mlir (see e.g. conda-forge/clang-compiler-activation-feedstock#99).
This is a lot of work (rebasing patches, raising issues where necessary, potentially backporting patches), and I doubt it's worth the effort. A brandnew compiler stack every 6 month should be plenty enough?

i guess i don't have the full context here (i guess this is tied to your work somehow...) but this is mlir feed stock so i was thinking just in terms of mlir. i mean mlir (e.g., via mlir-opt) has value independent of the remainder of the stack i think? anyway it was just a thought - if you think it's not worth it then it's probably not. incidentally i'm "watching" this repo because when i first discovered it seemed like a good way to have a dep on mlir, but since dev isn't bumped often i ended up setting up wheel builds of llvm+mlir on my own. anyway nbd and thanks for the effort on this distro channel.

Ok, thanks for the context. Not sure what you'd use a dev version of mlir for? It would simply the situation somewhat because we'd only have to build llvmdev and mlir, which would be a bit more feasible. But it'd have to be you to do the PRs to both feedstocks, and with a reasonably low frequency (say, max. once per month), and not during the rc-phase at least

Ok, thanks for the context. Not sure what you'd use a dev version of mlir for?

that's kind of a funny question - only because people actually complain about this quite often - every project that uses mlir that i am familiar with, pins to a (hopefully recent) commit hash rather than a release version. now i'm not familiar with all mlir projects (e.g., flang might be different), but i'm talking about serious projects (torch-mlir, tensorflow, jax) so it's definitely not unconventional. my own projects are also pinned to a commit hash.

It would simply the situation somewhat because we'd only have to build llvmdev and mlir, which would be a bit more feasible. But it'd have to be you to do the PRs to both feedstocks, and with a reasonably low frequency (say, max. once per month), and not during the rc-phase at least

yea like i said i've found my own means around - that mlir-wheels repo buld 4x a day :)

every project that uses mlir that i am familiar with, pins to a (hopefully recent) commit hash rather than a release version.

Yeah, because MLIR is still moving so quickly. It'll likely settle down eventually.


Uses httpsRedirect code in redirectWhenHttpProto

This makes redirectWhenHttpProto redirect using the code set in httpsRedirect

It's merged and released under the tag 18.02.08-104.


NIFI-12583 Update SMBJ to 0.13.0

Summary
NIFI-12583
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking

[X] Apache NiFi Jira issue created

Pull Request Tracking

[X] Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
[X] Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

[X] Pull Request based on current revision of the main branch
[X] Pull Request refers to a feature branch with one commit containing changes

Verification
Please indicate the verification steps performed prior to pull request creation.
Build

[ ] Build completed using mvn clean install -P contrib-check

[ ] JDK 21

Licensing

[ ] New dependencies are compatible with the Apache License 2.0 according to the License Policy
[ ] New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

[ ] Documentation formatting appears as expected in rendered files

Release notes: https://github.com/hierynomus/smbj/compare/v0.12.2...v0.13.0


Ignore dependencies coming from webpack-dev-server

This plugin currently informs me of duplicates where one of the instances comes from webpack-dev-server. Ideally it'd be nice if this plugin simply ignores files from that module to reduce noise, or potentially even provides an optional function for consumers to identify whatever they deem a false positive. Maybe something like:
new DuplicatePackageCheckerPlugin({
  emitError: false,
  isFalsePositive: function () {
    // add custom logic here that returns true when we deem this is a false positive.
    // this will require useful information via argument(s) for custom logic
    return false;
  },
  verbose: true,
})

Thanks for opening this issue @sandersky. What kind of arguments do you have in mind? I'm currently thinking about adding the package name and full path of the module. Is there something else that you think might be useful?

Glancing at the code real quick what about instances and name which come from here? Your logic could just do an early return in the for loop whenever the custom method returns true to avoid logging the issue or pushing an error to the array.


Multi-line strings cause errors to be reported on the wrong line

The error is on line 14, but it is reported on line 17.
The line offset is exactly the same as the number of new lines in the multi-line string.
Using Windows 10, elm 0.19.0.

I am pretty sure this is because lines end with \r\n on Windows. I think the \r is getting counted as a new line as well. Thanks for the report! I'll look into how to fix it!

Looks like that's correct. If I change the line endings to \n the error is reported on the correct line.


codecov: fix missing redirection

The prior commit to export the HTML coverage reports is broken due to it
missing the required redirection operator. Here's what the error message
would look like:
+ xz -9e /var/lib/buildbot/slaves/zfs/Ubuntu_17_04_x86_64_Coverage__TEST_/build/tests/coverage-user.tar.xz
+ tar -cf - coverage-user
xz: /var/lib/buildbot/slaves/zfs/Ubuntu_17_04_x86_64_Coverage__TEST_/build/tests/coverage-user.tar.xz: No such file or directory

This patch attempts to fix the issue.

Merged. Thanks!


CLI fails to parse tsconfig.json with comments

Originally reported here: justdlabs/justd#244
Describe the bug
Just tried to init a new project that started with bun init. Bun creates a tsconfig.json file with the following contents:
{
  "compilerOptions": {
    // Enable latest features
    "lib": ["ESNext", "DOM"],
    "target": "ESNext",
    "module": "ESNext",
    "moduleDetection": "force",
    "jsx": "react-jsx",
    "allowJs": true,

    // Bundler mode
    "moduleResolution": "bundler",
    "allowImportingTsExtensions": true,
    "verbatimModuleSyntax": true,
    "noEmit": true,

    // Best practices
    "strict": true,
    "skipLibCheck": true,
    "noFallthroughCasesInSwitch": true,

    // Some stricter flags (disabled by default)
    "noUnusedLocals": false,
    "noUnusedParameters": false,
    "noPropertyAccessFromIndexSignature": false
  }
}

Running bunx justd-cli@latest init next produces the following error:
✖ Failed to parse tsconfig.json.

Removing the comments (to adhere to JSON) passes the cli
To Reproduce
Steps to reproduce the behavior:

Create tsconfig with a comment
Run npx justd-cli@latest init
See error

Expected behavior
Support comments in tsconfig.json

At least right now, just remove the //
see this

It will fix on #4


fix: get TTKN appears duplicated transaction

Discribe
Currently, there is no better solution to avoid double spend when constructing transactions, so use the simplest error prompt for processing
Related problem

fix #197

Codecov Report

:exclamation: No coverage uploaded for pull request base (develop@4ab483e). Click here to learn what that means.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

@@            Coverage Diff             @@
##             develop     #266   +/-   ##
==========================================
  Coverage           ?   65.26%
==========================================
  Files              ?       39
  Lines              ?     6161
  Branches           ?      236
==========================================
  Hits               ?     4021
  Misses             ?     2137
  Partials           ?        3

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4ab483e...2c33804. Read the comment docs.

I didn't see the conversation last day in #197, sorry about that.
This issue is not detailed enough, but as I remember this issue is about state management. In the current version, a user can click the Get 1,000 Test Token(TTKN) on L1 button on the popup twice and trigger a double spend, @Dawn-githup was this the issue?
If it was, for the click twice issue, I think maybe we can add a state control logic to the button, that when a faucet method is running, the user cannot trigger the method again in the same page.

was this the issue

yes, was this the issue
From what you've said, it's possible to add a click rate control to the button, but it would take about 5 seconds to avoid this problem.Whether this will affect the user experience, click no response

I didn't see the conversation last day in #197, sorry about that.
This issue is not detailed enough, but I remember it was about state management. In the current version, a user can click the Get 1,000 Test Token(TTKN) on L1 button on the popup twice and trigger a double spend, @Dawn-githup was this the issue?
If it was, for the click twice issue, I think maybe we can add a state control logic to the button, that when a faucet method is running, the user cannot trigger the method again in the same page.

When the user refreshes the page, the status of the button will become invalid, and you can continue to click. Of course, this does not necessarily happen
But I think simple error prompt is an effective way to avoid introducing more complexity
@Dawn-githup @ShookLyngs


Dev Channel Post-Reset build: Can't save video

We had discovered an experience of bugs and quirks where Animator Insiders in the Dev Channel couldn't save videos.

issue resolved in next build (22533.1000)


Add support for method_exists() guards

implementation for https://github.com/johnbillion/wp-compat/pull/6

in case you find more variants which needs fixing and are not covered yet, please send another failing test-case and I will provide a followup

I think this should work as a initial iteration (in case you don't have remarks)


Full Prover and Test Prover Script

[x] Set a valid title
[x] Use branch-name [<ref>-]<feature-description>
[x] Brief description of the changes
[x] Create matching PRs in dependent repos

Creates an end-to-end full prover tool. Tests the tool in a script.

Adding @akileshtangella  as a reviewer as this has an effect on deployment and we should be careful not to add friction to this process.  For example, if we do end up replacing keygen with a rust command it could have an impact on several scripts and deployment steps.
(@SupremoUGH note that keygen currently has features like skipping generation of existing keys, dry-run mode etc)


Pods not restarting following config changes

I've set the enableConfigReload flag to true assuming every time I make changes to the CRD (e.g. set debug to true or increase the MaxPayload), the pods would be restarted in order to pick up these changes but this is not the case.. Am I missing something?

I believe it triggers a config reload by using SIGHUP not by restarting.
https://github.com/nats-io/nats-server/blob/6d5ac0a5e3944a4744c5da27e9c2322fcbb0c8b5/server/signal.go#L59

Nice! thanks for digging into this @chiaolun 👍


WICKET-6788 Improve performance of markup escaping

Checks for Character.UNASSIGNED instead of looking up non-chars in a set.
This solution more than doubles the throughput:
escapeMarkupHashSet        thrpt    5  395348,174 ± 48047,375  ops/s
escapeMarkupCharacterType  thrpt    5  847227,062 ± 13051,584  ops/s

https://issues.apache.org/jira/browse/WICKET-6788

Thanks for the reviews! Can somebody please merge this? I don't seem to have write access yet.

@theigl You need to link your GitHub account with your Apache account at https://gitbox.apache.org/

@martin-g: Thanks for the hint!


SwiftPrivateLibcExtras: explicitly unwrap the fildes array

When building on newer Android NDKs, the pipe function is marked as having a non-nullable type parameter. Explicitly unwrap the parameter so that it works for both nullable and non-nullable attributed pipe declarations.

CC: @drodriguez @finagolfin @etcwilde

@swift-ci please test

So I already had a version of this change in #69908, which I've held off on because the last line in that pull breaks older NDKs, like the NDK 25 used on the community Android CI.
Should I remove the last line in that pull and we can get the rest in now?

So I already had a version of this change in #69908, which I've held off on because the last line in that pull breaks older NDKs, like the NDK 25 used on the community Android CI.
Should I remove the last line in that pull and we can get the rest in now?

Sure, that seems reasonable - I'm not sure what platform could be adversely impacted - the unwrapping is pretty much required. Definitely happy with going with your PR over this as it is more complete.

This can be closed, merged the same fix in my earlier pull.


Adding Serilog, AppInsights Sink, and updated existing log messages t…

…o use structured logging
Configured to use serilog. My only question would be if we should include the ApplicationInsights Sink package my default?
I used it for testing purposes to ensure Serilog was wired up and pushing logs correctly.

Maybe comment it out with a note saying "Uncomment to wire up Application Insights" ?
Can we wire up a more local sink option as a default (other than console)?

Is this good to merge now?
I see the related article is live: https://blog.nimblepros.com/blogs/serilog-structured-logging/


call enrich on admin list API

this adds enrichment to admin API list and also makes the API pageable.  It'll need a corresponding change to the geneva action codebase.
fixes #703

I will take a look tomorrow. Please don't merge before I look properly, if possible.

Update to this: we had discussion with Jim last week. I think we decided:

Do not make any changes to the enricher itself (don't want to make the complex thing even more complex)
Add enricher to admin list and add pagination
Implement pagination on the Geneva action side

+1 - moved back to draft for the interim

@m1kola please can you re-review this?

@jim-minter I just noticed that the PR is still in draft. Are you planning to add something to it? Or is it in draft so we don't merge before geneva action side is ready?

closing for #859


Document is outdated for coroutine ?

The current documentation on the website seems to be outdated?
http://litote.org/kmongo/quick-start/

import org.litote.kmongo.coroutine.* //NEEDED! import KMongo extensions

val client = KMongo.createClient().coroutine  // <-- error on .coroutine, compile error

What is the correct way to import dependencies? Do we need to include both kmongo-async and kmongo-coroutine?
Thanks.

You are right, there is typo. Should be:
import org.litote.kmongo.reactivestreams.*
import org.litote.kmongo.coroutine.* //NEEDED! import KMongo extensions

val client = KMongo.createClient().coroutine  // <-- error on .coroutine, compile error

I'm going to fix it


Issue after updating to latest xamarin.ios and xcode

VERSIONS

Xamarin.Forms.GoogleMaps - 3.3.0
Xamarin.Forms - <IP_ADDRESS>1265

PLATFORMS

[ ] Android
[x] iOS
[ ] UWP

ACTUAL BEHAVIOR
I'm unable to build a project after the update, the project was working perfectly but as soon I installed the latest Xcode version and the latest update of VSMac can't build the project.
ACTUAL SCREENSHOTS/STACKTRACE
/Users/theuser/.nuget/packages/xamarin.build.download/0.7.1/buildTransitive/Xamarin.Build.Download.targets(3,3): Error: Did not find reference matching RestoreAssemblyResources AssemblyName metadata 'Google.Maps, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null'
If I install Xamarin.Build.Download I get
/Users/starlingonzalez/Documents/Projects/ecostructivemobile/ecostructivemobile.iOS/MTOUCH: Error MT0009: Error while loading assemblies: /Users/starlingonzalez/.nuget/packages/xamarin.google.ios.maps/3.5.0/lib/xamarinios10/Google.Maps.dll. (MT0009) (ecostructivemobile.iOS)
Which I have to mention again, the project was running fine  and in Android don't get any issues, seems related to the new xcode, or Xamarin.iOS package which is :
Xamarin.iOS
Version: <IP_ADDRESS> (Visual Studio Community)
Hash: 7ec3751a1
Branch: xcode12
Build date: 2020-09-16 11:33:15-040
Any guidance on the topic will be greatly appreciated

Forgot to mention that this is in Catalina (10.15.7) also

worth to mention that I tried the current Xamarin.Forms.Maps and it works out of the box, just letting you know about it to see if it help narrow the issue

I think I find the issue,
I downloaded the source code and did the following:

Update all dependencies/packages in all the projects
I still get same error, but went deeper on the solution and found that it was referencing the wrong Xamarin.Google.iOS.Maps package, was <IP_ADDRESS> and updated to <IP_ADDRESS>

built the project and generate the nuget package following this https://docs.microsoft.com/en-us/nuget/create-packages/creating-a-package-dotnet-cli, manually added the repository, remove all nuget packages and restore and was able to make it work.
I must say it wasn't easy to came to this solution, but think It's good to mention it here.
Thanks for the great work!

@starl1n can you share the nuget package?

Sure thing
Here's a link directly to it
Remember to add a local repository for it and put it in that folder
https://1drv.ms/u/s!AihMZY0ZyrxQk_YsnFwHe59--DosjA?e=tsf2pw


Study time constraints of block timestamps

What should the policy be for submitting blocks with timestamps in the past?
What should the policy be for submitting blocks too far into the future?
All these decisions should be up to the consensus algorithm chosen.

Currently there's some boilerplate code in place to prevent basic bad blocks, but this problem should be studied more deeply.

What should the policy be for submitting blocks with timestamps in the past?

Any new block timestamp must now be >= previous block's timestamp.

What should the policy be for submitting blocks too far into the future?

With the new longest chain policy with least holes in time slots, this doesn't matter much, since posting a block in the future will make it get ignored. However, we allow only 2 minutes in the future anyway.


Is it possible to define more than one graphite database?

Hi there,
Is it possible to define more than one graphite database?
And if it is, what should be the syntax for graphite_options?
I tried this code:
    graphite_options        => [ {
      'enabled'           => true,
      'database'          => 'graphite',
      'bind-address'      => ':2003',
      'protocol'          => tcp,
      'consistency-level' => 'one',
      'name-separator'    => '.',
      'batch-size'        => 1000,
      'batch-pending'     => 5,
      'batch-timeout'     => '1s',
      'udp-read-buffer'   => 0,
    },
    {
      'enabled'           => true,
      'database'          => 'graphite2',
      'bind-address'      => ':2011',
      'protocol'          => tcp,
      'consistency-level' => 'one',
      'name-separator'    => '.',
      'batch-size'        => 1000,
      'batch-pending'     => 5,
      'batch-timeout'     => '1s',
      'udp-read-buffer'   => 0,
    } ],

But I've got an error:
Error: Could not retrieve catalog from remote server: Error 400 on SERVER: Failed to parse template influxdb/influxdb.conf.erb:
  Filepath: /etc/puppet/modules/influxdb/templates/influxdb.conf.erb
  Line: 128
  Detail: undefined method `key' for nil:NilClass
 at /etc/puppet/modules/influxdb/manifests/server/config.pp:96 on node influxdbnode-96jxf36fl7tdfn7
Warning: Not using cache on failed catalog
Error: Could not retrieve catalog; skipping run

Please advice. Thank you!

what version of puppet you use ?

3.8.7

n1tr0g,
I fixed template a little to make it work.
It was (LINE 126-129):
<% @graphite_options.each do |option| -%>
[[graphite]]
<% @options.key.sort.each do |key| -%>
<% val = @options[key]

And fix is:
<% @graphite_options.each do |option| -%>
[[graphite]]
<% option.keys.sort.each do |key| -%>
<% val = option[key]

It it correct I can commit with Pull Request.

looks ok ... can you create an PR ?

@n1tr0g Of course! Done.


Explicit taskHub parameter for stored procedures

Please consider changing approach from using implicit dt.CurrentTaskHub() to explicit parameter in all procedures.
Rational. Flexibility in support database sharing/isolation approaches and simplicity.
For example, from documentation: "This is often valuable when your organization has many small apps but prefers to manage only a single backend database. When multitenancy is enabled, different apps connect to a shared database using different database login credentials and each app will only have access to its own data." Explicit assumption of different login is not flexible, and might be not reflecting reality for majority of financial organizations that actually want to share the database schema.

@michaelplavnik can you share more about the setup that you want to enable? There are several ways to share a database and I want to understand if there is a mechanism to enable your scenario that doesn't require explicit task hub parameters.
I anticipate it will be difficult for us to continue support the higher security model if we add explicit task hub parameters.

The following setup: hub process is running under AD account, SQL server trusted authentication, shared connection pool between task hub and domain specific logic. Multiple physical hosts, each running single hub process. Hosts are partitioned based on task hub name.
In regards to your concern. It seems to revolve around @taskHubMode = 1. This can still be enforced even with explicit task hub name (e.g. instead of deducing task hub name, assert USER_NAME() = taskHubName). Other mode then becomes application level responsibility mode.

I see. I think that strategy might work and that the feature could be generally useful - thank you.
While useful, it may be difficult for our team to prioritize this feature at this time without input from more users. That said, many of the features in this project are community contributions, and we'd be happy to accept a PR for this enhancement as well is anyone wants to contribute it (in which case we can publish it immediately).

i support this line of discussion because operating durable functions with the sql provider drives one into conflict with unforable combinations of at minimum

1:1 map of sql-login-name<=> task hub separation. in a dev environment with frequent code changes this is a confounding factor for retiring in-flight orchestrations that encourages bloat of 'abandoned' schemas and databases with inflight orchestrations
tight coupling of schema names and kubernetes func deploy configuration of scalar metric as per the config below. this is a cross-cutting concern that depends on the keda autoscaler configuration

  - metadata:
      connectionStringFromEnv: FunctionStorage_SQLSERVER
      query: SELECT dt.GetScaleRecommendation(10, 1)
      targetValue: '1'
    type: mssql

i believe the rationale posited by the original poster is in line with what i've said here. apologies if not


GH-34453: [Go] Support Builders for user defined extensions

This should serve as discussion as it's a medium change but this should Close https://github.com/apache/arrow/issues/34453 and give users the ability to define custom Builder for their extensions just like they define ExtensionTypes and ExtensionArrays

Closes: #34453

Took a look through, thoughts?

@zeroshade  Thanks for the initial review! Commented and also linked to a few example on how we use it.

Ready now for another review, though looks like some workflows are failing. I think this is not connected though to this PR


chore: add contribution guide and document scripts/vm.py

Copied from https://github.com/foundry-rs/foundry/blob/master/CONTRIBUTING.md with some minor modifications to make it specific to forge-std
Documents running vm.py to update src/Vm.sol in more detail, related: https://github.com/foundry-rs/forge-std/pull/615#discussion_r1787370448

To generate the changes from my PR on Foundry repo I had to manually modify vm.py to fetch the json from my repo+branch.
It would be nice to be able to pass that information to vm.py, something like:
$ ./scripts/vm.py tudmotu vm.mockCalls

And it would fetch the json file from https://raw.githubusercontent.com/{username}/foundry/{branch}/crates/cheatcodes/assets/cheatcodes.json
This could be option and default to "foundry-rs" and "master" respectively, to keeo backwards-compatibility.
WDYT?

To generate the changes from my PR on Foundry repo I had to manually modify vm.py to fetch the json from my repo+branch.
It would be nice to be able to pass that information to vm.py, something like:
$ ./scripts/vm.py tudmotu vm.mockCalls

And it would fetch the json file from https://raw.githubusercontent.com/{username}/foundry/{branch}/crates/cheatcodes/assets/cheatcodes.json
These params could be optional and default to "foundry-rs" and "master" respectively, to keep backwards-compatibility.
WDYT?

Ah I see, I generally wouldn't be against making this addition
In terms of process it is usually the case that cheatcodes are first merged and then a follow-up PR in forge-std is to be drafted rather than concurrently. Defaulting to the existing case is a good middle ground I feel.
Would you like to contribute this change?

Sure, will open a small PR using argparse and you can decide if you want to include it.

Going to merge as it is relatively non-controversial and should help external contributors to run / update
Happy to handle any follow-ups / modifications


Adding MIN_FREE_DISK to monolithic's env vars

See parent issue lancachenet/monolithic - Implement NGINX 'min_free` parameter to ensure cache drive always has free space

@tpill90 the MIN_FREE_DISK env var should be added to generic as it'll pull accross


Investigate GSF Impact Framework integration

How can we integrate SusQL with the Green Software Foundation's Impact Framework?

Verify that it is possible to configure the Impact Framework to use SusQL data. Document how to do this is sufficient detail that clients can easily implement.
Would it make this easier if we provided a SusQL Plugin? How to create this plugin? How much effort involved?
Other useful deliverables?

Reference: https://if.greensoftware.foundation/

added various documentation and scripts on using GSF Impact framework plugins to read Prometheus data.
https://github.com/sustainable-computing-io/susql-operator/blob/main/samples/impact-framework/README.md


feat(customElement): support attachInternals method

close #10948

Should we also create a new API like useHostInternals()? As _internal seems to be a private field


[CI-7218] Update ci-allure-report.md

Removing the note for Hosted VM.
Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the maintainers.
What Type of PR is This?

[ ] Issue
[ ] Feature
[ ] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[ ] Tested Locally
[ ] Optional Screen Shoot.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app


Support for Cleware USB traffic light device

The traffic light devices from Cleware use the same API as Switch and Multiplexer. Therefor they should also be supported by microservice
https://www.cleware-shop.de/epages/63698188.sf/de_DE/?ObjectPath=/Shops/63698188/Categories/Signalleuchten

Hi @milanac030988 ,
please work on this with highest priorty.
Should be (hopefully) not much to do (basically different GUIs), but has a nice effect visually for everybody in the room.
Thank you,
Thomas

Started implementing

very good!

Hi @milanac030988 ,
what is the status of this issue?
Thank you,
Thomas

Finished implement but have no device for test