HADOOP-18889. S3A v2 SDK third party support

handle getBucketLocation() unsupported
append / to marker tool searches if the first call fails.
downgrade change control errors a bit better. TODO: useful error text/docs
handle unknown storage classes.
Docs on how to bind to and test third party stores, including google gcs.

Not doing the region logic; this is other test failures.
Exception translation/resilience

new AWSUnsupportedFeatureException ex for unsupported/unavailable errors
handle 501 method unimplemented the same
all ex > 500 mapped to the AWSStatus500Exception
precondition errors handled a bit better
GCS throttle exception also recognised.
New class ErrorHandling to move our error handling logic too, initially somewhere for new stuff
ErrorHandling.maybeTranslateNetworkException() scans down an exception chain and if the inner one is of a known type

UnknownHostException
NoRouteToHostException
ConnectException
Then a new exception of that specific type is created, with the top level ex its cause.
This is done to retain the whole stack chain.

reduce the number of retries within the AWS SDK
and those of our S3ARetryPolicy

The reduction in retries is because its clear when you try to create a bucket
which doesn't resolve that the time for even an UnknownHostException to
eventually fail over 90s, which then hit the s3a retry code.

Reducing the sdk retries means these escalate to our code better.
Cutting back on our own retries makes it a bit more responsive for most real deployments.
maybeTranslateNetworkException() and s3a retry policy means that
UnknownHostException is recognised and fails fast.

Lots of changes to the test code:

more switches to turn off test suites (acls, v1list, ...)
more resilience to different test failures
pull up skip() checks into config create phase, rather than waiting for fs to be instantiated (faster; keeps the fs cache clean)
tuning for new exceptions

How was this patch tested?

AWS S3 london: no regressions observed.
a third party endpoint: showed troublespots, especially how handling of
UnknownHostException needed to be radically improved.
Gave me the stack traces for the docs too

Docs cover google gcs binding; I've not tested that yet, but the settings came from
a colleague who has connected the v1 sdk to it.
A full test run against GCS should be something we require here as it supports
a different subset of the s3 apis (no bulk delete, v1 list only...)
For code changes:

[X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[X] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 37s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 16 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 50s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
33m 22s

trunk passed

+1 :green_heart:
compile
17m 40s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
16m 41s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
5m  6s

trunk passed

+1 :green_heart:
mvnsite
2m 47s

trunk passed

+1 :green_heart:
javadoc
2m  9s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 55s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m  1s

trunk passed

+1 :green_heart:
shadedclient
34m  8s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 33s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 31s

the patch passed

+1 :green_heart:
compile
16m 33s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
16m 33s

the patch passed

+1 :green_heart:
compile
16m 18s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
16m 18s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 14 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
4m 21s
/results-checkstyle-root.txt
root: The patch generated 9 new + 22 unchanged - 0 fixed = 31 total (was 22)

+1 :green_heart:
mvnsite
2m 49s

the patch passed

+1 :green_heart:
javadoc
2m  4s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

-1 :x:
javadoc
0m 55s
/results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05.txt
hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

+1 :green_heart:
spotbugs
4m 20s

the patch passed

+1 :green_heart:
shadedclient
34m 31s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 40s

hadoop-common in the patch passed.

+1 :green_heart:
unit
2m 58s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 10s

The patch does not generate ASF License warnings.

249m 53s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux b95c140165f9 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 0edc728942f4eaef1e1e8118d57d9e33e56fb502

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/1/testReport/

Max. process+thread count
2589 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 41s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 16 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 41s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
33m 47s

trunk passed

+1 :green_heart:
compile
19m 18s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
17m 34s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 48s

trunk passed

+1 :green_heart:
mvnsite
2m 53s

trunk passed

+1 :green_heart:
javadoc
2m  1s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 41s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m 12s

trunk passed

+1 :green_heart:
shadedclient
34m 47s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 31s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 28s

the patch passed

+1 :green_heart:
compile
19m  9s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
19m  9s

the patch passed

+1 :green_heart:
compile
17m 23s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
17m 23s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
5m  1s
/results-checkstyle-root.txt
root: The patch generated 9 new + 22 unchanged - 0 fixed = 31 total (was 22)

+1 :green_heart:
mvnsite
2m 53s

the patch passed

+1 :green_heart:
javadoc
1m 52s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 45s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m 25s

the patch passed

+1 :green_heart:
shadedclient
34m 54s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 56s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  4s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 11s

The patch does not generate ASF License warnings.

257m 40s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 843a19528357 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 8c0dbd40e2b434dd2ff9ba95bc6d7da6d116f081

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/3/testReport/

Max. process+thread count
1263 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

new commit now works properly with GCS except for some known test failures! Docs cover the details...the key thing is s3a can handle it if you don't have the gcs-connector. No idea about performance diffs. I know gcs does some things with caching parquet footers etc, but s3a offers vector io.
also i've somehow got multipart playing up. will look at.

Tested: google cloud somewhere

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 38s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 23 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m  6s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
31m 50s

trunk passed

+1 :green_heart:
compile
17m 21s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
16m  9s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 15s

trunk passed

+1 :green_heart:
mvnsite
2m 49s

trunk passed

+1 :green_heart:
javadoc
2m  7s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 55s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m  3s

trunk passed

+1 :green_heart:
shadedclient
30m 47s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
31m 16s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 34s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 29s

the patch passed

+1 :green_heart:
compile
16m 43s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
16m 43s

the patch passed

+1 :green_heart:
compile
15m 55s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
15m 55s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 7 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
4m 24s
/results-checkstyle-root.txt
root: The patch generated 2 new + 28 unchanged - 0 fixed = 30 total (was 28)

+1 :green_heart:
mvnsite
2m 48s

the patch passed

+1 :green_heart:
javadoc
1m 58s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 55s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m 21s

the patch passed

+1 :green_heart:
shadedclient
34m 56s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 23s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  8s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 10s

The patch does not generate ASF License warnings.

242m 48s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 14967e03ae5e 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / a6f80d3af9358c8ba650fb74e1b5b7c6f358cded

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/4/testReport/

Max. process+thread count
1265 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/4/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

latest iteration tested: s3 london at -Dscale and -Dprefetch
*Error translation uses reflection to create IOE of the right type.

All IOEs at the bottom of an AWS stack chain are regenerated.
Troubleshooting doc updated with the new classnames;
cutting out stack traces rather than bother recreating them.

Pulled the multipart param stuff, which can be addressed in a separate JIRA.
Where I also think we should move listUploads() to S3AInternals
as it is very internal.
But did tweak ITestS3AMultipartUtils while debugging this...
leaving that in as better assertions are always good.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 38s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 25 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 41s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
32m 17s

trunk passed

+1 :green_heart:
compile
17m 14s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
16m 12s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 25s

trunk passed

+1 :green_heart:
mvnsite
2m 48s

trunk passed

+1 :green_heart:
javadoc
2m  8s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 55s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m  3s

trunk passed

+1 :green_heart:
shadedclient
34m  7s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
34m 35s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 31s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 30s

the patch passed

+1 :green_heart:
compile
16m 29s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
16m 29s

the patch passed

+1 :green_heart:
compile
15m 56s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
15m 56s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 9 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
4m 18s
/results-checkstyle-root.txt
root: The patch generated 1 new + 27 unchanged - 1 fixed = 28 total (was 28)

+1 :green_heart:
mvnsite
2m 47s

the patch passed

+1 :green_heart:
javadoc
2m  4s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 56s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m 20s

the patch passed

+1 :green_heart:
shadedclient
34m 41s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 23s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  5s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 11s

The patch does not generate ASF License warnings.

246m 48s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/5/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux<PHONE_NUMBER>ca 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / f4fde354ac4953d67aebcb2d513dc8ee7f6bae42

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/5/testReport/

Max. process+thread count
1263 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/5/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

failure of test run with  -Dparallel-tests -DtestsThreadCount=10 -Dscale
normally I run with count=8; wonder if this is a factor. but the huge stuff is done at the end, sequentially. or its a leftover of me cancelling a previous run. in which case i should add a new cleanup
[ERROR] Failures:
[ERROR]   ITestS3AHugeMagicCommits.test_030_postCreationAssertions:150 [Pending uploads]
Expected size:<1> but was:<2> in:
<["Upload to tests3ascale/ITestS3AHugeMagicCommits/commit/commit.bin with ID GU0jUb2jczQjP9D0HPT1pbctBiRNC6iXXok03zCW7UsBsqOpwXQfamXwj_E.cMVRiUcmVXxbIUqDYUftzCADiTu6ReSjverMlkx9yWGPpwEF6ZXgD..FCiXE5q02zeCO; initiated 2023-10-10 16:46:50",
    "Upload to tests3ascale/ITestS3AHugeMagicCommits/commit/commit.bin with ID UctmfmGnoyg.F0CvKsScj5.PyFChQdYdiIaes5AMEADRrbLOgZMFoh53P1osgA5hmBR89mSaWl6lqkmLct._3wizqiHYAmpFZvEE9FSUxm.vRSsCb2WcBleQOGYObM4s; initiated 2023-10-10 17:00:53"]>
[ERROR] Errors:
[ERROR]   ITestS3AHugeMagicCommits>AbstractSTestS3AHugeFiles.test_045_vectoredIOHugeFile:549->AbstractSTestS3AHugeFiles.assumeHugeFileExists:461->AbstractSTestS3AHugeFiles.assumeFileExists:471 » FileNotFound

fixed the test cleanup; one failure is
[INFO]
[ERROR] Failures:
[ERROR]   ITestS3AContractUnbuffer>AbstractContractUnbufferTest.testUnbufferMultipleReads:114->AbstractContractUnbufferTest.validateFileContents:139->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89 failed to read expected number of bytes from stream. This may be transient expected:<256> but was:<124>
[ERROR] Errors:
[ERROR]   ITestS3APrefetchingLruEviction.testSeeksWithLruEviction:162 » TestTimedOut tes...

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 35s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 25 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 48s

Maven dependency ordering for branch

-1 :x:
mvninstall
46m 30s
/branch-mvninstall-root.txt
root in trunk failed.

-1 :x:
compile
10m 49s
/branch-compile-root-jdkUbuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04.txt
root in trunk failed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04.

+1 :green_heart:
compile
16m  4s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 37s

trunk passed

+1 :green_heart:
mvnsite
2m 49s

trunk passed

+1 :green_heart:
javadoc
1m 58s

trunk passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
1m 45s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
3m 56s

trunk passed

+1 :green_heart:
shadedclient
38m 19s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
38m 49s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 31s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 36s

the patch passed

+1 :green_heart:
compile
21m 26s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
21m 26s

the patch passed

+1 :green_heart:
compile
19m  4s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
19m  4s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 9 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
4m 19s
/results-checkstyle-root.txt
root: The patch generated 1 new + 27 unchanged - 1 fixed = 28 total (was 28)

+1 :green_heart:
mvnsite
2m 49s

the patch passed

+1 :green_heart:
javadoc
2m 15s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

-1 :x:
javadoc
0m 53s
/results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05.txt
hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

-1 :x:
spotbugs
0m 30s
/patch-spotbugs-hadoop-tools_hadoop-aws.txt
hadoop-aws in the patch failed.

-1 :x:
shadedclient
8m 25s

patch has errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
17m  9s
/patch-unit-hadoop-common-project_hadoop-common.txt
hadoop-common in the patch failed.

-1 :x:
unit
0m 47s
/patch-unit-hadoop-tools_hadoop-aws.txt
hadoop-aws in the patch failed.

-1 :x:
asflicense
1m 24s
/results-asflicense.txt
The patch generated 3 ASF License warnings.

234m 53s

Reason
Tests

Failed junit tests
hadoop.io.TestSequenceFileAppend

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/6/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux bf596cab6891 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / f7d99fd1bf89bd9dbe65f2c6bfb7afde77856c70

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/6/testReport/

Max. process+thread count
553 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/6/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 35s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 26 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
16m 45s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
31m 39s

trunk passed

+1 :green_heart:
compile
17m 19s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
15m 19s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 22s

trunk passed

+1 :green_heart:
mvnsite
2m 45s

trunk passed

+1 :green_heart:
javadoc
2m  8s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 50s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
3m 58s

trunk passed

+1 :green_heart:
shadedclient
34m 29s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
34m 58s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 32s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 26s

the patch passed

+1 :green_heart:
compile
15m 56s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
15m 56s

the patch passed

+1 :green_heart:
compile
15m 56s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
15m 56s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 9 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
4m 16s
/results-checkstyle-root.txt
root: The patch generated 2 new + 27 unchanged - 1 fixed = 29 total (was 28)

+1 :green_heart:
mvnsite
2m 44s

the patch passed

+1 :green_heart:
javadoc
2m  4s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

-1 :x:
javadoc
0m 54s
/results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05.txt
hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

+1 :green_heart:
spotbugs
4m 14s

the patch passed

+1 :green_heart:
shadedclient
34m 30s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 21s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  5s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 14s

The patch does not generate ASF License warnings.

246m 28s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/7/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux e7161ae7cee0 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / a0ffcb55446b14c0dd9653c4a79f028ed691f797

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/7/testReport/

Max. process+thread count
3152 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/7/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 37s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 26 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
16m 15s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
31m 46s

trunk passed

+1 :green_heart:
compile
16m 55s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
17m 30s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
5m  7s

trunk passed

+1 :green_heart:
mvnsite
2m 39s

trunk passed

+1 :green_heart:
javadoc
1m 51s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 41s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
3m 58s

trunk passed

+1 :green_heart:
shadedclient
33m 59s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
34m 27s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 32s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 26s

the patch passed

+1 :green_heart:
compile
16m 16s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
16m 16s

the patch passed

+1 :green_heart:
compile
15m 55s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
15m 55s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
4m 27s
/results-checkstyle-root.txt
root: The patch generated 3 new + 26 unchanged - 2 fixed = 29 total (was 28)

+1 :green_heart:
mvnsite
2m 46s

the patch passed

+1 :green_heart:
javadoc
2m  4s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

-1 :x:
javadoc
0m 54s
/results-javadoc-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05.txt
hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

+1 :green_heart:
spotbugs
4m 17s

the patch passed

+1 :green_heart:
shadedclient
34m  8s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 20s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  5s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 12s

The patch does not generate ASF License warnings.

247m 41s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/8/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 91b71db57e72 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 3693ff6ec3767ca1cf8c3c75d33a8305bab239fc

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/8/testReport/

Max. process+thread count
1796 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/8/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

once javadocs is happy i will merge this

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 37s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 26 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
16m 19s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
30m 54s

trunk passed

+1 :green_heart:
compile
16m 48s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
15m 55s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 28s

trunk passed

+1 :green_heart:
mvnsite
2m 50s

trunk passed

+1 :green_heart:
javadoc
2m  2s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 44s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m  0s

trunk passed

+1 :green_heart:
shadedclient
34m 24s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
34m 52s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 32s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 27s

the patch passed

+1 :green_heart:
compile
15m 51s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
15m 51s

the patch passed

+1 :green_heart:
compile
15m 26s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
15m 26s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
4m 15s
/results-checkstyle-root.txt
root: The patch generated 3 new + 26 unchanged - 2 fixed = 29 total (was 28)

+1 :green_heart:
mvnsite
2m 48s

the patch passed

+1 :green_heart:
javadoc
2m  2s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 54s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m 17s

the patch passed

+1 :green_heart:
shadedclient
35m 38s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m  8s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  6s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m  7s

The patch does not generate ASF License warnings.

245m 48s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/9/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 674e50616597 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 970d1bf1be047a01226671e41d266b5a97a3284a

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/9/testReport/

Max. process+thread count
3152 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/9/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

going to cut out the bits related to connection settings; needs its own review. specifically, i want the settings
  <property>
    <name>fs.s3a.connection.timeout</name>
    <value>25000</value>
  </property>

  <property>
    <name>fs.s3a.connection.establish.timeout</name>
    <value>5000</value>
  </property>

to map to millis, and i want tests to show this

rolled back one commit; it's been through yetus so will merge

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 37s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 26 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
16m 41s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
34m  0s

trunk passed

+1 :green_heart:
compile
18m 39s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
15m 34s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 26s

trunk passed

+1 :green_heart:
mvnsite
2m 50s

trunk passed

+1 :green_heart:
javadoc
2m  6s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 54s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m  0s

trunk passed

+1 :green_heart:
shadedclient
33m 47s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
34m 15s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 32s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 22s

the patch passed

+1 :green_heart:
compile
16m 31s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
16m 31s

the patch passed

+1 :green_heart:
compile
16m  8s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
16m  8s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
4m 25s
/results-checkstyle-root.txt
root: The patch generated 3 new + 26 unchanged - 2 fixed = 29 total (was 28)

+1 :green_heart:
mvnsite
2m 46s

the patch passed

+1 :green_heart:
javadoc
2m  3s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 54s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m 20s

the patch passed

+1 :green_heart:
shadedclient
33m 54s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 14s

hadoop-common in the patch passed.

+1 :green_heart:
unit
3m  9s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m 11s

The patch does not generate ASF License warnings.

250m 22s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/11/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 24f73ce3741a 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 13fbaf84645e3e0bfb08e0ce0e8e6172d7d70148

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/11/testReport/

Max. process+thread count
1302 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/11/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 26 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
16m 32s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
31m 52s

trunk passed

+1 :green_heart:
compile
17m 11s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
15m 29s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 18s

trunk passed

+1 :green_heart:
mvnsite
2m 28s

trunk passed

+1 :green_heart:
javadoc
1m 47s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 35s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
3m 42s

trunk passed

+1 :green_heart:
shadedclient
32m 35s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
33m  0s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 30s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 22s

the patch passed

+1 :green_heart:
compile
15m 18s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
15m 18s

the patch passed

+1 :green_heart:
compile
14m 53s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
14m 53s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
4m  5s
/results-checkstyle-root.txt
root: The patch generated 3 new + 26 unchanged - 2 fixed = 29 total (was 28)

+1 :green_heart:
mvnsite
2m 27s

the patch passed

+1 :green_heart:
javadoc
1m 43s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
1m 35s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
4m  1s

the patch passed

+1 :green_heart:
shadedclient
34m  7s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 21s

hadoop-common in the patch passed.

+1 :green_heart:
unit
2m 50s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
1m  8s

The patch does not generate ASF License warnings.

236m 58s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/12/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6141

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux fb58909410e9 5.15.0-86-generic #96-Ubuntu SMP Wed Sep 20 08:23:49 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 97992b0ed722122360a4a27b2bccc6a8b2fd7261

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/12/testReport/

Max. process+thread count
3152 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6141/12/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


[DOCS] <Logo - Name>

Issue Description
The logo_name "PathSphere" is not in a proper position.
Additional Context
No response
Screenshots or Examples (if applicable)

Proposed Solution (optional)
No response
Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I am willing to work on this issue (optional)

plz assign this issue

@ambrishgoswami no need. I can do it by myself.

@ambrishgoswami  why are you sending PR in my issue when you are not assigned to this. If you want create your own.

i have given logo problem to someone else
and @ambrishgoswami why you created pr for someone elses issue


Finish nearly all moving logic

Description
This pr completes nearly all moving logic.  without Dataframe commands
But sorry that I only have a Mac, and don't have the ability to see if there are any error on windows..
I think there might have some wrong span value during migration...Hopefully it doesn't too much...
Tests
Make sure you've run and fixed any issues with these commands:

[ ] cargo fmt --all -- --check to check standard code formatting (cargo fmt --all applies these changes)
[ ] cargo clippy --all --all-features -- -D warnings -D clippy::unwrap_used -A clippy::needless_collect to check that you're using the standard code style
[ ] cargo build; cargo test --all --all-features to check that all the tests pass

Wow! Yeah I think this looks pretty good. I didn't check every file but I tried to check most of them. We'll fix the bugs we find as we get the tests passing, I think.


Allow a way to mark all cookies as "HTTP only" and "SSL required" by default

Basically, this would be an equivalent to the <httpCookies> element in Web.config:
<httpCookies domain="String"
             httpOnlyCookies="true|false"
             requireSSL="true|false" />

Allows marking all cookies with these flags regardless of how the CookieOptions object is constructed.  More info at http://msdn.microsoft.com/en-us/library/ms228262(v=vs.100).aspx.

And rename the "secure" cookie option as part of this.

Removing @GrabYourPitchforks as the assignee :smile: (Unless you like, you know, really want to do it :smile: )

@blowdart in this case secure is appropriate because that's the actual text used in the cookie header.

That doesn't make it true though.

Agreed, but we can't change the RFC.  Renaming our APIS that set this value will just case confusion about what's being set.

Seems like this would be a feature of Hosting

Any proposals on how? High jacking the IResponseCookiesFeature?

I think so.

I would be interested in taking this on.
I am already doing some work with the Secure flag on cookies for https://github.com/aspnet/Session/pull/28

@blowdart how important is this for beta 6 (i.e. do we need this now?)

It's a big security regression, so it would be really really nice to have as soon as possible, but I leave the exact release to your discretion. If you have time now, then please do now.

Ok I will try to take a look this week

Preference for making this a middleware rather than embedding it in hosting.

Added suggestion - why not change the cookie class to make cookies http only for default, and make them "secure" by default if the request is over https.

Not going to happen for beta 6 at this point

@HaoK lets have a little design meeting before you tackle this.

@haok will you be able to look into this?

UseCookiePolicy(new CookiePolicyOptions
{
  HttpOnly = HttpOnlyPolicy.None | Always
  Secure = SecurityPolicy.None | Always | SameAsRequest
  OnAppendCookie = ctx =>
  OnDeleteCookie = ctx =>

  AppendCookieContext ( HttpContext, CookieOption, CookieName, CookieValue)
  DeleteCookieContext ( HttpContext, CookieOption, CookieName, CookieValue)
});

Test Map behavior

Namespace: Microsoft.AspNet.CookiePolicy in security repo stand alone package.

This is nice!

5cc1fea40045041f77a6bb2bd23e231e24f82da7

@HaoK I just want to confirm. Im currently migrating code.
.net 4.5 mvc:
 <httpCookies requireSSL="true" />
so in .net core mvc, it should be this:
 services.ConfigureApplicationCookie(o => o.Cookie.SecurePolicy = Microsoft.AspNetCore.Http.CookieSecurePolicy.Always);
is that correct?

Comments on closed issues are not tracked, please open a new issue with the details for your scenario.


Supports syntax highlighting features in *.md files

Description
In *.mdx files, syntax highlighting features work as expected, but they do not work in *.md files. I'm not sure if this is a bug or due to some limitations. The same situation occurs in both v2 and v3 alpha.
```js filename="test.js" {1}
console.log('hello world')

console.log('goodbye world')
```

*.mdx

*.md

We parse md files with markdown parser
And language icons are added via rehype plugin which adds import statement with according icon (to reduce bundle size) https://github.com/shuding/nextra/blob/v3/packages/nextra/src/server/rehype-plugins/tests/rehype-icon.test.ts
And import statements are not supported with markdown parser

Thanks for explaning! 🙏

Btw we can still add support for filename


Fixes #60 : Idempotence test improvement

Idempotence in two steps to able visualisation and to avoid buffer saturation.
With a tee and tail, in order to be able to read the output of the test. That would be helpful to determine which is the wrong task and to correct it.

Clever... I never thought of doing it this way! I'll be adopting this for my other multi-platform roles as well.


Remove old build files

This removes all of the old build system in favor of poetry.
We were still installing the tdbpy tool using the old build script, and maintaining two separate lists of dependencies where tox used a weird mix of both. This only retains poetry.

While working on this I saw that 3.11 unfortunately introduced some changes that caused parts of the codegen to fail. Since i have no time to investigate now, the PR currently just sets the max supported version to 3.10.


fix: group condition should only apply to the first event

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license
Summary
(describe what this merge request does)
Implementation highlights
(describe how the merge request does for feature changes, share the RFC link if it has)
Test checklist

[x] add new test cases
[ ] all code changes are covered by unit tests
[ ] end-to-end tests

[ ] deploy web console with CloudFront + S3 + API gateway
[ ] deploy web console within VPC
[ ] deploy ingestion server

[ ] with MSK sink
[ ] with KDS sink
[ ] with S3 sink

[ ] deploy data processing
[ ] deploy data modeling

[ ] new Redshift Serverless
[ ] provisioned Redshift
[ ] Athena

[ ] deploy with reporting

Is it a breaking change

[ ] add parameters without default value in stack
[ ] introduce new service permission in stack
[ ] introduce new top level stack module

Miscellaneous

[ ] introduce new symbol link source file(s) to be shared among infra code, web console frontend, and web console backend

@tyyzqmf  please add front-end part

@tyyzqmf please add front-end part

done


Dotenv does not overwrite values set in PHP-FPM via nginx fastcgi_param

I am running a development server using PHP 7.1, PHP-FPM, nginx 1.8.0, and Dotenv 2.4.0. The nginx .conf file for my server, I eventually figured out, included a fastcgi_param directive setting the APP_ENV environment variable to dev. Consequently, even though I had a line APP_ENV=development in my .env file, which was being loaded by Dotenv, a call to getenv('APP_ENV') returned dev and not, as expected, development.
As I understand the Dotenv documentation, this is dependent on using overload() and not simply load(). However, the two behaved similarly.
This seems very similar to issue #39. Ideally it would be great to change the behavior of Dotenv (assuming this is possible). In the meantime, it would at least be helpful to note the limitation in the documentation (in the section about overwriting values).

Fixed by https://github.com/vlucas/phpdotenv/pull/284 I think?


could not load the model

I use llama.cpp to load the llama-3-8B locally, I test the model with llama.cpp project, It can run well.
But when I run the src/setup_hipporag.sh file, I got those result, I don't know why?
I monitor the running process, the usage of GPU is 0%

Hi,
I would suggest printing llama3's output here to see if it produces the proper output.
It would be more appropriate for us to find the problem if you could provide the full commands being executed here.
In addition, we have not tested the quantization to Q4. I'm not sure Q4 will be sufficient for our task requirement.

Thanks for your reply, I could not print the llama3's output, becaues the code stopped at this line of code, at file src/openie_with_retrieval_option_parallel.py

my executed commands is below:
data=sample
retriever_name=/HOME/scw6dlp/run/HippoRAG/contriever
extraction_model=/HOME/scw6dlp/run/HippoRAG/llama.cpp/models/Lexi-Llama-3-8B-Uncensored_Q4_K_M.gguf  # LLM using LangChain, e.g., 'gpt-3.5-turbo' or 'meta-llama/Llama-3-8b-chat-hf'
available_gpus=0,1
syn_thresh=0.8
llm_api=llama.cpp # e.g., 'openai', 'together'
extraction_type=ner

# Running Open Information Extraction
python src/openie_with_retrieval_option_parallel.py --dataset $data --llm $llm_api --model_name $extraction_model --run_ner --num_passages all # NER and OpenIE for passages
python src/named_entity_extraction_parallel.py --dataset $data --llm $llm_api --model_name $extraction_model  # NER for queries

# Creating Contriever Graph
python src/create_graph.py --dataset $data --model_name $retriever_name --extraction_model $extraction_model --threshold $syn_thresh --extraction_type $extraction_type --cosine_sim_edges

# Getting Nearest Neighbor Files
CUDA_VISIBLE_DEVICES=$available_gpus python src/RetrievalModule.py --retriever_name $retriever_name --string_filename output/query_to_kb.tsv
CUDA_VISIBLE_DEVICES=$available_gpus python src/RetrievalModule.py --retriever_name $retriever_name --string_filename output/kb_to_kb.tsv
CUDA_VISIBLE_DEVICES=$available_gpus python src/RetrievalModule.py --retriever_name $retriever_name --string_filename output/rel_kb_to_kb.tsv

python src/create_graph.py --dataset $data --model_name $retriever_name --extraction_model $extraction_model --threshold $syn_thresh --create_graph --extraction_type $extraction_type --cosine_sim_edges

Apparently, the args is the triple_json, the args is below, it's not empty.
num_processes is 10, so the execue code is outputs = pool.map(extract_openie_from_triples, args)

args=[[(0, {'title': 'Thomas C. Sudhof', 'text': "Introduction\nThomas Christian Sudhof (German pronunciation: ['to:mas 'zy:t,ho:f] i; born December 22, 1955), ForMemRS, is a German-American biochemist known for his study of synaptic transmission. Currently, he is a professor in the school of medicine in the department of molecular and cellular physiology, and by courtesy in neurology, and in psychiatry and behavioral sciences at Stanford University.", 'idx': 0, 'passage': "Thomas C. Sudhof\nIntroduction\nThomas Christian Sudhof (German pronunciation: ['to:mas 'zy:t,ho:f] i; born December 22, 1955), ForMemRS, is a German-American biochemist known for his study of synaptic transmission. Currently, he is a professor in the school of medicine in the department of molecular and cellular physiology, and by courtesy in neurology, and in psychiatry and behavioral sciences at Stanford University."})], [(1, {'title': 'David Eagleman', 'text': 'Introduction\nDavid Eagleman (born April 25, 1971) is an American neuroscientist, author, and science communicator. He teaches neuroscience at Stanford University[1] and is CEO and co-founder of Neosensory, a company that develops devices for sensory substitution. [2] He also directs the non-profit Center for Science and Law, which seeks to align the legal system with modern neuroscience[3] and is Chief Science Officer and co-founder of BrainCheck, a digital cognitive health platform used in medical practices and health systems.', 'idx': 1, 'passage': 'David Eagleman\nIntroduction\nDavid Eagleman (born April 25, 1971) is an American neuroscientist, author, and science communicator. He teaches neuroscience at Stanford University[1] and is CEO and co-founder of Neosensory, a company that develops devices for sensory substitution. [2] He also directs the non-profit Center for Science and Law, which seeks to align the legal system with modern neuroscience[3] and is Chief Science Officer and co-founder of BrainCheck, a digital cognitive health platform used in medical practices and health systems.'})], [(2, {'title': 'Karl Deisseroth', 'text': 'Introduction\nKarl Alexander Deisseroth (born November 18, 1971) is an American scientist. He is the D.H. Chen Foundation Professor of Bioengineering and of psychiatry and behavioral sciences at Stanford University. He is known for creating and developing the technologies of hydrogel-tissue chemistry (e.g., CLARITY, STARmap) and optogenetics, and for applying integrated optical and genetic strategies to study normal neural circuit function, as well as dysfunction in neurological and psychiatric disease.', 'idx': 2, 'passage': 'Karl Deisseroth\nIntroduction\nKarl Alexander Deisseroth (born November 18, 1971) is an American scientist. He is the D.H. Chen Foundation Professor of Bioengineering and of psychiatry and behavioral sciences at Stanford University. He is known for creating and developing the technologies of hydrogel-tissue chemistry (e.g., CLARITY, STARmap) and optogenetics, and for applying integrated optical and genetic strategies to study normal neural circuit function, as well as dysfunction in neurological and psychiatric disease.'})], [], [], [], [], [], [], []]


Account Creation Issue

Story
see this account: https://explorer.near.org/accounts/096985b8bb52a859d75c7b0e84889bb46fb9346524e264141f667c8954868184
with no action with create account, the create timestamp is not correct, it seems like update with transactions
Acceptance Criteria

[ ] account without create account is correct showing the create timestamp
[ ] Mobile ok
[ ] Tested

Closing in favor of https://github.com/near/near-indexer-for-explorer/issues/68


Prevent discord command injection through mimic!start

Is your feature request related to a problem? Please describe.
Mimic seems to be able to run commands through mimic!start E.G. mimic!start tph!selfmute
Describe the solution you'd like
mimic!start could use a Zero Width Space in front of the result
Describe alternatives you've considered

Filtering certain prefixes (but that could be hard-coding)

Additional context
Tried in TPH (I got told) and I think an attacker could be able to run things from mimic, even though I failed

You could also use an embed to show the results, that would render mentionning roles/everyone impossible as well


fix(tar): append slash to top-level directory mtree entries

bsdtar's mtree format has a quirk wherein entries without "/" in their first word are treated as "relative" entries, and "relative" directories will cause tar to "change directory" into the declared directory entry. If such a directory is followed by a "relative" entry, then the file will be created within the directory, instead of at top-level as expected. To mitigate, we append a slash to top-level directory entries.
Fixes #851.

Changes are visible to end-users: no
Test plan
(Please advise on how I should test this change)

Covered by existing test cases
New test cases added
Manual testing; please provide instructions so we can reproduce:

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks - you should be able to find somewhere in https://github.com/aspect-build/bazel-lib/blob/main/lib/tests/tar/BUILD.bazel that tickles this case, and assert that the new mtree matches some string

I tried to introduce a test, however the main problem is that any file I create with file_write is created inside lib/tests/tar/, and mtree doesn't hit the bug. That also made me realize that we need to add this logic to mtree_mutate (because of strip_prefix), but that doesn't solve the problem that we can't test mtree_spec by itself. What should I do here?

Could I get another look at this please? :)

Interesting, it seems like the output order of mtree_spec is either random or differs between my machine and the CI. Perhaps I could write a genrule that orders the output of mtree in such a way to trigger the bug.

Sorry for the delay, I was on vacation. I've made the tests run the sort command on the output, which should hopefully make the order consistent between systems now.
@alexeagle Could I get a re-run of the tests please?

Thanks!


Panic on OSX ("Invalid argument")

The "send_and_receive" test (in https://github.com/maidsafe/crust/pull/570 here: https://github.com/madadam/crust/blob/stress-test/tests/send_and_receive.rs, not yet merged to master) fails on OSX with this stacktrace:
thread 'RaiiBootstrap' panicked at '

 =======================================================================================
| Result evaluated to Err: Error { repr: Os { code: 22, message: "Invalid argument" } } |
 =======================================================================================

', src/connection.rs:224
stack backtrace:
   1:        0x10224abb8 - sys::backtrace::tracing::imp::write::h7add7fdda97786a1s4u
   2:        0x10224ca95 - panicking::default_handler::_$u7b$$u7b$closure$u7d$$u7d$::closure.44030
   3:        0x10224c6b8 - panicking::default_handler::h72a4f6df9637bc80Rvz
   4:        0x10223beb6 - sys_common::unwind::begin_unwind_inner::hf798769ad97c097fe3t
   5:        0x10223c34e - sys_common::unwind::begin_unwind_fmt::hb2ee19b4aa59ba8ak2t
   6:        0x101ee0f2c - connection::connect_tcp_endpoint::_$u7b$$u7b$closure$u7d$$u7d$::closure.23153
   7:        0x101ee09bb - result::Result<T, E>::unwrap_or_else::h8718638085262797868
   8:        0x101eb09a6 - connection::connect_tcp_endpoint::hd5904597d9cef2e9nkb
   9:        0x101ebd30c - connection::connect::hd21b7049d845f2b8fjb
  10:        0x101eba75d - bootstrap::RaiiBootstrap::bootstrap::h93a93d7ac124546dT7a
  11:        0x101eb9dd8 - bootstrap::RaiiBootstrap::new::_$u7b$$u7b$closure$u7d$$u7d$::closure.22280
  12:        0x101eb9677 - std::thread::Builder::spawn::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::closure.22269
  13:        0x101eb95c8 - sys_common::unwind::try::try_fn::h3100308267746893306
  14:        0x10224a06b - __rust_try
  15:        0x102247463 - sys_common::unwind::inner_try::hdaa7ae415a983f2ag0t
  16:        0x101eb9505 - sys_common::unwind::try::h245024374647048752
  17:        0x101eb9349 - std::thread::Builder::spawn::_$u7b$$u7b$closure$u7d$$u7d$::closure.22266
  18:        0x101eba0e7 - boxed::F.FnBox<A>::call_box::h4038387312002249685
  19:        0x10224bd1c - sys::thread::Thread::new::thread_start::h45441f586afbe2dciKy
  20:     0x7fff855e4059 - _pthread_body
  21:     0x7fff855e3fd6 - _pthread_start

This suggest problem in crust master, as the PR only adds this test and does not change anything in crust itself.
Fixing this would allow merging https://github.com/maidsafe/crust/pull/570 and closing https://github.com/maidsafe/crust/issues/569.

New information:

This error occurs no matter how many messages are sent. In fact, it occurs even when no messages are sent.
It occurs even with as few as two clients, but only if they are spawned in parallel (each in its own thread). If spawned sequentially, it doesn't occur.
The crash originates here: https://github.com/maidsafe/crust/blob/master/src/connection.rs#L220 - peer_addr sometimes returns error here.
This error occurs only when listening over TCP. UDP seems to be unaffected.

Fixed in #570 . Once it is merged, this issue can be closed.


Awk command not working in latest Azure cli version

Describe the bug
Hello,
We have a Github action in which we install the latest version of Azure CLI and try to run a inlineScript that includes the following command:
OUTPUT=$(echo $MY_JSON_VARIABLE | jq -r .scopeMapId | awk -F'\/' '{ print $9 }')
And we get this error:
Starting script execution via docker image mcr.microsoft.com/azure-cli:2.67.0 /opt/github/actions-runner/_work/_temp/AZ_CLI_GITHUB_ACTION_1732898353757.sh: line 2: awk: command not found
I saw that there was an issue created for the -jq command and it was fixed, so wondering if this was already reported somewhere and fixed. If so I'd appreciate it if you linked the issue with the solution!
Thank you!
Related command
jq -r .scopeMapId | awk -F'/' '{ print $9 }'
Errors
Starting script execution via docker image mcr.microsoft.com/azure-cli:2.67.0 /opt/github/actions-runner/_work/_temp/AZ_CLI_GITHUB_ACTION_1732898353757.sh: line 2: awk: command not found
Issue script & Debug output
.
Expected behavior
awk command should work with latest version of Azure CLI
Environment Summary
Job step uses: azure/CLI@v2 image.
Additional context
No response

Thank you for opening this issue, we will look into it.

Azure CLI Docker image does not include all Linux tools.
Please add tdnf install awk -y at the beginning of the script.

@bebound  It worked perfectly for our scenario.
PSC @claudinei-ferreira @faelzsouza


[Feature] want to add new java script tutorial

Description
tutorialTpoint
https://www.javatpoint.com/reactjs-tutorial
here the link

Screenshots

Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I am willing to work on this issue (optional)
[X] I am a GSSoC'23 contributor

Hi @Sushilverma002! :) Just to confirm, are you participating in GSSOC'23?

Yess

You're assigned @Sushilverma002


ci: Upgrade to the latest stable version of Xcode

As I'm not an expert of Github Actions, I hope this will fix #5163

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 9.52%. Comparing base (4d9c7fc) to head (a5c38d8).
Report is 77 commits behind head on develop.

Additional details and impacted files
@@            Coverage Diff             @@
##           develop   #5169      +/-   ##
==========================================
- Coverage     9.54%   9.52%   -0.03%
==========================================
  Files          325     327       +2
  Lines        16411   16571     +160
==========================================
+ Hits          1567    1578      +11
- Misses       14844   14993     +149

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

yes probably enough; see: https://github.com/openfoodfacts/smooth-app/issues/3853


Cannot find /_nuxt/vendor.bundle.js

Hello again!
Working with koa-nuxt template, trying to make production version of application. When i'm trying to do npm run start (after npm run build), the server staring, but with no css and with this messages in console

What am i doing wrong?

Seems like it doesn't really try to make client build. Here is an output of nom run build
`build [=============       ] 65%[nuxt:build:server]
Hash: ea4affe609e4fff26543
Version: webpack 2.2.1
Time: 17356ms
Asset     Size  Chunks                    Chunk Names
img/bg2.e693547.png  1.25 kB          [emitted]
img/rocket.aa3c96a.png  3.27 kB          [emitted]
img/arrow_left.1681d6e.png  2.73 kB          [emitted]
img/arrow_right.b766fc8.png  2.74 kB          [emitted]
img/help.2a764e7.png  3.19 kB          [emitted]
img/more.e4f2ed3.png  3.69 kB          [emitted]
img/logo.cfdfefe.png  5.81 kB          [emitted]
img/appstore.5557fc5.png  2.41 kB          [emitted]
img/bg.1244333.png  1.25 kB          [emitted]
img/money-bag.d26f8b1.png  3.27 kB          [emitted]
img/googleplay.4857358.png   7.5 kB          [emitted]
img/back.a34ef5f.png   3.4 kB          [emitted]
img/cat-bag.b551904.png  3.54 kB          [emitted]
img/chat_black.6660589.png  3.39 kB          [emitted]
img/close.57ac1cc.png  7.54 kB          [emitted]
img/help_white.5048a93.png  5.88 kB          [emitted]
img/plus.7434e98.png  2.68 kB          [emitted]
img/logo_mob.be3ec30.png  4.82 kB          [emitted]
server-bundle.js   770 kB       0  [emitted]  [big]  main
WARNING in asset size limit: The following asset(s) exceed the recommended size limit (250 kB).
This can impact web performance.
Assets:
server-bundle.js (770 kB)
WARNING in entrypoint size limit: The following entrypoint(s) combined asset size exceeds the r
Entrypoints:
main (770 kB)
server-bundle.js
WARNING in webpack performance recommendations:
You can limit the size of your bundles by using import() or require.ensure to lazy load some pa
For more info visit https://webpack.js.org/guides/code-splitting/`

And little bit above that

  build [==========          ] 50%TypeError: error.setMessage is not a function
    at LazyResult.handleError (/Users/pdll/Dev/node/nuxt-koa/node_modules/postcss/lib/lazy-result.js:162:23)
    at /Users/pdll/Dev/node/nuxt-koa/node_modules/postcss/lib/lazy-result.js:196:27
(node:53295) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 2): TypeError: Cannot read property 'source' of undefined
(node:53295) DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-ze
ro exit code.

@pdll
Can you create this issue on the koa repo please?

mee to hello?How to do it, thank you


How to pass large data to html in task module(a html page hosted in azure) in Messaging Extension in Teams app

We are using a task module(a html page hosted in azure) in Messaging Extension to show a custom user form. The task module is called when custom action is clicked in teams. Our requirement is to pass large data to the task module. The only option we found is through query string while calling the task module but passing large data is not possible through query string. Is there any alternate way to pass data to the task module.

@MaheshakaMudli , Please refer to the documentation here for Initial invoke request from a message .
Here a sample code for the same.

Please re-open if you still have any queries.


 The test needs to add some sort of barrier to make sure the multiprocessing finishes.

smfh


Implement a delete view for lobbies

Goal: Users who created a lobby should be able to delete the same lobby in case it was created by mistake. We want to implement a Delete View of the CRUD pages to allow this to happen. We also need to figure out how to restrict access to this view to only the user who is the "host" of the lobby.
Deliverables:

PR

forked a branch called matches/lobby-edit-delete

added delete views and debugged url issues
the view should be restricted to just the lobby creator now

associated PR: PR #282

Closing Comment:
PR is merged and task is finished.
We implemented edit and delete views that are only available to the lobby's host (nobody else can edit or delete). We also made sure to only display links to these on the frontend to the host.

Issue Score: Excellent
Comments:
Detailed goal and concise updates!


[Feature Request]

Describe the Feature
We should have more fields

need a field for past experiences/jobs
field for linkedin/githubs and personal websites if they have
ethnicity, disabled, veteran status
skills, some companies ask for it

Is this feature related to a bug? If so please describe
No response
Screenshots
No response
Additional Context
No response

Could be sourced from resume file?

probably the work experience, but other stuff will probably need to input

oops sorry

I think that it would be a good idea to add some of these fields. Probably worth thinking about whether it would be meaningful if that info is always going to be on the resume. They should at the very least be optional fields.


Documentation

On the wiki:
The GLFW_VULKAN_STATIC is no longer supported.
Should have information about:
glfwInitVulkanLoader(vkGetInstanceProcAddr);
instead
--- Text with error
Linking against the Vulkan loader
By default, GLFW will look for the Vulkan loader on demand at runtime via its standard name (vulkan-1.dll on Windows, libvulkan.so.1 on Linux and other Unix-like systems and libvulkan.1.dylib on macOS). This means that GLFW does not need to be linked against the loader. However, it also means that if you are using the static library form of the Vulkan loader GLFW will either fail to find it or (worse) use the wrong one.
The GLFW_VULKAN_STATIC CMake option makes GLFW call the Vulkan loader directly instead of dynamically loading it at runtime. Not linking against the Vulkan loader will then be a compile-time error.
macOS: To make your application be redistributable you will need to set up the application bundle according to the LunarG SDK documentation. This is explained in more detail in the SDK documentation for macOS.

Also the
https://www.glfw.org/docs/latest/compile_guide.html has same problem

Hi!
If by wiki you mean /docs/latest on the website then that is only up-to-date with the latest release, which is 3.3.8 and still includes GLFW_VULKAN_STATIC. The pre-release documentation for 3.4 has a section on glfwInitVulkanLoader instead.


godep causing go-sqlite3 to compile on every save with vim-go

I'm having a strange issue since I switched to godep. Every time I save a file in my project I noticed a cpu spike and a long delay before I can do anything inside vim. I looked at what was running, and it was compiling some c files inside of Godeps/_workspace/src/mattn/go-sqlite3. This happens every time I save the file.
I would lean towards this being a issue with vim-go and maybe it is, but my go buiild times have more than doubled since I switched to using godep as well.
Does anyone have a clue as to what might be happening? Thanks!

Do you have syntastic enabled?

Vim-go doesn't call go build or anything a like. As @freeformz said it might be due https://github.com/scrooloose/syntastic which does auto build on every save.

FWIW: I removed syntastic from my vim setup and similar issues are now resolved for me.

@fatih thanks btw.

Thanks guys, and sorry I filed this bug report in the wrong place. I just happened to notice it the same time I was switching to godep.
Setting let g:loaded_syntastic_go_go_checker = 0 in my vimrc solved the problem.


chore: add dependabot

If you do not know already, dependabot helps the project with dependency updates. It creates a PR for each npm package that can be updated.
To activate the dependabot a maintainer has to enable the feature under Settings -> Code security and analysis then in the Dependabot section the "dependabot version updates".

The config that I added currently proposes updates weekly for all packages in the root package.json

Thanks Paul!

(aka. I pressed the buttons in the settings as well)


[strorage] Add revoke-delegation-keys command

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

[ ] I adhere to the Command Guidelines.

I should update history.rst, but I haven't done that because now is in releasing cycle.


too many API POST requests per second

I have many files in my site and during deployment the plugin is making too many API POST requests per second. That's why I'm getting this message from Github sometimes:

You have triggered an abuse detection mechanism and have been temporarily blocked from calling the API. Please retry your request again later

Github support team says that they will block me if I make more than 300 requests per second. Would be great to slow down the plugin and control that it doesn't make more than 300 per sec.

+1

I'm getting the exactly same problem from a few days ago.

+1
The same happens to me recently.

+1 same here.

duplicate of #17

I'm facing the same issue:

Error creating blob: You have triggered an abuse detection mechanism and have been temporarily blocked from calling the API. Please retry your request again later. (403)

It worked previously.
I'm using this configuration, if it can help:
<plugin>
  <groupId>com.github.github</groupId>
  <artifactId>site-maven-plugin</artifactId>
  <version>0.10</version>
  <configuration>
    <message>Creating site for ${project.version}</message>
  </configuration>
  <executions>
    <execution>
      <goals>
        <goal>site</goal>
      </goals>
      <phase>site-deploy</phase>
      <configuration>
        <outputDirectory>${basedir}/_build/html</outputDirectory>
      </configuration>
    </execution>
  </executions>
</plugin>

It takes longer, but I was able to address the issue I was experiencing:

Error creating blob: You have triggered an abuse detection mechanism and have been temporarily
blocked from calling the API. Please retry your request again later. (403)

With the following update:
https://github.com/awoods/maven-plugins/commit/c62c7b168375e3bfaf0dec7de2fa5fc03d8ed173

The 0.12.0 release includes the fix from #90 and should resolve this issue.
/cc https://github.com/github/maven-plugins/pull/90#issuecomment-107713564


DB data does not persist

When I bring a container down, I lose my data.
Surely this isn't expected?
Don't we need a volume for /var/lib/mysql?

Adding a mysql volume remedied this, but are you intending for people to use the storage container for this?
version: '2'
services:
  mysql:
    build:
      context: docker/mysql/
      dockerfile: MySQL-5.7.Dockerfile
    ports:
      - 13306:3306
    volumes:
      - mysql:/var/lib/mysql
    env_file:
      - etc/environment.yml
      - etc/environment.development.yml
volumes:
  mysql:

There is already a volume set inside the Dockerfile for MySQL 8.0:
https://github.com/docker-library/mysql/blob/86431f073b3d2f963d21e33cb8943f0bdcdf143d/8.0/Dockerfile#L62
also for MySQL 5.7:
https://github.com/docker-library/mysql/blob/86431f073b3d2f963d21e33cb8943f0bdcdf143d/5.7/Dockerfile#L68
and MySQL 5.6:
https://github.com/docker-library/mysql/blob/86431f073b3d2f963d21e33cb8943f0bdcdf143d/5.6/Dockerfile#L62
But you will lose the data if you remove the container and the volume. Please don't use a storage container, use the volume or a host mounted volume :)
Any steps how to reproduce the lost data? Which docker solution are you using?

Steps to reproduce:

Using https://github.com/webdevops/php-docker-boilerplate/blob/master/docker-compose.development.yml as docker-compose.yml (so MySQL-5.6.Dockerfile)
docker-compose up -d
Add a table to the database database that has been created
docker-compose down
docker-compose up -d
database has no tables :(

"Works as intended"
From the documentation of docker-compose down:
Stops containers and removes containers, networks, volumes, and images created by up.

By default, the only things removed are:
- Containers for services defined in the Compose file
- Networks defined in the networks section of the Compose file
- The default network, if one is used
Networks and volumes defined as external are never removed.

https://docs.docker.com/compose/reference/down/
What you want to use is docker-compose stop :)

Ah ok - thanks for the clarification.
I always use down so I don't have unused containers all over my system.
So I guess what I'm doing would be way to persist that data. I might argue the example compose files should have that too.
FWIW I'm coming from using https://github.com/laradock/laradock, which has a mysql volume and will therefore persist between up and down.

👍


Use fillLocalInfo when unboxing threads, include device name

r? @mmaxim
@songgao userInfoMapper didn't get device names before, this fixes that.

I already did.

I meant here: https://github.com/keybase/client/pull/4361/files#diff-0c741c719ee20a92e9bfc748635882a5R27
Sorry for lacking the link earlier. No seat on train so n cellphone today :(

Whoops, ok!

@songgao PTAL


awscli: 1.11.10 -> 1.11.27

Motivation for this change
Lot of new services are available in new AWS CLI
Things done

[x] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[x] macOS
[ ] Linux

[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

@jnsaff please modify your PR so you have a commit per package you touch, and name them according to our guidelines (see e.g. how @Mic92 modified the title of the PR).

awscli was already updated to 1.11.30 in the mean time.

awscli was already updated to 1.11.30 in the mean time.


Document the use of iri equivalent terms for use with RDF

I would be inclined to follow the pattern of Darwin Core, but to use the namespace chronoiri:. Would it make sense to document that within the Darwin Core RDF Guide if the Extension is a stand-alone Darwin Core vocabulary? Otherwise, a similar document would have to be made here.

I think that if chrono ends up being a separate vocabulary within Darwin Core, then it would make sense to add a section to the RDF guide. chronoiri: also makes sense since most other aspects of the chrono vocab are modeled after DwC.

I agree.
On Fri, Oct 30, 2020 at 11:18 AM Steve Baskauf<EMAIL_ADDRESS>wrote:

I think that if chrono ends up being a separate vocabulary within Darwin
Core, then it would make sense to add a section to the RDF guide.
chronoiri: also makes sense since most other aspects of the chrono vocab
are modeled after DwC.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/tdwg/chrono/issues/12#issuecomment-719579349, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AADQ725WE3OLGJYPWHU6ZGDSNLDMRANCNFSM4STT42GQ
.

Based on https://github.com/tdwg/chrono/issues/19. This is no longer an open question. Both an IRI-value list section of the term list document and documentation in the RDF Guide are needed.

First pass at a chrono table in the RDF guide here

Looks good.


Broken changelog for windows

In windows environment i try use release-it-lerna-changelog and my changelogs in release looks something like this and in console this (It's different releases)
�🚀 Let's release release-it-test (currently at 0.0.2)

Changelog:
* Add lerna (bd2d34c)
* Remove lerna (69ad898)
* Update release script (e7bea72)
* Merge pull request #3 from Kolobok12309/feature/second-feature (0adb363)
* Add second console.log (0e182df)

Trouble in shell exec for windows, you try exec command D:\projects\release-it-test\node_modules\lerna-changelog\bin\cli.js --next-version=Unreleased --from=0.0.2, but windows try open *.js file by default viewer, for me it VSCode.
If call node ..., or lerna-changelog --next-version=Unreleased --from=0.0.2 all fine.

Oh no, you are totally correct! I'm sorry about that.
Hmm, I'm not sure what is the correct way to find the executable in a platform agnostic way?

I can not suggest a completely correct option, but lerna-changelog without full path working correctly in windows, npm add node_modules/.bin/lerna-changelog.cmd and use it, for nix it node_modules/.bin/lerna-changelog.
I can help with tests for windows if needed.


Order by nulls last produces sql error under postgres

Summary of problem or feature request
When orderByNullsLast is used is appears as though column identifiers are not escaped properly.
For example a user table that has a column named order and trying to do the following results in the column order not being escaped and a sql error when sorting by this order column
return datatables(User::query())
            ->orderByNullsLast()
            ->make(true);

Removing orderByNullsLast makes the query work as expected.
System details

Operating System - Windows 10
PHP Version - 7.2
Laravel Version - 5.6
Laravel-Datatables Version - 8.5.1
Database - PostgreSQL 10

Working fine for me on mysql. Maybe try updating datatables.php config to fit your need?
'nulls_last_sql' => '%s %s NULLS LAST',


websocket ERROR after upload an image.

[error screenshot]

[error in frontend term]

[screenshot in backend term]

[backend startup command]
poetry run uvicorn main:app --reload --port 7001 --host <IP_ADDRESS>
[frontend startup command]
$ yarn dev --host <IP_ADDRESS>
yarn run v1.22.19
$ vite --host <IP_ADDRESS>
23:09:13
23:09:13
VITE v4.5.0  ready in 434 ms
➜  Network: http://<IP_ADDRESS>:5173/                                                 23:09:13
➜  press h to show help                                                                    23:09:13
ERROR                                                                                23:09:16
[TypeScript] Found 0 errors. Watching for file changes.
[environment]
npm version: 10.2.4
node version:  v20.11.1
Python version: 3.10.0
system ubuntu 22.04.3 LTS x86_64
CPU  AMD 5900HX

Don't worry about the "ERROR" on the front-end. Not sure why that's showing up during build but it's not a problem.
What logs do you get if any after "Incoming websocket connection...", you should see more logs like before the connection closes typically.

This is the screenshot of backend service's log. I'm not sure of whether a socket connection been established before error happens.

In this log, you're not able to receive the websocket message. Are you uploading a screenshot or a video? The issue might be that the payload is too large.

Please try https://v0.dev/
It free from https://vercel.com/

I'v never tried to upload a video, it's just a nomal image file.

I've never attempted to upload anything. The error occurs right at the beginning, just as I start the Docker.

Oh i see the issue might be with your ffmpeg install. One thing you can try is updating pyproject.toml and removing the moviepy dependency. You shouldn't need that for just screenshots.


Abstract EVM tx parsing

Overview
The ethereum and avalanche standard tx parser should look pretty much identical. As we add more evm chains it will be nice to have shared logic abstracted and extensible for unique chain needs
References and additional details
Current evm chains: ethereum, avalanche
Acceptance Criteria

Abstract shared functionality where it makes sense
Ensure base functionality/logic can be easily extensible to support chain specific needs

Need By Date
No response
Screenshots/Mockups
No response
Estimated effort
No response

let's copypasta ethereum parsers for now, and we can abstract this if and when we do a 3rd evm chain


Replace -Path with -LiteralPath in Internal Function Get-DbopsFile.ps1

I have a path that looks like the following:
.\CREATE PROCEDURE [dbo].[myProc].sql
No matter what I tried, Install-DBOScript fails because the path is not valid. This is because the brackets are not accepted and thus no amount of escaping will allow me to get past the function Get-DbopsFile. I have altered this internal function myself to specify -LiteralPath instead of the default -Path. I am not sure what issues this could cause, but it seems like a straightforward change. Happy to test further if needed.
Thanks!

I think this has something to do with how powershell treats brackets in Get-Item. If you try escaping [] symbols with a backtick ```` I think that would fix it for you. The solution here would be to add -LiteralPath parameter to the functions, which shouldn't be too hard.

I pondered about whether I can add -LiteralPath parameter, and seems like I wouldn't be able to. Functions use different parameter names, and adding a -Literal* counterpart to each of them seems excessive. However, Get-DbopsFile accepts results from Get-Item/Get-ChildItem, which means you can do something like this:
Install-DBOScript -Path (Get-Item -LiteralPath '.\CREATE PROCEDURE [dbo].[myProc].sql') ...

This would pass a FileSystemInfo object to the command and it would be able to handle it nicely. The alternative, like I mentioned before, should be escaping the symbols.