HADOOP-18820. Cut AWS v1 support

downgrade v1 sdk to "provided"
only allowed in one package in production code
use isolated classes and reflection games to allow rest of module to work without it when instantiating credential providers.
tests updated as appropriate
remapping of standard aws v1 credential providers to v2 classnames prior to instantiation.

How was this patch tested?
Integration tests in progress
For code changes:

[x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[x] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[x] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+1 :green_heart:
mvninstall
34m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
0m 32s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
0m 27s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
0m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
0m 33s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
0m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 28s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

-1 :x:
spotbugs
0m 51s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
20m 58s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 23s

the patch passed

+1 :green_heart:
compile
0m 26s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
0m 26s

the patch passed

+1 :green_heart:
compile
0m 21s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
0m 21s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
0m 15s
/results-checkstyle-hadoop-tools_hadoop-aws.txt
hadoop-tools/hadoop-aws: The patch generated 15 new + 8 unchanged - 0 fixed = 23 total (was 8)

+1 :green_heart:
mvnsite
0m 23s

the patch passed

+1 :green_heart:
javadoc
0m 13s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
0m 19s
/patch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
hadoop-aws in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

-1 :x:
spotbugs
0m 48s
/new-spotbugs-hadoop-tools_hadoop-aws.html
hadoop-tools/hadoop-aws generated 1 new + 1 unchanged - 0 fixed = 2 total (was 1)

+1 :green_heart:
shadedclient
20m 54s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 25s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 29s

The patch does not generate ASF License warnings.

89m 22s

Reason
Tests

SpotBugs
module:hadoop-tools/hadoop-aws

String is incompatible with expected argument type Class in org.apache.hadoop.fs.s3a.auth.AwsCredentialListProvider.buildAWSProviderList(URI, Configuration, String, List, Set)  At AwsCredentialListProvider.java:argument type Class in org.apache.hadoop.fs.s3a.auth.AwsCredentialListProvider.buildAWSProviderList(URI, Configuration, String, List, Set)  At AwsCredentialListProvider.java:[line 208]

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle

uname
Linux 30e2e1043b44 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 70380c357d265c6589fa9b14a5bf7aa2f1e5155b

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/1/testReport/

Max. process+thread count
651 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 29s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 6 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+1 :green_heart:
mvninstall
35m  5s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
0m 33s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
0m 27s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
0m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
0m 32s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
0m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 27s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

-1 :x:
spotbugs
0m 52s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
21m 22s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 23s

the patch passed

+1 :green_heart:
compile
0m 27s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
0m 27s

the patch passed

+1 :green_heart:
compile
0m 21s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
0m 21s

the patch passed

-1 :x:
blanks
0m  1s
/blanks-eol.txt
The patch has 5 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
0m 15s
/results-checkstyle-hadoop-tools_hadoop-aws.txt
hadoop-tools/hadoop-aws: The patch generated 20 new + 11 unchanged - 0 fixed = 31 total (was 11)

+1 :green_heart:
mvnsite
0m 24s

the patch passed

+1 :green_heart:
javadoc
0m 13s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
0m 19s
/patch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
hadoop-aws in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+1 :green_heart:
spotbugs
0m 46s

the patch passed

+1 :green_heart:
shadedclient
21m 13s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 25s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 29s

The patch does not generate ASF License warnings.

90m 41s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 21140752e13e 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 8357400d824851ff4d402a7409b6d13a93885359

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/2/testReport/

Max. process+thread count
554 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 30s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 7 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+1 :green_heart:
mvninstall
38m 55s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
0m 33s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
0m 28s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
0m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
0m 34s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
0m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 28s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

-1 :x:
spotbugs
0m 54s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
20m 53s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
21m 10s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 23s

the patch passed

+1 :green_heart:
compile
0m 26s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
0m 26s

the patch passed

+1 :green_heart:
compile
0m 20s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
0m 20s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 1 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
0m 15s
/results-checkstyle-hadoop-tools_hadoop-aws.txt
hadoop-tools/hadoop-aws: The patch generated 2 new + 11 unchanged - 0 fixed = 13 total (was 11)

+1 :green_heart:
mvnsite
0m 24s

the patch passed

+1 :green_heart:
javadoc
0m 13s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
0m 19s
/patch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
hadoop-aws in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+1 :green_heart:
spotbugs
0m 45s

the patch passed

+1 :green_heart:
shadedclient
21m 14s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 27s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 29s

The patch does not generate ASF License warnings.

94m 28s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 9e53ace4bce6 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / b282db327e4810db5e6928f8f73b995c61aa4133

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/3/testReport/

Max. process+thread count
634 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

current dependency setup
[INFO] +- com.amazonaws:aws-java-sdk-core:jar:1.12.367:provided
[INFO] |  +- commons-logging:commons-logging:jar:1.1.3:provided
[INFO] |  +- software.amazon.ion:ion-java:jar:1.0.2:provided
[INFO] |  +- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.12.7:provided
[INFO] |  \- joda-time:joda-time:jar:2.8.1:provided
[INFO] +- software.amazon.awssdk:bundle:jar:2.19.12:compile
[INFO] |  \- software.amazon.eventstream:eventstream:jar:1.0.1:compile

sdk core stuff is being involved, which isn't needed at all.
I'm pulling in the changes of #5739 to align dependencies, then make sure more are stripped.
This gives
[INFO] +- com.amazonaws:aws-java-sdk-core:jar:1.12.367:provided
[INFO] +- software.amazon.awssdk:bundle:jar:2.19.12:compile
[INFO] +- software.amazon.awssdk.crt:aws-crt:jar:0.21.0:test

@ahmarsuhail what do we do about the crt library? is it in bundle.jar? is it something to tag as provided and document?

hi, needs a bit more review/upvote. with this patch, we still support v1 providers if people set up the classpath, but we map the standard ones to v2 equivalents.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 8 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+1 :green_heart:
mvninstall
46m 12s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
0m 32s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
0m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
0m 25s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
0m 29s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
0m 23s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
0m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

-1 :x:
spotbugs
0m 48s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
23m 35s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
23m 52s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 24s

the patch passed

+1 :green_heart:
compile
0m 31s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
0m 31s

the patch passed

+1 :green_heart:
compile
0m 19s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
0m 19s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 13s

the patch passed

+1 :green_heart:
mvnsite
0m 29s

the patch passed

+1 :green_heart:
javadoc
0m 13s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
0m 20s
/patch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
hadoop-aws in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+1 :green_heart:
spotbugs
0m 48s

the patch passed

+1 :green_heart:
shadedclient
24m 28s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 17s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 28s

The patch does not generate ASF License warnings.

107m 20s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux fa29271f9c31 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / b608465f24ac0bbedbc13acc44754b6027064c23

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/4/testReport/

Max. process+thread count
660 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/4/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 32s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 8 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
20m 21s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 13s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m 44s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
11m  0s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
2m 32s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
1m 15s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
1m  7s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
1m  9s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 39s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 54s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
23m  9s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
23m 30s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 24s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
0m 35s

the patch passed

+1 :green_heart:
compile
9m 41s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
9m 41s

the patch passed

+1 :green_heart:
compile
9m 34s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
9m 34s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
2m 21s

the patch passed

+1 :green_heart:
mvnsite
1m 17s

the patch passed

+1 :green_heart:
javadoc
1m  5s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
0m 39s
/patch-javadoc-hadoop-tools_hadoop-aws-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
hadoop-aws in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+0 :ok:
spotbugs
0m 33s

hadoop-project has no data from spotbugs

+1 :green_heart:
shadedclient
21m 47s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
0m 32s

hadoop-project in the patch passed.

+1 :green_heart:
unit
2m 25s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 50s

The patch does not generate ASF License warnings.

153m 58s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/5/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint

uname
Linux 1f26be94dc21 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 4119dbca6ad0d9b79881a57ce96dc289dce3b1b3

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/5/testReport/

Max. process+thread count
728 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/5/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

the current pom changes means that s3 select operations fail

[ERROR] testReadLandsatRecordsNoMatch(org.apache.hadoop.fs.s3a.select.ITestS3SelectLandsat)  Time elapsed: 147.958 s  <<< ERROR!
java.io.IOException: java.lang.NoClassDefFoundError: software/amazon/eventstream/MessageDecoder
        at org.apache.hadoop.fs.s3a.select.SelectObjectContentHelper.select(SelectObjectContentHelper.java:75)
        at org.apache.hadoop.fs.s3a.WriteOperationHelper.lambda$select$10(WriteOperationHelper.java:660)
        at org.apache.hadoop.fs.store.audit.AuditingFunctions.lambda$withinAuditSpan$0(AuditingFunctions.java:62)
        at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:122)

given that the feature has never worked properly through MR/spark jobs and nobody has ever filed a bug report against the feature, I'm not sure it gets used at all.
we should be ruthless here; cut it?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 32s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 11 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
13m 26s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
23m 43s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
11m 37s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
10m 27s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
2m 19s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
13m 59s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 54s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
5m 13s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 41s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 31s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
37m 51s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
38m 10s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 25s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m  2s

the patch passed

+1 :green_heart:
compile
10m 10s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
10m 10s

the patch passed

+1 :green_heart:
compile
9m 41s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
9m 41s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
2m 23s
/results-checkstyle-root.txt
root: The patch generated 1 new + 12 unchanged - 12 fixed = 13 total (was 24)

+1 :green_heart:
mvnsite
10m  3s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 59s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
4m 51s
/patch-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
shadedclient
40m 32s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
678m  9s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 26s

The patch does not generate ASF License warnings.

915m 58s

Reason
Tests

Failed junit tests
hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.hdfs.server.federation.router.TestRouterRPCMultipleDestinationMountTableResolver

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/6/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 36ef18449c2d 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / e5672ef3052f401e19c6943bf9731c932863d982

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/6/testReport/

Max. process+thread count
3638 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/6/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 33s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 11 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
13m 54s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
24m  9s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
11m 42s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
11m 36s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
3m 11s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
15m 50s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
6m 27s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
5m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 43s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
20m 15s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
46m 23s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
46m 43s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 23s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
26m  4s

the patch passed

+1 :green_heart:
compile
11m 23s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
11m 23s

the patch passed

+1 :green_heart:
compile
11m 58s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
11m 58s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
3m 22s
/results-checkstyle-root.txt
root: The patch generated 1 new + 12 unchanged - 12 fixed = 13 total (was 24)

+1 :green_heart:
mvnsite
11m 16s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
6m 41s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
5m 25s
/patch-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+0 :ok:
spotbugs
0m 17s

hadoop-project has no data from spotbugs

+1 :green_heart:
shadedclient
50m 54s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
682m 25s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 24s

The patch does not generate ASF License warnings.

958m 58s

Reason
Tests

Failed junit tests
hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.server.namenode.ha.TestObserverNode

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/7/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 91887e0d56d5 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / d40b3fad1c1419cd9c68d4562428aead47da3331

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/7/testReport/

Max. process+thread count
3434 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/7/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 29s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 11 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
13m 52s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
26m 56s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
13m 36s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
11m 35s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
3m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
16m 54s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
7m 12s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
6m  6s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 18s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 53s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
20m 34s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
45m 35s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
45m 54s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 26s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
26m 24s

the patch passed

+1 :green_heart:
compile
11m 55s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
11m 55s

the patch passed

+1 :green_heart:
compile
11m 11s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
11m 11s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
2m 55s
/results-checkstyle-root.txt
root: The patch generated 1 new + 12 unchanged - 12 fixed = 13 total (was 24)

+1 :green_heart:
mvnsite
11m 24s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
6m  9s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
5m  5s
/patch-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
shadedclient
49m 42s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
684m  0s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 23s

The patch does not generate ASF License warnings.

965m  5s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/8/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux e8845c24d712 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 3f5181cbeee6505a228eab5816e4c9286f69c99a

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/8/testReport/

Max. process+thread count
3880 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/8/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 37s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 11 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 36s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m  4s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
11m  9s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
compile
9m 36s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
checkstyle
2m 32s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
15m 36s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
6m  8s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javadoc
5m 18s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 42s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
19m 15s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
41m 11s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
41m 30s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 25s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
20m 53s

the patch passed

+1 :green_heart:
compile
10m  7s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

+1 :green_heart:
javac
10m  7s

the patch passed

+1 :green_heart:
compile
9m 31s

the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

+1 :green_heart:
javac
9m 31s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
2m 22s
/results-checkstyle-root.txt
root: The patch generated 1 new + 12 unchanged - 12 fixed = 13 total (was 24)

+1 :green_heart:
mvnsite
9m 25s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 54s

the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1

-1 :x:
javadoc
4m 43s
/patch-javadoc-root-jdkPrivateBuild-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.txt
root in the patch failed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09.

+0 :ok:
spotbugs
0m 17s

hadoop-project has no data from spotbugs

+1 :green_heart:
shadedclient
38m 15s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
664m  3s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 21s

The patch does not generate ASF License warnings.

903m 35s

Reason
Tests

Failed junit tests
hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.hdfs.server.namenode.ha.TestObserverNode

hadoop.fs.http.client.TestHttpFSFWithWebhdfsFileSystem

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/9/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 02c00e14ac69 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / b73afe2d1503941b3b96e8ec1340a10199f0403c

Default Java
Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/9/testReport/

Max. process+thread count
3732 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/9/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

created https://issues.apache.org/jira/browse/YARN-11546 for the TestTimelineAuthFilterForV2 failure

With the latest aws-java-sdk-v2 version 2.20.118, the CRT issue has been resolved. Tested by removing the CRT dependency and running ITestS3ACopyFromLocalFile, all tests pass. This was previously failing with java.lang.NoClassDefFoundError: software/amazon/awssdk/crt/s3/S3MetaRequest

...nice. do that as a followup to this so we isolate dependency version changes?

can do as follow up, but could remove the crt update in the troubleshooting doc here

good point. will skip mentioning it

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 36s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 17 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
15m  5s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
20m 34s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m 51s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
9m 40s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 20s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
14m 37s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 53s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  4s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 43s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 42s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
37m 51s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
38m 10s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 24s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m  2s

the patch passed

+1 :green_heart:
compile
10m 13s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
10m 13s

the patch passed

+1 :green_heart:
compile
9m 37s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
9m 37s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
2m 19s
/results-checkstyle-root.txt
root: The patch generated 1 new + 24 unchanged - 12 fixed = 25 total (was 36)

+1 :green_heart:
mvnsite
9m 20s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 48s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

-1 :x:
javadoc
4m 47s
/patch-javadoc-root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05.txt
root in the patch failed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05.

+0 :ok:
spotbugs
0m 17s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
0m 50s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
18m  2s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
38m 28s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
667m  1s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 23s

The patch does not generate ASF License warnings.

899m 15s

Reason
Tests

Failed junit tests
hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.hdfs.server.namenode.ha.TestObserverNode

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/11/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux e0f5701e37c8 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 90abbde52c96865759881ffc7401b62473fa31e2

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/11/testReport/

Max. process+thread count
3656 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/11/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

thought of one more change; add a hadoop s3guard sdk command to support probes for sdk version.

one more "little" bit of redesign. i want to move those entry points we expose from s3afs (client, credentials, getObjectMetadata() into a new S3AInternals API, which is what you ask for. lines us up for refactoring the S3AFileSystem class later.

S3AFileSystem.getObjectMetadata() is already broken because of the new response type. Any application using this will have to update its code.
S3AInternals sounds good to me.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 32s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+0 :ok:
markdownlint
0m  1s

markdownlint was not available.

+0 :ok:
shelldocs
0m  1s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 27 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 49s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
19m 55s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m 36s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
9m 39s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 21s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
14m 18s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 55s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  6s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 41s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 39s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
37m 57s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
38m 16s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 25s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m  5s

the patch passed

+1 :green_heart:
compile
10m  6s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
10m  6s

the patch passed

+1 :green_heart:
compile
9m 40s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
9m 40s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 6 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
2m 19s
/results-checkstyle-root.txt
root: The patch generated 2 new + 28 unchanged - 12 fixed = 30 total (was 40)

+1 :green_heart:
mvnsite
9m 40s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 46s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  4s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
0m 51s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
17m 57s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
38m 19s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
667m 22s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 22s

The patch does not generate ASF License warnings.

898m 45s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier

hadoop.hdfs.server.namenode.ha.TestObserverNode

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/12/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 58415ce0809f 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 4553cb24ee6ad4c21fff646b588e6eb101bf2e56

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/12/testReport/

Max. process+thread count
3516 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/12/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 30s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 27 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 36s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
20m  4s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m 34s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
9m 40s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
14m 18s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 58s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  6s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 41s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 35s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
38m 14s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
38m 33s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 25s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m 35s

the patch passed

+1 :green_heart:
compile
10m  0s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
10m  0s

the patch passed

+1 :green_heart:
compile
9m 35s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
9m 35s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

+1 :green_heart:
checkstyle
2m 20s

root: The patch generated 0 new + 28 unchanged - 12 fixed = 28 total (was 40)

+1 :green_heart:
mvnsite
10m 15s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 53s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m 21s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 35s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 53s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
17m 21s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
41m 56s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
696m 37s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 25s

The patch does not generate ASF License warnings.

935m 47s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/13/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux c026b70e84e5 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 99273ebf497ca9c0b60dad3873a7a22d4b286014

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/13/testReport/

Max. process+thread count
3560 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/13/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 29 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 29s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
24m 17s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m 45s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
9m 50s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 43s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
15m 30s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
6m  9s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m 27s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 48s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
21m 11s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
45m 32s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
45m 52s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 24s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
24m 54s

the patch passed

+1 :green_heart:
compile
11m 39s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
11m 39s

the patch passed

+1 :green_heart:
compile
11m 14s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
11m 14s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

+1 :green_heart:
checkstyle
3m 12s

root: The patch generated 0 new + 23 unchanged - 18 fixed = 23 total (was 41)

+1 :green_heart:
mvnsite
11m 32s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
6m 38s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m 35s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 17s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 51s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 59s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
23m 43s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
54m 13s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
686m 17s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 31s

The patch does not generate ASF License warnings.

964m 47s

Reason
Tests

Failed junit tests
hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

hadoop.hdfs.TestReconstructStripedFileWithValidator

hadoop.hdfs.server.namenode.ha.TestObserverNode

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/14/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux bc2d418a5d96 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 34beeeae7bd81f00f9bb740418dd2334dd6d3488

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/14/testReport/

Max. process+thread count
3620 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/14/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 32s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 29 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 29s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
28m 22s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
13m  0s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
11m 52s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
3m 16s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
16m 55s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
7m 10s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
6m  4s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 18s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 45s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
21m 56s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
50m 11s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
50m 31s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 24s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
27m 18s

the patch passed

+1 :green_heart:
compile
11m 48s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
11m 48s

the patch passed

+1 :green_heart:
compile
10m 53s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
10m 53s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 2 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

-0 :warning:
checkstyle
2m 45s
/results-checkstyle-root.txt
root: The patch generated 1 new + 23 unchanged - 18 fixed = 24 total (was 41)

+1 :green_heart:
mvnsite
10m 54s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
6m 20s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m 41s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 40s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 59s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
21m 20s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
49m  0s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
671m 18s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 24s

The patch does not generate ASF License warnings.

961m 55s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/15/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 5c7619e4dcd3 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / f6eeb29f6a8d806d1033a19d1ec2ec4ebe8363be

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/15/testReport/

Max. process+thread count
3439 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/15/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Spotbugs is running off a version of the findbugs.xml which is not the one in the last commit. not sure how/why, but locally a call to mvn spotbugs:check is happy, the way it isn't before that patch.
All test failures are unrelated.
I don't know what is up with the spotbugs run, but this patch is ready except for style/eof, which i will now address

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 28s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 29 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 14s

Maven dependency ordering for branch

-1 :x:
mvninstall
20m 41s
/branch-mvninstall-root.txt
root in feature-HADOOP-18073-s3a-sdk-upgrade failed.

+1 :green_heart:
compile
10m  9s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
8m 56s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
13m 31s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 51s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
4m 58s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 18s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 42s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 25s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
37m  4s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
37m 23s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 27s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
19m  4s

the patch passed

+1 :green_heart:
compile
9m 33s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
9m 33s

the patch passed

+1 :green_heart:
compile
9m  2s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
9m  2s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
2m 18s

root: The patch generated 0 new + 23 unchanged - 18 fixed = 23 total (was 41)

+1 :green_heart:
mvnsite
8m 41s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 40s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
4m 58s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 25s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 52s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
17m 34s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
39m 52s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
657m 34s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 26s

The patch does not generate ASF License warnings.

888m 21s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/16/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 6fbd276abe0e 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / 644b390e9e491dbb2b3caf8cbcd0b35bc9e2a11f

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/16/testReport/

Max. process+thread count
3953 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/16/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

latest patch removed the redundant method and updates the auditing docs to cover the migration to the new option, plus any other updates needed. Note: storediag updated to print the new audit option and those files on the classpath to list what to automatically load too.
@ahmarsuhail if people really wanted to plug in handling here, maybe we should say "if the class implements Configurable we call setConf on it". that way people can add dynamic configuration through hadoop/spark jobs.

OK, I added the setConf() feature. Means thing is potentially useful.
V1 handlers get an error, as seen in the test
2023-08-17 17:24:42,849 [setup] WARN  s3a.SDKV2Upgrade (LogExactlyOnce.java:warn(39)) - Ignoring V1 SDK request handlers set in fs.s3a.audit.request.handlers: not-valid-class

Note, AFAIK nobody has ever added a custom handler.

tested s3 london at scale; got the usual huge file multipart failure. turn off for now?
also saw a transitive failure of ITestS3APrefetchingInputStream; seen that before. unrelated

@mukund-thakur @mehakmeet you happy with this? we are, and once it's in I'm ready to rebase and merge to trunk

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 29s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  1s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 29 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 42s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
20m 15s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m  7s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
9m  7s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 23s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
14m 12s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 52s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  6s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 43s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
18m 14s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
42m 54s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
43m 11s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 24s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
20m 22s

the patch passed

+1 :green_heart:
compile
10m 20s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
10m 20s

the patch passed

+1 :green_heart:
compile
8m 57s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
8m 57s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 3 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

+1 :green_heart:
checkstyle
2m 20s

root: The patch generated 0 new + 23 unchanged - 18 fixed = 23 total (was 41)

+1 :green_heart:
mvnsite
8m 58s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
5m 44s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m 22s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 25s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 52s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
18m 25s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
42m 58s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
669m  0s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 28s

The patch does not generate ASF License warnings.

914m  6s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/17/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 2d3d8fdf14bb 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / f7b2638c38d414e5361a85ab7fab24f94ee808e1

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/17/testReport/

Max. process+thread count
3998 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/17/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 28s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 31 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
14m 19s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
21m 10s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
10m 57s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
10m 26s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 33s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
14m 48s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 49s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
4m 42s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 17s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 36s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 39s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
38m 29s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
38m 48s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 25s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
21m 42s

the patch passed

+1 :green_heart:
compile
11m  6s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
11m  6s

the patch passed

+1 :green_heart:
compile
9m 59s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
9m 59s

the patch passed

-1 :x:
blanks
0m  0s
/blanks-eol.txt
The patch has 3 line(s) that end in blanks. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

+1 :green_heart:
checkstyle
2m 34s

root: The patch generated 0 new + 23 unchanged - 19 fixed = 23 total (was 42)

+1 :green_heart:
mvnsite
9m 39s

the patch passed

+1 :green_heart:
shellcheck
0m  0s

No new issues.

+1 :green_heart:
javadoc
6m  4s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
4m 40s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 17s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 27s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 48s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
17m 35s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
42m  3s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
670m  2s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 27s

The patch does not generate ASF License warnings.

914m 40s

Reason
Tests

Failed junit tests
hadoop.net.TestSocketIOWithTimeout

hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/18/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 54af3b9dcb42 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / afc678715eaac4085fbe0ffe140b75da47c81bc5

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/18/testReport/

Max. process+thread count
3560 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/18/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 30s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  2s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+0 :ok:
xmllint
0m  0s

xmllint was not available.

+0 :ok:
markdownlint
0m  0s

markdownlint was not available.

+0 :ok:
shelldocs
0m  0s

Shelldocs was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 31 new or modified test files.

_ feature-HADOOP-18073-s3a-sdk-upgrade Compile Tests _

+0 :ok:
mvndep
13m 56s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 55s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
compile
9m 53s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
compile
9m  0s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
2m 24s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
mvnsite
13m 49s

feature-HADOOP-18073-s3a-sdk-upgrade passed

+1 :green_heart:
javadoc
5m 51s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  2s

feature-HADOOP-18073-s3a-sdk-upgrade passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+0 :ok:
spotbugs
0m 18s

branch/hadoop-project no spotbugs output file (spotbugsXml.xml)

-1 :x:
spotbugs
0m 41s
/branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html
hadoop-tools/hadoop-aws in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

-1 :x:
spotbugs
17m 29s
/branch-spotbugs-root-warnings.html
root in feature-HADOOP-18073-s3a-sdk-upgrade has 1 extant spotbugs warnings.

+1 :green_heart:
shadedclient
37m 29s

branch has no errors when building and testing our client artifacts.

-0 :warning:
patch
37m 47s

Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 26s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
18m 58s

the patch passed

+1 :green_heart:
compile
9m 27s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javac
9m 27s

the patch passed

+1 :green_heart:
compile
8m 58s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
8m 58s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
2m 20s

root: The patch generated 0 new + 23 unchanged - 19 fixed = 23 total (was 42)

+1 :green_heart:
mvnsite
8m 34s

the patch passed

+1 :green_heart:
shellcheck
0m  1s

No new issues.

+1 :green_heart:
javadoc
5m 43s

the patch passed with JDK Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04

+1 :green_heart:
javadoc
5m  0s

root-jdkPrivateBuild-1.8.0_382-8u382-ga-1~20.04.1-b05 with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05 generated 0 new + 1450 unchanged - 1 fixed = 1450 total (was 1451)

+0 :ok:
spotbugs
0m 18s

hadoop-project has no data from spotbugs

+1 :green_heart:
spotbugs
1m 27s

hadoop-common in the patch passed.

+1 :green_heart:
spotbugs
0m 52s

hadoop-tools/hadoop-aws generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
spotbugs
17m 39s

root generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
shadedclient
37m 39s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
665m 15s
/patch-unit-root.txt
root in the patch passed.

+1 :green_heart:
asflicense
1m 26s

The patch does not generate ASF License warnings.

895m 46s

Reason
Tests

Failed junit tests
hadoop.mapreduce.v2.TestMRJobs

hadoop.mapreduce.v2.TestUberAM

hadoop.mapreduce.v2.TestMRJobsWithProfiler

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/19/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/5872

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle markdownlint shellcheck shelldocs

uname
Linux 66c881e154c3 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
feature-HADOOP-18073-s3a-sdk-upgrade / d89d95e4bbd91a6b637760bc006f654331b82845

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.20+8-post-Ubuntu-1ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/19/testReport/

Max. process+thread count
3944 (vs. ulimit of 5500)

modules
C: hadoop-project hadoop-common-project/hadoop-common hadoop-tools/hadoop-aws . U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5872/19/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.