HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount

NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 31s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
31m 26s
trunk passed

+1 :green_heart:
compile
1m 22s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
1m 10s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
0m 58s
trunk passed

+1 :green_heart:
mvnsite
1m 19s
trunk passed

+1 :green_heart:
shadedclient
19m 59s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 10s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 33s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
3m 33s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
3m 30s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m 13s
the patch passed

+1 :green_heart:
compile
1m 23s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

-1 :x:
javac
1m 23s
hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 generated 2 new + 602 unchanged - 0 fixed = 604 total (was 602)

+1 :green_heart:
compile
1m 12s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
javac
1m 12s
hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 generated 2 new + 586 unchanged - 0 fixed = 588 total (was 586)

-0 :warning:
checkstyle
0m 56s
hadoop-hdfs-project/hadoop-hdfs: The patch generated 7 new + 570 unchanged - 0 fixed = 577 total (was 570)

+1 :green_heart:
mvnsite
1m 22s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s
The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
17m  4s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 55s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 32s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
3m 40s
the patch passed

_ Other Tests _

-1 :x:
unit
100m  9s
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 40s
The patch does not generate ASF License warnings.

195m 23s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting

hadoop.hdfs.qjournal.client.TestQuorumJournalManager

hadoop.hdfs.qjournal.client.TestQJMWithFaults

hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy

hadoop.hdfs.TestErasureCodingPolicies

hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy

hadoop.hdfs.server.namenode.ha.TestBootstrapAliasmap

hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier

hadoop.hdfs.TestFileChecksum

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux 6e7ac29f0d10 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 0d855159f09

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1.txt

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01.txt

checkstyle
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt

unit
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/testReport/

Max. process+thread count
3706 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/1/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m  3s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
31m 22s
trunk passed

+1 :green_heart:
compile
1m 18s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
1m  9s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
0m 56s
trunk passed

+1 :green_heart:
mvnsite
1m 18s
trunk passed

+1 :green_heart:
shadedclient
18m  7s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 52s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 20s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
3m 12s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
3m  8s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m 11s
the patch passed

+1 :green_heart:
compile
1m  9s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

-1 :x:
javac
1m  9s
hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 generated 2 new + 602 unchanged - 0 fixed = 604 total (was 602)

+1 :green_heart:
compile
1m  2s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
javac
1m  2s
hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 generated 2 new + 586 unchanged - 0 fixed = 588 total (was 586)

-0 :warning:
checkstyle
0m 50s
hadoop-hdfs-project/hadoop-hdfs: The patch generated 7 new + 569 unchanged - 0 fixed = 576 total (was 569)

+1 :green_heart:
mvnsite
1m 10s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  2s
The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
15m 48s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 46s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 15s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
3m 13s
the patch passed

_ Other Tests _

-1 :x:
unit
113m 15s
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 36s
The patch does not generate ASF License warnings.

202m 26s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.datanode.TestBPOfferService

hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux 64599a30402d 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / e5fe3262702

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1.txt

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01.txt

checkstyle
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt

unit
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/testReport/

Max. process+thread count
3019 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/2/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m  5s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
31m 48s
trunk passed

+1 :green_heart:
compile
1m 18s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
1m 10s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
0m 56s
trunk passed

+1 :green_heart:
mvnsite
1m 17s
trunk passed

+1 :green_heart:
shadedclient
17m 59s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 51s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 19s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
3m 10s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
3m  8s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m 10s
the patch passed

+1 :green_heart:
compile
1m 12s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

-1 :x:
javac
1m 12s
hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 generated 2 new + 602 unchanged - 0 fixed = 604 total (was 602)

+1 :green_heart:
compile
1m 13s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
javac
1m 13s
hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 generated 2 new + 586 unchanged - 0 fixed = 588 total (was 586)

+1 :green_heart:
checkstyle
0m 53s
the patch passed

+1 :green_heart:
mvnsite
1m 21s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s
The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
15m 38s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 53s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 20s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
3m 17s
the patch passed

_ Other Tests _

-1 :x:
unit
110m 45s
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 37s
The patch does not generate ASF License warnings.

200m 56s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.TestDFSClientRetries

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux fc9cffaf39a1 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 958cab804ef

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/3/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1.txt

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/3/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01.txt

unit
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/3/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/3/testReport/

Max. process+thread count
2805 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/3/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

Thanks @LeonGao91 for your works, some comment inline.
I wonder that if someone could config more than one archive path at one device (for some reason or mis-config), then it may not work correct, right? Which works fine for logic disk in my opinion although it is not recommended. Thanks.

Thanks for the review! @Hexiaoqiao
I think this feature is mostly useful if users don't want to setup Linux level partitions to divide DISK/ARCHIVE, in which the size of partitions is difficult to change in production.
For the question:

It checks the underling filesystem mount to identify if two volumes are on the same mount, instead of the real physical disk. So it should work if the mount on a logical partition.
The reason is datanode uses DF to calculate capacity-related information, which is on the filesystem mount level. This patch is making sure the capacity of DISK/ARCHIVE volume is correctly calculated and reported.

If users mistakenly configured multiple archive paths on the same mount, it will throw an error msg (as per this line). But yes the capacity will not be reported correctly in this case. Please let me know what do you think, we can probably just exit DN and let users fix the config.

If users mistakenly configured multiple archive paths on the same mount, it will throw an error msg (as per this line). But yes the capacity will not be reported correctly in this case. Please let me know what do you think, we can probably just exit DN and let users fix the config.

Thanks @LeonGao91 , this is indeed my concern, I think only log is not proper way, because the following logic will be not correct, especially the capacity remains if mis-config. FYI, Thanks.

Thanks @LeonGao91 , this is indeed my concern, I think only log is not proper way, because the following logic will be not correct, especially the capacity remains if mis-config. IMO, DataNode instance exit probably more graceful. FYI, Thanks.

That makes sense, I will make the change accordingly.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m  3s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
31m 16s
trunk passed

+1 :green_heart:
compile
1m 16s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
1m  9s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
0m 56s
trunk passed

+1 :green_heart:
mvnsite
1m 18s
trunk passed

+1 :green_heart:
shadedclient
18m 13s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 50s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 21s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
3m  6s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
3m  4s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m  9s
the patch passed

+1 :green_heart:
compile
1m 10s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

-1 :x:
javac
1m 10s
hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 generated 2 new + 602 unchanged - 0 fixed = 604 total (was 602)

+1 :green_heart:
compile
1m  4s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
javac
1m  4s
hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 generated 2 new + 586 unchanged - 0 fixed = 588 total (was 586)

+1 :green_heart:
checkstyle
0m 49s
the patch passed

+1 :green_heart:
mvnsite
1m  9s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s
The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
15m 41s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 45s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 15s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
3m 11s
the patch passed

_ Other Tests _

-1 :x:
unit
110m 40s
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 34s
The patch does not generate ASF License warnings.

199m 27s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics

hadoop.hdfs.TestSnapshotCommands

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.TestRollingUpgrade

hadoop.hdfs.server.balancer.TestBalancer

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux e52145dca4b9 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / eacbe07b565

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/4/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1.txt

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/4/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01.txt

unit
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/4/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/4/testReport/

Max. process+thread count
2682 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/4/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
40m 11s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
39m 33s
trunk passed

+1 :green_heart:
compile
2m 10s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
1m 52s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
1m 20s
trunk passed

+1 :green_heart:
mvnsite
1m 45s
trunk passed

+1 :green_heart:
shadedclient
21m 54s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 28s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
2m 13s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
5m 21s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 15s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
2m 10s
the patch passed

+1 :green_heart:
compile
2m  1s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

-1 :x:
javac
2m  1s
hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 generated 2 new + 602 unchanged - 0 fixed = 604 total (was 602)

+1 :green_heart:
compile
1m 43s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
javac
1m 43s
hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 generated 2 new + 586 unchanged - 0 fixed = 588 total (was 586)

+1 :green_heart:
checkstyle
1m 10s
the patch passed

+1 :green_heart:
mvnsite
1m 44s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  2s
The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
23m  2s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m  9s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 48s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
4m 59s
the patch passed

_ Other Tests _

-1 :x:
unit
175m 20s
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
1m 50s
The patch does not generate ASF License warnings.

337m  3s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.server.datanode.TestDirectoryScanner

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier

hadoop.hdfs.server.namenode.TestFileTruncate

hadoop.hdfs.server.namenode.ha.TestHAAppend

hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting

hadoop.hdfs.server.diskbalancer.TestDiskBalancer

hadoop.hdfs.TestSnapshotCommands

hadoop.hdfs.server.namenode.TestDecommissioningStatus

hadoop.hdfs.TestDFSShell

hadoop.hdfs.TestHDFSFileSystemContract

hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl

hadoop.hdfs.server.datanode.TestDataNodeUUID

hadoop.hdfs.TestGetFileChecksum

hadoop.hdfs.TestQuota

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/5/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux ad2d6017d552 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / eacbe07b565

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/5/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1.txt

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/5/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01.txt

unit
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/5/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/5/testReport/

Max. process+thread count
2539 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/5/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 13s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
36m  4s
trunk passed

+1 :green_heart:
compile
1m 54s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
1m 33s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
1m 11s
trunk passed

+1 :green_heart:
mvnsite
1m 48s
trunk passed

+1 :green_heart:
shadedclient
20m 39s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m  9s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 39s
trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
4m 17s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
4m 15s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m 38s
the patch passed

+1 :green_heart:
compile
1m 39s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

-1 :x:
javac
1m 39s
hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 generated 2 new + 602 unchanged - 0 fixed = 604 total (was 602)

+1 :green_heart:
compile
1m 26s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
javac
1m 26s
hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 generated 2 new + 586 unchanged - 0 fixed = 588 total (was 586)

+1 :green_heart:
checkstyle
1m  6s
the patch passed

+1 :green_heart:
mvnsite
1m 38s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  2s
The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
17m 18s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m  3s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 38s
the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
4m 23s
the patch passed

_ Other Tests _

-1 :x:
unit
145m 33s
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
1m 13s
The patch does not generate ASF License warnings.

251m 57s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.server.datanode.TestDirectoryScanner

hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA

hadoop.hdfs.server.datanode.TestBlockRecovery

hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier

hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting

hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery

hadoop.hdfs.TestSnapshotCommands

hadoop.hdfs.server.namenode.TestDecommissioningStatus

hadoop.hdfs.server.namenode.ha.TestUpdateBlockTailing

hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks

hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes

hadoop.hdfs.server.datanode.TestDataNodeUUID

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/6/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux af4a1e33ff1c 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 7a6265ac425

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/6/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1.txt

javac
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/6/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01.txt

unit
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/6/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/6/testReport/

Max. process+thread count
2751 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/6/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.0.6

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@Hexiaoqiao Would you please take a second look? I have added a check as we discussed with UT.

Sorry, I missed this message before. Will have another review later today. Thanks.

@Hexiaoqiao Thanks for the comments! I have replied and please let me know if it makes sense to you.

+1 from my side. Ping @jojochuang @ayushtkn @goiri would you like to have another check? Thanks

Thanks for working on this, Leon! The patch looks good to me in general. Still have a couple of questions for discussion:

To add percentage and mount in FsVolumeImpl may not be very clear. How about we add a new wrapper class for the group of volumes and indicating their common mount and capacity distribution?
"reserved" is shared by the FsVolumeImpl instances on the same mount. Thus we need to verify if the reserved space of the mount may be counted twice.
Later update of the DFS_DATANODE_RESERVE_FOR_ARCHIVE_PERCENTAGE configuration may affect the capacity usage percentage calculation, although this scenario is rare in practice.

Thanks @Jing9 For the review!

Very good idea, I will make a wrapper for the relationship. This will be useful if we want to update the ratio without restarting DN.

Another good point, I did some investigation, although "reserve" is not being reported to NN, "NonDfsUsed" will be reported and double-counted. As discussed I will add an optional field to solve this.

Yes, this is expected and we are looking at balancer/mover to kick-in to balance the datanode once the ratio is updated. I will put some java doc to explain this.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
28m 39s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  1s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
11m 39s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
20m 30s

trunk passed

+1 :green_heart:
compile
4m  4s

trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
3m 48s

trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
1m 16s

trunk passed

+1 :green_heart:
mvnsite
2m 19s

trunk passed

+1 :green_heart:
shadedclient
18m 52s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 41s

trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
2m  0s

trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
3m  8s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 32s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 28s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 57s

the patch passed

+1 :green_heart:
compile
3m 57s

the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
cc
3m 57s

the patch passed

+1 :green_heart:
javac
3m 57s

the patch passed

+1 :green_heart:
compile
3m 37s

the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
cc
3m 37s

the patch passed

+1 :green_heart:
javac
3m 37s

the patch passed

-0 :warning:
checkstyle
1m  7s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 6 new + 699 unchanged - 0 fixed = 705 total (was 699)

+1 :green_heart:
mvnsite
1m 56s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
14m 30s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 27s

the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
2m  0s

the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

-1 :x:
findbugs
3m  2s
/new-findbugs-hadoop-hdfs-project_hadoop-hdfs.html
hadoop-hdfs-project/hadoop-hdfs generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
unit
2m 20s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
95m  0s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

-1 :x:
asflicense
0m 45s
/patch-asflicense-problems.txt
The patch generated 1 ASF License warnings.

235m 37s

Reason
Tests

FindBugs
module:hadoop-hdfs-project/hadoop-hdfs

Should org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MountVolumeMap$VolumeInfo be a static inner class?  At MountVolumeMap.java:inner class?  At MountVolumeMap.java:[lines 108-123]

Failed junit tests
hadoop.hdfs.server.namenode.TestNamenodeCapacityReport

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks

hadoop.hdfs.TestFileChecksum

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/9/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 44ad547c0310 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 74634eb0027

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/9/testReport/

Max. process+thread count
4449 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/9/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
32m 59s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  0s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
11m 27s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 47s

trunk passed

+1 :green_heart:
compile
4m 23s

trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
3m 59s

trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
1m  9s

trunk passed

+1 :green_heart:
mvnsite
2m 18s

trunk passed

+1 :green_heart:
shadedclient
20m  4s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 31s

trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 58s

trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
3m 13s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 42s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 22s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m  1s

the patch passed

+1 :green_heart:
compile
4m 20s

the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
cc
4m 20s

the patch passed

+1 :green_heart:
javac
4m 20s

the patch passed

+1 :green_heart:
compile
3m 54s

the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
cc
3m 54s

the patch passed

+1 :green_heart:
javac
3m 54s

the patch passed

-0 :warning:
checkstyle
1m  3s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 3 new + 698 unchanged - 0 fixed = 701 total (was 698)

+1 :green_heart:
mvnsite
1m 58s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
16m 14s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 25s

the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
1m 48s

the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
5m 51s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 12s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
120m 27s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 36s

The patch does not generate ASF License warnings.

271m  0s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.TestFileChecksum

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/10/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 9caea1b855a1 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 872440610f0

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/10/testReport/

Max. process+thread count
2581 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/10/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
28m 53s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  0s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 54s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
21m 26s

trunk passed

+1 :green_heart:
compile
4m 10s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
3m 48s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m 14s

trunk passed

+1 :green_heart:
mvnsite
2m 17s

trunk passed

+1 :green_heart:
shadedclient
18m 20s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 37s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
2m  0s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m  5s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 32s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 27s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m  2s

the patch passed

+1 :green_heart:
compile
4m  5s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
4m  5s

the patch passed

+1 :green_heart:
javac
4m  5s

the patch passed

+1 :green_heart:
compile
3m 40s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
3m 40s

the patch passed

+1 :green_heart:
javac
3m 40s

the patch passed

-0 :warning:
checkstyle
1m  5s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 699 unchanged - 0 fixed = 700 total (was 699)

+1 :green_heart:
mvnsite
2m  1s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
14m 21s

patch has no errors when building and testing our client artifacts.

-1 :x:
javadoc
0m 49s
/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>.txt
hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>.

+1 :green_heart:
javadoc
1m 55s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
findbugs
5m 37s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 20s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
97m 52s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 41s

The patch does not generate ASF License warnings.

242m 29s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestGetFileChecksum

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.server.balancer.TestBalancer

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/11/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux aed0a56f03ff 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 8ee6bc2518b

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/11/testReport/

Max. process+thread count
4305 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/11/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
29m 20s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  1s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 48s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
25m 22s

trunk passed

+1 :green_heart:
compile
5m  6s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
4m 38s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m 29s

trunk passed

+1 :green_heart:
mvnsite
2m 33s

trunk passed

+1 :green_heart:
shadedclient
21m 33s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 39s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
2m  5s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m 38s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
6m  0s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 28s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 22s

the patch passed

+1 :green_heart:
compile
5m 10s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
5m 10s

the patch passed

+1 :green_heart:
javac
5m 10s

the patch passed

+1 :green_heart:
compile
4m 36s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
4m 36s

the patch passed

+1 :green_heart:
javac
4m 36s

the patch passed

-0 :warning:
checkstyle
1m 18s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 698 unchanged - 0 fixed = 699 total (was 698)

+1 :green_heart:
mvnsite
2m 23s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

-1 :x:
shadedclient
0m 58s

patch has errors when building and testing our client artifacts.

-1 :x:
javadoc
0m 25s
/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-client-jdkUbuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>.txt
hadoop-hdfs-client in the patch failed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>.

-1 :x:
javadoc
0m 24s
/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>.txt
hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>.

-1 :x:
javadoc
0m 23s
/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-client-jdkPrivateBuild-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10.txt
hadoop-hdfs-client in the patch failed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10.

-1 :x:
javadoc
0m 25s
/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10.txt
hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10.

-1 :x:
findbugs
0m 24s
/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.txt
hadoop-hdfs-client in the patch failed.

-1 :x:
findbugs
0m 24s
/patch-findbugs-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch failed.

_ Other Tests _

-1 :x:
unit
0m 25s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt
hadoop-hdfs-client in the patch failed.

-1 :x:
unit
123m 43s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 38s

The patch does not generate ASF License warnings.

259m  4s

Reason
Tests

Failed junit tests
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks

hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks

hadoop.hdfs.TestSetrepIncreasing

hadoop.hdfs.TestGetFileChecksum

hadoop.hdfs.tools.TestDFSAdmin

hadoop.hdfs.TestDFSStripedOutputStreamWithFailure

hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer

hadoop.hdfs.tools.TestViewFileSystemOverloadSchemeWithDFSAdmin

hadoop.hdfs.TestReplaceDatanodeFailureReplication

hadoop.hdfs.TestPersistBlocks

hadoop.hdfs.TestMultipleNNPortQOP

hadoop.hdfs.TestDecommissionWithBackoffMonitor

hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer

hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr

hadoop.hdfs.tools.TestDFSAdminWithHA

hadoop.fs.TestHdfsNativeCodeLoader

hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy

hadoop.hdfs.TestViewDistributedFileSystem

hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData

hadoop.hdfs.TestDFSInotifyEventInputStream

hadoop.fs.viewfs.TestViewFsAtHdfsRoot

hadoop.hdfs.TestStripedFileAppend

hadoop.hdfs.TestDFSClientFailover

hadoop.hdfs.tools.TestStoragePolicyCommands

hadoop.hdfs.TestAclsEndToEnd

hadoop.hdfs.TestDFSUpgradeFromImage

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/12/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 36f7269b9cc2 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 8ee6bc2518b

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/12/testReport/

Max. process+thread count
4741 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/12/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m 37s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  1s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
11m 47s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
26m 35s

trunk passed

+1 :green_heart:
compile
5m 26s

trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
4m 55s

trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
checkstyle
1m 19s

trunk passed

+1 :green_heart:
mvnsite
2m 27s

trunk passed

+1 :green_heart:
shadedclient
23m 29s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 52s

trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
2m 12s

trunk passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+0 :ok:
spotbugs
4m  3s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
7m  9s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 31s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 34s

the patch passed

+1 :green_heart:
compile
5m 36s

the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
cc
5m 36s

the patch passed

+1 :green_heart:
javac
5m 36s

the patch passed

+1 :green_heart:
compile
4m 31s

the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
cc
4m 31s

the patch passed

+1 :green_heart:
javac
4m 31s

the patch passed

-0 :warning:
checkstyle
1m 21s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 698 unchanged - 0 fixed = 699 total (was 698)

+1 :green_heart:
mvnsite
2m 30s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  2s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
19m  2s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 42s

the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
javadoc
2m 11s

the patch passed with JDK Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

+1 :green_heart:
findbugs
7m 20s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 38s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
221m 16s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 42s

The patch does not generate ASF License warnings.

362m  6s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks

hadoop.hdfs.TestSetrepIncreasing

hadoop.hdfs.TestDecommission

hadoop.hdfs.server.blockmanagement.TestBlockInfoStriped

hadoop.hdfs.server.blockmanagement.TestBlockManager

hadoop.hdfs.server.datanode.TestDataNodeReconfiguration

hadoop.hdfs.TestStripedFileAppend

hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId

hadoop.hdfs.server.diskbalancer.TestDiskBalancerWithMockMover

hadoop.hdfs.TestDecommissionWithStriped

hadoop.hdfs.TestLeaseRecovery

hadoop.hdfs.TestReadStripedFileWithDNFailure

hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation

hadoop.hdfs.server.balancer.TestBalancer

hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes

hadoop.hdfs.TestReconstructStripedFile

hadoop.hdfs.server.mover.TestMover

hadoop.hdfs.server.balancer.TestBalancerRPCDelay

hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy

hadoop.hdfs.TestMaintenanceState

hadoop.hdfs.TestErasureCodingPolicies

hadoop.hdfs.server.datanode.TestLargeBlockReport

hadoop.hdfs.TestDFSInotifyEventInputStream

hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier

hadoop.hdfs.TestDecommissionWithBackoffMonitor

hadoop.hdfs.TestDecommissionWithStripedBackoffMonitor

hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant

hadoop.hdfs.server.namenode.TestBackupNode

hadoop.hdfs.TestWriteRead

hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy

hadoop.hdfs.TestLeaseRecovery2

hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy

hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped

hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes

hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages

hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy

hadoop.hdfs.TestErasureCodingMultipleRacks

hadoop.hdfs.TestDFSClientRetries

hadoop.hdfs.server.namenode.TestCheckpoint

hadoop.hdfs.TestBlockStoragePolicy

hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier

hadoop.hdfs.server.datanode.TestBlockRecovery

hadoop.hdfs.TestViewDistributedFileSystem

hadoop.hdfs.server.datanode.TestDirectoryScanner

hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy

hadoop.hdfs.TestDFSStripedOutputStreamWithFailure

hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness

hadoop.hdfs.TestGetFileChecksum

hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean

hadoop.hdfs.server.namenode.TestNameNodeMXBean

hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock

hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/13/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux d67a0c29c922 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 7169ec45095

Default Java
Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_265-8u265-b01-0ubuntu2~18.04-b01

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/13/testReport/

Max. process+thread count
3234 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/13/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m 13s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  0s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 41s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
23m 23s

trunk passed

+1 :green_heart:
compile
4m 20s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
3m 49s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m  9s

trunk passed

+1 :green_heart:
mvnsite
2m 13s

trunk passed

+1 :green_heart:
shadedclient
19m 43s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 29s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
2m  1s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m  9s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 36s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 22s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m  0s

the patch passed

+1 :green_heart:
compile
4m 11s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
4m 11s

the patch passed

+1 :green_heart:
javac
4m 11s

the patch passed

+1 :green_heart:
compile
3m 48s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
3m 48s

the patch passed

+1 :green_heart:
javac
3m 48s

the patch passed

-0 :warning:
checkstyle
1m  4s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 698 unchanged - 0 fixed = 699 total (was 698)

+1 :green_heart:
mvnsite
1m 58s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  2s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
16m 22s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 22s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 52s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
findbugs
5m 55s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 27s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
125m 17s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 36s

The patch does not generate ASF License warnings.

247m 52s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestSetrepIncreasing

hadoop.hdfs.TestFileCreationClient

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData

hadoop.hdfs.TestReadStripedFileWithDNFailure

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/14/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux caea6235b032 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 4890b855ece

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/14/testReport/

Max. process+thread count
2641 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/14/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
33m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
buf
0m  0s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 42s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 49s

trunk passed

+1 :green_heart:
compile
4m 21s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
3m 55s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m 10s

trunk passed

+1 :green_heart:
mvnsite
2m 12s

trunk passed

+1 :green_heart:
shadedclient
19m 52s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 30s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 57s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m 11s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 40s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 22s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m  0s

the patch passed

+1 :green_heart:
compile
4m 17s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
4m 17s

the patch passed

+1 :green_heart:
javac
4m 17s

the patch passed

+1 :green_heart:
compile
3m 48s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
3m 48s

the patch passed

+1 :green_heart:
javac
3m 48s

the patch passed

-0 :warning:
checkstyle
1m  4s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 698 unchanged - 0 fixed = 699 total (was 698)

+1 :green_heart:
mvnsite
2m  1s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
16m 22s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 23s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 53s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
findbugs
5m 51s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 13s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
112m 21s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 37s

The patch does not generate ASF License warnings.

266m 28s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA

hadoop.hdfs.server.datanode.TestBPOfferService

hadoop.hdfs.TestFileChecksum

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.TestRollingUpgrade

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/15/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 6aae26552476 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / e580280a8b0

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/15/testReport/

Max. process+thread count
2942 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/15/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m  6s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  1s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 50s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 55s

trunk passed

+1 :green_heart:
compile
4m 32s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
3m 58s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m 12s

trunk passed

+1 :green_heart:
mvnsite
2m 11s

trunk passed

+1 :green_heart:
shadedclient
20m  0s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 28s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 56s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m 10s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 40s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 47s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m  0s

the patch passed

+1 :green_heart:
compile
4m 16s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
4m 16s

the patch passed

+1 :green_heart:
javac
4m 16s

the patch passed

+1 :green_heart:
compile
3m 55s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
3m 55s

the patch passed

+1 :green_heart:
javac
3m 55s

the patch passed

-0 :warning:
checkstyle
1m  3s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 698 unchanged - 0 fixed = 699 total (was 698)

+1 :green_heart:
mvnsite
1m 58s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
16m 18s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 24s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 53s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
findbugs
5m 54s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 15s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
121m 29s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

-1 :x:
asflicense
0m 46s
/patch-asflicense-problems.txt
The patch generated 20 ASF License warnings.

244m 40s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestBlocksScheduledCounter

hadoop.hdfs.TestStateAlignmentContextWithHA

hadoop.hdfs.TestDFSStripedOutputStream

hadoop.hdfs.TestSafeModeWithStripedFile

hadoop.hdfs.TestGetFileChecksum

hadoop.hdfs.TestWriteConfigurationToDFS

hadoop.hdfs.TestFileChecksumCompositeCrc

hadoop.hdfs.TestDFSStripedOutputStreamWithFailure

hadoop.hdfs.TestLocalDFS

hadoop.hdfs.TestHDFSServerPorts

hadoop.hdfs.TestDistributedFileSystemWithECFileWithRandomECPolicy

hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR

hadoop.hdfs.TestSnapshotCommands

hadoop.hdfs.TestPread

hadoop.hdfs.TestFileChecksum

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/16/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 49a986c6190c 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / d07dc7afb4a

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/16/testReport/

Max. process+thread count
3003 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/16/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m  7s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
buf
0m  0s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 41s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
22m 46s

trunk passed

+1 :green_heart:
compile
4m 17s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
3m 53s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m  8s

trunk passed

+1 :green_heart:
mvnsite
2m 12s

trunk passed

+1 :green_heart:
shadedclient
19m 59s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 29s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 53s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m 13s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 41s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 23s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 59s

the patch passed

+1 :green_heart:
compile
4m 13s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
4m 13s

the patch passed

+1 :green_heart:
javac
4m 13s

the patch passed

+1 :green_heart:
compile
3m 49s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
3m 49s

the patch passed

+1 :green_heart:
javac
3m 49s

the patch passed

-0 :warning:
checkstyle
1m  4s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 698 unchanged - 0 fixed = 699 total (was 698)

+1 :green_heart:
mvnsite
1m 59s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
15m 58s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 23s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 51s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
findbugs
5m 48s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 14s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
109m 42s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 36s

The patch does not generate ASF License warnings.

231m  1s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.namenode.TestNameNodeMXBean

hadoop.hdfs.server.namenode.TestDecommissioningStatus

hadoop.hdfs.TestRollingUpgrade

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/18/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 302a0518c0a2 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 7e52c0975f7

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/18/testReport/

Max. process+thread count
2877 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/18/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

Hi @Hexiaoqiao I have updated the PR with comments from Jing, please feel free to take a second look if you get a chance, thanks!

Thanks @LeonGao91 and @Jing9 for your works, will confirm today later. Thanks.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
buf
0m  0s

buf was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:

0m  0s
test4tests
The patch appears to include 3 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 12s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
20m 34s

trunk passed

+1 :green_heart:
compile
4m  9s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
3m 42s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
checkstyle
1m 14s

trunk passed

+1 :green_heart:
mvnsite
2m 16s

trunk passed

+1 :green_heart:
shadedclient
18m 21s

branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 34s

trunk passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
2m  6s

trunk passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+0 :ok:
spotbugs
3m  3s

Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
5m 26s

trunk passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 26s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m  3s

the patch passed

+1 :green_heart:
compile
3m 58s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
cc
3m 58s

the patch passed

+1 :green_heart:
javac
3m 58s

the patch passed

+1 :green_heart:
compile
3m 39s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
cc
3m 39s

the patch passed

+1 :green_heart:
javac
3m 39s

the patch passed

-0 :warning:
checkstyle
1m  7s
/diff-checkstyle-hadoop-hdfs-project.txt
hadoop-hdfs-project: The patch generated 1 new + 699 unchanged - 0 fixed = 700 total (was 699)

+1 :green_heart:
mvnsite
1m 58s

the patch passed

+1 :green_heart:
whitespace
0m  0s

The patch has no whitespace issues.

+1 :green_heart:
xml
0m  1s

The patch has no ill-formed XML file.

+1 :green_heart:
shadedclient
14m 28s

patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
1m 28s

the patch passed with JDK Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
1m 56s

the patch passed with JDK Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

+1 :green_heart:
findbugs
5m 41s

the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 17s

hadoop-hdfs-client in the patch passed.

-1 :x:
unit
97m 44s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 43s

The patch does not generate ASF License warnings.

213m 36s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics

hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks

hadoop.hdfs.server.namenode.ha.TestBootstrapAliasmap

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/19/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2288

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc buflint bufcompat xml

uname
Linux 0588a3ccf8dd 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / ae7b00a9988

Default Java
Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9+11-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_272-8u272-b10-0ubuntu1~18.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/19/testReport/

Max. process+thread count
4123 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2288/19/console

versions
git=2.17.1 maven=3.6.0 findbugs=4.1.3

Powered by
Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.