HADOOP-16854 Fix to prevent OutOfMemoryException and Make the threadpool and bytebuffer pool common across all AbfsOutputStream instances

NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 34s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
19m 34s
trunk passed

+1 :green_heart:
compile
0m 32s
trunk passed

+1 :green_heart:
checkstyle
0m 24s
trunk passed

+1 :green_heart:
mvnsite
0m 35s
trunk passed

+1 :green_heart:
shadedclient
14m 50s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 27s
trunk passed

+0 :ok:
spotbugs
0m 52s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 50s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 29s
the patch passed

+1 :green_heart:
compile
0m 24s
the patch passed

+1 :green_heart:
javac
0m 24s
the patch passed

-0 :warning:
checkstyle
0m 16s
hadoop-tools/hadoop-azure: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)

+1 :green_heart:
mvnsite
0m 26s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
14m  5s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 23s
the patch passed

-1 :x:
findbugs
0m 54s
hadoop-tools/hadoop-azure generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
unit
1m 24s
hadoop-azure in the patch passed.

+1 :green_heart:
asflicense
0m 32s
The patch does not generate ASF License warnings.

58m 15s

Reason
Tests

FindBugs
module:hadoop-tools/hadoop-azure

Possible doublecheck on org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.threadExecutor in new org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream(AbfsClient, String, long, int, boolean, boolean)  At AbfsOutputStream.java:new org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream(AbfsClient, String, long, int, boolean, boolean)  At AbfsOutputStream.java:[lines 112-114]

Subsystem
Report/Notes

Docker
Client=19.03.7 Server=19.03.7 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux 0a6b74a2b28b 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / cf9cf83

Default Java
1.8.0_242

checkstyle
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/1/artifact/out/diff-checkstyle-hadoop-tools_hadoop-azure.txt

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/1/artifact/out/new-findbugs-hadoop-tools_hadoop-azure.html

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/1/testReport/

Max. process+thread count
415 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/1/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 32s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
19m 51s
trunk passed

+1 :green_heart:
compile
0m 30s
trunk passed

+1 :green_heart:
checkstyle
0m 23s
trunk passed

+1 :green_heart:
mvnsite
0m 35s
trunk passed

+1 :green_heart:
shadedclient
15m  0s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 28s
trunk passed

+0 :ok:
spotbugs
0m 52s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 51s
trunk passed

_ Patch Compile Tests _

-1 :x:
mvninstall
0m 25s
hadoop-azure in the patch failed.

-1 :x:
compile
0m 23s
hadoop-azure in the patch failed.

-1 :x:
javac
0m 23s
hadoop-azure in the patch failed.

-0 :warning:
checkstyle
0m 17s
hadoop-tools/hadoop-azure: The patch generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)

-1 :x:
mvnsite
0m 24s
hadoop-azure in the patch failed.

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
14m  2s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 24s
the patch passed

-1 :x:
findbugs
0m 27s
hadoop-azure in the patch failed.

_ Other Tests _

-1 :x:
unit
0m 27s
hadoop-azure in the patch failed.

+1 :green_heart:
asflicense
0m 31s
The patch does not generate ASF License warnings.

56m 59s

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux c4ecc203ffa3 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ea68863

Default Java
1.8.0_242

mvninstall
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/patch-mvninstall-hadoop-tools_hadoop-azure.txt

compile
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/patch-compile-hadoop-tools_hadoop-azure.txt

javac
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/patch-compile-hadoop-tools_hadoop-azure.txt

checkstyle
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/diff-checkstyle-hadoop-tools_hadoop-azure.txt

mvnsite
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/patch-mvnsite-hadoop-tools_hadoop-azure.txt

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/patch-findbugs-hadoop-tools_hadoop-azure.txt

unit
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/testReport/

Max. process+thread count
414 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/3/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
31m 11s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
22m 13s
trunk passed

+1 :green_heart:
compile
0m 29s
trunk passed

+1 :green_heart:
checkstyle
0m 23s
trunk passed

+1 :green_heart:
mvnsite
0m 32s
trunk passed

+1 :green_heart:
shadedclient
16m 22s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 22s
trunk passed

+0 :ok:
spotbugs
0m 52s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 51s
trunk passed

_ Patch Compile Tests _

-1 :x:
mvninstall
0m 22s
hadoop-azure in the patch failed.

-1 :x:
compile
0m 22s
hadoop-azure in the patch failed.

-1 :x:
javac
0m 22s
hadoop-azure in the patch failed.

-0 :warning:
checkstyle
0m 15s
hadoop-tools/hadoop-azure: The patch generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)

-1 :x:
mvnsite
0m 23s
hadoop-azure in the patch failed.

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
15m 22s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 21s
the patch passed

-1 :x:
findbugs
0m 25s
hadoop-azure in the patch failed.

_ Other Tests _

-1 :x:
unit
0m 24s
hadoop-azure in the patch failed.

+1 :green_heart:
asflicense
0m 28s
The patch does not generate ASF License warnings.

92m 12s

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux a8124915e0c1 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ea68863

Default Java
1.8.0_242

mvninstall
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/patch-mvninstall-hadoop-tools_hadoop-azure.txt

compile
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/patch-compile-hadoop-tools_hadoop-azure.txt

javac
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/patch-compile-hadoop-tools_hadoop-azure.txt

checkstyle
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/diff-checkstyle-hadoop-tools_hadoop-azure.txt

mvnsite
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/patch-mvnsite-hadoop-tools_hadoop-azure.txt

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/patch-findbugs-hadoop-tools_hadoop-azure.txt

unit
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/testReport/

Max. process+thread count
307 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/2/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 46s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
23m 25s
trunk passed

+1 :green_heart:
compile
0m 31s
trunk passed

+1 :green_heart:
checkstyle
0m 22s
trunk passed

+1 :green_heart:
mvnsite
0m 36s
trunk passed

+1 :green_heart:
shadedclient
17m 34s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 26s
trunk passed

+0 :ok:
spotbugs
0m 58s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 56s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 29s
the patch passed

+1 :green_heart:
compile
0m 25s
the patch passed

+1 :green_heart:
javac
0m 25s
the patch passed

-0 :warning:
checkstyle
0m 15s
hadoop-tools/hadoop-azure: The patch generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0)

+1 :green_heart:
mvnsite
0m 28s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
15m 43s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 20s
the patch passed

-1 :x:
findbugs
0m 57s
hadoop-tools/hadoop-azure generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
unit
1m 22s
hadoop-azure in the patch passed.

+1 :green_heart:
asflicense
0m 30s
The patch does not generate ASF License warnings.

66m 49s

Reason
Tests

FindBugs
module:hadoop-tools/hadoop-azure

Possible doublecheck on org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.threadExecutor in new org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream(AbfsClient, String, long, int, boolean, boolean)  At AbfsOutputStream.java:new org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream(AbfsClient, String, long, int, boolean, boolean)  At AbfsOutputStream.java:[lines 112-114]

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux aa72f0276124 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ea68863

Default Java
1.8.0_242

checkstyle
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/4/artifact/out/diff-checkstyle-hadoop-tools_hadoop-azure.txt

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/4/artifact/out/new-findbugs-hadoop-tools_hadoop-azure.html

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/4/testReport/

Max. process+thread count
457 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/4/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 32s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
19m  4s
trunk passed

+1 :green_heart:
compile
0m 31s
trunk passed

+1 :green_heart:
checkstyle
0m 25s
trunk passed

+1 :green_heart:
mvnsite
0m 34s
trunk passed

+1 :green_heart:
shadedclient
14m 42s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 26s
trunk passed

+0 :ok:
spotbugs
0m 51s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 50s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 29s
the patch passed

+1 :green_heart:
compile
0m 22s
the patch passed

+1 :green_heart:
javac
0m 22s
the patch passed

-0 :warning:
checkstyle
0m 17s
hadoop-tools/hadoop-azure: The patch generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0)

+1 :green_heart:
mvnsite
0m 27s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
14m  8s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 22s
the patch passed

-1 :x:
findbugs
0m 59s
hadoop-tools/hadoop-azure generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
unit
1m 21s
hadoop-azure in the patch passed.

+1 :green_heart:
asflicense
0m 32s
The patch does not generate ASF License warnings.

57m 29s

Reason
Tests

FindBugs
module:hadoop-tools/hadoop-azure

Possible doublecheck on org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.threadExecutor in new org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream(AbfsClient, String, long, int, boolean, boolean)  At AbfsOutputStream.java:new org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream(AbfsClient, String, long, int, boolean, boolean)  At AbfsOutputStream.java:[lines 112-114]

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/5/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux 51cd613b37fa 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ea68863

Default Java
1.8.0_242

checkstyle
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/5/artifact/out/diff-checkstyle-hadoop-tools_hadoop-azure.txt

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/5/artifact/out/new-findbugs-hadoop-tools_hadoop-azure.html

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/5/testReport/

Max. process+thread count
425 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/5/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 34s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
19m 51s
trunk passed

+1 :green_heart:
compile
0m 31s
trunk passed

+1 :green_heart:
checkstyle
0m 24s
trunk passed

+1 :green_heart:
mvnsite
0m 35s
trunk passed

+1 :green_heart:
shadedclient
15m 22s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 25s
trunk passed

+0 :ok:
spotbugs
0m 53s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 51s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 28s
the patch passed

+1 :green_heart:
compile
0m 24s
the patch passed

+1 :green_heart:
javac
0m 24s
the patch passed

+1 :green_heart:
checkstyle
0m 16s
the patch passed

+1 :green_heart:
mvnsite
0m 26s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
14m  4s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 22s
the patch passed

-1 :x:
findbugs
0m 54s
hadoop-tools/hadoop-azure generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
unit
1m 21s
hadoop-azure in the patch passed.

+1 :green_heart:
asflicense
0m 31s
The patch does not generate ASF License warnings.

58m 54s

Reason
Tests

FindBugs
module:hadoop-tools/hadoop-azure

Possible doublecheck on org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.threadExecutor in org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.()  At AbfsOutputStream.java:org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.()  At AbfsOutputStream.java:[lines 97-99]

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/6/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux 598fdcaa2f6e 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ea68863

Default Java
1.8.0_242

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/6/artifact/out/new-findbugs-hadoop-tools_hadoop-azure.html

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/6/testReport/

Max. process+thread count
414 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/6/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
2m  6s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
25m 33s
trunk passed

+1 :green_heart:
compile
0m 30s
trunk passed

+1 :green_heart:
checkstyle
0m 24s
trunk passed

+1 :green_heart:
mvnsite
0m 51s
trunk passed

+1 :green_heart:
shadedclient
16m 46s
branch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 23s
trunk passed

+0 :ok:
spotbugs
0m 51s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 49s
trunk passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 28s
the patch passed

+1 :green_heart:
compile
0m 23s
the patch passed

+1 :green_heart:
javac
0m 23s
the patch passed

+1 :green_heart:
checkstyle
0m 15s
the patch passed

+1 :green_heart:
mvnsite
0m 25s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
15m 49s
patch has no errors when building and testing our client artifacts.

+1 :green_heart:
javadoc
0m 20s
the patch passed

-1 :x:
findbugs
0m 55s
hadoop-tools/hadoop-azure generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
unit
1m 22s
hadoop-azure in the patch passed.

+1 :green_heart:
asflicense
0m 28s
The patch does not generate ASF License warnings.

69m 14s

Reason
Tests

FindBugs
module:hadoop-tools/hadoop-azure

Possible doublecheck on org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.threadExecutor in org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.()  At AbfsOutputStream.java:org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream.()  At AbfsOutputStream.java:[lines 97-99]

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/7/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle

uname
Linux 5bc63547926f 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ea68863

Default Java
1.8.0_242

findbugs
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/7/artifact/out/new-findbugs-hadoop-tools_hadoop-azure.html

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/7/testReport/

Max. process+thread count
307 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/7/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m  0s
Docker mode activated.

-1 :x:
patch
0m  5s
https://github.com/apache/hadoop/pull/1890 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem
Report/Notes

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/8/console

versions
git=2.17.1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m  0s
Docker mode activated.

-1 :x:
patch
0m  5s
https://github.com/apache/hadoop/pull/1890 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem
Report/Notes

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/9/console

versions
git=2.17.1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m  0s
Docker mode activated.

-1 :x:
patch
0m  4s
https://github.com/apache/hadoop/pull/1890 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem
Report/Notes

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/10/console

versions
git=2.17.1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m  0s
Docker mode activated.

-1 :x:
patch
0m  4s
https://github.com/apache/hadoop/pull/1890 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem
Report/Notes

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/11/console

versions
git=2.17.1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m  0s
Docker mode activated.

-1 :x:
patch
0m  5s
https://github.com/apache/hadoop/pull/1890 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem
Report/Notes

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/12/console

versions
git=2.17.1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m  0s
Docker mode activated.

-1 :x:
patch
0m  5s
https://github.com/apache/hadoop/pull/1890 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.

Subsystem
Report/Notes

GITHUB PR
https://github.com/apache/hadoop/pull/1890

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-1890/13/console

versions
git=2.17.1

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Please check the following PR
https://github.com/apache/hadoop/pull/1901


forbid setattr type changes and enable block replacement

this change includes:

prevent attributes whose names don't start with '_' from changing types
properly replace _children if both existing value and new value are blocks.

Please add tests for these new behaviors


Activating Open Collective

This pull request adds backers and sponsors from your Open Collective https://opencollective.com/url-shortener ❤
It adds two badges at the top to show the latest number of backers and sponsors. It also adds placeholders so that the avatar/logo of new backers/sponsors can automatically be shown without having to update your README.md. [more info]. See how it looks on this repo.
We have also added a postinstall script to let people know after npm|yarn install that you are welcoming donations (optional). [More info]
You can also add a "Donate" button to your website and automatically show your backers and sponsors there with our widgets. Have a look here: https://opencollective.com/widgets
P.S: As with any pull request, feel free to comment or suggest changes. The only thing "required" are the placeholders on the README because we believe it's important to acknowledge the people in your community that are contributing (financially or with code!).
Thank you for your great contribution to the open source community. You are awesome! 🙌
And welcome to the open collective community! 😊
Come chat with us in the #opensource channel on https://slack.opencollective.com - great place to ask questions and share best practices with other open source sustainers!

Awesome thanks! 🎉🍾


Number of parameters

Hello,
I was wondering where the number of parameters of the InteractE on WN18RR, FB15k-237 and YAGO3-10 is reported somewhere.
Cheers

Hi Demirrr,
We do a comparison of the score functions of different embedding methods in Table 1 of our paper. We did not report the number of parameters for our best models. If you require them, it should be easy to run the given command to instantiate the model and compute the number of params before this line.

The function to count the number of parameters is given here:
https://gist.github.com/zackenton/12a86b6e0ff274b39608e40f4a412f2b


View file History of file changes (local history)

VSCode Version: 1.2
OS Version: W7

Steps to Reproduce:Copy paste content
When copy file content from one to another, it replaces the whole content, sometimes not intended to do so,  and there is no option to undo that action. The whole work will loose. Especially found when VS code becomes slow and hanging

@Jijokoickal Can you perhaps show a screen recording of what is going on? I have copied and pasted content from one file to another multiple times with 100% success rate.
Do you have some sort of external program that modifies the files on disk?
Can you please provide more specific steps.

unfortunately I don't have a screen recording. I am working in an organization and I dont have options for that too. Still issue is happening even if I update VS code. Copy part of file from one to another and when I come to old tab, some contents are copied from the other file and it is saved. Even I am unable to revert by Ctrl+Z, because the file will be already saved. If we have an option to history like android studio it will be easy to revert the file.

My belief is that there is some other third party software editing the file on disk. That is the only time AFAIK the workbench causes the model to drop its undo stack. Leaving this issue to track as a feature request for local history. fyi @bpasero

This feature request will not be considered in the next 6-12 months roadmap and as such will be closed to keep the number of issues we have to maintain actionable. Thanks for understanding and happy coding!

I think this is a really useful feature in intellij. I don't understand why there is no interest to implement it. I especially like knowing my changes are always tracked so if I mess something up I can revert it quickly, also useful when making changes that are not ready to be committed on git.


Merge the 'Authorized Support Ticket Initiators' airtable into the 'Community Partners' airtable

Split out of https://github.com/2i2c-org/infrastructure/issues/3048 to handle this specific task.
This task can be marked as completed when all the information in https://airtable.com/appxk7c9WUsDjSi0Q/tbl3CWOgyoEtuGuIw/viwtpo7RxkYv63hiD?blocks=hide (which was gathered in the process described in https://github.com/2i2c-org/infrastructure/issues/3048#issuecomment-1907195217) is merged into https://airtable.com/appbjBTRIbgRiElkr/tblYGygEo5PQBSUYt/viwGZLBERreDcvUMO?blocks=hide in a useful form.
Once that is merged, a follow-up to https://github.com/2i2c-org/team-compass/pull/797 and https://github.com/2i2c-org/infrastructure/pull/3634 needs to be made to point to the new location.

Assigning to @jmunroe per https://github.com/2i2c-org/infrastructure/issues/3048#issuecomment-1909011115

I've merged all of the data from the "Authorized Support Ticket Initiators" base into the "2i2c" base.  The data itself is stored in the Communities table with a list of "Authorized Technical Contacts" which has a many-to-many relationship with the 'Contacts' table to store email addresses.  To update this data (currently) requires adding/removing/modifying records in the 2i2c base.
I think it makes sense for Partnerships to take responsibility for keeping the data consistent with the leads, contracts, and relationships we have with communities.
For use by Support Triagers, I suggest the Airtable interface: Airtable: Support Use be the primary way of looking up this information when triaging FreshDesk Support Tickets.  I'll create a short video overview of what that interface currently looks like.
In a future state, I can imagine an integration between FreshDesk and Airtable to make this same information appear within FreshDesk but that is beyond the scope of this particular issue.

Video overview of work done: https://www.loom.com/share/5631fdd559f84363a9873f54cc4e88fa?sid=d84120e1-9f39-4e56-9f61-d3a08d5f8188


Losing focus on the current document while editing a block of code results in incorrect scrolling

[x] The Plugin is up to date
[x] Obsidian is up to date

Describe the bug
When the code block is in the editing state, if you switch to another page or browser or something, come back to obsidian and find that the document scrolling is heavily offset.
And without using this plugin this problem does not occur, because you can edit the code block directly.
It may be that the current document loses focus and then changes back to a block that cannot be edited, and then enters the editing state when focus is restored, but does not return to the original position.
To Reproduce
Steps to reproduce the behavior:

Write a long block of code.
Entering the editing state of a code block and scroll down a bit.
Open your browser.
Back to Obsidian page.

Expected behavior
Revert to the original scroll offset.
Screenshots
If applicable, add screenshots to help explain your problem.
Occurs on

[x] Windows
[ ] macOS
[ ] Linux
[ ] Android
[ ] iOS

Plugin version
0.4.3
Additional context
The other thing that confuses me is that, in the code block editing state, it is often the original syntax highlighting colour, while there are only a few cases where the preview state syntax highlighting can be displayed.

The scroll issue is caused by how Obsidian handles code block post processors. I don't think there is anything I can do about it.
The original highlighting showing happens on large code blocks, as Obsidian hides the parts of the note that are not visible and the plugin requires the entire code block to be "loaded" for it to be able to do syntax highlighting.

I am also not updating highlights on scroll for performance reasons. Maybe something can still be improved there.

The scroll issue is caused by how Obsidian handles code block post processors. I don't think there is anything I can do about it.

Is it possible to prevent a block of code from exiting from the editing state when the note loses focus?

no, not afaik

oops, mentioned the wrong issue in that commit