hadoop: add aarch64 support

This commit also changes the names of the tests for Hadoop so they use dashes instead of dots,
and makes the default hadoop test what would have been hadoop-all after the rename.
This change should mean that we're able to run
nix build github:nixos/nixpkgs/master#nixosTests.hadoop
which I was unable to do prior to this change.
I've built this change on aarch64-darwin, aarch64-linux, and x86_64-linux. I've run the NixOS tests for Hadoop on aarch64-linux, and x86_64-linux. On aarch64-darwin I just ran hadoop version and hadoop checknative.
I made a flake to spin up an AWS EC2 instance on a bare-metal instance (required because NixOS tests need KVM), create a ramdisk (to avoid provisioning a larger amount of disk space), and build and test the change there: https://github.com/ConnorBaker/nix-hadoop-aarch64-test.
I've seen some posts discussing getting the native libraries working for macOS, but I wasn't sure how to do that. I'm not familiar with patchelf or install_name_tool or how linking works, so any help would be appreciated!
Motivation for this change
Spark requires Hadoop, so adding Hadoop's aarch64 distribution allows us to use Spark on that platform.
Things done

Built on platform(s)

[x] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

[x] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

I used an m6g.metal instance (about $2.50 an hour) for the aarch64-linux tests and a c5n.metal instance (about $4.00 an hour) for the x86_64-linux tests.
I'm running the tests again on m6g.metal and c5n.metal to get you the numbers on how long it'll take -- I don't remember exactly, but I thought it was less than 20 or 30 minutes.

cc @grahamc about resource usage

Uh oh, I'm getting a failed build for nixosTests.hadoop, though not until about 19m in.  Both hadoop-yarn and hadoop-hdfs seem to be fine. I'll test against current master to see if I can reproduce it there.

On the same c5n.metal instance as above. I blew away the nix store in the ramdisk prior to running these. (Note: I had to get a copy of nixpkgs because I wasn't able to figure out how to use nix build with a flake when there are nested attribute sets).
It works, so I think I may have messed up by setting openssl = null; and conditionally updating the attribute set when the platform is Linux, but I don't know enough Nix to say that's what did it. I also made sure to do the same tests against the repo just prior to my changes, to make sure that the copy of master I was working off of didn't have the same issue before I started. I'll do some further investigating later tonight!
$ curl -L --silent https://github.com/NixOS/nixpkgs/archive/refs/heads/master.tar.gz | tar -xz
$ cd nixpkgs-master/
$ time nix build -f ./nixos/tests/hadoop/hdfs.nix --out-link hadoop-hdfs

real	1m44.698s
user	2m23.901s
sys	0m55.611s

$ time nix build -f ./nixos/tests/hadoop/yarn.nix --out-link hadoop-yarn

real	0m28.016s
user	0m41.740s
sys	0m19.863s

$ time nix build -f ./nixos/tests/hadoop/hadoop.nix --out-link hadoop

real	5m2.715s
user	7m42.968s
sys	3m52.261s

As of the latest, I was able to build the tests successfully on aarch64 and on x86_64.
Here it is on aarch64:
$ time nix build github:/connorbaker/nixpkgs/master#nixosTests.{hadoop,hadoop-yarn,hadoop-hdfs} --store ~/ramdisk

real	5m49.831s
user	8m3.129s
sys	4m53.577s

and on x86_64 I got:
real	4m51.494s
user	8m24.644s
sys	4m47.754s

While debugging, I found that some of the problems I was having were a result of specifying store in ~/.config/nix/nix.conf (or, at the least, they went away when I specified store as a command-line argument).
After modifying store in ~/.config/nix/nix.conf, is there anything I need to do to make the changes take effect?

Volth and @illustris, would you also be willing to review?
Volth, I can't find your GitHub user -- if you're still maintaining Hadoop, can you update maintainers-list.nix?

Diff looks good. Also verified that NixOS tests succeed on aarch64 and x86_64. Thanks!

Sure!
See https://github.com/ConnorBaker/nixpkgs/commit/799d7434e2a49407b6506cecb21d3f1fd3d3ae4c for the latest.
(I had to wrap patchelf in an optionalString because that doesn't work on Darwin.)
So here's the latest build on an x86_64-linux:
$ nix build github:connorbaker/nixpkgs#hadoop --print-build-logs
hadoop> unpacking sources
hadoop> unpacking source archive /nix/store/57vfasjl07by1fb4krlh9sn4hmz4w5cs-hadoop-3.3.1.tar.gz
hadoop> source root is hadoop-3.3.1
hadoop> setting SOURCE_DATE_EPOCH to timestamp<PHONE_NUMBER> of file hadoop-3.3.1/share/doc/hadoop/project-reports.html
hadoop> patching sources
hadoop> configuring
hadoop> no configure script, doing nothing
hadoop> building
hadoop> no Makefile, doing nothing
hadoop> running tests
hadoop> no Makefile or custom checkPhase, doing nothing
hadoop> installing
hadoop> post-installation fixup
hadoop> shrinking RPATHs of ELF executables and libraries in /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libnativetask.so.1.0.0
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhdfs.so.0.0.0
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhadoop.so.1.0.0
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhdfspp.so.0.1.0
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/wordcount-nopipe
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/wordcount-part
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/wordcount-simple
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/pipes-sort
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/test-container-executor
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/container-executor
hadoop> shrinking /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/oom-listener
hadoop> strip is /nix/store/v5a649mvjkgwcxsjiz6ngw03xhnh7isp-binutils-wrapper-2.35.2/bin/strip
hadoop> stripping (with command strip and flags -S) in /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib  /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/bin
hadoop> patching script interpreter paths in /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/stop-estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/start-estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/sls/bin/rumen2sls.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/sls/bin/slsrun.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-workload/bin/parse-start-timestamp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-workload/bin/start-workload.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-blockgen/bin/generate-block-lists.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/upload-fsimage.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/parse-metrics.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/create-slim-hadoop-tar.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/start-dynamometer-cluster.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-all.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-yarn.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-dfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-dfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/hadoop-daemon.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/mr-jobhistory-daemon.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-all.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/kms.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/yarn-daemons.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-secure-dns.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/distribute-exclude.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/workers.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-yarn.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/refresh-namenodes.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-secure-dns.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-balancer.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-balancer.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/yarn-daemon.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/httpfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/hadoop-daemons.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hdfs-config.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hadoop-config.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-streaming.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-distcp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-archive-logs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-gridmix.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-mapreduce.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-azure.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-s3guard.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-kms.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-azure-datalake.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-httpfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-openstack.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-yarn.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-aws.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-kafka.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-rumen.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-archives.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-extras.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-hdfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-aliyun.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/mapred-config.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hadoop-functions.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-streaming.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-distcp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-archive-logs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-gridmix.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-sls.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-resourceestimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-dynamometer-blockgen.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-dynamometer-workload.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-aws.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-rumen.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-archives.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-extras.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-dynamometer-infra.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hadoop-layout.sh.example: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/mapred: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/yarn: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/hadoop: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/hdfs: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/4nmqxajzaf60yjribkgvj5j54x9yvr1r-bash-5.1-p12/bin/bash"
hadoop> checking for references to /build/ in /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1...
hadoop> automatically fixing dependencies for ELF files
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhdfspp.so.0.1.0
hadoop>   libprotobuf.so.18 -> found: /nix/store/n7wm7y0jlppd8hrmbn1gd7f9ji7qrkpg-protobuf-3.7.1/lib/libprotobuf.so.18
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop>   libsasl2.so.2 -> found: /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libsasl2.so.2
hadoop>   libstdc++.so.6 -> found: /nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib/libstdc++.so.6
hadoop> setting RPATH to: /nix/store/n7wm7y0jlppd8hrmbn1gd7f9ji7qrkpg-protobuf-3.7.1/lib:/nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib:/nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native:/nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhadoop.so.1.0.0
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhdfs.so.0.0.0
hadoop>   libjvm.so -> found: /nix/store/kylb9qkyg5njrkln7fpx5lpb4qidnjvg-openjdk-headless-11.0.12+7/lib/openjdk/lib/server/libjvm.so
hadoop> setting RPATH to: /nix/store/kylb9qkyg5njrkln7fpx5lpb4qidnjvg-openjdk-headless-11.0.12+7/lib/openjdk/lib/server
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libnativetask.so.1.0.0
hadoop>   libz.so.1 -> found: /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libz.so.1
hadoop>   libsnappy.so.1 -> found: /nix/store/4i9d1kj13qw0fm1f05zcga715ld3cfp9-snappy-1.1.9/lib/libsnappy.so.1
hadoop>   libjvm.so -> found: /nix/store/kylb9qkyg5njrkln7fpx5lpb4qidnjvg-openjdk-headless-11.0.12+7/lib/openjdk/lib/server/libjvm.so
hadoop>   libstdc++.so.6 -> found: /nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib/libstdc++.so.6
hadoop> setting RPATH to: /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native:/nix/store/4i9d1kj13qw0fm1f05zcga715ld3cfp9-snappy-1.1.9/lib:/nix/store/kylb9qkyg5njrkln7fpx5lpb4qidnjvg-openjdk-headless-11.0.12+7/lib/openjdk/lib/server:/nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/pipes-sort
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop>   libstdc++.so.6 -> found: /nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib/libstdc++.so.6
hadoop> setting RPATH to: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib:/nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/wordcount-simple
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop>   libstdc++.so.6 -> found: /nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib/libstdc++.so.6
hadoop> setting RPATH to: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib:/nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/wordcount-part
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop>   libstdc++.so.6 -> found: /nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib/libstdc++.so.6
hadoop> setting RPATH to: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib:/nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/examples/wordcount-nopipe
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop>   libstdc++.so.6 -> found: /nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib/libstdc++.so.6
hadoop> setting RPATH to: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib:/nix/store/ndnqiz3nnifj1blhg9q626xlmkqq1nmh-gcc-10.3.0-lib/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/oom-listener
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/container-executor
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop> setting RPATH to: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib
hadoop> searching for dependencies of /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/bin/test-container-executor
hadoop>   libcrypto.so.1.1 -> found: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib/libcrypto.so.1.1
hadoop> setting RPATH to: /nix/store/2aprvflf41z1dfma87mzd3md51xm2g71-openssl-1.1.1m/lib

And here's the same build on the latest on aarch64-darwin:
$ nix build .#hadoop --print-build-logs
hadoop> unpacking sources
hadoop> unpacking source archive /nix/store/7i751wf2lyx1rfkm2207rb51vbckzch5-hadoop-3.3.1-aarch64.tar.gz
hadoop> source root is hadoop-3.3.1
hadoop> setting SOURCE_DATE_EPOCH to timestamp<PHONE_NUMBER> of file hadoop-3.3.1/share/doc/hadoop/project-reports.html
hadoop> patching sources
hadoop> updateAutotoolsGnuConfigScriptsPhase
hadoop> configuring
hadoop> no configure script, doing nothing
hadoop> building
hadoop> no Makefile, doing nothing
hadoop> running tests
hadoop> no Makefile or custom checkPhase, doing nothing
hadoop> installing
hadoop> post-installation fixup
hadoop> strip is /nix/store/km02igh4pshp20d0wn89rf5jjfxcm8v5-clang-wrapper-11.1.0/bin/strip
hadoop> stripping (with command strip and flags -S) in /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib  /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/bin
hadoop> patching script interpreter paths in /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/bin/mapred: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/bin/yarn: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/bin/hadoop: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/bin/hdfs: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-extras.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-distcp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-archive-logs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-sls.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-resourceestimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-dynamometer-infra.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-rumen.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-dynamometer-blockgen.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-streaming.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-aws.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-dynamometer-workload.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-archives.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/tools/hadoop-gridmix.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hadoop-config.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hadoop-layout.sh.example: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hadoop-functions.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-extras.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-s3guard.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-distcp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-kms.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-openstack.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-archive-logs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-mapreduce.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-httpfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-azure-datalake.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-azure.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-rumen.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-yarn.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-streaming.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-aws.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-kafka.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-aliyun.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-hdfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-archives.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/shellprofile.d/hadoop-gridmix.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/hdfs-config.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/libexec/mapred-config.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/yarn-daemon.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/yarn-daemons.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/distribute-exclude.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-yarn.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-all.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/mr-jobhistory-daemon.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/kms.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/workers.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-dfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-secure-dns.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-balancer.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-secure-dns.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-dfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/httpfs.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-yarn.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/start-balancer.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/hadoop-daemons.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/hadoop-daemon.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/refresh-namenodes.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/sbin/stop-all.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/sls/bin/rumen2sls.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/sls/bin/slsrun.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/upload-fsimage.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/create-slim-hadoop-tar.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/parse-metrics.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-infra/bin/start-dynamometer-cluster.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-blockgen/bin/generate-block-lists.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-workload/bin/start-workload.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-workload/bin/parse-start-timestamp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/stop-estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"
hadoop> /nix/store/g1bkm13bdn7a2im98ijwkgx7vbwfsgl3-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/start-estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p12/bin/bash"

On x86_64-linux we see
$ ./result/bin/hadoop checknative -a
WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
2022-02-24 03:57:41,976 INFO  [main] bzip2.Bzip2Factory (Bzip2Factory.java:isNativeBzip2Loaded(61)) - Successfully loaded & initialized native-bzip2 library system-native
2022-02-24 03:57:41,978 INFO  [main] zlib.ZlibFactory (ZlibFactory.java:loadNativeZLib(59)) - Successfully loaded & initialized native-zlib library
2022-02-24 03:57:41,981 WARN  [main] erasurecode.ErasureCodeNative (ErasureCodeNative.java:<clinit>(49)) - Loading ISA-L failed: Failed to load libisal.so.2 (libisal.so.2: cannot open shared object file: No such file or directory)
2022-02-24 03:57:41,981 WARN  [main] erasurecode.ErasureCodeNative (ErasureCodeNative.java:<clinit>(55)) - ISA-L support is not available in your platform... using builtin-java codec where applicable
2022-02-24 03:57:42,002 INFO  [main] nativeio.NativeIO (NativeIO.java:isPmdkAvailable(192)) - The native code was built without PMDK support.
Native library checking:
hadoop:  true /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libhadoop.so.1.0.0
zlib:    true /nix/store/bqjh8dc6m5plswxrmmn9x4cpxrrw94lv-zlib-1.2.11/lib/libz.so.1
zstd  :  true /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libzstd.so.1
bzip2:   true /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libbz2.so.1
openssl: true /nix/store/i9pg1y2ki390xp6ypcpglzqk92slr6bd-hadoop-3.3.1/lib/hadoop-3.3.1/lib/native/libcrypto.so
ISA-L:   false Loading ISA-L failed: Failed to load libisal.so.2 (libisal.so.2: cannot open shared object file: No such file or directory)
PMDK:    false The native code was built without PMDK support.
2022-02-24 03:57:42,007 INFO  [main] util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 1: ExitException

while on aarch64-darwin we have
$ ./result/bin/hadoop checknative -a
WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete.
2022-02-23 23:03:11,804 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(60)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Native library checking:
hadoop:  false
zlib:    false
zstd  :  false
bzip2:   false
openssl: false
ISA-L:   false
PMDK:    false
2022-02-23 23:03:11,924 INFO  [main] util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 1: ExitException

I've talked (a little bit) previously with people about how to do the same patching on macOS but I can't find my notes on it at the moment. If you happen to know what commands would be needed to help Hadoop find the libraries, let me know!

From the logs, it looks like autoPatchelfHook isn't running at all on darwin.
https://github.com/ConnorBaker/nixpkgs/blob/799d7434e2a49407b6506cecb21d3f1fd3d3ae4c/pkgs/applications/networking/cluster/hadoop/default.nix#L38
optional (stdenv.isLinux && (nativeLibs != [ ] || libPatches != "")) [ autoPatchelfHook ];

You'll just have to drop the stdenv.isLinux here.

I removed it as suggested and it errored (I thought patchelf didn't work on Darwin)?
Here are the last few lines of the log (the rest of which is identical to the log before the change):
/nix/store/qx36hf946n1bcdb60nw8iambf1500r28-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-blockgen/bin/generate-block-lists.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40
/nix/store/qx36hf946n1bcdb60nw8iambf1500r28-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-workload/bin/start-workload.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9
/nix/store/qx36hf946n1bcdb60nw8iambf1500r28-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/dynamometer/dynamometer-workload/bin/parse-start-timestamp.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c4
/nix/store/qx36hf946n1bcdb60nw8iambf1500r28-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/stop-estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5
/nix/store/qx36hf946n1bcdb60nw8iambf1500r28-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-5.1-p1
/nix/store/qx36hf946n1bcdb60nw8iambf1500r28-hadoop-3.3.1/lib/hadoop-3.3.1/share/hadoop/tools/resourceestimator/bin/start-estimator.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/m0nsx4ai768kjp9c40vhkpj9pxlii46m-bash-
automatically fixing dependencies for ELF files
/nix/store/a4q92isrpiy004njsk6x66rsahw62am3-auto-patchelf-hook/nix-support/setup-hook: line 333: -l: command not found

I tried again after also removing the optional in
optionalString stdenv.isLinux "patchelf --add-rpath ${jdk.home}/lib/server $out/lib/${untarDir}/lib/native/libnativetask.so.1.0.0";

to see if that helped (it would make sense to use patchelf if we're using autoPatchelfhook right?), but it didn't:
$ nix log /nix/store/s4jpnbvmmfk4kgk7rl2292kis1n2gd35-hadoop-3.3.1.drv
@nix { "action": "setPhase", "phase": "unpackPhase" }
unpacking sources
unpacking source archive /nix/store/7i751wf2lyx1rfkm2207rb51vbckzch5-hadoop-3.3.1-aarch64.tar.gz
source root is hadoop-3.3.1
setting SOURCE_DATE_EPOCH to timestamp<PHONE_NUMBER> of file hadoop-3.3.1/share/doc/hadoop/project-reports.html
@nix { "action": "setPhase", "phase": "patchPhase" }
patching sources
@nix { "action": "setPhase", "phase": "updateAutotoolsGnuConfigScriptsPhase" }
updateAutotoolsGnuConfigScriptsPhase
@nix { "action": "setPhase", "phase": "configurePhase" }
configuring
no configure script, doing nothing
@nix { "action": "setPhase", "phase": "buildPhase" }
building
no Makefile, doing nothing
@nix { "action": "setPhase", "phase": "checkPhase" }
running tests
no Makefile or custom checkPhase, doing nothing
@nix { "action": "setPhase", "phase": "installPhase" }
installing
/nix/store/0qlq4s175mzlx9g0aqcdk95j92g1z7mf-stdenv-darwin/setup: line 1378: patchelf: command not found

Any ideas?

ah, my bad... Yes, patchelf doesn't work on darwin. I'm not sure if hadoop with native libs can even work in darwin with the way we're packaging now.
[illustris@desktop:/dev/shm/hadoop-3.3.1/lib/native]$ file libhadoop.so.1.0.0
libhadoop.so.1.0.0: ELF 64-bit LSB shared object, ARM aarch64, version 1 (SYSV), dynamically linked, BuildID[sha1]=c08694691c54cd5ce768dea281674437c23afaf4, with debug_info, not stripped

The native lib files bundled with hadoop are ELF files. Apache doesn't release builds with .dylib files for darwin, and it isn't supported on darwin. It might still be possible to build native libs for darwin, but it might not be a good idea to do that in nixpkgs.

I actually looked into building Hadoop from source, but all the Java tooling threw me... maybe I'll try again?
As long as the builds are cached, end-users shouldn't have to compile it themselves, right? And we can always offer the binary distribution alongside it.

That's how it was done before https://github.com/NixOS/nixpkgs/pull/141143
Building from source is not a good idea because

maven central does not guarantee the same checksum for an artifact pulled from different mirrors
the build process for hadoop will download multiple dynamically linked binaries that will get used at build time. I tried looping mvn build and patchelf, but some of these binaries are overwritten by a fresh copy of the unpatched binary during the subsequent run of maven
if the end user wants to change their java version, it will force a very expensive full rebuild

Yikes, no kidding!
So without finding a way to link the libraries on macOS (which I absolutely lack the knowledge to do) I guess this is as good as it'll get.
In terms of the scope of this pull request, do you think it's good? Are there other things you'd like to see done, or ways I can clean it up further? I'm still learning about most of nix's builtins and the nixpkg's lib, so any advice would be appreciated!

Great feedback!
I had to keep the isLinux check to prevent autoPatchelfHook from running on darwin (which causes a crash). If we don't have that check, then even with the patchelf call in libPatches guarded, we still get this error:
$ nix log /nix/store/3xmyasz6bxsfq0608krxv7pbs9kbx4by-hadoop-3.3.1.drv
@nix { "action": "setPhase", "phase": "unpackPhase" }
unpacking sources
unpacking source archive /nix/store/7i751wf2lyx1rfkm2207rb51vbckzch5-hadoop-3.3.1-aarch64.tar.gz
source root is hadoop-3.3.1
setting SOURCE_DATE_EPOCH to timestamp<PHONE_NUMBER> of file hadoop-3.3.1/share/doc/hadoop/project-reports.html
@nix { "action": "setPhase", "phase": "patchPhase" }
patching sources
@nix { "action": "setPhase", "phase": "updateAutotoolsGnuConfigScriptsPhase" }
updateAutotoolsGnuConfigScriptsPhase
@nix { "action": "setPhase", "phase": "configurePhase" }
configuring
no configure script, doing nothing
@nix { "action": "setPhase", "phase": "buildPhase" }
building
no Makefile, doing nothing
@nix { "action": "setPhase", "phase": "checkPhase" }
running tests
no Makefile or custom checkPhase, doing nothing
@nix { "action": "setPhase", "phase": "installPhase" }
installing
/nix/store/0qlq4s175mzlx9g0aqcdk95j92g1z7mf-stdenv-darwin/setup: line 1378: patchelf: command not found


update same code as PR 686 to remove softmax

@nvpohanh wanna take a final look before I merge? Same as #686

Looks good to me. Thanks!


add static minified files

added minified version for jsDelivr:
https://www.jsdelivr.com/package/npm/js-beautify
now exists only not minified files in repo:
https://github.com/beautify-web/js-beautify/blob/master/js/lib/beautify.js
https://github.com/beautify-web/js-beautify/blob/master/js/lib/beautify-html.js
https://github.com/beautify-web/js-beautify/blob/master/js/lib/beautify-css.js
and also not in jsDelivr:
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>

@bitwiseman "It is not sufficient to checkin the minified current version of the file. Minification needs to be added to the build."
these minified files are copied from CloudFlare:

https://cdnjs.cloudflare.com/ajax/libs/js-beautify/1.7.5/beautify.min.js
https://cdnjs.cloudflare.com/ajax/libs/js-beautify/1.7.5/beautify-css.min.js
https://cdnjs.cloudflare.com/ajax/libs/js-beautify/1.7.5/beautify-html.min.js

@epexa That is fine, but what happens when the unminified files are updated?  Will you be maintaining the minified files?
Also, I'm not sure I understand what you're trying to do.
https://www.jsdelivr.com/package/npm/js-beautify already has minified files<EMAIL_ADDRESS>What does this change add?

We're no longer checking in the built files (minified or unminified).  We should probably add the minified files to package, but it is not required.


[FLINK-8401][Cassandra Connector]Refactor CassandraOutputFormat to allow subclass to customize the fai…

What is the purpose of the change
Refactor CassandraOutputFormat to allow subclass to customize the failure handling logic.
Brief change log

Added to protected methods for handling cassandra write result, these allow subclass to override them to customize.

Verifying this change
This change is already covered by existing tests.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
The public API, i.e., is any changed class annotated with @Public(Evolving): ( no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: ( no)
The S3 file system connector: (no)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

@tillrohrmann , can you help take another look?

Looks good to me.
Will merge this.


Curriculum: looping back to "Hello Camper ... Go to Curiculum."

Describe your problem and - if possible - how to reproduce it
From this page, "https://www.freecodecamp.org/" I click either "Curriculum" at top near right, or the "Go to the Coding Curriculum" button, and all that happens is I get looped back to the same page,
https://www.freecodecamp.org/
Sometimes, for a matter of seconds, I see what looks like it might be a list of curriculum topics, or an actual challenge, but then back to https://www.freecodecamp.org/, and "Welcome Camper."
I don't feel welcome at all, and this is too representative of my past experiences, though usually you keep me happily progressing for minutes, or even hours, before I hit a wall of code.
Add a Link to the page with the problem
https://www.freecodecamp.org/
Tell us about your browser and operating system

Browser Name: Firefox
Browser Version: 61.0.1
Operating System: Windows 10, "ver 1803, OS build 17134.165

If possible, add a screenshot here

@Pastshelfdate Have you tried going to `

@bharatgupta99 Could you try going to the curriculum page (https://learn.freecodecamp.org) directly, see if it would redirect you somewhere?

might be an odd issue with the ocde not taking you to the first cirriculium
try this link
https://learn.freecodecamp.org/responsive-web-design/basic-html-and-html5/say-hello-to-html-elements

@Pastshelfdate I was also experiencing the same issue in Chrome, just cleared my cache and decided to log in with Email option and my progress appears to be back to normal and I'm no longer looping.

Guys, is this fixed now? For me it's working fine. If so, please close it @Pastshelfdate


Merge release 1.6.0 back into dev

Proposed changes
Merge release 1.6.0 back into dev
Type of change

[ ] Feature work
[ ] Bug fix
[ ] Documentation
[x] Engineering change
[ ] Test
[ ] Logging/Telemetry

Risk

[ ] High – Errors could cause MAJOR regression of many scenarios. (Example: new large features or high level infrastructure changes)
[x] Medium – Errors could cause regression of 1 or more scenarios. (Example: somewhat complex bug fixes, small new features)
[ ] Small – No issues are expected. (Example: Very small bug fixes, string changes, or configuration settings changes)

Additional information

Replaced by https://github.com/AzureAD/microsoft-authentication-library-common-for-objc/pull/910 to resolve conflicts.


[SPARK-17138][ML][MLib] Add Python API for multinomial logistic regression

What changes were proposed in this pull request?
Add Python API for multinomial logistic regression.
as MLOR and LOR use unified interface,
add family param in python api.
How was this patch tested?
doc test.

Test build #64543 has started for PR 14852 at commit 2ddb948.

Test build #64543 has finished for PR 14852 at commit 2ddb948.

This patch fails Python style tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class MultinomialLogisticRegression(JavaEstimator, HasFeaturesCol, HasLabelCol, HasPredictionCol, HasMaxIter,
class MultinomialLogisticRegressionModel(JavaModel, JavaClassificationModel, JavaMLWritable, JavaMLReadable):

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64543/
Test FAILed.

Merged build finished. Test FAILed.

Now that https://github.com/apache/spark/pull/14834 has been merged, we can make the updates to Python API. There is no new interface to implement, but it would be great if this PR could take care of updating the Python side to reflect that LOR supports multiclass now.

@sethah OK. I will study the unified scala API for LOR and update the python-side api PR ASAP. Thanks!

Test build #65721 has started for PR 14852 at commit 0e9b423.

Test build #65721 has finished for PR 14852 at commit 0e9b423.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65721/
Test PASSed.

Merged build finished. Test PASSed.

cc @sethah  @yanboliang thanks!

@WeichenXu123 We should also expose coefficientMatrix and interceptVector for LogisticRegressionModel. Meanwhile, update the Python docs for supporting multinomial logistic (softmax) regression. Thanks.

Done. thanks! @yanboliang

Test build #65828 has started for PR 14852 at commit d7b9967.

Test build #65828 has finished for PR 14852 at commit d7b9967.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65828/
Test PASSed.

Merged build finished. Test PASSed.

Done. thanks for careful review :) @sethah

Test build #65885 has started for PR 14852 at commit c47ac07.

Test build #65885 has finished for PR 14852 at commit c47ac07.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
    This class supports multinomial logistic (softmax) and binomial logistic regression.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65885/
Test PASSed.

Merged build finished. Test PASSed.

LGTM. @yanboliang what do you think?

LGTM2, merged into master. Thanks! @WeichenXu123 @sethah


[Bug]  About Texture.from function  when pass a BaseTexture object

Bug at
https://github.com/pixijs/pixi.js/blob/master/src/core/textures/Texture.js#L471
    else if(source instanceof BaseTexture)
    {
        return new Texture(BaseTexture);
    }

I think it should be
    else if(source instanceof BaseTexture)
    {
        return new Texture(source);
    }

Good spot, PR made to fix :)

Hello! The above code is correct. No fix required 👍

@GoodBoyDigital are you sure? Looks like it is passing in the BaseTexture class as the first param to the Texture ctor instead of the source. How is that correct?

@GoodBoyDigital are you sure?  Please test it .

Pretty sure this is correct, Texture constructor expects a BaseTexture rather than an image.

oooohh!

you guys are correct

sorry about that!

K, I'm going to revert your revert :P


Addresses SAM issue 551

Goes with ssc pull request https://github.com/NREL/ssc/pull/894
Test file
SAM_551.zip
Changes to SAM_api files

37 API file changes and test results changes - includes warning messages now for single owner


A special version of rebar needed to compile YAWS

I wanted use YAWS in embedded mode. However, the late release (rebar 2.5.1 17 20150118_115522 git 2.5.1-102-g25aca7e) of rebar failed to compile it. However, an older version (rebar 2.5.1 R14B04 20141216_212600 git 2.5.1-57-gb79606) can do it. More info in
http://stackoverflow.com/questions/11876263/yaws-as-rebar-dependency/11883926#comment44414815_11883926

Fixed in latest release. Tested now, and it works


Allow space after FROM: as some (broken) clients do this

I've found a couple of mail clients that add an extra space after FROM:, this patch allows this optional space.

That space is already supported - the mailFromRE already has the \s? in it and the test coverage for spaces begins on smtpd_test.go#L141.
The change you've made in smptd.go actually removes support for the space in the To: field.

That space is already supported - the mailFromRE already has the \s? in it and the test coverage for spaces begins on smtpd_test.go#L141.
The change you've made in smptd.go actually removes support for the space in the To: field.


MaxMind databases from 'geolite2-redist' package installation failed.

node: v12.18.3
macOS: Catalina 10.15.6
❯ yarn
yarn install v1.22.4
[1/4] 🔍  Resolving packages...
[2/4] 🚚  Fetching packages...
[3/4] 🔗  Linking dependencies...
warning " ><EMAIL_ADDRESS>has unmet peer dependency<EMAIL_ADDRESS>[4/4] 🔨  Building fresh packages...
[1/7] ⠄ @prisma/cli
[2/7] ⠄ bcrypt
[3/7] ⠄ geolite2-redist
[4/7] ⠄ @ampproject/toolbox-optimizer
error /Users/like/repo/fork/umami/node_modules/geolite2-redist: Command failed.
Exit code: 1
Command: node scripts/postinstall.js
Arguments:
Directory: /Users/like/repo/fork/umami/node_modules/geolite2-redist
Output:
Downloading MaxMind databases from mirror...
events.js:292
      throw er; // Unhandled 'error' event
      ^

Error: connect ECONNREFUSED <IP_ADDRESS>:443
    at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1141:16)
Emitted 'error' event on ClientRequest instance at:
    at TLSSocket.socketErrorListener (_http_client.js:426:9)
    at TLSSocket.emit (events.js:315:20)
    at emitErrorNT (internal/streams/destroy.js:92:8)
    at emitErrorAndCloseNT (internal/streams/destroy.js:60:3)
    at processTicksAndRejections (internal/process/task_queues.js:84:21) {
  errno: 'ECONNREFUSED',
  code: 'ECONNREFUSED',
  syscall: 'connect',

@lastingman This looks like a network failure, if you try again it may work. If the host is down, you may just have to wait unfortunately, unless there's a mirror to point it to..

@lastingman This looks like a network failure, if you try again it may work. If the host is down, you may just have to wait unfortunately, unless there's a mirror to point it to..

Hi @hugomd,
I tried several times, it doesn't work.
I narrow down the problem, it happens at file ./node_modules/geolite2-redist/scripts/download-helper.js:21

The https request is not working properly.

Since this is due to another module, you'll have to raise an issue with the geolite2-redist repo.

$ node scripts/build-geo.js
node:events:504
throw er; // Unhandled 'error' event
^
Error: connect ECONNREFUSED <IP_ADDRESS>:443
at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1157:16)
Emitted 'error' event on ClientRequest instance at:
at TLSSocket.socketErrorListener (node:_http_client:442:9)
at TLSSocket.emit (node:events:526:28)
at emitErrorNT (node:internal/streams/destroy:157:8)
at emitErrorCloseNT (node:internal/streams/destroy:122:3)
at processTicksAndRejections (node:internal/process/task_queues:83:21) {
errno: -61,
code: 'ECONNREFUSED',
syscall: 'connect',
address: '<IP_ADDRESS>',
port: 443
}
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
ERROR: "build-geo" exited with 1.
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
Process finished with exit code 1
I also had a similar issue and tried several times without getting a solution


v2.0.0

Changes:

Add support for the the portable_atomic and loom crates. (#27)
Breaking: Add an std feature that can be disabled to use this crate on no_std platforms. (#22)
Replace usage of cache-padded with crossbeam-utils. (#26)

"adding an std feature" is only a breaking change because crates can opt to default-features = false, right?

"adding an std feature" is only a breaking change because crates can opt to default-features = false, right?

Yes. With the std feature, certain traits that are normally implemented on concurrent-queue are disabled. There is a way around it (see #29), but it's probably better to just go with the breaking change.

I'm not sure if we should release a new version yet, or check if downstream crates might need some additional modifications...

All of smol's crates do not use concurrent-queue as a public dependency. smol is by and large the largest user of concurrent-queue; all of its crates have about 10 million downloads, while the next largest consumer (jackiechan) has about 50k downloads. Of the crates with more than 10k downloads:

jackiechain and barrage are unmaintained forks of async-channel with an alternate version of smol-rs/async-channel#47 implemented.
sosistab imports concurrent-queue but never uses it.

None of these crates have concurrent-queue as a public dependency. Every other crate involved has less than 10k downloads.

@smol-rs/admins It looks like I don't have push permissions, so the release didn't take. Does anyone mind making the push?

Published. Thanks for working on this!
(In the future I would like to set up CI to publish the crate via tag push like my crates.)


Term recommendation is broken

The issue was related to how gene2go are parsed. There's a couple of outstanding issues though:

duplicated TIER3 genes cause an issue
added terms don't have overlap and size


#Idea

Idea Title
Be as descriptive as you can with your idea/bug report/question/suggestion.
Issue Details
Add a detailed explanation of what is wrong or what you want implemented. Images and rich content is welcome!

@slovz7 What's your real issue? Please don't test stuff in this channel.


Security reports

Hi,
the docker image for the latest stable version of SFTPGo and therefore the helm chart could be affect by security issues, for system packages, disclosed after the image is built.
For example, currently, the alpine image ships a vulnerable openssl version. We don't use openssl at all but this isn't the point.
To fix this issue, I'm thinking of rebuilding the last tag on schedule, for example once a week. What do you think about? thanks

I don't think moving versioned tags is a good idea. Versioned artifacts should be immutable.
I think pushing new (patch) versions is the only way to publish new artifacts.

Currently the 2.0.x branch has some bug fixes so I could release 2.0.3 in few weeks, we'll see in future if we have no changes and there is a security issue for a system package or for the Go version used to build the tag


Autoscaling low and up targets.

This is a Feature Request
Add a lower target resource for horizontal auto-scaler.
What would you like to be added

The number of pods should be constant and not changing when the resource consumption is between the min and the max accepted values. Eg: while we have a cpu load between 20 and 60 the number of pods in the replica set should be x.
If the utilization drops below 20% then scale down, if the utilization grows about 60% scale up.
Why is this needed
Stabilize the number of pods in use and keep them from thrashing. Could be used in conjunction with --horizontal-pod-autoscaler-downscale-stabilization.
Comments

This sounds like a feature request for the HorizontalPodAutoscaler itself, rather than for the documentation.
@astateofmind01 – have I got that right?

Yes, sorry if i didn't add it in the right place :)

This should be an issue against https://github.com/kubernetes/kubernetes/
/close


fix(hstore): JRaft Metrics miss

Purpose of the PR

close #2603

Main Changes

Verifying these changes

[ ] Trivial rework / code cleanup without any test coverage. (No Need)
[ ] Already covered by existing tests, such as (please modify tests here).
[ ] Need tests and can be verified as follows:

xxx

Does this PR potentially affect the following parts?

[ ]  Dependencies (add/update license info & regenerate_dependencies)
[ ]  Modify configurations
[ ]  The public API
[ ]  Other affects (typed here)
[ ]  Nope

Documentation Status

[ ]  Doc - TODO
[ ]  Doc - Done
[ ]  Doc - No Need

LGTM~.
By the way, may be we can add some metrics-related unit tests.


Add instruction for manually pausing cluster reconcile

Issue #, if available:
#2846
Description of changes:
Added documentation about manual cluster reconciliation pause in the cluster management upgrade section. Pausing eks-a cluster controller is more of an internal operation and not meant to be used frequently by user. Thus I'm adding it in the upgrade page instead of a separate section.
Testing (if applicable):
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve
/cherrypick release-0.11


New repository for documentation examples

Forking the discussion that started in #297 to here.
The problem
In the documentation, there will eventually be a (hopefully) substantial number of examples, both code and output videos/gifs. Git is pretty bad at tracking binary files, and if we keep these in the main repository, it will bloat up and become very clunky. Further, not every user/developer that clones the repository will need to (or want to) interact with the example gifs/movies.
The solution
@kolibril13 suggested that we create a new repository under the ManimCommunity organization. This repo would contain the gif/video files to be included in the documentation, but not the documentation itself. The documentation itself will remain under the main repository. Further, @naveen521kk brought up the fact that using GitHub for hosting is fine, but we should use other solutions for delivery and suggested jsdelivr. The benefits are that it will be much faster, and will be up whenever github is down.
What we need from you
Adding a new repository to the ManimCommunity organization is a fairly big change to the face of the organization, and I would not want to do that without making sure the core team approves. Up to now we have four people in favor (@Aathish04, @naveen521kk, @kolibril13, and myself). We need to hear from at least few more among @kilacoda @yoshiask @eulertour @PgBiel @XorUnison @kilacoda @huguesdevimeux @safinsingh @faielgila. Please feel free to thumbs up or down and/or raise any issues that you want to discuss.
PS: sorry for the multiple mentions in the other issue and this one. I just can't bring myself to make executive decisions on my own without running it by the whole team!

The maximum file size on GitHub is 100MB so storing video in a repository probably won't last very long, especially if we use high quality video. We may end up having to host it ourselves somehow.

I will consider youtube or something like that for videos, but for images and gifs a repo would be useful.

Would it be more useful for one of us to create a website, I could help with that for sure. That way we can have it all in one easily accessible place that doesn't have like a file storage limit and if we really need to we can host the files on a separate platform

What are the other options except having a GitHub repo? I don't see any issue in having such thing.

The maximum file size on GitHub is 100MB so storing video in a repository probably won't last very long, especially if we use high quality video. We may end up having to host it ourselves somehow.

This is fine for all the quick example, 100MB is enough. For more long and complicated example, I think we can use Youtube. But the problem with Youtube is that it can't be accessed by everyone without doing some weird password-share syste.

This is fine for all the quick example, 100MB is enough. For more long and complicated example, I think we can use Youtube

Good idea! It did not occur often to me to have file sizes bigger than 50 mb, even for long and complicated scenes, so I think this will not occur to often.
Another thing we should consider is the maximum total size of the repo. I could only find an old answer (from 2017) here, they say that there is no hard border, but you get a notification from github when your repo exceeds 1 GB.

Adding a new repository to the ManimCommunity organization is a fairly big change to the face of the organization, and I would not want to do that without making sure the core team approves

To keep the current face of the organization: we could make this doc-files repo a private repo and try if jsdelivr can somehow get access to that.

To keep the current face of the organization: we could make this doc-files repo a private repo and try if jsdelivr can somehow get access to that.

Jsdelivr fetches only from public repositories but yeah it caches it forever.
They say so,  https://www.jsdelivr.com/features

We use a permanent S3 storage to ensure all files remain available even if GitHub goes down, or a repository or a release is deleted by its author. Files are fetched directly from GitHub only the first time, or when S3 goes down.

I think the examples gallery will only rarely contain examples larger than
100MB. If that ever happens, we can use YouTube for those few. The rest can
go in a repo.
The repo should be public, because open source! But also because I think
private repos are not free (as in they cost money).
Not sure if it's necessary to create a whole separate site for this though?
I'd much rather just host the documentation in RTD, until we're ready to
have s fully fledged actual website for the project.
On Sun, Aug 16, 2020, 3:41 AM Naveen M K<EMAIL_ADDRESS>wrote:

To keep the current face of the organization: we could make this doc-files
repo a private repo and try if jsdelivr can somehow get access to that.
Jsdelivr fetches only from public repositories but yeah it caches it
forever.
They say so, https://www.jsdelivr.com/features
We use a permanent S3 storage to ensure all files remain available even
if GitHub goes down, or a repository or a release is deleted by its author.
Files are fetched directly from GitHub only the first time, or when S3 goes
down.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ManimCommunity/manim/issues/308#issuecomment-674492975,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAILYAA53RNV22XVBA45PP3SA6ERHANCNFSM4QASNVPA
.

private repos are not free (as in they cost money).

They changed this. Private repos are also free now: https://github.com/pricing
But you are right, it would be better to have this open-source.  I feel comfortable with the idea to have a public second repo for img and gifs.

A repo for images and stuff sounds ok to me. But for videos that exceed a certain size, we might see ourselves forced to use YouTube, as was said here already.

I'd just like to point out that GitHub repos do max out at a specific size. It's still free to use and everything, but you have to set up GitHub LFS (Large File System) which is a bit of a pain

How long a video is a 100MB file at high quality?
How many hours of video could we store in a barebones GitHub repository?

Even if we do find a way to do it with github, I'd much rather use something that's designed for file storage to store videos and gifs.

How long a video is a 100MB file at high quality?

I just made a test with this script:
class TestExample(Scene):
    def construct(self):
        s=Square()
        c= Circle()
        for i in range(0,60):
            self.play(Transform(s.copy(),c.copy()))
            self.play(Transform(c.copy(),s.copy()))

The video is 1080p 60fps and 2 minutes long
-> TestExample.mp4 has a size of 6.2 MB
-> TestExample.gif has a size of  52.8 MB

Holy crap what a difference. So I don't think we'll have many examples that are longer than 2min. I'm assuming that examples will be short and succinct. BUT, a single 2min example occupying 50MB is kind of ridiculous, and the git history is going to explode.
@eulertour what do you suggest we use instead?

BUT, a single 2min example occupying 50MB is kind of ridiculous, and the git history is going to explode.

I think it's worth noting that the video was rendered in 1080p at 60FPS.
I don't think we need to have every single example animation rendered at such a high quality.

Fair. But still, now I'm on the fence.

git history is going to explode.

We could write a bot that cleans the git history from time to time.
I think version control is not so important in the case of videos.
But if there is another possible solution (maybe from eulertour), I would prefer that as well.

If we don't put it in version control, then we can't use GitHub (or GitHub + jsdelivr) as hosting.
I think we should just use YouTube and share a password :shrug:

Using Youtube would be to me a waste of time. Like, if you want to add/update/whatever scene example you will have to ask for the password, connect it, put remove the old video, replace, and put the new link.
I think that with something more collaborative-oriented, such as GitHub, doing something more automatized would be possible.

I mean we could just set the password once and share it with all devs, no need to ask every time. But yes I see your point and I agree it could get old really fast.

I mean we could just set the password once and share it with all devs, no need to ask every time.

Google hates it when people on opposite sides of the planet log into the same account, anti-hacking measures and all. I'd much rather have just a single person handle everything Youtube related if we go that route.

Google hates it when people on opposite sides of the planet log

Very, very good point. 100% the account will get suspended/asked for mail verification ten times per day.

Very, very good point. 100% the account will get suspended/asked for mail verification ten times per day.

I and @Aathish04 had some experience and it doesn't allowed me to login again.

Ok, fair. So YT is a huge chore, and GH is not great for our purpose. What else is there?

How about cloudinary?

So we basically need a file system that lives in the cloud, with at least a few GB in storage, for free, with rapid distribution/CDN, and that allows any one of us to easily authenticate from around the world.
Does cloudinary offer this? Why use it instead of other options? I'm always a bit weary of asking everyone to sign on / register for yet another app/service/solution. A cloud bucket could also serve the same purpose, for example.

cloud bucket could also serve the same purpose, for example.

I mean, I've got a 20GB IBM Cloud bucket on a free plan. I could set up some API keys for y'all and whatnot, but just too much of a hassle I think. Open to discussion though.

Another thing to think about: how are we going to accept contributions by other members of the community? We won't be giving out keys/passwords to literally anyone, so we will have to do something like this:

ask them to upload their example gif somewhere (say imgur)
open a PR containing their example code, documentation, and a link to imgur
and then one of us is going to have to take the file from imgur and then put it in YT/GH/cloud/bucket/etc

Sounds like a hassle to me

At this point, I say we keep everything in imgur.

This means we don't need to care about authentication/passwords/keys
imgur is specialized in serving images and I've never ever heard it being down
imgur supports both mp4 and gif
imgur maximum file size for animated images is 200MB
the only limit I can find is 60 seconds in length, which sounds fine to me since we are talking about an examples gallery

Additionally, we should also keep a file in the documentation that is a manually-curated list to each example URL. A simple csv will do:
name,path,url
example1,examples/example1.rst,https://imgur.com/some_url_here
example2,examples/example2.rst,https://imgur.com/some_url_here
example3,examples/example3.rst,https://imgur.com/some_url_here

So whenever anyone (devs or users) contributes or adds a new example, they have to provide the example, the page in the documentation where it is linked to, as well as the imgur URL. (This list could also be generated automatically, even.)
Thoughts?

If not GitHub repo, if we use cloudinary or any storage bucket, what can be done is set up a GitHub Action which check for images(The contributor should be using Imgur or something similar) in documentation and upload to cloudinary/bucket and then asks the user to replace the existing images with those. Maybe, if that is hard, we can maintain a CSV file with images as mentioned above above and ask the contributors to edit that for images to be uploaded and we can use it to upload( Note: it should be done once docs are merged before deploying). Also what do other opensource do for this?

Maybe, if that is hard

I don't think it's hard, it's just a bunch of extra steps for the contributor. It may discourage contributions. We want to make contributing as easy as possible, especially because manim tends to attract users that are more experienced in math than in programming.

Also what do other opensource do for this?

No idea. What other movie/animation-heavy software do we know of?

Also readthedocs themselves doesn't host images?

Everything RTD does is pull a GH repo and build/host the documentation. So that would require us to keep everything under version control which is what we are trying to avoid.

It may discourage contributions

There I am total with you!
Once there was a really cool project from flipdot to collect manim examples:
https://manim.flipdot.org/
But there, the contribution was also very difficult, so it did not grow a lot.

Maybe, if that is hard, we can maintain a CSV file with images

I would try to keep things as simple as possible with images.
And when it comes to structuring, in my opinion, git is the best option.
Also, we could think of a script that searches for manim code in markdown files, puts them somewhere, and then inserts them at the right place on the website (Like #285). I could ask the https://manim.flipdot.org/ people, maybe they have an idea for us.
Or we ask the github-employes, there is some information about storage and a contact form linked here: https://docs.github.com/en/github/managing-large-files/about-storage-and-bandwidth-usage Maybe they like our project and give us resources to something we might be able to use for this purpose.

And when it comes to structuring, in my opinion, git is the best option.

Also, we could think of a script that searches for manim code in markdown files, puts them somewhere, and then inserts them at the right place on the website (Like #285).

This discussion is about where to store the image files, not how to produce them or include them in the documentation. The main point here is that git will become bloated really quickly.

This discussion is about where to store the image files, not how to produce them or include them in the documentation

I think automated creation is very related to the contribution of scripts, which was also appealed to this issue. But we can shift this to a sperate issue.

The main point here is that git will become bloated really quickly.

There are tools to delete large but deleted files, that are still sleeping in the repo.
One of these tools is the bfg-repo-cleaner.
When we run it from time to time, there are only the actual video files.
For testing if a repo can contain more then a few videos, I just uploaded 864 videos, each ~2MB to this repo
https://github.com/ManimCommunity/manim-docs-files/tree/master/Lots_of_videos,
and there was no complain from github. Here, they all have the same content but only different names, so git might compress them very efficiently. So  I could also do this test again, but with video files that differ in content.

Yes, git can be made leaner using tools like the one you mentioned. However, what would be the workflow for someone trying to contribute a new example?

They have to clone two repositories, this one to write the documentation, and the other one to push the files
They have to make two different PRs, probably at the same time, unless we want to allow arbitrary pushes to the manim-docs-files repo.
Even if the above two points were somehow automatable using Actions or some other solution, we would still be asking each contributor to download the full repo of examples just so they can add a new one. So we might well be asking them to download 1GB (or more) of gifs, so they can push a 3s video.

I'm not loving this workflow.

Isn't this the exact use case for gDrive/Dropbox? We can just create one of those with shared access.
P.S. Sorry I've been slow lately, work has been hectic

Isn't this the exact use case for gDrive/Dropbox? We can just create one of those with shared access.

Not really gDrive, since the point was made above that it's a major hassle to access the same account from different places in the world. Dropbox maybe?

If you're referring to https://github.com/ManimCommunity/manim/issues/308#issuecomment-674977975, the method of sharing described there is antipattern and the same thing would probably happen with dropbox.
The way to share files is to create the shared directory and configure it so that people with different accounts can access it, not share a single account between multiple people.

Oh snap you've solved it

Question: Does gDrive and Dropbox support embedding? I don't think so. If we were to use gDrive space then we may need to use blogger which also is hassle as it is not possible for shared account.

According to this random article it seems possible.

That's ok for video's what about a gif or image?

It does seem to be possible, given the instructions here. It's not as simple as the video embedding though.

For gifs and images:
It would be cool if they can be accessed by an URL that looks just like the folder structure. Then we could use markdown and insert the images there.
I just tried it with the owncloud:

Only problem: the owncloud has links like :lNiKxHTlL5xTiDz

It would be cool if they can be accessed by an URL that looks just like the folder structure.

Only possible if we something like GitHub with jsdelivr.
See the link below of what you uploaded in other repo.
<EMAIL_ADDRESS>

It would be cool if they can be accessed by an URL that looks just like the folder structure

Cool, yes, but not necessary.

Then we could use markdown and insert the images there.

You can use markdown to insert any image, regardless of whether or not "the URL looks just like the folder structure".

So it seems like the easiest option is to get a folder on gDrive or Dropbox and give read/write permissions to each dev. No password sharing necessary. Are people ok with this?

I just got an answer:

The /gh/ endpoint has a limit of 20 MB per file and raising that one is not a very good idea. I think a custom proxy endpoint would be a better fit here:

The files can be hosted either on GitHub or any other location available over HTTP.
jsDelivr retrieves files on demand from the configured location, and caches them for the configured time.
There are no limits on the number of hosted files or the size of individual files (ideally within 100 MB per file though).
Let us know if this would work for you.

Great to know that they responded.

The files can be hosted either on GitHub or any other location available over HTTP.

Maybe gDrive? Or any cloud bucket which offers for free. @Aathish04 said he had one.

(ideally within 100 MB per file though).

We can do that. That is easy I think.
@kolibril13 I think you would need to email him again saying about that because custom proxy endpoint can one be set up by them and not ourselves. Also need other opinions about this. Maybe @eulertour and @leotrs

This is a very encouraging answer indeed! So all we have to decide is where to host the files. The 100MB limit should be easy to respect, but let's document that somewhere in the docs to be sure.
I vote we use gDrive.
Thanks @kolibril13 for emailing them!

What we are gonna do on this? I have an idea. We can use storage bucket from https://www.ibm.com/cloud/free and then configure it with jsdelivr.
If need to consider something else. Maybe let's look into https://free-for.dev/ to check whether anything is available for free.