Problem with golang package hashes

Hi,
On every CF deployment I get a hash mismatch with some of the Golang packages.  If I upload the cf-release a second time, the hash mismatch goes away.
The error I receive is:
Task 53 | 09:51:55 | Compiling packages: golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904 (00:02:08)
                   L Error: Action Failed get_task: Task 4c3277e8-4378-48e1-4cf4-cc352d367ca8 result: Compiling package golang: Fetching package golang: Fetching package blob a09deaac-8473-480f-8def-18eea047c31e: Getting blob from inner blobstore: Checking downloaded blob 'a09deaac-8473-480f-8def-18eea047c31e': Expected stream to have digest 'sha256:bbe2a2a729194e0e05a4bc717af4cb15d1d2864a199e76920a0bda915663e930' but was 'sha256:d8f303ce0f25cf1edf53a4dca2a44a324fb3c9f29666863e973c9762bfacb8b6'
Task 53 | 09:51:59 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:02:12)
                   L Error: Action Failed get_task: Task 672520d2-21f0-4ed9-6afa-1a599a694116 result: Compiling package golang-1.8: Fetching package golang-1.8: Fetching package blob 73fcb11b-892b-48e3-ab92-92d490659df9: Getting blob from inner blobstore: Checking downloaded blob '73fcb11b-892b-48e3-ab92-92d490659df9': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
Task 53 | 09:53:16 | Error: Action Failed get_task: Task 4c3277e8-4378-48e1-4cf4-cc352d367ca8 result: Compiling package golang: Fetching package golang: Fetching package blob a09deaac-8473-480f-8def-18eea047c31e: Getting blob from inner blobstore: Checking downloaded blob 'a09deaac-8473-480f-8def-18eea047c31e': Expected stream to have digest 'sha256:bbe2a2a729194e0e05a4bc717af4cb15d1d2864a199e76920a0bda915663e930' but was 'sha256:d8f303ce0f25cf1edf53a4dca2a44a324fb3c9f29666863e973c9762bfacb8b6'

I have been getting error for a few months, or more.  I get this even on the latest cf-release (273).
What can be done to resolve this issue as its preventing my CI/CD pipeline for deploying/testing CF.
Thanks
Rob

Hey @rerooted. How are you uploading the release -- are you uploading using a bosh.io url, creating the release locally, etc? Is there a difference between how you upload the release the first or second time (by hand vs. in CI, different machines, etc.)?
Also, which version of cf-release started causing this issue for your deployment?
One of the odd things about the error message you showed is that the failures have to do with compiling two packages, one called golang and the other golang-1.8. Neither of the packages are present in cf-release currently: if you look at the package definitions in CF 273 there packages called golang1.8 (no dash) and golang1.8.3. Does your repo have local changes?

I'm uploading using a bosh.io URL: https://bosh.io/d/github.com/cloudfoundry/cf-release.  Everything is scripted, so the upload is the same both times, from the same environment/machine.
I don't remember what version it was, but 'may' have been around March-ish this year, it was definitely before May.
I am using the bosh.io URL, so there are no local changes.  One of the packages within cf-release brings in the various golang packages (golang, golang-1.8 & golang-1.8.3)
$ bosh releases

Name                  Version   Commit Hash
cf                    273*      e4d5f0e6+
cf-rabbitmq           226.0.0*  d6d9ba21+
cf-smoke-tests        39*       93d63e5
cflinuxfs2            1.155.0*  39848e41+
diego                 1.26.0*   323e91f
garden-runc           1.9.3*    55956f4
(*) Currently deployed
(+) Uncommitted changes

6 releases

Succeeded

$ bosh inspect-release cf/273
[snip]
Package                                                                 Compiled for  Blobstore ID                          Digest
[snip]
go-buildpack/d0b470c38416e5b426b957c4ef3320f02328fb3d                   (source)      9d413429-f748-4fa5-8bd7-1b0c6e0c5147  2c8d7ca4f7942ae36386110c467d74ac4f2b5a87
golang1.8-windows/abdc6d184faaa907278235ee0e257b8740f85b97              (source)      873c09ad-0000-4230-9d4d-d2404cffac38  4365206f10e198a91d00ab3dc88c242dd0500bf7
golang1.8.3-windows/ede2ab5e3b1c219d920c83d9fade29a31d8942d1            (source)      6a293bdb-7c66-49f6-be45-db34af930d03  e34f933b11c057ae0ec64e8a9e421b71aac20189
golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4                    (source)      16a4a3e1-4d5c-49ec-b110-d3ebbe0dbcc2  843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3
golang1.8/63a243be32451af083a062ba2c929c3f2b34f132                      (source)      b98657d9-0b07-4f80-94ce-16734a00e9e1  dac8587b4ce06a0f647f0061984d308349af9d08
[snip]

Current failure output, I've picked out all of the Golang bits
Task 19 | 10:07:06 | Preparing deployment: Preparing deployment (00:00:01)
[snip]
Task 19 | 10:07:24 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132
[snip]
Task 19 | 10:10:44 | Compiling packages: go-buildpack/d0b470c38416e5b426b957c4ef3320f02328fb3d
[snip]
Task 19 | 10:11:36 | Compiling packages: golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0
[snip]
Task 19 | 10:11:43 | Compiling packages: go-buildpack/d0b470c38416e5b426b957c4ef3320f02328fb3d (00:00:59)
Task 19 | 10:11:43 | Compiling packages: golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904
[snip]
Task 19 | 10:12:10 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132
[snip]
                   L Error: Action Failed get_task: Task 8ac10612-65bf-4f43-7ccd-8ed8aa60b6ea result: Compiling package golang-1.8: Fetching package golang-1.8: Fetching package blob cc39204e-a3b5-459a-a7bc-6cfbf1fcddc3: Getting blob from inner blobstore: Checking downloaded blob 'cc39204e-a3b5-459a-a7bc-6cfbf1fcddc3': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
[snip]
Task 19 | 10:12:45 | Compiling packages: golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0 (00:01:09)
Task 19 | 10:12:46 | Compiling packages: golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904 (00:01:03)
[snip]
Task 19 | 10:13:12 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:01:02)
                   L Error: Action Failed get_task: Task 2d5b568a-8f4c-45fa-4cf9-ca6f201d4cd2 result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob b98657d9-0b07-4f80-94ce-16734a00e9e1: Getting blob from inner blobstore: Checking downloaded blob 'b98657d9-0b07-4f80-94ce-16734a00e9e1': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
[snip]
Task 19 | 10:17:11 | Error: Action Failed get_task: Task 8ac10612-65bf-4f43-7ccd-8ed8aa60b6ea result: Compiling package golang-1.8: Fetching package golang-1.8: Fetching package blob cc39204e-a3b5-459a-a7bc-6cfbf1fcddc3: Getting blob from inner blobstore: Checking downloaded blob 'cc39204e-a3b5-459a-a7bc-6cfbf1fcddc3': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
[snip]

These other releases have Golang packages:
$ bosh inspect-release diego/1.26.0 | grep golang
golang-windows/b336b2341205cb209c29c1523e04e784332aee8a2f4918929810e97a527e35b1         	(source)            	01cd4a33-3bf8-4881-89ef-23bd7ddbf842	sha256:ef6c7bd2e131329459bcea2c0dbd599fdfdc856917b6b0674aa0cda06cab1aac
golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904                 	(source)            	0496b891-6a31-48f4-b2e2-758c67db9537	sha256:bbe2a2a729194e0e05a4bc717af4cb15d1d2864a199e76920a0bda915663e930
golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904                 	ubuntu-trusty/3445.7	85fff552-78f7-4e87-5291-0337618ddc4c	sha256:06acc3ddaf1721e4b49d66bc93420ec3c702980cd244235b181111e00c60532c

$ bosh inspect-release cf-rabbitmq/226.0.0 | grep golang
golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132                     	(source)            	cc39204e-a3b5-459a-a7bc-6cfbf1fcddc3	dac8587b4ce06a0f647f0061984d308349af9d08

$ bosh inspect-release garden-runc/1.9.3 | grep golang
golang-windows/2e793bd719d5c6070219cdaa00892ef5c669e1bfe2e3731150f87870d4972e56  	(source)            	7364ac87-ec26-4614-886b-e96d66a6c213	sha256:f5cfe832dc6c10f1aeb7353b39b2b6154302500b4d00e1f77750e61a65395b66
golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0          	ubuntu-trusty/3445.7	85a33cd2-6a34-4f83-71c3-20a6293759ce	sha256:d8b605483e9fe2f7c865baa3c4a9ee866836f8e8fba77c13610fb3f7f4e92f85
golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0          	(source)            	8953779e-809e-4913-a591-8e33c07693bd	sha256:53f4b3d83516aef5054fe0fa158b26aee71339e2fd18463e12fee6fb00ffb778

I'll keep this failed CF deployment as it is in case we can debug anything.  I'll stand up another CF deployment and then re-upload the releases, I'll then repost the output of inspect-release.

Apologies for the verbosity of this, but it shows the output of a successful CF deployment:
After repeated re-runs of 'bosh deploy' without uploading the releases again:
Task 45 | 12:35:39 | Preparing deployment: Preparing deployment (00:00:01)
Task 45 | 12:35:50 | Preparing package compilation: Finding packages to compile (00:00:02)
Task 45 | 12:35:52 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132
Task 45 | 12:35:52 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132
Task 45 | 12:35:52 | Compiling packages: golang1.8/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4
Task 45 | 12:35:52 | Compiling packages: golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4
Task 45 | 12:35:52 | Compiling packages: cli/6e22370bfb380059b856a1b397bc14ae9ec1633c
Task 45 | 12:38:05 | Compiling packages: golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 (00:02:13)
                   L Error: Action Failed get_task: Task 7bb9b5e2-5998-48f2-770a-50e3a7d40380 result: Compiling package golang1.8.3: Fetching package golang1.8.3: Fetching package blob 2fb31da8-6524-44da-be3d-e9cc93e19be4: Getting blob from inner blobstore: Checking downloaded blob '2fb31da8-6524-44da-be3d-e9cc93e19be4': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'
Task 45 | 12:38:14 | Compiling packages: cli/6e22370bfb380059b856a1b397bc14ae9ec1633c (00:02:22)
                   L Error: Action Failed get_task: Task 3f0f1c7b-74e7-4149-6061-c474979347a1 result: Compiling package cli: Fetching package cli: Fetching package blob d242b7bb-6a76-4bb6-9c66-9bbbbd2f2587: Getting blob from inner blobstore: Checking downloaded blob 'd242b7bb-6a76-4bb6-9c66-9bbbbd2f2587': Expected stream to have digest '5ce085c3f161bf0ba61def34f5e94c085c7f42c2' but was 'a1d7bced521d88217c6adc8391b86f891c1fafaf'
Task 45 | 12:38:15 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:02:23)
                   L Error: Action Failed get_task: Task 2013ac03-7b78-490f-6d13-41669a0db046 result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob e787ac51-040e-44b7-b5e7-94f8b7664139: Getting blob from inner blobstore: Checking downloaded blob 'e787ac51-040e-44b7-b5e7-94f8b7664139': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
Task 45 | 12:38:49 | Compiling packages: golang1.8/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 (00:02:57)
                   L Error: Action Failed get_task: Task 403d1110-2800-4673-51e0-ba82b5b9ecc3 result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob 1dd5acc8-7e76-4957-a254-92429fd40a6a: Getting blob from inner blobstore: Checking downloaded blob '1dd5acc8-7e76-4957-a254-92429fd40a6a': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'
Task 45 | 12:38:56 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:03:04)
                   L Error: Action Failed get_task: Task 7fd843b0-631a-4103-79db-9bd8364092a2 result: Compiling package golang-1.8: Fetching package golang-1.8: Fetching package blob 4ad514c8-63e7-4685-ae61-d88f00525574: Getting blob from inner blobstore: Checking downloaded blob '4ad514c8-63e7-4685-ae61-d88f00525574': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
Task 45 | 12:38:56 | Error: Action Failed get_task: Task 7bb9b5e2-5998-48f2-770a-50e3a7d40380 result: Compiling package golang1.8.3: Fetching package golang1.8.3: Fetching package blob 2fb31da8-6524-44da-be3d-e9cc93e19be4: Getting blob from inner blobstore: Checking downloaded blob '2fb31da8-6524-44da-be3d-e9cc93e19be4': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'

(it seems there is another package that is having issues: cli)
After re-uploading the releases again the packages all successfully compiled.  The output of 'bosh inspect-release' for each of the releases is below:
$ bosh releases
Name                  Version   Commit Hash
cf                    273*      e4d5f0e6+
cf-rabbitmq           226.0.0*  d6d9ba21+
cf-smoke-tests        39*       93d63e5
cflinuxfs2            1.155.0*  39848e41+
diego                 1.26.0*   323e91f
garden-runc           1.9.3*    55956f4

(*) Currently deployed
(+) Uncommitted changes

6 releases

Succeeded

$ bosh inspect-release cf/273 | grep golang
golang1.8-windows/abdc6d184faaa907278235ee0e257b8740f85b97              (source)                2c0bb7ef-4223-4920-b96e-705720a5f10c    4365206f10e198a91d00ab3dc88c242dd0500bf7
golang1.8.3-windows/ede2ab5e3b1c219d920c83d9fade29a31d8942d1            (source)                fa785f53-1eb5-4585-a24c-a7dcc09466e3    e34f933b11c057ae0ec64e8a9e421b71aac20189
golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4                    (source)                f5e14b55-ee93-4d53-ad4f-0643e28892a6    843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3
golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4                    ubuntu-trusty/3445.7    9312f58c-64ce-4a53-58eb-bbe65061d1e5    d6187e2e33a53797413ad7dfeca34e611ca2ff9e
golang1.8/63a243be32451af083a062ba2c929c3f2b34f132                      (source)                86004dd0-37e9-427a-9faa-2db70553f6b6    dac8587b4ce06a0f647f0061984d308349af9d08
golang1.8/63a243be32451af083a062ba2c929c3f2b34f132                      ubuntu-trusty/3445.7    bfd96d53-497d-4029-7de8-796cfcbba2a1    5e3f682577e7c7cc9864cfebb47413dd6b331634

$ bosh inspect-release cf-rabbitmq/226.0.0 | grep golang
golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132                             (source)                b469c7a2-5f97-4c44-85ee-6a8a0c8044a3    c25e7406a45fb901a085edc8a7b1769f6fb543dd
golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132                             ubuntu-trusty/3445.7    df97f993-5e38-4b17-607c-d0bafc591d45    a0768eda68dcbf1b4eab959bf09ff03a03b29ceb

$ bosh inspect-release inspect-release diego/1.26.0 | grep golang
golang-windows/b336b2341205cb209c29c1523e04e784332aee8a2f4918929810e97a527e35b1                 (source)                f14d4520-37ab-4d31-adff-d23b5284db06    sha256:ef6c7bd2e131329459bcea2c0dbd599fdfdc856917b6b0674aa0cda06cab1aac
golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904                         (source)                dea4d148-9e49-46cb-80ac-623c6d675887    sha256:bbe2a2a729194e0e05a4bc717af4cb15d1d2864a199e76920a0bda915663e930
golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904                         ubuntu-trusty/3445.7    2781704e-b0e7-41aa-81d7-e0365b672b8e    4e98c23606e9b2660c625d2307c8951b10f7ff41

$ bosh inspect-release inspect-release garden-runc/1.9.3 | grep golang
golang-windows/2e793bd719d5c6070219cdaa00892ef5c669e1bfe2e3731150f87870d4972e56         (source)                40e68f7f-9b9e-4260-9c1b-d752276954a5    sha256:f5cfe832dc6c10f1aeb7353b39b2b6154302500b4d00e1f77750e61a65395b66
golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0                 (source)                af3ce85f-f61e-4cf2-bce3-2f648d2c84e8    sha256:53f4b3d83516aef5054fe0fa158b26aee71339e2fd18463e12fee6fb00ffb778
golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0                 ubuntu-trusty/3445.7    25e50888-2264-4122-9d0b-b0f180363e4b    7b8469385620b599752046ad10e295f56d472fd1

hmm if you are seeing that it succeeds eventually that strongly points at your blobstore. what is it (provider and any interesting configurations)?
Sent from my iPhone

On Sep 19, 2017, at 7:08 AM, Robert Kent<EMAIL_ADDRESS>wrote:
Apologies for the verbosity of this, but it shows the output of a successful CF deployment:
After repeated re-runs of 'bosh deploy' without uploading the releases again:
Task 45 | 12:35:39 | Preparing deployment: Preparing deployment (00:00:01)
Task 45 | 12:35:50 | Preparing package compilation: Finding packages to compile (00:00:02)
Task 45 | 12:35:52 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132
Task 45 | 12:35:52 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132
Task 45 | 12:35:52 | Compiling packages: golang1.8/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4
Task 45 | 12:35:52 | Compiling packages: golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4
Task 45 | 12:35:52 | Compiling packages: cli/6e22370bfb380059b856a1b397bc14ae9ec1633c
Task 45 | 12:38:05 | Compiling packages: golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 (00:02:13)
L Error: Action Failed get_task: Task 7bb9b5e2-5998-48f2-770a-50e3a7d40380 result: Compiling package golang1.8.3: Fetching package golang1.8.3: Fetching package blob 2fb31da8-6524-44da-be3d-e9cc93e19be4: Getting blob from inner blobstore: Checking downloaded blob '2fb31da8-6524-44da-be3d-e9cc93e19be4': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'
Task 45 | 12:38:14 | Compiling packages: cli/6e22370bfb380059b856a1b397bc14ae9ec1633c (00:02:22)
L Error: Action Failed get_task: Task 3f0f1c7b-74e7-4149-6061-c474979347a1 result: Compiling package cli: Fetching package cli: Fetching package blob d242b7bb-6a76-4bb6-9c66-9bbbbd2f2587: Getting blob from inner blobstore: Checking downloaded blob 'd242b7bb-6a76-4bb6-9c66-9bbbbd2f2587': Expected stream to have digest '5ce085c3f161bf0ba61def34f5e94c085c7f42c2' but was 'a1d7bced521d88217c6adc8391b86f891c1fafaf'
Task 45 | 12:38:15 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:02:23)
L Error: Action Failed get_task: Task 2013ac03-7b78-490f-6d13-41669a0db046 result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob e787ac51-040e-44b7-b5e7-94f8b7664139: Getting blob from inner blobstore: Checking downloaded blob 'e787ac51-040e-44b7-b5e7-94f8b7664139': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
Task 45 | 12:38:49 | Compiling packages: golang1.8/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 (00:02:57)
L Error: Action Failed get_task: Task 403d1110-2800-4673-51e0-ba82b5b9ecc3 result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob 1dd5acc8-7e76-4957-a254-92429fd40a6a: Getting blob from inner blobstore: Checking downloaded blob '1dd5acc8-7e76-4957-a254-92429fd40a6a': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'
Task 45 | 12:38:56 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:03:04)
L Error: Action Failed get_task: Task 7fd843b0-631a-4103-79db-9bd8364092a2 result: Compiling package golang-1.8: Fetching package golang-1.8: Fetching package blob 4ad514c8-63e7-4685-ae61-d88f00525574: Getting blob from inner blobstore: Checking downloaded blob '4ad514c8-63e7-4685-ae61-d88f00525574': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
Task 45 | 12:38:56 | Error: Action Failed get_task: Task 7bb9b5e2-5998-48f2-770a-50e3a7d40380 result: Compiling package golang1.8.3: Fetching package golang1.8.3: Fetching package blob 2fb31da8-6524-44da-be3d-e9cc93e19be4: Getting blob from inner blobstore: Checking downloaded blob '2fb31da8-6524-44da-be3d-e9cc93e19be4': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'
(it seems there is another package that is having issues: cli)
After re-uploading the releases again the packages all successfully compiled. The output of 'bosh inspect-release' for each of the releases is below:
$ bosh releases
Name                  Version   Commit Hash
cf                    273*      e4d5f0e6+
cf-rabbitmq           226.0.0*  d6d9ba21+
cf-smoke-tests        39*       93d63e5
cflinuxfs2            1.155.0*  39848e41+
diego                 1.26.0*   323e91f
garden-runc           1.9.3*    55956f4
(*) Currently deployed
(+) Uncommitted changes
6 releases
Succeeded
$ bosh inspect-release cf/273 | grep golang
golang1.8-windows/abdc6d184faaa907278235ee0e257b8740f85b97              (source)                2c0bb7ef-4223-4920-b96e-705720a5f10c    4365206f10e198a91d00ab3dc88c242dd0500bf7
golang1.8.3-windows/ede2ab5e3b1c219d920c83d9fade29a31d8942d1            (source)                fa785f53-1eb5-4585-a24c-a7dcc09466e3    e34f933b11c057ae0ec64e8a9e421b71aac20189
golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4                    (source)                f5e14b55-ee93-4d53-ad4f-0643e28892a6    843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3
golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4                    ubuntu-trusty/3445.7    9312f58c-64ce-4a53-58eb-bbe65061d1e5    d6187e2e33a53797413ad7dfeca34e611ca2ff9e
golang1.8/63a243be32451af083a062ba2c929c3f2b34f132                      (source)                86004dd0-37e9-427a-9faa-2db70553f6b6    dac8587b4ce06a0f647f0061984d308349af9d08
golang1.8/63a243be32451af083a062ba2c929c3f2b34f132                      ubuntu-trusty/3445.7    bfd96d53-497d-4029-7de8-796cfcbba2a1    5e3f682577e7c7cc9864cfebb47413dd6b331634
$ bosh inspect-release cf-rabbitmq/226.0.0 | grep golang
golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132                             (source)                b469c7a2-5f97-4c44-85ee-6a8a0c8044a3    c25e7406a45fb901a085edc8a7b1769f6fb543dd
golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132                             ubuntu-trusty/3445.7    df97f993-5e38-4b17-607c-d0bafc591d45    a0768eda68dcbf1b4eab959bf09ff03a03b29ceb
$ bosh inspect-release inspect-release diego/1.26.0 | grep golang
golang-windows/b336b2341205cb209c29c1523e04e784332aee8a2f4918929810e97a527e35b1                 (source)                f14d4520-37ab-4d31-adff-d23b5284db06    sha256:ef6c7bd2e131329459bcea2c0dbd599fdfdc856917b6b0674aa0cda06cab1aac
golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904                         (source)                dea4d148-9e49-46cb-80ac-623c6d675887    sha256:bbe2a2a729194e0e05a4bc717af4cb15d1d2864a199e76920a0bda915663e930
golang/81204f38eebc29dbd249b8c27638f4de9331a3e263763b2b276f20cd22517904                         ubuntu-trusty/3445.7    2781704e-b0e7-41aa-81d7-e0365b672b8e    4e98c23606e9b2660c625d2307c8951b10f7ff41
$ bosh inspect-release inspect-release garden-runc/1.9.3 | grep golang
golang-windows/2e793bd719d5c6070219cdaa00892ef5c669e1bfe2e3731150f87870d4972e56         (source)                40e68f7f-9b9e-4260-9c1b-d752276954a5    sha256:f5cfe832dc6c10f1aeb7353b39b2b6154302500b4d00e1f77750e61a65395b66
golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0                 (source)                af3ce85f-f61e-4cf2-bce3-2f648d2c84e8    sha256:53f4b3d83516aef5054fe0fa158b26aee71339e2fd18463e12fee6fb00ffb778
golang/d0d1b2a5863243f82a949288cef9a3d5fc9d000e9be2904aea6d04650a0149b0                 ubuntu-trusty/3445.7    25e50888-2264-4122-9d0b-b0f180363e4b    7b8469385620b599752046ad10e295f56d472fd1
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

I'm using S3 as my blobstore provider , completely standard.  The S3 buckets are built using Cloudformation and I'm using AWS instance profiles to grant access.

@cppforlife There's some weird stuff going on here. Two packages -- golang1.8 and golang-1.8 -- are expecting to have the same digest dac8587b4ce06a0f647f0061984d308349af9d08, but get c25e7406a45fb901a085edc8a7b1769f6fb543dd and fail:
Task 45 | 12:38:15 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:02:23)
                   L Error: ... Compiling package golang1.8: ... Checking downloaded blob 'e787ac51-040e-44b7-b5e7-94f8b7664139': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
Task 45 | 12:38:56 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:03:04)
                   L Error: ... Compiling package golang-1.8:  ... Checking downloaded blob '4ad514c8-63e7-4685-ae61-d88f00525574': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'

cf-release does in fact have such a package:
https://github.com/cloudfoundry/cf-release/blob/v273/.final_builds/packages/golang1.8/index.yml#L5
cf-rabbitmq does not have a package with that digest:
https://github.com/pivotal-cf/cf-rabbitmq-release/blob/v226.0.0/.final_builds/packages/golang-1.8/index.yml#L5
Why would the director expect them both to have that digest?

@rerooted when you say

After re-uploading the releases again the packages all successfully compiled.

do you mean you've used --fix with upload release?

Yes, after uploading with --fix things work.

Could the cause be similar to this issue https://github.com/cloudfoundry/nfs-volume-release/issues/5?

@rerooted which director version are you using? given that those two packages are named differently, i dont think it's package reuse. does this happen for any other package? can you provide releases section of the manifest that you are trying to deploy?

@cppforlife I am using the latest versions, with the exception of the RabbitMQ release.  My last, failed, deployment used:
CF_VERSION="275"
DIEGO_VERSION="1.26.1"
GARDEN_RUNC_VERSION="1.9.3"
CFLINUXFS2_VERSION="1.156.0"
CF_RABBITMQ_VERSION="226.0.0"
CF_SMOKE_TEST_VERSION="39"

My releases section from my manifest:
releases:
- {name: cf, version: latest}
- {name: cflinuxfs2, version: latest}
- {name: cf-rabbitmq, version: latest}
- {name: cf-smoke-tests, version: latest}
- {name: diego, version: latest}
- {name: garden-runc, version: latest}
- {name: postgresql-databases, version: latest}

I upload directly using bosh upload-release or bosh upload-stemcell.  The URLs I use are:
https://bosh.io/d/stemcells/bosh-aws-xen-hvm-ubuntu-trusty-go_agent
https://bosh.io/d/github.com/cloudfoundry/cf-release
https://bosh.io/d/github.com/cloudfoundry/diego-release
https://bosh.io/d/github.com/cloudfoundry/garden-runc-release
https://bosh.io/d/github.com/cloudfoundry/cflinuxfs2-release
https://bosh.io/d/github.com/pivotal-cf/cf-rabbitmq-release=v226.0.0
https://bosh.io/d/github.com/cloudfoundry/cf-smoke-tests-release
If I keep re-starting the deployment I eventually get only Golang failing and the 'cli' app.
I can reliably repeat the issue.  I have a fully automated pipeline that builds an AWS setup via Cloudformation.  The outputs from that are then fed into variables, that then get sucked in during the Bosh deployment process.  I first do bosh create-env followed a two stage bosh deploy, first stage creates the RDS databases, via two errands, and then the second stage creates the actual deployment.
I can add links to the Github repos that perform all of this if you are interested.

which director version are you using

to get the director version, please run bosh -e foo env.
On Thu, Sep 28, 2017 at 3:57 AM, Robert Kent<EMAIL_ADDRESS>wrote:

@cppforlife https://github.com/cppforlife I am using the latest
versions, with the exception of the RabbitMQ release. My last, failed,
deployment used:
CF_VERSION="275"
DIEGO_VERSION="1.26.1"
GARDEN_RUNC_VERSION="1.9.3"
CFLINUXFS2_VERSION="1.156.0"
CF_RABBITMQ_VERSION="226.0.0"
CF_SMOKE_TEST_VERSION="39"
My releases section from my manifest:
releases:

{name: cf, version: latest}
{name: cflinuxfs2, version: latest}
{name: cf-rabbitmq, version: latest}
{name: cf-smoke-tests, version: latest}
{name: diego, version: latest}
{name: garden-runc, version: latest}
{name: postgresql-databases, version: latest}

I upload directly using bosh upload-release or bosh upload-stemcell. The
URLs I use are:
https://bosh.io/d/stemcells/bosh-aws-xen-hvm-ubuntu-trusty-go_agent
https://bosh.io/d/github.com/cloudfoundry/cf-release
https://bosh.io/d/github.com/cloudfoundry/diego-release
https://bosh.io/d/github.com/cloudfoundry/garden-runc-release
https://bosh.io/d/github.com/cloudfoundry/cflinuxfs2-release
https://bosh.io/d/github.com/pivotal-cf/cf-rabbitmq-release=v226.0.0
https://bosh.io/d/github.com/cloudfoundry/cf-smoke-tests-release
If I keep re-starting the deployment I eventually get only Golang failing
and the 'cli' app.
I can reliably repeat the issue. I have a fully automated pipeline that
builds an AWS setup via Cloudformation. The outputs from that are then fed
into variables, that then get sucked in during the Bosh deployment process.
I first do bosh create-env followed a two stage bosh deploy, first stage
creates the RDS databases, via two errands, and then the second stage
creates the actual deployment.
I can add links to the Github repos that perform all of this if you are
interested.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/cloudfoundry/cf-release/issues/1239#issuecomment-332801795,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AALV9xRZs2vfM2aAYa4PBZ4m6gUh8fT3ks5sm3uVgaJpZM4PXgos
.

Bosh env output:
Name      oranges
UUID      1bcf4464-6c4c-4efb-9337-e80a74b23516
Version   263.2.0 (00000000)
CPI       aws_cpi
Features  compiled_package_cache: enabled
          config_server: disabled
          dns: disabled
          snapshots: enabled
User      director

Digging into things a little.  It seems when compiling golang-1.8 and golang1.8 they both pull in the golang-1.8 blob from cf-rabbitmq/226.0.0, but they use the hash from the golang1.8 package from cf/275.
The golang1.8 package compilation failure at 13:16:51 appears to come from the compilation using the golang-1.8.3 blob from cf/275
Task 43 | 13:16:45 | Compiling packages: golang1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:02:22)
                   L Error: Action Failed get_task: Task 1c83c2c2-1095-4c0a-6a25-f0cda269416a result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob 27576bb5-6d39-4ad2-9551-e0b86fe74d21: Getting blob from inner blobstore: Checking downloaded blob '27576bb5-6d39-4ad2-9551-e0b86fe74d21': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
[snip]
Task 43 | 13:16:50 | Compiling packages: golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132 (00:02:27)
                   L Error: Action Failed get_task: Task 2fbb23c3-35c4-4a8d-654c-b88bc44a9221 result: Compiling package golang-1.8: Fetching package golang-1.8: Fetching package blob a886694a-cfcd-4999-a13e-1518f8638060: Getting blob from inner blobstore: Checking downloaded blob 'a886694a-cfcd-4999-a13e-1518f8638060': Expected stream to have digest 'dac8587b4ce06a0f647f0061984d308349af9d08' but was 'c25e7406a45fb901a085edc8a7b1769f6fb543dd'
[snip]
Task 43 | 13:16:51 | Compiling packages: golang1.8/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 (00:02:28)
                   L Error: Action Failed get_task: Task 8a74b1bf-11bb-4dc2-69a8-70c2395f7677 result: Compiling package golang1.8: Fetching package golang1.8: Fetching package blob 6663d4e5-eb55-41ef-92a8-6a0fc922513e: Getting blob from inner blobstore: Checking downloaded blob '6663d4e5-eb55-41ef-92a8-6a0fc922513e': Expected stream to have digest '843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3' but was 'd6a17f16543293855a88e014fbd29adb81fb9758'
[snip]

$ bosh inspect-release cf/275 | grep -E 'golang-?1.8(.3)?/'
golang1.8.3/6b1bfba0bc0455c57678161490ce4fa4fd5f70f4                  	(source)             	60588001-bfe1-4b12-acb2-ad03b3a69ecf	843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3
golang1.8/63a243be32451af083a062ba2c929c3f2b34f132                    	(source)             	f9f5a023-04ec-4e07-b8d4-b7af4a54abaa	dac8587b4ce06a0f647f0061984d308349af9d08

$ bosh inspect-release cf-rabbitmq/226.0.0 | grep -E 'golang-?1.8(.3)?/'
golang-1.8/63a243be32451af083a062ba2c929c3f2b34f132                     	(source)             	1590bdb0-5b9c-4b4b-bb0d-96c64b0ddd5b	c25e7406a45fb901a085edc8a7b1769f6fb543dd

Digging into the database shows that the fingerprints & versions are the same for cf golang1.8 and the cf-rabbitmq golang-1.8.  The cf-smoke-tests golang1.8 fingerprint & version matches the cf golang-1.8'
bosh=# SELECT packages.name,releases.name,version,sha1,fingerprint FROM packages,releases WHERE packages.name IN ('golang1.8','golang-1.8','golang1.8.3') AND release_id = releases.id ORDER BY version;
    name     |      name      |                 version                  |                   sha1                   |               fingerprint
-------------+----------------+------------------------------------------+------------------------------------------+------------------------------------------
 golang1.8   | cf             | 63a243be32451af083a062ba2c929c3f2b34f132 | dac8587b4ce06a0f647f0061984d308349af9d08 | 63a243be32451af083a062ba2c929c3f2b34f132
 golang-1.8  | cf-rabbitmq    | 63a243be32451af083a062ba2c929c3f2b34f132 | c25e7406a45fb901a085edc8a7b1769f6fb543dd | 63a243be32451af083a062ba2c929c3f2b34f132
 golang1.8.3 | cf             | 6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 | 843e58de6b7cb0f52fc8d0c8b30061e7bffff0a3 | 6b1bfba0bc0455c57678161490ce4fa4fd5f70f4
 golang1.8   | cf-smoke-tests | 6b1bfba0bc0455c57678161490ce4fa4fd5f70f4 | d6a17f16543293855a88e014fbd29adb81fb9758 | 6b1bfba0bc0455c57678161490ce4fa4fd5f70f4
(4 rows)

I also get the same problem if I have the release URLs in the manifest and Bosh/Director uploads the releases.


kak-desktop: Is this the only way to check if we are inside a terminal?

After I suggested (I apologize for caussing this issue) kak-desktop should open the file passed in the terminal if it is run from there, the following lines where added to kak-desktop:
elif test -t 1; then
  kak "$@"

I wonder if there's a better way to check if kak-desktop is being run inside a terminal than to check the output file descriptor. The reason is, if I spawn dolphin using sxhkd its output is linked to tty1, which also happens to the spawned kak-desktop process when I try to open a file. As a result, the file is not opened in a new terminal emulator. I know this can be fixed starting dolphin as dolphin >/dev/null,  but perhaps there's a different way to check whether the process indeed has access to a virtual terminal displayed to the user.

I’m not sure if there is another way.  If you find a better handling, I will happily merge.

I’m not sure if there is another way. If you find a better handling, I will happily merge.

I only know that STDIN is not matched to a terminal in my particular case, so checking with test -t 0 would suffice. Instead of replacing a test with the other one, I suggest including both, which, even though it doesn't quite solve the problem, I believe will be more robust. What do you think?


Schlage lock management; slots disappear from UI and unclear whether usercode exists

I'm using zwave-js-ui version:
zwave-js-ui: 9.16.2
zwave-js: 13.0.2
I'm using Home Assistant 2024.7.4
I have 18 devices and I think a pretty solid zwave network.
The problem devices are Schlage BE469ZP door locks
Occasionally when I try to add a pin code (usercode), whether through the Home Assistant Developer Tools or through the zwave-js-ui user interface, I receive a confirmation that it was added (either green checkmark or dialog box) and then the slot literally disappears from the UI (see attached image for UserID 17). More often than not I think the pin code actually gets entered in the lock but I don't know of a way to confirm.
If I'm missing any information that would help troubleshoot please let me know. And if there is a way to confirm that the pin code is actually in the lock that would be great. I'd prefer to do this programmatically rather than the UI anyway.

Please make a application log, loglevel debug and attach it here as a file (drag & drop into the text field).
Also please attach a node json dump (just click on node Advanced button and then Export JSON with UI format). And also check if there are issues on chrome console.
The logs should contain a try when you set the userCode, does refreshing UI make the userId 17 appear again?


Processing geoJSON power plant list

We want to be able to take a list of power plant locations, stored in a geoJSON FeatureCollection, and convert them into a gridded representation of water usage.  We get the water usage for each plant by multiplying the plant's capacity by an average water usage determined by the plant's type.
The gridded output will be sparse (i.e., most grid cells zero), so it will be useful to have the output in a sparse representation.  I'm thinking something like
 { "type": "FeatureCollection",
    "features": [
         { "type": "Feature",
        "geometry": {"type" : "Point", "coordinates": [69.113400, 34.563800]},
        "properties": {"water-withdrawal":  0.4, "units": "km^3"}
        },
         { "type": "Feature",
        "geometry": {"type" : "Point", "coordinates": [19.434000, 40.487400]},
        "properties": {"water-withdrawal":  0.25, "units": "km^3"}
        },
    ...
   ]
}

So, the function that does this processing will need to take a list of conversion factors and a dictionary of water usage factors for each plant type, and it will return a geoJSON structure (i.e., a python structure that could exported using the json.dump() function) like the one above.
Since we will be using this output in code that may not be entirely capable of processing JSON, we will want to have another function that converts this to a list of tuples:
[(lon, lat, val),
 (lon, lat, val),
 ...
]

We can put these new functions in a module called "geotools" under the "gcam" package.
We will also need a function to write a list of tuples like the one above to a file as a three-column csv.  We can put that one in the gcam.util module.

This sort of capability, and dataset, will also be central to the historical (and even future) emissions gridding routines that we will develop for CEDS.

From: Robert Link<EMAIL_ADDRESS>Sent: Tuesday, September 01, 2015 9:22 AM
To: JGCRI/gcam-driver
Subject: [gcam-driver] Processing geoJSON power plant list (#2)
We want to be able to take a list of power plant locations, stored in a geoJSON FeatureCollection, and convert them into a gridded representation of water usage. We get the water usage for each plant by multiplying the plant's capacity by an average water usage determined by the plant's type.
The gridded output will be sparse (i.e., most grid cells zero), so it will be useful to have the output in a sparse representation. I'm thinking something like
{ "type": "FeatureCollection",
"features": [
{ "type": "Feature",
"geometry": {"type" : "Point", "coordinates": [69.113400, 34.563800]},
"properties": {"water-withdrawal":  0.4, "units": "km^3"}
},
{ "type": "Feature",
"geometry": {"type" : "Point", "coordinates": [19.434000, 40.487400]},
"properties": {"water-withdrawal":  0.25, "units": "km^3"}
},
...
]
}
So, the function that does this processing will need to take a list of conversion factors and a dictionary of water usage factors for each plant type, and it will return a geoJSON structure (i.e., a python structure that could exported using the json.dump() function) like the one above.
Since we will be using this output in code that may not be entirely capable of processing JSON, we will want to have another function that converts this to a list of tuples:
[(lon, lat, val),
(lon, lat, val),
...
]
We can put these new functions in a module called "geotools" under the "gcam" package.
We will also need a function to write a list of tuples like the one above to a file as a three-column csv. We can put that one in the gcam.util module.
—
Reply to this email directly or view it on GitHubhttps://github.com/JGCRI/gcam-driver/issues/2.

Yes, eventually we will want to generalize.  For right now, I'm just going for something that will work for the specific project we're working on, but hopefully it will be a useful building block.
By the way, is everyone who has access to this repository getting notifications about issues here?  I don't want to clutter everyone's inbox with stuff that may not be relevant to them.


move build trigger files to istio

move build trigger files to istio

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: rkpagadala
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

release/OWNERS [rkpagadala]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@rkpagadala: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-pilot-multicluster-e2e.sh
27e34c50bdc2693bac3d1e79f80aebe66eb60833
link
/test istio-pilot-multicluster-e2e

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


Detect CRYPTO

A Bitcoin wallet is a program or software that allows users to send, receive, and securely store Bitcoin. A Bitcoin wallet address is a sequence of case-sensitive alphanumeric characters that allows the validation and tracking of purchases. While the address is not associated with a person directly, the address owner's transaction history and balance is visible on the blockchain. Someone who knows the identity of the wallet owner and the address can gather information on their spending habits and finances. There are services dedicated to the tracking of this information that require only the input of a wallet address. Therefore, the safeguarding and protection of Bitcoin addresses from the public eye is essential to avoid breaches in privacy. The linking of public identities and public Bitcoin wallets must be prevented.
See here for more information about Crypto Wallet Numbers
Will detect a string of 27-62 alphanumeric characters. The string must exclude O, I (capital i), or l (lowercase L). It must start with a 1, 3, or bc1. The double SHA-256 hash of the address bytes must produce a checksum that, when appended to the address, can be encoded back to the original address.
Will use a segwit-compatible address: bc1q42kjb79elem0anu0h9s3h2n586re9jki556pbb

@SyGitGud please add your team name label

I know you said a Bitcoin wallet address is not associated with a person directly so would a person be alright if theirs was exposed in a data leak of some kind?


added MIMO for TransferFunction.zero()

Expanded TransferFunction.zero() to work on MIMO systems.

@DDTantor This PR still has problems and is now the master branch.  Can you please fix the problems identified above, and then rebase this against the current master.  If you are no longer actively developing this feature, let me know and we can delete this PR.

@DDTantor This PR still has problems and is now the master branch. Can you please fix the problems identified above, and then rebase this against the current master. If you are no longer actively developing this feature, let me know and we can delete this PR.


[CP Staging] fix: Search - Website crashes after exploring expenses in search for some time.

Explanation of Change

Fixed Issues
$ https://github.com/Expensify/App/issues/52864
PROPOSAL: https://github.com/Expensify/App/issues/52868
Tests
TEST 1

Log in with an account with several expenses on it.
Tap on search on the bottom of the page.
Open any expense.
Tap on the arrow on the top left corner.
Open a different expense.
Tap on the arrow on the top left corner.
Repeat steps 4 - 5 a few more times.
Verify that the user can continue exploring all the expenses without the website crashing.

TEST 2

Open any group chat or create one if necessary.
Tap on the group header.
Tap on "Leave"
Verify the user succesfully left and the group disappeared from LHN.

[x] Verify that no errors appear in the JS console

Offline tests
TEST 1

Log in with an account with several expenses on it.
Tap on search on the bottom of the page.
Open any expense.
Tap on the arrow on the top left corner.
Open a different expense.
Tap on the arrow on the top left corner.
Repeat steps 4 - 5 a few more times.
Verify that the user can continue exploring all the expenses without the website crashing.

TEST 2

Open any group chat or create one if necessary.
Tap on the group header.
Tap on "Leave"
Verify the user succesfully left and the group disappeared from LHN.

QA Steps
TEST 1

Log in with an account with several expenses on it.
Tap on search on the bottom of the page.
Open any expense.
Tap on the arrow on the top left corner.
Open a different expense.
Tap on the arrow on the top left corner.
Repeat steps 4 - 5 a few more times.
Verify that the user can continue exploring all the expenses without the website crashing.

TEST 2

Open any group chat or create one if necessary.
Tap on the group header.
Tap on "Leave"
Verify the user succesfully left and the group disappeared from LHN.

// TODO: These must be filled out, or the issue title must include "[No QA]."

[x] Verify that no errors appear in the JS console

PR Author Checklist

[x] I linked the correct issue in the ### Fixed Issues section above
[x] I wrote clear testing steps that cover the changes made in this PR

[x] I added steps for local testing in the Tests section
[x] I added steps for the expected offline behavior in the Offline steps section
[x] I added steps for Staging and/or Production testing in the QA steps section
[x] I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[x] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
[x] I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).

[x] I included screenshots or videos for tests on all platforms
[x] I ran the tests on all platforms & verified they passed on:

[x] Android: Native
[x] Android: mWeb Chrome
[x] iOS: Native
[x] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

[x] I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
[x] I followed proper code patterns (see Reviewing the code)

[x] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
[x] I verified that comments were added to code that is not self explanatory
[x] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[x] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method

[x] If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:

[x] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[x] I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
[x] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[x] I verified the JSDocs style guidelines (in STYLE.md) were followed

[x] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[x] I followed the guidelines as stated in the Review Guidelines
[x] I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
[x] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[x] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[x] I verified that if a function's arguments changed that all usages have also been updated correctly
[x] If any new file was added I verified that:

[x] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[x] If a new CSS style is added I verified that:

[x] A similar style doesn't already exist
[x] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))

[x] If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
[x] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[x] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[x] If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
[x] If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:

[x] I verified that all the inputs inside a form are aligned with each other.
[x] I added Design label and/or tagged @Expensify/design so the design team can review the changes.

[x] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[x] If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
https://github.com/user-attachments/assets/b3cceb0b-87e5-4f8f-b12d-46236db30b23

Android: mWeb Chrome
https://github.com/user-attachments/assets/1bbbdbe9-d3a6-4547-9de4-d02736f53633

iOS: Native
https://github.com/user-attachments/assets/400dba79-6ffd-4968-b365-7acc1ec33f16

iOS: mWeb Safari
https://github.com/user-attachments/assets/87cc2d39-4abe-4bc7-aeba-2231c708ecbb

MacOS: Chrome / Safari
https://github.com/user-attachments/assets/48858d14-b884-4736-b15b-2f5fa82d01da

MacOS: Desktop
https://github.com/user-attachments/assets/d191b745-76b8-46cb-bc95-11db36d53bfa

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.


Tables? :)

I have the possibility to use table? I can not find anything.

Hi! Please check out the answer there https://www.reddit.com/r/golang/comments/5mr70e/nuklear_gui_package_for_go_now_supports_various/dc6gyk5/
So far there is no table widget, although there is a grid. I guess a table can be made but I didn't look into it yet.

Yes, a table is very important! It is the main problem of all GUI examples available for GO. We already are looking for a long time for something usable.

@Fruchtgummi if you share an abstract use case I could elaborate on this.

I Like the Bootstrap-Table see https://github.com/wenzhixin/bootstrap-table
Windows-Form Table https://msdn.microsoft.com/en-ie/library/aa984314(v=vs.71).aspx

hey.
I am looking into similar issues. I am intending to build up a GUI toolkit that is like Material Design.
i knwo MD is not everyones cup of tea, but lots of users are already trained in it by using so many google products.
Also i used to design GUIs alot and part of the issue with GUI's is getting enough coverage of the expected UX patterns for that is general enough to be used on lots of projects. I believe this is one of the good things also about Material Design in that its general enough to be used for lots of things.
In other works its like a Corporate iDentity kit (that they call it in graphic design) with attention to lots of sticky UX design questions. By having all these answered for you, you basically have your requirements and its just a matter of implementing them. Requirements that are correct is half the battle !
So if anyone else is interested in this please do let me know...

here is a decent example
https://github.com/material-components/material-components-ios/tree/develop/components
There is also a web and android implementation, but i feel the IOS version sis the clearest one that give an actual api for help to think about what needs to be done to make a Material Design opengl based library.

@joeblew99 implementing material layouts is hard, be careful
https://github.com/dskinner/material (discontinued)

i know his project. I played with it 6 months ago.
Yes it is hard i agree.
Let me state the the other reason for all this is because as a golang programmer i just want a write once run everywhere ability for the GUI, just like we have for golang. So you have to pick a UX / UI style, and MD is basically the onyl one that has made it to that point.
At the moment the options are terrible:

electron. Enough said :)
gomobile. still have to write the actual UI in Java / objective c
qt (license costs for real apps), and slow slow compile times

Did you see his new project ? Its doing MD also with a new approach:
https://github.com/dskinner/x
MD example, plus other there too.
https://github.com/dskinner/x/tree/master/glw/example/glwidget
I am not sure where he is going with it yet.
From what i can see he is trying to do a bring up that covers all the hard stuff where his old project failed from what i can see. Its also got libs designed for 2D and 3D too from what i can see.
So he failed but he has a new attempt :)
The code is very very readable too.
Also now there is some really nice redux libs in golang that can really made it easy to build GUI without the cognitive load.
https://github.com/johnsiilver/boutique
The docs are really well done.
The coding style is nice and easy and scalable in terms of soze of a project.
This design is such that a complex system with PUSH messaging is much easier to build. You can build a GUI on top of a CQRS style backend easiyl with htis approach.
Then there is the ability to also use the same code to make webgl / browser apps
https://github.com/hajimehoshi/ebiten/tree/master/internal/opengl
It has video and audio working too.
It leverages gopherjs and webgl.
So its all getting there. I remember on reddit or some other forum when i raised this a year ago there were lots of gophers very much wanting this, and some wanting it MD based.
I am working on this 100% between other stuff and have one other guy working with me.
You did the hard work on the low level stuff, so that less competent programmers like me and others can built on top.
i ask if you can help support us ??
I have build custom UIs for years and i know i can do it in MD.
There are great examples with MD Lite and others where you can look inside to see assets etc.
There are perfect docs from google.
Its doable !
Fine control is where the obstacle often is and with openGL we have fine fine control :)
I am still in two minds about nuklear. Have to say this.  Its not that its bad, its more that its not easy to extend for gophers. If you dig into the code and try out Nuklear and Nucular on all desktops and mobiles you start to see how you need specific bits added to make the UX experience work (little things like the scroll speed needed to vary between platforms, or the way selecting text in a text box has to vary between platforms).  SO, pat of me thinks a more golang base allows us to overcome these little things more easily. Maybe there is slight runtime perf loss but i kind of think its ok.
Also as we all know with this approach there are no limits. You can have a project where you need Forms, 2D canvases (like your Teg workshop which is awesome)  and 3d charts, models, etc, and you dont have to switch languages and approaches. Its compelling for me to know i dont hit a dead end - i can go all the way if needed on a project to raise it up to a very high standard.
Also i noticed vurtun has a new project.
https://github.com/vurtun/quarks
Again, it makes me scared to use it as i have not idea whats going on as there is not the adaptability of golang. Maybe its dumb.. just saying...
At the moment its me, another guy called alex who is a really good golang programmer and loves UI stuff and good to work with, and maybe you to help with the really low level stuff.
What do you say ?


Create screenshot finally done part 2.py for issue #1956

done

Description
Finally made a single folder and put my files there. This is in reference to PR #2135
Fixes #1956

Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] Documentation Update

Checklist:

[ ] My code follows the style guidelines(Clean Code) of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have created a helpful and easy to understand README.md
[ ] My documentation follows Template for README.md
[ ] I have added the project meta data in the PR template.
[ ] I have created the requirements.txt file if needed.

Project Metadata
If there is no-file/nothing to fill the below fields with, then type: none
Example: If no requirements.txt needed/present, then type none in Requirments.
Category:

[ ] Calculators
[ ] AI/ML
[ ] Scrappers
[ ] Social_Media
[ ] PDF
[ ] Image_Processing
[ ] Video_Processing
[ ] Games
[ ] Networking
[ ] OS_Utilities
[ ] Automation
[ ] Cryptography
[ ] Computer_Vision
[ ] Fun
[ ] Others

Title: <write script title here>
Folder: <type the folder name that contains your script>
Requirements: <type the name of text file containing the required to install python packages, type None if no file required>
Script: <Enter the name of the .py file (The main entry point of the program)>
Arguments: <enter any arguments that the script needs but - separeted like: h-c-m>
Contributor: @bhavya1857
Description: i hope you find this fine @avinashkranjan

@avinashkranjan please do check this


this.replace is not a function

Hi,
when giving a non-string Id to the translate Filter, I am getting the error `TypeError: this.replace is not a function. Attached fix works for me.
(Use Case: I am using translation in tables that can contain labels as well as data.)

Thanks for your contribution. Even though the check might make sense in general, I'm asking myself:
You're not translating values/data here, right?

Well ... you're right, the flaw is deeper in my application logic. However, it took some time for me to find out the reason for this, as angular doesn't give line numbers when intrapolating statements. So I guess an error would be fine if it would be more clearly angular-translate-related ...
For completenes, the tests should also do integer, undefined and so on. I will add them on Friday.

I have added the current return values in the commented part. Esp $translate([]) == {} is a bit inconsistent but you're right, this normally shouldn't happen.

Thanks. Landed as 8616dca


[Release-1.22] Add certificate rotation integration tests

Signed-off-by: galal-hussein<EMAIL_ADDRESS>

Proposed Changes

Types of Changes

Verification

Linked Issues

User-Facing Change

Further Comments

@galal-hussein you need to change the package to rancher/k3s we haven't backported the k3s-io change.

It'll also need the timeout extended as in https://github.com/k3s-io/k3s/pull/5431

@galal-hussein you need to change the package to rancher/k3s we haven't backported the k3s-io change.

Fixed

The contents of this PR have been merged in https://github.com/k3s-io/k3s/pull/5761


Add tests to sdist

Describe the feature
Currently the tests are not included in the PyPI sdist.  As a result in order to do packaging for openSUSE at https://build.opensuse.org/package/show/devel:languages:python:django/python-django-codemod , I need to fetch the sdist from Github, which is a few extra steps.
Please can the tests be added to the sdist.
To Reproduce
Download sdist from PyPI, untar and see that now tests are present.

Tests are not included intentionally. I don't see much point in them as the end users don't really need them to run the code, it's just adding some extra bytes to download from PyPI, using extra bandwidth and storage.
Pardon my ignorance, but I don't understand why this needs to be packaged on openSUSE, don't people have pip/pipx installed/installable there?

Regarding why, I am a maintainer of the django package collection on openSUSE, and I frequently use codemod to fixup packages which havent done a release of the compatibility needed for the latest release of Django.
e.g. https://build.opensuse.org/package/show/devel:languages:python:django/python-django-user-agents
https://build.opensuse.org/package/view_file/devel:languages:python:django/python-django-user-agents/python-django-user-agents.spec?expand=1 is where you can see the tool being used.  Packages get deleted on openSUSE if they fail to build for six weeks, so the clock is ticking.  As soon as another Django release occurs, approx 20 django packages break.  Your tool means I don't need to disable newly failing tests, or apply lots of patches against the most recent released version of a package, etc. Much appreciated.
https://pypi.org/project/django-codemod/#files shows that there are wheels and sdists being uploaded.  The wheels do not include tests, and are intended for normal pip usage.  The wheels are downloaded by default by pip, and include only what is necessary to run the code.  The sdist (source distribution) is where the tests reside, and are only fetched explicitly via pip arguments, or by URL directly as my package maintenance scripts do.

This took longer because the build was broken due to an unrelated issue: it looks like something wonky was going on in the cache and it's not speeding the build very much so I removed it #658.
Thanks for the contribution, not a big fan of shipping tests to PyPI, but as you explained, it shouldn't be too bad since it's only in the source distribution, so I'm good with this 👍🏻


ta_alloc(0) leads to returning same non-NULL address twice

Calling ta_alloc(0) and then another ta_alloc() (of any size) appears to be returning the same address twice. Having two memory blocks sharing the same address is bad since there is no way for ta_free() to know which to free.
ta_alloc(0) should probably either return NULL or behave the same as if ta_alloc(1) was called.

@jlindgren90  Thank you very much for this and the other PR - I will take a look asap, but likely will take a little while for me to review & test this...


midis update

Uploading Midis colected through last year.

I decided to do a review of this pull request since it's something with a lot of content to review. Note that you are not forced to take everything into account, it's just what I thought should be changed. Outside of these specific tracks/what I pointed to change in these specific tracks, everything else seems to be good to go.
Loop differences:
(I'm not sure if it's the plan to be 1:1 with the RTP for this but there is no reason to make them change compared to it if you want my opinion)
Tracks that don't loop in the 2k(3) RTP but does in the OpenRTP:

2003Hero's Return
JDoubt
JEndofBattle1
JEndofBattle2
JEndofBattle3
JEndofBattle4
JFanfare1
JFanfare2
JFanfare3
JFanfare4
JFanfare5
JFanfare6
JInn1
JInn2
JItem
JJoke2

It does not really make sense for a jingle to loop.
Tracks that loop in the 2k(3) RTP but not in the OpenRTP:

2003Cathedral
2003Deep Memory
2003Young Memories
Parting 2
Victory

These tracks should be able to properly be looped by removing the end part and making it restart at a a correct tempo compared to the rest of the track.
I think that the tracks that I have listed in the Loop differences part could all be used as-is by just changing this property if we want to be accurate compared to the 2k(3) RTP.
Tracks that may be too short and/or repetitive:

2003Creeping Darkness
2003Dark Altar
2003Machine Fortress
Field 2
Hero1
Hero2
Mystery2
Wrath

I think that some of them may have to be changed if you want my opinion, while they may sound good they may be a bit too short to encourage people to use them.
Specific issues:

2003DesertedMansion seems to not loop correctly sometimes when I listen to it in RPG Maker. I have not took a look at it deeply, but there may have something to change there to how it loops.
2003Lonesome Journey has an issue with how the volume is set, causing issues in the RPG_RT and RPG Maker (See https://github.com/EasyRPG/Player/issues/2995). While it does not directly affect the Player, I think that it could be a good thing to remove it to avoid potential issues.

Nitpicking from my side (you don't have to take it into account):

2003Panic is good, but does not convey panic
J2003Horn is not a horn or does not sound like one to me

Not looping means btw that they have the loop point at the end making the track silent


[SPARK-27421][SQL][2.4] Fix filter for int column and value class java.lang.String when pruning partition column

This pr backport https://github.com/apache/spark/pull/30380 to branch-2.4.
What changes were proposed in this pull request?
This pr fix filter for int column and value class java.lang.String when pruning partition column.
How to reproduce this issue:
spark.sql("CREATE table test (name STRING) partitioned by (id int) STORED AS PARQUET")
spark.sql("CREATE VIEW test_view as select cast(id as string) as id, name from test")
spark.sql("SELECT * FROM test_view WHERE id = '0'").explain

20/11/15 06:19:01 INFO audit: ugi=root ip=unknown-ip-addr cmd=get_partitions_by_filter : db=default tbl=test
20/11/15 06:19:01 INFO MetaStoreDirectSql: Unable to push down SQL filter: Cannot push down filter for int column and value class java.lang.String
20/11/15 06:19:01 ERROR SparkSQLDriver: Failed in [SELECT * FROM test_view WHERE id = '0']
java.lang.RuntimeException: Caught Hive MetaException attempting to get partition metadata by filter from Hive. You can set the Spark configuration setting spark.sql.hive.manageFilesourcePartitions to false to work around this problem, however this will result in degraded performance. Please report a bug: https://issues.apache.org/jira/browse/SPARK
 at org.apache.spark.sql.hive.client.Shim_v0_13.getPartitionsByFilter(HiveShim.scala:828)
 at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$getPartitionsByFilter$1(HiveClientImpl.scala:745)
 at org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$withHiveState$1(HiveClientImpl.scala:294)
 at org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree1$1(HiveClientImpl.scala:227)
 at org.apache.spark.sql.hive.client.HiveClientImpl.retryLocked(HiveClientImpl.scala:226)
 at org.apache.spark.sql.hive.client.HiveClientImpl.withHiveState(HiveClientImpl.scala:276)
 at org.apache.spark.sql.hive.client.HiveClientImpl.getPartitionsByFilter(HiveClientImpl.scala:743)

Why are the changes needed?
Fix bug.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Unit test.

Test build #131325 has started for PR 30422 at commit a97ce6a.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35929/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35929/

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/35929/
Test PASSed.

Test build #131325 has finished for PR 30422 at commit a97ce6a.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131325/
Test FAILed.

retest this please.

Test build #131329 has started for PR 30422 at commit a97ce6a.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35934/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35934/

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/35934/
Test FAILed.

Test build #131336 has started for PR 30422 at commit 29ddfe9.

Test build #131329 has finished for PR 30422 at commit a97ce6a.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131329/
Test FAILed.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35940/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35940/

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/35940/
Test FAILed.

Hm, the test failures in Jenkins look related. But it passed in GitHub Actions ...:
[info] - 0.13: getPartitionsByFilter: chunk in ('ab', 'ba') and ((cast(ds as string)>'20170102') (37 milliseconds)

retest this please

Test build #131345 has started for PR 30422 at commit 29ddfe9.

Test build #131336 has finished for PR 30422 at commit 29ddfe9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131336/
Test PASSed.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35949/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35949/

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/35949/
Test FAILed.

Merged to branch-2.4.

Test build #131345 has finished for PR 30422 at commit 29ddfe9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131345/
Test PASSed.


Fix a typo in README.md

Coverage remained the same at 97.21% when pulling b721c278ce85d46d1011287ef71fcadcf1a8e914 on clbn:patch-1 into d7860406559d018b76666ae7b73725accf1ea009 on zverok:master.

Coverage remained the same at 97.21% when pulling b721c278ce85d46d1011287ef71fcadcf1a8e914 on clbn:patch-1 into d7860406559d018b76666ae7b73725accf1ea009 on zverok:master.

Coverage remained the same at 97.21% when pulling b721c278ce85d46d1011287ef71fcadcf1a8e914 on clbn:patch-1 into d7860406559d018b76666ae7b73725accf1ea009 on zverok:master.


fix(icon-list): add container bottom margin

Fix https://github.com/adobe/express-website-issues/issues/356
Test URLs:

Before: https://main--express-website--adobe.hlx.page/drafts/Anuj/nonprofits
After: https://issue-356--express-website--adobe.hlx.page/drafts/Anuj/nonprofits?lighthouse=on

Some pages with icon lists to check for regressions:

Before: https://main--express-website--adobe.hlx.page/express/feature

After: https://issue-356--express-website--adobe.hlx.page/express/feature

Before: https://main--express-website--adobe.hlx.page/education/express/deployment

After: https://issue-356--express-website--adobe.hlx.page/education/express/deployment

Before: https://main--express-website--adobe.hlx.page/express/nonprofits

After: https://issue-356--express-website--adobe.hlx.page/express/nonprofits

Before: https://main--express-website--adobe.hlx.page/express/feature

After: https://issue-356--express-website--adobe.hlx.page/express/feature


Incompatibility with Node < v8.5.0

I got the following error while trying to install the package:
/foo/node_modules/graphql_ppx/copyPlatformBinaryInPlace.js:41
    fs.copyFileSync(filename, 'ppx');
       ^
TypeError: fs.copyFileSync is not a function
    at Object.<anonymous> (/foo/node_modules/graphql_ppx/copyPlatformBinaryInPlace.js:41:8)
    at Module._compile (module.js:570:32)
    at Object.Module._extensions..js (module.js:579:10)
    at Module.load (module.js:487:32)
    at tryModuleLoad (module.js:446:12)
    at Function.Module._load (module.js:438:3)
    at Module.runMain (module.js:604:10)
    at run (bootstrap_node.js:383:7)
    at startup (bootstrap_node.js:149:9)
    at bootstrap_node.js:496:3

I had Node v6.11.4, which doesn't support fs.copyFileSync (Added in: v8.5.0).
https://github.com/mhallin/graphql_ppx/blob/3d78a2e4249464ac3698fc5d3db1e6e08d084a34/copyPlatformBinaryInPlace.js#L41
Since the error message isn't really helpful, I would suggest to either check the Node version or use some kind of polyfill.

@xtuc @mhallin said he would be happy to accept PRs that add copyFileSync polyfill


Update layout of pw reset/pw reset confirm pages

Resolve #4146
Also check the reset confirm page.

Reverted the change of the reset-pw-confirm page.


HTML Creation omitting jQuery code in log.html

Hello. Been having this issue with version 3.0 and have not been able to find help or anyone else asking about the same issue. Is this in fact a bug? When trying to view a log.html file, it displays only a blank white screen and the browser console throws an "Uncaught ReferenceError: jQuery is not defined"
Comparing an older working log.html to a current non-working log, the broken HTML is missing code from the following 3 files in robot\htmldata\lib
jsxcompressor.min.js
jquery.min.js
jquery.tablesorter.min.js
Each is a single enormous function call which is why they are omitted.
Copying and pasting them into the non-working html file allows it to open with all of its actual result data.
This occurs with both default output creation and using rebot to generate reports.

This definitely shouldn't happen with the normal installation.

We had 2 different install methods yield the same issue, 1 was installed using PIP the conventional way, the other installing from source. The robot folder is located in the location that the test will be run.  The tests are used with Sikuli and thus are interpreted by Jython. A modified jybot.bat had to be created to tie in Sikuli.
`@echo on
setlocal
set ROBOT_HOME=%~dp0
set JYTHON_HOME=%ROBOT_HOME%
set SIKULIX_HOME=%ROBOT_HOME%
REM echo %CLASSPATH%
set CLASSPATH=%SIKULIX_HOME%sikulixapi.jar;C:\Python27;C:\Python27\Scripts;C:\jython2.7.0\bin;C:\jython2.7.0\lib;C:\ProgramData\Oracle\Java\javapath\
REM;%CLASSPATH%
set JYTHONPATH=%SIKULIX_HOME%sikulixapi.jar\Lib
javaw -cp %JYTHON_HOME%jython-standalone-2.7.0.jar;% org.python.util.jython ^
%ROBOT_HOME%robot\run.py ^
--pythonpath=%ROBOT_HOME%program.sikuli ^
%*
endlocal `
I ran a compare htmldata folder of the 2.9.2 version and 3.0 version and there is some minor differences and an entire extra folder in the 2.9.2 one. Not sure if this is related or just part of the 3.0 update.
The logs were working well originally until recently and actually never worked for the person installing with PIP (about a month ago)

The way you run tests with standalone Jython looks somewhat complicated so it could be related to that. Nobody else has been reporting this and RF 3.0 has been out for a year, so I'm fairly certain something funny is happening in your environment.

Thank you Pekka! I appreciate the fast responses. I guess this issue can be closed since it is something specific on our part.
Would you have any insight into the part of the output creation that handles inserting the jQuery functions? This is strangely the only thing that appears to be amiss with any part of Robot for us.
Thanks again!

I know how that code works but I have absolute no clue why it won't work in your environment.

Pekka, it appears that at some point during the deployment or through our source control software, those 3 files are being stripped on the testing machines. Thank you for the support. We should be able to solve it from here.
Thanks again.

Great that you got it sorted out!

Thank you for your help and the great software!


Turn the "select a config" button into a drop down list with view templates

As suggested by @nvictus:
Current the select a config file selection button is confusing as it looks like a drop down button.
Instead it should open a drop down which lets the user select between choosing either a predefined view config if different layouts and an option to load one's own view config
The templates could include

2 column
3 column
etc.

It could also include a few templates populated with common data (e.g. coordinates and gene annotations for hg19/hg38, mm9/mm10). And templates for the "1D genome-browser" view, and with detail views. Then all the extra examples on the homepage can be safely moved to the "examples" gallery.  That way, the homepage can be cleaner having only one viewer instance and it should load faster too.


feature: date literal support Zone

Proposed changes
support
'2022-05-01 01:02:55 +02:30
'2022-05-01 01:02:55 Asia/Shanghai

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

support
'2022-05-01 01:02:55+02:30
'2022-05-01 01:02:55Asia/Shanghai


How can export each module to its separate file?

Im using grunt-angular-builder to concat and minify AngularJs application. However this plugin requires only one module definition per file.
How could I fix this problem?

Seconded. You can do this via the gulp equivalent. I had it going so each template was jsified and then added as a script reference in the index.html file (via injector). usemin would then bundle them up on build.
One benefit was I could watch html files and regen only the changed/new html file rather than every single one.
Defining every html file as a task in the gruntfile is no solution.

Soo... I wrote this and slapped in my copy of html2js
if (options.perFileOutput) {
      this.files.forEach(function(f) {
        var moduleName = f.moduleName;

        f.src.filter(existsFilter).map(function(filepath) {
          var name = normalizePath(path.relative(options.base, filepath));
          var content = getContent(filepath, options);

          var output = '(function() {\n' +
          '\tvar module;\n' +
          '\ttry {\n' +
          '\t\tmodule = angular.module(' + options.quoteChar + moduleName + options.quoteChar + ');\n' +
          '\t} catch (e) {\n' +
          '\t\tmodule = angular.module(' + options.quoteChar + moduleName + options.quoteChar + ', []);\n' +
          '\t}\n' +
          '\tmodule.run([' + options.quoteChar + '$templateCache' + options.quoteChar + ', function ($templateCache) {\n' +
          '\t\t$templateCache.put(' + options.quoteChar + name + options.quoteChar + ', ' + options.quoteChar + content + options.quoteChar + ');\n' +
          '\t}]);\n' +
          '})();';

          grunt.file.write(f.dest + name + '.js', grunt.util.normalizelf(output));
        });
      });
    }

So perFileOutput isn't an option that exists at the moment. I didn't real deal with the else case either.
It doesn't check for coffee.
I expects a moduleName value to be defined in each file set. Output is the dest (must have trailing slash) + the normalised path to the file with .js appended. eg `scripts/components/test.html.js'

@worldspawn: would you mind putting this into a PR (ideally with a unit test)?  I'd be happy to review and merge it.

Yeh I could if you describe how you want it to work. I was thinking if perFileOutput is true it won't ever run the current loop, this negates the usefulness of some of the other options such as options.module options.singleModule options.fileHeadingString options.fileFooterString and perhaps some others. And I dont know coffee script syntax


Support World uploads in RAR format

Such as http://www.planetminecraft.com/project/whos-your-daddy-3654710/


Integrate real crypto

@nc6 do we need to keep this ticket open, or does #982 subsume it?

This ticket does still need to stay open; it can only be closed once we have adopted the new crypto libraries that are currently being considered for KES and VRF.

@mrBliss says actually all actual crypto code will live ledger side. If that is true, we can close this after all. Let's verify that.

@mrBliss says actually all actual crypto code will live ledger side. If that is true, we can close this after all. Let's verify that.

Ignore what that guy said, he doesn't know what he's talking about :slightly_smiling_face:
There's the Crypto class in cardano-ledger-specs:
https://github.com/input-output-hk/cardano-ledger-specs/blob/e09a3efa9f428de474384856c0311088b1503819/shelley/chain-and-ledger/executable-spec/src/Cardano/Ledger/Shelley/Crypto.hs
This is how we would currently instantiate that class on the consensus side:
https://github.com/input-output-hk/ouroboros-network/pull/1695/files?file-filters[]=.hs#diff-8962e0a6804a4df8f80d0ef7c7652ab3R53-R67
AFAIK, the final KES (https://jira.iohk.io/browse/CDT-60) and VRF (https://jira.iohk.io/browse/CDT-59) implementations will follow soon, after which we can replace SimpleKES and SimpleVRF with the real implementations.

Ignore what that guy said, he doesn't know what he's talking about slightly_smiling_face

I did say "If that is true" :roll_eyes:

The real implementation that still requires testing: https://github.com/mkannwischer/xmssfs

I have updated https://github.com/input-output-hk/cardano-base/issues/102
TLDR: we have been offered a KES implementation in C with a Haskell binding written by @vincenthz.  This should eliminate one of the key outstanding issues that stands in the way of deploying the node.


Complete pom.xml

That way maven central requirement checks pass when releasing

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Graph error state

Fixes

https://issues.redhat.com/browse/HACBS-1457
Design doc
Description

Add graph error state to Surface API errors
Type of change

[x] Bugfix

Screen shots / Gifs for design review

Application workflow graph empty state:

Commit graph empty state:

PipelineRun graph empty state:

Multiple errors (different message):

Multiple errors with same error messages are clubbed together as a single message:

How to test or reproduce?

Manually modify the kind in any of the models used by graph to an invalid name in hacbs.ts

Browser conformance:

[x] Chrome
[x] Firefox
[x] Safari
[ ] Edge

/lgtm
/approve


Update file upload translations to avoid concatenation

This updates the file upload form translations to better align with i18n conventions (ie. avoid concatenating translations).
Closes #3260

Thanks ❤


something is wrong with salloc

when i tried
salloc -N 1 --ntasks-per-node=8
and once I launch dask, what  I got is the following
<Client: 'tcp://<IP_ADDRESS>:41107' processes=4 threads=8, memory=251.69 GiB>
so --ntasks-per-node=8 allocated 8 threads, 4 cores, rather than 8 cores
or I misunderstood something here

i just now noticed the same thing with ipyparallel! So there's a different SLURM flag we should use

probably just need to add --ntasks-per-core=1

fixed in setup instructions in 52fddd89a3efc9339799937dbf3d5fb0d743365c


All icons disappear.

Describe the bug

Steps to Reproduce

Create a Python Application project, add simple Python code.

Expected behavior

Additional context and screenshots
All icons disappear.

Launch VS and select Help > About Microsoft Visual Studio

Can't repro in this environment, so I closed it.


MRI data preprocessing

Daniel suggested we start with this dataset: https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=70226903
these are N=922 breast MRI exams. The patients all have cancer, but we have many labels available (survival, subtype, etc.). So one idea would be to use this dataset, split it into four partitions, and then use SL to train a classifier for categorical targets. However, downloading the data requires a special tool and will cost 30 mins of work. In the end, use the 3Dslicer software (https://www.slicer.org/) to look at the images.

reconstruct the images to 3d, using dcm2niix to have nifti files, https://github.com/rordenlab/dcm2niix
crop the tumor to the segmentation, slice the tumor and get jpg or png images from every slice and then we use that as tiles

In short:  dcm -> nifti -> slice to jpg as tiles


TreeView Multiselection

🙋 Feature Request
Add multiselect capability to the TreeView component
🤔 Expected Behavior
On top of the current behavior:

ctrl+click or ctrl+enter on a node should add it to (or subtract it from) the list of selected items
shift+click or shift+enter on a node should add all the nodes to the current selection from the closest selection before the node until the node
the list of selected items should be data bindable

😯 Current Behavior
A click or enter on a node selects it but removes any other selection
💁 Possible Solution

🔦 Context

We'd like to use the tree view for some configuration pages. In some of them it is possible to set certain properties for multiple nodes at the same time -> multiple selection.
I considered to use the Telerik controls, but they are slow and the library is too heavy.
I implemented my own TreeView, which works reasonably well. However I am considering to use a control library and seems to be a waste to implement new controls if the ones in the library are almost ok.
💻 Examples

https://demos.telerik.com/blazor-ui/treeview/selection

Hi,
Unfortunately, the underlying web component does not support multi-select so this is not something we can add anytime soon. I wiil try to find out if this is on the horizon for the web components.

Ok, understood, thanks for the answer.


expose branch option when using context.config?

Feature Request
Is your feature request related to a problem? Please describe.
Would be great for context.config to expose the branch option in
https://github.com/probot/probot/blob/f053bf84eca0c23f61a6c60d6a01c1324e38f2b5/src/context.ts#L228
https://github.com/probot/octokit-plugin-config/blob/b869dd5ea4adb4a26d1e3c388b3eeba9c44c243a/src/compose-config-get.ts#L14-L17
I seen a lot of release drafter users being confused by when the config is loaded when they are testing a branch or want to use the config loaded from their desired branch workflow.

I guess so, just means I have to mess with the probot context, which I had hoped not to 😅

no you don't have to mess with anything, context.octokit.config.* already exists, you can just use it?

well I'll be darned.


Fixed Banner Link Text Cropped On Mobile Devices #7

Description of PR
Removed redundant css causing Banner link text to automatically cropped in smaller devices (portrait mode)

Relevant Issues
Fixes #7
Checklist

[x] Compiles and passes lint tests
[x] Properly formatted
[x] Tested on desktop
[x] Tested on phone

Screenshots After Fix

@aksanoble could you please review this PR

@kmanadkat Thanks!


Patrickjcasey/quiet flag bug

When running hc check --format json -v quiet https://github.com/mitre/hipcheck, the following error occurs on origin/main

This merge request corrects this error and fixes the regression related to -v quiet in 3.5.0

If anyone has an idea of how to test this/ensure I hid everything that should be hidden when -v quiet is passed, I would love to hear it!q

Regarding testing, we've talked about doing snapshot testing with cargo-insta and that's what I'd like to do. Can you open an issue for it in the next milestone?


[TF-TRT] Cast Converter Re-Engineered

This PR changes the way TF-TRT deal with Cast nodes. TensorRT engineers advised us to treat Cast as an Identity node and let TensorRT decides on which compute precision to use according to precision_mode=....
This behavior can be deactivated using TF_TRT_EXPERIMENTAL_FEATURES=reject_fp32_fp16_cast if needed to work around any unforeseen issue
This PR also adds converter.summary() to TF-TRT test files in order to ease test debugability

@bixia1 for review
CC: @tfeher

I have two general comment on this PR:
(1) the existing support is cast from fp16 to fp32, the feature name added here is called reject_fp32_fp16_cast. Shouldn't it be reject_fp16_fp32_cast?
(2) the existing code only supports cast from fp16 to fp32, the change here make us support fp32 to fp16 as well. Is this an intensionally change? If yes, please add test and add this to the PR description.

Hi @DEKHTIARJonathan Can you please check @bixia1's comments and keep us posted ? Thank you!

@DEKHTIARJonathan Any update on this PR? Please. Thank you!

@bixia1

(1) the existing support is cast from fp16 to fp32, the feature name added here is called reject_fp32_fp16_cast. Shouldn't it be reject_fp16_fp32_cast?

What I mean by reject_fp32_fp16_cast is to reject all FP Cast (fp32 => fp16 and fp16 => fp32), I am renaming the feature to reject_all_fp_cast_ops, I think it's more self explanatory.

(2) the existing code only supports cast from fp16 to fp32, the change here make us support fp32 to fp16 as well. Is this an intensionally change? If yes, please add test and add this to the PR description.

Yes absolutely, it is intentional. This PR changes the way Cast Operation in handled by TRT to and from FP16/32 precision. I am updating the PR description

@bixia1 please review. This PR is good to go ;)


esc env version history seems to repeat results

What happened?
With a new project and environment containing 3 revisions, I see this when I run esc env version history:

I also seem to have to ctrl+c to get out of it. (There's also a significant lag -- feels like it might actually be stuck in a loop.)
I'd expect to see just three entries here and the CLI to exit zero (I suppose unless paging).
Example
See above.
Output of pulumi about
➜ pulumi about
CLI
Version      3.133.0
Go Version   go1.23.1
Go Compiler  gc

Host
OS       darwin
Version  14.6.1
Arch     arm64

Additional context
It may help that I used my personal (cnunciato) org for this. When I switch to use an Enterprise org (e.g., zephyr), the output is as I'd expect:

Contributing
Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

Thanks, friends! 🚀


concepts for "corrected" versions of variables

Some variables are routinely corrected for certain artifacts. For example, the aerosol particle sulphate mass concentration is found as such, but also as version subtracting the contribution of sea-salt sulphate. Should be clarified. Probably "corrected" version will be level 3 product.

Discussed at ACTRIS DC ET meeting, no objection.

Closed, since no effect on vocabulary.


implemented expandable bottom bar to menu section.

@wasabeef, @ogaclejapan  can you please review this PR

@wasabeef, any chances to get approval?

@st235
Can you change the README.md file too?

@wasabeef, yeah, of course!

@wasabeef, README.md changed 🙂
Anyway, thank you for a replay!

@st235
Great works. 🚢

@wasabeef
Thank you 🎉

I'm sorry for the too late reply. 🤕

no problems)


New test runner: Use npm test command

We can simplify the use of Stryker quite a bit if we simply use the npm test command of a repository. In order to do this, we can create a simple test runner, let's call it the NpmTestTestRunner for now.
The idea is that, instead of hooking into the test runner and test framework, we simply use the npm test command. If exit code is 0, the test passed, if it is 1, the test errors. Our timeout system should still work with this approach, so a timeout would also be supported.
Basically, we would trade in performance for simplicity.
Mutode uses this approach. @DiegoRBaquero is the author and might have some time to implement this feature.

That's quite a clean way to incorporate it in Stryker :) do you want this in the core Stryker package or as a plugin? This may have zero dependencies.

Good question. I'm happy with putting it in the core, as long as it has 0 dependencies and it is not MB's in size (which is shouldn't have to be).
We might want to make it more generic in that we might want to allow people to inject there own test script. For example mocha test/**/*.js. That might come in handy, if people also use e2e tests as part of there normal build process and want Stryker to just run the unit tests.
So the name could better be CustomScriptTestRunner, or CustomCommandTestRunner.

I had some time on a 10 hour flight, so I decided to implement this feature. @DiegoRBaquero do you want to review it? I'm especially interested to see if made some obvious mistakes using require('child_process').exec.

Cool! I'll try to review it this weekend


[BUG] Stuck at Generating remote plugin manifes on aarch64-linux

Field
Description

Plugin
chadtree wilder

Nixpkgs
github:nixos/nixpkgs/a71e967ef3694799d0c418c98332f7ff4cc5f6af

[x] I have read the FAQ and my bug is not listed there.

Description
When building on aarch64-linux, the buildPhase will stuck at Generating remote plugin manifes. I have waiting for 10 hours and it still keeps strucking.
Building on x86_64-linux seems good for me.
Minimal, Reproducible Example (MRE)

  plugins = {
    chadtree.enable = true;
    wilder.enable = true;
  };

Have you tried re-running the build command or does it always behave the same ?

Yes. I have run it on both a raspberry pi 5 and a aarch64-linux-binfmt-enabled x86_64 machine serveral times. All results in the same issue.


Generate a webpack.config file

Do you want to request a feature or report a bug?
Feature
What is the current behavior?
Currently, a webpack config file is not generated
If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem via https://jsfiddle.net or similar (template: https://jsfiddle.net/84v837e9/).
N/A
What is the expected behavior?
A webpack.config.js should be auto generated with information from the webpack smple config.
Which versions of react-raise, and which browser / OS are affected by this issue? Did this work in previous versions of  react-raise?
N/A
NB: You can drop a comment below for more clarification

Issue fixed


little readme mistake

Hi,
thanks for the great pojekt.
There is a little mistake in the readme. Under the point PWM Frequency you mixt the function names analogWriteFrequency and analogWriteResolution:)
Lucas

@LucasBublitz I fixed that, thank you for the report

Hi,
Sorry about this issue, it happens due to some conflicts with vc addons
that try to render shortcodes in the backend, it's fixed in the development
version (attached to this email) that I am going to upload shortly
Thanks
wp-brain-dev.zip
https://drive.google.com/file/d/1H6gR3RN052An7aMUr4zaAn7vKqOQlPkw/view?usp=drive_web
On Thu, Nov 15, 2018 at 12:51 PM LucasBublitz<EMAIL_ADDRESS>wrote:

Hi,
thanks for the great pojekt.
There is a little mistake in the readme. Under the point PWM Frequency you
mixt the function names analogWriteFrequency and analogWriteResolution:)
Lucas
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ERROPiX/ESP32_AnalogWrite/issues/1, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AGRa5Lvxtw6M_7anMf6C1SogTx57_PUSks5uvWNAgaJpZM4YfvGt
.


SAMZA-2189: Integrate startpoint resolution workflow with SamzaContainer startup sequence.

This patch is comprised of the following changes:

Integrates the resolving startpoints to offset workflow to container startup sequence.
Either if the startpoint does not exist for a (taskname, system-stream-partition) or the startpoint resolution fails, then the checkpointed offset is used as starting offset
Added unit-tests to validate the altered starting offset computation flow for a partition.

@dnishimura
Please take a look when you have a chance.