e2e-test: Set ginkgo timeout to 2 hours

In d07462a6068ca7f6f086c2b734c2cdfb97e902e5, the timeout for the test
pipelineRun was increased to 2 hours (see the commit message for
reasoning.)
However, ginkgo has its own timeout which defaults to 1 hour. Increase
to 2 hours correspondingly.

/retest

2 times in a row the e2e-tests task failed in 15 secs. Based on the logs:
STEP-E2E-TEST

2024/03/22 05:37:24 warning: unsuccessful cred copy: ".docker" from "/tekton/creds" to "/": unable to create destination directory: mkdir /.docker: permission denied
  "level"=0 "msg"="Starting Red Hat App Studio e2e tests..."

.
.
.

[TIMEDOUT] A suite timeout occurred
  In [BeforeAll] at: /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:53 @ 03/22/24 05:37:32.914

The task started at 05:37:24 and finished at 05:37:32.914, so it took ~9 secs. You've set timeout to 5 secs, maybe the extra ~4 secs were for starting the tests.
So, I think the timeout flag is working. Similar to what you did previously, let's maybe increase this to a higher value (2hr?) and see what's wrong.

• [FAILED] [9.488 seconds]
[build-service-suite Build templates E2E test] HACBS pipelines [It] should eventually finish successfully for component with Git source URL https://github.com/redhat-appstudio-qe/devfile-sample-python-basic [build, build-templates, HACBS, pipeline, build-templates-e2e]
/github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:202

  Timeline >>
  PipelineRun devfile-sample-python-basic-bwqf-jdn2c reason: CouldntGetTask
  failed to store PipelineRun build-templates-e2e:devfile-sample-python-basic-bwqf-jdn2c: mkdir /root/tmp: permission denied
  attempt 1/3: PipelineRun "devfile-sample-python-basic-bwqf-jdn2c" failed: PipelineRun devfile-sample-python-basic-bwqf-jdn2c reason: CouldntGetTask
  failed to store PipelineRun build-templates-e2e:devfile-sample-python-basic-bwqf-jdn2c: mkdir /root/tmp: permission denied
  attempt 2/3: PipelineRun "devfile-sample-python-basic-bwqf-jdn2c" failed: PipelineRun devfile-sample-python-basic-bwqf-jdn2c reason: CouldntGetTask
  failed to store PipelineRun build-templates-e2e:devfile-sample-python-basic-bwqf-jdn2c: mkdir /root/tmp: permission denied
  attempt 3/3: PipelineRun "devfile-sample-python-basic-bwqf-jdn2c" failed:
  [FAILED] in [It] - /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:206 @ 03/22/24 08:42:07.328
  << Timeline

  [FAILED] Expected success, but got an error:
      <*errors.errorString | 0xc000feb0b0>:

      {s: ""}
  In [It] at: /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:206 @ 03/22/24 08:42:07.328

Hmm :thinking: maybe a flaky run?
/retest

/retest

$ tkn pr -n build-templates-e2e logs devfile-sample-python-basic-ytax-ln2w6

Pipeline build-templates-e2e/ can't be Run; it contains Tasks that don't exist: Couldn't retrieve Task "": error requesting remote resource: error getting "bundleresolver" "build-templates-e2e/bundles-1f492e63bfbf4ba88fa3190d4ce051ad": cannot retrieve the oci image: GET https://quay.io/v2/redhat-appstudio-tekton-catalog/pull-request-builds/manifests/sha256:ebb2fe8fe89005229962167b9a31015a023a49a7169c52edfc34d18fcb1270dd: MANIFEST_UNKNOWN: manifest unknown; map[]

Interesting :thinking:

The CouldntGetTask failures happened in a lot of build-definitions CI runs over the past two days (I've been collecting logs over night)
e2e-failures/build-definitions-pull-request-5tvnv.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-j4c7h.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-j9hgz.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-kfc9c.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-nd4rr.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-rq2lp.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-xl7v2.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-zbf6l.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-zwxnj.log:@ 03/21/24
e2e-failures/build-definitions-pull-request-4n54h.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-6kxwc.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-9bx9n.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-bs2sd.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-cpzk4.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-hf5d8.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-jt65w.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-jwtp5.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-qf4rq.log:@ 03/22/24
e2e-failures/build-definitions-pull-request-wlslj.log:@ 03/22/24

Investigating

/retest

So, the build-pipeline-selector in the build-templates-e2e namespace references non-existent tasks :confused:
$ oc -n build-templates-e2e get buildpipelineselector -o yaml | yq '.items[].spec.selectors[].pipelineRef.params[] | select(.name == "bundle").value'
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:docker-build-b7ba402fbdcba48351d7282770d9aeb63e8a59e1
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:docker-build-b7ba402fbdcba48351d7282770d9aeb63e8a59e1
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:fbc-builder-b7ba402fbdcba48351d7282770d9aeb63e8a59e1
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:nodejs-builder-b7ba402fbdcba48351d7282770d9aeb63e8a59e1
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:java-builder-b7ba402fbdcba48351d7282770d9aeb63e8a59e1
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:docker-build-b7ba402fbdcba48351d7282770d9aeb63e8a59e1

$ tkn bundle list quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:docker-build-b7ba402fbdcba48351d7282770d9aeb63e8a59e1 -o yaml > bps.yaml

$ yq < bps.yaml '.spec.tasks[].taskRef.params[] | select(.name == "bundle").value'
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:init-0.2@sha256:61a383c0dc7b26e34b9e04c445bea87e186c1b082ad72a513bc2071cc93769b7
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:git-clone-0.1@sha256:506d20e241c415fff66f00623b5b313b473a84b11715b2f1d2ed269bdda28e13
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:prefetch-dependencies-0.1@sha256:0528c92115b58d194540cd35dd3f7ef61edfe08ab46d6dd94c9badc6ed4ca82b
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:buildah-0.1@sha256:ebb2fe8fe89005229962167b9a31015a023a49a7169c52edfc34d18fcb1270dd
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:source-build-0.1@sha256:13abc4ca9e9dfb513a0ebdb50025cff1b7e0fdaf66c40b4fffd2d8878a09559e
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:deprecated-image-check-0.3@sha256:6edffbe9146ef3d778f534b7f4948e85c74b014a4aa292a7f5c74c0057d92ea3
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:clair-scan-0.1@sha256:9b4d433a2b81fe3c6f315def6b39b726321b8c7e6535605d57644dee4098e383
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:ecosystem-cert-preflight-checks-0.1@sha256:04594931dd7107feb95c29494229f517e4c6d672bafb63d46e49744bd2d36e34
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:sast-snyk-check-0.1@sha256:0404228aa41557a437d26c3820a4d941dc33c4f66ff2b36a17689c2ae2fca3d0
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:clamav-scan-0.1@sha256:c1e1adb318f9e93a0a5f1150c8a42e1013a9b8a970e6a172cbaa7d5a2fb51ecd
quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:sbom-json-check-0.1@sha256:f095eed94baf11190c55f1f81fe765f57527fd1418452222cc14b8f5301b301b

$ crane manifest quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:buildah-0.1@sha256:ebb2fe8fe89005229962167b9a31015a023a49a7169c52edfc34d18fcb1270dd
Error: fetching manifest quay.io/redhat-appstudio-tekton-catalog/pull-request-builds:buildah-0.1@sha256:ebb2fe8fe89005229962167b9a31015a023a49a7169c52edfc34d18fcb1270dd: GET https://quay.io/v2/redhat-appstudio-tekton-catalog/pull-request-builds/manifests/sha256:ebb2fe8fe89005229962167b9a31015a023a49a7169c52edfc34d18fcb1270dd: MANIFEST_UNKNOWN: manifest unknown; map[]

Attempting to fix in https://github.com/redhat-appstudio/build-definitions/pull/904

/retest

Wow, 2 hours still not enough
Ran 46 of 759 Specs in 6482.674 seconds
FAIL! - Interrupted by User -- 45 Passed | 1 Failed | 10 Pending | 703 Skipped
--- FAIL: TestE2E (6482.69s)
FAIL

Wow, 2 hours still not enough

Nice, at least that means the timeout is working :smile:
so next stop, 4hrs? :eyes:

/retest
This time, the failure was was while waiting for a build pipelineRun to finish
[e2e-tests : e2e-test]   PipelineRun devfile-sample-python-basic-w2cr-8ww5h reason: Running
[e2e-tests : e2e-test]   PipelineRun devfile-sample-python-basic-w2cr-8ww5h reason: Running
[e2e-tests : e2e-test]   PipelineRun devfile-sample-python-basic-w2cr-8ww5h reason: Running
[e2e-tests : e2e-test]   PipelineRun devfile-sample-python-basic-w2cr-8ww5h reason: Running
[e2e-tests : e2e-test]   PipelineRun devfile-sample-python-basic-w2cr-8ww5h reason: Running
[e2e-tests : e2e-test]   attempt 3/3: PipelineRun "devfile-sample-python-basic-w2cr-8ww5h" failed: context deadline exceeded
[e2e-tests : e2e-test]   [FAILED] in [It] - /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:206 @ 03/25/24 13:57:48.192
[e2e-tests : e2e-test]   << Timeline
[e2e-tests : e2e-test]
[e2e-tests : e2e-test]   [FAILED] Expected success, but got an error:
[e2e-tests : e2e-test]       <context.deadlineExceededError>:
[e2e-tests : e2e-test]       context deadline exceeded
[e2e-tests : e2e-test]       {}

/retest

Tekton chains setting new records, 2 hours and no attestation
/retest

/retest

Ooh, that's a new one
[e2e-tests : e2e-test] • [PANICKED] [1.971 seconds]
[e2e-tests : e2e-test] [build-service-suite Build templates E2E test] HACBS pipelines when the container image for component with Git source URL https://github.com/redhat-appstudio-qe/retrodep is created and pushed to container registry [AfterAll] contains non-empty sbom files [build, build-templates, HACBS, pipeline, sbom, slow, build-templates-e2e]
[e2e-tests : e2e-test]   [AfterAll] /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:379
[e2e-tests : e2e-test]   [It] /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:472
[e2e-tests : e2e-test]
[e2e-tests : e2e-test]   Timeline >>
[e2e-tests : e2e-test]   extracting contents of container image quay.io/redhat-user-workloads/build-templates-e2e/test-app-901/retrodep-0rdr:build-33968-1711444444@sha256:ede761fbacde580c37e99b40388d5610283ae37046f075c2f0e29a931a8b4fd9 to dir: /tmp/eimage3929356478
[e2e-tests : e2e-test]   [PANICKED] in [AfterAll] - /usr/local/go/src/runtime/panic.go:260 @ 03/26/24 09:48:32.477
[e2e-tests : e2e-test]   << Timeline
[e2e-tests : e2e-test]
[e2e-tests : e2e-test]   [PANICKED] Test Panicked
[e2e-tests : e2e-test]   In [AfterAll] at: /usr/local/go/src/runtime/panic.go:260 @ 03/26/24 09:48:32.477
[e2e-tests : e2e-test]
[e2e-tests : e2e-test]   runtime error: invalid memory address or nil pointer dereference
[e2e-tests : e2e-test]
[e2e-tests : e2e-test]   Full Stack Trace
[e2e-tests : e2e-test]     github.com/redhat-appstudio/e2e-tests/tests/build.glob..func<IP_ADDRESS>()
[e2e-tests : e2e-test]      /github.com/redhat-appstudio/e2e-tests/tests/build/build_templates.go:381 +0xa7

/retest while I look into it

/retest

Same failure, probably something I did

Re-testing after fixing the e2e change https://github.com/redhat-appstudio/e2e-tests/pull/1095

I haven't seen this in weeks

The push event PLR https://github.com/redhat-appstudio/build-definitions/runs/23138993549 for this PR fails

The push event PLR https://github.com/redhat-appstudio/build-definitions/runs/23138993549 for this PR fails

Probably doesn't matter, there were no bundle changes in this PR
The failure looks like a one-off Quay issue
[build-bundles : build-bundles] Error: could not push image to registry as "quay.io/redhat-appstudio-tekton-catalog/pipeline-docker-build:fd5815a110e54ae17de6396306ed62ca1beaf476": GET https://quay.io:443/v2/redhat-appstudio-tekton-catalog/pipeline-docker-build/blobs/uploads/: unexpected status code 405 Method Not Allowed: <!doctype html>
[build-bundles : build-bundles]
[build-bundles : build-bundles] <title>405 Method Not Allowed</title>
[build-bundles : build-bundles]
Method Not Allowed

[build-bundles : build-bundles]
The method is not allowed for the requested URL.


Edit documentation

My university technical writing course has an assignment which involves editing documentation on GitHub repositories as practice in real world settings. Edits may involve aspects like style, structure, and concision. Existing style guidelines would be taken into account. The following is one of the resources I would be using:
https://jacobian.org/writing/technical-style/
Would anyone mind if I add or propose edits to documentation in this repository? It would really help me out!

I think starter project doesn't need documentation. Try search some libs without documentation.


Replace BFF trtl client with store client

Scope of changes
This replaces the BFF trtl client with the store client interface. Previously the BFF was using namespace "collections" and directly invoking the trtl client to do PUTs/GETs to the trtl database. This has been removed in favor of a struct which embeds a store client for doing CRUD operations against the store. This will enable the BFF to be able to interact with some of the directory service objects as well.
Type of change

[ ] bug fix
[ ] new feature
[ ] documentation
[x] refactoring

Acceptance criteria
Hopefully this hasn't broken anything, I think the only external changes we will have to make is updating the names of a few environment variables.
Author checklist

[x] I have manually tested the change and/or added automation in the form of unit tests or integration tests
[ ]  I have updated the dependencies list
[ ]  I have recompiled and included new protocol buffers to reflect changes I made
[ ]  I have added new test fixtures as needed to support added tests
[x]   Check this box if a reviewer can merge this pull request after approval (leave it unchecked if you want to do it yourself)
[x]  I have moved the associated Shortcut story to "Ready for Review"

Reviewer(s) checklist

[ ] Any new user-facing content that has been added for this PR has been QA'ed to ensure correct grammar, spelling, and understandability.

Codecov Report
Base: 44.45% // Head: 44.21% // Decreases project coverage by -0.24% :warning:

Coverage data is based on head (4e59a70) compared to base (f9d8539).
 Consider uploading reports for the commit d929b89 to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #808      +/-   ##
==========================================
- Coverage   44.45%   44.21%   -0.25%
==========================================
  Files         611      613       +2
  Lines       22927    22798     -129
  Branches     1373     1373
==========================================
- Hits        10192    10079     -113
+ Misses      11426    11416      -10
+ Partials     1309     1303       -6

Flag
Coverage Δ

unittests
44.21% <ø> (-0.25%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

.../github.com/trisacrypto/directory/pkg/bff/db/db.go
25.00% <0.00%> (-34.53%)
:arrow_down:

...hub.com/trisacrypto/directory/pkg/sectigo/creds.go
43.44% <0.00%> (-21.32%)
:arrow_down:

...com/trisacrypto/directory/pkg/bff/config/config.go
53.77% <0.00%> (-2.09%)
:arrow_down:

...com/trisacrypto/directory/pkg/gds/config/config.go
76.66% <0.00%> (-1.69%)
:arrow_down:

...b.com/trisacrypto/directory/pkg/store/trtl/trtl.go
63.06% <0.00%> (-0.12%)
:arrow_down:

...c/github.com/trisacrypto/directory/pkg/gds/mock.go
73.55% <0.00%> (ø)

...ithub.com/trisacrypto/directory/pkg/store/store.go
22.50% <0.00%> (ø)

...m/trisacrypto/directory/pkg/store/config/config.go
100.00% <0.00%> (ø)

...ithub.com/trisacrypto/directory/pkg/bff/db/mock.go
50.00% <0.00%> (ø)

...trisacrypto/directory/pkg/store/leveldb/leveldb.go
45.85% <0.00%> (+0.06%)
:arrow_up:

... and 2 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


exclude config parameter does not work

Describe the bug
In an i18n case, with a page "/somePage", exclude: ['/somePage'] or exclude: ['/es/somePage'] configs don't have any effect, and the page still ends up in the individual sitemaps (e.g. es-ES-sitemap.xml)
Reproduction
https://stackblitz.com/edit/github-vty3pl-txnly4?file=nuxt.config.ts
System / Nuxt Info
------------------------------
- Operating System: Linux
- Node Version:     v18.18.0
- Nuxt Version:     3.8.1
- CLI Version:      3.9.1
- Nitro Version:    2.7.2
- Package Manager<EMAIL_ADDRESS>- Builder:          -
- User Config:      devtools, modules, content, i18n, routeRules, site, sitemap
- Runtime Modules<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>- Build Modules:    -
------------------------------

Thanks, fixed in v4.1

Thanks for looking at this. I forked the repro and upgrade to v4.1.0:
exclude: ["/somePage"] is not prefixed in the locale sitemaps exclude:
"sitemaps": {
    "index": {
      "sitemapName": "index",
      "_route": "sitemap_index.xml",
      "sitemaps": [],
      "sources": []
    },
    "en-US": {
      "include": [],
      "exclude": [
        "/somePage",
        "/_nuxt/**",
        "/api/**"
      ],
      "includeAppSources": true,
      "sitemapName": "en-US",
      "_route": "en-US-sitemap.xml",
      "_hasSourceChunk": false,
      "sources": []
    },
    "es-ES": {
      "include": [],
      "exclude": [
        "/somePage",
        "/_nuxt/**",
        "/api/**"
      ],
      "includeAppSources": true,
      "sitemapName": "es-ES",
      "_route": "es-ES-sitemap.xml",
      "_hasSourceChunk": false,
      "sources": []
    },
    "da-DK": {
      "include": [],
      "exclude": [
        "/somePage",
        "/_nuxt/**",
        "/api/**"
      ],
      "includeAppSources": true,
      "sitemapName": "da-DK",
      "_route": "da-DK-sitemap.xml",
      "_hasSourceChunk": false,
      "sources": []
    }

So //somePage ends up in the individual sitemaps.
For a prefix_and_default strategy, both /somePage and //somePage should be excluded from the default locale sitemap

Thanks, should be fixed in v4.1.1


Unable to create Bundle class object from JsonObject

Describe the bug
I'm trying to create Bundle object from jsonObject but it throws InvalidDefinitionException with error message Cannot construct instance of com.ibm.fhir.model.resource.Bundle (no Creators, like default constructor, exist): cannot deserialize from Object value (no delegate- or property-based Creator)
Environment
I'm using it for android in gradle file implementation 'com.ibm.fhir:fhir-model:4.10.2'
To Reproduce
Steps to reproduce the behavior:
Call:
val m = ObjectMapper()
val myClass: Bundle = m.readValue(credentialSubject.getAsJsonObject("fhirBundle").toString(), Bundle::class.java)
Expected behavior
It should create as a Bundle Object

You might also want to take a look at our FHIRClientImpl which uses jax-rs configured with custom components to handle the serialization/deserialization of FHIR resources. This is used extensively in the fhir-server-test project. See also FHIRJsonProvider which implements both MessageBodyReader and MessageBodyWriter

@anshul90 please let us know if the above info is helpful.

Hi, I tried as you said but still I'm unable to get the result what I need. I'm using VerifiableCredential library also since years which works fine for me.
I'm using it with Kotlin. And You can find the snippet below.
`fun Credential.fhirBundleEntry(): JsonArray? {
return if (credentialSubject?.has("fhirBundle") == true) {
val iss: InputStream? = ClassLoader.getSystemClassLoader().getResourceAsStream(credentialSubject.getAsJsonObject("fhirBundle").toString())
val bundle = FHIRParser.parser(Format.JSON).parse(iss) as Bundle
    credentialSubject.getAsJsonObject("fhirBundle").getAsJsonArray("entry")
} else null

}`
In above snippet, Bundle gets null always.


Fix the placement of the "add a config" button

Coverage remained the same at 93.759% when pulling 436d2aa73e62e36b95a0b83abbf5e47405f67d01 on SirCmpwn:fix-config-button-placement into 708111474ba958e76e117b9a81847a77c32acce7 on linode:master.

Assuming this works. mergerating.

Thanks!


Fails to locate game on secondary drive

My application uses steamlocate-rs to find the install directory of Titanfall2 (1237970).
A user of my application on Fedora 38 noticed however that it was unable to locate their install of Titanfall2.
On their setup they installed Steam via the native Fedora package.
As such their library folders are located in
~/.local/share/Steam/config/libraryfolders.vdf
~/.local/share/Steam/steamapps/libraryfolders.vdf

which (partially anonymised) looks like:
"libraryfolders"
{
    "0"
    {
        "path"        "/home/XXXXXXXXX/.local/share/Steam"
        "label"        ""
        "contentid"        "XXXXXXXXXXXXXXXXXXXX"
        "totalsize"        "0"
        "update_clean_bytes_tally"        "6504277467"
        "time_last_update_corruption"        "0"
        "apps"
        {
            "XXXXXXX"        "XXXXXXXXXX"
        }
    }
    "1"
    {
        "path"        "/mnt/0678788f-1ffe-4a12-8608-8ef3b8467106/SteamLibrary"
        "label"        ""
        "contentid"        "4113662200414089328"
        "totalsize"        "737229742080"
        "update_clean_bytes_tally"        "10119163182"
        "time_last_update_corruption"        "0"
        "apps"
        {
            "XXXXXXXXX"        "XXXXXXXXX"
            "1237970"        "68365272890"
            "XXXXXXXXX"        "XXXXXXXXX"
            "XXXXXXXXX"        "XXXXXXXXX"
        }
    }
}

Unfortunately I have not yet been able to figure out where the game detection fails (reading libraryfolders.vdf, accessing secondary drive, ...)
For detection I'm using the newest release of steamlocate, i.e. 1.2.1

Can you reproduce on the 2.0.0-alpha.0 release? It's possible there is a value in their app manifest that fails to parse on the 1.2.1 release

Aight, I'll try to push out a build with that version of the library over the next day or so and get them to test it to see if it solves it ^^

Ok, didn't get to push out a build yet but talking to the affect person again, it turns out they still had leftover files from a Flatpak install of Steam and steamlocate apparently was prioritising those and ignoring the other files?
Still trying to find out more about this...

Yeah, so to confirm, removing the leftover Flatpak Steam files, fixed the issue for the affected person.

Maybe this is useful in some way. These seem to be the installation directories of Steam on various Linux distros:
https://github.com/lutris/lutris/blob/73ea627dca06e049dcbb57222932cb82227ea576/lutris/util/steam/config.py#L13C5-L25


Always ignore top-level system components when rendering pipenv graph?

pipenv graph currently displays the dependency graph for everything visible in the environment, including the contents of system site-packages.
I'm working around that by doing:
$ pew toggleglobalsitepackages
Disabled global site-packages
$ pipenv graph
...
$ pew toggleglobalsitepackages
Enabled global site-packages

I'm wondering if it may make more sense to just always restrict the top level graph entries to items listed in Pipfile, and have two separate sections at the end for:

additional local packages (included in pip list --local, but not in Pipfile.lock)
additional global packages (included in pip list, but not in pip list --local)

I'm also thinking it would be reasonable to just not show the global packages at all - when we turn that option on, we usually know why we're doing it.

not sure how feasible this is — will investigate

I'm down for removal of anything in site-packages.

easier said than done.

If it's a pain to implement, I'd be fine with a "no change" resolution - turning site-packages access off temporarily is straightforward and explicit, and having pipenv graph spit out multiple screenfuls of text may help remind folks just why "no access to system packages" is the default behaviour.

Sounds good to me :)


Chore: Clean up and Start Documenting more

This PR completes some tests, adds some additional error checking, fixes the benighted problem with merging options (replaces deepmerge with deep-extend) and starts in on some more in-depth documentation in the README.

:+1:


Broken schema URI link on documentation landing page

URI: https://w3id.org/nmdc/nmdc

This issue was fixed in https://github.com/perma-id/w3id.org/pull/3927 by Donny, so I think it is good to be closed.


Missing Fontawesome Icons in Live Demo

The icons are missing at http://moberwasserlechner.jelastic.servint.net/vaadin-chartjs/
Maybe its vaadin 7.7.0

Invalid dependency management. theme jar was missing


Bar Graph Render Issue in 2.5.0

Hi Guys,
I am having an issue when it comes to rendering a bar graph with a large dataset (365 data points).
The bar color, width and/or gaps seem to be inconsistent which leads to the graph not displaying in a crisp manor. The issue only appears in 2.5.0 and renders perfectly in earlier versions. The issue appears differently in different browsers.
Here is the bar graph in 2.4.0:
https://jsfiddle.net/samy2k01/d5gzyxnf/
Here it is in 2.5.0 with the issue:
https://jsfiddle.net/samy2k01/Ls5qqc22/
Am I missing something?
Thanks, Sam.

@samy2k01 are you referring to how the bar edges appear to overlap? I think this is due to the way the pixels are overlapping.
Comparing between the fiddles, I noticed that the 2.5 version fits slightly differently. Maybe you could use the options.layout.padding config to add some padding on the left side to get the old behaviour back.
In the long run, I'm not sure what the best way to deal with the bars overlapping when it comes to subpixel rendering issues like this. There are a number of options (we could render at a higher resolution and then compress down as a possible example).

Hi @etimberg
Thanks for your help with this. I tried to fiddle with the options.layout.padding config but the issue seems to persist in the same manor. I wonder what causes this to occur in version 2.5
Thanks, Sam.

I think it's just how the sizing works out. We made some changes to the sizing algorithms which change the width of the chart area which then causes this. This issue was still possible in the old version, it just didn't happen for your specific chart

Understood @etimberg - thanks for the clarification.

@etimberg
you are right, #4217 is a dup of this issue.
Master still has the same problem for me.
However, if I downgrade to 2.4.0, it's all perfect :)
Please compare.
2.5.0

2.4.0

@simonbrunel @potatopeelings thoughts on this?

Any update on this? I'm having the same issue with version 2.7.2


Disable padding around highlighted rich text in the editor Output panel

Follow-up to https://github.com/godotengine/godot/pull/77114 (can be merged independently).

This prevents [bgcolor] and [fgcolor] rendering from overlapping on nearby characters (especially on the line below).
This also makes it look closer to terminal output (which never uses padding).
Testing project: test_print_rich_bgcolor.zip
Preview

Before
After

Thanks!


IDE

Could you tell me which IDE you use to debug lua in Linux ? thanks.

I recommend Lua booster
debug everywhere


Access Denied error when trying to save subtitle through a cmd command run via c# app

Here my entire code. I am getting access denied error
        private void btnSubtitles_Click(object sender, RoutedEventArgs e)
        {
            string srVideoId = "m-UVVY_syP0";
            string srBaseFolder = "C:\\style teaching\\subtitles";
            List<string> lstLanguages = new List<string>{"de", "fr"};

            foreach (var vrLang in lstLanguages)
            {
                string srSaveFiled = srBaseFolder + "\\" + "subtitle_" + vrLang + ".vtt";
                string srCmd = @$"/k youtube_transcript_api {srVideoId} --languages en --translate {vrLang} --format webvtt > ""{srBaseFolder}""";
                directExecuteCommand(srCmd);
            }

        }

       System.Diagnostics.ProcessStartInfo processInfo = new System.Diagnostics.ProcessStartInfo("CMD.exe", cmd);
            processInfo.Verb = "runas"; // This sets the process to run as administrator
            System.Diagnostics.Process.Start(processInfo);

I am using same strategy in whisper transcribe and it works very well
When I remove --format webvtt > ""{srBaseFolder}"" it works very well and prints translation

@jdepoix

Since removing --format webvtt > ""{srBaseFolder}"" fixes it, it sounds like you don't have access to the folder you are trying to write the result to.
I will close this as this is not an issue with the module.


CPOL-42 Allows pagination

I'm adding lombok, it needs IDE configuration to function properly:
Eclipse: https://projectlombok.org/setup/eclipse
Intelli: https://projectlombok.org/setup/intellij

Updated the code:

no more lombok, added the builder and getters.
NFE are reported to the client, but still using defaults if page or pagePerItem are not passed.


kraft: 0.7.3 -> 0.7.5

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for kraft is: Build and use highly customized and ultra-lightweight unikernel VMs
meta.homepage for kraft is: https://github.com/unikraft/kraftkit
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.7.4 with grep in /nix/store/v7c6z6jxgic6fiwy426yrlwgxvidsxi2-kraftkit-0.7.4
found 0.7.4 in filename of file in /nix/store/v7c6z6jxgic6fiwy426yrlwgxvidsxi2-kraftkit-0.7.4

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
kraft

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/v7c6z6jxgic6fiwy426yrlwgxvidsxi2-kraftkit-0.7.4 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A kraft https://github.com/r-ryantm/nixpkgs/archive/a1d8c05196ebc3a3891f05993f4141ed981261a2.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/a1d8c05196ebc3a3891f05993f4141ed981261a2#kraft

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/v7c6z6jxgic6fiwy426yrlwgxvidsxi2-kraftkit-0.7.4
ls -la /nix/store/v7c6z6jxgic6fiwy426yrlwgxvidsxi2-kraftkit-0.7.4/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

kraft

Maintainer pings
cc @dit7ya for testing.

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for kraft is: Build and use highly customized and ultra-lightweight unikernel VMs
meta.homepage for kraft is: https://github.com/unikraft/kraftkit
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.7.5 with grep in /nix/store/jpnv15qp507hxc8z6mbc6kr0vdr5m8w3-kraftkit-0.7.5
found 0.7.5 in filename of file in /nix/store/jpnv15qp507hxc8z6mbc6kr0vdr5m8w3-kraftkit-0.7.5

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
kraft

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/jpnv15qp507hxc8z6mbc6kr0vdr5m8w3-kraftkit-0.7.5 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A kraft https://github.com/r-ryantm/nixpkgs/archive/7a86bbde701ae9364379fed57930b5e7eb994bb8.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/7a86bbde701ae9364379fed57930b5e7eb994bb8#kraft

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/jpnv15qp507hxc8z6mbc6kr0vdr5m8w3-kraftkit-0.7.5
ls -la /nix/store/jpnv15qp507hxc8z6mbc6kr0vdr5m8w3-kraftkit-0.7.5/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

kraft

Maintainer pings
cc @dit7ya for testing.


Enable authentication check on all routes

What this PR does / why we need it:
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
Release note:

/hold waiting for delivery-service consumers to adjust


Visual selection doesn't include char under cursor

The visual selection doesn't include the character under the cursor. For example, in the selection below, pressing y copies only "packag" not "package".

This differs from VIM and other VIM emulation modes, where the character under the cursor is part of the selection. And would be copied.
The problem applies not only to copying/yanking but also to deleting and pasting.

Comparing monaco-vim implementation vs CodeMirror or VsCode Vim, it seems that neither vim emulation system does this in the same way as Vim does. However, the other two systems handle this edge case by allowing selection of the last character of a line, moving the cursor past the last character of a line for mouse selection. monaco-vim cannot select the last character of a line.


Comment & Likes not deleting

It seems my comments and likes are not deleting when using this tool. Anyone else experiencing this issue?

Are you getting any feedback? I don't get anything, it gives me options of years, months, type and then I get nothing. Checking the activity log on fb nothing has been deleted. A verbose mode or some logging would be handy

Are you getting any feedback? I don't get anything, it gives me options of years, months, type and then I get nothing. Checking the activity log on fb nothing has been deleted. A verbose mode or some logging would be handy

No feedback. As an example, I ask the program to delete all comments and likes for the year 2015, the program closes as if it was successful without deleting anything.

It shouldn't happen that you get no output. Could you send the entire output of the program? That could help to understand why it's not collecting entries.

It shouldn't happen that you get no output. Could you send the entire output of the program? That could help to understand why it's not collecting entries.


Wire in the guard to make it evident that we have it when making ch…

…anges that require it.

Clean up some old members and code not used any more.

@vekterli or @geirst PR

@toregge please take a look as well.

@geirst Fixed, PTAL


update the translation of NLP-pretrain part

Just update 1 translation of NLP-pretrain part, nothing else has been changed. not sure why the previous merged PRs are listed again in this PR.

Job d2l-zh/PR-1007/4 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-1007/


Remove dependabot integration

Manually reviewing the PRs is an additional headache we don't want to take. We will update the dependencies manually like we do for server.

Merge merge merge!!


Appstudio update test-component-pac-gaqq

Pipelines as Code configuration proposal

Pipelines as Code CI/test-component-pac-gaqq-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
9 seconds
appstudio-init

✅ Succeeded
11 seconds
clone-repository

✅ Succeeded
8 seconds
appstudio-configure-build

✅ Succeeded
10 seconds
sast-snyk-check

✅ Succeeded
43 seconds
build-container

✅ Succeeded
17 seconds
sanity-inspect-image

✅ Succeeded
14 seconds
deprecated-base-image-check

✅ Succeeded
1 minute
clamav-scan

✅ Succeeded
14 seconds
clair-scan

✅ Succeeded
21 seconds
sbom-json-check

✅ Succeeded
10 seconds
sanity-label-check

✅ Succeeded
11 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
show-summary

Pipelines as Code CI/test-component-pac-gaqq-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
6 seconds
appstudio-init

✅ Succeeded
17 seconds
clone-repository

✅ Succeeded
16 seconds
sast-snyk-check

✅ Succeeded
15 seconds
appstudio-configure-build

✅ Succeeded
31 seconds
build-container

✅ Succeeded
24 seconds
sbom-json-check

✅ Succeeded
48 seconds
clamav-scan

✅ Succeeded
18 seconds
deprecated-base-image-check

✅ Succeeded
12 seconds
clair-scan

✅ Succeeded
19 seconds
sanity-inspect-image

✅ Succeeded
9 seconds
sanity-optional-label-check

✅ Succeeded
11 seconds
sanity-label-check

✅ Succeeded
7 seconds
show-summary

Pipelines as Code CI/test-component-pac-gaqq-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
6 seconds
appstudio-init

✅ Succeeded
17 seconds
clone-repository

✅ Succeeded
16 seconds
sast-snyk-check

✅ Succeeded
15 seconds
appstudio-configure-build

✅ Succeeded
31 seconds
build-container

✅ Succeeded
48 seconds
clamav-scan

✅ Succeeded
19 seconds
sanity-inspect-image

✅ Succeeded
24 seconds
sbom-json-check

✅ Succeeded
12 seconds
clair-scan

✅ Succeeded
18 seconds
deprecated-base-image-check

✅ Succeeded
11 seconds
sanity-label-check

✅ Succeeded
9 seconds
sanity-optional-label-check

✅ Succeeded
7 seconds
show-summary


With the most recent HP System updates, this has stopped working.

My Omen installed an update from HP 2 days ago and now the registry 8613 redirection trick seems to no longer work.
It keeps insisting on wanting to install an Omen Command Center app from the AppStore which I promptly uninstalled but the old behaviour is not restored. The Omen Command Center wasn't an App store packaged app previously so I'm guessing that's the cause of the change.
It seems to be ignoring the 8613 mapping and always using an omencommandcenter protocol in HKEY_CLASSES_ROOT. I tried adding send-home as the shell/open/command handler for that instead which stops nagging about the App store but the home key only works at the console (and much more slowly then before) but not inside other GUI applications, largely because I think shell/open/command is taking the focus elsewhere first. Grrrr!
Any ideas?
I'm not sure how to revert to the old HP System Event version or if that's even possible without nasty side effects.

Fixed.
I checked all the versions of the HPWMISVC.exe and HPMSGSVC.exe and they were still dated back 2018. Then I noticed that as well as there being an App store version of the Omen Command Center, there was an App store version of the HP System Event Utility now installed too.
Uninstalling that App as well restored the 8613 handling that HPMSGVC.exe does.
Phew!
Now, if only HP would allow Omen and Fn+Omen to be swapped around, that would be so much better.


Running into redirect issue when using Instance M365, Azure seems to work fine though

I am receiving the following error after completing the interactive login/MFA:
AADSTS50011: The redirect URI 'https://login.microsoftonline.us/organizations' specified in the request does not match the redirect URIs configured for the application 'fb78d390-0c51-40cd-8e17-fdbfab77341b'. Make sure the redirect URI sent in the request matches one added to your application in the Azure portal. Navigate to https://aka.ms/redirectUriMismatchError to learn more about how to fix this.
This occurs when I run
$param = @{
Instance = 'Microsoft365';
Analysis = 'ExchangeOnline';
PromptBehavior = 'SelectAccount';
Environment = 'AzureUSGovernment';
ExportTo = 'HTML';
}
Invoke-Monkey365 @param
I don't see app fb78d390-0c51-40cd-8e17-fdbfab77341bin Azure AD at all

Hey @mike16329,
Thanks for submitting this. That error is rare, as it seems that the reply url is correct for GCC environments as explained here.
Could you please elaborate? Could you please also check if you can connect through exchange online Powershell module?
Thanks

Of course. I extracted the zip for monkey365-main and renamed it Monkey365 and placed it in program files. I then import it with the command Import-Module C:"program files"\monkey365,the command seems to work successfully and shows no errors. I then, from the C:"program files"\monkey365 directory, ran
$param = @{
Instance = 'Microsoft365';
Analysis = 'ExchangeOnline';
PromptBehavior = 'SelectAccount';
Environment = 'AzureUSGovernment';
ExportTo = 'HTML';
}
Invoke-Monkey365 @param
It brings up the interactive login box, I log in with my global admin GCCH account, complete MFA, and then it gives me the URI redirect error. I am able to successfully log into the exchange online PowerShell module using the following command format Connect-ExchangeOnline -UserPrincipalName<EMAIL_ADDRESS>-ExchangeEnvironmentName O365USGovGCCHigh

Hi @mike16329,
Firstly, thank you for replying so promptly and thanks for letting me know about this issue. It's really appreciated.
I had faced this problem when authentication library for Desktop is used, and after researching a bit into the MS documentation I think where the problem is, so I just updated the develop branch with an small update.
Could you please check if it works for you?
Thanks in advance,

Hi @mike16329,
It is confirmed that MS documentation is wrong regarding Reply Urls with GCC tenants. Documentation states that Reply Url for GCC High is https://login.microsoftonline.us/organizations, which is wrong and should be https://login.microsoftonline.us/organizations/oauth2/nativeclient for .NET applications.
The dev branch was updated and main branch will be updated with this fix among others on this week.
References
https://login.microsoftonline.us/organizations/oauth2/nativeclient
Cheers,

Fixed in main branch.
Cheers,


Uninstalling doesn't fully uninstall

I tried uninstalling and reinstalling the program, as there was a bug, I tried to fix, but the settings are still there even after a restart after the uninstall.
Steps to reproduce the behavior:

Uninstall Program
Restart
Installing the program
Settings are still there

My logical thinking is, that when I uninstall the program, that everything also the settings should be deleted.

Model: Dell G15 5515
OS: Windows 11

Yes, it's true. Setting is not wiped at uninstall - in this case you will need to restore it any app update.
Instead, (as mentioned into tools readme - it's good idea to read it) i have alienfx-config too to manage configuration (backup/restore/delete). Check it.

how do I install alienfx-config?

It's among the tools, installed into the same folder.

I found it but it instantly closed after opening
https://github.com/T-Troll/alienfx-tools/assets/161766591/9eafe55c-f01e-4b69-969d-41868d2f3541

Uff....

Read project readme
Open CMD
Run it from it with parameters mentioned

Sorry for the unnecessary questions. I now got it deleted, but even now after a fresh reinstall it still happens that the fans just idle at 600 RPM no matter the temperature and only begin to spin again if I change the power mode to G mode, and switch back.

It's a well-known bug of some hardware - fans stuck at low.
I fight it permanently, but it back again for new firmware....
Try to:

Set "Restore power mode" in settings.
Quit GUI
Set non-manual mode using alienfan-cli
Start GUI again

In this case, it will switch modes every time GUI/system start.

What is the command for the non manual mode

Quit GUI, but set "Restore power mode" in settings before it.
Open Administrator CMD.
Navigate to the tools folder (cd command)
Run alienfan-cli getpower
You will see how much power modes your system have (at the first line) and current power mode next line (it will be Manual (0) most probably
Run alienfan-cli setpower=X, there X is something bigger, then 0 but lower, then total power modes you have
Look at the fans reaction (f.e. issuing alienfx-cli rpm)
In case it is OK, just keep it and run GUI

Thanks! Seems to be working now.

Being honest, better downgrade BIOS as well - this bug can return in case mode will be still manual at system start.

Sure? Doesn’t the bios also have an effect on the security of the system?

No one use flaws in "security" they patch.
The facts are you fans stuck in 0 boost then system start into Manual mode. And it's a bug.
Do as you wish, i've just provide information.

Ok I didn’t know that. if the problem reoccurs I will downgrade the bios.


Container fails to start

Got an error after updating docker and trying to start container
System: Ubuntu 20.04
Docker version: 20.10.21
It's a ftb server so no version specified
Also I'm using rancher for my containers
Docker logs say:
[init] Running as uid=1000 gid=1000 with /data as 'drwxrwxr-x' 19 1000 1000 4096 Nov 16 09:50 /data'
[mc-image-helper] 14:50:16.975 ERROR : 'get' command failed: launchermeta.mojang.com: Temporary failure in name resolution
[init] ERROR: version lookup failed

I had cloudflare warp installed and it somehow blocked this specific container


Pretrained weights link not working

Please update the Google Drive weights link

Hi, have you found the link address of the pretrained weights?

Hi, have you found the link address of the pretrained weights?


feat(response): add batch operation response

What type of PR is this?
type-feature

What this PR does / why we need it:
add batch operation response
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

Additional documentation e.g., usage docs, etc.:

@yizhouxw I've implemented your suggestion, please take a look when you have a chance


Export-RubrikDatabase occasionally issues - TerminatingError(Invoke-WebRequest): "The operation has timed out."

When using Export-RubrikDatabase, I occasionally get a time-out error (even though the gui shows the export still running).
Waiting for restore to complete - (Wednesday, July 29, 2020 6:24:08 AM) - (41.82%)
PS>TerminatingError(Invoke-WebRequest): "The operation has timed out."

TerminatingError(Invoke-WebRequest): "The operation has timed out."
TerminatingError(Invoke-WebRequest): "The operation has timed out."
TerminatingError(Invoke-WebRequest): "The operation has timed out."

There should be a way to control the Time-Out interval when using Export-RubrikDatabase
Expected Behavior:
Allow the use of a Time-Out parameter that could be set to indefinitely
Steps to Reproduce:
I cannot always reproduce this situation.  The event fails occasionally
Context:
I'm using sdk 5.0.2 of the Rubrik sdk
I saw some documentation on the internet about
Set-RubrikModuleOption -OptionName DefaultWebRequestTimeOut -OptionValue 30
I tried that command, but received an error, so I am unclear as to how I can control the default web request time out value for an operation.
DefaultWebRequestTimeOut doesn't exist in options file.

Hi @ShodginGitHub - just noticing this issue you filed as well.
You should be able to change the value with the command you ran - can you please post the error message you received?

Ok, disregard my ticket regarding my inability to change the timeout value – I’ve gotten this working on my side
Scott Hodgin
Database Administrator, MCITP
(Protect and Serve)
South Carolina Farm Bureau Insurance Company
shodgin<EMAIL_ADDRESS>From: Mike Preston<EMAIL_ADDRESS>Sent: Wednesday, July 29, 2020 4:36 PM
To: rubrikinc/rubrik-sdk-for-powershell<EMAIL_ADDRESS>Cc: Hodgin, Scott<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: [ External Email ] Re: [rubrikinc/rubrik-sdk-for-powershell] Export-RubrikDatabase occasionally issues - TerminatingError(Invoke-WebRequest): "The operation has timed out." (#666)
WARNING: This email was received from outside of SFB's email system. DO NOT CLICK LINKS or ATTACHMENTS in this email unless you recognize the sender and are sure that it is safe to do so.
Hi @ShodginGitHubhttps://github.com/ShodginGitHub - just noticing this issue you filed as well.
You should be able to change the value with the command you ran - can you please post the error message you received?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/rubrikinc/rubrik-sdk-for-powershell/issues/666#issuecomment-665913014, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHC35GCEHTJX4CGHGOEZ7LDR6CB4TANCNFSM4PLPG2FA.

This issue should be resolved with #668 to the devel branch - will cut a release to master shortly


Case insensitive keys for relation models

What steps will reproduce the problem?
 $dataProvider = new ActiveDataProvider([
            'query' => $query->joinWith(['someCaseInsensitiveRelation']),
        ]);

What is the expected result?
So If I make request without dataProvider, I have got all related models:

What do you get instead?
but if I using dataProvider related models will be empty

Additional info
It's happens because model keys case sensitive. For example I using Postgres citext or for MySQL (for utf8) my on condition case insensitive (luke = Luke).
I suggest add optional feature for this. May be useCaseInsensitiveKeys = false or something else? It might looks like:
//vendor/yiisoft/yii2/db/ActiveRelationTrait.php

    private function normalizeModelKey($value)
    {
        if (is_object($value) && method_exists($value, '__toString')) {
            // ensure matching to special objects, which are convertable to string, for cross-DBMS relations, for example: `|MongoId`
            $value = $value->__toString();
        }

        return $this->useCaseInsensitiveKeys ? strtolower($value) : $value;
    }

any suggestions?

Q
A

Yii version
<IP_ADDRESS>

PHP version
7.0.2

Operating system
MacOs 12.4

related to #9077

Won't be done in 2.0 but could be considered for 3.0.


How to Defined [ Service Avg Throughput ]

Please answer these questions before submitting your issue.

Why do you submit this issue?
Question or discussion

Question

Our bussiness system have one service named generalxxx-app, and this service contains six instance。i see every instance's  Avg Throughput is 3.4k cpm。but generalxxx-app service Avg Throughput  is 7.095k cpm 。In my understanding, shouldn't the Avg Throughput of service be the sum of the Avg Throughput of all instances？  What should it be？

Logically, it should. But why it isn't, I am not sure. Check the storage persistence, maybe some OPs have error.


Add a default timeout to $.request

I think that a case can be made in either direction for whether or not $.request should have a default timeout (as of now, it does not have one). Since the principle use case of dax is as a scripting tool, presumably it will frequently have uses in:

CI / CD pipelines
Background processing tasks

and other places where it can be reasonably expected that a human is not sitting there watching a script proceed (and able to notice that a request is hung due to any number of potential issues).
Due to the fact that the current implementation makes no distinction between the various parts of making a request (and I don't know if it even reasonably can while remaining a simple fetch under the hood) such as the time it takes to connect, to lookup DNS, to actually download the data, etc, I think it makes sense to have this default timeout be "generous" within the context of calling an API or downloading a webpage. I would suggest something like 60_000 (one minute) as the default.
I looked around at default http clients from different ecosystems (ruby, php, go, etc) and found that it's pretty common not to have a default timeout, so the precedent is definitely there to keep it as is, but in my opinion it makes sense to have a default for the role that dax fills.
Thanks for considering!

I don't think this should be done because the default timeout value to pick depends on the scenario. Generally on CIs people will have an overall CI timeout and if they would like to use one on requests then they can build their own $ with a default $.request timeout that works for their situation.
For example, say we add the default timeout to be 1 minute. Occasionally on GitHub CIs something might just hang for 2 minutes or so before completing successfully. Us not having a timeout means that request completes after 2 minutes successfully and the CI completes successfully. Us having a timeout means we fail that request and the CI run fails. So it might end up annoying people quite a bit if we introduce a default timeout (even if it's from 1 hour... somewhat related, I once had a 1 hour 30 minute bulk update program timeout on me while it was progressing and that was not very pleasant).
By the way, looking at the API I realized that there was no way to specify a delay string like "1s" to RequestBuilder#timeout. I fixed that in #91. I'll do a release a bit later today.

Ya, that's for sure possible, and your stance makes sense!
Thanks for taking a look, feel free to close if you think it's not the right default to provide. Also, thanks for #91, cheers!


Feature Request: Add ISO code property to country's object

Hi there, thanks for providing such a cool solution.
I'm currently playing around with your API trying to implement map visualization via https://www.react-simple-maps.io/.
The problem I'm facing right now is that I can't match some of the countries.
It would be mad cool if you could add ISO property to the country's object for such cases as well as unification in general.
Best wishes ✌

A quick example of possible variant:
{
  provincestate: "Guizhou",
  countryregion: "Mainland China",
  ISO_A2: "CN",
  ISO_A3: "CHN",
  lastupdate: "2020-03-03T11:42:00.006Z",
  location: {
    lat: 26.8154,
    lng: 106.8748
  },
  confirmed: 146,
  deaths: 2,
  recovered: 114
},

Also, please let me know if you have time for this feature, in case if you're busy I'll be more than happy to help you out by submitting a pull request with the updated object model.

Thank you for the feature request.
I am going to do it ASAP!

@yastrebovb new feature has been added 😃
  {
    "provincestate": "Anhui",
    "countryregion": "Mainland China",
    "lastupdate": "2020-02-29T07:21:21.001Z",
    "confirmed": 990,
    "deaths": 6,
    "recovered": 821,
    "location": {
      "lat": 31.8257,
      "lng": 117.2264
    },
    "countrycode": {
      "iso2": "CN",
      "iso3": "CHN"
    }
  }

@Laeyoung Thank you 😊


Tiny Contribution

@vikjITA thank you for the pull request. but please use PoEditor to edit the language files. :)


Unable to build, missing scala package

Resolving dependencies...
Configuring eta-spark-<IP_ADDRESS>...
Building eta-spark-<IP_ADDRESS>...
Failed to install eta-spark-<IP_ADDRESS>
Build log ( /home/e/.etlas/logs/eta-<IP_ADDRESS>/eta-spark-<IP_ADDRESS>-7ff8V9lSSWZ9EXhvpzvsij.log ):
etlas: Entering directory '.'
Configuring eta-spark-<IP_ADDRESS>...
Preprocessing library for eta-spark-<IP_ADDRESS>..
Building library for eta-spark-<IP_ADDRESS>..

src/Spark/Core/Internal/Types.hs:8:8: error:
    Could not find module ‘Scala’
    Use -v to see a list of the files searched for.
  |
8 | import Scala
  |        ^^^^^
etlas: Leaving directory '.'
etlas: Error: some packages failed to install:
eta-spark-<IP_ADDRESS>-7ff8V9lSSWZ9EXhvpzvsij failed during the building phase. The
exception was:
ExitFailure 1

@qhua948 Should be fixed with the latest version. Can you confirm?

@andreabedini Thanks for bringing this up.
--allow-newer-base is a default in the latest etlas (v<IP_ADDRESS> and above).


Extracting 7z file throwing an error

Hi, I am using this library to unzip a .7z file I found required for my code and this library doesn't seem to extract the 7z file properly. Every time I try to unzip the file, it throws me this error
net.lingala.zip4j.exception.ZipException: zip headers not found. probably not a zip file
So does this mean I cannot unzip a 7z file using this library?

Zip4j, as the title in readme suggests, only works with zip files and not 7z.

Thanks for the quick reply. I started using zip file for the process and your library is very helpful and fits in the size constraint of the application.
Thank you for this awesome library, sir.

@srikanth-lingala Does this library still not support 7z?


Compilation error if dimensions of state or inputs are one

This error in general happens if the dimension of a variable that should be defined as an array is 1. In this case, the decVar functions declare a scalar, which results in a compilation error when due to it being accessed as an array in the code (i.e., with [i]).
This is a problem because it means that the toolbox does not currently work for SISO systems, nor for systems with a single inputs.
To solver this, we need to rethink how variables are declared. In particular, which should be the fields of the dictionary passed to the decVar function. And if they should be so restricted to only having 5 fields, as is currently the case.

This issue was fixed in 92f5f9b4f321912eb0afe1439d101f998dfcf8ad.
I will close the issue once these changes have been merged into the main branch.

This issue is now fixed in the master branch.


[BUG] VMs get stuck in paused/unpause loop while Longhorn replicas are being recreated

Describe the bug
VMs are stuck in a pause/unpause loop during Longhorn volume repair when one of harvester nodes had a temporary network disruption.
VMs that are running on the harvester node that was not disconnected are also doing the pause/unpause loop. They become stable once longhorn finished recreating the replica volume on the node that was disconnected.

In the events I see the following reason:
VirtualMachineInstance home-cluster-worker-7d7dacea-pchf9
VM Paused due to IO error at the volume: disk-0

Longhorn recreating the replicas

To Reproduce

Create 2 harvester nodes
Deploy VMs on both of them
Temporary disconnect network on harvester node 2

Expected behavior
VMs to keep running on harvester node 1
Support bundle
Environment

Harvester ISO version: v1.2.1
Underlying Infrastructure (e.g. Baremetal with Dell PowerEdge R630): node 1 running on Dell R730, node 2 running on a repurposed intel i9 desktop computer

Additional context

Hey there.  Please see issue https://github.com/harvester/harvester/issues/4739
Basically, disable fstrim in the vms.
Regards.

Oh interesting! Thanks for referencing the existing issue!
Looks like this was also fixed upstream in Longhorn 🤔 https://github.com/longhorn/longhorn/issues/7103

Yes - but Harvester 1.2.1 has longhorn 1.4.3 - it is fixed in later versions of harvester (therefore later longhorn versions)


Remove the link to the govuk help page about cookies

cc. @edwardhorsford.

Thanks @gemmaleigh. IMHO this is safer for us.


Proposal for handling "(anonymous model)" in docs

See: https://github.com/microsoft/typespec/issues/1972

You can try these changes at https://cadlplayground.z22.web.core.windows.net/prs/2798/
Check the website changes at https://tspwebsitepr.z22.web.core.windows.net/prs/2798/


Possible session leak

I have the feeling there is a session leak in the server code in case the server gets "too many" messages.
This is the scenario:

Use the subs.rs example

Instead of returning Ok() in the publish method, use:
tokio::time::sleep(Duration::from_secs(1)).await;
Err(MyServerError)

Implement Drop for MySession, print out something

Now when you send one message, it processes it, fails, closes the connection and prints out the message from drop.
If you send e.g. 20 messages at once, it processes all of the, closes the connection, but doesn't print out the message. This is pretty reproducible.
My assumption is, the session is still lingering somewhere.

I found cause of the problem, this is deadlock on protocol level. I don't think it is possible to fix this problem. I will try to mitigate it with keep-alive timer.
v3 server has in-flight limit, but default it is 16 message, if client sends 16 publishes server stops reading from socket, implementation of publish service in subs example sends publishes to client and expect ack before it ack's client's publish, but if server stops reading incoming data it cannot read ack from client so all inflight publishes stays in queue and never resolves.

Tricky. Wouldn't it work if (in this case) the socket would be closed, and so at least the session could be cleaned up? Sending either a "peer gone" event, or some dedicated "session overflow" event?

problem is that we pause read/write operations  on socket, we cannot get disconnect event from it. i’ve been thinking about timeout if socket operations stop, i will try to build something next couple days


x/telemetry/internal/counter: TestStack fails if test function name is slightly longer

https://github.com/golang/telemetry/blob/2375252a9134bc3b5cb502adb82264656851a7b9/internal/counter/counter_test.go#L363C7-L363C7
This function f is currently used to test the stack counter's behavior.
If we rename it to something slightly longer, e.g. recursiveFn, the test starts to fail due to the truncated counter name.
Currently, stack counter names are constructed by concatenating full func loc info in a call stack https://github.com/golang/telemetry/blob/2375252a9134bc3b5cb502adb82264656851a7b9/internal/counter/stackcounter.go#L62 The function loc info is of the form <package>.<func>:<linenumber> and the package path itself can be long, and the concatenation can easily exceed maxNameLen (=256).
It looks like we need more efficient encoding & datastructure for the stack info.
cc @pjweinb @jamalc @rsc

My initial reaction is that it would be better to increase maxNameLen if
this is really a problem. (fixing the test is not a real problem: don't
rename the function)  In the general case each stack frame comes from a
different import path. Of course, the package, function, line number, and
punctuation come from a limited alphabet, and could be compressed in
various ways, Any fixed maxNameLen, though, suggests that stack counters
should only report a small number of frames.
On Wed, Jul 5, 2023 at 12:26 PM Hyang-Ah Hana Kim @.***>
wrote:

https://github.com/golang/telemetry/blob/2375252a9134bc3b5cb502adb82264656851a7b9/internal/counter/counter_test.go#L363C7-L363C7
This function f is currently used to test the stack counter's behavior.
If we rename it to something slightly longer, e.g. recursiveFn, the test
starts to fail due to the truncated counter name.
Currently, stack counter names are constructed by concatenating full func
loc info in a call stack
https://github.com/golang/telemetry/blob/2375252a9134bc3b5cb502adb82264656851a7b9/internal/counter/stackcounter.go#L62
The function loc info is of the form .: and
the package path itself can be long, and the concatenation can easily
exceed maxNameLen (=256).
It looks like we need more efficient encoding & datastructure for the
stack info.
cc @pjweinb https://github.com/pjweinb @jamalc
https://github.com/jamalc @rsc https://github.com/rsc
—
Reply to this email directly, view it on GitHub
https://github.com/golang/go/issues/61181, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABJIAIZCZQVESFBINPZC7JTXOWIS3ANCNFSM6AAAAAAZ7GEAOY
.
You are receiving this because you were mentioned.Message ID:
@.***>

We will try

increase the maxNameLen (and the page size)
apply a simple name compression rule in counter name generation.  (the same rule should be applied in upload and upload server's counter validation)


Link support. Open API v3

Hi
Does NSwag support open API 3 link objects? If so: where is the documentation?
Im not interested in client generation, but server side documentation generation. Im trying to make our API consumable by robots and this feature would help a lot.
https://swagger.io/docs/specification/links/
I need to able to define relation between multiple objects so the robots understand it. If this is supported how would it work? Data attributes at model level or how? Im looking for solution for our .net API and cant find anything :/

No this is not supported yet. How would you envision the api for that?

Duplicate of: https://github.com/RSuter/NSwag/issues/1405


backAndroidHandler/onBackAndroid/onExitApp not triggered on Actions.refresh

Version
Tell us which versions you are using:

react-native-router-flux v3.7.0
react-native v0.37

My case is: if this.state.isValueChanged is false, show save confirmation dialog if press back.
componentWillMount() {
  Actions.refresh({
      title: 'Kontak Restoran',
      renderRightButton: this.renderUpdateButton,
      backAndroidHandler: this.handleBackAndroidHandler,
      onBackAndroid: this.handleBackAndroidHandler,
      onExitApp: this.handleBackAndroidHandler,
  })
}

handleBackAndroidHandler =  () => {
    console.log('foo')
}

renderUpdateButton = () => {
  console.log('bar')
}

Expected behaviour
on page loaded, show foo in console.
when back android button pressed, show bar in console.
Actual behaviour
on page loaded, show foo in console.
when back android button pressed, console didn't show bar
I already test with debugger, and function not triggered.

I didn't know about this functionality. In my app, I'm currently using
BackAndroid.addEventListener('hardwareBackPress', () => Actions.pop());

Yes, I'm using hardwareBackPress event too. But it's not enough because my case is to trigger something before back button in device or navbar is pressed .

me too。 use onBackAndroid  cannot refresh 。 so  when  action.pop need refesh I use   RCTDeviceEventEmitter.emit()
componentWillUnmount() {
if(device.android){
RCTDeviceEventEmitter.emit('update'Id)
}
}


ShapeShifter export gif or video

Hi!
My name is David and i'm Android Developer.
I use ShapeShifter online application.
Please help me.
How to export to GIF or Video?
Thank you!
Dave

I'm also interested in this.


Cilium timeout error for Arm64

@André Martins,
I tried running the smoketest.yaml with CircleCi, and I am getting the below time out error for deployment pods.
timed out waiting for the condition on deployments/pod-to-a-denied-cnp
timed out waiting for the condition on deployments/pod-to-b-multi-node-nodeport

Logs of Circleci for reference: https://app.circleci.com/pipelines/github/odidev/cilium/1/workflows/64e57aaa-d0ae-4570-8477-6a23485378e3/jobs/1
Config.yml file for reference: https://github.com/odidev/cilium/blob/master/.circleci/config.yml
It would be helpful if you could share some points for the above issue.

@tgraf ,could you please look into the above issue?

@odidev have you tried deploy cilium with cilium-cli?

@ aanm, I have tried to deploy cilium in cilium-cli by using the make install command, which is present in the Readme.md file. I have verified where those cilium binaries are present. They are present in the /usr/local/bin/ directory.
I have tried to run the Kind.yaml using GitHub actions for amd64 and arm64. For amd64, the connectivity test fails. For arm64 architecture, by using the GitHub runner it is failing to build and install cilium CLI binary. Please have a look at the logs:
Logs of Amd64 architecture: https://github.com/anilreddypuresoftware/cilium-cli/actions/runs/3435021657/jobs/5726905326
Logs of Arm64 architecture: https://github.com/anilreddypuresoftware/cilium-cli/actions/runs/3436250524/jobs/5729557404
Also, in cilium package I was facing timeout error in the smoketest.yaml file. Due to this time out error some pods are not running. It would be helpful if you could share some pointers for the test issue.
Logs of Circleci for reference: https://app.circleci.com/pipelines/github/odidev/cilium/1/workflows/64e57aaa-d0ae-4570-8477-6a23485378e3/jobs/1
Config.yml file for reference: https://github.com/odidev/cilium/blob/master/.circleci/config.yml

Traffic is dropped with the following logs:
  ❓ [79] Nov 10 08:25:07.018: test-namespace/client2-f6bf998db-wtts5:58976 -> one.one.one.one:80 from-endpoint FORWARDED TRAFFIC_DIRECTION_UNKNOWN DROP_REASON_UNKNOWN (TCP Flags: ACK)
  ❓ [80] Nov 10 08:25:07.018: test-namespace/client2-f6bf998db-wtts5:58976 -> one.one.one.one:80 to-proxy FORWARDED EGRESS DROP_REASON_UNKNOWN (TCP Flags: ACK)
  ❓ [81] Nov 10 08:25:07.018: test-namespace/client2-f6bf998db-wtts5:58976 -> one.one.one.one:80 from-endpoint FORWARDED TRAFFIC_DIRECTION_UNKNOWN DROP_REASON_UNKNOWN (TCP Flags: ACK, FIN)
  ❓ [82] Nov 10 08:25:07.018: test-namespace/client2-f6bf998db-wtts5:58976 -> one.one.one.one:80 to-proxy FORWARDED EGRESS DROP_REASON_UNKNOWN (TCP Flags: ACK, FIN)
  ❓ [83] Nov 10 08:25:07.019: one.one.one.one:80 -> test-namespace/client2-f6bf998db-wtts5:58976 from-proxy FORWARDED TRAFFIC_DIRECTION_UNKNOWN DROP_REASON_UNKNOWN (TCP Flags: ACK, FIN)
  ❓ [84] Nov 10 08:25:07.019: one.one.one.one:80 -> test-namespace/client2-f6bf998db-wtts5:58976 to-endpoint FORWARDED EGRESS DROP_REASON_UNKNOWN (TCP Flags: ACK, FIN)
  ❓ [85] Nov 10 08:25:07.019: test-namespace/client2-f6bf998db-wtts5:58976 -> one.one.one.one:80 from-endpoint FORWARDED TRAFFIC_DIRECTION_UNKNOWN DROP_REASON_UNKNOWN (TCP Flags: ACK)
  ❓ [86] Nov 10 08:25:07.019: test-namespace/client2-f6bf998db-wtts5:58976 -> one.one.one.one:80 to-proxy FORWARDED EGRESS DROP_REASON_UNKNOWN (TCP Flags: ACK)

@ aanm, I have tried to deploy cilium in cilium-cli by using the make install command as per Readme.md file. I have verified that cilium binaries installation. It is present in the /usr/local/bin/ directory.
I also tried to run the Kind.yaml using GitHub actions for amd64 and arm64(using self-hosted agent). For both architectures it is deployed successfully.
For arm64 architecture, I have used self-hosted runner to deploy in GHA.
I have added self-hosted runner by using this link: https://github.com/odidev/cilium-cli/settings/actions/runners/new?arch=arm64&os=linux
Please have a look at the logs:
Workflow file of self-hosted runner: https://github.com/odidev/cilium-cli/actions/runs/3477322438/workflow
Logs of Amd64 architecture: https://github.com/odidev/cilium-cli/actions/runs/3477539409/jobs/5813819478
Logs of Arm64 architecture: https://github.com/odidev/cilium-cli/actions/runs/3477322438/jobs/5813364222

@aanm, Could you please share your feedback regarding the above issue.


update to senzing 3.6

update to use new docker images and senzing 3.6

PR merged, release published


pip-compile fails with MetadataGenerationFailed when psycopg2 is in requirements.in

When I use psycopg2 in my requirements.in file then pip-compile fails and throw an exception and does not generate a requirements.txt file. I am using venv but that should not cause a problem.
# ------- Example requirements.in file which does not compile ------------
psycopg2

# ------- Example requirements.in file which DOES compile ------------
Django<4.0

Environment Versions

OS Type: Amazon Linux 2 (amzn2-ami-hvm-2.0.20210427.0-x86_64-gp2)
Python version:  Python 3.7.10
pip version: pip 22.0.3 from /mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip (python 3.7)
pip-tools version: pip-compile, version 6.5.1

The currently installed packages in this venv are:
$ pip list
Package            Version
------------------ -------
click              8.0.3
importlib-metadata 4.11.1
pep517             0.12.0
pip                22.0.3
pip-tools          6.5.1
setuptools         47.1.0
tomli              2.0.1
typing_extensions  4.1.1
wheel              0.37.1
zipp               3.7.0

Steps to replicate

Create an Amazon Linux 2 box and install pip-tools

pip install --upgrade pip
pip install pip-tools

Create the requirements.in file as shown above
Compile that file

$ pip-compile --output-file requirements.txt requirements.in --upgrade

Expected result
An output file in requirements.txt
Actual result
It fails with:
$ pip-compile --output-file requirements.txt requirements.in --upgrade

ERROR:pip.subprocessor:[present-diagnostic] python setup.py egg_info exited with 1
Traceback (most recent call last):
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/operations/build/metadata_legacy.py", line 68, in generate_metadata
    spinner=spinner,
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/utils/subprocess.py", line 224, in call_subprocess
    raise error
pip._internal.exceptions.InstallationSubprocessError: python setup.py egg_info exited with 1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/xvdb/views/mysrc/myenv/bin/pip-compile", line 8, in <module>
    sys.exit(cli())
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/piptools/scripts/compile.py", line 466, in cli
    results = resolver.resolve(max_rounds=max_rounds)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/piptools/resolver.py", line 175, in resolve
    has_changed, best_matches = self._resolve_one_round()
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/piptools/resolver.py", line 319, in _resolve_one_round
    their_constraints.extend(self._iter_dependencies(best_match))
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/piptools/resolver.py", line 428, in _iter_dependencies
    dependencies = self.repository.get_dependencies(ireq)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/piptools/repositories/pypi.py", line 239, in get_dependencies
    download_dir, ireq, wheel_cache
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/piptools/repositories/pypi.py", line 201, in resolve_reqs
    results = resolver._resolve_one(reqset, ireq)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 379, in _resolve_one
    dist = self._get_dist_for(req_to_install)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 332, in _get_dist_for
    dist = self.preparer.prepare_linked_requirement(req)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 487, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 560, in _prepare_linked_requirement
    self.build_isolation,
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 58, in _get_prepared_distribution
    abstract_dist.prepare_distribution_metadata(finder, build_isolation)
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/distributions/sdist.py", line 47, in prepare_distribution_metadata
    self.req.prepare_metadata()
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/req/req_install.py", line 533, in prepare_metadata
    details=details,
  File "/mnt/xvdb/views/mysrc/myenv/lib64/python3.7/site-packages/pip/_internal/operations/build/metadata_legacy.py", line 71, in generate_metadata
    raise MetadataGenerationFailed(package_details=details) from error
pip._internal.exceptions.MetadataGenerationFailed: metadata generation failed

I haven't been able to reproduce yet matching most of your environment locally. Does it behave any differently if you remove (rename if not committed) any existing requirements.txt?

Ah, I have reproduced it with Amazon Linux (only), via container:
$ podman run -it docker://amazonlinux
# yum install python3
# python3 -m venv venv
# . ./venv/bin/activate
# pip install -U pip
# pip install pip-tools
# pip list
Package            Version
------------------ -------
click              8.0.3
importlib-metadata 4.11.1
pep517             0.12.0
pip                22.0.3
pip-tools          6.5.1
setuptools         47.1.0
tomli              2.0.1
typing_extensions  4.1.1
wheel              0.37.1
zipp               3.7.0
# echo psycopg2 >requirements.in
# pip-compile -U requirements.in

So trying pip install psycopg2 reveals more: it needs pg_config executable on the system to build, but they mention you can alternatively opt to use the psycopg2-binary package.
I think this is just going to come down to installing some things pyscopg2 needs for its build environment to work properly, like postgresql-devel and gcc and whatever else they write in their docs. Then try installing directly for a clue as to what's still missing, if anything. Or use their binary package.

The error message threw me and I ended using the psycopg2-binary in requirements.in file and it worked. Thank you!

Since psycopg2-binary isn't suitable for production, this issue can be solved by installing the postgresql development headers. On Debian based distros, it's called libpq-dev.

I would really like this reopened with the goal to provide a better error message. Anything that hints at the true root of the problem would be really helpful.

@dwt
Thanks! Let me see how the error presents and where pip-tools fits in:
Setting up:
$ podman run -it --rm docker://amazonlinux
# yum install -y python3
# python3 -m venv venv
# . ./venv/bin/activate
# pip install -U pip pip-tools

Checking current pip-tools messages:
# pip-compile - -o - <<<psycopg2

big output
ERROR:pip.subprocessor:[present-diagnostic] python setup.py egg_info exited with 1
Traceback (most recent call last):
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/build/metadata_legacy.py", line 68, in generate_metadata
    spinner=spinner,
  File "/venv/lib64/python3.7/site-packages/pip/_internal/utils/subprocess.py", line 224, in call_subprocess
    raise error
pip._internal.exceptions.InstallationSubprocessError: python setup.py egg_info exited with 1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/venv/bin/pip-compile", line 8, in <module>
    sys.exit(cli())
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/venv/lib64/python3.7/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/venv/lib64/python3.7/site-packages/piptools/scripts/compile.py", line 466, in cli
    results = resolver.resolve(max_rounds=max_rounds)
  File "/venv/lib64/python3.7/site-packages/piptools/resolver.py", line 175, in resolve
    has_changed, best_matches = self._resolve_one_round()
  File "/venv/lib64/python3.7/site-packages/piptools/resolver.py", line 319, in _resolve_one_round
    their_constraints.extend(self._iter_dependencies(best_match))
  File "/venv/lib64/python3.7/site-packages/piptools/resolver.py", line 428, in _iter_dependencies
    dependencies = self.repository.get_dependencies(ireq)
  File "/venv/lib64/python3.7/site-packages/piptools/repositories/pypi.py", line 239, in get_dependencies
    download_dir, ireq, wheel_cache
  File "/venv/lib64/python3.7/site-packages/piptools/repositories/pypi.py", line 201, in resolve_reqs
    results = resolver._resolve_one(reqset, ireq)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 379, in _resolve_one
    dist = self._get_dist_for(req_to_install)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 332, in _get_dist_for
    dist = self.preparer.prepare_linked_requirement(req)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 487, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 560, in _prepare_linked_requirement
    self.build_isolation,
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 58, in _get_prepared_distribution
    abstract_dist.prepare_distribution_metadata(finder, build_isolation)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/distributions/sdist.py", line 47, in prepare_distribution_metadata
    self.req.prepare_metadata()
  File "/venv/lib64/python3.7/site-packages/pip/_internal/req/req_install.py", line 533, in prepare_metadata
    details=details,
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/build/metadata_legacy.py", line 71, in generate_metadata
    raise MetadataGenerationFailed(package_details=details) from error
pip._internal.exceptions.MetadataGenerationFailed: metadata generation failed

The highlights from above:

pip._internal.exceptions.InstallationSubprocessError: python setup.py egg_info exited with 1
pip._internal.exceptions.MetadataGenerationFailed: metadata generation failed

Those are what led me to try with plain pip, but let's see if we get any good details with verbosity turned up:
# pip-compile -vvv - -o - <<<psycopg2

big output
Using indexes:
  https://pypi.org/simple

                          ROUND 1
Current constraints:
  psycopg2 (from -r -)

Finding the best candidates:
  found candidate psycopg2==2.9.3 (constraint was <any>)

Finding secondary dependencies:
  psycopg2==2.9.3 not in cache, need to check index
ERROR:pip.subprocessor:[present-diagnostic] python setup.py egg_info exited with 1
Traceback (most recent call last):
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/build/metadata_legacy.py", line 68, in generate_metadata
    spinner=spinner,
  File "/venv/lib64/python3.7/site-packages/pip/_internal/utils/subprocess.py", line 224, in call_subprocess
    raise error
pip._internal.exceptions.InstallationSubprocessError: python setup.py egg_info exited with 1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/venv/bin/pip-compile", line 8, in <module>
    sys.exit(cli())
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/venv/lib64/python3.7/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/venv/lib64/python3.7/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/venv/lib64/python3.7/site-packages/piptools/scripts/compile.py", line 466, in cli
    results = resolver.resolve(max_rounds=max_rounds)
  File "/venv/lib64/python3.7/site-packages/piptools/resolver.py", line 175, in resolve
    has_changed, best_matches = self._resolve_one_round()
  File "/venv/lib64/python3.7/site-packages/piptools/resolver.py", line 319, in _resolve_one_round
    their_constraints.extend(self._iter_dependencies(best_match))
  File "/venv/lib64/python3.7/site-packages/piptools/resolver.py", line 428, in _iter_dependencies
    dependencies = self.repository.get_dependencies(ireq)
  File "/venv/lib64/python3.7/site-packages/piptools/repositories/pypi.py", line 239, in get_dependencies
    download_dir, ireq, wheel_cache
  File "/venv/lib64/python3.7/site-packages/piptools/repositories/pypi.py", line 201, in resolve_reqs
    results = resolver._resolve_one(reqset, ireq)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 379, in _resolve_one
    dist = self._get_dist_for(req_to_install)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 332, in _get_dist_for
    dist = self.preparer.prepare_linked_requirement(req)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 487, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 560, in _prepare_linked_requirement
    self.build_isolation,
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/prepare.py", line 58, in _get_prepared_distribution
    abstract_dist.prepare_distribution_metadata(finder, build_isolation)
  File "/venv/lib64/python3.7/site-packages/pip/_internal/distributions/sdist.py", line 47, in prepare_distribution_metadata
    self.req.prepare_metadata()
  File "/venv/lib64/python3.7/site-packages/pip/_internal/req/req_install.py", line 533, in prepare_metadata
    details=details,
  File "/venv/lib64/python3.7/site-packages/pip/_internal/operations/build/metadata_legacy.py", line 71, in generate_metadata
    raise MetadataGenerationFailed(package_details=details) from error
pip._internal.exceptions.MetadataGenerationFailed: metadata generation failed

The improvement here is just making clear that the problem occurs when trying to do some installation operation with psycopg2 specifically. This is good info, but still lacks the details we ultimately need.
And what do we get with pip directly?
# pip install psycopg2

big output
Collecting psycopg2
  Using cached psycopg2-2.9.3.tar.gz (380 kB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [23 lines of output]
      running egg_info
      creating /tmp/pip-pip-egg-info-1p0ko9rt/psycopg2.egg-info
      writing /tmp/pip-pip-egg-info-1p0ko9rt/psycopg2.egg-info/PKG-INFO
      writing dependency_links to /tmp/pip-pip-egg-info-1p0ko9rt/psycopg2.egg-info/dependency_links.txt
      writing top-level names to /tmp/pip-pip-egg-info-1p0ko9rt/psycopg2.egg-info/top_level.txt
      writing manifest file '/tmp/pip-pip-egg-info-1p0ko9rt/psycopg2.egg-info/SOURCES.txt'

      Error: pg_config executable not found.

      pg_config is required to build psycopg2 from source.  Please add the directory
      containing pg_config to the $PATH or specify the full executable path with the
      option:

          python setup.py build_ext --pg-config /path/to/pg_config build ...

      or with the pg_config option in 'setup.cfg'.

      If you prefer to avoid building psycopg2 from source, please install the PyPI
      'psycopg2-binary' package instead.

      For further information please check the 'doc/src/install.rst' file (also at
      <https://www.psycopg.org/docs/install.html>).

      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Well that's much clearer, with a lot of explanation.
OK. Maybe we can get more of that message into our own logs, at least with -vvv. I'll try to have a look.

I think the content we want (mentioning pg_config) is not included in the pip-raised exception, so we can't just catch, log, and re-raise it.
It looks like it happens at pip/_internal/operations/build/metadata_legacy.py when calling call_subprocess, and from there it is included as far as the InstallationSubprocessError:

passed to the exception's __init__ as output_lines
stored as exception attribute output_prompt
passed up to a parent exception class via super as context

The exception is then passed (pip-internally) to subprocess_logger.error.
OK, and I see subprocess_logger = getLogger("pip.subprocessor").
When using pip directly, this goes through pip's internal RichPipStreamHandler(RichHandler)'s emit method, which uses some logic to display the diagnostic error. I think when used by pip-compile, this method is not used, so I will try to follow it.

I've found that we can get that output, at least with newer versions of pip, by using our old _setup_logging always, basically what #1565 was doing.
At this point I've got to tag out and ask for insight from anyone who's worked on the logging changes. Anything to add at this time?
Pinging: @nicoa @davisagli @hugovk @di

See the comment here about why it was recommended to skip _setup_logging for newer pip versions. IIRC this seemed to be correct based on my testing for https://github.com/jazzband/pip-tools/pull/1567/.

I can take another look at this tomorrow. Complete guess, but maybe some difference between handling pip’s stdout and stderr?
David

On Mar 17, 2022, at 5:41 PM, Dustin Ingram @.***> wrote:

See the comment here about why it was recommended to skip _setup_logging for newer pip versions. IIRC this seemed to be correct based on my testing for #1567.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.

It looks like pip-tools probably needs the following changes:

Remove the conditional at https://github.com/jazzband/pip-tools/blob/master/piptools/repositories/pypi.py#L107 -- we still need to call pip's setup_logging function to put in place the RichPipStreamHandler which formats the [present-diagnostic] messages nicely.
Add the same conditional before https://github.com/jazzband/pip-tools/blob/master/piptools/repositories/pypi.py#L454 (and around the remainder of the _setup_logging method). It's necessary to initialize pip's logging, but with pip > 22 it appears to no longer be necessary to explicitly connect it to pip-tools' LogContext.stream (which is really stderr)
Do something to avoid also logging a traceback for the MetadataGenerationFailed exception.

Btw as an easier way to reproduce this I created setup.py containing 1/0 (to provoke a ZeroDivisionError), req.in containing -e ., and then ran pip-compile req.in.


Different abis support

Hello.
Are you planing to support not only armeabi-v7a? I had tried to do that, i had replaced APP_ABI in Application.mk to armeabi, but had got this error:
Android NDK: ERROR:caffe-android-lib/caffe-mobile/jni/Android.mk:protobuf: LOCAL_SRC_FILES points to a missing file     Android NDK: Check that caffe-android-lib/caffe-mobile/jni/../../protobuf/obj/local/armeabi/libprotobuf.a exists  or that its path is correct
This happened because protobuf library is building only for armeabi-v7a, and i can't make it to build for another eabi.
Thanks in advance.
P.S. sorry for my bad English

I did not have a try before, but you can try to build protobuf for armeabi. (Are you trying to run caffe on older devices?)

run caffe on older devices is crazy...


use the raw issue dict for export, print and search

remove unused constants
close #2

No new changes? @Timuuc


Support Unsupervised Training with Queries and Documents Similar to Generative Pseudo Labling

We want to support training text embedding models in an unsupervised way based on queries and documents provided by a user without the need of relevance scores or labels.
This should be done on basis of GPL with some adjustments to make it work with queries provided by the user. Moreover, we want to support not only English but also multi-lingual model.
The following sub tasks are necessary for this integration

[ ] Implement functions in the client to generate a dataset with triplets and margin values using the gpl package
[ ] Implement functions in finetuner-core to train text encoding models using such a dataset https://github.com/jina-ai/finetuner-core/issues/474
[ ] Integrate multi-lingual text encoding models into Finetuner

@guenthermi Hey I think this can be done in this way -
To integrate unsupervised training of text embedding models based on user-provided queries and documents without relevance scores or labels, we can follow the following steps:
We can implement functions in the client to generate triplets and margin values based on the user-provided queries and documents. A triplet will consists of an anchor text, a positive text, and a negative text, where the anchor text will be similar to the positive text and dissimilar to the negative text. The margin value will be used to determine the distance between the anchor and negative texts and the anchor and positive texts.
After generating triplets and margin values, we can use finetuner-core to train text encoding models using this dataset. We can implement functions in finetuner-core to train text encoding models using the triplets generated by the client. This will involve optimizing a loss function based on the distance between the anchor and positive texts and the distance between the anchor and negative texts.
Finally, we can integrate multi-lingual text encoding models into finetuner-core to support multiple languages. We can do it by using pre-trained language models such as BERT, XLM, or multilingual models. These pre-trained models can be fine-tuned using the triplet dataset generated by the client. This will allow the models to learn language-specific features and generalize across languages.

Yes, we plan to do it in a similar way. The training is already supported, however, generating the triplets will not be done inside the clients, but rather as a compute job, since we need to do it with GPUs since it is too slow otherwise.

@guenthermi I think performing the triplet generation as a compute job on a GPU cluster will be a good approach to improve the efficiency of the process and accelerate the training of the model.
I have joined slack, I am a beginner in ML/AI but I would love to try to develop it. Do you have any personal suggestions as to how should I start apart from documentations ?

Thanks for the reply. I think for now I will look into some open source content and learn more about how things work. All the best.


SNZB-04P not change state

I add SNZB-04P from iHost to homebridge and state not change, forever - closed.
Log homebridge: [homebridge-plugin-ewelink-cube] This plugin generated a warning from the characteristic 'Contact Sensor State': characteristic value expected valid finite number and received "NaN" (number).

How to fix it?

The issue is caused because we are switching capability protocol.
We are actively support the new protocol for homebridge plugin but it needs some time.

Well, as always... A new device has been released and we have to wait until they create software for it...

@SuiKaSan When can we expect an update?

@SuiKaSan i update iHost eWeLink CUBE 2.1.0, nothing change.

I have updated to v2.1. The sensor still does not indicate the status open/closed, motion detected/no motion. How to solve the problem? Has anyone tried to remove homebridge and reinstall it?

I have updated to v2.1. The sensor still does not indicate the status open/closed, motion detected/no motion. How to solve the problem? Has anyone tried to remove homebridge and reinstall it?

I tried, nothing has changed.


How to get profile info? (e.g. name, image)

Not an issue, just seeking help...
Between NIP-19 and nip-19.ts, I can't put it together.
Appreciate if anyone can explain how to fetch name/image/etc from an npub or pubkey

We need a group running on Nostr for developer questions like this. Maybe ask on StackOverflow or on https://t.me/nostr_protocol?
The short answer is to read NIP-01.

agreed. it'd feel right to use nostr if possible...
maybe if there was standard hashtag, repos could link & people could follow? nostr communities have a bit of overhead
https://nostr.band/note1nqeet8zq0knctrwwh4gup4dfqxr0c8unf648ds6547e9xf9xmayqndc0sd

I'm building https://swarmstr.com mainly for this. It's in an early phase, buggy and slow but I'm committing most of my free time to make it work.

@decentropy IDK if my approach is correct but i just looked it up using a separate subscription:
const profile = await new Promise(resolve => {
  let p = null
  const sub = pool.sub(relays, [
    { kinds: [0], authors: ['HEX_PUBKEY'] }
  ])
  sub.on('event', event => {
    if (!p || p.created_at < event.created_at) p = event
  })
  sub.on('eose', () => {
    sub.unsub()
    resolve(p)
  })
})

thanks yep, the replies here helped... event kind 0 (per NIP-01)


Install Azure Cli added in documentation

@N-Usha

Hi, @harshitha1112 Thank you for your contribution. We really appreciate it. However I think the changes you have suggested are quite self-explanatory.
Thank you for taking out time to create this PR. Looking forward to more contributions from you.