kubeconfig rotation on deleting Shoot can deadlock the deletion

How to categorize this issue?

/area quality
/kind bug
/priority 3
What happened:
In large landscapes we often have Shoots that fail to be deleted because of various reasons (user issues, transient errors, etc). Under some circumstances, kubeconfig rotation for Shoot in deletion can deadlock the Shoot deletion.
What you expected to happen:
kubeconfig rotation on deleting Shoot to do not deadlock the Shoot deletion. Or the kubeconfig rotation to be forbidden on Shoot in deletion.
How to reproduce it (as minimally and precisely as possible):

Create a v1.19.x Shoot cluster

Add dummy finalizer for example to the volumesnapshots.snapshot.storage.k8s.io CRD to simulate issue that will cause the ControlPlane deletion to fail.

Delete the Shoot. Make sure that first the deletion will fail on the step Waiting until shoot control plane has been destroyed, then in the next tries it will fail on the step Waiting until Shoot control plane has been reconciled

Rotate the kubeconfig credentials while the deletion is failing on step Waiting until Shoot control plane has been reconciled

Restart the kube-apiserver Pods (to simulate eviction for example) and make sure the new kube-apiserver Pods cannot get ready

$ k -n shoot--foo--bar get po -l role=apiserver
NAME                              READY   STATUS             RESTARTS   AGE
kube-apiserver-674b556bfb-q4cdl   1/2     CrashLoopBackOff   6          11m

$ k -n shoot--foo--bar describe po kube-apiserver-674b556bfb-q4cdl
Events:
  Type     Reason     Age                   From               Message
  ----     ------     ----                  ----               -------
  Normal   Pulled     11m                   kubelet            Container image "eu.gcr.io/gardener-project/alpine-iptables:3.10.3" already present on machine
  Normal   Created    11m                   kubelet            Created container set-iptable-rules
  Normal   Started    11m                   kubelet            Started container set-iptable-rules
  Normal   Started    11m                   kubelet            Started container vpn-seed
  Normal   Created    11m                   kubelet            Created container vpn-seed
  Normal   Pulled     11m                   kubelet            Container image "eu.gcr.io/gardener-project/gardener/vpn-seed:0.19.0" already present on machine
  Normal   Killing    10m                   kubelet            Container kube-apiserver failed liveness probe, will be restarted
  Normal   Created    10m (x2 over 11m)     kubelet            Created container kube-apiserver
  Normal   Started    10m (x2 over 11m)     kubelet            Started container kube-apiserver
  Warning  Unhealthy  10m (x4 over 11m)     kubelet            Liveness probe failed: HTTP probe failed with statuscode: 401
  Warning  Unhealthy  9m59s (x8 over 11m)   kubelet            Readiness probe failed: HTTP probe failed with statuscode: 401
  Normal   Pulled     6m31s (x6 over 11m)   kubelet            Container image "k8s.gcr.io/kube-apiserver:v1.19.12" already present on machine
  Warning  BackOff    86s (x17 over 5m31s)  kubelet            Back-off restarting failed container

Remove the dummy finalizer from the volumesnapshots.snapshot.storage.k8s.io CRD and make sure that the deletion still fails because the apiserver is now unavailable

Basically the static-token Secret in the Seed is updated with the new token, while the probes in kube-apiserver Deployment spec still refer to the old Bearer token -> liveness and readiness probes fail with 401 (the token for the probes can be only updated with the Deploying Kubernetes API server step).
The deadlock is that step Waiting until Shoot control plane has been reconciled (when the ControlPlane is in deletion) relies on the apiserver to be available for clean up of resources. On the other side gardenlet can never proceed to the Deploying Kubernetes API server step as it depends on the Waiting until Shoot control plane has been reconciled step.
Environment:

Gardener version: v1.27.0-dev-c1841f54d8a9aa35d9567cec1b504b7564afabee
Kubernetes version (use kubectl version):
Cloud provider or hardware configuration:
Others:

@gardener/gardener-maintainers wdty about forbidding kubeconfig rotation on Shoot in deletion? I guess such operation on Shoot in deletion does not make sense in general and can only interfere with the deletion flow.

Makes sense.
Should we explicitly forbid it via validation on update request or it is enough the controller simply to skip this operation?
I lean toward the silently skipping the rotation.

I think it's better to have a validation that rejects the update. If we have backwards compatibility concerns, then we can have a feature gate for it, hence we can allow gardener operators to enable it in controlled manner.

/assign


fix(nuxt): added a class on wrapper div on createClientPage

🔗 Linked issue
Resolves #30344
📚 Description
There is a limitation to client-only pages where they generate a classless and id-less div which is tricky to target with CSS.
I added a 'client-page-wrapper' class to the generated wrapper to more easily target this div with CSS.
I've checked the effects via running the playground with the corresponding issue's reproduction steps:

I think we should probably make it configurable and allow specifying other attributes as well. (similar to the bodyAttrs in useHead)

I'm currently exploring another solution which could remove the div wrapper around client pages 🤔

Hi, I was able to add the customizability by adding this to the app.ts file and importing it to the client-component file

Despite the fact that it seems to be working as intended, I am getting this editor error when I do add my custom value to the nuxt config file:

Object literal may only specify known properties, and 'clientPageAttrs' does not exist in type '{ baseURL?: string | undefined; buildAssetsDir?: string | undefined; cdnURL?: string | undefined; head?: { title?: string | { textContent?: string | false | null | undefined; tagPriority?: number | ... 7 more ... | undefined; } | null | undefined; ... 11 more ...; viewport?: string | undefined; } | undefined; ... 11...'.ts(2353)
config.d.ts(121, 2): The expected type comes from property 'app' which is declared here on type 'InputConfig<NuxtConfig, ConfigLayerMeta>'
(property) clientPageAttrs: {
    class: string;
}

I'm not really sure how to squash this error. Maybe I missed a type declaration file I should have added the new option to?

That's tricky, i'm not sure what do we want here.

client page wrapper attributes for all client page at the app level ?
client page wrapper attributes defined in at the page level (maybe with definePageMeta ? )

Do we need to keep the div, though? I though that this resolves it: https://github.com/nuxt/nuxt/pull/30425

I'll let Daniel decide about that. If #30425 should go in 4.x only or also in 3.x . If it goes into 3.x then yes this issue and PR will be closed


bar chart x-axis

Every bar chart (NO2/Dust/Temperature) should have the same x-axis (dates).

Outdated.


CDAP-15460 Big Table Source and Sink plugin

JIRA: https://issues.cask.co/browse/CDAP-15460
WIKI: https://wiki.cask.co/display/CE/Bigtable+Source https://wiki.cask.co/display/CE/Bigtable+Sink
In scope of this PR:

implemented column mappings

@albertshau addressed all comments

@albertshau addressed last comments and added unit tests


Using arow function without explicit return not type checking correctly

🔎 Search Terms
"arrow function incorrect typing"
🕗 Version & Regression Information
Version 5.7.2 install via Yarn
⏯ Playground Link
No response
💻 Code
Main functions
const client = new ApolloClient({ link, cache, defaultOptions })

export const subscribe = <T>(
  graphql: DocumentNode,
  variables: object,
): Observable<FetchResult<MaybeMasked<T>>> =>
  client.subscribe<T>({
    query: graphql,
    variables,
  })

Using subscribe in arrow function without assigning value first gives no type error:
export const watchPost = (
  variables: object,
  graphql: string,
): Observable<FetchResult<WatchPostResponse>> =>
  subscribe(
    gql`
    subscription watchPost($uuid: ID!) {
      postUpdated(uuid: $uuid) {
        ${graphql}
      }
    }
    `,
    variables,
  )

Assigning to a const and then returning it gives type error:
export const watchPost = (
  variables: object,
  graphql: string,
): Observable<FetchResult<WatchPostResponse>> => {
  const value = subscribe(
    gql`
    subscription watchPost($uuid: ID!) {
      postUpdated(uuid: $uuid) {
        ${graphql}
      }
    }
    `,
    variables,
  )

  return value
}

Type error given:
Type 'Observable<FetchResult<unknown>>' is not assignable to type 'Observable<FetchResult<WatchPostResponse>>'.
  Type 'FetchResult<unknown>' is not assignable to type 'FetchResult<WatchPostResponse>' with 'exactOptionalPropertyTypes: true'. Consider adding 'undefined' to the types of the target's properties.
    Type 'SingleExecutionResult<unknown, Record<string, any>, Record<string, any>>' is not assignable to type 'FetchResult<WatchPostResponse>' with 'exactOptionalPropertyTypes: true'. Consider adding 'undefined' to the types of the target's properties.
      Type 'SingleExecutionResult<unknown, Record<string, any>, Record<string, any>>' is not assignable to type 'SingleExecutionResult<WatchPostResponse, Record<string, any>, Record<string, any>>' with 'exactOptionalPropertyTypes: true'. Consider adding 'undefined' to the types of the target's properties.
        Type 'unknown' is not assignable to type 'WatchPostResponse'.ts(2322)

🙁 Actual behavior
Does not throw an error that return type of subscribe function is incompatible with expected function return type
🙂 Expected behavior
Should throw the same typing error like it with when assigning result to variable and returning that variable
Additional information about the issue
No response

This is working as intended. The one that typechecks OK benefits from return type inference. The subscribe call itself doesn't contain any positions from which your T could be inferred from.
So in the first example, the compiler falls back to other information that it can find in the surrounding context - and that's the return type of the outer function because the subscribe's result is "assigned" to it. The compiler is smart enough here to understand that subscribe is meant to return Observable<FetchResult<MaybeMasked<T>>> and that it's assigned to Observable<FetchResult<WatchPostResponse>>. So using the regular inference algorithm capabilities it infers from WatchPostResponse (source) into MaybeMasked<T> (target).
In the other example, you have "detached" it from that contextual information and therefore it falls back to the T's constraint and that's just unknown.
Note that your first example isn't particularly type-safe anyway. Given lack of inference candidates in the actual call, this is as safe as casting or as safe as assigning any to some known type. Given the nature of client-server communication and APIs, it's a reasonable tradeoff that many applications choose.


Remove unused array A[]

A[] is not used anywhere in the code. Probably, non precalc implementation was intended, but not implemented.

Nice catch.  Thanks!


cht.sh: unstable-2018-11-02 -> unstable-2019-08-06

Motivation for this change
Discovered cht.sh but then realized the CLI doesn't have shell completions in the version available on nixpkgs.
They're sort of helpful when you get past 1,000 options.
Closure size:
/nix/store/plz5ab1xlgp1gkv26y3skrbf27w5ka26-cht.sh-unstable-2018-11-02     45469952
/nix/store/vy2xm234qaizjy1iz4p4xc08sp4v3bn5-cht.sh-unstable-2019-08-06     45481360

Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Notify maintainers
cc @fgaz

Thanks for helping maintain the package

Thanks for helping maintain the package

Don't mention it!
Discovered this package via Reddit and noticed we didn't have tab completions and knew I had to have it.
Better yet, it seems like @chubin is okay opening issues here after major releases, etc 🎉 (context)


Make it compatile with Python3.x + pep8 compliant

A few minor changes to make it compatible with Python3.x + pep8 compliant

I went ahead and created a new branch with similar changes (applied after the recent updates). Hopefully @AishwaryaAgrawal will verify that everything still works and merge it into master.


Support aws keypairs

Allow provisioning users as keypairs or using existing ones.

I don't quite get this one. Are we importing the ssh key to aws and use that for the instances?
It sounds to me an optional feature. If the user wanted to do the import, it's fine. If they don't, they can just ignore it.
The patch just made the importing as default. And it will make things complicated as we have to sync the status between aws and archon.
What if we could use a reference to the aws keypair? If the reference exists, we use it. Otherwise we just follow the standard procedure.

Before this our aws provider doesn't support keypair at all which makes ssh to aws instances a disaster. Referencing keypair is a must-have. We can make importing option by adding extra annotation (maybe aws.archon.kubeup.com/aws-import-keypair?) and allowing User entity with only Name and no SSH key.

We used to use those reference in InstanceSpec to provision users through cloud-init. If it's done properly, ssh should not be a problem.
The old default behaviour was setting no keypair when creating instance and let cloud-init to setup the users. I think it used to work but it might fail with some os. Do you have any failure case?
To use the keypair when it's set the in the annotation should be nice to have. But we'd better not to do the importing. How should we deal with the keypair if it already exist but we have an updated keypair in User resource.

I forgot about the cloud-init thing. Then this is unnecessary.

Reference a keypair in aws to avoid setting the ssh key in archon should be a good improvement though. We could add it to the todo list. When user use this feature, we just delegate the ssh key lifecycle management to aws. Some user might need this feature to avoid managing ssh key in two different places.


Server Compromised? CDN 404s and homepage alert/redirect

https://unpkg.com/react/
<EMAIL_ADDRESS>are redirecting to https://compliance-jessica.xyz/a.php

https://twitter.com/unpkg/status/852655106562564098


Boot into hardware setup menu on Vmware

Description

allow VMs to be started into BIOS on Vmware. This is implemented in the reboot, start and deploy APIs for user VMs.

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[ ] Bug fix (non-breaking change which fixes an issue)
[x] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Screenshots (if appropriate):

A primate PR has been created with number 313
How Has This Been Tested?

this has been manually verified by means of API/old-UI/primate and checking if the boot menu would then be visible or not depending on the flag passed.

@blueorangutan package

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✖centos7 ✖debian. JID-1141

@blueorangutan package

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✖centos7 ✖debian. JID-1142

@blueorangutan package

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✖centos7 ✖debian. JID-1143

Packaging result: ✖centos7 ✖debian. JID-1146

Packaging result: ✔centos7 ✔debian. JID-1147

Packaging result: ✖centos7 ✖debian. JID-1148

Packaging result: ✔centos7 ✔debian. JID-1151

Packaging result: ✔centos7 ✔debian. JID-1155

Packaging result: ✔centos7 ✔debian. JID-1160

Packaging result: ✔centos7 ✔debian. JID-1169

Packaging result: ✔centos7 ✔debian. JID-1176

Packaging result: ✔centos7 ✔debian. JID-1177

Packaging result: ✔centos7 ✔debian. JID-1178

Packaging result: ✔centos7 ✔debian. JID-1179

Packaging result: ✔centos7 ✔debian. JID-1180

Packaging result: ✔centos7 ✔debian. JID-1181

Packaging result: ✔centos7 ✔debian. JID-1187

@DaanHoogland do you think it could be used to extend it for KVM?

Packaging result: ✔centos7 ✔debian. JID-1194

Packaging result: ✔centos7 ✔debian. JID-1196

Packaging result: ✔centos7 ✔debian. JID-1197

@DaanHoogland maybe i thought of "bios" as boot order. so in VMware i can set them into the bios. in kvm i need an xml entry, but that would have to be implemented too. an example would be the use of PXE. that's what we lack so far.
 <bootmenu enable='yes'/>

@svenvogel I think you want to look @bwsw 's latest merged feature, PR #3823. It might give an example of the needed. not sure though.

@DaanHoogland maybe i thought of "bios" as boot order. so in VMware i can set them into the bios. in kvm i need an xml entry, but that would have to be implemented too. an example would be the use of PXE. that's what we lack so far.
 <bootmenu enable='yes'/>

this is the reason why I ask. where do you think this should be implemented?

on second thought, I don't think I understand what you want exactly.

Packaging result: ✔centos7 ✔debian. JID-1198

@blueorangutan test matrix

@DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan test matrix

@DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

Trillian test result (tid-1472)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 39982 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1472-kvm-centos7.zip
Smoke tests completed. 83 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Trillian test result (tid-1473)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 42793 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1473-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
Smoke tests completed. 83 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Trillian test result (tid-1471)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 51671 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1471-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Smoke tests completed. 81 look OK, 2 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_01_scale_vm
Failure
25.96
test_scale_vm.py

test_01_redundant_vpc_site2site_vpn
Failure
379.02
test_vpc_vpn.py

@cl-k-takahashi I saw your interest in this change. Do you care to give it an independent review?

@DaanHoogland yes, thanks Daan, thats maybe a good solution to use kvm hooks and enable this feature. you are right. i thought from vmware perspective and thought how i get the pxe or boot menu into kvm. maybe its a idea to think about a non hook design like this one for kvm to get "bios" formerly boot options.

Packaging result: ✔centos7 ✔debian. JID-1209

Packaging result: ✔centos7 ✔debian. JID-1212

Packaging result: ✔centos7 ✔debian. JID-1213

@blueorangutan test matrix

@DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

Trillian test result (tid-1508)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 37891 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1508-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_nested_virtualization.py
Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
Smoke tests completed. 79 look OK, 2 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_nested_virtualization_vmware
Failure
147.26
test_nested_virtualization.py

test_07_reboot_ssvm
Failure
24.25
test_ssvm.py

Trillian test result (tid-1507)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 41237 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1507-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 83 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

@blueorangutan test centos7 xs71

@DaanHoogland unsupported parameters provided. Supported mgmt server os are: centos6, centos7, ubuntu. Supported hypervisors are: kvm-centos6, kvm-centos7, kvm-ubuntu, xenserver-71, xenserver-65sp1, xenserver-62sp1, vmware-67u3, vmware-65u2, vmware-60u2, vmware-55u3, vmware-51u1, vmware-50u1

@blueorangutan test centos7 xenserver-71

@DaanHoogland a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

the failures in vmware seem related, however on a manual rerun of test_ssvm, test_08_reboot_cpvm failed instead of test_07_reboot_ssvm, as it did in the automated run, giving me the thought this is yet another timing issue.
I'll be investigating test_nested_virtualization as well.

last run of test_ssvm actually went fine ???:
Test List secondary storage VMs ... === TestName: test_01_list_sec_storage_vm | Status : SUCCESS ===
ok
Test List console proxy VMs ... === TestName: test_02_list_cpvm_vm | Status : SUCCESS ===
ok
Test SSVM Internals ... === TestName: test_03_ssvm_internals | Status : SUCCESS ===
ok
Test CPVM Internals ... === TestName: test_04_cpvm_internals | Status : SUCCESS ===
ok
Test stop SSVM ... === TestName: test_05_stop_ssvm | Status : SUCCESS ===
ok
Test stop CPVM ... === TestName: test_06_stop_cpvm | Status : SUCCESS ===
ok
Test reboot SSVM ... === TestName: test_07_reboot_ssvm | Status : SUCCESS ===
ok
Test reboot CPVM ... === TestName: test_08_reboot_cpvm | Status : SUCCESS ===
ok
Test destroy SSVM ... === TestName: test_09_destroy_ssvm | Status : SUCCESS ===
ok
Test destroy CPVM ... === TestName: test_10_destroy_cpvm | Status : SUCCESS ===
ok
Test NFS Version on Secondary Storage mounted properly on SSVM ... SKIP: No NFS version provided in test data

----------------------------------------------------------------------
Ran 11 tests in 705.971s

OK (SKIP=1)

Packaging result: ✖centos7 ✖debian. JID-1214

Packaging result: ✔centos7 ✔debian. JID-1215

@blueorangutan test centos7 vmware-67u3

@DaanHoogland a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

Trillian test result (tid-1509)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 40504 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1509-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermittent failure detected: /marvin/tests/smoke/test_routers.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
Smoke tests completed. 81 look OK, 2 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true
Error
265.14
test_routers_network_ops.py

test_01_scale_vm
Failure
12.32
test_scale_vm.py

Trillian test result (tid-1510)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 41710 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1510-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Smoke tests completed. 82 look OK, 1 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_04_rvpc_privategw_static_routes
Error
547.24
test_privategw_acl.py

@blueorangutan package

@borisstoyanov a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos7 ✔debian. JID-1217

@blueorangutan test

@borisstoyanov a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-1512)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35234 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1512-kvm-centos7.zip
Smoke tests completed. 83 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test centos7 vmware-65

@blueorangutan test centos7 vmware-65

@borisstoyanov unsupported parameters provided. Supported mgmt server os are: centos6, centos7, ubuntu. Supported hypervisors are: kvm-centos6, kvm-centos7, kvm-ubuntu, xenserver-71, xenserver-65sp1, xenserver-62sp1, vmware-67u3, vmware-65u2, vmware-60u2, vmware-55u3, vmware-51u1, vmware-50u1

@blueorangutan test centos7 vmware-65u2

@borisstoyanov a Trillian-Jenkins test job (centos7 mgmt + vmware-65u2) has been kicked to run smoke tests

Trillian test result (tid-1514)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 42689 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4021-t1514-vmware-65u2.zip
Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_root_resize.py
Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
Smoke tests completed. 82 look OK, 1 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_07_reboot_ssvm
Failure
26.83
test_ssvm.py

Packaging result: ✔centos7 ✔debian. JID-1271

Packaging result: ✔centos7 ✔debian. JID-1294

@blueorangutan test centos7 vmware-67u3

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

This or any of the VMware related PRs may have introduced some regression due to consistently failing test test_07_reboot_ssvm :( let's fix that soon irrespective of what/who caused this cc @DaanHoogland


Conceptual: nullable X optional

Hello,
Specifically when parsing from json, there are two different situations which might need to be considered:

Key is not present. This, for javascript, would be translated to a key not present at all.
Value specifically set as null, as per JSON specification. This, in javascript, would be translated to a key with null value.

I have come to a point in which I am not sure about how to deal with this kind of validation.
I suppose nullable() means, in the sense of a schema, effectively an optional value: if it is present, it is parsed. If not present, it is ignored, meaning that an error is not thrown when parsing.
If this is the case, can we consider an optional() (like zod offers) for cases where the key might or not be present, meaning that the parsed object wouldn't have that key when parsed?

@marlon-sousa it could be solved like that: https://github.com/chubbyphp/chubbyphp-parsing/pull/13/files

https://github.com/chubbyphp/chubbyphp-parsing/releases/tag/1.2.0


After successfully setting the wallpaper, return to the previous screen.

I think it is not necessary to go back to the previous screen, just display the successful setup message.

Having the same issue, How did you fix it?

same here


Transparency of the project

Could we please have more transparency what is happening with this project to avoid unnecessary and parallel work.
At this point I have rewritten a significant part of the test vector generation for Wycheproof, just so that I can continue with the project. Without some coordination even more time might be wasted, which could be used for solving new issues instead. At this point I don't know who is interested in the project and what potentially outstanding issues are.
For example it would be helpful to have just a list of cryptographic primitives and their status (i.e. whether they are supported, whether test vectors have been tested or which party might be interested to use them)

We're still ramping up a maintenance framework for the project, so I think what comes across as a lack of transparency is really work in progress. For context, until end of March we worked on getting the handoff finalized, and we're still working on getting the generators published, for example.
What I can tell you is that most if not every major cryptographic implementation is interested in consuming the vectors, and some are interested in contributing. I have not heard requests for specific primitives besides ML-KEM and ML-DSA, for which we have some in-progress contributions. There is definitely interest in defining a new reusable format for test vectors, although I don't expect that to be something that works out in the span of a few weeks.
We had a session at OSCW to talk about what implementers want from test vector libraries. I am not sure it's super easy to follow in video, since there's a lot of audience participation, but you might be interested in the recording https://archive.org/details/oscw-2024-fillippo-valsorda-cryptographic-test-vectors or I can send you a transcript.
There is consensus around making the Wycheproof project not just a source of test vectors, but a repository where different sources/people/projects can pool vectors, so that downstreams can use them all at once. We'll work over the next few weeks to make it easier to contribute vectors and to consume them.
You're very welcome to send any new vectors. If you're worried about duplicating work, maybe open an issue to announce what you are working on, and then close it with the PR that submits those vectors?
Note that since we intend to accept vectors from multiple sources, we can't rely on regenerating them all when changing formats or adding new ones, but we will have to port the old ones, and iteratively add new ones.

Maybe I wasn't clear enough. When I left Google a year ago two managers independently asked me if I'm willing to continue the project. I also received some non-committal promises that I might get access to my generator code. Hence I've continued working on the project. Now we have two parallel projects. This is obviously not ideal. Hence it would make sense to have a meeting to clear things out. What worries me most is that I have worked on the project a over a decade. Hence I don't want to lose the project a second time.
Thanks for the link to the video.  I have a few comments:

There are already tests comparing the test vectors to the JSON schemas. The JSON schemas and the documentation of the test vector formats are generated from the same source, so that they would not fall out of sync. I don't know how to set this up on github however.
You talked about test vectors with intermediate values. In most cases these should be relatively easy to generate. Another option would be code that guesses the location where an error occurred. Most of the code I had there were colabs. If this kind of stuff is of interest then maybe it would be possible to recover these colabs (or rewrite them. They are probably less than 1000 lines of code)
You talked about testing the test vectors. One issue that needs to be discussed are test vectors with unclear states. An example are test vectors with modified private key. Here it is unclear if a crash with a modified private key is a vulnerability or not, since in most cases users modifying their own key means that they are just shooting themselves into the foot. However if private keys can be uploaded to an HSM, then crashes do matter. For such tests it is important to have a way to gain consensus whether libraries need strong private key validations or not. A big question here is how to decide what checks a library should perform when importing keys, or performing similar functions that are difficult to attack. I have generated a relatively large number of faulty keys. They have not been published exactly, since I don't know the expectations.
Test vector format: if we want to change the format of the test vectors then it would make sense to tackle this now before making big announcements.
Data structures for various languages: I think it should be possible to generate the data structure from the same source that generates the JSON schema and documentation.

I also received some non-committal promises that I might get access to my generator code.

I'm trying to enable that!

Hence it would make sense to have a meeting to clear things out.

Sure! I still don't have an email address for you, but you can reach out at<EMAIL_ADDRESS>and we can set up a call.
I want to be upfront: the goal of C2SP, my own intention, and the community's interest is in growing Wycheproof into a repository for (properly attributed!) test vectors from multiple sources. I think what you worked on can fit perfectly, but I want to be clear it's not the same single-source design of Wycheproof-at-Google.

There are already tests comparing the test vectors to the JSON schemas. The JSON schemas and the documentation of the test vector formats are generated from the same source, so that they would not fall out of sync. I don't know how to set this up on github however.

Happy to do the GitHub Actions setup.
I'm not sure I see the autogenerated documentation, where is it?

You talked about test vectors with intermediate values. In most cases these should be relatively easy to generate. Another option would be code that guesses the location where an error occurred. Most of the code I had there were colabs. If this kind of stuff is of interest then maybe it would be possible to recover these colabs (or rewrite them. They are probably less than 1000 lines of code)

Intermediate values are useful while developing an implementation, so I am not sure they make sense in the same format/place as the rest, but they would definitely be useful. Maybe they fit in the more "free-form" part of the repository we talked about at OSCW.

You talked about testing the test vectors. One issue that needs to be discussed are test vectors with unclear states.

When I talk about testing the test vector I just mean making sure they were generated correctly given their intention, so we can just write implementations that pass/fail based on the "acceptable" state.

Here it is unclear if a crash with a modified private key is a vulnerability or not, since in most cases users modifying their own key means that they are just shooting themselves into the foot.

Heh, this is a whole topic among implementers and different libraries take different views. I think it would make sense to have them, maybe with a specific flag/in specific files, to let libraries decide if they fit the threat model.

Test vector format: if we want to change the format of the test vectors then it would make sense to tackle this now before making big announcements.

I would rather take our time to gather community feedback on the new format. For now, I want to get us set up with refreshed docs, and the tooling to smoothly add and consume vectors in the current v1 format.

Data structures for various languages: I think it should be possible to generate the data structure from the same source that generates the JSON schema and documentation.

Generating them is indeed easy, but knowing what the right data structure is requires language-specific knowledge that I don't have across all languages. For now I think just making the JSON available is a good first step.

The auto generated file I talked about is
https://github.com/C2SP/wycheproof/blob/master/doc/types.md
Unfortunately, this is an old version, which is sad because the main goal was to generate doc and schemas from the same source, then test the schemas against the test vectors, which should ensure that  the documentation reflects the test vector files. Of course if that gets out of sync, then nothing is gained.
Yes, feedback would be nice. One thing I could do is generate some sample test vector files with a new format, just for discussion. An issue about the about the test vector format is open. I guess so fart there aren't any major complaints yet.

I'm wondering if the upcoming Eurocrypt would be an opportunity for some small meeting.
For example discussing the following topics would be helpful for the project:

Organization: So far I've rewritten about 80'000 lines of code for the test vector generation. A significant fraction might not have been necessary with a clearer organization of the project. Hence, it might be useful to consider how duplicate work can be avoided in the future.

Priorities: To have some impact it would be very useful to determine if there are important algorithms or primitives that are missing.

Tools: One thing I noticed is that the test vectors are often converted to other formats. It might be helpful to provide some tools to support such conversions.

Annoyances that make the project harder to use than necessary.

Friendly ping.
It is quite difficult to make efficient progress with the project without coordination. Given that this is mainly a project done in free time any kind of duplication should be avoided.


Video Annotation

Describe the bug
I installed Label Studio 1.7.2 (community edition) on a fresh Ubuntu 20.04 VM. I am trying to label videos. In total, I have around 80 2-minute videos divided into multiple tabs for different annotators to work on.
The problem that I am seeing is related to timeline. I hit play button, video starts. I hit pause button, video stops at say 30th frame. Now, if I select 35th or 40th frame in the timeline two things happen.
One, the video sort of freezes. As if, clicking on different frames doesn't have any impact on the videos position.
Secondly, if I hit play, the video starts from the 1st frame and not from the frame it was earlier paused on. It's as if I can't touch the timeline window without resetting it.
I wonder if anyone's seen this issue before.
Metadata:
Metadata:
major_brand     : isom
minor_version   : 512
compatible_brands: isomiso2avc1mp41
encoder         : Lavf58.29.100
Duration: 00:02:00.09, start: 0.000000, bitrate: 1415 kb/s
Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1920x1080, 1412 kb/s, 29.97 fps, 29.97 tbr, 11988 tbn, 59.94 tbc (default)
EDIT
The application is installed on a server. When I connect to the server directly and run the GUI, I see that it works. However, when I access the application as an annotator from the network, it gives above errors.

@asaeed9 where do you store video files?

video files are stored on the same server where the software is installed, an ubuntu 20.04 virtual machine on Oracle Cloud. Annotators access the software from their client machines through a URL. Everything works well on the server itself. It definitely seems a network issue, but with this network issue or congestion, label studio's behavior is rather unexpected (above errors).

Try using s3/gcp cloud storages, they well distributed across internet network. Seems it's not a LS issue.

Hi, I am facing the same issue with files hosted both locally and on google drive
Clicking on any frame in the timeline or inputting any frame number does not show that frame in the video player, and instead it resets to the first frame.
i.e., The only way to move between the video is pause/play.
Latest version (1.9.2-post0)


Installing in Pinokio

I have ComfyUI running in Pinokio, and i want to add this workflow, There is not python_embedded that I can find in the folder structure.
I can git cldoe to the custom nodes, but is there a way to get the script to also download all the models?

I have ComfyUI running in Pinokio, and i want to add this workflow, There is not python_embedded that I can find in the folder structure.
I can git cldoe to the custom nodes, but is there a way to get the script to also download all the models?

Hi @SoundGuy
You can generally install custom nodes with the Comfyui Manager the easiest way. No git clone or any commands needed. Same counts for downloading most of the models.
Lately I wrote a step guide about it in the Pinokio Wiki - How to load workflows and install custom nodes in ComfyUI
If you can't download a model with the Manager because it is not showing up in the list, you can also download the models manually into the respective folders. The folder structure inside of ComfyUI is the same. And you find ComfyUI in Pinokio in
.\pinokio\api\comfyui.git\app
Some models can be downloaded in the left side menu Download Models before starting ComfyUI.
In Download Models - Download by URL you can enter the direct Download URL of Huggingface models.
All these checkpoints get automatically downloaded into .\pinokio\api\comfyui.git\app\models\checkpoints and also appear in .\pinokio\drive\drives\peers\LongNumber\checkpoints and get automatically shared with other Stable Diffusion Apps such as Automatic1111 and Fooocus.
But there is no script that enables you to automatically download all necessary models of a workflow.

Thank @6Morpheus6 !
Ok, so I did the Pip install, and i used the node manager to install this from the URL, and now I've manually am downloading the models (ComfyUI crashes since i don't have everything it seems) and the Download by URL only has Checkpoint and Lora and no upscale so im' downloading them manually and putting them in the folder, however, i cannot find ""ComfyUI/models/annotators"" folder which for the Res101 and the  ControlnetHED files..  Also googling up what folder is that leads me back to this github page, seems like it's the only reference. are these suppose to be in some other folder?

@SoundGuy Are you sure the HED annotator is missing? If you installed the custom node Comfyui-controlnet_aux then you should still have all the preprocessors. In this image you see an example of the HED preprocessor.
Id you add the Preprocessor Selector from Controlnet_aux, the dropdown menu will show you the full list of all available and preinstalled preprocessors.

If ComfyUI crashes or you got Errors in the start procedure, I suggest to join the Pinokio Discord Server
and ask in pinokio-support. Communication, sharing images and troubleshooting would be way faster and more efficient there.
I'm sure I can help you to fix your issues.


Add method for loading a specific activity in a sequence

PT Story: https://www.pivotaltracker.com/story/show/178131977
[#178131977]
These changes allow you to load a specific activity within a sequence by adding a sequence-activity parameter to an Activity Player sequence's URL. They also add/update a sequence-activity param to/in the URL whenever a new activity is selected from the sequence navigation menu or sequence home page.

@scytacki Aside from the routing library question, do the latest changes look good?
Is it OK that when you navigate between activities in a sequence, the activity's index value will always be used to update the sequenceActivity param?
(The related change to LARA that's needed for this to work is in this PR.)

@scytacki Yeah, it doesn't use the activity ID. Thanks for catching that. I'm pretty sure though that that particular setting of the sequenceActivity param is unnecessary since it is set again in app.tsx when the selected activity loads (in renderActivity). So I just removed line 47 from sequence-nav.tsx. Does that make sense?


Output operators access non-existent members

operator<<(embree_ostream cout, const PointMi& line) in kernels/geometry/pointi.h accesses the non-existent member line.v0.
operator<<(embree_ostream cout, const QuadraticBezierCurve& a) in kernels/subdiv/bezier_curve.h accesses the non-existent member a.u.

Hi, just fixed this. The fix should be available in the next release.
Thanks!


Maintenance and improvements on our e2e startup

We want to improve our e2e testing to make it easier to run and more capable.
Considerations, questions, and things to improve:

Work with devs to break out tests that can be run in parallel
Devs running on different architectures
How best to e2e tests against multiple browsers in CI
What the heck is going on with the .git directory?
simplify docker-compose if possible
support an interactive cypress run with docker
Cypress version is up to 12. We've just updated it to version 10.
Gather resource utilization stats about e2e tests

Cypress supports the following browsers:

electron
chrome
chromium
chrome:canary
edge
firefox
webkit?

This is a WIP ticket and will be updated after a sync with Zedd.


Error compiling nixfromnpm

[nix-shell:~/Development/nixfromnpm]$ cabal install
Warning: The package list for 'hackage.haskell.org' does not exist. Run 'cabal
update' to download it.
Resolving dependencies...
Configuring nixfromnpm-0.10.3...
Building nixfromnpm-0.10.3...
Failed to install nixfromnpm-0.10.3
Build log ( /Users/tpflug/.cabal/logs/nixfromnpm-0.10.3.log ):
cabal: Entering directory '.'
Configuring nixfromnpm-0.10.3...
Building nixfromnpm-0.10.3...
Preprocessing executable 'nixfromnpm' for nixfromnpm-0.10.3...
[ 1 of 14] Compiling Paths_nixfromnpm ( dist/build/autogen/Paths_nixfromnpm.hs, dist/build/nixfromnpm/nixfromnpm-tmp/Paths_nixfromnpm.o )
[ 2 of 14] Compiling Filesystem.Path.Wrappers ( src/Filesystem/Path/Wrappers.hs, dist/build/nixfromnpm/nixfromnpm-tmp/Filesystem/Path/Wrappers.o )
[ 3 of 14] Compiling NixFromNpm.Common ( src/NixFromNpm/Common.hs, dist/build/nixfromnpm/nixfromnpm-tmp/NixFromNpm/Common.o )

src/NixFromNpm/Common.hs:219:12:
    Ambiguous occurrence ‘throw’
    It could refer to either ‘ClassyPrelude.throw’,
                             imported from ‘ClassyPrelude’ at src/NixFromNpm/Common.hs:(44,1)-(48,70)
                             (and originally defined in ‘safe-exceptions-<IP_ADDRESS>:Control.Exception.Safe’)
                          or ‘Control.Exception.Lifted.throw’,
                             imported from ‘Control.Exception.Lifted’ at src/NixFromNpm/Common.hs:60:1-47
                             (and originally defined in ‘GHC.Exception’)

src/NixFromNpm/Common.hs:223:9:
    Ambiguous occurrence ‘throw’
    It could refer to either ‘ClassyPrelude.throw’,
                             imported from ‘ClassyPrelude’ at src/NixFromNpm/Common.hs:(44,1)-(48,70)
                             (and originally defined in ‘safe-exceptions-<IP_ADDRESS>:Control.Exception.Safe’)
                          or ‘Control.Exception.Lifted.throw’,
                             imported from ‘Control.Exception.Lifted’ at src/NixFromNpm/Common.hs:60:1-47
                             (and originally defined in ‘GHC.Exception’)
cabal: Leaving directory '.'
cabal: Error: some packages failed to install:
nixfromnpm-0.10.3 failed during the building phase. The exception was:
ExitFailure 1

I tried a couple of things and fixed some faulty expressions on the way but I always end up with one or more ambiguity errors like the above.

Looks like this is a problem with an upstream Haskell dependency in a nixpkgs
update :( I'll take a look but hopefully the fix is straightforward.
On Friday, August 5, 2016, Tobias Pflug<EMAIL_ADDRESS>wrote:

[nix-shell:~/Development/nixfromnpm]$ cabal install
Warning: The package list for 'hackage.haskell.org' does not exist. Run 'cabal
update' to download it.
Resolving dependencies...
Configuring nixfromnpm-0.10.3...
Building nixfromnpm-0.10.3...
Failed to install nixfromnpm-0.10.3
Build log ( /Users/tpflug/.cabal/logs/nixfromnpm-0.10.3.log ):
cabal: Entering directory '.'
Configuring nixfromnpm-0.10.3...
Building nixfromnpm-0.10.3...
Preprocessing executable 'nixfromnpm' for nixfromnpm-0.10.3...
[ 1 of 14] Compiling Paths_nixfromnpm ( dist/build/autogen/Paths_nixfromnpm.hs, dist/build/nixfromnpm/nixfromnpm-tmp/Paths_nixfromnpm.o )
[ 2 of 14] Compiling Filesystem.Path.Wrappers ( src/Filesystem/Path/Wrappers.hs, dist/build/nixfromnpm/nixfromnpm-tmp/Filesystem/Path/Wrappers.o )
[ 3 of 14] Compiling NixFromNpm.Common ( src/NixFromNpm/Common.hs, dist/build/nixfromnpm/nixfromnpm-tmp/NixFromNpm/Common.o )
src/NixFromNpm/Common.hs:219:12:
Ambiguous occurrence ‘throw’
It could refer to either ‘ClassyPrelude.throw’,
imported from ‘ClassyPrelude’ at src/NixFromNpm/Common.hs:(44,1)-(48,70)
(and originally defined in ‘safe-exceptions-<IP_ADDRESS>:Control.Exception.Safe’)
or ‘Control.Exception.Lifted.throw’,
imported from ‘Control.Exception.Lifted’ at src/NixFromNpm/Common.hs:60:1-47
(and originally defined in ‘GHC.Exception’)
src/NixFromNpm/Common.hs:223:9:
Ambiguous occurrence ‘throw’
It could refer to either ‘ClassyPrelude.throw’,
imported from ‘ClassyPrelude’ at src/NixFromNpm/Common.hs:(44,1)-(48,70)
(and originally defined in ‘safe-exceptions-<IP_ADDRESS>:Control.Exception.Safe’)
or ‘Control.Exception.Lifted.throw’,
imported from ‘Control.Exception.Lifted’ at src/NixFromNpm/Common.hs:60:1-47
(and originally defined in ‘GHC.Exception’)
cabal: Leaving directory '.'
cabal: Error: some packages failed to install:
nixfromnpm-0.10.3 failed during the building phase. The exception was:
ExitFailure 1
I tried a couple of things and fixed some faulty expressions on the way
but I always end up with one or more ambiguity errors like the above.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/adnelson/nixfromnpm/issues/68, or mute the thread
https://github.com/notifications/unsubscribe-auth/AE2wt74lNcEmqeWSgQJqkUV1CzmsM6BQks5qc6dMgaJpZM4JeEKZ
.

--
-- Allen

So I'm able to build successfully off of the latest channel for nixos, but when attempting to build off of the latest channel of nixpkgs, and upstream dependency fails (i.e. before it even gets to nixfromnpm). Can you tell me what commit of nixpkgs you're building off of? Assuming you're using a channel, you can see it by running
$ readlink ~/.nix-defexpr/channels/nixos
/nix/store/75hkcmvzspsiphzn2s56lyfy4z9b1zz4-nixos-16.03.1171.9cb194c/nixos

(replace "nixos" with "nixpkgs" if you're using nixpkgs)
The 9cb194c part is the commit.


Error install botKit

Hello guys, I'm trying to install botkit, but it always gives a bug, could anyone help me?
npm WARN addRemoteGit Error: Command failed: git -c core.longpaths=true config -
-get remote.origin.url
npm WARN addRemoteGit
npm WARN addRemoteGit     at ChildProcess.exithandler (child_process.js:211:12)
npm WARN addRemoteGit     at emitTwo (events.js:106:13)
npm WARN addRemoteGit     at ChildProcess.emit (events.js:192:7)
npm WARN addRemoteGit     at maybeClose (internal/child_process.js:890:16)
npm WARN addRemoteGit     at Socket. (internal/child_process.js:334:1
1)
npm WARN addRemoteGit     at emitOne (events.js:96:13)
npm WARN addRemoteGit     at Socket.emit (events.js:189:7)
npm WARN addRemoteGit     at Pipe._handle.close [as _onclose] (net.js:501:12)
npm WARN addRemoteGit  git://github.com/ianwremmel/extend-error.git resetting re
mote C:\Users\rcborges\AppData\Roaming\npm-cache_git-remotes\git-github-com-ian
wremmel-extend-error-git-024938ae because of error: { Error: Command failed: git
-c core.longpaths=true config --get remote.origin.url
npm WARN addRemoteGit
npm WARN addRemoteGit     at ChildProcess.exithandler (child_process.js:211:12)
npm WARN addRemoteGit     at emitTwo (events.js:106:13)
npm WARN addRemoteGit     at ChildProcess.emit (events.js:192:7)
npm WARN addRemoteGit     at maybeClose (internal/child_process.js:890:16)
npm WARN addRemoteGit     at Socket. (internal/child_process.js:334:1
1)
npm WARN addRemoteGit     at emitOne (events.js:96:13)
npm WARN addRemoteGit     at Socket.emit (events.js:189:7)
npm WARN addRemoteGit     at Pipe._handle.close [as _onclose] (net.js:501:12)
npm WARN addRemoteGit   killed: false,
npm WARN addRemoteGit   code: 1,
npm WARN addRemoteGit   signal: null,
npm WARN addRemoteGit   cmd: 'git -c core.longpaths=true config --get remote.ori
gin.url' }
npm ERR! git clone --template=C:\Users\rcborges\AppData\Roaming\npm-cache_git-r
emotes_templates --mirror git://github.com/ianwremmel/extend-error.git C:\Users
\rcborges\AppData\Roaming\npm-cache_git-remotes\git-github-com-ianwremmel-exten
d-error-git-024938ae: Cloning into bare repository 'C:\Users\rcborges\AppData\Ro
aming\npm-cache_git-remotes\git-github-com-ianwremmel-extend-error-git-024938ae
'...
npm ERR! git clone --template=C:\Users\rcborges\AppData\Roaming\npm-cache_git-r
emotes_templates --mirror git://github.com/ianwremmel/extend-error.git C:\Users
\rcborges\AppData\Roaming\npm-cache_git-remotes\git-github-com-ianwremmel-exten
d-error-git-024938ae: fatal: unable to connect to github.com:
npm ERR! git clone --template=C:\Users\rcborges\AppData\Roaming\npm-cache_git-r
emotes_templates --mirror git://github.com/ianwremmel/extend-error.git C:\Users
\rcborges\AppData\Roaming\npm-cache_git-remotes\git-github-com-ianwremmel-exten
d-error-git-024938ae: github.com[0: <IP_ADDRESS>]: errno=No error
npm ERR! git clone --template=C:\Users\rcborges\AppData\Roaming\npm-cache_git-r
emotes_templates --mirror git://github.com/ianwremmel/extend-error.git C:\Users
\rcborges\AppData\Roaming\npm-cache_git-remotes\git-github-com-ianwremmel-exten
d-error-git-024938ae: github.com[1: <IP_ADDRESS>]: errno=No error
npm ERR! Windows_NT 6.1.7601
npm ERR! argv "C:\Program Files\nodejs\node.exe" "C:\Users\rcborges\AppDat
a\Roaming\npm\node_modules\npm\bin\npm-cli.js" "install"
npm ERR! node v7.5.0
npm ERR! npm  v4.3.0
npm ERR! code 128
npm ERR! Command failed: git -c core.longpaths=true clone --template=C:\Users\rc
borges\AppData\Roaming\npm-cache_git-remotes_templates --mirror git://github.c
om/ianwremmel/extend-error.git C:\Users\rcborges\AppData\Roaming\npm-cache_git-
remotes\git-github-com-ianwremmel-extend-error-git-024938ae
npm ERR! Cloning into bare repository 'C:\Users\rcborges\AppData\Roaming\npm-cac
he_git-remotes\git-github-com-ianwremmel-extend-error-git-024938ae'...
npm ERR! fatal: unable to connect to github.com:
npm ERR! github.com[0: <IP_ADDRESS>]: errno=No error
npm ERR! github.com[1: <IP_ADDRESS>]: errno=No error
npm ERR!
npm ERR!
npm ERR!
npm ERR! If you need help, you may report this error at:
npm ERR!     https://github.com/npm/npm/issues
npm ERR! Please include the following file with any support request:
npm ERR!     C:\Users\rcborges\AppData\Roaming\npm-cache_logs\2017-03-08T15_08_
13_729Z-debug.log

It looks like git/npm is hosed on your machine, can you try reinstalling those or fixing them and try again?

I tried this, but it did not work. I'm using proxy, can that be it?

Mostly likely! You'd need to make sure the proxy allows access to all the services mentioned in the error above, or use a starter kit to run it on gomix or heroku.

I am having the same problem. Just in case to fix the issue, it is trying to connect to <IP_ADDRESS> and <IP_ADDRESS>, which returns a non valid certificate issue when accessing via a browser.

Both those errors indicate its failing on your private network. You should work with your proxy admin to allow access to Github and NPM.

I do think I have fully access to github and npm. It is the first time I have this kind of problems.

You can also skip the NPM install and download a zip directly from the Github if your network is blocking NPM.

I tried this, downloaded the file directly from Github and executed npm install, but it still does not work

Getting beyond the scope of this project, but you might need to check out:
https://github.com/arei/npmbox

But I think if you are in restrictively proxied environment, you are going to keep running into connection issues all the way down. I would resolve those issues instead of trying workarounds.

I ran into the same exact error when installing:
npm install --save botkit
PS: It may be due to proxy but other packages seem to install fine with npm install, so not sure where the problem is.

Comigo acontece a mesma coisa, quando eu executo:
npm install botkit-middleware-watson --save
Funciona normalmente, o erro só ocorre com:
npm install --save botkit

The same thing happens to me when I execute:
Npm install botkit-middleware-watson --save
It works normally, the error only occurs with:
Npm install --save botkit

Are you able to clone other github projects on your machine, per your logs it seems like your proxy is blocking git commands.

i guess it is a problem with proxy, i used a vpn connection and i could run the command fine..

Eu resolvi o problema ao executar : npm config set proxy http://user:pass@domain:port


Use sbt-native-packager for releases

It would be nice to have .deb, .rpm etc. packages in order to install Ammonite easily

If nobody has done it after a year let's call this a wontfix for now


Add rds snapshot on delete example

This PR adds an example for Amazon RDS DB instance with a deletion policy as follows.

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/sample-templates-services-us-west-2.html
https://s3-us-west-2.amazonaws.com/cloudformation-templates-us-west-2/RDS_Snapshot_On_Delete.template

Thanks!

Gracias!


Update for Serverless Application Repository hosting

This replaces the per-region S3 buckets with a Serverless Application Repository entry.
The SAR is in us-east-1 but allows you to reference the application from any region. This removes a step when adding support for a new region to the elastic stack. (We still have to copy the AMI(s) to the new region but at least not this too).
I also took this change as an opportunity to require an SSM parameter for the agent token. Inside this serverless application we can strongly type the BuildkiteAgentTokenParameter parameter as an SSM parameter that exists and handle the difference between a literal token and SSM parameter name in the enclosing template outside the application, simplifying the code.
So far this is a straight copy of the resources from the elastic-ci stack, I haven’t fiddled with the parameter naming for autoscaling yet, I also haven’t added Descriptions to the parameters.
Currently it supports overriding the lambda IAM role with your own one, but I think it makes more sense to bring in the KMS key ID and completely generate the correct permissions inside the application. I want to experiment with exporting the role ARN from this template and attaching the KMS permission from outside it first.
cc @lox @pda @chloeruka

@yob while I’m working on the agent scaler I’d like to push this over the line so we can adopt it in the elastic stack later, going to look at fixing up the publishing machinery in Buildkite accounts now

neat!
So this will start publishing new versions to SAR, and we can follow up with a change in the elastic stack that starts using the SAR version instead of the S3 version?

also took this change as an opportunity to require an SSM parameter for the agent token. Inside this serverless application we can strongly type the BuildkiteAgentTokenParameter parameter as an SSM parameter that exists and handle the difference between a literal token and SSM parameter name in the enclosing template outside the application, simplifying the code.

Does this mean we'll need to remove the BuildkiteToken parameter from the elastic stack and cut a new major version 6.x?


chore(main): release 0.5.3

:robot: I have created a release beep boop
0.5.3 (2023-05-02)
Bug Fixes

improve logging when CIS .status.conditions patch fails (#357) (beece44)

Dependency Updates

deps: bump k8s.io/klog/v2 from 2.90.1 to 2.100.1 (#355) (d486f1d)
deps: update ghcr.io/aquasecurity/trivy docker tag to v0.41.0 (#348) (9aa6626)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/statnett/image-scanner-operator/releases/tag/v0.5.3 :sunflower:


Support sub-pixel anti-aliasing and fix blurry text issues

This PR does the following:

Characters are now drawn to an integer grid, but cell width is now floored. Originally it was ceiled which made the text look odd, and then a floating point number was used which makes the CharAtlas optimizations look blurry. Now characters look great whether they're cached or uncached.
Background and foreground layers are now merged, this was necessary to support sub-pixel anti-aliasing as the effect only applies when drawn only an opaque background.
Bold is now supported for uncached text.

Fixes #988
Fixes #987
Fixes #973

Browser zoom 100%
Before:

After:

Browser zoom 100%, magnified
Before zoomed in:

After zoomed in:

Browser zoom 150%
Before:

After:

I just covered the following cases:

Draw background on text layer before the canvas is shown to prevent a black flash when the background isn't #000
Draw background on char atlas to properly support non-#000 backgrounds
Redraw background when the canvas is resized

Coverage decreased (-0.2%) to 70.003% when pulling b225866c270a554781ac2116844fc8dbb5acfce9 on Tyriar:blurriness_fix into 136c82f9adc05c4182e1e07953f5640a04d8475c on sourcelair:v3.

Coverage decreased (-0.03%) to 70.127% when pulling c2b765f3ffc39f11a1663abfd6c9ce67c2544d17 on Tyriar:blurriness_fix into 136c82f9adc05c4182e1e07953f5640a04d8475c on sourcelair:v3.

Coverage decreased (-0.03%) to 70.127% when pulling c2b765f3ffc39f11a1663abfd6c9ce67c2544d17 on Tyriar:blurriness_fix into 136c82f9adc05c4182e1e07953f5640a04d8475c on sourcelair:v3.

Coverage decreased (-0.1%) to 70.035% when pulling aca7ab63e87899b1e8160f047b49812756eb3574 on Tyriar:blurriness_fix into 136c82f9adc05c4182e1e07953f5640a04d8475c on sourcelair:v3.

Coverage decreased (-0.04%) to 70.116% when pulling fee381e29c3d24e67d84351a91081ac2c4a1af76 on Tyriar:blurriness_fix into 136c82f9adc05c4182e1e07953f5640a04d8475c on sourcelair:v3.

Coverage decreased (-0.03%) to 70.127% when pulling 8bdc8fb7a22b0d16a8cfe5e54d9eee42d5216e0f on Tyriar:blurriness_fix into 136c82f9adc05c4182e1e07953f5640a04d8475c on sourcelair:v3.

The paint flashing in 2 isn't actually re-drawing the whole line, Chrome's just saying "things in this rectangle are changing"


Suggestions missing on ALT+. but present for F8

Suggestions missing on ALT+. but present for F8
Latest patched Windows 10, brand new install of latest VSCode.
Language: default English.
Word: "acceptence"
Please let me know if I can provide more details.

I'm able to repro that - I'll need to look into the issue and come back to see what is required to fix it :)  Thanks for reporting it.

I took a look in the 'config' JSON file, and found that one word had been added thrice -- not sure if it is connected.

I had another crack at this and could no longer repro the issue.  Are you still seeing this problem/do you have any repeatable steps?
Sorry,
Sean

Ditto. Perhaps VSCode updates have cured it? I have spotted another issue, though, for another ticket.


Fix log spam on invalid invalid query

What

Resolves: https://github.com/rerun-io/rerun/issues/5568

Fixes recent regression of getting Could not find root data result for Space View SpaceViewId(2e0664ef-251a-4813-9eae-f728818bf507) spamed when editing the query expressions. E.g. this would trigger when changing a query from + $origin/** to + $origin/*
Checklist

[x] I have read and agree to Contributor Guide and the Code of Conduct
[x] I've included a screenshot or gif (if applicable)
[ ] I have tested the web demo (if applicable):

Using newly built examples: app.rerun.io
Using examples from latest main build: app.rerun.io
Using full set of examples from nightly build: app.rerun.io

[x] The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
[x] If applicable, add a new check to the release checklist!

PR Build Summary
Docs preview
Examples preview
Recent benchmark results
Wasm size tracking

Reviewing this led me to instead implement: https://github.com/rerun-io/rerun/pull/5571/, which I think is the preferable fix since it avoids this query (that didn't need to be there) all together.
This is important for still being able to edit the visible history on an empty space view.

Closing in favor of that one


Extreme high resources needed

I'm getting a big CPU and memory usage.

Are you also having similar problems?

Hi @joaogbcravo ,
Not even remotely Oo
How many secrets do you manage via the operator and what environment are you running?

Just checked a bit and my current consumption on my cluster is very low:
NAME                                                    CPU(cores)   MEMORY(bytes)
bitwarden-crd-bitwarden-crd-operator-696987c566-mh79g   1m           91Mi

ofc there are spikes because of the on update timer and the relogin schedule but nothing too serious. in your case it really seems like the bitwarden cli is continuously running, which should not be the regular case.
The log entry may very well be a reason for that. you can find the startup logic here https://github.com/Lerentis/bitwarden-crd-operator/blob/main/src/bitwardenCrdOperator.py#L37
as you can see the operator starts with a signin and not with the create_managed_secret handler

I will close this. This is not an issue - more like a discussion.
Thanks for the fast answers!


Low Accuracy on 80 Tasks After Fine-Tuning Meta-Llama-3-8B-Instruct (19/400 = 4.75%)

I used 80 tasks from the file task_info_selected.csv in this repository, and fine-tuned Meta-Llama-3-8B-Instruct using the train.sh(train.sh.txt below) script generated from this repository. Then, I generated the predict.sh(predict.sh.txt below) script for inference following the instructions in the same repository here. However, the final result I got is a Competition Accuracy of 19 / 400 = 0.0475, meaning it only got 19 tasks correct. Can you help me identify what might be wrong?
/workspace/wubing/marc/test_time_train.py, for using the selected 80 tasks, I updated the code blow.
if args.num_tasks is not None:     if args.num_tasks_selected:         import pandas as pd         df = pd.read_csv('/workspace/wubing/marc/task_info_selected.csv')         selected_tasks = df['task_id'].to_list()         arc_test_tasks = [task for task in arc_test_tasks if task.name.replace("-0", "") in selected_tasks]         print("Use selected tasks as ttt paper")     else:         arc_test_tasks = arc_test_tasks[: args.num_tasks]
predict.log
train.log
predict.sh.txt
train.sh.txt

Which checkpoints do you use in Meta-Llama-3-8B-Instruct folder?

The expected value should be around 36 tasks for this model. I attached the logs of inference and predictions for what you're trying to run per my understanding. I also attached one of the tasks TTT loss logs. The checkpoint used in this run should be same as: https://huggingface.co/ekinakyurek/marc-8B-finetuned-llama3/tree/main
0a1d4ef5_tt.txt
8B_grids_no_lm_generated_model_tti.zip
==========
We also have some verification notebooks now on kaggle. These use modal branch and BARC checkpoints. This should be fully replicable but requires modal account and some credits. However, you can just take a look and see the logs settings etc. You can also see the induction part details as well from the BARC team.
For BARC checkpoints make sure the torchtune tokenizer is in BARC mode --- requires editing to tokenizer file under your torchtune installation: https://github.com/ekinakyurek/torchtune/blob/efd85e000e83dcf6803c623cf83943e4a817377a/torchtune/models/llama3/_tokenizer.py#L51-L55
Here are the notebooks:
Problem 0-99: (5033.9s)
https://www.kaggle.com/code/xu3cpn/dev-ensemble-induction-and-transduction?scriptVersionId=209665817
Problem 100-199: (4017.6s)
https://www.kaggle.com/code/xu3cpn/dev-ensemble-induction-and-transduction?scriptVersionId=209687715
Problem 200-299: (5571.9s)
https://www.kaggle.com/code/xu3cpn/dev-ensemble-induction-and-transduction?scriptVersionId=209747304
Problem 300-399: (4822.4s)
https://www.kaggle.com/code/xu3cpn/dev-ensemble-induction-and-transduction?scriptVersionId=209779088
Score: 251.5/400 = 62.875

Meta-Llama-3-8B-Instruct

I am using the downloaded safetensors from Meta-Llama-3-8B-Instruct.

Which checkpoints do you use in Meta-Llama-3-8B-Instruct folder?

I am using the downloaded safetensors from Meta-Llama-3-8B-Instruct.

For task 0a1d4ef5, my log is in 0a1d4ef5_log_1732848905.txt.txt
I noticed that my loss values are quite different from yours. Here are mine:
Step 1: loss: 1.4690, lr: 7.14e-06, tokens_per_second_per_gpu: 6844.40
...
Step 144: loss: 0.0259, lr: 0.0, tokens_per_second_per_gpu: 6964.37
Below are yours:
Step 1: loss: 0.3976, lr: 7.14e-06, tokens_per_second_per_gpu: 4387.33
...
Step 144: loss: 7.03e-05, lr: 0.0, tokens_per_second_per_gpu: 7082.98

Which checkpoints do you use in Meta-Llama-3-8B-Instruct folder?

I am using the downloaded safetensors from Meta-Llama-3-8B-Instruct.

Okay that’s the problem I guess. Can you use our finetuned checkpoints as in the paper.
https://huggingface.co/ekinakyurek/marc-8B-finetuned-llama3/tree/main


Minimalism (1/n)

Just for fun I started looking at how to bridge the gap between the ML subset used in the current interpreter, and the one supported by the Scheme compiler. I'm looking at the issues one by one, and I only did two trivial changes for now. I may push more in the future, but I will stop when you start reviewing to avoid race conditions -- and open a new PR for following patches.

Seems good!


Update the python deps caused by numpy 2.0

Addresses https://github.com/apache/beam/issues/32681
Following https://cwiki.apache.org/confluence/display/BEAM/Python+Tips#PythonTips-HowtoupdatedependenciesthatareinstalledinPythoncontainerimages and https://cwiki.apache.org/confluence/display/BEAM/Python+Tips#PythonTips-InstallingPythoninterpreters, updated the base image deps.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

cc @jrmccluskey

We will pin protobuf==4.25.5 for now with Beam 2.61.0.

cc @Abacn later I will polish this PR to update the deps. FYI.

stop reviewer notifications

Given how close we are to the release cut, I would keep the dependency changes to a minimum or do this update after the release cut.

For example, if there is a regression in google-api-core==2.22.0, we have only two weeks to notice that.

@damccorm what do you think? I am fine to do this after 2.61.0.

Its borderline, but I probably agree waiting is safer. I don't think we need to do this for the current release

Rebased. Based on the discussions, we should get this in ASAP after 2.61.0.

https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python_Coverage.yml, https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python_ML.yml,  are also read on the master. My PR is not related to these failed workflows.


The db works without password in start, but it has happened to me after some time it starts asking for password which is not set anywhere. What's the solution for this?

How are you connecting to the database? Connections from <IP_ADDRESS>/0 are set to trust.
https://github.com/postgresml/postgresml/blob/master/pgml-extension/docker/pg_hba.conf#L96


net: mqtt: use zsock_ functions

Using zephyr's internals zsock_ calls make mqtt library more compatible,
now it does not depend on NET_SOCKETS_POSIX_NAMES.
Signed-off-by: Jan Pohanka<EMAIL_ADDRESS>

2.4 is released so we could try to merge this, @xhpohanka could you check the sanitychecker failures and re-submit?

2.4 is released so we could try to merge this, @xhpohanka could you check the sanitychecker failures and re-submit?

I was on holiday for last three weeks, I hope I will have time to fix it soon. From the log it seems to me that current sanity checks can be caused by something different than my patches, is that even possible?

is that even possible?

Yes, that is possible. Could you rebase against latest master and re-submit, we will then see if the errors will disappear.


Home path should probably be retruning HTML response

Testing #22302
@app.get("/")
def home(request: Request) -> Response:
    return Response(content='
Add /docs to the end of the URL to access the Swagger UI or click here
', headers={"Content-Type": "text/html; charset=utf-8"})

Good point! I ended up removing this route given I didn't mention it in the tutorial (https://github.com/microsoft/vscode-docs/pull/6760/commits/5b8cdfcf5f2f647ca92188167b6efdb98f657a4a), and didn't want to make the tutorial even longer by explaining it. But great to keep this in my mind!


issues in bachelor studyrights (prblms in oodi-oodikone)

KH40_004
   2017    oodi only 1 both 96
   011531500

Should not be in oodi-oodikone since is not present at current term.
KH50_001
   2020    sis only 1 both 426
   013866367

Should be in oodi-oodikone since has reactivated the studyright. Sis-oodikone is here right
KH50_005
   2020    sis only 1 both 680
   014617913

Should be in oodi-oodikone since has registered absent this term
KH55_001
   2019    sis only 2 both 165
   015160142

no idea why oodi-oodikone does not show this

011531500 is actually ok, since absents are also included in populations be default

not fixing, since these are correct in sis


Computational Complexity

Hey, rather than an issue with your code I had a question. You note that you're using Montgomery reduction to achieve a better performance. However, I can't seem to find what exact form of it you are using. Could you comment on this, in terms of multiplication, what is the computational complexity. Thus how many multiplications still take place?
Next, it seems that the signing procedure is a bit slower than verification for secp256k1. Based on how ecdsa works, one would expect that it would be the other way around. Could you comment on how this is achieved?
Thanks in advance!

Actually the code uses a Montgomery Ladder to do point multiplication in a constant time manner. So the question of how many multiplications take place doesn't really make sense since it is the point multiplication algorithm.
I would guess signature verification is slightly longer because it requires two point multiplications which, even using Shamir's Trick, will make it take a little longer than signing which only requires one point multiplication.

Thanks for letting me know it uses a Montgomery Ladder, that is helpful. On the performance thing, it seems that signing is, on my machine, 0.0027 seconds while verification is 0,0023 seconds. Like you said, I'd expect verification to be slower due to the two point multiplications. However, it is faster. Any comments on why?


 One PR is enough for one feature/bugfix. And even then, the very least is to read the Contribution Guidelines and provide a description.
I'll close all the others, please discuss only here.

What exactly do these changes do?

It's related to #1020. But see my comment: https://github.com/SFML/SFML/issues/1020#issuecomment-167429583.

Sorry, I this is related to my forum post on submitting to Mac AppStore. All external libs used in a project need to have these lines added to there .plist for them to pass a validation phase on submit.
Sorry for the confusion

Alright, seems like 7 pull requests weren't enough...
Discussion continues in https://github.com/SFML/SFML/pull/1033.


Add line wrapping support for the formatter

Description:
eg:
Original:
function foo(int a, int b, int c, int d) {
}

Formatted:
function foo(int a, int b,
             int c, int d) {
}

Added with https://github.com/ballerina-platform/ballerina-lang/commit/81b2cbc3266784e78c1f68df14a7fe00d47360c1


[Content block with L-shaped card group] Assign name & create functional specs - AEM Learn ecosystem

User Story

As a [user role below]:
DDS developer

I need to:
have the Content block with L-shaped card group functional specs

so that I can:
so that I can properly code the Content block with L-shaped card group component that meets the Design functions and intent

Additional information

Overview and scope of the engineering work should be included in the linked epic (#6129 )
This component is designed by AEM.  Pavol Prok is the designer

Acceptance criteria

[ ] New component name is selected, documented and communicated
[ ] Documented Content block with L-shaped card group functional specifications
[ ] Sent and/or presented the specs to Design and Engineering for their review and comments
[ ] Comment is added with link to functional specs

enhancement Offset cards in card group:
https://github.com/carbon-design-system/carbon-for-ibm-dotcom-website/wiki/Card-group
new Background media component:
https://github.com/carbon-design-system/carbon-for-ibm-dotcom-website/wiki/Background-media
new Card section offset:
https://github.com/carbon-design-system/carbon-for-ibm-dotcom-website/wiki/Card-section-offset


LoadGen: Customize doxygen organization.

Hi @christ1ne , ptal at this one too. It's mostly an organizational change, so not as urgent as the previous patch, but it's not as invasive. Thanks!


HBase Secondary Index is not working

Hi Lily,
When we set below property in hbase-site.xml for creating Phoenix secondary index, Lily Indexer is not working.

hbase.regionserver.wal.codec
org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec

@paulfocke

I've also faced this Issue. If I need to create secondary Indexes in Phoenix then I have to update my WAL codec in hbase-site and in the mean time the Lily Indexer gots unsupportive.
Is there any resolution where I can use both Phoenix Secondary Indexes and Lily Indexer collaboratively.
Thanks


WFLY-7711 Make AbstractSubsystemBaseTest#testSchemaOfSubsystemTemplat…

…es opt-in as opposed to flooding reports with @Ignored tests (WFCORE-1677)
https://issues.jboss.org/browse/WFLY-7711
WildFly part of https://issues.jboss.org/browse/WFCORE-1677 which needed needed wildfly/wildfly-core#1938 (now merged in core and here).

@rhusar needs a rebase

Rebased.

Retest this please


Cleanup of Dojo locations information

Business Goal/Theory
For reporting and searching purposes, there are several issues with the location information of Dojos.
List of issues to contend with

[ ] No regional information stored (county, state etc.)

Closing, done on https://github.com/CoderDojo/cp-dojos-service/commit/0864a2b8cdc7936f34efbb84a8f6bacea0985037


[AutoRelease] t2-sql-2024-03-14-22678(can only be merged by SDK owner)

https://github.com/Azure/sdk-release-request/issues/5040
Live test success
https://dev.azure.com/azure-sdk/internal/_build?definitionId=1034
BuildTargetingString
azure-mgmt-sql
Skip.CreateApiReview
true

issue link:https://github.com/Azure/sdk-release-request/issues/5040

/check-enforcer override


NoMethodError with convert :pathname_list

Describe the problem
Using convert :pathname_list results in undefined method 'strip' for ["vendor/spdx.json", "spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json"]:Array (NoMethodError)
Steps to reproduce the problem
module Jsonlinter
  class Cli
    include TTY::Option

    usage do
      program "jsonlinter"

      command "run"
    end

    argument :path do
      name "path"
      arity one_or_more
      convert :pathname_list
      desc "Paths (or files) to scan"
    end

    flag :help do
      short "-h"
      long "--help"
      desc "Print usage"
    end

    flag :silent do
      long "--silent"
      desc "Do not display any output"
    end

    def run
      if params[:help]
        print help
      elsif params.errors.any?
        puts params.errors.summary
      else
        pp params.to_h
      end
    end
  end
end

Actual behaviour
$ ruby -I/home/quintasan/source/jsonlinter/lib /home/quintasan/source/jsonlinter/exe/jsonlinter vendor/spdx.json spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json

/home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/conversions.rb:95:in `block (2 levels) in <module:Conversions>': undefined method `strip' for ["vendor/spdx.json", "spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json"]:Array (NoMethodError)

           .map { |v| v.strip.gsub(/\\\\,/, ",") }
                       ^^^^^^
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/conversions.rb:95:in `map'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/conversions.rb:95:in `block in <module:Conversions>'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/conversions.rb:118:in `block (3 levels) in <module:Conversions>'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/param_conversion.rb:22:in `call'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/pipeline.rb:29:in `block in call'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/pipeline.rb:28:in `each'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/pipeline.rb:28:in `call'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser/arguments.rb:161:in `assign_argument'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser/arguments.rb:62:in `block in parse'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser/arguments.rb:58:in `each'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser/arguments.rb:58:in `parse'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser.rb:50:in `block in parse'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser.rb:45:in `each'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option/parser.rb:45:in `parse'
        from /home/quintasan/.local/share/rtx/installs/ruby/3.1.4/lib/ruby/gems/3.1.0/gems/tty-option-0.3.0/lib/tty/option.rb:54:in `parse'
        from /home/quintasan/source/jsonlinter/exe/jsonlinter:38:in `<main>'

Expected behaviour
I expected it to work with multiple paths
Describe your environment

OS version: Ubuntu 22.04
Ruby version: 3.1.4
TTY::Option version: 0.3.0

It does work properly if I pass one path to it:
ruby -I/home/quintasan/source/jsonlinter/lib /home/quintasan/source/jsonlinter/exe/jsonlinter vendor/spdx.json
{:help=>false, :silent=>false, :path=>[#<Pathname:vendor/spdx.json>]}

Hi Michał 👋
Thanks for using the tty-option gem.
I don't believe this to be a bug but a misunderstanding on how to use the library.
For your example to work you need to call the 2.6 parse method first.
For instance, passing the following paths to parse converts the paths as expected:
linter = Jsonlinter::Cli.new
linter.parse(%w[vendor/spdx.json spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json])
linter.run
# =>
# {:help=>false, :silent=>false, :path=>[#<Pathname:vendor/spdx.json>, #<Pathname:spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json>]}

Alternatively, add the parse method call to your run method:
def run
  parse
  if params[:help]
  ...
end

Then running:
ruby jsonlinter vendor/spdx.json spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json

Gives the same result.

@piotrmurach Fascinating but this is almost exactly the same way I run it:
cmd = Jsonlinter::Cli.new
cmd.parse
cmd.run

See https://gitlab.com/Quintasan/jsonlinter/-/blob/master/exe/jsonlinter?ref_type=heads

I had a quick play with your code.
It seems that when you comment out the require_realtive "runner" and the Jsonlinter::Runner.call(params) from the lib/jsonlinter/cli.rb and simply output puts params.to_h it works fine:
bundle exec exe/jsonlinter vendor/spdx.json spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json
# =>
# {:autocorrect=>false,
# :help=>false,
# :silent=>false,
# :paths=>[#<Pathname:vendor/spdx.json>, #<Pathname:spec/frontend/editor/schema/ci/json_tests/positive_tests/retry.json>]}

I wonder what is happening inside the runner file to 'override' this behaviour?

@piotrmurach fair enough, that seems to squarely put the problem on my side. I don't have access to a computer ATM so I'll play around with it to tomorrow.

As I was already playing with your gem I decided to dig into why this is happening.
The culprit is the activesupport dependency.
In particular, the inclusion of require "active_support/core_ext/array/grouping" in the lib/jsonlinter/discriminator.rb is the real issue. It overrides the Array#split core method. The split is used internally by tty-option to convert any list arguments whether they are pathname or other objects.
I consider activesupport use in gems an antipattern and red flag. Once you include it and override core ruby classes then all bets are off. I'd strongly encourage you to stop using this dependency as you may have a hard time finding bugs in the future. I don't believe there is a safe way to use it and any benefits gained may not outweigh the obvious downsides.
I'd recommend also before submitting issues to any project, isolate the problem and run a minimum case like I did in this issue thread without any other dependencies. This way you will quickly know whether the problem is with your code or external library. Open-source developer's time is limited and could be spent on resolving actual issues and implementing new features. Please don't take it as a reprimand, as I don't believe you meant to waste my time, but as a perspective to carry with you into the future.


Query USB CON PORT

I want to connect dev board to arduino but need COM PORT parameters (numbers like COM5, COM6), is there any command to check.

Have you tried to send data to arduino from dev board?

@LINYOUWEI0804
I dont have a arduino with me currently, but I had one in my office and I remember being able to send data via screen on the dev board.
First of course, you need to write a program to have the arduino listen over serial port and then screen in the dev board terminal with the same baudrate you used in your arduino program

I use USB to connect,Does coral need to install arduino IDE and Do I need to send the arduino program to coral?
THANK!

@LINYOUWEI0804
sorry I can't quite remember but I believe I have the IDE on a different machine and upload the program to the Arduino. Something as simple as this example:
Example Code
int incomingByte = 0; // for incoming serial data

void setup() {
  Serial.begin(9600); // opens serial port, sets data rate to 9600 bps
}

void loop() {
  // send data only when you receive data:
  if (Serial.available() > 0) {
    // read the incoming byte:
    incomingByte = Serial.read();

    // say what you got:
    Serial.print("I received: ");
    Serial.println(incomingByte, DEC);
  }
}

Upload that on the arduino, on the board you can type
screen /dev/tty-path-to-arduino 9600


Some emojis aren't displayed in my environment

Hi, Some emojis aren't displayed in my environment(iOS16.4).

Is this bug?

Same here. Do you have a solution for this?

Hi, @frantischek
I excluded emojis that were not displayed.
https://github.com/s-n-1-0/EmojiPicker/commit/d5d3294c5cec8d65b0be65c98ae7370f8e0ad5e4
But in the end, I used a different library.
https://github.com/izyumkin/MCEmojiPicker


Missing fd-find dependency from pixi.toml

Describe the bug
Unless I am doing something wrong, pixi run cpp-fmt fails as fd can't be found:
traversaro@IITBMP014LW012:~/rerun$ pixi run cpp-fmt
 WARN pixi::project::manifest: BETA feature `[pypi-dependencies]` enabled!

Please report any and all issues here:

        https://github.com/prefix-dev/pixi.

Turn this warning off by setting the environment variable `PIXI_BETA_WARNING_OFF` to `true`.

✨ Pixi task (cpp): fd --extension h --extension hpp --extension c  --extension cpp --exec clang-format -i
fd: command not found

To Reproduce
Steps to reproduce the behavior:

pixi run cpp-fmt after installing rust and pixi in a clean Ubuntu 22.04 image

Expected behavior
pixi should install fd.
Screenshots

Backtrace

Desktop (please complete the following information):

OS: Ubuntu 22.04

Rerun version

Additional context
I guess we should simple add fd-find to pixi.toml, but I am not sure about your policy on version pinning in pixi.toml .

Thanks!


Missing some units commonly used in SMIRNOFF force fields

>>> from openff.units import unit
>>> unit.Quantity("2000.0 * kilocalories_per_mole/angstrom**2")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/quantity.py", line 211, in __new__
    inst = ureg.parse_expression(value)
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/registry.py", line 1263, in parse_expression
    return build_eval_tree(gen).evaluate(
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/pint_eval.py", line 92, in evaluate
    left = self.left.evaluate(define_op, bin_op, un_op)
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/pint_eval.py", line 93, in evaluate
    return bin_op[op_text](left, self.right.evaluate(define_op, bin_op, un_op))
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/pint_eval.py", line 102, in evaluate
    return define_op(self.left)
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/registry.py", line 1264, in <lambda>
    lambda x: self._eval_token(x, case_sensitive=case_sensitive, **values)
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/registry.py", line 1159, in _eval_token
    {self.get_name(token_text, case_sensitive=case_sensitive): 1}
  File "/Users/mwt/miniconda3/envs/openff-dev/lib/python3.9/site-packages/pint/registry.py", line 643, in get_name
    raise UndefinedUnitError(name_or_alias)
pint.errors.UndefinedUnitError: 'kilocalories_per_mole' is not defined in the unit registry
>>> from openmm import unit
>>> unit.Quantity("2000.0 * kilocalories_per_mole/angstrom**2")
Quantity(value='2000.0 * kilocalories_per_mole/angstrom**2', unit=dimensionless)

These are all I seem to have encountered experimenting with SMIRNOFF file parsing. Please feel free to open a new issue if there are other conveniences currently offered by OpenMM or other units packages that are not found here.


Update dependency management

Add dependabot config
Add requirements.in file
Update pre-commit config
Add virtual environment directory to .gitignore

I'm not seeing Django asking for a migration so I think you're okay there.

Now that I've pulled it down and tried to stand it up, I realized I don't have a config since you're .gitignoring it.
Maybe add some info into the readme about the types of info that it should include?

Well, there's an example config file. The approach we've taken in other cases is to check for that file in the entrypoint script and create it if it doesn't exist.

Well, there's an example config file. The approach we've taken in other cases is to check for that file in the entrypoint script and create it if it doesn't exist.

Good call.  Anyway, I'd vote for adding something like that to the entrypoint here.


IntArray type not listed in assignment 6

In assignment 6 we have to write tests that invoke the strategy get-type which returns one of several types. However, the assignment does not list the type used for int arrays in the (reference) implementation. It only lists Int(), Bool and ClassType, but what is the exact syntax for int[]? I would expect IntArray(), but just want to be sure.

That's correct; you can also find this in the signature file. It used to be impossible to test int arrays (due to problems in spt), but we're fixed that in this year's edition. I'll update the assignment, thanks for reporting.

Fixed in 985a333f3385bd82e0c25a3b00ca8fec12d44062.


Selecting character in battle bug

I'm not sure what causes it, but some time in act 2, the classes being modded in, such as antipaladin, become unselectable with healing and buff spells during combat, at least in turn-based mode. This applies to abilities others use, as well as their own abilities, if they require mousing over them or their portrait to use it.
It also seems that any class outfits they have vanish, leaving them naked underneath whatever armor they have on.

What mods you use?
Do you gestalt?

the classes being modded in, such as antipaladin

So it happens for classes added by other mods too? Or you only checked that it happens for antipaladin in your game?

So far, antipaladin from this and brawler from Brawler Class, which hasn't been updated in a while. I haven't tested every single modded class I have, but it doesn't seem to affect modded archetypes for existing classes. I'm not using any gestalt classes.
The mods I'm using:
Enforcer Archetype: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/286
Asmodean Enforcer Archetype: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/284
Scaling Cantrips: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/64
Companion Respec: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/309
Toy Box: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/8
Bubble Buff Bot: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/195
Alternate Human Traits: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/337
Brawler Class: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/207
Spars Sundries: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/339
Homebrew Archetypes: https://www.nexusmods.com/pathfinderwrathoftherighteous/mods/279
Kineticist Expanded Elements: https://github.com/SpencerMycek/KineticistExpandedElements
Tome of the Firebird: https://github.com/pheonix99/TomeOfTheFirebird
And the Tabletop Tweaks mods: https://github.com/Vek17/TabletopTweaks-Core, https://github.com/Vek17/TabletopTweaks-Base, https://github.com/Vek17/TabletopTweaks-Reworks

Thank you for the details.
If it happens to me I'll look at it.

Thank you for the details. If it happens to me I'll look at it.

I think I found the issue, and it wasn't with your mod. Spars Sundries had some bug that made modded classes become naked and unselectable, at least with some accessories. Removing that mod got rid of it, it seems.


Change Geometry::set_spatial_reference so it only borrows srs (fixes issue #45)

This fixes #45. All tests now reliably complete without a segfault.

cool! thank you :)


Request TLS certificate signing from API server

Every Kubernetes cluster has a root CA that an operator can trust using a Certificate Signing Request (CSR). pkg/tls should provide an option to use a CSR to establish trust in addition to creating a new CA or using an existing one from disk.

/lifecycle frozen

Closing as per https://github.com/operator-framework/operator-sdk/issues/498#issuecomment-520628154.


skip() is not working as expected

Full demo projet can be found here: https://github.com/jeromewaibel/modelmapper-issue
Java 11, Modelmapper 2.4.5
This is my DTO
public class CustomerDataDTO {
  private String bankData;
}

I would like it to map to this class
public class CustomerData {
  private Customer customer;
  private String bankData;
}

and I would like modelmapper to ignore "customer" entirely (leave it null).
This is my mapping
    modelMapper.typeMap(CustomerDataDTO.class, CustomerData.class)
        .addMappings(m -> m.skip(CustomerData::setCustomer));
    CustomerDataDTO dto = new CustomerDataDTO("IBAN");
    CustomerData customerData = modelMapper.map(dto, CustomerData.class);
    System.out.print("mapping done, this should be null: " + customerData.getCustomer());

but customerData always has a customer object set, created by the default constructor.
Customer looks like this:
public class Customer {
  private final String firstName;
  private CustomerData customerData;
}

as you can see it points back to it CustomerData.
If you rename the CustomerData property to something completly different (private CustomerData foobar;) it works as expected (no Customer created).

Thanks for reporting this issue with reproducible code.
Can you try with skipping the property before applying the implicit mappings? This is some limitation of modelmapper. Thanks!
modelMapper.emptyTypeMap(CustomerDataDTO.class, CustomerData.class)
    .addMappings(m -> m.skip(CustomerData::setCustomer)
    .implicitMappings();

Happy 2022!
That did the trick, thank you.
If you don't consider this a bug but "works as designed" feel free to close this issue.


PPTP-2433: Added an info log for return not submittable for kibana

PPTP-2433: Added an info log for return not submittable for kibana dashboard. Will create a chart based on this log.

Note I will trigger one of these in Staging to create the visualisation for the main dashboard. So there'll be a follow-up PR on kibana-dashboards after this one is merged.

test this please