OIDCUnAuthAction pass not transmitting headers since version 2.4.11

Hello,
First and foremost, thank you very much for all the incredible work done on this terrific module!
Is there any known issue with the option OIDCUnAuthAction pass and the new release 2.4.11?
I've been using OIDCUnAuthAction in order to make a web application public/not authenticated but at the same time give the possibility to users to have an authentication URL to get access to the application as an authenticated user.
 is configured with OIDCUnAuthAction pass this way all  can be access as not authenticated or authenticated.
Inside a <Location /main/login>, I set the option OIDCUnAuthAction auth. This way user can access myapp.com/main/login, get authenticated and then get access to all other  as an authenticated user. The application behind can then retrieve HTTP headers to display specific things for authenticated users.
Until version 2.4.10, this was working perfectly, but with the last 2.4.11 version, after authentication, when accessing  using the OIDCUnAuthAction pass, claims are not transmitted anymore. A session cookie is correctly created and transmitted from the client side.
Above is the configuration I'm using. When upgrading to version 2.4.11, I just had to set the OIDCXForwardedHeaders, as explain in the changelog.
If I remove the OIDCUnAuthAction pass option, application s requires authentication and the claims are correctly transmitted.
If it can help, I can send debug logs.
<VirtualHost *:80>

  ServerName https://myapp.com

  <LocationMatch "^/?$">
    Require all denied
  </LocationMatch>

  <Location "/oidc-callback">
    AuthType openid-connect
    Require claim<EMAIL_ADDRESS>  </Location>

  <Location "/main">
    Allow from all
    RewriteEngine On
    ProxyPreserveHost On

    RewriteRule ^/var/www/html/main(.*)$ http://myapp-web-main-mynamespace.svc.cluster.local/$1 [L,P]
    ProxyPassReverse http://myapp-web-main-mynamespace.svc.cluster.local/

    AuthType openid-connect
    Require claim aud:${OIDC_CLIENT_ID}
  </Location>

  <Location "/main/api">
    RewriteEngine On
    ProxyPreserveHost On

    RequestHeader set X-Forwarded-Prefix "/main/api"
    RewriteRule ^/var/www/html/main/api/(.*)$ http://my-app-backend-main.mynamespace.svc.cluster.local:8080/$1 [L,P]
    ProxyPassReverse http://my-app-backend-main.mynamespace..svc.cluster.local:8080/

    AuthType auth-openidc

    Require claim aud:${OIDC_CLIENT_ID}
    Require claim appid:${OIDC_CLIENT_ID}
  </Location>

  <Location "/main/login">
     AuthType openid-connect

     Require claim aud:${OIDC_CLIENT_ID}

     OIDCUnAuthAction auth
     RewriteEngine On
     ProxyPreserveHost On

     RewriteRule ^/var/www/html/main/login(.*)$ https://myapp.com/main/$1 [L,R]
  </Location>

  OIDCUnAuthAction pass

  # In order to avoid calling userinfo_endpoint the OIDCProviderUserInfoEndpoint must not be set
  # For this reason, it's not possible to use the OIDCProviderMetadataURL option, every OIDCProvider
  # URL must be set manually to ensure the userinfo_endpoint is not set.
  # For more information see discussion : https://groups.google.com/g/mod_auth_openidc/c/Fw9dGXPXrNY/m/_YOn3fF-AQAJ

  OIDCProviderIssuer https://adfs.mycompany.com/adfs
  OIDCProviderAuthorizationEndpoint https://aadfs.mycompany.com/adfs/oauth2/authorize/
  OIDCProviderJwksUri https://adfs.mycompany.com/adfs/discovery/keys
  OIDCProviderTokenEndpoint https://adfs.mycompany.com/adfs/oauth2/token/
  OIDCProviderEndSessionEndpoint https://adfs.mycompany.com/adfs/oauth2/logout

  OIDCSessionInactivityTimeout 3600
  OIDCSessionMaxDuration 28800
  OIDCCryptoPassphrase ${OIDC_CRYPTO_PASSPHRASE}
  OIDCClientID ${OIDC_CLIENT_ID}
  OIDCClientSecret ${OIDC_CLIENT_SECRET}

  OIDCRedirectURI https://myapp.com/oidc-callback

  OIDCScope "openid allatclaims"
  OIDCRefreshAccessTokenBeforeExpiry 60
  OIDCPassClaimsAs headers
  OIDCRemoteUserClaim upn
  OIDCXForwardedHeaders X-Forwarded-Host X-Forwarded-Port X-Forwarded-Proto

  OIDCCacheType memcache
  OIDCMemCacheServers myapp-memcached-main.mynamespace.svc.cluster.local:11211

  LogLevel warn

  #Option to allow url with encoded slashes in the query params such as ?date=2020%2F2021
  AllowEncodedSlashes NoDecode

</VirtualHost>

unfortunately that looks like a bug indeed, can you send the full server debug logs?

in this case you can send it to<EMAIL_ADDRESS>

Thank you, I sent the email.

for the record: at first inspection it seems that for some locations there is no AuthType set, but there is a  Require claim directive applied to them (not sure why it would work before then though)

Thank you for looking, but it seems every location has an AuthType, or perhaps I'm cross-eyed ;). The problem is probably somewhere else. I'm going to reproduce it outside of my environment, in a reproducible way, so we can really see if it's a bug or just me not knowing how to properly use your module ;). I should find time to do it in a few days.

any luck with that?

I just finished refactoring my Apache configs (was using RewriteRule inside  which is not supported). Will retry now with the last mod_auth_openidc version and keep you informed.

I tried with my new Apache config and the issue is still occurring. For now, I will stay on version 2.4.10, but sooner or later I will have to upgrade to a newer version of your module and will have to solve this problem.  When the time's gonna come, I will try to reproduce the problem in a new environment with minimum configuration (I cannot find the time to do it now). In the meantime, you can close my issue. I will reopen it or create a new one later.

let's leave it open, I may find time to re-create the issue myself

let's leave it open, I may find time to re-create the issue myself

can you send the latest and simplest config that exposes this behaviour?

I was able to reproduce and fix; please test https://github.com/zmartzone/mod_auth_openidc/commit/3f082c156da2c410c4024d1c81bac26948d5816a and confirm

I've been able to build the rc5 and test the fix. Claims are now correctly passed when I use OIDCUnAuthAction pass.
Thanks a lot for the work!

...after trying for some days, it seems like we have the same issue with (not only) the latest release <IP_ADDRESS>:
    OIDCProviderMetadataURL (...)
    OIDCClientID (...)
    OIDCClientSecret (...)
    OIDCRedirectURI /redir

    OIDCRemoteUserClaim preferred_username

    #OIDCCookieDomain (...)

    <Location "/redir">
        AuthType openid-connect
        Require valid-user
    </Location>

    OIDCUnAuthAction auth

What could be the reason for not getting any "lazy session" headers?

"lazy session" headers are passed on  OIDCUnAuthAction pass, I don't see that in your config?

I just verified myself that this still works as expected; since you're sponsoring you can send your server debug logs to<EMAIL_ADDRESS>and we'll take a look, tnx


test: Test implications in circuit constraints.

Introduce a new strategy for creating a random linear combination of 5 variables in constraints.rs
Add a test for enforcing an implication with a linear combination if premise is true in constraints.rs

Thanks for the review. This approach was not well thought out, I'll re-issue something that made more sense. In the meantime, to answer some pointed comments you had:

Now, if we configure proptest to run this only four times, will it deduplicate cases and therefore guarantee exhaustive testing? Is it smart enough to do this all by itself?

It is not, because proptest does not check for exhaustion, irrespective of whether you're using a strategy. Every test runs 100 times by default (with the option of configuring otherwise).

We might as well sample a random number from the distribution we care about and create a simple linear combination of that value times one. This would make the intent much clearer and reasoning about composition in future proptests less error-prone.

I think that's probably right.


Python dependencies as submodules

This adds all Python dependencies as git submodules. They will all be cloned upon plugin installation, and the user will no longer need to take any manual steps, i.e. pip install.

Any feedback on this?

I don't think it's necessary. You have to pip install neovim module anyway, so I don't see how adding two more names to the list can be problematic.

I'll give it a spin today. Could you please raise a PR to update the installation instructions in the meantime? Please also include the recent change py2 -> py3
Thanks!

Also, why do we need six at this time?


UPDATED: Change collections to containers

thanks for waiting, lost internet over here for a sec. couldn't fetch upstream before so just made a new PR with the updated master. I think this one should be good

Thanks for the work @juniormince . You can also look at other issues.

Fixed #44


Adding Tessel support

@olivierbloch, Thanks for signing the contribution license agreement so quickly! Actual humans will now validate the agreement and then evaluate the PR.
Thanks, MSBOT;


Race condition while setting XR's spec.claimRef

What happened?

Previously while working on some experiments with compositions to answer a question in the Crossplane providers slack channel, I have observed a race condition that causes an AWS Bucket MR (and the corresponding S3 bucket) to leak. If a bucket leaks and when the corresponding claim is deleted, the leaked Bucket MR and the corresponding S3 bucket are not deleted.
Please note that this case involves patching from XR's spec.claimRef.name to composed's external-name annotation and the race condition seems to be between the composite reconciler (while rendering the composed resources) and the claim reconciler (when a claim is bound to the XR). Please see the comments below for some further context.
How can we reproduce it?

Back then, I could reproduce the issue with the following manifests. Please note that the race condition does not always occur by definition.
---
apiVersion: apiextensions.crossplane.io/v1
kind: CompositeResourceDefinition
metadata:
  name: compositebuckets.aws.example.org
spec:
  group: aws.example.org
  names:
    kind: CompositeBucket
    plural: compositebuckets
  claimNames:
    kind: CompositeBucketClaim
    plural: compositebucketclaims
  versions:
  - name: v1alpha1
    served: true
    referenceable: true

---
apiVersion: aws.example.org/v1alpha1
kind: CompositeBucketClaim
metadata:
  name: my-bucket-with-policy
  namespace: default
spec:
  compositionSelector:
    matchLabels:
      provider: aws
      policy: test

---
apiVersion: apiextensions.crossplane.io/v1
kind: Composition
metadata:
  name: bucket-with-policy
  labels:
    provider: aws
    policy: test
spec:
  compositeTypeRef:
    apiVersion: aws.example.org/v1alpha1
    kind: CompositeBucket
  resources:
    - name: bucket
      base:
        apiVersion: s3.aws.crossplane.io/v1beta1
        kind: Bucket
        spec:
          forProvider:
            acl: private
            locationConstraint: us-east-1
      patches:
        - fromFieldPath: "spec.claimRef.name"
          toFieldPath: "metadata.annotations['crossplane.io/external-name']"
        - fromFieldPath: "status.atProvider.arn"
          toFieldPath: "metadata.annotations['bucket-arn']"
          type: ToCompositeFieldPath
    - name: bucket-policy
      base:
        apiVersion: s3.aws.crossplane.io/v1alpha3
        kind: BucketPolicy
        spec:
          forProvider:
            region: us-east-1
            policy:
              version: '2012-10-17'
              statements:
                - action:
                    - s3:ListBucket
                    - s3:GetBucketLocation
                    - s3:ListBucketMultipartUploads
                    - s3:PutBucketCORS
                  effect: Allow
                  principal:
                    allowAnon: true
      patches:
        - fromFieldPath: "spec.resourceRefs[0].name"
          toFieldPath: "spec.forProvider.bucketNameRef.name"
        - fromFieldPath: "metadata.annotations['bucket-arn']"
          toFieldPath: "spec.forProvider.policy.statements[0].resource[0]"

What environment did it happen in?
Crossplane version: v1.3.0 (commit id where the observation was made: b1a6b2080a54fa05bd905391874a8256fb3fd240)

This seems like it could be a similar class of issue to https://github.com/crossplane/crossplane-runtime/issues/277. I will try to get some time to look into both next week.

It looks like I jumped the gun on transferring this - crossplane/crossplane was the right place after all since the race appears to be in the claim reconciler. I'll send it back there. :)


Cap points per week per rider to 170 (100 + 10 for each 1+ mile day) for team ride calculations

The rules for Freezing Saddles 2019 are changing to make the competition emphasize regular riding more than riding more miles, for the team standings only. We will change the rules as follows (as originally suggested by Steve O., Henry Dunbar, and company):

10 points for each day of 1 mile+ (same as before)
1 point per mile (same as before)
Team contribution per individual capped at 100 miles per week
(individual rankings would remain the same - no cap on the individual scoreboard)

The maximum someone could contribute to their team is 170 points per week.  If they miss a day, then 160.  This helps teams that ride more days and keeps a couple of superhumans from carrying entire teams.  In fact, it would probably make the contributions of players 4-7 much more valuable, since the top few players on each team would all max out, negating their advantage.
Let's use the Strava standard week of Monday - Sunday as the week, so it is easy for people to look at Strava to see how many miles they have for the week. Yes, this means we will have short weeks at the beginning and end of the competition, and we will keep the 100 point mileage cap per person for those weeks, so people can ride more those days and have it reflected in the team standings.

This advice on how to deal with weeks may help: https://stackoverflow.com/questions/36024712/how-to-group-by-week-in-postgresql

Strava standard weeks are also ISO8601 standard weeks, it would appear. The MySQL documentation shows that it follows ISO8601 weeks, where week 1 is the first week containing January 4th in a year.

Are you taking a crack at the scoring issue? If so please claim it on GitHub by assigning it to yourself.
If we create another view based on the query @jrenault came up with (adapted below) we could probably just sum on the points and be done with it.
select *, (select case when distance<100 then (distance+(10*days)) else (100+(10*days)) end) as team_points from weekly_stats


commands\classsearch.ts formatting is inconsistent

Currently the bot prints out the data like this:

I'm requesting someone to find a more readable way to print the results

The part of code that controls the formatting of this statement is found under /src/commands/classsearch.ts contentBuilder function.


Tensorflow support

Thank you for your job!
Is there an easy way to convert your PyTorch model to Tensorflow?

Hopefully, you can convert PyTorch model to ONNX first. And then convert ONNX to Tensorflow. But currently, it mostly supports popular models. In onder to convert, MODNet into Tensorflow, we've ONNX right now, but some features does not support while converting it to Tensorflow. Possilbe solution might be a minor tweaking to the original model architecture. Maybe this will help.

Yes, I have some troubles to convert your ONNX model to Tensorflow. Where can I find the original model architecture? Is there a special commit?
Thanks!

@bratyslav
Hi, thanks for your attention.
I am sorry that we do not have any plan of the Tensorflow version right now.
Hope the community can help. :)

Hopefully, you can convert PyTorch model to ONNX first. And then convert ONNX to Tensorflow. But currently, it mostly supports popular models. In onder to convert, MODNet into Tensorflow, we've ONNX right now, but some features does not support while converting it to Tensorflow. Possilbe solution might be a minor tweaking to the original model architecture. Maybe this will help.

Have you tried to convert onnx to coreml? I tried to use this code:
`import coremltools
mlmodel = coremltools.converters.onnx.convert(
model = 'pretrained/modnet.onnx',
predicted_feature_name = [],
minimum_ios_deployment_target='13',
)`
and get error: 'index -2 is out of bounds for axis 0 with size 0'

@bratyslav
Sorry, I haven't tried it. Hope someone can help.

Hopefully, you can convert PyTorch model to ONNX first. And then convert ONNX to Tensorflow. But currently, it mostly supports popular models. In onder to convert, MODNet into Tensorflow, we've ONNX right now, but some features does not support while converting it to Tensorflow. Possilbe solution might be a minor tweaking to the original model architecture. Maybe this will help.

Have you tried to convert onnx to coreml? I tried to use this code:

mlmodel = coremltools.converters.onnx.convert(
    model = 'pretrained/modnet.onnx',
    predicted_feature_name = [],
    minimum_ios_deployment_target='13',
)

and get error: 'index -2 is out of bounds for axis 0 with size 0'

same issue with you.
and i try convert ckpt to onnx using export_onnx under different torch version, like through pip install "torch==1.4" "torchvision==0.5.0", there comes different error, such as "while converting op of type: Upsample..."

@xpeng
As said in the README.md file, the tool requires:
onnx==1.8.1
onnxruntime==1.6.0
opencv-python==<IP_ADDRESS>
torch==1.7.1

Since this tool is provided by the community, we have not verified its compatibility with other PyTorch versions. Sorry for this.


Adds virtual package to composer

Rationale: there are other implementations of this PSR. This allows developers to rely on an implementation of the PSR instead of a concrete package. Since this is considered to be the "first" implementation, it is a good place to start this practice.

Question: How would this affect how one consumes PSR-7? I recall seeing this for PSR-3, but never understood the relevance or semantics. Is there anything you can link me to to explain it?

This post helped me understand the rationale behind virtual packages.
How did the need appear for something like this?
The ivory HTTP adapter is currently being migrated to the php-http organization and getting separated into smaller packages. We would like to allow using the library with any PSR 7 implementations. The main point is that you let the user/developer choose the actual dependency without sticking to any concrete one. It is something like requiring an interface.
However we realised that we won't be able to do so in php-http/adapter, because we have a MessageFactory and some request extensions. Still, this is a great feature if a package author needs PSR 7, but doesn't care about the actual implementation.

:+1: on this that would allow us to support both phly/http and guzzle/psr7 without requiring one of them but instead rely on the virtual package which represents them :)

@egeloen Actually we can't. :stuck_out_tongue: See my comments on Gitter.

However it would make sense in case of this package:
https://github.com/php-http/message-decorator

Can you explain why this is beneficial if not to solve what @egeloen mentioned?

Well, it CAN be, but the way we are currently doing things in our adapter package it is not possible. I already have a proposal, but that must be discussed.
Until then, there can be numerous cases when a package needs a PSR-7 implementation and it does not care about the exact one. (See the linked package)

Gotcha. Thanks for the PR on the Guzzle package.


Intention or bug? File::move does not update path

Describe the bug
After a call to File::move(...) File::getRealPath() still returns the path of the file's previous location. This does not make sense, I believe, because that location is invalid. Therefore, I tend to call this a bug.
CodeIgniter 4 version
CodeIgniter4 Alpha 4
Affected module(s)
File
Expected behaviour, and steps to reproduce if appropriate
This reproduces the bug(?):
log_message('debug',$file->getRealPath());
$file->move($newDirectory,$newName);
log_message('debug',$file->getRealPath()); // expected to be $newDirectory.$newName

Yes, that sounds like a bug!

Here we need to update the reference of $file object to new file as this refers to old file object


[Bug]: remote-exec provisioner error

Description
Applying fails with
╷
│ Error: remote-exec provisioner error
│
│   with module.kube-hetzner.null_resource.kustomization,
│   on .terraform/modules/kube-hetzner/init.tf line 278, in resource "null_resource" "kustomization":
│  278:   provisioner "remote-exec" {
│
│ error executing "/tmp/terraform_579678025.sh": Process exited with status 1
╵
╷
│ Error: remote-exec provisioner error
│
│   with module.kube-hetzner.null_resource.kustomization_user_deploy[0],
│   on .terraform/modules/kube-hetzner/kustomization_user.tf line 80, in resource "null_resource" "kustomization_user_deploy":
│   80:   provisioner "remote-exec" {
│
│ error executing "/tmp/terraform_1586559340.sh": Process exited with status 1
╵

As this might have something to do with extra-manifests, here is my extra-manifests/kustomization.yaml.tpl:
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization
resources:
  - ./external-secrets.yaml

and my extra-manifests/external-secrets.yaml.tpl:
apiVersion: v1
kind: Namespace
metadata:
  name: external-secrets
---
apiVersion: helm.cattle.io/v1
kind: HelmChart
metadata:
  name: external-secrets
  namespace: external-secrets
spec:
  chart: external-secrets
  targetNamespace: external-secrets
  repo: https://charts.external-secrets.io
  valuesContent: |-
    installCRDs: true

Kube.tf file
locals {
  hcloud_token = "xxx"
}

module "kube-hetzner" {
  providers = {
    hcloud = hcloud
  }
  hcloud_token = var.hcloud_token != "" ? var.hcloud_token : local.hcloud_token

  source = "kube-hetzner/kube-hetzner/hcloud"

  version = "2.11.0"

  ssh_public_key = file("~/.ssh/id_ed25519.pub")
  ssh_private_key = file("~/.ssh/id_ed25519")
  network_region = "eu-central" # change to `us-east` if location is ash

  control_plane_nodepools = [
    {
      name        = "control-plane-fsn1",
      server_type = "cax11",
      location    = "fsn1",
      labels      = [],
      taints      = [],
      count       = 2
    },
    {
      name        = "control-plane-nbg1",
      server_type = "cax11",
      location    = "nbg1",
      labels      = [],
      taints      = [],
      count       = 1
    }
  ]

  agent_nodepools = [
    {
      name        = "agent-small",
      server_type = "cax21",
      location    = "fsn1",
      labels      = [],
      taints      = [],
      count       = 5
    }
  ]
  load_balancer_type     = "lb11"
  load_balancer_location = "fsn1"

  base_domain = "xxx"
  etcd_s3_backup = {
     etcd-s3-endpoint        = "xxx"
     etcd-s3-access-key      = "xxx"
     etcd-s3-secret-key      = "xxx"
     etcd-s3-bucket          = "xxx"
  }
  enable_longhorn = true
  disable_hetzner_csi = true
  ingress_controller = "none"
  kured_options = {
     "reboot-days": "sa,su"
     "start-time": "3am"
     "end-time": "8am"
     "time-zone": "Local"
   }

  cluster_name = "xxx"
  restrict_outbound_traffic = false
  additional_tls_sans = ["xxx"]
  lb_hostname = "xxx"
  create_kubeconfig = false
  nginx_values = <<EOT
controller:
  kind: "DaemonSet"
  service:
    annotations:
      "load-balancer.hetzner.cloud/name": "tarabao"
      "load-balancer.hetzner.cloud/use-private-ip": "true"
      "load-balancer.hetzner.cloud/protocol": "https"
      "load-balancer.hetzner.cloud/certificate-type": "managed"
      "load-balancer.hetzner.cloud/http-managed-certificate-name": "xxx"
      "load-balancer.hetzner.cloud/http-managed-certificate-domains": "*.xxx"
      "load-balancer.hetzner.cloud/http-redirect-http": "false"
      "load-balancer.hetzner.cloud/type": "lb11"
      "load-balancer.hetzner.cloud/uses-proxyprotocol": "true"
    ports:
      http: 443
  EOT
}

provider "hcloud" {
  token = var.hcloud_token != "" ? var.hcloud_token : local.hcloud_token
}

terraform {
  required_version = ">= 1.3.3"
  required_providers {
    hcloud = {
      source  = "hetznercloud/hcloud"
      version = ">= 1.38.2"
    }
  }
}

output "kubeconfig" {
  value     = module.kube-hetzner.kubeconfig
  sensitive = true
}

variable "hcloud_token" {
  sensitive = true
  default   = ""
}

Screenshots
No response
Platform
MacOS

@carstenblt  The best way forward here, is to SSH into the server when that error happens (see readme debug section) and run the script directly, in that previous attempt you would have run /tmp/terraform_1586559340.sh directly just executing it as in in your terminal, that will show the error message, please share that, and also the content of that file (without sensitive values).

@mysticaltech Thank you for your reply. The two scripts that fail:
#!/bin/sh
set -ex
sed -i 's/^- |[0-9]\+$/- |/g' /var/post_install/kustomization.yaml
timeout 360 bash <<EOF
  until [[ "\$(kubectl get --raw='/readyz' 2> /dev/null)" == "ok" ]]; do
    echo "Waiting for the cluster to become ready..."
    sleep 2
  done
EOF

kubectl apply -k /var/post_install
echo 'Waiting for the system-upgrade-controller deployment to become available...'
kubectl -n system-upgrade wait --for=condition=available --timeout=360s deployment/system-upgrade-controller
sleep 7
kubectl -n system-upgrade apply -f /var/post_install/plans.yaml

fails with
+ sed -i 's/^- |[0-9]\+$/- |/g' /var/post_install/kustomization.yaml
sed: can't read /var/post_install/kustomization.yaml: Not a directory

and
#!/bin/sh
rm -f /var/user_kustomize/*.yaml.tpl
echo 'Deploying manifests from /var/user_kustomize/:' && ls -alh /var/user_kustomize
kubectl kustomize /var/user_kustomize/ | kubectl apply --wait=true -f -

fails with
Deploying manifests from /var/user_kustomize/:
-rw-r--r--. 1 root root 334 Dec 22 11:50 /var/user_kustomize
error: must build at directory: '/var/user_kustomize/': file is not directory
error: no objects passed to apply

Indeed, /var/user_kustomize is not a directory but rather my extra-manifests/external-secrets.yaml.tpl file and /var/post_install is a kured DaemonSet definition.

@carstenblt  Very interesting, I will try to reproduce and look into it ASAP.

@mysticaltech have you had time to look at this, I am experiencing the same issue.

@libracoder Sorry not yet, will try tonight.

Oh great, Thank you!

I think i found the issue @mysticaltech
There is a wierd "" character appended to the private keys each time its created

Strange discovery
 command = "install -b -m 600 /dev/null /tmp/${random_string.identity_file.id} && echo ${file("~/.ssh/id_ed25519")} > /tmp/${random_string.identity_file.id}"
Using this code instead of the heredoc does not add the special character to the name of the file  b

@libracoder  Your issue may be different from @carstenblt's one. Which platform are you on? If on Windows, please make sure to use WSL.

Yeah, I think so I am having a myraid of issue. I am on windows using WSL. After fixing the issue with the file names, now I have these errors
module.kube-hetzner.module.agents["0-0-agent-small"].hcloud_server.server (local-exec): Executing: ["/bin/sh" "-c" "until ssh -o UserKnownHostsFile=/dev/null -o StrictHos
tKeyChecking=no -o IdentitiesOnly=yes -o PubkeyAuthentication=yes -i /tmp/3rgtcngppy7cskz6vtq8 -o ConnectTimeout=2 -p 22<EMAIL_ADDRESS>true 2> /dev/null\r\ndo\r\n  echo \"Waiting for MicroOS to become available...\"\r\n  sleep 3\r\ndone\r\n"]
module.kube-hetzner.module.agents["0-0-agent-small"].hcloud_server.server (local-exec): /bin/sh: 6: Syntax error: end of file unexpected (expecting "do")
╷
│ Error: local-exec provisioner error
│
│   with module.kube-hetzner.module.control_planes["0-0-control-plane-fsn1"].hcloud_server.server,
│   on .terraform/modules/kube-hetzner/modules/host/main.tf line 60, in resource "hcloud_server" "server":
│   60:   provisioner "local-exec" {
│
│ Error running command 'until ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PubkeyAuthentication=yes -i
│ /tmp/4tc950ymt3qc42lez113 -o ConnectTimeout=2 -p 22<EMAIL_ADDRESS>true 2> /dev/null
│ do
│   echo "Waiting for MicroOS to become available..."
│   sleep 3
│ done
│ ': exit status 2. Output: /bin/sh: 6: Syntax error: end of file unexpected (expecting "do")
│
╵
╷
│ Error: local-exec provisioner error
│
│   with module.kube-hetzner.module.agents["0-0-agent-small"].hcloud_server.server,
│   on .terraform/modules/kube-hetzner/modules/host/main.tf line 60, in resource "hcloud_server" "server":
│   60:   provisioner "local-exec" {
│
│ Error running command 'until ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PubkeyAuthentication=yes -i
│ /tmp/3rgtcngppy7cskz6vtq8 -o ConnectTimeout=2 -p 22<EMAIL_ADDRESS>true 2> /dev/null
│ do
│   echo "Waiting for MicroOS to become available..."
│   sleep 3
│ done
│ ': exit status 2. Output: /bin/sh: 6: Syntax error: end of file unexpected (expecting "do")
│
╵
libracoder@Libracoder-Surface8-Pro:/var/www/ht-cloud$

Ok, @libracoder  please search this repo, others have successfully deployed via WSL-2, it definitely works. And you may want to have a look at that short but important SSH guide, your keys need to be created in that manner from WSL too. https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner/blob/master/docs/ssh.md

Thank you so much for you help. I will go through the docs you shared.

@libracoder  That's one issue that just showed up on my radar with a solution, and there are others too. https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner/issues/1140

@carstenblt  FYI, just pushed the fix in v2.11.2, and tested with your own example, it worked like a charm. Good luck!

@carstenblt FYI, just pushed the fix in v2.11.2, and tested with your own example, it worked like a charm. Good luck!

+ sed -i 's/^- |[0-9]\+$/- |/g' /var/post_install/kustomization.yaml
sed: can't read /var/post_install/kustomization.yaml: Not a directory

is still the same. The other changed:
#!/bin/sh
/tmp/terraform_1365493471.sh: line 3: unexpected EOF while looking for matching `''

This is because the file looks like this:
#!/bin/sh
rm -f /var/user_kustomize/*.yaml.tpl
echo 'Applying user kustomization...
kubectl apply -k /var/user_kustomize/ --wait=true

@carstenblt  Terraform destroy, make sure you are on a proper linux shell like WSL and try again, if it worked for me with this very same setup, it should work for you.

@carstenblt  Thanks for your PR #1143 , it was merged and deployed in v2.11.3.

@carstenblt  Thanks for your PR #1143 , it was merged and deployed in v2.11.3.

@mysticaltech I believe this is what breaks it:

create cluster with 3 control planes in a node pool
move one of the control planes to a new node pool

I'll try to check later if this reproduces it.

@carstenblt  Of course, that's not supposed to happen. See readme and kube.tf.example, you can only scale up and down nodepools, and it should be done very carefully with draining proper node deletion etc. And once HA you cannot scale down to non-HA in my experience, what you could do is create a new nodepool with a count of 1, bringing the total control planes to 4, then drain the last node of first nodepool, do kubectl delete node and scale down the count to 2.

It seems that something is wrong. Please see the details:
module.infra.null_resource.kustomization (remote-exec): Connecting to remote host via SSH...
module.infra.null_resource.kustomization (remote-exec):   Host: xxxx
module.infra.null_resource.kustomization (remote-exec):   User: root
module.infra.null_resource.kustomization (remote-exec):   Password: false
module.infra.null_resource.kustomization (remote-exec):   Private key: false
module.infra.null_resource.kustomization (remote-exec):   Certificate: false
module.infra.null_resource.kustomization (remote-exec):   SSH Agent: true
module.infra.null_resource.kustomization (remote-exec):   Checking Host Key: false
module.infra.null_resource.kustomization (remote-exec):   Target Platform: unix
module.infra.null_resource.kustomization (remote-exec): Connected!
module.infra.null_resource.kustomization: Still creating... [40s elapsed]
module.infra.null_resource.kustomization (remote-exec): + sed -i 's/^- |[0-9]\+$/- |/g' /var/post_install/kustomization.yaml
module.infra.null_resource.kustomization (remote-exec): sed: can't read /var/post_install/kustomization.yaml: Not a directory
╷
│ Error: remote-exec provisioner error
│
│   with module.infra.null_resource.kustomization,
│   on .terraform/modules/infra/init.tf line 288, in resource "null_resource" "kustomization":
│  288:   provisioner "remote-exec" {
│
│ error executing "/tmp/terraform_148135017.sh": Process exited with status 2
╵
% ssh root@xxxx -p 60022
infra-control-plane-vnc:~ # less /var/post_install
infra-control-plane-vnc:~ # ls -l /var/post_install
-rw-r--r--. 1 root root 642 Jan  2 18:16 /var/post_install
infra-control-plane-vnc:~ #

The file /var/post_install should have been a directory instead.

@otavio Please open a new issue with reproduceable steps, and please try to debug yourself too.


Travis build error with python 3.4

This popped up over the last few days (since the last release), and I brought it up during the scipy sprint.
I'm currently getting an error with the conda package for numba on python 3.4.  Here's a link to the log: https://travis-ci.org/librosa/librosa/jobs/252844064

After some triage, it appears the issue is triggered by only having Numba Python 3.4 packages for NumPy 1.10 in the public Anaconda repo.  We should see if the Anaconda team will put our build for NumPy 1.11 in the public repo as well.

Correction: I do see the NumPy 1.10 / Python 3.4 build in the public repo, but I'm not sure why conda  is not picking it in the build.

Think it's because there's no np111py34 build for linux64 in the channel as noted by  @seibert , were this present the package downgrading etc would not be needed.
The error message as seen is due to SciPy in the installation having ufuncs that need libgfortran.so.1 but the installation environment having libgfortran.so.3. I think this is probably a mistake somewhere in constraint specification/resolution in the package dependencies.

Closing as I think this was resolved and librosa appears to be building fine again. Thanks.


feature: Dockerfile for bookshelf demo app

To support deployment to Cloud Run, let's get a Dockerfile for the bookshelf app.
Reference from other getting started apps:

Node.js
Python

May take reference from this:
https://github.com/googleapis/testing-infra-docker/blob/main/php/php80/Dockerfile

@rogerthatdev  do you want to take this up or you want help?

In lieu of adding a Dockerfile, i've submitted #254 to support deploying as buildpack instead.


@ngtools/webpack HMR compilation errors ignored

🐞 Bug report
Command (mark with an x)

- [ ] new
- [ ] build
- [ ] serve
- [ ] test
- [ ] e2e
- [ ] generate
- [ ] add
- [ ] update
- [ ] lint
- [ ] xi18n
- [ ] run
- [ ] config
- [ ] help
- [ ] version
- [ ] doc

not using angular cli, but @ngtools/webpack
Is this a regression?
Dont know if this ever worked with @ngtools/webpack because i havent been using it during development before.
Description
When you create compilation error in project, like you add some unused import, compilation throws error in console, but this error is not displayed in WebpackNotifierPlugin nor in browser through HMR. When you use awesome-typescript-loader it works correctly.
What is even weirder is that if you stop compilation process and run it again, error is thrown correctly everywhere, only during HMR change it is not handled correctly.
If you fix initial problem and HMR is running you will get error

from the TypeScript compilation. Please make sure it is in your tsconfig via the 'files' or 'include' property.

and you have to restart npm start command. All three mentioned things are slowing development with @ngtools/webpack compared to awesome-typescript-loader.
🔬 Minimal Reproduction
download this https://github.com/kukjevov/ngtools-error
#1

git clone https://github.com/kukjevov/ngtools-error
cd ngtools-error
npm install
npm start
open in browser http://localhost:8888 add ChangeDetectorRefintonavigation.component.ts` into import statement
save file
you can see error in system console, but no error in browser, nor in WebpackNotifierWindow

#2

stop npm start
run npm start again
you will see error in system notification window
refresh browser http://localhost:8888
you will see also in browser

#3

open navigation.component.ts and remove unused ChangeDetectorRef from import statement
save file
you can see error in system console, this errors dissapears after you restart npm start

🔥 Exception or Error
See minimal reproduction part
🌍 Your Environment

angular: 9.0.0-next.2
@ngtools/webpack: 8.3.0-rc.0
node: 10.16.0
npm: 6.9.0

Hi, thanks for opening the issue.
There are separate issues here;
1. Forked type checking errors not being sent to webpack
This seems to be caused by the forked type checker as when using the fork type checking we are solely emitting logs to the the console and not passing these logs to the webpack compilation. As a workaround you cab disbale  forkTypeChecker via the AngularCompilerPlugin.
2. Compilation errors in (AOT) first run errors are not being recoverable
For the former, I am not sure if there was any reason why we solely log such error message instead of providing them in webpack compilation. Looping in @filipesilva as he probably knows.

First run errors AOT should be recoverable. It sounds like a bug that they aren't.

Yeah, that for sure, what about the first problem?

It's intended that type errors aren't sent to webpack when using the forked type checker. If they were, and they blocked the compilation, then there's no point in having a forked type checker as rebuilds would just take longer.

Thanks for answers.
Could be part of first problem solved by using https://www.npmjs.com/package/fork-ts-checker-webpack-plugin for notifications?
Is there any way to be able to send these errors to HMR report in browser without disabling forkedTsCheck?

I don't think it makes sense to use a separate forked TS type checker. You'd just get twice the number of TS type checks, and it wouldn't work correctly in AOT mode. It might be possible to send type errors to the HMR report in between compilations, it's just not something we've looked at.

It would be great to have some information about compilation errors at least in browser, because right now i dont know that there are errors application usually works and then on server application fails becuase there is no HMR build and i send not compilable application to repository, because i dont check console so often.
Thanks

@filipesilva you know what is interesting? Sometimes, i dont know what have i done but, running @ngtools/webpack gets in state, when everything is working even AOT compilation errors are shown in notifications and also through HMR
Only difference what i see is that if it is not displayed, it is case when error is displayed in console as regular text, but if it is displayed as "error" in red it gets everywhere it should. So it means it is possible to make it working :).

@filipesilva I figured it out. Now i know what to do to make it working. If you create webpack error, like import non existing template in templateUrl and fix it and then cause any typescript or AOT binding template error it will work in notifications and also in browser using HMR.
Thanks

Hi @kukjevov,
This should be addressed via https://github.com/angular/angular-cli/pull/19114

Hi @alan-agius4 will this land in version 11?
Thx anyway :)

That would be available in 11.1


switch duffy provisioning to CentOS Stream 9 boxes

I've only tested that vagrant is installable so far, but with CS8 going EOL soon, we should rather switch and fix up any possible fallout

I intend to merge this tomorrow morning when I have time to watch resulting pipeline runs

Not too bad for a fallout.

https://github.com/theforeman/forklift/pull/1808 makes things generally work again (merged w/o y'alls review)
https://github.com/theforeman/forklift/pull/1809 makes things a bit more pretty again (and reverts the above)


Unable to remove second ring from BIS

I just installed the plugin and tried importing BIS from etro, but it didn't import the BIS I was using, so I started changing it.  Problem is, I cannot remove the last ring or the materia in it.

Thanks for reporting. This already got fixed in #83. A testing version including this should be available today or tomorrow and a stable release later next week


Request: Use fan art instead of channel logo on the Channel Information Screen

There is some easy free Python code being uses in some of the other plugins to pull TVDB data.. by querying by the Show title in many cases it is easy to pull a fan art picture for the show, instead of displaying a giant version of the channel logo.
If the episode data is present in tvheadend it might be able to pull even more detailed data.

This part already existed within one of the last version. This made the plugin much slower since this logic shouldn't be handled by the plugin rather than tv-headend.


Set up .prettierignore to avoid formatting lib

Current dependencies on/for this PR:

main

PR #108   👈

This comment was auto-generated by Graphite.


mkcloud: dont try to deploy services that cannot work

without other (disabled) services

For me, this is already too much code. And we did not really change the config. If the user requests to not have ceilometer, he cannot get aodh (even if he does not know it).


Saga: Change "IsPersist" property value type from String to Boolean #1827

Ⅰ. Describe what this PR did
Saga: Change "IsPersist" property value type from String to Boolean
Ⅱ. Does this pull request fix one issue?
#1827

Codecov Report

Merging #1836 into develop will increase coverage by 0.09%.
The diff coverage is 50%.

@@              Coverage Diff              @@
##             develop    #1836      +/-   ##
=============================================
+ Coverage      54.95%   55.05%   +0.09%
- Complexity      2352     2353       +1
=============================================
  Files            421      421
  Lines          14266    14268       +2
  Branches        1682     1711      +29
=============================================
+ Hits            7840     7855      +15
- Misses          5681     5683       +2
+ Partials         745      730      -15

Impacted Files
Coverage Δ
Complexity Δ

...statelang/parser/impl/AbstractTaskStateParser.java
76.92% <50%> (+0.6%)
8 <0> (ø)
:arrow_down:

.../statelang/parser/impl/StateMachineParserImpl.java
77.77% <50%> (+0.63%)
7 <0> (ø)
:arrow_down:

...server/store/file/FileTransactionStoreManager.java
59.21% <0%> (-0.99%)
29% <0%> (ø)

...ource/sql/struct/cache/AbstractTableMetaCache.java
91.17% <0%> (+2.94%)
11% <0%> (+1%)
:arrow_up:

...rotobuf/convertor/RegisterTMResponseConvertor.java
84.84% <0%> (+3.03%)
3% <0%> (ø)
:arrow_down:

...rotobuf/convertor/RegisterRMResponseConvertor.java
84.84% <0%> (+3.03%)
3% <0%> (ø)
:arrow_down:

...otobuf/convertor/GlobalBeginResponseConvertor.java
96.96% <0%> (+3.03%)
3% <0%> (ø)
:arrow_down:

...obuf/convertor/BranchRollbackRequestConvertor.java
96.42% <0%> (+3.57%)
3% <0%> (ø)
:arrow_down:

...otobuf/convertor/BranchCommitRequestConvertor.java
100% <0%> (+3.57%)
3% <0%> (ø)
:arrow_down:

...otobuf/convertor/BranchReportRequestConvertor.java
96.29% <0%> (+3.7%)
3% <0%> (ø)
:arrow_down:

... and 7 more


Support HTTPS and custom port for E-Series

Added new config items: WebProxyPort and WebProxyInsecure
Cleaned up underscores from the E-Series config structs. Left the underscore in HostData_IP to avoid breaking existing config files.

Your latest changes look good. I just tested, and it works fine. Thanks again for taking the time to contribute to this project.

Thanks @matthew-hannon

Thanks!


Add URL redirections setup to CloudFormation template

About redirections, the final solution uses a single S3 bucket named nlpsandbox.io. Route 53 has two A records, nlpsandbox.io and www.nlpsandbox.io that both redirect to the CloudFront distribution connected to the S3 bucket.

Just noticed the description of the repo:

AWS CloudFormation template for deploying the NLP Sandbox benchmarking infrastructure

Since the redirections are not needed for the benchmarking infra, should this configuration live somewhere else?

@thomasyu888 Feel free to delete the bucket if needed. It's preferable to do this before the launch. For reference, the current redirection rules are listed below.
[
    {
        "Condition": {
            "KeyPrefixEquals": "tools/date-annotator/leaderboard"
        },
        "Redirect": {
            "HostName": "www.synapse.org",
            "HttpRedirectCode": "307",
            "Protocol": "https",
            "ReplaceKeyWith": "#!Synapse:syn22277123/wiki/608544"
        }
    },
    {
        "Condition": {
            "KeyPrefixEquals": "tools/person-name-annotator/leaderboard"
        },
        "Redirect": {
            "HostName": "www.synapse.org",
            "HttpRedirectCode": "307",
            "Protocol": "https",
            "ReplaceKeyWith": "#!Synapse:syn22277123/wiki/608545"
        }
    },
    {
        "Condition": {
            "KeyPrefixEquals": "tools/physical-address-annotator/leaderboard"
        },
        "Redirect": {
            "HostName": "www.synapse.org",
            "HttpRedirectCode": "307",
            "Protocol": "https",
            "ReplaceKeyWith": "#!Synapse:syn22277123/wiki/608546"
        }
    },
    {
        "Condition": {
            "KeyPrefixEquals": "discord"
        },
        "Redirect": {
            "HostName": "discord.gg",
            "HttpRedirectCode": "307",
            "Protocol": "https",
            "ReplaceKeyWith": "Zb4ymtF"
        }
    },
    {
        "Redirect": {
            "HostName": "www.synapse.org",
            "HttpRedirectCode": "307",
            "Protocol": "https",
            "ReplaceKeyWith": "nlpsandbox"
        }
    }
]

Cloudfront Distribution CNAMEs is not supported: https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-cloudfront-distribution-distributionconfig.html.  So will resort to the manual creation of the cloudfront resource.

@thomasyu888 The URL redirections are currently broken. I guess I may expect this as long as this ticket is open. I looked at the AWS account and so all the resources (R53 records, CF distribution, S3 buckets) and everything is there so I'm not sure why the redirections are broken.

@tschaffter The redirections are working again.  The Cloudfront distribution was disabled - I thought I enabled it again, but my internet must have cut out.


Set backoff limit for load test job

What type of PR is this?
/kind bug
What this PR does / why we need it:
The default limit is 6 which does not play well with our big-job deployment.
Which issue(s) this PR fixes:
N/A
Special notes for your reviewer:
/assign @mborsz
Does this PR introduce a user-facing change?:

NONE

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:

/lgtm
/approve


Intellisense only work after typing something

Describe the bug
When I open a project intellisense doesn't work right away, it only works after I type something.
Steps to reproduce

Open a F# project
intellisense doesn't work
Try to type something
intellisense start to work

Screenshots

Machine info

OS: Windows
.NET SDK version: 5.0.403
Ionide version: 5.9.1

At first glance this is a timing issue between when the file is opened and type checking is queued, and when the request for highlighting, etc, is sent. We should make some kind of top-level 'wait for at least one type check result for this file' method that we could use in highlighting, references, etc, to ensure that this doesn't happen.

I think it might be somehow connected to #1622? Not sure though.

I can't reproduce this anymore - startup behaviour seems to be correct.


Document specialization feature

Might be worth checking for other places to use it before publicizing it.

Fixed by c0770ef0e1d271f12dc7cd67bcb882de627203e7


Schema validation generate wrong result if source column name is lower and target column name is upper

Hi,
I'm try to check schema validation in BigQuery source view vs target view. But in source i have lower name column and in target i have upper case name. If i run validation then i see "column<>COLUMN" and i have status FAILED :)
I made quic change in schema_validation.py and add some 2 lines and working:
def schema_validation_matching(source_fields, target_fields):
    """ Compare schemas between two dictionary objects """
    results = []
    # Go through each source and check if target exists and matches

   #----------- GW add START
    target_fields = {k.casefold(): v for k, v in target_fields.items()}
    source_fields** = {k.casefold(): v for k, v in source_fields.items()}
   #----------- GW add STOP

    for source_field_name, source_field_type in source_fields.items():

Please add a parameter to configuration maybe that I can choose if i want use lower or upper.
In documentation BigQuery - https://cloud.google.com/bigquery/docs/reference/standard-sql/lexical#case_sensitivity is see something like that:
Category | Case Sensitive? Table names | Yes Column names | No
Thanks,
Greg

Similar to Issue #495

Thanks 👍


Publishing changes from within view updates is not allowed, this will cause undefined behavior.

Xcode show the runtime issues in the toolbar, is it my mistakes?

Is this with your own custom logic, or with the standard library code?

standard library code

Ok, I'll take a look.
Meanwhile, any more information you can provide would be great.
As in, from where is that function called?

Ok happened to me so I researched a bit. From what I can see using FocusState is a major culprit, at least in my case.

@qazwyw @nadavhart Do you have any steps that I can follow to reproduce this?

@danielsaidi I believe I figured it out. I have a KeyboardTextField on top of my keyboard and I'm adding a .focused modifier and a FocusState instead of using the hasFocus binding that KeyboardTextField init accepts. What solved my runtime issues for me was setting the FocusState to false during onDisappear of the containing view.
That said, I'm having other issues that seem to relate to me using the .focused modifier instead of the hasFocus binding,  so I'm trying to switch to use that instead, but with no luck so far. For some reason I'm unable to set focus to it on view appearance even though default value is true. Not exactly related to this thread I guess but just wanted to share maximum info.

Thank you for the additional information! 🙏
I'm currently working on wrapping up the 7.9 release, but will go through some bugs and iOS 17 problems after that.

Hey @nadavhart and @qazwyw - I managed to reproduce this when adding interactable keyboard previews to a main app yesterday. It seems like SwiftUI does something differently, which causes this.
I managed to silence these warnings by wrapping the input controller's keyboard context updates in async wrappers, so I think handling async is the way to go, although it's rather annoying since our code is not async.
I don't want to add this to 7.9 since it could bring some unexpected bugs, but will look at including it in a patch update in a few weeks.

@nadavhart @qazwyw Have you checked if this is fixed in KeyboardKit 8?

@danielsaidi I've encountered this as part of a consulting engagement that have ended a couple of months ago, so I don't have access to that project anymore. Nonetheless I appreciate you fixing it! KeyboardKit is a great framework and my customer was super happy with the decision to integrate it 💪🙏

@nadavhart Thank you for the information! I'm very happy to hear that KK served you well 🙌


Add Assert.type_relation for <: and !<: expressions in assert: macro

Issue: #88
This PR addresses creates a special case Assert.type_relation function for the assert: foo <: Some (and !<:) operators because the right-hand side is a type expression, not a value expression, so we can't treat it the same as other operators in the language.
Error messages for this macro look like this:

Thanks!

🙌


CamelCased names

It would be nice to have all trait and command names camelcased as there is currently no way to get those from the git and they are need for the sync fulfillment

Matching case to the actual trait / command name would be nice. The lack of a comprehensive "trait" list like there is with "devices" is one of the holes in my implementation now... but a directory listing would be close, even though it wouldn't be ideal since we still couldn't get metadata like trait name, etc.

We now have platform level enum schema for traits / commands / and device types, see: 06c1127

We now have platform level enum schema for traits / commands / and device types, see: 06c1127


Error Loading finnlp in Robo-Advisor Example

I downloaded the following notebook: fingpt/FinGPT_v2/FinGPT_Robo_Advisor/chatgpt-robo-advisor-v2/ChatGPT_Robo_Advisor_v2.ipynb
I run the first two cells and get the following error message. For some reason the distribution cannot be located. Any ideas?

Nevermind, figured it out.


Is there any way I use the var as an ast.Node?

I don't want a []byte as a sonic.Get([]byte), this will be do a repeat job. I have done this Unmarshal action before.
code:
package main
import (
"fmt"
"github.com/bytedance/sonic"
)
type Message struct {
Timestamp int64  json:"timestamp"
Message   string json:"message"
}
func main() {
const a3 = {             "timestamp":1654760858618823,             "message":"Hi"         }
var d3 Message
err := sonic.Unmarshal([]byte(a3), &d3)
if err != nil {
}
s1, _ := sonic.Get([]byte(a3))
s2, _ := sonic.Get(d3)
messageStr, _ := s1.Get("message").Raw()
fmt.Printf("messageStr:%v\n", messageStr)
fmt.Printf("messageStr s2:%v\n", s2)

}

As desired, you can use ast.NewAny() to contain your struct:
s2 := ast.NewAny(d3)
out, err := s2.MarshalJSON()
println(string(out)) \\ "{"timestamp":1654760858618823,"message":"Hi"}"

But I don't understand why you want to do this. If your goal is to pass the entire JSON, I recommend you to use ast.NewRaw():
s2 := NewRaw(a3)
out, err := s2.MarshalJSON()
println(string(out)) \\ "{ "timestamp":1654760858618823, "message":"Hi" }"

This is more effecient.

@AsterDY AsterDY, thank you very much for your answer, I am new and I don't know there are two ways to use, that seems nice for me.


Python: 3.2 What is Logical and Comparison Operator?

Python: 3.2 What is Logical and Comparison Operator?
Issue Number #412

Type of change 📝

[x] Audio (Should be in mp3 format Includes speech clarity, Concise ,Low distortion)

Domain of Contribution 📊

[x] Python_Domain

Checklist ✅

[x] I follow Contributing Guidelines & Code of conduct of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I'm GWOC'21 contributor

@prathimacode-hub  can you assign this issue for video part


Typo in hyperlink in installation wiki

https://github.com/SUSE/Portus/wiki/Installing-Portus
Under 'Installing the RPM', the link to the Portus release in OpenSuse points to
http://software.opensuse/org/package/Portus?search_term=Portus
and instead should be http://software.opensuse.org/package/Portus?search_term=Portus

Fixed! Thanks for the tip :)


VR HA is not getting triggered by Cloudstack

ISSUE TYPE
BUG
Component Name
HA, Management server
CLOUDSTACK VERSION
Cloudstack version 4.19
SUMMARY
VR HA is not getting triggered by Cloudstack
Steps to reproduce the issue

Create a cloudstack env with 2 kvm hosts

Create a new system offering for virtual router with Ha enabled option or use the default (System Offering For Software Router).

Make sure offerha parameter is set  when list serviceofferings issystem=true
{
      "cpunumber": 1,
      "cpuspeed": 500,
      "created": "2024-02-20T10:52:30+0000",
      "defaultuse": true,
      "diskofferingstrictness": false,
      "dynamicscalingenabled": true,
      "encryptroot": false,
      "hasannotations": false,
      "id": "13dd43a0-3ddf-4cb4-b81b-a191cffdf7a0",
      "iscustomized": false,
      "issystem": true,
      "isvolatile": false,
      "limitcpuuse": false,
      "memory": 256,
      "name": "System Offering For Software Router",
      "offerha": true,
      "provisioningtype": "thin",
      "rootdisksize": 0,
      "storagetype": "shared",
      "systemvmtype": "domainrouter"
 },

   {
      "cacheMode": "none",
      "cpunumber": 1,
      "cpuspeed": 500,
      "created": "2024-03-19T03:58:21+0000",
      "defaultuse": false,
      "diskofferingstrictness": false,
      "displaytext": "harouter",
      "dynamicscalingenabled": true,
      "encryptroot": false,
      "hasannotations": false,
      "id": "3212cee3-3ac0-46cb-9a85-10781ecdefb8",
      "iscustomized": false,
      "iscustomizediops": false,
      "issystem": true,
      "isvolatile": false,
      "limitcpuuse": false,
      "maxiops": 0,
      "memory": 256,
      "miniops": 0,
      "name": "harouter",
      "offerha": true,
      "provisioningtype": "thin",
      "rootdisksize": 0,
      "storagetype": "shared",
      "systemvmtype": "domainrouter"
    }

Set the global setting value for "router.service.offering" to the UUID vaule of the service offering or leave it NULL

Create a Network and  deploy the vm in the network

Make sure router is running host 1 and the vm is running on host 2

Login to the kvm host 1 and execute the following command

echo c > /proc/sysrq-trigger

After 10 min the host 1 will be marked as down and the vr will be in stopped state

This issue is not occuring for ssvm and console proxy
Actual Behaviour
VR is in stopped state
Expected Behaviour
VR should migrate to HOST 2

This issue is not observed in the latest build of 4.19.1


Can not remove AMF with  error cannot destroy application "amf": application is used by 2 consumers

Bug Description
Deploy Charmed Ather SD-Core, all the charms were active.
Then I attached a custom image to AMF which put the charm in error error state.
Then I resolved the charm and  tried to remove AMF. It failed  with ERROR removing application amf failed: cannot destroy application "amf": application is used by 2 consumers.
I forced to remove it. I got the same error.
I removed all the K8s objects belongs to AMF, then tried to remove charm again.
I got the same error.
Now unit is in unknow status and charm hanged in Waiting status with a message Waiting for AMF service to start.
To Reproduce
Follow the tutorial to deploy the environment https://canonical-charmed-oai-ran.readthedocs-hosted.com/en/latest/tutorials/getting_started/
Environment
juju 3.5.5
Microk8s 1.31 classic
Relevant log output
gatici@gaticipc:~/charmed5g/sdcore-amf-operator$ juju remove-application amf
WARNING This command will perform the following actions:
will remove application amf
- will remove unit amf/0
- will detach storage certs/20
- will detach storage config/22

Continue [y/N]? y
ERROR removing application amf failed: cannot destroy application "amf": application is used by 2 consumers

gatici@gaticipc:~/charmed5g/sdcore-amf-operator$ juju remove-application amf  --force
WARNING This command will perform the following actions:
will remove application amf
- will remove unit amf/0
- will detach storage certs/20
- will detach storage config/22

Continue [y/N]? y
ERROR removing application amf failed: cannot destroy application "amf": application is used by 2 consumers

gatici@gaticipc:~/charmed5g/sdcore-amf-operator$ juju remove-application amf  --force --no-wait
WARNING This command will perform the following actions:
will remove application amf
- will remove unit amf/0
- will detach storage certs/20
- will detach storage config/22

Continue [y/N]? y
ERROR removing application amf failed: cannot destroy application "amf": application is used by 2 consumers

gatici@gaticipc:~/charmed5g/sdcore-amf-operator$ kubectl delete statefulset.apps/amf  service/amf-external   service/amf-endpoints  service/amf pod/amf-0   -n sdcore
statefulset.apps "amf" deleted
service "amf-external" deleted
service "amf-endpoints" deleted
service "amf" deleted
pod "amf-0" deleted

gatici@gaticipc:~/charmed5g/sdcore-amf-operator$ juju status
Model   Controller                  Cloud/Region                Version  SLA          Timestamp
sdcore  microk8s-classic-localhost  microk8s-classic/localhost  3.5.5    unsupported  13:27:37+03:00

SAAS  Status  Store  URL
cu    active  local  admin/ran.cu

App                       Version  Status   Scale  Charm                     Channel        Rev  Address         Exposed  Message
amf                       1.5.1    waiting    0/1  sdcore-amf-k8s            1.5/stable     834  <IP_ADDRESS>  no       Waiting for AMF service to start
ausf                      1.5.1    active       1  sdcore-ausf-k8s           1.5/stable     645  <IP_ADDRESS>   no
grafana-agent             0.40.4   blocked      1  grafana-agent-k8s         latest/stable   80  <IP_ADDRESS>  no       Missing ['grafana-cloud-config']|['logging-consumer'] for logging-provider; ['grafana-cloud-config']|['send-remote-wr...
mongodb                            active       1  mongodb-k8s               6/stable        61  <IP_ADDRESS>  no
nms                       1.0.0    active       1  sdcore-nms-k8s            1.5/stable     741  <IP_ADDRESS>   no
nrf                       1.5.2    active       1  sdcore-nrf-k8s            1.5/stable     720  <IP_ADDRESS>   no
nssf                      1.5.1    active       1  sdcore-nssf-k8s           1.5/stable     614  <IP_ADDRESS>  no
pcf                       1.5.2    active       1  sdcore-pcf-k8s            1.5/stable     650  <IP_ADDRESS>  no
router                             active       1  sdcore-router-k8s         1.5/stable     424  <IP_ADDRESS>  no
self-signed-certificates           active       1  self-signed-certificates  latest/stable  155  <IP_ADDRESS>  no
smf                       1.6.2    active       1  sdcore-smf-k8s            1.5/stable     745  <IP_ADDRESS>   no
traefik                   2.11.0   active       1  traefik-k8s               latest/stable  203  <IP_ADDRESS>  no       Serving at <IP_ADDRESS>.nip.io
udm                       1.5.1    active       1  sdcore-udm-k8s            1.5/stable     605  <IP_ADDRESS>  no
udr                       1.6.1    active       1  sdcore-udr-k8s            1.5/stable     597  <IP_ADDRESS>  no
upf                       1.5.0    active       1  sdcore-upf-k8s            1.5/stable     691  <IP_ADDRESS>  no

Unit                         Workload  Agent  Address      Ports  Message
amf/0                        unknown   lost   <IP_ADDRESS>         agent lost, see 'juju show-status-log amf/0'
ausf/0*                      active    idle   <IP_ADDRESS>
grafana-agent/0*             blocked   idle   <IP_ADDRESS>         Missing ['grafana-cloud-config']|['logging-consumer'] for logging-provider; ['grafana-cloud-config']|['send-remote-wr...
mongodb/0*                   active    idle   <IP_ADDRESS>          Primary
nms/0*                       active    idle   <IP_ADDRESS>
nrf/0*                       active    idle   <IP_ADDRESS>
nssf/0*                      active    idle   <IP_ADDRESS>
pcf/0*                       active    idle   <IP_ADDRESS>
router/0*                    active    idle   <IP_ADDRESS>
self-signed-certificates/0*  active    idle   <IP_ADDRESS>
smf/0*                       active    idle   <IP_ADDRESS>
traefik/0*                   active    idle   <IP_ADDRESS>         Serving at <IP_ADDRESS>.nip.io
udm/0*                       active    idle   <IP_ADDRESS>
udr/0*                       active    idle   <IP_ADDRESS>
upf/0*                       active    idle   <IP_ADDRESS>

Offer  Application  Charm           Rev  Connected  Endpoint  Interface  Role
amf    amf          sdcore-amf-k8s  834  1/1        fiveg-n2  fiveg_n2   provider
upf    upf          sdcore-upf-k8s  691  0/0        fiveg_n3  fiveg_n3   provider
gatici@gaticipc:~/charmed5g/sdcore-amf-operator$ juju remove-application amf  --force  --no-wait
WARNING This command will perform the following actions:
will remove application amf
- will remove unit amf/0
- will detach storage certs/20
- will detach storage config/22

Continue [y/N]? y
ERROR removing application amf failed: cannot destroy application "amf": application is used by 2 consumers

### Additional context

_No response_

The charm is removed after running  juju remove-offer admin/sdcore.amf  --force


Bump version to 2.5.8

Created a new release that has compatibility fixes with Django 1.9+

bump!


Correction for raw affiliation UMR IATE, Montpellier SupAgro Campus, France.

Correction needed for raw affiliation UMR IATE, Montpellier SupAgro Campus, France.
raw_affiliation_name: UMR IATE, Montpellier SupAgro Campus, France.
new_rors: 03rnk6m14;0000n5x09
previous_rors: 03rnk6m14
works_examples: W2514472502
contact: c04ad6cbd2e618da1ae26dd18d84b0f8:8da0136379c3f7518236734159b709de9148 @ inrae.fr

This issue was accepted and ingested by the OpenAlex team on 2024-11-18. The new affiliations should be visible within the next 7 days.


PMB-17: More logs

Problem:

Not a lot of logs, so debugging may be hard if something goes wrong

Solution:

Add more logs

Changes:

API
Server
Telegram Bot

Partially done: 332ebd58cd493c3cfa6e925ecbc0076092d5a393


Implement Default Webhooks

Partially implement #770. (This is only webhooks, not git hooks.)

Add "Default Webhooks" page in site admin UI.
Persist to the existing webhooks table, but store with RepoID=0 and OrgID=0.
Add a few handlers and templates, but mostly modify the existing ones to serve double-duty. I should point out that installations that have customized the webhooks templates (probably uncommon) will need to edit them to accomodate a slight change in the semantics of .BaseLink.
Upon repo creation, copy the set of default webhooks into the new repo.
A repo owner may delete or edit these webhooks if he doesn't like the defaults.

Codecov Report

Merging #4299 into master will decrease coverage by 0.03%.
The diff coverage is 3.57%.

@@            Coverage Diff             @@
##           master    #4299      +/-   ##
==========================================
- Coverage   20.09%   20.05%   -0.04%
==========================================
  Files         153      153
  Lines       30696    30763      +67
==========================================
+ Hits         6168     6170       +2
- Misses      23586    23651      +65
  Partials      942      942

Impacted Files
Coverage Δ

routers/repo/webhook.go
0% <0%> (ø)
:arrow_up:

models/repo.go
18.37% <0%> (-0.04%)
:arrow_down:

models/webhook.go
45% <5.88%> (-5.26%)
:arrow_down:

modules/process/manager.go
69.56% <0%> (-4.35%)
:arrow_down:

modules/avatar/avatar.go
100% <0%> (+18.75%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e2721b6...30ba097. Read the comment docs.

It's been a while.  Should I merge master into this branch now to make review easier, or is it best to wait?

I'm confused about why drone failed.  Is it a drone bug, or something I did wrong?

@aunger let me re-trigger drone.

Thanks for your help, @techknowlogick, but I've tried Discord a few times and don't get much response. Would you mind doing the review yourself?
@lunny, would you review this too? I see you hearted it. It's been languishing for two months now.
Thanks.

@aunger I will review and test it. but that maybe spend my some time.

LGTM

@ethantkoenig Mind reviewing this PR? This would turn one of your ufw customizations into an admin setting. https://github.com/unfoldingWord-dev/gogs/blob/a2489be2c7ab4d3d20838135bb1d538c2eb5f40c/models/repo.go#L1363

@aunger I won't be able to, sorry.

Can default webhooks be stored to new table, so that this functionality could be later extended more easily?

@lafriks Someone could certainly implement it that way. This PR's KISS approach is better in some ways though, because the plumbing is more easily shared (don't need an abstraction of a webhook if they are all the same) and it requires less attention to table schemas. What future extensions do you have in mind?

@aunger I would like to have ability to have forced webhooks for all repositories, updating webhooks for repositories when changing default webhook, ability to select/deselect from default webhooks in repository settings etc

@lafriks Great ideas. Site-wide hooks are more flexible. I was weighing most of that before I implemented this, but I didn't get any feedback (https://github.com/go-gitea/gitea/issues/770#issuecomment-398274022), so I decided to go simple ("agile"?) with this implementation, because it's all my organization needs right now (and because it's what #770 explicitly asked for).

@lafriks I won't tackle site-wide hooks right now. If you're going to code it up now, that's awesome. If not, I hope you consider merging this implementation in the meantime. Thanks.


Ruby 2.2 Windows

I have Windows and will be able to test new builds of Nokogiri.
I believe the problem on this system is the inability for Nokogiri to be compiled. I am not massively experienced with this type of work, but want to learn.
If you need any input etc from Windows x64 users running 2.2.1, I am available.

Seems to be functional, will keep updated with any info

Hello,
Thanks for asking this question. We've have multiple open tickets about this, and I'm consolidating them under #1256. Please follow along there!
-m


Change license plate to pseudo european model

I changed the 3d model for the license plate, as well as the format to AA - 0000
To see the changes, just spawn in the debug world and look at the vehicle

I updated the UV map to move the text up

Feature has been moved to 12gabriel3/EveronLife:license-plate


Hotfix/4.5.5

Fixes

Fixes problems recognizing rabbitmq-related errors and exiting
dl-cpp updated to v2.8.1

Testing

Forced rabbitmq errors result in clean exits in dl-cpp tests and kv-store stests

Prior to merging for releases:

[x] update the project's version in the top-level CMakeLists.txt file
[x] update the appVersion to be the new container image tag version in chart/Chart.yaml

@laroque yeah, I totally agree about the workflow syntax.  I just need time to sit and figure out the better way to organize it.
Thanks for the review.


Allow non-admin users to change their password

What is the proper setup so that users can change their password and don't need an admin to do so? I don't see it in the list of permissions and just giving an account Staff status isn't enough to get a user to the form.

There wasn't a view for that until now.
I added one and linked to it from the profile section in the settings.


Version question

Hi Eric and everyone.
I installed a version of the module using pip install.  It is different, but works after looking at the code and leaving out the api version. I believe this is  an older version but I wanted to be sure. Is the pip repository older ?
Thank you,
Jack

I have used github version. Indeed in pip old version


DocsArchive-<IP_ADDRESS>Auto archive content

Please don't merge this PR until target archive repo PR https://github.com/OPS-E2E-PPE/docs-archive-test-target_39004a6f-5e29-4412-9553-84d47b61258c/pull/1 is merged into live branch.
Auto archive content to https://github.com/opstest2/docs-archive-test-target_39004a6f-5e29-4412-9553-84d47b61258c.git

Docs Build status updates of commit 4669f52:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error: GitBranchDeletedOrForcePushed] Cannot sync git repo to specified commit because branch Release_Archive_main_2022-03-07-07-54-06 has been deleted or has been force pushed

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Cannot load ‘bookcorpusopen’

Describe the bug
Cannot load 'bookcorpusopen'
Steps to reproduce the bug
dataset = load_dataset('bookcorpusopen')

or
dataset = load_dataset('bookcorpusopen',script_version='master')

Actual results
ConnectionError: Couldn't reach https://the-eye.eu/public/AI/pile_preliminary_components/books1.tar.gz
Environment info

datasets version: 1.9.0
Platform: Linux version 3.10.0-1160.45.1.el7.x86_64
Python version:  3.6.13
PyArrow version: 6.0.1

The host of this copy of the dataset (https://the-eye.eu) has been down for months.
Finding this dataset is a little esoteric, as the original authors took down the official BookCorpus dataset some time ago.
There are community-created versions of BookCorpus, such as the files hosted in the link below.
https://battle.shawwn.com/sdb/bookcorpus/
And more discussion here:
https://github.com/soskek/bookcorpus
Do we want to remove this dataset entirely?  There's a fair argument for this, given that the official BookCorpus dataset was taken down by the authors.   If not, perhaps can open a PR with the link to the community-created tar above and updated dataset description.

Hi! The bookcorpusopen dataset is not working for the same reason as explained in this comment: https://github.com/huggingface/datasets/issues/3504#issuecomment-1004564980

Hi @HUIYINXUE, it should work now that the data owners created a mirror server with all data.


Causes page to scroll down when picker created with 0% opacity

I'm spawning one of my website's custom popup objects with a picmo inside it, but the second it's created the page immediately scrolls down to the picker, even though it's completely hidden. I suspect this is due to autofocus of an element, even though in my create function I have "autoFocusSearch" set to false. I'd prefer not to use picmo's popup solution if possible, but if that is the only way forward I'm fine to use that.
Page in question: https://osekai.net/profiles/?user=2 (you can see on load it scrolls to around where picmo is)

https://user-images.githubusercontent.com/33783503/180637745-1e121b54-7600-42e9-aebb-4b65bca0f476.mp4
if (document.getElementById("comments__emoji_container")) {
    var emoji = document.getElementById("comments__emoji_container");
    const picker = picmo.createPicker({
        rootElement: emoji,
        className: 'osekai__emoji-picker',
        autoFocusSearch: false,
    });
    picker.addEventListener('emoji:select', selection => {
        document.getElementById("comments__input").value += selection.emoji;
    });
}

Is this a bug or am I doing something wrong?

I think I see what's happening - when autoFocusSearch is false, the picker will still automatically set the focus to the first focusable emoji in the picker. This is left over from when PicMo was only shown in a popup where it makes sense to do this as soon as it is created, but for an inline picker like you have here it doesn't make sense.
I think currently your only options are:

Use the popup picker functionality in the @picmojs/popup-picker package, or
In your own popup element, don't create the picker until the popup is opened the first time. For the inline picker, the auto focus behavior will only happen once, when the picker is created.

There may be another way to move the focus back, but at that point your page is already scrolled.
I think I need to improve the autofocusing feature by allowing one of three actions:

Auto focus the search (autoFocusSearch)
Auto focus the emoji area
No auto focus

I can introduce a new option called initialFocus or something that takes one of these three values. This should be easy to do, will follow up with yo soon.

This has been implemented and will be included in the 5.4.0 release which is coming soon, there are a few other things I want to include.

Thank you for the help! It's really appreciated ❤ - I'll be waiting for the new release! :3

I just released v5.4.0 which should fix your issue.

I had to set autoFocus to none for it to work, but after doing that it works flawlessly! Thanks for the help!

Leaving it undefined still scrolls down, and setting it to none ends up with an error.

const picker = picmo.createPicker({
    rootElement: emoji,
    className: 'osekai__emoji-picker',
    autoFocus: none
});

I've updated my picmo version to 5.4.0 from the CDN (https://unpkg.com/picmo@5.4.0/dist/umd/picmo.js). Might I be doing something wrong here?

none should be a string: autoFocus: 'none', does it work then?

afraid that has not done anything to help. the page is still scrolling down 😅

The CDN version you linked includes the change for autoFocus, if the value is 'none' or undefined it should not do any autofocus. Is there something else in your code that could be triggering a focus operation?

if i simply comment out the picmo code, it immediately stops doing the focus/scroll. and beyond theming i haven't modified picmo at all. i can't think of any reason it'd be autoscrolling if simply removing picmo fixes it, sadly

There must be something else going on. Are you sure that it's a focus operation that is causing the scroll? Your site looks pretty complicated but any chance you can provide a simpler example that exhibits the problem?
I will reopen this issue since it looks like the autoFocus option did not resolve the issue.

i've made a little codepen which shows off the issue, hope it helps! https://codepen.io/Hubz/pen/VwXQoZK

That was super helpful! I have found the issue. When setting the initial category, I was accidentally focusing the button which is what's causing your issue.
I want to do some further testing to make sure I didn't break focus elsewhere, but should have a fix ready soon.

Hi, I just published version 5.4.1. Can you try this out and let me know if it fixes your issue?

that's fixed it, thank you so much!


Skip serialization of field Span.error if equals to 0

What does this PR do?
It skips the serialization of the field Span.error as it's done by tracers (at least .net and PHP)
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.

Can we easily add a utest?

Done!


PCluster fleet launch failure with Torque

Environment:
aws-parallelcluster-2.4.0 and aws-parallelcluster-2.4.1  #############################################
AWS Parallel Cluster Configuration File
#############################################
[global]
#cluster_template = test-meme-cluster
sanity_check = true
#############################################
AWS Credentials and Connection Settings
#############################################
[aws]
This is the AWS credentials section (required).
These settings apply to all clusters
replace these with your AWS keys
aws_region_name = us-west-2
################################
Defining Cluster Templates
################################
[cluster test-meme-cluster]
key_name = meme-suite-uswest-2
initial_queue_size = 1
max_queue_size = 4
maintain_initial_size = true
scheduler = torque
cluster_type = spot
spot_price = 0.05
Modified Ubuntu 16.04
custom_ami = ami-0572a6ec3824c764e
compute_instance_type = m5.large
master_instance_type = m5.large
ebs_settings = testuser, testdata
vpc_settings = meme-suite
base_os = ubuntu1604
#post_install = https://meme-suite-custom-bootstrap.s3-us-west-2.amazonaws.com/meme-suite-cluster-config.sh
[cluster primary-meme-cluster]
key_name = meme-suite-uswest-2
initial_queue_size = 1
max_queue_size = 7
maintain_initial_size = true
scheduler = torque
cluster_type = spot
spot_price = 0.05
Modified Ubuntu 16.04
custom_ami = ami-0572a6ec3824c764e
compute_instance_type = m5.large
master_instance_type = m5.large
ebs_settings = primaryuser, primarydata
vpc_settings = meme-suite
base_os = ubuntu1604
#post_install = https://meme-suite-custom-bootstrap.s3-us-west-2.amazonaws.com/meme-suite-cluster-config.sh
[vpc meme-suite]
vpc_id = vpc-fdbca39f
master_subnet_id = subnet-6a44612c
[ebs testdata]
ebs_volume_id = vol-0fb32e70e5d029f59
shared_dir = /home/meme-data
[ebs primarydata]
ebs_volume_id = vol-0d21dcf853fbf4d05
shared_dir = /home/meme-data
[ebs testuser]
ebs_volume_id = vol-0cf0dc28ead15983d
shared_dir = /home/meme
volume_type = standard
volume_size = 400
[ebs primaryuser]
ebs_volume_id = vol-05812a41028831261
shared_dir = /home/meme
.
Bug description and how to reproduce:
We've been using pcluster 2.4.0 and 2.4.1 with Torque and this configuration file for months without problem. Yesterday (2020-04-21) we began seeing a problem where jobs were piling up in the Torque queue but never being run. Our autoscaling group had launched the maximum allowed number of compute instances. Looking at /var/spool/torque/server_log and /var/spool/torque/server_priv/nodes is look like though compute instances were being spun up, they were never being added to /var/spool/torque/server_priv/nodes
I deleted that instance of the cluster and I've repeatedly tried to relaunch a new instance, using the command
pcluster create -c meme-web-aws-pcluster-config -t test-meme-cluster test-meme-cluster
This would almost always fail, with the error message
Cluster creation failed.  Failed events:

AWS::CloudFormation::Stack parallelcluster-test-meme-cluster The following resource(s) failed to create: [MasterServerWaitCondition, ComputeFleet].
AWS::AutoScaling::AutoScalingGroup ComputeFleet Resource creation cancelled
AWS::CloudFormation::WaitCondition MasterServerWaitCondition Failed to receive 1 resource signal(s) within the specified duration

but actually worked once or twice. When I looked at the Torque logs on the master, the issue was always the same as the initial problem: the compute node was not being added to the server_priv/nodes file, so communication couldn't be established between the master and the compute node.
Additional context:
Any other context about the problem. E.g.:
No cloudwatcher or sqs logs found. It looks like there was a script failure in cloud-init.log
2020-04-23 03:48:56,073 - handlers.py[DEBUG]: finish: modules-final/config-scripts-user: FAIL: running config-scripts-user with frequency once-per-instance
cloud-init-output.log
cloud-init.log

Hi Charles.
From the logs you shared seems like you are using an ami backed with ParallelCluster 2.4.0 to create a cluster with ParallelCluster 2.4.1.
As reported in our user guide:
"After you build your own AMI, you no longer receive updates or bug fixes with future releases of AWS ParallelCluster. Also, you must repeat the steps used to create your custom AMI with each new AWS ParallelCluster release. "
To solve the issue you could either build a new AMI with the version of ParallelCluster you want to use (latest one is currently 2.6.1) by following the steps in this tutorial:
https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials_02_ami_customization.html
or re-install parallelcluster 2.4.0 by launching the following command:
pip install aws-parallelcluster==2.4.0

If you are working with different version of ParallelCluster in the same machine you run the above command inside a virtual environment as described here:
https://docs.aws.amazon.com/parallelcluster/latest/ug/install-virtualenv.html
Hope it helps.

I thought I had tried using both versions 2.4.0 and 2.4.1 with similar failures. However the situation may have been confused because we were also get failures to purchase spot instances of m5.large instances in us-west-2.  At any our configuration seems to be working now with pcluster 2.4.0 and using m5n.large instances. Thanks for your quick assistance!


Allow using any(*) and possible other wildcard usages in aggregations

@ymost : this repository is about Kusto Python SDK. For feature requests: use http://aka.ms/adx.uservoice
(Please, also describe what you mean in more details)


Dataset request

Hello, thank you for your sharing. May I inquire when the new dataset will be made publicly available?

@Themistanny Thank you for your interest in OphNet! To track each download, we will be sending the data download link via email (we expect this to be completed within about a month). Please make sure that you have successfully filled out and submitted the data application form.

@Themistanny Thank you for your interest in OphNet. The dataset is now open-sourced; please refer to Dataset Preparation. If you have any other questions, feel free to leave a message.


Changing BM25Retriever _retrieve to use numpy methods

Description
Using BM25Retriever with a modest  amount of data(~40000 short nodes) was taking several seconds, which seemed odd.
Apparently, after computing the scores of the nodes, the sorting is done with python's sorted, which is slow compared to numpy's argsort and sort. The supporting library rank_bm25 has a get_top_n function that can be adapted to do the _retrieve's work using these functions.
Fixes # BM25Retrieve retrieval performance
New Package?
No
Version Bump?
Did I bump the version in the pyproject.toml file of the package I am updating? (Except for the llama-index-core package)

[x] Yes
[ ] No

Type of Change

[x] Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?
make test, this little benchmark and checking the computed scores match in my use case.
import random
import string
from llama_index.retrievers.bm25 import BM25Retriever
from llama_index.core.schema import TextNode

nodes = []
for i in range(100000):
    nodes.append(TextNode( text= ''.join(random.choices(string.ascii_lowercase, k=20))))

bm25retriever = BM25Retriever.from_defaults(nodes=nodes,
                                            similarity_top_k= 5)

bm25retriever.retrieve("foobar")

before
In [5]: %timeit bm25retriever.retrieve("foobar")
746 ms ± 39.2 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

after
: %timeit bm25retriever.retrieve("foobar")
20.2 ms ± 536 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)

Suggested Checklist:

[x] I have performed a self-review of my own code
[x] My changes generate no new warnings
[x] New and existing unit tests pass locally with my changes
[x] I ran make format; make lint to appease the lint gods

That doesn't result in the same output :
In [5]: foo
Out[5]: array([0, 1, 2, 3, 4, 5, 6, 7, 8, 9])
In [6]: foo[-2:]
Out[6]: array([8, 9])
In [7]: foo[::-1][:2]
Out[7]: array([9, 8])
Also, the [::-1] doesn't seem to actually duplicate the array (not an
expert in numpy's vodoo):
In [8]: foo2 = foo[::-1]
In [9]: foo2.base
Out[9]: array([0, 1, 2, 3, 4, 5, 6, 7, 8, 9])
Regards,
El lun, 10 jun 2024 a las 18:11, Logan @.***>)
escribió:

@.**** commented on this pull request.
In
llama-index-integrations/retrievers/llama-index-retrievers-bm25/llama_index/retrievers/bm25/base.py
https://github.com/run-llama/llama_index/pull/14015#discussion_r1633506428
:

 def _retrieve(self, query_bundle: QueryBundle) -> List[NodeWithScore]:

     if query_bundle.custom_embedding_strs or query_bundle.embedding:
         logger.warning("BM25Retriever does not support embeddings, skipping...")

   scored_nodes = self._get_scored_nodes(query_bundle.query_str)

   query = query_bundle.query_str

   tokenized_query = self._tokenizer(query)

   scores = self.bm25.get_scores(tokenized_query)

   top_n = scores.argsort()[::-1][: self._similarity_top_k]

seems like it would be even faster if we didn't reverse the list
top_n = scores.argsort()[-self._similarity_top_k:]
—
Reply to this email directly, view it on GitHub
https://github.com/run-llama/llama_index/pull/14015#pullrequestreview-2108224776,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUPSSVLHYTXRDWFOPKE5O2DZGXF4XAVCNFSM6AAAAABI7XUNROVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDCMBYGIZDINZXGY
.
You are receiving this because you authored the thread.Message ID:
@.***>


Replace native splash screen?

Does it replace native splash screen of android and ios?

no, it simply creates new Scaffold with timer(


Warning: Workspaces can only be enabled in private projects

Thanks for writing this plugin! It works great, even when used in combination with @docusaurus/plugin-ideal-image.
However, when installing, I see:
 $ yarn add docusaurus-plugin-image-zoom
yarn add v1.22.18
[1/4] Resolving packages...
[2/4] Fetching packages...
[3/4] Linking dependencies...
warning Workspaces can only be enabled in private projects.
[4/4] Building fresh packages...
success Saved lockfile.
warning Workspaces can only be enabled in private projects.
success Saved 2 new dependencies.
info Direct dependencies
└─<EMAIL_ADDRESS>info All dependencies
├─<EMAIL_ADDRESS>└─<EMAIL_ADDRESS>Done in 4.64s.

Could this be to blame:
https://github.com/gabrielcsapo/docusaurus-plugin-image-zoom/blob/c2c1155080dc847e542a039d11aba5de3e05774b/package.json#L23-L25

Thanks @norosa, fixing this now. We have no reason to install it as a workspace and publish it as a workspace.

should be fixed in https://github.com/gabrielcsapo/docusaurus-plugin-image-zoom/commit/7fc492c1aec46ffeb7562d5e736197f9fe2af195 [0.1.1]! Thank you @norosa


Is this a bug or have I failed to understand something?

I'm basing  a project on Electron React Boilerplate.  A simple alteration to its e2e tests fails, and I cannot see what's wrong.
The original test spec looks like this :
it('should to Counter with click "to Counter" link', async () => {
  const { client } = this.app;

  await client.click('[data-tid=container] > a');
  expect(await findCounter().getText()).toBe('0');
});

...and the original React markup looks like this :

Home

  <Link to="/counter">to Counter</Link>

It seemed weird to me, to refer indirectly to the hyperlink, so I added my own data-tid to the link itself ...

Home

  <Link to="/counter" data-tid="cntr">to Counter</Link>

... and tried to test it like that :
it('should to Counter with click "to Counter" link', async () => {
  const { client } = this.app;

  await client.click('[data-tid=container] > a');  // working original
  /*  The following attempts, succeed with Chrome debugger XPath search,  */
  /*  but fail in testing with ... */
  /*  "An element could not be located on the page using the given search parameters." */
  // await client.click('//a[@data-tid="cntr"]');
  // await client.click('[data-tid="cntr"]');
  // await client.click('[data-tid=cntr]');

  expect(await findCounter().getText()).toBe('0');
});

Chrome debugger finds the element, but Spectron doesn't. What's wrong?
If this is not a bug, what's the rule to follow in future to not fall down the same hole again?

+1
Have you found a solution for this?


https://github.com/USDJPM/JPM/pull/1

oken Name: USDJPM
Token Symbol : JPM
Token Supply : total number of tokens created  4 200 000 000
Token Value : 0,14$ f
Token Network : TRON TRC20
Community Base : https://twitter.com/usdjpm
Listed in IEO or not :
https://www.koinpark.com/trade/JPM-BTC
https://www.koinpark.com/trade/JPM-ETH
https://www.koinpark.com/trade/JPM-USDT
https://www.koinpark.com/trade/JPM-INR
contract address  TRtgjeEnCYK5LHgZui47ph3ge6dSyiPswJ
https://tronscan.org/#/token20/TRtgjeEnCYK5LHgZui47ph3ge6dSyiPswJ
www.usdjpm.com
telegram  https://t.me/usdjpmtrc20
https://www.coingecko.com/en/coins/usdjpm


lightweight hello world python sample

i like the sentiments python sample function, but we should add a lighter python sample as well for ci and quick idiomatic python demo and experiments.

Depends on update/publish of new python function invokers

shipped in 0.0.5
see https://github.com/projectriff/riff/commit/aff04abf09b5a0d086212f1d1b63e974bf18343d#diff-cc76b24c6f3a76f3996ce0ffa30029ae


Get any Component from Entity

Hi, is there any way to get an arbitrary component from an entity? The general idea I had was to have some systems that use callbacks/scripts for their behavior (e.g. AI/Collision), but then the callback might want to use other data from the entity. I know I could just add more components to the system, but ideally I could do something like
SystemData = (Entity, ReadAnyComponent)  then in the callback, something like
let position = components.get::<Position>(&entity)
or something similar.
I'm not bothered about mutable access or anything similar, just a way of getting arbitrary components from entities without having to define it in the system data, even if there's a performance loss or having to keep the data behind a lock or an Arc or something.
Is this at all possible to do in any way?

Hello!
First of all, scripting is a complex topic. There's no obvious & good solution for it, but I'm working on that issue.
There's no such way to read an arbitrary component from a system, but it's technically possible from outside. But still, what you describe above would be complicated, because you obviously can't call a generic function from a script. So you need quite a lot functionality:

somehow refer to the Rust types from Lua (probably Strings), mapped to some type metadata
somehow fetch an unknown type from the world (technically possible, but meh)
pass it to Lua and somehow make it usable there

In the latest (released) version, you did such a dynamic fetch with Resources::fetch_id_*. For that, you need to get the TypeId of MaskedStorage<MyComponent>. Then you need a way to extract an entity out of it. That is only possible using it as a trait object (where the trait is a custom, object-safe trait that allows getting an Entity). However, you already have a trait object (Box<Resource>). This trait object doesn't contain any other implementations obviously, so you need a way to somehow get the vtable of your trait object, which is again quite tricky. I made a helper here (not released).
TL;DR: It would be much easier for you to just pass all the components or write the code in Rust.

Thanks for your reply!
I'm using Gluon as my scripting language which I think can already handle Generics and Rust <-> Gluon type mappings. I already have some code like:
opal.world_mut().create_entity()
    .with(GluonUiComponent {
        name: String::from("Testing Ui"),
        expr: String::from("
let { (|>) } = import! std.function
let { bordered_rectangle, rgba } = import! conrod

let rect =
    bordered_rectangle.new 0.5 0.5 \"rect\" |>
        bordered_rectangle.color (rgba 1.0 0.6 0.4 1.0) |>
        bordered_rectangle.x_y 0.5 0.5 |>
        bordered_rectangle.border 0.55 |>
        bordered_rectangle.border_color (rgba 0.0 0.0 0.0 1.0) |>
        bordered_rectangle.build in rect"),
});

Which works by wrapping Conrod types, so I'm already dealing with the whole type marshaling problem. (Obviously the script here isn't loaded from a file yet, but the proof of concept works)
I guess one way would be some sort of AnyMap of components that you'd have to fill in in an earlier system? Or maybe using a message queue or futures to request components that I could then get from outside the system loop and pass in, but that'd introduce latency between the request and the response.
The problem I'm seeing with the passing all the components in way is that it means that I can't write core things as a library and extend them inside a separate project as easily because any components added in the separate project wouldn't be inside the SystemData of the core systems.
Writing it all in Rust would solve the type marshaling problems, but it would still leave the problem of getting arbitrary components for entities, right? I couldn't have a Movement AI system that works with entities having closures or scripts, I'd have to have a different one for each combination of components/each behavior needed?

I just noticed, there's one issue that makes modeling a system hard: https://github.com/slide-rs/shred/issues/79
I will need to implement that sooner or later. Would that be useful to you?

I think the dynamic system data stuff would probably be useful, it'd let components defined outside the core library to be registered into the scripting system(s) without the slightly hacky AnyMap solution I've been toying with.
I'm attempting to use some components just for behavior, the general idea being that they communicate with systems through a messaging system to actually request state changes. Because there's no mutable access to the world in these behavior components, the idea seems to be working okay so far in my little toy demos.
Here's a short gif of a rough AnyMap-based solution here: https://twitter.com/callymcallym/status/979681749855801345
The Gluon script in the example is below. The scripts are compiled into a function which is given a copy of the data map for the entity (which should probably be an Option) and the map structure (which could probably also be stored in the data map).
In this example there's a data_reference in the map which contains an entity ID and that entity's map (if it has one) - from this entity ID, you can look the position of it up in the map.
I'm sure there are way better ways to actually code this in gluon, I'm struggling quite a lot with the functional elements of it, but as a proof of concept, it works. The main UI system doesn't need to know about positions, or other elements, or in theory the map.
let (data, map) = data

let { (|>) } = import! std.function
let data_reference = import! data_reference
let initial_position = import! initial_position
let { location } = import! map
let { vec3 } = import! cgmath
let { bordered_rectangle, rgba } = import! conrod

let position =
    match data_reference.get data with
    | Some ref ->
        match data_reference.entity ref with
            | Some entity ->
                match location map entity with
                    | Some location -> location
                    | None -> vec3.new 0.0 0.0 0.0
            | None -> vec3.new 0.0 0.0 0.0
    | None -> vec3.new 0.0 0.0 0.0

let color = rgba (vec3.x position / 10.0) (vec3.y position / 10.0) (vec3.z position / 10.0) 1.0

let rect =
    bordered_rectangle.new 0.5 0.5 \"rect\" |>
        bordered_rectangle.color color |>
        bordered_rectangle.x_y 0.5 0.5 |>
        bordered_rectangle.border 0.55 |>
        bordered_rectangle.border_color (rgba 0.0 0.0 0.0 1.0) |>
        bordered_rectangle.build in rect

Hey @callym, you might be interested in [https://github.com/slide-rs/shred/blob/master/examples/dyn_sys_data.rs](this new example). It might actually be too dynamic for your particular case, but I thought I'd let you know because it's kind of my proof of concept for scripting.

Closing this for now, I don't think it adds anything valuable.