Errors in installing as per the steps mentioned in README

Hello,
I actually have tried installing Eclipse Ditto and Hono using the cloud2edge package, but there are many issues, in just the installation part itself, using either minikube or MicroK8s.
Are there any changes to be made in the steps? Thanks

Hello,
I don't know what kind of issues you might have, but in my experience usually the package crashes when a persistent volume with enough capacity for the mongodb pod has not been deployed. Also mongodb needs a persistent volume claim pointing to that persistent volume. Check that both are related and available before deploying the package. It may also be that the persistent volume is not being associated correctly with the pod because the kubernetes tags don't match. Likewise, you can check the github for the cloud2edge package or try another version to see if it works.
On the other hand, if you are having problems installing the cloud2edge package you can try installing Eclipse Ditto and Eclipse Hono separately. It really works the same as using the package (this is really just to make it easier to install together and establish a sample connection). You can try the default configuration to see if it works (without setting values).
To install ditto:
helm upgrade --install --dependency-update -n digitaltwins dt-ditto eclipse-iot/ditto --version=3.1.4 --wait --debug
To install hono:
helm upgrade --install dt-hono eclipse-iot/hono -n digitaltwins --version=2.3.1
If you still have issues, please check the corresponding repository or provide more information.
Regards :)

Hello @juliarobles, thanks for your help. The cloud2edge package has gone through some updates, I have managed to install it now after following the recent updates to the package using the documentation of cloud2edge.
However, I am facing issues in deploying InfluxDB:
For InfluxDB, [Helm](https://github.com/influxdata/helm-charts/tree/master/charts/influxdb2) will again be used for deployment. The following [sc-influxdb2.yaml](https://github.com/ertis-research/OpenTwins/blob/main/files_for_manual_deploy/sc-influxdb2.yaml) and [pv-influxdb2.yaml](https://github.com/ertis-research/OpenTwins/blob/main/files_for_manual_deploy/pv-influxdb2.yaml) files will be required to be applied before installation. In addition, the recommended values are in the [values-influxdb2.yaml](https://github.com/ertis-research/OpenTwins/blob/main/files_for_manual_deploy/values-influxdb2.yaml) file (it is recommended that you check it before installing and change the password variable to your preference).

The files you have mentioned as in this case, are not available anymore. Could you please help me out with obtaining the missing files, there are more in the README of this repository. Thanks.

I have just added the missing files, sorry for the delay. If you have any more problems, don't hesitate to comment.

Hello, thank you so much for adding the missing files!
However, I am facing an issue in Connecting Eclipse Hono and Eclipse Ditto:
"The first thing to do is to check the IPs and ports to use with kubectl get services -n $NS. At this point we are interested in the dt-service-device-registry-ext and dt-ditto-nginx services, which correspond to Eclipse Hono and Eclipse Ditto respectively (if you have followed these instructions and services are NodePort, you will have to use port 3XXXX).
We will then create a Hono tenant called, for example, ditto (you must override the variable HONO_TENANT if you have chosen another name).
HONO_TENANT=ditto
curl -i -X POST http://$HONO_IP:$HONO_PORT/v1/tenants/$HONO_TENANT

"
I have been following these steps, and I will show you the output of each:
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ kubectl get services -n $NS
NAME                              TYPE           CLUSTER-IP       EXTERNAL-IP      PORT(S)                         AGE
c2e-adapter-amqp                  LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    5671:30744/TCP                  8d
c2e-adapter-http                  LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    8443:30754/TCP                  8d
c2e-adapter-mqtt                  LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    8883:32673/TCP                  8d
c2e-ditto-gateway                 ClusterIP      <IP_ADDRESS>      <none>           8080/TCP                        8d
c2e-ditto-nginx                   NodePort       <IP_ADDRESS>    <none>           8080:31176/TCP                  8d
c2e-ditto-swaggerui               ClusterIP      <IP_ADDRESS>     <none>           8080/TCP                        8d
c2e-kafka                         ClusterIP      <IP_ADDRESS>    <none>           9092/TCP,9094/TCP               8d
c2e-kafka-0-external              LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    9094:32094/TCP                  8d
c2e-kafka-headless                ClusterIP      None             <none>           9092/TCP,9093/TCP               8d
c2e-service-auth                  ClusterIP      <IP_ADDRESS>    <none>           5671/TCP,8088/TCP               8d
c2e-service-command-router        ClusterIP      <IP_ADDRESS>     <none>           5671/TCP                        8d
c2e-service-device-registry       ClusterIP      <IP_ADDRESS>    <none>           5671/TCP,8080/TCP,8443/TCP      8d
c2e-service-device-registry-ext   LoadBalancer   <IP_ADDRESS>   <IP_ADDRESS>   28443:30353/TCP                 8d
c2e-zookeeper                     ClusterIP      <IP_ADDRESS>     <none>           2181/TCP,2888/TCP,3888/TCP      8d
c2e-zookeeper-headless            ClusterIP      None             <none>           2181/TCP,2888/TCP,3888/TCP      8d
ditto-mongodb                     ClusterIP      <IP_ADDRESS>   <none>           27017/TCP                       8d
grafana                           NodePort       <IP_ADDRESS>    <none>           80:32023/TCP                    68m
influxdb-influxdb2                NodePort       <IP_ADDRESS>     <none>           80:30237/TCP                    70m
kafka-cluster                     LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    9094:30635/TCP,9092:31267/TCP   5d23h
kafka-manager                     NodePort       <IP_ADDRESS>   <none>           9000:31077/TCP                  5d23h
zookeeper                         ClusterIP      <IP_ADDRESS>     <none>           2181/TCP                        5d23h

So according to this my HONO_IP should be <IP_ADDRESS> (correct me if I am wrong), and HONO_PORT should be 28443, right? But this doesn't exactly match to what's written in your documentation, that  "(if you have followed these instructions and services are NodePort, you will have to use port 3XXXX)", which means it should start with 3, which isn't happening in my case, I have followed the NodePort installation.
Unfortunately, when I run the commands, this is my output:
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ HONO_TENANT=ditto
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ HONO_IP=<IP_ADDRESS>
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ HONO_PORT=28443
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ curl -i -X POST http://$HONO_IP:$HONO_PORT/v1/tenants/$HONO_TENANT
curl: (7) Failed to connect to <IP_ADDRESS> port 28443: No route to host

I am actually new to all of this, so is there some place where I am making a mistake? Thanks a lot for your help.

Hello, thank you so much for adding the missing files!
However, I am facing an issue in Connecting Eclipse Hono and Eclipse Ditto:
"The first thing to do is to check the IPs and ports to use with kubectl get services -n $NS. At this point we are interested in the dt-service-device-registry-ext and dt-ditto-nginx services, which correspond to Eclipse Hono and Eclipse Ditto respectively (if you have followed these instructions and services are NodePort, you will have to use port 3XXXX).
We will then create a Hono tenant called, for example, ditto (you must override the variable HONO_TENANT if you have chosen another name).
HONO_TENANT=ditto
curl -i -X POST http://$HONO_IP:$HONO_PORT/v1/tenants/$HONO_TENANT

" I have been following these steps, and I will show you the output of each:
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ kubectl get services -n $NS
NAME                              TYPE           CLUSTER-IP       EXTERNAL-IP      PORT(S)                         AGE
c2e-adapter-amqp                  LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    5671:30744/TCP                  8d
c2e-adapter-http                  LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    8443:30754/TCP                  8d
c2e-adapter-mqtt                  LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    8883:32673/TCP                  8d
c2e-ditto-gateway                 ClusterIP      <IP_ADDRESS>      <none>           8080/TCP                        8d
c2e-ditto-nginx                   NodePort       <IP_ADDRESS>    <none>           8080:31176/TCP                  8d
c2e-ditto-swaggerui               ClusterIP      <IP_ADDRESS>     <none>           8080/TCP                        8d
c2e-kafka                         ClusterIP      <IP_ADDRESS>    <none>           9092/TCP,9094/TCP               8d
c2e-kafka-0-external              LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    9094:32094/TCP                  8d
c2e-kafka-headless                ClusterIP      None             <none>           9092/TCP,9093/TCP               8d
c2e-service-auth                  ClusterIP      <IP_ADDRESS>    <none>           5671/TCP,8088/TCP               8d
c2e-service-command-router        ClusterIP      <IP_ADDRESS>     <none>           5671/TCP                        8d
c2e-service-device-registry       ClusterIP      <IP_ADDRESS>    <none>           5671/TCP,8080/TCP,8443/TCP      8d
c2e-service-device-registry-ext   LoadBalancer   <IP_ADDRESS>   <IP_ADDRESS>   28443:30353/TCP                 8d
c2e-zookeeper                     ClusterIP      <IP_ADDRESS>     <none>           2181/TCP,2888/TCP,3888/TCP      8d
c2e-zookeeper-headless            ClusterIP      None             <none>           2181/TCP,2888/TCP,3888/TCP      8d
ditto-mongodb                     ClusterIP      <IP_ADDRESS>   <none>           27017/TCP                       8d
grafana                           NodePort       <IP_ADDRESS>    <none>           80:32023/TCP                    68m
influxdb-influxdb2                NodePort       <IP_ADDRESS>     <none>           80:30237/TCP                    70m
kafka-cluster                     LoadBalancer   <IP_ADDRESS>    <IP_ADDRESS>    9094:30635/TCP,9092:31267/TCP   5d23h
kafka-manager                     NodePort       <IP_ADDRESS>   <none>           9000:31077/TCP                  5d23h
zookeeper                         ClusterIP      <IP_ADDRESS>     <none>           2181/TCP                        5d23h

So according to this my HONO_IP should be <IP_ADDRESS> (correct me if I am wrong), and HONO_PORT should be 28443, right? But this doesn't exactly match to what's written in your documentation, that "(if you have followed these instructions and services are NodePort, you will have to use port 3XXXX)", which means it should start with 3, which isn't happening in my case, I have followed the NodePort installation.
Unfortunately, when I run the commands, this is my output:
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ HONO_TENANT=ditto
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ HONO_IP=<IP_ADDRESS>
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ HONO_PORT=28443
agnibha@leo:~/OpenTwins/files_for_manual_deploy$ curl -i -X POST http://$HONO_IP:$HONO_PORT/v1/tenants/$HONO_TENANT
curl: (7) Failed to connect to <IP_ADDRESS> port 28443: No route to host

I am actually new to all of this, so is there some place where I am making a mistake? Thanks a lot for your help. (Just a short note, I am actually trying to build an Open Source DT system for a wind turbine application, for a research project)

Actually I hadn't run the minikube tunnel command before, it has worked for me now! Thanks anyway!

Hello!
I am actually facing an error in CMAK, not sure exactly as to how to fix it:
Yikes! Ask timed out on [ActorSelection[Anchor(akka://kafka-manager-system/), Path(/user/kafka-manager)]] after [5000 ms]. Message of type [kafka.manager.model.ActorModel$KMAddCluster]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. Try again.
Is there a fix for this?

Deploying RabbitMQ
For its deployment we will use Helm as in most technologies and, therefore, the sc-rabbitmq.yaml, pv-rabbitmq.yaml, pvc-rabbitmq.yaml and values-rabbitmq.yaml files will be needed.
@juliarobles , these files are missing too, for RabbitMQ deployment, could you please add them as well? Thanks a lot

I just added the files to deploy RabbitMQ. Sorry for taking so long, I've been very busy the last few weeks.
On the other hand, the installation of CMAK is not really necessary for the use of the platform. In fact, our idea is to replace that tool with a newer one. Any Kafka manager can do the same for you. We are using this manager for another project and it is quite good.
If you need anything, let us know, I will try to answer you as soon as possible.
Regards :)

Hi! Thanks for your reply. I will check out the new Kafka manager, thank you for suggesting it.
I think there is one more missing file from this section:
"You also need to store in variables the IPs and ports of both Kafka and InfluxDB, as well as the name of the Kafka topic. These variables will be INFLUX_IP, INFLUX_PORT, KAFKA_IP, KAFKA_PORT and KAFKA_TOPIC. Once all variables are ready, Telegraf can be displayed with the values defined in the values-telegraf.yaml file."
The values-telegraf.yaml file

Hi, sorry for not answering sooner, we have had a problem with that file and we have had to change several things. I have already added it and updated the README with a new command to use it. Also, I have modified the command that connects Eclipse Ditto with Kafka to send the events happened in the twins.
Regards

Hello! I am actually facing an error in CMAK, not sure exactly as to how to fix it (I have installed zookeper as well, but is there something to be done in its installation which should be taken care of? Thanks in advance):
Yikes! Ask timed out on [ActorSelection[Anchor(akka://kafka-manager-system/), Path(/user/kafka-manager)]] after [5000 ms]. Message of type [kafka.manager.model.ActorModel$KMAddCluster]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. Try again.
Is there a fix for this?

Hi @casafurix, were you able to resolve this issue?
Even I am facing the same issue. I have tried and checked with different IP address values for "cluster zookeeper host" in the CMAK UI, when adding a new cluster.
I also tried re-mapping in the '/etc/hosts' file, the 'zookeper-1' and 'zookeeper-2' hostname urls with endpoints of the 'zookeeper' pod using 'kubectl get endpoints zookeeper -n $NS'. In my case, it was '<IP_ADDRESS>'.
This caused the kafka-manager logs to finally show that a socket connection had been established at that url.
However, am still receiving the same error as you in CMAK when creating the new cluster. Is there some configuration that I might be missing?
I would be grateful for any ideas or pointers on what might have worked for you.
@juliarobles could you also provide any viewpoint on this issue?
I am currently trying to reproduce this amazing project separately in both windows (10 Home) and linux (ubuntu 22.04) and using minikube for my local laptop kubernetes cluster (with cpus=max and memory=15gb settings) and have started 'minikube tunnel'.
I also tried the new kafka-ui project as suggested by you in one of the previous posts, but faced similar issues when creating the cluster. It seems that the address of the zookeeper hosts is not able to be resolved.
I can share more logs and info if required.
Thanks in advance.

Hello! I am actually facing an error in CMAK, not sure exactly as to how to fix it (I have installed zookeper as well, but is there something to be done in its installation which should be taken care of? Thanks in advance):
Yikes! Ask timed out on [ActorSelection[Anchor(akka://kafka-manager-system/), Path(/user/kafka-manager)]] after [5000 ms]. Message of type [kafka.manager.model.ActorModel$KMAddCluster]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. Try again.
Is there a fix for this?

Hi @casafurix, were you able to resolve this issue? Even I am facing the same issue. I have tried and checked with different IP address values for "cluster zookeeper host" in the CMAK UI, when adding a new cluster. I also tried re-mapping in the '/etc/hosts' file, the 'zookeper-1' and 'zookeeper-2' hostname urls with endpoints of the 'zookeeper' pod using 'kubectl get endpoints zookeeper -n $NS'. In my case, it was '<IP_ADDRESS>'. This caused the kafka-manager logs to finally show that a socket connection had been established at that url.
However, am still receiving the same error as you in CMAK when creating the new cluster. Is there some configuration that I might be missing?
I would be grateful for any ideas or pointers on what might have worked for you.
@juliarobles could you also provide any viewpoint on this issue? I am currently trying to reproduce this amazing project separately in both windows (10 Home) and linux (ubuntu 22.04) and using minikube for my local laptop kubernetes cluster (with cpus=max and memory=15gb settings) and have started 'minikube tunnel'. I also tried the new kafka-ui project as suggested by you in one of the previous posts, but faced similar issues when creating the cluster. It seems that the address of the zookeeper hosts is not able to be resolved. I can share more logs and info if required.
Thanks in advance.

The issue mentioned above was solved using "Kafka-UI" project as mentioned in the above suggestions.
Created a new deployment for kafka-ui, connected to the configured kafka cluster, and by default, it would create a new cluster as defined in the deployment yaml (referenced below) spec in 'KAFKA_CLUSTERS_0_NAME'.
apiVersion: apps/v1
kind: Deployment
metadata:
  name: kafka-ui-deployment
  labels:
    app: kafka-ui
  # namespace: mstore
spec:
  replicas: 1
  selector:
    matchLabels:
      app: kafka-ui
  template:
    metadata:
      labels:
        app: kafka-ui
    spec:
      containers:
      - name: kafka-ui
        image: provectuslabs/kafka-ui:latest
        env:
        - name: KAFKA_CLUSTERS_0_NAME
          value: "digital_twin_local_cluster"
        - name: KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS
          value: kafka-cluster:9092
        - name: KAFKA_CLUSTERS_0_ZOOKEEPER
          value: zookeeper:2181
        imagePullPolicy: Always
        resources:
          requests:
            memory: "256Mi"
            cpu: "100m"
          limits:
            memory: "1024Mi"
            cpu: "1000m"
        ports:
        - containerPort: 8080
---
apiVersion: v1
kind: Service
metadata:
  name: kafka-ui-service
spec:
  selector:
    app: kafka-ui
  type: NodePort
  ports:
    - protocol: TCP
      port: 8080
      targetPort: 8080
      nodePort: 31006

then apply the file during the kafka deployment setup stage, as mentioned in the README.
kubectl apply -f deploy-svc-kafka-ui.yaml -n $NS

This gives an url on which the kafka-ui can be accessed in a web browser at the link:
'http://:.
Will look something like "http://192.168.XX.XX:3XXXX"
The topic can then consequently be defined using the kafka-ui web dashboard.

Hi @yasharth97, I'm glad you were able to fix it and thank you very much for sharing the solution. Right now we are working on improving the platform installation and then CMAK will be replaced by the Kafka-UI project. Hopefully we will be able to update the README of the platform soon.
Regards :)


Menu accessibility keyboard access using tab and screen reader

@leejsinclair I would like to merge this into my https://github.com/lu4p/specter fork I actively maintain.
Can you elaborate what this exactly does?

It was an effort to keep the sub menu items open when using the keyboard to
navigate.
I came across this issue when doing accessibility testing with a
screenreader. I was unable to have sub menu items read aloud.
Cheers,
Lee
On Thu, 2 Jul 2020, 4:19 am lu4p<EMAIL_ADDRESS>wrote:

@leejsinclair https://github.com/leejsinclair I would like to merge
this into my https://github.com/lu4p/specter fork I actively maintain.
Can you elaborate what this exactly does?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/picturepan2/spectre/pull/590#issuecomment-652574469,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAFMYWZ4OJOCAB46QNPNVRDRZN42DANCNFSM4HK4SREQ
.


move search bar to top of page

The approach is straightforward: put the search controls at the top of the results list, similarly to the illustrations in the mockups of issue #365. If the user scrolls, the search bar assumes a floating position at the top of the screen and the list of items scrolls underneath it (as also suggested in the mockups).
Representative screenshots non-scrolled and scrolled:

Notes on the CSS changes:

the searchSection and searchPadding classes are sort of complementary (only one is display: block at a time)
they both have an associated class "float" that toggles on and off depending on scroll position
a media query was needed to fill in missing container padding on xs screens (not sure why it was missing). I would have preferred an @include directive not to hard-code the bootstrap xs width in the @media query, but that is only possible in scss files, not modules, and I didn't think it would be good to risk global scss changes just for this unique case.
the form left/right were set to 0 because the containers already provide the correct (responsive) shape.
the form flex-flow was set to nowrap to fix unsightly overlaps of the search inputs with other parts of the page on very narrow window sizes.

I'd like the selects to be moved below the dropdown. Do you want to take a stab at that or should I?

Yes below the search box please!

Besides moving the inputs, I also moved the my-3 class from one div to the other to keep the spacing equivalent.

Looks great!

This branch also got messed up somehow. Maybe a rebase will help?

I have rebased thee

Sorry about the merge mess... I think I've got the hang of it now after fixing the other one.


[Android] SQLite access failing from C# library

Accessing sqlite from the library is causing a linker failure, seen below:

31545-31980/com.s.t.android E/linker: library "/system/lib64/libsqlite.so" ("/system/lib64/libsqlite.so") needed or dlopened by "/data/app/com.s.t.android-2/lib/arm64/libmonosgen-2.0.so" is not accessible for the namespace: [name="classloader-namespace", ld_library_paths="", default_library_paths="/data/app/com.s.t.android-2/lib/arm64:/data/app/com.s.t.android-2/base.apk!/lib/arm64-v8a", permitted_paths="/data:/mnt/expand:/data/data/com.s.t.android"]
31545-31980/com.s.t.android I/mono-stdout: System.DllNotFoundException: /system/lib64/libsqlite.so
31545-31980/com.s.t.android I/mono-stdout:     at (wrapper managed-to-native) HIA2.C.DataAccess.SQLite.SQLite3Wrapper:Open (byte[],intptr&,int,intptr)

Hi @Zomb ,
What C# class/library are you using here? Is is from Mono.Data.Sqlite or something on NuGet?

The library appears to be using a standard sqlite3.dll to access the database. I can try different options if needed though!

Oh could you just paste a C# snippet, is it using [DllImport] directly?
I have generally used this one by Frank Krueger, but I have not tested it with Embeddinator.

This is the import:
[DllImport("sqlite3", EntryPoint = "sqlite3_open_v2", CallingConvention = CallingConvention.Cdecl)]
public static extern Result Open(byte[] filename, out IntPtr db, int flags, IntPtr zvfs);

Ok, do you know if this works in a normal Xamarin.Android app?
Android N made it where you can't use sqlite3 directly from a DllImport anymore. Frank's sqlite-net sits on top of SQLitePCL.raw by Eric Sink, and he talks about how he had to work around Android N here.
It sounds like you are working with existing code, so it might be tough to port to a different SQLite library.

I do believe this works in a normal Xamarin.Android app, but I will cross check, I might have just not tested on an N phone using this library. There is this post on the Xamarin forums with the same error I have, will try some of the options out and see if I can work around the issue!

The library appears to work in a standard Xamarin.Android app, I will see if I can figure out why!

Is it possible we're failing to bundle the needed native libraries in the AAR?
Can you please check and list the contents of the generated AAR?

These are the bundled .so files in arm64-v8a:

libHIALibAndroid.so
libjnidispatch.so
libmonodroid.so
libmonosgen-2.0.so

I am trying to create a sample project with a simple database dll that I can use both in a standard Xamarin.Android project and a e4k one. I will share my results once I have that working!

I did not have much luck with the dllImport on Android N, so, I started experimenting with sqlite-net-pcl. This resulted in to the following exception:

System.TypeInitializationException: The type initializer for 'SQLite.SQLiteConnection' threw an exception. ---> System.DllNotFoundException: e_sqlite3
at (wrapper managed-to-native) SQLitePCL.SQLite3Provider_e_sqlite3+NativeMethods:sqlite3_libversion_number ()
at SQLitePCL.SQLite3Provider_e_sqlite3.SQLitePCL.ISQLite3Provider.sqlite3_libversion_number () [0x00000] in <333eb4a8d93048dda7cf513b2db01259>:0
at SQLitePCL.raw.SetProvider (SQLitePCL.ISQLite3Provider imp) [0x00008] in <57ac49ef645c4295bc1eec6d6048bdf5>:0
at SQLitePCL.Batteries_V2.Init () [0x00005] in <7ea61fe397ba4b9890da8f07af0f83af>:0
at SQLite.SQLiteConnection..cctor () [0x00000] in <9b4aaa86123841b8bec74a2ddde70f09>:0

I am not sure why e_sqlite3 is not being found.

If its of any help, the SQL libraries included in the aar are:

SQLite-net.dll
SQLitePCLRaw.batteries_v2.dll
SQLitePCLRaw.core.dll
SQLitePCLRaw.provider.e_sqlite3.dll

I think there is a build action used here named AndroidNativeLibrary, I bet I need to do something to get it to work in Embeddinator.
Thanks @Zomb for letting us know.

Yeah, we are not extracting and including these native libraries at all yet:

I've not seen this __AndroidNativeLibraries__ zip file before looking at one of these. The other zip we are extracting, because it contains assets, resources, jar files, etc. Hopefully it is easy to add this second one.
One thing you could do manually (for now) is add the so files you need to the Android Studio project. These go in src/main/java/jniLibs/[abiname].

I can try. Can you tell me where I can find the right so files to include?

If you do this:
monodis --mresources path/to/SQLitePCLRaw.lib.e_sqlite3.dll

It will dump __AndroidNativeLibraries__.zip into your current directory. Then you can unzip to get the native libraries.
I've been looking at this and unfortunately Xamarin.Android seems like it moves native libraries directly from here into the final APK. That means there isn't an existing thing I can use to put them in our AAR file. For the other zip file, there was an MSBuild task I could use that extracted them.

I have been able to confirm that this works. For the reference of anyone who stumbles on this thread, these are the steps I used:

run monodis --mresources as mentioned above
create folder jnilibs under src/main
copy all the architecture folders generated (arm* for example) into jnilibs folder

@Zomb try it out and let us know, I added test cases specifically checking SQLitePCL.raw works.

@jonathanpeppers When I generate the aar, should I see sqlite3.so files in jni/arm* inside the aar? Or is it packaged elsewhere?

@jonathanpeppers Nevermind, it looks like the linker was stripping it out. I looked at your test and added the Init calls into my code, and the so files got added in. It appears that the dependencies from other library dlls are not enough to keep the linker from stripping the so files out.

Yeah in our test project it has:
adding: jni/arm64-v8a/libe_sqlite3.so(in = 1212320) (out= 579604)(deflated 52%)
adding: jni/armeabi/libe_sqlite3.so(in = 983712) (out= 609207)(deflated 38%)
adding: jni/armeabi-v7a/libe_sqlite3.so(in = 905896) (out= 566523)(deflated 37%)
adding: jni/x86/libe_sqlite3.so(in = 1335860) (out= 630440)(deflated 52%)
adding: jni/x86_64/libe_sqlite3.so(in = 1294544) (out= 641900)(deflated 50%)

The only issue I found was due to the linker, I had to add these:
//All these Init() ensure the linker doesn't strip assemblies we need
SQLitePCL.Batteries_V2.Init();
SQLitePCL.lib.embedded.Init();

Full file is here: https://github.com/mono/Embeddinator-4000/blob/master/tests/managed/android/android.cs#L281
I think Eric made these methods in SQLitePCL.raw for this reason.

I'm having the same problem described in the first post.
Extracting the native libraries manually from AndroidNativeLibraries.zip doesn't work for me because I am not using the .aar in Android Studio.
I think that adding these two lines for making the assemblies be inside the .aar would work for me, but I don't know where do I have to put them. I cloned the repository and opened the solution, and, as far as I know, I should make the modifications and build to get the .exe, but I don't see where that lines should go.


[Bug]: x-ms-mutability issue to support CreateOrUpdate scenario in PUT operation

Describe the bug
The swagger genereated from TypeSpec set RP properties mutability by ["read", "create"] which block the update command generation of Azure CLI and PowerShell. Azure CLI and PowerShell use Put operation to update the resources.
Reproduction
This issue is reported in this teams channel
Checklist

[X] Follow our Code of Conduct
[X] Check that this issue is about the Azure libraries for typespec. For bug in the typespec language or core libraries file it in the TypeSpec repo
[X] Check that there isn't already an issue that request the same bug to avoid creating a duplicate.
[X] The provided reproduction is a minimal reproducible example of the bug.

resolved dup of #589


ADE Dashboard documentation needs more optimization tips

I am concerned about cluster load caused by the Azure Data Explorer dashboards. While there were a couple of tips on reducing load in this document, I don't have a good sense of how often these queries are run, if the result of the queries are cached somewhere or are run again each time they are viewed by each user, etc...
I am looking for more information on how refresh works so that I can be sure to optimize my design to reduce cluster load.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a4be1640-3699-8fdf-07a2-c9b922499c90
Version Independent ID: 55027537-6af4-541d-da8d-e2cdc2b5fa92
Content: Visualize data with the Azure Data Explorer dashboard
Content Source: data-explorer/azure-data-explorer-dashboards.md
Service: data-explorer
GitHub Login: @orspod
Microsoft Alias: orspodek

@daviw-git Thanks for bringing this to our attention. Your feedback has been shared with the content owner for further review.

Hi @daviw-git,
In general, all of the performance optimization rules are applicable to ADX dashboards.
Specifically, we do plan to add performance optimizations during 2021for ADX dashboards.
For now, the main recommendation is not to overload the cluster with dashboard queries using the auto refresh capability of dashboards. That's the purpose of allowing the dashboard owner to control the minimal time interval for refreshing the dashboard.
https://docs.microsoft.com/en-us/azure/data-explorer/azure-data-explorer-dashboards#enable-auto-refresh

Thanks @Gabilehner for your detailed response.
@daviw-git We will now proceed to close this issue. Feel free to reach out with any additional questions.

#please-close


Soloseq inference - can't fold using ESM-1b alone

In the README it states that template finding for SoloSeq will be skipped if no tools or dbs are passed, and the fold will happen using ESM alone. However I get multiple errors when running the following command:
python openfold/run_pretrained_openfold.py \
    meth_fastas \
    openfold/data/pdb_mmcif/mmcif_files \
    --output_dir results \
    --model_device "cuda:0" \
    --config_preset "seq_model_esm1b_ptm" \
    --openfold_checkpoint_path openfold/openfold/resources/openfold_soloseq_params/seq_model_esm1b_ptm.pt

If the mmcif_files are not downloaded it fails if they aren't downloaded, I had to download them to get past this.
Removing all args related to tools and db like above, I still get a HHSearch error:

INFO:/root/openfold/openfold/openfold/utils/script_utils.py:Loaded OpenFold parameters at openfold/openfold/resources/openfold_soloseq_params/seq_model_esm1b_ptm.pt...
INFO:/root/openfold/openfold/run_pretrained_openfold.py:Generating alignments for MGYG000000044_01310...
Traceback (most recent call last):
  File "/root/openfold/openfold/run_pretrained_openfold.py", line 470, in <module>
    main(args)
  File "/root/openfold/openfold/run_pretrained_openfold.py", line 275, in main
    precompute_alignments(tags, seqs, alignment_dir, args)
  File "/root/openfold/openfold/run_pretrained_openfold.py", line 80, in precompute_alignments
    template_searcher = hhsearch.HHSearch(
  File "/root/openfold/openfold/openfold/data/tools/hhsearch.py", line 58, in __init__
    if not glob.glob(database_path + "_*"):
TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'

It still seems to be attempting to generate alignments. Is this an error? Do I need to specify another flag to skip every tool + alignment and just use ESM based folding?
Thank you.

Hi @amardeepranu , thanks for your interest in Soloseq.
Could you try generating the embeddings first using:
python scripts/precompute_embeddings.py fasta_dir/ embeddings_output_dir/
And then using the same run_pretrained_openfold.py command, but with --use_precomputed_alignments=embeddings_output_dir

There are a separate set of weights used for soloseq, which were defined in your earlier command by this argument:     --openfold_checkpoint_path openfold/openfold/resources/openfold_soloseq_params/seq_model_esm1b_ptm.pt
Judging by the bash: line 6: --output_dir: command not found message, perhaps there's a whitespace/ newline character issue in the command?

You will need to provide a directory for the --template_mmcif_dir. Despite the required flag, templates are not necessary for folding predictions.
If your precomputed alignments directory does not contain any alignments for templates (e.g. it only contains the pre-computed ESM embeddings), then template structures will not be used for creating the prediction.
In the future, we may refactor the inference script so that the soloseq mode does not require a template_mmcif_dir if the template-based prediction path is not used to help avoid this confusion.

Note that the directory cannot be empty so if you want to use no templates at all, at the moment you still need to at least fake one with something like touch empty.cif.


Bug Report: extension-webm not found

id tryed installing this but this dosent installed
C:\Users\User>haxelib git extension-webm https://github.com/KadeDev/extension-webm
You already have extension-webm version git installed.
Updating extension-webm version git ...
fatal: empty string is not a valid pathspec. please use . instead if you meant to match all paths

this isnt even a bug this is something on your end


Set zero power for PV inverters not neccessary to reach target power

If desired power is already reached without the need to use some inverters, their powers need to be set to zero.
If not, their original powers would remain and the target powers would be wrong.
In case the requested power is zero, this was also leading to crashes because there were no allocations.  This change also fixes that issue.
Closes #933

Based on #944.

Oh, I guess we shouldn't have merged #916 and merge this one instead to release a rc602, as this is probably a fix we'll need to ship soon. Maybe we should branch for a rc602, what do you think?

Maybe we should branch for a rc602, what do you think?

Maybe, but rc700 doesn't seem so bad either, and only the PVPool users need to update immediately.


ci: reuse nx commands

PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows Conventional Commits
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[ ] Bugfix
[ ] Feature
[ ] Refactoring
[ ] Code style update
[x] Build or CI related changes
[ ] Documentation content changes

What is the new behavior?
$ nx serve demo

$ nx serve:ip demo # serve by your IP

$ nx serve:ssl demo

Does this PR introduce a breaking change?

[ ] Yes
[x] No

@vladimirpotekhin hello, please review me)


8.x release missing for drupal/slack.

The Drupal packagist only lists 7.x versions of slack module - https://packagist.drupal-composer.org/packages/drupal/slack. However, there is an 8.x release as we can see here - https://www.drupal.org/project/slack.
I am not sure if the composer.json in the module causes a problem but it appears valid.
I tried to find a generic issue for this but the closest I could find was #53. Should this be manually refreshed?
Sidenote: The package drupal/slack does not even come up in search. I have to manually type it in the URL to go to the page.

The composer.json of the slack module is invalid. Verify via
git clone --branch 8.x-1.x https://git.drupal.org/project/slack.git
cd slack
composer validate

 [Seld\JsonLint\ParsingException]
  "./composer.json" does not contain valid JSON
  Parse error on line 12:
  ...ode.org/slack"  },}
  --------------------^
  Expected: 'STRING' - It appears you have an extra trailing comma

Oh, I wish it worked on an invalid composer.json file. I am now stuck until my patch goes through, unless I add a special repository for this. Will that work?

Yes, you can add your own fork to your composer.json and require it.


library/pci_doe_responder_lib: Use libspdm DOE encode/decode helpers

Instead of encoding and decoding DOE discovery packets manually inside spdm-emu let's instead use the generic helper functions in libspdm. This way we can test functions that others can also utilise to when using libspdm.

This depends on https://github.com/DMTF/libspdm/pull/2012 being merged and then the version of libspdm to be updated to include the change from https://github.com/DMTF/libspdm/pull/2012. It won't build until then

This depends on https://github.com/DMTF/libspdm/pull/2012 being merged and then the version of libspdm to be updated to include the change from https://github.com/DMTF/libspdm/pull/2012. It won't build until then

That is fine. Question: if you think this patch is ready for review?

This is ready to go, it just needs https://github.com/DMTF/libspdm/pull/2012 merged first. Hence the draft status as it would break the build if merged without https://github.com/DMTF/libspdm/pull/2012

This is ready to go, it just needs https://github.com/DMTF/libspdm/pull/2012 merged first.

OK. if so, please change to ready for review. I will sync libspdm, then merge this.
Draft means you are still working on it, IMHO.

Hence the draft status as it would break the build if merged without https://github.com/DMTF/libspdm/pull/2012

I will not merge anything if CI fails.


In order fro PayPal to work it may be necessary to update your android manifest

Something changed in the way the class manage the activity result you should try to update the manifest in this way
See this issue on the original sdk
https://github.com/braintree/braintree-android-drop-in/issues/419
That link to this page
https://developer.paypal.com/braintree/docs/guides/drop-in/setup-and-integration/android/v4/#paypal
This are the modification necessary for the DropInActivity in the manifest
        <activity android:name="com.braintreepayments.api.DropInActivity"             android:exported="true"             tools:node="merge"             >             <intent-filter tools:node="removeAll" />             <intent-filter>                 <action android:name="android.intent.action.VIEW" />                 <data android:scheme="@string/braintree" />                 <category android:name="android.intent.category.DEFAULT" />                 <category android:name="android.intent.category.BROWSABLE" />             </intent-filter>         </activity>
I'll try to provide a PR to update the example and documentation as soon as I can, if you can do before even better

Hello,
I have used BraintreeBrowserSwitchActivity version 3.0.0.Now I have changed version 4.0.0 ,so BraintreeBrowserSwitchActivity doesn't work at all.App is crashing
Now I have changed manifest file and used com.braintreepayments.api.DropInActivity but Vault flow is not working with this.I can't pass amount 'null' or  '0'.It simply doesn't accept it and app crash

Any problem to this issue? having similar issue

com.braintreepayments.api.DropInActivity
With this I see another issue, if you're on Android 14 and 14+ if a user cancels the PayPal payment it throws exception and doesn't come back to the app.
Exception java.lang.RuntimeException:   at android.app.ActivityThread.performLaunchActivity (ActivityThread.java:4164)   at android.app.ActivityThread.handleLaunchActivity (ActivityThread.java:4322)   at android.app.servertransaction.LaunchActivityItem.execute (LaunchActivityItem.java:103)   at android.app.servertransaction.TransactionExecutor.executeCallbacks (TransactionExecutor.java:139)   at android.app.servertransaction.TransactionExecutor.execute (TransactionExecutor.java:96)   at android.app.ActivityThread$H.handleMessage (ActivityThread.java:2685)   at android.os.Handler.dispatchMessage (Handler.java:106)   at android.os.Looper.loopOnce (Looper.java:230)   at android.os.Looper.loop (Looper.java:319)   at android.app.ActivityThread.main (ActivityThread.java:8919)   at java.lang.reflect.Method.invoke   at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run (RuntimeInit.java:578)   at com.android.internal.os.ZygoteInit.main (ZygoteInit.java:1103) Caused by java.lang.NullPointerException: Attempt to invoke virtual method 'void android.os.Bundle.setClassLoader(java.lang.ClassLoader)' on a null object reference   at com.braintreepayments.api.DropInActivity.getDropInRequest (DropInActivity.java)   at com.braintreepayments.api.DropInActivity.onCreate (DropInActivity.java)   at android.app.Activity.performCreate (Activity.java:8975)   at android.app.Activity.performCreate (Activity.java:8944)   at android.app.Instrumentation.callActivityOnCreate (Instrumentation.java:1456)   at android.app.ActivityThread.performLaunchActivity (ActivityThread.java:4146)


replace deprecated k8s-workload-registrar

Signed-off-by: Batuhan Apaydın<EMAIL_ADDRESS>Fixes #68

[x] Add CRDs for spire-controller-manager
[x] RBAC resources
[x] webhook & service resources
[x] Editing spire-server to add spire-controller-manager

/cc @marcofranssen

everything seems fine to me, PTAL @marcofranssen

Gave some inline feedback, but also have a general request which I also didn't clearly put in the issue.
Can we do the following
k8sregistrar:
  enabled: false

spire-controller-manager:
  enabled: true

So we can first have a couple of releases where people can still fall back on the old stuff.
I also think we might want to have a dedicated file, service-account for the spire-controller-manager to have it as a separate deployment with its own rbac.
In general first rebase on main, so you have a few new Values like the socketPath to be reused

totally agree with you! I've updated the helm templates according to your feedback!


FLEDGE - server support and one adapter implementation (openx) #2411

BidderResponse has a new FledgeAuctionConfigs field (this is the contract with adapters)
pbsOrtbSeatBid has a new fledgeAuctionConfigs field (internal PBS bidder adapter)
exchange merges fledgeAuctionConfigs from all bidders into ext.fledge.auctionconfigs[]
request must contain imp[].ext.prebid.ae=1

TODO: validation on impid, validation that imp had ae: 1, bidderName

@laurb9 do you need to update master branch ?

@laurb9 do you need to update master branch ?

I will. I'll also close this, with the public https://github.com/prebid/prebid-server/pull/2445 opened.


ImportError: No module named 'bashplotlib'

Hi,
I'm using Python 3.4.2 and run into the following error when trying to import 'bashplotlib':
ImportError: No module named 'bashplotlib'

It happens when importing it in my project with the example of the README as follows:
from bashplotlib.histogram import plot_hist

I installed the package with the following command:
sudo pip3 install bashplotlib

And it's listed under the installed packaged.
Could you help me with this?

+1 for Python 2.7. Using Conda environment but installed with pip install bashplotiib.
$ hist --demo
Traceback (most recent call last):
  File "/Users/allan/homeInstalled/anaconda/envs/py27/bin/hist", line 7, in <module>
    from bashplotlib.histogram import main
ImportError: No module named bashplotlib.histogram

Likewise with Python 3.5.1 and Python 2.7.11 on OS X 10.10.5 and Ubuntu 12.04.5 LTS.

Installing from the github repo directly (rather than from pypi) seems to work
pip install git+https://github.com/glamp/bashplotlib.git@master

Worked fine for me with Python 3.6.3, pip3 9.0.1, MacOS 10.12.6 .

where does pip say its installed for you guys? Where does python say its installed? Do other projects work?
Need some more info, works fine for me.
Mac:
➜  bashplotlib git:(master) $ pip --version
pip 9.0.3 from /Users/kennethgoodman/.local/lib/python3.6/site-packages (python 3.6)
➜  bashplotlib git:(master) $ python --version
Python 3.6.3 :: Anaconda, Inc.


TNO-1742: Move the Generate Elasticsearch Query...

TNO-1742: Move the Generate Elasticsearch Query Code to tno-core

Update Editor and Subscriber to use tno-core:0.0.317. Run yarn install in both the Editor and Subscriber.

Updated, thanks


AS0099 acts out in Run-ALValidation

I also created a yammer-thread about this, but it seems a problem in the BcContainerHelper.
https://www.yammer.com/dynamicsnavdev/threads/1502614861414400
As you can see, info-message AS0099 is reported as an error:

Is it may be an idea - as we don't really want to see this "info" in the pipeline - to put AS0099 as "None" in the default ruleset?
https://bcartifacts.azureedge.net/rulesets/appsource.default.ruleset.json

Run-AlCops will now ignore all infos - unless you add a parameter called -doNotIgnoreInfos

2.0.23 has shipped


[Algo] Insertion Sort in C++

Algorithm

[x] I have gone through the repository and made sure this algorithm has not been implemented

Information about my new algorithm

Algorithm Name: Insertion Sort

Programming Language: C++

Time complexity: O(n*2)

Is this your first contribution to this repository?
Yes

can I take this issue


Stop current deployment

I may be stupid, but after some time looking on the docs and the CLI, I can't seem to find any way to stop (or pause) the current deployment. The closest command is cargo shuttle delete but I'm too afraid to do that because it looks like it will delete the whole service.
Is there a way to halt the currently running deployment?

Hi there!
Currently at the moment, the quickest way to stop the current deployment is by using cargo shuttle project rm which stops the container your deployment is on until you decide to deploy again.

It looked fine until uhhh...

Try using cargo shuttle project rm again - there are currently some kinks being worked out with deployments sometimes partially not shutting down correctly. Not entirely sure what the ETA is on the fix, but yeah

Well actually it's ok now since I actually just did create another project with a different name. Hmm... now I have a different problem...

Ill take a look and try to implement this as sono as I have time this week

Hey there, I just started looking into the issue, after a first look at the project there seem to be already a Stopped state on deployments
Seems like the idea would be to just add stop/restart commands and relative endpoints that change and persist that state (which I'm not sure of as I still have to look up what will the Stopped state imply)
I'll probably find something new, am I going in the right direction ? Can I ask someone in particular in case I'd need some help ?

Hey! Apologies for the late reply, we've been busy with a release. This issue is quite complicated and I haven't looked into it for a bit, but I can give you some leads. @chesedo may have more insight when he gets a moment.
So the jist of it is we do currently have a command for stopping the current deployment, and it works in every way except for actually stopping the service.  Even if we use the kill sender to drop the handle to the deployment, the deployments task lives on. You should be able to see this if you run locally with tokio-console.
For a code lead, IIRC this is the root of the issue: https://github.com/shuttle-hq/shuttle/blob/main/service/src/lib.rs#L472-L479
Sorry I can't give you more information atm, but I hope this helps!

The code @oddgrd links to is the reason deployments are not being stopped because that tokio::Runtime never gets dropped. If we were to remove the std::mem::forget() then the runtime will be dropped by Bootstrapper::into_handle().  So the solution will be to somehow keep the runtime around until the kill signal is send to the kill channel in DeploymentManager and to only then drop it.

Had a quick look at the related code. Here is a careless proposal:
Make ServerHandle a struct that holds the JoinHandle and the Runtime.
Let Binder take ownership of Runtime and give it to the ServerHandle.
The spawned task in Loader.load can then hold the runtime until after the bootstrapper's handle is done.
I have a very incomplete understanding of this so there are probably flaws with my approach, but perhaps it is in the right direction.
What do you think?

@jonaro00 It might, but I'd have to take a closer look to give a proper answer. Did you try it? It would be great to have this fixed now, but we are working on refactoring from loading projects as dynamic libraries to compiling projects to binaries and starting them. And at that point, this problem should be solved. But it could be a little while.

This should be resolved after 0.12, but please re-open this if you still experience it. Thanks!


Improve machine upgrade playbook

Current dependencies on/for this PR:

main

PR #2519   (this PR)

This comment was auto-generated by Graphite.


Attempt at upgrading to redshift 1.10.

This build works but running redshift-gtk fails with this message:
Traceback (most recent call last):
File "/nix/store/dxjacmxvyv3nnnkzmc5yjflww0xddhsw-redshift-1.10/bin/.redshift-gtk-wrapped", line 26, in
from redshift_gtk.statusicon import run
File "/nix/store/dxjacmxvyv3nnnkzmc5yjflww0xddhsw-redshift-1.10/lib/python3.4/site-packages/redshift_gtk/statusicon.py", line 30, in
import gettext
File "/nix/store/mrnx02fglz1cqsnqqf916i58pbvh1x2d-python3-3.4.2/lib/python3.4/gettext.py", line 49, in
import locale, copy, io, os, re, struct, sys
File "/nix/store/mrnx02fglz1cqsnqqf916i58pbvh1x2d-python3-3.4.2/lib/python3.4/locale.py", line 20, in
import functools
File "/nix/store/mrnx02fglz1cqsnqqf916i58pbvh1x2d-python3-3.4.2/lib/python3.4/functools.py", line 22, in
from types import MappingProxyType
File "/nix/store/dbmvgicplkk3grs8dc0s89ykyic1gi1b-pygobject-3.12.1/lib/python3.4/site-packages/gi/types.py", line 28, in
from ._constants import TYPE_INVALID
SystemError: Parent module '' not loaded, cannot perform relative import
If this problem can be fixed, this pull request would be useful.

Superseeded by #6997


Tier 4 tanks bug

When i play tier 4 tanks the game kick me out like i just die, it happen to every tier 4. Is there anyway to fix it?

Install latest rxd - patch


Update example

The example is out of date. It also looks like the typescript definition is out of date as well?

I see the readme was out of date in several places - I just pushed an update, thanks!
What's wrong with the typescript defs?

I will try replacing my current physics engine (rapier-js) with this when I get the chance to get you some more detailed feedback. I'll probably just make a PR fixing type definitions if I notice anything is wrong or incomplete (there are a lot of any types).
I would really appreciate some examples of the following in the readme:
const aabb = "???" // what is this? It looks like it's an object from your aabb library but it's not re-exported here so it's really awkward to set
const mass = 10 // is it just some number? are there units? are decimals allowed?
const friction = 0.5 // can it be greater than 1?
const restitution = 0.5 // can it be greater than 1?
const gravityMult = 1 // what does this even mean?
const onCollide = ()=>{
    console.log("collided!")
} // are there any inputs?

var body = phys.addBody( aabb, mass, friction, restitution, gravityMult, onCollide )

I haven't tested the Physics constructor so I don't have any issues with that right now, especially since you gave examples of inputs in the readme.
This library looks perfect for a project I'm building, and in comparison to the other libraries I've seen online it's significantly better (the api looks nicer, the performance looks acceptable, and it looks like it's being maintained(?)). My one complaint is that I tried rewriting my physics back in v0.0.3 to use this engine and it just wouldn't work for me, given the out of date docs and what I believe to be broken type defs.
If you could add some example values, or really docs of any kind on them, that would be amazing. Love the work! Cheers!

Hi! Yes, this was mostly written quite a while ago, and most properties/methods don't have type decorations. But the library is maintained and bug-free as far as I know, and should be fast. But be warned that it's performant because it's a toy engine - it assumes all rigid bodies are AABBs, and it only collides bodies with terrain, not with each other. But if those limitations work for you, this engine will probably be faster than most alternatives thanks to its simplicity.
Answers to questions:

aabb means an aabb-3d instance
physical properties are all standard definitions/units - friction and restitution are standard coefficients, etc. Units are unspecified, except that distances are in voxel widths
gravityMult is what it says, a multiplier for gravity for that body (to make objects more floaty, etc)
onCollide passes a vec3 of the collision impulse values along each axis - I added this to the readme

I can try to add type decorations someday, but for now hope this helps..


Flextype 0.9.0 - [epic]

Guys!
I am working on a new architecture approach, going closer to headless cms.
We already have ability to create any type of entries but in the new version of Flextype this will be more clear.
According to headless cms philosophy, we should have:

Core to work with entries (Flextype)
API to access entries (Flextype API - REST or GraphQL)
APP to render entries (for e.g. Site plugin)
APP to manage entires (for e.g. Admin plugin)

This will allow us to have clear API to work with a site content and API to ACCESS and MANAGE entries on any type of devices and any SPA builded with Vue, React and etc.. - a lot of benefits it will gives.
no time estimations for now, work in progress.
Thank you for your patience!
Milestone for this release: https://github.com/flextype/flextype/milestone/2

Как попасть в ЗБТ 8 числа?


Creating docstring for theme_toronto

Thanks! I think this is the template we should follow for the python functions.


[Date Picker] Masking is broken with MM/yyyy format and views prop

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Current behavior 😯
When using the inputFormat prop set to 'MM/yyyy', the masking is broken. Adding a custom rifm formatter doesn't seem to help.
https://user-images.githubusercontent.com/70706530/150567891-60b109ae-92ac-419a-9d94-6cd4e05c0554.mp4
Expected behavior 🤔
The masking shouldn't break when using a 'MM/yyyy' format.
Steps to reproduce 🕹
This was forked from the official template for the basic example of date picker usage:
https://codesandbox.io/s/basicdatepicker-material-demo-forked-2ey8d?file=/demo.tsx
Context 🔦
I'm trying to have my date formatted like 'MM/yyyy'. Examples are:

01/2022
12/1989

Your environment 🌎
Was reproduced on the mui template from code sandbox (see above).

If you add manually the mask prop:
mask="__/____"

supposedly it should apply the mask. But I found that the prop views is the one that seems to be breaking the masking. If you remove the views prop, the mask will work as expected.
I editted your sandbox with the changes I mentioned: https://codesandbox.io/s/basicdatepicker-material-demo-forked-m2n36?file=/demo.tsx:471-542
Obviously this is not a solution, but I just wanted to point out, that the problem could be related to the views prop.

I've made the same observation as @miguelCT.
I saw in another discussion that when the views prop is set to ['year', 'month'] without any format applied, it defaults to the year in digits and the month in text (month name according to locale). This means that applying a mask would be hard since the length of the months' name vary depending on month and language.
So my guess is that there's a rule somewhere that disables the mask when year is set to ['year', 'month']. And maybe the bug is that the mask is disabled even though the user has specified a format where you do know the exact length of the date (in my case yyyy-MM).

So my guess is that there's a rule somewhere that disables the mask when year is set to ['year', 'month']. And maybe the bug is that the mask is disabled even though the user has specified a format where you do know the exact length of the date (in my case yyyy-MM).

This might be the rule here:
https://github.com/mui-org/material-ui/blob/becb199bd3c32471fb26a9ac6dc2d7d0b1a4d3ac/packages/mui-lab/src/DatePicker/shared.ts#L72
This is preventing me from upgrading from v4.  Why is this mask not allowed?

Any updates on this?


semicolon bug fix, underscores allowed in names

three alterations:

semicolons weren't allowed in terminals' names.
whitespace wasn't allowed before semicolons.
semicolons added in readme example

note:
I am very unfamiliar with this nested functional parser design and rust so my implementations might be naive.

Good job!


Translation of "Precise Throughput timer" in French

Description
translation for "Precise Throughput timer" in French
Motivation and Context
Fixing bug_62310 ; the French label of "Precise Troughput Timer" is not translated.
How Has This Been Tested?

Screenshots (if appropriate):
Types of changes

Bug fix (non-breaking change which fixes an issue)

Checklist:

missing AL2 header. I will make an updated PR

The PR is fixed. You can merge if ok.

Apply on trunk. Thanks.
You can close the PR.
URL: http://svn.apache.org/viewvc?rev=1829511&view=rev
Log:
French translation of Precise Throughput Timer label
Bugzilla Id: 62310
Modified:
jmeter/trunk/src/components/org/apache/jmeter/timers/poissonarrivals/PreciseThroughputTimerResources_fr.properties
jmeter/trunk/xdocs/changes.xml


Add support for environment-specific configurations season

Rabbit season

Failed Test
Failure Summary
Logs

[chromium] should display user profile information correctly.
The test timed out waiting for the expected text "User Profile" in the page, but it received an empty array instead.
Logs ↗

[chromium] should display the about us section correctly.
The "About" section was not found on the page, and the title was not displayed correctly.
Logs ↗

Flaky Test
Failure Summary
Logs

[chromium] should login with credentials correctly correctly.
The login request to the server failed with a 404 Not Found error.
Logs ↗

[chromium] should load the pricing page correctly.
The pricing page failed to load correctly, and the title and heading were not found within the expected time.
Logs ↗

[chromium] should return list of users correctly.
The API call to get a list of users failed with a 404 Not Found error.
Logs ↗

[chromium] should display error message for invalid login correctly.
The expected HTTP status code 401 was not received, instead a function was returned.
Logs ↗

... and 1 more

View Full Report ↗ ⋅ Docs


[Wasm] Enable native exception handling

From: https://emscripten.org/docs/porting/exceptions.html#webassembly-exception-handling-proposal, To enable it, pass -fwasm-exceptions at both compile time and link time.

I tried a few options:

-fwasm-exceptions doesn’t work for node, throw tons of errors, __trap called
-fexception seemed not working properly for node, adding this flag will remove warnings like below but the catch block in c++ is not executed.

Exception catching is disabled, this exception cannot be caught. Compile with -sNO_DISABLE_EXCEPTION_CATCHING or -sEXCEPTION_CATCHING_ALLOWED=[..] to catch

The good news is try/catch in js works without adding any new compile/link flag


Add support for specifying private fields through a strawberry.type variable

Description
strawberry.Private is great for specifying private fields, however, does not play well with IDE's: https://github.com/strawberry-graphql/strawberry/issues/702
This PR adds supports for specifying which fields on a type should be made private, through a private_fields variable on strawberry.type decorator

Types of Changes

[ ] Core
[ ] Bugfix
[ ] New feature
[x] Enhancement/optimization
[x] Documentation

Issues Fixed or Closed by This PR

https://github.com/strawberry-graphql/strawberry/issues/702

Checklist

[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] I have tested the changes and verified that they work and don't break anything (as well as I can manage).

Hi, thanks for contributing to Strawberry 🍓!
We noticed that this PR is missing a RELEASE.md file. We use that to automatically do releases here on GitHub and, most importantly, to PyPI!
So as soon as this PR is merged, a release will be made 🚀.
Here's an example of RELEASE.md:
Release type: patch

Description of the changes, ideally with some examples, if adding a new feature.

Release type can be one of patch, minor or major. We use semver,so make sure to pick the appropriate type. If in doubt feel free to ask :)

I'm always a bit hesitant to keep tacking on more arguments to the function signatures for our types. I do feel like there's gotta be a cleaner way to get this done.
I'll let @patrick91 give his opinions here, though

I agree
It's not urgent on my end to get a solution for this in either, we can sleep on this for a while

I'm always a bit hesitant to keep tacking on more arguments to the function signatures for our types. I do feel like there's gotta be a cleaner way to get this done.
I'll let @patrick91 give his opinions here, though

I agree
It's not urgent to get a solution for this on my end, we can sleep on this

@lijok I think we should work on a plugin for PyCharm instead of changing our code, I don't have bandwidth for that at this time, but maybe in future :)
What do you think? Happy to close this PR for now?

@lijok I think we should work on a plugin for PyCharm instead of changing our code, I don't have bandwidth for that at this time, but maybe in future :)
What do you think? Happy to close this PR for now?

Yeah, that makes sense
Happy to close this


using catvae without a phylogeny

Hi @mortonjt,
Is it okay to train a catvae model without a phylogeny? If so, how should I extract the embeddings index IDs from the model output? I see all the utils rely on the phylogeny for the index order.
Thanks!

Hi! Yes you don’t need to specify a phylogeny - if none is specified , a
random phylogeny will be generated.
https://github.com/flatironinstitute/catvae/blob/master/catvae/models/linear_vae.py#L16
It wont really matter which tree you use for estimation - but it can help
with interpretation.
On Thu, May 5, 2022 at 3:56 PM Cameron Martino @.***>
wrote:

Hi @mortonjt https://github.com/mortonjt,
Is it okay to train a catvae model without a phylogeny? If so, how should
I extract the embeddings index IDs from the model output? I see all the
utils rely on the phylogeny for the index order.
Thanks!
—
Reply to this email directly, view it on GitHub
https://github.com/flatironinstitute/catvae/issues/75, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AA75VXMY2FKDT4HR7UG6URDVIQRYPANCNFSM5VGDMIJQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

@mortonjt For the order of the index IDs without the tree in the embedding is it just the order of the IDs in the biom tables? or ALR first or last IDs? so bt.ids('observation')[1:] or  bt.ids('observation')[:-1]?
Thanks!!

Maybe to be more explicit. When I do:
W = model.vae.decoder.weight.detach().cpu().numpy()
dist_W = squareform(pdist(W))
dist_Wdf = pd.DataFrame(dist_W)

How would I grab the correct IDs order for dist_Wdf and am I calculating dist_Wdf correctly?
Thanks!!

See the Readme on extracting embeddings. I have a helper function to do
this
https://github.com/flatironinstitute/catvae/blob/master/catvae/util.py#L70
On Thu, May 5, 2022 at 6:02 PM Cameron Martino @.***>
wrote:

Maybe to be more explicit. When I do:
W = model.vae.decoder.weight.detach().cpu().numpy()dist_W = squareform(pdist(W))dist_Wdf = pd.DataFrame(dist_W)
How would I grab the correct IDs order for dist_Wdf and am I calculating
dist_Wdf correctly?
Thanks!!
—
Reply to this email directly, view it on GitHub
https://github.com/flatironinstitute/catvae/issues/75#issuecomment-1119085435,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AA75VXJ7HC3IEZNDQYEQY33VIRAOPANCNFSM5VGDMIJQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Right, but those require a basis/phylogeny tree as input in order to get the correct order of the IDs. How should I do it without one?

Got it. Ok, don’t use the defaults. Id use the random_linkage function
(used in that get_basis method) to get you a random phylogeny - which you
can use the helper methods listed previously
On Thu, May 5, 2022 at 8:14 PM Cameron Martino @.***>
wrote:

Right, but those require a basis/phylogeny tree as input in order to get
the correct order of the IDs. How should I do it without one?
—
Reply to this email directly, view it on GitHub
https://github.com/flatironinstitute/catvae/issues/75#issuecomment-1119155624,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AA75VXKHUPZOQJSM26AWP2LVIRP5VANCNFSM5VGDMIJQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

That worked. Thanks!!

FYI - it only really works if you make the tree ahead of time and plug it in (otherwise it won't match).  Might be good to expose the tree in the function (i.e. self.tree) so one could pull it out after if needed.


.find() with Object Property Selector does not work with defaultValue prop.

I've been trying to find an input with defaultValue='Some value', but the .find() method is unable to find it.
The input in which I'm setting defaultValue is accessible when using .find() with props such as name and type. I would like to know if there's a reason for this behaviour.
Cheers!

Hey @devjunkORG thanks for the issue. I think we need some more information to figure out whats going on.
Are you using mount or shallow? What does your component look like? What does your find() query look like?

Yeah, sorry about the lack of context. Here we go:
// Component's render()
return (

                    {this.props.label}
                    <input ref={this.props.name} type={this.props.type} name={this.props.name} placeholder={this.props.placeholder} defaultValue={this.props.defaultValue} />

        );

// Test case:
it('should render one text field with value "Some value"',() => {
  const wrapper = mount(<Form options={ form }/>);
  expect(wrapper.find({ defaultValue: 'Some value' })).to.have.length(1);
});

does wrapper.find('[defaultValue]') find the component? Maybe your object value isn't correct?

This does not work either.
it('should render one text field with value "Some value"',() => {
            const wrapper = mount(<Form options={ form }/>);
            expect(wrapper.find('[defaultValue]')).to.have.length(1);
        });

Looking for other props, however, does work:
it('should render one input with name "someText"', () => {
            const wrapper = mount(<Form options={ form } />);
            expect(wrapper.find({ name: 'someText' })).to.have.length(1);
        });

@devjunkORG what version of enzyme are you using? I wasnt' able to reproduce using a simple example. You can see it here: Aweary/enzyme-test-repo/blob/issue-402/test.js
class TestComponent extends React.Component {
  render() {
    return (

        Test
        <input name='test' defaultValue='test'/>

    );
  }
}

/**
 * Change the `describe` and `it` block so it acurately describes
 * the test that you are trying to reproduce.
 */

describe('Issue #402', () => {
  it('should find the input using defaultValue', () => {
    const wrapper = mount(<TestComponent/>);
    expect(wrapper.find({defaultValue: 'test'})).to.have.length(1);
  });
})

Props are ok. If I use the value from this.props.defaultValue on the name prop, I can find it correctly.
I'm using<EMAIL_ADDRESS>I failed to mention that I'm using find on the <Form /> wrapper, but <Input /> is a child component generated by <Form />. Still, I can find by the name prop, and any others, so I don't understand the nature of this. I'll keep digging and let you guys know if I figure it out.

@devjunkORG can you share the output of wrapper.debug()?

<Form options={{...}}>
  <form action="/someAction" className="ui form">
    <input type="hidden" name="_method" value="POST" />
    <Input type="text" placeholder="A placeholder" label="Some label" defaultValue="Some value" description="Some description">

            Some label

          <input type="text" name={[undefined]} placeholder="A placeholder" defaultValue="Some value" />

    </Input>
    <Input type="text" name="someText" placeholder="placeholder">

          <input type="text" name="someText" placeholder="placeholder" defaultValue={[undefined]} />

    </Input>
  </form>
</Form>

I tried it in another project and it worked. Something must be wrong with the test itself, so I should not bother you with this anymore.
Thanks for the help. I didn't know about .debug()

@devjunkORG yeah looks like something is going on with the defaultValue prop not being passed properly or something. I'm going to go ahead and close this, but feel free to post any follow up questions, and if we find an issue with enzyme we can re-open it

@Aweary Thanks for all the help :) I'll let you know if we figure it out. I might ask for a rewrite of the whole test though.


MAINT: linalg: lstsq clean up

Due to the LAPACK version bump to 3.4.x, the function and the tests cleaned up and the docs are a bit more clarified.
Also removed some outdated items from the tests at the import area.

Good to see this workaround go.
With wheel-building and openblas situation, would be nice to double-check it's OK with it too.

@ev-br I think I'm not aware of the situation with the wheel-building. Do you have @tylerjereddy's recent PRs in mind or otherwise can you elaborate a bit?

Yes, AFAIU, Tyler discovered a bunch of failures in prep for the release. The setup over at MacPython/scipy-wheels repo is a bit different from our usual CI, and it includes openblas, hence my question. I'm not following the details very closely though.

LGTM, and verified MKL is happy. OpenBLAS should be fine too - let's just merge and find out (that's the easiest way to test, and is what we do with all PRs that are green here - anyway it won't interfere with the 1.2 release)


Request: Example and Test Scenario for MultiplayerSpawner and MultiplayerSynchronizer

Is your feature request related to a problem? Please describe.
I'm seeking assistance in understanding and implementing the MultiplayerSpawner and MultiplayerSynchronizer modules within the Godot-WebRTC-Match-Maker library for my project.
Describe the solution you'd like
I would like to have a simple and clear example demonstrating the usage of the MultiplayerSpawner and MultiplayerSynchronizer in the RPC demo project.
Describe alternatives you've considered
I haven't explored any alternatives yet, as I'm specifically interested in utilizing these modules within the Godot-WebRTC-Match-Maker library.
Additional context
I appreciate any help provided, as it will greatly aid me in incorporating these features into my project. Thank you!

Hi, thanks for reaching out! :)
There currently isn't an example utilizing Godot's Multiplayer-Nodes (MultiplayerSynchronizer and MultiplayerSpawner) as ... well ... it's Godot's nodes.
They utilize the MultiplayerPeer under the hood. So by simply setting the Multiplayer.MultiplayerPeer property correctly, you should be able to use those nodes as well!
You can see an example of setting this with the Match Maker in the RPC Demo.
Specifically, RPC.cs:16
As a guide for Godot's nodes, you may refer to this blog article from Godot!
It's in GDScript, but it's almost 1:1 with C# :)
I personally found Godot's network nodes very lacking though, which lead me to implement my own protocol for the Game demo as it's much better performing and is utilizing features of WebRTC (like channels) better.
Let me know if I can provide more help!


document env vars

This adds a page with DVC environment variables. It doesn't document all of them since some seem intended to be private, but it documents all those that are mentioned elsewhere in the docs. I don't think this is the ideal place for the page, but I don't want to bog this down in a major reorg of docs like suggested in #4381.
Related:

https://github.com/iterative/dvc.org/pull/5012
https://github.com/iterative/dvc.org/issues/5029

Open to doing this differently or combining with #5012, but seems like we need somewhere to document all DVC env vars

Are we ready to merge this?

I was waiting to align on the related issues linked above.
Is it worthwhile to document DVC_EXP_AUTO_PUSH in its current state? I initially drafted this PR in part as a precursor to https://github.com/iterative/dvc.org/pull/5035, but I'm not sure we actually want to push people to use this env var. I lean towards dropping it from this PR for now and then I think we could merge.

Also, if it absorbs #5012, let me do one more pass to maybe clarify and incorporate some of the suggestions there from @natikgadzhi.

Dropped DVC_EXP_AUTO_PUSH and DVC_EXP_GIT_REMOTE to keep this simple. Merging now.


fix installation command

The PR fixes installation command in README.
Now, we have an error:
❯ go version
go version go1.23.2 darwin/arm64

❯ go install -u github.com/roblaszczak/vgt
flag provided but not defined: -u
usage: go install [build flags] [packages]
Run 'go help install' for details.

After:
❯ go install github.com/roblaszczak/vgt@latest
go: downloading github.com/roblaszczak/vgt v1.0.0

Thx!


Rename the existing header

Issue Template
Title: Rename the existing heather
Description:

I want to rename the exiting header in envoy configuration but I cant find any related document expect [Access header values by name from header modification options] (https://github.com/envoyproxy/envoy/issues/5051) where has no response. Is there any solution for this requirement in envoy?

@mohammadMahdavi can you clarify what you mean by "rename existing header"? Are you talking about a scenario where you have a request with header A: foobar and want to rename it to B: foobar? If so, I don't think there's a configuration option for this, you can accomplish it with a simple filter or Lua snippet.

Personally I think that it should be achieved by adding a header with the value of another header and removing the specific header(s).
I have a case for it too. My API Gateway (based on Ambassador) will receive the Authorization header and process it. I do not want my backend APIs to be aware of the actual bearer token, I will provide them the required values in separate headers. Yet, for some cases (like calling OAuth2 /userinfo endpoint) they may need the original bearer token. To make it clean, I would like to create another header "x-userinfo-token" or something like it, populate it with the value of the original Authorization header and then drop the original Authorization header.


feat(scheduler): add automatic scheduler switching feature

Description

To address potential issues with Scheduler failures during P2P downloads, this project aims to implement an automatic switching feature at the Peer node. When a Scheduler encounters an issue and cannot properly handle downloads, the Peer node will switch to other Scheduler nodes using a hash ring to continue the download, thereby preventing download failures and improving success rates.
Requirements

Scheduler Availability Check During Peer Registration: Ensure that the Scheduler is available during the Peer node registration process.

Automatic Scheduler Switching: If the current Scheduler is unavailable, automatically switch to another Scheduler node until a usable Scheduler is found.

Feature Development: Complete the development of the automatic switching logic and Scheduler availability detection.
Testing: Implement unit tests and end-to-end (E2E) tests to ensure the reliability and stability of the feature.

Related Issue

https://github.com/dragonflyoss/client/issues/551

Motivation and Context

Please refer to the following document link for detailed instructions

https://www.yuque.com/baimo/fv9qk8/ghfsq8uldrer2p7r

Location of corresponding configuration items：dragonfly-client-config/src/dfdaemon.rs

    // cooldown_duration is the scheduler's cooldown time (in seconds).
    // When the scheduler becomes unavailable due to an exception, this field specifies
    // the time period during which the scheduler will not be accessed.
    #[serde(
        default = "default_scheduler_cooldown_interval",
        with = "humantime_serde"
    )]
    pub cooldown_interval: Duration,

    // max_attempts is the maximum number of attempts to connect to the scheduler.
    // If the connection to the scheduler fails, dfdaemon will retry up to this number of times.
    #[serde(default = "default_scheduler_max_attempts")]
    #[validate(range(min = 1))]
    pub max_attempts: u32,

    // refresh_threshold is the threshold for refreshing available scheduler nodes.
    // When the number of attempts to connect to the scheduler reaches this value,
    // dfdaemon will refresh the available scheduler nodes.
    #[serde(default = "default_scheduler_refresh_threshold")]
    #[validate(range(min = 1))]
    pub refresh_threshold: u32,

Simultaneously configure the corresponding default value function：
// default_scheduler_cooldown_interval is the default cooldown time (in seconds) for the scheduler.
// This duration specifies the time period during which the scheduler will not be accessed
// after it becomes unavailable due to an exception.
#[inline]
fn default_scheduler_cooldown_interval() -> Duration {
    Duration::from_secs(60)
}

// default_scheduler_max_attempts is the default maximum number of attempts to connect to the scheduler.
// If the connection to the scheduler fails, dfdaemon will retry up to this number of times.
#[inline]
fn default_scheduler_max_attempts() -> u32 {
    3
}

// default_scheduler_refresh_threshold is the default threshold for refreshing available scheduler nodes.
// When the number of attempts to connect to the scheduler reaches this value,
// dfdaemon will refresh the available scheduler nodes.
#[inline]
fn default_scheduler_refresh_threshold() -> u32 {
    10
}

Add error type: dragonfly-client-core/src/error/mod.rs

    // ExceededMaxAttempts is the error when the maximum number of attempts is
   exceeded.
    #[error("exceeded maximum number of attempts")]
    ExceededMaxAttempts,

    // SchedulerNotServing is the error when the current scheduler is not serving.
    #[error("current scheduler is not serving")]
    SchedulerNotServing,

Add switch logic and scheduler health check：dragonfly-client/src/grpc/scheduler.rs
The unavailable_scheduler_addrs field is only valid between two refresh operations, so in order to maintain synchronization between the available_scheduler_addrs and unavailable_scheduler_addrs fields, a cleaning logic has been added to the update_available_scheduler_addrs function：dragonfly-client/src/grpc/scheduler.rs

    // Clean the unavailable scheduler addrs.
    let mut unavailable_scheduler_addrs =
self.unavailable_scheduler_addrs.write().await;
    unavailable_scheduler_addrs.clear();
    drop(unavailable_scheduler_addrs);

after drop the unavailable_scheduler_addrs, is there any mechanism that the addr will be add back when the scheduler instance work normally?

after drop the unavailable_scheduler_addrs, is there any mechanism that the addr will be add back when the scheduler instance work normally?

The design intent is for unavailable_scheduler_addrs to be valid only during the interval between two refreshes. Therefore, when available_scheduler_addrs is updated, the corresponding unavailable_scheduler_addrs will be released.


Fix a bug that doesn't copy over serialized models in setup.py

Sorry about this, @matt-peters ! I should've noticed. Btw: Why switch back to distutils from setuptools? I always thought that the latter was developed as a much-improved successor to the former. e.g. https://packaging.python.org/current/#tool-recommendations

Switched back -- that was a debugging remnant (to make it easier to inspect the installed files... setuptools bundles them into an opaque zip file).


Restore Crashlytics quickstart testing

Restore Crashlytics quickstart testing in .travis.yml that was disabled in #4730.

Done in the GHA transition.


[Feature-7460][Alert] Wechat alert add send to group chat

Purpose of the pull request
close #7460
Brief change log

Codecov Report

Merging #7465 (0a5d50a) into dev (fb31dcd) will decrease coverage by 0.03%.
The diff coverage is 72.72%.

@@             Coverage Diff              @@
##                dev    #7465      +/-   ##
============================================
- Coverage     41.28%   41.25%   -0.04%
+ Complexity     3660     3659       -1
============================================
  Files           635      636       +1
  Lines         26426    26446      +20
  Branches       2959     2961       +2
============================================
- Hits          10910    10909       -1
- Misses        14489    14510      +21
  Partials       1027     1027

Impacted Files
Coverage Δ

...uler/plugin/alert/wechat/WeChatAlertConstants.java
0.00% <ø> (ø)

...lugin/alert/wechat/WeChatAlertParamsConstants.java
0.00% <ø> (ø)

...hinscheduler/plugin/alert/wechat/WeChatSender.java
45.73% <16.66%> (-0.81%)
:arrow_down:

...lphinscheduler/plugin/alert/wechat/WeChatType.java
88.88% <88.88%> (ø)

...plugin/alert/wechat/WeChatAlertChannelFactory.java
97.82% <100.00%> (+0.32%)
:arrow_up:

...he/dolphinscheduler/common/enums/SqoopJobType.java
0.00% <0.00%> (-88.89%)
:arrow_down:

...r/plugin/registry/zookeeper/ZookeeperRegistry.java
48.64% <0.00%> (-7.21%)
:arrow_down:

...er/master/dispatch/host/assign/RandomSelector.java
77.77% <0.00%> (-5.56%)
:arrow_down:

...inscheduler/common/task/sqoop/SqoopParameters.java
74.00% <0.00%> (-2.00%)
:arrow_down:

...dolphinscheduler/remote/future/ResponseFuture.java
81.96% <0.00%> (-1.64%)
:arrow_down:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fb31dcd...0a5d50a. Read the comment docs.

would you please supplement some documents about the use of wechat alarm plug-in?
https://github.com/apache/dolphinscheduler-website

would you please supplement some documents about the use of wechat alarm plug-in? https://github.com/apache/dolphinscheduler-website

I'll add it.


MINOR: Fix log format in AbstractCoordinator

More detailed description of your change
Accidentally saw a log:
[2021-03-02 20:39:56,418] DEBUG FindCoordinator request failed due to {} (org.apache.kafka.clients.consumer.internals.AbstractCoordinatorTest$DummyCoordinator:863)
org.apache.kafka.common.errors.AuthenticationException: Authentication failed

I fixed it to:
[2021-03-02 20:51:39,050] ERROR FindCoordinator request failed due to Authentication failed (org.apache.kafka.clients.consumer.internals.AbstractCoordinatorTest$DummyCoordinator:863)

I think the author wants to call Logger.debug(String format, Object arg), but called Logger.debug(String msg, Throwable t). In fact, there are 3 overloadings Logger.debug() so we need to be careful.
Summary of testing strategy (including rationale)
test locally
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@ableegoldman , Hi, PTAL.

@chia7712 Thank you,There are 5 overloadings of log.debug,


Support Node 18+

In a Node 18.0.0 environment I can't install and use this as I get the following error. Is it possible to update the peer dependency SignalFx to 7.5.1 or is there a workaround?

This has been fixed in @splunk/otel 1.4.1. Note we are moving to OTel metrics and getting rid of SignalFx libraries, but this will be a 2.0 release.


past events in reverse order; events page hero image

Please check the Events page banner - both text and image

Done


java.lang.NumberFormatException

Thank you for developing this useful package.
When I am running 3D-DNA, I encountered the below error:
version: 180922
###############
Starting iterating scaffolding with editing:
...starting round 0 of scaffolding:
:) -p flag was triggered. Running LIGer with GNU Parallel support parameter set to true.
:) -s flag was triggered, starting calculations with 15000 threshold starting contig/scaffold size
:) -q flag was triggered, starting calculations with 1 threshold mapping quality
...Using cprops file: phased.0.0.cprops
...Using merged_nodups file: phased.0.mnd.0.txt
...Scaffolding all scaffolds and contigs greater or equal to 15000 bp.
...Starting iteration # 1
:) DONE!
...visualizing round 0 results:
:) -p flag was triggered. Running with GNU Parallel support parameter set to true.
:) -q flag was triggered, starting calculations for 1 threshold mapping quality
:) -i flag was triggered, building mapq without
:) -c flag was triggered, will remove temporary files after completion
...Remapping contact data from the original contig set to assembly
...Building track files
...Building the hic file
Not including fragment map
Start preprocess
Writing header
Writing body
java.lang.NumberFormatException: For input string: "R2"
	at java.base/java.lang.NumberFormatException.forInputString(NumberFormatException.java:68)
	at java.base/java.lang.Integer.parseInt(Integer.java:658)
	at java.base/java.lang.Integer.parseInt(Integer.java:776)
	at juicebox.tools.utils.original.AsciiPairIterator.advance(AsciiPairIterator.java:149)
	at juicebox.tools.utils.original.AsciiPairIterator.next(AsciiPairIterator.java:194)
	at juicebox.tools.utils.original.Preprocessor.computeWholeGenomeMatrix(Preprocessor.java:493)
	at juicebox.tools.utils.original.Preprocessor.writeBody(Preprocessor.java:371)
	at juicebox.tools.utils.original.Preprocessor.preprocess(Preprocessor.java:283)
	at juicebox.tools.clt.old.PreProcessing.run(PreProcessing.java:108)
	at juicebox.tools.HiCTools.main(HiCTools.java:86)
...detecting misjoins in round 0 assembly:
:) -p flag was triggered. Running with GNU Parallel support parameter set to true.
:) -c flag was triggered, starting calculations with 5% saturation level
:) -w flag was triggered, performing cursory search for mismatches at 25000 resolution
:) -d flag was triggered, depletion score will be averaged across a region bounded by 125000 superdiagonal
:) -k flag was triggered, starting calculations with 55% depletion as mismatch threshold
:) -n flag was triggered, performing mismatch region thinning at 1000 resolution
...Dumping 25000 resolution matrix
HiC file version: 8
ERROR [2020-10-12 22:08:59,712]  [DatasetReaderV2.java:229] [main]  Error reading dataset
java.io.EOFException
	at htsjdk.tribble.util.LittleEndianInputStream.readString(LittleEndianInputStream.java:119)
	at juicebox.data.DatasetReaderV2.readFooter(DatasetReaderV2.java:435)
	at juicebox.data.DatasetReaderV2.read(DatasetReaderV2.java:225)
	at juicebox.data.HiCFileTools.extractDatasetForCLT(HiCFileTools.java:64)
	at juicebox.tools.clt.old.Dump.readArguments(Dump.java:353)
	at juicebox.tools.HiCTools.main(HiCTools.java:85)
Could not read hic file: null
:( Juicebox dump is empty! Perhaps something is wrong with the hic file or the requested resolution is too high. Exiting!
:) -w flag was triggered, performing cursory search for repeat at 25000 resolution
:) -t flag was triggered, flagging regions with coverage higher than 2
...Dumping 25000 resolution coverage track
HiC file version: 8```

I am using java 1.8.0.

I would be really grateful for your time and help!

Hello Henry,
There seems to be something wrong with your input. There are no interactions during scaffolding, the map error points to the same thing. Check your fasta and merged_nodups.txt files, that they actually match and that they are of expected format.
Thanks,
Olga

On Oct 12, 2020, at 4:10 PM, T. H. (Henry) Hung<EMAIL_ADDRESS>wrote:
Thank you for developing this useful package.
When I am running 3D-DNA, I encountered the below error:
/data/dops-dalbergia/univ4423/bin/3d-dna/run-asm-pipeline.sh /data/dops-dalbergia/univ4423/DBCO/fc_phase_a80/5-phase/output/phased.0.fasta merged_nodups.txt version: 180922 ############### Starting iterating scaffolding with editing: ...starting round 0 of scaffolding: :) -p flag was triggered. Running LIGer with GNU Parallel support parameter set to true. :) -s flag was triggered, starting calculations with 15000 threshold starting contig/scaffold size :) -q flag was triggered, starting calculations with 1 threshold mapping quality ...Using cprops file: phased.0.0.cprops ...Using merged_nodups file: phased.0.mnd.0.txt ...Scaffolding all scaffolds and contigs greater or equal to 15000 bp. ...Starting iteration # 1 :) DONE! ...visualizing round 0 results: :) -p flag was triggered. Running with GNU Parallel support parameter set to true. :) -q flag was triggered, starting calculations for 1 threshold mapping quality :) -i flag was triggered, building mapq without :) -c flag was triggered, will remove temporary files after completion ...Remapping contact data from the original contig set to assembly ...Building track files ...Building the hic file Not including fragment map Start preprocess Writing header Writing body java.lang.NumberFormatException: For input string: "R2" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:492) at java.lang.Integer.parseInt(Integer.java:527) at juicebox.tools.utils.original.AsciiPairIterator.advance(AsciiPairIterator.java:149) at juicebox.tools.utils.original.AsciiPairIterator.next(AsciiPairIterator.java:194) at juicebox.tools.utils.original.Preprocessor.computeWholeGenomeMatrix(Preprocessor.java:493) at juicebox.tools.utils.original.Preprocessor.writeBody(Preprocessor.java:371) at juicebox.tools.utils.original.Preprocessor.preprocess(Preprocessor.java:283) at juicebox.tools.clt.old.PreProcessing.run(PreProcessing.java:108) at juicebox.tools.HiCTools.main(HiCTools.java:86) ...detecting misjoins in round 0 assembly: :) -p flag was triggered. Running with GNU Parallel support parameter set to true. :) -c flag was triggered, starting calculations with 5% saturation level :) -w flag was triggered, performing cursory search for mismatches at 25000 resolution :) -d flag was triggered, depletion score will be averaged across a region bounded by 125000 superdiagonal :) -k flag was triggered, starting calculations with 55% depletion as mismatch threshold :) -n flag was triggered, performing mismatch region thinning at 1000 resolution ...Dumping 25000 resolution matrix HiC file version: 8 ERROR [2020-10-12 22:04:08,465] [DatasetReaderV2.java:229] [main] Error reading dataset java.io.EOFException at htsjdk.tribble.util.LittleEndianInputStream.readString(LittleEndianInputStream.java:119) at juicebox.data.DatasetReaderV2.readFooter(DatasetReaderV2.java:435) at juicebox.data.DatasetReaderV2.read(DatasetReaderV2.java:225) at juicebox.data.HiCFileTools.extractDatasetForCLT(HiCFileTools.java:64) at juicebox.tools.clt.old.Dump.readArguments(Dump.java:353) at juicebox.tools.HiCTools.main(HiCTools.java:85) Could not read hic file: null :( Juicebox dump is empty! Perhaps something is wrong with the hic file or the requested resolution is too high. Exiting! :) -w flag was triggered, performing cursory search for repeat at 25000 resolution :) -t flag was triggered, flagging regions with coverage higher than 2 ...Dumping 25000 resolution coverage track HiC file version: 8
I am using java 1.8.0.
I would be really grateful for your time and help!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/aidenlab/3d-dna/issues/92, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACLAMG2JF4EOZN4A5KFU4EDSKNWC7ANCNFSM4SNL6EQQ.

Hi Olga, thank you for your reply.
head merged_nodups.txt
0 000000F_0 1730 0 16 000000F_0 1912 0 0 150M CCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCAAAACCCAAAACCCTAAACCCTAAACCC 0 150M AACCCAAAACCCTACACCCAAAGCCCCAATCCCTTAACCCTAAACCCTAACCCCTAAACCCTACACCCTAAACCCTAAACCCTAAACCCAAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAAC GWNJ-0957:663:GW2009263402nd:1:1109:16315:69098 GWNJ-0957:663:GW2009263402nd:1:1109:16315:69098
0 000000F_0 1737 0 16 000000F_0 11269 0 0 150M CCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCAAAACCCTAAACCCTAAACCCTAAACCCTAAACCC 12 14S136M AACCCTGATGCCTGAACCCTAAGCCCTAAACCCTAAACCCTAAACCCTAAACCCTCAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAAC GWNJ-0957:663:GW2009263402nd:1:1108:30381:12279 GWNJ-0957:663:GW2009263402nd:1:1108:30381:12279```

`grep ">" phased.0.fasta | head`
```>000000F_0
>000001F_0
>000002F_0
>000003F_0
>000004F_0
>000005F_0
>000006F_0
>000007F_0
>000008F_0
>000009F_0```

The fasta does not seem to have any problem. I am unsure of the format of merged_nodups.txt. Do you think it looks normal?

Check for carriage return, i.e. look in an editor with hidden characters. -Olga

On Oct 12, 2020, at 4:19 PM, T. H. (Henry) Hung<EMAIL_ADDRESS>wrote:
Hi Olga, thank you for your reply.
head merged_nodups.txt
0 000000F_0 1730 0 16 000000F_0 1912 0 0 150M CCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCAAAACCCAAAACCCTAAACCCTAAACCC 0 150M AACCCAAAACCCTACACCCAAAGCCCCAATCCCTTAACCCTAAACCCTAACCCCTAAACCCTACACCCTAAACCCTAAACCCTAAACCCAAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAAC GWNJ-0957:663:GW2009263402nd:1:1109:16315:69098 GWNJ-0957:663:GW2009263402nd:1:1109:16315:69098
0 000000F_0 1737 0 16 000000F_0 11269 0 0 150M CCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCAAAACCCTAAACCCTAAACCCTAAACCCTAAACCC 12 14S136M AACCCTGATGCCTGAACCCTAAGCCCTAAACCCTAAACCCTAAACCCTAAACCCTCAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAACCCTAAAC GWNJ-0957:663:GW2009263402nd:1:1108:30381:12279 GWNJ-0957:663:GW2009263402nd:1:1108:30381:12279```
grep ">" phased.0.fasta | head
>000001F_0
>000002F_0
>000003F_0
>000004F_0
>000005F_0
>000006F_0
>000007F_0
>000008F_0
>000009F_0```

The fasta does not seem to have any problem. I am unsure of the format of merged_nodups.txt. Do you think it looks normal?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <https://github.com/aidenlab/3d-dna/issues/92#issuecomment-707350896>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACLAMG2WHLDZ2MN5U4ALBCLSKNXFLANCNFSM4SNL6EQQ>.

My bad. The file system on my cluster is quite unstable these days, I just noticed there was a premature cp leading to a truncated merged_nodups.txt file. It is now running perfectly now. Thanks for your help.


Add Data related cmdlets

I will work on data related cmdlets for test how it works.

closing as all cmdlets will be merged.