Blank page with ALB Ingress

Describe the bug
I have finally setup my kafka-ui and exposed it via an ingress of type Application Load Balancer in AWS.
Whenever I hit the URL of the application load balancer in my browser, I simply get a blank page. I do have JS enabled in my browser, so not sure why this occurs.
I found this strange, so I tried to curl.
My output is the following:
❯ curl  kafka-ui-*.elb.amazonaws.com

<!doctype html><meta charset="utf-8"/><link rel="icon" href="./favicon.ico"/><meta name="viewport" content="width=device-width,initial-scale=1"/><link rel="apple-touch-icon" href="./logo192.png"/><link rel="manifest" href="./manifest.json"/><title>UI for Apache Kafka</title><link href="/static/css/main.6b53eac5.css" rel="stylesheet">You need to enable JavaScript to run this app.

%

You can see the last section:
You need to enable JavaScript to run this app.

Which to me seems like it is unable to load the JS code required for the frontend.
Any idea what this could be due to?
Set up
I use helmfile to deploy my applications into an EKS cluster.
My helmfile.yaml kafka-ui release looks like this (excluding envs):
- name: kafka-ui
    chart: kafka-ui/kafka-ui
    installed: true
    namespace: kafka
    values:
      - service:
          type: ClusterIP
          port: 8080
      - ingress:
          enabled: true
          ingressClassName: alb
          annotations:
            alb.ingress.kubernetes.io/load-balancer-name: "kafka-ui"
            alb.ingress.kubernetes.io/scheme: "internet-facing"
            alb.ingress.kubernetes.io/target-type: "ip"
          tls:
            enabled: false

This will create the following ingress:
❯ k get ingress -n kafka
NAME       CLASS   HOSTS   ADDRESS                                          PORTS   AGE
kafka-ui   alb     *       kafka-ui-*.elb.amazonaws.com                   80           70m

The Ingress:
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: kafka-ui
  labels:
    helm.sh/chart: kafka-ui-0.3.3
    app.kubernetes.io/name: kafka-ui
    app.kubernetes.io/instance: kafka-ui
    app.kubernetes.io/version: "0.3.3"
    app.kubernetes.io/managed-by: Helm
  annotations:
    alb.ingress.kubernetes.io/load-balancer-name: kafka-ui
    alb.ingress.kubernetes.io/scheme: internet-facing
    alb.ingress.kubernetes.io/target-type: ip
spec:
  ingressClassName: alb
  rules:
    - http:
        paths:
          - backend:
              service:
                name: kafka-ui
                port:
                  number: 8080
            pathType: Prefix
            path: /

And the Service:
apiVersion: v1
kind: Service
metadata:
  name: kafka-ui
  labels:
    helm.sh/chart: kafka-ui-0.3.3
    app.kubernetes.io/name: kafka-ui
    app.kubernetes.io/instance: kafka-ui
    app.kubernetes.io/version: "0.3.3"
    app.kubernetes.io/managed-by: Helm
spec:
  type: ClusterIP
  ports:
    - port: 8080
      targetPort: http
      protocol: TCP
      name: http
  selector:
    app.kubernetes.io/name: kafka-ui
    app.kubernetes.io/instance: kafka-ui

Because this is an ALB, it also generates a Security Group in AWS. This security group allows all inbound on port 80 by default.
Regarding my envs in the values.yaml file, I have only added what is required for SCRAM based authentication to the broker listeners.
Are there any other configurations that are necessary for the ingress ?
Steps to Reproduce
Steps to reproduce the behavior:

Create an EKS cluster with IGW and NGW attached
Deploy AWS ALB controller
Create a Kafka cluster with listeners accepting SCRAM authentication
Deploy kafka-ui as above.

Expected behavior
I would expect the browser to open the front end as usual. I am able to port-forward to it, and that seems to work fine.
Screenshots
Additional context

Hey, thanks for reaching out. We'll take a look once we have someone available.

Great, thanks.

Hi @mattia-crypto, I suppose that cause of the issue is a wrong path in ingress, ALB controller use it to build listener rules, so instead of specifying just / need to pass /* to being able forward any request to the targets

@RustamGimadiev thanks for this, I will test ASAP and let you know.

@RustamGimadiev  tested it now, and it works. Thanks!

Hi @mattia-crypto, I suppose that cause of the issue is a wrong path in ingress, ALB controller use it to build listener rules, so instead of specifying just / need to pass /* to being able forward any request to the targets

This fixed a problem that I had been working hours on for a totally separate project.  Thank you!


[B030] Add support for Union usage in except expression

Conforming to https://peps.python.org/pep-0604/
Except expressions can be written with Unions
try:
    pass
except ValueError | TypeError:
    pass

Thanks for the PR! Is this a valid pattern? Given:
try:
    raise ValueError("Some error")
except ValueError | TypeError:
    pass

I get:
❯ python foo.py
Traceback (most recent call last):
  File "/Users/crmarsh/workspace/ruff/foo.py", line 2, in <module>
    raise ValueError("Some error")
ValueError: Some error

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/crmarsh/workspace/ruff/foo.py", line 3, in <module>
    except ValueError | TypeError:
TypeError: catching classes that do not inherit from BaseException is not allowed

Looks like you are right!
Sorry, I've seen this pattern in some projects and didn't question its validity.
thanks

No worries! I wasn't sure either, had to test it myself.


webapp flow questions

running version 0.0.3
Spent some time attempting to use amber from a webapp, here's what I found.  I have adb logcat running to see the error is my event does not have an ID.  The webapp does not know the pubkey of the user (without the user pasting this as an additional step for them) and therefor cannot serialize to provide the event ID.  I think the Amber intent should handle generating the ID since it is the one doing the signing and has the pubkey and the private key available.  The json ideally would only have to include kind, created_at, tags, and content.
(the error I get is: java.lang.NullPointerException: Attempt to invoke virtual method 'java.lang.String com.google.gson.JsonElement.getAsString()' on a null object reference at com.greenart7c3.nostrsigner.service.model.Event$EventDeserializer.deserialize(Event.kt:201)
I've also realized, I will still need to be able to receive the signed event back from Amber, which I think would be possible if I setup my webapp as a PWA and use web share target.
https://developer.chrome.com/articles/web-share-target/
All in all, this is cool.  Logins are hard.  Let me know what you think about the ID situation and whether or not you think amber could share back the signed event.  Thanks

an example of the event i'm attempting to sign, in stringified json is: {"kind":27235,"created_at":1691188677,"tags":[],"content":"5NdAcSy9mSIMnOktXpmd"}

Fixed the error deserializing the json and created a copy raw json button.
Will look into the web share target in the future

https://github.com/greenart7c3/Amber/releases/tag/v0.0.5

Thank you!  I haven't had a chance to try it yet, but I want to close this issue so it doesn't clog the repo.  PV


multibyte characters entered in the results field disappear

Description
When entering multibyte characters into the query filter line of the results window, if you hit enter the characters disappear.　　If they are copy / pasted into the text field they remain when hitting enter.
DBeaver Version
Ultimate Edition 23.1
Operating System
macOS Ventura 13.5.1
Database and driver
No response
Steps to reproduce
1 open a query result window.
2. enter a query with Japanese characters in the results filter.
3.  hit enter.
4. Characters disappear.
Additional context
No response

Hello @kyle-joiner
Could you please provide a video of this issue?
I can't reproduce it for now on Windows. It could be an OS-specific issue.


[SUPPORT] How to run Periodic Compaction? Multiple Tables - When no Upserts

I have a use case where Mongo Oplogs are ingested into Kafka Topic via Debezium.
These oplogs are from N Collections, since Hudi does'nt support Multiple table insertions in a DataSource.
I am taking these oplogs (Spark+Kafka Dstreams) and bucketing based on collection names and then inserting it into Hudi Tables. (N Hudi Tables corresponding to N collections)

AFAIU Hudi doesnot support Async Compaction with Spark (Not using Structured Streaming). so, is there any other way to run Async Comapction or Periodic Compaction? Is there any tool which can be ran periodically to do compactions?

If I am using inline compaction, then how to do compaction every 15min or periodically if there are no Upserts on the table?

Is there a possibility to run Compaction Async in a different spark jobs for multiple tables?

There can be around 100 tables for oplogs.

Expected Behaviuor-

Want to run compactions every X min and data should be fresh in _ro table for tht X min.
Even if there are no Upserts happening then after X minutes data should be compacted.

Code Snippet (Spark Streaming)
//Read From Kafka
List<Row> db_names = df.select("source.ns").distinct().collectAsList();

for(int i =0;i<db_names.size();i++){
    Dataset<Row> ds=kafkaDf.select("*").where(kafkaDf.col("source.ns").equalTo(dbName));
    // Few other Transformations
    persistDFInHudi(ds,sanitizedDBName,tablePath);
}

private void persistDFInHudi(Dataset<Row> ds, String dbName, String tablePath) {
        ds
                .write().format("org.apache.hudi").
                options(QuickstartUtils.getQuickstartWriteConfigs()).

                option(DataSourceWriteOptions.OPERATION_OPT_KEY(),DataSourceWriteOptions.UPSERT_OPERATION_OPT_VAL()).
                option(DataSourceWriteOptions.TABLE_TYPE_OPT_KEY(),DataSourceWriteOptions.MOR_TABLE_TYPE_OPT_VAL()).
                option(DataSourceWriteOptions.PRECOMBINE_FIELD_OPT_KEY(), "ts_ms").

                option(DataSourceWriteOptions.RECORDKEY_FIELD_OPT_KEY(), "_id").
                option(DataSourceWriteOptions.PAYLOAD_CLASS_OPT_KEY(), MergeHudiPayload.class.getName()).
                option(DataSourceWriteOptions.PARTITIONPATH_FIELD_OPT_KEY(), "db_name").
                option(HoodieWriteConfig.TABLE_NAME, dbName).
                option(HoodieCompactionConfig.INLINE_COMPACT_PROP,true).
                option(DataSourceWriteOptions.HIVE_SYNC_ENABLED_OPT_KEY(),"true").
                option(DataSourceWriteOptions.HIVE_TABLE_OPT_KEY(), dbName).
                option(DataSourceWriteOptions.HIVE_PARTITION_FIELDS_OPT_KEY(),"db_name").
                option(DataSourceWriteOptions.DEFAULT_HIVE_ASSUME_DATE_PARTITION_OPT_VAL(),"false").
                option(HoodieCompactionConfig.INLINE_COMPACT_NUM_DELTA_COMMITS_PROP,1).
                option(DataSourceWriteOptions.ASYNC_COMPACT_ENABLE_OPT_KEY(),false).
                option(DataSourceWriteOptions.HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY(), MultiPartKeysValueExtractor.class.getName()).
                mode(SaveMode.Append).
                save(tablePath);
    }

Also, tried to use
            Option<String> instantTime=client.scheduleCompaction(Option.empty()); // How to get commit instant time?
            JavaRDD<WriteStatus> writeStatues = client.compact(instantTime);
            client.commitCompaction(instantTime, writeStatues, Option.empty());
        }

@tandonraghav : the correct setup would be to actually keep separate Hudi tables for each Mongo collection (table) as the schema could be different across collections. You should have Debezium route CDC for eac collection to its own dedicated Kafka Topic and have Hudi read from separate topics to build them.
Have you looked at DeltaStreamer in Hudi (continuous mode). That tool is tailor made for the use-case you are describing.

@bvaradar Mongo Collection-> Hudi Table (This is our setup also)

We cannot put collections to different topics because there are 100s of such collections, so not in favour of creating those many topics.
I tried to do Compaction using below code

Option<String> instantTime=client.scheduleCompaction(Option.empty());
            System.out.println(instantTime);
            client.compact(instantTime.get());

But if this code fails somehow then how do i get the last compaction instantTime? So, that I can use to compact again.

@tandonraghav : Regarding your question on compaction, Since you are using WriteClient level APIs, you can use
HoodieTable.getHoodieView().getPendingCompactionOperations().map(Pair::getKey()).distinct() will give you compaction timestamps.
Regarding the setup, 100s of topics in kafka should be fine and not an anti-pattern.Curious how you manage various schema corresponding to each Mongo collection when writing to single kafka topic. Are you using avro encoding and schema registry ?

@bvaradar Thanks for the answer.
Below is how our set up looks like-

We have Client Level Mongo collections. Write various client Mongo oplogs into one topic.

Write into one Topic in Json Format.

Read from this topic (groupBy clients) and then apply Schema at client Level for each batch read. There can be a mixed of Client json while reading from the Topic but every client will have a specific schema.

Transform and Apply schema for every client before saving into Hudi table.

Again, I want to say we save via Spark Dataframe. Do not want to Compact inline due to the volume of records.
But we are compacting via HoodieClient in a different Spark job for multiple tables every X min. As, I am not able to find a way using spark DF to run only Compaction.
Do you see any issue in saving via DF and concurrently running Compaction via HoodieClient?
Very soon, we will be doing the perf for Apache Hudi. Will keep you posted.

@tandonraghav : You need to make synchronize the compaction scheduling (not compaction execution) with spark DF write. You can then run compaction for scheduled compaction separately.
Just so that you are made aware of all things : Note that inline compaction does not need to run every single time you are ingesting data. You can set it to run every N commits but it will be inline when it runs (blocks writing)
Let me open a jira to support such a setup. We usually have folks running async compaction in delta-streamer continuous mode and in structured streaming (recently).  Async compaction in spark DF write or in deltastreamer run-once mode is generally not done as users need to setup separate compaction job.
Meanwhile, you can comment out the line  https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java#L724 to make inline compaction not run compactions but only schedule them. You can then use your writeClient code to run compactions. Let me know if this makes sense..

@tandonraghav : I just edited the comment above after reviewing 0.6.0 code. Please re-read the above comment to avoid any confusion

FYI : https://issues.apache.org/jira/browse/HUDI-1329

@bvaradar Yes, i am aware that Compaction need not run everytime and can run after X delta commits.
But Lets say I have done X-Y Delta commits and then there are no writes on the table for few minutes. Then how will you get Fresh Data from _ro (we are using Presto, so *_rt is not the option)
DeltaStreamer is not an option as we have multiple tables in same topic? I believe Streamer will not work for such a setup.

@bvaradar And you are saying in 0.6.0, if  I have given hoodie.compact.inline=false and hoodie.compact.inline.max.delta.commits=2 then the moment there are 2 delta commits it will schedule a Compaction timeline.
And then we can query compaction timeline and do all the compactions? Is this understanding correct?
And what about situation where we have only 1 delta commit for few time but we want fresh data in _ro after X minutes?

@tandonraghav : Can you elaborate on your expected event rate and what is your data-freshness SLA expectations ? Its possible that Copy-On-Write table would be good enough.
To your other question on data-freshness: Yes your understanding is correct. If you have sporadic incoming changes and have tighter data-freshness SLA, you can set hoodie.compact.inline.max.delta.commits=1 and run compactions at interval corresponding to your data-freshness req.

@bvaradar SLA ~ 15m for fresh data... and we can have around 10-30M updates/client..But this varies from client to client.
But we want to test for 50M/client and there can be X clients like that...
So,COW is not an option.
Also, i just tried with this config on HUDI 0.6.0
ds
                .write().format("org.apache.hudi").
                options(QuickstartUtils.getQuickstartWriteConfigs()).
                //option("hoodie.avro.schema",SchemaUtils.schemaMapper.get(dbName)).
                option(DataSourceWriteOptions.OPERATION_OPT_KEY(),DataSourceWriteOptions.UPSERT_OPERATION_OPT_VAL()).
                option(DataSourceWriteOptions.TABLE_TYPE_OPT_KEY(),DataSourceWriteOptions.MOR_TABLE_TYPE_OPT_VAL()).
                option(DataSourceWriteOptions.PRECOMBINE_FIELD_OPT_KEY(), "ts_ms").
                //option("hoodie.combine.before.upsert",false).
                option(DataSourceWriteOptions.RECORDKEY_FIELD_OPT_KEY(), "_id").
                option(DataSourceWriteOptions.PAYLOAD_CLASS_OPT_KEY(), MergeHudiPayload.class.getName()).
                option(DataSourceWriteOptions.PARTITIONPATH_FIELD_OPT_KEY(), "db_name").
                option(HoodieWriteConfig.TABLE_NAME, dbName).
                **option(HoodieCompactionConfig.INLINE_COMPACT_PROP,false).**
                option(DataSourceWriteOptions.HIVE_SYNC_ENABLED_OPT_KEY(),"true").
                option(DataSourceWriteOptions.HIVE_TABLE_OPT_KEY(), dbName).
                option(DataSourceWriteOptions.HIVE_PARTITION_FIELDS_OPT_KEY(),"db_name").
                option(DataSourceWriteOptions.DEFAULT_HIVE_ASSUME_DATE_PARTITION_OPT_VAL(),"false").
                **option(HoodieCompactionConfig.INLINE_COMPACT_NUM_DELTA_COMMITS_PROP,1).**
                option(DataSourceWriteOptions.ASYNC_COMPACT_ENABLE_OPT_KEY(),false).
                option(DataSourceWriteOptions.HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY(), MultiPartKeysValueExtractor.class.getName()).
                mode(SaveMode.Append).
                save(tablePath);

And i dont see any compactionTimeline requested (I checked inside folders). Am i missing something?
-rw-r--r--  1 raghav  wheel     0B Oct  9 14:33<PHONE_NUMBER>3322.deltacommit.requested
-rw-r--r--  1 raghav  wheel   1.6K Oct  9 14:33<PHONE_NUMBER>3322.deltacommit.inflight
-rw-r--r--  1 raghav  wheel   1.9K Oct  9 14:33<PHONE_NUMBER>3322.deltacommit
-rw-r--r--  1 raghav  wheel     0B Oct  9 14:34<PHONE_NUMBER>3417.deltacommit.requested
-rw-r--r--  1 raghav  wheel   1.6K Oct  9 14:34<PHONE_NUMBER>3417.deltacommit.inflight
-rw-r--r--  1 raghav  wheel   1.9K Oct  9 14:34<PHONE_NUMBER>3417.deltacommit

Can you cat the contents of<PHONE_NUMBER>3322.deltacommit and<PHONE_NUMBER>3417.deltacommit

@bvaradar I think the issue was -> option(DataSourceWriteOptions.ASYNC_COMPACT_ENABLE_OPT_KEY(),false). If i set this also to true. It is creating the compaction.requested.

@bvaradar Thanks for helping here. But still issue is not solved.
The Freshness of data is coming as a big concern. Probably i am missing something here.

If I run Compaction after every X min, we should get fresh data till X min. (irrespective of number of delta commits)

Putting Inline.compact=false and delta.commits=1 and async.compact=true, is not helping out this is generating Compaction request only for 1 delta commit.
If a compaction request exists then it is not generating compaction request after every df.write().

Also, as suggested we cannot run df.write() and  Option<String> instantTime=client.scheduleCompaction(Option.empty()); concurrently.

The problem still remains same tht if I have delta.commits=5 and i have only 3 delta commits and I run compaction then i would not get fresh data and compaction request would not even kick in.
How do i solve this problem?

@tandonraghav : It is by design that a "file" which is pending compaction is not scheduled for compaction till the compaction is done.
One another knob is the strategy for selecting files for compaction Scheduling which is also pluggable.  For example :  You can implement your own CompactionStrategy to prioritize files belonging to "hot" partitions and keeping the number of files per compaction to be less.
Basically, You need to run compactions at higher frequencies and keeping  delta.commits=1 if you are trying to optimize for data-freshness but want to use Read-Optimized queries.

@bvaradar Thanks for the update.


[FEATURE ASK] Provide general encryption and decryption method

MSAL extension should provide encrption/decryption methods for general purpose, it may look like:
	byte[] Encrypt(SecureString ); //or return as base64 string?
	SecureString Decrypt(byte[] );

Besides token info, we want to protect client secret of service principal as well, currently in Azure PowerShell client secret of service principal is saved as plain text which doesn’t meet secret review. MSAL extension for Python has provided similar functionality, you may find the sample code here

@bgavrilMS : this ask is dependent on the API review that Ray has out.

@henrik-me. There is a partner ask for this one: Epic 1396293: Provide general encryption and decryption method
Is it something we want to take in Q1?
cc: @bgavrilMS @maliksahil

I propose we close it.

you mean we reject the partner request @bgavrilMS ?

Is it not a valid requirement?

We'll provide it part with the token cache serializers in MIcrosoft.Identity.Web;
See https://github.com/AzureAD/microsoft-identity-web/issues/1044

This is not for confidential client apps @jmprieur, this is for public client apps.
I think we should expose the storage primitives, similar to how Msal.py do it?

yes, this sounds good, @bgavrilMS

Included in MSAL.NET Extensions 2.19.0 release.


feat: Benchmarking tool

Merge branch 'googleapis:main' into perf-benchmarking

Please don't merge into your feature branch - instead, fetch the main branch and then rebase your feature branch from it.
For example:
$ git checkout main
$ git pull upstream main
$ git checkout perf-benchmarking
$ git rebase main
$ git push -f

Done.


Jetty metrics configuration option

The HTTP component could support a configuration option for enabling "free" Jetty metrics from instrumented implementations of key interfaces via metrics-jetty9. An example configuration.

Hi @marsmining, looks like you didn't get a response. Adding @dryewo for his thoughts. If he's supportive of the idea, would you be willing to make a PR?

Brandon, please go on and make a PR. It looks like a nice feature.


Logstash_writer role does not have permission to logstash index

Problem description
When running the docker-compose with elastic stack version 7.17.0, the permissions defined in the role defined on /setup/roles/logstash_writer.json are not complete. This makes logstash throw an error when connecting to elasticsearch.
In order to fix the issue, the role must be provided with access to the "logstash" index as well.
Stack configuration
ELASTIC_VERSION=7.17.0
Docker setup
Docker version:
Client: Docker Engine - Community
 Version:           20.10.12
 API version:       1.41
 Go version:        go1.16.12
 Git commit:        e91ed57
 Built:             Mon Dec 13 11:45:27 2021
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.12
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.16.12
  Git commit:       459d0df
  Built:            Mon Dec 13 11:43:36 2021
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.4.12
  GitCommit:        7b11cfaabd73bb80907dd23182b9347b4245eb5d
 runc:
  Version:          1.0.2
  GitCommit:        v1.0.2-0-g52b36a2
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

Docker compose version
docker-compose version 1.29.2, build 5becea4c
docker-py version: 5.0.0
CPython version: 3.7.10
OpenSSL version: OpenSSL 1.1.0l  10 Sep 2019

@panos-indev thanks for investigating this.
First of all, a word of advice: the release-7.x branch doesn't have the setup service and is using the elastic user to connect to Elasticsearch by default.
I do not recommend using the main branch to run the v7 release version of the Elastic stack as some configuration settings may differ.
With that being said, you're raising a good point. We probably should use the setup service to initialize v7 too, as we want people to use unprivileged users as much as possible.
I'll work on enabling the setup service on the release-7.x branch and incorporate your recommendation 🙌

Related: https://github.com/elastic/logstash/issues/10722


Fix Systems For Async Colliders

This is a quick little fix to adjust which systems get added for the async colliders. Tested it with and without the feature and it seems to be working perfectly in headless with these changes.
I'm not 100% sure if these systems that I've adjusted all require being after Bevy's transform_propagate_system so I've just retained the order as if init_async_colliders was still there.
Resolves the problem mentioned here:
https://github.com/dimforge/bevy_rapier/pull/306#issuecomment-1383206963

Can we get this merged anytime soon?

Can we get this merged anytime soon?

Forgot about this pull request, will fix the conflicts so hopefully it can be merged at some point.

That should do it, if there are any issues with the way that I'm conditionally adding systems let me know.

Closing since this problem should be fixed by: https://github.com/dimforge/bevy_rapier/pull/373


hca upload files using a lot of cpu/memory

I was using hca upload files * to upload about 80GB of fastq files (16 files) from my local machine to an upload area. During the transfer, I experienced significant slowdown of everything else running on my machine. I don't remember experiencing this slowdown before, although I haven't had to transfer files from a local source in a while. It looks like my machine was maxed out on CPU usage (screenshots below). Wondering if this is normal or expected behavior? It doesn't seem ideal...
During transfer:

After transfer:

I'm guessing this is because the CLI is now doing client-side checksumming?  @maniarathi do you stream the file while checksumming or attempt to read it into memory?

So I did actually test the memory footprint of this a while back and the memory was 64MB which is what is expected given that it streams it in that sized chunks.

@malloryfreeberg how much memory was consumed?  Alas your Activity monitor screenshots don't show that.

As for CPU, I expect that simultaneous checksumming of several files will be quite CPU intensive.  Does it limit parallelization?  It looks like it does, based on the number of cores you have (DEFAULT_THREAD_COUNT = multiprocessing.cpu_count() * 2).  On machine machine cpu_count() returns 8, so that means it is trying to checksum all 16 files simultaneously.  That's a bad thing.
There are several ways to fix this:

parallelize less aggressively - reduce thread count
provide a command line option to limit parallelism further
calculate checksums in-line while uploading, which will limit the parallelism based on your available bandwidth.

I realize # 3 doesn't work well with the current architecture, as client-side and server-side checksums are compared before upload starts.  I wish there was a more efficient way to decide whether to upload or not.
We should probably do # 1 and #2.

@sampierson @maniarathi I unfortunately did not grab memory usage during this time. I can reproduce, but I'll have to download the files to my local machine again :( Stay tuned!

@malloryfreeberg Don't bother.  I think we know what the culprit is.  I think the problem is CPU not memory.


How do I run multiple platforms and show the results for each platform?

Hi, I am interest in running the benchmark tests on Linux, Mac and Windows and have the results display for individually. May you tell me if that's possible and how to do that? Thank you.

Currently this action does not support multiple platforms in single page by default.
There are 2 options:

Prepare separate page for each platform like /dev/bench/macos/index.html. Separate benchmark jobs per platforms and specify different benchmark-data-dir-path (e.g. /dev/bench/macos for macOS and /dev/bench/windows for Windows). You can see the benchmark results in separate page per platform.
Separate benchmark jobs per platforms and specify different benchmark-data-dir-path (e.g. /dev/bench/macos for macOS and /dev/bench/windows for Windows). Then write up your own /dev/bench/index.html in your gh-pages branch. The HTML file should load JS files for all platforms (/dev/bench/macos/data.js, /dev/bench/windows/data.js) and draw your favorite graph based on loaded benchmark results data.

If 1. meets your requirements, I recommend 1. since it's easier.

Thank you for the quick reply. Solution 1 sounds good.

Benchmarking by platform may be relatively easy by manually creating the directory like "macos" for one time. If we want to benchmark by os version, and arch, there would be friction for users to create the directories by themselves, as the directory is required to be pre-created by users. Especially it will add operational cost when users add new os version and sunset old versions.
Is it better if we support something like label for users to specify? So "" directory will be auto-created by the action. @ktrz

with something like benchmark-data-dir-path: '/dev/bench/${{ matrix.go-version }}' I get: Error: EACCES: permission denied, mkdir '../../../../../dev/bench'.


The num_train_epochs parameter of AdaptationArguments() does not correspond to trainer behavior

If I specify num_train_epochs in my AdaptationArguments, the training ends at 4% (1/25th) of the specified number of epochs:
from math import ceil
from pathlib import Path

from adaptor.lang_module import LangModule
from adaptor.objectives.MLM import MaskedLanguageModeling
from adaptor.schedules import SequentialSchedule
from adaptor.adapter import Adapter
from adaptor.utils import AdaptationArguments, StoppingStrategy

batch_size: int = 48
effective_batch_size: int = 256

dataset: Path = Path('dataset-text+latex.txt')
input_model_dir: Path = Path('./roberta-base-text+latex/')
objective_dir: Path = Path('./tuned-roberta-base-text+latex.MLM-objective/')
output_model_dir: Path = Path('./tuned-roberta-base-text+latex/')

gradient_accumulation_steps = int(ceil(1.0 * effective_batch_size / batch_size))

lang_module = LangModule(str(input_model_dir))
objectives = MaskedLanguageModeling(lang_module, batch_size=batch_size,
                                    texts_or_path=str(dataset))
training_arguments = AdaptationArguments(output_dir=str(objective_dir),
                                         stopping_strategy=StoppingStrategy.FIRST_OBJECTIVE_CONVERGED,
                                         evaluation_strategy='steps', do_train=True, do_eval=True,
                                         gradient_accumulation_steps=gradient_accumulation_steps,
                                         logging_steps=1000, eval_steps=1000, num_train_epochs=1)
schedule = SequentialSchedule([objectives], training_arguments)
adapter = Adapter(lang_module, schedule, training_arguments)

adapter.train()  # wait a few hours here
adapter.save_model(str(output_model_dir))

MaskedLanguageModeling:   4%| | 6000/152572 [56:18<22:55:24,  1.78batches/s, epoch=1, loss=3.56, split=
Scheduler reached the given maximum number of epochs for all objectives. Triggering termination.
Scheduler reached a termination condition: ALL_OBJECTIVES_NUM_EPOCHS
{'train_runtime': 3367.1729, 'train_samples_per_second': 45.312, 'train_steps_per_second': 7.552, 'train_loss': 4.1629501953125, 'train_MaskedLanguageModeling_loss': 3.0827627918720246, 'train_MaskedLanguageModeling_num_batches': 1000, 'epoch': 0.04}

Setting num_train_epochs to 25 times the desired number of epochs solves the problem for me, but I am not sure why.

@stefanik12 I found the source of the issue. It's an off-by-one error:
https://github.com/gaussalgo/adaptor/blob/cc6334c02074e220e2d5b4a9b7084007d7e6bece/adaptor/schedules.py#L88-L89
The comparison should be > rather than >=. Currently, if self.args.num_train_epochs == 1, then the training will stop as soon as _objective_passed_epochs is called, because objectives always start with epoch == 1:
https://github.com/gaussalgo/adaptor/blob/cc6334c02074e220e2d5b4a9b7084007d7e6bece/adaptor/objectives/objective_base.py#L285


Helm does not create external workload secrets

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
After installing Cilium and configuring Cilium clustermesh using Helm cilium clustermesh vm commands are failing with an error message:
Error: Unable to determine status: unable to get secret "clustermesh-apiserver-client-certs" to access clustermesh service: secrets "clustermesh-apiserver-external-workload-certs" not found
This happens because Cilium Helm chart does not create external workload secrets. I've tested cronJob and helm certificate provisioning methods.
Cilium Version
1.12.1
Kernel Version
5.4.0-81-generic
Kubernetes Version
1.24
Sysdump
No response
Relevant log output
No response
Anything else?
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Currently, helm chart didn't support external workload VM, hence it's probably why the mentioned secret is missing.
I am not sure how difficult it is to port logic from cilium-cli to helm chart to support ExternalWorkload VM though.


docs: Links to TRPC documentation in the TRPC section of create t3 docs are broken.

Provide environment information
N/A
Describe the bug
In the TRPC Section of the  Create T3 docs, all links to trpc.io are broken, and lead to a "not found page".
Reproduction repo
NA
To reproduce
N/A - issue is with live docs page.
Additional information
No response

Some are still not working. I make a PR here - https://github.com/t3-oss/create-t3-app/pull/1946
@literallyJoel  @juliusmarminge


Upgrade to jest v24-26 and babel to version 7

Because or Jest version is v23 we have vulnerabilities caused by yargs-parser.
We tried to fix it by using the resolutions, this introduced more problems. Also, resolutions are patches and not a solution.
linked issue: https://github.com/facebook/jest/issues/7424
This vulnerability has been fixed in jest v24>
Jest version 24 uses Babel 7:
https://jestjs.io/blog/2019/01/25/jest-24-refreshing-polished-typescript-friendly#typescript-support
But we use a previous version that is not compatible with jest v24.
To fix this problem properly we should consider upgrading jest to v24 or higher and babel to version 7.

Also related to #123 I think.


[connector-file-local][feature] add save mode function for localfile

Purpose of this pull request
add save mode function for localfile
Does this PR introduce any user-facing change?
NO
How was this patch tested?
add unit test
Check list

[x] add save mode function for localfile

add doc

cc @TyrantLucifer as well.


Add retries when calling TokenCredentialRequest from "pinniped login [...]" commands.

The retries are still fairly conservative (retry.DefaultRetry is 5 tries over roughly 50ms).
We see this condition come up occasionally in test runs, for example: https://hush-house.pivotal.io/teams/tanzu-user-auth/pipelines/pinniped-pull-requests/jobs/integration-test-1.19/builds/250.1#L60509ee3:474:486
Release note:
Added retry logic when making Concierge API requests from "pinniped login [...]" commands.

Codecov Report

Merging #502 (8e878fc) into main (d85135c) will increase coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #502      +/-   ##
==========================================
+ Coverage   78.49%   78.51%   +0.02%
==========================================
  Files         110      110
  Lines        5393     5399       +6
==========================================
+ Hits         4233     4239       +6
  Misses        997      997
  Partials      163      163

Impacted Files
Coverage Δ

pkg/conciergeclient/conciergeclient.go
98.14% <100.00%> (+0.10%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d85135c...8e878fc. Read the comment docs.


Connect to Telethon/Telegram

Hello, I am trying to use Telepathy, but after entering, telephone - API ID and API HASH I am asked :
Please enter your phone (or bot token):
I don't know what to enter and I haven't received anything more than the web connection code in my telegram application.
Thx in advance

Sorry, I made a mistake the firsts two time with my phone number
All is good
I had to re-enter my phone number and received a code on Telegram app


throttler: MaxReplicationLagModule: Distinguish between replicas.

@alainjobart This is ready for review now.

LGTM overall. I concentrated on the logic, not nitpicking. :)


Add verbose documentations

Add documentation for most of the public stuffs
Rename <P, Q> to <Req, Resp> to be clear.
Add #[doc(hidden)] for those internal methods used only in benchmark or tests.
rpc -> RPC, grpc -> gRPC.

PTAL @Hoverbear @overvenus

@CaitinChen You are lovely!! Thanks a lot. I will fix these gramma issues.

@breeswish  You are welcome. You are also lovely!! "fix grammar" not "fix grammas"

@Hoverbear @overvenus PTAL


stageX / Y not initialized in manually dispatched MouseEvent

Tested with OpenFL 4.2.0 and Lime 3.2.1.
import openfl.events.MouseEvent;
import openfl.display.Sprite;

class Main extends Sprite {
	public function new() {
		super();
		stage.addEventListener(MouseEvent.MOUSE_MOVE, onMouseMove);
		stage.dispatchEvent(new MouseEvent(MouseEvent.MOUSE_MOVE,
			true, false, 1, 2, stage, false, false, false));
	}

	function onMouseMove(e) {
		trace(e.stageX, e.stageY);
		stage.removeEventListener(MouseEvent.MOUSE_MOVE, onMouseMove);
	}
}

On Flash, the output is 1,2 like expected.
On Cpp, it's 0,0.
On Neko, it's null,null, which is especially problematic because of invalid operation errors when the values are used for calculation (this is how I noticed the problem). Same on HTML5.
So it looks like e.stageX / Y are simply uninitialized.

This is kind of a strange behavior, but we'll copy it 😕


A slight typo in a line of controller code on the demo site: EditableTableCtrl

In the sub-function : app.controller('EditableTableCtrl', function($scope, $filter, $http, $q) {
When the line is saved - it should say       results.push($http.put('http://<IP_ADDRESS>:3001/api/Tblbudgetxypoints', newuser));      //you had $http.push
For a noob - this took an hour to figure out. Learned lots about rest and strongloop - but… alas - thanks for the code so far. It has taught me a lot. Thanks for posting all that.

I think this can be closed.  I no longer see any references to $http.push in the documentation.


Last word in text doesn't appear

I have an issue that while using the package it's working very well, but there's an issue that the last word in text doesn't appear since I change the state it appear
here's a video that explain what I mean
TypeWriterText : what's your name how are you
first time it was what's your name how are
then when state changed it gone to be what's your name how are you
https://github.com/Nialixus/typewritertext/assets/46425858/17182c12-6c20-4067-ba59-719cc1b724e0
this is my code
TypeWriterText(
      text: Text(
        text,
        textAlign: TextAlign.left,
        style: TextStyle(
            fontSize: 11.sp,
            fontWeight: FontWeight.w400,
            height: 2,
            color: AppColors.whiteColor),
      ),
      duration: const Duration(milliseconds: 5),
    )

@sayedmoataz I checked source code. find out every character is shown, but by default TypeWriterText.maintanSize is true. I believe text was overflowed,  hide by the TextOverflow.hide. so, set maintanSize: false to TypeWriterText , everything work fine.

It's hard to reproduce this issue without seeing the full code.
Theoretically:

This happens because the parent widget rebuilds its descendants. The parent needs to wait to change its state until the TypeWriterText finishes using the onFinished function.

When the parent changes state, it skips some frames where the descendant is supposed to display each character, causing it to leap to the last line due to the state change.

It would be very helpful if you could provide the full code from that page.


Add more labels to issues and pull requests

Because it's a very open project, can we still use those labels?

WIP
Review needed
Review done
Change needed
Feedback integrated
Rebase needed
Merge only on release
Ready to merge
External contribution

You may need more that I don't use. So go ahead.
I was wondering if you had considered and discarded that or if this can still be done.

I am not sure we need the following as this can already be managed by information provided by github (at list in the PR lists)

Review needed --> Review required
Ready to merge --> Approved
Change needed --> Require changes
Review done --> approved or require changes

As per team decision, I have removed the labels described above.


Is PMS still maintained or has been abandoned?

As of now, it doesn't work.

Right click and click open instead of double clicking. If that doesn't work it's probably in quarantine. Take it out by running this command in terminal: xattr -c /Applications/PimpMyStremio


Version 1.5 OSX Portable not displaying App Window on Sierra

Expected Behavior

The app should show a window of some kind with options and menu.
Current Behavior

The app launches without crashing but no window or dialog appear. The only option in the top menu bar below Mongoclient is 'Quit'.
Your Environment

Mongoclient version used: 1.5.0 Portable OSX version file: v0.35.6
Environment name (e.g. chrome 39, portable, docker): Portable
Operating System and version (e.g. windows 10, ubuntu 16, osx 10.12):OSX 10.12.3

Hello @FrancisJMR,
can you please try to run it from the terminal like:
/path/debug/build/MyProgram.app/Contents/MacOS/MyProgram
I'm aware 1.5.0 portables has similar issues, I'm going to try to fix this with 2.0.0, thanks for the feedback.
#322 related.
Cheers

Good idea and yes that worked running:
$ Downloads/osx-portable/Mongoclient.app/Contents/MacOS/Electron
Maybe it's a problem related to the packaging.
No problems form the command line but here's the output anyways:
INFO  electrify:index:  initializing
INFO  electrify:plugins:  use  mongodb
INFO  electrify:plugins:  use  nodejs
INFO  electrify:plugins:  use  socket
[warn] kq_init: detected broken kqueue; not using.: Undefined error: 0
[warn] kq_init: detected broken kqueue; not using.: Undefined error: 0
[warn] kq_init: detected broken kqueue; not using.: Undefined error: 0
[warn] kq_init: detected broken kqueue; not using.: Undefined error: 0
INFO  electrify:index:  start
INFO  electrify:plugins:  start
INFO  electrify:plugins:mongodb:  starting mongo...
2017-03-23T14:41:34.182-0400 I CONTROL  [initandlisten] MongoDB starting : pid=85550 port=11235 dbpath=/Users/pb/Downloads/osx-portable/Mongoclient.app/Contents/Resources/app/db 64-bit host=prdbrt.local
2017-03-23T14:41:34.182-0400 I CONTROL  [initandlisten] db version v3.2.11-39-g1c43b90
2017-03-23T14:41:34.182-0400 I CONTROL  [initandlisten] git version: 1c43b90c0483bc7574fecd0eaeee610480cc9217
2017-03-23T14:41:34.182-0400 I CONTROL  [initandlisten] allocator: system
2017-03-23T14:41:34.182-0400 I CONTROL  [initandlisten] modules: none
2017-03-23T14:41:34.183-0400 I CONTROL  [initandlisten] build environment:
2017-03-23T14:41:34.183-0400 I CONTROL  [initandlisten]     distarch: x86_64
2017-03-23T14:41:34.183-0400 I CONTROL  [initandlisten]     target_arch: x86_64
2017-03-23T14:41:34.183-0400 I CONTROL  [initandlisten] options: { net: { bindIp: "<IP_ADDRESS>", port: 11235 }, storage: { dbPath: "/Users/pb/Downloads/osx-portable/Mongoclient.app/Contents/Resources/app/db", mmapv1: { smallFiles: true } } }
2017-03-23T14:41:34.183-0400 I -        [initandlisten] Detected data files in /Users/pb/Downloads/osx-portable/Mongoclient.app/Contents/Resources/app/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2017-03-23T14:41:34.183-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=4G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2017-03-23T14:41:35.605-0400 W STORAGE  [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger
2017-03-23T14:41:35.609-0400 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/Users/pb/Downloads/osx-portable/Mongoclient.app/Contents/Resources/app/db/diagnostic.data'
2017-03-23T14:41:35.609-0400 I NETWORK  [HostnameCanonicalizationWorker] Starting hostname canonicalization worker
2017-03-23T14:41:35.611-0400 I NETWORK  [initandlisten] waiting for connections on port 11235
INFO  electrify:plugins:mongodb:  mongo started
INFO  electrify:plugins:socket:  starting socket
2017-03-23T14:41:35.612-0400 I NETWORK  [initandlisten] connection accepted from <IP_ADDRESS>:54544 #1 (1 connection now open)
2017-03-23T14:41:35.614-0400 I NETWORK  [conn1] end connection <IP_ADDRESS>:54544 (0 connections now open)
SockJS v0.3.18 bound to "/electrify"
INFO  electrify:index:  socket listening at 11236
INFO  electrify:plugins:nodejs:  starting meteor...
2017-03-23T14:41:35.627-0400 I NETWORK  [initandlisten] connection accepted from <IP_ADDRESS>:54546 #2 (1 connection now open)
2017-03-23T14:41:35.627-0400 I NETWORK  [conn2] end connection <IP_ADDRESS>:54546 (0 connections now open)
2017-03-23T14:41:36.819-0400 I NETWORK  [initandlisten] connection accepted from <IP_ADDRESS>:54583 #3 (1 connection now open)
2017-03-23T14:42:16.927-0400 I CONTROL  [signalProcessingThread] got signal 15 (Terminated: 15), will terminate after current cmd ends
2017-03-23T14:42:16.927-0400 I FTDC     [signalProcessingThread] Shutting down full-time diagnostic data capture
2017-03-23T14:42:16.929-0400 I CONTROL  [signalProcessingThread] now exiting
2017-03-23T14:42:16.929-0400 I NETWORK  [signalProcessingThread] shutdown: going to close listening sockets...
2017-03-23T14:42:16.929-0400 I NETWORK  [signalProcessingThread] closing listening socket: 10
2017-03-23T14:42:16.929-0400 I NETWORK  [signalProcessingThread] closing listening socket: 11
2017-03-23T14:42:16.930-0400 I NETWORK  [signalProcessingThread] removing socket file: /tmp/mongodb-11235.sock
2017-03-23T14:42:16.930-0400 I NETWORK  [signalProcessingThread] shutdown: going to flush diaglog...
2017-03-23T14:42:16.930-0400 I NETWORK  [signalProcessingThread] shutdown: going to close sockets...
2017-03-23T14:42:16.930-0400 I NETWORK  [conn3] end connection <IP_ADDRESS>:54583 (0 connections now open)
2017-03-23T14:42:16.932-0400 I STORAGE  [signalProcessingThread] WiredTigerKVEngine shutting down

Probably its about packaging, thanks for sharing the output will take a look asap.

Hello @FrancisJMR
can you check again with the newest release ?

Looks like it works. Thank you.


Question: Moving DataProcessor.with() and DataProcessor.fill()

DataProcessors appear to be primarily intended for moving DataManipulators in and out of DataHolders. However, there are two methods that aren't related to this, and they can be annoying for modders who want to integrate with Sponge:

Optional<I> with(Key<? extends BaseValue<?>> key, Object value, I immutable);
Optional<M> fill(DataContainer container, M m);

Could they be moved to the DataManipulator classes?

Optional with(Key> key, Object value, I immutable);

Is used here.
And fill is used as a delegate for building data. The only thing people have to do is just return Optional.empty() since they can safely ignore them. This isn't hard to do and this is why multi-processor handling does what it does, the first processor (usually sponge) will return a non-empty Optional. The rest can safely just return empty and be on their merry way.

Thanks for clarifying.


[Bug]: The ClusterRoleBinding "system-upgrade" is invalid

Description
Got
The ClusterRoleBinding "system-upgrade" is invalid: roleRef: Invalid value: rbac.RoleRef{APIGroup:"rbac.authorization.k8s.io", Kind:"ClusterRole", Name:"system-upgrade-controller"}: cannot change roleRef

When applying with latest version on existing cluster.
Kube.tf file
did not change between applys

Screenshots
No response
Platform
Linux

Previous working version was v2.14.6

Same here when upgrading from 2.15.0 to 2.15.3

The system-upgrade-controller manifests have changed. Maybe we need those two manifests to be added to the kustomization too:
https://github.com/rancher/system-upgrade-controller/blob/master/manifests/clusterrolebinding.yaml
https://github.com/rancher/system-upgrade-controller/blob/master/manifests/clusterrole.yaml
The same way that crd.yml was added. If someone can test this and shoot a PR, it would be super appreciated.

Folks, brand new clusters work well now with the version. For upgrade, in case you experience issues:
kubectl delete -f https://raw.githubusercontent.com/rancher/system-upgrade-controller/9e7e45c1bdd528093da36be1f1f32472469005e6/manifests/system-upgrade-controller.yaml
Cleanup the old one. Then upgrade!


pass error message separately

This PR changes the way error messages are passed to the frontend. In the past the HTML was sent from the backend but now it is passed separately in the JSON response.
@graceguo-supercat @michellethomas

Codecov Report

Merging #5194 into master will decrease coverage by <.01%.
The diff coverage is 40%.

@@            Coverage Diff             @@
##           master    #5194      +/-   ##
==========================================
- Coverage   63.46%   63.45%   -0.01%
==========================================
  Files         261      261
  Lines       19835    19838       +3
  Branches     1992     1995       +3
==========================================
  Hits        12589    12589
- Misses       7237     7240       +3
  Partials        9        9

Impacted Files
Coverage Δ

...perset/assets/src/components/StackTraceMessage.jsx
58.33% <25%> (-6.67%)
:arrow_down:

superset/views/core.py
74.66% <33.33%> (+0.01%)
:arrow_up:

superset/views/base.py
66.89% <66.66%> (-0.24%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 66ffcb6...7fa5559. Read the comment docs.


Custom Logging Format

Summary
This pull request adds support for custom logging formats to LemLib.
Motivation
This pull request is being created to make it possible for users to make graphical debuggers for odometry and PID. The new format API allows the user to customize LemLib's logging output to whatever their needs are.
Test Plan
The code needs to be run on a bot and each of the new logging methods need to be tested, along with changing the format.
Additional Notes
This PR is completely untested, and is therefore likely to change. I'd also like to give the user control over the refresh rate of the logger, but I need to do more testing to figure out how that will work.
This pull request is also completely undocumented. I will get that done as soon as I finish testing.

This PR has been now tested and works. The only thing that I'm unsure about it the way that other parts of the program access the logger. Currently I have a globally defined object defined the the logging header, but I don't know if this is a good idea.
A viable alternative could be making the user define the logger, and then taking a pointer to it in the chassiss's constructor. Note that this would also require taking it as input in the FAPID constructor as well.


modified versions of KB and K8S

Bump k8s and KB dependencies in java-operator-plugins

@laxmikantbpandhare after you bump these dependencies, can you run go mod tidy.

Yes, I did this.

@laxmikantbpandhare I'm not sure if the CI has e2e tests. Can you verify if everything works as expected after the version bump. Just for a final verification before merging the PR, since C-R 0.9+ has quite a few breaking changes.

@laxmikantbpandhare I'm not sure if the CI has e2e tests. Can you verify if everything works as expected after the version bump. Just for a final verification before merging the PR, since C-R 0.9+ has quite a few breaking changes.

I verified using memcached operator. I was able to scaffold an operator using init and create api command. The operator is compiled and ran successfully.

/lgtm


Fix react-dom/server module name

ReactDOMServer is found in react-dom, it's not its own package.
https://facebook.github.io/react/blog/2015/10/07/react-v0.14.html#major-changes
https://facebook.github.io/react/docs/top-level-api.html#reactdomserver

Or maybe we should release a standalone react-dom-server package? cc: @zpao

Don't really want to at this point, they go together.

@zertosh Test plan? Did you try this?

@samwgoldman: Yup, I copy-pasted this updated file into a project then:
[ignore]
.*/node_modules/react/.*
.*/node_modules/react-dom/.*

[libs]
# the updated flow.js from this pr
./react-flow.js

[version]
0.20.1

And ran flow on:
/* @flow */
var React = require('react');
var ReactDOMServer = require('react-dom/server');
class Component extends React.Component {
  render() {
    return <div />;
  }
}
// ok
var html1: string = ReactDOMServer.renderToString(<Component />);
// error
var html2: number = ReactDOMServer.renderToString(<Component />);

Saw these results:
$ flow check
index.js:16
 12: var html2: number = ReactDOMServer.renderToString(<Component />);
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ call of method `renderToString`
 12: var html2: number = ReactDOMServer.renderToString(<Component />);
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ string. This type is incompatible with
 12: var html2: number = ReactDOMServer.renderToString(<Component />);
                ^^^^^^ number

Found 1 error

Excellent—thank you!
@facebook-github-bot import


Fix: iec61853 module model errors

I found a handful of errors/typos in the iec61853 moduel model that were significantly affecting results and corrected them. I also changed the IAM model to consider sky and ground diffuse effects using the same approach as the cec and mlm models.

Great, thanks for fixing those errors! I'll take a look at these.


Refs 101: update commit format

Changes the commit format such that:

A jira card is now required
You can use Refs or Fixes to indicate if a PR
is related to or fully fixes a card
Adds a github action to validate PR Title

updated to drop the '#' symbol, as that can cause confusion since github interprets '#num' as a link to a pr

https://issues.redhat.com/browse/HMSCONTENT-101

This task currently requires qe-approval, but this PR does not fully resolve the task.  Please contact QE to determine appropriate testing required.

https://issues.redhat.com/browse/14709226


Eliminate Warnings in Browser and Tests

We should investigate eliminating any remaining warnings (such as from npm run test or browser debug console) once #244 is complete.
Subtasks

[ ] #425
[ ] #426

@tuckerzp Yeah that message appears in the logs. I'd look at the MUI update https://github.com/EasyDynamics/oscal-react-library/runs/6812426449?check_suite_focus=true#step:7:239

@tuckerzp specifically mui/material-ui#33134 should resolve these new warnings and hopefully the next update to the mui/labs package will take care of that new warning

MUI v5.8.4 has been released which has a fix for that set of forwardRef issues. Hopefully our bot picks up that change at ~8:30 ET today.

#414 fixed the additional error!

@rgauss good to move over?


Pr publish imu transform

Added feature to publish IMU transform in both ros and ros2. I added a boolean to the BridgePublisher that will allow publishing IMU without listening to the IMU message topic and to not force publishing the message if it is not being listened to. The boolean to publish the TF transform as well as the IMU frame and world frame are passed to the imuConverter object and initialized in the constructor. Once running, the flag in the BridgePublisher will cause the converter toRosMsg function to be called in order to publish the transform but not published.

Hello,
Thanks for the PR.
But I don't quite get why does a sensor package need to publish the TF of the orientation message ?

Hello,
Thank you. For me it is useful in debugging/checking a sensor setup for a robot. Publishing a transform directly from the sensor transformed into the base_link helps identify the correct static transform for the connection of the camera to the physical base_link of all the sensors.

Currently, I had to disable the magnetometer for better sync published for Gyro and accelerometer. And the actual transform you added needs to go in the Nav/localization stack where you receive this IMU sensor and determine which direction your bot is oriented or update it. And since most open-source libs will have it included on the other side to do this using the sensor data. It would be redundant and not the right place as per my understanding. Feel free to correct me if I'm wrong here.

I'm closing this PR since it is out-of the scope for a Device driver.
And I would be happy to discuss more on the PointCloud update we were discussing.
Feel free to ping me if I had missed any mail on that.

hi @kaiden8 does this publish transform from the oak_imu frame to oakd_frame ? I am also interested to get tf between frames

so this PR has compatibility issues with the current depthi implementation.
interMsg has linear_acceleration and angular velocity @saching13 , how would one get the orientation and translation ?
thank you

so this PR has compatibility issues with the current depthi implementation.
interMsg has linear_acceleration and angular velocity @saching13 , how would one get the orientation and translation ?
thank you

Write a subscriber which converts it to odomwtry.


MTextFormattingOptions fails to report Bold, Italic or UnderLined properties when passes a TextStyle object

It appears that the MTextFormattingOptions instance fails to report the properties of a TextStyle obtained from an MText entity. I have bold and italic MText entities and when I pass the TextStlye enitity extracted from the MText into the MTextFormattingOptions, the Bold and Italic properties report false.
I attach a sample file which demonstrates the problem.
Text that is bold and italic.zip

Yes, when both the font file name and the font information in the extended data (font family name and font style) of the TextStyle are present the font style was not being applied. After running a couple test, there is no information about the extended data in the TextStyle in the DXF official documentation, the font information always takes precedence over the font file value.
Therefore, I will also modify the TextStyle class to use the font file or the font family name plus the font style, but not both. to avoid having a font family with an style that do not correspond with the font file.

Thanks for confirming - also thanks for the library, its awesome. For the timebeing I am using the raw XData to eastablish if the text is bold and/or italic but I look forward to your update. Also, it seems Underline property also doesn't work - I couldn't find any XData which refers to this property however.

The code is already updated.
There is no option in the TextStyle for underline texts, however you can use the MText entity together with the MTextFormattingOptions, something along these lines:
TextStyle style = new TextStyle("Arial", FontStyle.Regular);
MText text = new MText() {Height = 10, Style = style};
MTextFormattingOptions format = new MTextFormattingOptions() {Underline = true};
text.Write("Sample text", format);

I suppose that AutoCAD internally requires to read the actual font file that corresponds to a given font family and font style to know its geometry, and if there is no file, it cannot draw a text with those options. Imagine that you have a font family "A", if that family does not have a file to represents, Bold for example, there will be no available font "Bold A". I am talking about the different font variations installed in your system not the font styles of the NET enum FontStyle.
The only way that I know to get the different variations of a font family and its corresponding font file is through the system registry, but at the moment I do not want to mess with it. So, the FontStyle enum shows the common options, but it will be your responsibility to know that a specific style is available for a given font family.
Autodesk is to lazy to provide a proper DXF documentation, there are too many things that I have to guess by pure trial and error, so problems may arise.

Fixed in netDxf 2.3.0

Thanks Daniel, appreciated. I looked at the font registry technique myself, but it doesn't yeild the variants of a font, just the main font file. I saw some ways of doing it via StackOver flow but it was outside of the scope of my project so I didn't attempt to implement it - needless to say, I don't blame you for not going near it at this point in time.


APIView - Replace connection string with managed identity

APIView uses connection strings to authenticate against storage and cosmos. Change is required to use managed identity to connect to these resources instead of connection strings.

Duplicate of #8312


Added tests for summarize_manifest_files task

Codecov Report

Merging #24 (0e3b159) into main (a7afb32) will increase coverage by 14.36%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##            main      #24       +/-   ##
==========================================
+ Coverage   2.34%   16.71%   +14.36%
==========================================
  Files         31       31
  Lines        341      341
==========================================
+ Hits           8       57       +49
+ Misses       333      284       -49

Impacted Files
Coverage Δ

...er_collection/manifest/summarize_manifest_files.py
100.00% <100.00%> (+100.00%)
:arrow_up:

...ner_collection/manifest/find_missing_conditions.py
26.66% <0.00%> (+26.66%)
:arrow_up:

...ainer_collection/manifest/filter_manifest_files.py
27.58% <0.00%> (+27.58%)
:arrow_up:

...er_collection/manifest/update_manifest_contents.py
28.57% <0.00%> (+28.57%)
:arrow_up:

src/container_collection/manifest/__init__.py
100.00% <0.00%> (+100.00%)
:arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Extension doesn't work on remote workspaces

The extension works great on local workspaces (thanks!!!).
On remote workspaces I get the following error:
Could not copy GitHub URL: Git extension not installed or not activated yet!
I confirmed that the builtin git extension is installed globally.
This is true for multiple workspaces, both local (works) and remote (error), across multiple local and remote machines (all running Linux). Please let me know if I can provide any further information.

I wasn't able to reproduce on WSL, but I found the option to add an "extensionDependency" in the description of the vscode.git extension and fixed a deprecation warning. These changes are published (v0.0.12), does this update change anything w.r.t. your issue?

Thanks for the quick response, but that did not work. I noticed that VSCode reports that the extension is running locally because it prefers to do so. I removed ui from extensionKind and that solved the problem.
https://github.com/ManuelHentschel/vscode-github-linker/blob/cd2e189f3e03a28e48bf999fcfd1d3ffcad7f727/package.json#L9-L12
Perhaps switching to "extensionKind": ["workspace", "ui"] as described here: https://code.visualstudio.com/api/advanced-topics/extension-host#preferred-extension-location would work; I have not yet tested that.

Good catch! I removed the entry now (not sure why I put it there in the first place). This change makes the extension work on the remote SSH that I tested.

Thanks for the quick fix! It works for me on local and remote.


python is not recognize as internal or external command in atom

i have set python path in environment and  installed script but error shows python  is not recognized as internal or external command

Can you provide more information.

i have installed anaconda3 in windows10,. i installed atom  in atom i installed script package  but it showing error while running program. i tried to set python path of anaconda in variable environment but still same error.


added nextjs-progressbar

What kind of PR is this?:

/kind feature
What this PR does / why we need it:
To show client-side loading.

Codecov Report

Merging #128 (4c23d2b) into main (5ddcdc1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #128   +/-   ##
=======================================
  Coverage   82.07%   82.07%
=======================================
  Files          18       18
  Lines         212      212
  Branches       40       40
=======================================
  Hits          174      174
  Misses         37       37
  Partials        1        1

Impacted Files
Coverage Δ

src/pages/_app.tsx
60.00% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5ddcdc1...4c23d2b. Read the comment docs.


Change default period to throughput result view

Not sure if this is in the default template, but throughput test views between a host pair seem to default to 6 hours, which doesn't show much (one dot) so maybe 7 days would be a better default.

If you log in with admin/write access to your Grafana instance, you can change the time range default and then save the dashboard and check the Save current time range as dashboard default. However this will be a change for the whole Endpoint Pair Explorer dashboard, so for throughput, but also for latency, trace and others.
We could change the default for new installations, yes, tbd.

Thanks.  6 hours default makes no sense for throughput, so I'd suggest at least upping it to 24 hours, and perhaps 7 days, as the default.

As discussed perhaps the solution is to have the drill down duration (currently 6 hours) match the value set in the mesh view (default 24 hours?)


Adding inferred dtype and a special empty() allocator

This modifies the type inference algorithm to refine dtype for array allocation done by numba.unsafe.ndarray.empty_inferred.  The approach is similar to how list/set are refined.  The allocator creates an array of undefined dtype, which on only getitem and setitem are allowed.  Getitem can create slices of the same undefined dtype.  It is needed for 2d array comprehension.  Setitem refines the undefined dtype and propagate the type info backward.

I'm getting a weird error when running tests with command python runtests.py -f numba.tests.test_comprehension.TestArrayComprehension. The error is:
FAIL: test_array_comp_inferred_dtype_outside_setitem (numba.tests.test_comprehension.TestArrayComprehension)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/hliu54/HPS/numba/numba/tests/test_comprehension.py", line 454, in test_array_comp_inferred_dtype_outside_setitem
    np.testing.assert_array_equal(array_comp(n, v), cfunc(n, v))
  File "/nix/store/ay82hpsmb79ymwsqna6pghdgwp5pphnj-python3.6-numpy-1.12.1/lib/python3.6/site-packages/numpy/testing/utils.py", line 871, in assert_array_equal
    verbose=verbose, header='Arrays are not equal')
  File "/nix/store/ay82hpsmb79ymwsqna6pghdgwp5pphnj-python3.6-numpy-1.12.1/lib/python3.6/site-packages/numpy/testing/utils.py", line 796, in assert_array_compare
    raise AssertionError(msg)
AssertionError:
Arrays are not equal

(mismatch 10.0%)
 x: array([1, 1, 2, 3, 4, 5, 6, 7, 8, 9])
 y: array([ 1.2+0.j,  1.0+0.j,  2.0+0.j,  3.0+0.j,  4.0+0.j,  5.0+0.j,
        6.0+0.j,  7.0+0.j,  8.0+0.j,  9.0+0.j])

This happens in function test_array_comp_inferred_dtype_outside_setitem, which had nothing to do with complex numbers before the error happens.
However, if I replace i * 1j in test_array_comp_inferred_dtype with i * 1, then the error would not happen.
Also, running just a single test with python runtests.py -f numba.tests.test_comprehension.TestArrayComprehension.test_array_comp_inferred_dtype_outside_setitem works without error.
So it looks like there is some type inference "pollution" going on here. @sklam

Also, looks like there is some windows specific failures

I take it back. The set of errors were not windows specific. Both travis and and appveyor fail at the same places. However, the trouble is that I cannot re-produce these failures locally. Any idea of what is going on? @sklam

I can see it on my linux machine with python runtests.py -vbf numba.tests.test_comprehension
But with python runtests.py -mvbf numba.tests.test_comprehension (-m for parallel test), it segfaulted at test_array_comp_with_iter.

Thanks for the fix on the caching thing. All tests now work for me locally, but there is still issue with travis and appveyor.


Tracy Handler.php render method checks if response->getContent instance of View, but is string so never returns view.

In Laravel 5.4, if in my exception handler I add some code like:
return response()->view('errors.403', [], 403);
And have Tracy running, tracy will never show the view response and instead shows the full exception trace, this is because in: vendor/recca0120/laravel-tracy/src/Exceptions/Handler.php Line 62, we check $response->getContent instanceof View, however at this point the getContent returns the compiled view string, and it's the original property on the response that holds the view instance.
We could add an additional || to the if to account for $response->getOriginalContent() instanceof View (Looking at the commit history of the Response class in Laravel, when setting content it always rendered the view object into a string so it may be this never worked and we should either be checking is_string or checking the originalContent?)

Hi @jrbarnard
when I return response()->view('errors.403', [], 403), It work correctly. (like this screenshot)
could you show me. this full exception trace ??
and check $response->getContent();
https://github.com/laravel/framework/blob/5.4/src/Illuminate/Routing/ResponseFactory.php#L69
https://github.com/laravel/framework/blob/5.4/src/Illuminate/View/Factory.php#L123
use response()->view('errors.403', [], 403) will return View.
and $response->getOriginalContent(), it only work on JsonResponse.

Hi @recca0120
Re reading the issue I added and I definitely wasn't very clear! Hopefully the below helps to show the issue.
Throwing an exception say in a controller (this example is basically mocking a policy exception):

It will be handled as expected in app/Exceptions/Handler.php in the render method. If I say check for the type of the exception and then say handle the response in a specific way, this example is a policy exception has occurred therefore we will show the errors.403 view:

However, we get the full tracy exception trace like below:

Instead of the expected 403 view.
It's definitely hitting the response()->view code in Handler.php, however as the tracy Handler overrides this handler and then runs checks on the response from our Handler.php render method, tracy doesn't return the response as expected as '$response->getContent() instanceof View' doesn't evaluate to true.
Let me know if you're having any trouble recreating the issue, I can make a pull request for a potential fix if needed?
Cheers,
James

I've added a pull request here to fix this issue, it keeps the old $response->getContent() check, but also adds an original content comparison as all laravel response views content are strings by the time the response is inspected.

@recca0120 Thanks for merging the pull request are we able to do a 1.8.91 release to packagist with the fix so I can update via composer using tagged releases?

release


Fixed an issue with select being called twice on every navigation.

This might relate to issue #46. Select was being called twice every time I navigated. I noticed a bit of jumpiness that seems to be better with this code removed.
There might be a good reason you have this code that I hadn't considered, but I couldn't figure it out. It seemed extraneous.

There is a very good reason.
If you change the hash in url (by hand, or by clicking back button) it will handle changing the slides. To it can't be removed.
But you may be right about select being called twice. I was thinking it will not be a problem, as the same styles will be just applied again and nothing should change, but it may affect animation in some way.
The fix for it would be quite simple. On the beginning of select function in should also be checked if selected element is already active, and if it is just return doing nothing.
I'll try to fix this ASAP, but if you are quicker I'll be happy to merge pull request :)

Yeah, I'll send a new pull request. :)

Unfortunately this does not have an impact on the lagging transition mentioned [#46] (https://github.com/bartaz/impress.js/issues/46).
But it almost removes the possibility to give out links to a certain slide. (you have to load the page twice to reach the slide with this snippet removed)


[EOSF-920] Add sign up/sign in functionality

Purpose
Currently, sign in and sign up buttons on the navbar are not working in quick files.
Summary of Changes
Add properties for sign up and sign in buttons.
Ticket
https://openscience.atlassian.net/browse/EOSF-920
Reviewer Checklist

[ ] meets requirements
[ ] easy to understand
[ ] DRY
[ ] testable and includes test(s)
[ ] changes described in CHANGELOG.md (don't have initial release yet)

Coverage decreased (-0.04%) to 4.965% when pulling 0467af218c2fb60ab1c77ee0946ec36b425623b5 on baylee-d:feature/log-in-log-out into 97d894dc023d7643eb2a7f32814faa090c9dc441 on CenterForOpenScience:develop.


Support configuration for dataclasses across python versions 3.6, 3.7+

Summary
publishing whylogs workflow hits a poetry.lock install error on python 3.10.1:
ERROR: Package 'dataclasses' requires a different Python: 3.10.1 not in '<3.7,>=3.6'

Steps to Reproduce it
Run the deploy workflow.
Example
https://github.com/whylabs/whylogs/runs/4797036101?check_suite_focus=true
What is the current bug behavior?
poetry install fails in automation.

Resolved with https://github.com/whylabs/whylogs/pull/425/


Support generating from jsdoc classes

https://github.com/mmkal/ts/blob/43cf60beb6d0ed7efa349e9c1fe3770d0d9df0e8/packages/eslint-plugin-codegen/src/presets/markdown-from-jsdoc.ts#L25
This is only looking at variables and arrow functions, it would be cool if it could look for classes, abstract classes, interfaces, etc.

@wSedlacek released in v0.27.0. I hope you haven't been waiting for the last 2.5 years!

I have been busy working on rebuilding the entire networking layer for our product with gRPC and microservices 😄
Thank you for getting this fixed!


LESS mixin unexpected code formatting

Description
This is moved over from https://github.com/microsoft/vscode/issues/146693
Using VSCode 1.66.0 and the new built-in LESS code formatting feature less.format.enable implemented by the JS Beautify library.
When using a LESS mixin that accepts CSS code rules as a parameter (this is used for media query mixins), the formatting when saved is a little unexpected. The formatting is consistent, but it is unusal.
Input & Expected Output
.example(@rules) {
    @rules();
}

.test {
    .example({
        color:red;
    });
}

Actual Output
.example(@rules) {
    @rules();
}

.test {
    .example( {
            color:red;
        }

    );
}

More Information
Similar issue reported a while back js-beautify issue 722
I've noticed that if you add the following to VSCode's settings.json file, the results are slightly better:
"less.format.newlineBetweenRules": false

This gives you formatting like:
.example(@rules) {
    @rules();
}

.test {
    .example( {
            color:red;
        }
    );
}

I was asked to move the issue over here, so hope it's in the right place now.
Environment
OS: macOS 12.3.1 VSCode 1.66.0 which bundles js-beautify
I have been trying to track down the version of js-beautify, but I cannot seem to find it within VSCode, so if anyone can advise how I can report this that would be great.
Settings
Defined by VSCode

1.66.0 uses jsbeautify 1.14.0

@aeschli
Thanks for the update. That means this is definitely still valid.

@aeschli
Are you seeing a lot of issue reported?
I only see 5 open in this project currently: https://github.com/beautify-web/js-beautify/issues?q=is%3Aissue+is%3Aopen+less+OR+scss+label%3A"language%3A+templating"+
As I said this issue probably wouldn't be super hard to fix, I just don't have the time myself.
As to comfort, it is really up to you.   Without a better alternative, maybe someone will be inspired to help make this one better.

@bitwiseman Yes, so far it's only a few issues that don't seem to be complicated to fix.

@aeschli @bitwiseman I have added a PR for a possible solution to the spacing problems mentioned in this ticket and #772.


Don't delete operator

Speed up CI by avoiding the deletion of the operator in benchmarks with several test cases.

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_fiod
Pass
0
00:07:56

test_fs_drift
Fail
3
00:00:06

test_smallfile
Pass
0
00:05:01

test_uperf
Pass
1
00:36:47

@rsevilla87 I imagine this will break in the get_uuid function since it does not know how to handle multiple benchmark tests at once.
I'm fine with re-using the operator but we should still clean up the old benchmark pods/etc prior to running in my opinion.

@rsevilla87 I imagine this will break in the get_uuid function since it does not know how to handle multiple benchmark tests at once.
I'm fine with re-using the operator but we should still clean up the old benchmark pods/etc prior to running in my opinion.

Disregard this. I completely missed the delete benchmark line in place of wait_clean. Apparently, reviewing PRs should be done after I have some coffee. :-)

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_fiod
Pass
0
00:08:11

test_fs_drift
Pass
0
00:05:07

test_smallfile
Pass
0
00:05:12

test_uperf
Pass
0
00:16:11

@dry923 do you have any concerns of this potentially breaking snafu-ci ? I took a look at the pr and it looks unlikely.

@dry923 do you have any concerns of this potentially breaking snafu-ci ? I took a look at the pr and it looks unlikely.

@aakarshg I took another look at the snafu-ci code and I don't think it should effect it.

@dry923 do you have any concerns of this potentially breaking snafu-ci ? I took a look at the pr and it looks unlikely.

@aakarshg I took another look at the snafu-ci code and I don't think it should effect it.

Opening a fake PR in Snafu with Depens-on to verify it works :)

@rsevilla87 Can you add in a wait for the benchmark cleanup.? I was watching the snafu pr run and I noticed a uperf server being spun up while the other was still in terminating.

cloud-bulldozer/snafu#182 (comment) shows that the snafu ci is also working fine.

@rsevilla87 Can you add in a wait for the benchmark cleanup.? I was watching the snafu pr run and I noticed a uperf server being spun up while the other was still in terminating.

I think that shouldn't be problematic, CI uses uuid to get the status of the pods, that uuid is collected from benchmark metadata and the old one has been already deleted before creating the new one.

@rsevilla87 Can you add in a wait for the benchmark cleanup.? I was watching the snafu pr run and I noticed a uperf server being spun up while the other was still in terminating.

I think that shouldn't be problematic, CI uses uuid to get the status of the pods, that uuid is collected from benchmark metadata and the old one has been already deleted before creating the new one.

It actually caused the uperf server pod to fail to start a few times (I believe it was after the service ip test). Once the old pod was terminated the new one kicked on fine. This is the error that was seen:
[root@perf-sm5039-4-2 ~]# oc logs -n my-ripsaw uperf-server-0-e027717c
3.** TCP: Cannot bind to port 8270 Address already in use
Error starting slave

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_fiod
Pass
0
00:08:43

test_fs_drift
Pass
1
00:11:01

test_smallfile
Pass
0
00:06:02

test_uperf
Fail
3
00:26:33

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_fiod
Pass
0
00:08:26

test_fs_drift
Pass
0
00:05:54

test_smallfile
Pass
0
00:05:58

test_uperf
Pass
0
00:16:29

/rerun all

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_fiod
Pass
0
00:08:17

test_fs_drift
Pass
0
00:04:42

test_smallfile
Pass
1
00:09:52

test_uperf
Pass
0
00:15:17

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_backpack
Pass
3
00:17:58

test_fiod
Pass
0
00:08:16

test_fs_drift
Pass
0
00:05:40

test_hammerdb
Pass
0
00:04:06

test_pgbench
Pass
0
00:02:13

test_smallfile
Pass
0
00:04:50

test_uperf
Pass
0
00:16:11

test_ycsb
Pass
0
00:01:40

@rsevilla87 It looks good. My only thought is we should probably standardize on the figlet and apply_operator call being outside the functional_test_[workload] function and instead be like you have it in test_fiod.sh and test_fs_drift.sh. Thoughts?

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_backpack
Pass
1
00:08:04

test_byowl
Pass
0
00:01:32

test_fiod
Pass
0
00:08:37

test_fs_drift
Pass
1
00:08:55

test_hammerdb
Pass
0
00:04:11

test_iperf3
Pass
0
00:02:55

test_pgbench
Pass
0
00:00:41

test_smallfile
Pass
2
00:14:10

test_sysbench
Pass
0
00:01:40

test_uperf
Pass
0
00:15:55

test_ycsb
Pass
0
00:01:38

@rsevilla87 It looks good. My only thought is we should probably standardize on the figlet and apply_operator call being outside the functional_test_[workload] function and instead be like you have it in test_fiod.sh and test_fs_drift.sh. Thoughts?

@rsevilla87 looks like you missed ycsb when applying the above

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_backpack
Pass
0
00:02:48

test_byowl
Pass
0
00:01:58

test_fiod
Pass
1
00:19:49

test_fs_drift
Pass
0
00:06:07

test_hammerdb
Pass
0
00:05:01

test_iperf3
Pass
0
00:03:52

test_pgbench
Pass
0
00:02:20

test_smallfile
Pass
0
00:05:19

test_sysbench
Pass
0
00:02:31

test_uperf
Pass
0
00:16:32

test_ycsb
Pass
0
00:01:51

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_backpack
Pass
1
00:04:48

test_byowl
Pass
0
00:01:38

test_fiod
Pass
0
00:08:34

test_fs_drift
Pass
0
00:04:16

test_hammerdb
Pass
0
00:04:44

test_iperf3
Pass
0
00:03:26

test_pgbench
Pass
0
00:02:34

test_smallfile
Pass
1
00:09:24

test_sysbench
Pass
0
00:01:47

test_uperf
Pass
3
01:21:51

test_ycsb
Pass
0
00:01:50

@rsevilla87 i did some testing in https://github.com/cloud-bulldozer/ripsaw/pull/357 and it looks like adding
es.indices.refresh(index=index)

to the check_es.py script seems to work the most reliably (ignore the backpack failures that is something else I need to investigate). Thoughts?

 So I'm changing the goal for this PR since in my opinion it's not worth to waste more time in debugging these things.

Results for crc_jjb

Test
Result
Retries
Duration (HH:MM:SS)

test_backpack
Pass
3
00:09:20

test_byowl
Pass
0
00:01:59

test_fiod
Pass
0
00:10:01

test_fs_drift
Pass
0
00:05:45

test_hammerdb
Pass
0
00:03:42

test_iperf3
Pass
0
00:03:03

test_pgbench
Pass
0
00:02:23

test_smallfile
Pass
0
00:05:54

test_sysbench
Pass
0
00:01:35

test_uperf
Pass
0
00:17:34

test_ycsb
Pass
0
00:01:42

I like the change of focus for this one. It's good for me. @aakarshg you good w/ the change?

I like the change of focus for this one. It's good for me. @aakarshg you good w/ the change?

yes good with the change, @rsevilla87 can this be merged now?

I like the change of focus for this one. It's good for me. @aakarshg you good w/ the change?

yes good with the change, @rsevilla87 can this be merged now?

I think so. This change is not very aggressive and shouldn't break anything.


Install bundler 2.2.11 and update gem

Install bundler 2 and update gem from 3.0.3 to 3.2.14
Bundler 2 is only used to install core's gems when building the image, bundler 1 is still used for all updates.
Once we ship this we can enable bundler v2 support here https://github.com/dependabot/dependabot-core/blob/main/bundler/lib/dependabot/bundler/helpers.rb#L10

Planning to test this on staging, dry-runs look 👌

Looking good on staging 🎉  https://github.com/dsp-testing/feelepxyz-testing-git-bundler/pull/9/files


Geonames geocoder

Hi @bchapuis,
Should we close this branch now that it's a duplicate of https://github.com/baremaps/baremaps/pull/417 ?


json path is not fully supported by sql server json_modify??????

[
i m quite surprise to found out that json path may not be fully supported by json_modify? please look at the sample below, it is a working sample of json path, but i got compilation error from sql server because i m trying to use json path filter ?() to pick an action item to edit.  The sql server doc claims json path is supported, however, all samples are using position like [0] to access an item in an array.
I am very confused. If it is the case, there is no way we can switch from mongodb to sqlserver to use it as key value store. Please tell me i am wrong somehow.
UPDATE [dbo].[Workflow]
SET actions= JSON_MODIFY(actions, '$[?(@.actionId=="123")].status', 'test')
WHERE [EnvelopeId] = '321' And [CustomerId] = '890']

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c82cfd37-92b5-0cd6-ef01-95a3ae01fe67
Version Independent ID: d4fd0259-f051-5aa4-efd1-8b1d6335732e
Content: JSON Path Expressions - SQL Server
Content Source: docs/relational-databases/json/json-path-expressions-sql-server.md
Product: sql
Technology: ****
GitHub Login: @jovanpop-msft
Microsoft Alias: jovanpop

@cliffschwab -- thank you for your feedback.  Please consider these resources:

SQL Server on Microsoft Q&A
DBA Stack Exchange
Stack Overflow

@jovanpop-msft -- please look into this potential examples update issue.

SQL Server/Azure SQL is supporting full json path. This is no supported in any json function. Supported subset of json path is explained here: https://docs.microsoft.com/en-us/sql/relational-databases/json/json-path-expressions-sql-server?view=sql-server-ver15

SQL Server/Azure SQL is supporting full json path. This is no supported in any json function. Supported subset of json path is explained here: https://docs.microsoft.com/en-us/sql/relational-databases/json/json-path-expressions-sql-server?view=sql-server-ver15

@WilliamAntonRohm if you thing that this should be additionally clarified, should we add this to docs backlog? Otherwise we can close this.
adding @julieMSFT

@WilliamAntonRohm if you thing that this should be additionally clarified, should we add this to docs backlog? Otherwise we can close this.
adding @julieMSFT

@jovanpop-msft -- Jovan, your comment regarding json paths, with that doc link, is sufficient.

@jovanpop-msft -- Jovan, your comment regarding json paths, with that doc link, is sufficient.


Schedule page design v2

[x] current session
[x] current time
[x] past session
[x] past time
[x] past day
[x] sessions with video links

any other interesting states or functionality we want to strive for?

decision: current talk is enough

[ ] nice to have "jump to" links for schedule visitors during the conf
[ ] nice to have relevant copy cc @vschupmann

The current copy is"

Every session is available through Livestream during the event, and available after the event on the Chrome Developers YouTube channel.

Proposed new copy is under review our team's "Content Plan" Google doc.

current copy is still good for "during" state 👍


Unboxing [NSURL]?

Hi,
First, thanks for your amazing work !
Just wondering if that kind of unboxing is supposed to work:
struct Obj: Unboxable {
    let id: Int
    let pictures: [NSURL]?

    init(unboxer: Unboxer) {
        self.id = unboxer.unbox("id")
        self.pictures = unboxer.unbox("pictures")

where pictures is an array of strings

Hi @arsonik! Welcome to Unbox! Glad to have you here!
Yes, Unbox supports unboxing NSURLs from Strings through the use of a transformer right out of the box! (No pun intended 😉) You should be good to go! Let us know if you have any other questions—we're always happy to help and we try to respond as quickly as possible!

@JohnSundell I think we can close this one!

hmm thanks for your reply,
doesn't seem to work right out of the box though
it is an array of NSURL ! to just a single NSURL is that why it's not working ?
not working self.pictures = unboxer.unbox("pictures_url")
the code that is actually working:
        do {
            self.pictures = try Unboxer.performCustomUnboxingWithDictionary(unboxer.dictionary, closure: { unboxer in
                return (unboxer.dictionary["pictures"] as? [String])?.flatMap {
                    NSURL(string: $0)
                }
            })
        } catch {
            self.pictures = nil
        }

@arsonik, I'll take a look in the morning. I know that there have been some issues in the past were arrays of transformables weren't unboxing quite as they should. Thanks for uncovering another case (if that is the case!) Just thought I'd chime in to let you know that you are indeed not crazy 😉

Hi guys, FYI I'm the one who opened #85 and got it compiled after the fix but it actually crashes in runtime.

Hey @ntnhon, @clayellis, @arsonik! I see now that there's a bug in how an array of UnboxableByTransform values are handled (it just tries to unbox the same type, rather than going for the raw type and then transforming it). Will fix the bug now, stand by :)

@ntnhon Shouldn't crash though, even with the current bug in the implementation. Can you post a stack trace?

Fixed in master. Let me know how that works. Will make a release soon, probably tomorrow evening :)

Working like a charm ! Thanks.
Stupid question: why unbox can't work with class i/o struct ?

@arsonik Awesome 🎉 There's nothing preventing you to use classes instead of structs with Unbox. Just implement init(unboxer:) as a required initializer.

My bad ! Dunno why I though I could not 👍🏻


Use api get data,but the time made me confused,

i use the  url  /api/v1/model/namespaces/{namespace-name}/pods/{pod-name}/metrics/{metric-name}?start=X&end=Y:
get json
{
  "metrics": [
   {
    "timestamp": "2016-09-19T06:19:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:20:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:21:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:22:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:23:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:24:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:25:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:26:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:27:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:28:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:29:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:30:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:31:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:32:00Z",
    "value": 4
   },
   {
    "timestamp": "2016-09-19T06:33:00Z",
    "value": 4
   }
  ],
  "latestTimestamp": "2016-09-19T06:33:00Z"
 }

what‘s the time means.it not current time.’

which "time" do you mean?
timestamp is the point in time in which the value was observed.
latestTimestamp is the maximum value of all timestamps
Please of re-open in case of more questions


[Feature Request] Explicit PYTHONOPTIMIZE environment variable detection

Minimal reproduction:
test.py:
from beartype import beartype

@beartype
def test(x: int) -> None:
    print(x)

if __name__ == "__main__":
    test("test")

⬢ [Docker] ❯ python test.py
Traceback (most recent call last):
  File "/home/ray/phare-sandbox/test.py", line 8, in <module>
    test("test")
  File "<@beartype(__main__.test) at 0x7ff83a8b8280>", line 29, in test
beartype.roar.BeartypeCallHintParamViolation: Function __main__.test() parameter x='test' violates type hint <class 'int'>, as str 'test' not instance of int.

⬢ [Docker] ❯ PYTHONOPTIMIZE=1 python test.py
test

In a Jupyter notebook, this does not work to disable beartype:

This is a blocker for projects that require JIT compilation such as with PyTorch compile / LLMs: https://pytorch.org/tutorials/intermediate/torch_compile_tutorial.html (the beartype decorator breaks compilation, which is needed to speed up LLM training and inference).
Loving beartype otherwise, it's saved me from many bugs -- rawr! 🐻

Excellent issue! Currently, all runtime type-checkers that I know of (including @beartype, typeguard, and Pydantic) just let Python handle PYTHONOPTIMIZE. That is, we don't explicitly detect PYTHONOPTIMIZE; we let Python itself detect PYTHONOPTIMIZE at startup, which then implicitly sets the __debug__ global accordingly.
Clearly, this historical approach is overly simplistic. By letting Python handle everything, we fail to account for dynamic changes to the PYTHONOPTIMIZE environment variable that a user manually makes after Python has already started up.
Thankfully, this should be trivial for @beartype (and everybody else) to support. Thanks so much for the excellent issue that I can actually do something about, @jaanli. :smile:
That said, this...

...the beartype decorator breaks compilation

This saddens me! Would you mind opening a separate issue about that? That's actually the first I've heard of that. I mean, I'm not surprised. PyTorch is a huge thing. But I'd rather @beartype not break that huge thing if I can help it. Perhaps there's something that can be done on our end to improve @beartype + PyTorch integration.
Let's cogitate on this as I stroke my chin thoughtfully. :thinking:

You're the bestest, thank you @leycec!! Will file a separate issue to reproduce :)

Resolved by a342229. The @beartype decorator now silently reduces to a noop (i.e., avoids decorating anything with runtime type-checking) when you manually set the ${PYTHONOPTIMIZED} environment variable to a non-zero integer from within REPLs like Jupyter. Flex, @beartype!
Thanks so much for this super fun distraction, @jaanli. It's rare to receive a feature request that I can actually push out in an hour. Oh, if only they were all like this... :sweat_smile:


fix!: Remove Most Fields from dbt Target

@izeigerman do you mind also taking a look when you get a chance (I know you are traveling)? Just want to get another set of eyes since this is breaking/requires a migration.


⚠ Bofrost.be has degraded performance

In 699d6e5, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1252 ms

Resolved: Bofrost.be performance has improved in ff53c29.


New package: SAOImageDS9 v0.2.0

Registering package: SAOImageDS9
Repository: https://github.com/JuliaAstro/SAOImageDS9.jl
Created by: @emmt
Version: v0.2.0
Commit: 562947811f85037bcff6a7891791594cbebf6f9b
Git reference: master
Release notes:

First official release.

@emmt

The following dependencies do not have a [compat] entry that is upper-bounded and only includes a finite number of breaking releases: TwoDimensional

:slightly_smiling_face:
[noblock]

I hope all these will be fixed now...


[Question]: Does Babelfish support a higher version than SQL Server 2014?

Hi,
What's your question?
we're currently migrating an application of ours to AWS, using an Aurora Database with Babelfish with Postgres, our Application is a Spring Boot Application which connects via JDBC.
Our current problem is that Babelfish always reports that it is running SQL version 2014, but one of our libraries (Flyway) requires a higher version. We know we can overwrite the output of select @@version, but Flyway uses the metadata of the JDBC driver, which in turn uses the output of SELECT SERVERPROPERTY('productversion'), and this still reports version 2014.
Is there any way we can work around this issue?
If you're wondering why I didn't use the Question template, this is due to this bug -> https://github.com/babelfish-for-postgresql/babelfish_extensions/issues/702
Version
BABEL_1_X_DEV (Default)
KR,
Markus

There is currently no way to let Babelfish return a different SQL Server version, but we have noted the requirement for making this configurable.

Hi Rob,
thanks for the info, consider the question answered, I'll close it.
We'll have to go with a native SQL server then.
KR,
Markus


Replace replace-in-file package to resolve CWE-772 in inflight

Is there an existing issue for this?

[X] I have searched the existing issues

Which Transloco package(s) are the source of the bug?
Transloco
Is this a regression?
No
Current behavior
.
Expected behavior
.
Please provide a link to a minimal reproduction of the bug, if you won't provide a link the issue won't be handled.
https://cwe.mitre.org/data/definitions/772.html
Transloco Config
No response
Please provide the environment you discovered this bug in
No response
Browser
No response
Additional context
This issue has been opened https://github.com/jsverse/transloco/issues/768 But was closed with no reason given. On the main branch, this issue persists. Reopening.
I would like to make a pull request for this bug
No

I see replace-in-file has been removed in this PR: https://github.com/jsverse/transloco/pull/693
It would be good to provide the reason why https://github.com/jsverse/transloco/issues/768 was closed to clear this type of confusion.


Can't create paragraph easily in About page

Editing content on the About page is harder than it should at the moment.
Can we set the page so that you can type in the textarea and hit return here?
Demo: https://www.loom.com/share/589745ee28a24bd7818d1a4b281a33a3

This issue should be fixed (needs testing)

Tested and seems to be working for me!

Looks good!


Jikkyou Powerful Pro Yakyuu 2012 Kettei Ban [PCSG00134]

App summary

App name: Jikkyou Powerful Pro Yakyuu 2012
App serial: PCSG00134
App version: 1.00

Vita3K summary

Version: v0.1.6
Build number: 2852
Commit hash: https://github.com/vita3k/vita3k/commit/45f62ea9
CPU backend: Dynarmic

Test environment summary

Tested by: nishinji
OS: Windows 10
CPU: Ryzen 9 3950x
GPU: RTX 3060ti
RAM: 32 GB

Issues
Screenshots

Log
vita3k.log
Recommended labels
Bootable?

add a log