Use Micronaut AOT

This PR introduces Micronaut AOT to the build. It is done in a way so that the commands used to run in dev mode and package the native image are the same.

Thanks for your contribution, @alvarosanchez!
I'm curious, why aren't these settings automatically configured when I include -f micronaut-aot when creating the app?
Adding the code from this PR to the Make a Micronaut App from Scratch section of the blog post will make Micronaut's AOT look pretty complicated, IMO.

I'm curious, why aren't these settings automatically configured when I include -f micronaut-aot when creating the app?

They will soon, I'm working on that. I just wanted to gather some general feedback from you here.

Done in https://corparch-core-srv.slack.com/archives/D039E106PHA/p1648652672075089
Will be ready by next week with Micronaut 3.4.2.

@alvarosanchez Great! I'll make sure this repo and its blog post are updated shortly after it's released and before my talk at Devoxx France (April 21).

@alvarosanchez I created a new Micronaut app using the following command:
mn create-app com.okta.rest.app --build maven -f security-jwt -f micronaut-aot

You can see the results of what changed between Micronaut 3.4.0 and 3.4.2 in #22. It doesn't seem to have all the changes that are in this PR. Is that expected?

@alvarosanchez The generated app in #22 works fine when I run ./mvnw mn:run but fails to build with GraalVM afterward using ./mvnw package -Dpackaging=native-image. If I run ./mvnw clean before package, it works fine.
I wanted to let you know about this because this behavior is different from previous versions.
[INFO] Scanning for projects...
[INFO]
[INFO] -------------------------< com.okta.rest:app >--------------------------
[INFO] Building app 0.1
[INFO] ----------------------------[ native-image ]----------------------------
[INFO]
[INFO] --- maven-resources-plugin:3.2.0:resources (default-resources) @ app ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Using 'UTF-8' encoding to copy filtered properties files.
[INFO] Copying 2 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.10.1:compile (default-compile) @ app ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- micronaut-maven-plugin:3.2.3:aot-analysis (default-aot-analysis) @ app ---
[WARNING] Packaging is set to [native-image], but Micronaut AOT runtime is set to [jit]. Setting AOT runtime to: [native]
[INFO] Running Micronaut AOT 1.0.3 aot-analysis
[INFO] Packaging project
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Using 'UTF-8' encoding to copy filtered properties files.
[INFO] Copying 2 resources
[INFO] Nothing to compile - all classes are up to date
[INFO] Executing Micronaut AOT analysis
22:15:51.159 [main] INFO  i.m.aot.MicronautAotOptimizer - Analysis will be performed with active environments: []
[INFO]
[INFO] --- micronaut-maven-plugin:3.2.3:graalvm-resources (default-graalvm-resources) @ app ---
[INFO] Generating /Users/mraible/Downloads/micronaut/target/classes/META-INF/native-image/com.okta.rest/app/resource-config.json
[INFO]
[INFO] --- maven-jar-plugin:3.2.0:jar (default-jar) @ app ---
[INFO] Building jar: /Users/mraible/Downloads/micronaut/target/app-0.1.jar
[INFO]
[INFO] --- native-maven-plugin:0.9.11:build (default-build) @ app ---
[INFO] ImageClasspath Entry: io.micronaut:micronaut-inject:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-inject/3.4.2/micronaut-inject-3.4.2.jar)
[INFO] ImageClasspath Entry: org.slf4j:slf4j-api:jar:1.7.29:compile (file:///Users/mraible/.m2/repository/org/slf4j/slf4j-api/1.7.29/slf4j-api-1.7.29.jar)
[INFO] ImageClasspath Entry: javax.annotation:javax.annotation-api:jar:1.3.2:compile (file:///Users/mraible/.m2/repository/javax/annotation/javax.annotation-api/1.3.2/javax.annotation-api-1.3.2.jar)
[INFO] ImageClasspath Entry: jakarta.inject:jakarta.inject-api:jar:2.0.1:compile (file:///Users/mraible/.m2/repository/jakarta/inject/jakarta.inject-api/2.0.1/jakarta.inject-api-2.0.1.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-core:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-core/3.4.2/micronaut-core-3.4.2.jar)
[INFO] ImageClasspath Entry: org.yaml:snakeyaml:jar:1.30:compile (file:///Users/mraible/.m2/repository/org/yaml/snakeyaml/1.30/snakeyaml-1.30.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-validation:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-validation/3.4.2/micronaut-validation-3.4.2.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/micronaut/micronaut-validation/3.4.2/micronaut-validation-3.4.2.jar!/META-INF/native-image/io.micronaut.validation/micronaut-validation/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.micronaut:micronaut-core-reactive:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-core-reactive/3.4.2/micronaut-core-reactive-3.4.2.jar)
[INFO] ImageClasspath Entry: org.reactivestreams:reactive-streams:jar:1.0.3:compile (file:///Users/mraible/.m2/repository/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar)
[INFO] ImageClasspath Entry: javax.validation:validation-api:jar:2.0.1.Final:compile (file:///Users/mraible/.m2/repository/javax/validation/validation-api/2.0.1.Final/validation-api-2.0.1.Final.jar)
[INFO] ImageClasspath Entry: io.projectreactor:reactor-core:jar:3.4.14:runtime (file:///Users/mraible/.m2/repository/io/projectreactor/reactor-core/3.4.14/reactor-core-3.4.14.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-http-client:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http-client/3.4.2/micronaut-http-client-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-http-client-core:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http-client-core/3.4.2/micronaut-http-client-core-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-websocket:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-websocket/3.4.2/micronaut-websocket-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-http-netty:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http-netty/3.4.2/micronaut-http-netty-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-buffer-netty:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-buffer-netty/3.4.2/micronaut-buffer-netty-3.4.2.jar)
[INFO] ImageClasspath Entry: io.netty:netty-codec-http2:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-codec-http2/4.1.76.Final/netty-codec-http2-4.1.76.Final.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/netty/netty-codec-http2/4.1.76.Final/netty-codec-http2-4.1.76.Final.jar!/META-INF/native-image/io.netty/codec-http2/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.netty:netty-handler:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-handler/4.1.76.Final/netty-handler-4.1.76.Final.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/netty/netty-handler/4.1.76.Final/netty-handler-4.1.76.Final.jar!/META-INF/native-image/io.netty/handler/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.netty:netty-resolver:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-resolver/4.1.76.Final/netty-resolver-4.1.76.Final.jar)
[INFO] ImageClasspath Entry: io.netty:netty-handler-proxy:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-handler-proxy/4.1.76.Final/netty-handler-proxy-4.1.76.Final.jar)
[INFO] ImageClasspath Entry: io.netty:netty-common:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-common/4.1.76.Final/netty-common-4.1.76.Final.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/netty/netty-common/4.1.76.Final/netty-common-4.1.76.Final.jar!/META-INF/native-image/io.netty/common/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.netty:netty-buffer:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-buffer/4.1.76.Final/netty-buffer-4.1.76.Final.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/netty/netty-buffer/4.1.76.Final/netty-buffer-4.1.76.Final.jar!/META-INF/native-image/io.netty/buffer/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.netty:netty-transport:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-transport/4.1.76.Final/netty-transport-4.1.76.Final.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/netty/netty-transport/4.1.76.Final/netty-transport-4.1.76.Final.jar!/META-INF/native-image/io.netty/transport/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.netty:netty-codec:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-codec/4.1.76.Final/netty-codec-4.1.76.Final.jar)
[INFO] ImageClasspath Entry: io.netty:netty-codec-socks:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-codec-socks/4.1.76.Final/netty-codec-socks-4.1.76.Final.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-http-server-netty:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http-server-netty/3.4.2/micronaut-http-server-netty-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-http-server:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http-server/3.4.2/micronaut-http-server-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-router:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-router/3.4.2/micronaut-router-3.4.2.jar)
[INFO] ImageClasspath Entry: io.netty:netty-codec-http:jar:4.1.76.Final:compile (file:///Users/mraible/.m2/repository/io/netty/netty-codec-http/4.1.76.Final/netty-codec-http-4.1.76.Final.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/netty/netty-codec-http/4.1.76.Final/netty-codec-http-4.1.76.Final.jar!/META-INF/native-image/io.netty/codec-http/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.micronaut:micronaut-jackson-databind:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-jackson-databind/3.4.2/micronaut-jackson-databind-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-jackson-core:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-jackson-core/3.4.2/micronaut-jackson-core-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-json-core:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-json-core/3.4.2/micronaut-json-core-3.4.2.jar)
[INFO] ImageClasspath Entry: com.fasterxml.jackson.core:jackson-core:jar:2.13.2:compile (file:///Users/mraible/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.13.2/jackson-core-2.13.2.jar)
[INFO] ImageClasspath Entry: com.fasterxml.jackson.core:jackson-annotations:jar:2.13.2:compile (file:///Users/mraible/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.13.2/jackson-annotations-2.13.2.jar)
[INFO] ImageClasspath Entry: com.fasterxml.jackson.core:jackson-databind:jar:<IP_ADDRESS>:compile (file:///Users/mraible/.m2/repository/com/fasterxml/jackson/core/jackson-databind/<IP_ADDRESS>/jackson-databind-<IP_ADDRESS>.jar)
[INFO] ImageClasspath Entry: com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.13.2:compile (file:///Users/mraible/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-jdk8/2.13.2/jackson-datatype-jdk8-2.13.2.jar)
[INFO] ImageClasspath Entry: com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.13.2:compile (file:///Users/mraible/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-jsr310/2.13.2/jackson-datatype-jsr310-2.13.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-runtime:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-runtime/3.4.2/micronaut-runtime-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-http:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http/3.4.2/micronaut-http-3.4.2.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/micronaut/micronaut-http/3.4.2/micronaut-http-3.4.2.jar!/META-INF/native-image/io.micronaut.http/micronaut-http/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.micronaut:micronaut-aop:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-aop/3.4.2/micronaut-aop-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut:micronaut-context:jar:3.4.2:compile (file:///Users/mraible/.m2/repository/io/micronaut/micronaut-context/3.4.2/micronaut-context-3.4.2.jar)
[INFO] ImageClasspath Entry: io.micronaut.security:micronaut-security-jwt:jar:3.5.0:compile (file:///Users/mraible/.m2/repository/io/micronaut/security/micronaut-security-jwt/3.5.0/micronaut-security-jwt-3.5.0.jar)
[WARNING] jar:file:///Users/mraible/.m2/repository/io/micronaut/security/micronaut-security-jwt/3.5.0/micronaut-security-jwt-3.5.0.jar!/META-INF/native-image/io.micronaut.security/token-jwt/native-image.properties does not match recommended META-INF/native-image/${groupId}/${artifactId}/native-image.properties layout.
[INFO] ImageClasspath Entry: io.micronaut.security:micronaut-security:jar:3.5.0:compile (file:///Users/mraible/.m2/repository/io/micronaut/security/micronaut-security/3.5.0/micronaut-security-3.5.0.jar)
[INFO] ImageClasspath Entry: io.micronaut.security:micronaut-security-annotations:jar:3.5.0:compile (file:///Users/mraible/.m2/repository/io/micronaut/security/micronaut-security-annotations/3.5.0/micronaut-security-annotations-3.5.0.jar)
[INFO] ImageClasspath Entry: com.nimbusds:nimbus-jose-jwt:jar:9.20:compile (file:///Users/mraible/.m2/repository/com/nimbusds/nimbus-jose-jwt/9.20/nimbus-jose-jwt-9.20.jar)
[INFO] ImageClasspath Entry: com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile (file:///Users/mraible/.m2/repository/com/github/stephenc/jcip/jcip-annotations/1.0-1/jcip-annotations-1.0-1.jar)
[INFO] ImageClasspath Entry: jakarta.annotation:jakarta.annotation-api:jar:2.0.0:compile (file:///Users/mraible/.m2/repository/jakarta/annotation/jakarta.annotation-api/2.0.0/jakarta.annotation-api-2.0.0.jar)
[INFO] ImageClasspath Entry: ch.qos.logback:logback-classic:jar:1.2.10:runtime (file:///Users/mraible/.m2/repository/ch/qos/logback/logback-classic/1.2.10/logback-classic-1.2.10.jar)
[INFO] ImageClasspath Entry: ch.qos.logback:logback-core:jar:1.2.10:runtime (file:///Users/mraible/.m2/repository/ch/qos/logback/logback-core/1.2.10/logback-core-1.2.10.jar)
[INFO] ImageClasspath Entry: com.okta.rest:app:native-image:0.1 (file:///Users/mraible/Downloads/micronaut/target/app-0.1.jar)
[INFO] Executing: /Users/mraible/.sdkman/candidates/java/current/bin/native-image @/var/folders/f7/5x4rvsr5599ffnfckn487nzm0000gn/T/native-image10219684773485556230args
========================================================================================================================
GraalVM Native Image: Generating 'app'...
========================================================================================================================
[1/7] Initializing...                                                                                (4.2s @ 0.24GB)
 Version info: 'GraalVM <IP_ADDRESS> Java 17 CE'
 3 user-provided feature(s)
  - io.micronaut.buffer.netty.NettyFeature
  - io.micronaut.http.netty.graal.HttpNettyFeature
  - io.micronaut.jackson.JacksonDatabindFeature
[2/7] Performing analysis...  []                                                                         (6.6s @ 0.53GB)
To see how the classes got initialized, use --trace-class-initialization=com.okta.rest.aot.generated.PropertySourceLoaderFactory,com.okta.rest.aot.generated.HttpResponseFactoryFactory,com.okta.rest.aot.generated.BeanIntrospectionReferenceFactory,com.okta.rest.aot.generated.BeanDefinitionReferenceFactory,com.okta.rest.aot.generated.BeanConfigurationFactory,com.okta.rest.aot.generated.HttpRequestFactoryFactory
   4,219 (87.53%) of  4,820 classes reachable
   5,345 (63.05%) of  8,478 fields reachable
  18,084 (79.86%) of 22,644 methods reachable
      55 classes,   124 fields, and   866 methods registered for reflection

Error: Classes that should be initialized at run time got initialized during image building:
 com.okta.rest.aot.generated.PropertySourceLoaderFactory was unintentionally initialized at build time. To see why com.okta.rest.aot.generated.PropertySourceLoaderFactory got initialized use --trace-class-initialization=com.okta.rest.aot.generated.PropertySourceLoaderFactory
com.okta.rest.aot.generated.HttpResponseFactoryFactory was unintentionally initialized at build time. To see why com.okta.rest.aot.generated.HttpResponseFactoryFactory got initialized use --trace-class-initialization=com.okta.rest.aot.generated.HttpResponseFactoryFactory
com.okta.rest.aot.generated.BeanIntrospectionReferenceFactory was unintentionally initialized at build time. To see why com.okta.rest.aot.generated.BeanIntrospectionReferenceFactory got initialized use --trace-class-initialization=com.okta.rest.aot.generated.BeanIntrospectionReferenceFactory
com.okta.rest.aot.generated.BeanDefinitionReferenceFactory was unintentionally initialized at build time. To see why com.okta.rest.aot.generated.BeanDefinitionReferenceFactory got initialized use --trace-class-initialization=com.okta.rest.aot.generated.BeanDefinitionReferenceFactory
com.okta.rest.aot.generated.BeanConfigurationFactory was unintentionally initialized at build time. To see why com.okta.rest.aot.generated.BeanConfigurationFactory got initialized use --trace-class-initialization=com.okta.rest.aot.generated.BeanConfigurationFactory
com.okta.rest.aot.generated.HttpRequestFactoryFactory was unintentionally initialized at build time. To see why com.okta.rest.aot.generated.HttpRequestFactoryFactory got initialized use --trace-class-initialization=com.okta.rest.aot.generated.HttpRequestFactoryFactory

Error: Use -H:+ReportExceptionStackTraces to print stacktrace of underlying exception
------------------------------------------------------------------------------------------------------------------------
                        0.4s (3.5% of total time) in 17 GCs | Peak RSS: 2.09GB | CPU load: 10.27
------------------------------------------------------------------------------------------------------------------------
Produced artifacts:
 /Users/mraible/Downloads/micronaut/target/app.build_artifacts.txt
========================================================================================================================
Failed generating 'app' after 11.0s.
Error: Image build request failed with exit status 1
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  16.673 s
[INFO] Finished at: 2022-04-16T22:16:03-06:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.graalvm.buildtools:native-maven-plugin:0.9.11:build (default-build) on project app: Execution of /Users/mraible/.sdkman/candidates/java/current/bin/native-image @/var/folders/f7/5x4rvsr5599ffnfckn487nzm0000gn/T/native-image10219684773485556230args returned non-zero result -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

It doesn't seem to have all the changes that are in this PR. Is that expected?

The only bit missing AFAIK is the Logback XML to Java conversion, which requires Logback 1.3 which is still an alpha version.

Thanks for the response @alvarosanchez. I'll close this issue. I documented the need to run clean in my post's update PR. https://github.com/oktadev/okta-blog/pull/1142

Sounds good. I have created an issue to track down the error, since running clean is not optimal.
Will send a PR to the blog once that is fixed.


Simulation study dataset build

Identify and write a reproducible procedure to build the dataset from the UKB and potentially other study.

Requires extracting a subworkflow to generate a dataset in TarGene


Spec suite speed increase

This is just Pull request to discuss minor changes to increase spec speed.

found a small change to increase spec speed.
This is twice as fast and the more zeros you add the faster this gets but I was not sure if it was worth the noise in the code.
You can can get this 3X faster with lines of zeros.
$ ./bin/crystal build  -o lol spec/compiler/semantic/tuple_spec.cr; and ./lol -p
Using compiled compiler at `.build/crystal'
............................


GDB-5294 Implement window messaging service to receive language string

Implemented service to handle massages posted from parent window

LGTM, but just check why the lint has failed!

LGTM, but just check why the lint has failed!

lint issue - 'MessageType' is defined but never used

lint issue - 'MessageType' is defined but never used


Card Grid decoration doesn't change color

In this component, https://elements.nuxt.space/landing/card-grid#cardgrid, there is a rounded blurred decoration. But using pinceau config file, I expected that change the color to have a fully harmonized first page. Unfortunately, that's not the case.
Currently

rounded blurred decoration in codegroup? where's it on your screenshot? not really sure I understand what you mean

Yes, I'm speaking about this component. (Screenshot from my local computer but soon on internte)
https://elements.nuxt.space/landing/card-grid
The blurred circle doesn't change colors to use theme colors from pinceau.
Here my config:
import { defineTheme, palette } from 'pinceau'

export default defineTheme({
  color: {
    primary: palette('orange')
  }
})

But maybe I need to add more config to this file?

I'm talking about ellipsis https://elements.nuxt.space/globals/ellipsis (but there is no exemple so I did not understand that was this.

Ho, I understand, I called CardGrid CodeGrid. Sorry about this confusion.

I am afraid, right now Ellipsis gradient is hardcoded, as Pinceau struggles with rgba function, but maybe @Tahul knows the way to make it use generated palette?

Hey :)
@Barbapapazes we can definitely change that inside the Ellipsis for sure.
Also, what you can do is copy the component with the exact same name in your components/ directory, and replace the implementation with yours, and you should be fine! :)

Thanks for the response. As I can see in elements, it's possible to pass a props and the overwrite is a nice idea.


Stats to terminal while logging to file

This is a feature request
What is the problem you are having with rclone?
I would like Rclone to support the following
Output stats to console/terminal while "log to file" is active. Stats should not be outputted to the "log to file"
Is it possible that an extra parameter is added so that we can decide where the stats should be outputted (to log or to console/terminal)
What is your rclone version (eg output from rclone -V)
1.42
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Windows 10 x64 1803
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone.exe sync --delete-after --bwlimit 3M --delete-excluded --exclude-from "C:/rclone/Configs/Exclusions.txt" --stats 1s --log-file "C:\Log\Rclone.log" --log-level INFO D:/ cryptGDrive:D
A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

I think you are probably looking for the --progress or -P flag in the latest beta.
This will output updating stats to the terminal and you can send the log elsewhere with --log-file.

The latest beta results in this for me so i was unable to test it
C:\rclone\rclone.exe sync --delete-after --bwlimit 3M --delete-excluded --exclude-from "C:/rclone/Configs/Exclusions.txt" --progress --stats 0m --log-file "Rclone Mirror_D 2018-09-01  43037-Simulate.log" --log-level DEBUG --dry-run D:/ cryptGDrive:D
2018/09/01 04:30:38 DEBUG : rclone: Version "v1.42-157-gb4d86d54" starting with parameters ["C:\rclone\rclone.exe" "sync" "--delete-after" "--bwlimit" "3M" "--delete-excluded" "--exclude-from" "C:/rclone/Configs/Exclusions.txt" "--progress" "--stats" "0m" "--log-file" "Rclone Mirror_D 2018-09-01  43037-Simulate.log" "--log-level" "DEBUG" "--dry-run" "D:/" "cryptGDrive:D"]
2018/09/01 04:30:38 DEBUG : Using config file from "C:\Users\Username\.config\rclone\rclone.conf"
2018/09/01 04:30:38 INFO  : Starting bandwidth limiter at 3MBytes/s
panic: non-positive interval for NewTicker
goroutine 25 [running]:
time.NewTicker(0x0, 0xc0003a3f58)
C:/go/src/time/tick.go:23 +0x196
github.com/ncw/rclone/cmd.startProgress.func2(0xc00006c300, 0x11c2bc0)
C:/gopath/src/github.com/ncw/rclone/cmd/progress.go:44 +0x58
created by github.com/ncw/rclone/cmd.startProgress
C:/gopath/src/github.com/ncw/rclone/cmd/progress.go:39 +0x89

Remove the "--stats 0m" and it will work.  I'll fix that now!

I've fixed that in the latest beta (uploaded in 15-30 mins).
Note that 1.43 is released which should work provided you don't use --progress and --stats 0 together!

Thank you
Works perfectly

I've found an issue
When --progress is enabled i sometimes get a lot of these errors in the console.
*** Error from ANSI parser: New state of 'nil' is invalid.
After some investigation the following filename wil trigger this. These are chinese characters. Japanese and Korean characters don't seem to be an issue though

狐妖小红娘.ext

Test command
C:\rclone\rclone.exe sync --delete-after --delete-excluded --exclude-from "C:/rclone/Configs/Exclusions.txt" --progress --log-file "C:\Users\username\Desktop\Rclone TEST.log" --log-level DEBUG E:/test/ cryptGDrive:TEST

no i don't see them.
Japanese and korean characters are not shown and do not generate errors.
Chinese characters generate the beforementioned error
Personally i don't really care that the utf8 characters are not shown, just as long as the error is suppressed since that actually blocks showing "--progress"

@SL-Gundam thanks for the clarification.
The best way forward on this would be to fix the above issue - fancy having a look at that?
I think a reasonable fix for you would be not to report errors from the parser which would at least make -P useful.  What do you think of that?

In this specific situation the ANSI parser error is useless in my opinion.
I'm not sure what other situations it might occur and might actually be wanted
So suppressing the error would be fine for me. Another option is to move the error to log level DEBUG. Since debug is used to test mostly, production environments would not affected

I supressed the error here.
Can you have a go with it?  Does the ansiparser display something sensible even though there was an error?
https://beta.rclone.org/branch/v1.43-075-ge367b399-fix-2501-progress-errors-beta/ (uploaded in 15-30 mins)
Thanks

I'm sorry to say but its not fixed.
The error is not shown. Thats good. But the progress is also not shown as can be seen from the screenshot
Rclone 1.43-075

Rclone 1.43.1:

OK I had another idea - here I just replace all non-ASCII characters with .
I think that should fix the strange behaviour - it isn't ideal but hopefully will do until the upstream bug is fixed.
https://beta.rclone.org/branch/v1.43-137-g60dac68f-fix-2501-progress-errors-beta/ (uploaded in 15-30 mins)
What do you think of that @SL-Gundam ?

For "v1.43-137-g60dac68f-fix-2501-progress-errors-beta" the windows version is still not available so i tested against "v1.43-139-g87ef3cc6-fix-2438-s3-v2-sign-beta"
Not sure whether this change is present in that version
To my knowledge its not an issue for the command prompt if you output UTF8. I will just show a question mark since the font being used does not support UTF8 characters (based on my experience with robocopy). It should suffice to make sure that Rclone's ANSI Parser does not stumble on the UTF8 characters.
See the result below. I'm afraid its unchanged

@SL-Gundam
The windows build bot decided to take a holiday!
Try this one instead
https://beta.rclone.org/branch/v1.43-138-gf6c174e9-fix-2501-progress-errors-beta/ (uploaded in 15-30 mins)
Thanks

Works perfectly :thumbsup:


Demo: Automatic publish to PyPI

Automatically publish elliott and doozer to PyPI when a new release tag is created.
See openshift-pipelines/README.md for instructions.

tl;dr
but it seems unlikely to cause problems and i trust you know what you're doing :)


Navbar toggle not working || Mobile view

Describe the bug
Navbar toggle not working || Mobile view
Note:

Do mention if your are working under GSSoC'21.
If you want to work on an issue, you should check if it has already been assigned to anyone. If the issue is free you can comment /assign to get the issue assigned to you.
If you are raising a new issue and want to work on it then also you should comment /assign under the issue to get it auto assigned.
Please refrain from adding labels to your issue/pull-request on your own. It is the job of the Project Admin and the Mentors to review your issue/pull-request and add labels accordingly.
According to the level of the issue, respective time will be allotted under which the task needs to be completed/resolved by the assigned person. If the issue is not resolved within the given time, it will be assigned to the next person. In case of any discrepancies, the decision of the maintainer will be final.

level - 0: 2 days
level - 1: 3 days
level - 2: 4 days
level - 3: 5 days

I am self assigning this issue under gssoc.
/assign

/assign

@Pranav016 Hey. I checked everything on my end I think there is an issue with the bootstrap js file. If we change the version back to 4.3.1 then the navbar works fine. If you have any other suggestions please let me know.

@Pranav016 Hey. I checked everything on my end I think there is an issue with the bootstrap js file. If we change the version back to 4.3.1 then the navbar works fine. If you have any other suggestions please let me know.
And if I change the version back we get console error because the file is blocked. Do you want me to make the navbar again ?

Can suggest a fix with the latest bootstrap versions ? We need a long term solution


shalika- adding mock-server script in package.json

@tiagostutz can you please verify the PR and merge it ,if it has no issue

@tiagostutz any update ?

Hi @shalika10 👋🏻 !
First of all, thanks for your PR! =)
I'm reviewing it right now and will come back asap.


A Logo Proposal

Greetings,
I've noticed this project and see that it doesn't have a logo,
I'm a Graphic Designer I could give you a logo proposal if you wish,
If this is something that may be of the interest of this project, let me know
Cheers! Luigi.

@LuigiBaute it won't be a bad idea, looking forward to seeing what you come up with

Ok I'll start working on it, the name of the logo should be ''legato'', right? @terdia

yes

Maybe knowing what Legato means can give more inspiration - https://en.wikipedia.org/wiki/Legato

Hello @terdia this is what I came up with, If you like the idea and want a different color variation let me know, any suggestion is welcome. Cheers!

The last row is preferred so far, can it be improved?

Sure, which color you liked the most? how do you want me to improve it? @terdia

@LuigiBaute this one -

I should submit a pull request with the resizable png plus the monochromatics, and all its files in a google drive, is that good?
@terdia

how about?

This

without the line is okay

Hello @terdia ,

I really like this logo I think It'll suit your project very well :+1:
Can I submit it in a Pull Request?

Yes @LuigiBaute  please do, thanks for your help

@terdia should I create a new file for the logo or just upload it on an specific file already created?

Maybe add a logo folder and out it inside

I've submitted the pull request now, thank you for letting me be a part of this really cool project!
Best regards!

Thanks a great deal. I will pull and check later.

Closing this issues

Best regards @terdia
I'd like to know more about the details of this project, I read the link you sended but it gave me abstracts ideas about it, this project is about ''music sequencers, instrument controllers, fingerboards, guitar synthesizers, wind controllers, and electronic drums. Synthesizers without built-in controllers are often called sound modules, and are controlled via USB, MIDI or CV/gate using a controller device, often a MIDI keyboard or other controller.'' ? If you'd like me to update the read me to give more specific details about the project, I could do that :+1:

OOPS no this is actually a PHP framework, you can read more more in the documentation https://docs.legatoframework.com

That explains everything pretty well, If I could suggest is for you to add that link to the project description and the content of the site to the project read.me I think it would be easier for a newcomer to this project to understand it! thanks! @terdia


The input for a date in the creation of cleanup and maintenance records should be a calendar.

It should be a calendar so it is easier for people to pick a date.

http://www.w3schools.com/tags/tryit.asp?filename=tryhtml5_input_type_date

Fixed by pull request #88.


Are these features meant to work via Siri / Homepod

Quick question as I can't find anything concrete on this. I have installed this and all is working on both of my LG TVs. I can turn the devices on & off.
Homebridge can see volume controls and channel up / down, mute etc. But I can't seem to tell Siri to apply these settings via voice. Like I want to be able to "Pause Living Room TV" or "Next Channel or Channel Up on Living Room TV". Doesn't seem to work.
Can someone point me int he right direction on how to get this fixed if it is indeed possible.
Thanks

You have to create the switches for those features (with configuration) and tell Siri to turn them on by the switch name. As far as i am aware Siri is not able to control a TV they way you would expect it to.

Thanks for the reply. Yes, "Channel Up On" seems to work, just doesn't feel natural. I wonder if there is a way to change it.

Unfortunately not and the reason is as I already mentioned because Siri cannot control TV's officially.


fixed the issue with character slicing

fixes #138

When this PR is merged, we'll either want to rebase out the checkpoint commit with the failing test, or we'll want to squash it.

@dibashthapa thanks for the pr. Could you sign the commit so we can merge it?

@jaytaph Done

@dibashthapa thanks for the pr!


Bug 2100436: VM list filter failed vms

📝 Description
Add Failed status filter
🎥 Demo

/approve

/lgtm


⚠ Bofrost.fr has degraded performance

In 0a1205a, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1203 ms

Resolved: Bofrost.fr performance has improved in 2dd1f6d after 13 minutes.


Making a script that installs dependancies

As an enhancement we can add a bash script, like a ./setup that installs all the dependencies and runs pip too?

@vedmathai Please do not open empty issues.

Sorry, the draft got published by mistake. I am writing the whole thing now.

How different would it be in terms of architecture as compared to https://github.com/Melissa-AI/Melissa-Core/blob/master/setup/travis-build-core.sh ?

This is exactly what I had in mind. Maybe one work around is make something called ./install.sh and then call the file you mentioned above from within it.
Another is to make the setup more interaction oriented, similar to what you have in the installation wiki. But only the setup interacts with you. If you ask me, it seems more of a frill than anything. But it will be nice considering you a aiming for a release. It will make it more friendly to first timers. And given the point of the project is 'assistance', it will really go well with the philosophy.

I see, do you wanna mock up a sample so that I can get a more precise idea of what are you trying to do differently? I must admit, an easier installation process is crucial to save time.

How about wrapping it as an Python package thus allowing people to install it using a single line command like
sudo pip install melissa

which inturn calls a script that consists of the following lines of code
sudo apt-get install gcc automake autoconf libtool bison swig python-dev libpulse-dev
sudo apt-get install espeak
sudo apt-get install multimedia-jack
cp data/memory.db.default data/memory.db

Yes, let's make brew and apt-get package managers a priority. Have you worked on making packages for these before @lakshmanaram?

@tanay1337  I have worked on managing python packages before but haven't done brew or apt-get. I can try working on the apt-get one if that's okay....

Pardon me @lakshmanaram, I misread what you wrote. pip seems like a good idea, go ahead with that.

@tanay1337 I shall start working on it right away.. :+1:

Any updates @lakshmanaram?

I am working on it @tanay1337 . Really sorry for the delay.
And is it okay if I rearrange the repo structure to look this way
Melissa-Core/
|-  LICENSE.md
|-
|-
|-
|-

I am working on it @tanay1337 . Really sorry for the delay.
And is it okay if I rearrange the repo structure to look this way
Melissa-Core/
|- LICENSE.md
|- README.md
|- requirements-dev.txt
|- requirements.txt
|- setup.cfg
|- melissa/
|    |-- main.py
|    |-- start.py
|    |-- tests/
|    |     |--- ...
|    |-- setup/
|    |     |--- ...
|    |-- data/
|    |     |--- ...
|    |-- melissa/
|    |     |--- ...

With respect to this structure, Melissa-Core would be the git repo and outer melissa directory would be considered as a single module inside which all the other directories are placed undisturbed.
Classic structure for Python packages is to have a single module directory. If you have some issues with this structure, then I shall stick to the present repo and push the pip setup that I've done.

Hmm, I can't see why not but I just have a few concerns (or rather questions since I am not aware of the pip workflow and infrastructure).

The users will have to go to Melissa-Core/melissa when they start?
Is it possible to abstract the installation procedure to just pip install melissa and  then use it from an independent Python file via something similar to this?

import melissa
melissa.main()

CC: @rachmadaniHaryono

for question
1 don't have to.
from python
import melissa.main import main
main.main()

or we can add main.py to call it from module (http://stackoverflow.com/questions/4042905/what-is-main-py)
```python -m melissa````
2 to use it from pip install just add entry points http://python-packaging.readthedocs.io/en/latest/command-line-scripts.html#the-console-scripts-entry-point
advantage

the structure have advantage for subfolder module to import the module from the parent or other subfolder
one folder containing all files.
other here http://stackoverflow.com/questions/193161/what-is-the-best-project-structure-for-a-python-application
may fix absolute import if ported to python3

other:

i don't know why there is setup and data folder there, because afaik we don't have any
we only have subfolder plugins and other file is either in one folder with both main.py and start.py so it still have better import naming (see below)
the test is actually excluded due to recommendation from pytest. it didn't have __init__.py file http://doc.pytest.org/en/latest/goodpractices.html?highlight=init

from that structure alone, to import stt module, user have to do it like this
from melissa.melissa import stt

Okay then, you can go ahead with the proposed architecture @lakshmanaram!

Cool @tanay1337
@rachmadaniHaryono  explained the structure beautifully. Thanks for the links.
I initially intended to move the tests, so that they'll not be disturbed relative to the project core. I guess, I shall keep the tests folder as suggested in the main directory itself. :+1:
And there are setup and data folders inside melissa directory at present which aren't going to be disturbed in the process of reorganizing the structure.

Any progress on this @lakshmanaram @rachmadaniHaryono? This is now P1 and is acting as a blocker for https://github.com/Melissa-AI/Melissa-Core/issues/11.

I see your name here @rachmadaniHaryono.

Any updates on this @lakshmanaram ?

@tanay1337 is this issue still continued, with #165 there will also be complete overhaul of the package.
i don't know how much @lakshmanaram have done, but if possible maybe directly change the structure package with the new integration branch on 165?

That's actually a good idea, @rachmadaniHaryono. Would you like to help me with it? Currently, I am planning to work on this: https://github.com/Melissa-AI/Melissa-Core/pull/144 and as soon as I am done, I will join you with https://github.com/Melissa-AI/Melissa-Core/issues/165.

Why not use setup tools ?

@tanay1337 @lakshmanaram @rachmadaniHaryono
What I can perceive (from this issue) is that we have to add an install.sh to install the dependencies. Right ?

not anymore since #175, it should be installed with pip install .

That's right @rachmadaniHaryono


HTTP Response code 304

Based on Cache section, we expect to have code 304 as a supported response code also in HTTP Method to Status Code Mapping section (but unfortunately not supported since not mentioned among the allowed code "API developers SHOULD use only").

The mapping should be read as follows : "For each HTTP method, API developers SHOULD use only status codes marked as "X" in this table", as stated above the table. However, that does not mean that developers cannot use status codes that aren't in the table. In fact, developers can use status codes as listed in section "Status Codes List". The mapping method/status code is simply for common HTTP methods.


Add feature gate to operator

Which issue this PR addresses:
Fixes cases where we enabled Prometheus in production and it is broken due to storage being not available
What this PR does / why we need it:
Introduces feature flag into the operator to enable/disable features
Test plan for issue:
unit
Is there any documentation that needs to be updated for this PR?
Will need to be done after

Have we considered approach where we instead of proposed here feature gate add reconciler for the managed storage class?

Are you referring to the out-of-box ARO managed-premium storage class? My take is that we should only add a reconciler to watch it, if we are sure users won't replace it with their own default storage class. If there are more than one default storage classes, the storage class admission controller will fail, per K8s doc here.

Have we considered approach where we instead of proposed here feature gate add reconciler for the managed storage class?

The problem with this is that customers can use any other storage (databricks, storageos, any other random provider) and we are not in the position to change this.

/lgtm


page generators override existing folders

Components are working btw.. only generators
but I guess it's safer to check for the folder rather than checking for the file


Add golang archive to /usr/local/go instead of /usr/local

Issue #, if available: N/A
Description of changes: Go archive should be added to /usr/local/go instead of /usr/local.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/assign @danbudris

/ok-to-test

/lgtm

/approve


Possible memory leak on SSR / server side

First off, thanks for this super awesome plugin!
That being said, I think I just discovered a memory leak when using snotify with SSR.
This can be mitigated by only installing the plugin on the client side (which probably makes sense anyway).
I haven't found the root cause of this leak, but by not installing (Vue.use()) this plugin server-side solved the leak.
For anyone wondering how to do this:
make sure you know if you are rendering client or server side eg. in webpack.client.config:
plugins: [
    new webpack.DefinePlugin({
      'process.BROWSER_BUILD': true,
    })
]

Next only use the plugin if this variable is true
if (process.BROWSER_BUILD) {
  Vue.use(Snotify)
}

I think that needs to be added to the readme.


Use puppet templates

Many configuration values are hard coded in files and then they are copied in the right folder. It would be nice to use template and set the value to use inthe puppet script. Example: jetty http pot

outdated: moved to use Ansible now, and tracking issues on JIRA.


Does not work for relative paths with one dot

-//! [non_blocking]: ./non_blocking/index.html
+//! [non_blocking]: .::non_blocking

Ok, the issue is something to do with the leading module, this works fine:
   62:  "/// [`Layer`s]: ../layer/trait.Layer.html"
        "/// [`Layer`s]: layer::Layer"

Making progress:
-//! [non_blocking]: ./non_blocking/index.html
+//! [non_blocking]: non_blocking
 //! [write]: https://doc.rust-lang.org/std/io/trait.Write.html
-//! [guard]: ./non_blocking/struct.WorkerGuard.html
-//! [rolling]: ./rolling/index.html
+//! [guard]: .::non_blocking::WorkerGuard
+//! [rolling]: rolling

Thanks a lot ! I was working on another branch that I simply forgot to push that handle this (and many other things).
I just merged my branch into master, could you check if the most recent version fixed the problem ? (Feel free to reopen if it did not)


Continue workspace build after a crate fails

Running cargo hax into ... on a virtual workspace with crates A and B, where A uses B (not sure if this is relevant though).
Expected
Code from both crates is extracted
Actual
B has some errors during extraction and A is never extracted.
Note that running cargo hax into ... for crate A extracts code. But it is impossible to extract all crates in the workspace with one invocation of cargo hax into .... This appears to be a regression introduced in #174.

We maybe will need to use Cargo build plans for this

This is related to #173: in that PR ultimately we want to redesign things a bit to always use cargo build plans

@W95Psp can you check if this is still an issue? It's still something we should support.


Integration: TimescaleDB for Time-Series Data

Write tutorial (documentation) how to use pREST with TimescaleDB

@avelino What about provide a docker-compose.yml as an example?

@fabriziomello docker-compose is a great way, you can put it inside the documentation folder.

@avelino just an example below of what I have in mind.

I like Integrations topics page name, send PR pls 😄


插入图片支持设置背景吗

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

你好，预计本周内的版本更新将会支持

@hadoop835 设置表格背景功能已加入，请关注后续版本更新

Reverted for problematic implementation.


How to set "noResult" and "noOptions" slot for vue-multiselect?

The slot is empty and no text is shown in frontend.

Ok i looked into the pug template and find that it simply uses a property "noResult" for the noResult-slot and a property maxElements for the maxElements-slot.
Thats not mentioned here
https://vue-generators.gitbook.io/vue-generators/fields/optional_fields/vuemultiselect


Added tests for enums with String and Float raw types

Nice work! Thanks @burntheroad

Cool! Git is so hard sometimes. Thanks for your patience


Storybook: Set up VR stories for all components

VR stories should include as many states in a single story as possible. This will make reviewing snapshots easier and reduce how many snapshots we use per release.
TODO: create sub tasks for each component

Going to focus on demos first


VS Code Integration

Report
Thoughts on how to improve VS Code integration in the docs:

[x] Add more gifs and examples - where?
[x] Add tab to download button on landing page
[ ] Add gifs/examples on landing page - show different interfaces we support (vs code, jupyter, etc.)?

I think we should close this and come back to the last item as part of/after the landing page redesign. WDYT @shcheklein?

Sounds good to me!


Server Error 500 when applying DO JSON in 1.9.0

Environment

Declarative Onboarding Version: 1.9
BIG-IP Version: 15.0.1 Azure

Summary
Attempting to build a cluster of Azure LB with 2 F5 BIG-IP Nodes in avail set via Terraform. When using DO, DO returns with a 500 server error
"errors":["Cannot read property 'includes' of undefined","Cannot read property 'includes' of undefined"]
Steps To Reproduce
Steps to reproduce the behavior:

Submit the following declaration:

{
    "schemaVersion": "1.9.0",
    "class": "Device",
    "label": "Basic onboarding",
    "Common": {
        "class": "Tenant",
        "hostname": "(redacted)",
        "dbvars": {
            "class": "DbVariables",
            "ui.advisory.enabled": true,
            "ui.advisory.color": "green",
            "ui.advisory.text": "/Common/hostname",
            "configsync.allowmanagement": "enable"
        },
        "myDns": {
            "class": "DNS",
            "nameServers": [
                "<IP_ADDRESS>",
                "<IP_ADDRESS>",
                "<IP_ADDRESS>"
            ],
            "search": [
                (redacted)
            ]
        },
        "myNtp": {
            "class": "NTP",
            "servers": [
                "time.nrc.ca",
                "0.pool.ntp.org",
                "1.pool.ntp.org"
            ],
            "timezone": "Canada/Eastern"
        },
        "myProvisioning": {
            "class": "Provision",
            "ltm": "nominal"
        },
        "default": {
            "class": "Route",
            "gw": "<IP_ADDRESS>",
            "network": "default",
            "mtu": 1500
        },
        "configsync": {
            "class": "ConfigSync",
            "configsyncIp": "<IP_ADDRESS>"
        },
        "failoverAddress": {
            "class": "FailoverUnicast",
            "address": "<IP_ADDRESS>"
        },
        "failoverGroup": {
            "class": "DeviceGroup",
            "type": "sync-failover",
            "members": ["(redacted, this is node1 fqdn)", "(redacted, this is node2 fqdn)"],
            "owner": "/Common/failoverGroup/members/0",
            "autoSync": true,
            "saveOnAutoSync": false,
            "networkFailover": true,
            "fullLoadOnSync": false,
            "asmSync": false
        },
        "trust": {
            "class": "DeviceTrust",
            "localUsername": "(redacted)",
            "localPassword": "(redacted)",
            "remoteHost": "<IP_ADDRESS>",
            "remoteUsername": "(redacted)",
            "remotePassword": "(redacted)"
        }
    }
}

Observe the following error response:

"selfLink":"https://localhost/mgmt/shared/declarative-onboarding/task/d48587a5-3301-47b1-86c6-51f235f34ef8","code":500,"status":"ERROR","message":"invalid config - rolled back","errors":["Cannot read property 'includes' of undefined","Cannot read property 'includes' of undefined"],"result":{"class":"Result","code":500,"status":"ERROR","message":"invalid config - rolled back","errors":["Cannot read property 'includes' of undefined","Cannot read property 'includes' of undefined"]}

Expected Behavior
200 OK
Actual Behavior
500 Internal Server Error

Issue is tracked internally as AUTOTOOL-1139.

This issue has been resolved as part of the 1.11.0 release.


Ktlint 0.44.0, Kotlin 1.6.10

This pull request closes #1105

java.lang.ClassCastException: class kotlin.reflect.jvm.internal.KTypeImpl cannot be cast to class kotlin.jvm.internal.TypeReference (kotlin.reflect.jvm.internal.KTypeImpl and kotlin.jvm.internal.TypeReference are in unnamed module of loader 'app')
	at org.cqfn.diktat.ruleset.smoke.DiktatSmokeTest.overrideRulesConfig(DiktatSmokeTest.kt:300)
	at org.cqfn.diktat.ruleset.smoke.DiktatSmokeTest.overrideRulesConfig$default(DiktatSmokeTest.kt:53)
	at org.cqfn.diktat.ruleset.smoke.DiktatSmokeTest.regression - should not fail if package is not set(DiktatSmokeTest.kt:96)

Ktlint 0.44 also has (finally) a proper logging framework integration. We should check it in our plugins, where for both maven and gradle a slf4j-compatible logger is already available.

if you will be fixing build one day - please polish the readme formatting (RUN AS CLI section) in this PR. There is a broken formatting in it.

Build passes with kotlin 1.6.10 and ktlint 0.43.2 and explicit ListSerializer.
In ktlint 0.44.0 they must've changed something important.
Also, they now have rule modifiers: RunAfterRule to establish order without the need to constantly change ruleset provider.

There was a breaking change in pinterest/ktlint#1230: now rule execution order is determined not by order from RuleSetProvider (which we heavily relied on), but rather rules are sorted alphabetically by IDs with ability to tweak order with modifiers. I managed to make our smoke tests pass by copying part of our rules order using modifiers, but it probably needs more testing.

very serious change, as we depend on the rule order…

May be we should assign proper IDs (aka 1,2,3) for rules to save the order?

May be we should assign proper IDs (aka 1,2,3) for rules to save the order?

We should prepend all rule IDs with padded indices 001, 002, ..., 137 to preserve the original order

May be we should assign proper IDs (aka 1,2,3) for rules to save the order?

We should prepend all rule IDs with padded indices 001, 002, ..., 137 to preserve the original order

@Arrgentum could you please help with this change? You can commit directly into this branch. Rules should have IDs like 001-comments, 002-single-constructor etc. Basically, we want them to be sortable lexicographically into the same order that we currently have in DiktatRuleSetProvider. This way we won't need things like RunAfterRule


Godot 3.3.4    24-May-2021, HTML5 Exporter Bugg (InteractiveLoader fail)

Godot version:

https://downloads.tuxfamily.org/godotengine/3.3.2/Godot_v3.3.2-stable_win64.exe.zip
OS/device including version:

Open Gl 2.0 Intel (R) HD Graphics 620
Issue description:

Load + Interactiveloader(), fail in HTML5
Steps to reproduce:
var newScene = Load(PathToScene).instance() ####.   " InteractiveLoader() "
get_tree().get_root().add_child(newScene)
Minimal reproduction project:

PLease View the video.--  (unknow function in js file exporter)
https://youtu.be/oAHuzi1uc7o
(https://esbva.itch.io/xenauts )

Correction
Itch.io, limitation pck size < 100mg, use Gamejolt
https://gamejolt.com/games/Xenauts/385452


Network state listener not working for capacitor

Network changes are not triggered due to different network api.

@kingsleyzissou I think we are good to close it. It have been addressed.
Feel free to assign to yourself

I did a test earlier this week and it seemed good to me. We can reopen if we need to.


Provide Float::min_positive()

Is there a good reason that Float doesn't export a function min_positive() wrapping f32::MIN_POSITIVE and f64::MIN_POSITIVE?
If there is none, I would argue to include this method.

Fixed in https://github.com/rust-lang/num/pull/99


[Bug]:  Stretchly cannot skip the break when mac do not disturb is on

Version

[X] I'm using version 1.10.0

Known issues

[X] I've checked Known issues

Existing issues

[X] I've checked Existing issues

What operating system are you using?
macOS
Operating System Version
macOS Monterey 12.4
Reproduction steps

open mac do not disturb

...
Reproduces how often: [What percentage of the time does it reproduce?]
Expected Behavior
Stretchly stop timer and skip the break
Actual Behavior
Stretchly still continue timer and show the break screen.
Relevant log output
No response
Preferences
No response
Additional information
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Hi, I am not sure what exactly you mean in "Expected Behavior", but when DND is on, it is correct behavior to not allow breaks. Stretchly respects DND settings and show no breaks in DND.

Hi, I am not sure what exactly you mean in "Expected Behavior", but when DND is on, it is correct behavior to not allow breaks. Stretchly respects DND settings and show no breaks in DND.

In fact,  now if i turn on DND, the break page will still show. My system version is monterey 12.5。

@stevechoris could you please share the logs when that happens?

ok, where is the log path, please?

2022年8月6日 19:31，Jan Hovancik @.***> 写道：
@stevechoris https://github.com/stevechoris could you please share the logs when that happens?
—
Reply to this email directly, view it on GitHub https://github.com/hovancik/stretchly/issues/1172#issuecomment-1207198714, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA6P7XZQLL2JV4DSFBNF43DVXZEJ7ANCNFSM53XWIGQA.
You are receiving this because you were mentioned.

https://github.com/hovancik/stretchly#debugging

I have same issue. My system version in 12.5.1
Here are the logs. It happens for some times.
I took a quick look at the logs and it looks like the DND mode detection is the problem. I tried to turn DND on and no record appears in logs. I have DND set to be turned on working days at 10:00 and that is not in logs as well.

Thanks for the logs! I am using this library, and it seems it does not support the Monterey, yet :( https://github.com/felixrieseberg/macos-notification-state/issues/32

Duplicate of #1080


Only show relevant tabs.

Hey, I just made a Pull Request!
For organizations that have a lot of plugins, some teams may want to utilize plugins that others find to be a distraction on their pages.
The CI/CD switcher is a good pattern, but it still forces the entire organization to agree on what tabs are active.
With this change, the default EntityPages will only show the tabs that are applicable for the Entity based on its annotations, providing more control to teams on how they want their Entity to look.
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[x] All your commits have a Signed-off-by line in the message. (more info)

Hi! The entity pages have recently been migrated and look like this now: https://github.com/backstage/backstage/blob/100f6e74982864c1fe9656d4d13565985782285c/packages/app/src/components/catalog/EntityPage.tsx#L386. There's some guides around how to migrate in the create-app changelog and a bunch of information here: https://backstage.io/docs/plugins/composability
We had the idea to implement an if prop on the EntityLayout.Route component, similar to the EntitySwitch.Case. It would cause the tab to be shown only if the filter in the if prop matches. Would that cover your use-case as well?

Yes that's perfect, thanks @Rugvip


Crash when left-clicking certain blocks like EnderIO fluid conduits

The title should be enough for illustrating the whole issue.
This also happens on Advanced Seared Drain from Smeltery IO, but crash reason not exactly the same, I will provide crash logs for both of them.
EnderIO(Ender Fluid Conduit)
SmelteryIO(Advanced Seared Drain)

GTCEu(Coke oven hatch) as well
probably because of some TEs isn't implementing getTankProperties properly


Bug: OSX-specific shortcuts don't work

Some specific ones called out on Discord:

cmd+shift+] (and [) to shift through open tabs
cmd + , to open settings

We should definitely hook up these; as they don't conflict with Vim bindings, and should just work.

Can I add a few other ones?

Command + W: Close tab / buffer.
Command + 1-8: Jump to the nth tab.
 Command + 9`: Jump to the last tab.

The change tabs shortcuts for macos now work. (I can't seem to find the commit where they got added.

Thanks @yunti. Also Cmd+W should work. I've updated #1423 with Cmd+,, and will close this in favor of that.


add documentation for using with Kubernetes

Can we also collapse the 4 commits into 1

squashed

I think we need to wait for the verification of bosh deployment success, and attempt to attach a similarly local minikube or kubeadm-dind deployed kubernetes to confirm this works.

yeah I would like to try it against a kubernetes deployment. will give it a go tomorrow since I have a running deployment of the broker


Add jmx_port config.

The CMAK application has the following line:
val jmxPortResult = fieldExtended[Int]("jmx_port")(json)
It would be nice to be able to configure the JMX port in the config file. Not every Kafka is exposing JMX on TCP 12345.

Dear @tdixonspin
Why did you put this question here ? Please explain

I honestly wasn't sure where it put like a feature request. I just noticed that I wasn't able to set a custom JMX port, and it looks like CMAK pulls it from the config, but your operator doesn't account for it in the clusterConfigShared schema.

I honestly wasn't sure where to put like a feature request. I just noticed that I wasn't able to set a custom JMX port, and it looks like CMAK pulls it from the config, but your operator doesn't account for it in the clusterConfigShared schema.

how do you handle JMX port configuration outside of K8S ?
What are exact actions, plz report here.

Nothing specific outside of K8S. Right now we are exposing TCP 7075 for JMX metrics. It looks like CMAK takes the jmx_port object in for this object:
case class BrokerIdentity(id: Int, host: String, jmxPort: Int, secure: Boolean, nonSecure:Boolean, endpoints: Map[SecurityProtocol, Int]) {     def endpointsString: String = endpoints.toList.map(tpl => s"${tpl._1.stringId}:${tpl._2}").mkString(",")   }

Duplicate of https://github.com/eshepelyuk/cmak-operator/issues/13

I don't have any JMX port configurations outside of K8S.


Update the README.md file to describe the repo.

Edits made to README.md and attempting first pull request as per Google Shell git tutorial.

I didn't realize that commits made after the pull request approval would also be merged. I will be mindful of this in the future and can revert if deemed necessary, but am using this opportunity to test out the live site.


Add more compile compatibility for Float8Tensor ops

We have been pretty targeted with the ops we support for Float8Tensor, I am curious if you have any concrete usecases for these ops. Could you also add some tests cases. Otherwise thanks for the contributions, I am surprised that the contstructor isnt working correctly would also love a test case there!

Yes, most of these ops are due to using the Float8Tensor to handle an FP8 kv-cache. The example usage for all of these will be in https://github.com/pytorch-labs/fp468-llm today or tomorrow at the latest. I'll add the tests for both the ops and the constructor. The issue on the constructor was that that it didn't matter what the original dtype was, it always returned fp32

@drisspg as I'm writing the unit tests, I'm thinking of what a correct copy_ operation looks like: If we try to copy an FP32/FP16/BF16 tensor into an FP8 one, should we do some scaling if the Float8Tensor has it? Or what does the opposite operation look like as well? Say copying an FP8 tensor with scales into an FP32/FP16 one? should we unscale through the FromFloat8Constructor?

@ani300  Great questions
For a copy from scaled_fp8 to hp_type I  think we should unscale and copy into.
For copy from hp to an fp8 tensors, I think the semantics are a little hazier. Do you have a clear need for this operation? Otherwise I would potentially ban this for now. Some options:

Calculate new scales and copy in both data and new scales, Probably my option 1
Create a temporary FP8 tensor using the scales that exist on the LHS: https://github.com/pytorch-labs/float8_experimental/blob/edae9a3e4fc3e1ae8d8cfe02738532c4067b3f4a/float8_experimental/float8_tensor.py#L65 and then copy in the data
Just directly convert existing tensor to a float8_e* type, and only copy in the data.

@vkuzo  any strong thoughts on the semantics here?

If we try to copy an FP32/FP16/BF16 tensor into an FP8 one, should we do some scaling if the Float8Tensor has it? Or what does the opposite operation look like as well?

IMO:

if user wants to use copy_ to copy bf16 to float8, the copy is done with a direct cast, without scaling, and user gets back a torch.Tensor with dtype float8_... and not a Float8Tensor.  If user actually wants scaling, there should be some wrapper code which scales the data whichever scaling strategy is relevant (per-tensor/row/group/block, dynamic/delayed/static, etc).  I'm not a fan of defining copy_ on Float8Tensor because of the ambiguity of the scaling details.
if user wants to usecopy_ to copy a Float8Tensor to a bf16 tensor, I think it's fine to unscale and copy as there is no ambiguity.

Thanks @drisspg and @vkuzo for your comments and opinions! I'll implement the FP8 -> BF16 copy (which is the one I'm using anyways), add the Float8Tensor to Float8Tensor with everything equal (scale, mm_config, etc.), and ban everything else.

For the failing unit test, I'm waiting on pytorch CI not failing to run at all to land this: https://github.com/pytorch/pytorch/pull/128758

@ani300 failing CI is becuase we are still using last nights nightly


Return response, not just (parsed) body of it

This allows to inspect headers etc in the future.

@michaelsauter This is nice, but I think we should include updates to the documentation explaining the change, with a migration guide to the new behaviour (i.e. having to explicitly call .result on the response object).

@mungler Updated the documentation in c5691a4.

ping @mungler

Looks good :)


implement analyze_outputs

Original depends on savesamesize.m, which I'm unsure if needs a new implementation or not.

status of jbfill.m is similarly tenuous


Branch links don't expand on Android

Might be related to #24
The URL https://bnc.lt/l/2enuGxU-2g resolves.
evgbr://open?link_click_id=81743897969033762 but only fills in referringParams on iOS, not Android.
To reproduce:

Clean app open after app is killed using the link
Get Branch Instance
Set Identity (if any)
Init session with BranchReferralInitListener, Activity#getIntent#getData, Activity

Below the lines from the log showing the problem
I/Evergive﹕ [1] 2.onInitFinished: [branch-behavior] initialization finished for evgbr://open?link_click_id=81743897969033762
V/Evergive﹕ [1] BranchMetricsBehavior.handleBranchLink: [branch-behavior] error: null, referringParams: {}

It's possible that the session was not closed prior to clicking the link - are you calling closeSession in onStop still? So you received parameter from a prior session. This is a pretty common integration mistake

Yes. Close session is always called when the app is closed/moves to background
V/Evergive﹕ [1] BranchMetricsBehavior.onAction: [branch-behavior] ACTION: CLOSE SESSION

That said, please keep in mind that this would fail either way if the App is killed, if you only rely on closeSession.

By the way, if I received a parameter from a prior session, should I not see the Branch data from that session (e.g. a previous link?).

Actually, I think I managed to get it working on the debug build. I'll close this out and see what the difference is.

The problem was that the links where always opened in the production build (matches the package). Opening the development build manually after the production build opened, correctly loaded the branch data.

Ah thanks for closing the issue. I'll get back to you on the other one later today, but I don't think you should hold a production release for it. It's unnoticeable to the customer

@aaustin should we never show and error from branch to the user?

Probably not, but it kind of depends on the implementation. If an error is thrown in getShortUrl, we automatically return a default URL with no parameters. If an error is throw in init, we recommend just not processing the callback.


added service worker, updated manifest, more icons

Updated the manifest with new icons, and features to make this a PWA.
Made site available offline (should add an ajax script to tell user they're offline)

@saxobroko - just curious; why were some of the existing files deleted?

to maintain consistency in the manifest


[Story] Create Book Component

As a User, I need to have a visual representation of my novels so that I have a more enjoyable user experience.
Requires Tasks #2 and #4 to be completed.
Each book will be shown visually in a card format. Similar to this image. The card itself will be the image supplied by the user or some default image, the title of the book displayed either below the card or on the bottom of the card, and a progress bar below the card.
The progress bar should be from this package and should be green if the book is in progress, red if the book is dropped, or orange if the book is aside. The progress itself should be the percentage followed by the number of pages read, for example if a user was halfway through a 100 page book, the progress bar would look like 50% (50). If the book is completed, there should be a green check mark displayed in place of the progress bar. If the book is in the plan to read list, there should be nothing displayed where the progress bar or check mark would be.
When clicked, each card should open the edit book route (which should be a clone of the new book route), with the fields auto-filled with the clicked book's details. From there, any changes that are made should be saved, database and state should be updated, and the corresponding book in the Library route should reflect the changes.
Acceptance Criteria:

[x] Given a BookType, when a Book component is created with the BookType, then a new Book component should be made and displayed in the /library route.
[x] Given a Book component in the /library route, when looked at, the viewer should see an image, the title, and the appropriate progress bar/icon/nothing shown as well.
[x] Given a Book component, when component is clicked, then route is changed to /edit-book
[x] Given a Book component has already been clicked, when in the /edit-book route, then the fields are filled with the clicked Book's information
[x] Given a Book component has already been clicked, when in the /edit-book route, changes have been made, and the submit button has been clicked, then the original Book component gets updated and the entry in the database also gets modified.
[x] Given a Book component, when it's visible and a progress bar should be shown, then a progress bar is shown with the appropriate styling
[x] Given a Book component, when it's visible and in the in progress status, then a progress bar is shown with the bar colored green
[x] Given a Book component, when it's visible and in the dropped status, then a progress bar is shown with the bar colored orange
[x] Given a Book component, when it's visible and in the aside status, then a progress bar is shown with the bar colored red
[x] Given a Book component, when it's visible and a progress bar shouldn't be shown, then the appropriate icon, or nothing, is shown
[x] Given a Book component, when it's visible and in the planned status, then no icon or progress bar should be shown
[x] Given a Book component, when it's visible and in the completed status, then a green check-mark should be shown

Finished with commit 9f571313ccc915f5b699d3f406f42fd7abb2732c


Plugin v0.2.7 and Traefik v2.7+ panic due to reflect.Set

I'm getting the following error when running htransformation plugin with Traefik v2.7+:
src/github.com/tomMoulard/htransformation/htransformation.go:40:3: panic

Error in Go routine: reflect.Set: value of type map[string]*interp.node is not assignable to type map[string]func(http.ResponseWriter, *http.Request, struct { Header string \"yaml:\\\"Header\\\"\"; HeaderPrefix string \"yaml:\\\"HeaderPrefix\\\"\"; Name string \"yaml:\\\"Name\\\"\"; Regexp *regexp.Regexp \"yaml:\\\"-\\\"\"; Sep string \"yaml:\\\"Sep\\\"\"; Type string \"yaml:\\\"Type\\\"\"; Value string \"yaml:\\\"Value\\\"\"; ValueReplace string \"yaml:\\\"ValueReplace\\\"\"; Values []string \"yaml:\\\"Values\\\"\"; SetOnResponse bool \"yaml:\\\"SetOnRequest\\\"\" })

This looks pretty similar to the error in https://github.com/tomMoulard/htransformation/issues/39

I need to reproduce this on my own, but it looks like an error on Yaegi's side.

@Michaelhobo, I am sorry, but I cannot reproduce your issue. Can you provide a reproducible use case, using the docker-compose.yaml example file provided in the repository, for example ?

Here is the docker-compose.yml file I used
version: '3.9'

services:
  traefik:
    image: traefik:v2.7
    command:
      - --api.insecure=true
      - --providers.docker
      - --providers.file.filename=/rules-htransformation.yaml
      - --log.level=DEBUG
      - --experimental.plugins.htransformation.moduleName=github.com/tomMoulard/htransformation
      - --experimental.plugins.htransformation.version=v0.2.7
    ports:
      - 9000:80
      - 9001:8080
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - ./rules-htransformation.yaml:/rules-htransformation.yaml
      - .:/plugins-local/src/github.com/tomMoulard/htransformation/
    tty: true

  whoami:
    image: traefik/whoami # https://github.com/traefik/whoami
    command: -name whoami
    labels:
      traefik.http.routers.whoami.rule: Host(`whoami.localhost`)
      traefik.http.routers.whoami.middlewares: htransformation@file

Here's the log from running docker compose up: https://gist.github.com/Michaelhobo/b2dff45b9391168f7cb0bbf6db4eb801

Also to clarify, we haven't done the Traefik v3 migration yet, so what I mean by "v2.7+" is really "v2.7 <= x < v3.0".
I ran this again with traefik:v3.0, and it does not have that error.


Increase upset threshold to 3%

Actually, it was predicting accurately with a 1% margin towards the end (when there were more data points) so I think this is unnecessary. However, I will add a new issue for allowing a user to set their own upset threshold


feature(cmd): Add --output option to helm dep list

What this PR does / why we need it:
This PR resolves issue #8064.
some helm commands, like helm repo list support --output flag that can change the output format to table, json or yaml. There is even package and interface just for that (output.Writer). The helm dep list doesn't follow this convention. I changed the helm dep list command implementation to implement output.Writer interface and by that allowing to change the format with the --output flag. The tests extended to check every output option, and of course for backward comparability when --output not specified.
If applicable:

[ ] this PR contains documentation
[x] this PR contains unit tests
[x] this PR has been tested for backwards compatibility

close #8064

the commit 44a2225035d93ab6e8dc40af7c3ee4ff13452fae that merged 3 days ago caused conflicts to my changes. i pushed new code after merge and sorting out the conflicts.

i pushed another commit that merges latest master and fix the conflict from the change https://github.com/helm/helm/commit/d6708667da5c79ab4a093ea7473e96b93be5f1f7#diff-652b5654e858ccc21ad086dc6fe01c09R55-R57.


pooling and aggregation operations

in the forward pass, in the table wise sharding, when pooling is executed? is it after alltoall communication? and executed on trainer local? where can I see the exact code in torchrec code base?
in the backward pass, in the table wise sharding, when sorting and aggregation is executed? can you please point the lines in code base.

in the forward pass, in the table wise sharding, when pooling is executed?
The pooling is done in FBGEMM_GPU, not in torchrec itself. For example: https://pytorch.org/FBGEMM/fbgemm_gpu-python-api/table_batched_embedding_ops.html

The backward key sortion and gradient reduction are also done inside fbgemm_gpu.

Can you point out for the classes in fbgemm_gpu that covers the backward
sorting and gradient aggregation?
On Mon, Jul 29, 2024 at 10:28 PM Junzhang @.***> wrote:

The backward key sortion and gradient reduction are also done inside
fbgemm_gpu.
—
Reply to this email directly, view it on GitHub
https://github.com/pytorch/torchrec/issues/2257#issuecomment-2257495221
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQGDI2BECYBK6SFHVWHFP2LZO4QBDBFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTAVFOZQWY5LFUVUXG43VMWSG4YLNMWVXI2DSMVQWIX3UPFYGLLDTOVRGUZLDORPXI6LQMWWES43TOVSUG33NNVSW45FGORXXA2LDOOJIFJDUPFYGLKTSMVYG643JORXXE6NFOZQWY5LFVEZTQNJUGA4DMNRTQKSHI6LQMWSWS43TOVS2K5TBNR2WLKRSGQZTMOBSGI3DGNFHORZGSZ3HMVZKMY3SMVQXIZI
.
You are receiving this email because you authored the thread.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.

It's written in cpp, specifically, cuda source code.

The sort
The aggregation is done inside CUDA kernels. (The source code is a templatized file and not readable, you can build fbgemm_gpu on your own and check the generated files. ) For example

sorry, a followup question for the forward pass communication and pooling.
I profiled the forward pass with both nsight and torch profiler. I see the
all2all calls at python level, and the low level NCCL calls as SendReceive
for all2all, but I didn't see any calls map to the pooling. Does the
pooling actually happen within SendReceive? or it is after SendReceive and
within all2all? or it is after all2all, but just not appropriate profiled.
On Mon, Jul 29, 2024 at 10:25 PM Junzhang @.***> wrote:

in the forward pass, in the table wise sharding, when pooling is executed?
The pooling is done in FBGEMM_GPU, not in torchrec itself. For example:
https://pytorch.org/FBGEMM/fbgemm_gpu-python-api/table_batched_embedding_ops.html
—
Reply to this email directly, view it on GitHub
https://github.com/pytorch/torchrec/issues/2257#issuecomment-2257491798
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQGDI2B4CJ5KDLAKGJ5S5U3ZO4PUBBFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTAVFOZQWY5LFUVUXG43VMWSG4YLNMWVXI2DSMVQWIX3UPFYGLLDTOVRGUZLDORPXI6LQMWWES43TOVSUG33NNVSW45FGORXXA2LDOOJIFJDUPFYGLKTSMVYG643JORXXE6NFOZQWY5LFVEZTQNJUGA4DMNRTQKSHI6LQMWSWS43TOVS2K5TBNR2WLKRSGQZTMOBSGI3DGNFHORZGSZ3HMVZKMY3SMVQXIZI
.
You are receiving this email because you authored the thread.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.

sorry, a followup question for the forward pass communication and pooling. I profiled the forward pass with both nsight and torch profiler. I see the all2all calls at python level, and the low level NCCL calls as SendReceive for all2all, but I didn't see any calls map to the pooling. Does the pooling actually happen within SendReceive? or it is after SendReceive and within all2all? or it is after all2all, but just not appropriate profiled.

The pooling is done before all2all. Maybe this figure is clearer

The first all2all is for lookup keys which is fed into fbgemm and fbgemm will do pooling for you. The second all2all performs all2all on pooled embedding.
So the pooling happens actually in CUDA kernels.

Thanks for the explanation. It helps a lot.
Let me dig deeper to some details:
1, can I assume the first all2all actually communicate about the KJT per
batch? so after this all2all, each GPU with a shard of an embedding table
actually will launch a fbgemm kernel to do the lookup and pooling. and then
use the 2nd all2all to send the pooled embedding vectors back to the KJT
batch owner. If this assumption is correct, for row wise parallelism,
all2all is still used in forward pass, if a sample has the indices across
multiple shards (means the embedding vectors stored on different GPUs), how
to do pooling?
2. if the above assumption is correct.  why not have only one all2all to
let each KJT batch owner have the individual embedding vectors (based on
their keys) and let them launch cuda kernel to do pooling locally.
On Tue, Jul 30, 2024 at 11:23 PM Junzhang @.***> wrote:

sorry, a followup question for the forward pass communication and pooling.
I profiled the forward pass with both nsight and torch profiler. I see the
all2all calls at python level, and the low level NCCL calls as SendReceive
for all2all, but I didn't see any calls map to the pooling. Does the
pooling actually happen within SendReceive? or it is after SendReceive and
within all2all? or it is after all2all, but just not appropriate profiled.
The pooling is done before all2all. Maybe this figure is clearer
image.png (view on web)
https://github.com/user-attachments/assets/ed784d80-0b2f-4067-b68a-fa62a29cd891
The first all2all is for lookup keys which is fed into fbgemm and fbgemm
will do pooling for you. The second all2all performs all2all on pooled
embedding.
So the pooling happens actually in CUDA kernels.
image.png (view on web)
https://github.com/user-attachments/assets/80c28ad6-7199-4cf6-aa27-bf30734b7cb9
—
Reply to this email directly, view it on GitHub
https://github.com/pytorch/torchrec/issues/2257#issuecomment-2259761683
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQGDI2DIFK34EIS3PZ5XQKLZPB7HRBFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTAVFOZQWY5LFUVUXG43VMWSG4YLNMWVXI2DSMVQWIX3UPFYGLLDTOVRGUZLDORPXI6LQMWWES43TOVSUG33NNVSW45FGORXXA2LDOOJIFJDUPFYGLKTSMVYG643JORXXE6NFOZQWY5LFVEZTQNJUGA4DMNRTQKSHI6LQMWSWS43TOVS2K5TBNR2WLKRSGQZTMOBSGI3DGNFHORZGSZ3HMVZKMY3SMVQXIZI
.
You are receiving this email because you authored the thread.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.

One correction: For RW, there is no the 2nd all2all, instead, it should be a ReduceScatter. (Table-wise should contain all2all)

1, can I assume the first all2all actually communicate about the KJT per
batch?
AFAIK, Yes. But be noted that a KJT all2all usually is composed of several tensor all2all.
if a sample has the indices across
multiple shards (means the embedding vectors stored on different GPUs), how
to do pooling?

There should be a collective. For rw sharding, it could be a reduce scatter.

why not have only one all2all to let each KJT batch owner have the individual embedding vectors (based on
their keys) and let them launch cuda kernel to do pooling locally.

Initially, each rank has its dp input. The first all2all is used for sending keys to the corresponding sharding for lookup. I don't think we can skip it.  As I clarified, the 2nd should be a RS for RW.
The local lookup result from fbgemm is a dense tensor which includes all bags, so it's ready for RS. If the fbgemm does not do pooling and return a jagged tensor, then we need a jagged tensor all2all + local reduce.

before all2all, how to remove the duplicated embedding indices per table.

For embeddingbag, I think there's no dedpulication. But for embedding, there is a deduplication in input_dist.

thanks for the clarification! very helpful.

sorry, forget to ask some details on the collective communication operators. Just for confirmation: in the forward pass, for the communication about embedding indices, there are multiple all2all calls, each call for a jagged tensor (e.g. one call for values, one call for lengths, one call for lengths per key). In both forward and backward pass, for the communications for embedding vectors, there is only one call for all batches across all keys and tables. if the 2nd statement is correct, when the system scales up, the data size of of the call will increase n^2 (n is the number of ranks in the system). Why not cut the single call to multiple calls with each call communicate about 64MB (for best network bandwidth efficiency).


NBG3, NBG0 do not seem to be accessible

I have tried many things to access NBG0 and NBG3, using the line scroll demo I changed it to jo_vdp2_set_nbg3_8bits_image and changed the make file to disable printf.
The output is just corruption on NBG1.
I would like to simply change the colour of the background, is there an alternative function I can use?

oops, it would help if I enabled the background first

Hi, I need a sample that show the problem.

Yes:
- When NBG0 is set as 2048 or 32768 colors, NBG2 can not longer be displayed.
- When NBG0 is set at 16,770,000 colors, NBG1 to NBG3 can not longer be displayed.
- When NBG1 is set at 2048 or 32768 colors, NBG3 can longer be displayed.


Aw/refactor configs update

Add a script to run everything. A really simple one: julia dir/file.jl for each target.

Add a script to run everything. A really simple one: julia dir/file.jl for each target.

Done. I added the files one-by-one, as there are some Julia files we don't want to run with this (playground.jl is an example).
I've left space for scripts in the metalhead and FPBench folders—we can add those later.

where is the script?

@bennn Oops. Pushed run_all.sh just now


Moving profile to bottom right

Hello,
I wanted to leave more width for the blog content and have been working on move the profile to the bottom right.
I successfully embedded it in the sidebar.html and removed it from all other locations.
The only problem I'm having is that the white background of the profile box only covers about 1/3rd of it from the left side.
I am thinking some element of the sidebar is not wide enough - but I don't know which one.
I also don't know whether the better practice is to alter the profile partial template to specify a minimum width for the background, or if I should alter the sidebar partial instead.
Any help would be much appreciated.

Here is a screenshot


[XLA] Sink constants into the conditional computation in while loops

Modify the WhileLoopConstantSinking  pass so that it sinks the constants into the while loop conditional as well. From my (limited) experiments, this helps the WhileLoopAnalysis::ComputeWhileLoopTripCount function in being able to evaluate and get the trip count (at least for simple while loops created by dynamic_rnns where the original conditional is anded with the max_iterations) .

Thank you for the review comments! I think I have addressed all of them now.

Done, thank you 👍


Widevine plugin doesn't copy binaries

The Shaka player embedded plugin in Widevine CMD repo doesn't work as described in this readme paragraph:
## Shaka Player Embedded Plugin

This repository also provides a plugin that can be used to automatically add
Widevine support to [Shaka Player Embedded][].  All you need to do is use the
`dev_cdm.json` or `release_cdm.json` files and pass them to the `./configure`
script of Shaka Player Embedded.  For example:

./configure --ios --eme-impl ~/prebuilt_cdm/shaka_plugin/dev_cdm.json

The certificate will be handled automatically and the resulting Shaka Player
Embedded framework bundle will contain the embedded Widevine CDM.  This means
the resulting Shaka Player Embedded framework is usable by itself.

The resulting shaka player build directory doesn't contain Widevine CDM anywhere.
Build Environment
Shaka player emb., commit dabbeb5b
Widevine CDM 5.2.4
Xcode 12.4

I didn't update the docs there when I fixed #63.  You need to manually add the CDM to your app's frameworks in addition to Shaka embedded's two frameworks.

I've updated the CDM docs.  One thing we should do is to copy the correct CDM to the build directory.  That would at least make it easier for people to find the correct one.  For now you need to find the correct version in the lib folder of the CDM repo.


Apply projectHealth recommendations to platform-base

@bot-gradle test this

Ignore CI test failures here

@bot-gradle test and merge

The merge queue build has started. Click here to see all failures if any.


Not possible to install latest version of Python

I want to be able to use the default provider (i.e. not provider => 'pip) and still install the latest version of python, python-virtualenv and python-pip. It seems that at the moment it is hardcoded to ensure => 'present'.

An additional observation I had was that it doesn't seem like installing Python 2.7 via pip works anyway. With the following puppet code:
class { 'python':
  provider => 'pip',
}

I get the following error:
err: /Stage[main]/Python::Install/Package[python==system]/ensure: change from absent to latest failed: Could not update: Execution of '/usr/local/bin/pip install -q --upgrade python==system' returned 1: /usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  Could not find a version that satisfies the requirement python==system (from versions: )
No matching distribution found for python==system
/usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
 at /etc/puppet/ext_modules/python/manifests/install.pp:57

Setting version => '2.7.10' and I get a different issue:
err: /Stage[main]/Python::Install/Package[python==2.7.10]/ensure: change from absent to latest failed: Could not update: Execution of '/usr/local/bin/pip install -q --upgrade python==2.7.10' returned 1: /usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
  Could not find a version that satisfies the requirement python==2.7.10 (from versions: )
No matching distribution found for python==2.7.10
/usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
  InsecurePlatformWarning
 at /etc/puppet/ext_modules/python/manifests/install.pp:57


Time for a new release ?

The latest Flask release is 0.10.1, which is close to 18 months old now (https://pypi.python.org/pypi/Flask/0.10.1).
A lot of work has been done since, including a new CLI this summer, which I find personally very useful, and many many small fixes.
I believe that the plan was to make a 1.0 release from the current code base. I don't know if there are still blocking issues in this respect.
If there are blocking issues, maybe it's time to mark them as such on the GitHub issue tracker. It would also help some people, I think, if another 0.x release was made in the interim.
I see on https://github.com/mitsuhiko/flask/blob/master/CHANGES that a 0.10.2 release was also planned with only fixes. In that case, maybe it would be time to to it (if this is still convenient) and do a 0.11 if it's not possible to do a 1.0 in the short term.

FWIW, due to the long cycle between releases, my company has started considering other frameworks.  Not meant as a criticism, just want to point it that there is a negative affect for some to go so long without releases.

We're looking and considering using flask, but the release issue is concerning. What's the issue here? Aren't releases just a part of normal software development? What makes flask different?
Not meant to be pointed questions, only sincerely curious if just pulling from git is flask's 'release' model, or what is the thinking here?

Recent discussion on Reddit: http://www.reddit.com/r/flask/comments/39lm43/flask_likely_to_get_to_10/

I'm asking the same question as @jrhite. The python package management world doesn't exactly make it easy to depend on git-based dependencies in your package...

@jmagnusson I'm all for a release.  But if you really need python packages from Git, pip does support this pretty well:
https://pip.pypa.io/en/latest/reference/pip_install.html#git

@rsyring
I know very well that you can install git packages with pip. But what I'm talking about is released packages on PyPI depending on other projects which only exist on git. It is possible with --find-links, but it's not exactly like with NPM, where It Just Works™.

This is continued in #1575


Send XREyeViews if available

Relevant components:

[X] Signalling server
[ ] Common library
[X] Frontend library
[ ] Frontend UI library
[ ] Matchmaker
[ ] Platform scripts
[ ] SFU

Problem statement:
What problem does this PR address?
Transform + Viewport should be auto-detected via WebXR #7
Solution
How does this PR solve the problem?
It adds the missing counter part to UE 5.4.2 feature
Documentation
XREyeView is additionally send in Frontend/library/src/WebXR/WebXRController.ts onXrFrame.
Test Plan and Compatibility
Standalone build and tested with Quest 3 device.

You beat me to the punch - I had been working on this in a branch, which I just merged in https://github.com/EpicGamesExt/PixelStreamingInfrastructure/pull/177
Thanks for looking into this though.


Add zephyr to CI

Simple Zephyr firmware that summons two threads, logging in round-robin before exiting. This sample requires a lot of exits as it's not using the cpu a lot.

So cool to have Zephyr running in the CA 🙂
That will make sure our interrupts stay functional, thank your for pushing that!


The pre-built binary "lbrynet" file doesn't launch on linux 32bits system

The command ./lbrynet start returns -sh: ./lbrynet:cannot execute binary file even after a chmod +x lbrynet

Thanks for reaching out! Unfortunately we only support 64 bit versions on Linux for our binaries. Building a 32 bit binary would require a bit more work and is not a common request.
Your best bet would be to compile your own following: https://github.com/lbryio/lbry-sdk/blob/1e478e354599eb71664b8cb912b54a9af8f31db3/.github/workflows/main.yml#L68


onQueryChange with remote data feature rerenders whole table

Hey guys,
I already asked the following question in the material-table repository, but as you know it has become very quiet over there.
I am using the remote data feature of material-table-core and want the table data be updated on a regular interval like every 2 seconds.
For that i use the useEffect() hook which calls onQueryChange() on a tableRef.
See https://codesandbox.io/s/material-table-flickering-forked-9d2w5 for an example.
Everything works as expected besides whenever I call onQueryChange(), the whole table is rerendered.
My expectation is that only the table data should be rerendered in the same way as when you change the table data directly by setting a new array to the data prop.
Is there a way to use onQueryChange() or some other method to make material-table only rerender the data and not the whole table?

Hey @andiries the way we are currently handling state needs to be improved upon greatly.  It seems as though we have the typical case of "left hand not knowing what the right hand is doing".  Making one minor tweak to state here, causes issues over there, etc..
Truth be told, I'm at a crossroads of what to do with this project. Fix issues like this? Ignore them and refactor appropriately? Abandon this project altogether in favor of @material-ui and DataGrid?

Hey @andiries the way we are currently handling state needs to be improved upon greatly.  It seems as though we have the typical case of "left hand not knowing what the right hand is doing".  Making one minor tweak to state here, causes issues over there, etc..
Truth be told, I'm at a crossroads of what to do with this project. Fix issues like this? Ignore them and refactor appropriately? Abandon this project altogether in favor of @material-ui and DataGrid?

Hey @oze4 thanks for your quick reply. I totally understand your point.
I have to decide if I want to use material-table in our environment. With the fact that @mbrn is somehow not available I guess I have to move forward to DataGrid or maybe react-table.
Anyway, Thanks for your efforts

Hey @oze4 thanks for your quick reply. I totally understand your point.
I have to decide if I want to use material-table in our environment. With the fact that @mbrn is somehow not available I guess I have to move forward to DataGrid or maybe react-table.
Anyway, Thanks for your efforts