Dependencies clash around com.jayway.jsonpath and excluded minidev library

After logbook-spring-boot-starter version 2.10.0 the versions clash might appear around the library com.jayway.jsonpath and excluded sub-dependency minidev.
Description

The logbook library uses the highest version of the com.jayway.jsonpath at the moment. Meanwhile the sub-dependency minidev was excluded. However, a target project itself might involve the same dependency but with a lower version. This could "hide" the minidev library from an entire project.
The issue was caught in the project based on the Spring with the Gradle toolchain. As of conflict resolution the highest version (from logbook) is taken where the sub-depencency minidev was excluded (#1036). At lease it is how I see it.
            <!-- JsonPath -->
            <dependency>
                <groupId>com.jayway.jsonpath</groupId>
                <artifactId>json-path</artifactId>
                <version>${json-path.version}</version>
                <exclusions>
                    <!-- we configure json path to use jackson therefore we do not need json-smart -->
                    <exclusion>
                        <groupId>net.minidev</groupId>
                        <artifactId>json-smart</artifactId>
                    </exclusion>
                </exclusions>
            </dependency>

Expected Behavior
Normal application startup.
Actual Behavior
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'requestMappingHandlerAdapter' defined in class path resource [org/springframework/boot/autoconfigure/web/servlet/WebMvcAutoConfiguration$EnableWebMvcConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter]: Factory method 'requestMappingHandlerAdapter' threw exception; nested exception is java.lang.NoClassDefFoundError: net/minidev/json/writer/JsonReaderI
	at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:658)
	at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:638)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1334)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1177)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:564)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:524)
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:944)
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:583)
	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:145)
	at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:754)
	at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:434)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:338)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1343)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1332)
        ...
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49)
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:108)
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:58)
	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:88)
Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter]: Factory method 'requestMappingHandlerAdapter' threw exception; nested exception is java.lang.NoClassDefFoundError: net/minidev/json/writer/JsonReaderI
	at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:185)
	at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:653)
	... 27 common frames omitted
Caused by: java.lang.NoClassDefFoundError: net/minidev/json/writer/JsonReaderI
	at com.jayway.jsonpath.internal.DefaultsImpl.<init>(DefaultsImpl.java:17)
	at com.jayway.jsonpath.internal.DefaultsImpl.<clinit>(DefaultsImpl.java:15)
	at com.jayway.jsonpath.Configuration.getEffectiveDefaults(Configuration.java:43)
	at com.jayway.jsonpath.Configuration.access$000(Configuration.java:29)
	at com.jayway.jsonpath.Configuration$ConfigurationBuilder.build(Configuration.java:224)
	at org.springframework.data.web.JsonProjectingMethodInterceptorFactory.<init>(JsonProjectingMethodInterceptorFactory.java:75)
	at org.springframework.data.web.ProjectingJackson2HttpMessageConverter.initProjectionFactory(ProjectingJackson2HttpMessageConverter.java:87)
	at org.springframework.data.web.ProjectingJackson2HttpMessageConverter.<init>(ProjectingJackson2HttpMessageConverter.java:72)
	at org.springframework.data.web.config.SpringDataWebConfiguration.extendMessageConverters(SpringDataWebConfiguration.java:169)
	at org.springframework.web.servlet.config.annotation.WebMvcConfigurerComposite.extendMessageConverters(WebMvcConfigurerComposite.java:144)
	at org.springframework.web.servlet.config.annotation.DelegatingWebMvcConfiguration.extendMessageConverters(DelegatingWebMvcConfiguration.java:123)
	at org.springframework.web.servlet.config.annotation.WebMvcConfigurationSupport.getMessageConverters(WebMvcConfigurationSupport.java:869)
	at org.springframework.web.servlet.config.annotation.WebMvcConfigurationSupport.requestMappingHandlerAdapter(WebMvcConfigurationSupport.java:673)
	at org.springframework.boot.autoconfigure.web.servlet.WebMvcAutoConfiguration$EnableWebMvcConfiguration.requestMappingHandlerAdapter(WebMvcAutoConfiguration.java:423)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.base/java.lang.reflect.Method.invoke(Unknown Source)
	at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154)
	... 28 common frames omitted
Caused by: java.lang.ClassNotFoundException: net.minidev.json.writer.JsonReaderI
	at java.base/java.net.URLClassLoader.findClass(Unknown Source)
	at java.base/java.lang.ClassLoader.loadClass(Unknown Source)
	at org.springframework.boot.loader.LaunchedURLClassLoader.loadClass(LaunchedURLClassLoader.java:151)
	at java.base/java.lang.ClassLoader.loadClass(Unknown Source)
	... 47 common frames omittedf

Possible Fix

Please correct me if I am wrong, but it seems the net.minidev dependency should be not excluded.
Steps to Reproduce

Create an empty Gradle Java application based on Spring Boot 2.5.1
Ensure the following dependencies.

'org.springframework.boot:spring-boot-starter-undertow'
'org.springframework.boot:spring-boot-starter-web'
'org.springframework.boot:spring-boot-starter-actuator'
'org.springframework.boot:spring-boot-starter-data-jpa'
'logbook-spring-boot-starter:2.10.0'

Run application

Context

No major concern, fail on dependency version update 'logbook-spring-boot-starter' 2.9.0 -> 2.10.0.
Your Environment

Version used: 2.10.0
Link to your project: n/a

Thank you.

The stacktrace doesn't suggest that logbook is even involved.

@whiskeysierra Thanks for getting back to me on this. Yes, it is true, the stacktrace does not indicate involvement of the logbook.
The issue is around "hidden" dependency (java.lang.NoClassDefFoundError: net/minidev/json/writer/JsonReaderI). The dependency net.minidev:json-smart was excluded with a corresponding directive in the pom file (https://github.com/zalando/logbook/pull/1036/files#diff-9c5fb3d1b7e3b0f54bc5c4182965c4fe1f9023d449017cece3005d3f90e8e4d8).
However, in the sample project the logbook is not the only library which uses the net.minidev:json-smart and com.jayway.jsonpath. Here the Spring also has such a dependency. But logbook uses the highest version of the com.jayway.jsonpath in the project, so gradle keeps it as a main one for all other users (libraries). And that main one version of com.jayway.jsonpath depends on the net.minidev:json-smart which was excluded.
Therefore, other users (e.g. Spring) fail because absence of net.minidev:json-smart is crucial for them. Maybe I am wrong, but that is how I see the problem.

But then there are two fixes which would be correct:

Direct dependency to json-smart within your project.
Manually, statically configure jsonpath to use jackson, also within your project.

Both are fine, but neither belongs to Logbook.
This is a dependency issue with Maven. Logbook doesn't need json-smart, so it shouldn't be Logbooks responsibility to fix another dependency which does.

I've provided both workarounds for logbook-spring-autoconfigure (https://github.com/zalando/logbook/pull/1087) and fix for spring-data-commons, which causes it (https://github.com/spring-projects/spring-data-commons/pull/2403)

@whiskeysierra thanks for feedback.
Yes, of course, there are many solutions around it:

open a ticket in Spring;
stop using Spring;
reconfigure Spring;
manually bring additional transitive dependency into project;
stop bumping version of logbook after 2.9.0;
exclude com.jayway.jsonpath (not just json-smart) from logbook on project level.

Some of those solutions are quite hacky and temporary ones. Here it is mostly about practice of using or not using directives such exclude in libraries which are designed to be a part of a big project.
Of course, I am not insisting on anything, but after version 2.10.0 (inclusive) logbook users have to build hacky workarounds. It is fine as solutions exist in general, but it is not a fully clean approach.
Thank you!

Here it is mostly about practice of using or not using directives such exclude in libraries which are designed to be a part of a big project.

But from Logbook's perspective that is the correct thing to do. We don't need it, we don't want it, we don't depend on it. The classpath of our users stays clean. It's really a Maven issue because if two dependencies have the same transitive dependency but one of them exclude a transitive dependency of that transitive dependency then Maven should do the right thing and not exclude it, since it's needed by someone else.

There are a few aspects here. Spring Data is doing the right thing, it uses the configuration builder API that applies defaults. It is more the DefaultsImpl that doesn't expect the absence of minidev. It would make sense to bring this discussion to jsonpath.
Adding flexibility on the Spring side would certainly allow for further options.

Spring Data is doing the right thing, it uses the configuration builder API that applies defaults.

Agreed, Spring Data is doing nothing wrong here.

It is more the DefaultsImpl that doesn't expect the absence of minidev.

Why should it? The default dependencies (if you don't exclude anything) include minidev. Everything is good here too.
If someone excludes a dependency, they should also change their configuration to make sure they don't actually depend on it. Spring Data is doing this. And so does Logbook. I see Maven at fault, because if you have two dependencies which depend on the same thing, but one of them excludes a transitive dependency while the one doesn't (which means it depends on it), then Maven should not exclude that transitive dependency.

Why should it? The default dependencies (if you don't exclude anything) include minidev. Everything is good here too.

jsonpath ships with various mapper and provider implementations so having a class path check on their side seems a sensible approach to determine defaults.

The fix is available in spring-data-commons v2.5.3 (spring-data BOM v2021.0.3, spring-boot BOM v2.5.3) - huge thanks to @mp911de.
I propose to merge this spring-boot dependency upgrade to prevent further errors/failures/issues.

@whiskeysierra I suppose it's not reproducible on spring-boot 2.5.3 bom so I think we should close it.
@nantipov please confirm it

Thanks you @mp911de , @sokomishalov and @whiskeysierra .
Yes, we can closed the issue.


[Accessibility][Product Carousel] The "previous and "next" buttons for the carousel have insufficient color contrast.

Steps to Reproduce

Open page in Google Chrome.
Test color contrast with the Accessible Color Picker tool.

Current Behavior
The "previous" and "next" buttons are gray (#AAA) on a white (#FFF) background, resulting in an insufficient color contrast of 2.32:1. Users with low vision will have difficulty distinguishing these controls.
Expected behavior/code
Interactive elements need to meet a minimum color contrast ratio of 3:1. Designers and developers need to use colors that meet this minimum.
Environment
Chrome 91, Windows 10
AEM Core Components v. 2.17
Affected Users
Users with low vision
WCAG SC
1.4.11 Non-text Contrast

Tracked via CIF-2372


send not work

Hi. Thank you for reporting the issue. Can you please tell us what did you do to get there? What you tried to do and what you clicked. And what happens if you restart the wallet. Thank you

?

?

@FreeM1ne can you please try with the new version v.2.6.2 https://emerald.cash/download/


No way to browse custom types (created with CREATE TYPE)

In pgAdmin, one of the types of browsable object that can be enabled is "type". But it doesn't seem possible to enable them in OmniDB.
For example, I can create a new ENUM type:
create type foo as enum ('bar', 'baz');

But then I have no way to browse it:

Great, thanks. Closing this one then.

Hi @qris ,
We have released this feature in OmniDB 2.14 last week.
Regards,
William


Switch to Bumper for Managing Temporaries

This change seems necessary to not rely on a "home-made" memory management tool.

I ran my basic benchmark suite. The performance for small bases is significantly improved. For large bases it is slightly improved. It looks like Bumper really is much more efficient for memory management. I did not expect that.

For the record here are the timings
OBJECT POOLS TIMINGS
(base) ortner@CosmicCrisp benchmarks % j110 --project=.. benchmark.jl
[ Info: static_solid_harmonics
L = 1
  2.083 ns (0 allocations: 0 bytes)
L = 2
  4.708 ns (0 allocations: 0 bytes)
L = 3
  7.958 ns (0 allocations: 0 bytes)
L = 4
  12.470 ns (0 allocations: 0 bytes)
L = 5
  18.806 ns (0 allocations: 0 bytes)
L = 6
  24.766 ns (0 allocations: 0 bytes)
L = 7
  32.654 ns (0 allocations: 0 bytes)
L = 8
  37.718 ns (0 allocations: 0 bytes)
L = 9
  48.034 ns (0 allocations: 0 bytes)
L = 10
  63.478 ns (0 allocations: 0 bytes)
L = 11
  75.797 ns (0 allocations: 0 bytes)
L = 12
  87.492 ns (0 allocations: 0 bytes)
[ Info: batched evaluation vs broadcast
[ Info: nX = 32 (try a nice number)
[ Info: broadcast! cost is almost exactly single * nX
L = 3
    single:   7.958 ns (0 allocations: 0 bytes)
broadcast!:   240.719 ns (0 allocations: 0 bytes)
   batched:   494.601 ns (0 allocations: 0 bytes)
L = 6
    single:   24.765 ns (0 allocations: 0 bytes)
broadcast!:   796.438 ns (0 allocations: 0 bytes)
   batched:   851.841 ns (0 allocations: 0 bytes)
L = 9
    single:   47.986 ns (0 allocations: 0 bytes)
broadcast!:   1.525 μs (0 allocations: 0 bytes)
   batched:   1.517 μs (0 allocations: 0 bytes)
L = 12
    single:   87.452 ns (0 allocations: 0 bytes)
broadcast!:   2.792 μs (0 allocations: 0 bytes)
   batched:   2.319 μs (0 allocations: 0 bytes)
L = 15
    single:   133.857 ns (0 allocations: 0 bytes)
broadcast!:   4.143 μs (0 allocations: 0 bytes)
   batched:   3.500 μs (0 allocations: 0 bytes)
[ Info: static vs generic basis for single input (nX = 1)
[ Info:   this shouws that the generic single-input implementation needs work
L = 3
  static:   7.958 ns (0 allocations: 0 bytes)
 generic:   304.325 ns (3 allocations: 288 bytes)
L = 6
  static:   24.807 ns (0 allocations: 0 bytes)
 generic:   357.538 ns (3 allocations: 544 bytes)
L = 9
  static:   48.028 ns (0 allocations: 0 bytes)
 generic:   433.500 ns (3 allocations: 992 bytes)
L = 12
  static:   87.495 ns (0 allocations: 0 bytes)
 generic:   538.286 ns (3 allocations: 1.55 KiB)
L = 15
  static:   133.797 ns (0 allocations: 0 bytes)
 generic:   668.586 ns (3 allocations: 2.22 KiB)
L = 18
  static:   225.331 ns (0 allocations: 0 bytes)
 generic:   754.443 ns (3 allocations: 3.09 KiB)
L = 21
  static:   351.163 ns (0 allocations: 0 bytes)
 generic:   929.586 ns (3 allocations: 4.03 KiB)
L = 24
  static:   422.950 ns (0 allocations: 0 bytes)
 generic:   1.050 μs (3 allocations: 5.16 KiB)
L = 27
  static:   538.799 ns (0 allocations: 0 bytes)
 generic:   1.200 μs (3 allocations: 6.34 KiB)
L = 30
  static:   644.194 ns (0 allocations: 0 bytes)
 generic:   1.417 μs (3 allocations: 7.78 KiB)
[ Info: compute! vs compute_with_gradients! (using 32 inputs)
L = 1
        compute!:   315.771 ns (0 allocations: 0 bytes)
 _with_gradient!:   375.823 ns (0 allocations: 0 bytes)
L = 3
        compute!:   492.052 ns (0 allocations: 0 bytes)
 _with_gradient!:   711.607 ns (0 allocations: 0 bytes)
L = 5
        compute!:   747.225 ns (0 allocations: 0 bytes)
 _with_gradient!:   1.283 μs (0 allocations: 0 bytes)
L = 7
        compute!:   1.092 μs (0 allocations: 0 bytes)
 _with_gradient!:   2.074 μs (0 allocations: 0 bytes)
L = 9
        compute!:   1.538 μs (0 allocations: 0 bytes)
 _with_gradient!:   3.406 μs (0 allocations: 0 bytes)
L = 11
        compute!:   2.032 μs (0 allocations: 0 bytes)
 _with_gradient!:   5.236 μs (0 allocations: 0 bytes)
L = 13
        compute!:   2.727 μs (0 allocations: 0 bytes)
 _with_gradient!:   7.250 μs (0 allocations: 0 bytes)
L = 15
        compute!:   3.552 μs (0 allocations: 0 bytes)
 _with_gradient!:   9.291 μs (0 allocations: 0 bytes)
[ Info: compute vs compute_with_gradients for code-generated basis
L = 1
        compute:   2.083 ns (0 allocations: 0 bytes)
 _with_gradient:   2.416 ns (0 allocations: 0 bytes)
L = 2
        compute:   4.750 ns (0 allocations: 0 bytes)
 _with_gradient:   10.468 ns (0 allocations: 0 bytes)
L = 3
        compute:   7.958 ns (0 allocations: 0 bytes)
 _with_gradient:   20.520 ns (0 allocations: 0 bytes)
L = 4
        compute:   12.513 ns (0 allocations: 0 bytes)
 _with_gradient:   35.540 ns (0 allocations: 0 bytes)
L = 5
        compute:   18.764 ns (0 allocations: 0 bytes)
 _with_gradient:   53.414 ns (0 allocations: 0 bytes)
L = 6
        compute:   24.765 ns (0 allocations: 0 bytes)
 _with_gradient:   79.947 ns (0 allocations: 0 bytes)
L = 7
        compute:   32.613 ns (0 allocations: 0 bytes)
 _with_gradient:   105.303 ns (0 allocations: 0 bytes)
L = 8
        compute:   37.718 ns (0 allocations: 0 bytes)
 _with_gradient:   140.437 ns (0 allocations: 0 bytes)
L = 9
        compute:   48.070 ns (0 allocations: 0 bytes)
 _with_gradient:   166.174 ns (0 allocations: 0 bytes)
L = 10
        compute:   63.478 ns (0 allocations: 0 bytes)
 _with_gradient:   236.851 ns (0 allocations: 0 bytes)


fix: Remove deprecated dependency from devcontainer's Dockerfile

golang.org/x/tools/cmd/guru is deprecated and raises error during devcontainer generation
Checklist

[x] Commits are signed with Developer Certificate of Origin (DCO - learn more)

/skip-e2e


The dataset format

Hello,
Thank you for your great work
if I generate the dataset correctly, what will be its folder placement structure?
Could you give me an example?Just a screenshot is ok.

The data generated is structured as follows:
- SAVE_PATH: provided in run_evaluation.sh
    - {routes_file_name}_{timestamp}: contains data for an individual route
        - rgb_{front, left, right, rear}: multi-view camera images at 400x300 resolution
        - seg_{front, left, right, rear}: corresponding segmentation images
        - depth_{front, left, right, rear}: corresponding depth images
        - lidar: 3d point cloud in .npy format, containing the forward-facing 180 degrees as provided on the Leaderboard
        - lidar_360: point cloud with a 360 degree FOV
        - topdown: BEV segmentation images required for NEAT's auxiliary loss
        - measurements: contains ego-agent's position, velocity and other metadata

Note that the seg_, depth_ and lidar folders are not required for training NEAT, but are used by some of the baselines in our paper.

The data generated is structured as follows:
- SAVE_PATH: provided in run_evaluation.sh
    - {routes_file_name}_{timestamp}: contains data for an individual route
        - rgb_{front, left, right, rear}: multi-view camera images at 400x300 resolution
        - seg_{front, left, right, rear}: corresponding segmentation images
        - depth_{front, left, right, rear}: corresponding depth images
        - lidar: 3d point cloud in .npy format, containing the forward-facing 180 degrees as provided on the Leaderboard
        - lidar_360: point cloud with a 360 degree FOV
        - topdown: BEV segmentation images required for NEAT's auxiliary loss
        - measurements: contains ego-agent's position, velocity and other metadata

Note that the seg_, depth_ and lidar folders are not required for training NEAT, but are used by some of the baselines in our paper.
Is the data structure like this one?
And where are the train_towns =['Town01'] mentioned in the config?

Yes, the structure is correct. Here you used eval_routes_weathers.xml as the ROUTES variable in run_evaluation.sh. To generate the towns in our training dataset, you would need to use the routes files from here: https://github.com/autonomousvision/neat/tree/main/leaderboard/data/training_routes.

Yes, the structure is correct. Here you used eval_routes_weathers.xml as the ROUTES variable in run_evaluation.sh. To generate the towns in our training dataset, you would need to use the routes files from here: https://github.com/autonomousvision/neat/tree/main/leaderboard/data/training_routes.

ok, I got it. Thank you very much!

Yes, the structure is correct. Here you used eval_routes_weathers.xml as the ROUTES variable in run_evaluation.sh. To generate the towns in our training dataset, you would need to use the routes files from here: https://github.com/autonomousvision/neat/tree/main/leaderboard/data/training_routes.

Sorry, I use carla for the first time, I still have some questions.
If I want to generate the towns in your training dataset, I just need to modify the the ROUTES variable in run_evaluation.sh?
Because I have got some error. I mean, shall I also need to modify some other variables?

In fact, I pay more attention to the semantic segmentation process of BEV by using implicit neural representation, so I want to use data for debugging quickly... I'm sorry to bother you.

I have solved the above problems. It seems that I should restart terminal, when change the var.

If you want to quickly access some data, we have released the dataset for TransFuser here: https://github.com/autonomousvision/transfuser
See the readme in that repository for more details. The release includes a large scale dataset (406GB) which includes the BEV semantic segmentation labels for NEAT.

If you want to quickly access some data, we have released the dataset for TransFuser here: https://github.com/autonomousvision/transfuser#dataset
See the readme in that repository for more details. The release includes a large scale dataset (406GB) which includes the BEV semantic segmentation labels for NEAT.

But you have said that there are some diffierences between the two repos? Could I use the dataset for TransFuser directly?

The main difference is the weathers (in TransFuser, we use 14 fixed weathers, and in NEAT, we randomly sample the weather parameters from Gaussian distributions). There are also minor differences in how the autopilot drives. If you are not specifically interested in robustness to new weather conditions, you can directly use the dataset from TransFuser.

The main difference is the weathers (in TransFuser, we use 14 fixed weathers, and in NEAT, we randomly sample the weather parameters from Gaussian distributions). There are also minor differences in how the autopilot drives. If you are not specifically interested in robustness to new weather conditions, you can directly use the dataset from TransFuser.

OK, thank you for your patience. Your work is really great! As a newcomer, I admire you very much！


cant find dongletools.exe

not sure where dongletools.exe is on this file, I haven't been able to locate it elsewhere.

Built and uploaded new binaries which are now linked from the README. I tried quickly testing with Windows 10 under QEMU but it didn't seem to work - hopefully that's just my system not having the drivers installed?

I have somewhat the same problem, but for me it states open dongle failed with error code a8160002.


Revisit black/isort config settings

I always had this issue too on Windows (with Python 3.11). Just check on Ubuntu (with Python 3.8) - the same, isort splits a long multiline import string into two shorter ones. With isort 5.12.0 (latest from https://github.com/pycqa/isort) - the same.
.pre-commit-config.yaml
# holidays/countries/__init__.py is excluded due to imports being in
# relevance order vs. alphabetical one.
# tests/countries/test_united_states_virgin_islands.py is excluded due
# to a bug whereby black and isort don't agree and enter into an
# infinite fix loop.
# TODO remove this exclusion when isort and black play nice again.

Originally posted by @KJhellico in https://github.com/dr-prodigy/python-holidays/pull/1049#discussion_r1154347452

Resolved by https://github.com/dr-prodigy/python-holidays/pull/1297


We need to choose the UI framework

A decision needs to be made on what framework we should use to design the UI. Node.js, Python, and or Java. We also need to know what api's we are going to use: express, mongo, etc..

I'm assigning @M-LKT, @Jozufozu, @emmettrm (and other hardware members responsible for the system and its operation that are interested) to generate a set of requirements for the UI, both technical (like rendering latency and packet drop behavior) and visual (what kind of visual elements, graphs, buttons, etc. we need).


Bulk metadata ARXIVNG-332

Coverage decreased (-1.2%) to 83.962% when pulling 92cde701721c7ec0300207c351f4724e9364dd07 on task/ARXIVNG-332 into 05681cad394019fa8c60ee73e27a026b05717b7e on develop.


Configure Renovate

Welcome to Renovate! This is an onboarding PR to help you understand and configure settings before regular Pull Requests begin.
🚦 To activate Renovate, merge this Pull Request. To disable Renovate, simply close this Pull Request unmerged.

Detected Package Files

package.json (npm)
.travis.yml (travis)

What to Expect
With your current configuration, Renovate will create 9 Pull Requests:

Update dependency istanbul to ~0.4.0

Schedule: ["at any time"]
Branch name: renovate/istanbul-0.x
Merge into: master
Upgrade istanbul to ~0.4.0

Update dependency mocha to ~1.21.0

Schedule: ["at any time"]
Branch name: renovate/mocha-1.x
Merge into: master
Upgrade mocha to ~1.21.0

Update dependency node to 0.12

Schedule: ["at any time"]
Branch name: renovate/node-0.x
Merge into: master
Upgrade node to 0.12

Update dependency sinon to ~1.17.0

Schedule: ["at any time"]
Branch name: renovate/sinon-1.x
Merge into: master
Upgrade sinon to ~1.17.0

Update dependency async to v3

Schedule: ["at any time"]
Branch name: renovate/async-3.x
Merge into: master
Upgrade async to 3.x

Update dependency debug to v4

Schedule: ["at any time"]
Branch name: renovate/debug-4.x
Merge into: master
Upgrade debug to 4.x

Update dependency epoll to v4

Schedule: ["at any time"]
Branch name: renovate/epoll-4.x
Merge into: master
Upgrade epoll to 4.0.x

Update dependency mocha to v10

Schedule: ["at any time"]
Branch name: renovate/mocha-10.x
Merge into: master
Upgrade mocha to ~10.7.0

Update dependency sinon to v18

Schedule: ["at any time"]
Branch name: renovate/sinon-18.x
Merge into: master
Upgrade sinon to ~18.0.0

🚸 Branch creation will be limited to maximum 2 per hour, so it doesn't swamp any CI resources or overwhelm the project. See docs for prhourlylimit for details.

❓ Got questions? Check out Renovate's Docs, particularly the Getting Started section.
If you need any further assistance then you can also request help here.

This PR has been generated by Renovate Bot.

Renovate is disabled
Renovate is disabled because there is no Renovate configuration file. To enable Renovate, you can either (a) change this PR's title to get a new onboarding PR, and merge the new onboarding PR, or (b) create a Renovate config file, and commit that file to your base branch.


As a non-sighted user, I want to hear a description of visualizations embedded in essay content so that I can access these insights.

dev notes
see this article for an approach

[x] alter the "embedded svg" block to use <object> tag, something like:

<object
    role="img"
    aria-label=“membership chart"
    type="image/svg+xml" data="chart.svg">

the logbooks show many more members than the cards. there are missing logbooks....etc etc

</object>

[x] add an optional "extended description" parameter that will render the inner text. clarify (via help text?) that this text is only read to non-sighted users and should describe the major insights or takeaways from the graphic. multiple paragraphs is ok

going to move this to next milestone, if no one objects.

I think I remember something about not being able to use <object> for this because wagtail doesn't allow it, but I'm a little confused about the markup that is in use now. For an example I created with @rlskoeser's bubble chart svg from PPA, I see:

Bubble chart of PPA collections showing relative sizes. Generated         with d3.js.

This bubble chart shows that the Literary and Linguistic collections are the largest and very similar in size; Original Bibliography is the next largest but much smaller; the rest decrease in size, with Dictionaries as the smallest.

for this example in VoiceOver, the
 isn't read by or accessible to the screen reader, because the
 has an aria-label defined that overrides it and defines the accessible name for the entire
. after a moment, however, the long description is read, because it's associated with the
.
for the inner , it has a role set to img, but is also aria-hidden despite having an alt. I don't really know what a defined role or alt would mean in the context of being aria-hidden, but at any rate they will never be used, as far as I know. again, this doesn't matter because the accessible name for the
 is defined via aria-label directly on it, so we wouldn't look to the 's alt tag even if it were visible to an SR.
I tried a structure more like below, which I think felt a little more natural:

Bubble chart of PPA collections showing relative sizes. Generated with d3.js.

One problem with this chart is that it gives an inflated sense of the  PPA as a whole. Since numerous items are in multiple collections, they  are represented more than once. For comparison, look at a bubble chart  that includes the whole of the PPA among the collections. You can see  that the Literary and Linguistic collections each represent a sizable  proportion of the PPA, and that all the bubbles combined are much larger  than the entirety of the PPA.

for this, voiceover will initially read "Bubble chart of PPA collections showing relative sizes. Generated with d3.js. Figure.", which is similar to what a sighted user would see (the caption and its associated figure). after a moment, it will read the long description. crucially, if the user continues paging through the document via voiceover, they can then interact with the inner image (which will be announced as "bubble graph of collections, image" using the alt) and then finally with the description before leaving the figure.
I like this approach because it preserves the separate roles of caption, alt, and long description, and also allows the user to access the long description if they happened to not wait or miss it when they landed on the figure. Open to suggestions!

@thatbudakguy thanks for the careful testing and markup suggestions, happy to revise.
If I remember correctly, we had a concern was about the text inside the SVG being readable, which is why the img to be aria-hidden. Was this not a problem when you tested?

this wasn't a problem for me and I think is resolved by setting role=img on the svg, which we do (although not sure if there was any text in the svg I used anyway).


Adds razorpay integration

Most of the code is boilerplate.
I have a few doubts regarding the integration:

What kind of request is expected for a Cancel event. Do I just redirect (GET) to the url? Or should it be a POST with certain parameters. If POST, what are the required parameters?
Is the complete? method required for a Notification

I'm also sending a mail to<EMAIL_ADDRESS>with the required details asked in the offsite-gateway-sim repo.

Marking this as closed.


[BUG] <Security: SSL Medium Strength Cipher Suites Supported>

What happened?

while the kube-apiserver and etcd has already suppuort the  Strength Cipher Suites
The kube-controller-manager, kube-scheduler, kubelet need to also suppuort Strength Cipher Suites

What did you expect to happen?
How to reproduce it (as minimally and precisely as possible)?

'...'
'...'

Anything else we need to know?
Environment

MicroShift version (use microshift version):
Hardware configuration:
OS (e.g: cat /etc/os-release):
Kernel (e.g. uname -a):
Others:

Relevant logs

This issue was fixed in PR #2973, but since that PR is not linked to this issue due to a typo, it was not closed automatically.
@lance5890 Can you close it?

This issue was fixed in PR #2973, but since that PR is not linked to this issue due to a typo, it was not closed automatically.
@lance5890 Can you close it?

ok


Update LAB[PL-200]_M01L06_Relationships.md

Module: 00
Lab/Demo: 00
Fixes # .
Changes proposed in this pull request:

Submitted by ParameshRamki on behalf of MOC Labs Review


Create @shopify/react-form

We should pull out our form handling HoC into a package.

My plan for dealing with this is:

prototype a few changes to the api in web
propose a final api
write the package in quilt

I want to balance the main issues with onboarding people to the current implementation

lots of boilerplate to add a field
config split over several areas
because it's an HoC we have to have mapper functions rather than just using props in closure scope

and the main perf problem (entire page rerendering when one value changes), though that can also be fixed by changing the child components
I'll also sanity check using Formik to offload needing to write this, but the main issues there are type-safety (formik looks like it sacrifices this but maybe we can make it workable) and potentially size (~7kb minzipped).

After speaking with chris I think I have a good idea of how I want this to look. RFC / sample PR coming soon.


Change to rootfs.unmount_rootfs

Added a 'num_layers' argument to the unmount_rootfs function in the rootfs module.

Looks good! Merging...


replaceTagText function does not support double-byte character

left is what it returns now, right is what it should return

roam can only parse double-byte character surrounding with [[ ]]

wow that's crazy. Thanks for the fix!

Could you open a pull request against the repo?


Github: add workflow support

Providing automatic release + binaries generation as #1 suggested (on push new tag).
Generates binaries for amd + arm for darwin + linux + windows.
Tested on my repo 🙂
Edit:
I did not include the install.sh script in the final archive.
Maybe something to add 🤔 or we should really merge it inside the go binary.

What about FreeBSD? 😉
Perhaps we can also consider keeping a very simple install.sh so that people can install app with a single command like Homebrew and distrobox, etc? The install script would mostly be there to ensure that where ever app is placed, it's part of $PATH?


Custom view not appearing

At the moment the code in Example 1 works, but the code in Example 2 does not. Why?
Example 1)

(UIView *)customViewForEmptyDataSet:(UIScrollView *)scrollView
{
UIActivityIndicatorView *activityView = [[UIActivityIndicatorView alloc] initWithActivityIndicatorStyle:UIActivityIndicatorViewStyleGray];
[activityView startAnimating];
return activityView;
}

Example 2)

(UIView *)customViewForEmptyDataSet:(UIScrollView *)scrollView
{
UIView *view = [[UIView alloc] initWithFrame:CGRectMake(0, 0, 200, 200)];
[view setBackgroundColor:[UIColor greenColor]];
return view;
}

@dzenbot  I faced this problem after updating the library to the latest version! before that it was working perfectly! now I'm trying to find out what changed to overcome this issue!
#pragma mark - EmptyDataSet datasource

(UIView *)customViewForEmptyDataSet:(UIScrollView *)scrollView {
UIView *view              = [[UIView alloc]initWithFrame:self.collectionView.bounds];
[view setBackgroundColor:[UIColor redColor]];
UIButton *addPhotoBtn     = [[UIButton alloc]initWithFrame:CGRectMake(118, 30, 84, 84)];
[addPhotoBtn setImage:[UIImage imageNamed:@"addPhoto"] forState:UIControlStateNormal];
[addPhotoBtn addTarget:self action:@selector(addPhoto:) forControlEvents:UIControlEventTouchUpInside];
[view addSubview:addPhotoBtn];
UILabel *hintLabel        = [[UILabel alloc]initWithFrame:CGRectMake(0, 5, 320, 25)];
hintLabel.numberOfLines   = 0;
hintLabel.textAlignment   = 1;
hintLabel.textColor       = [UIColor grayColor];
hintLabel.backgroundColor = [UIColor greenColor];
hintLabel.font = [UIFont osBoldFontWithSize:15];
[view addSubview:hintLabel];
return view;
}

I was able to address the issue by setting constraints on the views embedded in the custom views.


add some attributes to the Options of a Connection

enableDatabaseCustomization
brut_force_protection
import_mode
disable_signup

Hi @laurentdutheil, thanks for contributing!
It is a bit strange that these properties are not documented by Auth0. However other users have submitted patches to add properties that are unofficially supported so I can't really say no to such additions :)
Perhaps we can think of a way to support arbitrary values in the ConnectionOptions struct, via an embedded map[string]interface{} or something along those lines.
Cheers,
Alex

You're so fast!
Thank you!


Cnt example rc 1.0

Created 10,0 CNT example using LAMMPS USER-Phonons, similar as instruction in the supplement information for our submitted manuscript.

good to merge.

good to merge.


Added SQl Tamil Playlist New PR

What does this PR do?
Add resource(s) | Remove resource(s) | Add info | Improve repo
For resources
Description
Why is this valuable (or not)?
How do we know it's really free?
For book lists, is it a book? For course lists, is it a course? etc.
Checklist:

[x] Read our contributing guidelines.
[x] Search for duplicates.
[x] Include author(s) and platform where appropriate.
[x] Put lists in alphabetical order, correct spacing.
[x] Add needed indications (PDF, access notes, under construction).
[x] Used an informative name for this pull request.

Follow-up

Check the status of GitHub Actions and resolve any reported warnings!

title is [SQL in Tamil (தமிழில் SQL)]
Don't invent titles! Use the title given by the resource.

Update missing world


View Single card

As a user I want to see a card holding the details of the task overdue

http://reminders.zuri.chat


Apply RepoConfig should exclude itself

Right now when we apply RepoConfig it will check out a source repository and then apply all resources it finds. This can cause a loop. Because applying a RepoConfig will end up trying to apply that RepoConfg again.

Actually this shouldn't happen because RepoConfig has an allow list
https://github.com/jlewi/hydros/blob/48988a89c2dbabe5fb7f4e6970fb8c403d8c8c83/pkg/gitops/repocontroller.go#L209


Support for converting to typed slices.

This allows converting generic slices ([]interface{}) into typed slices.
Makes it easier to call Go code that takes in typed arrays / varargs.

Sorry about delay. Thanks.


python312Packages.xstatic-jquery-ui: normalize pname

Description of changes
part of #245383
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 294816 run on x86_64-linux 1

2 packages failed to build:

bepasty
bepasty.dist

4 packages built:

python311Packages.xstatic-jquery-ui
python311Packages.xstatic-jquery-ui.dist
python312Packages.xstatic-jquery-ui
python312Packages.xstatic-jquery-ui.dist


Change @every 24h default schedules to @midnight

Fixes #16107.

Codecov Report

Merging #16431 (1770ed2) into main (efeb8e8) will decrease coverage by 0.00%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main   #16431      +/-   ##
==========================================
- Coverage   45.43%   45.43%   -0.01%
==========================================
  Files         717      717
  Lines       84162    84162
==========================================
- Hits        38237    38235       -2
- Misses      39777    39780       +3
+ Partials     6148     6147       -1

Impacted Files
Coverage Δ

modules/cron/tasks_basic.go
85.43% <100.00%> (ø)

models/unit.go
41.09% <0.00%> (-2.74%)
:arrow_down:

modules/queue/workerpool.go
53.05% <0.00%> (-0.77%)
:arrow_down:

models/repo_list.go
77.82% <0.00%> (+0.77%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update efeb8e8...1770ed2. Read the comment docs.

We need to get better at making the first comment in a PR represent what the PR is doing to explain to future readers what the aim and intention of the PR was.
As this is technically breaking I've added the breaking label and a breaking section to the first comment.


feat: recipe page responsive design

What does this PR do?
Make the recipe page responsive. The Recipe/Application details will be placed on top on the README.md when the window size will reach a size of 1024px. (Ref https://tailwindcss.com/docs/responsive-design).

The models tabs is a bit weird looking when the size is very small, the table itself is responsible of that behaviour, so we probably want later to improve the table component.

Screenshot / video of UI
https://github.com/projectatomic/ai-studio/assets/42176370/1402004d-50c5-4222-80fb-8477fc200ad6
What issues does this PR fix or reference?
Fixes https://github.com/projectatomic/ai-studio/issues/258
How to test this PR?

(1) Open any recipe
(2) Make the window size vary

We might want to have @mairin opinion on the subject

@lstocchi  thanks for the tests! It was complicated to find, but the small horizontal bar was appearing because the text in the links in markdown where overflowing.

@lstocchi I fixed the position of the toggle button. However, for the scrollbar, the issue is a bit complexe, the table has some hardcoded pixel values for the headers, and they are overflowing on the right, the scrollbar is hidden because of that.
The ideal fix would be to define optional column, that could be hidden when the size of the screen get too small.
For now, I cannot improve further the design nor fix the scroll bar without changing a lot the table component.


AttributeError: 'scipy.spatial.transform.rotation.Rotation' object has no attribute 'as_dcm'

Hi,
I switched it to try running off of a Stanford image, as per the Github instructions.
I ended up with this error:
(smalifythis) s@s-To-be-filled-by-O-E-M:~/SMALify$ python smal_fitter/optimize_to_joints.py
** fvcore version of PathManager will be deprecated soon. **
** Please migrate to the version in iopath repo. **
https://github.com/facebookresearch/iopath

Dataset size: 1
/home/s/SMALify/smal_fitter/priors/pose_prior_35.py:58: UserWarning: The given NumPy array is not writeable, and PyTorch does not support non-writeable tensors. This means you can write to the underlying (supposedly non-writeable) NumPy array using the tensor. You may want to copy the array to protect its data or make it writeable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at  /opt/conda/conda-bld/pytorch_1595629403081/work/torch/csrc/utils/tensor_numpy.cpp:141.)
  self.precs = torch.from_numpy(res['pic'].r).float().to(device)
EPOCH: Optimizing Stage: 0       Epoch: 0, Loss: 14132.33, Temporal: (0.0, 0.0, EPOCH: Optimizing Stage: 0	 Epoch: 0, Loss: 14132.33, Temporal: (0.0, 0.0, EPOCH: Optimizing Stage: 0	 Epoch: 0, Loss: 14132.33, Temporal: (0.0, 0.0, 0.0):
Traceback (most recent call last):
  File "smal_fitter/optimize_to_joints.py", line 147, in <module>
    main()
  File "smal_fitter/optimize_to_joints.py", line 140, in main
    model.generate_visualization(image_exporter)
  File "/home/s/SMALify/smal_fitter/smal_fitter.py", line 210, in generate_visualization
    rot_matrix = torch.from_numpy(R.from_euler('y', 180.0, degrees=True).as_dcm()).float().to(self.device)
AttributeError: 'scipy.spatial.transform.rotation.Rotation' object has no attribute 'as_dcm'

Do you have any ideas as to how to resolve this? Was really, really interested in this tool.
I'm running Ubuntu 18.

Had wrong version of scipy
Solved by pip install scipy==1.5.2 , as specified in requirements.txt

Had wrong version of scipy
Solved by pip install scipy==1.5.2 , as specified in requirements.txt

"as_dcm" is replaced with "as_matrix" in the later version, please check https://docs.scipy.org/doc/scipy/reference/generated/scipy.spatial.transform.Rotation.from_matrix.html?highlight=from_dcm
for more details


Intital scaffolding of app using create-react-app

@JVanderford I would wrap the App component in a BrowserRouter component, in order to use react-router-dom to create links to other pages in the SPA.  Using Browser Router should eventually allow for server-side rendering of routes as well (for SEO sake), via a separate but analogous router.  We can talk about this more tomorrow, and I'd like to get a branch off this myself.  For now I'm going to approve/merge this to get the ball rolling

Alas, I don't have write access 👎
Regardless, I say :shipit:

Brian, did you mean to merge this up?  I don't have write access so I can't merge.

@BWortman   I've addressed the port and the rimraf issues.  I'm not sure what issue you're having with npm test, other than there are no tests yet so there is nothing to run.  The test watch runs fine for me, just reports that there are no tests to run.


Support of assignees and reviewers

Hello,
Can we specify assignees and / or reviewers at the PR creation?
The original project seems to support it using the dependabot.yml file.
Thanks

@Pascal997 ,
Support for dependabot.yml file located at .azuredevops/dependabot.yml is now available. Maybe you can get an initial PR submitted and we can iterate on the specifics?

@Pascal997,
Support for assignees and/or reviewers is not present in the upstream repository, see link.
You can however solve this case using branch policies in Azure DevOps that add approvers automatically to any new PR. I will proceed and close this issue as there is nothing more left.

Added in #428


FPGA Device Plugin Validation on real hardware

Validate FPGA device plugin on real hardware.

@bart0sh - please document the remaining tasks.

Remaining tasks:

run full FPGA test. Currently only preprogrammed mode is tested.
integrate with github CI: maintainers should be able to trigger PR tests by adding /ok-to-test comment. Logs should be visible in the PR

Status update: FPGA test successfully runs. integration with github actions is progressing.


Improve ip address check

What is this pull request?
Improves address check in stateless validation using regular expressions
Why do you implement it? Why do we need this pull request?
Address should have either ip v4 or DNS hostname(RFC) format
How to use the features provided in the pull request?
Check out commands validator test, which adds checks for ipv4 and hostname address check
Details/Features
Tests were rewritten using commands validator fixture

Looks nice!
Also afair there's some DNS host validations in the develop branch. Thus plz don't spend time on the improvement, I'm pretty sure we can reuse it

Codecov Report

Merging #785 into trunk/shared_model will decrease coverage by 0.03%.
The diff coverage is 28.26%.

@@                  Coverage Diff                   @@
##           trunk/shared_model     #785      +/-   ##
======================================================
- Coverage               40.17%   40.14%   -0.04%
======================================================
  Files                     456      456
  Lines                   15502    15530      +28
  Branches                 8594     8616      +22
======================================================
+ Hits                     6228     6234       +6
  Misses                   1554     1554
- Partials                 7720     7742      +22

Impacted Files
Coverage Δ

shared_model/validators/commands_validator.hpp
43.42% <0%> (-0.83%)
:arrow_down:

...hared_model/validators/commands_validator_test.cpp
32.53% <31.7%> (-1.81%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6089aad...682806a. Read the comment docs.


crypto/tls: permanently broken tls.Conn should not return temporary net.Error

What version of Go are you using (go version)?

$ go version
go version go1.11.5 linux/amd64

Does this issue reproduce with the latest release?
Yes.
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/jack/.cache/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/jack/go"
GOPROXY=""
GORACE=""
GOROOT="/usr/local/go"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build787904603=/tmp/go-build -gno-record-gcc-switches"

What did you do?

Set a deadline on a TLS connection.
Do a failing write due to that deadline. As documented the connection is permanently broken.
Clear deadline (doesn't really matter because connection is permanently broken - but just to mimic what would work for regular TCP connection).
Do another write.

Demo code: https://github.com/jackc/go-tls-deadline-temporary-error
What did you expect to see?
A net.Error where Temporary() => false or a non-net.Error.
What did you see instead?
An net.Error where Temporary() => true.
This is technically documented behavior After a Write has timed out, the TLS state is corrupt and all future writes will return the same error.  But it means that code that works generically with the net.Conn interface cannot rely on temporary errors being (potentially) temporary. It must treat them as permanent.
Perhaps the original failed tls.Conn.Write could return a non-temporary error.

Thanks for reporting this issue @jackc and @FiloSottile for the triage and direction!
Here is a standalone test adapted from @jackc's report and source code that can be used as a regression test
package main

import (
	"crypto/tls"
	"fmt"
	"net"
	"net/http"
	"net/http/httptest"
	"net/url"
	"testing"
	"time"
)

func TestPermanentlyBrokenConnection(t *testing.T) {
	cst := httptest.NewTLSServer(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
		w.Write([]byte("Hello, World!"))
	}))
	defer cst.Close()

	cstU, _ := url.Parse(cst.URL)
	conn, err := tls.Dial("tcp", cstU.Host, &tls.Config{InsecureSkipVerify: true})
	if err != nil {
		t.Fatalf("Dial err: %v", err)
	}

	if err = conn.SetDeadline(time.Now()); err != nil {
		t.Fatalf("conn.SetDeadline(time.Now()): %v", err)
	}

	if _, err = conn.Write([]byte("should fail")); err == nil {
		t.Fatal("conn.Write succeeded when it should have failed")
	}

	// Clear deadline
	err = conn.SetDeadline(time.Time{})
	if err != nil {
		t.Fatalf("final conn.SetDeadline(time.Time{}): %v", err)
	}

	_, err = conn.Write([]byte("This connection is permanently broken"))
	if err != nil {
		fmt.Println("Write err", err)
	}

	ne := err.(net.Error)
	if ne.Temporary() {
		t.Fatal("Got a net.Error that apparently is temporary")
	}
}


Arguments to an sdag method are not available for defining condition of a while statement

Original author: Nikhil Jain
Original issue: https://charm.cs.illinois.edu/redmine/issues/269

Seems like arguments passed to an sdag entry methods are not available for use in condition of while statement. They are available for others.
Look at the attached files for an example. I get the following error:
In file included from caseTest.C:12:0:
caseTest.def.h: In member function ‘void Main::_while_0(Closure_Main::run_2_closure*)’:
caseTest.def.h:211:7: error: ‘i’ was not declared in this scope
caseTest.def.h: In member function ‘void Main::_while_0_end(Closure_Main::run_2_closure*)’:
caseTest.def.h:222:7: error: ‘i’ was not declared in this scope

Original author: Jonathan Lifflander
Original date: 2013-08-16 06:10:33

Should be fixed. See commit f4ee6b0e301b6de4605b72cfe21bc451bc6044d6

Original author: Nikhil Jain
Original date: 2013-08-16 06:12:45

Tested, works now.

Original date: 2015-07-16 19:23:00

Noting when this was fixed.


Change the check file to make our code pass the checks

As the title says i wanna make it so our python files finally pass the checks set up for our project...

Update: Our linter ruff is raising four issues that need to be adressed. Check the CI .yml file for the errors. Most of them are non defined names and non pythonic code.
@redibaj @fabrice-eberle @Sara25s @juldimag


JSP build step not honoring bootstrap classpath

I'm running into the following error with the appengine sdk version 1.9.42:
08:51:02.640 [INFO] [org.gradle.process.internal.DefaultExecHandle] Starting process 'command '/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/bin/java''. Working directory: ... Command: /Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/bin/java -Dfile.encoding=UTF-8 -Duser.country=GB -Duser.language=en -Duser.variant -cp ~/.gradle/appengine-sdk/appengine-java-sdk-1.9.42/lib/appengine-tools-api.jar com.google.appengine.tools.admin.AppCfg --oauth2 --enable_jar_classes --enable_jar_splitting update $root/build/exploded-app
...
08:51:43.029 [QUIET] [system.out] INFO: Built File: /internal/some.jsp
08:51:43.318 [ERROR] [system.err] warning: [options] bootstrap class path not set in conjunction with -source 1.7

My build.gradle has source and target compatibility set to 1.7:
sourceCompatibility = '1.7'
targetCompatibility = '1.7'

and the boot classpath also set to the 1.7 runtime jars:
def bootJars = ['rt.jar', 'jsse.jar', 'jce.jar'].collect { new File("$rootDir/java7jars/$it") }

tasks.withType(JavaCompile) {
  doFirst {
    options.bootClasspath = bootJars.collect { it.path }.join(File.pathSeparator)
  }
}

All of the java compilation tasks work fine with this config, except appengine's JSP compilation step.  Can you please read options.bootClasspath (or even a new option) and pass that on to the JSP compiler?

@loosebazooka
This sounds like something we need to make sure we do in our other plugins as well.

I think it'll have to be handled by the appengine sdk, @ludoch ?

Right, staging does not deal with bootclasspath....
On Tue, May 23, 2017 at 11:48 AM, Appu Goundan<EMAIL_ADDRESS>wrote:

I think it'll have to be handled by the appengine sdk, @ludoch
https://github.com/ludoch ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/gradle-appengine-plugin/issues/286#issuecomment-303495722,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAE4zedFfYbvBf1HpIPSPNLaAhsM9aWeks5r8ynhgaJpZM4NjVWC
.


Unable to publish package. Error: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.

Uploading a package to nuget.org using the command line tool fails with the error: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.  Also unable to upload using a browser or the Nuget Package Explorer app.  Browser will freeze, go blank, or return a similar error (depends on browser type).  In Nuget Package Explorer, the upload appears to never complete (progress bar spins).
The package may be relatively large (~340MB), but I'm not aware of any package size limits on nuget.org.  Can you determine why the upload is failing?
NuGet package shared here: https://esri.box.com/s/v9fcl5vvrgsoei6jsc0js389hnl1pavd

We do limit package size on nuget.org to 250mb, and really ask package authors not to exceed 50mb.
We should check why this behaves this way rather than provide a good error message

We indeed have a limit and large packages are usually bad.
Which NuGet.exe client are you using to do the push?


0.14.2 does not have _multidict.c

@asvetlov you forgot to include .c extension file

I've included _multidict.c into generated .tar.gz archive, but excluded it from git tree.

i see. pipy release has it, but github release does not.


Add tests for convolve2d

Follow-up of #6046. Close #6057.
Verified that the added tests would fail on CuPy v9.6 (as #6046 was not backported) but not on the master branch.

Jenkins, test this please


HTCondor tutorial: add cloudresourcemanager.googleapis.com to the list of services to enable

Describe the bug
Step 2 of the HTCondor tutorial instructs to enable these services:
gcloud services enable \
    storage.googleapis.com \
    compute.googleapis.com \
    secretmanager.googleapis.com \
    serviceusage.googleapis.com \
    --project=<MYPROJECTNAME>

The cluster deployment (Step 5) in the HTCondor tutorial fails with several error messages for
  {
    "@type": "type.googleapis.com/google.rpc.ErrorInfo",
    "domain": "googleapis.com",
    "metadata": {
      "consumer": "projects/<MYPROJECTNAME>",
      "service": "cloudresourcemanager.googleapis.com"
    },
    "reason": "SERVICE_DISABLED"
  }

Steps to reproduce
Follow the HTCondor tutorial Step 1 - 5 on cloudshell
Expected behavior
Cluster deployment finishes
Actual behavior
Cluster deployment fails
Version (ghpc --version)
$ ./ghpc --version
ghpc version - not built from official release
Built from 'main' branch.
Commit info: v1.32.0-2-gbec99bb6

(This is how it comes when following the tutorial on cloudshell)
Blueprint
https://github.com/GoogleCloudPlatform/hpc-toolkit/blob/main/community/examples/htc-htcondor.yaml
Execution environment
Cloud shell
Additional context
This is easily solved by adding cloudresourcemanager.googleapis.com in the list of services to enable.
In the tutorial text:
https://github.com/GoogleCloudPlatform/hpc-toolkit/blob/main/docs/tutorials/htcondor.md#enable-apis--permissions
<walkthrough-enable-apis apis="storage.googleapis.com,compute.googleapis.com,secretmanager.googleapis.com,serviceusage.googleapis.com,cloudresourcemanager.googleapis.com"></walkthrough-enable-apis>

(visible in raw)

@katilp just to clarify, did this fail on "ghpc create" or "ghpc deploy"?
I ask because create does API validation checks that should have been caught before deploy. So there may be 2 fixes to make.

Yes, ./ghpc deploy htcondor-pool --auto-approve
Creating went fine according to my notes (copy-pasted from the output, but I'm not 100% sure if I took all output or just the end of it)
$ ./ghpc create \
    community/examples/htc-htcondor.yaml \
    --vars \
    "project_id=<MYPROJECTNAME>"
Creating deployment folder "htcondor-pool" ...
To deploy your infrastructure please run:

./ghpc deploy htcondor-pool

Find instructions for cleanly destroying infrastructure and advanced manual
deployment instructions at:

htcondor-pool/instructions.txt

There was another minor thing: https://github.com/GoogleCloudPlatform/hpc-toolkit/blob/main/community/modules/scheduler/htcondor-access-point/main.tf#L39 does not say "Hello, world!" as expected in the tutorial

@tpdownes For additional context, not sure if it matters, I used the same project earlier for this https://cloud.google.com/hpc-toolkit/docs/quickstarts/slurm-cluster so the other services (storage.googleapis.com,compute.googleapis.com,secretmanager.googleapis.com,serviceusage.googleapis.com) were already enabled.

@katilp I'm not able to replicate your problem. I suspect it involves the creation of service-accounts in a project that is part of a folder hierarchy (the Cloud Resource Manager manages organizations and folders that contains projects). Do you have your full output that contains the text surrounding the error message?

@tpdownes Thanks for having checked! I do not have the full output, but let me retry with

a fresh project doing only this
a fresh project doing first the basic slurm-cluster tutorial and this.

This is under my GCP account so no "organization".
For the background, I'm doing this as we might indicate it as a possible option for some heavy (beyond-laptop) processing to users of open data from the CMS experiment.

I just ran into something similar on a brand-new project, one difference being that it is under an org. I received a message during "ghpc create" saying I needed to enable the logging and IAM APIs. Once these two were enabled, "ghpc deploy" ran without issues.

I am submitting #2536 to improve the tutorial experience.
@maucaro what you're seeing is the intended behavior when ghpc detects that a blueprint is aware that an API is needed but is not enabled. I've added these 2 APIs along with the Cloud Resource Manager API reported by @katilp.
I'm still not sure precisely where we need Cloud Resource Manager but I'm going to create an internal bug to track it down.

#2536 was merged to fix the tutorial. @katilp please report any other issues with HTCondor functionality!


Middleman 3.0 requires manual server restart for any change in config.rb or middleman-blog

I've been working on getting a few of my projects upgraded from Middleman 2.0 to Middleman 3.0 and have noticed that I now need to manually restart the middleman server whenever I make a change in config.rb.
I'm also noticing this issue when my project is using middleman blog 3.0 – whenever I make a change to any file within the middleman project, all my blog content disappears and I need to manually refresh the server. Any non-blog related content seems to remain cached and doesn't updated until a manual refresh of the server too.
I can't imagine this is the expected result since Middleman 2.0 auto updated with zero lag time. I noticed this post about middleman server speed issues on Windows and was curious if this issue is somewhat related.
I'm seeing the issue on both OSX 10.8.1 and 10.7.xx. I'm running ruby-1.9.3-p194 on both. As a side note, I even created a fresh Middleman-Blog site via middleman init MY_BLOG_PROJECT --template=blog to see if this also produced this issue and it did.
Any areas I should troubleshoot?

I'm experiencing this same issue @benjaminwood . Seeing the same thing where CSS and JS files are updated, but the template files are not updating and require a server restart. I am not using live reload, just refreshing the page manually. Still not seeing template changes unless I do a manual server restart.
OS X 10.10.1
Ruby 2.0.0-p598

to add, the --force-polling flag works for me to correct the issue. As @benjaminwood mentioned, this isn't a long term solution, but will use it in the meantime. Hope this helps identify the issue.


[feat|fix] : SDE frontend : Hotfix 3.2 with pcf - rel:2.3.0

Description
Fixed

permissions updated.
trivy workflow updated.
bug fixes.
version bump for chart release.

Pre-review checks
Please ensure to do as many of the following checks as possible, before asking for committer review:

[x] DEPENDENCIES are up-to-date. Dash license tool. Committers can open IP issues for restricted libs.
[x] Copyright and license header are present on all affected files

Closing PR. refactoring code


Run Integration Tests In Github Workflows CI

In order to increase velocity and correctness, we need to be able to run integration tests during our CI stage. We will leverage docker and docker compose to accomplish this.

Create dockerfile that compiles and runs LucidMQ
Create a dockerfile that runs the integration tests in lucidmq-py
Create a docker-compose file that executes the complete workflow.
Create a github workflow step that runs the docker-compose file.

The following commits complete this request:
e14e143
9c04ca4
fc6b04f
f21f7d9
2a08587


Add explanation and examples for symbols used when displaying branch coverage

Yesterday, CI was broken as one branch was not covered, see
plugins.py                       210      0     50      1    99%   303->302

While the arrow symbols for if/else branches are more or less self explanatory, here I did not understand what it means.
I then had a look at

https://coverage.readthedocs.io/en/7.2.2/branch.html
https://coverage.readthedocs.io/en/7.2.2/cmd.html#coverage-summary-coverage-report
https://coverage.readthedocs.io/en/7.2.2/faq.html
but did not find any explanation. I then reached out to a online chat, where I was helped: The for-loop is not exhausted

I'd like to have examples for both if/else and for-loops (and maybe other special things), and explanations for those examples, ideally at the branch coverage page, and maybe a link from the cmd.html page, where the branch coverage example is shown, a la "more examples and explanations at ...".
Thank you!

I will be working on this one as a part of pycon23 Sprint.

I will be working on this one as a part of pycon23 Sprint.

Hi, are you still working on this?

No one is working on this at the moment.


added Jenkinsfile

let's align with standard CI

Signed-off-by: Max Kovgan<EMAIL_ADDRESS>

@nickgrealy LGTM ?


Look into alternative storage methods

CSV or JSON are not the best ways to store our data. Look into other methods. (Possibility: TinyDB?)

Yeah good point. I don't know database software, but I also saw sqlite3 recommended.


Where is the Consent table?

when i run this application,. it's create all tables (clinet, scopes, ...) but for Consent & Token there is no table ! where dose this project store consents? i think it's not in memory because it's work fine even after restart the app.

There are 3 different features (Scopes, Client, and Operational):
https://identityserver.github.io/Documentation/docs/ef/overview.html
You need to opt into each one.

i know, but just like default example in source code, i use this code :
(factory.RegisterOperationalServices(efConfig);
and it's look like the EF handle the consent or token values, but there is no Consent or Token table created in my db.
the project work correctly but i can not find out how

Oh I suspect you haven't done anything in IdSvr to yet create the tables (like consent, or code flow).

as the matter of the fact, i do !
and that's amaze me, how does it work even after restart the IdSvr, because if i misconfig anything, at least it should not remeber my Consent to test client, but id dose.
so just let be clear, if i all the things goes right and use IdSvr, there should be a Toke and Consent table in database?

i think there is a little bug, i just got the latest version and everything goes alright
thank you

I have the same issue, i receive both ID, Access and Refresh tokens using scope offline_access and the authorization code flow. I do have entries in the consent table but nothing in the Tokens table..

@MohammadKani I'm having the exact same issue as you did.  I'm glad to hear you resolved it.  Can I please ask from which branch did you grab the latest updates from which resolved this for you?
Also I'm interested as to how you manage and add new Clients, Scopes etc? Can you share what IdentityServer3.Admin project(s) you are using to achieve this?
Thanks :+1:


Re-introduce a way to get the allocation size of a table

This was previously removed from RawTable in #546. This is now added as a public API on HashMap, HashSet and HashTable.
Fixes #238
Fixes #506

@bors r+

:pushpin: Commit 1089b93a8e9ba360f7e6ef8d212f5bd923329c20 has been approved by Amanieu
It is now in the queue for this repository.

:hourglass: Testing commit 1089b93a8e9ba360f7e6ef8d212f5bd923329c20 with merge 3b350d76854e412673e3a5c54304b41605c2161e...

:sunny: Test successful - checks-actions
Approved by: Amanieu
Pushing 3b350d76854e412673e3a5c54304b41605c2161e to master...


chore: remove docker image release

Describe your changes
Removing Docker release

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 74.53%. Comparing base (81aa0e7) to head (0c43b82).

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #108   +/-   ##
=======================================
  Coverage   74.53%   74.53%
=======================================
  Files          57       57
  Lines        2835     2835
=======================================
  Hits         2113     2113
  Misses        722      722

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


OpenPilot PC Simulation

I am hoping to validate a testing method on OpenPilot as it is one of the few opensource automotive software. The testing method relies on sending inputs to a module and observing the code coverage and output to understand the system's behavior.
I am targeting to perform the testing on PC and not use any hardware device. I have compiled OpenPilot successfully on Ubuntu 16.04.

Ideally, I would like to send CAN messages and observe the outputs of the system. I don't have to test the full system; a small functionality can be sufficient. Is this achievable without using any hardware device?
Is there any documentation that describes a correct behavior/output?
I replayed driving data using unlogger with remote data using the example python replay/unlogger.py '3533c53bb29502d1|2019-12-10--01-13-27'. I couldn't access the data that is being fetched from the route-name. How can I test the system with other inputs? From where can I get sample data so I can build similar files and experiment with different inputs?

We have a test called process replay that seems to be what you're looking for. It runs in CI, and it's targeted to run on PC. test_processes.py has some sample routes that you can use.

Thank you for your quick reply.
Is there a way to create/alter a route?
If I am not mistaken, in process replay a changed code will run against the same routes and be compared with a known good output.
I am targeting testing the process on different fuzzy inputs.

Each process has a config that specifies its inputs and outputs. Instead of replaying a drive, you can build your own messages using whatever inputs you want. If you want to reuse the replay_process function, then you'd have to build all the msgs in advance (the lr input is just a list of messages).


Update sql-database-upgrade-new-service-tiers.md

Added information about how to use the V12 upgrade server functionality to get recommendation on the service tier for Web/Business database(s).

Canceling this; accepting edited version by CSI


Installation issue ?

I'm using the hyparket library a 100% javascript project, no React, or Angular. I use the LitElement framework.
I've done the npm i hyparquet, that installed the version 1.6.4
When I try to use the library with this import:
import { parquetMetadata } from 'hyparquet'

The browser logs this error:
Loading module from “http://localhost:3000/@fs/path_to/node_modules/.vite/deps/hyparquet.js?v=c52c84b7” was blocked because of a disallowed MIME type (“ ”).

The vite command throws some errors, like "Big integer literals are not available in the configured target environment (...)".
Is the module for another framework? Should I install another version?

I've fixed my problem with this link:
https://stackoverflow.com/questions/75576741/how-to-solve-error-big-integer-literals-are-not-available-in-the-configured-tar


DSCFCISqlBuild.ps1 is outdated

Hey, just thought I'd point out the example here is still using xSQLServerFailoverClusterSetup, which as far as I can tell doesn't exist anymore.

Yes, all the examples in the root of /Examples should be rewritten, because they reference resources that no longer exist or has been been updated with breaking changes.  We had a discussion about that here https://github.com/PowerShell/xSQLServer/issues/462 and my thought was that I would have time to fix this during the month that went by. But other stuff needed to be done
I'm looking at splitting these examples between xSQLServer and xFailOverCluster. Help is welcomed. :)

Closing this and tracking this in issue #462.


Change .card to .creditcard

The .card class was interfering with .card at Ratchet UI library. So I have changed it to .creditcard which even represents the class better since card can be any given card (card like UI).

Hmmm, I think I like this change but I'm not sure. I think there's something to be said for having name parity, but I also get that .card is pretty non-specific.
Anyone else have thoughts?
If this gets merged, it'll go in the 1.0 release.

.jessecard maybe?

Mmm, I like that idea better. I think .jp-card would be best.
On Sun, Jan 11, 2015 at 3:21 PM, David Reinberger<EMAIL_ADDRESS>wrote:

.jessecard maybe?
—
Reply to this email directly or view it on GitHub
https://github.com/jessepollak/card/pull/141#issuecomment-69517158.

Ugh, hate to do this, but would you mind opening the same PR off the v-1.0 branch?

sure no prob ;)

Thank you :)

Any ETA on this? If it's within the next 30 min, I can wait, otherwise I can just go ahead and do it myself. Sorry to rush — just trying to get this beta out today!

I did this myself, but merged in your commits — thank you for your hard work!


Pure JSON code

JSON5 is cool for what it is, but not sure it's a mandatory requirement for this package--and having it "in the way" was meaning lots of build overhead to use kle-serial in a browser.
Consequently, these two commits...

Remove JSON5 as a dependency.
Remove the .parse() method altogether as it can (should?) be done at an application layer if/when needed (+/- JSON5 support if that's wanted).

This then focuses this library on just deserialization. Huzzah! 😀
Thanks for building this and KLE!
🎩

+1 to this; seems like a good candidate for a major version bump as well so folks who were dependent on .parse can still use it, while new apps (like mine) can take advantage of the reduced bundle size.


I tested some audio feature extraction libraries, such as Librosa. When running the MFCC function, the application immediately crashed. I also attempted to run a heavier library like tensorflow-cpu and train a simple embedded model, but the application crashed once again. Of course, we're dealing with different architectures here, and I believe it might not be straightforward.
In any case, I would like to understand the extent to which we intend to address this issue. What are your thoughts on what we can achieve? I believe that at the very least, Librosa's MFCC should run smoothly, but beneath the surface, it relies on dynamic libraries and not solely on pure Python code.

serious_python depends on Kivy, so a native library you'd like to use must have a "recipe" here: https://github.com/kivy/python-for-android/tree/develop/pythonforandroid/recipes. Submit a new issue at https://github.com/kivy/python-for-android/issues.

Okay, this is enough to address my doubts. I will read the content you recommended. Thank you <3.

According to Python-for-Android, it's possible to run numpy, but that doesn't happen in Serious-Python. Do you have any idea why this happens?

Importing Python using the editor, I get the following error. It seems Numpy is not able find the C-extensions required.
The following command was used to package the python app.
dart run serious_python:main package app/src

Because Numpy is a non-pure Python module, i.e. part of it is written in C/Rust. Non-pure modules should be built as part of Kivy.
I'm going to provide all necessary instructions how to do that.

Because Numpy is a non-pure Python module, i.e. part of it is written in C/Rust. Non-pure modules should be built as part of Kivy.
I'm going to provide all necessary instructions how to do that.

Hi!. Thanks for the reply. But it would be nice, if it is shared at the earliest.

https://github.com/flet-dev/serious-python/tree/main/src/serious_python#adding-custom-python-libraries

https://github.com/flet-dev/serious-python/tree/main/src/serious_python#adding-custom-python-libraries

Hey!. Thanks for the information. I followed the steps that's mentioned in the link, yet I get this issue while building numpy using toolchain.
I tried several solution to resolve Cython dependency issue, but none worked. Have you got any solution to this problem?
Any help would be greatly appreciated. Thanks!
[DEBUG   ] x numpy-1.24.2/versioneer.py
[DEBUG   ] New State: numpy.extract at 2023-11-07 12:36:56.515058
[INFO    ] Install_hostpython_prerequisites numpy
[INFO    ] Executing pip for hostpython with: ['install', 'Cython==0.29.36']
[INFO    ] Running Shell: /Users/hashim/Downloads/kivy-ios/dist/hostpython3/bin/pip3 ('install', 'Cython==0.29.36') {'_iter': True, '_out_bufsize': 1, '_err_to_out': True}
[DEBUG   ] WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
[DEBUG   ] WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
[DEBUG   ] WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
[DEBUG   ] WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
[DEBUG   ] WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
[DEBUG   ] WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
[DEBUG   ] Could not fetch URL https://pypi.org/simple/cython/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/cython/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
[DEBUG   ] ERROR: Could not find a version that satisfies the requirement Cython==0.29.36 (from versions: none)
[DEBUG   ] ERROR: No matching distribution found for Cython==0.29.36
[DEBUG   ] WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
[DEBUG   ] Could not fetch URL https://pypi.org/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/pip/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
[DEBUG   ] WARNING: There was an error checking the latest version of pip.
[DEBUG   ]
Exception in thread background thread for pid 96761:
Traceback (most recent call last):
  File<EMAIL_ADDRESS>line 1045, in _bootstrap_inner
    self.run()
  File<EMAIL_ADDRESS>line 982, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 1641, in wrap
    fn(*rgs, **kwargs)
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 2569, in background_thread
    handle_exit_code(exit_code)
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 2269, in fn
    return self.command.handle_command_exit_code(exit_code)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 869, in handle_command_exit_code
    raise exc
sh.ErrorReturnCode_1:

  RAN: /Users/hashim/Downloads/kivy-ios/dist/hostpython3/bin/pip3 install Cython==0.29.36

  STDOUT:
WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS... (1553 more, please see e.stdout)

  STDERR:

Traceback (most recent call last):
  File "/opt/homebrew/bin/toolchain", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 1562, in main
    ToolchainCL()
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 1306, in __init__
    getattr(self, args.command)()
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 1375, in build
    build_recipes(args.recipe, ctx)
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 1140, in build_recipes
    recipe.execute()
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 701, in execute
    self.install_hostpython_prerequisites()
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 78, in _cache_execution
    f(self, *args, **kwargs)
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 766, in install_hostpython_prerequisites
    _hostpython_pip(["install", prerequisite])
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 1201, in _hostpython_pip
    shprint(pip_cmd, *args)
  File "/opt/homebrew/lib/python3.11/site-packages/kivy_ios/toolchain.py", line 60, in shprint
    for line in cmd:
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 915, in next
    self.wait()
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 845, in wait
    self.handle_command_exit_code(exit_code)
  File "/opt/homebrew/lib/python3.11/site-packages/sh-1.14.3-py3.11.egg/sh.py", line 869, in handle_command_exit_code
    raise exc
sh.ErrorReturnCode_1:

  RAN: /Users/hashim/Downloads/kivy-ios/dist/hostpython3/bin/pip3 install Cython==0.29.36

  STDOUT:
WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/cython/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS... (1553 more, please see e.stdout)

  STDERR:

Similarly, There's JNUI issue while building numpy from p4a.
[INFO]:    Trying first build of pyjnius to get cython files: this is expected to fail                                                                                [825/1978]
[DEBUG]:   -> running python3 setup.py build_ext -v
[DEBUG]:        Traceback (most recent call last):
[DEBUG]:          File "/storage0/naspi/metameta/mtag/.buildozer/android/platform/build-arm64-v8a_armeabi-v7a/build/other_builds/pyjnius-sdl2/armeabi-v7a__ndk_target_21/pyjnius/setup.py", line 70, in <module>
[DEBUG]:            assert JAVA.is_jdk(), "You need a JDK, we only found a JRE. Try setting JAVA_HOME"
[DEBUG]:        AssertionError: You need a JDK, we only found a JRE. Try setting JAVA_HOME
Exception in thread background thread for pid 11857:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/home/zeed/.local/lib/python3.10/py/lib/python3.10/site-packages/sh.py", line 1641, in wrap
    fn(*rgs, **kwargs)
  File "/home/zeed/.local/lib/python3.10/py/lib/python3.10/site-packages/sh.py", line 2569, in background_thread
    handle_exit_code(exit_code)
  File "/home/zeed/.local/lib/python3.10/py/lib/python3.10/site-packages/sh.py", line 2269, in fn
    return self.command.handle_command_exit_code(exit_code)
  File "/home/zeed/.local/lib/python3.10/py/lib/python3.10/site-packages/sh.py", line 869, in handle_command_exit_code
    raise exc
sh.ErrorReturnCode_1:

  RAN: /storage0/naspi/metameta/mtag/.buildozer/android/platform/build-arm64-v8a_armeabi-v7a/build/other_builds/hostpython3/desktop/hostpython3/native-build/python3 setup.py build_ext -v

  STDOUT:
Traceback (most recent call last):
  File "/storage0/naspi/metameta/mtag/.buildozer/android/platform/build-arm64-v8a_armeabi-v7a/build/other_builds/pyjnius-sdl2/armeabi-v7a__ndk_target_21/pyjnius/setup.py", line 70, in <module>
    assert JAVA.is_jdk(), "You need a JDK, we only found a JRE. Try setting JAVA_HOME"
AssertionError: You need a JDK, we only found a JRE. Try setting JAVA_HOME

  STDERR:

[INFO]:    pyjnius first build failed (as expected)
[INFO]:    Running cython where appropriate
[INFO]:    Cythonize jnius/jnius.pyx
[DEBUG]:   -> running python3 -cimport sys; from Cython.Compiler.Main import setuptools_main; sys.exit(setuptools_main()); ./jnius/jnius.pyx
[DEBUG]:        /home/zeed/.local/lib/python3.10/py/lib/python3.10/site-packages/Cython/Compiler/Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: /sto
rage0/naspi/metameta/mtag/.buildozer/android/platform/build-arm64-v8a_armeabi-v7a/build/other_builds/pyjnius-sdl2/armeabi-v7a__ndk_target_21/pyjnius/jnius/jnius.pyx
[DEBUG]:          tree = Parsing.p_module(s, pxd, full_module_name)
[DEBUG]:
[DEBUG]:        Error compiling Cython file:
[DEBUG]:        ------------------------------------------------------------
[DEBUG]:        ...
[DEBUG]:        import sys
[DEBUG]:        import traceback
[DEBUG]:
[DEBUG]:        include "jnius_compat.pxi"
[DEBUG]:        include "jni.pxi"
[DEBUG]:        include "config.pxi"
[DEBUG]:        ^
[DEBUG]:        ------------------------------------------------------------
[DEBUG]:
[DEBUG]:        jnius/jnius.pyx:100:0: 'config.pxi' not found
[DEBUG]:
[DEBUG]:        Error compiling Cython file:
[DEBUG]:        ------------------------------------------------------------
[DEBUG]:        ...
[DEBUG]:
[DEBUG]:        include "jnius_compat.pxi"
[DEBUG]:        include "jni.pxi"
[DEBUG]:        include "config.pxi"
[DEBUG]:
[DEBUG]:        IF JNIUS_PLATFORM == "android":
[DEBUG]:          ^
[DEBUG]:        ------------------------------------------------------------
[DEBUG]:
[DEBUG]:        jnius/jnius.pyx:102:3: Compile-time name 'JNIUS_PLATFORM' not defined

Found this: https://stackoverflow.com/a/63084099/1435891 - could be your case.


Seasonal sorting old animes

Seasonal Anime sorting gives a clear look, and offers an easy way to find out what to watch next season or what I missed during the past season. Such as Spring 2015; Summer 2015; Fall 2015 ... and so on.
Currently only upcoming are sort by season but old are sort by decade. That causes too many in a tab.

You can sort by year in upcoming V3.
Don't know about seasonal breakdowns though - it may be possible with whatever's in the drop down below the slider.
cc @NuckChorris

I don't know if it's in the interface, but we can definitely do this on the server side
cc @joshfabian for design wisdom

+1 on seasonal breakdowns in V3.


Uploading flags image lead to 404 error

Hi guys could you please check link for image
https://res.cloudinary.com/dvbuhh0bl/image/upload/c_scale,h_15,w_15/v1495279723/default_tmey2r.png
HTTP ERROR 404
looks like something broken on server side. Thanks.

Until they fix it, a temporary fix is to download the image yourself:

and then in your css:
::ng-deep .flag {
    background-image: url('../../assets/images/flags.jpg') !important;
}


How do I use a script to get the content of another project

Is it possible and how to use the script to get the content of another project?
I want to do some code comparison, so I don't know whether I can use API in one project to open and get the content of another project at the same time, such as function.

No, you can't reach across projects.  Can you just use one project with multiple programs in it?

No, you can't reach across projects. Can you just use one project with multiple programs in it?

Ok, I don't think that's possible either. I'm using a diaphora/bindiff approach, where I scan the first program, then serialize what I need, then deserialize the first program in the second program, and then compare.
I can put multiple programs in a project, but does that mean I can get content across programs? Are there any examples or materials to refer to? Thank you!

If you are looking for something to do from you GUI, maybe you are looking for the following.
In the Project Window, you can have one active project with one program or more programs in it, and then choose Project->View Project... to have another project with corresponding programs that you want to compare in it.
Then in the Code Browser, you can choose the Diff tool (Tools->Program Differences...) (or use the Diff tool icon) and in the Current Projects pull-down, select this second project that you had earlier selected to view in the Project Manager, and then choose the program that you want to compare from the selected project with the current program you have open in the Code Browser.
Search the help for more clues as to how to do this.

Thank you, I know how the GUI works, but here I want to try to implement it with scripts only.

Take a look at the code starting here:
https://github.com/NationalSecurityAgency/ghidra/blob/3c4c734132202f95fe2e928da50f1ebc662b1fbd/Ghidra/Features/FileFormats/ghidra_scripts/UpgradeDexToGhidra71Script.java#L55-L57
It shows how to go back to the project manager and walk through the folders/files to access other programs in the project.

Cool, we have tested it according to your method, which is very great, thank you very much!


HTTP Provisioner

HTTP Provisioner
Overview
The HTTP Provisioner is an EDC extension that is configured to invoke an HTTP endpoint to perform provisioning operations on behalf of the EDC. The provisioning process is designed as an asynchronous, potentially long-running operation.
Exemplary Use Cases
An organization wants to share data originating in a backend system. For each transfer request, the backend system must prepare the data, which can take an indefinite period of time. Once the data is prepared, it can be pushed to the requesting consumer or pulled by the consumer from an endpoint.
In addition to backend data, the organization also needs to share data from other sources.
Asynchronous Messaging
The HTTP Provisioner will implement a Provisioner that POSTs a provision request to a configured HTTP endpoint. The endpoint is expected to return an HTTP 200 acknowledgment immediately after it has persisted the request for processing. The provision operation will be completed sometime after the acknowledgment has been sent.
Provisioner Operation
Multiple HTTP HttpResourceDefinitionGenerator and HttpProvisioner pairs may be configured. One pair is associated with an Asset Data Address (ADA) type and a provisioner endpoint. This makes it possible to configure an EDC runtime to support multiple backend provisioning systems keyed on the data address type.
When a transfer request is received on the provider, an HttpProvisioner will be engaged based on the data address type associated with the asset. The provisioner will post an HttpProvisionerRequest to its configured endpoint. When processing is complete, the provisioning endpoint will POST a response to the callback address containing a Source Data Address (SDA) that can be used to resolve the asset contents.
When the callback response is received by the EDC, a Command will be enqueued to update the associated TransferProcess with the provisioned resource.

sounds good!
What about using HTTP 202 ACCEPTED if call gets provisioned async.
We could then also use HTTP 200 OK in case a provisioner can return the SDA immediately.
 Moritz Keppler<EMAIL_ADDRESS>Daimler TSS GmbH, legal info/Impressum