Support for creating cameras with custom projections

I saw that both of the included PerspectiveProjection and OrthographicProjection implement a common trait called Projection, with methods to generate the Mat4 matrix and to handle window resizing. This seems like a convenient interface for implementing a custom projection type in my game.
Since I could not use the predefined Camera{2d,3d}Components bundle, I tried to spawn a camera entity using a tuple with the components that those predefined bundles have, but with my own projection type.
I couldn't get anything to render on the screen.
My unconfirmed suspicion is that perhaps bevy includes some systems to process the camera which are not generic and only work with the predefined projection types.
I need some way to create a camera with an orthographic projection that is not based on window pixels. Such use cases are common, so bevy's camera support should be improved to give the user more flexibility.

You need to add a bevy_render::camera::camera_system::<MyCameraSystemHere>.system() to the POST_UPDATE stage.
See below:
https://github.com/bevyengine/bevy/blob/979a1346a16898335bf1fe130c81d20297cd45e0/crates/bevy_render/src/lib.rs#L128-L134

Is there any reason the camera 3d components must be constrained to using a perspective matrix?
E.g., couldn't the more general case be used?
pub struct Camera3dComponents {
    pub camera: Camera,
    pub projection: Mat4,
    pub visible_entities: VisibleEntities,
    pub transform: Transform,
    pub global_transform: GlobalTransform,
}

The matrix needs to be updated using the window width and height when that changes, when the window is resized. This has different effects on different projections
In future I expect it to become generic over the projection type.

Triage:

.system() is no longer needed in the suggested fix.
These bundles are now split into PerspectiveCameraBundle and OrthographicCameraBundle, with different constructor sets for each.
We have #[bundle] for nested bundles, so we could create a shared 'BaseCameraBundle' (which is the Camera3dComponents suggested above)
The documentation has not improved

As far as I can tell, this is fixed.
Now bevy has a CameraProjection trait one can derive, and it can be added to bevy using the CameraProjectionPlugin.
An example of custom projection can be found on @Selene-Amanita's bevy_basic_portals project.


Using print for output

I tried to compare the option before and the option after, I didn't really see the difference, maybe there are cases when it is noticeable? I'll be glad if you tell me.
I wanted to make an issue with the question first, but decided that it would be faster, because there are minimal changes and immediately, if everything is good, we can apply them.

[ ] CHANGELOG.md's "Unreleased" section has been updated, if applicable.

I believe it was for Windows users

#249

Maybe using Mordant's Terminal's print solves Windows? I don't have a Windows machine to test anything.

I checked several options on not the newest Windows 10 (x86, latest JDK17) with a built-in terminal (the same with PowerShell) and with the latest version Terminal (there is a regular terminal inside, but you can choose others if installed). I tested it on a jest sample. I didn't see any problems with the output other than what is below.

1. no changes in simple terminal

2. no changes in Terminal

3. using `print` in simple terminal

4. using `print` in Terminal

5. using `System.out.write` in Terminal

Others do not differ from the above.

I will close the pull request, since the changes break the output and it turns out to be incorrect.

We should try with Mordant and with raw mode enabled, too. Or maybe the amount of code to make it work is small enough to take on ourselves (or maybe Mordant would take it on).

I checked with Mordant Terminal#rawPrint, the results are one-to-one, as with print.

Tracking at #471


Next/NextInSection and Prev/PrevInSection are flipped?

This was previously reported as issue  #9158 and apparently closed as resolved. However it is clearly not resolved.
I  have a contents page which sorts things in order of the page weight. I would expect the next page to be the next one in the contents but it isn't it is the previous one; and vice versa.
Even the docs say

The behavior of the PrevInSection and NextInSection methods on a Page object is probably the reverse of what you expect.

Surely the intuitive thing is to behave as people expect rather than putting such a comment in the docs?

I have had this issue reported ... 100s of times before, which is why that line is in the documentation. I can add that that the original implementation went in the other direction (the way you want it), but that was reported as a bug, I agreed, and we spent 100 hours on a deprecation cycle to change the meaning. The odds of us doing that again now, with even some more thousands of Hugo sites in the wild is ... close to zero, so I'm closing this issue.
The current behaviour comes from Hugo's default page sort when no weight is set: Date descending (newest first), so next goes correctly to the next when you look at it sorted from newest to oldest, but it goes back in time.
Anyhow, even if we wanted to (I don't), we cannot change this.
You can use https://gohugo.io/methods/page/next/ instead if you want.

Thanks for the reply. I can understand why you don't want to change the
default as this would be an issue for existing sites. Have you considered
having a config setting for the sort order? There are many circumstances
where you might want it to work differently e.g. if you have a table of
contents for a book or topic that is sorted by weight. And it seems odd to
have something in the docs that saying it acts in an unexpected way.
On Fri, 16 Aug 2024 at 10:30, Bjørn Erik Pedersen @.***>
wrote:

I have had this issue reported ... 100s of times before, which is why that
line is in the documentation. I can add that that the original
implementation went in the other direction (the way you want it), but that
was reported as a bug, I agreed, and we spent 100 hours on a deprecation
cycle to change the meaning. The odds of us doing that again now, with even
some more thousands of Hugo sites in the wild is ... close to zero, so I'm
closing this issue.
The current behaviour comes from Hugo's default page sort when no weight
is set: Date descending (newest first), so next goes correctly to the
next when you look at it sorted from newest to oldest, but it goes back
in time.
Anyhow, even if we wanted to (I don't), we cannot change this.
You can use https://gohugo.io/methods/page/next/ instead if you want.
—
Reply to this email directly, view it on GitHub
https://github.com/gohugoio/hugo/issues/12776#issuecomment-2293165947,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJE32MCXGHIZAZX6QNIVNLZRXBBRAVCNFSM6AAAAABMTV5Z5GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJTGE3DKOJUG4
.
You are receiving this because you authored the thread.Message ID:
@.***>

@simonm3 see https://gohugo.io/methods/pages/next/

https://gohugo.io/getting-started/configuration/#configure-page


rooter selfupdate

CLI command rooter selfupdate is failing to upgrade rooter package. Error: Package name '.*.rooter' does not match any packages in the profile.
rooter selfupdate
warning: Package name '.*.rooter' does not match any packages in the profile.
warning: No packages to upgrade. Use 'nix profile list' to see the current profile.

my nix profile list
nix profile list
Name:               devenv
Flake attribute:    legacyPackages.aarch64-darwin.devenv
Original flake URL: flake:nixpkgs
Locked flake URL:   github:NixOS/nixpkgs/c8a17040be4a20b29589cb4043a9e0c36af1930e?narHash=sha256-7NBJm1jfMeAowE1J2oljYqWVvI9X7FyyxBY4O8uB/Os%3D
Store paths:        /nix/store/b3qrqdgy7zkl5wz8mcgqpxnyid7ldvv2-devenv-1.3

Name:               direnv
Flake attribute:    legacyPackages.aarch64-darwin.direnv
Original flake URL: flake:nixpkgs
Locked flake URL:   github:NixOS/nixpkgs/e2f08f4d8b3ecb5cf5c9fd9cb2d53bb3c71807da?narHash=sha256-CAZF2NRuHmqTtRTNAruWpHA43Gg2UvuCNEIzabP0l6M%3D
Store paths:        /nix/store/86zx2b7bd57p8wjaw4vz313vfyx8883q-direnv-2.34.0

Name:               nix-direnv
Flake attribute:    legacyPackages.aarch64-darwin.nix-direnv
Original flake URL: flake:nixpkgs
Locked flake URL:   github:NixOS/nixpkgs/e2f08f4d8b3ecb5cf5c9fd9cb2d53bb3c71807da?narHash=sha256-CAZF2NRuHmqTtRTNAruWpHA43Gg2UvuCNEIzabP0l6M%3D
Store paths:        /nix/store/fp00nk0xyj8nr964c81gcl39xc38j3jj-nix-direnv-3.0.6

Name:               rooter
Flake attribute:    packages.aarch64-darwin.rooter
Original flake URL: github:run-as-root/rooter/main
Locked flake URL:   github:run-as-root/rooter/54cab22c6212e35ca97c5dea06ca3c8250db62e5?narHash=sha256-I0ENwIAhFv8sohMJULxAl7P5x%2BAh4gmrjTD0EZgw4iM%3D
Store paths:        /nix/store/2wsyiagin86g824p8h8560kcbkhqnl16-rooter

I've done successful upgrade to rooter 1.0.0-beta8 with nix nix profile upgrade rooter
nix profile upgrade rooter
rooter -V
rooter 1.0.0-beta8

Thanks for reporting this @MPietrukowski
Based on #12 I assume you have nix 2.24.
Starting with nix 2.20 the profile command was changed. Up until now we have treated this as unstable.
But it is now safe to assume it will stay this way 😅
The commit 326b8926cdaceecbbce444df98952d5f3f2632cf should fix this.
However the next update still has to be installed using nix profile upgrade rooter in your case.


typo: Double word "in"

@nschonni : Thanks for your contribution! The author, @KathrynEE, has been notified to review your proposed change.


Failing to open iOS application in the simulator

I'm getting further since #60 was fixed, but not quite all the way there yet. The application appears to successfully install in the simulator, but then fails to open:
An error was encountered processing the command (domain=FBSOpenApplicationErrorDomain, code=1):
The operation couldn’t be completed. (FBSOpenApplicationErrorDomain error 1.)

This could be related: http://stackoverflow.com/questions/31350957/fbsopenapplicationerrordomain-error-1. Something to do with environment variables on launch. I'll try take a look into this later.

@sharplet I'd love to know if you've resolved this.

I have not. Might try to take a look tomorrow.

Ok! I worked out what's going on here. The cause of the error: the app bundle that was being installed was built for iphoneos, not for iphoneosimulator. No wonder it crashed on launch. Here's how that happens:

bin/run_ios_app searches relative to Build/Products, which contains subfolders for all destination + configuration pairs.
I had previously built for device from within Xcode
During :Xrun, right here, we do a find for *.app bundles and take the first result.
The iphoneos build is the first result.

Here's what I thought we could do: Instead of grepping for BUILD_DIR, we instead use CONFIGURATION_BUILD_DIR to build the path to the app bundle.
However, there seems to be a discrepancy between xcodebuild build and xcodebuild -showBuildSettings in terms of how it resolves build settings. xcodebuild build uses the Configuration defined in the Run action of the scheme, whereas xcodebuild -showBuildSettings completely ignores the configuration from the scheme, instead using the default configuration for command line builds.
I can think of two options:

Replicate Xcode's behaviour by locating the .xcscheme file and parsing the XML to find the Run action's configuration
Add an :Xconfiguration command to vim-xcode and then use that to pass an explicit configuration through to invocations of xcodebuild.

Thoughts?

Is there an even easier way to solve this? We actually don't support running on a device at all right now, so could we modify our script to only find simulator builds?

Yeah we could totally hardcode that.

FWIW, it's currently hardcoded to look up simulator builds in #71.

In a discussion on #71, it became clear that it makes sense to flesh out support for schemes.
The core of the problem is that when we use xcodebuild -showBuildSettings, it doesn't actually use the configuration defined in any scheme action, instead using the default configuration for command-line builds (usually Release) or a configuration that's explicitly passed in.
So because xcodebuild -showBuildSettings doesn't do enough to let us read build settings based on the current scheme, we'll have to instead start parsing the scheme. After talking with @gfontenot about it in person, here's a proposal for how to implement this:

When running :Xscheme, we validate the scheme name using the output of xcodebuild -list. No change here from current behaviour.
After validating the scheme name, we do a recursive search in the current directory for a .xcscheme file that matches the selected scheme, and choose the first match.
Store the path to the .xcscheme file.
Add a new shell script that can parse a scheme file for useful information.
Somewhere during the run part of :Xrun, grab the configuration for the current scheme's build action and pass that explicitly to bin/run_ios_app.
Now we can use xcodebuild -showBuildSettings -configuration <name> to read CONFIGURATION_BUILD_DIR and install the correct app bundle.

Note: this would explicitly not be supporting ambiguous scheme names in workspaces or projects. Unambiguous scheme lookup can be added later.


Request has no attribute 'source'

This is from the docs, yet my console reports
`AttributeError: 'Request' object has no attribute 'source'`
using latest version of Kyoukai from git fyi

This should be corrected within 2.0 (with whatever the new property on the Werkzeug request is) on the uWSGI worker by default - I'll make sure to add that to the default httptools worker tonight.


IcingaDB-Redis: Allow to set a Redis password

Right now it's not possible to set a password for icingadb-redis if I'm not mistaken. This should be added.

Thanks again for the PR, I'll close it with the reference in place.


Mutiple custom tooltip styles

Hi Matthew
I would like to be able to use multiple custom tooltip styles with a pannellum scene.
As an example, directional hotspots tooltip might have tooltips that are styled to look like direction signs on a highway. Whilst information hotspots tooltip might be styled to look like a heritage sign.
Is there already a way to do this that I've overlooked?
Best wishes
Derek

While the custom hot spots example only shows a single style, there's no limitation preventing use of multiple styles. If you provide a different createTooltipFunc and cssClass parameters to different hot spots, you should get different styles.

Thanks Matthew
I hadn’t  realised that multiple createTooltipFunctions could be used with Pannellum, but now you’ve told me it makes perfect sense, and yes it works.
Best wishes
Derek
From: Matthew Petroff<EMAIL_ADDRESS>Sent: 11 October 2020 23:45
To: mpetroff/pannellum<EMAIL_ADDRESS>Cc: Derek Stillingfleet<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [mpetroff/pannellum] Mutiple custom tooltip styles (#920)
While the custom hot spots example https://pannellum.org/documentation/examples/custom-hot-spots/  only shows a single style, there's no limitation preventing use of multiple styles. If you provide a different createTooltipFunc and cssClass parameters to different hot spots, you should get different styles.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/mpetroff/pannellum/issues/920#issuecomment-706779094 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AC47ZDGBVTU6QK6C3VVB7Q3SKIYNXANCNFSM4SCXGX4A .  https://github.com/notifications/beacon/AC47ZDGZQNSW2MSDYTUPGATSKIYNXA5CNFSM4SCXGX4KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOFIQJPVQ.gif


Request dedicated filesystem mount for deposited files

H2 will "hang on" to user-deposited files locally, just as current Hydrus does. We should store these on a dedicated, backed-up mount.

[ ] Initiate a sprint planning discussion about how much space to request in each env for this mount.
[ ] Write up a new ops-tasks issue requesting a mount similar to Hydrus's current mount in /data/hydrus-files (call it /data/h2-files?) for each of our deployed environments (qa, stage, prod).

[ ] Specify that this mount should be backed up regularly just as Hydrus's is.

[ ] If needed, specify the path to this mount in shared_configs (if it varies across environments; else stuff the value in the application repository in config/settings.yml)
[ ] Update DevOpsDocs with something like the following (based on Hydrus's docs) in the dependencies section:

#### Mounted Filesystem

There is a shared mount at /data/h2-files. When a user creates a new self-deposit object, the files are put in a Druid tree on the shared mount. This mount must have available disk space. Files must remain in the mount for looking at the object through the self-deposit app in H2.

We will discuss this on Monday the 26th during mid-sprint planning.

Ask for double the size of Hydrus's mounts in the three environments. Also check in re: how easy to grow these volumes over time.


Custom Role Permissions

Are the custom role permissions listed still valid/complete? I verified I have those actions assigned in a custom role at subscription scope but am getting TAUserDoesNotHavePermissions errors enabling Traffic Analytics against a security group (which previously did work).

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 59a0b9f5-9071-5e89-5f52-ca8fb2dbc90b
Version Independent ID: 61a1736f-56c1-7950-72b3-907f32689ca4
Content: Azure traffic analytics
Content Source: articles/network-watcher/traffic-analytics.md
Service: network-watcher
GitHub Login: @damendo
Microsoft Alias: damendo

@mstair Thanks for the feedback! I was also unable to enable Traffic Analytics using the permissions given. It also required permissions over the Network Watcher RG:
There was an error provisioning the resource group 'NetworkWatcherRG'.
Additional details from the underlying API that might be helpful: The client  does not have authorization to perform action 'Microsoft.Resources/subscriptions/resourceGroups/read' over scope '/subscriptions/SubIDHere/resourceGroups/NetworkWatcherRG'
I am assigning this issue to the author to update with the correct permissions needed.

As advised by my manager @jyothisuri, closing the issues that are older than a year.
#please-close

#reassign: @Harsha-CS


Stricter types

Close #95
This adds a new piece of middleware.
This also avoids any (which is a breaking change in types, but not in behavior.)

Two issues:

codesandbox doesn't detect type declarations (not even with v3.0.3)
it would be nice to come up with better middleware name. any suggestions?

This doesn't break anything for JS users. Let me merge this in.


[Infra] Expose user-configurable autoscaling parameters

This PR is a follow up from the previous ones, to expose autoscaling configurations to the Turing users, and it updates the infra set up to include the HPA along with a few small fixes. Previous PRs:

https://github.com/caraml-dev/turing/pull/234
https://github.com/caraml-dev/turing/pull/236

Modifications

.github/workflows/cluster-init.yaml - Increase the versions of Knative / Knative Istio, to use the same default value used by the cluster init script.

api/turing/config/config.go - Clean up outdated config (also from other test / example files)

infra/cluster-init/init.sh, infra/docker-compose/dev/docker-compose.yml - Install the optional Knative serving extension for HPA

ui/src/router/components/form/components/autoscaling_policy/AutoscalingPolicyPanel.js - Display autoscaling metric unit (% for CPU, Mi for memory and nothing for the rest) for clarity

Update e2e tests to exercise CPU / Memory based autoscaling metrics

Thanks for the review. Merging!


zh: remove support for basic authentication

Signed-off-by: Monis Khan<EMAIL_ADDRESS>xref: #19630 https://github.com/kubernetes/kubernetes/pull/89069

Easier to review with whitespace ignored: https://github.com/kubernetes/website/pull/20133/files?w=1

/hold
pending #19630

FYI: this is a localization of generated documentation. The v1.19 generated documentation won't include this option.
/hold cancel


simd: add clarification that implicit vector casts are reinterpretations

Motivation: https://issues.dlang.org/show_bug.cgi?id=20112


Vectorized NeighborsAutograd::backward

This small PR updated the way the NeighborsAutograd::backward computes the positions_grad. Now, instead of iterating over the samples (i.e. list of neighbors), the operation is vectorized with torch::index_add.
Contributor (creator of pull-request) checklist

[ ] Tests updated (for new features and bugfixes)?
[ ] Documentation updated (for new features)?
[ ] Issue referenced (for PRs that solve an issue)?

Reviewer checklist

[ ] CHANGELOG updated with public API or any other important changes?

Could you also do the same for the cell gradients?


Old env vars

https://github.com/ONSdigital/sdx-downstream-ctp/blob/13fb5a22f9d1d9a159dbf62a2c88d0cef10e0b65/app/settings.py#L22
The old FTP_ env vars shouldn't be hanging around if not used.

This service isn't in use anymore


Add collectd release to the official bosh releases list

Hello here,
would it be possible to add the collectd bosh release to the official bosh release list.
It would make its usage more convenient.
In alternative, the project github releases could contain a proper ready-to-use bosh release gzipped tar, instead of the standard github project archive
Thanks,
Claudio

@claudio-benfatto this release how has fancy CI https://ci.starkandwayne.com/teams/main/pipelines/collectd-boshrelease?groups=blobs&groups=collectd-boshrelease
It will automatically bump to new collectd versions; and the shipit task will automatically update manifests/collectd.yml with the latest final release URL/sha1. This release info is also appended to release notes https://github.com/cloudfoundry-community/collectd-boshrelease/releases/tag/v2.2.0

That's great @drnic ! Many thanks!


developerkey page flash before login

GWA version
1.0.0
Description
when login to developer page first time,
developer key page content appears for a very short moment then redirect to login GitHub Login page.
Expected behaviour
when user no logged in, it should go to GitHub Login immediately

The authentication filter was not run on the exact resource /. I have added that so it triggers the login before the angular app is downloaded.


API breaking change. Update required for articles that use transition_components() or transition_reveal()

Code using these functions will need to be updated and the Rmd  source files re knitted.
#gganimate has experienced a small (but very breaking) change… The `id` argument hof transition_components() and transition_reveal() has been deprecated in favour of using group aesthetic in each layer #rstats— Thomas Lin Pedersen (@thomasp85) December 10, 2018

Hey Adam! I modified the transition_components() part by removing the id argument and using the group or colour arguments in the ggplot() call.


Questions about v4 tiny on Edge TPU

@hhk7734 Very interesting to see v4 tiny on Edge TPU. I have two questions

What ops where not mapped to the TPU?
Did you quantize (post-training/training-aware) to INT8?

Thanks
Originally posted by @ankandrew in https://github.com/hhk7734/tensorflow-yolov4/issues/4#issuecomment-670947207

Several tests are in progress on the TPU.
I will comment 1~2 days later.

I should have opened a new issue =)
Perfect, I am interested about the results)

The yolov4-tiny model is shown below. The red area is the part that cannot be converted.

There was a test script, but I forgot to tell it.
https://github.com/hhk7734/tensorflow-yolov4/blob/master/test/make_edgetpu_tflite.ipynb

❯ edgetpu_compiler yolov4-tiny-relu.tflite
Edge TPU Compiler version 14.1.317412892

Model compiled successfully in 764 ms.

Input model: yolov4-tiny-relu.tflite
Input size: 5.96MiB
Output model: yolov4-tiny-relu_edgetpu.tflite
Output size: 6.19MiB
On-chip memory used for caching model parameters: 5.92MiB
On-chip memory remaining for caching model parameters: 208.25KiB
Off-chip memory used for streaming uncached model parameters: 0.00B
Number of Edge TPU subgraphs: 1
Total number of operations: 150
Operation log: yolov4-tiny-relu_edgetpu.log

Model successfully compiled but not all operations are supported by the Edge TPU. A percentage of the model will instead run on the CPU, which is slower. If possible, consider updating your model to use only operations supported by the Edge TPU. For details, visit g.co/coral/model-reqs.
Number of operations that will run on Edge TPU: 51
Number of operations that will run on CPU: 99
See the operation log file for individual operation details.

TF 2 is not yet stable. Depending on the version, it may or may not be converted. A high version doesn't mean it works.

Thanks for the detailed response =)
Any possible reasons why the yolo heads don't get mapped to the TPU? I don't see any opt not supported here.
Also, a good thing to keep in mind is the TPU slow-down when there is Off-chip memory used (some experiments). Do you think this can happen once the heads (everything in red circle) get mapped to tpu?

In my test, Add, Sub, and Mul are each supported, but if there are more than three(? or four) consecutive operations, the parts are not converted.
Model: "YOLOv4Tiny"
_________________________________________________________________
Layer (type)                 Output Shape              Param #
=================================================================
CSPDarknet53Tiny (CSPDarknet ((None, 38, 38, 256), (No 3633632
_________________________________________________________________
PANetTiny (PANetTiny)        ((None, 38, 38, 255), (No 2429182
_________________________________________________________________
YOLOv3HeadTiny (YOLOv3HeadTi ((None, 38, 38, 255), (No 0
=================================================================
Total params: 6,062,814
Trainable params: 6,056,606
Non-trainable params: 6,208
_________________________________________________________________

yolov4-tiny has 6M params. The header contains constant matrixes and (I think) is therefore not included in the summary. I'll look at it :). This is really useful information. Thanks.

I've been doing lots of tests also with yolov4-tiny on Google Coral and the best solution is to split the model in two:

Darknet and Features
Features to Boxes

The first part is easily convertible to tflite->edgetpu, but the second part has problems ALWAYS (unmapped to TPU, unsuported ops, etc).
In the end I convert the last part (Features to Boxes) to pure vectorized numpy instead of Tensorflow or Tflite, and run that on CPU. I get an inference time of ~25ms, getting 40fps with this method.
I can share code if you want to take a look

I've been doing lots of tests also with yolov4-tiny on Google Coral and the best solution is to split the model in two:

Darknet and Features
Features to Boxes

The first part is easily convertible to tflite->edgetpu, but the second part has problems ALWAYS (unmapped to TPU, unsuported ops, etc).
In the end I convert the last part (Features to Boxes) to pure vectorized numpy instead of Tensorflow or Tflite, and run that on CPU. I get an inference time of ~25ms, getting 40fps with this method.
I can share code if you want to take a look

WOW :astonished:
I tried that too, but the Darknet and Features part was 50ms~.
What's your TF and edgetpu_compiler version????
Your results are really impressive. I want it!!!

Hi,
First of all, thank you for your great efforts.
Can you share "yolov4-tiny-relu.weights"?
And, when creating this weight, what is the difference from the yolov4-tiny.weights?

yolov4-tiny-relu.weights
from yolov4.tf import YOLOv4

yolo = YOLOv4(tiny=True)

yolo.classes = "dataset/coco.names"

yolo.make_model(activation1="relu")
yolo.load_weights("yolov4-tiny-relu.weights", weights_type="yolo")

yolo.inference("image.png")

yolov4-tiny-relu use relu instead of mish.

Did you also think about using relu6 instead of relu? Although I'm not sure of the benefits of one and the other

I've been doing lots of tests also with yolov4-tiny on Google Coral and the best solution is to split the model in two:

Darknet and Features
Features to Boxes

The first part is easily convertible to tflite->edgetpu, but the second part has problems ALWAYS (unmapped to TPU, unsuported ops, etc).
In the end I convert the last part (Features to Boxes) to pure vectorized numpy instead of Tensorflow or Tflite, and run that on CPU. I get an inference time of ~25ms, getting 40fps with this method.
I can share code if you want to take a look

WOW 😲
I tried that too, but the Darknet and Features part was 50ms~.
What's your TF and edgetpu_compiler version????
Your results are really impressive. I want it!!!

I will share my code during the weekend!
TF is tf_nightly-2.2.0.dev20200422-cp36-cp36m-manylinux2010_x86_64
Edgetpu_compiler is latest version

@ankandrew
I'm not sure what's better. I'll try relu6 after finishing relu test. :)

I have experienced significant drops in mAP if relu-6 is used.
However, this result was from TinyYOLOv3.

I've been doing lots of tests also with yolov4-tiny on Google Coral and the best solution is to split the model in two:

Darknet and Features
Features to Boxes

The first part is easily convertible to tflite->edgetpu, but the second part has problems ALWAYS (unmapped to TPU, unsuported ops, etc).
In the end I convert the last part (Features to Boxes) to pure vectorized numpy instead of Tensorflow or Tflite, and run that on CPU. I get an inference time of ~25ms, getting 40fps with this method.
I can share code if you want to take a look

Hi @agjunyent, amazing work! How many supported operations did you manage to get? can I have a look at your code?

Hi @agjunyent, I'm really impressed by the performances that you get. I would be very interested to have a look at your code.

@agjunyent as everyone said here, likewise, I'm waiting for your code eagerly.

I'll organize and share the code during this week!!!

Hey, I know no one likes bumps that much but is there any progress? I'm really looking forward to your code ! @agjunyent

Hey! Sorry for the delay. Been a busy week...
So I'll try to explain how I do it to get around 25ms inference time.
First of all, I train the model in google colab (just because my PC cannot do it) using the code from the .zip file I attach here
train_inference_yolo.zip
Inside here you will see some files, but the most important are:

train.py -> training. There are some parameters that you can play with. The most important and needed ones are:

CLASSES_NAMES: a ".names" file with the names of your classes, one per line, WITHOUT new line at the end
TRAIN/VAL_DATASET: .tfrecord file of your dataset, created using this repo: https://github.com/mwindowshz/YoloToTfRecords
LOAD_WEIGHTS: wether to resume training or start from scratch, hdf5 format.
All the other parameters are self explanatory

convert.py -> convert TF to TFlite for coral compiler. Just change the parameters to match your model. Then use the compiler to get the _coral.tflite version of the weights
inference.py -> inference. Only a demo code. You can pick that code for your purpouse. Just change:

WEIGHTS (l174): _coral.tflite format of the weights of the model
INPUT_IMAGE: path to the input image for inference
NUM_CLASSES: how many classes the model has been trained with

Try to download the files and play with them. I've tested them a bit, but not thoroughly, so expect some bugs. If any question just ask!

@agjunyent  Thank you for sharing! I'm trying to use train.py with pre-trained relu weights linked in this repo without success. Do you know the steps to do this?

Let me try today to use the weights linked on this repo.
I modified the code quite a bit, both training and inference, to have 100% of operations mapped to CPU, and use numpy vectorization on the ones that could not be mapped, so plain Tensorflow is not used at all.
I'll get back when I have something

Thanks @agjunyent for the files!
I have a question. Is there a way to use only the convert.py, with yolov4-tiny weights so that I convert them to .tflite, or I need to do the entire process in order to retrain it? I tried using the convert.py but I could not convert the weights, so I suppose I need to run the training first right? I suppose you're using coco to retrain it?
Thanks for your help once again

TF 2 is not yet stable. Depending on the version, it may or may not be converted. A high version doesn't mean it works.

which version are you using because it doesn't convert with tf-gpu 2.2
"RuntimeError: Unsupported output type INT8 for output tensor 'Identity' of type FLOAT32."

@agjunyent
Thanks for sharing your code here.
I tried compiling the model for edgetpu and ended up with the following log file which takes a massive 1500ms on edgetpu. Was wondering if you have any pointer or if you can share some more info about the environment you used to obtain you 25ms performance. I tried multiple tf version and was only able to successfully compile the model using tf-nightly-2.5.0
Would appreciate any help here.
Edge TPU Compiler version 14.1.317412892
Input: converted_model.tflite
Output: converted_model_edgetpu.tflite
Operator                       Count      Status
CONV_2D                        19         Mapped to Edge TPU
CONV_2D                        2          More than one subgraph is not supported
QUANTIZE                       9          Mapped to Edge TPU
QUANTIZE                       1          Operation is otherwise supported, but not mapped due to some unspecified limitation
RESIZE_NEAREST_NEIGHBOR        1          Operation version not supported
CONCATENATION                  6          Mapped to Edge TPU
CONCATENATION                  1          More than one subgraph is not supported
PAD                            2          Mapped to Edge TPU
MAX_POOL_2D                    3          Mapped to Edge TPU
SPLIT                          3          Mapped to Edge TPU

On my test
yolov4-tiny-relu with head(224x224) 21ms ~
yolov4-tiny-relu with head(608x608) 132ms ~
I think this model can speed up by finding a few optimization methods, but is there any way to dramatically speed it up as long as we don't change the model itself?
edgeTPU benchmarks: https://coral.ai/docs/edgetpu/benchmarks/

Hi, please correct me if I am wrong, but I consider the current implementation of the edge tpu export to be broken. When using the most recent tensorflow release (2.3.1), a tflite model is exported, however the edgetpu-compiler wont work with it. I noticed this problem is caused by tf switching from their toco tflite converter to a new one. The new converter can't handle the tf.exp() op in the graph.
I was able to get it working by disabling the new converter. This is certainly not a permanent solution, however it works with all tf versions including 2.5-nightly. When using the most recent compiler with the new -a flag, 97 of 128 operations run on the edge tpu.
If desired, I can make a pull request, with the necessary changes. I can add a script for exporting the edge tpu and onnx model too.

I compiled the tflite with -a.
$ edgetpu_compiler -a yolov4-tiny-relu-int8.tflite
Edge TPU Compiler version 15.0.340273435

Model compiled successfully in 1105 ms.

Input model: yolov4-tiny-relu-int8.tflite
Input size: 5.96MiB
Output model: yolov4-tiny-relu-int8_edgetpu.tflite
Output size: 6.28MiB
On-chip memory used for caching model parameters: 6.06MiB
On-chip memory remaining for caching model parameters: 716.25KiB
Off-chip memory used for streaming uncached model parameters: 3.38KiB
Number of Edge TPU subgraphs: 2
Total number of operations: 149
Operation log: yolov4-tiny-relu-int8_edgetpu.log

Model successfully compiled but not all operations are supported by the Edge TPU. A percentage of the model will instead run on the CPU, which is slower. If possible, consider updating your model to use only operations supported by the Edge TPU. For details, visit g.co/coral/model-reqs.
Number of operations that will run on Edge TPU: 98
Number of operations that will run on CPU: 51
See the operation log file for individual operation details.

Compared to the previous version, it runs 48 more on the Edge TPU. But slower than before.
input_size = (512, 384)
without -a, FPS: 11 ~ 12
with -a, FPS: 9~10

My results are quite the opposite. I used the tiny_yolov4 with relu activation and weights provided by your repo. The input tensor has a size of (608, 608, 3). With the -a flag i get three subgraphs with 97 of 128 operations running on the tpu. Without the flag I have one subgraph with 42/128 operations mapped. This gives me the following inference times for 5 runs:

Run 1
Run 2
Run 3
Run 4
Run 5

with -a flag
0.0722s
0.0650s
0.0642s
0.0629s
0.0687

without -a flag
0.2012s
0.1675s
0.1743s
0.1665s
0.1702s

Please make PR. I'm curious about your code. :open_mouth:

Alright, I'm on it. It will take a bit though, because I want to write a sanity test beforehand. At this point I only testet the inference time with random input data. I want to see, if the model with quantized inputs and outputs is able to make useful predictions on real data (kite.jpg).

The yolov4-tiny full int8 model is shown below. The red area is the part that cannot be converted.

How to convert from tiny tensorflow to tflite int8? I have follow the tutorial from your repo's issue to convert to int8 but it failed while compiling for edge tpu "Model not quantized". Thanks.

Did you follow this? https://wiki.loliot.net/docs/lang/python/libraries/yolov4/python-yolov4-edge-tpu

@hhk7734 oh isee, so it requires to download val2017 images first right?

yep, for post training.

I try to implement it on raspi 4 with coral
when i try to convert error occurs
dataset = YOLODataset(   File "/home/farhan/.local/lib/python3.8/site-packages/yolov4/tf/dataset/keras_sequence.py", line 52, in __init__     self.dataset = parse_dataset(   File "/home/farhan/.local/lib/python3.8/site-packages/yolov4/common/parser.py", line 219, in parse_dataset     raise RuntimeError( RuntimeError: parse_dataset: 'center_x', 'center_y', 'width', and 'height' are between 0.0 and 1.0.
what is the problem?

'center_x', 'center_y', 'width', and 'height' should be between 0.0 and 1.0.

Hei, actually just directory issue, it works, thank you :D

How you get the tiny-relu version? did you just change the activation "leaky" to "relu"?
Ive some issue to run the video detection using this code
`import cv2
from yolov4.tflite import YOLOv4
yolo = YOLOv4()
yolo.config.parse_names("dataset/coco.names")
yolo.config.parse_cfg("config/yolov4-tiny-relu-tpu.cfg")
yolo.summary()
yolo.load_tflite("yolov4-tiny-relu-int8_edgetpu.tflite")
yolo.inference(
"road.mp4",
is_image=False,
cv_apiPreference=cv2.CAP_V4L2,
cv_frame_size=(640, 480),
cv_fourcc="YUYV",
)
`
it just pop a blank cv2 window, but for image is working fine.

yolo.inference("road.mp4", is_image=False)

yes, I just change leaky to relu. But, not well trained.
I plan to do transfer learning after backbone training.

Model
EdgeTPU Ops: https://coral.ai/docs/edgetpu/models-intro/#supported-operations
yolov4-tiny
image -> conv2d -> ... -> conv2d -> yolo_0
                   ... -> conv2d -> yolo_1

yolo layer
input
x, y, w, h, o, c0, c1, ...

output
(scale * logistc(x) - 0.5 * (scale - 1) + cx) / grid_width,
(scale * logistc(y) - 0.5 * (scale - 1) + cy) / grid_height,
prior * exp(w) / net_width
prior * exp(h) / net_height
logistic(o)
logistic(c0)
logistic(c1)
...

prior == anchor == biases

EdgeTPU
In the current situation, not all layers are mapped to the TPU, because of SPLIT_V, EXP, ...
Even if you can map all of them, Too many layers have too much information loss at 8-bit precision.
We have to choose whether to change the model so that it can use a lot of TPU, or to give up some and run it on the CPU.
This can be a question of whether you choose speed or precision.
When using TPU, I removed all operations from yolo except logistic.
Converted model

Identity - x0, Identity_1 - logistic(x0)
Identity_2 - x1, Identity_3 - logistic(x1)
FPS test
Model only

input shape (1, 416, 416, 3)

In [9]: def model(x):
   ...:     yolo._interpreter.set_tensor(yolo._input_details["index"], x)
   ...:     yolo._interpreter.invoke()
   ...:         # [yolo0, yolo1, ...]
   ...:         # yolo == Dim(1, height, width, channels)
   ...:         # yolo_tpu == x, logistic(x)
   ...:
   ...:     return [
   ...:         yolo._interpreter.get_tensor(output_detail["index"])
   ...:         for output_detail in yolo._output_details
   ...:     ]
   ...:

In [10]: 100/timeit.timeit(lambda: model(x), number=100)
Out[10]: 31.288735650288498

model + scale_x_y + copy x[..., wh] to logistic(x)[..., wh]
https://github.com/hhk7734/tensorflow-yolov4/blob/b67ca4557d3073d59bd8bb8c5876243ea29308f9/py_src/yolov4/tflite/__init__.py#L97-L129

input shape (1, 416, 416, 3)

In [14]: 100/timeit.timeit(lambda: yolo._predict(x), number=100)
Out[14]: 30.969583151128262

resize -> ... -> diounms
https://github.com/hhk7734/tensorflow-yolov4/blob/b67ca4557d3073d59bd8bb8c5876243ea29308f9/py_src/yolov4/common/base_class.py#L189-L191
yolo.predict(x, prob_thresh) do resize image -> _predict -> diounms -> fit pred bbox to original image shape.

probability thresh 25%
image shape (640, 480, 3)
input shape (1, 416, 416, 3)

24 ~ 29 FPS depending on the number of objects found.
Plan

Train yolov4-tiny-relu and yolov4-tiny-relu-new_coords on darknet to get AP50 35%~ (coco val2017)

@hhk7734 what tpu you are using?

@farhantandia Coral dev board

#49 #86


Export .iid/.cid

Hi,
As a user;
I want to export individual IED SCL files from the project
in order to integrate these files to my engineering workflow for different usecases.
Hope this is also in scope.
Best Regards
Burak

Thank you for this contribution. We need to be able to export such files of course if we want to be part of the engineering process. For now we are working heavily to be able to "touch" all important elements of an SCL file with OpenSCD.
Do you have something where you require this feature right now already? Do you do system engineering with OpenSCD already?

It is just a small part the customer needs to export individual cid/iid and send back to IED only the changes he made for RCB Client LN assignment to be represented in the cid/iid as well.
Workaround is he goes back to SCT and does it there but this is too much hassle for him, once he did the Client LN assignment in OpenSCD why to go back to SCT for just export step.
This is the story.

I see. But again I must be honest with you. This is not a small thing to implement and my guess is around Feb next year :(

We would have a use for this with the current software for GE devices (Enervista 8.3) which will only do SV configuration from an IID/CID/ICD file:


dbeaver ER Diagram

How do I draw a table model or view on dbeaver ER Diagram

You can view only existing tables/view on ERD. If you need to make some custom diagram you can do this: https://github.com/dbeaver/dbeaver/wiki/Custom-Diagrams

@serge-rider That's really great to be able create ER Diagrams for the selected tables with Notes. But ability to define a schema using ER diagrams is a great help in database designing. Personally, that's something i miss badly coming from MySQL Workbench. I would request this feature from DBeaver team.

How can I see the Primary and Foreign Keys when I make the connections. For some weird reason I only see a line and looks nothing like what is on the wiki. I currently have a standard enterprise license.

Im trying to see the ER diagram of some applications using mariaDB and dbeaver 6.0.2.
the tables appears on the diagram, but there is no relationship or connections between then. Is it avaiable on dbeaver? How do I enable to see the connections?

@reya276 @crlsgms Are you sure your table have foreign keys? Check it on Fereign Keys tab of table editor. Maybe you are working with myisam database engine (which doesn't support relations).

@reya276 @crlsgms Are you sure your table have foreign keys? Check it on Fereign Keys tab of table editor. Maybe you are working with myisam database engine (which doesn't support relations).

Yes I'm looking at a wordpress database with an e-commerce store which have a bunch of tables with foreign keys. All or most tables are InnoDB not myisam.

@reya276 @crlsgms Are you sure your table have foreign keys? Check it on Fereign Keys tab of table editor. Maybe you are working with myisam database engine (which doesn't support relations).

Serge, I'm sure the application has foreign keys, they are just not displaying any lines / connections on the diagram
Is there any other information or test I can do to simulate this, so would be possible to troubleshoot on dbeaver?

Can you see your foreign keys in table editor?
Like here:

OK I will bite. I am evaluating DBeaver. I really like the ERD with related tables. I am learning a schema for a new product and this is useful. Earlier today DBeaver stopped pulling in Foreign Key information. It was pulling it in earlier, but now is not. I have an Oracle 9 database. I have connections for several Oracle databases and two DB2 databases. None seem to be returning Foreign Key information? I found a different issue from 2015 where a fresh install "fixed" this issue. Is there something I should try before that?


Works on LG K10 2017 (m250n) on Ubuntu 17.04, Python 2.7.13.

Looks like I was a bit too fast. lglaf works, but the shell doesn't accept a lot of commands. ls works, but cd doesn't, for example.

What does "not work" mean? Did you have to use --rawshell to workaround #24?

Thanks for merging my PR.
By "not work", I mean that cd does not descend to any subdirectory: cd data fails without giving any error message. I executed python3 lglaf.py --rawshell but that didn't change anything. I have a feeling that it's related to my problem, though.

Every command runs in a separate process, so in order to make cd work you will have to run for example:
cd dir && ls

(this is a limitation of LAF)

Thanks. That did the job.


UPLoad INformation Of My coin

Token Address
https://scan.tomochain.com/address/0xc7f08a11f571b38a402d77bc1e5a097d3561f239
Token Symbol
RSCOIN, RSC
Token Name
Rscoin
Token Logo

Token Description
RSCOIN is an open source, global payment network that is fully decentralized without any central authorities. Mathematics secures the network and empowers individuals to control their own finances. With substantial industry support, trade volume and liquidity,
Website
Coming Soon
Social links
Github::https://github.com/RSCOIN2020
Twitter::https://twitter.com/RSCOIN1
Telegram::https://t.me/RSCOIN1

@khaihkd support this case, thanks

done


remove the option to pass in the --no-preview-dart-2 flag to analysis

remove the option to pass in the --preview-dart-2 / --no-preview-dart-2 to flutter analyze

@a-siva

@gspencergoog, I have not created a PR in the new cirrus world - are the failures on the analyze and test-linux bots expected?

The analyze error looks like a bug in the whitespace detection script: it's got:
grep: : No such file or directory

Where the two colons indicate that it's looking for a file with an empty string as the filename.
You can safely ignore that one as long as you don't have trailing whitespace on any of the lines.  I'll look at why it's trying to do that...
As for the Linux failure, it looks like Cirrus just terminated that one: they had a problem with that yesterday, and it should be fixed.  I restarted that test to see if it would finish.

OK, I've looked into that analysis test, and I really don't see how it's failing the way it is: we explicitly filter out filenames that don't exist from the argument list before giving it to grep.
I thought maybe you were just a few commits behind on your master (before the fix to the whitespace check was committed), but you're up-to-date, so I'm left scratching my head... :-/

Looking at your repo some more, I think you should update to the latest master HEAD and try again: I wasn't able to run update-packages on your no_preview_dart_2_flag branch as it was (it failed version checks because it couldn't figure out the version of Flutter), but once I rebased it locally on top of a current master, it worked fine.

@a-siva, thanks for the review, and @gspencergoog, thanks for taking a look at the build. I've updated the PR and merged to master; fingers crossed for a green build.

Looking good.


CityBuild Road Bug Players Build on Road with No Permission

Issue description

Expected result: It is not good for random player to build a Random Road with blocks Griefing is Coming with that Problem.

Steps to reproduce the issue

... player go to the Road
... player on the Road placed a random Block on the Road

OS and versions

Plugin Version: 2.1.0
PocketMine-MP: 3.22.1
PHP: 7.4.13
Game version: PE/Win10

Other Plugins

If you remove all other plugins, does the issue still occur? No MyPlot cant be remove but i need it aktiv

Have you asked for help in the community discord before creating an issue?
Yes
Can you provide sample, minimal reproducing code for the issue? If so, paste it in the bottom section.
Player with no permission's can build on the Plot Rosds
i looked for where the bug comes i dont found this.

Console error, backtrace or other files
 No errors

Yellow Bug Area with Road Build Bug player can build on the Road
Red Main Plot Area

I can confirm this.

Fixed


Move source name away from SymbolGetter attribute

SymbolGetter is currently created with only a single source name readable, but making the source name a parameter for symbol lookup functions instead would be more flexible

This would allow for larger batching of disassembler operations


Missing sensors

Version of the moonraker integration
1.3.4
Describe your setup
Elegoo Neptune 4 Pro with Klipper Software
Describe the bug
Only 3 sensors visible. I used the Moonraker for a year without a problem and were able to draw graphs of temperature curves in Homeassistant. But after one of the last updates sensors were unavailable. I reinstalled Moonraker (multiple times) and can only see Fila, Thumbnail and Webcam.

Hey,
could you send me a full copy of your logs
once this is started. please reload your app

Not more information, but same here with exactly same configuration, i think is the 1.3.4 version problem.

if you need another log, just ask :)

yeah, I would need a log please @pinkfloydFR or @gimmel

@marcolivierarsenault do you still need a log? i can send you one but I dont want to post it here

Oopsy totaly forgot, will post it today, sorry !

@marcolivierarsenault do you still need a log? i can send you one but I dont want to post it here

Yes please send me via email.
<EMAIL_ADDRESS>

Same issue for me, rolled back to 1.3.3 and it works fine.

Can confirm issue is in 1.3.4. Reverting to 1.3.3 fixed my issue with neptune 4 plus not showing sensors

ok issue is info is None
 'print_stats': {'info': None, ...
Debug:
  File "/config/custom_components/moonraker/sensor.py", line 216, in <lambda>
    if "total_layer" in sensor.coordinator.data["status"]["print_stats"]["info"]
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: argument of type 'NoneType' is not iterable

we need to add a check for like data["status"]["print_stats"]["info"] is not None

Will likely fix in next 24h

Please upgrade to 1.3.5 and let me know if it fixes it?
Thanks

I've been having this issue for a couple of days. I just uninstalled completely and reinstalled (through HACS), I now have 1.3.5. I'm still seeing this issue. I'll send you my log via email.

I take that back, I just needed to restart - this is fixed for me with 1.3.5. Thank you!

sorry for delay, working here too, thk !

I’m just back from vacation and the problem is fixed. Thank you very much! It’s a great integration that I couldn’t live without.

Fine also for me, thank you for all the effort to get this fixed quickly.


Update single-page-applications.md

Add details to spa implementation, reference basic-spa-example
I found the instructions a bit sparse around the spa piece, I think these extra details would be helpful. Please review to make sure the instructions are correct here.

Rebase is a bit overkill for a single doc commit. I'll try to watch my words ;)


[WIP] 41 mocked typography

Fixes #41
Creator

[ ] Build relevant tests if any apply
[ ] Ensure there are no new warnings
[ ] Upload an animated GIF showcasing the solution (if it applies)
[ ] Set a relevant reviewer

Reviewer

[ ] Run test and make sure all tests pass
[ ] Review function and form on iOS
[ ] Review function and form on Android
[ ] Review function and form on Web
[ ] Review new test logic

I have good news and bad news. The good news is that I have most of this done. The bad news is that I'm blocked by finishing this completely until we lock down final font assets. For now everything is stubbed and mocked out. I'm not sure if the issues below make this blocked or if it's good for review but I'm going to flag it for an second pass as I know @conrad-vanl has looked at them before.
Issues
I still need to add a few props to BodyCopy and UIText to handle bold and italic but again these wont be all that useful until we sort out final font assets.
I also left the H1 component using the temporary theme font (open sans) as an example of the brokenness we have there.
Storybook chokes on the font files and this probably needs to be resolved. I think there are some solutions in this issue here.


use datetime.timezone.utc instead of django util

Fixes deprecation warning on Django 4.1:
RemovedInDjango50Warning: The django.utils.timezone.utc alias is deprecated. Please update your code to use datetime.timezone.utc instead.

Thank you very much! We'll create a new release soon.


Precompilation Abnormalities

cc @jlperla @Nosferican
It looks like the package sporadically precompiles when it shouldn't. For example, see http://compare-lectures.quantecon.org/jl/aiyagari.html#, by which point we've already run the activate_github() with the environment several times. (There's also a build error here, which may be worth investigating).
In my REPL, I also see
(v1.0) pkg> precompile
Precompiling project...
Precompiling Optim
[ Info: Recompiling stale cache file C:\Users\Arnav Sood\.julia\compiled\v1.0\Optim\R5uoh.ji for Optim [429524aa-4258-5aef-a3af-852621145aeb]
Precompiling PkgTemplates
[ Info: Recompiling stale cache file C:\Users\Arnav Sood\.julia\compiled\v1.0\PkgTemplates\IGiQL.ji for PkgTemplates [14b8a8f1-9102-5b29-a752-f990bacb7fe1]

julia> using QuantEcon
[ Info: Recompiling stale cache file C:\Users\Arnav Sood\.julia\compiled\v1.0\QuantEcon\V0Mv9.ji for QuantEcon [fcd29c91-0bd7-5a09-975d-7ac3f643a60c]

right after adding the package, which looks wrong (shouldn't it have precompiled on ] precompile?)
(Edit: This is on Julia v1.0.2)

Closing because of https://github.com/JuliaLang/Compat.jl/issues/636. which spontaneously cleared up. This is probably a Julia Pkg issue.


⚠ Samsung has degraded performance

In 8c80eb3, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2693 ms

Resolved: Samsung performance has improved in ea46b2c.


Compatibility: Expanded Traits

Weight cap becomes 55 with no traits added. Beast of Burden adds 10 lbs at 55 to make 65.

related: https://github.com/badonnthedeer/AnthroTraits/commit/ffb3804b23f4bbae5cbc930c06fc14aa349975b8

https://github.com/badonnthedeer/AnthroTraits/commit/a7fc70a79fbee2378ece8aba233efb2c0cda8bc8
Fixed for now. Closing until new issue is reported.


check for null queryString in handleSignatureRequest()

check for null queryString in handleSignatureRequest() before performing contains() check. In Tomcat 8, this value is null when the query string is empty (Ah Java how you love the NPE's...)

Nice catch. Thanks!


Add Swift/ObjC merging into terminal targets

Summary
Work towards https://github.com/MobileNativeFoundation/rules_xcodeproj/issues/1724. Add the ability to consider multiple merge sources possible for a single destination, representing the Swift/ObjC sandwich that is mixed language frameworks. Generally, only works with mixed-language terminal targets at this point.
Replacement for https://github.com/MobileNativeFoundation/rules_xcodeproj/pull/2058.

Replaced by https://github.com/MobileNativeFoundation/rules_xcodeproj/pull/2131.

Reopened to test CI, closing now.


[ZEPPELIN-5915]improve query efficiency

What is this PR for?
improve query efficiency:deal complex sql
Design Document: https://docs.google.com/document/d/1wruK0ZZ0XiriYOraFa5WYSz531pcsCpJeIBmne57fJY/edit?usp=sharing
What type of PR is it?
Improvement
Todos

[ ] - Task

What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-5915
How should this be tested?

CI

Questions:

Does the license files need to update? No
Is there breaking changes for older versions? No
Does this needs documentation? Yes

hi @Reamer @jongyoul @huage1994 ,could you help me to review this pr?

A few thoughts about your work:

All functionality is located in the JDBC interpreter. All new dependencies and classes should also be located there.
It seems that in case of a complex query you modify the dataset with the JDBC interpreter at the source. With your current implementation, the user is not aware of this right away.
You want to cache complex queries with an LRUCache. Depending on the size of the cache, queries may not be removed from the cache and the user may see stale data. I think a time based cache would be more appropriate here.
Have you ever heard of PreparedStatements?
At first view your configuration options are only JDBC interpreter configuration, therefore the configuration should be stored only in the JDBC interpreter and not as global ZeppelinConfiguration.

@Reamer  hi，firstly thanks for your advice
"All functionality is located in the JDBC interpreter. All new dependencies and classes should also be located there"---- it contains antlr4 ,and it also can be used in the feature in sql debug https://github.com/apache/zeppelin/pull/4598
but i am very sorry , the feature cost you  a lot of time ,but it can not be merged
if this feature of sql debug can be merge, the use of antlr can also be used in this feature.
'queries may not be removed from the cache and the user may see stale data' --- this is really a good question，it is i want to do in next step，i create temp table as the data, but if the origin data change or temp table very much ,it need to fix ,so i write the Design Document, the last step is to clean the temp table
https://docs.google.com/document/d/1wruK0ZZ0XiriYOraFa5WYSz531pcsCpJeIBmne57fJY/edit

A few thoughts about your work:

All functionality is located in the JDBC interpreter. All new dependencies and classes should also be located there.
It seems that in case of a complex query you modify the dataset with the JDBC interpreter at the source. With your current implementation, the user is not aware of this right away.
You want to cache complex queries with an LRUCache. Depending on the size of the cache, queries may not be removed from the cache and the user may see stale data. I think a time based cache would be more appropriate here.
Have you ever heard of PreparedStatements?
At first view your configuration options are only JDBC interpreter configuration, therefore the configuration should be stored only in the JDBC interpreter and not as global ZeppelinConfiguration.

and could you help me to continue complete the feature of sql debug  https://github.com/apache/zeppelin/pull/4598

A few thoughts about your work:

All functionality is located in the JDBC interpreter. All new dependencies and classes should also be located there.
It seems that in case of a complex query you modify the dataset with the JDBC interpreter at the source. With your current implementation, the user is not aware of this right away.
You want to cache complex queries with an LRUCache. Depending on the size of the cache, queries may not be removed from the cache and the user may see stale data. I think a time based cache would be more appropriate here.
Have you ever heard of PreparedStatements?
At first view your configuration options are only JDBC interpreter configuration, therefore the configuration should be stored only in the JDBC interpreter and not as global ZeppelinConfiguration.

and the data cache is really for hive like this large data database (not  for mysql), as we know ,complex hive sql have shuffle and reducer ,it cost a lot of time

Sorry for the late and short comment but how about making debug paragraph as a new interpreter? I mean, for instance, %jdbc.debug. Debugging jdbc paragraph itself is reasonable but I'm worried that this feature would be included in ZeppelinServer because this is only for jdbc interpreter and it won't work for other interpereters. WDYT?

and the data cache is really for hive like this large data database (not for mysql), as we know , hive sql will tranlate to mapreduce job， complex hive sql have shuffle and reducer ,it cost a lot of time

I agree that Zeppelin could help to reduce resource usage but I, as one of the maintainers, believe that we shouldn't change any user behaviors and mechanisms working as it is. Your approach might be better for some cases but it could have a kind of hidden steps and it could have another problem. If you would like to do it really, I believe that you can make your/your company's own interpreter. It can be merged into this repository but we, as reviewers, should consider not to make significant side effects with the highest priority.

and the data cache is really for hive like this large data database (not for mysql), as we know , hive sql will tranlate to mapreduce job， complex hive sql have shuffle and reducer ,it cost a lot of time

I agree that Zeppelin could help to reduce resource usage but I, as one of the maintainers, believe that we shouldn't change any user behaviors and mechanisms working as it is. Your approach might be better for some cases but it could have a kind of hidden steps and it could have another problem. If you would like to do it really, I believe that you can make your/your company's own interpreter. It can be merged into this repository but we, as reviewers, should consider not to make significant side effects with the highest priority.

ok, thanks for your advice, and could you help to review this pr of sql debug, https://github.com/apache/zeppelin/pull/4598
is it suitable?


Trouble finding where the application is pointing the redirects.

When I access the application it redirects me to draw.html. I was trying to find the file where I can change it to redirect to a draw.php file and add php to the application's webpage.

fml these issues..  what the fsk is going on?!  too much dumbness.


Cosmos DB - Cannot set an offer throughput on an existing container that uses the database shared throughput

If a container has not had it's throughput set before (i.e. we are using the DB shared throughput), and you try to call az cosmosdb collection update  to set a throughput on that container. The method will fail with the following error:
Cannot find offer for collection X
This looks like it was possible using the older .NET SDK per this example: https://github.com/markjbrown/cosmosdb-offers/blob/master/ChangeOfferNetCore/Program.cs
If we should be using a different method to set a throughput on an existing container for this case, please let me know.
Thanks

I just verified that the example provided does not work.  There is an error since the query for an offer returns null.  The question is, can we only set throughput on a container at creation?  There seems to be some confusion on this.

We also have this ticket open with the SDK team.  https://github.com/Azure/azure-cosmos-dotnet-v3/issues/82

Hi @ajk2018, I am looking into your question. I will post an update when I find out more.

Currently, with the database shared throughput model, you cannot switch between throughput provisioned at a database level or at a collection level. You can only select shared throughput or collection level the first time you provision either.
If you want to be able to update throughput at a collection level, you will need to specify dedicated throughput for that collection when it is provisioned under the database with shared throughput enabled.


Less keys processed/returned when using MR [JIRA: CLIENTS-134]

Third bug report in two days: I'll promise I'll stop for a while, as tomorrow I'll undergo surgery :)
I've put the code in this gist to ease the flow.
The problem is twofold:
In python_code1.py, I try to process 40 keys, and I get the traceback in the python_tb1.py file.
If I lower the number of keys (python_code2.py), I get the results, but I have less keys (15) instead of the 27 unique keys that I fed to the MR code.
Anybody has a clue?

Looks like your final reduce function has no clause that matches its given arguments (that's the meaning of function_clause).  You can also directly feed searches directly into mapreduce.

@seancribbs I'll look into the clause stuff.
BTW, feeding searches doesn't seem to work either, see https://github.com/basho/riak-python-client/issues/393

@gglanzani Thanks, we'll look into it.

@gglanzani @seancribbs
In fact the search feeding problem is more general: https://github.com/basho/riak/issues/618
It happens outside python client.

Ok, I think this can be closed. I think it's an issue of mochijson2 version 4.x because when I try the same query on my machine (mochijson2 version 5.x), I don't get the function_clause problem.

The associated GitHub issue was closed.
[posted via JIRA by Derek Somogyi]


Do you have a plan for this to be isormorphic or universal?

This is the boilerplate I'm looking for.
But I need more one thing, "isomorphic" or "universal".
Do you have a plan for support this feature?

Sorry, no plans. That said, there are many alternatives out there with it built in. http://andrewhfarmer.com/starter-project/


Client to Server Message?

Why we dont have a feature for client->server message on a channel?

There currently isn't any support for sending data from the client to the server. Only Sever -> Client and Client -> Client. If there is a good use case for this please follow up with some details. But for most cases, it seems like pushing data to your server first is the normal pattern in terms of authentication, validation, and hitting the database if necessary.
Closing for now.


cabal build all fails

OS
Your OS: Ubuntu 18.04.6 LTS
Versions
The db-sync version (eg cardano-db-sync --version): 12.0.2
PostgreSQL version:
Build/Install Method
The method you use to build or install cardano-db-sync:
# checkout the latest release (currently 12.0.2) of db-sync
git checkout $(curl -s https://api.github.com/repos/input-output-hk/cardano-db-sync/releases/latest | jq -r .tag_name)

# cherry pick the following 2 commits (using -n to avoid auto committing into local git repo)

# grabs change to Genesis.hs
git cherry-pick -n bff6e182cf41f6f7a9ff3d08bb1fc9984e2d0f66

# grabs change to Block.hs
git cherry-pick -n 132f569bcd297ce73bca407a52acee513aa75389

cabal update
cabal build all

Problem Report
Warning: Requested index-state 2021-07-02T00:00:00Z is newer than
'hackage.haskell.org'! Falling back to older state (2021-07-01T22:06:28Z).
Resolving dependencies...
cabal: Could not resolve dependencies:
[__0] trying: Win32-network-<IP_ADDRESS> (user goal)
[__1] trying: base-<IP_ADDRESS>/installed-<IP_ADDRESS> (dependency of Win32-network)
[__2] trying: byron-spec-chain-<IP_ADDRESS> (user goal)
[__3] trying: microlens-th-<IP_ADDRESS> (dependency of byron-spec-chain)
[__4] trying: template-haskell-<IP_ADDRESS>/installed-<IP_ADDRESS> (dependency of
microlens-th)
[__5] trying: pretty-<IP_ADDRESS>/installed-<IP_ADDRESS> (dependency of
template-haskell)
[__6] trying: hedgehog-1.0.5 (dependency of byron-spec-chain)
[__7] trying: time-1.9.3/installed-1.9.3 (dependency of hedgehog)
[__8] trying: text-<IP_ADDRESS>/installed-<IP_ADDRESS> (dependency of hedgehog)
[__9] trying: cardano-api-1.31.0 (user goal)
[_10] trying: scientific-<IP_ADDRESS> (dependency of cardano-api)
[_11] trying: aeson-<IP_ADDRESS> (dependency of cardano-api)
[_12] trying: cardano-db-12.0.2 (user goal)
[_13] trying: postgresql-simple-0.6.4 (dependency of cardano-db)
[_14] trying: postgresql-libpq-<IP_ADDRESS> (dependency of postgresql-simple)
[_15] rejecting: postgresql-libpq:-use-pkg-config (constraint from config
package libpq>=9.3, not found in the pkg-config database)
[_15] fail (backjumping, conflict set: postgresql-libpq,
postgresql-libpq:use-pkg-config)
After searching the rest of the dependency tree exhaustively, these were the
goals I've had most trouble fulfilling: postgresql-simple, base,
postgresql-libpq, aeson, text, time, postgresql-libpq:use-pkg-config,
scientific, cardano-db, cardano-api, hedgehog, pretty, template-haskell,
byron-spec-chain, microlens-th, Win32-network
Try running with --minimize-conflict-set to improve the error message.

What versions of ghc and cabal are you using?

I am using the same versions of cabal and ghc .
I ran the commands (on a Debian testing system):
cd /tmp/
git clone https://github.com/input-output-hk/cardano-db-sync
cd cardano-db-sync/
git checkout $(curl -s https://api.github.com/repos/input-output-hk/cardano-db-sync/releases/latest | jq -r .tag_name)
git cherry-pick -n bff6e182cf41f6f7a9ff3d08bb1fc9984e2d0f66
git cherry-pick -n 132f569bcd297ce73bca407a52acee513aa75389
cabal update
cabal build all

and it starts building. I have no idea what is wrong on you system. I will however note that Ubuntu 18.04.6 LTS is a rather old Ubuntu release. Have you tried using a newer LTC release?

Ok that's good to know - I will get 20.04 LTS and reconfirm soon

:facepalm: I didn't notice this earlier:
[_15] rejecting: postgresql-libpq:-use-pkg-config (constraint from config
package libpq>=9.3, not found in the pkg-config database)
[_15] fail (backjumping, conflict set: postgresql-libpq,

You need to sudo apt install libpq-dev.

Ahh ok - sudo apt install pkg-config libpq-dev works!


2.8 / 3.0 Compatibily ?

List of TODOs for ~2.8|~3.0 compatibility:

[x] Twig SettingExtension deprecations
[ ] Decide on bumping framework-bundle from 2.3 LTS to 2.6 or 2.7 LTS
[ ] Service definition factory method #62
[ ] FormType::getName, FormType::setDefaultOptions, buildForm via FormType FQCN

@dmishh the factory_method is deprecated, so hope that can be fixed.

Can you provide a TODO on what to be done before this issue is resolved?

@Nyholm added TODO list to issue description

I've created #71, #72 and #73


[feature] support Public Key Authentication

I like shellhub user interface and the design.
Could you add support Public Key Authentication?
Thank you.

Thank you for reporting this issue; we intend to add support for key authentication in future but for now we are focusing on more basic stuff and polishing the code base.

Can we already use pub key auth with 3d party clients like putty? Is this just a website limitation?

Not yet. We are still working on more basic functionality.

This functionality is a must have 😇
Hope to see this coming!

@otavio if we store the public key on the web site, let users manage their keys like keys on github.
It could avoid keys store on the agent container and avoid agent container to access hosts files.

@shawn111 good idea :-D thanks for sharing it.

Hello @shawn111 @jwillmer @AntoinedeChassey , the feature will be available in next release. Thanks for your patience.

Hello @shawn111 @jwillmer @AntoinedeChassey , the feature will be available in next release. Thanks for your patience.

Great project folks!
Hope to see ssh key authentication added soon, it is a must have functionality


Facebook does not work counter

Good afternoon!
By clicking on the Facebook post on a social network button appears, but the counter is not changing. What could be the problem? Website - https://armymusic.ru

That’s a desired behavior. You can update counters manually: https://github.com/sapegin/social-likes#popup_closedsocial-likes

The problem is not the fact that after pressing the button does not change the value of the counter, and that it does not work for the Facebook button. On the other counters all right.

https://github.com/sapegin/social-likes#counters-dont-work

API requests results in Network tab in your browser’s developer tools -

see screenshot

If you report a bug make sure you use the latest version: this was fixed four months ago.


Is there any way to generate copy button when using  rehype-highlight-code-block ?

Is there any way to generate copy button when using  rehype-highlight-code-block ?

All of this happens “server side”. Copy buttons need client side JS anyway, and can’t work without JS. So it’s better to solve it on your side that trying to add that here.

Thank you
but after the html generated,It is really difficult to change the structure and The code block also mix with html tags.
To implement this function on client side is to hard。
I use nextjs to build my website,and rehype to render markdown contents.
Is there any way to solve this problem?

There are tons of ways to solve this.
But I don’t believe it’s not something for this project, as I mentioned before.
If you use rehype, you can write a plugin.
I don’t see why it’s hard to change HTML after this plugin. The code blocks are still there. You can append into them. Either with a rehype plugin, or with client-side JavaScript (which is a good place for buttons that only do client-side JavaScript-things!)

@wooorm ,ok


Lag/issue when deleting flags

Christin noticed that in the NWC collection, when she deletes the value in the flag note area, she is not able to move to another object in the collection. When I tried to replicate this problem in a test collection of 3 items, I was able to do it without a problem. I'm wondering if this is an issue because of the size of the collection? It works fine if she clicks on the "x" to close the note, but if she deletes the note content, the flag goes away in the lefthand area, but she can't go into another object.

@amgaynor If you are needing to remove a flag, use the 'x'. When that happens can to go to 'View' -> 'Developer' -> 'Toggle Developer Tools' and post a screen cap of that window.

This is what appears on the error screen. Not sure if this is what you wanted.

This problem comes up because Brays is being packaged while still in developer mode and it likes to do more checks than needed for production code. I've fixed this for future versions, so this won't be an issue.
Until then if you want to remove a flag, use the 'x' button to remove.


[Feature] Add Nx target to lint code with Checkstyle

Is your feature request related to a problem? Please describe
This feature is not related to a problem.
Describe the idea you'd like
Checkstyle is a widely adopted solution to lint Java code. It is part of the Maven CLI and can be executed with mvn checkstyle:check or ./mvnw checkstyle:check. I'm currently integrating Checkstyle to my Nx workspace with the method described below. It would be great if this Nx plugin implemented a target, e.g. named @nxrocks/nx-spring-boot:lint, to lint a project. The goal would be to enable the user to lint project with this Nx plugin without having to manually setup Checkstyle as described below.
Describe alternatives you've considered
Here is how I currently integrate Checkstyle with my Nx workspace.

Add a Checksum configuration file in the root directly of the Nx workspace. I picked the default configuration file google_checks.xml used by Google. When not specifying any configuration file to Checksum, it uses its internal Sun configuration. Both Google and Sun configuration files can be found here.
Add the following target to a project:

    "lint": {
      "executor": "@nrwl/workspace:run-commands",
      "options": {
        "command": "./mvnw checkstyle:check",
        "cwd": "apps/challenge-core-service"
      }
    },

Add the following section to pom.xml to enable the update of Checkstyle at runtime. The current version is 10.3. Without this section, an older version of Checkstyle will run with the mvnw script provided by this GitHub repo.

  <build>
    <pluginManagement>
      <plugins>
        <plugin>
          <groupId>org.apache.maven.plugins</groupId>
          <artifactId>maven-checkstyle-plugin</artifactId>
          <version>3.1.2</version>
          <dependencies>
            <dependency>
              <groupId>com.puppycrawl.tools</groupId>
              <artifactId>checkstyle</artifactId>
              <version>10.3</version>
            </dependency>
          </dependencies>
        </plugin>
      </plugins>
    </pluginManagement>
  </build>

Specify the location of the configuration file in pom.xml.

	<properties>
          <checkstyle.config.location>${basedir}/../../checkstyle.xml</checkstyle.config.location>
	</properties>

Additional context

The plugin should enable the user to place the Checkstyle configuration file outside of the project that uses it, e.g. in the root directory of the Nx workspace for the sake of keeping the code DRY. Hence, the plugin should allow the user to specify the location of the Checkstyle configuration file.
Do not make the assumption that all projects are included directly in the folders apps/ and libs/, e.g. when reading the Checkstyle configuration file. For example, in my workspace I have a project in libs/shared/data-access-x that is shared between multiple projects. I have seen this project structure in workspaces created by others too.

Thanks!

Hi @tinesoft,
I appreciate how your plugin helped me to start developing Spring Boot apps inside with Nx. :-)
I will play with Spotless and let you know. Right now I'm battling an issue related to importing a lib in an app (see upcoming comment to #71).


Problem with legend on transition diagram

Dear all,
I met a problem with a legend on the transition diagram for a single type of defect. The legend doesn't match calculations, i.e. when number of energy lines  in the picture is increasing the legend stop to work correctly. Please, take a look at attached pictures for defects in Mg2Sn. Is there any way to fix it? Thank you.
cheers
wojtek

Hi wojtek,
Thanks for reporting this! We also found this minor bug a little while ago and have fixed it on the develop branch -- which will be merged to main with a new release soon. You can install this with pip install https://github.com/SMTG-Bham/doped/archive/develop.zip, or with git clone etc for the developer installation.
Thanks!

Dear Sean,
thank you.
cheers
wojtek


How can I get the joint_state?

I just run the moveit_planning_execution.launch and it runs successfully in moving and planning, with connected rqt graph. However, I just build a new python node to subscribe the topic /joint_state, I just always get the empty information, such as position: [0,...,0], velocity: [], effort: []. Can you provide any information?
Also, actually I want to measure the force and torque for the each joint. I just find a way by using current value, joint and joint velocity. Can you give any suggestions about this? (better way, or how can I get the current value).
Thanks very much.

Ok
first,  the correct topic name is: /joint_states
second,currently, AUBO drivers do not provide information about forces and torque

Ok @qw2261
first, the correct topic name is: /joint_states
second,currently, AUBO drivers do not provide information about forces and torque


Controller Inverters are broken

Describe the bug
Controlled inverters fail to update values beyond one line away.
To Reproduce
Steps to reproduce the behaviour:

Place a controlled inverter
Set Enable to 1
Set Enable to 0
Observe how all the nodes do not update their value, despite the wire updating its value

Expected behavior
The behaviour is similar to that of tristates
Screenshots

Device Information [optional]:

OS: Windows
Browser: chrome

Are you working on this issue? No

@gr455 are you still working on this issue or i can take this up ,
i am not getting what's this draft tag on your pull request means

@Palaksharma23 Draft tag just means that the PR is not ready yet. However, I do think this should fix the error. Can you test and review this PR? That would be really helpful


Planner not starts tasks

Impress and Node.js versions
16.15.0
Platform
macos
Describe the bug
After starting of an app, a tasks is not added to:
constructor() {
    this.tasks = new Map();
}

After manual add new tasks, start does not schedule, because no tasks in this.tasks
but .json files has been created
To Reproduce
In Example do:
// lib / task1 / start.js
await application.scheduler.add({
        name: 'name',
        every: '5s',
        args: { i: 2 },
        run: 'lib.task1.f1',
      });

// lib / task1 / f1.js
async (args) => {
  console.debug('lib.task1.f1', args);
  await metarhia.metautil.delay(1000);
};

Expected behavior
No response
Screenshots
No response
Additional context
No response

Done in #1780 and #1781


Integration tests for Tensorflow Seldon servers

Description
Integration tests for Tensorflow Seldon severs are required to validate that Seldon Deployment will be successful.
Integration tests for these servers should be a part of Seldon integration tests suite and run on every PR.
These tests will be reused in ROCKs testing.
The following Tesnorflow prepackaged Seldon servers should be covered in test:
        "TENSORFLOW_SERVER": {
          "protocols" : {
            "tensorflow": {
              "image": "tensorflow/serving",
              "defaultImageVersion": "2.1.0"
              },
            "seldon": {
              "image": "seldonio/tfserving-proxy",
              "defaultImageVersion": "1.15.0"
              }
            }
        },

Design
Use pamatetirized tests to execute same test for different Seldon servers.
To test use specified test deployments from:

https://docs.seldon.io/projects/seldon-core/en/latest/examples/server_examples.html#Serve-Tensorflow-MNIST-Model
https://docs.seldon.io/projects/seldon-core/en/latest/examples/server_examples.html#Serve-Tensorflow-MNIST-Model-with-Seldon-Protocol
https://docs.seldon.io/projects/seldon-core/en/latest/examples/server_examples.html#Serve-Tensorflow-Model-with-Tensorflow-protocol

For seldon protocol, server container image in test response data is updated based on deployed seldon-config ConfigMap. This ensures that test response data contains properm image and version.
For one of the Tensorflow tests request and response data are relatively large. That data is stored in files and common paramterized test is modified to be able to read data from file (JSON) or use it as is (JSON object).
Eg.:
    # prepare request data:
    # - if it is string, load it from file specified in by that string
    # - otherwise use it as JSON object
    if isinstance(request_data, str):
        # response test data contains file with JSON data
        with open(f"tests/data/{request_data}") as f:
            request_data = json.load(f)

For mlflowserver test ephemeral-sorage=2G requirement/limit needs to be added to ensure it runs in GH runner.
Testing
Integration testing should pass when implemented.

Merged. Closing.


Fix declaration file incremental tests

I found a whole slew of problems. This fixes most of them and makes travis happy again. The fixes include

Avoid using SSet.of_list (this exposed the fact that our travis linux builds don't actually test with the right version of ocaml. I have a fix ready for that separately).
There seem to be some connection issues that are reproing on travis OSX builds. On OSX /tmp is a symlink to /private/tmp, so all files that go in there need to be properly normalized between the client and the server. It turns out that files that don't exist yet weren't being normalized. The fix is to normalize the directory which will exist.
One of the tests has mistakes in which .js files it was moving and where
There as an actual bug in the declaration file code. When using haste, if foo.js @providesModule Foo, but foo.js.flow doesn't have an @providesModule, then foo.js.flow will look at foo.js to infer which module it provides. This means when foo.js changes we need to recheck foo.js.flow. For now I made it so that declaration files are always rechecked when the implementation files change.

@facebook-github-bot shipit

I accidentally hit the merge button and merged this directly. I force rolled back quickly so hopefully no one is disrupted. I'll send a new PR and merge it properly.


Guild operation main in subdirectory not working on remote

Guild complains that it cannot find the file operations/prepare.py but it works if I move the file to the "root".
Successfully installed road-segmentation-package-0.0.0
Starting unet-r1:prepare on vast as 24fba4d41aff41adb585292fb0c9b5ba
WARNING: cannot import flags from operations/evaluate: No module named operations/evaluate
WARNING: cannot import flags from operations/prepare: No module named operations/prepare
WARNING: cannot import flags from operations/train: No module named operations/train
WARNING: cannot import flags from operations/search_lr: No module named operations/search_lr
WARNING: cannot import flags from operations/train: No module named operations/train
guild: No module named prepare

If I add an __init__.py file to the operations folder then I get another error message
WARNING: cannot import flags from /root/.guild/runs/532c78ae6946443f9127f98f4c0a3a39/.guild/job-packages/road_segmentation_package/operations/train.py: Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/opt/conda/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/opt/conda/lib/python3.7/site-packages/guild/plugins/import_argparse_flags_main.py", line 157, in <module>
    main()
  File "/opt/conda/lib/python3.7/site-packages/guild/plugins/import_argparse_flags_main.py", line 48, in main
    _exec_module(args.mod_path, args.package)
  File "/opt/conda/lib/python3.7/site-packages/guild/plugins/import_argparse_flags_main.py", line 147, in _exec_module
    python_util.exec_script(mod_path, mod_name=_exec_mod_name(package))
  File "/opt/conda/lib/python3.7/site-packages/guild/python_util.py", line 387, in exec_script
    exec(code, script_globals)
  File "/root/.guild/runs/532c78ae6946443f9127f98f4c0a3a39/.guild/job-packages/road_segmentation_package/operations/train.py", line 14, in <module>
    from road_segmentation import train
ModuleNotFoundError: No module named 'road_segmentation'

I can't change to a relative import because the root directory does not have an __init__.py
ImportError: attempted relative import with no known parent package

guild.yml
- package: road-segmentation-package

- model: unet-r1
  sourcecode:
    - '*.py'
    - 'operations/*.py'
    - guild.yml
    - exclude:
        dir:
          - input
          - tb
          - checkpoints
  operations:
    prepare:
      main: operations/prepare
      flags-import: all
      output-scalars: off

This works if you add the root path to the python path

I created an resolution doc to illustrate the issues here.
https://github.com/guildai/issue-resolution/tree/master/246-guild-operation-main-in-subdirectory-not-working-on-remote
TLDR; Use operations.prepare for your main spec. Be certain that operations/__init__.py to make the dir a Python package.

Thank you!

@gar1t Suggestion: Could add a warning or error if a user defined a main spec with a slash / and suggest using a dot?
main: operations.prepare

The spec operations/prepare is entirely legit. It just means something different. This is how you specify the start of the Python source path for a module. The example shows how you can use this form - it's quite common.

I feel like this could be a linting topic. Guild could scan a project and detect this condition. But that's a pretty expensive test as Guild would need to examine the main module to see how it's importing other modules.

Okay I see. I think that detecting the project strutcture sounds like overkill


Dart native implementation

I would love to see Dart native implementation to implement it in CyBear Jinni smart home.

@guyluz11 do you mean integrating Matter SDK in CyBear Flutter app? Have you tried implementing this SDK in the flutter project?

Not yet but it is something I would love to contribute to

That sounds awesome! You can get started by reading the Matter Documentation here.
You will also need:

A Google Nest Hub for facilitating local connectivity.
A matter-enabled device, or a virtual Matter device.

The above-cited code for Android only works for Reading Boolean values the last time I checked. So we still need to write methods to support other data types, as well as functions to send device actions to the hub.

Thanks for the info.
I would like to make this package behave as number 1, sending the matter devices requests and asking for info and states listening for changes and sending set state requests.


Integrate WebRTC with RESTful API for Milestone XProtect VMS

This pull request adds a WebRTC module to the Milestone XProtect VMS by integrating it with RESTful API services for authentication, session creation, and session updates. The integration aims to streamline the process of establishing a WebRTC connection with an XProtect VMS via the API Gateway. This implementation adheres to the architectural principles outlined in the Milestone SDK WebRTC JavaScript Sample.

I've noticed that the video is visible but the timestamp I receive is not correct. I'm not sure if this stems from a bug in the Milestone server. It appears to be 100 times smaller than it should be, and needs to be multiplied by a factor. The API includes a video speed factor, but it seems to only pertain to playback and not to live streaming. Is this correct, or am I missing a time factor/time scale somewhere that I haven't noticed in the stream negotiation?
diff --git a/internal/webrtc/milestone.go b/internal/webrtc/milestone.go
index f63f49e..947183d 100644
--- a/internal/webrtc/milestone.go
+++ b/internal/webrtc/milestone.go
@@ -229,6 +229,7 @@ func milestoneClient(rawURL string, query url.Values, desc string) (core.Produce
        prod := webrtc.NewConn(mc.PeerConnection)
        prod.Desc = "WebRTC/OpenIPC"
        prod.Mode = core.ModeActiveProducer
+       prod.TimeSpeed = 100

        resp, err := createWebRTCSession(mc, details)
        if err != nil {
diff --git a/pkg/webrtc/conn.go b/pkg/webrtc/conn.go
index 6483535..053da5b 100644
--- a/pkg/webrtc/conn.go
+++ b/pkg/webrtc/conn.go
@@ -15,6 +15,7 @@ type Conn struct {
        UserAgent string
        Desc      string
        Mode      core.Mode
+       TimeSpeed float32

        pc *webrtc.PeerConnection

@@ -99,6 +100,10 @@ func NewConn(pc *webrtc.PeerConnection) *Conn {
                                return
                        }

+                       if c.TimeSpeed != 0 {
+                               packet.Timestamp = uint32(float32(packet.Timestamp) * c.TimeSpeed)
+                       }
+
                        if len(packet.Payload) == 0 {
                                continue
                        }

I have made big code refactoring for your PR. I hope nothing breaks, because I can't test this code.

I don't know about timespeed. Maybe some problems on milestone side. Because there is no problems with all other clients.

https://github.com/AlexxIT/go2rtc/releases/tag/v1.9.0


Create snake_case file if linter is Pylint

Summary
The add_rule.py script would create a test case that pointed to a file that didn't exist when the linter is set to "pylint". This PR fixes that.
Test Plan
python scripts/add_rule.py --name DoTheThing --prefix PL --code C0999 --linter pylint

Thx.


Amazon Linux 2023 Support

Is it feasible or possible to add support for Amazon Linux 2023 to this playbook? Thanks

No problem. Appreciate the reply.
Many thanks.


Abnormally long run time?

Bug/Feature Request Title
Abnormally long expected run time. The estimate keep climbing! And progress remains 0.
I ran on Windows 10 and featuretools 0.10.1
I was just following along this tutorial https://github.com/Featuretools/predict-loan-repayment/blob/master/Automated Loan Repayment.ipynb
except I couldn't get this line to run
#default_trans_primitives =  ["day", "year", "month", "weekday", "haversine", "numwords", "characters"]

so I dropped two primitives
#default_trans_primitives =  ["day", "year", "month", "weekday", "haversine"]

Bug/Feature Request Description
I was just following along this tutorial https://github.com/Featuretools/predict-loan-repayment/blob/master/Automated Loan Repayment.ipynb
Expected Output
Within the hour
Output of featuretools.show_info()
Elapsed: 19:46 | Progress:   0%|          | Remaining: 899:20:03

FWIW, this is what I see just before the Elapsed: ...
uilt 2188 features
Total size of entityset: 11.28767 gb.
Total number of cpus detected: 12.
Total size of system memory: 68.67001 gb.
Built 2188 features
Elapsed: 02:33 | Progress:   0%|

This is a large dataset where you are calculating many features. The best approach for speeding it up would be to follow the instructions in this article about using Dask + Featuretools. We have an example notebook for using dask with this exact dataset here.


Add ignore-prefix for no-expression-statement. Fix #39

A first stab at this. Happy for any pointers and further discussion.

Could you also change the relevant parts of the readme to indicate that the ignore-prefix option is supported in no-expression-statement rule?

@jonaskello Done!

Thanks :-).

Now released in 4.2.0.


[AMBARI-23748] - Logout button does not navigate user to login/logged out page

Logout button does not navigate user to login/logged out page
What changes were proposed in this pull request?
Added LoginScreenGuard and the AuthService is more sophisticated now. So when the user logged in it will redirect to the URL from where the user arrived to the login screen or if it is not presented then the root/default route.
When the user is logged out it will redirect to the login page.
How was this patch tested?
Manually and unit tests.
Please review Ambari Contributing Guide before opening a pull request.
@aBabiichuk please review it. Thanks

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/2118/
Test PASSed.


Disable internal logging

Use case
Our application writes a lot of info into logs, but the library produces some info logs too, that is redundant for us.
For sure, we can somehow filter messages produced by the library.
Proposal
Implement enabling/disabling logging for the library or make library log level configurable (i.e. write only errors)
If idea makes sense - I can submit PR
Thank you

Hi @dmytrohridin, would it be possible to just disable it with logging configuration like this:
{
  "Logging": {
    "LogLevel": {
      /* ... */
      "CorrelationId": "Error"
    }
  },
  "AllowedHosts": "*"
}

... this will keep logging errors (currently only when correlation ID is not configured), or you can set value to None.

@wdolek I tried in this way, but it's not working (I use Serilog)

@dmytrohridin I haven't used Serilog much yet, but this looks like configuration which could help (Serilog 2.1+):
Log.Logger = new LoggerConfiguration()
    // ...
    .MinimumLevel.Override("CorrelationId", LogEventLevel.Error);

... or there may be other ways of filtering. I can understand that adding bool flag would be the easiest for user though.

@wdolek nice idea, will try, thank you

it works, thank you, will close issue

Thanks for providing the solution @wdolek!


Gkrizek/stateless init

Pull Request Checklist

[ ] If this is your first time contributing, we recommend you read the Code
Contribution Guidelines
[ ] All changes are Go version 1.12 compliant
[ ] The code being submitted is commented according to Code Documentation and Commenting
[ ] For new code: Code is accompanied by tests which exercise both
the positive and negative (error paths) conditions (if applicable)
[ ] For bug fixes: Code is accompanied by new tests which trigger
the bug being fixed to prevent regressions
[ ] Any new logging statements use an appropriate subsystem and
logging level
[ ] Code has been formatted with go fmt
[ ] Protobuf files (lnrpc/**/*.proto) have been formatted with
make rpc-format and compiled with make rpc
[ ] For code and documentation: lines are wrapped at 80 characters
(the tab character should be counted as 8 characters, not 4, as some IDEs do
per default)
[ ] Running make check does not fail any tests
[ ] Running go vet does not report any issues
[ ] Running make lint does not report any new issues that did not
already exist
[ ] All commits build properly and pass tests. Only in exceptional
cases it can be justifiable to violate this condition. In that case, the
reason should be stated in the commit message.
[ ] Commits have a logical structure according to Ideal Git Commit Structure

Apologies, meant to be into my own fork. Disregard.


Identity attribute for commands

Right now, in the app service, we explain how to get the aggregate id from a command:
OnNewAsync<V1.CreateTask>(
    cmd => new ProjectTaskId(cmd.TaskId),
    async (task, cmd, token) => { ... }
)

It seems a bit too verbose. We know the drill - the identity must be a non-empty string value. So, in theory, it can be simplified to use an attribute:
public record CreateTask([AggregateId] string TaskId, string Description);

The app service overloads without the first function would be able to check if the property is of type string on startup, ensure that it's not empty when it gets the command, and construct the identity instance of a given type as it has a default constructor. So, the call would look like:
OnNewAsync<V1.CreateTask>(
    async (task, cmd, token) => { ... }
)

I'd rather implement #153 and make things more explicit