NIFI-5388: enabled EL support for dynamic properties of Kafka 1.0 processors

Thank you for submitting a contribution to Apache NiFi.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[x] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?

[x] Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[x] Has your PR been rebased against the latest commit within the target branch (typically master)?

[x] Is your initial contribution a single, squashed commit?

For code changes:

[x] Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
[ ] Have you written or updated unit tests to verify your changes?

Started writing unit tests but it seemed trivial validating that the properties have EL support enabled. I will attach a video to the JIRA ticket of me verifying expected behavior for the Kafka consumer.

[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
[ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
[ ] If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

[x] Have you ensured that format looks appropriate for the output in which it is rendered?

Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and submit an update to your PR as soon as possible.

@zenfenan the consumer one has input forbidden on it, so you won't get flowfiles there. For the publisher, my guess is it's probably being conservative about reconfiguring the producers, which isn't a bad call IMO.


Firebase Migrations Prep

Moves the class info request before the FB JWT request, so that the class hash is sent to the Portal to get added to the claims.

@kswenson After our discussion today I added another commit to this branch which adds the fields necessary for testing migrations while keeping them safely mergeable.

Added a third commit here with code and instructions for running a migration, also part of the "steady state" of the app.


fix documentation: use 'execute' instead of 'run'

this patch fixes the usage description: currently it states that 'run' is a valid command. It should be 'execute'.

plz increase the version in the csproj as well

I think you have to merge with main again because the pipeline is not the new one. I'm currently fighting with the CD pipeline not beeing able to use the Nuget secret when under PR context. So I have to ask you for merges. Sorry about that and btw thanks or your efforts!


Linux trying to use CoreGraphics

I'm new to this repo. Looks like either: some stuff is compiling for linux that shouldn't be, or some things that should compile are using Mac-specific types
❯ swift build
Building for debugging...
/home/arckex/SwiftVVD/Sources/DKGUI/Views/Gesture/ButtonGesture.swift:36:19: error: cannot find type 'CGPoint' in scope
    var location: CGPoint
                  ^~~~~~~
/home/arckex/SwiftVVD/Sources/DKGUI/Views/Gesture/ButtonGesture.swift:57:65: error: cannot find type 'CGPoint' in scope
    override func began(deviceID: Int, buttonID: Int, location: CGPoint) {
                                                                ^~~~~~~
/home/arckex/SwiftVVD/Sources/DKGUI/Views/Gesture/ButtonGesture.swift:57:19: error: method does not override any method from its superclass
    override func began(deviceID: Int, buttonID: Int, location: CGPoint) {
    ~~~~~~~~      ^
/home/arckex/SwiftVVD/Sources/DKGUI/Views/Gesture/ButtonGesture.swift:68:65: error: cannot find type 'CGPoint' in scope
    override func moved(deviceID: Int, buttonID: Int, location: CGPoint) {
                                                                ^~~~~~~
/home/arckex/SwiftVVD/Sources/DKGUI/Views/Gesture/ButtonGesture.swift:68:19: error: method does not override any method from its superclass
    override func moved(deviceID: Int, buttonID: Int, location: CGPoint) {
    ~~~~~~~~      ^
/home/arckex/SwiftVVD/Sources/DKGUI/Views/Gesture/ButtonGesture.swift:41:26: error: cannot infer contextual base in reference to member 'zero'
        self.location = .zero
                        ~^~~~

CG-Types are located in Foundation on non-Apple systems.
I fixed this issue by type aliasing CG-Types locally to make them available without importing CoreGraphihcs or Foundation.
It should build correctly now. If you have any other issues, feel free to let me know.


❓  Persistent Service Webhooks

🧑🤝🧑 Meta
Before you start, we need a little bit more information from you:
Use Case (delete as appropriate): Using Portainer at Home
Have you reviewed our technical documentation and knowledge base? Yes

❓ Question:
Is there a way to make the Service Webhooks persistent?
When I'm performing maintenance work on my Docker Swarm based lab, I use the following scenario, which leads into disabled service hooks:

Stopping existing / running workload stacks via portainer
removing basic stacks from cli like portianer, traefik
performing the maintenance work
redeploy the basic traefik and portainer stacks via docker stack deploy -c portainer.yml portainer
Starting the stopped workload stacks/services

So now all the previously activated service webhooks are disabled.

Hi, can you describe why you're actually removing stacks, including Portainer, and then try to reinstate your setup?

I try to minimize the risk of corrupting the underlying nfs volumes. It's because I want to make sure the docker daemon doesn't try to mount the remote volumes when I have to take take down the nfs server, too.
The complete environment looks like this:
[ 2x HAproxy + Keepalived]  -- Forwards traffic to docker nodes --> [ Multiple Docker Swarm Manager with Traefik ]  -- routes --> [target stack/ service]

I use the service webhooks by my cicd to trigger an upadte after building my new images. But unfortunately I have to adjust all the pipelines after restarting the environment like described.

Does the steps docker stack rm portainer + docker stack deploy -c portainer.yml portainer cause the webhook reset?

Rather than removing, I'd scale it down to zero:
docker service scale portainer=0

Is there another way to trigger a service update withing portainer-ce through the api?

As per https://docs.portainer.io/v/ce-2.11/api/docs:
curl --request PUT --insecure --write-out "%{http_code}" \
--url 'https://<IP_ADDRESS>:9443/api/endpoints/3/forceupdateservice' \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer eyJhbGciOiJIUzI1yhk66sR3MyYSF0A' \
--data '{"ServiceID":"a33y8okc5hryd1m229varjttk","PullImage":false}'

Thanks for the help. I think the problem occurred because I stopped the stacks.
So after the maintenance I restart the stacks:

This will simply create internally a new stack with new service ids, which looks like any new stack
I guess portainer just stored the yml file but it's simply a new stack for docker. So of cause the webhooks are simply disabled in a new service. And there is no reference to the old one.


Fix global header display issue

Fixes

Fixes #[issue number] by @[KewKartik]
#Description
Updated the code to fix the issue mentioned in the linked GitHub issue.
Technical details
No additional technical details to mention.
Tests
No specific steps for testing as it's a code fix.
Screenshots

Checklist
My pull request has a descriptive title.
My pull request targets the default branch of the repository.
My commit messages follow best practices.
My code follows the established code style of the repository.
I added or updated tests for the changes I made (if applicable).
I added or updated documentation (if applicable).
I tried running the project locally and verified that there are no visible errors.
Developer Certificate of Origin
I hereby certify that my contribution is in compliance with the Developer Certificate of Origin 1.1.

Hi! Thanks for the efforts!
Assuming this is for #178, see comment there. Issue is set to status: blocked, and wasn't moved out of status: awaiting triage yet, so PRs for this shouldn't be issued yet.
Closing.


[feature request] - move focus to next monitor

What do you think of the feature of switching focus to the next monitor when you try to move off the edge of the monitor?
For example: Someone has 2 monitors, 1 and 2 and each one has 2 panes, a,b,c,d.
While on mon1, on window A, (m1wA) I can move to m1wB with cmd+ctrl+L. If I hit it again, I end up on m2wC.

There used to be an option for kwmc window -f <direction>|<next|prev> to work across monitor boundaries. I would actually love for this functionality to return to be honest.

This is exactly the feature I would like the most. I guess there must have been issues with the old implementation?

Might reintroduce this setting.

This would be really awesome - it's one of the only things I feel like I'm missing from my old linux i3 environment.
It'd be really cool if you could move a window across the display boundaries too... e.g. kwmc window -m east would move the window to the next display if the window was already the east-most on the current display.
I think that both of these might be achievable with a bash command, if there was a way to ask if a window was already the east-most.  i.e., if I say kwmc query window focused east, return -1 if I'm already the east-most, rather than wrapping around and returning the window from the west side of the display.
(BTW thanks a ton for such an awesome program... it makes my OSX dev environment soooo much nicer!!)

This is not likely to happen in Kwm, as I'm spending most of my programming efforts on chunkwm at the moment.  This feature is something I will be doing in chunkwm for sure.
The project is still very early in development, but should (hopefully) surpass Kwm in every way, in the end.
If anyone wants to take at shot at implementing this feature in Kwm, I do accept PRs.

whoa, nice, will look forward to the release of chunkwm!


Cafes UI

Description
Add user interface for cafes and peers to the application.

I want to consolidate all my thinking on this, so here it goes. I've spent this past week working on and thinking about this issue. I've been able to go through all of the existing cafes code I could find and I think I have a good grasp of the cafes workflow. In the process of this work, I've had some success, ran into some problems, and I have a few questions.
Questions

Where should I make the API call to determine which cafes are nearest to the user? Right now I am doing the logic asynchronously using textile-lb-api in componentDidMount() just so it's there, but I think I should probably put it in a saga. If I do put it in a saga, I'm not sure what part of the state I should store the request/results/errors in.

Where should I store the hardcoded cafe information? As far as I can tell, it's not possible to store it as JSON in the .env, and I'm not sure how App/Config works. Right now I just have it stored as a variable in the CafesList component file, where it is used.

At what point in onboarding is the user registered with a cafe? In App/features/account/sagas.ts, registerCafesIfNeeded() is called whenever the node starts up, which executes registerCafes() if the user isn't registered with a cafe. This code uses the aforementioned textile-lb-api to find the nearest cafes and registers the user with one of those. This all makes sense to me, but that code relies on environment variables which do not exist in my .env. Despite this, I am still somehow registered with a cafe after onboarding? I'd really like to know how this is happening. My .env also features a number of environment variables which seem relevant, but are never used anywhere in the application (tested using grep):

RN_TEXTILE_CAFE_OVERRIDE="https://us-west-beta.textile.cafe"
...
RN_TEXTILE_CAFE_GATEWAY_URL="http://<IP_ADDRESS>:5050"

The existing code for cafe registration uses cafe url for registration, and it seems like the latest SDK relies on them as well, but @sanderpick has mentioned to me that we want to use peer IDs for registration. It seems like the javascript api and command line interface have already switched to peer IDs. Should I go ahead and use urls? Or table this whole issue for now and wait to write new code until the sdk has been updated?

Problems

I originally planned to use react-native-swipe-list-view for the Deregister button on the cafes settings view, but that library has a lot of issues and seems like it's very poorly maintained (even though it has a ton of stars?). I'm just going to table that feature and put the deregister button in the cafe screen itself.

I feel like this feature has honestly taken me longer than it should, and I really want to get at least a draft totally done in the next day or two. This isn't really a problem, just an observation.

Success
I'm opening a draft PR to make it easy to see the code for these features:

The cafes onboarding screen looks and works great, and in the process of designing it I expanded on the work from contact multi-select and made a nice Checkbox element.

The cafes setting screen / individual cafe view is also functional, although it doesn't have the Deregister button like the mockup, and the Services list is hardcoded in as a placeholder (since the logic for assigning certain cafes to certain services isn't there).

tl;dr: The UI is done. I totally get the logic and API for the cafes "backend" but I'm not sure how to proceed with it. I'd like to leave open the possibility that I have totally misunderstood the existing code.

Nice, sounds like some great progress. I'll try to step through each of your bullets here:

Sounds like we should create a redux "feature" (a subdir in our "features" dir) for cafe-related things. All the logic, state, and I/O for cafes should live in there. You'll be able to have some redux state that holds a "loading" state while a saga is calling the textile-lb-api, trigger that saga using an action when the "choose a cafe" screen is loading during onboarding.
I'm not sure what JSON data you're needed to store in the .env... The only constants required for registering a cafe are RN_TEXTILE_LB_URL or RN_TEXTILE_CAFE_URL (soon to be RN_TEXTILE_CAFE_PEER_ID). Any other information about previously registered cafes is persisted in the go-textile layer and is queried and stored in redux as needed.
I'm not sure about you somehow registering a cafe even when the env vars don't exist, but... We will want to remove the automatic call to registerCafesIfNeeded. A call to registerCafe will only happen when the user explicitly chooses to register a cafe during onboarding or later on from the settings screens. The cafe to be registered will come either from our LB api or from the user manually entering the information. You can see the current valid env values in https://github.com/textileio/photos/blob/master/.env.example
The version of the SDK that is used in your branch uses cafe URL, so you'll have to use URL. But an update to the SDK that is currently WIP switches to peer id. Once that's out, you can update your branch and start using peer id. It's a pretty simple switch, just type .peer instead of .url.
I don't think your problems are very big problems. I'm all for avoiding 3rd party dependencies that are poor quality, even if it means a more simple or less ideal implementation for us.
Work always takes longer than you think. This is a complicated one, don't worry about it!

Let's chat if you want, could be good to just make sure we're on the same page.

+1 to @asutula's points. There a lot going on here so thanks for dumping your thoughts! One more thing comes to mind:

Do we want to use the "nearest cafe" technique at all anymore? Is the idea there to just tell them which one is closest, sort of like a recommendation?

Yeah, right now the UI is using the nearest cafe feature for a recommendation. It just says Recommended below the peer ID for the two cafes, like in the mockup.

Check out the draft PR #1175 to see the UI code. Working on building out the backend saga code following @asutula's suggestions!

This is all great, and I'm super clear about how to proceed. Making really strong progress today. Only thing-regarding the .env, sander and I agreed that we should store a hardcoded list of the textile cafes (e.g. us-west, us-east, etc.) somewhere and show that in onboarding, along with the option to enter your own peerId. We talked about storing this in the config (I assumed that meant the .env) but I couldn't find a place to put it, so it's just hardcoded into CafesList.tsx right now.

Makes sense to me!


Localization fixes about package load state and cache handling

Store package load state in config, don't rely on cache (it may be disabled)
Make sure we reload the localization files when we clear the localization cache

Thanks! I think I will probably change the configuration key name but other than that looks good.


Add script to test driver-toolkit ImageStream and image contents

This PR adds an e2e test for the driver-toolkit, intended to be run in the OpenShift CI.
Currently the test is quite simple:

Verify that the ImageStream/driver-toolkit exists
Verify that the ImageStream/driver-toolkit tags are there (latest and RHCOS version) and that they match
Verify that the kernel version in the driver-toolkit image matches the kernel version on a worker node.

Planned extensions of this testing include:

Verify that the driver-toolkit also contains the right version of the real time kernel packages
Build the simple-kmod on top of the driver-toolkit

Thanks to @kpouget for some ideas I borrowed from the gpu-operator testing in openshift-psap/ci-artifacts.
/cc @qbarrand @yevgeny-shnaidman @kpouget

I think this is ready to merge from my side,
@qbarrand @kpouget @yevgeny-shnaidman any final comments?

/hold @kpouget gave me the idea to save some JSON artifacts to $ARTIFACTS_DIR which is set in the openshift ci

I added an additional test to verify the RHEL_VERSION used in the driver-toolkit as well as the kernel version.

/retest

/unhold

thanks for the updates @dagrayvid, let's merge it :)
/lgtm


Improve pub points

Use secure links for README

Thanks! Eventually I should probably update those to an actual image host other than my personal one, but this is a good change in the mean time


Today's updates

Creating a pull request now as it's late and there's an interesting forum post I want to reply to.
A "major" change here is I'm getting confused by the custom field being called "content", I feel it's too much like a reserved name. I'm so confused I'm not even sure if my changes will affect the code, specifically:
  call: ({ create_entry }) => ({ greeting_text }) => {
    return create_entry({ greeting_text, entry_def_id: "greeting" });

which was:
  call: ({ create_entry }) => ({ content }) => {
    return create_entry({ content, entry_def_id: "greeting" });

I have got to a certain point in the text and will continue, I've changed all references to "content" to "greeting_text" and from "Hello World" to "Holo, World!", I thought it would be kinda cool / missed opportunity given the tone of your writing I thought it would fit in. On the subject of tone I've toned a few bits down to keep it concise - no need to say "well zomes don't do much but they do even when you're not looking" etc. - I found this a little confusing and distracting so hope the new text sounds ok and keeps your "character" but is just a little "tighter" ;)
I'll propose two changes on the developer-exercises repo with regards to the content->greeting_text and "Hello World" -> "Holo, World!", I'm sorry my memory fails me with git so I'm just doing it through the web UI at the moment, branching & stuff doing my head in. Flippin annoying having "learning difficulties", I can seemingly do some complicated things no problem but when it comes to relatively simple things my brain fails me hah!
Cheers,
sbp

Hi @stephenbpurkiss,
I get now what your pull requests in developer-exercises are about. Thanks for your explanation in this pull request.
I hope you are fine with me waiting a bit more before merging this in. I would like to add a few more basic exercises before improving on the existing one's. I received some feedback from Guillem, like moving some of the Rust tips to another place. I would like to incorporate that as well.
And thanks for spotting all my typing and spelling mistakes :bow:

Hah no problem, no rush, an apologies for my awful git fu, I'll catch up, it's just been a while!
Am enjoying the deep learning too, I was hacking assembler code 39 years ago, then BBC BASIC, then Pascal, then RPG/400 for IBM AS/400s in 1990 for a govt funded course and a year of "work experience" when I learned about relational databases - physical files stored the data, logical files stored the views, then ADA and Java at Uni, then J2EE, JSPs & Javabeans in the dotcom days c200, then a step back from OO to PHP, then into PHP to crazy abstraction in Drupal, then a mix of OO with Drupal rewrite from procedural to mostly OO, where I learned about traits and dependency injection, and now Rust.
You would think I'd be good at this by now lol but no, still confuses the hell out of me but I kinda enjoy it, and now I realise things like ADHD is why I have a small amount of knowledge about a wide range of things, and Autism means I dive deep into some things like user freedom-respecting software licensing lol!
I'm ranting, I'll leave you to it, thanks for all your work and giving something our future fellow humans have to control the machines with!

Just a quick update - I've added a markdown and git extension to visual studio so that's cool, am going to work on the changes I've made in this but not sure whether to "pull back" this pull request then create new one, will become clearer as I discover more, posting this so you know I've not just abandoned life the universe everything [inc. this] ;)
Have a great weekend!

...huh, nice to see VS has a vim emulator extension - was tempted but guess I should learn some new tricks ;)

Stephen,
I pulled directly from your forked repository and merged into the master branch.

Changing content to greeting_text was not possible since this breaks the simulation
I kept "Hello world" instead of "Holo world" mainly because I hope it give a better change finding the gym when you search for "Holochain hello world example".

Hi @tixel

Changing content to greeting_text was not possible since this breaks the simulation
How does it break the simulation?

I kept "Hello world" instead of "Holo world" mainly because I hope it give a better change finding the gym when you search for "Holochain hello world example".
Good point, I hadn't thought of that! I did check and there are references to Holo World still and not all my other changes seem to be there so not sure if https://holochain-gym.github.io/developers/basic/entries/ is up-to-date or not.

Hi @stephenbpurkiss,
I do not know exactly why the simulation break if you do not use 'content'. Guillem has written all the playground simulations and I lake the knowledge, skills and free time to figure it out.
That aside, I do think you are right and that we should avoid using words like "content" where possible. Perhaps Guillem or somebody else will upgrade the playground simulation so that it will be possible.

Ok cool thanks - it is good to know that it broke, I presume it is only JavaScript so will have a play myself when my brain next lands on this ;)

Just pushed the change from content to greeting_text, you can see how to fix the simulation without breaking it :)

Awesome!
Only one sip into morning coffee but had a quick look... does "content" still need changing in the simulation perhaps?

i.e.
{
  "entry_type": "App",
  "greeting_text": "test"
}

OK, so think this is the point where I get the point - the "content" under the Entry Contents is indeed the content of greeting_text, and it is the key, so it is correct in being "content".
Blimey O'reilly I'm glad I'm extracting myself from the dirty details of this one, hopefully now it's less confusing for the next person - i.e. they shouldn't get confused because the field name is now greeting_text.
Have a great weekend,
sup

(can't believe it took me inspecting the element on the web page and seeing it marked up as 'key' to finally get it lol)


[Question] High/Low tariff sensor values always zero

Hi Frans,
All still working perfectly, but had a question regarding the P1 tariff values.
At the moment, only normal tariff has a value, however high- and low tariff are always reported zero. Do you by any chance know if these are actually provided/filled in the Zonneplan interface or just there as a placeholder?
Thanks!

Hi,
These should give you the same info as in de Zonneplan app on the Stroom gekocht overview.
At least for me these values seem to match :)

Ah, I don't buy power from them so that could explain things (also don't have this in the app). Thanks!


fix(build): Fix the build for good this time by exporting the right t…

…hings

:tada: This PR is included in version 1.6.7 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Clarify documentation configuration requirements for standalone certificates

I think that the docs can be slightly clarified to avoid misunderstandings like in #1044

Thank you for the PR 👍
I only have a minor wording change request.

Fixed!


It seems that bipe_alibi is not working yet.

It seems that bipe_alibi is not working yet.
get_ape_embeddings returns a tuple, which is different  from embed_tokens.
All codes since here do not work.
if self.config.rpe_type == "bipe_alibi":
    inputs_embeds = self.get_ape_embeddings(torch.stack([input_ids, token_ids], dim=-1))
else:
    inputs_embeds = self.embed_tokens(input_ids)

Hi,
Sorry about the typo in get_ape_embeddings
It should be return embed  rather than return embed, X[:, :, 0].


add support for multiple omniauthable models

taken from: https://github.com/heartcombo/devise/pull/5176

oops. wrong repo. sorry!


home dir SetPermissions changed from 755 to 750

CLA signed

Hi Ryan, couple issues before we can merge:

There is a test failing from this change.
The pull request should be against the development branch.

Thanks for the contribution!

Closing due to working from the wrong branch.


Create unit test infrastructure

Create ContainerToolsRule similar to what CloudToolsRule has but probably faster and simpler, with better accomodation for Kotlin test framework .
The test rule should support:

test services
easy mocks
test projects via heavyweight fixture

Conceivably we can follow what this blog suggests (https://blog.philipphauer.de/best-practices-unit-testing-kotlin/) and also consult Kotlin group on this.

I think we can mark this as fixed now as we have most of the required support in place.


Adultswim extractor

Before submitting a pull request make sure you have:

[x] At least skimmed through contributing guidelines including yt-dlp coding conventions
[x] Searched the bugtracker for similar pull requests
[x] Checked the code with flake8 and ran relevant tests

In order to be accepted and merged into yt-dlp each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Fix or improvement to an extractor (Make sure to add/update tests)
[x] New extractor (Piracy websites will not be accepted)
[x] Core bug fix/improvement
[ ] New feature (It is strongly recommended to open an issue first)

Description of your pull request and other information
Implements #3861 to extend the adultswim extractor to extract episodes packed into streams. It reads the episode info json from the website and created a playlist from that. The m3u8 segments are generated within the new m3u8 generator in hls.py by filtering and extending the parsed manifest. The generator itself is modeled after the mpd generator in that there is an added protocol called 'm3u8_native_generator' and the option to make HlsFD download from a list or callable containing/generating the segments.
Also, in case that the downloader finishes before the currently live episode changes, the callable AdultSwimStreamIE._live_hls_fragments sleeps until a new episode aired, stalling HlsFD.

You broke the code during merge. Add the new extractor to yt_dlp/extractor/_extractors.py to fix it

I've tested it extensively and it should work well now.


Unable to fetch GCM device token

Environment

Device: Sony c5 ultra
OS version: 5.1
SDK version: 21
[Android] Google Play Services version: 8298000

Problem

I am getting following error while getting the device token An error occurred while either fetching the InstanceID token, sending the fetched token to the server or subscribing to the PubSub topic. Please try running the sample again.

Steps to reproduce:

Get the Sample code https://github.com/googlesamples/google-services/tree/master/android/gcm
Get and Add your API key and Sender ID
Compile and run the sample

Observed Results:

Getting Error in particular device but in other device it is working fine.

Expected Results:

Should get the device token from GCM for the device

That is a realtively old version of Google Play Services - can you try updating the device to a newer one and see if that resolves the issue?
Is there anything else in the log as well that might indicate the issue?


effect speed undefined error

Good news and bad news...
The good news is that I ordered a random set of addressable LEDs off Ali Express and they just worked with this integration!!
I paid £2.18 for these on a Choice special deal, but even now they are only £3.84.  Amazing to think that addressable LEDs are now more or less the same as non-addressables.
The bad news is that on first discovery I got an error when trying to set the effect.  I didn't capture the exact error message, I will do that next time, but it was complaining that effect_speed wasn't an int between 0 and 255.
I strongly suspect that this is because it was undefined.
The line that was generating the error:  https://github.com/raulgbcr/lednetwf_ble/blob/5da1d4f903c4056a85f8dc29f27801aabb03f9ad/custom_components/lednetwf_ble/lednetwf.py#L377
I can see that self._effect_speed is defined during instantiation. It can also be set by a notification from the device.  Once I added some more debugging and restart HA the error was gone.
I will try and find a reproducer and fix the bug.  For now the work around seems to be "just wait a bit".

I tested the fix, and it works for me.
This new device has different effects to the circle lights, so the effect names don't match, but it does switch effects and so far nothing has bricked the lights by choosing an invalid effect.
My feeling at this point is that it's not worth the effort of enumerating the effects of this new thing.  Just merge the fix and leave everything as it is.  If someone comes along with a more pressing need & the desire to contribute then we can revist.

I think that I was wrong on that LED count bit in the notification, but it probably deserves more effort to see if we can support them better.
I also wonder if because these lights don't have white LEDs that there could be some bytes missing so the offsets are wrong?
Something for another day :)


More 2.4 metrics

Provide additional server-status metrics. The series of commits first provide more base metrics, than also adds the metrics from mod_proxy (see also issue #47).
Test data is updated according to these new metrics.

Indeed, the Circle CI need some updates, has been failing for quite some time
@roidelapluie could you also have a quick look at the proposed changes if you have a minute?

hi @rainerjung
Sorry for the long delay
Could you try merging master to your branch and see if the CI/CD can correctly build with your changes

Merged and checks now pass.

@rainerjung   this is really cool - thanks for adding this!
@Lusitaniae  Could this potentially be merged then?

Some of the additional metrics should not be tracked by Apache Exporter
https://prometheus.io/docs/instrumenting/writing_exporters/#machine-and-process-metrics
Machine and process metrics

Many systems, for example Elasticsearch, expose machine metrics such as CPU, memory and filesystem information. As the node exporter provides these in the Prometheus ecosystem, such metrics should be dropped.

@roidelapluie Would you like to review too?

CPU metrics: the included CPU metrics are not system wide CPU metrics. They provide only the CPU use by Apache httpd and its children. Since Apache is multi-process and the processes have dynamic live duration, it is nearly impossible to correctly monitor Apache CPU use from outside of the process. The Apache server-status has wuite complex code to track CPU for the httpd parent process plus all children plus all historic children to provide correct monotonically increasing CPU use numbers. And in fact it took until Apache version 2.4.35 in September 2018 to get it right.
The cited page https://prometheus.io/docs/instrumenting/writing_exporters/#machine-and-process-metrics contains in the next page an example - the Java exporter - that for the same reasons exports the CPU use just of the JVM process.
So IMHO the CPU metrics under discussion here are not redundant and can currently not be monitored in other ways.

Thank you for the extra details @rainerjung
I will merge for now!

@Lusitaniae would you consider doing a release with this new feature in?
Also using and testing the newly refactored CI/CD (https://github.com/Lusitaniae/apache_exporter/pull/104) would be work it?

v0.10.0 was released yesterday, please test and let me know.
Thanks everyone.

v0.10.0 was released yesterday, please test and let me know.
Thanks everyone.

I did. It works great in general, but I found a bug - see https://github.com/Lusitaniae/apache_exporter/issues/109


fix: Remove typo in inputs for chaos

Remove a typo (double '$') in the chaos experiment action that causes the passed delay to evaluate to a string such as '$10' - when passed to the action, it evaluates to 0 (due to strconv.Atoi and no error handling) and throws a panic on a division by zero (there is a computation that relies on delay being the divisor). This PR fixes that.

I noticed the readme is not updated with the new parameters. Would you mind updating it?

I noticed the readme is not updated with the new parameters. Would you mind updating it?

Nvm, it has been updated as part of #70


Set maxLength to 100 for Edittext views

@nasthagiri @rohan-dhamal-clarice - There was a crash on few phones where if the user while inputting his credentials on Edittext, selected from the prompted text, and the selected text is greater than the maxlength, it would crash the application.
I was unable to reproduce the issue but have increased the maxLength from 60 to 100.
Please review
Jira Link - https://openedx.atlassian.net/browse/MOB-1351

:+1:

:+1:


PR: Add support for Python 3.7

Fixes #118.

@ccordoba12 I'll merge this one and publish another release

Thanks!


Fix Windows Rtools 3.5 Boost program options bug

Submisison Checklist

[x] Run tests: ./runCmdStanTests.py src/test
[x] Declare copyright holder and open-source license: see below

Summary:
This fixes #913 and adds Github Actions tests for Windows Rtools 3.5 (for now it tests that it builds and is able to build the example model).
Copyright and Licensing
Please list the copyright holder for the work you are submitting (this will be you or your assignee, such as a university or company): Rok Češnovar, Univ. of Ljubljana
By submitting this pull request, the copyright holder is agreeing to license the submitted work under the following licenses:

Code: BSD 3-clause (https://opensource.org/licenses/BSD-3-Clause)
Documentation: CC-BY 4.0 (https://creativecommons.org/licenses/by/4.0/)

@serban-nicusor-toptal mind reviewing this one?

Looks good to me.
The Download & install RTools is very nice and clean.


Can not connect to Digital Paper app

I'm using Windows 10 and the pkg I'm using is <IP_ADDRESS>40
I lost my device Id and authkey file, due to loss of PC datas. so I tried to re-install digital paper app but it can not find my rpt-cp1.
whenever I connect use cable it tries to connect to rpt-cp1 but it silently failed.
dpt-tools wasn't able to find find my machine without device id, I stuck in the stuation. I can not upgrade/downgrade PKGs or add wifi access point to my rpt-cp1.
(the rpt-cp1 can not find any Wifi access point except that I added via digital paper app in the past)
The diagnosis mode is still accessible, so I tried factory reset but it shows error message like below.
: line 28: DIAG_get_setid: not found
NG
Is there any way to find deviceId manuallly? or anyway to factory reset?

If you lost your authentication files, you need to reset your device from device settings.
If you want to reset it through diagnosis mode, you need to run cd /usr/local/bin and then ./factory_reset.sh

also, why not reset it by pressing the reset button for 30s while the device is on?

So  sorry for late response.
I tried run factory_reset script in diagnosis mode but it shows error message below
: line 28: DIAG_get_setid: not found
NG
I also tried reset it by pushing reset button 30s' but it did not work somehow.
I think I missed something, I'll keep trying to find way. Thank you.

I found a way to solve the problem.

Open device manager and check if there's any conflict ports in ports(COM&LPT) section. (For example, maybe there're two devices that was assigned COM3)
And, if there's conflict, try to figure out which one is dpt. (You can find when the device was plugged in from properties--> events)
Then you should change its port number(in properties -> port settings -> advanced) to any port that is not in use.
Save, and unplug the device.
Open digital paper app and try to pair again.

Some background knowledge: https://github.com/janten/dpt-rp1-py/blob/master/docs/linux-ethernet-over-usb.md

Maybe you should add this to your guide? I guess you have said this is a known issue. @HappyZ

Thanks @Cmf0rTS1997  for helping, I'll close this unless issue persists at your end @friedScale


[WIP]Remove SubExpression type

Remove hacky SubExpression Expression type (which was just a wrapper around an Expression)
TODO:

[x] Remove SubExpression
[x] Remove SubExpression specific optimisations
[x] Fix tests using SubExpression
[ ] Fix parentheses always being inserted around "sub-expressions" which require a single term (see below)

Known issues:
Parentheses will always be inserted around sub-expressions which are not a single term (i.e. application and infix operators).
This results in output like the following: a + b + c -> (a + b) + c
Example output:

I think I've fixed the additional parentheses being inserted!


Changed identifiers quoting char to double quotes

As stated in SQLite's documentation, double quotes should be used for identifiers. Brackets and back quotes are documented as supported for compatibility, but back quotes causes invalid foreign keys to be created, at least on Mac OS 10.13.

SQL serialization has since moved to vapor/sqlite. I've manually applied these changes there. Thanks for the contribution!


Remove MLS example from SELinux example in run reference

MCS/MLS are currently not supported, so should not
have been documented. For reference, see https://github.com/docker/docker/issues/22826#issuecomment-220418929
closes https://github.com/docker/docker/issues/22826

LGTM - @rhatdan is this more accurate?

**Note**: MCS/MLS levels are currently not supported.

Change to:
**Note**: Automatic translation of MLS labels is not currently supported.

Thanks @rhatdan, updated!

LGTM

it's green! merging


Support multilabel classification and regression

Motivation: describe the problem to be solved
NannyML currently supports only single target classification and regression. Extending it to multilabel (multi-output) case would enable us to monitor our multilabel regression neural networks.
Describe the solution you'd like
Support for multilabel classifiers and regressors. Implementationally, this has a few possible approaches, but the simplest would be to treat this as a series of problems and average metrics for CBPE / DLE.
A nice addition would be to be able to configure how scores are combined. Average metric is the simplest one, but this treats all problems as equally important, and would result in no alarm if one metric is severely underperforming, but others are ok. Accepting a predefined option (mean, geometric mean, max) or Python callable, would be quite useful.
Describe alternatives you've considered
Create separate NannyML models for each target and monitor them separately. However, this has downsides:

having to train and maintain multiple monitoring models separately
having to aggregate the results ourselves, e.g. we have to look into 3 DLE results and compare them ourselves

Additional context
This is quite important for neural networks, since multilabel training can be used for expanding the training set. Even if some labels are not available, masked loss can be used. It also encourages generalization for representation learning, so it's quite useful. For tabular problems, Random Forest also supports this, as do scikit-multilearn models, with the same rationale.

Hey Jakub,
Thanks for opening the issue. We've been considering adding multilabel classification (and to a lesser extent multilabel regression) for a while now, but we never had enough pull from users to actually prioritize it. Your request definitely makes us look at a roadmap again and at least consider prioritizing it.
Would you be open to contributing these features? We will happily provide support and guidance. One example solution that should be reasonably easy to implement is extending our existing confusion matrix estimation feature to also estimate confusion matrix for multilabel problems. The implementation should be reasonably straightforward, as it's just doing binary classification multiple times and combining them as you outlined. Then extending it to all classification metrics should be very simple.
Let me know if you'd like to contribute something along these lines!

I could try, this looks relatively straightforward. However, after delving into code details, I see overall a few things to discuss.

For probability calibration in CBPE, this will require training a separate calibration model per label. So an array of calibration models will need to be train and used for multilabel cases. This will be mostly exactly like the existing multiclass case, right?
Model predictions and actual targets are currently saved in Pandas DataFrames. However, columns with Numpy arrays (which would be result of multilabel classification) are not exactly well handled in Pandas from my experience. On a positive side, this would keep the code structure as-is (and quite readable), on the other will require weird handling in some cases. What do you think?
This would require changes in cbpe.py (add arguments and multilabel methods), and in metrics.py to add multilabel versions of metrics, and adding tests. Or did I forget something?

Hey,

Yeah, it's basically like having multiple binary classification models. So not exactly like multiclass, but very similar.
That's above my pay grade. @nikml @nnansters help here pls.
I think so. @nnansters can you confirm?

Hey @j-adamczyk ,
Thanks for chipping in!

Yup, sounds like multiclass. I tend to prefer using dictionaries for the use case of associating a label and a value. I like it more explicit and not depend just on array ordering.
Yeah, that's a proper trade-off.  The idea of Numpy arrays in DataFrame columns does scare me somewhat. Turning the arrays into DataFrame columns seems like the cleanest way, but it might break the existing "single value target" implementation. Would have to delve a bit deeper for the impact that may have. But again, I do prefer making it more explicit; i.e. introducing multilabel support instead of hacking it in as embedded arrays. I will take a closer look it this as well.
Yes, that is very correct. Most of the work will be in the metrics.py module, but it should hopefully allow you to work in some isolation of the existing stuff (bar the changes for multilabel targets).


[SPARK-31270][CORE] Expose executor metrics in task detail table in StageLevel

What changes were proposed in this pull request?
Expose executor metrics in task detail table in StageLevel

Why are the changes needed?
help developer to check app running status.
Does this PR introduce any user-facing change?
NO
How was this patch tested?
MT

Can one of the admins verify this patch?

Can one of the admins verify this patch?

ok to test

Test build #120542 has started for PR 28061 at commit 7807901.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25248/
Test PASSed.

cc @sarutak

Test build #120542 has finished for PR 28061 at commit 7807901.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120542/
Test FAILed.

Maybe,
peakJvmHeapMemory -> peakJvmOnHeapMemory?
Peak JVM Heap Memory -> Peak JVM On Heap Memory?

Sure, make it more clear

I'll review within a week.

Test build #120555 has started for PR 28061 at commit 48a355d.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25261/
Test PASSed.

Test build #120555 has finished for PR 28061 at commit 48a355d.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120555/
Test FAILed.

Test build #120556 has started for PR 28061 at commit bbea4f9.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/25262/
Test PASSed.

Test build #120556 has finished for PR 28061 at commit bbea4f9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/120556/
Test PASSed.

Thank you, @sarutak !

Additional comments:

Could you explain more about manual test in the description so that we can understand what and how you tested?
With this change, appearance of UI changes so this change should be user facing.
Please update screen shots when you update the code.

So I wonder it's not helpful that those metrics are displayed for each task.

Such as Stage Executor Metrics, it show each executors's peak memory during this stage, but there is still a problem that during this stage, other stage's task will run in same executor too when executor's core num is bigger than 1.
We just show each task's running status about JVM, as an SRE, we need to know  task running status as many as possible. Any one of these metrics can help the user find problems and provide help.

O.K, I understand the motivation.
I confirmed that those peak metrics are calculated for each task so the fundamental idea might be fine even though over-wrapping or consecutive tasks are affected each other like GC Time.
What do you think, @dongjoon-hyun , @gengliangwang ?

@AngersZhuuuu Sorry to reply late.
Actually, I am slightly -1 on the changes since it is not straightforward enough. Even @sarutak has to think about the meaning of the metrics.
How about just displaying the max on/off heap memory in the executor page?

@AngersZhuuuu Sorry to reply late.
Actually, I am slightly -1 on the changes since it is not straightforward enough. Even @sarutak has to think about the meaning of the metrics.
How about just displaying the max on/off heap memory in the executor page?

how about this ? https://github.com/apache/spark/pull/28036
https://github.com/apache/spark/pull/28036#issuecomment-610725617

how about this ? #28036
#28036 (comment)

That's way better!

That's way better!

ok,  I will focus on that pr and follow your advise

@sarutak I prefer the approach in https://github.com/apache/spark/pull/28036 .
What do you think? If so, shall we close this one?

I also prefer that.

cc @sarutak  @gengliangwang  Close it


Gym: No such file or directory: 'Kingfisher'

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I read the Contribution Guidelines
[x] I read docs.fastlane.tools
[x] I searched for existing GitHub issues

Issue Description
Gym failed because it can't find Kingfisher. It does compile it in a previous stage in gym, and there is a folder inside the Pods folder called "Kingfisher". This is weird, because I just moved the fastlane files to another branch in my repository, checked if everything was OK but then this error shows up, this is not happening in the other branch
Complete output when running fastlane, including the stack trace and command used

▸ Compiling ModuleApp-iOS_vers.c
▸ Compiling ModuleApp-iOS_vers.c
▸ Linking ModuleApp-iOS
❌  clang: error: no such file or directory: 'Kingfisher'
▸ Linking ModuleApp-iOS
❌  clang: error: no such file or directory: 'Kingfisher'
** ARCHIVE FAILED **
The following build commands failed:
Ld /Users/user/Library/Developer/Xcode/DerivedData/ModuleApp-iOS-fhfgmzaawccjskfdrjcfzvwoprqk/Build/Intermediates.noindex/ArchiveIntermediates/ModuleApp-iOS/IntermediateBuildFilesPath/ModuleApp-iOS.build/Release-iphoneos/ModuleApp-iOS.build/Objects-normal/armv7/ModuleApp-iOS normal armv7
Ld /Users/user/Library/Developer/Xcode/DerivedData/ModuleApp-iOS-fhfgmzaawccjskfdrjcfzvwoprqk/Build/Intermediates.noindex/ArchiveIntermediates/ModuleApp-iOS/IntermediateBuildFilesPath/ModuleApp-iOS.build/Release-iphoneos/ModuleApp-iOS.build/Objects-normal/arm64/ModuleApp-iOS normal arm64
(2 failures)
Environment

✅ fastlane environment ✅
Stack

Key
Value

OS
10.13.1

Ruby
2.2.4

Bundler?
false

Git
git version 2.13.6 (Apple Git-96)

Installation Source
~/.fastlane/bin/bundle/bin/fastlane

Host
Mac OS X 10.13.1 (17B48)

Ruby Lib Dir
~/.fastlane/bin/bundle/lib

OpenSSL Version
OpenSSL 1.0.2g  1 Mar 2016

Is contained
true

Is homebrew
false

Is installed via Fabric.app
false

Xcode Path
/Applications/Xcode.app/Contents/Developer/

Xcode Version
9.1

System Locale

Variable
Value

LANG
en_US.UTF-8
✅

LC_ALL
en_US.UTF-8
✅

LANGUAGE
en_US.UTF-8
✅

fastlane files:
`./fastlane/Fastfile`
# Customize this file, documentation can be found here:
# https://docs.fastlane.tools/actions/
# All available actions: https://docs.fastlane.tools/actions
# can also be listed using the `fastlane actions` command

# Change the syntax highlighting to Ruby
# All lines starting with a # are ignored when running `fastlane`

# If you want to automatically update fastlane if a new version is available:
# update_fastlane

# This is the minimum version number required.
# Update this, if you use features of a newer version
fastlane_version "2.64.1"

default_platform :ios

platform :ios do

  lane :firstlane do |options|
    # gym part of the fastfile
    gym(
      scheme: "ModuleApp-iOS",
      workspace: "ModuleApp-iOS.xcworkspace",
      export_method: "app-store",
      clean: true,
      include_bitcode: true,
      output_name: "#{appname}.ipa"
    )

      end
end

# More information about multiple platforms in fastlane: https://docs.fastlane.tools/advanced/#control-configuration-by-lane-and-by-platform
# All available actions: https://docs.fastlane.tools/actions

# fastlane reports which actions are used. No personal data is recorded.
# Learn more at https://docs.fastlane.tools/#metrics

`./fastlane/Appfile`

# you can even provide different app identifiers, Apple IDs and team names per lane:
# More information: https://docs.fastlane.tools/advanced/#appfile

fastlane gems

Gem
Version
Update-Status

fastlane
2.66.2
✅ Up-To-Date

Loaded fastlane plugins:

Plugin
Version
Update-Status

fastlane-plugin-appicon
0.10.0
✅ Up-To-Date

Loaded gems

Gem
Version

CFPropertyList
2.3.5

activesupport
4.2.10

addressable
2.5.2

babosa
1.0.2

bigdecimal
1.2.6

bundler
1.14.6

claide
1.0.2

cocoapods
1.3.1

cocoapods-core
1.3.1

cocoapods-deintegrate
1.0.1

cocoapods-downloader
1.1.3

cocoapods-plugins
1.0.0

cocoapods-search
1.0.0

cocoapods-stats
1.0.0

cocoapods-trunk
1.3.0

cocoapods-try
1.1.0

colored
1.2

colored2
3.1.2

commander-fastlane
4.4.5

concurrent-ruby
1.0.5

declarative
0.0.10

declarative-option
0.1.0

domain_name
0.5.20170404

dotenv
2.2.1

escape
0.0.4

excon
0.59.0

faraday
0.13.1

faraday-cookie_jar
0.0.6

faraday_middleware
<IP_ADDRESS>

fastimage
2.1.0

fastlane-plugin-appicon
0.10.0

fourflusher
2.0.1

fuzzy_match
2.0.4

gh_inspector
1.0.3

google-api-client
0.13.6

googleauth
0.5.1

highline
1.7.8

http-cookie
1.0.3

httpclient
2.8.3

hurley
0.2

i18n
0.9.1

io-console
0.4.3

json
1.8.1

jwt
2.1.0

jwt
1.5.6

libxml-ruby
3.0.0

little-plugger
1.1.4

logging
2.2.2

memoist
0.16.0

mime-types
3.1

mime-types-data
3.2016.0521

mini_magick
4.5.1

minitest
5.4.3

molinillo
0.5.7

multi_json
1.12.2

multi_xml
0.6.0

multipart-post
2.0.0

nanaimo
0.2.3

nap
1.1.0

netrc
0.11.0

nokogiri
1.5.6

os
0.9.6

plist
3.3.0

power_assert
0.2.2

psych
2.0.8

public_suffix
2.0.5

rake
10.4.2

rdoc
4.2.0

representable
3.0.4

rest-client
2.0.2

retriable
3.1.1

rouge
2.0.7

rouge
1.11.1

ruby-macho
1.1.0

rubygems-update
2.5.2

rubyzip
1.2.1

security
0.1.3

signet
0.7.3

slack-notifier
1.5.1

sqlite3
1.3.13

terminal-notifier
1.8.0

terminal-table
1.7.3

test-unit
3.0.8

thread_safe
0.3.6

tty-screen
0.6.2

tzinfo
1.2.4

uber
0.1.0

unf
0.1.4

unf_ext
<IP_ADDRESS>

unicode-display_width
1.3.0

unicode-display_width
1.1.3

word_wrap
1.0.0

xcodeproj
1.5.3

xcpretty
0.2.6

xcpretty-travis-formatter
0.0.4

generated on: 2017-11-23

On that branch, can you do a regular build in Xcode?

@milch didn't try that, and it couldn't. I've fixed it, this had nothing to do with fastlane.
For people also having a similar problem: https://stackoverflow.com/questions/31264763/apple-mach-o-linker-error-no-such-file-or-directory-swifty-json
I had a -framework to many. So it looked like -framework -framework "Kingfisher"

Alright, no problem. Glad you managed to fix it!

On 23.11.2017, at 13:55, royberris<EMAIL_ADDRESS>wrote:
@milch https://github.com/milch didn't try that, and it couldn't. I've fixed it, this had nothing to do with fastlane.
For people also having a similar problem: https://stackoverflow.com/questions/31264763/apple-mach-o-linker-error-no-such-file-or-directory-swifty-json https://stackoverflow.com/questions/31264763/apple-mach-o-linker-error-no-such-file-or-directory-swifty-json
I had a -framework to many. So it looked like -framework -framework "Kingfisher"
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/fastlane/fastlane/issues/11010#issuecomment-346611284, or mute the thread https://github.com/notifications/unsubscribe-auth/AARDb4TPnjzg7SQVGxfef9DMSIOwqIOkks5s5WtCgaJpZM4QopBJ.


Use modern python tooling

Why is this using requirements.txt?
Please move to poetry.

Sorry for the inconvenience. We may move to poetry in the future. If you are willing to help us move to poetry, we would appreciate it.


checkbox fix: incorrect behavior of the value field during editing

Hello Cristian. Thank you for your work. Sorry for my English.
If you open the entity editing page with not active checkbox ($field['value'] = false, because field has a boolean value in $casts) and try to save the entity (do not click on checkbox), you will receive a validation error. Why? Look at "value" in the picture when page is loaded (it's empty). Validator waiting '0' or '1'

Look at row below from changed file. When page is loading $field['value'] isset and not null - it's false (boolean) and Blade print emptiness, because {{ false }} => "" and {{ true }} => "1"
6 |    <input type="hidden" name="{{ $field['name'] }}" value="{{ old(square_brackets_to_dots($field['name'])) ?? $field['value'] ?? $field['default'] ?? 0 }}">

At first I wanted to fix this problem with php, but I have to create a few lines of code. The second way is to use js. Only one row of code. Now it is impossible to create an empty attribute "value". Do you like this solution? I can do this using php.

I added a comment with a link because this line of code may not be understood in the future.

Note: I mean we will get validation error if we have validation rule in request class " boolean"

Hi @urlportal ,
You're right, of course. Thank you so much for the fix - I think a JS fix here is fine, since it's only one line and it fits well with the rest of the solution.
Just merged your fix into master, it'll be available with a composer update later today, as 4.0.13, after I bundle it with a few more non-breaking changes.
Thanks again for taking the time to put this PR together.
Cheers!


Error: ffmpeg error (see stderr output for detail)

I keep get this error when I want to merge my audio to my video, here is my code:
import ffmpeg

video = ffmpeg.input('D:/Downloads/Wadada.mp4')
audio = ffmpeg.input('d:/Downloads/audio.mp4')

ffmpeg.concat(video, audio, v=1, a=1).output('D:/Downloads/out.mp4').run()

Or
import ffmpeg

video = ffmpeg.input('D:/Downloads/Wadada.mp4')
audio = ffmpeg.input('D:/Downloads/audio.mp4')

out = ffmpeg.output(video, audio, 'D:/Downloads', vcodec='copy', acodec='aac', strict='experimental')
out.run()

Then I got the same error:
---------------------------------------------------------------------------
Error                                     Traceback (most recent call last)
~\AppData\Local\Temp/ipykernel_3736/1465659961.py in <module>
      5
      6 out = ffmpeg.output(video, audio, 'D:/Downloads', vcodec='copy', acodec='aac', strict='experimental')
----> 7 out.run()

D:\xxxx\xxx\anaconda3\lib\site-packages\ffmpeg\_run.py in run(stream_spec, cmd, capture_stdout, capture_stderr, input, quiet, overwrite_output)
    323     retcode = process.poll()
    324     if retcode:
--> 325         raise Error('ffmpeg', out, err)
    326     return out, err
    327

Error: ffmpeg error (see stderr output for detail)

Where did I go wrong??

What a coincidence, I have the same problem. I am calling FFmPEG-Python from a thread. Have you solved the problem?

What a coincidence, I have the same problem. I am calling FFmPEG-Python from a thread. Have you solved the problem?

Yes, I did. But seems to be a new problem unfortunately.
I have to say it was funny how I get rid off this error. I just change the single quote, which is my habit, to double quote then code could run. But just now I tried again, the error is gone no matter single or double quote I use. I have no idea what happened yesterday.
Anyway, this code works well for small size of videos, if your video is large, 8K for example, it would be very slow and all your cpu and rom would be eat up. So far I am not sure how to optimze it.
I suggest you to run ffmpeg in command line instead of running code in ffmpeg-python especially when your video is large.
And here it is:
ffmpeg -i video.mp4 -i audio.mp4 -c copy output.mp4

Remind: Before you run it make sure you add ffmpeg path in your environment variables on Windows, or brew install on Mac.

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'E:\My Proj\audio-to-subtitle\Your Age.mp4':
Metadata:
[Parsed_subtitles_0 @ 000001d00a060c00] Unable to open C:\Users\linki\AppData\Local\Temp\Your Age.srt
[AVFilterGraph @ 000001d009a22680] Error initializing filters
Error initializing complex filters.
Invalid argument

The path to srt file seems wrong.


Refactor/rename

Rename stuff for readability

Codecov Report

Merging #4 (a7f7299) into main (e796b25) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main        #4   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           13        13
  Lines          407       407
=========================================
  Hits           407       407

Impacted Files
Coverage Δ

src/purgatory/domain/messages/events.py
100.00% <100.00%> (ø)

src/purgatory/domain/model.py
100.00% <100.00%> (ø)

src/purgatory/domain/repository.py
100.00% <100.00%> (ø)

src/purgatory/service/circuitbreaker.py
100.00% <100.00%> (ø)

src/purgatory/service/handlers/circuitbreaker.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e796b25...a7f7299. Read the comment docs.


Update for ClojureScript 2727

https://groups.google.com/d/msg/clojurescript/rB5sj6vp3UU/qvlgHg_Yq0kJ

Let's also close this in favor of #37


Ionic index.html cannot find moment.js and angular-moment.js

Hi i'm getting this errors on application start in console:

Steps i do:
npm install angular-moment moment --save
then add this to index.html
<script src="components/moment/moment.js"></script>
<script src="components/angular-moment/angular-moment.js"></script>

I spent last night on this. Tried to install with bower. Changed lot of path combinations. What could be wrong?

Seems like you need to install it with bower if you expect to find it inside components.
When you use npm, it is installed inside node_modules, and then you will probably need webpack or browserify to consume that.

if installed using bower, add this instead:
`
<script src="lib/moment/min/moment.min.js"></script>

<script src="lib/angular-moment/angular-moment.min.js"></script>

`

Hi Antonio,
Why would you need to go to /lib, shouldn't the components be directly into the bower_components directory?

@TSilviu,
In your project root directory, add a new file .bowerrc, you can specify the installation directory in bower. As for me,it's  {   "directory":"app/libs" }, if you dont specify,default bower_components  directory.


Search bar

Was trying to figure out if there was a way to create a search bar in the side bar that doesn't use Algolia search for example (trying to build the site as cheap as possible)
What would you like to be added:
Simple search bar in the side bar and displays results in the same element.
Why is this needed:
Would make the docs easier to navigate.
Is your enhancement request related to a problem? Please describe.
No.
Additional context
Thank you, this project is awesome!

Algolia is free for open-source projects. If it's not open-source, there is no easy way to achieve that with a static website.

Algolia is free for open-source projects. If it's not open-source, there is no easy way to achieve that with a static website.

Algolia is free for open-source projects. If it's not open-source, there is no easy way to achieve that with a static website.

Would it be possible to add a JS-Search option? Similar to how DocZ does it? I'll look into Algolia, they have a doc option that seems like it could work well.

Algolia is free for open-source projects. If it's not open-source, there is no easy way to achieve that with a static website.

Would it be possible to add a JS-Search option? Similar to how DocZ does it? I'll look into Algolia, they have a doc option that seems like it could work well.

Hey @chris1000 👋🏻
As @diego3g has mentioned, you can use Algolia if your project will be Open Source. It is perfect for technical documentation, you can find their website in this link.
If you want to use your own search, with a Gatsby Plugin, I'd recommend you use something like elasticlunr-search or local-search, that supports lunr and FlexSearch.
There's another option also, tinysearch, which is a great solution for static websites. But I don't have any tutorials on how to integrate it with React/Gatsby.

Hey @chris1000 👋🏻
As @diego3g has mentioned, you can use Algolia if your project will be Open Source. It is perfect for technical documentation, you can find their website in this link.
If you want to use your own search, with a Gatsby Plugin, I'd recommend you use something like elasticlunr-search or local-search, that supports lunr and FlexSearch.
There's another option also, tinysearch, which is a great solution for static websites. But I don't have any tutorials on how to integrate it with React/Gatsby.

Updated: I got approved for the DocsSearch however how can I shadow the sidebar to add the search bar in? I tried creating a file at<EMAIL_ADDRESS>and copy the contents from the original file but I get missing file errors and I tried using the useSidebar hook and I'm getting errors as well, any help would be awesome! Seriously awesome project, thank you for the help!

Updated: I got approved for the DocsSearch however how can I shadow the sidebar to add the search bar in? I tried creating a file at<EMAIL_ADDRESS>and copy the contents from the original file but I get missing file errors and I tried using the useSidebar hook and I'm getting errors as well, any help would be awesome! Seriously awesome project, thank you for the help!

I'll close this issue. If you have further questions, let me know in the comments 💜


Suggestion: Adding Voyager routes should check if they already exist in the routes/web.php.

As the title says:
This causes me problems with the routes/web.php with git pull/push as it causes conflicts on the remote server.
Thanks.

This (and also for security matters) is why you should change your /admin path in the configs to something else.

I feel like there are two issues here.
First, I agree that the voyager:install command should check that before adding the routes.
But I don't understand how that is affecting your use of git push/pull and/or causing issues on your remote server.  Could you please explain that in more detail @EngHazem?
@Frondor, I'm not sure I understand the relevance of your comment either.  What is the security concern with leaving it as "/admin"?  Also, what "config" does that exist in? It's my understanding (as the dev that made the change) that all Voyager routing configuration is done in the route file.  Specifically, the '/admin' prefix is added through a Route::group() surrounding the call to Voyager::routes().

@Frondor
Sorry, I didn't get your point..
@fletch3555
When ever I run voyager:install on the remote server, the routes/web.php file is edited, so each time I need to run git pull on the remote server, I need first to either:

Commit changes on remote server, which will cause a conflict when I run git pull.
Run git fetch, and then checkout the routes file before running git pull.

I occasionally run voyager:install on the remote server as the website is still under construction.

My apologizes, seems like I got confused or can't remember why I said that.
@fletch3555 can't find the article I read before, where it was suggested to mask the admin URL to avoid possible credential guessing and possible exploits that may appear after each release.
Although I'm not sure about that, it made sense to me, and I always prefer to change it.

This issue was discussed already.
Every time you install Voyager, it edits routes/web.app and append Voyager::routes();, generating duplicated entries.

I currently do have a challenge of domain/admin page not displaying on my web server but on the localhost it works perfect

hello @cyntechtic, this issue is related to another subject.
Please open a new issue describing what's happening, there will be someone to help you out.

@akazorg, we've fixed this already, right?  If so, please go ahead and close this.

Yes @fletch3555, fixed. Closing issue.


[javascript] Syntax Highlight Binary and Octal number literals like Hex number literals

All modern browsers support the new Octal and Binary numeric literals from ES6. Would be nice if they are syntax highlighted like Hex / Scientific number literals.
Testing on https://codemirror.net/mode/javascript/index.html you can see the differences when typing:

Also, while typing "0x" you get consistent coloring, it should likely be the same for "0b", "0e" and even scientific notation "123e" if possible.

That was fast, thanks!


How to host theme-cards on cloudflare with such cloudflare-pages.yaml ?

dev/exsite/.github/workflow
cat cloudflare-pages.yaml
name: Cloudflare Pages

on:
  # auto deploy when pushing to specified branches.
  push:
    branches:
      - main

  # allow triggering workflow manually.
  workflow_dispatch:

jobs:
  publish:
    runs-on: ubuntu-latest
    permissions:
      contents: read
      deployments: write
    name: Publish to Cloudflare Pages
    steps:
      - name: Checkout
        uses: actions/checkout@v3

      - name: Setup Node
        uses: actions/setup-node@v3
        with:
          node-version: "19"

      - name: Cache dependencies
        uses: actions/cache@v3
        with:
          path: ~/.npm
          key: ${{ runner.os }}-node-${{ hashFiles('**/package-lock.json') }}
          restore-keys: |
            ${{ runner.os }}-node-

      - name: Install dependencies
        run: npm ci

      - name: Setup Hugo
        uses: peaceiris/actions-hugo@v2
        with:
          hugo-version: "latest"
          extended: true

      - name: Cache Hugo modules
        uses: actions/cache@v3
        with:
          path: /tmp/hugo_cache
          key: ${{ runner.os }}-hugomod-${{ hashFiles('**/go.sum') }}
          restore-keys: |
            ${{ runner.os }}-hugomod-

      - name: Build
        run: hugo --minify --gc --enableGitInfo
        # Use following instead if defaultContentLanguageInSubdir is enabled.
        # run: hugo --minify --gc --enableGitInfo && cp public/en/404.html public/404.html

      - name: Publish to Cloudflare Pages
        uses: cloudflare/pages-action@v1
        with:
          apiToken: ${{ secrets.CLOUDFLARE_API_TOKEN }}
          accountId: ${{ secrets.CLOUDFLARE_ACCOUNT_ID }}
          projectName: hb-theme
          directory: ./public
          # Optional: Enable this if you want to have GitHub Deployments triggered
          gitHubToken: ${{ secrets.GITHUB_TOKEN }}

and CLOUDFLARE_API_TOKEN, CLOUDFLARE_ACCOUNT_ID are filled

Hi, it's hard to help you without what exact error you encountered.
From what I got from above.

dev/exsite/.github/workflow

The folder name should be workflows not workflow, you should be able to check deploy status on the repo Actions tab.

projectName: hb-theme

Should replace it with your own Cloudflare project name.

I'd recommend reading (or again) the following references.

https://hbstack.dev/docs/deployment/cloudflare-pages/#deploy-sites-via-github-cloudflare-pages-actions
https://github.com/cloudflare/pages-action

using workflows and copy action file from site. still not working. Can you update the doc with more detail steps ?Thank you.

Hmm, not working mean nothing... please describe which step you are stuck into, and what error do you got?

forked https://github.com/hbstack/theme-cards
clone  https://github.com/techhubhub/theme-cards
added CLOUDFLARE_ACCOUNT_ID and CLOUDFLARE_API_TOKEN in github repo as:

git push

23s
Run hugo --minify --gc --enableGitInfo
hugo --minify --gc --enableGitInfo
shell: /usr/bin/bash -e {0}
hugo: downloading modules …
go<EMAIL_ADDRESS>(replaced by ../): reading ../go.mod: open /home/runner/work/theme-cards/go.mod: no such file or directory
hugo: collected modules in 23484 ms
Total in 23486 ms
Error: failed to load modules: failed to download modules: failed to execute 'go [mod download -modcacherw]': failed to execute binary "go" with args [mod download -modcacherw]: go<EMAIL_ADDRESS>(replaced by ../): reading ../go.mod: open /home/runner/work/theme-cards/go.mod: no such file or directory
*errors.errorString
Error: Process completed with exit code 1.

Thanks for the detiail, the problem is that the example site of cards theme is located in exampleSite, please following the installation guide to install the theme.
IF YOU REALLY WANT TO DO THIS, PLEASE NOTE THAT IN THIS WAY YOU'RE MAINTAINING THE CARDS THEME YOURSELF, SEE https://github.com/techhubhub/theme-cards/blob/8b076d69687ed62f437ca34e3c68fcdad6214eef/exampleSite/go.mod#L5

Replace hugo --minify --gc --enableGitInfo with cd exampleSite && hugo --minify --gc --enableGitInfo.
Replace directory: ./public with directory: ./exampleSite/public.

May I ask why do you want to fork the theme instead of installing it?
It's always recommended to follow the installation guide, it will avoid encountering unnecessary problems if you're new to this.

I did install it first, but can't deploy it on cloudflare; so I am trying the mini steps to debug the issue.
Here is the steps, when I installed it.

forked https://github.com/hbstack/theme-cards
clone https://github.com/techhubhub/theme-cards
cd exampleSite & cp -rf *  dev/exsite
cp -rf .github into exsite
added added CLOUDFLARE_ACCOUNT_ID and CLOUDFLARE_API_TOKEN
push exsite to private repo master

OK, let's make forward.

1... ~ 6...

Seems there is one step left.

I did install it first, but can't deploy it on cloudflare

Please provide the real site action erorr logs.
Btw, does your site (dev/exsite not the fork one) work locally (npm run dev)? The best practice is to run it locally to make sure everything is OK, then deploy it to public.

npm run dev

yes locally, npm ci, then npm run dev works without issue.

Please provide the real site action erorr logs.

Run npm run lint
npm ERR! Missing script: "lint"
npm ERR!
npm ERR! Did you mean this?
npm ERR!     npm link # Symlink a package folder
npm ERR!
npm ERR! To see a list of scripts, run:
npm ERR!   npm run
npm ERR! A complete log of this run can be found in:
npm ERR!     /home/runner/.npm/logs/2024-02-04T1812_21_828Z-debug-0.log
Error: Process completed with exit code 1.

Seems wrong workflow, please double check, there isn't npm run lint command inside the workflow.

it seem like cloudflare giving me error now.
Cloudflare API returned non-200: 404API returned:
Would you mind sharing how you get the CLOUDFLARE_ACCOUNT_ID and CLOUDFLARE_API_TOKEN?
Here is how I got mine.

Cloudflare API returned non-200: 404API returned:

Hmm, are you sure that your Cloudflare projectName is hb-theme?

Would you mind sharing how you get the CLOUDFLARE_ACCOUNT_ID and CLOUDFLARE_API_TOKEN?

https://github.com/cloudflare/pages-action?tab=readme-ov-file#get-account-id
https://github.com/cloudflare/pages-action?tab=readme-ov-file#generate-an-api-token

You might set up correctly, since if one of account ID or API token is invalid, APIs should return 401 or something else.

so projectName should be repo name?

so projectName should be repo name?

Your CLOUDFLARE PAGES PROJECT NAME


Added new Section (Protection from Covid19)

Added new Section (Protection from Covid19)
Add your description
Related Issues: #203

Closes #203

Issue
#203
Checklist

[x] I have gone through the [contributing guide](## PR Description

Add your description
Related Issues: Issue for which you are raising a PR for

Closes #

Issue
[Issue number or description]
Checklist

[ x I have gone through the contributing guide
[x] I have updated my branch and synced it with project main branch before making this PR
[x] Is this a bug fix/enhancement/documentation changes
this is enhancement

Undertaking
I declare that:

The content I am submitting is original and has not been plagiarized.
No portion of the work has been copied from any other source without proper attribution.
The work has been checked for plagiarism, and I assure its authenticity.

[x] I have updated my branch and synced it with project main branch before making this PR
[x] Is this a bug fix/enhancement/documentation changes
[x] Part of GSSOC
[x] Tested for any breaking changes
[x] Other relevant checks completed

I understand that any violation of this undertaking may have legal consequences that I will bear and could result in the withdrawal of any recognition associated with the work.

[x] I Agree

https://github.com/Anishkagupta04/RAPIDOC-HEALTHCARE-WEBSITE-/assets/137484958/cf261263-9fd7-46be-838e-98d3ca7b09fb


Praise - Not Issue

I had literally started writing code in VS just now to build a quick and dirty console app to just write me a layout.json file for 144 textures before I stumbled across your app here. Saved me at least an hour!
Cheers!

Thanks for the comment! Glad this little project was of use to you!


Permit lodash version 3 to also be acceptable within npm

The sendgrid-nodejs project leverages the following lodash functions:

isObject
extend
isEmpty
merge

Based on the lodash changelog, _.isObject had some optimizations and _.merge had some sanity checks introduced (which wouldn't impact the usage within sendgrid.js).
All tests pass.
This PR tells sendgrid to permit both the v2 and v3 of lodash, but tells it to prefer the v3 branch.

Thanks for the PR!


CompileAnalysis contains many redundant strings

While upgrading our repository from zinc 0.13.9 to 1.1.7, we experienced an increase in memory usage. After investigation, it was likely because during the upgrade we switched to using name hashing (by virtue of the previous implementation having been removed). We've found other solutions to this increase, so it isn't currently a blocker.
But while inspecting heap dumps during the investigation, I noticed that the object graph below CompileAnalysis contains highly redundant strings. For one module, we saw 2708 distinct occurrences of the string "java" (representing ~130KB on the heap), 789 instances of "equals", 287 instances of "findByName", etc.
The distribution of occurrences and their redundancy for that module was:
redundancy	count
1		8210
2		809
4		550
8		839
16		423
32		68
64		24
128		26
256		2
512		33
1024		17
2048		4
4096		2

(ie, there were 17 distinct strings that occurred between 512 and 1024 times in this module alone)

I started in on a patch to intern strings during protobuf deserialization, which I expect would significantly reduce this redundancy.
But while doing that it occurred to me that a more efficient and typesafe solution would be to change the protobuf schema to store the interned string values once (ie, by replacing string with message InternKey {int32}). This would be similar to the Java classfile constant pool.

Funny that you report now, I was profiling this a week ago and also saw the brutal amount of objects that Zinc was allocating. Aside from the strings I also saw a lot of name hashes created and other intermediary objects that could be removed.
I don't know to which extent the protobuf deserialization logic is involved with the creation of these objects. I would expect that the majority of them are created from the bridge when compilation happens. I think the best way to solve this problem is via pooling (as we do in the compiler with term and type names).

But while doing that it occurred to me that a more efficient and typesafe solution would be to change the protobuf schema to store the interned string values once (ie, by replacing string with message InternKey {int32}). This would be similar to the Java classfile constant pool.

I agree this is a superior solution than String.intern, which can have unexpected results if the JVM string table gets too full. Are you going to submit a patch with this improvement?
I wanted to take a shot at reducing the high consumption of name hashes during compilation this weekend (the other main source of allocation). Let me know if we're not stepping on each other's toes! I'm happy to defer these tasks to you if you're already looking into all of them.

protobuf deserialization logic

To be clear, I'm not blaming the deserialization logic: since most of the objects created there are short lived, they should get cleaned up quite easily. I was just editing there because that was the easiest place to introduce the interning.
Rather, I'm concerned with the memory held by a CompileAnalysis object as it is held in memory over longer periods. Before switching from loose classfile inputs to jars, we were not able to hold all of the CompileAnalysis for the dependencies of our largest targets in a 6GB heap at once, which meant that the upgrade was causing OOMs (again, "fixed" by switching to jar classpaths).
So it's not about throughput, but rather about total memory usage.

I agree this is a superior solution than String.intern, which can have unexpected results if the JVM string table gets too full. Are you going to submit a patch with this improvement?

I could, but it would be a big protobuf schema change... is there appetite for that?

I would welcome that change. So long as we can keep the old reader and and a new reader/writer for the same version, it's good for me (so that we can reuse previously generated analysis files).
The problem we're trying to solve here is pretty fundamental so I see value in it. This would also reduce the size of the analysis file considerably.

I have some staged changes to fix this, so I'll submit them soon. After the PR, any help regarding further profiling would be welcome.

I was looking at the #1326 and looks like the intern optimization is gone.
Shall first enable benchmark for analysis serialization/deserialization performance and then add the optimization back if it does not affect performance (which I doubt it would).


#250 - remove excessive ToList calls in perfomance critical places

I checked main EntityFramework project for ToList calls, and replaced some of them. There are some more places to fix, but they need more careful editing.

@Backs,
Thanks for having already signed the Contribution License Agreement. Your agreement has not been validated yet. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot


Wiki translation

Need help with translation of "Usage" wiki page

If there is English text, I can translate. Unfortunately I have no more idea about Russian.


Refs #33022 -- Fixed test isolation issues in MigrateTests.

ticket-33022
Thanks to Chris's first efforts, I narrowed the failure to test_custom_user followed by test_migrate_partially_applied_squashed_migration, which I contributed in 910ecd1b8df.
Try:
.tests/runtests.py migrations.test_commands.MigrateTests migrations.test_executor.ExecutorTests -k test_custom_user -k test_migrate_partially --shuffle<PHONE_NUMBER>
This diff solves it, but I am not 100% certain of the correct cleanup behavior in test_custom_user.

Thanks for the patch, however I don't think it's a correct solution. This is an isolation issue in test_migrate_partially_applied_squashed_migration and fix should be added to it.


Documentation issue (code different than the DOM)

Hello
It seems that the code proposed for the popin : https://boosted.orange.com/docs/4.5/components/modal/#orange-popin does not correspond to the example shown.
Notably, the code proposed does not include FLEX which are existing if we inspect the popin code.

You're right, it's not using cards anymore. thanks for spotting this!

Sure, no problem :)
Could you please let us know when the code has been corrected on Boosted ?
Thanks in advance


CameraPreview freezes during startVideoRecording on iOS

The CameraPreview view freezes momentarily while calling CameraController.startVideoRecording() on iOS devices.
This is caused by:

The calls to stopRunning() / startRunning() in startVideoRecording() (these seem unnecessary?).
and the call to setUpCaptureSessionForAudio().

Both of these must be commented before the CameraPreview view will cease freezing for ~1 second.

Looks similar or at least related to #25959

I created this issue separately to #25959 as they will both need to be fixed in different ways.
For this problem, I would recommend:
a) Stop calling stopRunning / startRunning from within startVideoRecording, unless we need that
b) and create a new operation 'prepare:forVideoRecording' that does the heavy listing to prepare the audio for video/audio recording so it can be done early, or when the user say toggles a 'Video Recording' mode in their app.

To reproduce, run the demo on an iOS device and press the videocam icon: https://pub.dartlang.org/packages/camera#-example-tab-

[✓] Flutter (Channel beta, v0.11.9, on Mac OS X 10.13.6 17G3025, locale en-US)
• Flutter version 0.11.9 at /Users/cvolzke/development/flutter
• Framework revision d48e6e4 (6 weeks ago), 2018-11-20 22:05:23 -0500
• Engine revision 5c81474
• Dart version 2.1.0 (build 2.1.0-dev.9.4 f9ebf21297)
[✓] Android toolchain - develop for Android devices (Android SDK 28.0.3)
• Android SDK at /Users/cvolzke/Library/Android/sdk
• Android NDK location not configured (optional; useful for native profiling support)
• Platform android-28, build-tools 28.0.3
• Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
• Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1136-b06)
• All Android licenses accepted.
[✓] iOS toolchain - develop for iOS devices (Xcode 10.0)
• Xcode at /Applications/Xcode.app/Contents/Developer
• Xcode 10.0, Build version 10A255
• ios-deploy 1.9.4
• CocoaPods version 1.5.3
[✓] Android Studio (version 3.2)
• Android Studio at /Applications/Android Studio.app/Contents
• Flutter plugin version 31.3.1
• Dart plugin version 181.5656
• Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1136-b06)
[✓] Connected device (1 available)
• Guy Ronen’s iPhone • 7ddc980a43e74699578777e6435afcee2dd2d717 • ios • iOS 11.4.1

I've added a pull request here: https://github.com/flutter/plugins/pull/1023

I think it's safe to close the issue as the PR was merged already on March 13. Please comment if you encounter it again.


Regarding SQL Database Support of Availability Zones

https://azure.microsoft.com/is-is/blog/azure-sql-database-now-offers-zone-redundant-premium-databases-and-elastic-pools/
I assuming that the, Availability Zones of SQL Databases is only supported for premium tiers.
or does the Standard Tiers SQL Database will support the Availability Zones?
Thanks,

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cca70845-100f-2cfd-aba3-34b7fa4a5264
Version Independent ID: 475b26e5-9e23-f769-3bd5-cbc4a678dbf0
Content: What are Azure Availability Zones?
Content Source: articles/availability-zones/az-overview.md
Service: azure
GitHub Login: @cynthn
Microsoft Alias: cynthn

@cynthn Thanks for the feedback. We are currently investigating into the issue and will update you shortly.

@KeiroKamioka0000 Yes your understanding is correct, As of now Availability Zone is supported in Premium tier only.
Please refer this doc for reference.
Please let us know if you need more information.

Thanks, in the document....
As example, [Service Bus (Premium Tier Only)] it mention Premium Tier Only.
However nothing mentioned for the SQL Database, since if only supported by Premium Tier only.
This document should mention about this.
So it should show SQL Database (Premium Tier Only) instead of just say SQL Database.

@KeiroKamioka0000 Thanks for your suggestion. I believe there is some misunderstanding in reading this document. In the document they have mentioned the Services that support Availability Zones, and Service bus which Availability Zones supports is Premium Tier Only. So AZs are supported with Premium Tier only for all the services mentioned. I believe there is no need to mention the tier explicitly for all the services.
I hope there is no confusion now.

We will now proceed to close this thread. If there are further questions regarding this matter, please comment and we will gladly continue the discussion.


feat(angular-table): adds Angular adapter for tanstack/table

This is WIP PR that adds Angular adapter for tanstack table

Woo! 🎉

I don't understand what happened to this PR. Is this implemented in some other way?


ROX-27268: Run local-sensor in CI with debug logs by default

Description
Local-sensor is used in Sensor integration tests in CI. It would be useful to make it print debug logs by default, so that an analysis of potential flakes is faster.
User-facing documentation

[x] CHANGELOG is updated OR update is not needed
[x] documentation PR is created and is linked above OR is not needed

Testing and quality

[x] the change is production ready: the change is GA or otherwise the functionality is gated by a feature flag
[ ] CI results are inspected

Automated testing

[ ] added unit tests
[ ] added e2e tests
[ ] added regression tests
[ ] added compatibility tests
[ ] modified existing tests

Nothing - running existing tests should be enough
How I validated my change
Locally
$ KUBECONFIG="$HOME/.cluster/kubeconfig"  ./tools/local-sensor/scripts/local-sensor.sh -v -b

============== local-sensor ==============
RUN_BUILD           = yes
RUN_GENERATE        = no
RUN_TEST            = no
VERBOSE             = true
LOGLEVEL            = debug
OUTPUT_DIR          = /Users/prygiels/src/go/src/github.com/stackrox/stackrox2/tools/local-sensor/out
K8S_EVENTS_FILE     = /Users/prygiels/src/go/src/github.com/stackrox/stackrox2/tools/local-sensor/out/trace.jsonl
FAKE_WORKLOAD_FILE  = /Users/prygiels/src/go/src/github.com/stackrox/stackrox2/scale/workloads/default.yaml
POLICIES_FILE       = /Users/prygiels/src/go/src/github.com/stackrox/stackrox2/sensor/tests/data/policies.json
TIME_FILE           = /Users/prygiels/src/go/src/github.com/stackrox/stackrox2/tools/local-sensor/out/time.txt
LOCAL_SENSOR_BIN    = local-sensor
PROMETHEUS_ENDPOINT = http://localhost:9090
PROMETHEUS_QUERY    = rox_sensor_sensor_events
PROMETHEUS_DUMP     = /Users/prygiels/src/go/src/github.com/stackrox/stackrox2/tools/local-sensor/out/sensor_events_dump.json
ROX_METRICS_PORT    = :9091
==========================================
Building local-sensor: local-sensor
Build done

and then
export LOGLEVEL=debug  # this works without this PR locally, but still wanted to confirm it
./tools/local-sensor/out/local-sensor

and notice many log messages with debug level.
On CI

See the logs from the run of  gke-sensor-integration-tests in CI (when the run finishes)

This one didn't work.

See  the logs from the second run of  gke-sensor-integration-tests in CI

/test gke-sensor-integration-tests


All docker containers exit with FATA[2426] unexpected EOF

I have a CoreOS machine, running 10 containers.
Most of them are microservices with io.js/express ( there's also a MongoDB and a REDIS db ).
I noticed a couple of times all of them exited together(!).
Here's docker ps -a after the "crash"

And here's docker logs -ft entry-layer terminated from the crash

( note: if I try to print the logs again, I don't see that error code, which is not helpful. I wouldn't see that error if I didn't have that terminal running, right? Is there another way to catch it? )
Where is this error coming from? I mean it has to be docker related, since it makes all the containers to crash somehow... Or is it related with CoreOS?
Any idea where to see the error codes and debug it somehow?
Thanks.

Smells like your box is running out of memory and the kernel is killing things trying to get some back.
Try logging into the box and running dmesg. Look for out of memory alerts (search for the text Out of memory).

Oh, and if you're using coreos, it's also possible the box is doing it's automatic upgrade. Check uptime on the box to see if it's rebooted. Also check journalctl -u docker.service to see if the docker daemon is being restarted for some other reason.

@phemmer Sounds like you found it.
[1777343.640585]  [<ffffffff81141d2f>] out_of_memory+0x4bf/0x4f0
[1777343.959234] Out of memory: Kill process 19062 (node) score 235 or sacrifice child

So should I limit the memory on each container? or do I just increase the RAM in my VM?
Thanks.

Also, how can I see how much memory each container asks for?
Is that still not provided somehow? ( http://stackoverflow.com/questions/18956063/memory-usage-of-docker-containers )

@AntouanK If prod, always setup RAM/CPU limits for your containers :)
You can see what individual processes are using in the container with docker top <container>
You can see the overall cpu/mem/net usage via docker stats <container>

Of course there is a stats command...
https://docs.docker.com/reference/commandline/cli/#stats
I should check the CLI first...
Thanks @cpuguy83

Are we good to close this issue?

Yeah. Thanks for the help...

The status codes you see from docker ps are from the application in the container, not Docker,
Is that what you're referring to?

@cpuguy83 Well, those FATAL[0000] type of errors are from Docker, right?
Check the screenshots above to see what I mean.

Yes, but they're from the docker client. The OOM killer likely killed the docker daemon on the remote host, so your docker client dumped that EOF error because it lost the connection.

Yeah, sounds like it. My current issue is completely solved.
I'm saying, just for future reference, is there a list somewhere to see that error code 2426 refers to for example?

I'm pretty sure that's a timecode or something from the logger.


Change to the latest container

These should also be changed so that the pushing to dockerhub works. But maybe you could consider adding your own credentials as secrets and use them?

Right, lets leave it as it is then for now. I am changing it back!

Ok.

I have now adressed all the comments above.


S3DIS preprocessing

First of all, thanks for sharing your amazing work and code.
By the way, we have a single question on S3DIS dataset preprocessing.
The size of S3DIS you provided is about 4GB, which is much lighter than standard S3DIS dataset (about 60 GB).
Could you share preprocessing method for the S3DIS dataset?

Thanks for your comments.
We use the preprocessed dataset provided by PointWeb since it is well-organized and easy to use. It merges the annotation and original points data. You may refer to PointNet. It provides the script for S3DIS preprocessing.

Thanks for your explanation! It helps a lot :)

@honggudrnjs
Hi,
Do you know how to generate the .h files for S3DIS dataset in the downloaded dataset? Thanks a lot. Best wishes.

Xiaobing

@Dingry
Hi,
Do you know how to generate the .h files for S3DIS dataset in the downloaded dataset? Thanks a lot. Best wishes.
Xiaobing

@mutianxu
Hi,
I have seen the code, this answer only merges the annotation and point cloud. But it does not include the generation of .h files. According to the downloaded S3DIS dataset, the .h files are generated by the author at first? I have no idea. Could you please provide what the .h files contain? or the code? Thanks a lot.

Hi,
Do you mean the .h5 files used in our methods? PointNet also preprocesses it, I think the processing code can be found in this repo.

Hi @Dingry ;
I have generated the .h5 files now. But the number of .h5 files generated is not equal to the .h5 files downloaded. What's the difference? How to set the H5_BATCH_SIZE to make the generated .h5 files equal to downloaded files? Thanks.

Hi @Dingry ：
I only generated 24 .h files, but the author has provided 23585 .h files. I have no idea how to generate 23585 .h files. Could you please provide some information of generating 23585 .h files? Thanks a lot.

I have controled the H5_BATCH_SIZE setting as 2, but I can't obtain the files, with each of the same size, for example in the downloaded file of 150MB. The files I have generated have different sizes, for example 170MB or 140MB. Do you know how to control the size of the generated .h files?