[New Scheduler] Brief etcd unavailability can result in specific action queue to get stuck if unlucky

I had an action queue get into a stuck state after about two seconds of etcd downtime while other actions were able to recover gracefully. Essentially what it appears happens is that the queue endpoint key times out in etcd and no longer exists, but the controller doesn't hear this and continues to think the scheduler endpoint of the queue is on the same scheduler endpoint (I believe WatchEndpointRemoved should be sent to the controllers in this case but that doesn't seem to have happened). In the QueueManager of the scheduler the activation it was sent to, it then hits this code path because the queue doesn't exist on the host it sent it to and tries to remotely resolve it through etcd but the queue endpoint doesn't exist in etcd:
      case t =>
        logging.warn(this, s"[${msg.activationId}] activation has been dropped (${t.getMessage})")
        completeErrorActivation(msg, "The activation has not been processed: failed to get the queue endpoint.")
    }}

All requests for this action will then be dropped in the QueueManager unless the schedulers are restarted. Is there any way to make this more resilient so that if something gets stuck in this edge case, we can recover somehow without requiring a restart? @style95
Additional logs for the timeline:
How I know connectivity to etcd fails is this logs emits for two seconds from the controller before all activations for that action begin to fail and all other actions become fine again.
[WARN] [#tid_T8Gk2BdDdf4PIjq8W8Ta12kD0ZAOMgwE] [ActionsApi] No scheduler endpoint available [marker:controller_loadbalancer_error:2:0]
Then from the invoker this log is emitted from the containers that exist for the action until the schedulers are restarted:
[ActivationClientProxy] The queue of action [REDACTED] does not exist. Check for queues in other schedulers.

Let me look into it.
But I see some issues and questions at first glance.
I found the default lease timeout is 1 second.
https://github.com/apache/openwhisk/blob/master/ansible/group_vars/all#L467
An intermittent network rupture can happen at any time, this should be bigger than 1s.
It could easily break the system with short network unavailability and we are using 10s in our downstream.
I think it is better to update the default.
Regarding the error The activation has not been processed, the queue manager is supposed to retry until it fetches the endpoint. It is supposed to retry up to 13 times with exponential backoff starting with 1ms and the total wait time would be around 8 seconds(1ms + 2ms + 4ms + ... 4096ms).
Was there such a log?
Also, when an endpoint is removed while there is actually a queue, the system is supposed to restore the etcd data until the data is explicitly requested to be deleted.
Regarding the error, No scheduler endpoint available, it conforms to the existing behavior of the ShardingPoolBalancer that no retry is performed when there is any issue in Kafka.
https://github.com/apache/openwhisk/blob/master/core/controller/src/main/scala/org/apache/openwhisk/core/loadBalancer/CommonLoadBalancer.scala#L210
But I feel it would be better to add a retry mechanism here too.
In general, there was a but in the code and we recently fixed it with the following.
https://github.com/apache/openwhisk/pull/5251
Need to see if it could cause any regression.
@ningyougang @jiangpengcheng
Do you have any idea?

But I feel it would be better to add a retry mechanism here too.
I agree.
Do more test for case (make etcd downtime for several seconds while invoking 10 actions, make etcd lease time to 1 second)
Currently, @style95 is doing rebase work, i think after rebase work finish, can do this test work.

My local etcd lease timeout is 1. I'm updating it to 10 today as recommended by your current downstream.
Regarding the queue manager and retrying 13 times to get the queue lease from etcd with exponential backoff, the issue is not being able to get the lease it's that it no longer exists so there is no longer a queue for this action.
Order of events:

Couple second network blip with etcd results in leases timing out
Etcd connectivity recovers.
However the lease for the queue has failed by this point and the queue thus is removed
The controller is supposed to get notified when a WatchEndpointRemoved occurs for the respective lease so that it updates that it needs to send a new create queue request to a scheduler endpoint. However for whatever reason this doesn't occur and the controller thinks that the queue is still on the old scheduler host.
The controller continues to send activations to this scheduler which no longer has a queue for this action, which falls back to remote resolution so it tries to lookup the lease in etcd to find the correct scheduler to forward this activation to.
It then doesn't know what to do and fails the activation with The activation has not been processed since there is no lease available for the queue.
The controller keeps sending activations to this scheduler forever hitting this case and failing all activations for this action unless the hosts are restarted

Hopefully increasing the lease timeout helps so that these short network issues do not result in losing leases. However that doesn't fix the issue of very specific edge cases not being able to gracefully recover when a lease is inevitable lost and needs to get recreated.
At least for this specific case I have two suggestions,

Is the controller can cache and periodically check the queue lease still exists if not create new queue maybe? That way you won't resolve immediately, but at least can resolve after some time without restart. Though don't know if there's any case there where you could have duplicate queues for an action.
To recover immediately, instead of failing the activation in this case when the lease no longer exists for the action queue when you hit this case can we instead recreate the queue locally in the scheduler it was sent to and then it recovers rather than fail the activation and all subsequent activations? Or is this also a dangerous suggestion?

One thing I couldn't get it is when a lease is removed for some reason, the system is supposed to recover the lease and all data.
Since the network rupture can happen at any time, the should be resilient with them.
When I design the new scheduler, that was the main requirement and we had tested many times.
But it seems the data is not properly recovered in your case and that's my question.
Regarding the cache about the scheduler endpoint, I think that would be a good improvement.
Currently, if no scheduler endpoint is found, it will just fail activations.
But we can make controllers send activations and queue creation request to the scheduler side anyway(with cached endpoints as long as it is reachable), and make schedulers handle the remaining.

So for what it's worth, I've yet to see this issue again since I raised the etcd lease timeout to 10 seconds from 1 second and it's been a couple weeks. So my theory was that 1 second was too short and it was facing a cyclical race condition where it would ask for a new lease, it writes it but by the time it tries to write again the lease has expired again and it's now going be stuck in this loop. That's my theory at least, I don't have proof in the code; but if you want to take a look at the code based on this knowledge that does seem to have fixed it


Fbx Import for Camera Tracking

Is your feature request related to a problem? Please describe.
No.
Describe the solution you'd like
It would be great if you could make it possible to import fbx animations from blender for example to nerfstudio as camera path. Some other Nerf generating application is able todo so and this makes things easier.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

This would be a nice feature to include. Do you know of other nerf libraries that have this support that we can reference?

Hi,Yes there is one that allow that and you can export an animation From Blender as fbx and import directly to there. It is https://lumalabs.aiNot sure if this answers your question.BRMarkusAm 28.11.2022 um 00:39 schrieb Matthew Tancik @.***>:
This would be a nice feature to include. Do you know of other nerf libraries that have this support that we can reference?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

Thanks for the extra info! Luma is unfortunately closed source so there isn't much we can gleam from them. There doesn't seem to be an easy to use python FBX library that I can find. Autodesk FBX library doesn't have a pypi package and py-FBX appears to be an unfinished project. I'll keep searching...

Yea, that could work, can you provide examples of other python based software doing this?

A software like the foundry nuke can import fbx/abc camera system and in the attributes of the camera it converts xyz position rotation to world matrix
from there you can use the scritping panels to write some code to export out a camera_path.json that can be imported in nerfstudio
there is non commercial nuke here
https://www.foundry.com/products/nuke-family/non-commercial
Hope it helps

We will add a blender workflow which will hopefully capture this workflow in #1218

A software like the foundry nuke can import fbx/abc camera system and in the attributes of the camera it converts xyz position rotation to world matrix
from there you can use the scritping panels to write some code to export out a camera_path.json that can be imported in nerfstudio

Can we re-open this? A direct fbx/abc export it will have a more universal integration coverage.

We weren't sure how to add this functionality in practice. Do you have any ideas?

You can use the python API https://docs.alembic.io/python/examples.html


Add Gene drop down is unresponsive

The Add Gene drop down is unresponsive.
Steps to reproduce:

Prod
Click into add genes
Scroll to click on additional genes, nothing happens
Desired behavior
Drop down immediately shows gene as selected

See below video:
https://images.zenhubusercontent.com/228681195/1641f4cc-edb9-4171-af8f-baf77ac67e2f/screen_recording_2023_07_19_at_8_44_45_am.mov
NOTES:

~Use SDS Dropdown buttons prop: demo~: Actually we're still using SDS MenuSelect, so we need to implement the buttons ourselves. But doesn't seem too bad! Code

It'd take a lot longer to fix the heatmap freezing issue, since it involves performance profiling, finding top bottlenecks, and derive potential solutions from there

Update the dropdown to not render heatmap until dropdown is closed. If the lag is fixed, then we confirm that the heatmap rendering is causing the dropdown to lag.

@signechambers1 @hthomas-czi Need some design/product work to figure out a good solution assuming that the Apply/Cancel pattern is required

@tihuan Please link to SDS ticket here

I asked SDS if they could add Cancel/Apply buttons for us in the ticket above 👍

I asked SDS if they could add Cancel/Apply buttons for us in the ticket above 👍

Closing, no longer an issue.


Only Certain Hotkeys Bindable

OS:
Windows 10 Pro
Issue Descriptions:
Can only bind certain keys as hotkeys. I can only bind certain keys as hotkeys, like ctrl-s, ctrl-shift-w, etc. I cannot bind other keys like Space, ` or Print Screen
I think this is more of a feature than a bug though.
Thanks.

Confirmed that I can only use ctrl+whatever on macos.

This is intended behavior, this hotkeys are global and prevent the original action of the keys when used.  If we let you set "space" as your global hotkey you would never be able to hit "space" in another application.  We're protecting you guys by enforcing this criterea.

I just want to be able to use my mac play/pause button but it will not work.

@abrambailey If they do not work then another application has seized control of them, possibly Chrome itself.
Check out the FAQ https://github.com/MarshallOfSound/Google-Play-Music-Desktop-Player-UNOFFICIAL-/wiki/FAQ#my-media-keys-dont-work

CTRL-SHIFT + whatever is working beautifully for me.

@MarshallOfSound Bit of an oddball here, but I play music when I'm in iRacing or other racing games.
The wheel I have along with the button boxes show up as their own game controllers.
Since it's not related to the keyboard, could game controllers bypass the CTRL lockout?

This behavior is really annoying. I use Emacs, so I extensively use Ctrl for keybindings there. I would much prefer to use the Super (windows) key for 'global' keybindings. Although I can do that just fine for playback (using Gnome's media keys), I can't do the same for Thumbs Up, which is the main reason I use a desktop client (don't really want to interrupt what I'm doing to give a song a thumbs up).
I've been using Nuvola for a while; I love their keybindings, but it's nowhere near as stable or pretty as GPMDP. I want to make the switch, but until I can use more keys for keybindings I can't really do it.
Although unrelated, another awesome hotkey would be to 'bring up' the client if it's minimized/closed to tray/behind another window.

Just in case it's useful for anyone, I wrote some python scripts to 'like' songs and to bring the player forward so I could assign any keybindings :)
https://gist.github.com/aiguofer/bcc3fbc899d162ff3e69a13db18e1ebe


Research: identify commands to refactor to async

Related to #2124
Now that we confirmed that we can use async without losing coverage, let's have a look at our codebase and identify commands that could benefit from refactoring promises to async. I know that we have some commands where we pass around promises and which makes the code unnecessarily complicated, so if we refactored it to async, it would simplify maintaining that code going forward.
Let's log the identified commands below and we can later create separate issues for them to track the work independently.

Hey @waldekmastykarz , so to be just to be clear, the commands we are looking for are like teams channel get where we are getting teamId from teamName, we could refactor this function to be async  and then keep the the main function request as a promise (no change) as there is no added value there.

This is an easy case. Cases like https://github.com/pnp/cli-microsoft365/blob/7d100202b667e69f83848dd832c524e784b40940/src/m365/tenant/commands/auditlog/auditlog-report.ts#L94-L110 would benefit more so ideally we should handle them first.

Something like this too where we can break down the chain of 3-4 promises into multiple functions ? Or should we only look at the ones which are already separate functions to start with
https://github.com/pnp/cli-microsoft365/blob/266fd8d68e2a71a9c3d8d58d5c133916193f99b9/src/m365/aad/commands/approleassignment/approleassignment-add.ts#L69-L158

@vipulkelkar we could definitely refactor inline code to separate functions and call them async to make the code easier to follow.

https://github.com/pnp/cli-microsoft365/blob/c0d4238592eaff4038e3d26bb9634139dac26375/src/m365/aad/commands/app/app-add.ts#L89-L111

https://github.com/pnp/cli-microsoft365/blob/c0d4238592eaff4038e3d26bb9634139dac26375/src/m365/aad/commands/approleassignment/approleassignment-list.ts#L59-L104

https://github.com/pnp/cli-microsoft365/blob/c0d4238592eaff4038e3d26bb9634139dac26375/src/m365/aad/commands/approleassignment/approleassignment-remove.ts#L60-L137

https://github.com/pnp/cli-microsoft365/blob/c0d4238592eaff4038e3d26bb9634139dac26375/src/m365/aad/commands/o365group/o365group-add.ts#L64-L179

https://github.com/pnp/cli-microsoft365/blob/c0d4238592eaff4038e3d26bb9634139dac26375/src/m365/aad/commands/o365group/o365group-set.ts#L71-L180

https://github.com/pnp/cli-microsoft365/blob/c0d4238592eaff4038e3d26bb9634139dac26375/src/m365/file/commands/convert/convert-pdf.ts#L65-L107

https://github.com/pnp/cli-microsoft365/blob/4e51be5584b839453f9363b73ee22f0ea8ef3c1c/src/m365/flow/commands/flow-export.ts#L78-L171

@waldekmastykarz, shall we close this one, as we will be refactoring the entire codebase to Async/await?

Referencing https://github.com/pnp/cli-microsoft365/issues/3618

Yes, let's use the epic for tracking the feature and then separate issues for the different commands/areas.


PHP7 released!

PHP 7 is set to be released on December 3rd, 2015.

Shouldn't this be modified?

That's what Pull Requests are for.

I don't really know the project, I don't really know what it should be replaced with.
Would this be find?

PHP 7 has been released on December 3rd, 2015.


Giving files as context to Copilot autocompletion

I'd love it if it was possible to give files as context to the Copilot autocompletion, like you can for chat. I've found the options around customizing the prompt but my use case is that a lot of individual files in my codebase have a matching PDF spec, and I'd love to be able to give the spec as context for autocompletion in the individual files.

context to the Copilot autocompletion

You mean the ghosted text after the cursor, right?

Yes, not for chat but for code completion.
On Fri, Nov 15, 2024, 02:48 Johannes Rieken @.***>
wrote:

context to the Copilot autocompletion
You mean the ghosted text after the cursor, right?
—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/vscode/issues/233866#issuecomment-2478157248,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABAZQ5IIXEOME4DIHP4N432AWRODAVCNFSM6AAAAABRZYKLHGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZYGE2TOMRUHA
.
You are receiving this because you authored the thread.Message ID:
@.***>


[FEATURE REQ] Support 'stored' & 'metadata' in Azure OpenAI client for ChatCompetionsOptions

Is your feature request related to a problem? Please describe.
Support these 2 new parameters in the latest OpenAI chat completions API:

store = [true|false]: https://platform.openai.com/docs/api-reference/chat/create#chat-create-store
metadata = Map<String, String> : https://platform.openai.com/docs/api-reference/chat/create#chat-create-metadata

Additional context
These parameters are used for distillation. I don't think Azure supports it yet, but I'd like to at least use the client API against OpenAI endpoints. https://platform.openai.com/docs/guides/distillation
Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

[X] Description Added
[X] Expected solution specified

We would also like to use these params, any chance this can be picked up?

@thai-op
azure-ai-openai supports both Azure OpenAI and OpenAI endpoints. We are waiting for Azure OpenAI to support above new parameters before we can release the SDK. metadata will be supported in 2024-10-01-preview Azure OpenAI service API version, but I haven't heard any news about store yet. I will keep you posted when the release it out.

For those of you that want to continue to use Azure SDK but still also want to enjoy the latest OpenAI features, here's how I intercepted the HTTP requests and add store & metadata parameter into the chat completion request before sending it to OpenAI.
    static class OpenAIInterceptorHttpClient implements HttpClient {
        private final HttpClient delegate;
        private final ObjectMapper objectMapper = new ObjectMapper();

        OpenAIInterceptorHttpClient(HttpClient delegate) {
            this.delegate = delegate;
        }

        @Override
        public Mono<HttpResponse> send(HttpRequest request) {
            return delegate.send(request);
        }

        @Override
        public Mono<HttpResponse> send(HttpRequest request, Context context) {
            return delegate.send(request, context);
        }

        @SneakyThrows
        @Override
        public HttpResponse sendSync(HttpRequest request, Context context) {
            if (request.getUrl().getPath().endsWith("chat/completions")) {
                var modifiedRequest =
                        objectMapper.readValue(request.getBodyAsBinaryData().toString(),
                                InterceptedChatCompletionsOptions.class);
                var firstMessage = modifiedRequest.getMessages().getFirst();
                var metadata = new HashMap<String, String>();

                // if name is set on the first system or user message, then we'll automatically
                // store and tag those for distillation later
                switch (firstMessage) {
                    case ChatRequestSystemMessage system -> {
                        if (system.getName() != null) {
                            metadata.put("1stMessageRole", "system");
                            metadata.put("1stMessageName", system.getName());
                            modifiedRequest.setMetadata(metadata);
                            modifiedRequest.setStore(true);
                        }
                    }
                    case ChatRequestUserMessage user -> {
                        if (user.getName() != null) {
                            metadata.put("1stMessageRole", "user");
                            metadata.put("1stMessageName", user.getName());
                            modifiedRequest.setMetadata(metadata);
                            modifiedRequest.setStore(true);
                        }
                    }
                    default -> {
                    }
                };

                request.setBody(BinaryData.fromObject(modifiedRequest));
            }
            return delegate.sendSync(request, context);
        }
    }

Where the new intercepted requested payload is:
   @Data
    static class InterceptedChatCompletionsOptions {
        // new fields
        @JsonProperty(value = "store")
        private Boolean store;

        @JsonProperty(value = "metadata")
        private Map<String, String> metadata;

        // existing fields supported by Azure SDK belows
        @JsonProperty(value = "messages")
        private List<ChatRequestMessage> messages;

        @JsonProperty(value = "max_tokens")
        private Integer maxTokens;

        @JsonProperty(value = "temperature")
        private Double temperature;

        @JsonProperty(value = "top_p")
        private Double topP;

        @JsonProperty(value = "logit_bias")
        private Map<String, Integer> logitBias;

        @JsonProperty(value = "user")
        private String user;

        @JsonProperty(value = "n")
        private Integer n;

        @JsonProperty(value = "stop")
        private List<String> stop;

        @JsonProperty(value = "presence_penalty")
        private Double presencePenalty;

        @JsonProperty(value = "frequency_penalty")
        private Double frequencyPenalty;

        @JsonProperty(value = "stream")
        private Boolean stream;

        @JsonProperty(value = "model")
        private String model;

        @JsonProperty(value = "seed")
        private Long seed;

        @JsonProperty(value = "response_format")
        private ChatCompletionsResponseFormat responseFormat;

        @JsonProperty(value = "tools")
        private List<ChatCompletionsToolDefinition> tools;

        @JsonProperty(value = "tool_choice")
        private BinaryData toolChoice;

        @JsonProperty(value = "logprobs")
        private Boolean logprobs;

        @JsonProperty(value = "top_logprobs")
        private Integer topLogprobs;
    }

Then you can configure your OpenAI client to use the interceptor http client:
OpenAIClient openaiClient = new OpenAIClientBuilder()
                                .httpClient(new OpenAIInterceptorHttpClient(
                                        HttpClient.createDefault(new HttpClientOptions()
                                                .responseTimeout(Duration.ofSeconds(300))
                                                .setApplicationId("openai"))))
                                .buildClient();

It's a hack, but it's what we have to deal with to be able to both use Azure OpenAI & the regular OpenAI via the same SDK. Hopefully the Azure SDK team can use this example improve their API so that we can easily add new parameters without much customization while waiting for Azure to catch up with OpenAI new feature.


throttling or debouncing interval [feature erequest]

Would it be possible to add some kind of configuration to receive at-most on event every n seconds?
Without implementing this manually in user-space with lodash.debounce?

Not likely. The issue I see here is that an IO capture library should capture all events, implementing some form of filter should be something added-on, not a part or feature of the capture solution. Debouncing is the wrong term here too. The possible use for such a feature would be time-delimited repetitive action activated on IO events, but not debouncing.
This will be left open as a feature request and the way I think this should be implemented (if implemented) would be something like a frequency filter iohook.setFrequency('mousemove', 0.2) (1 of every 5 consecutive mousemove events will be propagated) or something similar.


Input: Date type defaults to today's date in Safari

Describe the bug
In Safari, the input component of type date, datetime-locale or time all render with today's date and/or time.

In the imge above the input is bound to a form control with an initial value of null.
Safari Version: 17.1 (196<IP_ADDRESS>.7)
MacOS Version: 14 (Sonoma)
Problem does not seem to occur in Chrome. Have not tested FireFox or Edge.
Provide Code
Angular: "@angular/core": "~16.1.0",
Web Components: "@abgov/web-components": "^1.14.0",
Angular Web Components: "@abgov/angular-components": "^2.5.0",
Angular standalone component.
In Template
<goa-input
    goaValue
    name="birthDate"
    data-cy="birthDate"
    type="date"
    [min]="minDate"
    [max]="maxDate"
    placeholder=""
    [formControl]="formGroup.controls.birthDate"
    [value]="formGroup.controls.birthDate"
  >
  </goa-input>

In implementation
public formGroup = new FormGroup<PreScreenType>({
    isApplyingOnBehalf: new FormControl(null, { validators: [Validators.required] }),
    isInAlberta: new FormControl(null, { validators: [Validators.required] }),
    immigrationStatus: new FormControl(null, { validators: [Validators.required] }),
    birthDate: new FormControl(null, { validators: [Validators.required] }),
  });

To Reproduce

Create Angular 16 application
Import ReactiveForms module into component
Create FormGroup or FormControl to bind input to
Add input to page (as shown in code above)
Bind input
Set initial value to either (null, '', or undefined) in Form Control implementation (makes no difference in this case and results in the same thing)
Serve application
Browse to app in Safari

Relevant console log output
No response
What browsers are you seeing the problem on?
Safari
Additional context
No response

@ArakTaiRoth investigate if this is an issue with the native HTML component

@achantz Just letting you know we're closing this story. This is the default functionality of the default input type="date" component in HTML, so our component isn't doing anything different and it likely can't be fixed.

Hi Dustin,
Thanks for looking into this.
– Angelo

On Jun 6, 2024, at 4:26 PM, Dustin Nielsen @.***> wrote:
@achantz https://github.com/achantz Just letting you know we're closing this story. This is the default functionality of the default input type="date" component in HTML, so our component isn't doing anything different and it likely can't be fixed.
—
Reply to this email directly, view it on GitHub https://github.com/GovAlta/ui-components/issues/1455#issuecomment-2153501287, or unsubscribe https://github.com/notifications/unsubscribe-auth/AG3CEF5FAG26YGDSZ6YWICDZGDO3HAVCNFSM6AAAAAA7D3PWMOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJTGUYDCMRYG4.
You are receiving this because you were mentioned.


Wallet Restores

The wallet must be able to restore from the backups that it creates. I believe that this functionality is currently missing.

we can restore from seeds using InitFromSeed and LoadSeed; good enough?


feat(datastore.snomed): Improve suggested changes in SnomedQueryOptimizer

With the 1k value set, heap usage is around 300 MB:

I could not generate a chart for the 10k version, because with instrumentation the optimizing process takes a lot longer to run. But it seems that one goes up to 1.7 GB of heap usage.

With the 1k value set, heap usage is around 300 MB:

I could not generate a chart for the 10k version, because with instrumentation the optimizing process takes a lot longer to run. But it seems that one goes up to 1.7 GB of heap usage.

Hmm, that's a lot 😄 Would it be possible to identify areas where memory consumption could be lowered a bit? No need to refactor anything now, just mark variables, statements with a comment where optimization could take place.

I suspect most of that is going in the ECL evaluation cache, as the process invokes the evaluator with different expressions in quick succession. I will need to fire up a profiler to dig into allocation details.

I suspect most of that is going in the ECL evaluation cache, as the process invokes the evaluator with different expressions in quick succession. I will need to fire up a profiler to dig into allocation details.

Did you measure this with a dedicated Elasticsearch instance or in embedded mode?

ES was running separately, I'm thinking of SnomedConceptRequestCache here... maybe?

SnomedConceptRequestCache

That's only for data expansion queries, ECL caches are outside of Snow Owl.


DDC gets confused when Object has static members.

This CL adds static members to Object.
When building the SDK (tools/build.py -mrelease -ax64 create_sdk) I get the following error:
Command failed: tools/sdks/dart-sdk/bin/dart --dfe=tools/sdks/dart-sdk/bin/snapshots/kernel-service.dart.snapshot pkg/dev_compiler/tool/build_pkgs.dart --analyzer-sdk out/ReleaseX64/gen/utils/dartdevc/ddc_sdk.sum --kernel-sdk out/ReleaseX64/gen/utils/dartdevc/kernel/ddc_sdk.dill --output out/ReleaseX64/gen/utils/dartdevc
output: [error] Static members from supertypes must be qualified by the name of the defining type. (package:path/src/path_map.dart, line 9, col 62)
[error] Static members from supertypes must be qualified by the name of the defining type. (package:path/src/path_set.dart, line 9, col 58)

Please fix all errors before compiling (warnings are okay).

The path package library lines in question are:
/// A map whose keys are paths, compared using [equals] and [hash].

and
/// A set containing paths, compared using [equals] and [hash].

So, the error is in the unmatched reference in the DartDoc. Those should be [Context.equals] and [Context.hash]. However, that doesn't mean that finding the static hash in Object is in any way correct, because it is not visible at that point. The reference here is still just undeclared, it is not magically referencing the static Object.hash, and it is not OK to make it an error.
(Make it an error to have an undeclared reference, but don't invent references that are not there).
Blocking #11617

Blocking the CL https://dart-review.googlesource.com/c/sdk/+/73360

https://dart-review.googlesource.com/c/sdk/+/83223


change yapf default setting

working yapf version: 0.8.2

Well, when I run that, I get
Formatter yapf has errors: b'yapf: "\'{based_on_style:pep8,indent_width:4}\'" is not a valid style or file path\r\n' Skipping.

xD
Are you running vim from the terminal though?

yes I only use vim in terminal

Ok, since I can't use python in the terminal version on windows (which I'm on) for some reason, I can't test this myself on terminal vim.
Would you care to try this out yourself in gvim on your system? Maybe there's a clue.

Well, I tested it in gvim, it works for me.

I tried it on my linux computer (ubuntu 14.04) and this solution worked for both vim and gvim. But the original definition also works there.
@cmcginty does this new solution work for you? If yes, this may be just a conflict between mac and windows.

related: https://github.com/Chiel92/vim-autoformat/issues/137#issuecomment-222916809

So on windows I get this errors message:
"~\.vim\bundle\vim-autoformat\samples\python.py" 208L, 8063C
Selected formatter: yapf
Formatter yapf has errors: b'yapf: "\'{based_on_style:pep8,indent_width:4}\'" is not a valid style or file path\r\n' Skipping.
Failing config: "yapf --style='{based_on_style:pep8,indent_width:4}' -l 1-208"
Definition in 'g:formatdef_yapf' was unsuccessful.
Definition in 'g:formatdef_autopep8' was successful.

From "\'{based_on_style:pep8,indent_width:4}\'" it seems that stuff is getting doubly escaped here. I need to investigate this further.

@WHQ25 @cmcginty I pushed a new definition to branch WHQ25-fix_yapf. Could you please check it out and see if that one works for you?

Sorry, gmail filed this issue incorrectly in my inbox. I'll test out the code tomorrow.

:+1:  works fine for me


If single viable target drive no information given

Currently, if there is only 1 viable drive to burn to, etcher auto-selects it. This is great, but you get no information about the size of the drive like you do when there are multiple available drives:

It'd be really nice to have the size perhaps in parens here as an extra source of calm that the drive is not in fact the system one :)

Looks reasonable. Its easy to implement, but we need to test in Windows to make sure a string like \\.\PHYSICALDRIVEN plus the size doesn't overflow or push things aside.


firebase push only work with opened app?

I've implemented FireBaseX in my Ionic 4 app to send remote notifications.
this.platform.ready().then(() => {
  let platforms = this.platform.platforms();

  if(platforms.includes('ios') || platforms.includes('android') || platforms.includes('mobile')){

    this.firebase.getToken().then(token => {
      console.log(`FIREBASE TOKEN ${token}`);
      if(platforms.includes('ios')) this.firebase.grantPermission();
    });

    this.firebase.onMessageReceived().subscribe(data => {
      console.log('FIREBASE MESSAGE', data);
    });

  }

});

So when I open the app in iOS, it asks for permissions correctly.
Then I send test message and the console.log() appears correctly.
2020-02-05 17:35:38.282123-0300 Parkaz[86464:2354851] didReceiveMessage: {
    "collapse_key" = "com.myapp.app";
    from = 678323471xxxx;
    notification =     {
        body = teste;
        e = 1;
        tag = "campaign_collapse_key_5659280550157990837";
        title = teste;
    };
}

However, if the app is not opened, nothing happens. The notification banner doesn't appear, no badge, no sound... nothing...
Am I doing something wrong?

How were you able to solve this? I've had this bug for months now. @leabdalla


Could not load file or assembly 'Neo.Lua, Version=<IP_ADDRESS>, ....

2:25:09 PM.828 ( 60 FPS)	Exception running asynchronous task:
System.AggregateException: One or more errors occurred. ---> System.TypeLoadException: Could not set up parent class, due to: Could not load type of field 'NeosWikiAssetGenerator.Type_Processors.NeosTypeProcessor:LuaInstance' (4) due to: Could not load file or assembly 'Neo.Lua, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=fdb0cd4fe8a6e3b2' or one of its dependencies. assembly:Neo.Lua, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=fdb0cd4fe8a6e3b2 type:<unknown type> member:(null) signature:<none> assembly:F:\Steam\steamapps\common\NeosVR\Libraries\NeosWikiAssetGenerator.dll type:NeosTypeProcessor member:(null) signature:<none>
  at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[TStateMachine] (TStateMachine& stateMachine) [0x0002c] in <9577ac7a62ef43179789031239ba8798>:0
  at NeosWikiAssetGenerator.WikiAssetGenerator.GenerateNew () [0x0001f] in <4b668905f0644cfa8a016fac336e4bf2>:0
  at NeosWikiAssetGenerator.WikiAssetGenerator+<<GeneratePressed>b__10_0>d.MoveNext () [0x0000f] in <4b668905f0644cfa8a016fac336e4bf2>:0
   --- End of inner exception stack trace ---
---> (Inner Exception #0) System.TypeLoadException: Could not set up parent class, due to: Could not load type of field 'NeosWikiAssetGenerator.Type_Processors.NeosTypeProcessor:LuaInstance' (4) due to: Could not load file or assembly 'Neo.Lua, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=fdb0cd4fe8a6e3b2' or one of its dependencies. assembly:Neo.Lua, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=fdb0cd4fe8a6e3b2 type:<unknown type> member:(null) signature:<none> assembly:F:\Steam\steamapps\common\NeosVR\Libraries\NeosWikiAssetGenerator.dll type:NeosTypeProcessor member:(null) signature:<none>
  at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[TStateMachine] (TStateMachine& stateMachine) [0x0002c] in <9577ac7a62ef43179789031239ba8798>:0
  at NeosWikiAssetGenerator.WikiAssetGenerator.GenerateNew () [0x0001f] in <4b668905f0644cfa8a016fac336e4bf2>:0
  at NeosWikiAssetGenerator.WikiAssetGenerator+<<GeneratePressed>b__10_0>d.MoveNext () [0x0000f] in <4b668905f0644cfa8a016fac336e4bf2>:0 <---

   at void BaseX.UniLog.Error(string message, bool stackTrace)
   at void FrooxEngine.CoroutineManager.CheckExceptions(Task task)
   at void System.Threading.Tasks.ContinuationTaskFromTask.InnerInvoke()
   at void System.Threading.Tasks.Task.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()
   at bool System.Threading.ThreadPoolWorkQueue.Dispatch()
   at bool System.Threading._ThreadPoolWaitCallback.PerformWaitCallback()

Copying Neo.Lua.dll from the nuget package dir (C:\Users\xxx\.nuget\packages\neolua\1.3.13\lib\netstandard2.0\Neo.Lua.dll) into Neos_Data/Managed solved that issue.
A bit hacky. Maybe it can go into the same directory as the plugin instead (Libraries)?

I set it up to copy to the plugins directory as you suggested, and provided it as part of the launch options for neos.
This will put an error in the log (since it's not a neos plugin), but will still load it into memory where it can be used by the asset generator plugin.
Fixed in 4bf69f8c9d289eebf23e21bbb9d91827200a2ded
Thanks!


fix(#1872): Changing Modal overlay background colour

@ArakTaiRoth We could use the modal opacity design token here:
https://design.alberta.ca/design-tokens/opacity

issue is verified on firefox and chrome, for react and angular

:tada: This PR is included in version 1.17.0-alpha.57 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 4.17.0-alpha.29 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.21.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 4.21.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 3.0.0-alpha.4 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 3.0.3 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Add support for 3.13

Add missing rebindings
Build package properly by overriding build_py cmdclass
Change .pth to single line, to avoid NameErrors, possibly due to this 3.13 change
bump fancycompleter to 0.10.6

Test are failing, will have to go through them and figure out which ones are actually failing and which ones are false positives


cargo loading into vesicle (GO:0035459) is_a complex assembly

cargo loading into vesicle (GO:0035459)
I guess becuse of the way it is defined
Definition | Parents
The formation of a macromolecular complex between the coat proteins and proteins and/or lipoproteins that are going to be transported by a vesicle.
It seems strange though....

Seems ok to me.

We wouldn't usually call the attachment of a cargo to something "complex-assembly" though.
This seems to be used to annotate a cargo receptor.  It still seems odd.
To annotate the complex you would need to annotate the complex+ it's transported substrates.
Are you sure that seems OK?

If it isn't the assembly of the cargo-receptor complex, then what is it, just binding? It seems to me that it is a special kind of binding that results in the cargo-receptor complex. @vanaukenk would this be a strategy to handle the more types of contextual binding cases?

I see, it's the is_a parent that's a problem.....it also has is_a transport, not sure if that is correct though?  maybe it is... but why is_a "transport" and part_of "vesicle-mediated transport"?
It still seems strange but now I think about it I remember questioning this before. I was just doing a quick check of our "protein complex assembly" annotations and this seems not quite right...

Leave if you think its OK

a) It depends on how you define a complex and if the receptor is a multi-protein unit that only forms when the cargo is bound, as in many membrane signaling receptors ;-)
b) I think the term name is confusing. The def describes essentially the docking of cargo to the vesicle coat proteins but the term name suggests it's the movement of the cargo INTO the vesicle.


Use aid.txt for getting analysis id

If this is going to be the way forward, needing to have the .prj_files directory in the workspace, then the documentation will need to be updated to state that this is a requirement.


PRs to fix patches in singleton-blobstore upstream project

./singleton-blobstore/blobstore/jobs/patch_blobstore_conf.sh
./singleton-blobstore/blobstore/jobs/patch_blobstore_pre-start.sh
./singleton-blobstore/blobstore/ig_resolver/patch_job_mf.sh

relates with #12


NoSuchElementException: packet-encoder - AbstractEventExecutor safeExecute

Waterfall dev 99 (MC 1.11.2)
11:47:56 [INFO] §9This server is running Waterfall version git:Waterfall-Bootstrap:1.11-SNAPSHOT:6844551:99 by md_5
11:48:00 [SEVERE] Jan 21, 2017 11:48:00 AM io.netty.util.concurrent.AbstractEventExecutor safeExecute
WARNING: A task raised an exception. Task: net.md_5.bungee.connection.InitialHandler$6$1@36fa3c47
java.util.NoSuchElementException: packet-encoder
	at io.netty.channel.DefaultChannelPipeline.getContextOrDie(DefaultChannelPipeline.java:1080)
	at io.netty.channel.DefaultChannelPipeline.addBefore(DefaultChannelPipeline.java:251)
	at io.netty.channel.DefaultChannelPipeline.addBefore(DefaultChannelPipeline.java:240)
	at net.md_5.bungee.netty.ChannelWrapper.addBefore(ChannelWrapper.java:115)
	at net.md_5.bungee.netty.ChannelWrapper.setCompressionThreshold(ChannelWrapper.java:127)
	at net.md_5.bungee.UserConnection.setCompressionThreshold(UserConnection.java:630)
	at net.md_5.bungee.connection.InitialHandler$6$1.run(InitialHandler.java:504)
	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:418)
	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:312)
	at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)
	at java.lang.Thread.run(Thread.java:745)

As per-usual: does this happen on BungeeCord?, and reproduction steps.

I'm not sure. I just upgraded from Waterfall dev 95 to 99, then noticed these NoSuchElementException errors starting to occur. The error has occurred 5 times thus far for me and always ~5-7 seconds after an InitialHandler has connected. Not after every connection, just randomly from different players.
I can swap over to BungeeCord and monitor the logs if you'd like me to see if it appears there. But as far as I can recall, this never use to occur on dev 95 of Waterfall.

We have the same thing happen to us, latest waterfall.

@jamierocks I can not seem to reproduce on Bungee, so I am assuming it is a problem somewhere with the commits I linked above.

Latest Waterfall, experiencing this issue too.
Saw on Internet Bungee fixed it in 2015, might aswell be a new issue...

@jamierocks Testing on BungeeCord dev 1225 for the last day or so, this error only managed to occur once when looking through the logs.
22:07:50 [SEVERE] Feb 01, 2017 10:07:50 PM io.netty.util.concurrent.AbstractEventExecutor safeExecute
WARNING: A task raised an exception. Task: net.md_5.bungee.connection.InitialHandler$6$1@578d7956
java.util.NoSuchElementException: packet-encoder
	at io.netty.channel.DefaultChannelPipeline.getContextOrDie(DefaultChannelPipeline.java:1080)
	at io.netty.channel.DefaultChannelPipeline.addBefore(DefaultChannelPipeline.java:251)
	at io.netty.channel.DefaultChannelPipeline.addBefore(DefaultChannelPipeline.java:240)
	at net.md_5.bungee.netty.ChannelWrapper.addBefore(ChannelWrapper.java:115)
	at net.md_5.bungee.netty.ChannelWrapper.setCompressionThreshold(ChannelWrapper.java:127)
	at net.md_5.bungee.UserConnection.setCompressionThreshold(UserConnection.java:613)
	at net.md_5.bungee.connection.InitialHandler$6$1.run(InitialHandler.java:497)
	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403)
	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:304)
	at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
	at java.lang.Thread.run(Thread.java:745)

I'm not sure why it occurs so frequently with Waterfall dev 99 (65 times for me). Presumably one of the commits I linked above may be isolating the actual problem more frequently? Not entirely sure. Would it be possible for you to add a bit of debug info that could help locate the problem?

Fixed upstream in BungeeCord.


Added the ability to enumerate using a specific usage page

This  is  helpful if  you need to target a specific vendor usage page

Hey, sorry I havent gotten this pushed to nuget. The build server is down, will be back up by EOW. If you need it pushed sooner let me know and I can push it manually.

No worries and thanks for the quick turn around on this.  I am building
from my fork and my release is still about 4 weeks out.  Once it is pushed
I will convert my build to use the Nuget package.  Thanks again, your
package has been a huge help.
Cheers,
-Bill
Bill Prescott
Director SW Engineering
Logitech Inc.
ph:<PHONE_NUMBER>
gv:<PHONE_NUMBER>
<EMAIL_ADDRESS>On Wed, Feb 1, 2017 at 7:44 AM, mikeobrien<EMAIL_ADDRESS>wrote:

Hey, sorry I havent gotten this pushed to nuget. The build server is down,
will be back up by EOW. If you need it pushed sooner let me know and I can
push it manually.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/mikeobrien/HidLibrary/pull/75#issuecomment-276691866,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADLdINZ5CLYLyzGK4062xxubfC3nawuRks5rYKhIgaJpZM4LwVxR
.

Pushed, see other thread.


120 frame flicker when load webview

when I use 13pro max\ 14pro max to load webview, in high frame rate ,I get flicker shadow when webview scrolling . you can try it,
must appear！！hope you fix it。

but when I use webview_flutter ,this donot appear. I checked the frame rate is bigger than 60.

but when I use webview_flutter ,this donot appear. I checked the frame rate is bigger than 60.

whats is your version of flutter? i have same problem, and this gone after update to flutter 3.3.4

Flutter  Channel stable, 3.0.2  ,when I update to  flutter 3.3.4 , I will comment the result

nope，when I update to flutter 3.3.4, this also appears , good news is : flicker shadow is better, but it also appears

Could you share a screen record of this issue please?

https://user-images.githubusercontent.com/12962946/194693754-a1d9292e-ec28-4746-89fe-8e8404fb5623.MP4
env:
[✓] Flutter (Channel stable, 3.3.4, on macOS 12.6 21G115 darwin-arm, locale
zh-Hans-CN)
[✓] Android toolchain - develop for Android devices (Android SDK version
32.1.0-rc1)
[✓] Xcode - develop for iOS and macOS (Xcode 14.0)
[✓] Chrome - develop for the web
[✓] Android Studio (version 3.4)
[✓] Android Studio (version 2021.2)
[✓] Connected device (3 available)
[✓] HTTP Host Availability
flutter_inappwebview: 5.4.4+3

https://user-images.githubusercontent.com/12962946/194693851-fe938e48-db68-46d0-b458-0bb98f6b1354.MP4
when I zipped this video , the situation is not obvious

13 pro max , did not limit iPhone high frame rate

When you release your finger and webview scroll naturally, the situation happens

this url contains lots of pictures ,so this happens. when url did not contains lots of pictures , may not appear

Could you share a screen record of this issue please?

hi , up stairs.

I'm using a real iPhone 12 Pro and I don't have any problem with scroll:
https://user-images.githubusercontent.com/5956938/197167405-e65d8452-b346-4ae6-a20f-af7247cb8e83.mp4
Unfortunately, I don't have an iPhone 13 to test 120 frame refresh rate, but it may be something related to how Flutter native views are rendered.

Also, check https://github.com/flutter/flutter/issues/90675


Fix documentation command for rust/workspace-crate

Current dependencies on/for this PR:

main

PR #11   👈

This comment was auto-generated by Graphite.


[tutorial] Build a Tooltip element

This is an advanced tutorial on building a tooltip element.

The tooltip shows/hides based on interaction with a target element.
The "on top" state is done with position: fixed which should suffice for most cases.
It's positioning is managed via a small third-party library.
A css transition is used to animate the tooltip when it's shown/hidden.
A lazy creation mechanism is provided to create the tooltip lazily when the user interacts with the target.
Finally, a tooltip directive is provided to declaratively leverage lazy creation.

lots of wording suggestions and suggestions to add switchable samples which are described in the CONTRIBUTING.md for tutorials

Seems like your samples are not compiling

This is awesome. Added a few minor suggestions.

Got a verbal LGTM from @kevinpschaaf.


Parallelise tests

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)

Resolves #912 (part 1)

/retest

/test pre-busola-integration-test-k3s

/test pre-main-test-infra-pjtester

/retest

/test all


handle payments with no gas cost for the sender ( or refilling sender )

Ethereum gas is always charged to the sender and is always payed in ether.

We need to find a way to relay that tx so that gas is payed by us or refill the sender address with enough gas.
Option txRelay
References
- https://github.com/Decentralized-Blockchain/uport-identity/blob/develop/docs/txRelay.md
- https://0xproject.com/
Option Refill
When a user wallet address doesn't have enough ether to execute a payment in Knowledge we
need to find a way to refill that address with just enough ether for that transaction.

We need to transfer that cost to the seller or the user in form a Knowledge fee. This is also challenging, how can we get a exchange rate ?  Perhaps in the form of pull oracle that always return the same exchange rate for all node for a given tx. eg. GET knowledgeapi.io/v1/exchange-rate?orderId=KNW872892LU8 . This involves risks and complexities that need to be properly assessed.

We need to SUPER careful not to open up a potential vulnerability.

About point 2, this is most probably going to be a back-end task, to pull the exchange rates and do all the conversions, not something the contract should care.

I also think refilling the accounts will have the worst UX, since we need to wait for the refill to be processed before doing the Knowledge tx

Your are right, duh.  Payment contract doesn't need to know the exchange rate. it simply receives the total amount. And yeah, txRelay seems the way to go so far.  Refill is funky.


Add virtual [lost] frame for lost events

What does this PR do?

Count lost events per watcher
Add a count argument to pprof_aggregate to be able to report multiple
identical samples at once
Before profile upload, for each watcher with lost events, report a sample
with watcher's sample_period and count of lost events

Current dependencies on/for this PR:

main

PR #161

PR #162

PR #163   👈

This comment was auto-generated by Graphite.


ADD: KeyboardAwareScrollView package

Fixes #1
I added the KeyboardAwareScrollView package and the component to your screen and this is the result.
Please let me know if that works for you.
https://user-images.githubusercontent.com/1775881/194443331-d6d936e4-48d4-48ab-ac1e-bcaecdf60da0.mp4

could you please adjust the KeyboardAwareScrollView style so that the shadows of the TextInputs display correctly?

@aldo-rl Fixed!

@SoldierCorp Thank you.


Cleanup puppeteer_dev_chrome_profile folders in tmp after running Puppeteer

This PR tackles #30 and exceptions like these:

Lambda Execution Exception for Wnx\SidecarBrowsershot\Functions\BrowsershotFunction: "ENOSPC: no space left on device, write. [TRACE] Error: ENOSPC: no space left on device, write at Object.writeSync (fs.js:737:3) at Object.writeFileSync (fs.js:1535:26)".

Chromium / Puppeteer generates a profile in /tmp that keeps lying around between Lambda executions. These profiles can accumulate and exhaust the default "ephemeral storage" of 512MB. Execution the Lambda again in short succession will lead to the error above.
This PR tries to resolve this problem by removing any puppeteer_dev_chrome_profile-*-folders after the Browsershot is finished.
Related Issues

https://github.com/stefanzweifel/sidecar-browsershot/issues/30
https://github.com/puppeteer/puppeteer/issues/6414
https://github.com/puppeteer/puppeteer/issues/6286
https://github.com/mifi/reactive-video/issues/11
https://github.com/puppeteer/puppeteer/issues/6291

I've deployed this PR to https://3.screeenly.com/ over the weekend and let the function run like a 1000 times. Didn't run into any disk space issues anymore.
Will merge and tag a new release soon.


Memory leaks due to longjmp over C++ frames, std::function/std::unique_ptr

We have started using std::unqiue_ptr (as well as std::function and others). Those objects are only functioning well if their destructor is properly called. In VM we often longjmp very far up the stack, which makes usages of such c++ objects potentially problematic (see e.g. 3f23b9b69de2fc3b2f156a781c4236d79d1715ed).
We might want to be more careful and possibly re-evaluate whether / where we allow std::unqiue_ptr et al  and/or where we allow longjmp.
/cc @mraleph @rmacnak-google @alexmarkov @a-siva

An alternative to banning std::function/unique_ptr is to provide a StackResource based wrapper which would ensure destruction - but I agree it's a footgun.
FWIW our usage of setjmp/longjmp in conjunction with StackResource is undefined behavior because of jumping over non-trivial destructors is undefined behavior see http://eel.is/c++draft/csetjmp.syn#2


[Speed]Update how-do-i-enable-http2-server-push-in-wordpress.mdx

Summary
For better visibility of the PHP code. Per docs style guide.
Thanks!

@nenizera - thanks for raising this.
The right syntax should be:
define('CLOUDFLARE_HTTP2_SERVER_PUSH_ACTIVE', true);


make beta div-specific viz selector icon

App-specific viz selector icons:

[ ] Ranked abundance box: boxes decreasing in height
[ ] Ranked abundance scatter: two trends?
[ ] Beta div scatter: look clustered
[ ]

@dpbisme ideas for alpha div box and scatter?

After much thought, I decided against making app-specific visualization selector icons except in very specific situations. Consider that in the future, ranked abundance and alpha div will have box, scatter, and line plots. So we'd need three different viz selector icons for line plot. This won't scale well.
Instead, i propose that unless a user will be prevented from clicking on the icon when using the default version, use the default version associated with the viz type. For example, in beta div we use a scatter plot, but the computation is defining both axes so the plot is really more a "pcoa plot", for lack of a better name. Users don't think of this viz as a scatterplot with defined axes.
@d-callan

@asizemore can we close this ticket?

Not yet. I still need to implement the finalized icon for beta div.

This is done. I'm happy with what we have :)
To QA, please just verify that the scatterplot viz icon and the beta div viz icon are different. Tanks!

Looks great!


Thrift Haul Sourcing

Things that might not be in codex or wiki, but might be used for future Lost and Found

Iron Warrior 1987 (not the Mike Christian one, the Miles O'Keefe one)
YouTube Films&Clips Free Movies

Destroy All Monsters
"Deluxe Collector's Edition Letterbox Format!" - ADV Films
archive org AIP HD Reconstruction

Spacehunter: Adventures in the Forbidden Zone
"Superior Quality Video Tape Recorded in the LP Mode." - Goodtimes video
archive org gore888

Alien Autopsy: (facto or fiction?)
"CONTAINS EXTRA NEVER-BEFORE-SEEN FOOTAGE PLUS THE COMPLETE, UNEDITED ALIEN AUTOPSY!" - Vidmark Entertainment
Box says "approx 70 minutes" but many online sources are 45 min, meaning they skip the "autopsy" potentially...
tubi
archive org tv broadcast of 45 min doc 1
archive org tv broadcast of 45 min doc 2
archive org "original alien autopsy" 19 min
45 + 19 = 64 minutes ... so "approx 70" might include promotional materials unique to the tape...

Warrior Women / Island Warriors (FVCR's VHS cover title) / Country of Beauties (1981) HKMDb IMDb
youtube Craigles 1:25:48, "Women Warriors" at 0:00:02, "First Distributors" The End at 1:25:40 (probably just sped up and cropped compared to the next two)
youtube "wu tang" 1:29:43, "Country of Beauties" at 0:00:00, The End at 1:29:35
archive org 1:29:59, "Country of Beauties" at 0:00:15, The End at 1:29:51 (includes film distributor at beginning)

(DVD)
Lady Rambo
Kill You! In My Justice
kill you in my justice

ENGLISH SUBTITLED *

"Lady Ramboh finds her sister and
her best friend on vacation, and the
three of them spend the days
having lots of fun.  But the fun trip is
ruined, when the girls are
kidnapped and raped by the
remaining traffickers.  Lady Ramboh
seeks revenge.  She has a room full
of grenade launchers to prove it."
"Onna Rambo 1994 1h 20m
Japanese w/ English Subtitles"
archive org Analog Video Shop 1:14:08

(DVD FLP-91589)
This of course IS from FVCR, and is an exciting rarity - a digital copy of the English dub of this movie.
Cyber Ninja (english dub)
There are several online sources of this movie, but the most complete has been the archive org DVD iso.  That edition includes a cool behind-the-scenes feature which extends the runtime of the movie from 1h12m to 1h33m.

Bruce Lee Fights Back from the Grave
https://youtu.be/oATRYN23n7k 1:24:16, grave 0:00:15
https://tubitv.com/movies/11407/bruce-lee-fights-back-from-the-grave 1:24:26, grave 0:00:14

(VHS)  THE REAL Bruce Lee
Cover:
"BRUCE LEE
A rare find
sure to
please fans
of the
martial
arts legend
THE REAL
(script, red) Bruce Lee
(black block)THE REAL (script)Bruce Lee
STARRING BRUCE LEE DRAGON LEE
DIRECTED BY JIM MARKOVIC PRODUCED BY SERAFIM KARALEXIS
SCREENPLAY BY SERAFIM KARALEXIS LARRY DOLCHIM"
AKAs and Versions
https://www.imdb.com/title/tt0186483/movieconnections/?ref_=tt_trv_cnn
https://www.imdb.com/title/tt0186483/releaseinfo/?ref_=tt_dt_aka#akas
https://hkmdb.com/db/movies/view.mhtml?id=8928&display_set=eng
Online Sources
https://youtu.be/PxgYkeHDdOs 1:40:07 CC 240p
https://youtu.be/jWTasyEIltQ 1:35:03 CC "1080p"

[Has almost nothing to do with FVCR, but similar...]
(DVD) LEGEND OF THE DEVIL
"HIS
HEART
CRAVES
VENGEANCE...
(right-justified)...HIS
SWORD
DEMANDS
BLOOD!"
AKAs and Versions
https://www.imdb.com/title/tt0230780/movieconnections/?ref_=tt_trv_cnn
https://www.imdb.com/title/tt0230780/releaseinfo/?ref_=tt_dt_aka#akas
Preservation
archive org mkv, re-edited trailer package

(DVD)
Spine:
"7Movies Kung 功夫 Fu Zombies"
Front Cover:
"How do
you kill
something
that's already
DEAD?
7Killer
Movies
Kung 功夫 Fu
ZOMBIES"
Back:
"The
ULTIMATE
GENRE MASH-UP!
7deadly films featuring the greatest martial artists including Gordon Liu(Kill Bill vol. 1 & 2), Siu-Wong Fan (Ip Man), Billy Chong (A Fistful of Talons), Eddy Ko (TV's Fist of Fury), and Panna Rittikrai (Ong Bak) - in a battle to the end against their toughest enemy yet... the living dead!
SHAOLIN vs. EVIL DEAD
94 Mins. - English Dub
1.78:1
ANAMORPHIC
WIDESCREEN
SHAOLIN vs. EVIL DEAD 2
100 Mins. - Cantonese with English subtitles
1.78:1
ANAMORPHIC
WIDESCREEN
KUNG FU ZOMBIE
78 Mins.  - Cantonese with English subtitles
2.35:1
ANAMORPHIC
WIDESCREEN
SPIRITED KILLER 2
92 Mins. - Taiwanese (??) with English subtitles
2.35:1
ANAMORPHIC
WIDESCREEN
SPIRITED KILLER 3
90 Mins. - Taiwanese (??) with English subtitles
2.35:1
ANAMORPHIC
WIDESCREEN
KUNG FU FROM
BEYOND THE GRAVE
89 Mins. - English Dub
1.78:1
ANAMORPHIC
WIDESCREEN"

(DVD)7Movies Kung 功夫 Fu Zombies
Shaolin vs. Evil Dead HKMDb IMDb akas
Shaolin vs. Evil Dead 2 HKMDb IMDb AKAs

(DVD)7Movies Kung 功夫 Fu Zombies
Disc 2:
Spirited Killer 2
Spirited Killer 3
We're Going to Eat You

Shopping...
VHS Unknown Origin
VHS HP Lovecraft's The Unnamable
VHS Star Crystal
VHS Spacehunter (diff back cover than above)
DVD Great American Circus and Show Trains
DVD 15 Great Cinema
DVD  McDonald's Rutinas de 15 minutos yoga
DVD Rivers of North America: Missouri River (Film Ideas, Inc. 2004)

(Bluray) DYNAMO
Main Movie (dub with eng softsubs) 1:36:00
Extra 16mm print (dub, no subs)  1:20:40


:bug: Create route and database

Summary
Need to create route firstly so that it can be used to generate certs.
Need to create inventory database. it will be created by default.
Related issue(s)
Fixes #

/lgtm


🔧 Update template

This pull request merges the current state of the template used here into this project so that it is up to date.

:tada: This PR is included in version 1.0.0-develop.9 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


[WIP] Refactor testing suite

What do these changes do?
This PR aims to refactor the testing suite to simplify the addition of new tests and to increase the code coverage of our current tests.

[ ] passes git diff upstream/master -u -- "*.py" | flake8 --diff

Jenkins, add to whitelist.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/11/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/20/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/23/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/27/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/28/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/29/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/127/
Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/142/
Test FAILed.

Merged build finished. Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/180/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/303/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/304/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/305/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/306/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/308/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/323/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/321/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/327/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/325/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/329/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/331/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/340/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/343/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/345/
Test FAILed.

Merged build finished. Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/348/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/350/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/351/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/353/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/356/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/358/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/361/
Test FAILed.

Merged build finished. Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/368/
Test FAILed.

Merged build finished. Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/374/
Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/371/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/376/
Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/392/
Test FAILed.

Merged build finished. Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/404/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/408/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/410/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/411/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/417/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/420/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/421/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/422/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/423/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/429/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin/430/
Test PASSed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/9/
Test FAILed.

Build finished. Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/6/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/15/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/17/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/5/
Test FAILed.

Build finished. Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/28/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/37/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/48/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/39/
Test FAILed.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/50/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/51/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/40/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/41/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/52/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/42/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/53/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/56/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/51/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/52/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/38/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/101/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/39/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/53/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/115/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/68/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/131/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/97/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/120/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/182/
Test PASSed.

Merged build finished. Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/123/
Test PASSed.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/129/
Test PASSed.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/191/
Test PASSed.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/164/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/227/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/228/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/229/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/171/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/172/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/234/
Test PASSed.

Merged build finished. Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/233/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/184/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/245/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/189/
Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/250/
Test PASSed.

Merged build finished. Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/190/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/251/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/194/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/255/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/200/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/261/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/201/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/202/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/262/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/263/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-PRB/203/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/264/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/269/
Test PASSed.


Add RequestAck to config

Coverage increased (+0.05%) to 88.583% when pulling a15d1e609946c9b614b304638c8a947bf8ee0ec3 on srirachapills:request-ack-config into 7275750c56535517a5a7cb7603d40ffcfd0aa144 on evalphobia:master.

Thank you 💟
Note: https://github.com/evalphobia/logrus_fluent/releases/tag/v0.5.3


add error handling around markdown conversion

This is a problem of deleting the docComment code.
I will revert this and add code for docComment in the apiviewer


Facility to Blacklist Un-Interesting Crashes

Hi @stephenfewer
It would be great if we can add feature to blacklist crashes which are not interesting. Basically what I mean is before inserting the crash to crashes table, we will consult another table to check if it's being black listed.
Thanks.

Currently I have implement a check for max 15 crashes to be recorded in DB for a hash_quick.


URLs for retrieving cash vix data no longer avaliable

Hello,
it seems that destination URLs for cash VIX assets are no longer avaliable:
DEBUG:root:
Reading URL https://ww2.cboe.com/publish/scheduledtask/mktdata/datahouse/vixcurrent.csv lines_to_discard 1
DEBUG:root:
Reading URL https://ww2.cboe.com/publish/scheduledtask/mktdata/datahouse/vvixtimeseries.csv lines_to_discard 1
DEBUG:root:
Reading URL https://ww2.cboe.com/publish/scheduledtask/mktdata/datahouse/vix9ddailyprices.csv lines_to_discard 3
DEBUG:root:
Reading URL https://ww2.cboe.com/publish/scheduledtask/mktdata/datahouse/vix3mdailyprices.csv lines_to_discard 2
DEBUG:root:
Reading URL https://ww2.cboe.com/publish/scheduledtask/mktdata/datahouse/vix6mdailyprices.csv lines_to_discard 2
DEBUG:root:
Reading URL https://ww2.cboe.com/publish/scheduledtask/mktdata/datahouse/gvzhistory.csv lines_to_discard 1
DEBUG:root:
Reading URL https://ww2.cboe.com//publish/scheduledtask/mktdata/datahouse/RVOL_History.csv lines_to_discard 1
DEBUG:root:
Reading URL https://ww2.cboe.com//publish/scheduledtask/mktdata/datahouse/RVOL3M_History.csv lines_to_discard 1
DEBUG:root:
Reading URL https://ww2.cboe.com//publish/scheduledtask/mktdata/datahouse/RVOL6M_History.csv lines_to_discard 1
DEBUG:root:
Reading URL https://ww2.cboe.com//publish/scheduledtask/mktdata/datahouse/RVOL12M_History.csv lines_to_discard 1

<title>ww2.cboe.com | 522: Connection timed out</title>
<meta charset="UTF-8" />
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
<meta http-equiv="X-UA-Co
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): data.nasdaq.com:443
vvixtimeseries.csv:  <!DOCTYPE html>
<!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]-->
<!--[if IE 7]>    <html class="no-js ie7 oldie" lang="en-US"> <![endif]-->
<!--[if IE 8]>    <html class="no-js ie8 oldie" lang="en-US"> <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en-US"> <!--<![endif]-->
<head>

Best regards

Hello dougransom,
test.ps1 seems using old vixtutil comand line:
mkdir test_output
cd test_output
vixutil -i  -m continuous.pkl -t term.pkl -c cash.pkl --calendar calendar.pkl -w continuous_weights.pkl

vixutil -i  -m continuous.csv -t term.csv -c cash.csv --calendar calendar.csv -w continuous_weights.csv

vixutil -i  -m continuous.html -t term.html -c cash.html --calendar calendar.html -w continuous_weights.html

vixutil -i  -m continuous.xlsx -t term.xlsx  -c cash.xlsx --calendar calendar.xlsx -w continuous_weights.xlsx
cd ..

vixutil -h is not showing -i options any more:
options:
  -h, --help            show this help message and exit
  -f output_file        output the history of vix futures to a file in record format.
                        Includes weekly and monthly expiries. The file extension
                        determines the file type. Valid extensions are: ['.csv',
                        '.pkl', '.xlsx', '.html']. Python programmers may prefer to
                        use the API
  -g output_file        output the history of vix monthly expiry futures in wide
                        format, with a column for each tenor. The file extension
                        determines the file type. Valid extensions are: ['.csv',
                        '.pkl', '.xlsx', '.html']. Python programmers may prefer to
                        use the API
  -j output_file        weighted mean of the front two month vix futures for an
                        average thirty day tenor . The file extension determines the
                        file type. Valid extensions are: ['.csv', '.pkl', '.xlsx',
                        '.html']. Python programmers may prefer to use the API
  -w output_file        output the weights of the various vix futures front two
                        months to make a 30 day average tenor. Note the weights are
                        as of the beginning of the trading day. The file extension
                        determines the file type. Valid extensions are: ['.csv',
                        '.pkl', '.xlsx', '.html']. Python programmers may prefer to
                        use the API
  -c output_file        output the vix cash term structure a file in record format.
                        The file extension determines the file type. Valid extensions
                        are: ['.csv', '.pkl', '.xlsx', '.html']. Python programmers
                        may prefer to use the API . Some other indexes from CBOE will
                        also be included. The file extension determines the file
                        type. Valid extensions are: ['.csv', '.pkl', '.xlsx',
                        '.html']. Python programmers may prefer to use the API
  -d output_file        output the vix cash term structure a file in wide format,with
                        a column for each index. The file extension determines the
                        file type. Valid extensions are: ['.csv', '.pkl', '.xlsx',
                        '.html']. Python programmers may prefer to use the API . Some
                        other indexes from CBOE will also be included. The file
                        extension determines the file type. Valid extensions are:
                        ['.csv', '.pkl', '.xlsx', '.html']. Python programmers may
                        prefer to use the API
  --calendar output_file
                        Expirys for vix futures for a given trade date
  --loglevel output_file
                        Level for logging module to display, default is ERROR

Best regards

Hi, please upgrade, pip install --upgrade vix_utils.  The commands are a bit different and there was a lot of rewrites due to what you mentioned above and getting the futures data from cboe rather than quandl.

investigating.

test.ps1 should be deleted, i will in a future release.
I think -c or -d  are what you want, though they should be called spot term structure not cash term structure.  I'll eventually correct that terminology.


Streamed Data with Azure DataBricks

Could Azure DataBricks structured streaming be used to ingest and process stream data in ADLS Gen 2? https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-data-scenarios?toc=%2Fazure%2Fstorage%2Fblobs%2Ftoc.json#streamed-data

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c5bd94d1-6f80-dff7-075e-8b874d413d3c
Version Independent ID: d0e49c5f-3660-55bd-7341-4d528ac73d9e
Content: Data scenarios involving Azure Data Lake Storage Gen2
Content Source: articles/storage/blobs/data-lake-storage-data-scenarios.md
Service: storage
Sub-service: data-lake-storage-gen2
GitHub Login: @normesta
Microsoft Alias: normesta

@tonio-lora Thanks for your question. We are checking on this and will respond to you soon.

@tonio-lora Streaming scenarios with Databricks work well. In the Databricks article- https://docs.azuredatabricks.net/spark/latest/structured-streaming/data-sources.html#streaming-data-sources-and-sinks), ADLS Gen2 is represented by both ‘Delta Lake Tables’ & ‘Write to Arbitrary Data Sinks’. We will soon support ‘Optimized Azure Storage File Source’ of Event Grid integration.
Can you also provide more details what exactly are you trying to perform or you workloads?

@tonio-lora Since we have not heard back from you we will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly reopen the issue and continue the discussion.


Problem on scripts/install_third_party_dependencies.sh

When it comes to installation on Linux,
scripts/install_third_party_dependencies.sh, which is the very first code that I should execute, does not work correctly.
It shows
Pip subprocess error:

failed

CondaEnvException: Pip failed

Thereafter, all the codes are useless.
Can you tell me how to solve this problem on the most recent version?

conda update -n base -c defaults conda

which is suggested as a solution does not work.

I am also facing same problem. Are there any requirements to be fulfilled for installation of openfold? Is GPU necessary?

Hm I just tried reinstalling OpenFold from scratch and am unable to reproduce this behavior. Could you share:

The full output of the command
Details about your environment (incl. CUDA installation, etc.)

@anpanche you too.

Same problem here:
mamba env create -n openfold_env -f environment.yml
Channels:

conda-forge
bioconda
pytorch
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
current version: 24.3.0
latest version: 24.5.0
Please update conda by running
$ conda update -n base -c conda-forge conda

Downloading and Extracting Packages:
Preparing transaction: done
Verifying transaction: done
Executing transaction: - By downloading and using the CUDA Toolkit conda packages, you accept the terms and conditions of the CUDA End User License Agreement (EULA): https://docs.nvidia.com/cuda/eula/index.html
done
Installing pip dependencies: / Ran pip subprocess with arguments:
['/home/fabian/miniforge3/envs/openfold_env/bin/python', '-m', 'pip', 'install', '-U', '-r', '/home/fabian/openfold/condaenv.v3nskj_k.requirements.txt', '--exists-action=b']
Pip subprocess output:
Collecting git+https://github.com/NVIDIA/dllogger.git (from -r /home/fabian/openfold/condaenv.v3nskj_k.requirements.txt (line 3))
Cloning https://github.com/NVIDIA/dllogger.git to /tmp/pip-req-build-5qi5j6us
Resolved https://github.com/NVIDIA/dllogger.git to commit 0540a43971f4a8a16693a9de9de73c1072020769
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting git+https://github.com/Dao-AILab/flash-attention.git@5b838a8 (from -r /home/fabian/openfold/condaenv.v3nskj_k.requirements.txt (line 4))
Cloning https://github.com/Dao-AILab/flash-attention.git (to revision 5b838a8) to /tmp/pip-req-build-coan6uef
Resolved https://github.com/Dao-AILab/flash-attention.git to commit 5b838a8
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'error'
Pip subprocess error:
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA/dllogger.git /tmp/pip-req-build-5qi5j6us
Running command git clone --filter=blob:none --quiet https://github.com/Dao-AILab/flash-attention.git /tmp/pip-req-build-coan6uef
WARNING: Did not find branch or tag '5b838a8', assuming revision or ref.
Running command git checkout -q 5b838a8
Running command git submodule update --init --recursive -q
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [13 lines of output]
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "/tmp/pip-req-build-coan6uef/setup.py", line 105, in
raise_if_cuda_home_none("flash_attn")
File "/tmp/pip-req-build-coan6uef/setup.py", line 55, in raise_if_cuda_home_none
raise RuntimeError(
RuntimeError: flash_attn was requested, but nvcc was not found.  Are you sure your environment has nvcc available?  If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.
  torch.__version__  = 1.12.1

  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
failed
CondaEnvException: Pip failed


[TC-SU-2.5] - SDK needs to implement the features in Applyupdate response

In OTA [TC-SU-2.5] - This test case not verify all steps mentioned in testplan ,some steps like 3,4,5 needs to be implemented in SDK.
Awaitnextaction and discontinue commands needs to be implement

Fixed here: https://github.com/project-chip/connectedhomeip/pull/15208


Integrate v1.0.0 into Merlin

This needs:

release as a package in PyPi #38
CARTO batch queryes #39
Config #37

We could also link it installing from github repo like:
pipenv install -e "git+ssh://git@github.com/GeographicaGS/Longitude.git@dev#egg=geographica-longitude"

Irrelevant


[BugFix] skip collect subfield expr without referencing cols

Fixes #issue
For sql like
select [1, 2, 3][1] is null from pc0 t1 right join sc0 t2 on t1.v1 = t2.v1;

[1, 2, 3][1] has been pushed to the left table in this right join because of this expr refs empty cols leading leftOutput.containsAll(subfieldUseColumns) = true
if (leftOutput.containsAll(subfieldUseColumns)) {
                    leftContext.put(index, subfieldExpr);
                    childSubfieldOutputs.union(index);
                } else if (rightOutput.containsAll(subfieldUseColumns)) {
                    rightContext.put(index, subfieldExpr);
                    childSubfieldOutputs.union(index);
                } else {
                    localContext.put(index, subfieldExpr);
                }

So just skip collect subfield expr without referencing cols.
What type of PR is this:

[x] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[x] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.2
[x] 3.1
[ ] 3.0
[ ] 2.5

[BE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[FE Incremental Coverage Report]
:heart_eyes: pass : 6 / 6 (100.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/optimizer/rule/tree/prunesubfield/SubfieldExpressionCollector.java
6
6
100.00%
[]

[BE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[FE Incremental Coverage Report]
:heart_eyes: pass : 6 / 6 (100.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/optimizer/rule/tree/prunesubfield/SubfieldExpressionCollector.java
6
6
100.00%
[]

@Mergifyio backport branch-3.2

@Mergifyio backport branch-3.1


Update dates for NDC Sydney 2020

Didn't check thorougly enough while reviewing #132
Couldn't find the CFP open/close dates, so I assume they're not published yet?

Please squash this one to hide me trying to fix my mistake by introducing another dumb one 😑