CryptoError(Signature(signature::Error { source: None }))

Gateway-rs stop transfering packets with the following error for each of the packets
( this was seen on alpha-19) it has disappeared after an upgrade to alpha-21, don't know if related to upgrade or restart.
Nov 07 18:20:39.715 INFO using gateway, uri: http://<IP_ADDRESS>:8080/, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW, module: dispatcher
Nov 07 18:20:40.474 WARN gateway stream error: CryptoError(Signature(signature::Error { source: None })), module: dispatcher
Nov 07 18:20:45.476 INFO using gateway, uri: http://<IP_ADDRESS>:8080/, pubkey: 115PmCR6fpFihdjw626JXYdUEdzwjh66yoWzWkMvB9CRGEx1U6G, module: dispatcher
Nov 07 18:20:45.956 WARN gateway stream error: CryptoError(Signature(signature::Error { source: None })), module: dispatcher
Nov 07 18:20:49.499 INFO uplink @3969801540 us, 868.10 MHz, Ok(DataRate(SF12, BW125)), snr: -14.5, len: 23 from MacAddress(AC:1F:09:FF:FE:05:89), module: gateway
Nov 07 18:20:50.957 INFO using gateway, uri: http://<IP_ADDRESS>:8080/, pubkey: 11tk4zzbyfMPYYHYda255ACoqfYFVdrUSoCWrCYfn8BoyuYrERK, module: dispatcher
Nov 07 18:20:51.123 WARN gateway stream error: CryptoError(Signature(signature::Error { source: None })), module: dispatcher

Hi, My experience is that after the upgrade to 21 and then restart it disappears.
In my situation it was observed and cured on as RAK gateway type 7258 that uses helium-gateway-v1.0.0-alpha.21-ramips_24kec.ipk

IIRC the gateways were updated to require signing of the packets so alpha19 would have no longer been compatible. But maybe I'm misremembering 🤔

Additional data was added to the signature that the validator (not router) applies over RPC results. Alpha.19 did not know about these new fields. Alpha.21 does know

I have the same problem now. Data-only hotspots I have are not able to conenct to the gateway and forward data.

I have the same problem now. Data-only hotspots I have are not able to conenct to the gateway and forward data.

You have crypto errors in the log?

Yes,
gateway region stream error: CryptoError(Signature(signature::Error { source: None })), module: dispatcher

Yes,
gateway region stream error: CryptoError(Signature(signature::Error { source: None })), module: dispatcher

while the the error isn't the same as this issue. Would you be able to create a new issue please so we can keep track?

Looks like this was already filed recently as #246


This Month in Rust OSDev (November 2021)

This is a draft for the upcoming "This Month in Rust OSDev (November 2021)" post. Please add your content to this draft by creating a pull request against the next branch.

Published at https://rust-osdev.com/this-month/2021-11/

There isn't anything for December?

Thanks for the reminder, I'll prepare a new draft PR in a moment.

@berkus Done at https://github.com/rust-osdev/homepage/pull/79


Allow Photino applications to open links in external browser

This commit provides a workaround for issue #111. Users were not able to open links in an external browser window, only inside the WebView itself. We now intercept web requests that use the application's scheme (e.g., app://) and, if it does not contain <IP_ADDRESS> or localhost, then we open the link in the browser.
Partially resolves tryphotino/photino.Blazor#111

if (RuntimeInformation.IsOSPlatform(OSPlatform.Windows))
{
    Process.Start(new ProcessStartInfo(url) { UseShellExecute = true });
}
else if (RuntimeInformation.IsOSPlatform(OSPlatform.Linux))
{
    Process.Start("xdg-open", url);
}
else if (RuntimeInformation.IsOSPlatform(OSPlatform.OSX))
{
    Process.Start("open", url);
}

Thanks for the suggestion @Jinjinov! I've only tested this change on Linux and it looks like xdg-open isn't required, but I guess that it could vary from distro to distro. I'll give it a go.

I didn't have the time to check it on every OS, but I got it from here:
https://stackoverflow.com/a/43232486

I tested your code, but unfortunately clicking on Google doesn't call HandleWebRequest(object sender, string schema, string url, out string contentType)
Since I am making a Markdown app, I want the links in the user's Markdown notes to be clickable.
I am generating the Markdown with https://github.com/xoofx/markdig and changing the generation of  tags would be too difficult, so I have no control over the generated links.

Yes, the HandleWebRequest appears to be only called when the registered schema is used (i.e., app://). I'm also using Markdig and I am replacing the instances of "http://" and "https://" in links with "app://".
this.Html = Markdown.ToHtml(this.Text, pipeline);

// Photino workaround to allow links to be opened in external browser windows
this.Html = this.Html.Replace("<a href=\"http://", "<a href=\"app://");
this.Html = this.Html.Replace("<a href=\"https://", "<a href=\"app://");

Interesting workaround, thank you for sharing :)
But my core Blazor code is shared between several project:
Blazor WASM - for web
Blazor Maui - for Windows, Android, iOS and MacOS
Photino Blazor - for Linux
I would have to change the method that is using Markdig to work differently for Photino.

I don't know why, but in my app, Google doesn't call HandleWebRequest.

I'm not quite sold on this solution tbh. It is confusing to have to use the app:// scheme to call web resources in my opinion. How about sending a message through window.external.sendMessage? You could bind a Javascript event to the a-tag and open the link inside the RegisterWebMessageReceivedHandler EventHandler on the C# end ...

Thanks @philippjbauer , that does indeed sound like a better solution and I agree that it shouldn't be merged in as is. I'll try your suggestion and let you guys know if it works.

I apologize for the off-topic comment, but this solution might help someone else who wants to open Markdown links in the default browser:
OnClickMarkdownExtension.cs
using Markdig;
using Markdig.Renderers;
using Markdig.Renderers.Html;
using Markdig.Syntax;
using Markdig.Syntax.Inlines;

namespace OpenMarkdownLinksInDefaultBrowser;

public class OnClickMarkdownExtension : IMarkdownExtension
{
    public void Setup(MarkdownPipelineBuilder pipeline)
    {
        pipeline.DocumentProcessed += ParserLinkInlines;
    }

    public void ParserLinkInlines(MarkdownDocument document)
    {
        foreach (LinkInline link in document.Descendants<LinkInline>())
        {
            link.GetAttributes().AddProperty("onclick", $"return openLink('{link.Url}');");
        }
    }

    public void Setup(MarkdownPipeline pipeline, IMarkdownRenderer renderer)
    {
    }
}

index.html

Program.cs
static void Main(string[] args)
{
    MarkdownPipeline _markdownPipeline = new MarkdownPipelineBuilder()
        .UseAdvancedExtensions()
        .UseSoftlineBreakAsHardlineBreak()
        .Use<OnClickMarkdownExtension>()
        .Build();
}

[JSInvokable]
public static void OpenLink(string url)
{
    Process.Start(new ProcessStartInfo(url) { UseShellExecute = true });
}

@andrew-bedford Looking forward to a new pull request. We're going to close this one for now. When you create the new pull request, please do it against the debug branch as we never merge directly into master. Thank you!


Fixed RPC error handle bug

Closes #509
@xJonathanLEI

I see you're adding 2 things:

support for parsing the data field when there's an error
support for the new deprecated endpoint error code from the sequencer

1 has been implemented by #513 (in a more idiomatic way too). I will now rebase this PR to only include 2. Thanks for the fix.

In fact, the best way to deal with the deprecated endpoints would be to simply remove them for good, but let's leave that for another day.


New WebAuthn article

What's changed, or what was fixed?

Adding a new WebAuthn article for /updates

Target Live Date: 2018-11-09

[ ] This has been reviewed and approved by (NAME)
[x] I have run npm test locally and all tests pass.
[x] I have added the appropriate type-something label.
[x] I've staged the site and manually verified that my content displays correctly.

CC: @petele

Whoops!
There were 2 warnings that will prevent this PR from being merged. Please take a look, and either fix, or provide a justification for why they can't be fixed.
WARNINGS
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L688 - Consider adding a "was this page helpful?" widget to your page: https://developers.google.com/web/resources/widgets#helpful
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L146 - Line must be at most 100 characters

Whoops!
There were 2 warnings that will prevent this PR from being merged. Please take a look, and either fix, or provide a justification for why they can't be fixed.
WARNINGS
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L760 - Consider adding a "was this page helpful?" widget to your page: https://developers.google.com/web/resources/widgets#helpful
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L78 - Line must be at most 100 characters

Whoops!
There were 3 warnings that will prevent this PR from being merged. Please take a look, and either fix, or provide a justification for why they can't be fixed.
WARNINGS
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L129 - Line must be at most 100 characters
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L156 - Line must be at most 100 characters
src/content/en/updates/2018/11/webauthn-reauth-ux.md#L170 - Line must be at most 100 characters

Any update on this?

I've decided to rework and land similar article at web.dev. I'll close this issue for now.


Make scheduler optimistic about its bindings

The vast majority of scheduler's time is spent waiting to hear back from apiserver. Now that scheduler tracks what assignments it thinks it has made, we can be optimistic that the binding will succeed and do the waiting in parallel.

I have not tried e2e on this, we should probably make sure that passes before merging.

LGTM with respect to the logic
Will let you and @bprashanth fight it out with respect to the rate/performance impact.

cc @fgrzadkowski

I also like the logic in this PR, but I partially share the fear with @bprashanth
However I think that we shouldn't just guess at what level we should rate-limit it (I hope it should be more than 10) - this value should be based on results of some experiments.

Yeah I'm not opposed to putting a rate-limit in. I think 10 qps is too low & agree with @wojtek-t that an experiment would be ideal. @wojtek-t, @timothysc, or @bprashanth--does one of you have time to run such an experiment and/or build a rate-limiting step on top of this commit? I'm totally swamped with code reviews today.

I think a client side in flight rate limit on the kubelets should be sufficient. I only want to prevent the thundering herd. I can do that. Thoughts?

The way I see it, the bottleneck is really the apiserver. Ideally i would tackle it thusly:

Fix current latency issues on apiserver so most requests take roughly a second (various ideas are being worked already).
Use a client in flight rate limiter on the kubelets, so we don't hammer the apiserver.
Increase rc limits so we start pods faster, put this fix in so we assign pods faster.

We might get ratholed if we do 3 before 1 and 2. Thoughts?

Sorry, I got a little lost. It seems you guys are talking about two rate limits: on scheduler sending bindings, and on Kubelet (doing what?). And when you refer to "client" rate limit are you talking about something that would apply to both of these, or just one?

And when you refer to "client" rate limit are you talking about something that would apply to both of these, or just one?

It would be a general limit that anything creating a restclient can opt in for (just like the qps throttling we have today). I would start off by setting it to something like 5 in flight requests on the kubelet, and 20/30 in flight requests for the scheduler. The current strategy of ratelimiting won't help if the bindings/event posts take O(seconds) which will happen in thundering herd situations like if we allowed burst levels of 100 pods/sec.

So, should we merge this now and worry about the rate limiting stuff later, or wait for the rate limiting stuff?

defer to @lavalamp as owner of this pr, rate limiting as i described should be relatively straight forward

So, should we merge this now and worry about the rate limiting stuff later, or wait for the rate limiting stuff?

Given that @timothysc ran it and it was an improvement, I'd say sure.

Use a client in flight rate limiter on the kubelets, so we don't hammer the apiserver.

We already rate-limit. You're talking about adding a client-side max-in-flight limit as well? It's not obvious to me whether that would change the behavior in a significant way. (as an aside: I'd rather add that sort of thing to apiserver. apiserver should enforce limits, we should move away from counting on well-behaved clients.)
We can also consider having apiserver terminate requests that are taking too long.

We already rate-limit. You're talking about adding a client-side max-in-flight limit as well? It's not obvious to me whether that would change the behavior in a significant way.

Yes, we rate limit at 20qps with bursts of 100, but the problem is it takes > 50ms to execute the binding (best case 100ms). the problem is more apparent on kubelets, that send 7 events + 1 status update per new pod, each event update takes 2.91 seconds (0.5 quantile) during density.
Rate limiting the kubelets to 5qps without monitoring in flight requests feels like a bad strategy, I'm only worried that this change will add fuel to the fire (we're already debugging apiserver request latency problems).

I'd rather add that sort of thing to apiserver. apiserver should enforce limits, we should move away from counting on well-behaved clients.

IMO apiserver limits should be last line of defense, as we have no choice but to return a 500 and assume the client will retry. I'm not sure the kubelets even retry events, which makes us blind when things go wrong.
That said, I'm fine with getting this in. Just explaining my concern.

You're talking about adding a client-side max-in-flight limit as well

No I mean a 'hang on a channel till we have less than 10 in flight requests' rate limiter, no 500s

You're talking about adding a client-side max-in-flight limit as well

No I mean a 'hang on a channel till we have less than 10 in flight requests' rate limiter, no 500s

Client side or server side? queueing isn't a solution if you can't handle the load.

Discussed irl, merging


APT whitelist request for libdbusmenu-qt5-dev

One of a few packages needed to build Quassel IRC on Travis' container infrastructure.
Full list of required packages missing from the whitelist:
qtscript5-dev libdbusmenu-qt-dev libdbusmenu-qt5-dev libphonon4qt5-dev libqca2-dev libphonon4qt5experimental4

Note: I am not an official representative of the Quassel project

Turns out libdbusmenu-qt-dev and libdbusmenu-qt5-dev are provided by the same source package, libdbusmenu-qt.  Closing this issue as it should be covered by issue #3141.  Pardon the noise!


Mistake in documentation on main page

In the main page under "Examples" (http://keras.io/examples/)
You have listed:
"# Dense(64) is a fully-connected layer with 64 hidden units. in the first layer, you must specify the expected input data shape: here, 20-dimensional vectors.
model.add(Dense(64, input_dim=20, init='uniform'))"
However, this will throw an error, because python takes in 64 as input_dim, then you re-assign input_dim with a keyword in the second input. Python is unsure which is the correct input_dim and throws an error.  Also, in my neural network classes I have never seen the phrase "hidden units" -- I don't think this is so common as you presume, and makes me think of hidden layers, which it is not. Can you just say "neurons" instead?
I have not heavily tested the rest of the documentation, but I think the rest of the example should follow the formula:
model.add(Dense(inputLayer, midLayer, init='uniform'))
model.add(Dense(midLayer, outputLayer, init='uniform'))
or some similar extension, where xxxLayer is the # of neurons (hidden units) in each layer

It looks like you are testing with an old version of Keras.
The API was changed one month ago: https://groups.google.com/d/msg/keras-users/iWVrWpR_eaQ/s0jxhdlcBgAJ.


Converting a Multi-Page-PDF to multiple PNG files

Hello,
I wanted to use node-magickwand to convert a PDF to separate PNG files.
In a terminal using the imagemagick cmd tool I can do this:
convert -density 150 in.pdf PNG32:out.png
and this converts the PDF to out1.png, out2.png etc.
With node-magickwand I at least managed to get the first page like
let im = new Magick.Image(null);
await im.readAsync('in.pdf');
await im.magickAsync('PNG32');
const blob = new Magick.Blob();
await im.writeAsync(blob);
await writeFile('out.png', blob.data());

But how would I load the PDF with a density of e.g. 150 and save all pages with node-magickwand?

In order to read all the pages of PDF document you must use the STL mehods:
const list = await Magick.readImagesAsync('in.pdf');
const density = new Magick.Point(10);
list.forEach(im => im.density(density));

In case you haven't already read my profile, I am currently living in total isolation since I am being extorted by the French police and the French judiciary about a series of falsified criminal proceedings including false rape charges and sexual harassment. They are trying to cover up those affairs because they are linked to the personal problem of the man who is behind that affair and the fact that these have been organized with corruption of judicial officials. The French police came yesterday evening, without any official order and drew their guns in an attempt to further intimidate me. In order to show me that I have to shut up about that affair, people are simultaneously posting issues on my projects. Yours is one of these. You don't happen to know anything?

Hi Momtchil,
first of all thank you for the example. It guided my in the right direction.
I am sorry to hear about that. I don't know anything about others posting issues on your projects. Sorry.
I really hope that you find the help you need to sort this thing out.
Thanks for your help nonetheless.


[REQUEST] Extend cell background color across entire row for a single row

Hi
First, thanks for this project, my shell applications now look awesome! :+1:
I just saw this feature request (https://github.com/willmcgugan/rich/issues/383).
Would it be possible to do the same for a single row?
I can change the background of a single row with the style attribute when using add_row, but then only the background of every cell is changed even when not using vertical separators.

The reason is i want to highlight (change color) only specific rows.
I know i could use row_styles when creating the table, and just provide a style for every row, but that seems a bit messy when there are a lot of rows.
Image using the row_styles:

The second image shows what i actually want to achieve.
Also i would find it cool to have the option to choose if the style should also be used when there are vertical lines.
Here the code i used to create those two tables:
from rich.console import Console
from rich.table import Table
from rich import box

table = Table(title="Star Wars Movies", title_style="", box=box.HORIZONTALS)

table.add_column("Released", justify="right",  no_wrap=True)
table.add_column("Title" )
table.add_column("Box Office", justify="right")

table.add_row("Dec 20, 2019", "Star Wars: The Rise of Skywalker", "$952,110,690")
table.add_row("May 25, 2018", "Solo: A Star Wars Story", "$393,151,347")
table.add_row("Dec 15, 2017", "Star Wars Ep. V111: The Last Jedi", "$1,332,539,889", style="on green")
table.add_row("Dec 16, 2016", "Rogue One: A Star Wars Story", "$1,332,439,889")

console = Console()
console.print(table)

from rich.console import Console
from rich.table import Table
from rich import box

row_styles=["", "", "on green", ""]  #This is a bit messy...?
table = Table(title="Star Wars Movies", title_style="", box=box.HORIZONTALS, row_styles=row_styles)

table.add_column("Released", justify="right",  no_wrap=True)
table.add_column("Title" )
table.add_column("Box Office", justify="right")

table.add_row("Dec 20, 2019", "Star Wars: The Rise of Skywalker", "$952,110,690")
table.add_row("May 25, 2018", "Solo: A Star Wars Story", "$393,151,347")
table.add_row("Dec 15, 2017", "Star Wars Ep. V111: The Last Jedi", "$1,332,539,889")
table.add_row("Dec 16, 2016", "Rogue One: A Star Wars Story", "$1,332,439,889")

console = Console()
console.print(table)

Fixed in 9.4.0


Add first enricher unit test

What type of PR is this?
/kind cleanup
What this PR does / why we need it:
This patch adds the necessary infra for unit testing the enricher while
implementing a first success test.
Further tests will be added in other patches.
Which issue(s) this PR fixes:

None
Does this PR have test?
Yes

Special notes for your reviewer:
None
Does this PR introduce a user-facing change?

None

/test pull-security-profiles-operator-test-e2e

/test pull-security-profiles-operator-test-e2e

Had to rebase on top of the latest master branch.

/test pull-security-profiles-operator-test-e2e

@JAORMX I need another LGTM on this one :upside_down_face:

/lgtm


fix: prevent crash when fetching a PR with over 30 commits

Addresses #38.
Github's PR commits endpoint seems to return commits from oldest to newest, which previously caused Buddy to crash when fetching a PR with over 30 commits. This PR increases the commit limit when fetching PRs and ensures that the head commit is included in the list of commits returned by the API.
Github's REST API does not allow for sorting of commits on a PR. This PR fixes crashes because of this, but does NOT fix the latest commit being unavailable if the limit is reached. This probably won't be an issue (I haven't found any PRs even close to 100 commits in EdgeTX).

Codecov Report

Merging #39 (2c3fd2f) into main (4838f38) will decrease coverage by 0.00%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main      #39      +/-   ##
==========================================
- Coverage   52.63%   52.63%   -0.01%
==========================================
  Files          80       80
  Lines        7812     7813       +1
  Branches      630      630
==========================================
  Hits         4112     4112
- Misses       3691     3692       +1
  Partials        9        9

Impacted Files
Coverage Δ

src/shared/backend/graph/firmware/index.ts
57.02% <0.00%> (-0.17%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Thanks for this, e2e tests are being weird I'll take a look


[XML] Bug in   when adding some chars inside

When i edit my xml files, i often have this bug in CDATA tags:
Example:
<e><![CDATA[abcde.. абвгд..]]></e>
if i add char "о" (russian symbol o), FD will add some code after that symbol and break this tag:
<e><![CDATA[abcde.. абвгд.. о</![CDATA[>]]></e>

Upd: in xml's comments too:

ty!


Normalize the config file to minimize noise later

We will be scripting a number of changes to the track configuration.
This runs configlet fmt, which ensures that any further changes can be minimized.
See https://github.com/exercism/meta/issues/95

If this is for nextercism should we be doing this on the nextercism branch?

There's a discussion happening in exercism/meta#95 about how this normalization degrades the readability of the configs.
That discussion has some good suggestions for improvements to the serializer.
I'd appreciate it if you would weigh in on that discussion with any suggestions for improving how we handle configs, consistency, and normalization.
Meanwhile, I'm going to close this and wait for that discussion to play out.
I'm sorry about the noise, and any extra work that I've caused you.

Will do.
Nothing to apologize for! Script-based normalization ends up being a time-saver and is appreciated! :+1:
This was more about weirdness in our own track.


NOTICK: Allow FlowSandboxGroupContext to close underlying SandboxGroupContext.

The underlying SandboxGroupContext object may secretly also be a MutableSandboxGroupContext or a CloseableSandboxGroupContext.
Modify the sandbox-app to close the flow's underlying SandboxGroupContext by any means necessary.

I don't think I have much to add to the discussion at this point. The compromise here seems fine.

And it's not as if I was suggesting adding anything that didn't exist before FlowSandboxGroupContext was created... :wink: :facepalm:.


Expose DialogueRunner.AddCommandHandler(string commandName, Delegate handler)

Hello!
DialogueRunner.AddCommandHandler has a lot of nice friendly overloads, however the Delegate one is not publicly exposed.
This is currently a problem for me because I need to do some more complex operations on my CommandHandlers, and would love to store them in a List<(string,Delegate)> where they can all rest independently of arity.
(And then be iterated over and added to the DialogueRunner)
This request also extends to DialogueRunner.AddFunction!
Let me know if this sounds acceptable, and why if not
Thanks a lot for your work ! :)

This sounds fine to me! They were initially private because I wanted to make sure that delegates of the right type that DialogueRunner uses, but being able to provide a Delegate makes sense to me (as long as you know what you're doing.)


Some questions about the training and evaluation stages

Hello,
Thank you for sharing this incredible codebase! It’s so exciting and well-constructed, and I’m eager to dive into your technique. I have a few questions about the training and evaluation stages and would appreciate any insights you can offer when you are convenient:

Training Scripts: It seems there are no scripts provided for reproducing the training process. Could you share any scripts (or settings consistent with the paper’s implementation details) for training the OA-ReactDiff and confidence models?
single_frag_only parameter: From the training code from oa_reactdiff/trainer/train_ts1x.py, I noticed that the parameter single_frag_only is set to True (line 89), which seems to filter out reaction cases with multiple-fragment reactants/products. Is this setting intended for the standard training setup? If so, how to ensure the trained model can handle multiple-fragment reactions that may appear in the test set, as discussed in the paper.
Data Splitting: I noticed that only training and validation datasets are provided in oa_reactdiff/data/transition1x/. After a quick review of the code, I guess you possibly employ the validation dataset in both the validation and test stages, which seems to violate the description in the paper and might lead to a slight risk of data leakage. Given that the model shows no signs of overfitting (as mentioned in the paper), this may have a minimal impact on reported metrics. However, I still want to know your opinions about the data split and evaluation.
Evaluation Pipeline: Could you share a detailed pipeline for reproducing the main evaluation results in the paper? For example, the current evaluation script (oa_reactdiff/evaluate/evaluate_ts_w_rp.py) doesn’t integrate both diffusion sampling and the confidence model’s sampling recommendation, and some hyperparameters differ slightly from the paper. Additionally, I would appreciate any guidance on reproducing Figure 3, especially on reaction selection and local TS geometry optimization.

Thank you very much for your help!
Best regards,
He Zhang

Hey He,
Thanks for your interests!

Training Scripts: We used oa_reactdiff/trainer/train_ts1x.py for training.
Great observation. single_frag_only was False during the training of all reactions.
The current "validation set" is actually the "test set" in conventional definition. We did not do any hyperparams tuning as we adopted the setting from the original LEFTNet paper directly. Therefore, there is no need for validation set, and there would be no data leakage concerns.
All the evaluation functions are in oa_reactdiff/evaluate as piecemeal scripts. As we did the structure generations and confidence ranking step by step, we do not have a pipeline at hand that does everything in one shot, which would require more engineering efforts.

Let me know if you have further questions!
Chenru

Hey Chenru,
Thank you for your prompt reply—it’s been very helpful! I have two follow-up questions about the evaluation process:

Checkpoint Selection for Inference: I noticed some inconsistencies in the checkpoint files used across different evaluation scripts. For example, oa_reactdiff/evaluate/run_eva_ts_e_rp.sh uses the leftnet_2304 model, while oa_reactdiff/evaluate/evaluate_rmsd_vs_ediff.py uses leftnet_2074, and there is also a checkpoint file named pretrained-ts1x-diff.ckpt in the codebase. Could you clarify which checkpoint was used to generate the paper’s results?
Noise Schedule Discrepancies: There seems to be a slight difference in the noise schedule settings between training and evaluation scripts. The training script defaults to a cosine noise schedule, while the evaluation scripts use a polynomial noise schedule, with polynomial power values set to 2 in oa_reactdiff/evaluate/run_eva_ts_e_rp.sh and 2.5 in oa_reactdiff/evaluate/run_confidence_sample.sh. Do you have any guidance on how the noise schedules were tuned for optimal performance with the OA-ReactDiff model?

Thanks again for your assistance!
He

Hi He,

leftnet_2074 should be the pretrained-ts1x-diff.ckpt, which is what we finally used.
It is recommended to use the same schedule in training and test. So please use a power of 2. I think we did some testing earlier on, and that power of 2.5 should be a legacy.

Chenru

Hi Chenru,
Thanks for your response.
He


⚠ Bofrost.at has degraded performance

In 8b96475, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2171 ms

Resolved: Bofrost.at performance has improved in 3645872 after 46 minutes.


Make substitue_current_word public

Hey, I'd really love to use this plugin. However, I already got <leader>e set. Automatically setting keymaps is generally discouraged
To be able to set custom keymaps, we need to make the function substitute_current_word public. Please return a module table in this file, so that we can set custom keymaps.

Hi @Myzel394! Thanks for your issue. I just extracted this from my setup last weekend and am surprised it was found so quickly. I plan to modularize it for self-mapping and lazy loading, potentially finishing before I start work in an hour. Stand by!

@Myzel394 it's ready to go and I update the readme with the details.


Simplify Hello World Tutorial

What :computer:

This PR simplifies the hello world tutorial by removing explanations on paymasters

Why :hand:

Paymasters are an added layer of complexity better left at a later stage in the learning process

Closing stale PR


improvement(TokenResource)!: Store the token subject in the token resource.

This is a breaking change because you may have to delete tokens in your database so that you can avoid the non-null constraint on subject.

Since there are people using the package now, I think we should create a documentation/topics/upgrading.md or similar that contains a heading per version with breaking change, explaining what needs to change.

@zachdaniel I have added an upgrading guide.


Show off execution for multiple languages / kernels in our documentation

Some users aren't sure whether MyST works with non-Python languages, since this is what we use in our execution documents. We should show off other languages. Here's a quick proposal for adding documentation that shows off execution in many languages:

Defined a reference section for execution.
Add a sub-page for each of the major languages we want to highlight (Python, Julia, R to start?) that generates a similar plot.
Label various cells on each of those sub-pages.
In our execution docs, we embed one cell from each of those languages
In that page, add a list of common kernels and links (or info) for how to install them.

There’s inspiration to find in the Pixi docs which has a page exactly for this: https://pixi.sh/latest/ide_integration/jupyterlab/#basic-usage


Some BYD downloads don't work

Using 47f05cdf1e8d28fb6d870ba4cb86382f98d5d110 server with v4.0.255 client.
Songs like Bookmaker, Dement, Fairytale, Goodtek, Infinity Heaven and more.
So I put 3.aff for each song to their song ID folder properly. When downloading the song from client, I saw network requests for both base.ogg, 0.aff, 1.aff, 2.aff, and 3.aff. But after that only PST, PRS, FTR are available but not BYD. Checking the dl container folder also show only the base ogg and 0-2 aff, not showing the BYD aff file.

Wait... songs in free packs...
Only the byd charts of those songs can be downloaded. You just need a 3.aff file in each song folder.
You said they cannot be downloaded. Maybe you changed the files after the server running or the folder names were wrong.
Emmm... Another possible reason is that you use the iOS device, so the download procedure must be in https connections.

So I tried your suggestion, here is the server side folder structure:
└── database
   └── songs
      └── goodtek
         └── 3.aff

As you suggested, only the 3.aff file was in the goodtek directory.
And here are the network requests after clicking the download button for Goodtek BYD:

As expected, only the 3.aff file was downloaded. The connection was indeed in HTTPS as I provided the URL base in settings.py. The content of that network request was also fine. However, after that, the download button on the Goodtek BYD chart was still available, and checking the dl folder on the device shows no sign of a goodtek_3 file:
iPad> cd dl && ls goodtek*
zsh: no matches found: goodtek*

WTF? It may be a new problem that haven't met before.
Well, I tried downloading it on the Android device. It is obviously ok.
It seems that the client received the file but didn't accept it. In the past, I will guess the ssl certification is not believable or the hash of the file is wrong. However you checked them carfully. Thus now I have no idea.
The best way is to get the packages from the official server and to see what I missed. I will try it later.

Note that manually putting the BYD aff file to the device's dl folder then restart the app would work, but still, the server serving file can't be installed on the device.

Well I checked everything and only found a strange difference. I will try it later and I hope you can help me to verify my conjecture because of my lacking in iOS devices.
Sorry for handling the problem slowly. I am not on the holidays and so busy.

It's alright. Sure I can help with any iOS releated testing etc.

Firstly, can you try to add a parameter in line 63 of main.py?
return send_from_directory(Constant.SONG_FILE_FOLDER_PATH, file_path, as_attachment=True, conditional=True)

OK I think I figured out... maybe...
So it seems no code needs to be changed... And yes we need to have only the 3.aff file in the songID folder, which is a hard requirement.
Then, since I used to have other files in the folder, when I tried to download, those files got downloaded and written to the dl folder (e.g. goodtek, goodtek_0, goodtek_1, goodtek_2 but not goodtek_3). At this point, no matter how I change the server side, the client won't write goodtek_3 even if it has a network request for it. What need to be done is to manually delete all the downloaded files for that song from the dl folder, restart app, and redownload.
I'm wondering if it's possible to specialize these songs so the server side only serves the 3.aff file regardless the existence of other files from the song folder. Since for completeness I have all the level files stored and put into the songs folder. It would be kind of troublesome to just maintain a folder structure for the Arcaea server.

Well, are you sure whether only the songs with byd charts in the base(free) pack have this problem? Does anything else work?
I am troubled about choosing which way to specify these songs.

OK. I figured out the rule here. If remote_dl is true, then serve everything including 3.aff and 3.ogg if exists.
// example
    "dropdead": {
      "audio": {
        "3": {
          "checksum": "ae8dce75832b652b83989792d1b33f26",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_dropdead/3.ogg"
        },
        "checksum": "80255b334f118a8b758df76a929e3a99",
        "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_dropdead/base.ogg"
      },
      "chart": {
        "0": {
          "checksum": "ade5c0c8aa37e6786d9a605dc578e2a7",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_dropdead/0.aff"
        },
        "1": {
          "checksum": "75fe739cfd526af8b957ce7c03d50d43",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_dropdead/1.aff"
        },
        "2": {
          "checksum": "794829f11947c4b959b330719d3516ab",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_dropdead/2.aff"
        },
        "3": {
          "checksum": "846f7829546b6e44047229a2faab25c0",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_dropdead/3.aff"
        }
      }
    },

If remote_dl is not true, then only serve 3.aff and 3.ogg if exists.
// example
    "ignotus": {
      "chart": {
        "3": {
          "checksum": "2e88a286fd05354ccffe344aadc9c00f",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_ignotus/3.aff"
        }
      },
      "audio": {
        "3": {
          "checksum": "58c1503cc9a6b24b8e50bffff2908ceb",
          "url": "https://static-lb.lowiro.com/download/res/4.0.255/dl_ignotus/3.ogg"
        }
      }
    },


Can't type system prompt/ The text input is disable

The system prompt is disabled when I start a new session.

At the moment the only way to add a system prompt is to enter it as Knowledge. Once you have at least one piece of Knowledge the System prompt field will be enabled and you can choose it from the list.


Laravel throttle rate limit not working properly when using axios post

When sending a verification link using axios post method, Laravel throtte rate limit did not work as expected.

1st Unprocessable Entity
2rd Unprocessable Entity
3th Unprocessable Entity
4th Too Many Requests

Duplicate throttle middleware

app\Http\Controllers\Auth\VerificationController.php
app\Http\Kernel.php


add sysinternals applications to the catalogue

Would it be possible? :)

this is a sysinternal pucket: https://github.com/Ash258/Scoop-Sysinternals


Added implementation of Non-Parametric Linearly Scaled Hyperbolic Tan…

Added implementation of Non-Parametric Linearly Scaled Hyperbolic Tangent (LiSHT) Activation Function suggested in https://github.com/JetBrains/KotlinDL/issues/167

Run tests locally: 213 of 213 passed

So, I'd like this PR and your ideas about minor refactoring in tests!

Hey @knok16 your PR is merged, thanks for the contribution, I'm going to create a few new ticket at the next week, but feel free to propose something from your side via issue or start a discussion


Rerender using conda-smithy to fix upload

I forgot to "rerender"... so the upload is failing.

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.
I do have some suggestions for making it better though...
For recipe:

License is not an SPDX identifier (or a custom LicenseRef) nor an SPDX license expression.

Documentation on acceptable licenses can be found here.

@conda-forge-admin, please rerender

@jcupitt sorry for the noise, I forgot/didn't know about needing to "rerender" the feedstock which (I think) is why the upload failed. This PR just changes the build number and asked the bot to rerender it. Can you merge this again?

It seems to be failing with package conflicts :(

... yeah, I'll see if I can resolve them.

Ok it's passing now... hopefully the upload works this time.

@jcupitt can you review this again please, I bumped the versions that changed back down.

LGTM! Well done @frmdstryr !

Looks like it worked this time... thank you!


couldn't use scala classes in java coding in scala-java polyglot gradle project using kotlin dsl

I have scala 2/java polyglot project gradle-scala-java-polyglot-project build using gradle kotlin dsl. I want the compilation of java and scala mixed.
Expected Behavior
If I use scala files in java code the compilation should be successful.
Current Behavior
If I use java files in scala the compilation is successful. But if I use scala files inside java then compilation fails.
Context
I'm not able to build the project which uses scala code inside java.
Steps to Reproduce

The self contained simple example project with only few files in this repository https://github.com/rajcspsg/gradle-scala-java-polyglot-project.
I've asked this question in stackoverflow and reddit as well.

in my understanding, gradle will first compilejava code, which failed where,  after change to below configuration,
it works.
we just let javacompile's source to be empty
sourceSets {
    main {
        java {
            setSrcDirs(listOf<String>())
        }
        scala {
            setSrcDirs(listOf("src/main/java", "src/main/scala"))
        }
    }
}

okay I tried your suggestion and got below error
gradle clean build

> Configure project :
e: /Users/rajkumar.natarajan/Documents/Coding/misc/adserver-flink-streaming/build.gradle.kts:47:13: Unresolved reference: setSrcDirs

FAILURE: Build failed with an exception.

* Where:
Build file '/Users/rajkumar.natarajan/Documents/Coding/misc/adserver-flink-streaming/build.gradle.kts' line: 47

* What went wrong:
Script compilation error:

  Line 47:             setSrcDirs(listOf("src/main/java", "src/main/scala"))
                       ^ Unresolved reference: setSrcDirs

1 error

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 1s

@JintaoXIAO your suggestion works closing the issue.


feat: Duplicate Withdrawal and move try from impls to rpc-compat

#3964

Since SealedBlock is also using Withdrawal under the hood, I think we would also have to move it, for now I have not moved it.

4 tests are failing in https://github.com/paradigmxyz/reth/blob/main/crates/consensus/beacon/src/engine/mod.rs
Investigating why it happened
`failures:
engine::tests::new_payload::new_payload_before_forkchoice

engine::tests::new_payload::payload_known

engine::tests::new_payload::payload_parent_unknown

engine::tests::new_payload::payload_pre_merge

`
failures:

---- engine::tests::new_payload::new_payload_before_forkchoice stdout ----
thread 'engine::tests::new_payload::new_payload_before_forkchoice' panicked at 'assertion failed: `(left == right)`
  left: `PayloadStatus { status: Invalid { validation_error: "blockhash mismatch, want 0xb4c1…c075, got 0x5053…ad13" }, latest_valid_hash: None }`,
 right: `PayloadStatus { status: Syncing, latest_valid_hash: None }`', crates/consensus/beacon/src/engine/mod.rs:2261:48
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

---- engine::tests::new_payload::payload_parent_unknown stdout ----
thread 'engine::tests::new_payload::payload_parent_unknown' panicked at 'assertion failed: `(left == right)`
  left: `PayloadStatus { status: Invalid { validation_error: "blockhash mismatch, want 0x6d5a…81a7, got 0x03e0…9bf6" }, latest_valid_hash: None }`,
 right: `PayloadStatus { status: Syncing, latest_valid_hash: None }`', crates/consensus/beacon/src/engine/mod.rs:2409:48

---- engine::tests::new_payload::payload_known stdout ----
thread 'engine::tests::new_payload::payload_known' panicked at 'assertion failed: `(left == right)`
  left: `PayloadStatus { status: Invalid { validation_error: "blockhash mismatch, want 0x9429…222a, got 0x853a…eb91" }, latest_valid_hash: None }`,
 right: `PayloadStatus { status: Valid, latest_valid_hash: Some(0x94292372ffb7a28138c3f2dcdacdc3f09f64203f641868af37c6e75fcdfe222a) }`', crates/consensus/beacon/src/engine/mod.rs:2312:13

---- engine::tests::new_payload::payload_pre_merge stdout ----
thread 'engine::tests::new_payload::payload_pre_merge' panicked at 'assertion failed: `(left == right)`
  left: `PayloadStatus { status: Invalid { validation_error: "blockhash mismatch, want 0x19ac…db7a, got 0x9895…3ff9" }, latest_valid_hash: None }`,
 right: `PayloadStatus { status: Invalid { validation_error: "Block 0x19acdf9d012fd0453a12b0c302f107c2f9836b2fcfc28f753b1399d68e97db7a is pre merge" }, latest_valid_hash: Some(0x0000000000000000000000000000000000000000000000000000000000000000) }`', crates/consensus/beacon/src/engine/mod.rs:2477:13

any updates here @supernovahs?
this will become a blocker for us shortly,
if you don't have the bandwidth, lmk, happy to help getting this over the line

@mattsse  Can u take a look ? I'm not able to figure out why they are failing?Thx

@supernovahs sorry for the delay,
we had to proceed with new features, hence the conflicts
do you have the bandwidth to update this? if not, happy to take over

I'm happy to resolve the merge conflicts , but I 'm stuck where the 4 tests are failing. If you could help pass them. It would be great.

ty!!
right, will take a look after conflicts are resolved

I'll ping u when I'm done fixing  . If i'm correct, we have to make the new impls standalone too right

@mattsse Can u review ? thx

Ready i think

cool, checking shortly

Yeah , got errors due to a recent update . Will update it tomorrow

Fixed


Async/Await blocks UI thread, If RobinhoodNet used from a UI

I added RobhinhoodNet to my windows forms application. When I call for e.g. DownloadQuote from UI thread the application hangs  & http request never returns. This issue is happening causing thread deadlock.
If I call any RobhinhoodNet  function from a thread which is not the UI thread, http call returns & I get valid data.
public async Task<IList<Quote>>
        DownloadQuote (IEnumerable<string> symbols)
        {
            var qq = await _rawClient.DownloadQuote(symbols);

Calling the Robinhood API in thread that is not a UI thread solves this.


Implement tests for block_accumulator

Fixes #3346
This PR adds tests for the block_accumulator component and its auxiliary parts.

bors r+


Add backend-agnostic worker-process data loading

Worker-process data loading is an integral part of many training applications. Exposing the API provided in keras.utils.PyDataset to backends other than tensorflow would be a valuable addition.
As an alternative, flags like workers, use_multiprocessing, and max_queue_size could be added to Model.fit, but this may be confusing when the user passes data that is fully in memory.

Exposing the API provided in keras.utils.PyDataset to backends other than tensorflow would be a valuable addition.

PyDataset is usable with any backend. Nothing about it is TF-specific. Did you encounter an issue?

Interesting, for me, the import does not work under the torch backend. I thought this was the intended behaviour:
conda create -y -n test-py-tensorflow python=3.11
conda activate test-py-tensorflow
pip install -U tensorflow keras
conda env config vars set KERAS_BACKEND=tensorflow
conda deactivate
conda activate test-py-tensorflow
python -c "import keras.utils.PyDataset"

works fine, whereas
conda create -y -n test-py-torch python=3.11
conda activate test-py-torch
pip install -U keras
conda install torch torchvision torchaudio cpuonly -c pytorch
conda env config vars set KERAS_BACKEND=torch
conda deactivate
conda activate test-py-torch
python -c "import keras.utils.PyDataset"

yields
ModuleNotFoundError: No modle named 'keras.utils.PyDataset'

After doing some more testing in a clean env, this is now actually the case for both tensorflow and torch on all my machines. Perhaps the export is broken?

The import pattern should be from keras.utils import PyDataset or import keras; keras.utils.PyDataset.

Sorry, that was a mistake I put in when creating a minimal example.
The issue seems to be a little bit deeper. When I install keras with conda, I get the above issue:
from keras.utils import PyDataset
>>> ImportError: cannot import name 'PyDataset' from 'keras.utils'

When I install with pip (as recommended by keras), I instead now get:
ModuleNotFoundError: No module named 'packaging'

Hi @LarsKue ,
Please install the packaging module using pip install packaging and try again.

The library packaging is a dependency for Keras. Please check here.
https://github.com/keras-team/keras/blob/da83683f5e92fa24a0ad7bf5dc034ea596346d21/requirements-common.txt#L20

@SuryanarayanaY thanks, this fixes the issue. packaging should probably be auto-installed when running pip install -U keras though. Would also be nice to have the conda repos updated so that the latest torch-compatible keras version is newer than 3.1.0, which has the issue of the missing PyDataset.


added animation in the dialog

I prefer to have separate file for animation/transition and even we can use svelte's use:* feature to enable animations.
<div use:transition={{show, componentName}}> <!-- show prop should be reactive... -->
    <slot/>
</div>


Install-Module for PSReadLine 2.1.0 Beta 1 on PowerShell 7

When i try to install PSReadLine 2.1.0 Beta 1 on PowerShell 7 i get the following error:

This is the information:

And there is also no solution so getting nowhere only redirected from one place to the other.

@aavdberg I was waiting for a response to Justin's comment above.  Are you running as admin?

Yes i am running as Admin, i solved the problem when i did see that Windows 10 Protected folders was blocking it.

So did this command in cmd with administrator rights.

But why powershell 7 gets blocked on Windows 10, where i have to report this and who will do something with it?

For that, please open an issue in the PowerShell repo.

For that, please open an issue on the PowerShell repo.

Oh, that's a change in Windows that moves the user's Documents folder to OneDrive. That means the same issue will potentially happen to all modules that are ships with PowerShell, including PowerShellGet. @joeyaiello Can you please take a look here?

@daxian-dbw @joeyaiello have now the same with installing PowerShellGet
Install-Module -Name PowerShellGet -AllowPrerelease -Force

From @aavdberg:

But why powershell 7 gets blocked on Windows 10, where i have to report this and who will do something with it?

@SydneyhSmith For context, Windows moved the personal document folder to OneDrive, and it looks it blocks PowerShell from accessing the folders there, including the user module path folder (see https://github.com/PowerShell/PowerShellGetv2/issues/596#issuecomment-612780010). Can you please point @aavdberg to the right place to report this issue?

@aavdberg for the time being if you want a workaround you can update $env:PSModulePath to have the old documents folder prioritized on the path:
 $env:PSModulePath = "<PreviousDocumentsPath>; $env:PSModulePath"

Thank you @alerickson just Friday received my new Surface Book 3 and was setting up everything. So I don't have a previous path.
But I can create a new location and copy all the content from the current location to this new location when I understand right?

@aavdberg, yup that'll work... the previous default documents path was:
C:\Users\<username>\Documents\PowerShell\Modules

I doubt if that will work for Install-Module. If Install-Module still treats the onedrive path as the personal module path, then it will not try to install modules to the newly created location.

Indeed not working and also when i remove the onedrive location from the env.

Ah okay, in that case as a workaround you can use Save-Module -Destination

I also ran into this exact problem and can confirm saving the module to another location and then copying it to the local module path worked. Hopefully this can be fixed soon as the problem is not obvious.


Outdate example

Hi,
The example above, though awesome, its very outdated. The project version isn't event supported by Xcode anymore. Many other changes need to be made to keep this doc up to date.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c37f6af1-e697-321a-a3ac-077446a8a3fe
Version Independent ID: f3e6b4c1-6910-f7ec-6f3b-0d3709ce2a82
Content: Walkthrough: Binding an iOS Objective-C Library - Xamarin
Content Source: docs/ios/platform/binding-objective-c/walkthrough.md
Product: xamarin
GitHub Login: @lobrien
Microsoft Alias: laobri

Thanks for your feedback @cfl777. The project in GitHub is based on an older version of Xcode - we're looking into updating it soon.

Hi,
Do you have any idea when you are going to update the project and the walkthrough.

Thanks for submitting an issue and we apologize for the delayed response. The requested updates haven't been made since the creation of the issue, and the timeline for resolution may vary based on resourcing, so the issue is being moved to an internal repo to better track it.


Usage of "grantOfflineAccess()"? Can I use it to stay signed in?

I'm trying to develop an application (pure JavaScript, no server-side code) where the user stays signed in after they successfully signed in. Just the way how pretty much every website works. My problem of course is the expiring access_token. I'm trying to find a way to get a new one (or solve this problem in a different way). Plus: I need access to YouTube Data API and Drive to store user settings.
For more details: I've created a question on Stackoverflow as well.
I've tried to access the API through different methods: this api client, accessing the OAuth endpoints directly, and hello.js, but I couldn't find a way to achieve that. Now my current idea is to look more into how the client works.
There I've noticed the method .grantOfflineAccess(). From other documentations this sounds like something that could help me. But the api JS client's doc doesn't say what this specific method actually does, how and when I should use it and how it relates to other methods (like: do I need to call .signIn() when I use .grantOfflineAccess(). (The docs basically just mention the method's existence. No explanation, guide, or example.)
Can you tell me if A) this method allows me to keep the user signed in and B) how I should use it?
Thank you.

Hi @alinnert,
When using gapi.auth2.init/signIn, the token is automatically refreshed in the background. Once the user is signed in, a fresh token will be available.
If you use gapi.client to access YouTube Data API, then it's done for you in the background and you can just call the API after the user consented to the required scopes.
You should not use grantOfflineAccess for pure client side apps. It's meant for server side apps.
The guide has more info: https://developers.google.com/identity/sign-in/web/sign-in

I see. I've heard of techniques that shouldn't be used in client side apps. So now I can put grantOfflineAccess into the same corner.
But when I just use init and signIn it works fine at first, but after one hour I get an error. I've done some research. That's how I've come to the conclusion that this happens because the access_token expires.
First, what am I doing:

gapi.load('auth2:client')
gapi.auth2.init({ apiKey, clientId, scope })
gapi.auth2.getAuthInstance().signIn({ prompt: 'select_account', ux_mode: 'redirect' })
gapi.client.request({ path: '.../youtube/v3/subscriptions/?mine=true&...' })

The error I get after one hour:
{
 "error": {
  "errors": [
   {
    "domain": "global",
    "reason": "authError",
    "message": "Invalid Credentials",
    "locationType": "header",
    "location": "Authorization"
   }
  ],
  "code": 401,
  "message": "Invalid Credentials"
 }
}

After signOut() and another signIn() it works again - for one hour. Is it supposed to work this way?

@alinnert this seems like a legitimate issue. The library should automatically refresh the token in the background, so you're using it right. We are investigating the root cause, I'll keep this thread posted.

Hi @alinnert, we pushed a fix for this issue. It should ensure the library refreshes the token before it expires. Let me know if that works!

@TMSCH If my machine is running for one hour it's working now, yes. But if I put it to e.g. standby or hibernation mode, and wake it up again after some time it wasn't able to get a new token in the meanwhile. If I try to make an API call then, it fails again. Isn't the client checking the token's age before making an API call with gapi.client.request()?
And I guess it's enough to refresh the page after you update the code, right?

@alinnert what browser are you using?

@TMSCH Firefox Developer Edition (57.0b8)

@alinnert I think we identified another potential root cause, and are pushing a fix.

@alinnert we pushed another fix, let me know if that works for you.

@TMSCH Unfortunately, no. Here is what happens:
[200] GET ...googleapis.com/youtube/v3/...

      (put laptop to sleep and wake it up again after ~90 minutes)

[ ? ] GET accounts.google.com/iframerpc?action=issueToken...

[401] GET ...googleapis.com/youtube/v3/...
response: the same 401 error object I've posted above

When I wake up my laptop there's this iframerpc request. It definitely gets fired after I wake up the laptop. But it has neither a status code or response body.
The YouTube API requests get manually triggered by a button.

Are you observing a call to iframerpc/action=issueToken? And there's no status code nor body, are you saying it's pending?

I'm just looking at the requests that get logged in the browser dev tools.
Since Firefox doesn't give me that much information about this request I've tried the same in Chrome. It says the request failed. It's not a pending request. In the console there's the following error: net::ERR_NETWORK_IO_SUSPENDED (source: 991844859-idpiframe.js:48).
I guess the iframerpc request happens too early after waking up.

bump

This issue still exists.
Any plans to fix it?

@TMSCH @grant Authorization works fine until access token not expires. Even I can able to access from another browser without any issue. After an hour again I have to go through the same validation process again. I have tried all the ways as provided in other issues. But no luck till now.
@TMSCH mentioned that grantOfflineAccess should not be used for pure client side apps.
Is there any workaround to make it similar like web apps offline access?
Could you please share a sample code?
Thanks in advance!


ChromeOS support

When attempting to use on Chrome OS, the font size is painfully small.

I had the same issue with Sublime Text until the most recent update so maybe it's a related issue.

Unfortunately there are some blockers for auto-detecting scaling on Linux (including for Linux apps on Chrome OS), but you should be able to manually work around this somewhat by changing editor.fontSize in settings. UI scaling is seemingly working properly with revery on sdl, and some Skia integration will help here as well, but it's still somewhat of a WIP feature.

Thanks for logging the issue @chimon2000 !
I believe this is the same root cause as #526 .
We're working on some changes in Revery to properly respect the GTK scaling via the GDK_SCALE environment variable: https://github.com/revery-ui/revery/pull/555
In this case, we'd use the following to figure out the right 'scaling' on Linux:

--force-device-scale-factor CLI flag
GDK_SCALE environment variable

What is the status of this now, since the updates to scaling have gone in?

I'll close this out as resolved with the scaling fixes - #793 #1069 #1206 - let us know if you're still seeing this, though!


Bitcoin js: BTC transaction with multiple inputs

Create an example of JavaScript integration code for a Bitcoin transaction with multiple inputs.
Note that while a transaction might have multiple inputs, a user should insert the passphrase only once for better user experience.
This should be similar to the Ethereum transaction example which can be found here.
Use this library: https://github.com/bitcoinjs/bitcoinjs-lib

via Hubstaff
User: Sinev Valentine
Project: Array.IO keychain - https://app.hubstaff.com/projects/471254
Date Range: 02/21/19 - 02/27/19
Work session total: 30:44:28
Grand total: 30:44:28


[LittleProxy v. 2.2.0] Not compatible with Android

The last version compatible with Android was 2.1.0 due to the following updates:

org.apache.commons
org.apache.logging.log4j

Hi @giuseppefrancodev

Why do you think the problem is with these two libraries?
Could you please describe your problem exactly: what was the error message + stack trace? Was it compile-time or runtime problem? etc.

When I tried to add `implementation 'io.github.littleproxy:littleproxy:2.2.0' dependency to my Android project, I didn't even compile - but the problem was with Netty libraries:
* What went wrong:
Execution failed for task ':app:mergeMoldova_stageReleaseJavaResource'.
> A failure occurred while executing com.android.build.gradle.internal.tasks.MergeJavaResWorkAction
   > 34 files found with path 'META-INF/INDEX.LIST' from inputs:
      - /Users/andrei/.gradle/caches/transforms-4/7d47165f2224733352b7119863f2b80a/transformed/jetified-netty-all-4.1.108.Final.jar
      - /Users/andrei/.gradle/caches/transforms-4/931e77e38f322eb547caae9c5b44a0d4/transformed/jetified-netty-transport-native-epoll-4.1.108.Final-linux-x86_64.jar
      - /Users/andrei/.gradle/caches/transforms-4/df493efcaebf019c108091f79630946c/transformed/jetified-netty-transport-native-epoll-4.1.108.Final-linux-aarch_64.jar
      - ...

Hi, there was some incompatibity with the project. Now is solved, the only thing needed is:
    packaging {         resources {             excludes += "META-INF/INDEX.LIST"             excludes += "META-INF/io.netty.versions.properties"         }     }


Register existing docker host.

We should allow users to easily register existing docker host/machine into a local docker-machine. This could probably be not too difficult if we follow the way the generic driver works. ie.: Give me ssh credentials and I setup a docker host.
This could be done with something like docker-machine register polka --ip-address xx.xx.xx.xx
Or with the various option used by the generic driver :
--generic-ip-address 										IP Address of machine
--generic-ssh-key "/Users/jlm/.ssh/id_rsa"					SSH private key path
--generic-ssh-port "22"										SSH port
--generic-ssh-user "root"									SSH user

btw, if you use the generic driver on an existing host, it will succesfully register the machine in docker-machine but at the expense of re-installing docker on the host.
This leads us to an interesting question : should we hack into the generic driver to allow not to re-install docker if it found it is already there, and just setup the certificates and register the docker host. Or should we have a dedicated command to this like the register one hinted above.
( the none diver as been in a distant path of some help on this, but the current code is broken in a way that it can't properly register existing host )

Closing as not relevant.

Can you explain why it is not relevant? I would be interested by such a feature, to manipulate a Swarm cluster in an easy way from different computers. Today I connect to SSH to a "controller" having docker-machine instead of using docker-machine directly.


How to get selected messages in the active chat

I searched documents but not found the selected messages in activechat object.
I also wonder how to select the messages.

I searched documents but not found the selected messages in activechat object.
I also wonder how to select the messages.

The requested functions don't exist in WAJS, but I added the label for us to add them in the future.

I searched documents but not found the selected messages in activechat object. I also wonder how to select the messages.

Me also trying to develop this feature. let us know if any body develop this

Any update on this issue?

My current solution is by traversing DOM tree,
function getSelectedMessages() {
  let selectedIds = Array.from(document.querySelectorAll("[role='row'] [data-id]")).filter(i=>i.querySelector('input:checked')).map(i=>i.dataset["id"])
  const selectedMsgs = WPP.whatsapp.MsgStore._models.filter(i=>selectedIds.includes(i.id._serialized))

  return selectedMsgs
}

// will return selected Messages object, and empty array if no selected message
console.log(getSelectedMessages())

It would be great to have this function baked into the lib.


Migrate columnar shuffle configurations to ConfigEntry

[BUG]/[FEATURE] title
What changes were proposed in this pull request?
Why are the changes needed?

What are the items that need reviewer attention?
Related issues.
Related pull requests.
How was this patch tested?
/cc @related-reviewer
/assign @main-reviewer

ping @kerwin-zk

LGTM except comment from @kerwin-zk

addressed


Order not executed because of "Gekko is already in process..."

Note: this is the technical bug tracker, please use other platforms for getting support and starting a (non technical) discussion. See the getting help page for details.
I'm submitting a ...
[X] bug report
[ ] question about the decisions made in the repository
Action taken (what you did)
Run tradebot (CLI), Gekko v0.6.5
Expected result (what you hoped would happen)
All orders are executed
Actual result (unexpected outcome)
Some orders were not executed because of "Received advice to sell/buy however Gekko is already in the process to sell/buy"
Other information (e.g. detailed explanation, stacktraces, related issues, suggestions how to fix, links for us to have context, eg. stackoverflow, etc)
I had this issue on multiple gekkos (bitfinex and kraken). I noticed that this happens, when the "[ORDER] summary" is missing in the order before. This could be the same issue as #2412.
Gekko v0.6.5 (CLI)
Bitfinex EUR/BTC

//LAST SUCCESSFUL BUY (missing "[ORDER] summary")
2018-08-17 20:07:23 (INFO):     2018-08-17T19:52:00Z NO-ADVICE   price= 5670.85891
2018-08-17 20:22:47 (INFO):     2018-08-17T20:07:00Z *** LONG ***  buy price= 5661.96668942
2018-08-17 20:22:47 (INFO):     2018-08-17T20:07:00Z LONG-ADVICE    price= 5661.96669

2018-08-17 20:22:47 (INFO):     We have new trading advice!
2018-08-17 20:22:47 (INFO):              Position: long
2018-08-17 20:22:47 (INFO):              Market price: 5661.96668942
2018-08-17 20:22:47 (INFO):              Based on market time: 2018-08-17 20:21:00

2018-08-17 20:22:47 (INFO):     Trader Received advice to go long. Buying  BTC
2018-08-17 20:38:12 (INFO):     2018-08-17T20:22:00Z LONG-ADVICE	price= 5658.60000
2018-08-17 20:52:31 (INFO):     2018-08-17T20:37:00Z LONG-ADVICE	price= 5662.10000
2018-08-17 21:09:03 (INFO):     2018-08-17T20:52:00Z LONG-ADVICE	price= 5674.20500
...

//ERROR
2018-08-21 10:22:50 (INFO):     2018-08-21T10:07:00Z NO-ADVICE   price= 5581.50000
2018-08-21 10:37:10 (INFO):     2018-08-21T10:22:00Z *** SHORT ***  sell price= 5593.79377326
2018-08-21 10:37:10 (INFO):     2018-08-21T10:22:00Z SHORT-ADVICE   price= 5593.79377

2018-08-21 10:37:10 (INFO):     We have new trading advice!
2018-08-21 10:37:10 (INFO):              Position: short
2018-08-21 10:37:10 (INFO):              Market price: 5593.79377326
2018-08-21 10:37:10 (INFO):              Based on market time: 2018-08-21 10:36:00

2018-08-21 10:37:10 (INFO):     Received advice to sell however Gekko is already in the process to buy
2018-08-21 10:37:10 (INFO):     Canceling buy order first
2018-08-21 10:52:33 (INFO):     2018-08-21T10:37:00Z SHORT-ADVICE        price= 5592.76775
2018-08-21 11:07:59 (INFO):     2018-08-21T10:52:00Z SHORT-ADVICE        price= 5595.54455

Might also be the same as #2465

So you've had this both on bfx and kraken? Because I have no problems on other exchanges, let's start out with bitfinex. Could you run this patch and log results? https://github.com/askmike/gekko/pull/2463

Meanwhile I'll introduce more logging around Gekko Broker orders, because there are too many issues right now.

One note about your logs: please turn on debug, that already spits out a lot more.

@askmike I just noticed I have this too on Binance. I had an open Buy order that was taking a while to fill and then the next advice advised to go short and it didn't cancel and sell. This led me to have a partial filled (exposed enough I think) but my strategy thought I was short at that point.
Then it didn't buy more on a long signal due to it thinking it was already exposed. I think I was 20% exposed at that point.
Is it possible to relay data to the strategy on whether I am long or short or exposed or not? Can I just use an event trigger on a portfolioValueChange in a strategy?
2018-08-21 10:13:59 (DEBUG):    [ORDER] statusChange: MOVING
2018-08-21 10:14:00 (DEBUG):    [ORDER] statusChange: OPEN
2018-08-21 10:14:06 (DEBUG):    Requested ZEC/BTC trade data from Binance ...
2018-08-21 10:14:07 (DEBUG):    Processing 3 new trades. From 2018-08-21 08:14:02 UTC to 2018-08-21 08:14:04 UTC. (a few seconds)
2018-08-21 10:14:07 (DEBUG):
      Current market: bear
      Percent change predicted: -0.6224794568842036
      Current price: 0.020732
      Last buy price: 0.020442
      Current position: long
2018-08-21 10:14:07 (INFO):     Received advice to sell however Gekko is already in the process to buy
2018-08-21 10:14:07 (INFO):     Canceling buy order first
2018-08-21 10:14:07 (DEBUG):    syncing private data
2018-08-21 10:14:07 (DEBUG):    syncing private data
2018-08-21 10:14:13 (INFO):     NOT selling, already no exposure
2018-08-21 10:14:16 (DEBUG):    Requested ZEC/BTC trade data from Binance ...
2018-08-21 10:14:17 (DEBUG):    No new trades.

2018-08-21 11:20:17 (DEBUG):
      Current market: bear
      Percent change predicted: 0.5567317458516279
      Current price: 0.020581
      Last buy price: 0.020442
      Current position: short
2018-08-21 11:20:17 (INFO):     NOT buying, already exposed

2018-08-21 10:14:07 (INFO):     Received advice to sell however Gekko is already in the process to > buy
2018-08-21 10:14:07 (INFO):     Canceling buy order first
2018-08-21 10:14:07 (DEBUG):    syncing private data
2018-08-21 10:14:07 (DEBUG):    syncing private data
2018-08-21 10:14:13 (INFO):     NOT selling, already no exposure

There was a bug here: after syncing Gekko did not reset the exposure, which is why the last line set NOT selling. I have pushed a fix for this (in both develop and the bfx debug branch). This one: https://github.com/askmike/gekko/commit/e12eea0279b2c16b2d3e308c09d77e7b24b2d95e

Hi @askmike, thank you for your work! i switched two of my bitfinex bots (eur/btc and usd/bch) to the bfx debug branch and enabled the debug logs. My strategy does not trade too often but i will post the logs here, when i see smth interesting.

both bfx debug gekkos executed the first order last night. It looks good and i also see the "[ORDER] summary" - therefore i guess the next order will be executed as well. i will post additional logs if an order should fail.
2470_bitfinex_eur_btc_bfx_debug.log

@danielm001 those logs look good. Note that I haven't changed the code in that branch, I only added more logging. Would love to see logs of it failing, thanks a lot!

Assuming this is fixed since e12eea0, if it isn't please create a new issue!

ok. no error so far, i think it‘s fixed as well. if not i‘ll open a new issue. thank a lot!


added a calculation of the Fast Hough Transform of an image

Moved code from https://github.com/Itseez/opencv/pull/3968 to opencv_contrib

@xolodilnik , very nice contribution ! Congratulations !

I like your API design, if this PR pass i am thinking extending your work with fast radon transform + inverse radon transform.

@xolodilnik, sorry for delay and thank you very much for the contribution! It looks great! I have one request (move header to opencv2 subdirectory) and one suggestion on the API; and then we can merge it in!

@vpisarev , i don't like the idea about "HoughPoints2Lines", because "FastHoughTransform" is calculating a dense voting picture along each discrete line of an image, and result can be used not only for line detection on edges images (for example, i used it for tracking oval objects on the structure tensor image in the videostream). I fixed all your notes, and then I have a warning about not defined function 'pyopencv_to<cv::Vec<int, 4> >' and two unsucsessfull builds. Can you help me with it?

@xolodilnik, I believe, if you change

CV_EXPORTS_W void HoughPoint2Line( const Point &houghPoint,
                                   InputArray  srcImgInfo,
                                   Vec4i       &line,
                                   int         angleRange = ARO_315_135,
                                   int         makeSkew = HDO_DESKEW,
                                   int         rules = RO_IGNORE_BORDERS );

to

CV_EXPORTS_W Vec4i HoughPoint2Line( const Point &houghPoint,
                                   InputArray  srcImgInfo,
                                   int         angleRange = ARO_315_135,
                                   int         makeSkew = HDO_DESKEW,
                                   int         rules = RO_IGNORE_BORDERS );

the problem will likely be solved. If not, temporary replace CV_EXPORTS_W with CV_EXPORTS.

@vpisarev, hello, i was fixed all your notes more than month ago. What else should i do to merge it in?

:+1:


Update SiteAuthSettings specs and introduce SiteAuthSettingsV2

MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Contribution checklist:

[ ] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

[x] Service team MUST add the "WaitForARMFeedback" label if the management plane API changes fall into one of the below categories.

adding/removing APIs.
adding/removing properties.
adding/removing API-version.
adding a new service in Azure.

Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs.

[ ] If you are blocked on ARM review and want to get the PR merged urgently, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.
Please follow the link to find more details on API review process.

You don't have permission to trigger SDK Automation.
Please add yourself to Azure group from opensource portal if you are MSFT employee,
or please ask reviewer to add comment *** /openapibot sdkautomation ***.
Please ask<EMAIL_ADDRESS>(or NullMDR in github) for additional help.

@cgillum @ConnorMcMahon @mattchenderson Making this PR to start the approval process for our updated swagger.

Can one of the admins verify this patch?

@mkarmark
You might need to refresh latest master. There is recently a merge on appservice 2019-08, which could be causing the BreakingChange in CI.

/azp run

All required CI is pass.
@mkarmark
Let me know when you want it merged.

@mkarmark
Let me know when you want it merged, or what is your schedule.


Added floor toggle and mesh scaling

Worked with Brett to incorporate floor toggle feature and some styling. Fixed a bug with pausing an animation and then switching to the other active.

I have yet to incorporate Michael's work with the splash page. If you guys wanted to do that tomorrow before demo, I don't think it will be very difficult with some git-foo.


RequestLobbyData, AddRequestLobbyListDistanceFilter and GameLobbyJoinRequested_t callback

Some more code for Steam lobbies :)

RequestLobbyData method
AddRequestLobbyListDistanceFilter method
If AddRequestLobbyListDistanceFilter is not called, k_ELobbyDistanceFilterDefault will be used, which will only find matches in the same or nearby regions.
GameLobbyJoinRequested_t callback, to be able to handle Invites from the other users

Very nice work, sir!  I'm still battling with GDNative.  The new master branch causes more problems and will require re-writing of the SConstruct file.  Always my biggest issue with GDNative, there are too many changes made to be stable.


Ensure with-package does not break nix run

with-packages alters the name of a package, which nix run expects to be a binary if meta.mainProgram is not set. This commit ensures that meta.mainProgram is set to the executable.

Thanks!


Add support for currencies which use symbols different to their alphabetic Code

An example of which is:
Kenyan shilling ( Alphabetic code : KES, symbol used is Ksh ),
or Tanzanian shilling( Alphabetic code : TZS, symbol used is Tsh)
I think there are many more like these.

We are not supporting symbols inside Currencies at all. Only formatting. If you want to use symbols, you can use the IntlFormatter, which in turn uses the intl extension.


Multi-field Import with Fixes

Includes PRs:

https://github.com/pilosa/java-pilosa/pull/173
https://github.com/pilosa/java-pilosa/pull/174

Coverage decreased (-0.2%) to 97.773% when pulling ff56d173c8a311e7ef5c4fc9ee1e6d99591ec4dc on yuce:mfi-with-fixes into f97d165b20fb5c59b143750ba284c8c083ff2691 on pilosa:master.


pre-rendered modality is deprecated

Fixes #149
Can anyone review? @jankowiakmaria @andyroyle ?

Looks fine to me :+1:
I would merge it, but it seems that my perms have been revoked since leaving OT

Sorry @andyroyle - can you retry now?

woohoo


Many timeout related UT failures

Story
Parent Issue
See follow up comments of various Travis build failures

fixed by https://github.com/intel-hadoop/gearpump/pull/1164

duplicate of #1165


rpi-imager: 1.8.1 -> 1.8.3

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Priorities
Add a :+1: reaction to pull requests you find important.

https://github.com/raspberrypi/rpi-imager/compare/v1.8.1...v1.8.3

Result of nixpkgs-review pr 268914 run on x86_64-linux 1

1 package built:

rpi-imager


[SUPPORT] Hudi enable metadata table feature when running alter table via spark.sql(query)

Tips before filing an issue

Have you gone through our FAQs? << link is dead

Join the mailing list to engage in conversations and get faster support at<EMAIL_ADDRESS>

If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced
A clear and concise description of the problem.
I have a Hudi table with "hoodie.metadata.enable"=false. Then, I try to delete the partition with spark.sql(s"ALTER TABLE $tableName DROP IF EXISTS PARTITION ($partitionSpec)").collect(). The metadata table somehow becomes enable.
To Reproduce
Steps to reproduce the behavior:

Write table with "hoodie.metadata.enable"=false.
Run some delete partition commands via spark.sql().
The .hoodie/metadata/ somehow has been created.

Expected behavior
A clear and concise description of what you expected to happen.
The metadata table should still disable
Environment Description

Hudi version : 0.15.0

Spark version : 3.3

Hive version : 2.3.9

Hadoop version :

Storage (HDFS/S3/GCS..) : GCS

Running on Docker? (yes/no) : no

Additional context
Add any other context about the problem here.
Stacktrace
Add the stacktrace of the error.

Should be a bug, we should comply with the existing table config for metadata table.

My workaround now is manually set the spark conf by running spark.conf.set("hoodie.metadata.enable", false) before running spark.sql(...). It seems to be okay now.
I guess it might cause by there is no hoodie.metadata.enable property and they read the default as true.

@ksoullpwk hoodie.metadata.enable is the writer properties and not table property so has to be passed along with writer also. Thats why setting with spark.conf works for you. So we should be good here.

To disable metadata while performing any operation with spark.sql(), we need to configure it as follows:
spark.sql("SET hoodie.metadata.enable=false")

Sample Code:
  // spark.sql("SET hoodie.metadata.enable=false")

  spark.sql(
    """
      |CREATE TABLE IF NOT EXISTS t_test (
      |  `id` VARCHAR(20),
      |  `name` VARCHAR(10),
      |  `age` INT,
      |  `ts` Long
      |) USING HUDI TBLPROPERTIES (primaryKey = 'id,name', preCombineField = 'ts')
      | LOCATION '/tmp/hudi/t_test'
    """.stripMargin)

  spark.sql("INSERT INTO t_test VALUES (1, \"hello\", 42,<PHONE_NUMBER>087)")

  spark.sql("SELECT * FROM t_test").show(false)

Do we also need to set it when running spark.table(tableName)?


cf7 push with start command but no Procfile fails for Python app

Issue
Pushing a simple Python app fails with cf7 when specifying the start command in manifest or on cmd line.
In contrast to the documentation https://docs.cloudfoundry.org/buildpacks/python/index.html#start-command, a Procfile seems to be required.
Context
Simple python-hello app (attached):

empty requirements.txt
index.html
server.py

import http.server
import socketserver

PORT = 8080

Handler = http.server.SimpleHTTPRequestHandler

with socketserver.TCPServer(("", PORT), Handler) as httpd:
    print("serving at port", PORT)
    httpd.serve_forever()

manifest.yml

---
applications:
- name: python-hello
  buildpacks:
  - python_buildpack
  random-route: true
  command: python3 server.py
  memory: 128M

stephan@WDFN34095835A:~/d047883/tmp/python-hello$ cf7 --version
cf7 version 7.1.0+4c3168f9a.2020-09-09

Same example works with cf6.
Colleagues report the same problem for nodejs apps. Therefore, I don't think that it is a buildpack issue but more related to CC v3.
https://docs.cloudfoundry.org/buildpacks/python/index.html#start-command refers to https://www.pivotaltracker.com/n/projects/966314/stories/132190561 which states:

Allow null process_types when a v2 app is staged

V2 apps can get start commands specified during a push or from a manifest, so Procfiles are not required
V3 apps continue to require Procfiles for successful staging

(https://github.com/cloudfoundry/cloud_controller_ng/commit/a0fc3c36bc0d34c7cdd7c2e17a872e60af12d029)
Steps to Reproduce

unzip the attached example python app
cf7 login
cf7 push -> failes with "StagingError - Staging error: No process types returned from stager" (see logs below)
cf7 push --no-manifest -c 'python3 server.py' --random-route -m 128M -b python_buildpack python-hello -> fails as well
cf6 push succeeds

When adding a Procfile to the app, cf7 push succeeds as well:
web: python3 server.py

Expected result
cf7 push succeeds without Procfile. I.e. same behavior as for cf6.
Current result
Pushing app python-hello to org uptime / space test as<EMAIL_ADDRESS>Applying manifest file /c/Users/d047883/tmp/python-hello/manifest.yml...
Manifest applied
Packaging files to upload...
Uploading files...
 594 B / 594 B [=========================================================================================================================================================================================] 100.00% 1s

Waiting for API to complete processing files...

Staging app and tracing logs...
   Downloaded python_buildpack
   Cell 18ff5e53-a3a7-4252-984d-410a261a2eda creating container for instance 6cc2a860-5953-40ab-aa73-f4707235c61c
   Cell 18ff5e53-a3a7-4252-984d-410a261a2eda successfully created container for instance 6cc2a860-5953-40ab-aa73-f4707235c61c
   Downloading app package...
   Downloaded app package (594B)
   -----> Python Buildpack version 1.7.18
   -----> Supplying Python
   -----> Installing python 3.8.5
          Copy [/tmp/buildpacks/d7b853a1f20575496c8d1e954762b5cd/dependencies/e0d0b83bd1361d27c169058aedc9573c/python_3.8.5_linux_x64_cflinuxfs3_08613f97.tgz]
   -----> Installing pip-pop 0.1.5
          Copy [/tmp/buildpacks/d7b853a1f20575496c8d1e954762b5cd/dependencies/2e88c958cb5cf0638aa875fa2e7b99e0/pip-pop-0.1.5-b32efe86.tar.gz]
   -----> Running Pip Install
          WARNING: You are using pip version 20.1.1; however, version 20.2.4 is available.
          You should consider upgrading via the '/tmp/contents817893367/deps/0/bin/python -m pip install --upgrade pip' command.
   No start command specified by buildpack or via Procfile.
   App will not start unless a command is provided at runtime.
   Exit status 0
   Uploading droplet, build artifacts cache...
   Uploading build artifacts cache...
   Uploading droplet...
   Uploaded build artifacts cache (15.7K)
   Uploaded droplet (55.3M)
   Uploading complete
   Cell 18ff5e53-a3a7-4252-984d-410a261a2eda stopping instance 6cc2a860-5953-40ab-aa73-f4707235c61c
   Cell 18ff5e53-a3a7-4252-984d-410a261a2eda destroying container for instance 6cc2a860-5953-40ab-aa73-f4707235c61c
   Cell 18ff5e53-a3a7-4252-984d-410a261a2eda successfully destroyed container for instance 6cc2a860-5953-40ab-aa73-f4707235c61c
StagingError - Staging error: No process types returned from stager
FAILED

python-hello.zip

I followed up with the buildpacks team and it sounds like it's expected that some buildpacks will not return process types or start commands. Based on that, CC should handle this case more gracefully, especially if there is already a start command provided on via the API/manifest.

It is interesting to note the problem is fixed by simply specifying the process type in the Procfile as follows without any commands
web:

In this case the command in the manifest is honored. Probably better to do it this way to ensure you don't have one set of commands in the manifest overwrite the one in Procfile (or other way around).

It is interesting to note the problem is fixed by simply specifying the process type in the Procfile as follows without any commands
web:

In this case the command in the manifest is honored. Probably better to do it this way to ensure you don't have one set of commands in the manifest overwrite the one in Procfile (or other way around).

This issue was addressed in capi-release 1.105. Thank you for raising this issue!


Is it possible to move sections out of config.toml?

IMHO the current config.toml in this theme is overloaded with stuff that should be kept out of it. is it possible to put work and clients out of it?
Thanks!

I've outsourced them into their own files. Read the CHANGELOG for more information.


WIP: github actions workflow

I'm not sure what the process is to update this to use github actions, but here is the run on my branch:
https://github.com/rezural/salva/actions

not sure if all the features i have enabled in the matrix is needed, probably not parry.

Thanks, that looks good. I think that it has to be merged at least once for it to run. So I’ll merge this and see how it goes.


Ensure isolate script is passed as command arg when installing modules

For #11399

[x] Pull request represents a single change (i.e. not fixing disparate/unrelated things in a single PR).
[x] Title summarizes what is changing.
[x] Has a news entry file (remember to thank yourself!).
[ ] Appropriate comments and documentation strings in the code.
[ ] Has sufficient logging.
[ ] Has telemetry for enhancements.
[x] Unit tests & system/integration tests are added/updated.
[ ] Test plan is updated as appropriate.
[ ] package-lock.json has been regenerated by running npm install (if dependencies have changed).
[ ] The wiki is updated with any design decisions/details.

Codecov Report

Merging #11447 into master will decrease coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master   #11447      +/-   ##
==========================================
- Coverage   61.03%   61.01%   -0.03%
==========================================
  Files         613      613
  Lines       33630    33631       +1
  Branches     4751     4751
==========================================
- Hits        20527    20520       -7
+ Misses      12657    12079     -578
- Partials      446     1032     +586

Impacted Files
Coverage Δ

src/client/common/installer/moduleInstaller.ts
94.66% <100.00%> (ø)

src/client/common/process/internal/python.ts
59.61% <100.00%> (+0.79%)
:arrow_up:

...nterpreter/locators/services/currentPathService.ts
90.62% <100.00%> (ø)

src/datascience-ui/react-common/arePathsSame.ts
75.00% <0.00%> (-12.50%)
:arrow_down:

src/client/common/utils/platform.ts
64.70% <0.00%> (-11.77%)
:arrow_down:

...cience/ipywidgets/cdnWidgetScriptSourceProvider.ts
84.48% <0.00%> (-2.59%)
:arrow_down:

src/client/datascience/debugLocationTracker.ts
76.56% <0.00%> (-1.57%)
:arrow_down:

src/client/common/process/proc.ts
14.49% <0.00%> (-0.73%)
:arrow_down:

src/client/testing/main.ts
14.38% <0.00%> (ø)

src/client/common/editor.ts
8.25% <0.00%> (ø)

... and 141 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ebfc9e7...c41a92e. Read the comment docs.


Beginnger tutorial

So was walking through the beginer tutorial but ran into issues as I think there are some application dependencies. aka supervisor?   assuming this supervisorctl is a pip install?  so perhaps this needs to be added so we can get everything needed installed?
- name: pip install supervisor
  ansible.builtin.pip:
    name: supervisor

was at "installing the application"
https://redhat-scholars.github.io/ansible-tutorial/ansible-tutorial/02-getting-started.html#installapp
put in creating the supervisord.d folder? as that also wasn't there? and the copy of hello.conf failed
- name: Create a directory if it does not exist
  file:
    path: /etc/supervisord.d
    state: directory
    mode: '0755'
  tags: ['setup']

tried this command directly:
/usr/local/bin/supervisorctl reread
error: <class 'ConnectionRefusedError'>, [Errno 111] Connection refused: file: /usr/lib64/python3.9/socket.py line: 832
Seems like there is something perhaps missing here in the ansible steps in order to start
supervisord with the hello.conf file?
Noticed if i changed hello.conf to supervisord.conf  in the /etc/supervisord.d folder then I got
Error: .ini file does not include supervisorctl section
For help, use /usr/local/bin/supervisorctl -h
So seems like the example file needs more re: a  supervisorctl section?
Feeling there may be other requirements for the example to work.  aka pip, other pip requirements?  If, so that would be good to put in the playbook example so that everything is set up to get the supervisorctl working, before we try the curl?

Didn't see the pre-req page where some of this was bing done via containers.


Better wasp pipeline

More careful tagging of images for stacking, cal hunting, output regions file, update headers with photometry,

CI seems to be failing for unrelated warning about gaia server


Update babylon.mixMaterial.ts

Fix this.mixTexture2 by this._mixTexture2

@deltakosh is the « what’s new » update necessary ?

I do not think so, it has already been done.
I made you a report on the Julien forum about the problems with this material.

Yeah I read that, i’ll Take time this weekend to fix and add options. I noticed the dark glitch and I have an idea how to fix it


Nothing in /app/data or /app/logs when using docker

Nothing is in these mapped drives when I start the container in docker compose.
searcharr:
    container_name: searcharr
    image: toddrob/searcharr:latest
    volumes:
      - /opt/searcharr/data:/app/data
      - /opt/searcharr/logs:/app/logs
      - /opt/searcharr/settings.py:/app/settings.py
    environment:
      - PUID=1000
      - GUID=1000
      - TZ=Europe/London
    restart: unless-stopped
    network_mode: host

Run docker logs searcharr to see if it's throwing an exception that's not being caught.
If there's no docker log, add command: python3 searcharr.py -v to docker-compose.yml and recreate the container (restarting is not enough). That will enable debug logging and then you should at least see the log file get created in the logs folder with an error message.

Thanks it's have got it working and there are logs in the logs folder now. It seems there is another issue. This is an entry in the logs.
Traceback (most recent call last):
  File "/app/searcharr.py", line 1001, in <module>
    tgr = Searcharr(settings.tgram_token)
  File "/app/searcharr.py", line 55, in __init__
    sonarr.Sonarr(settings.sonarr_url, settings.sonarr_api_key, args.verbose)
  File "/app/sonarr.py", line 23, in __init__
    self.get_all_series()
  File "/app/sonarr.py", line 67, in get_all_series
    r = self._api_get("series", {})
  File "/app/sonarr.py", line 142, in _api_get
    r = requests.get(url)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 637, in send
    adapter = self.get_adapter(url=request.url)
  File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 730, in get_adapter
    raise InvalidSchema("No connection adapters were found for {!r}".format(url))
requests.exceptions.InvalidSchema: No connection adapters were found for '<IP_ADDRESS>:8989/api/series?apikey=<myapikey>'

Put http:// or https:// on your Sonarr url in settings.py.

That worked. Thanks for your help, really appreciate it.


Double @media query in header

I found a double max-width: 670px in https://github.com/wesbos/Syntax/blob/5bbfc5ef778639af800a3e8ea174cecb13a3c33a/styles/_header.styl#L68-L77 while running Syntax.fm through Project Wallace: https://www.projectwallace.com/teamwallace/syntaxfm/imports/20181103144312413. I guess this extra MQ could be removed, as well as the resets above this nested MQ.

If this is deemed as an issue I'd love to practice a PR and delete lines 75-77 =)

#341 fixes the stylesheet and removes the redundant CSS


Error with @root_validator in voice.py since version 0.2.22

Description:
When importing from elevenlabs, I encountered a PydanticUserError related to the use of @root_validator in the voice.py file.
Steps to reproduce:

Install elevenlabs version 0.2.22.
The import should be successful without any errors.

Actual behavior:
Received the following error traceback:
File "/usr/local/lib/python3.10/site-packages/elevenlabs/api/voice.py", line 38, in VoiceClone
def computed_files_tuple(cls, values) -> List[str]:
File "/usr/local/lib/python3.10/site-packages/pydantic/deprecated/class_validators.py", line 228, in root_validator
raise PydanticUserError(
pydantic.errors.PydanticUserError: If you use `@root_validator` with pre=False (the default) you MUST specify `skip_on_failure=True`. Note that `@root_validator` is deprecated and should be replaced with `@model_validator`.

The specific error suggests that the use of @root_validator is deprecated and should be replaced with @model_validator. Additionally, it mentions the need to specify skip_on_failure=True if using @root_validator with pre=False.
For more details, refer to: https://errors.pydantic.dev/2.1.1/u/root-validator-pre-skip
Additional details:

This issue started appearing from version 0.2.22.
I am using Python version 3.10.12.

Would appreciate any insights or potential fixes for this!

Full error trace:
Aug 6 06:38:10 PM      from elevenlabs import generate, set_api_key, voices
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/elevenlabs/__init__.py", line 1, in <module>
Aug 6 06:38:10 PM      from .api import *  # noqa F403
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/elevenlabs/api/__init__.py", line 2, in <module>
Aug 6 06:38:10 PM      from .history import *  # noqa F403
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/elevenlabs/api/history.py", line 9, in <module>
Aug 6 06:38:10 PM      from .voice import VoiceSettings
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/elevenlabs/api/voice.py", line 30, in <module>
Aug 6 06:38:10 PM      class VoiceClone(API):
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/elevenlabs/api/voice.py", line 38, in VoiceClone
Aug 6 06:38:10 PM      def computed_files_tuple(cls, values) -> List[str]:
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/pydantic/deprecated/class_validators.py", line 222, in root_validator
Aug 6 06:38:10 PM      return root_validator()(*__args)  # type: ignore
Aug 6 06:38:10 PM    File "/usr/local/lib/python3.10/site-packages/pydantic/deprecated/class_validators.py", line 228, in root_validator
Aug 6 06:38:10 PM      raise PydanticUserError(
Aug 6 06:38:10 PM  pydantic.errors.PydanticUserError: If you use `@root_validator` with pre=False (the default) you MUST specify `skip_on_failure=True`. Note that `@root_validator` is deprecated and should be replaced with `@model_validator`.
Aug 6 06:38:10 PM
Aug 6 06:38:10 PM  For further information visit https://errors.pydantic.dev/2.1.1/u/root-validator-pre-skip
Aug 6 06:38:10 PM  1

This happens if you have a pydantic version >=2.0. By default it should be constrained to be pydantic>=1.10,<2.0, have you installed a the newer version?

Update: from v0.2.25 we use pydantic 2.0.