eswifi: udp sockets do not respect port bind

Describe the bug
eswifi-offloaded networking does not respect port bindings for clients. If you bind a socket to a specific port, or bind to 0, and then try to send to a remote, the bound port is disregarded and datagrams appear to be sent from the destination port. There appears to be no way to set the source port as a client, and the source port is always the same as the destination port.

What target platform are you using? B-L4S5I-IOT01A

What have you tried to diagnose or workaround this issue?

Bind to 0, sendto
Bind to 32100, sendto
Bind to 0, connect, send
Bind to 32100, send
Connect, send
Created example on mac os using posix api to demonstrate expected behavior

Is this a regression? If yes, have you been able to "git bisect" it to a
specific commit? No

To Reproduce
Steps to reproduce the behavior:
See attached file for full reference implementation.
This demonstrates how I am trying to use it, though.
  int ret;
  static char buf[] = "Hello world";

  /* Local sockaddr */
  struct sockaddr_in my_addr = {
    .sin_family = AF_INET,
    .sin_addr.s_addr = htonl(INADDR_ANY),
    .sin_port = htons(0)
  };

  /* Remote sockaddr */
  struct sockaddr_in server_addr = {
    .sin_family = AF_INET,
    .sin_port = htons(dst_port)
  };
  inet_pton(AF_INET, dst, &server_addr.sin_addr);

  int sock = zsock_socket(my_addr.sin_family, SOCK_DGRAM, IPPROTO_UDP);

  ret = zsock_bind(sock, (const struct sockaddr *)&my_addr, sizeof(struct sockaddr_in));
  if (ret < 0) { LOG_ERR("Bind: %d", ret);}

  ret = zsock_sendto(sock, buf, sizeof(buf), 0, (const struct sockaddr *)&server_addr, sizeof(struct sockaddr_in));
  if (ret < 0) { LOG_ERR("Sendto: %d", ret);}

Expected behavior
I expect that when I bind a socket to port 0, a random port is assigned and all sends using that socket are sent from that port. I also expect that when I bind a socket to a specific port, like 32100, all sends using that socket are sent from that port.
What wireshark has shown me is that packets sent from that socket have src port == dst port.
Impact
This is a major problem because I am not able to reestablish communications after reboots. I don't have any control over the source port. DTLS will ignore new handshake requests until server-side session expirations trigger. With a new port, I am able to initiate new handshakes.
Logs and console output
See attached for wireshark screencap.
Environment (please complete the following information):

OS: Mac OS
Toolchain: Zephyr SDK 0.15.2
Version: v3.3.0

udp.zip

This posix example demonstrates that providing the port in the sockaddr_in at bind associates the socket with that port. Wireshark confirms.
#include <string.h>
#include <sys/socket.h>
#include <arpa/inet.h>

static char buf[] = "Hello";

int main() {
  int ret;

  struct sockaddr_in my_addr = {
    .sin_family = AF_INET,
    .sin_addr.s_addr = htonl(INADDR_ANY),
    .sin_port = htons(32100)
  };

  struct sockaddr_in server_addr = {
    .sin_family = AF_INET,
    .sin_port = htons(5684)
  };
  inet_pton(AF_INET, "<IP_ADDRESS>", &server_addr.sin_addr);

  int sock = socket(my_addr.sin_family, SOCK_DGRAM, IPPROTO_UDP);

  ret = bind(sock, &my_addr, sizeof(struct sockaddr_in));
  if (ret < 0) { printf("Bind: %d", ret);}

  if (connect(sock, (struct sockaddr *)&server_addr, sizeof(server_addr)) < 0) {
    printf("Failed to set socket peer address %s", "<IP_ADDRESS>:5684");
  }

  ret = send(sock, buf, sizeof(buf), 0);
  if (ret < 0) { printf("Sendto: %d", ret);}

  return 0;
}

This looks like it is probably a bug with eswifi. The network stack is offloaded to the eswifi chip, and even if I try to disable network offloading, it is selected anyway.

@loicpoulain I pulled in your latest change to bind (9afa73236b1a3b6937eb0e7ff04a326bb8f1b0f6), which starts a UDP server with P5. But then the next call, sendto(), starts a UDP client with P6. So the port bound to the udp server socket is not used.

bind-sendto-udp.zip

I reached out to Inventek, and the response from them is that it is not possible to set the UDP client port.
I think this is a limitation that should be documented for this driver, or at least an error/log message should be returned if a bind/sendto occurs on the same port (c8f48681ed8161607b634d924061e9a946891673 will tear down the server silently, which is confusing if you expect bind/sendto to work).

I reached out to Inventek, and the response from them is that it is not possible to set the UDP client local port.
I think this is a limitation that should be documented for this driver, or at least an error/log message should be returned if a bind/sendto occurs on the same port. sendto will tear down the server (c8f4868) started by bind (54e8d10) silently, which is confusing if you expect bind/sendto to work.

Thanks for investigating this. Would you mind opening a Pull Request that does what you suggest? (document the limitation and issue an error message)


Update to v1.4.4, fix Python min (CFEP-25), add @wshanks

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.
I do have some suggestions for making it better though...
For recipe/meta.yaml:

ℹ No valid build backend found for Python recipe for package python-subunit using pip. Python recipes using pip need to explicitly specify a build backend in the host section. If your recipe has built with only pip in the host section in the past, you likely should add setuptools to the host section of your recipe.
ℹ PyPI default URL is now pypi.org, and not pypi.io. You may want to update the default source url.

This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12552188615. Examine the logs at this URL for more detail.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

@conda-forge-admin please rerender
Honestly, I don't know of the protocol to "remove" a maintainer.....

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found some lint.
Here's what I've got...
For recipe/meta.yaml:

❌ Recipe maintainer "RajeeGit" does not exist

This message was generated by GitHub Actions workflow run https://github.com/conda-forge/conda-forge-webservices/actions/runs/12552796128. Examine the logs at this URL for more detail.

hmm lol, he doesn't exist anymore..

@conda-forge-admin please rerender

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

Hi! This is the friendly conda-forge automerge bot!
I considered the following status checks when analyzing this PR:

linter: passed
azure: passed

Thus the PR was passing and merged! Have a great day!


Write module to parse dnadiff output

After developing the initial workflow for the dnadiff method #12, we need to ensure that we can reproduce the AlignedBases value provided by dnadiff.
To achieve this, we should:

Write a module to parse all files generated by the Snakemake workflows for the dnadiff method.
Generate a test set of expected output using dnadiff.
Use pytest to compare the expected output with the output provided by the module.

I started working on this under the issue_17 branch.
So far, I have written functions to parse .mcoords and .rdiff files. The code still requires testing and few tweaks.

Should we close this issue since parsing of dnadiff output was merged with #126?

Yes, and #133 will cover the final steps of getting this into the DB.


feat: add Chinese translations for Hong Kong (zh-HK), Taiwan (zh-TW) and China (zh-CN) locales

Thank you @neotan for the contribution!

Are they compatible with the latest version of the program?

@Tilannlou will be available in 0.3.3 which is coming soon, but not yet out.  ETA this week

如何將LM STUDIO設定語言增加中文選項


Improve SVD with no truncation

This combines the svd code when truncation or no truncation is requested, minimizing code duplication and fixing a bug that appeared when no truncation was requested.
This also makes sure that when cutoff=0, null singular values are truncated.

Codecov Report

Merging #258 into master will decrease coverage by 0.22%.
The diff coverage is 89.13%.

@@            Coverage Diff             @@
##           master     #258      +/-   ##
==========================================
- Coverage   80.93%   80.70%   -0.23%
==========================================
  Files          50       50
  Lines        4830     4783      -47
==========================================
- Hits         3909     3860      -49
- Misses        921      923       +2

Impacted Files
Coverage Δ

src/indexset.jl
73.33% <0.00%> (-0.33%)
:arrow_down:

src/mps/mpo.jl
98.49% <66.66%> (-0.60%)
:arrow_down:

src/Tensors/blocksparse/linearalgebra.jl
97.48% <100.00%> (-0.11%)
:arrow_down:

src/Tensors/linearalgebra.jl
88.42% <100.00%> (+0.09%)
:arrow_up:

src/decomp.jl
95.94% <100.00%> (ø)

src/mps/mps.jl
99.26% <100.00%> (-0.01%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6cd7427...7136b42. Read the comment docs.


Remove the Handled property from PushNotificationReceivedEventArgs

Update the idl and all the callers on the WindowsAppSDK and the demo and test apps.
Verified that the Push Notification tests keep passing.

/azp run

/azp run

re-ran the pipelines as some processes failed on x64. The failure doesn't seem related to this PR.

/azp run


Remove sensitive information

Remove sensitive information

I need more info here. Feel free to reopen if you have a specific concern.


Flush channel in QueuedObservable.DisposeAsync()

Breaking change

Proposed change

Type of change

[ ] Dependency upgrade
[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (which adds functionality to an existing integration)
[ ] Breaking change (fix/feature causing existing functionality to break)
[ ] Code quality improvements to existing code or addition of tests

Additional information

This PR fixes or closes issue: fixes #
This PR is related to issue:
Link to documentation pull request:

Checklist

[ ] The code change is tested and works locally.
[ ] Local tests pass. Your PR cannot be merged unless tests pass
[ ] There is no commented out code in this PR.
[ ] I have followed the [development checklist][dev-checklist]
[ ] The code compiles without warnings (code quality chek)
[ ] Tests have been added to verify that the new code works.

If user exposed functionality or configuration variables are added/changed:

[ ] Documentation added/updated for www.home-assistant.io

Codecov Report

Merging #590 (624d74f) into app_model (8bcd659) will decrease coverage by 0.06%.
The diff coverage is 83.33%.

@@              Coverage Diff              @@
##           app_model     #590      +/-   ##
=============================================
- Coverage      85.94%   85.88%   -0.07%
=============================================
  Files            110      110
  Lines           3010     3004       -6
  Branches         316      317       +1
=============================================
- Hits            2587     2580       -7
  Misses           285      285
- Partials         138      139       +1

Flag
Coverage Δ

unittests
85.88% <83.33%> (-0.07%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...l/NetDeamon.HassModel/Internal/QueuedObservable.cs
94.44% <80.00%> (-3.18%)
:arrow_down:

...odel/Internal/Client/AppScopedHaContextProvider.cs
77.77% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8bcd659...624d74f. Read the comment docs.


MNT: Re-rendered with conda-build 3.18.8, conda-smithy 3.4.1, and con…

Only for rerendering

@steffengraber can you please look at https://github.com/conda-forge/nest-simulator-feedstock/pull/14/files#r306381198


Doesnt work anymore

This library does not work anymore as this line fails - https://github.com/i18next/i18next-fluent/blob/master/src/index.js#L66

Need more details...i18next.languages is empty there...can't be after initializing at least not if either you set a lng on init or use the browser-languagedetector....

I'm able to reproduce this issue server-side where I'm using i18nextMiddleware.LanguageDetector in a node.js express app. My i18next init looks like this:
    i18next
        .use(i18nextMiddleware.LanguageDetector)
        .use(FilesystemBackend)
        .use(Fluent)
        .init({
            debug: true,
            fallbackLng: 'en',
            preload: ['en', 'de'],
            ns: ['translation', 'my.namespace'],
            detection: {
                order: ['cookie', 'querystring', 'header'],
                lookupCookie: 'lang'
            },
            backend: {
                loadPath: path.join(__dirname, '..', '..', 'client', 'build', 'locales/{{lng}}/{{ns}}.ftl'),
                parse: function(data) {
                    return ftl2js(data);
                }
            }
        });

It works if I set the lng option, but then that bypasses the language detection.

On serverside that can't really work...not this way...language detection happens during request - not on init -> there is also not the main instance used but a cloned instance on request!!!
So https://github.com/i18next/i18next-fluent/blob/master/src/index.js#L66 has to be done based on languages in preload.
A PR would be very welcome...

@oasalonen  If memory serves correctly I think that was the issue.
BTW, been using this library since this issue was created so kudos @jamuhl for creating this library!

thank you both for making this module better 👍


chore(ci): automatically delete cache entries associated with closed PRs

Description

Problem*
Looking at our current cache entries, we've got a number of these which are associated with merged pull requests

I don't think that these will actually ever be used past when the PR is actually merged so this just takes up cache space and contributes to churn.
Summary*
I've taken a workflow from
https://docs.github.com/en/actions/using-workflows/caching-dependencies-to-speed-up-workflows#force-deleting-cache-entries so that we automatically evict these from the cache once they are merged.
Documentation

[ ] This PR requires documentation updates when merged.

[ ] I will submit a noir-lang/docs PR.

[ ] I will request for and support Dev Rel's help in documenting this PR.

Additional Context

PR Checklist*

[x] I have tested the changes locally.
[x] I have formatted the changes with Prettier and/or cargo fmt on default settings.

@phated Are we good to merge this and see how it performs?

Are we good to merge this and see how it performs?

Yeah, I think so. Couple of comments inline though


Added total amount

Added setting "Total" and "Amount" which, if enabled, displays a field with the total value of what you hold(price*amount).

Hey @Madso02, Thanks you so much for your contribution!  This is a really cool feature. I'll be taking a look a it and create a new release with these changes.
Appreciate it 🙌

Sounds good @matextrem,
I apologise for already building and comitting the release, i realise it should not be done this way.

@Madso02 New 1.6.0 version released https://github.com/matextrem/streamdeck-tickertap/releases/tag/v1.6.0
Thanks!


[AOT] warning wrong type error message when using pug on webpack watch rebuilding

Versions
`@ngtools/webpack`: 6.0.0-beta.4

Repro steps

Branch: pug_issue
https://github.com/JounQin/ng-rubick/blob/pug_issue/src/views/console/console.component.pug
run yarn dev first, there is no error message, but whenever you change anything to trigger webpack rebuild, there will be an error message on console.
If I use html template, there will not be an error message. And I've checked the pug file output content, it is correct, and if I copy it and set it to be template content, there will not be an error message neither.
Observed behavior
ERROR in src/views/console/console.component.pug(1,1): : Property 'breadCrumb' is private and only accessible within class 'ConsoleComponent'.
src/views/console/console.component.pug(1,1): : Property 'label' does not exist on type 'BreadCrumbService'.
src/views/console/console.component.pug(1,1): : Property 'breadCrumb' is private and only accessible within class 'ConsoleComponent'.
src/views/console/console.component.pug(1,1): : Property 'label' does not exist on type 'BreadCrumbService'.

Desired behavior

No error message
Mention any other details that might be useful (optional)
Webpack: 4.0.1

There is no error any more after upgrading everything and replace pug-html-loader with pug-plain-loader.


File upload only works on 2nd attempt

Hi,
you examples work for me in part. But it only works on 2nd attempt.
With

onDrop(acceptedFiles, rejectedFiles) {
this.setState({ files: acceptedFiles, })

console.log('Accepted files: ', this.state.files)
console.log('Rejected files: ', rejectedFiles)
this.state.files.map((file) => $('#preview').append('') )
}

on the 1st attempt, state.files remains unidentified.
Also, this part from the example does exactly nothing. No error, no output.
{this.state.files.length > 0 ?

Uploading {this.state.files.length} files...

{this.state.files.map((file) =>  )}

 : null}

this.setState is async in React. Try using a second argument which is a callback function to do the work.


errors while processing file

For the most part the install is working well, Thank You.
/untagged/Colin Powell (1 items)
Finding tags for album "Colin Powell - Colin Powell".
Candidates:
1. Bud Powell - Strictly Powell (25.4%) (missing tracks, album, artist, ...) (1982, FR)
2. Jesse Powell - Jesse Powell (23.6%) (missing tracks, tracks, album, ...) (CD, 1996, US, MCA Records, 11287)
3. Jesse Powell - Jesse Powell (23.6%) (missing tracks, tracks, album, ...) (Digital Media, 1996, CA, Silas)
4. Bud Powell - Strictly Powell (23.3%) (missing tracks, album, artist, ...) (Digital Media, 1957, XW, RCA)
5. Bud Powell - Bud Powell (17.9%) (missing tracks, tracks, album, ...) (CD, 2001, Giants of Jazz, CD 53362)
# selection (default 1), Skip, Use as-is, as Tracks, Group albums,
Enter search, enter Id, aBort, eDit, edit Candidates? Error while requesting https://api.audnex.us/books/B08L39TTVK/chapters, attempt 1/3: status code 404, Not Found
Error while requesting https://api.audnex.us/books/B08L39TTVK/chapters, attempt 2/3: status code 404, Not Found
Error while requesting https://api.audnex.us/books/B08L39TTVK/chapters, attempt 3/3: status code 404, Not Found
audible: Error while fetching book information from Audnex
Traceback (most recent call last):
  File "/plugins/audible/audible.py", line 255, in get_albums
    return [self.get_album_info(p["asin"]) for p in products_without_unreleased_entries]
  File "/plugins/audible/audible.py", line 255, in <listcomp>
    return [self.get_album_info(p["asin"]) for p in products_without_unreleased_entries]
  File "/plugins/audible/audible.py", line 264, in get_album_info
    (book, chapters) = get_book_info(asin)
  File "/plugins/audible/api.py", line 25, in get_book_info
    chapter_response = json.loads(make_request(f"{AUDNEX_ENDPOINT}/books/{asin}/chapters"))
  File "/plugins/audible/api.py", line 50, in make_request
    raise e
  File "/plugins/audible/api.py", line 42, in make_request
    with request.urlopen(req) as response:
  File "/usr/lib/python3.9/urllib/request.py", line 214, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.9/urllib/request.py", line 523, in open
    response = meth(req, response)
  File "/usr/lib/python3.9/urllib/request.py", line 632, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.9/urllib/request.py", line 561, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.9/urllib/request.py", line 641, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

This is a download from Audiable, and most seem to tag perfect. This one does not, and the embedded data does not include the actual book / recording name = Colin Powell, An American Hero Speaks out
I changed the file name to "Colin Powell, An American Hero Speaks out" and the above happened.

Unfortunately, this is something entirely outside my control.
Please file an issue with Audnexus, since that is where the plugin gets its info from.


nvidia-smi

would you think possible to include nvidia-smi power consuptions working with ethmonitoring ?

Yes, i'l include it.

could you point me in the right direction?

Just need to read the output of this command:
nvidia-smi -i 0 --loop-ms=1000 --format=csv,noheader --query-gpu=power.draw
Unfortunately I don't work with NVidia to test it.


Problem: Invariant ASTs are incorrect

We've modelled our invariants as AST incorrectly.
We're inferring the "properties" by scanning the invariant, even though sample DQL code specifies the exact parameters you're using.
create invariant 'shopper-has-active-cart' (shopper_id) as (identifier) satisfied by (
	<:
		from all
			count as cart_count
		where shopper_id == shopper_id
			and is_created == true
			and is_checked_out == false
		check cart_count > 0
	:>
);

We've basically added a lot of extra work that should just be a part of the AST at the top to begin with.
We need to change all our ASTs (and our tests) to this new format, and ensure everything works.
Thankfully this will make invariants easier to use and model, so discovering this now was a win.

Solution: Add the parameters to the AST for invariants, remove the paramaterscanner class
SuccessCriteria: Current tests pass

Looks good. ASTs have the missing parameters attribute, it's able to handle it properly. Considering this issue closed.


feat(artifacts): Add fsspec storage handler

Description

Fixes #6670

What does the PR do?

🤖[deprecated] Generated by Copilot at 53f4cd9
This pull request adds an optional dependency on fsspec and a new storage handler class FsspecFileHandler to enable wandb to work with different filesystems for artifact storage. It also updates the default wandb storage policy to support fsspec-compatible schemes. These changes allow users to reference and store artifact files with schemes like s3:// or gcs:// without uploading them to the wandb backend.
Testing
How was this PR tested?

🤖[deprecated] Generated by Copilot at 53f4cd9

fsspec schemes
wandb artifacts can use
autumn of storage

hey @Jensssen thank you so much for the contribution!
Sorry for the slow response here, we're making a lot of changes to the W&B SDK with a new golang backend so we might not get to this review for a bit. We're definitely keeping track of the PR and will get to it as soon as we can. cc @noaleetz

Thank you for the contribution! I haven't used fsspec before, but it looks like a great project that will give us access to a number of different storage backends.

Yes indeed, some more niche storage solutions such as OSS (Alibaba), Huggingface or OCI (Oracle) would also be covered all at once :)


Handle command string splitting on double qutoes and single quotes

Addresses https://github.com/testcontainers/testcontainers-java/issues/5784

Thanks for your contribution, @REslim30! I don't think we need to implement the parser as this can be achieved as suggested here.


adjust testing framework and update README

IMPORTANT: Please do not create a Pull Request without creating an issue first.
Problem:

https://github.com/rancher/harvester/issues/388
Solution:

enable and adjust testing  framework and update the README file
Related Issue:
https://github.com/rancher/harvester/issues/388
Test plan:

N/A

@gitlawr updated, thanks.


Date string ignores the locale

Issue
When I set the locale of the date picker to "fr", I see that the options within the UIDatePicker have changed to French. However, the date string for that date is still in English. I'm using the "LL" and "LT" format strings.
Expected Behavior
The date string should have the French locale when I specify "fr" as the locale.
Code

Environment

react-native -v:
node -v:
npm -v:
yarn --version:
target platform: Android | iOS
operating system:

can we have some disclosure here? I noticed in your code you only use the prop locale for the DatePickerIOS, can't it be added to android?

I never tried it on Android

Same issue here

Was this ever solved?

Same issue

This actually can be overcome by using "getDateStr" instead of using "date". getDateStr takes Date as an input, you can use that input with your favorite library (eg momentjs) to convert the time to desired format and locale(language).

The only way language works for me is like this:
import moment from "moment"; if (getPrimaryLanguage() === "zh") {require("moment/locale/zh-cn")};
Define getPrimaryLanguage() yourself use library like i18njs...

same issue here


Unable to install via brew or docker

I would like to try this tool but I can't install via brew or podman.
$ podman pull --tls-verify=false us-central1-docker.pkg.dev/genuine-flight-317411/devel/holmes-dev
Trying to pull us-central1-docker.pkg.dev/genuine-flight-317411/devel/holmes-dev:latest...
Error: initializing source docker://us-central1-docker.pkg.dev/genuine-flight-317411/devel/holmes-dev:latest: reading manifest latest in us-central1-docker.pkg.dev/genuine-flight-317411/devel/holmes-dev: manifest unknown: Failed to fetch "latest"
$

Hi, thanks for reporting. It is a mistake in the readme. Can you please try with the image us-central1-docker.pkg.dev/genuine-flight-317411/devel/holmes (no -dev at the end)

Thanks, that fixed it!On Sep 2, 2024, at 10:44 AM, Natan Yellin @.***> wrote:
Hi, thanks for reporting. It is a mistake in the readme. Can you please try with the image us-central1-docker.pkg.dev/genuine-flight-317411/devel/holmes (no -dev at the end)
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

Awesome, happy to hear it!


feat(source-ghost) upgrade content-api to support Ghost v3

Updated the @tryghost/content-api package. Closes #867.

Thanks, again!


Custom Roles

Added Support for Custom roles in per-server-confs as Strings. I made them both strings so you could easily use the core conf command to change them, as opposed to putting them into an Object. Also changed deletedCommands to be an actual array instead of just a string.

i done goofed


Bizarre issue with inconsistently appearing Perceptive tag on token settings

This is a really bizarre and probably niche issue but it's got me absolutely stumped: I am using latest versions of Foundry (v11.315), Perceptive (v3.3.3) and the PF1E system (v9.6).  I have two different worlds on the same local Foundry server instance, sharing the same modules directory / copy of Perceptive, using the same modules overall -- and in particular, both have identical settings under System Settings for Perceptive.
Despite this, in one of the worlds, the Perceptive tab for token settings always appears, whether I have only Perceptive enabled by itself, or with any combination of modules up to all of the modules being enabled -- it's basically bulletproof that it always shows up.  In the other world, the Perceptive tab for token settings never appears, whether I have only Perceptive enabled by itself or with any combination of modules up to all of the modules being enabled.
It's baffling and I can't figure it out, I've tried Find the Culprit dozens of times, I've gone back and forth comparing the settings over and over again and I just can't make heads or tails of it and I'm stumped as to where else I could even begin to try to troubleshoot it.  If you have any suggestions, I would greatly appreciate it!

This sounds quite strange indeed. The only way i can see to fix this is, if you send me the world files (without the media files) of both worlds so i can take a closer look. If you prefer you can send the files via a discord DM (saibot5279)


Calorie counter (js beta) project should teach why input fields cannot be retrieved early

I have noticed that many people working on the palindrome project will fail to realize that trying to grab the value of an input field outside of an event handler will not work. (I've had to help many people understand that they need to move their whatever.value code down into the event handler. I think people are trying to include it early (when they're defining the variables that get the html elements globally) because they haven't seen what happens when you do that. Or they haven't linked that the global values are evaluated at a different time than the click handlers.
Therefore I suggest that somewhere before the calories counter project's step 18 is presented, a step or two are added to deliberately make that mistake. (Like maybe it makes them grab the value and try to log it globally and then explains why the log shows nothing)
Thanks

This is slightly touched in the Building a Role Playing Game:
https://www.freecodecamp.org/learn/javascript-algorithms-and-data-structures-v8/learn-basic-javascript-by-building-a-role-playing-game/step-15
https://www.freecodecamp.org/learn/javascript-algorithms-and-data-structures-v8/learn-basic-javascript-by-building-a-role-playing-game/step-16

Not what I meant. Step 16 talks about the script tag. But what I am seeing in people’s code in the forum is an attempt to retrieve values in global scopes. (Their script tag may be in the correct place but they’re not understanding that the value will be retrieved too early).

May I ask why this is not planned?

This seems to have been closed prematurely - it does sound like there is room for improvement here.

I agree with your comment @ojeytonwilliams, especially as it would be fairly easy to make the necessary improvement/clarification in one of the projects just by asking the user to get the value in the global scope ( a deliberate error) and explaining why it doesn't work, then moving it to an event listener to see the better result.

I am opening this issue for contribution.
A PR which resolves this issue should:

Insert a new step 38 into the Calorie Counter project which instructs the campers to try logging the value of entryDropdown.value and see what happens when they interact with the dropdown element. The step should also explain that behaviour.
Update the current step 38 (now step 39) to include instructions to remove the console log before defining the new function. The seed code should be updated to include the log statement.

@kamalxdev please don't ping maintainers asking for review, you have opened a PR, it will be reviewed


Fixes DBreezeSerializer

Could we please have an explanation as to why this change is required?

There is an inconsistency between the use of ReadWrite for IBitcoinSerializables in the Serializer versus the Deserializer. Once that is fixed some of the other code can be removed. Also when deserializing transaction we should deserialize to the appropriate transaction type by using CreateTransaction.

The problem is, it's quite a change in a very sensitive part of the code.
Can this wait a bit?

This can wait. There are workarounds like serializing to byte arrays etc for types not handled properly.

I'm pretty happy with this change. Once the build passes and we've managed to sync all networks I'll approve.
@quantumagi I've also merged latest into this branch of yours.

@dangershony I confirm that all networks has synced. Merge when ready 👍


x/debug/cmd/viewcore: panic on reading goroutines

What version of Go are you using (go version)?

$ go version
go version go1.12.7 linux/amd64

Does this issue reproduce with the latest release?
Yes.
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/sz/.cache/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/sz/go"
GOPROXY=""
GORACE=""
GOROOT="/snap/go/4098"
GOTMPDIR=""
GOTOOLDIR="/snap/go/4098/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build491690007=/tmp/go-build -gno-record-gcc-switches"

What did you do?
Steps to reproduce:

Run program from https://play.golang.org/p/xmVo_phJxMm
Wait a couple of seconds
Make a core dump of process launched in step 1 (my actions were: sudo gdb --pid=... and then generate-core-file)
viewcore <core-file> --exe <executable-file> overview

I have a ready to use core file but I'm not sure whether it is useful without the executable: https://cloud.mail.ru/public/4Gon/3gDrwK3dW
What did you expect to see?
viewcore shouldn't panic.
What did you see instead?
viewcore panics with:
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x739a60]

goroutine 1 [running]:
golang.org/x/debug/internal/core.(*Thread).SP(...)
	/home/sz/src/golang-debug/internal/core/thread.go:32
golang.org/x/debug/internal/gocore.(*Process).readG(0xc0000fe420, 0xc0000fe420, 0xc012192180, 0xc000020640, 0xc012192180)
	/home/sz/src/golang-debug/internal/gocore/process.go:508 +0xab0
golang.org/x/debug/internal/gocore.(*Process).readGs(0xc0000fe420)
	/home/sz/src/golang-debug/internal/gocore/process.go:472 +0x12d
golang.org/x/debug/internal/gocore.Core(0xc000126000, 0xa, 0x0, 0x0)
	/home/sz/src/golang-debug/internal/gocore/process.go:157 +0x2da
main.readCore(0xc000122700, 0xc0000e1d40, 0xc000122700, 0xc0000e1d68)
	/home/sz/src/golang-debug/cmd/viewcore/main.go:260 +0xd5
main.runOverview(0xc4d180, 0xc0000ac400, 0x0, 0x2)
	/home/sz/src/golang-debug/cmd/viewcore/main.go:372 +0x34
github.com/spf13/cobra.(*Command).execute(0xc4d180, 0xc0000ac3a0, 0x2, 0x2, 0xc4d180, 0xc0000ac3a0)
	/home/sz/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:766 +0x2ae
github.com/spf13/cobra.(*Command).ExecuteC(0xc4cf20, 0x8b3323, 0x1, 0xc0000e1f00)
	/home/sz/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:852 +0x2ec
github.com/spf13/cobra.(*Command).Execute(...)
	/home/sz/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:800
main.main()
	/home/sz/src/golang-debug/cmd/viewcore/main.go:238 +0x114

@hyangah @randall77

Hmm, something is weird about the core you get from that gdb command.
The core that Go dumps if you send it a SIGABRT with GOTRACEBACK=crash seems fine.
I don't know what the difference is yet. It might take me a few days to investigate further.

Actually, never mind, I can't reproduce this issue. I found a different one...
The cores generated this way are read fine by viewcore for me.
Could you post your binary as well? That would help with debugging.
It looks like somehow there's a goroutine in runnable state, but it has no associated OS thread. That shouldn't happen.


[TA] Enable tests for RecognizeLinkedEntities

Enable:

Live tests (add recordings for new versions)
Mock tests
Samples

API change check for Azure.AI.TextAnalytics
API changes have been detected in Azure.AI.TextAnalytics. You can review API changes here
API changes
+             V2022_03_01_Preview = 4,
-         public TextAnalyticsClientOptions(ServiceVersion version = V3_2_Preview_2);
+         public TextAnalyticsClientOptions(ServiceVersion version = V2022_03_01_Preview);
+         public static TextAnalyticsOperationStatus PartiallySucceeded { get; }


Add button focus and active colors

We were missing overrides for :focus and :active styles which I've added here along with two new color variants dark-1 and dark-2 for them. Fomantic UI has 4 different colors but I think 3 are sufficient. I also changed it on arc-green so button goes darker when pressed.

I would prefer to reduce the colors .... if it is feasible (well, I haven't seen why it's not feasible, I think it's better to be restraint instead of bloating the code)

https://github.com/go-gitea/gitea/issues/19353

The :active and :focus for red basic buttons are not taking effect, looks like they are overwritten by fomantic :hover and :focus styles when all these three pseudo-classes exist. For example, :active:
https://user-images.githubusercontent.com/17645053/236098214-2626d286-71d4-4ca6-a988-37e27957bfb9.mov

I would prefer to reduce the colors .... if it is feasible (well, I haven't seen why it's not feasible, I think it's better to be restraint instead of bloating the code)

Not feasible here untils color-mix, unless we want to accept the suboptimal state of 2 colors from us and 2 colors from fomantic.

The :active and :focus for red basic buttons are not taking effect

Thanks, will check out.

Are we using olive or violet or pink buttons? Many colors are never used, nobody knows whether they work as expected.
I think removing unused colors is feasible, just list all supported colors on the devtest page, and test them , show them to contributors, and remove all others.

They are still in the Fomantic CSS and can not be removed there. Generally I agree that we should probably only ever use primary,green and red buttons (or better, positive, negative), but that's a bigger refactor.

The :active and :focus for red basic buttons are not taking effect, looks like they are overwritten by fomantic :hover and :focus styles when all these three pseudo-classes exist. For example, :active:
Untitled.mov

Fixed and also added rules for positive and negative, which we should eventually use instead of red and green.

Personally I think that the palettes for the dark and light theme should be separated

I don't understand. We define color variables for everything and a theme can override everything. The -dark in the color names only indicates it's a darker shade of the original color. These won't be necessary any more for themes to define come color-mix.

Also… is there a reason why :focus and :active are separate colours

Personally I like the button giving me visual feedback when I pressed it. hover and focus are treatet the same, so it's 3 colors, normal, hover/focus and active. Focus could arguable be moved to an outline effect to make it easier to track focus when tabbing but I will defer that to later.

Ready for review.

The buttons @HesterG mentioned have still no effection.

The buttons @HesterG mentioned have still no effection.

Odd, I had tested them specifically.

The buttons @HesterG mentioned have still no effection.

Odd, I had tested them specifically.

Looks like color of texts is working correctly, but background is not for active.

Ah, I was following Fomantic UI closely and they don't alter background either on basic buttons. I guess we can add that as an "opinionated" change of ours, if it's desired.

Ideally I would like to replicate these outline buttons which show a very desaturated color on background on hover/active. To avoid having to define another 20+ CSS variables, we could theoretically use color-mix to obtain the shade, possibly with a graceful degradation to a grey shade for browsers without support.

Actually I think I will defer adding background highlight to basic buttons to another PR. Our basic buttons never had this background, fomantic does not have it and color-mix experiments are ought to be rather "experimental". So let's land this now, I will do the background addition in another PR.

Moved the button styles to its own file and consolidated them while fixing a number of issues related to primary buttons which were not yet conforming the new color schemes.
Changes include:

Primary button now follows same color scheme as other colors, which means I had to swap the dark/light meaning for dark themes. This is a breaking change to existing dark themes, but a neceessary one.
Some fixes around code editor, remove double border
Overwrite the font-weight: 500 on button from fomantic to 400, which imho looks better.

Will rebase after https://github.com/go-gitea/gitea/pull/24692 is in.

I think I might need to introduce specific button color variables for primary only. Reason is that buttons are the one exception where they go darker on both themes. Other color variations are generally inverse. With separate colors, it'll allow use to avoid the breaking change too, which is nice.

I will do a similar CSS variable scheme for primary button states like https://github.com/go-gitea/gitea/pull/24790 did for variables.

Ready again. The secondary button is now also styles for the first time by us. Previously it was default fomantic's black:

Are we using olive or violet or pink buttons? Many colors are never used, nobody knows whether they work as expected.

BTW, teal buttons are in used a few times, but I agree we should eventually remove these colors for a more consistent UI. Maybe will need to patch fomantic to rip out those color styles.


Add missing await to getting started in readme

Noticed we were missing an await after calling kvstore

Thanks @bechurch!


Turn on Paypal payment method for one-time contributions for Open Collective Foundation host

User story
As a financial contributor, I want the option to pay via Paypal to Collectives hosted by Open Collective Foundation.
Best solution for this problem
Make Paypal a payment option for all hosts, recurring and one time.
MVP
Turn on Paypal for one-time contributions for Foundation, like we have for OSC.
Note
People are sending money direct to Foundation's paypal address, which is creating unnecessary manual work for the host admins.

Can this please be done soon?

yes, @znarf do you think this can be a medium complexity task?

@piamancini This needs to be handled by the core team. Maybe this is doable without much code. We can prioritize that.

I looked at it and it's more complicated than what I thought, not something we can do on the side. Removing the priority.
Quickly created some branches with todos:

https://github.com/opencollective/opencollective-api/tree/feat/paypal-payment
https://github.com/opencollective/opencollective-frontend/tree/feat/paypal-payment


Help connecting using serial console

Hi,
I'm trying to use virtctl con to connect to a VM's serial console, but am missing something:
kb-admin@kbc:~$ ./virtctl-v0.4.0-linux-amd64 --kubeconfig=/home/kb-admin/.kube/config console testvm
Escape sequence is ^]
                     Can't connect to websocket (503): service unavailable

By all accounts the VM is running:
kb-admin@kbc:~$ kubectl describe vm testvm
Name:         testvm
Namespace:    default
Labels:       kubevirt.io/nodeName=kbn1
Annotations:  presets.virtualmachines.kubevirt.io/presets-applied=kubevirt.io/v1alpha1
API Version:  kubevirt.io/v1alpha1
Kind:         VirtualMachine
Metadata:
  Cluster Name:
  Creation Timestamp:  2018-04-12T17:56:52Z
  Generation:          1
  Resource Version:    161098
  Self Link:           /apis/kubevirt.io/v1alpha1/namespaces/default/virtualmachines/testvm
  UID:                 e18d5ed8-3e7a-11e8-9c76-dc3979f3438a
Spec:
  Domain:
    Devices:
      Disks:
        Disk:
          Bus:        sata
        Name:         mydisk
        Volume Name:  myvolume
    Features:
      Acpi:
        Enabled:  true
    Firmware:
      Uuid:  3ba9ffb1-68fd-4765-a94f-439759b309c1
    Machine:
      Type:  q35
    Resources:
      Requests:
        Memory:                      64M
  Termination Grace Period Seconds:  0
  Volumes:
    Name:  myvolume
    Persistent Volume Claim:
      Claim Name:  vm-storage-claim
Status:
  Interfaces:
    Ip Address:  <IP_ADDRESS>
  Node Name:     kbn1
  Phase:         Running
Events:          <none>

And from inside the docker running libvirtd:
[root@virt-launcher-testvm-hlpkl /]# virsh list
 Id    Name                           State
----------------------------------------------------
 1     default_testvm                 running

Please help me understand where the expected websocket endpoint is (in the virt-launcher container?) and how it's supposed to be discovered.
thanks,
Ben

The 503 may be coming from virt-api, check that it's healthy.

Thanks for responding @mlsorensen .  I can deploy VMs, which requires virt-api to be running, doesn't it?
As to its health, I see a running virtapi container:
root@kbn2:/storage/beiwe# docker container list | grep virt-api
3e692e5cfcd3        kubevirt/virt-api            "/virt-api --port 84…"   45 hours ago        Up 45 hours                             k8s_virt-api_virt-api-747ff7bdc6-st2sj_kube-system_bd2332df-3dce-11e8-9c76-dc3979f3438a_0
e544640767c4        k8s.gcr.io/pause-amd64:3.1   "/pause"                 45 hours ago        Up 45 hours                             k8s_POD_virt-api-747ff7bdc6-st2sj_kube-system_bd2332df-3dce-11e8-9c76-dc3979f3438a_0

and can exec into it.  It's appears to be listening on port 8443, but I don't know enough about how things are stitched together to know how to debug.

@ben-skyportsystems Thanks for reporting this. Did you also deploy kubevrit 0.4.0 on the cluster? There would be an issue if you used the 0.4 client and 0.3 on the cluster (or vice versa)

@davidvossel @karmab

Hi @fabiand , yes it's 0.4.0 all around.  Here's the output you asked for:
kb-admin@kbc:~$ kubectl get pods -n kube-system
NAME                                      READY     STATUS    RESTARTS   AGE
calico-etcd-x8ddf                         1/1       Running   0          2d
calico-kube-controllers-5449fdfcd-rzdhb   1/1       Running   0          2d
calico-node-2nkrz                         2/2       Running   0          2d
calico-node-hmt8b                         2/2       Running   2          2d
calico-node-szn4m                         2/2       Running   3          2d
etcd-kbc                                  1/1       Running   0          2d
kube-apiserver-kbc                        1/1       Running   0          2d
kube-controller-manager-kbc               1/1       Running   0          2d
kube-dns-86f4d74b45-l9tnn                 3/3       Running   0          2d
kube-proxy-mwfsb                          1/1       Running   0          2d
kube-proxy-q2b8l                          1/1       Running   1          2d
kube-proxy-sv2mm                          1/1       Running   2          2d
kube-scheduler-kbc                        1/1       Running   0          2d
virt-api-747ff7bdc6-9pt8b                 1/1       Running   0          1d
virt-api-747ff7bdc6-st2sj                 1/1       Running   0          1d
virt-controller-767587575-cq28l           0/1       Running   0          1d
virt-controller-767587575-zcdkb           1/1       Running   0          1d
virt-handler-m429d                        1/1       Running   0          1d
virt-handler-vmtvd                        1/1       Running   0          1d

@ben-skyportsystems is it possible you connect behind a proxy ?

@karmab : yes, I am behind a proxy and it's a constant PITA.  I've made sure that all the nodes are listed in the no_proxy environment variable and even restarted the controller node to be sure, but the problem is still there.

Also, in case it's relevant, I'm using Kubernetes v1.10.0.
I get the same 503 when using the Darwin build of virtctl, and the Mac is not behind a web proxy.

Also, in case it's relevant, I'm using Kubernetes v1.10.0.

good to know. I don't believe we've tested kubevirt on v1.10.0 yet. It's possible we're not compatible for some reason.
@ben-skyportsystems I have a couple of more requests.

Just to confirm websocket connections are not getting rejected for you across the board for some reason, can you do a kubectl exec -it <pod name> -- /bin/bash and see if you're able to establish a websocket connection using kubectl with any pod in the cluster?

I need virt-api logs from both instances during the time period that a failed 'virtctl' command is executed. So, execute virtctl in an attempt to connect to a VM's console, then provide kubectl log -n kube-system <virt-api pod name> output. It's going to be large, pastbin links might be best.

thanks!

@davidvossel:

It doesn't seem to be a global problem:

kb-admin@kbc:~$ kubectl get pods
NAME                         READY     STATUS      RESTARTS   AGE
virt-launcher-beiwe-swgph    1/1       Running     0          2d
virt-launcher-testvm-hlpkl   1/1       Running     0          3d
virt-launcher-testvm-pqwwv   0/1       Completed   0          4d
virt-launcher-testvm-qqr6j   0/1       Completed   0          4d
virt-launcher-testvm-x4rlg   0/1       Completed   0          4d
kb-admin@kbc:~$ kubectl exec -it virt-launcher-beiwe-swgph /bin/bash --
[root@virt-launcher-beiwe-swgph /]# exit
exit

There definitely seems to be a connectivity issue, most likely proxy-related:

kb-admin@kbc:~$ kubectl get pods -n kube-system | grep virt-api
virt-api-747ff7bdc6-9pt8b                 1/1       Running   0          4d
virt-api-747ff7bdc6-st2sj                 1/1       Running   0          4d
kb-admin@kbc:~$ kubectl logs -n kube-system -p virt-api-747ff7bdc6-9pt8b
Error from server: Get https://<IP_ADDRESS>:10250/containerLogs/kube-system/virt-api-747ff7bdc6-9pt8b/virt-api?previous=true: Gateway Timeout

If I look at the logs for the main Kubernetes API server, though, I see some interesting stuff:
kb-admin@kbc:~$ kubectl logs -n kube-system -p kube-apiserver-kbc
...
I0413 22:21:03.526765       1 controller.go:105] OpenAPI AggregationController: Processing item v1alpha1.subresources.kubevirt.io
E0413 22:21:03.527221       1 controller.go:111] loading OpenAPI spec for "v1alpha1.subresources.kubevirt.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0413 22:21:03.527253       1 controller.go:119] OpenAPI AggregationController: action for item v1alpha1.subresources.kubevirt.io: Rate Limited Requeue.
E0413 22:21:04.161547       1 available_controller.go:295] v1alpha1.subresources.kubevirt.io failed with: Get https://<IP_ADDRESS>:443: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E0413 22:21:29.152915       1 available_controller.go:295] v1alpha1.subresources.kubevirt.io failed with: Get https://<IP_ADDRESS>:443: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
E0413 22:21:59.136418       1 available_controller.go:295] v1alpha1.subresources.kubevirt.io failed with: Get https://<IP_ADDRESS>:443: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I0413 22:22:03.527515       1 controller.go:105] OpenAPI AggregationController: Processing item v1alpha1.subresources.kubevirt.io
E0413 22:22:03.527760       1 controller.go:111] loading OpenAPI spec for "v1alpha1.subresources.kubevirt.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

Also, if I run the commands from a machine that is not behind a web proxy, I get the same thing:
BAWARREN-M-W46P:Downloads bawarren$ kubectl -n kube-system exec -it virt-api-747ff7bdc6-9pt8b /bin/bash --
[virt-api@virt-api-747ff7bdc6-9pt8b ~]$ exit
exit
command terminated with exit code 130
BAWARREN-M-W46P:Downloads bawarren$ kubectl logs -n kube-system -p virt-api-747ff7bdc6-9pt8b
Error from server: Get https://<IP_ADDRESS>:10250/containerLogs/kube-system/virt-api-747ff7bdc6-9pt8b/virt-api?previous=true: Gateway Timeout

If I look at the logs for the main Kubernetes API server, though, I see some interesting stuff:

@ben-skyportsystems Those kube-apiserver 503 errors indicate to me that the kube-apiserver is unable to contact virt-api via the service endpoint.
If you run kubectl get services -n kube-system You'll see a ClusterIP service called virt-api. kube-apiserver can't contact virt-api using that service for some reason, even though virt-api appears to be online according to the readiness checks.
The fact that you are unable to tail virt-api's logs but you can perform a podExec is also very strange.
I wish I could be of more help here, but this appears to be an issue specific to your environment. In order to get virtctl's console/vnc support to work, kube-apiserver needs to be able to contact virt-api using that service endpoint. If you can figure out the connectivity issue that's occurring there, it's likely that everything will begin to work.

@ben-skyportsystems it looks like you have a setup with two schedulable nodes. Could you run ordinary pods on these nodes and try to access them via a service? As @davidvossel already pointed out, it is very likely that there is an issue with the network. The symptoms look a lot like calico has issues with forwarding traffic between nodes.


[PX-4220] - Track analytics for weight & framed dimensions in CMS

This PR adds specific event for framed dimensions dropdown menus.
EDIT:
It also includes some name changes to framed dimensions events to better align with the UI/database.

:rocket: PR was released in v2.15.0 :rocket:


Google Maps API and JSON?

I'm trying to display travel time in a badge using the Google Maps API. The problem is coming from the JSON query, I think. It appears to be returning the proper text string using web-based JSON query tools, but it's not displaying in the SVG shield image.
Here's the link I'm using to generate the shield (use your own Google Maps API key):
https://img.shields.io/badge/dynamic/json.svg?label=Travel Time&colorB=&prefix=&suffix=&query=$..duration.text&uri=https%3A%2F%2Fmaps.googleapis.com%2Fmaps%2Fapi%2Fdistancematrix%2Fjson%3Funits%3Dimperial%26origins%3DNew%2BYork%26destinations%3DLos%2BAngeles%26key%3D[yourAPIkeyhere]
Here's the link to the Google Maps API (use your own Google Maps API key):
https://maps.googleapis.com/maps/api/distancematrix/json?units=imperial&origins=New+York&destinations=Los+Angeles&key=[yourAPIkeyhere]
A couple caveats, in no particular order: I don't think, speak, or write in code, so I'm limited to using Shields (or a similar service) and lucky trial-and-error hacking to generate the dynamic image. It needs to be an image that will ultimately display in a kiosk.
Does anyone have any insight as to why it wouldn't work?

It's probably a problem with your API key. Without a key I see this:

and when I got the key correct I see this:

What result are you seeing?
For future use, here's a nice JSONPath test page. You can paste your JSON result into that page and experiment with the query.
Also, a caveat: for security reasons, do not send secrets to the Shields server. Be sure the key you're using is suitable for public consumption and is limited to the minimum, read-only access.

I was using the JSONPath page. I used that to figure out the $..duration.text query.
If I hit the Google API URL directly, it returns all the JSON information, including origin, destination, duration and distance. But when I put it in the Shields.io URL with the query, I'm getting the blank results that you're getting without the key. https://user-images.githubusercontent.com/1487036/33391915-83b5546a-d508-11e7-921f-68c85403c1e1.png
How would I figure out the correct key?
Thanks for your help!

Oh, wait! I generated a new key and it works like a charm! Don't know why the other key wouldn't work. Now to restrict it. Thanks for that tip as well.
Thanks for your help!


[FLINK-22243][bp-1.15] Reactive Mode parallelism changes are not shown in the Web UI

backport of #20941

@flinkbot run azure


File Watcher

Implement a basic file watcher and live reload

Shall I do anything on this?

Shall I do anything on this?

Nah, this is almost done, I just need to add it to the preact and arrowjs modules as well. live reload seems to be working with vanilla and then you can use the same socket module to inject HMR related stuff as well


[Bug]: Can't run prowler cronjob in kubernetes cluster

Steps to Reproduce

Create a namespace.
Create a secret with required values as mentioned here.
Create a cronjob as mentioned here.
Run the job manually.

Expected behavior
Job should run successfully.
Actual Result with Screenshots or Logs
Error: failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "./prowler.py": stat ./prowler.py: no such file or directory: unknown
How did you install Prowler?
Docker (docker pull toniblyx/prowler)
Environment Resource
Kubernetes Cluster (kops)
OS used
Flatcar Container Linux
Prowler version
3.5.3
Pip version
Using pip version defined in docker image
Context
No response

Hi @dudeja2-iresh2, as @christiandavilakoobin it seems to be an issue related with your execution PATH. Please check where is Prowler installed in your system and the use that path in your cronjob.
I'm going to close the issue. Please fell free to reopen it if encounter any more problems.

Thanks for your reply. I am using docker image and followed the README mentioned here. Can you confirm if it is working ?

I wasn't using k8s, but docker, using this:
docker run --user 0 --rm -ti -v $(pwd)/prowler/config.yaml:/home/prowler/.local/lib/python3.9/site-packages/prowler/config/config.yaml -v $(pwd)/prowler/results/:/home/prowler/output $(printf -- "--env AWS_ACCESS_KEY_ID=%s --env AWS_SECRET_ACCESS_KEY=%s --env AWS_SESSION_TOKEN=%s" $(aws sts assume-role --role-arn arn:aws:iam::xxxxxxx:role/global-prowler-ProwlerRole--role-session-name prowler --query 'Credentials.[ AccessKeyId, SecretAccessKey, SessionToken ]' --output text)) public.ecr.aws/o4g1s5r6/prowler:3.7.1 aws -M csv json json-asff html -w arn:aws:lambda:eu-west-1:xxxxxx:function:global-prowler-AllowList -f eu-west-1 us-east-1 --compliance ens_rd2022_aws


PLATUI-1401: Added name validator

@JoPintoPaul looks good to me, one thing I wonder for the future is if this will cause any spammer to change their tactic, because following this change they will get feedback that what they enter is invalid rather rather than it looking like a success


[Support Request]: Blank page after inserting 3rd party auth. - Azure

Attempted Debugging

[X] I have read the debugging page

Searched GitHub Issues

[X] I have searched GitHub for the issue.

Describe the Scenario
After adding the below to my .env file the site gives a blank page.  remove the code and its back to fully functioning.
{SERVICE}_AUTO_REGISTER=true
AZURE_AUTO_REGISTER=true
{SERVICE}_AUTO_CONFIRM_EMAIL=true
AZURE_AUTO_CONFIRM_EMAIL=true

I guessed that it was azre, the example was google and twitch.
Azure config is all ok as I can pair Azure with my account in users and it works fine.
permissions are all ok and have performed sudo chown -R www-data:www-data bootstrap/cache storage public/uploads
Exact BookStack Version
21.12
Log Content
No response
PHP Version
7.4.27
Hosting Environment
Server 2019 Hyper-V, Ubuntu 18.04.6 LTS

Hi @davecowley,
Can you remove the likes starting with {SERVICE}? So only keep the lines starting with AZURE. The {SERVICE} lines in the documentations are examples to show syntax, they are not needed themselves and are likely causing your config to break.

Hi, yes your right.  totally obvious looking back
thanks for your help.


Ref for a single Card

How to add a Ref on each Card?

if you put a ref on the component that you render as a card then it will show up as a child of refs within the Swipecards' ref. Not sure if theres a way to get a separate ref for each card, especially since I think its all the same card, just given different props and updated on each swipe, no unmount or willmount.


[Audio]:Club Penguin Halloween Party 2008

Check if this audio is already added to RetroStudio.

[X] The audio is not already in game.

Is this for the main-menu playlist?

[ ] Add to main-menu playlist.

Is this song from an old Roblox era or a sound effect?

[X] This song is from old Roblox or is a sound effect.

A link to the audio on Roblox
https://www.roblox.com/library/836233088/
A link to the audio file to download.
https://downloads.khinsider.com/game-soundtracks/album/club-penguin-original-soundtrack/14.%2520Halloween%2520Party%25202008%2520Outdoors%2520Theme.mp3
Notes
This song is from the 2008 club penguin event, but I'm not too sure if that reaches the criteria of being classified as "Old Roblox Era" please let me know if this must be a roblox song.

This was used in the 2021 october event, so i hope it's added.


Add pypi badges to README

I can't seem to get these onto one line and get the links to work. Removing ?branch=master from Travis gets them to one line, but it looked like the links were then all to Travis...

Seems to render fine now, it was just the diff preview that wasn't right.


Fix: Fatal crash after disabling children of active layer

A picture tells a thousand words
Before this PR
Uncaught TypeError: Cannot read property 'AO' of undefined
at Object.drawAll (polygon.js:34)
at ke (index.js:43)
at index.js:75
at index.js:26
at index.js:12
at Array.forEach ()
at he (index.js:11)
at ve (index.js:131)
at t.value (index.js:117)
at t.value (index.js:98)
at da (react-dom.production.min.js:5070)
at fa (react-dom.production.min.js:4826)
at ca (react-dom.production.min.js:4800)
at Ne (react-dom.production.min.js:5512)
at Fe (react-dom.production.min.js:670)
at An (react-dom.production.min.js:1760)
at ga (react-dom.production.min.js:5200)
at Pn (react-dom.production.min.js:1737)

Coverage decreased (-0.1%) to 42.035% when pulling 12b530649e13f627aff9c6c5bc42870aed68bd63 on bjornreppen:boom into 00ca985f787aba9841cd73af17dd50f1b465e601 on Artsdatabanken:master.


move pkg/topology to proper upstream

Fixes: #1366

Codecov Report

Merging #1379 (625fe00) into main (eeef8aa) will decrease coverage by 0.50%.
The diff coverage is n/a.

:exclamation: Current head 625fe00 differs from pull request most recent head 812bf85. Consider uploading reports for the commit 812bf85 to get more accurate results

@@            Coverage Diff             @@
##             main    #1379      +/-   ##
==========================================
- Coverage   50.56%   50.07%   -0.50%
==========================================
  Files          44       43       -1
  Lines        4952     4801     -151
==========================================
- Hits         2504     2404     -100
+ Misses       2302     2261      -41
+ Partials      146      136      -10

see 1 file with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

keeping this in draft until we have a release for containers/nri-plugins


Support for Azure OpenAI

Hello, thanks for this really helpful project! I am using Azure OpenAI over OpenAI itself and I would like to know if there is already a way to do that (Usually the baseurl needs to be set) or if that support is planned to be added?
Thank you!

Perhaps this is possible? The code is untested. CrawAI can use APIs based on langchain models.
import os

from langchain.schema import HumanMessage
from langchain_openai import AzureChatOpenAI

os.environ["AZURE_OPENAI_API_KEY"] = "..."
os.environ["AZURE_OPENAI_ENDPOINT"] = "https://<your-endpoint>.openai.azure.com/"

Azure_model = AzureChatOpenAI(
    openai_api_version="2023-05-15",
    azure_deployment="your-deployment-name",
)

researcher = Agent(
  role='Researcher',
  goal='Discover new insights',
  backstory="...",
  verbose=True,
  llm = Azure_model

I've taken this example from the wiki and adjusted it for Azure as well:
import os
from crewai import Agent, Task, Crew, Process
from langchain.agents import load_tools

from langchain.chat_models.azure_openai import AzureChatOpenAI

llm = AzureChatOpenAI(
    model=model_name,
    api_version=openai_api_version,
    api_key=openai_api_key,
    # azure_endpoint=open_ai_base,
    base_url=open_ai_base,
)

# Loading Human Tools
human_tools = load_tools(["human"])

# Define your agents with roles and goals
researcher = Agent(
  role='Senior Research Analyst',
  goal='Uncover cutting-edge developments in AI and data science in',
  backstory="""You are a Senior Research Analyst at a leading tech think tank.
  Your expertise lies in identifying emerging trends and technologies in AI and
  data science. You have a knack for dissecting complex data and presenting
  actionable insights.""",
  verbose=True,
  allow_delegation=False,
  # Passing human tools to the agent
  llm=llm,
  tools=human_tools
)
# the rest of the code...

Azure changed to regional endpoints so might be that's why the above stopped working?
Now it's like https://your_region.api.cognitive.microsoft.com/openai/deployments/your_deployment/chat/completions?api-version=some_version_string

I am trying to run the below code but somehow I am getting " Error code: 401 - {'error': {'message': 'Incorrect API key provided"
Could anyone help me with this?
from crewai import Agent
from textwrap import dedent
from tools import yt_tool
from load_dotenv import load_dotenv
from langchain_openai import AzureChatOpenAI
import os
load_dotenv()
llm = AzureChatOpenAI(
azure_deployment="gpt-4",
api_version="2023-06-01-preview",
api_key=os.environ.get("key"),
azure_endpoint=os.environ.get("endpoint"),
)
researchAgent = Agent(
role='Research Analsyt for Youtube Videos',
goal='Search popular youtube videos to extract actionable insights for the topic {topic}',
tools=[yt_tool],
llm=llm,
verbose= True,
memory=True,
allow_delegation=True,
backstory=dedent("""You're a Research Analsyt at a large company.
list 5 popular youtube videos on the {topic} as you're responsible for analyzing content in the youtube videos,
providing insights and suggestions to the business."""),
)

sorin
I am not able to connect to crew Ai using Azure Open AI key.

Could be because of the same Azure endpoint format upgrade I have? See
discussion here (LiteLLM is the underlying connection):
https://github.com/BerriAI/litellm/discussions/5995
On Thu, 3 Oct 2024, 21:02 Nirupama Bodapati, @.***>
wrote:

sorin
I am not able to connect to crew Ai using Azure Open AI key.
—
Reply to this email directly, view it on GitHub
https://github.com/crewAIInc/crewAI/issues/101#issuecomment-2392011715,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AA2KEWDRGAZFYSYPPFOXDYTZZWBETAVCNFSM6AAAAABPEDU3NKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJSGAYTCNZRGU
.
You are receiving this because you commented.Message ID:
@.***>


Add slurm profile to nextflow.config

Added slurm profile with similar options as the SGE profile.

This looks good to me. Thanks for the contribution.


how to e.preventDefault()?

I'm using react-hook-form as mentioned in shadncn-ui docs and the page keeps refreshing everytime I try to submit the form. Is there anyway I can prevent default behavior of the form ?

You can use form.handleSubmit(yourCallbackSubmitFunction)
<Form>
<form onSubmit={form.handleSubmit(onSubmit)}
  <FormField
    control={...}
    name="..."
    render={() => (
      <FormItem>
        <FormLabel />
        <FormControl>
          { /* Your form field */}
        </FormControl>
        <FormDescription />
        <FormMessage />
      </FormItem>
    )}
  />
</form>
</Form>

More info: https://ui.shadcn.com/docs/components/form#build-your-form

I'm using react-hook-form as mentioned in shadncn-ui docs and the page keeps refreshing everytime I try to submit the form. Is there anyway I can prevent default behavior of the form ?

Hey friend, how did you manage to resolve this? i did the exact same thing, copied from the docs but when i'm clicking the button the page refreshes...

You can use form.handleSubmit(yourCallbackSubmitFunction)
<Form>
<form onSubmit={form.handleSubmit(onSubmit)}
  <FormField
    control={...}
    name="..."
    render={() => (
      <FormItem>
        <FormLabel />
        <FormControl>
          { /* Your form field */}
        </FormControl>
        <FormDescription />
        <FormMessage />
      </FormItem>
    )}
  />
</form>
</Form>

More info: https://ui.shadcn.com/docs/components/form#build-your-form

Hey friend, i copied the entire code from the link you provided and it still refreshes the page, didn't understand your fix, would love to know what to do :)

Hi @mortz123
For me it worked fine without having to provide e.preventDefault() because I think handleSubmit from useForm is doing that behind the scene.
Here's my form code:
const formSchema = z.object({
      email: z
        .string({
          required_error: 'Email is required",
        })
        .email({ message: "Email is invalid" }),
      password: z
        .string({
          required_error: "Password is required"
        })
        .min(5, { message: "Password must be at least 5 characters long" })
    });

  const { handleSubmit, control, formState } = useForm({
    resolver: zodResolver(formSchema),
  });

// and in the form element

<form
    className="hawa-flex hawa-flex-col hawa-gap-4"
    onSubmit={handleSubmit((e) => {
        return props.handleLogin(e);
    })}
>
// the form content here
</form>

"use client";
import { CardWrapper } from "./card-wrapper";
import * as z from "zod";
import { LoginSchema } from "../../../schema";
import { Input } from "@/components/ui/input";
import {
  Form,
  FormControl,
  FormDescription,
  FormField,
  FormItem,
  FormLabel,
  FormMessage,
  useFormField,
} from "@/components/ui/form";
import { useForm } from "react-hook-form";
import { zodResolver } from "@hookform/resolvers/zod";
import { Button } from "@/components/ui/button";
import { ChangeEvent } from "react";

export const LoginForm = () => {
  const form = useForm<z.infer<typeof LoginSchema>>({
    resolver: zodResolver(LoginSchema),
    defaultValues: {
      email: "",
      password: "",
    },
    mode: "onChange",
  });
  const onSubmit = (values: z.infer<typeof LoginSchema>) => {

    console.log(values);
  };
  return (
    <CardWrapper
      headerLabel="Welcome back"
      backButtonLabel="Don't have an account?"
      backButtonHref="/auth/register"
      showSocial
    >
      <Form {...form}>
        <form
          onSubmit={form.handleSubmit(onSubmit)}
          className="space-y-6"
        >

            <FormField
              control={form.control}
              name="email"
              render={({ field }) => (
                <FormItem>
                  <FormLabel>Email</FormLabel>
                  <FormControl>
                    <Input
                      {...field} // this is the main solution
                      // disabled={isPending}
<EMAIL_ADDRESS>                      type="email"
                    />
                  </FormControl>
                  <FormMessage />
                </FormItem>
              )}
            />
            <FormField
              control={form.control}
              name="password"
              render={({ field }) => (
                <FormItem>
                  <FormLabel>Password</FormLabel>
                  <FormControl>
                    <Input
                      {...field}
                      // disabled={isPending}
                      placeholder="******"
                      type="password"
                    />
                  </FormControl>
                  <FormMessage />
                </FormItem>
              )}
            />

          <Button type="submit" className="w-full">
            Login
          </Button>
        </form>
      </Form>
    </CardWrapper>
  );
};

You have to use the spread operator to get props from react-hook-form only in this way so that the page doesn't refresh as you expect

"use client";
import { CardWrapper } from "./card-wrapper";
import * as z from "zod";
import { LoginSchema } from "../../../schema";
import { Input } from "@/components/ui/input";
import {
  Form,
  FormControl,
  FormDescription,
  FormField,
  FormItem,
  FormLabel,
  FormMessage,
  useFormField,
} from "@/components/ui/form";
import { useForm } from "react-hook-form";
import { zodResolver } from "@hookform/resolvers/zod";
import { Button } from "@/components/ui/button";
import { ChangeEvent } from "react";

export const LoginForm = () => {
  const form = useForm<z.infer<typeof LoginSchema>>({
    resolver: zodResolver(LoginSchema),
    defaultValues: {
      email: "",
      password: "",
    },
    mode: "onChange",
  });
  const onSubmit = (values: z.infer<typeof LoginSchema>) => {

    console.log(values);
  };
  return (
    <CardWrapper
      headerLabel="Welcome back"
      backButtonLabel="Don't have an account?"
      backButtonHref="/auth/register"
      showSocial
    >
      <Form {...form}>
// use this spread operator to prevent unexpected page refreshing issue then implement at onSubmit()
        <form
          onSubmit={form.handleSubmit(onSubmit)}
          className="space-y-6"
        >

            <FormField
              control={form.control}
              name="email"
              render={({ field }) => (
                <FormItem>
                  <FormLabel>Email</FormLabel>
                  <FormControl>
                    <Input
                      {...field}
                      // disabled={isPending}
<EMAIL_ADDRESS>                      type="email"
                    />
                  </FormControl>
                  <FormMessage />
                </FormItem>
              )}
            />
            <FormField
              control={form.control}
              name="password"
              render={({ field }) => (
                <FormItem>
                  <FormLabel>Password</FormLabel>
                  <FormControl>
                    <Input
                      {...field}
                      // disabled={isPending}
                      placeholder="******"
                      type="password"
                    />
                  </FormControl>
                  <FormMessage />
                </FormItem>
              )}
            />

          <Button type="submit" className="w-full">
            Login
          </Button>
        </form>
      </Form>
    </CardWrapper>
  );
};

You have to use the spread operator to get props from react-hook-form only in this way so that the page doesn't refresh as you expect


Enable Style/ColonMethodCall cop

Refer https://github.com/rails/rails/commit/9c0c90979a759a41628e0cd9d73821b0b34d03fc.

Thank you 💯

https://github.com/toshimaru/rubocop-rails/releases/tag/v1.2.2 has been released.


upgrade maturin, adjust to new version

@aviramha notify me, please, when this PR will be merged. I'm going to update #129 for easier merging.

@aviramha notify me, please, when this PR will be merged. I'm going to update #129 for easier merging.

Sorry I tried updating everything and it seems a bit trickier than what I thought.
I'm not sure when I'll have time to fix it, if you can make the CI work then I can merge it.


[Funimation] betting-on-the-handshake-event: Failed to parse JSON No JSON object could be decoded

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.09.20
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.funimation.com/shows/tsukiuta-the-animation/betting-on-the-handshake-event/?qid=d4ad92c7c2d924b', u'--verbose']
[debug] Encodings: locale US-ASCII, fs utf-8, out US-ASCII, pref US-ASCII
[debug] youtube-dl version 2020.09.20
[debug] Python version 2.7.16 (CPython) - Darwin-19.6.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3, rtmpdump 2.4
[debug] Proxy map: {}
[Funimation] betting-on-the-handshake-event: Downloading webpage
WARNING: [Funimation] betting-on-the-handshake-event: Failed to parse JSON No JSON object could be decoded
ERROR: Unable to extract al:web:url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 797, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 532, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/funimation.py", line 100, in _real_extract
    ], webpage, fatal=True)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1140, in _html_search_meta
    html, display_name, fatal=fatal, group='content', **kwargs)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1019, in _html_search_regex
    res = self._search_regex(pattern, string, name, default, fatal, flags, group)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1010, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract al:web:url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

PASTE VERBOSE LOG HERE

Description

There is a problem with downloading from Funimation.

install the firefox addon called the stream detector
to get the m3u8 playlists. set it to youtub-dl command
click copy the url and paste into the terminal

install the firefox addon called the stream detector
to get the m3u8 playlists. set it to youtub-dl command
click copy the url and paste into the terminal

Oh... Sorry I found solving of the problem.
I add a user-agent and cookies for it works.
youtube-dl --user-agent="Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Safari/537.36" --cookies funimation-cookies.txt 'animelink'

P.S I suggest to add a notify in parser about users have to add ua and cookies arguments. The message notify people for adding arguments and they won't to create duplicate issues.

That does not seem to be working for me, which is odd since just using straight cURL with a cookiejar works for fetching the video metadata.

I am having the same issue. In the command prompt, using the windows latest version installed tonight, Here's my command line information, with my actual username and password replaced as USERNAME and PASSWORD. I was testing with the first episode of "Black Clover" which I have no problem playing in a browser.
C:\compile>youtube-dl https://www.funimation.com/shows/black-clover/asta-and-yuno/?qid= --username USERNAME --password PASSWORD
[Funimation] Logging in
[Funimation] asta-and-yuno: Downloading webpage
WARNING: [Funimation] asta-and-yuno: Failed to parse JSON Expecting value: line 1 column 1 (char 0)
ERROR: Unable to extract al:web:url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

And here's the output using the verbose flag:
C:\compile>youtube-dl https://www.funimation.com/shows/black-clover/asta-and-yuno/?qid= --username USERNAME --password PASSWORD --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.funimation.com/shows/black-clover/asta-and-yuno/?qid=', '--username', 'PRIVATE', '--password', 'PRIVATE', '--verbose']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2<IP_ADDRESS>
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.10586
[debug] exe versions: none
[debug] Proxy map: {}
[Funimation] Logging in
[Funimation] asta-and-yuno: Downloading webpage
WARNING: [Funimation] asta-and-yuno: Failed to parse JSON Expecting value: line 1 column 1 (char 0)
ERROR: Unable to extract al:web:url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\YoutubeDL.py", line 806, in wrapper
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\YoutubeDL.py", line 827, in __extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\extractor\common.py", line 532, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\extractor\funimation.py", line 100, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\extractor\common.py", line 1140, in _html_search_meta
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\extractor\common.py", line 1019, in _html_search_regex
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpgi7ngq0n\build\youtube_dl\extractor\common.py", line 1010, in _search_regex
youtube_dl.utils.RegexNotFoundError: Unable to extract al:web:url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Now, I also tried the suggestion above, but it didn't work for me either:
C:\compile>youtube-dl --user-agent="Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Safari/537.36" --cookies funimation-cookies.txt 'https://www.funimation.com/shows/black-clover/asta-and-yuno/?qid='
ERROR: "'https://www.funimation.com/shows/black-clover/asta-and-yuno/?qid='" is not a valid URL. Set --default-search "ytsearch" (or run  youtube-dl "ytsearch:'https://www.funimation.com/shows/black-clover/asta-and-yuno/?qid='" ) to search YouTube

I also tried using the youtube-dl GUI front end from here which had the following error after giving it the login information:
I don't have problems downloading from other sites with either the command prompt or the GUI front end, so there's definately a problem with youtube-dl specifically with Funimation. Here's the logs it generated:
[02/07/21 23:21:26] WARNING: Unable to look up account info: HTTP Error 400: Bad Request
[02/07/21 23:22:27] WARNING: [Funimation] asta-and-yuno: Failed to parse JSON Expecting value: line 1 column 1 (char 0)
[02/07/21 23:22:27] ERROR: Unable to extract al:web:url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.


Intellisense with word wrap breaks below the wrap

VSCode Version: 1.13.0
OS Version: Windows 10 Pro

Steps to Reproduce:

Activate Word Wrap.
Have a line that is long enough to wrap.
Intellisense works above the wrap but stops working below it.

@Apostolique I cannot repro, can share a gif or video?

https://clips.twitch.tv/WiseExcitedKleeVoteNay

Weird, I cant repro in typescript, so may be its specific to C#
Do you see the same in any other languages?

I can confirm that it still breaks on my side even when I'm coding in TypeScript.
I have managed to pinpoint that the problem comes from the Vim extension.

Which vim extension are you using?
cc @rebornix

I'm using vscodevim.vim

thanks @Apostolique
@rebornix vim bug coming your way :)

@ramya-rao-a This is still some kind of breaking change between 1.12 and 1.13. Specifically, it has to do with this line: https://github.com/VSCodeVim/Vim/blob/master/src/mode/modeHandler.ts#L1697
I know that you guys reset some kinds of internal state when editor.selections is modified. Did you guys change anything that would be causing autocompletion to break?

As far as I can tell, this issue is fixed.


mysql changefeed blocked by abnormal kafka changefeed

What did you do?

1 TiCDC, 1 broker, 1 mysql; 3 kafka changefeeds, 1 mysql changefeed
At first, all changefeeds work normally
When kafka service stopped, the 3 kafka changefeeds don't sync data as expected, but the checkpoint of  mysql changefeed also will not move on.
[
{
"id": "kafka-task-1",
"summary": {
"state": "normal",
"tso":<PHONE_NUMBER>18948355,
"checkpoint": "2022-01-06 14:14:42.308",
"error": null
}
},
{
"id": "kafka-task-3",
"summary": {
"state": "normal",
"tso":<PHONE_NUMBER>18948355,
"checkpoint": "2022-01-06 14:14:42.308",
"error": null
}
},
{
"id": "kafka-task-4",
"summary": {
"state": "normal",
"tso":<PHONE_NUMBER>18948355,
"checkpoint": "2022-01-06 14:14:42.308",
"error": null
}
},
{
"id": "mysql-task-1",
"summary": {
"state": "normal",
"tso":<PHONE_NUMBER>60695559,
"checkpoint": "2022-01-06 14:15:42.358",
"error": null
}
}
]
[root@CentOS76_VM log]# date
Thu Jan  6 14:42:04 CST 2022

What did you expect to see?
mysql changefeed still can works normally
What did you see instead?
cdc log has expected ERROR: [ERROR] [changefeed.go:118] ["an error occurred in Owner"] [changefeedID=kafka-task-3] [error="[CDC:ErrKafkaNewSaramaProducer]new sarama producer: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)"]
WARN: [WARN] [client.go:226] ["etcd client outCh blocking too long, the etcdWorker may be stuck"] [duration=20m39.000245874s]
Versions of the cluster
Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):
5.4.0

TiCDC version (execute cdc version):
5.4.0

Another thing is, in this situation, the open files count continuous increasing:

when the broker out of line, cdc try to close the producer.

As shown in the picture above, close the syncClient is quite time-consuming.

maybe we should close the sync in a asynchronous way?

this is constraint by

For protocol, which would send checkpoint ts, this will happen.
At most, block the owner for about 1 minutes.

when the broker out of line, cdc try to close the producer.
As shown in the picture above, close the syncClient is quite time-consuming.
This would cause the owner block for about 1 minutes.

Good catch. If there are multiple Kafka changefeeds and close them one by one, the time cost will be larger.

This problem will cause the owner and processor blocked for a period of time, but only happen when all Kafka brokers were shut down. In a real-world production Kafka cluster, it would be rare that all Kafka brokers were shut down at the same time.
To solve this problem:

make the Close method will respond as soon as possible, which means block on a quite limited time. #4359
Initialize and close sink in an asynchronous ways, to prevent the owner and processor be blocked. #4249
expose some sink configuration can be configured by user.

after #4359 merged, blocking won't last too long, should no more than 2min, so that change the severity to minor.


expression plugin function with multiple columns as input

I've looked as the example but the haversine one is a bit confusing.
It looks like the python example gives 5 parameters to the Rust function so the last one is ignored as the functions only takes 4 parameters.
What is the best way to implement a function that takes multiple columns as parameters and still use all the parallelism and optimization from Polars?

Title
I concur.
The definition of the column is haversine=pl.col("floats").dist.haversine("floats", "floats", "floats", "floats") with sample column floats [5.6, -1245.8, 242.224].
And the unpacking of the data is:
#[polars_expr(output_type_func=haversine_output)]
fn haversine(inputs: &[Series]) -> PolarsResult<Series> {
    let out = match inputs[0].dtype() {
        DataType::Float32 => {
            let start_lat = inputs[0].f32().unwrap();
            let start_long = inputs[1].f32().unwrap();
            let end_lat = inputs[2].f32().unwrap();
            let end_long = inputs[3].f32().unwrap();
// etc

So from the other examples, we understand that inputs[0] is the column on which the plugin function is applied, and inputs[1, 2, 3] are the first 3 column names, and the last one is not used ! If this is correct, this is a bit misleading, isn't it ?
The pig_latinnify and pig_latinnify_with_parallelism make sense, work as expected (I cannot judge the parallelism) and are didactic demos, and so is the kwargs example.
But I would argue a a potentially very generic sample function with several columns as input and several columns as ouput would be more helpful, and, in terms of API it would quite readable to have the inputs and outputs as pl.struct.
Here is the python shell, super generic:
@pl.api.register_expr_namespace("demo")
class Demo:
    def __init__(self, expr: pl.Expr):
        self._expr = expr

    def demo_calc(self) -> pl.Expr:
        return self._expr._register_plugin(
            lib=lib,
            symbol="demo_calc",
            is_elementwise=True,
            kwargs={},
        )

A vaguely worded rust part would be:
// struct input column
struct FuncStructIn {
    a_float: bool,
    a_int: i64,
    a_string: String,
}

// struct output column
struct FuncStructOut {
    a_valid: bool,
    a_one: f64,
    a_two: f64,
}

// output type is a struct with schema FuncStructOut
#[polars_expr(output_type=FuncStructOut)]
fn demo_calc(inputs: &[Series], kwargs: PigLatinKwargs) -> PolarsResult<Series> {

    // unpack struct to individual variables, with all the relevant error checking
    // obviously this does not work but you get the idea
    let s_in: FuncStructIn = inputs[0].struct();

    let a_float : &ChunkedArray<T>= =    s_in.a_float;
    let a_int = s_in.a_int;
    let a_string = s_in.a_string;

    // impl_demo_calc contains the actuall processing
    let s_out: FuncStructOut = impl_demo_calc(a_float, a_int, a_string)

    // returns result
    // again syntax is super approximative
    Ok(s_out.into_series())
}

// approx syntax
pub(super) fn impl_demo_calc(
    a_float: &ChunkedArray<Float64Type>,
    a_int: &ChunkedArray<Int64Type>,
    a_string: &ChunkedArray<Utf8Type>,
) -> PolarsResult<ChunkedArray<FuncStructOut>> {
    // can be anything but return a FuncStructOut shaped struct
    // unless compute error due to bad input
}

// once the this is done, in a second stage, probably a _with parallelism version can be derived.

Hopefully the intention is clear.
Unfortunately, I don't know enough about polars-rs, and to be honest rust in general, at the moment.
The unpacking/re packing in particular is obscure to me..
If there is no serious drawback to this approach - eg. perf cost creating the input struct - then, once the unpacking/repacking and error management is demonstrated it can become a useful boilerplate to start from for many use cases/people.
Whether maintainers are willing to improve this part of the doc or not, I would be grateful for pointers to continue exploring.

looks like the dev has been done:
https://github.com/pola-rs/pyo3-polars/commit/870da1e00ce2024eddab2fd724cc9b605716e2a9
I guess we can close this issue.

looks like the dev has been done:
https://github.com/pola-rs/pyo3-polars/commit/870da1e00ce2024eddab2fd724cc9b605716e2a9

I think this solves a use case brought forward by polars extension plugin author Ion Koutsouris in this issue https://github.com/pola-rs/pyo3-polars/issues/58.
In the meantime I've learnt some Rust and done some research and existing comunity plugins are the best information sources. There I could  find exemples with input as a single column of type list or struct, and output as struct. Aggregating several columns into a col of type struct is easy (and cheap in lazy mode, it seems). Same for unpacking a struct into several columns.
I am not far from testing it and if confirmed, then my naive question above will be answered.

Does this help? https://marcogorelli.github.io/polars-plugins-tutorial/sum/

Does this help? https://marcogorelli.github.io/polars-plugins-tutorial/sum/
I think you're right about the haversine example though, will make a pr to clear it up

yes thanks a lot.
One more thing that is not clear. it looks like "pig_latinnify_with_paralellism" is not used anywhere, just defined. When do we need to use a library like Rayon to speed things up as one of the advantage of using shared library plugins  is to have "Parallelism and optimizations (are) managed by the default polars runtime"?

it looks like "pig_latinnify_with_paralellism" is not used anywhere, just defined

I have the same question :)

Does this help? https://marcogorelli.github.io/polars-plugins-tutorial/sum/

YES it does !
I read through it all and implemented along the way - not done the suggested extra work yet.
But it is a very valuable help :pray:
For somebody intermediate in rust, beginner in rust polarrs, proficient in python polars, the following sections, in particular, got my attention:

what is a series ?
what is a chunk ?
cumulative sum
branch mid predictions
list columns as input
struct columns as input/ouput


C API 'pulsar_message_id_t' couples to C++ 'class pulsar::MessageId'

Describe the bug
The C API prototype defined in message_id.h, such as:

PULSAR_PUBLIC const pulsar_message_id_t *pulsar_message_id_earliest();
PULSAR_PUBLIC const pulsar_message_id_t *pulsar_message_id_latest();

the return type is pulsar_message_id_t, which is defined as:

struct _pulsar_message_id {
pulsar::MessageId messageId;
};

where the pulsar::MessageId is a C++ class. Thus this kind of APIs can't work smoothly in pure C env.
To Reproduce
Steps to reproduce the behavior:

Go to source file 'message_id.h'
Check its definition

Expected behavior
C API should not couple to C++ class definition.

@AllenChien , Thanks for the reporting.  Currently Pulsar provided a native Cpp client, and the c client is a wrapper for Cpp client. And seems this is the reason that struct _pulsar_message_id exists.
Would you please help provide a detailed error information that you have meet?

Closed as stale.
The development of the C++ client has been permanently moved to https://github.com/apache/pulsar-client-cpp. If it's still relevant, please open an issue there.


403 Error when aiohttp resources are not fully merged

Aiohttp merges resources, when they are added in the correct order:

When using aiohttp-cors, resources have to be fully merged, or you end up having 2 resources for the same path, one for the GET method one for the POST, but the latter will not be considered when aiohttp-cors answers the OPTIONS request. It seems that aiohttp-cors supports only a single resource per path.
It would be nice if a hint about this could be added to the docs, if the support of multiple resources for the same path is too complex.
Requirements:
aiohttp==3.0.6
aiohttp_cors==0.7.0

Replicate:
def handler():
    pass

app.router.add_route('POST', '/a', handler)
app.router.add_route('GET', '/b', handler)
app.router.add_route('PUT', '/a', handler)

# Configure default CORS settings.
cors = aiohttp_cors.setup(app, defaults={
    "*": aiohttp_cors.ResourceOptions(
    allow_credentials=True,
    expose_headers="*",
    allow_headers="*")
})

# Configure CORS on all routes.
for route in list(app.router.routes()):
    cors.add(route)

@FabianElsmer we faced with the same issue, allow_methods="*" - could help you.
you could try this:
cors = aiohttp_cors.setup(app, defaults={         "*": aiohttp_cors.ResourceOptions(             allow_credentials=True,             expose_headers="*",             allow_headers="*",             allow_methods="*"         )     })


Run external benchmarks

We should see how we do on https://github.com/convoyinc/graphql-client-benchmarks

I didn't know these benchmarks - we definitely should! The first line of the readme says it focuses on the caching implementation of the clients, and we don't have that yet. But it's worth checking out.

Yeah, upon further reading it might be higher-level than this crate.


Add confirmation tool, update system prompt

Fairly straightforward, please review updated system prompt. By default the confirmation will apply to swaps and PF token creation, and anything else deemed risky by the AI.

Example usage:


Add adb vectorstore (updated)

Not 100% complete, but ready to merge into our (updated) trunk.

Wrong repo


Update app-service-web-vnet-troubleshooting.md

Included details for environment variable WEBSITE_PRIVATE_IP and serviceAssociationLink under troubleshooting info.

@kaushalp : Thanks for your contribution! The author(s) have been notified to review your proposed change.

This troubleshooting info doesn't help the user.  That is to look for system issues which customers cannot control.  We should not document that if the backend failed then you should scale up or down to fix.  Or enable/disable the feature.  We do not put workarounds as such into docs.
Those are bugs plain and simple, not troubleshooting items.

This troubleshooting info doesn't help the user.  That is to look for system issues which customers cannot control.  We should not document that if the backend failed then you should scale up or down to fix.  Or enable/disable the feature.  We do not put workarounds as such into docs.
Those are bugs plain and simple, not troubleshooting items.

We'll close the PR based on the author's response. Thanks.