Support exporting multiple tags not just the first one

This will join the various tags together in the exporter not just the first one in the array.
I have verified that this won't break the Grafana dashboards, that it will easily display the multiple tags.

This will join the various tags together in the exporter not just the first one in the array.
I have verified that this won't break the Grafana dashboards, that it will easily display the multiple tags.

This will break alerting by snapshot tag. See #9
annotations:
  description: The last snapshot older than 10 days
  details: {{ .Labels.snapshot_tag }}: {{ $value }} days ago

This should be implemented with environment variable option, not by default


Incorrect scaling on larger screens

The login and register pages are now fully large-screen compatible.
The content pages still need some improvement.


Fix error removing autocmds when the source is closed before the summary window

Just a missing . as far as I can tell.

Thanks!


Use implicit ActorRefFactory instead of ActorSystem for creating SlackRTMClient

The creation of a SlackRTMClient requires an implicit ActorSession to be in scope
object SlackRtmClient {
  def apply(token: String, duration: FiniteDuration = 5.seconds)(implicit arf: ActorSystem): SlackRtmClient = {
    new SlackRtmClient(token, duration)
  }
}

I'm quite new to Akka so may have misunderstood something, but I think that this means all of the ActorRefs created by the SlackRtmClient will sit at the top level of the actor hierarchy?
Ideally, I would like these to be able to sit underneath other actors in the actor hierarchy. I think this would be possible by changing the implicit ActorSystem to be an implicit ActorRefFactory so that we can use the actor context instead of the system. I couldn't see anywhere where it needed to explicitly be an ActorSystem but there's a good chance I missed something!
I'm happy to work on this if you think it's a good idea. Please let me know if I've missed an important point somewhere.

(another contributor here)
While I understand what you mean, I don't know enough of Akka to have some say.
I suggest you create a PR. I'll review it - either myself or consult with someone more knowledgeable with Akka.
Thanks.


Flaky behavior when using S3Target

I have a small Luigi pipeline (~50 tasks) that writes outfiles to S3 using S3Target. The pipeline is executed daily. Every few weeks (say 2-4 weeks), I see tasks fail with tracebacks like this:
Traceback (most recent call last):
  File "/home/.cache/pypoetry/virtualenvs/venv-9TtSrW0h-py3.7/lib/python3.7/site-packages/luigi/worker.py", line 184, in run
    raise RuntimeError('Unfulfilled %s at run time: %s' % (deps, ', '.join(missing)))
RuntimeError: Unfulfilled dependency at run time: MyTask_2020_06_30

This exception indicates that the worker is trying to run a task that doesn't have all its requirements complete. However, when I check on the dependencies, I find that they are all indeed complete, with outfiles in S3 as expected. Whenever I see tasks fail this way, they succeed without any modification the next time they execute. It seems that essentially any task in my pipeline can fail in this manner. There's no apparent pattern.
I thought that there could be a lag between when the upstream task writes its outfile to S3 and when the the outfile is seen to exist in the complete() call. I added a 5 second sleep to the outfile creation like so:
    def write_to_output(self, data=None):
        with self.output().open("w") as outfile:
            if data:
                outfile.write(data)
            else:
                outfile.write(datetime.datetime.now().strftime("%Y-%m-%d %H:%M:%S"))

        # Add a delay to give S3 time to actually display the file?
        # Hopefully this resolves the numerous race conditions we've seen.
        time.sleep(5)

Unfortunately, the errors persist.
Using Luigi version 2.8.12. I have a central scheduler with two worker nodes.

You are probably bitten by S3's lack of consistency, not by Luigi. S3 does not give any guarantees that you can immediately read an object that you have written. In really bad cases, it can take many hours for them to be visible.
IIRC, this presentation gives some explanation: https://youtu.be/UOE2m_XUr3U. Spark's Delta Lake was created as a workaround for weak storage consistency. GCS and HDFS provide stronger guarantees.
I suggest closing this issue.

Thanks for the response. I suppose I could try to read the object back in my function instead of sleeping.
I didn't realize S3 consistency behavior was so poor. I think it begs the question, should Luigi even have an S3Target class, if it's not reliable for workers to check?

The particular problem that you experience is not a major problem. The job will fail, but it will probably succeed the next time it is executed, assuming that you run Luigi through some cron scheduling. The pipeline then heals by itself, so it makes sense to have an S3Target. On closer thought, this scenario can happen with GCS as well, but probably not as often.
The major problem with S3 is that it lacks listing consistency. It does not affect S3Target, but S3FlagTarget. If the producer writes data files, and then the flag file (_SUCCESS), a consumer that has seen the flag file is not guaranteed to be able to list all the files. GCS and HDFS does provide this guarantee, but S3 does not.
I guess we should add documentation to Luigi, since these issues are likely to bite Luigi users. They are present in most distributed systems, but many developers are not aware.

Since opening this issue, S3 has added strong read consistency: https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency/
These errors no longer occur as a result.


Issue-330 Upgrade dependencies to support android 12

Description
Upgrading play-services-ads to 20.2.0 with recent version of androidx.work:work-runtime:2.7.0-alpha05 that supports android 12
Related Issues
https://github.com/googleads/googleads-mobile-flutter/issues/330
Checklist
Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]).
This will ensure a smooth and quick review process. Updating the pubspec.yaml and changelogs is not required.

[ ] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[ ] My PR includes unit or integration tests for all changed/updated/fixed behaviors (See Contributor Guide).
[*] All existing and new tests are passing.
[ ] I updated/added relevant documentation (doc comments with ///).
[*] The analyzer (flutter analyze) does not report any problems on my PR.
[*] I read and followed the Flutter Style Guide.
[*] I signed the CLA.
[*] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Does your PR require plugin users to manually update their apps to accommodate your change?

[*] No, this is not a breaking change.

@googlebot I signed it!

Closing in favor of https://github.com/googleads/googleads-mobile-flutter/pull/423

What the difference between my PR and this one ?


DWMTitus & Rofi installation does not check if unzip or wget is installed and fails if they are not.

Describe the bug
Tried to install dwmtitus, rofi and global theming on fresh arch minimal instal in virtual machine (vmware workstation pro on win11 host) and dwmtitus script failed because of missing wget and unzip. Rofi installation failed too. Also when I tried scripts again after manually installing those tools when dwmtitus script tried to unpack desktop wallpapers it failed the script because target directory was not empty.
To Reproduce
Steps to reproduce the behavior:

Install latest arch minimal install on virtual machine
Use linutil to install dwmtitus, rofi and global theming

Expected behavior
Script should prompt to install those tools if they are missing instead of failing script. Also in case of unzipping, script should ask to clear the target directory if it is not empty or if it already has files just skip the unzip process.

Already fixed on the dev branch.

Okay. Good to know. I could not know they are already fixed. Linutil is great tool afterall and I can't wait how it evolves.

Okay. Good to know. I could not know they are already fixed. Linutil is great tool afterall and I can't wait how it evolves. I am sorry about unnecessary bug ticket.

It's fine.

/close

as discussed above this issue has been fixed already, and is now included in the latest release


Add contributors guide

The "Where to put packages" section at the end is proposing the layout for packages for the containerd 2.0 release. While this may seem like a large breaking change, it will align with the go module /v2 change we already need to make.
Example package renames required by importers of v2
github.com/containerd/containerd -> github.com/containerd/containerd/v2/client
github.com/containerd/containerd/archive -> github.com/containerd/containerd/v2/pkg/archive
github.com/containerd/containerd/sys -> github.com/containerd/containerd/v2/pkg/sys
Actual changes to move packages and/or create new go submodules will be in follow up. This is also an opportunity to split out some packages into their own repository when it makes sense (this has been proposed for log).

Update
@mikebrow yeah our getting started flow and website makes me cringe a little bit. I added a link, but we really need some help setting up a more unified experience for getting started.

This is also an opportunity to split out some packages into their own repository when it makes sense (this has been proposed for log).

@dmcgowan This doesnt include splitting the api package right?  The one which we planned to do via automatic syncing.

The "Where to put packages" section at the end is proposing the layout for packages for the containerd 2.0 release. While this may seem like a large breaking change, it will align with the go module /v2 change we already need to make.
Example package renames required by importers of v2
github.com/containerd/containerd -> github.com/containerd/containerd/v2/client

Oh, just asking; was your  intent with those examples to put packages in a v2 subdirectory ? Because there's two "options"

Use go's invented alternative to git branches; instead of using branches, you copy all the code to a v2 directory, and maintain all code of all versions in a single branch effectively (v2 and v1 live in the same branch, but "v2" contains code for v2.x.x)
Or, just tag as v2.0.0 but rename the module (and v1 continues to live in the release branches for v1)

The "use a subdirectory" approach was also for compatibility with old dependency tools.
When moving to v2, you're renaming the module, or to put it in other words "v2" and "v1" are completely separate modules, separate projects, no relation whatsoever (their names may just look similar).
And even with the "v2 subdirectory" approach, these are separate modules (who happens to live in tthe same branch).
It's possible to associate them, but in that case it would require aliases to be provided, so v1 must depend on v2, and make the v1 types aliases for v2.
package foo // this is "foo" in the v1 module

// Import the v2 module, which will be code that's vendored
// so the vendor directory will have a copy of containerd from
// a v2 tag.
//
// go.mod will have something like:
//
// require github.com/containerd/containerd/v2 v2.0.0-alpha.0
import "github.com/containerd/containerd/v2/foo"

// Hello is the v1 alias for v2.
type Hello = foo.Hello

I created a quick example repository with that situation; look at the commit (and tag) history to get a bit of an idea what the flow was for that.
Perhaps there's other options possible; the biggest challenge is how to match signatures. The alternative could be to have v1 -> v2 adaptor code live in the v2 version (to type-cast v1 types to v2)

And of course I didn't post a link to my example repository; here it is; https://github.com/thaJeztah/mod-migrate

Or, just tag as v2.0.0 but rename the module (and v1 continues to live in the release branches for v1)

Was the approach I was thinking based on the previous attempt to rename the module. We already have release branches for maintaining the "v1" module. My understanding is there is no clean way to avoid "/v2" in our import paths once we create the "v2.0.0" tag.

@dcantah  Cleaned up the BUILDING and CONTRIBUTING links
I think we can move the v2 module discussion to that PR for now. We know we need it but still figuring out the how.

Ah, yes, sorry for somewhat derailing this PR (and we should / can definitely pick up that discussion elsewhere). I thought for a bit that the intent of that comment was "going forward, create a v2 directory, and put your new things under that".
@dmcgowan and I caught up a bit on Slack, and discussed some of the issues at hand (lots of further brainstorming will still be needed though!)


Request body discard added

Good day to you!
We have couple of errors in prod because of DecodeJsonPayload doesn`t discard the remaining response body data in 100% cases. It should be done in GO 1.5+

Nice!

Hi!
Thanks for your Pull Request! And sorry for my very slow response.
Do you have any reference to this bug I could add in comment ?
Is it the way it was fixed in go1.5 ? Or do you think that fix should be enabled only for some version of Go by checking runtime.Version() ?
Antoine


[test] [SD-App] please add M5Stack_LovyanToyBox.

Please add this project to the m5stack registry  https://github.com/lovyan03/M5Stack_LovyanToyBox

Thank you for your submission.
This project is now awaiting validation.

adding library requirements:
https://github.com/kosme/arduinoFFT/
https://github.com/lovyan03/M5Stack_TreeView/
https://github.com/lovyan03/M5Stack_OnScreenKeyboard/

This message is an automated reply:
The Travis CI build passed with https://github.com/lovyan03/M5Stack_LovyanToyBox.
See https://travis-ci.org/tobozo/M5Stack-SD-Updater/builds/532318768 for more info.

pre-hook:
sed -i -e 's/<arduino\.h>/<Arduino\.h>/g' LovyanToyBox/src/tjpgdClass.cpp
# keeping this hook until the original source is fixed (ping @lovyan03)

This message is an automated reply:
The Travis CI build passed with https://github.com/lovyan03/M5Stack_LovyanToyBox.
See https://travis-ci.org/tobozo/M5Stack-SD-Updater/builds/578144506 for more info.

This message is an automated reply:
The Travis CI build passed with https://github.com/lovyan03/M5Stack_LovyanToyBox.
See https://travis-ci.org/tobozo/M5Stack-SD-Updater/builds/578145341 for more info.


SceneBroadcaster: Use double for state publish frequency instead of int

…

🦟 Bug fix
Fixes #1414
Summary
Changed the state_hertz publishing frequency data type from int to double. Previously, worlds with those params set between 0 and 1 would crash due to being rounded to 0 and state_hertz being inverted. Note that dynamic_pose_hertz still gets rounded down to 0 as it is represented as int in AdvertiseOptions, but does not cause a crash.
Checklist

[ ] Signed all commits for DCO
[ ] Added tests
[ ] Updated documentation (as needed)
[ ] Updated migration guide (as needed)
[ ] codecheck passed (See contributing)
[ ] All tests passed (See test coverage)
[ ] While waiting for a review on your PR, please help review another open pull request to support the maintainers

I am a little new to this, is there an example for a test for crashing?

I think I can make death tests to check for crashes, is it ok? I am asking because I have not seen it in any other one of gazebo's test suites.

I think I can make death tests to check for crashes, is it ok? I am asking because I have not seen it in any other one of gazebo's test suites.

Oh I don't think we need to go that far. Just exercising that code path and having the test run successfully should be enough to make sure there's no crash. This way, if someone reverts the changes from this PR in the future, the test will crash and we'll notice the regression.
Thanks!

I added a test with a simple SDF file. It passes with the current fix but if applied before the patch it crashes with Floating point exception (core dumped) as expected.


Support for table in UI

Hey team! Please add your planning poker estimate with Zenhub @guusw @sinkingsugar


docs: Add carnivorousplants.co.uk to the showcase

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hello @tombennet,
thank you for adding your website to the showcase of Hugo. I've merged your contribution as 1d70aa98 .
Hugo's showcase section should be updated within the next minutes.
Cheers,
Digitalcraftsman


chore(main): release 0.0.7

:robot: I have created a release beep boop
0.0.7 (2024-02-05)
Bug Fixes

bump validator plugin version to support rule addition (#119) (27aad75)

Other

deps: update golang.org/x/exp digest to 1b97071 (#105) (91ac35e)
deps: update golang.org/x/exp digest to db7319d (#95) (1933d7f)
deps: update module github.com/azure/azure-sdk-for-go/sdk/azcore to v1.9.1 (#98) (5592c20)
deps: update module github.com/azure/azure-sdk-for-go/sdk/azidentity to v1.5.0 (#99) (dc7cbad)
deps: update module github.com/azure/azure-sdk-for-go/sdk/azidentity to v1.5.1 (#100) (689915a)
deps: update module github.com/onsi/ginkgo/v2 to v2.15.0 (#101) (fc1d119)
deps: update module github.com/onsi/gomega to v1.31.0 (#102) (cc5a349)
deps: update module github.com/onsi/gomega to v1.31.1 (#107) (f6172d4)
deps: update actions/upload-artifact digest to 1eb3cb2 (#94) (f53bf88)
deps: update actions/upload-artifact digest to 26f96df (#109) (50de20e)
deps: update actions/upload-artifact digest to 694cdab (#104) (05c654a)
deps: update anchore/sbom-action action to v0.15.4 (#103) (0a43800)
deps: update anchore/sbom-action action to v0.15.5 (#108) (74550db)
deps: update anchore/sbom-action action to v0.15.6 (#111) (ae639a9)
deps: update anchore/sbom-action action to v0.15.7 (#113) (ec04ebf)
deps: update anchore/sbom-action action to v0.15.8 (#114) (0ec6a61)
deps: update codecov/codecov-action digest to 4fe8c5f (#110) (68bbdf7)
deps: update codecov/codecov-action digest to ab904c4 (#112) (667b97d)
deps: update codecov/codecov-action digest to e0b68c6 (#117) (424210c)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/spectrocloud-labs/validator-plugin-azure/releases/tag/v0.0.7 :sunflower:


Kiali is reporting all proxies as "unsynced"

What kind of request is this (question/bug/enhancement/feature request):
Bug
Steps to reproduce (least amount of steps as possible):

Install Monitoring
Install Istio
Deploy BookInfo Project
Send traffic to /productpage
Observe Application Health from Kiali

Result:
Each service will show up as "Degraded" for the sole purpose of "(1 proxy unsynced)

Other details that may be helpful:
This happens because the anonymous user does not have permissions on pod/proxy
Editing the kiali ClusterRole in istio-system will fix this issue.
...
 - apiGroups:
   - ""
   resources:
   - pods/proxy
   verbs:
   - get
...

Issue identified with the help of this link:
https://github.com/kiali/kiali/issues/3318
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): v2.5.3
Installation option (single install/HA): HA

Not relevant until Kiali 1.28

Not relevant until Kiali 1.28


fix(graph-node): better namespace template

Improves the detection of namespaces containing indexer-service instances.
Replacing namespace templating query with indexer_service_channel_messages_total.
Before it was based on indexer_service_queries_total. The problem with that one is that the metric does not exist at all until the indexer-service gets a query, while indexer_service_channel_messages_total always starts out with 0.

thank you @aasseman! :bow:


setonix shpc for next deployment: updated SHPC to v57, with new funct…

…ionalities

Updated SHPC from 0.0.53 to 0.0.57.
New functionalities:

module views (automated module symlinks)
overrides (automated openfoam modulefiles with version specific binaries)
SINGULARITY_CONTAINER variable

Impact:

Backend: deployment simplified, as module symlinks and custom openfoam version are taken care of automatically
Userend: module naming convention now consistent with all other modules

At next deployment, the following two steps are required, in collaboration with the Platforms team (see also setonix/README.md):

update pawsey module, based on the newly generated /software/setonix/2022.XX/pawsey_load_first.lua (done with Kevin for previous deployment);
update user account creation process, following the updated /software/setonix/2022.XX/spack/bin/spack_create_user_moduletree.sh (done with William for previous deployment).


Not privateSECURITY-ISSUE DO NOT USE UNTIL CHANGES ARE MADE

@D-32 @liady @adrianmarinwork it is important to note that the current implementation of the code uploads data to the author's S3 bucket. While this may be a convenient solution for the author, it poses a potential security risk, as it could allow the author to access sensitive data, such as passwords or API keys, that users may inadvertently include in their data.
To address this concern, it would be advisable to modify the code so that it does not upload user data to a third-party service, such as the author's S3 bucket. One potential solution could be to modify the code so that it saves the user's data locally on their own machine instead of uploading it to a remote server. This would help ensure that the user's data remains secure and under their control.
It is important to be mindful of potential security risks when using third-party software or services. Users should always carefully review the code and configuration of any software or service they use, and take appropriate steps to secure their data and systems.

I would recommand allow people to add their own links or save the html file to local

There is no cause for alarm here. i can confirm that Generate PNG and Download PDF is processed locally and no user data is being smuggled. Share Link is something which has to be hosted in the cloud for universal access. And by observing the network activities, no sensitive user data is being sent when a post request is made to https://chat-gpt-static.netlify.app/.netlify/functions/chatgpt-upload.

Whether sensitive data is sent to that Netlify function or not would rather seem to depend on whether any sensitive data was included in the chat itself. With that in mind it might indeed be nice to warn users that their data is being sent to a third party in order to be shared.

Ok, i am confused. An alert like Your chat may include sensitive data. Proceed to share ? before being uploaded?

1# - The danger here is that you not in control of the chats that are been sent to the s3 bucket,
2# What if you want to delete the chat because you had forgot that you had put your password or sensitive information - you can't
#3 it is important to understand that data is being harvested here... lastly why can't the code be transparent enough so you could add you own s3 bucket or storj or even your own server
Listen i am not saying that this is what they would do, but i am suggesting for them to be open and trust worthly.
@watsonbox @spidy0x0 @liady @D-32

Agreed. Vouch

Hello guys, thank you for all your information about security issues. It's good to have in mind this kind of things.
Unfortunately, the owner of this project has stopped developing/maintaining the repository, I'm not a collaborator or the owner, I helped him with an issue some time ago.
I don't know if there are other projects that can do the same as this one.

@4m0ses could you give a starting point for where these changes would need to be made? I'm happy to take a look at it.

async function sendRequest() {
const data = getData();
const uploadUrlResponse = await fetch(
"https://chatgpt-static.s3.amazonaws.com/url.txt"
);
const uploadUrl = await uploadUrlResponse.text();
fetch(uploadUrl, {
method: "POST",
headers: {
"Content-Type": "application/json",
},
body: JSON.stringify(data),
})
.then((response) => response.json())
.then((data) => {
window.open(data.url, "_blank");
});
}

I believe this where the code goes and send the html file and returns with a link
async function sendRequest() {
  const data = getData();
  const uploadUrlResponse = await fetch(
    "https://chatgpt-static.s3.amazonaws.com/url.txt"
  );
  const uploadUrl = await uploadUrlResponse.text();
  fetch(uploadUrl, {
    method: "POST",
    headers: {
      "Content-Type": "application/json",
    },
    body: JSON.stringify(data),
  })
    .then((response) => response.json())
    .then((data) => {
      window.open(data.url, "_blank");
    });
}

Why don't you just remove sendRequest(); from the actionsArea.appendChild(downloadPdfButton);? Therefore, the code would never call the sendRequest function.


feat(standalone): expose olm package as parameters

Description

Follows up a discussion with @daveconde on setting up standalone clusters
Verification Steps

Checklist (Definition of Done)

[ ] All acceptance criteria specified in JIRA have been completed
[ ] Unit and integration tests added that prove the fix is effective or the feature works (tested against emulated and non-emulated OCM environment)
[ ] Documentation added for the feature
[ ] CI and all relevant tests are passing
[ ] Code Review completed
[ ] Verified independently by reviewer
[ ] Required metrics/dashboards/alerts have been added (or PR created).
[ ] Required Standard Operating Procedure (SOP) is added.
[ ] JIRA has created for changes required on the client side

hey @daveconde mind giving this a look?


A question about Functorch support

Hi, I tried to call the mamba block in the torch.vmap() function, and the following error occurred:
RuntimeError: In order to use an autograd.Function with functorch transforms (vmap, grad, jvp, jacrev, ...),
it must override the setup_context staticmethod. For more details, please see https://pytorch.org/docs/ master/notes/extending.func.html

It seems to be caused by the lack of compatibility with functorch in mamba. Are there any plans to add compatibility with functorch in the future?

We don't plan to support functorch ourselves (tbh I don't use functorch and idk what it takes to support it). Ofc we'd welcome PRs if folks want to work on this.


Support model declaration in zero.Init context

This PR aims to support model declaration in zero.Init context by applying the following improvements mainly done by @eisene in #3203.

Partition parameters of a class dynamically defined inside zero.Init() (followed the improvement proposed by @eisene)
Fixed condition in tests to check if parameter partitioning is properly applied (test_zero_nesting_init.py, test_zero_dynamic_class.py) (followed the improvement proposed by @eisene and added deepspeed.initialize to catch possible errors)
Restore zero.Init() context after deepspeed.initialize() (validated by new test: test_zero_nesting_init.py::TestShutdownInNestingInit::test_shutdown_in_nesting_init) (followed @tjruwase's suggestion)

The main difference with #3203 is that this PR solves the issue pointed by @tjruwase.
Regarding the issue, this PR also enables zero.Init() contexts to restore the state (patching functions) after deepspeed.initialize().

Hi @eisene, thank you for your proposal! I like your approach using annotations.
The only concern is that your PR seems to have changes for multiple purposes now.
So I would like to apply this PR right now to fix the related issues including yours (#3202). Then, can you submit another PR to implement your approach using annotations?

Apologies for the delay. I'll submit a new PR this week only you let me know that you don't need it anymore.

Apologies for the delay. I'll submit a new PR this week only you let me know that you don't need it anymore.

Hi @eisene, are you submitting a PR for your approach using annotation?
If so, shouldn't we merge this PR first so that you can make your change consistent with other fixes?

Agreed, since this one's already approved.

@eisene Thank you for your reply! I will merge this PR as soon as possible.
I just restarted tests because the previous tests seemed to fail due to some CI issue.

Agreed, since this one's already approved.

Hi @eisene, this PR was finally merged. Thank you for your waiting.
Now you are ready to work on your proposal.

Thanks. I made a new pull request #3865 that has the decorator logic.


Add ORDO to KG

This failed initial ingest (on Deanne’s list for Kids First)

ORDO is now part of the base set of UBKG ontologies.


Popover API

Would love to track the status of the new Popover API now in Chrome Canary: https://developer.chrome.com/docs/web-platform/popover-api/

Excited as well, but technically duplicate of https://github.com/Fyrd/caniuse/issues/6367. I have to update the title though!


Add Homebrew tap

It would be helpful for macOS and Linux users if there were a Homebrew tap. The client could then be installed without requiring root privileges and you'd be able to set up the shell completions as part of the installation process, leading to a better user experience. Additionally, this would allow upgrades to be handled with brew update instead of having to manually run nhost upgrade.

To the best of my knowledge, no tap was added so "completed" is perhaps a confusing status to apply.


Added Documentation

Closes issue #2
Added:

Contributing file
Code of conduct
Modified:
Readme

Hope you like it. @Saikat-98 😇

Thanks! You liked it. 😇

Thanks! You liked it. 😇


GEOMESA-2727 Accumulo filters for S2 index

Remove S3SFC, replaced with S2SFC
Fix s2/3 ranges to use exclusive stop rows
Pull out row filtering to trait
Fix stat generation with s2 index
Unit tests
Documentation

Signed-off-by: Emilio Lahr-Vivaz<EMAIL_ADDRESS>

Hi elahrvivaz,
I am new in Geomesa-hbase basically trying to load data into hbase via geomesa using geomesa-tutorial code in java. (using GeomesaQuickStart class and common project )
but unfortunately i couldn't.
i am getting error: NoSuchColumnFamilyFound while loading data in java sample code which is given by you.
#What i have done till now:**
1. i have installed Geomesa-hbase 2.x.X
2. i have installed hadoop 2.X.X
3. i have installed hbase 1.3.X
4. i have done all configuration according to geomesa site that whatever guided there.
#what i  am able to do till now after installation of above things.

i am able to ingest csv to hbase via geomesa-hbase ingest commnad
(i have take csv sample data from / geamesa-habse/exaple/ingest/csv)

#Now what i want to do with geamesa-hbase
I want to load data into  hbase using geomesa-tutorials github code  but i couldn't  .
can you guid me to do that?
why i am getting such error, what i am doing wrong.
Thank

@N-Mohanty can you email the users list or post your question in gitter? links here: https://github.com/locationtech/geomesa#join-the-community
thanks,


Executing validateField on an FieldArray throws TypeError: Cannot read property 'validate' of undefined

🐛 Bug report
I consistently get an error TypeError: Cannot read property 'validate' of undefined in the Formik class on line 503:
if (isFunction(fieldRegistry.current[name].validate)) {
It appears that when the field registers, nothing is getting set in the field registry for a validation function. I notice that in the Field code we get our validate function always from props. If I don't pass one (because i'm using Yup), does one get injected for me?
Current Behavior
I have a form that is pretty basic, holds a text field, a boolean, and an array of text fields.
I have broken the form up into parts to show to the user at a given time and I have a function that will accept the field names and the Formik legacyBag and run validateField.
Expected behavior
I think both issues should be handled, I would think I should be able to validate a "parent" field property and it will validate that part of the schema.
I also believe I should be able to validate myArray[i] and it be able to validate that as well, but that might be a stretch goal.
All in all I just need one of these to work, I'm trying to look in the code to assist, but I imagine there are faster people here to help.
Reproducible example
https://codesandbox.io/s/formik-codesandbox-template-p3d29
Suggested solution(s)
I think it might be an issue with how a field registers its validation function. I am currently using the original Field component and not the hook, but it appears that logic is the same.
I think on top of validateField there should be a validateFields where we can give a list of field names to validate.
Your environment

Software
Version(s)

Formik
2.1.4

React
16.3.0

TypeScript
3.7.5

Browser
All

npm/Yarn
6.13.4 (NPM)/1.22.4 (Yarn)

Operating System
OS X (Mojave)

same issue

I'm having this issue as well with Yup schema validation. I changed this line to:
if (fieldRegistry.current[name] && isFunction(fieldRegistry.current[name].validate)) {
and it worked, but of course this would need to be fixed in the package.

Facing same issue... Any updates?

Duplicate of #2291

Workaround for my companion lazy chaps.
    const fieldsToValidate = stepFieldsMap[activeStep] || [];
    formik.validateForm(formik.values)
      .then(errors=>{
        const errs = fieldsToValidate.reduce((errs, field)=>{
          if(errors[field])
            errs[field] = errors[field];

          return errs;
        }, {});

        formik.setErrors(errs);
      })
    ;

Is there any update on this?

I raised a PR a while back to fix this issue but it has become stale https://github.com/formium/formik/pull/2239

Merged the latest master into my branch and resolved the conflicts. It is not longer stale.

While waiting for the PR to get merged,
for anyone facing the same issue in<EMAIL_ADDRESS>you can use patch-package and create a file patch/formik+2.1.4.patch with following content:
diff --git a/node_modules/formik/.DS_Store b/node_modules/formik/.DS_Store
new file mode 100644
index 0000000..55d0d91
Binary files /dev/null and b/node_modules/formik/.DS_Store differ
diff --git a/node_modules/formik/dist/formik.cjs.development.js b/node_modules/formik/dist/formik.cjs.development.js
index a40e31e..843dada 100644
--- a/node_modules/formik/dist/formik.cjs.development.js
+++ b/node_modules/formik/dist/formik.cjs.development.js
@@ -628,7 +628,7 @@ function useFormik(_ref) {
     // This will efficiently validate a single field by avoiding state
     // changes if the validation function is synchronous. It's different from
     // what is called when using validateForm.
-    if (isFunction(fieldRegistry.current[name].validate)) {
+    if (fieldRegistry.current[name] && isFunction(fieldRegistry.current[name].validate)) {
       var value = getIn(state.values, name);
       var maybePromise = fieldRegistry.current[name].validate(value);

and then run npm install again, then it should be fine. Cheers!


Single Row in Match Template Illogical

In match template, we can create single row item. Since this is Matching, after creating app, user gets nothing to match (one entry on left , one on right) and on will always get full score.
In template editor user should be asked to give atleast 2 items.
I have solved this @opticod. Should I send a PR.

Ok, @codingblazer sent the PR, my college is going to start again in coming weeks. May get busy in multiple activities, will review them slowly in free time.

@opticod Np  :-)

Closed via #363


Add support for Python 3

As Python 2 has been deprecated, are there any plans for Python 3 support?

I haven't used this in a long time. Is something broken on Python 3? If you do a PR I'm happy to take a look.

I don't really know what I'm doing, but I tried to install this in a container using Ubuntu 20.04 as a base image, and I couldn't get it running... it could just be user error, and using the correct packages/commands could solve it...
I think it is related to changes made to pyramid for Python 3.
Basically, I'm using a base ubuntu 20.04, running:
apt-get --no-install-recommends -y install ca-certificates python3-pyramid
cd /webNUT/ #A clone of webnut/ from this repo
python3 setup.py install
pserve3 production.ini

The error I'm getting:
root@aa14f2b66455:/webNUT# pserve3 production.ini
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/pyramid/path.py", line 395, in _zope_dottedname_style
    found = getattr(found, n)
AttributeError: module 'webnut' has no attribute 'views'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/bin/pserve3", line 11, in <module>
    load_entry_point('pyramid==1.10.4', 'console_scripts', 'pserve')()
  File "/usr/lib/python3/dist-packages/pyramid/scripts/pserve.py", line 34, in main
    return command.run()
  File "/usr/lib/python3/dist-packages/pyramid/scripts/pserve.py", line 275, in run
    app = loader.get_wsgi_app(app_name, config_vars)
  File "/usr/lib/python3/dist-packages/plaster_pastedeploy/__init__.py", line 128, in get_wsgi_app
    return loadapp(self.pastedeploy_spec,
  File "/usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py", line 253, in loadapp
    return loadobj(APP, uri, name=name, **kw)
  File "/usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py", line 278, in loadobj
    return context.create()
  File "/usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py", line 715, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py", line 152, in invoke
    return fix_call(context.object, context.global_conf, **context.local_conf)
  File "/usr/lib/python3/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/local/lib/python3.8/dist-packages/webNUT-0.0-py3.8.egg/webnut/__init__.py", line 13, in main
    config.add_view('webnut.views.notfound',
  File "/usr/lib/python3/dist-packages/pyramid/config/views.py", line 235, in wrapper
    view = self.maybe_dotted(view)
  File "/usr/lib/python3/dist-packages/pyramid/config/__init__.py", line 749, in maybe_dotted
    return self.name_resolver.maybe_resolve(dotted)
  File "/usr/lib/python3/dist-packages/pyramid/path.py", line 335, in maybe_resolve
    return self._resolve(dotted, package)
  File "/usr/lib/python3/dist-packages/pyramid/path.py", line 342, in _resolve
    return self._zope_dottedname_style(dotted, package)
  File "/usr/lib/python3/dist-packages/pyramid/path.py", line 397, in _zope_dottedname_style
    __import__(used)
  File "/usr/local/lib/python3.8/dist-packages/webNUT-0.0-py3.8.egg/webnut/views.py", line 5, in <module>
    from webnut import WebNUT
ImportError: cannot import name 'WebNUT' from 'webnut' (/usr/local/lib/python3.8/dist-packages/webNUT-0.0-py3.8.egg/webnut/__init__.py)

Thanks for the details, it should be fixed now.


Cannot run examples

I've downloaded examples from https://github.com/rust-qt/examples, the examples were succeeded to compile.
But when running the executable, it shows the error
target/debug/hello_qml: symbol lookup error: target/debug/hello_qml: undefined symbol: _Z9qIsFinite8qfloat16, version Qt_5
How can I fix it?

rust version: rustc 1.53.0 (53cb7b09b 2021-06-17)
linux/amd64 5.8.0-59-generic

I'm having the same issue, using Qt version 5.15.2, the symbol is different for me though undefined symbol: _ZN2Qt8showbaseER11QTextStream

I was having another issue and I'll add it because I think its related
I installed Qt 5.15.2 from the official installer and I was having trouble adding it to the path in a way the ritual build script could detect it. Adding ~/Qt/5.15.2/gcc_64//bin to the $PATH in ~/.profile according to the instructions here made the installed qmake work correctly from a terminal but the build script could not find it, failing with failed to run command: "qmake" "-query" "QT_VERSION". I did some testing and Rust's std::process::Command was the problem as it couldn't find the added $PATH. Interestingly enough python's os.system was able to find it.
I created a symlink of ~/Qt/5.15.2/gcc_64/bin/qmake to /usr/bin and the example compiled fine, but I got the symbol lookup error: target/debug/_: undefined symbol: _ZN2Qt8showbaseER11QTextStream, version Qt_5. I ran ldd on the generated executable and it showed that it was linking against the /lib/x86_64-linux-gnu/libQt5* libraries installed with Ubuntu and not the ~/Qt/5.15.2/gcc_64/lib/libQt5* libraries that I installed. However, the C++ examples in ~/Qt/Examples ran just fine and linked with the correct libraries.
So this seems to be an environment variable/ritual build system issue. I'm gonna try and use Ubuntu's provided Qt and not the custom installed one and see if that works. This problem should be fixed nonetheless, but idk if the project is still being maintained

Update: using just Ubuntu's Qt packages and not the custom installed one works just fine, maybe that can fix your issue as well

Yes, undefined symbol errors when running an executable usually mean that you've built it against one Qt version but another Qt version is picked up by dynamic linker. As long as you follow Setting up, you should be fine. If the issue remains, try to examine relevant environment variables and remove any paths to the wrong Qt version from them.


HDDS-1669. SCM startup is failing if network-topology-default.xml is part of a jar

network-topology-default.xml can be loaded from file or classpath. But the NodeSchemaLoader assumes that the files on the classpath can be opened as a file. It's true if the file is in etc/hadoop (which is part of the classpath) but not true if the file is packaged to a jajr file:
{code}
scm_1         | 2019-06-11 13:18:03 INFO  NodeSchemaLoader:118 - Loading file from jar:file:/opt/hadoop/share/ozone/lib/hadoop-hdds-common-0.5.0-SNAPSHOT.jar!/network-topology-default.xml
scm_1         | 2019-06-11 13:18:03 ERROR NodeSchemaManager:74 - Failed to load schema file:network-topology-default.xml, error:
scm_1         | java.lang.IllegalArgumentException: URI is not hierarchical
scm_1         | 	at java.io.File.(File.java:418)
scm_1         | 	at org.apache.hadoop.hdds.scm.net.NodeSchemaLoader.loadSchemaFromFile(NodeSchemaLoader.java:119)
scm_1         | 	at org.apache.hadoop.hdds.scm.net.NodeSchemaManager.init(NodeSchemaManager.java:67)
scm_1         | 	at org.apache.hadoop.hdds.scm.net.NetworkTopologyImpl.(NetworkTopologyImpl.java:63)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManager.initializeSystemManagers(StorageContainerManager.java:382)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManager.(StorageContainerManager.java:275)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManager.(StorageContainerManager.java:208)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManager.createSCM(StorageContainerManager.java:586)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter$SCMStarterHelper.start(StorageContainerManagerStarter.java:139)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.startScm(StorageContainerManagerStarter.java:115)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.call(StorageContainerManagerStarter.java:67)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.call(StorageContainerManagerStarter.java:42)
scm_1         | 	at picocli.CommandLine.execute(CommandLine.java:1173)
scm_1         | 	at picocli.CommandLine.access$800(CommandLine.java:141)
scm_1         | 	at picocli.CommandLine$RunLast.handle(CommandLine.java:1367)
scm_1         | 	at picocli.CommandLine$RunLast.handle(CommandLine.java:1335)
scm_1         | 	at picocli.CommandLine$AbstractParseResultHandler.handleParseResult(CommandLine.java:1243)
scm_1         | 	at picocli.CommandLine.parseWithHandlers(CommandLine.java:1526)
scm_1         | 	at picocli.CommandLine.parseWithHandler(CommandLine.java:1465)
scm_1         | 	at org.apache.hadoop.hdds.cli.GenericCli.execute(GenericCli.java:65)
scm_1         | 	at org.apache.hadoop.hdds.cli.GenericCli.run(GenericCli.java:56)
scm_1         | 	at org.apache.hadoop.hdds.scm.server.StorageContainerManagerStarter.main(StorageContainerManagerStarter.java:56)
scm_1         | Failed to load schema file:network-topology-default.xml, error:
{code}
The quick fix is to keep the current behaviour but read the file from classloader.getResourceAsStream() instead of classloader.getResource().toURI()
See: https://issues.apache.org/jira/browse/HDDS-1669

/retest

Thanks @arp7 the review. I will commit it after a clean jenkins build. I would like to be sure that the issues is fixed on the jenkins side. The last run is failed because a wrong path in the Jenkinsfile. I fixed it and I am waiting for the next build...

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

0
reexec
32
Docker mode activated.

_ Prechecks _

+1
dupname
0
No case conflicting files found.

+1
@author
0
The patch does not contain any @author tags.

-1
test4tests
0
The patch doesn't appear to include any new or modified tests.  Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

0
mvndep
63
Maven dependency ordering for branch

+1
mvninstall
507
trunk passed

+1
compile
295
trunk passed

+1
checkstyle
88
trunk passed

+1
mvnsite
0
trunk passed

+1
shadedclient
903
branch has no errors when building and testing our client artifacts.

+1
javadoc
180
trunk passed

0
spotbugs
340
Used deprecated FindBugs config; considering switching to SpotBugs.

+1
findbugs
526
trunk passed

_ Patch Compile Tests _

0
mvndep
34
Maven dependency ordering for patch

+1
mvninstall
464
the patch passed

+1
compile
305
the patch passed

+1
javac
305
the patch passed

+1
checkstyle
95
the patch passed

+1
mvnsite
0
the patch passed

+1
whitespace
0
The patch has no whitespace issues.

+1
xml
2
The patch has no ill-formed XML file.

+1
shadedclient
681
patch has no errors when building and testing our client artifacts.

+1
javadoc
180
the patch passed

+1
findbugs
537
the patch passed

_ Other Tests _

-1
unit
153
hadoop-hdds in the patch failed.

-1
unit
1074
hadoop-ozone in the patch failed.

+1
asflicense
58
The patch does not generate ASF License warnings.

6413

Reason
Tests

Failed junit tests
hadoop.ozone.container.common.impl.TestHddsDispatcher

hadoop.ozone.client.rpc.TestFailureHandlingByClient

hadoop.ozone.client.rpc.TestOzoneRpcClient

hadoop.ozone.client.rpc.TestSecureOzoneRpcClient

hadoop.hdds.scm.safemode.TestSCMSafeModeWithPipelineRules

hadoop.hdds.scm.pipeline.TestSCMPipelineManager

hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis

Subsystem
Report/Notes

Docker
Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-946/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/946

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml

uname
Linux 4f1a92852b74 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / b057479

Default Java
1.8.0_212

unit
https://builds.apache.org/job/hadoop-multibranch/job/PR-946/1/artifact/out/patch-unit-hadoop-hdds.txt

unit
https://builds.apache.org/job/hadoop-multibranch/job/PR-946/1/artifact/out/patch-unit-hadoop-ozone.txt

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-946/1/testReport/

Max. process+thread count
4486 (vs. ulimit of 5500)

modules
C: hadoop-hdds/common hadoop-ozone/integration-test U: .

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-946/1/console

versions
git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1

Powered by
Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

Ok, it looks good to me.
Finally the acceptance test shows real results:
https://ci.anzix.net/job/ozone/17099/RobotTests/log.html

audit parser will be fixed by HDDS-1630
acl failure in mapreduce test is also a known issue

4 unit tests are independent, none of them are related to the network-topology error.
Will merge it soon.


Help to Start the Server after "npm install" steps

Hi Andreas,
I love your this repositories "Node-Red within express" project and would like to explore it to develop a back-end system for one of my project.
However, I am a bit confuse on how to run the server after the "npm install" step.
Moreover, I am faced this issue while doing "npm install" showing 7 vulnerabilities at below:

Should I ignore it and straight run/start the server? Kindly advise me on it
Can you kindly also advise the following steps to run/start the server? As I dont really understand the next steps on how it should be done.
Thanks in advance for the support.
Looking forward to your reply soon.
FYI, I am using Window to run this repositories.

Hello,
as the log states, vulnerabilites will be fixed by installing<EMAIL_ADDRESS>but this is described as a "breaking change".
Right now I do not have the time to test it myself - but what you may want to try is installing the mentioned version of NodeRED rather than the requested one and see whether the server (and the foreseen NodeRED flows) will still work as intended.
The mentioned vulnerabilities sound severe - for that reason, if you plan to use NodeRED as a backend, you may really want to give the new versoin a try!
How to run the final server will depend on whether you need "virtual hosts" or not - "virtual hosts" will be required if multiple domain names (e.g., a.de, b.de, c.de etc.) will be resolved to the same IP address and handled by the same actual server (which, internally, may direct any requests to domain-specific subdirectories in order to isolate domains from each other)

Hi,
I will

Hi,
I will try to explore around to test whether it works with both<EMAIL_ADDRESS>or the new version node-red.
Thanks for the sharing.

Please inform me about your result - it might be a good idea to change the package.log accordingly

Hi Andreas,
I have do some research on 7 vulnerabilities package. Based on node red forum, it doesn't affect the application and can continue to use it. Node-red developers will also resolve these vulnerabilities packages at next node-red 2.2.3 update.
However, my question is how do I start the server using "without virtual hosts processing". As I type in npm run in the VS code terminal, it will pop out error at below:

Your instruction manual is not very clear to both me and my teammates who are doing testing on your repository and trying to start the server and access the embedded Node-red to start our first node-red flow.

Is it possible for you to kindly to share some tips on starting the server "without virtual hosts processing" and accessing to node-red to start our first node-red flow?
We really need help and input from you so that we can really start using your repository.
Looking forward to your reply.

Hello,
form your terminal output, I assume that you are using some kind of Windows system (e.g., 10 or 11).
In that case, you may succeed by renaming startServerWithoutDomains to startServerWithoutDomains.bat.
As I do not run Windows anywhere, I cannot be more specific right now.
Kind regards,
Andreas Rozek

Hi Andreas,
Thanks a lot for this tips. I have successfully started the server and access into the node-red flow.
Will start designing my project system architecture using your repositories.

Really appreciated your help on this issue.

I'll try to update my documentation with regard to Windows in the next few days


V4.1.1 release prep

Release drafted.

There's quite a distinct pattern of downloads where it tails off during the day here - overnight in Europe - and speeds up around 7:30am BST

Very interesting. I think we have loads of Euro users.
I still can't make announcements 'announcements', despite code owner status. Guess you are the only one who can.

Yes re Announcements - as far as I can tell, (though I haven't run it to ground), for a non-organisation repo, only one owner.
LOL.

Have you seen the readme in HACS after installing and restarting @autoSteve?
FML

What the actual??? The image changes looked perfect!
I wonder if there is something special required for HACS. 🤷♂

All if the images are gone, even the ones we did not touch...

It's bizarre, because some of the images that were already hosted in .github/SCREENSHOTS are also gone.  Even the ones where I didn't touch the width attributes.
It's as if HACS does a prospective fetch of images, tries to work out if they exist, and decides if they don't, to remove a link from the readme.  I'm assuming it manipulates the readme and stashes a version, and that's a once off process for a new release, and it serves that version forever more.

Open a HACS issue? I see nothing in the Googlebox...

Yeah, I'm just reading through HACS closed issues, and the closest I can find is https://github.com/hacs/integration/issues/3362, but I'll do a little more looking.

The closest I can get from Ludeeus.
We use relative URLs...

The author needs to switch from relative to static URLs for them to ensure that the content properly works outside of github.com.
Nothing I can do about it.

https://github.com/hacs/integration/issues/2850

Confirmed with an autoSteve release. I'll create a PR.

I can see you've created a branch already.  Too fast for me.
I was busy taking phone calls - in IBM parlance, the air movement device is unserviceable due to faecal contamination as my report starts doing the rounds.

The designation v4.1.2 sounds way nicer than v4.1.1 anyway, getting us even further away from a dot-zero release.
I worked at NetApp for many years, and every odd-numbered ONTAP release was always one to be wary of, so that superstition might be spooking me...
Glad we got it sorted.
We're allowed the odd SNAFU I reckon. Training wheels still on and all that...

OMG.
The pull request to change the images to light mode is actually reflecting in the current release HACS version of the readme.
So it's just the readme markdown that gets cached, and not images... (kind of makes sense.)
#learning...


Add test for JSON marshaling for Teams

Resource covered: Teams

Thank you @gmlewis!
I'm glad to be contributing to this project, and I really appreciated your care with details during your review process.


[FR] [ws-sbom-generator] Use numpy >= 1.21

I would like to use this generator inside a Microsoft hosted agent in Azure DevOps. On the Windows 2019 Server Microsoft installs only Python 3.7.
Since numpy 1.22.3 needs Python 3.8 it's not possible to just use this python module.
My question is, if it's really necessary to use numpy 1.22.3 and if it's possible to use here a version greater or equals numpy 1.21

Okay. Thank you for the information.


Add gettextCatalog getCurrentLanguage getter for better consistency

As it's recommanded to use setCurrentLanguage, i think it's more consistent to also add a getter for currentLanguage property.

Makes sense. At some point I want to deprecate the currentLanguage field, it shouldn't be used directly. Merging, thanks!


Fixed warnings for react-test-utils and prop-types

Fixed warnings for react-test-utils being moved to react-dom and prop-types begin moved to its own package

I created a new branch based on top of v2.2.2-beta.1 containing my changes. However, due to the current branch structure, I couldn't make out where to merge back my changes, and thus the conflict.
Could you please accept my pull request so that we can get rid of the warnings in the v2 release?
I know v3 is the way forward, but until the documentation is ready and it is out of beta, it seems reasonable to maintain v2.

Sorry but v3 is the way to go forward. I realize this is still in beta, but the only reason for this is that I want a working example of this with react-native before it goes out of beta. As far as functionality goes, v3 is working and tested.


Create reactnative.js

This Pull Request resolves Issue #
Description:
In this Pull Request we have done the following additions/edits for the code:
Note: Delete all the text including this!

Make sure you replace #<IssueNumber> with the particular Issue that you are referencing with!
Make sure you describe the Issue properly and ask as many people as possible to review your Pull Request so that it can be merged as soon as possible!

@anldrms This doesn't seem to fit any of the issues on the repository. Please create a new issue on thi repository (Refer to  #3 for the format) and reference the newly created issue in the PR description


[FEATURE] Swap 2 numbers using Bit Manipulation

Detailed description
Hey , I want to add detailed documentation , code  of Swapping 2 numbers using Bit Manipulation.
The Lanugauge I will use for solving this issue will be C++.
Context
Its an important interview question that Swap 2 numbers without using 3rd variable, In that mostly guys answer using some staff like  doing some sort of addition , substraction but there if you answer with using Bit-manipulation then it will be eye catching and also better in case of Time complexity also .
Possible implementation
I will use XOR operation to solve this question, and will be using C++
Additional information
Please assign me ASAP...  I want to work on it.

@Panquesito7 Can you please assign this to me ?

Thanks for opening the issue. I have assigned it to you can raise a pr.

Can I also contribute here? Is someone still working on this?

@Panquesito7 @mishraabhinn I have submitted a PR on this problem. I don't think @Mrjoy832 has successfully written his code yet. Can you please assign this issue to me, or just merge my PR? (I don't know how it goes, I'm still new to this). #2132 <- This is my PR for this issue.


[SPARK-28879][K8S] Kubernetes node selector should be configurable

What changes were proposed in this pull request?
Added two new configuration items:
spark.kubernetes.executor.node.selector
spark.kubernetes.driver.node.selector
Which mimic the behaviour of spark.kubernetes.node.selector but specifically for executors and nodes.
Why are the changes needed?
To allow Kubernetes users to deploy driver and executor pods to different nodes.
This is especially important for AWS users who want to run executors on Spot instances.
Does this PR introduce any user-facing change?
No.

Can one of the admins verify this patch?

Why is this PR against 2.4 and not master?
And is there a reason why pod templates don't cover this? If they do, then we don't really want this. We don't add new features to already released branches.

Why is this PR against 2.4 and not master?
And is there a reason why pod templates don't cover this? If they do, then we don't really want this. We don't add new features to already released branches.

Because 3.0 is not going to be available in say AWS EMR for another year.

Understandable, but that's EMR's problem. Our policy is no new features in already released branches.

Understandable, but that's EMR's problem.


🐛 Bug Report: Logger appends log incorrectly

📜 Description
With the change in "backend-app-api", using "Filtered internal error with logId=${logId} from response" now this logs goes into pod itself, though logs are configured to be send to Redis.
👍 Expected behavior
All logs to be redirected to Redis
👎 Actual Behavior with Screenshots
A lot of messages in pod console like:
{"level":"error","logId":"4729a95e626d6a80b2f8","message":"Filtered internal error with logId=4729a95e626d6a80b2f8 from response Encountered invalid error, not an object, got 'class NotFoundError extends CustomErrorBase {\n  constructor() {\n    super(...arguments);\n    __publicField$1(this, "name", "NotFoundError");\n  }\n}'","service":"backstage","stack":"Error: Encountered invalid error, not an object, got 'class NotFoundError extends CustomErrorBase {\n  constructor() {\n    super(...arguments);\n    __publicField$1(this, "name", "NotFoundError");\n  }\n}'\n    at Object.assertError (/app/node_modules/@backstage/errors/dist/index.cjs.js:22:11)\n    at applyInternalErrorFilter (/app/node_modules/@backstage/backend-app-api/dist/index.cjs.js:603:12)\n    at /app/node_modules/@backstage/backend-app-api/dist/index.cjs.js:753:21\n    at handleReturn (/app/node_modules/express-promise-router/lib/express-promise-router.js:24:23)\n    at /app/node_modules/express-promise-router/lib/express-promise-router.js:55:9\n    at Layer.handle_error (/app/node_modules/express/lib/router/layer.js:71:5)\n    at trim_prefix (/app/node_modules/express/lib/router/index.js:326:13)\n    at /app/node_modules/express/lib/router/index.js:286:9\n    at Function.process_params (/app/node_modules/express/lib/router/index.js:346:12)\n    at next (/app/node_modules/express/lib/router/index.js:280:10)\n    at next (/app/node_modules/express/lib/router/route.js:136:14)\n    at /app/node_modules/express-promise-router/lib/express-promise-router.js:46:9\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)","type":"errorHandler"}
Prior to 1.23 I never seen such error message, and no error messages in pod.
👟 Reproduction steps
Just upgraded from 1.23.next-0 to the latest version
📃 Provide the context for the Bug.
No response
🖥 Your Environment
No response
👀 Have you spent some time to check if this bug has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Are you willing to submit PR?
No, but I'm happy to collaborate on a PR with someone else

so with the new behaviour instead of sending out a database error as HTTP body response, the error is filtered out and logged internally, that's why you are seeing the new logs.
I think the issue might be related to a misconfiguration in the logger passed to MiddlewareFactory.create(). Probably we are passing a new logger instead of the one you have configured.


[Question] - What is difference between AssetBundle and AssetDatabase mode in ResourceLoadMode

Hi @DonnYep
I am learning ResourceLoadMode:

Resource
+AssetBundle
+AssetDatabase

Could you please write some notes on what is AssetBundle  mode, Resource mode, and what is AssetDatabase mode
When to use each mode, if we build for mobile devices, what mode should we use?
Is AssetDatabase similar to the addressable assets of Unity?
Thank you so much!

Hi @codingwatching
I recommend using AssetDatabase mode in unity editor to speed up your development process. When you need to build the app, it is recommended to change to AssetBundle mode.Resource mode is a wrapper for Unity Resources.
You can check the following links:

Resources : https://docs.unity3d.com/ScriptReference/Resources.html
AssetDatabase : http://www.vfkjsd.cn/unity3d/Manual/AssetDatabase.html
AssetBundle : https://docs.unity3d.com/Manual/AssetBundlesIntro.html

AssetDatabase is not the same as addressable. Addressable is a complete resource management solution, the AssetDatabase mode I provide is just the underlying Unity AssetDatabase loading method in the unity editor.
I will update the readme file in more detail to explain the usage of the resource module.
Hope it can help you : ) !

Hi @DonnYep I got it! Thank you so much for the detail explanation. I really appreciate your support!

@codingwatching I'm glad this helped you : )


Setup lint to enable code styles check

Hi, @yusukebe  this PR is to setup lint script for consistent code styles, but if you don't want it, feel free to close it.

Thank you @metrue
I wanted linter. Will merge it.


fix(template) Add setter for template kind to parser manager

Signed-off-by: Jerome Simeon<EMAIL_ADDRESS>

Coverage increased (+0.002%) to 91.403% when pulling 822c8df73d5c4cb3825ceba347a6bb7ce194a386 on parserv2 into 7be93fef40a593321e25578bd1784e8056e45407 on master.


Uppercase project name won't showcase the differences anymore

Thanks to the capital P, Pello differs from the normalized name pello, so we can show where each of them is needed.

PEP 625 specified the sdist filename to be equivalent to the name normalized according to the wheel specification.
This means following these rules:
In distribution names, any run of -_. characters (HYPHEN-MINUS, LOW LINE and FULL STOP) should be replaced with _ (LOW LINE), and uppercase characters should be replaced with corresponding lowercase ones.

As a result, once a new Pello version is released, there won't be any uppercase Pello in the resulting specfiles.
A better example would be a one with hyphens and undescores, as this is the only difference between the project name and sdist name normalization.

Thanks for the report. We showcase this difference in https://docs.fedoraproject.org/en-US/packaging-guidelines/Python/#_example_spec_file without the use of sdists, so I think we are good.


Cu 8696pb2r2 create a navbar patryk kosiski

Implement navbar following the Figma design
Update title
Update necessary libraries to newest version

Task linked: CU-8696pb2r2 Create a navbar

Here's how it looks like:

Additional screen for user profile:


missing category on Uap6 application extensions page

The UAP6 Schema and AppManifestTypes SP_ExtensionCategory_UAP6 contain an extra application extension not mentioned on this page:

windows.barcodeScannerPreviewProvider

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5309a65b-6c16-e492-55e0-28f7be2e8638
Version Independent ID: ca43ca2d-76e0-0fda-e4dd-8748868b2dfa
Content: uap6:Extension - Windows UWP applications
Content Source: winrt-related-src/schemas/appxpackage/uapmanifestschema/element-uap6-extension.md
Product: uwp
Technology: winrt-reference
GitHub Login: @mcleanbyron
Microsoft Alias: mcleans

This extension category has been added to the uap6:Extension.


error for make

root@secret~/multiplayerpiano-server-master# make
mkdir -p build
g++ -std=c++11 -Wall -Wextra -Wno-unknown-pragmas -Wno-unused-parameter -MMD -MP -I ./src/ -I ./lib/uWebSockets/src/ -I ./lib/json/include/ -O2 -c -o build/server.o src/server.cpp
In file included from ./lib/uWebSockets/src/WebSocketProtocol.h:5:0,
                 from ./lib/uWebSockets/src/WebSocket.h:4,
                 from ./lib/uWebSockets/src/Group.h:4,
                 from ./lib/uWebSockets/src/Hub.h:4,
                 from ./lib/uWebSockets/src/uWS.h:4,
                 from src/server.hpp:1,
                 from src/server.cpp:1:
./lib/uWebSockets/src/Networking.h:7:30: fatal error: openssl/opensslv.h: No such file or directory
 #include <openssl/opensslv.h>
                              ^
compilation terminated.
Makefile:48: recipe for target 'build/server.o' failed
make: *** [build/server.o] Error 1

install the needed libraries
you're missing libssl-dev

Installed and complied no errors thanks you


Error when running terraform apply - Snowflake region Australia East

Provider Version
terraform providers: 0.22.0
Terraform Version
0.15.0
Describe the bug
When I run terraform apply I get the following error:
│ Error: error creating database: Post "https://xxxxx.AZURE_AUSTRALIAEAST.snowflakecomputing.com:443/session/v1/login-request?requestId=xxxxx&request_guid=xxxxx&roleName=SYSADMIN": x509: certificate is valid for *.us-west-2.snowflakecomputing.com, *.snowflakecomputing.com, *.global.snowflakecomputing.com, *.prod1.us-west-2.aws.snowflakecomputing.com, *.prod2.us-west-2.aws.snowflakecomputing.com, *.us-west-2.aws.snowflakecomputing.com, not xxxxx.AZURE_AUSTRALIAEAST.snowflakecomputing.com
│
│   on main.tf line 14, in resource "snowflake_database" "db":
│   14: resource "snowflake_database" "db" {

Expected behavior
This should create a database in my Snowflake instance.

error creating database: Post "https://xxxxx.AZURE_AUSTRALIAEAST.snowflakecomputing.com:443/session/v1/login-request?requestId=xxxxx&request_guid=xxxxx&roleName=SYSADMIN": x509: certificate is valid for *.us-west-2.snowflakecomputing.com, *.snowflakecomputing.com, *.global.snowflakecomputing.com, *.prod1.us-west-2.aws.snowflakecomputing.com, *.prod2.us-west-2.aws.snowflakecomputing.com, *.us-west-2.aws.snowflakecomputing.com, not xxxxx.AZURE_AUSTRALIAEAST.snowflakecomputing.com

There is issue on your certificate not a bug on this terraform plugin

I ran into the same issue and was able to temporarily work around but defining the region like this:
provider "snowflake" {
    username = "..."
  account  = "..."
  region   = "ca-central-1.aws"
  role     = "..."
}

Seems the format of the POST request doesn't match what snowflake is actually expecting:
x509: certificate is valid for *.us-west-2.snowflakecomputing.com, *.snowflakecomputing.com, *.global.snowflakecomputing.com, *.prod1.us-west-2.aws.snowflakecomputing.com, *.prod2.us-west-2.aws.snowflakecomputing.com, *.us-west-2.aws.snowflakecomputing.com, not xxxxxxx.AWS_CA_CENTRAL_1.snowflakecomputing.com

For me, the region had to be set to "us-west-2".  Then it started working.  The tutorial says to use the output of "SELECT current_region();" which is "AWS_US_WEST_2"... but that does not work.

I added the following as line 12
region   = "us-east-1"
and everything worked like a champ

I ran into the same issue and was able to temporarily work around but defining the region like this:
provider "snowflake" {
    username = "..."
  account  = "..."
  region   = "ca-central-1.aws"
  role     = "..."
}

Seems the format of the POST request doesn't match what snowflake is actually expecting:
x509: certificate is valid for *.us-west-2.snowflakecomputing.com, *.snowflakecomputing.com, *.global.snowflakecomputing.com, *.prod1.us-west-2.aws.snowflakecomputing.com, *.prod2.us-west-2.aws.snowflakecomputing.com, *.us-west-2.aws.snowflakecomputing.com, not xxxxxxx.AWS_CA_CENTRAL_1.snowflakecomputing.com

Changing to region from "us-east-2" to "us-east-2.aws" also worked for me :D

I also ran into this issue and I had to change my region from "us-east-2" to "us-east-2.aws".
thanks to everyone who contributed on this thread

I also ran into this issue. However, changing my region from "us-east-2" to "us-east-2.aws" doesn't address the problem. Instead of getting the x509 error, I get Error: error creating database: 390100 (08004): Incorrect username or password was specified.
Terraform version: 1.1.3
Snowflake provider version: 0.25.33

I ran into this issue today also. I finally realized that there is a link to a reference table in the guide. Solved my issue.

Using an Account Name as an Identifier
The account identifier for an account in your organization takes one of the following forms, depending on where and how the identifier is used:
<orgname>-account_name (for most URLs and other general purpose usage)
To resolve this issue, remove the Terraform environment variable SNOWFLAKE_REGION since it is optional and replace the environment value SNOWFLAKE_ACCOUNT using the taxonomy above instead of the generic account identifier
This will generate a URL in the format MY_ORG-MY_ACCOUNT.snowflakecomputing.com which will be covered by the pattern *.snowflakecomputing.com

It has worked for me in both, your way and also specifying the region with the format "region.cloud" (in my case west-europe.azure"). I have been able to see the organization name and account on the new UI at the left bottom of the website, just in case someone else struggles a bit searching that info while not being admin 😂

This has tripped us up as well. Just submitted a PR (#1398) that attempts to shed light on the different Snowflake account identifier formats in hope that it may help future adopters when configuring this provider.

I did the following to get things to work for me:

unset SNOWFLAKE_REGION
export SNOWFLAKE_ACCOUNT="ORG_ID-ACCOUNT_ID"

The SNOWFLAKE_ACCOUNT should match the characters on your login URL.

I ran into this issue today also. I finally realized that there is a link to a reference table in the guide. Solved my issue.

Ran into this problem doing the tutorial, would be great if that pointed to the reference guide so you can get it right manually rather than a query that produces a string that fails with an unhelpful message. This issue also seems to be the same thing: https://github.com/Snowflake-Labs/sfquickstarts/issues/799

We are closing this issue as part of a cleanup described in announcement. If you believe that the issue is still valid in v0.89.0, please open a new ticket.

Hey team,
I'm encountering an issue while setting up a Snowflake warehouse using Terraform. Here's the relevant configuration:
variables.tf:
variable "snowflake_account" {
description = "The Snowflake account name"
type        = string
default     = "XXXXX-XXXXX"
}
variable "snowflake_username" {
description = "The Snowflake username"
type        = string
default     = "xxxxx"
}
variable "snowflake_password" {
description = "The Snowflake password"
type        = string
sensitive   = true
default     = "xxxxxx@123"
}
variable "snowflake_role" {
description = "The Snowflake role to use"
type        = string
default     = "ACCOUNTADMIN"
}
variable "snowflake_region" {
description = "The Snowflake region"
type        = string
default     = "eu-west-3.aws"
}
variable "warehouse_name" {
description = "The name of the Snowflake warehouse"
type        = string
default     = "example_warehouse"
}
main.tf:
terraform {
required_providers {
snowflake = {
source  = "Snowflake-Labs/snowflake"
version = "~> 0.94.1"
}
}
}
provider "snowflake" {
account  = var.snowflake_account
user     = var.snowflake_username
password = var.snowflake_password
region   = var.snowflake_region
}
resource "snowflake_warehouse" "example_warehouse" {
name           = var.warehouse_name
warehouse_size = "SMALL"
}
However, I'm running into the following error:
error: open snowflake connection: timeout after 5m0s and 8 retries. HTTP Status: 513. Hanging?with%20provider[%22registry.terraform.io/snowflake-labs/snowflake"],on%20main.tf%20line%2010,%20in%20provider%20%22snowflake%22:10:%20provider%20%22snowflake%22
It seems to be a connection timeout issue. Has anyone encountered this before, or does anyone have suggestions on how to resolve it?
Thanks!

Hey @mdelhaous 👋

I don't think the region is needed, you can remove it.
Make sure your account is equal to SELECT LOWER(current_organization_name() || '-' || current_account_name());
You don't have the role assigned in the provider configuration.
Let me know if that helped.

Hey @sfc-gh-jcieslak ,
Thanks for the feedback! I’ve removed the region, updated the account to SELECT LOWER(current_organization_name() || '-' || current_account_name());, and checked the role assignment in the provider configuration. Everything is working perfectly now. Thank you so much for your help!
Thanks again! 🙌


Able to view and edit bank tags in the bank tag plugin

Sometimes i don't remember all the tags i made and what they contain. Would be nice if you could view and edit all the tags without going into a text file.

does right clicking and selecting edit tags not do that well enough for you?

its not primarily the editing of the tags that id care about, its seeing all the tags that are saved

This should probably be a feature request for the website as there isn't a good way to display it on the client side.

understrandable. it would atleast be nice to be able to delete a bank tag without having to make that tag into a bank tab tag then delete all tags from that tab.
unless theres already an easier way to do this


OLMo 7B finetuning w/ CPU offloading does not work

🐛 Describe the bug
I'm trying to finetune OLMO 7B on a single 4xA100 40GB node. I'm using the official config with no repo changes except that I've 1) loaded pretrained model parameters from HuggingFace and 2) enabled FSDP CPU offloading in scripts/train.py as follows:
    fsdp_model = FSDP(
        olmo_model,
        sharding_strategy=cfg.fsdp.sharding_strategy,
        mixed_precision=cfg.fsdp_precision,
        auto_wrap_policy=wrap_policy,
        use_orig_params=cfg.fsdp.use_orig_params,  # needed for compile and some of our optimizer/parameter metrics
        limit_all_gathers=True,
        device_id=get_local_rank(),
        param_init_fn=param_init_fn,
        cpu_offload=CPUOffload(offload_params=True),
    )

On my personal dataset and also Dolma v1.6_sample, training consistently fails---loss increases from the first iteration. Here are training loss curves on Dolma:

I ran it for longer on my personal dataset and loss eventually decreased, but it never fully recovers:

I've tried changing the learning rate, batch size, gradient clipping warming period, gradient clipping warmup factor, but no dice. I've also been able to reproduce this behavior by enabling FSDP w/ CPU offloading on OLMo-1B, which works normally  otherwise.
Versions
aiohttp==3.9.3
aiosignal==1.3.1
annotated-types==0.6.0
antlr4-python3-runtime==4.9.3
appdirs==1.4.4
async-timeout==4.0.3
attrs==23.2.0
beaker-gantry==0.21.0
beaker-py==1.24.0
black==23.12.1
boltons==23.1.1
boto3==1.34.39
botocore==1.34.39
build==1.0.3
cached-path==1.5.1
cachetools==5.3.2
certifi==2024.2.2
cffi==1.16.0
charset-normalizer==3.3.2
click==8.1.7
click-help-colors==0.9.4
cryptography==42.0.2
datasets==2.17.0
dill==0.3.8
docker==6.1.3
docker-pycreds==0.4.0
docutils==0.20.1
exceptiongroup==1.2.0
face==20.1.1
filelock==3.12.4
frozenlist==1.4.1
fsspec==2023.10.0
ftfy==6.1.3
gitdb==4.0.11
GitPython==3.1.41
glom==23.5.0
google-api-core==2.17.0
google-auth==2.27.0
google-cloud-core==2.4.1
google-cloud-storage==2.14.0
google-crc32c==1.5.0
google-resumable-media==2.7.0
googleapis-common-protos==1.62.0
huggingface-hub==0.19.4
idna==3.6
importlib-metadata==7.0.1
iniconfig==2.0.0
isort==5.12.0
jaraco.classes==3.3.1
jeepney==0.8.0
Jinja2==3.1.3
jmespath==1.0.1
joblib==1.3.2
keyring==24.3.0
lightning-utilities==0.10.1
markdown-it-py==3.0.0
MarkupSafe==2.1.5
mdurl==0.1.2
more-itertools==10.2.0
mpmath==1.3.0
msgspec==0.18.6
multidict==6.0.5
multiprocess==0.70.16
mypy==1.3.0
mypy-extensions==1.0.0
necessary==0.4.3
networkx==3.2.1
nh3==0.2.15
numpy==1.26.4
nvidia-cublas-cu12==<IP_ADDRESS>
nvidia-cuda-cupti-cu12==12.1.105
nvidia-cuda-nvrtc-cu12==12.1.105
nvidia-cuda-runtime-cu12==12.1.105
nvidia-cudnn-cu12==<IP_ADDRESS>
nvidia-cufft-cu12==<IP_ADDRESS>
nvidia-curand-cu12==<IP_ADDRESS>
nvidia-cusolver-cu12==<IP_ADDRESS>
nvidia-cusparse-cu12==<IP_ADDRESS>
nvidia-nccl-cu12==2.18.1
nvidia-nvjitlink-cu12==12.3.101
nvidia-nvtx-cu12==12.1.105
omegaconf==2.3.0
packaging==23.2
pandas==2.2.0
pathspec==0.12.1
petname==2.6
pkginfo==1.9.6
platformdirs==4.2.0
pluggy==1.4.0
protobuf==4.25.2
psutil==5.9.8
pyarrow==15.0.0
pyarrow-hotfix==0.6
pyasn1==0.5.1
pyasn1-modules==0.3.0
pycparser==2.21
pydantic==2.6.1
pydantic_core==2.16.2
Pygments==2.17.2
pyproject_hooks==1.0.0
pytest==8.0.0
pytest-sphinx==0.6.0
python-dateutil==2.8.2
pytz==2024.1
PyYAML==6.0.1
readme-renderer==42.0
regex==2023.12.25
requests==2.31.0
requests-toolbelt==1.0.0
requirements-parser==0.5.0
rfc3986==2.0.0
rich==13.7.0
rsa==4.9
ruff==0.2.1
s3transfer==0.10.0
safetensors==0.4.2
scikit-learn==1.4.0
scipy==1.12.0
SecretStorage==3.3.3
sentry-sdk==1.40.3
setproctitle==1.3.3
six==1.16.0
smart-open==6.4.0
smashed==0.21.5
smmap==5.0.1
sympy==1.12
threadpoolctl==3.2.0
tokenizers==0.15.1
tomli==2.0.1
torch==2.1.2
torchmetrics==1.3.0.post0
tqdm==4.66.2
transformers==4.37.2
triton==2.1.0
trouting==0.3.3
twine==4.0.2
types-setuptools==<IP_ADDRESS>40125
typing_extensions==4.9.0
tzdata==2023.4
urllib3==1.26.18
wandb==0.16.3
wcwidth==0.2.13
websocket-client==1.7.0
xxhash==3.4.1
yarl==1.9.4
zipp==3.17.0

Hi @epwalsh do you have an intuition for why this might be the case?

Hey @gahdritz it's very possible you're running into an FSDP bug. It certainly wouldn't be the first major FSDP bug we've seen. If you can reproduce this at the 1B scale then that's enough evidence to report it to PyTorch.

Coming late to this discussion. Are you loading optimizer state from somewhere? If you are not, you should warm up your learning rate from 0 over a number of steps.


fix: merge settings from generated files in js runtime

Description

Merge settings from generated settings files (e.g. QnA, Luis settings) in js runtime.
Task Item
#minor

Screenshots

Coverage remained the same at 56.747% when pulling e6c98e7284398d4ef19a37cc497c77d77c2fb19c on zim/merge-settings into 8cb80f989ca84d8caccde257bb3651030c6ece43 on main.

close due to security check failed.


lower topology periodic gossip complexity

Instead of gossiping to all neighbours, we select up to log(n_peers) neighbours at random, based on a probability distribution that takes into account the topology, i.e. favours neighbours at the end of "bottleneck" links. The distribution is determined from the unicast topology.
Closes #517.

@bboreham review please.

Coverage increased (+0.58%) to 38.04% when pulling 22f4bde82d114aa74dafe908cb9531e1c9f65a0c on rade:517_lower_topology_periodic_gossip_complexity into 86abc6ac2b2c7ff6ff2028594b3e12b79adff747 on zettio:master.

(discussed offline) selecting min(n_connections, log(n_peers)) connections to send down (as opposed to log(n_peers) peers, which may lie down fewer connections) seems a worthwhile improvement - more resilient to awkward topologies, while retaining the benefit that the overall cost is O(nlogn)

I've changed the neighbour selection to use the min(n_neighbours, log(n_peers)), excluded the gossip sender, and added some documentation.


autocommit prompted for github username and password

The scheduled task for running the map worked no problem this AM, but the autocommit task got hung up.
It prompted me for my GitHub username and password. I entered those, and it quickly flashed with some more printout in the command window but then closed before I could see what it said. This DID commit the changes, but it DID NOT push them.
Need to look into this with the alternative task that keeps the cmd window open. May be related to git - Message "Support for password authentication was removed. Please use a personal access token instead." - Stack Overflow
My computer was off on Sunday when this ran fine on Monday/Tuesday.
I did restart my computer last night before this morning. Not sure if that is related/there is some sort of time out, but need to dig into it.
For today's run, just manually pushed with GitHub desktop.

Same thing happened this AM (7/28). Deleted my old Personal Access Token (PAT) and used that to login in the cmd window when prompted for a password. The PAT was not expired so I'm not sure why it stopped working. Will just keep this issue open while monitoring how it goes during Leg 2.
The best approach might be to save the PAT string somewhere in a text file, and have it ready for the instances when it does need to be re-entered. Still not ideal but it saves from having to create it new each time.
Also of note, @ybarkley did NOT have to set up a PAT when she set up this autocommit task. I know that she works with GitHub directly from within RStudio so I suspect that maybe some global git authentication steps/credentials were maybe set up with that process and so those could be used here.

I also updated the PAT in my Windows Credential Manager

open 'Credential Manager' in Control Panel
select 'Windows Credentials'
if a credentila for git:https://github.com already exists, edit it and use your username and then the PAT as the password
if that credential does not exist (it did not for me), click 'Add a generic credential', type git:https://github.com as the 'Internet or network address:' and use your username and then the PAT as the password.

Ran without needing to put in password in AM on 7/29! Adding for reference tag for others possibly later but otherwise closing because I think this provides a fix. Will add notes on this to the #14 Readme


Create permanent chart cache

Current, chart cache is being built during the initial run of kustomize and stored in the OS tmp directory.
In order to sever the dependency to the chart repo during a kustomize run completely, it would be preferable to check in the chart cache, as a given version of qliksense-k8s is always dependent on a specific version anyway.
To do this:

In the CI job that integrates a new version of the helm chart from artifactory, fetch and untar the chart of charts' subcharts into top level charts directoy (eg. charts/audit)
The helm chart resource for each component needs to change from eg:

apiVersion: qlik.com/v1
kind: HelmChart
metadata:
  name: audit
subChart: audit
releaseName: audit

to
apiVersion: qlik.com/v1
kind: HelmChart
metadata:
  name: audit
chartHome: ../../charts/audit
releaseName: audit

The transformers directory contains two files that need to change fullpath.yaml:

apiVersion: qlik.com/v1
kind: FullPath
metadata:
  name: fullpath
fieldSpecs:
- kind: SelectivePatch
  path: patches/path
- kind: SelectivePatch
  path: patches/patches
- kind: HelmChart
  path: chartHome

and qseokversion.yaml:

apiVersion: qlik.com/v1
kind: SelectivePatch
metadata:
  name: qseokversion
enabled: true
patches:
- target:
    kind: HelmChart
  patch: |-
    apiVersion: qlik.com/v1
    kind: HelmChart
    metadata:
      name: helmchart
    releaseNamespace: default

Closing as this will be deprecated by new stategy around putting the output of helm template into qliksense-k8s directly.


Remove dependency on rc package

The package depends on the unmaintained "rc" package, recently compromised on npm.
It would be great if this dependency could be eliminated. At a minimum, unmaintained dependencies ought to be pinned to an exact version number to help mitigate supply chain attacks.

registry-auth-token successfully removed this dependency: https://github.com/rexxars/registry-auth-token/issues/39

Should consider https://github.com/rexxars/registry-auth-token/issues/39#issuecomment-1171928845.

If you want some more context in deciding whether using @pnpm/npm-conf makes sense for this project and why registry-auth-token is currently using it, see my follow-up comment on the issue in registry-auth-token that describes the thought process behind the change. (I am the original PR author of the changes that moved registry-auth-token off of rc to PNPM's package)

I think this is the official way to load .npmrc: https://github.com/npm/cli/tree/4e81a6a4106e4e125b0eefda042b75cfae0a5f23/workspaces/config
But I reckon it’s just an INI file so it can be read with npm’s own ini package after locating it: https://github.com/npm/ini

@npmcli/config looks too overengineered to me, some simple ini parser will probably be best. Stuff like auth parsing will be a bit more involved. BTW I don't see an issue still depending on rc as long as the version is locked down, but a more modern parser package will be better.

a more modern parser package will be better.

So we agree 😅
The problem is just that it's outdated and so are its subdependencies. Since it's reading npm config, it makes sense to use the same logic npm uses. I suppose the package by pnpm is good enough though and also used by registry-auth-token so it would be deduped where both packages are used.

From what I understand, the requirements to parse npmrc are:

Parse basic ini format, key=value, ignore lines starting with ;
Resolve env vars like ${HOME} in values

Honstely, this is probably 10 lines of code at most :)


CSS Padding Missing from .dcc .character .languages label

This is incredibly minor, but DCC\styles\dcc.css is missing a line to add padding to the left of the 'Languages' label on the actor-partial-pc-common.html sheet.  (The 'Lucky Roll' label has this padding.)
ADD
.dcc .character .languages label {
padding-left: 3px;
}

Fixed in v0.50.22


Out of Date Instructions

Hi,
It looks like the instructions on this page need updating because the code in the Git repo does not match the code examples in the instructions.
For example,

The API application configuration is in an authConfig.js file, not a config.json file.
There is no issuer property in credentials in the authConfig.js file.

I managed to get the example working, but it required a bit of playing around.
Regards,
Mark

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: cb86b02a-e703-09d7-01ee-48b621ab7967
Version Independent ID: dc9d5ad2-817e-c769-2890-d29805811a82
Content: Configure authentication in a sample React SPA by using Azure Active Directory B2C
Content Source: articles/active-directory-b2c/configure-authentication-sample-react-spa-app.md
Service: active-directory
Sub-service: b2c
GitHub Login: @kengaderdus
Microsoft Alias: kengaderdus

@MChez
Thanks for your feedback! We will investigate and update as appropriate.

@MChez
Thanks for your feedback. We've updated our docs. We'll proceed to close it but reach out to us if you have any questions. #please-close


valid-collections? only considers boolean true, not truthy values

Regarding: version 2SNAPSHOT-4
Background: The API documentation for valid-collections? states

Note: valid-collections? returns true if validation returns zero {:valid? falsey} results.

Observation: Collection predicates that return a non-boolean are not regarded as valid, even through they are truthy.
(get [42] 0)
;; => 42

(valid-collections? [42] [#(get % 0)])
;; => false

Expected output:
(valid-collections? [42] [#(get % 0)])
;; => true

Comment:
validate-collections, the underlying function, handles this case as expected.
(validate-collections [42] [#(get % 0)])
;; => ({:datum [42], :valid? 42, :path-predicate [0], :predicate #fn--9731, :ordinal-path-datum [], :path-datum []})

Also, coercing that same predicate's output to a boolean produces the expected result.
(valid-collections? [42] [#(boolean (get % 0))])
;; => true

Approach: Remove the current implementation's (true? ...).

Bug fixed in version 2-SNAPSHOT5.
(valid-collections? [42] [#(get % 0)])
;; => true

(valid-collections? {:x 42} {:foo #(get % :x)})
;; => true

Replaced
(every? #(true? ...) ...)
with
(empty? (only-invalid ...)) idiom.


Cookies response should not automatically be set in subsequent requests

From<EMAIL_ADDRESS>on January 16, 2012 20:35:08
I have been experimenting with Rest Assured today, and one of the issues I came across is that by default it uses response cookies in subsequent requests (where permissible, i.e. within same domain etc.).
I believe this to be a bad idea for a testing framework. When making subsequent calls, surely it is ideal for response cookies to not be propagated unless the user requests it explicitly?
For a simple example, I was testing our authentication system, with two invalid sets of credentials followed by valid credentials. I would not want cookies from the first or second request to be propagated to the third, however this default behaviour meant that when I was seeing errors because cookies weren't being sent on the successful authentication because they had been set already on the client in the previous requests.
In order to stop this behaviour, I made a few simple modifications to the 1.5 release. They are:
remove httpcore-4.0.1.jar and httpclient-4.0.3.jar from the dependencies
Add in httpcore-4.1.2.jar and httpclient-4.1.2.jar from http://hc.apache.org/downloads.cgi Note this is because we want to set a cookie policy of IGNORE_COOKIES. Up until version 4.1 of httpclient, IGNORE_COOKIES was not a field on CookiePolicy, hence the required upgrade. The replacement of httpcore was for compatibility reasons with httpclient-4.1.2
Use the following line of code before you make any calls to RestAssured:
    RestAssured.config = config().httpClient( new HttpClientConfig().setParam("http.protocol.cookie-policy", CookiePolicy.IGNORE_COOKIES));
    You'll need the following imports:
        import com.jayway.restassured.RestAssured;
        import static com.jayway.restassured.config.RestAssuredConfig.config;
        import org.apache.http.client.params.CookiePolicy;

Original issue: http://code.google.com/p/rest-assured/issues/detail?id=149

From<EMAIL_ADDRESS>on January 16, 2012 12:20:44
Status: Fixed

Is there a simple way to turn this back on? I tried this:
RestAssured.config = config().httpClient( new HttpClientConfig().setParam("http.protocol.cookie-policy", CookiePolicy.BROWSER_COMPATIBILITY));

Hmm no unfortunately I think it's hard coded :( Please add a new issue and I'll try to make it configurable.