Listing the alerts in azure monitor fails with error

This is autogenerated. Please review and update as needed.
Describe the bug
Ran the command to list the alerts in azure monitor and got the following error.
Command Name
az monitor alert-processing-rule list Extension Name: alertsmanagement. Version: 0.2.2.
Errors:
The command failed with an unexpected error. Here is the traceback:
("Unable to deserialize to object: type, AttributeError: 'str' object has no attribute 'get'", AttributeError("'str' object has no attribute 'get'"))
Traceback (most recent call last):
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/serialization.py", line 1436, in _deserialize
    found_value = key_extractor(attr, attr_desc, data)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/serialization.py", line 1180, in rest_key_extractor
    return working_data.get(key)
AttributeError: 'str' object has no attribute 'get'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/azure/cli/core/commands/__init__.py", line 710, in _run_job
    result = list(result)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/azure/core/paging.py", line 129, in __next__
    return next(self._page_iterator)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/azure/core/paging.py", line 76, in __next__
    self._response = self._get_next(self.continuation_token)
  File "/Users/rc45017/.azure/cliextensions/alertsmanagement/azext_alertsmanagement/vendored_sdks/alertsmanagement/operations/_alert_processing_rules_operations.py", line 177, in get_next
    error = self._deserialize(models.ErrorResponse, response)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/serialization.py", line 1376, in __call__
    return self._deserialize(target_obj, data)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/serialization.py", line 1454, in _deserialize
    raise_with_traceback(DeserializationError, msg, err)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/exceptions.py", line 51, in raise_with_traceback
    raise error.with_traceback(exc_traceback)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/serialization.py", line 1436, in _deserialize
    found_value = key_extractor(attr, attr_desc, data)
  File "/usr/local/Cellar/azure-cli/2.40.0/libexec/lib/python3.10/site-packages/msrest/serialization.py", line 1180, in rest_key_extractor
    return working_data.get(key)
azure.core.exceptions.DeserializationError: ("Unable to deserialize to object: type, AttributeError: 'str' object has no attribute 'get'", AttributeError("'str' object has no attribute 'get'"))

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az monitor alert-processing-rule list -g {}

Expected Behavior
Environment Summary
macOS-12.6-x86_64-i386-64bit, Darwin 21.6.0
Python 3.10.6
Installer: HOMEBREW

azure-cli 2.40.0

Extensions:
alertsmanagement 0.2.2
cosmosdb-preview 0.8.1
application-insights 0.1.16

Dependencies:
msal 1.18.0b1
azure-mgmt-resource 21.1.0b1

Additional Context

@kairu-ms for awareness

@radhakrishnan-chandarasikharan-kr Thanks for reaching out to us and reporting this issue. We are looking into this issue and we will provide an update.

@radhakrishnan-chandarasikharan-kr I used the same version of the AzCLI and the alertsmanagement extension as your environment. See below:

az version
{
"azure-cli": "2.40.0",
"azure-cli-core": "2.40.0",
"azure-cli-telemetry": "1.0.8",
"extensions": {
"alertsmanagement": "0.2.2"
}
}

While I tried to run the same command at my end and it worked fine. I am unable to reproduce this issue. See below:

az monitor alert-processing-rule list --resource-group MYRGName

Output:
[
{
"id": "/subscriptions/XXXX-XXX-XXXX-XXXX/resourceGroups/MYRGName/providers/Microsoft.AlertsManagement/actionRules/MyRuleName",
"location": "Global",
"name": "navbarule",
"properties": {
"actions": [
{
"actionGroupIds": [
"/subscriptions/XXXX-XXXX-XXXXXX-XXX/resourcegroups/MYRGName/providers/microsoft.insights/actiongroups/application insights smart detection"
],
"actionType": "AddActionGroups"
}
],
"conditions": null,
"description": null,
"enabled": true,
"schedule": null,
"scopes": [
"/subscriptions/XXXXX-XXX-XXXX-XXXXX/resourceGroups/MYRGName"
]
},
"resourceGroup": "MYRGName",
"systemData": {
"createdAt": "2022-09-27T07:00:45.298962+00:00",
"createdBy"<EMAIL_ADDRESS>"createdByType": "User",
"lastModifiedAt": "2022-09-27T07:00:45.298962+00:00",
"lastModifiedBy"<EMAIL_ADDRESS>"lastModifiedByType": "User"
},
"tags": {
"blob": "data"
},
"type": "Microsoft.AlertsManagement/actionRules"
}
]
As an alternative, could you please try either of the below commands and check if that helps ?
Command 1:

az resource list --resource-group MYRGName --resource-type "Microsoft.AlertsManagement/actionRules"

Command 2:

az rest --uri "https://management.azure.com/subscriptions/XXXXX-XXXX-XXXX-XXXX/resourceGroups/MyRGName/providers/Microsoft.AlertsManagement/actionRules?api-version=2021-08-08"

Hope this helps.

The command

az resource list --resource-group MYRGName --resource-type "Microsoft.AlertsManagement/actionRules"

did not work. However when I included the the subscription, it worked

az resource list --resource-group MYRGName --subscription mySID --resource-type "Microsoft.AlertsManagement/actionRules"

But adding the subscription to the original command did not throw any error, but neither was there any response. I get back an empty array ([])

az monitor alert-processing-rule list --subscription MYSID --resource-group MYRG

The command

az rest --uri "https://management.azure.com/subscriptions/XXXXX-XXXX-XXXX-XXXX/resourceGroups/MyRGName/providers/Microsoft.AlertsManagement/actionRules?api-version=2021-08-08"
returns an empty array ([])

@radhakrishnan-chandarasikharan-kr Thanks for getting back.

Could you please confirm if the resource group has any alert processing rules inside it ?
Could you try to create a new processing rule and check if that lists by running either of the above 2 commands ?

I have tried the same 2 commands at my end and it shows the output. Awaiting your reply.

@radhakrishnan-chandarasikharan-kr I wanted to do quick follow-up to check if you had a chance to look at my above comment. Please let us know if you had any updates on this. Awaiting your reply.

@navba-MSFT The resource group has a list of alerts. These are working and firing!
Few things I want to do and hence trying to use the cli. (a) The name of the alert cannot be updated; so I have to recreate it with a new name. (b) I haven't been able to find how to create the alerts in Terraform;
I'm hoping to be able to accomplish these using the CLI

@radhakrishnan-chandarasikharan-kr Thanks for getting back. Could you please run the same command with --debug switch and share the output with me over email navba [@] microsoft [dot] com? Also in the meantime try to run the command from the Azure Cloud Shell TryIt option and check if that works fine ? Awaiting your reply.

The cloud shell tryit requires me to have a storage account; don't have one in my resource group that I can use for this purpose.
Is there an option, along with --debug, to anonymize the data? (OR) do you need the resource/subscription details?

@radhakrishnan-chandarasikharan-kr Thanks for your reply. The --debug output itself will contain the resource / subscription details. But the goal here is to check the rest api calls being done along with the response received from the API call. So please run the same command with --debug switch and share the output with me over email navba [@] microsoft [dot] com?

@radhakrishnan-chandarasikharan-kr I wanted to do quick follow-up to check if you had a chance to look at my above comment. Please let us know if you had any updates on this. Awaiting your reply.

@radhakrishnan-chandarasikharan-kr The action is currently pending on you to share the debug details once you get a chance. Please feel free to reopen this thread, once you have the details. We would be happy to help.


Add support for DeviceArray from JAX

Allow AnnData objects have .X as a DeviceArray. Layer support should also be there but seems to currently fail just as it does e.g. for DaskArray, as mentioned in #693.
from jax import random
from anndata import AnnData

x = random.normal(random.PRNGKey(1), (100,10))
adata = AnnData(x)

adata.write("demojax.h5ad")

As mentioned in #659, it would be nice to also get DeviceArray on read in future if possible, currently it is a NumPy Array:
adata = anndata.read("demojax.h5ad")
type(adata.X)
# => numpy.ndarray

I would support JAX as another backend.
Would probably be worth opening another issue for tracking JAX as a backend. For IO, I was thinking that could be done with #659


Add python-setuptools to debian build dependencies.

The build requires it and places like Launchpad don't allow build-time fetching of external dependencies.

Thanks!


[CESD-492] Uploader should always use it's block list

Describe the bug
When the -f flag  is used, the uploader skips filtering through the blocklist https://github.com/codecov/uploader/blob/38a46e63bdee859f01abead19f71caa3a520641d/src/helpers/files.ts#L28-L151
Additional context
In addition to fixing this bug, rename the block list

The issue is here https://github.com/codecov/uploader/blob/38a46e63bdee859f01abead19f71caa3a520641d/src/index.ts#L159
The files passed with -f are added after the glob handles the ignore lists.


Return non-zero exit code breaks first call of systemd unit

When installing the anything-sync-daemon and run  "systemctl start"
before adjust asd.conf, the systemd unit returns it is failed.
This is caused by the return of a non-zero exit code if no directory
to sync is set or the $VOLATILE is not adjusted yet.
This commit sets a zero exit code for this not uncommon cases so the
call of the "systemctl start" does not fail but just stop due to the
exit command.
This is necessary since so package manager like dpkg can try to start
the systemd unit after installation/upgrade and do not fail due to a
failure of the systemd unit.

I might not understand correctly, but VOLATILE should always be defined.  Line 74 does even if the config file does not have a value.  If a package manager starts the service when the WHATTOSYNC array is null, it should end in a failure state, no?  Why have systemd think that the sync is setup?
I might not be understanding.  Please clarify.

It is correct that the anything-sync-daemon should exit if WHATTOSYNC is empty. The problem is that the Debian package manager aborts the installation if the systemd service exits with a non-zero-state.
The problem is if you disable the auto-start-logic the auto stop-and-restart logic when upgrading the package is disabled, too.
But you are right, this change is more a workaround of the problem, there should be a fix in Debian to allow disable the start-on-first-installation...

Agreed.  I will close this as it seems like a Debian problem.


Documentation discrepancies between repo and website.

Abstract
I have been using biosimulators.org as the perspective for our “landing page” as it is our own unique little section of the internet. I am also inspired by other major Python packages whose primary source of documentation is their own website (sometimes directly on the home page!).
Evidence
Given this viewpoint, it is clear that the presentation of entrypoints on our website needs some help. To support my assertion, I will reference the following examples:

For example, if you were to click on “Tutorial” under “Contents” on the
“BioSimulators-COPASI documentation” page

...only the cli and Docker entrypoints are referenced. To me, this is
confusing for a ‘Tutorials’ or ‘Getting Started’ page as only some of
the entrypoints from the “Overview” section are referenced. As a programmer it can be difficult to navigate the documentation, let alone someone with no coding experience.

Furthermore, when you click on "Tutorial" here: ...

...you are taken to a binder tutorial which ITSELF is a demonstration of the programmatic capabilities of the Python api.

Finally, there are several references to this page which is on the (for all intents and purposes) very different Biosimulations website.

I can understand why these methods are highlighted as they are the methods that require the least amount of setup. Of course, there may exist the philosophical "best practice" of interacting with this repo, but I fear that there is an overall lack of consistency in regard to the scope of a user's ability to interact with this fantastic tool.
Proposal

Create a landing page which references each application entrypoint in an explicit manner
Remove or change the reference to the runBiosimulations getting started guide to be a Biosimulators specific reference
Create a visualization of the relationship between Biosimulators, Biosimulations, and runBiosimulations. Let this visualization also describe their individual purpose/role in the framework.
Create a smart tool for model inference. Leverage the current abilities to identify simulation objects to provide the "best model for the job".
Leverage the biosimulators-tutorials repo and add a pre-configured, shareable, editable Google Colab "sandbox" notebook to the repo (see this pull request)

This issue seems very much inline with our current effort on simplifying and streamlining the biosimulators/biosimulations paradigm, and the web front end. It is great you are gathering these resources @AlexPatrie, we should make use of your recent experiences to improve how we present our paradigm. And it seems like some of that effort should focus on consolidating resources and improving how they are presented and accessed.
I agree about making more explicit references to application entry points. These should be under each tool's page on biosimulators.org. I also think we should put more resources in each tool's GitHub Biosimulator_toolname repository, rather than in a shared online space for all the tools. Notebooks and tutorials are appropriate here, showing how to use the particular tool. We can maybe make a GitHub pages that can access each of these tutorials and puts them on a website, kind of like how I have done with this tutorial for bigraph-viz: https://vivarium-collective.github.io/bigraph-viz/notebooks/basics.html


Helm Chart Improvements

Hello,
As part of playing around with the deployment of pgo, I made some changes to the helm chart to support deployment requirements that I had.
As far as I can tell they don't change the existing behavior / defaults, just add additional customization on a few items.
Is this something you may want to merge and add to these examples?
Cheers

very useful

FYI this has been rebased from current main.. What's the process here for merge?

I have updated this chart to the latest main as of writing, and added any additional improvements to the new objects.
I'm working on testing this version and will reply back here with results


Sync versions when creating a new branch/tag

Currently rtd doesn't detect if a branch/tag was deleted, we only detect if a commit was pushed to a branch or a tag was re-tagged.
Ref https://github.com/rtfd/readthedocs.org/issues/3192#issuecomment-408704631
Current status
GitHub
We only listen to push events for branch and tags in github https://developer.github.com/v3/activity/events/types/#pushevent. We can listen to Create and Delete events https://developer.github.com/v3/activity/events/types/#createevent https://developer.github.com/v3/activity/events/types/#deleteevent
GitLab
We only listen to push events which exclude tags https://docs.gitlab.com/ce/user/project/integrations/webhooks.html#push-events. We can listen to tag events with https://docs.gitlab.com/ce/user/project/integrations/webhooks.html#tag-events
GitLab doesn't have a separate event for creation/deletion, instead, it sets the before/after field to<PHONE_NUMBER>000000000000000000000000000000
BitBucket
We currently listen to push events, it works for branches and tags https://confluence.atlassian.com/bitbucket/event-payloads-740262817.html#EventPayloads-Push.
BitBucket doesn't have a separate event for creation/deletion, instead, it sets the new attribute (null if it is a deletion) and the old attribute (null if it is a creation).
Solution
First, we need to listen to (or modify) the above events to have the information about the creations and deletions. Our sync step is bound to a specific version (and it should exists in the database)
https://github.com/rtfd/readthedocs.org/blob/b04b11298f5a45d6f6c6ec3f9bbbf368b942295b/readthedocs/projects/tasks.py#L223-L226
So, we can't call it directly, said that we have 2 options:

Trigger a new build to the default branch

Call to SyncRepositoryTask with the default branch

https://github.com/rtfd/readthedocs.org/blob/b04b11298f5a45d6f6c6ec3f9bbbf368b942295b/readthedocs/projects/tasks.py#L223-L226
It doesn't trigger a new build, but clone the repo to the default branch and update the version list.
Conclusion
The changes for getting the information about new/removed branches and tags is relatively easy, but we need to take a decision about how to sync the versions, with 1) the user can see the build process and that something is happening, but we will be wasting resources building the documentation, with 2) we save resources but the user doesn't see anything (it can be checked in the webhook response  anyway)

First, we need to listen to (or modify) the above events to have the information about the creations and deletions

On Github, for example, we are only listening for push and pull_request events. Here is the code where this lives and should be updated to add more events:
https://github.com/rtfd/readthedocs.org/blob/b04b11298f5a45d6f6c6ec3f9bbbf368b942295b/readthedocs/oauth/services/github.py#L175
(the get_webhook_data on the other services classes have the same info for GitLab and Bitbucket)

we save resources but the user doesn't see anything (it can be checked in the webhook response anyway)

I prefer this way. Why? Because I think the user shouldn't care about this at all. This process of syncying the VCS repo with our Versions should be transparent and automatic. I'd say that we can trigger the SyncRepositoryTask with the default_branch of the project, as you mentioned.

I just realize that we have an inconsistency in our code. Even though that we are subscribed to push and pull_request in GitHub. Then, when we receive an event we are just considering push only:
https://github.com/rtfd/readthedocs.org/blob/b04b11298f5a45d6f6c6ec3f9bbbf368b942295b/readthedocs/restapi/views/integrations.py#L161

@humitos maybe for a future implementation #1340 , we don't need that at the moment

I meant that we are subscribing webhooks for two different events and we are processing only one.

Call to SyncRepositoryTask with the default branch

Feels like the right implementation. That was the general idea behind that bit of code to behind with, so we're mostly just expanding when it gets called to include delete events, I think?

Has this been deployed already?

Yes, it is

I ask because I pushed a tag and it was not discovered in RTD, and it has happened more times this year.
Maybe the problem is that my repository is configured with a GitHub Service (which are being deprecated) instead of a webhook. However, the documentation says that "Just the push event" should be selected. Perhaps it needs an update as well?

Oh, yes, the docs should be updated, we need to listen to delete and create events on github too https://github.com/rtfd/readthedocs.org/pull/4876/files#diff-d4da38e842120f1e061ecec27ff050c4R175.
That's done automatically by rtd, you only need to do that if you created the webhook manually. If it's an old webhook created by rtd, you should resync the webhook.

@humitos I think that's a manual step, but we could show a message maybe? But not sure how to identify the old webhooks.

I think that's a manual step, but we could show a message maybe?

Why it can't be automated?

But not sure how to identify the old webhooks.

All the project created before the PR got deployed need to be re-synced.

All the project created before the PR got deployed need to be re-synced.

It may be projects that are already re-synced, but I suppose that shouldn't be a problem.

@humitos I opened #5062 to track this


Rename sync to reload

Codecov Report

Merging #1900 (7086ec8) into gc (e8ea9f1) will increase coverage by 0.02%.
The diff coverage is 33.33%.

@@            Coverage Diff             @@
##               gc    #1900      +/-   ##
==========================================
+ Coverage   64.38%   64.41%   +0.02%
==========================================
  Files         125      125
  Lines       14689    14688       -1
==========================================
+ Hits         9458     9461       +3
+ Misses       5231     5227       -4

Impacted Files
Coverage Δ

src/irmin-pack/mem/irmin_pack_mem.ml
63.88% <0.00%> (+1.72%)
:arrow_up:

src/irmin-pack/unix/io_legacy.ml
70.96% <0.00%> (ø)

src/irmin-pack/unix/pack_store.ml
80.23% <ø> (ø)

src/irmin-pack/unix/ext.ml
70.21% <100.00%> (+0.49%)
:arrow_up:

src/irmin/store.ml
64.96% <0.00%> (-0.15%)
:arrow_down:

src/irmin-test/store.ml
94.82% <0.00%> (-0.06%)
:arrow_down:

src/irmin-http/irmin_http.ml
76.49% <0.00%> (+0.32%)
:arrow_up:

src/irmin-unix/resolver.ml
54.72% <0.00%> (+0.74%)
:arrow_up:

src/irmin-git/irmin_git.ml
46.29% <0.00%> (+0.84%)
:arrow_up:

... and 3 more

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

Looks all good (a simple syntactical change).


Addition of a build system generator

I suggest to reuse a higher level build system than your current small make file so that powerful checks for software features will become easier.

CMake
Autotools

Upvoted. The current makefile does not detect dependency changes in the tools area, either.


e2e Tests: Publish test helpers as a reusable library

We currently have a bunch of Page Objects in cypress/integration/po and we have other code in the support and plugins folders.
This code needs to be packaged in a way that QA or other groups can leverage to write their own e2e tests - leveraging what ww are doing here.
Simplest option would be to publish as an npm library (e.g. rancher/cypress) and restructure as necessary to support reuse. It would be good if the dashboard e2e tests could reference this library directly in the repository to simplify the e2e test creation process for dashboard - i.e. avoid having to publish a new version of the library in the case that writing a test requires a new Page Object or utlity.
This also needs documenting.

Hey @nwmac sounds good to do that.
I would start by writing down first most of the tests cases we may have around, then try to polish the logic behind the PO, including the way we identify elements.
We may also include the use of other libraries as well, e.g. @testing-library/cypress so we do not reinvent the wheel.

@nwmac we have several topics which are still open to be discussed.
I mentioned already to @richard-cox that the PO as they are set are just slowing down and creating some problems, so maybe we should limit them and not apply everywhere. For sure this needs to be discussed, together with all the other points which we are changing while working on the E2E.
It would be nice to collect thoughts through the company and other people working on the E2E, so we have something tangible to write down and not just unproven concept.

Another big problem which may probably be needed to tackle down is related on where do we want to place our identifiers.
We do not have a consistent way on how we pass attributes and we are not allowed to do directly to the component in most of the cases.
v-bind="$attrs"

It may force us to wrap in another element just for this reason, which we definitely do not want to have.

@nwmac Given this list of unclear states, I would rather suggest to create the repository, create the library, setup the publishing process, documentation and tree structure.
Successively we may extend commands/PO while we have a common ground.
This would speed up the process and avoid to discuss here about further issues.


X-axis tooltip clips outside chart area

Tooltip should be constrained to chart bounds to avoid clipping outside viewport zone.

I experiencing this issue, when i deactivate the first legend of the chart

Experiencing this problem as well


Classical Structured Prediction Losses for Sequence to Sequence Learning

❓ Questions and Help
Before asking:

search the issues.
search the docs.

What is your question?
I've tried to implement the Sequence Negative Loglikehood loss in Fairseq 0.9 using the code in https://github.com/pytorch/fairseq/tree/classic_seqlevel/fairseq/criterions.
The differences are:

In line 94-103 of fairseq_sequence_criterion.py, I did not detokenize and then tokenize.
The original code:

 for i, hypos_i in enumerate(hypos):
       ref = utils.lstrip_pad(target[i, :], self.pad_idx).cpu()
       r = self.dst_dict.string(ref, bpe_symbol='@@ ', escape_unk=True)
       r = tokenizer.Tokenizer.tokenize(r, self.dst_dict, add_if_not_exist=True)
       for hypo in hypos_i:
                h = self.dst_dict.string(hypo['tokens'].int().cpu(), bpe_symbol='@@ ')
                h = tokenizer.Tokenizer.tokenize(h, self.dst_dict, add_if_not_exist=True)
                # use +1 smoothing for sentence BLEU
                hypo['bleu'] = self._scorer.score(r, h)
 return hypos

My modification:
       for i, hypos_i in enumerate(hypos):
            ref = utils.strip_pad(target[i, :], self.pad_idx).cpu()
            for hypo in hypos_i:
                # use +1 smoothing for sentence BLEU
                hypo['bleu'] = self._scorer.score(ref, h)
        return hypos

In line 210-214 of fairseq_sequence_criterion.py, I did not left pad the decoder inputs.
Original code:

        input_hypos = [h['tokens'] for hypos_i in hypos for h in hypos_i]
        sample['hypotheses'] = data.LanguagePairDataset.collate_tokens(
            input_hypos, self.pad_idx, self.eos_idx, left_pad=True, move_eos_to_beginning=False)
        input['input_tokens'].data = data.LanguagePairDataset.collate_tokens(
            input_hypos, self.pad_idx, self.eos_idx, left_pad=True, move_eos_to_beginning=True)

my modification:
        input_hypos = [h['tokens'] for hypo_i in hypos for h in hypo_i]
        sample['hypotheses'] = data_utils.collate_tokens(
            input_hypos, self.pad, self.eos, left_pad=False, move_eos_to_beginning=False)
        sample['net_input']['prev_output_tokens'] = data_utils.collate_tokens(
            input_hypos, self.pad, self.eos, left_pad=False, move_eos_to_beginning=True)

When I finetune a base Transformer pre-trained with MLE on WMT16 Ro-En using SeqNLL (beam search with beam size 16) for around 1000 updates, it gives me this error
RuntimeError: Function 'LogSoftmaxBackward' returned nan values in its 0th output.
I checked the forward pass and found the encoder outputs to be normal whereas the decoder_out containing NAN values.
I also find the decoder produce NAN values when the sentence BLEU scores between the hypos and refs are mostly 0.
But not all sentence BLEUs are 0, others are still good, e.g. 70 or even 100.
The sentence BLEU looks like:
bleu: 0.0
bleu: 0.0
bleu: 70.71067811865476
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 0.0
bleu: 36.787944117144235
bleu: 0.0
bleu: 100.0

New updates:
I tried to include the detokenize and tokenize step as described in difference 1), now the error occurs at around 4000 updates.
Code

What have you tried?
What's your environment?

fairseq Version (e.g., 1.0 or master): 0.9
PyTorch Version (e.g., 1.0): 1.2
OS (e.g., Linux): Linux
How you installed fairseq (pip, source):
Build command you used (if compiling from source):
Python version:
CUDA/cuDNN version:
GPU models and configuration:
Any other relevant information:

Are you applying the +1 smoothing for sentence BLEU correctly? I think you need to initialize the counts to 1 somewhere.
You might also take a look at the seq_task branch, where we tried to update the branch to work with a more recent version of fairseq. If you're using 0.9.0, it should actually line up pretty nicely.
The main logic is implemented in a new task called "translation_struct": https://github.com/pytorch/fairseq/blob/seq_task/fairseq/tasks/translation_struct.py and you can combine it with the "sequence_risk" criterion: https://github.com/pytorch/fairseq/blob/seq_task/fairseq/criterions/sequence_risk.py

Are you applying the +1 smoothing for sentence BLEU correctly? I think you need to initialize the counts to 1 somewhere.
You might also take a look at the seq_task branch, where we tried to update the branch to work with a more recent version of fairseq. If you're using 0.9.0, it should actually line up pretty nicely.
The main logic is implemented in a new task called "translation_struct": https://github.com/pytorch/fairseq/blob/seq_task/fairseq/tasks/translation_struct.py and you can combine it with the "sequence_risk" criterion: https://github.com/pytorch/fairseq/blob/seq_task/fairseq/criterions/sequence_risk.py


msys2

I noticed it was possible to install msys from scoop, but following the links in the config file that seems to be the old version. Could you add msys2 install?

scoop install https://raw.githubusercontent.com/AStupidBear/scoop-bear/master/msys2.json works for me.

@AStupidBear How would you feel about submitting your msys2 manifest to the main bucket?

#1566

Thanks @AStupidBear. @Alxandr you can now run scoop install msys2 (after running scoop update).


Feature get posts hashlist

Added an endpoint get-posts-hashlist which can retrieve posts from an array of PostHashes.
Sample payload:
{
    "PostsHashList": ["bdebcb4b5ebf10bd20f8db3e8be55d5b618c7302ea7415967079c4ed58a746e6", "62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1","ba448a92b26a3aa4a2fb5e3f8d03e1956f87f26192503c6dd13031c34d9ea54a", "3a4d6f5b50512f36ed868c406e522775bba9637502cb9708ff3fbb451c70baf5" ],
    "ReaderPublicKeyBase58Check": "BC1YLhDaBCuTnctb44A9yV4hiQu2GV3g3672nHyDYxQoSQ3E7Jk2QHY",
    "OrderBy": ""
}

I have multiple projects waiting for this:

DeSocialWorld
Gemstori
Videso

This is great PR and every dApp requires this feature. It will help to load posts faster and less server request's

can you please return error object in case some post returns error, so I can render error message to the user or whatever... if I request 50 posts and only get 49 I want to know exactly why what happened to that 1 post, thank you!

@diamondhands0 @lazynina you can test this API at Next Killer App, I just activated it there https://next-killer-app.netlify.app/search/in restrospect it was inevitable
When doing text search I get list of hashes from SearchClout API maintained by @tijno and after that fetch posts by the list of hashes.

can you please return error object in case some post returns error, so I can render error message to the user or whatever... if I request 50 posts and only get 49 I want to know exactly why what happened to that 1 post, thank you!

It should put the posts that fail in the "PostsSkipped" array. So PostsFound + PostsSkipped should be equal to the count of posthashes you sent.
If that's not the case, please provide some samples where you get less posts back. Thanks!

can you please return error object in case some post returns error, so I can render error message to the user or whatever... if I request 50 posts and only get 49 I want to know exactly why what happened to that 1 post, thank you!

It should put the posts that fail in the "PostsSkipped" array. So PostsFound + PostsSkipped should be equal to the count of posthashes you sent.
If that's not the case, please provide some samples where you get less posts back. Thanks!

I could add the reason why it's skipped, for example:
{
    "PostsFound": [
        {
            "PostHashHex": "62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1",
            "PosterPublicKeyBase58Check": "BC1YLimX4JKJQDJmajsUJVSomtXtd24jHk88p3exyRh8nFry5FQnDRU",
            ...
            <removed>
            ...
        }
    ],
    "PostsSkipped": [
        {
            "PostHashHex": "bdebcb4b5ebf10bd20f8db3e8be55d5b618c7302ea7415967079c4ed58a746e6",
            "Reason": "Post not found" // <--- I can add this to the response
        }
    ]
}

this is what I want, I want everything to be in one array 😉 @diamondhands0 have a look at this please
{
    "PostsFound": [
        {
            "PostHashHex": "62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1",
            .......
        },
        {
            "error": "GetSinglePost: Could not find postEntry for PostHashHex: ec5efc8d03eadd6f7a4acd07ffae90fe009f0716137dbec551e14092c71dd3b2",
        }
    ]
}

This is super useful, I needed this over a year ago.

@erwin-willems this is what I want, I want everything to be in one array 😉 @diamondhands0 have a look at this please

Added Error to PostsSkipped. You can test with this payload:
{
    "PostsHashList": ["62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1","ba448a92b26a3aa4a2fb5e3f8d03e1956f87f26192503c6dd13031c34d9ea54a", "3a4d6f5b50512f36ed868c406e522775bba9637502cb9708ff3fbb451c70baf5","bdebcb4b5ebf10bd20f8db3e8be55d5b618c7302ea7415967079c4ed58a746e6", "bdebcb4b5ebf10bd20f8db3e8be55d5b618c7302ea7415967079c4ed58a746e5" ],
    "ReaderPublicKeyBase58Check": "BC1YLhDaBCuTnctb44A9yV4hiQu2GV3g3672nHyDYxQoSQ3E7Jk2QHY",
    "OrderBy": ""
}

@erwin-willems this is what I want, I want everything to be in one array 😉 @diamondhands0 have a look at this please
{
    "PostsFound": [
        {
            "PostHashHex": "62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1",
            .......
        },
        {
            "error": "GetSinglePost: Could not find postEntry for PostHashHex: ec5efc8d03eadd6f7a4acd07ffae90fe009f0716137dbec551e14092c71dd3b2",
        }
    ]
}

ah, I see, you want the errors in the PostsFound array. Computer says no because Go is quite strict. That would mean that every PostEntry object (PostsFound is a list of PostEntry objects) would get an Error entry. And if you get an error, that error would get every field of PostEntry, which is pretty ugly.
So PostsSkipped has to be a separate list, because it's a whole different object
A skipped post entry is just not the same as a normal post entry. Both have different fields.
(Opinions from others are welcome on this topic, of course 🙂 )

Concatenate 2 arrays in one before sending data back to client side, just don't forget to keep the correct order, it's important that array in response has same order as array in request

Concatenate 2 arrays in one before sending data back to client side, just don't forget to keep the correct order, it's important that array in response has same order as array in request

I still don't understand why it's so important to have only one array?
The objects in both arrays have different schema's. If you mix them it would break client expectations on which fields are returned from the API.
I really try to understand you.. But I'm still lost on the why..

it's not gonna break anything... when you are fetching for single post for example... in response you get post object or you get error object, does it break any schema in such case? no, because you know what to expect.... post object on success and error object on failure... you just did what was easier for you to do... I am sure @lazynina will kindly ask you to make the return array to comply with existing deso api

it's not gonna break anything... when you are fetching for single post for example... in response you get post object or you get error object, does it break any schema in such case? no, because you know what to expect.... post object on success and error object on failure... you just did what was easier for you to do... I am sure @lazynina will kindly ask you to make the return array to comply with existing deso api

The funny thing is that get-single-post also returns a different object on an error. Please compare both cases:
An existing posthex returns
{
    "PostFound": {
        "PostHashHex": "6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6126",
        ...
    }
}

And a nonexisting:
{
    "error": "GetSinglePost: Could not find postEntry for PostHashHex: 6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6125"
}

So if you list the root objects, then you see two in these examples:

PostFound
error

It would be better if they always return the PostFound and the error object (I don't even cry about the Case Style inconsistency here, error is lowercase, but should start with an E):
Post that exists:
{
    "PostFound": {},
    "error": "GetSinglePost: Could not find postEntry for PostHashHex: 6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6125"
}

Post that doesn't exist:
{
    "PostFound": {
        "PostHashHex": "6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6126",
        ...
    },
    "error": ""
}

This is exactly the same as I do in the PostHashlist, but because it can return part good and part bad posts it could have both objects.
The only difference from what I did is, I named "error" to "PostsSkipped", but I'm fine with changing that to "error" for consistency.
So look again at your sample, compare it with the examples above and then you see I'm not wrong nor lazy.
{
    "PostsFound": [
        {
            "PostHashHex": "62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1",
            .......
        },
        {   // <--- The indent is wrong here, error should not be part of the PostsFound object, it is a separate object
            "error": "GetSinglePost: Could not find postEntry for PostHashHex: ec5efc8d03eadd6f7a4acd07ffae90fe009f0716137dbec551e14092c71dd3b2",
        }
    ]
}

Look at this again.... you send request with list of hashes and you get this array in response... you start iterating over it and check if there is "error" field, if there is error field you render error or skip, if there is no error field you render post and go on, this is very simple concept that you refuse to accept and it's 100% matches existing DeSo API concept, there is no need to reinvent a wheel.... on a side note, I would add post hash into the object with error so I can track which hash gave me error.
{
    "PostsFound": [
        {
            "PostHashHex": "62ef62991f56d05f6cf55f06080d64e438a6529d58fae57822f1ab9cf34600f1",
            .......
        },
        {
            "error": "GetSinglePost: Could not find postEntry for PostHashHex: ec5efc8d03eadd6f7a4acd07ffae90fe009f0716137dbec551e14092c71dd3b2",
            "PostHashHex":  "ec5efc8d03eadd6f7a4acd07ffae90fe009f0716137dbec551e14092c71dd3b2"
        }
    ]
}

{
"PostFound": {
"PostHashHex": "6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6126",
...
},
"error": ""
}

If that was the case then get-single-post does not match the DeSo API concept. The error response would then:
{
"PostFound": {
"PostHashHex": "6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6125",
"error": "GetSinglePost: Could not find postEntry for PostHashHex: 6fbc03a99ae0694fe2894cb3e508d506dcfd2e1a27cd12b074f81a3f691b6125"
...
},
}
And that's not the case. Error is not part of the PostFound object, it's a separate object.
Once you start coding with Go, you will see such consistency/inconsistency, because the beauty of Go is that it won't let you do inconsistent things. Go check the code and see for yourself :)

🤦🏻♂

💙💙💙


RFP - rix

Checklist

[x] The package I am requesting does not already exist on https://community.chocolatey.org/packages;
[x] There is no open issue for this package;
[x] The issue title starts with 'RFP - ';
[x] The download URL is public and not locked behind a paywall / login;

Package Details
Software project URL : https://github.com/rh/rix
Direct download URL for the software / installer : https://github.com/rh/rix/archive/refs/tags/v0.2.0.tar.gz
Software summary / short description: Command-line XML editing and refactoring

This doesn't appear to be a Windows binary. Installation is through Ruby gems, and it was last updated in 2011. This is not a good candidate for a package.


chore: basic test plan document

Summary of changes
Changes introduced in this pull request:

Basic document outlining the goals and current state of testing in Forest

Reference issue to close (if applicable)

Closes
Other information and links

What is this? Documentation? :scream:

Should perf test be included here or maybe in a separate doc?

We can update the document once we have a more consistent story for performance testing.


:sparkles: Switch to Annotated Type Annotations

Ref: https://github.com/tiangolo/fastapi/releases/tag/0.95.0

E.g:
from neoclient import Header, get

@get("/foo")
def foo(token: Header[str]):
    ...

The general theory behind this would be to use meta/info classes to store the parameter metadata, e.g:
@get("/foo")
def foo(token: Annotated[str, Header()]):
    ...

Worth doing this before #177


tf.saved_model.save and predict a single value

In order to save the model, I have added this line after the training loop:
tf.saved_model.save(model, os.path.join(FLAGS.output_dir, "1") )
in order to get: assets, saved_model.pb and variables
from there, I am trying to load the model and predict a single value:
loaded = tf.saved_model.load( os.path.join(model_dir, "1") )

tokenizer = tokenization.FullTokenizer(vocab_file=None,spm_model_file=spm_model_file, do_lower_case=True)

text_a = "the movie was not good"
example = classifier_data_lib.InputExample(guid=0, text_a=text_a, text_b=None, label=0)

labels = [0, 1]
max_seq_length = 128

feature = classifier_data_lib.convert_single_example(ex_index=0, example=example, label_list=labels, max_seq_length=max_seq_length, tokenizer=tokenizer)

test_input_word_ids =tf.convert_to_tensor([feature.input_ids], dtype=tf.int32, name='input_word_ids')
test_input_mask     =tf.convert_to_tensor([feature.input_mask], dtype=tf.int32, name='input_mask')
test_input_type_ids =tf.convert_to_tensor([feature.segment_ids], dtype=tf.int32, name='input_type_ids')

logit = loaded.signatures["serving_default"]( input_mask=test_input_mask,input_type_ids=test_input_type_ids,input_word_ids=test_input_word_ids )

pred = tf.argmax(logit['output'], axis=-1, output_type=tf.int32)
prob = tf.nn.softmax(logit['output'], axis=-1)

print(f'Prediction: {pred} Probabilities: {prob}')

This solution works for a single value. Thanks

It turns out that due to a TF 2.0 bug loading model from HDF5 file is not possible.

m HDF5 file is not possible.

Well... we are loading from an init checkpoint which is stored in hdf5 when we pass the parameter --init_checkpoint=${ALBERT_DIR}/tf2_model.h5, so I suppose there is some support for it?

Loading --init_checkpoint=${ALBERT_DIR}/tf2_model.h5 works, what does not work is saving a trained model to .h5 file and using it for predictions.

Loading --init_checkpoint=${ALBERT_DIR}/tf2_model.h5 works, what does not work is saving a trained model to .h5 file and using it for predictions.

I see what you are saying. Are you trying to make a frozen inference graph? like this: https://datascience.stackexchange.com/questions/33975/what-is-the-difference-between-tensorflow-saved-model-pb-and-frozen-inference-gr

Just trying to save the trained model for subsequent serving with Flask.

We're in the same boat. We are doing it on DataBricks. Had some extra errors with the callbacks. So we commented them out, borrowed your code, and put it in a custom callback and it works now. So cheers.
`class MyCustomCallback(tf.keras.callbacks.Callback):
def on_train_batch_begin(self, batch, logs=None):
print('Training: batch {} begins at {}'.format(batch, datetime.datetime.now().time()))
def on_train_batch_end(self, batch, logs=None):
print('Training: batch {} ends at {}'.format(batch, datetime.datetime.now().time()))
print("saving model as per callback to:", os.path.join(FLAGS.output_dir, "1"))
tf.saved_model.save(model, os.path.join(FLAGS.output_dir, "1") )
print("model saved")
def on_test_batch_begin(self, batch, logs=None):
print('Evaluating: batch {} begins at {}'.format(batch, datetime.datetime.now().time()))
def on_test_batch_end(self, batch, logs=None):
print('Evaluating: batch {} ends at {}'.format(batch, datetime.datetime.now().time()))`
a la https://www.tensorflow.org/guide/keras/custom_callback

@Bidek56 do you mind sharing a little more information? Exactly what line in what file did you add this 'tf.saved_model.save(model, os.path.join(FLAGS.output_dir, "1") )' ? Also, Why are you doing an os.path.join? You are trying to make a subfolder called "1" to save to?

I have added the following line of code after this line:
tf.saved_model.save(model, os.path.join(FLAGS.output_dir, "1") )
os.path.join just adds /1 subfolder to output_dir, it's pure Python.

@birdmw Can tell what changes you did to add your custom callbacks. When I am running training its printing out results at the end of each epoch. I want to see at every step. I am not able to figure it out. can you help?


Facilitate completion of full application in staged exercises DRAFT

Background
In exercise JAC00184, an issue arose due to the second stage not being aligned with the new stages & statuses introduced earlier this year. That issue was resolved, but it also became apparent that it was not easy for Admins to see when a candidate had completed the second part of their application. Hence, we would like the platform to show when a candidate has completed their full application.
Notes:

In staged applications, candidates can update their application as many times as they wish within the window.
The status 'Full application not submitted' already exists and would be applied by Admins to candidates that did not complete their application at the second step

User Story
As an Admin, I would like to be able to see which candidates on my exercise have completed their full application so that I can send reminders if necessary.
Feature(s) Description

[ ] Create a new status 'Full application submitted' at the Selection days stage
[ ] Candidates that have completed all sections requested in the second stage of the application, reviewed their submission and pressed submit (at least once) are allocated the status 'Full application submitted'
[ ] The status of candidates that have not completed all sections and hence have not pressed submit at least once remains as it is (probably 'Shortlisting passed')

Acceptance Criteria
It's done when:

[ ] Admins can clearly distinguish candidates that have submitted their full application by their status
[ ] Candidate new status is reflected in the status column on the Stages page

Definition of Done

[ ] User stories/acceptance criteria met
[ ] Internal reviews passed (feedback actioned)
[ ] User testing passed
[ ] Relevant technical documentation updated
[ ] User guidance updated
[ ] Deployed and merged without errors

User Testing Steps

On an example staged exercise with incomplete second stage applications, try to distinguish which candidates have incomplete applications

Hey team! Please add your planning poker estimate with Zenhub @drieJAC @HalcyonJAC @KoWeiJAC @tomlovesgithub @warrensearle

@nickaddy can we discuss this one further as I think we need to clarify what we are updating.
We have two documents:

application contains all the data submitted by the candidate along with their submission status, date and reference number
applicationRecord contains internal private data and contains their stage & status through the post-application process

We should definitely record when the candidate has submitted their full application in the application document.
We can also use the application content (or lack of) to identify which applications have been completed and so this can easily be displayed on screen in the applications list & application view.
If we decide to update applicationRecord status for completed applications with 'Full application submitted' then we need to think through how this should work. It may necessitate combining Staged Applications and Tasks functionality: potentially a new 'Full applications' task, along the lines of PSDQ, which monitors submissions, allows reminders to be sent and when closed/completed updates the status of applications to 'Full application submitted' & 'Full application not submitted'
There may be a simpler solution (i.e. not another Task!) if we only use the 'Full application not submitted' terminal status and otherwise leave the applicationRecord alone.
Note: I think probably a new Task and simplifying Application Process is the way to go but we should talk it through

Hey team! Please add your planning poker estimate with Zenhub @drieJAC @HalcyonJAC @tomlovesgithub @warrensearle

Hey team! Please add your planning poker estimate with Zenhub @drieJAC @HalcyonJAC @tomlovesgithub @warrensearle

Hi @nickaddy am happy with what we discussed today (08/10/2024) and have estimated accordingly. It says this in the ticket description but just to clarify (hopefully) the tasks involved in implementing this ticket are:

[ ] Admin, DP & Apply. Include a new status called 'Full application submitted'
[ ] Apply. When candidate submits a full application (in a staged application), record a timestamp in their application document
[ ] Digital Platform. In onApplicationUpdate check for completed staged applications (look at the new timestamp) and update the corresponding applicationRecord to have the status of 'Full application submitted'.
[ ] Admin. Ensure the 'Full application not submitted' status appears in the Selection Days list of statuses that can be assigned and that it is configured to send the application back to the previous stage of Shortlisting.

Some optional additions are:

[ ] Admin. Include the new status in the filters in Exercise > Stages for Shortlisting and Selection Days (just in case SETs want to view only those candidates who have completed applications)
[ ] Digital Platform. In onApplicationUpdate send an email when a candidate has submitted their full application

I discussed this with Nick last Friday and we agreed that:

[x] Release the changes on admin on 18th Nov.
[ ] Run a script to check how many candidates have submitted the applications for Exercise 203 and update their status to Full Application Submitted on 20th Nov.


Add '@since' Javadoc tag to all agent APIs (issue #864).

This commit also adds a missing Javadoc.
@ubschmidt2 Do you think that the agent classes should have @since tags?  I wasn't sure, but I added them while I was updating the other contrib classes.

Codecov Report

Merging #978 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #978   +/-   ##
=========================================
  Coverage     81.28%   81.28%
  Complexity     1033     1033
=========================================
  Files           173      173
  Lines          4637     4637
  Branches        431      431
=========================================
  Hits           3769     3769
  Misses          762      762
  Partials        106      106

Impacted Files
Coverage Δ
Complexity Δ

...agent/instrumentation/ExecutorInstrumentation.java
84.21% <ø> (ø)
4 <0> (ø)
:arrow_down:

...ain/java/io/opencensus/contrib/agent/Settings.java
88.88% <ø> (ø)
4 <0> (ø)
:arrow_down:

...in/java/io/opencensus/contrib/agent/AgentMain.java
91.3% <ø> (ø)
4 <0> (ø)
:arrow_down:

.../instrumentation/ContextTrampolineInitializer.java
100% <ø> (ø)
2 <0> (ø)
:arrow_down:

...ensus/contrib/agent/bootstrap/TraceTrampoline.java
50% <ø> (ø)
3 <0> (ø)
:arrow_down:

...b/agent/instrumentation/ThreadInstrumentation.java
62.5% <ø> (ø)
3 <0> (ø)
:arrow_down:

...nt/instrumentation/TraceTrampolineInitializer.java
100% <ø> (ø)
2 <0> (ø)
:arrow_down:

...sus/contrib/agent/bootstrap/ContextTrampoline.java
75% <ø> (ø)
5 <0> (ø)
:arrow_down:

...trib/agent/instrumentation/UrlInstrumentation.java
66.66% <ø> (ø)
3 <0> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b848a65...c229685. Read the comment docs.

I'll merge this for now, but we can remove the tags later if they aren't necessary.


update the composition of the governance panel

That was the wrong base apparently. GitHub is still a perplexity. Sigh


No SVG Export

I am unable to export an imported design as SVG. I created an SVG and am using this editor to tweak it. When I go to export the tweaked design (remove extra lines and change line colors) nothing happens and no file is downloaded. Happy to submit my JSON project file for examination

Hi @tobitttt, could you attach your json file here if you do not mind, or you can send the file to dial.liu @provector.app

Diao,
Thank you for responding so quickly! Here is the JSON project file I could
not export as SVG. I hope you'll be able to reproduce the issue. I am using
the latest version of Google Chrome. Keep me in the loop if possible.
TJ Garcia
Design/CEO
@.***
Jack's Plastic Welding
1-(505)-334-8748
www.jpwinc.com
On Mon, Dec 2, 2024 at 11:44 PM Diao Liu @.***> wrote:

Hi @tobitttt https://github.com/tobitttt, could you attach your json
file here if you do not mind, or you can send the file to dial.liu @
provector.app
—
Reply to this email directly, view it on GitHub
https://github.com/diaoliu/provector/issues/16#issuecomment-2513687634,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3VB5T3BQGX26T5PRUOFDRT2DVHMJAVCNFSM6AAAAABS4OZNP2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMJTGY4DONRTGQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi @tobitttt could you send me the json file to my gmail<EMAIL_ADDRESS>I can not find the attachment if you reply me directly from GitHub notification email.


Authorize or import from existing Keybase

I'm on Linux. Recently I changed my laptop. I no longer have the old one, but have a copy of my old disk on my new one. I was logged on Keybase on my old laptop so I should still have everything that is needed to authenticate.
Can I use it to authorize my new laptop?
I tried to copy old_laptop_home_copy/.config/Keybase/ to ~/.config/Keybase, but it's not enough:
> keybase id

▶ ERROR Login required: to identify without specifying a user assertion

> keybase login

Your keybase username: ***
▶ WARNING Failed to reach system keyring (primary store (system keyring): failed to create item: No such interface “org.freedesktop.Secret.Collection” on object at path /org/freedesktop/secrets/collection/login), falling back to secondary store (file-based secret store (see https://keybase.io/docs/crypto/local-key-security)). [tags:ENG=***,LOGIN=***]

The device you are currently using needs to be provisioned.
Which one of your existing devices would you like to use
to provision this new device?

What should I try?

Try keybase -H /path/to/old/home/directory whoami. If that works, you should use keybase -H /path/to/old/home/directory paperkey to generate a new paper key and use it to provision the new device. If that doesn't work, and you have no other devices or paper keys, you may need to reset your account and start over. Either way, when you get back to your account make sure you have a paper key somewhere safe for the next time this happens.

> keybase -H old_laptop/home/nonodedev whoami

▶ ERROR dial unix /home/nonodedev/old_laptop/home/nonodedev/.config/keybase/keybased.sock: connect: no such file or directory

/home/nonodedev/old_laptop is read only because I want to avoid compromising those files. That could be the reason why it's failing.
I believe I should be able to restore everything by creating a new partition, reinstalling my Linux flavor, overwriting it with /home/nonodedev/old_laptop, then booting into it. For this reason I don't want to reset my account... But then I'll be unable to use it until I find the time to work on this.


Background is flashing white on main branch

Bevy version

Main Branch: https://github.com/bevyengine/bevy/commit/fb124c35beb96c7374764aa51517a12a3183c992
Macbook Pro M1 chip WASM Target

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36

I noticed recently the background bevy canvas space is a dark black color instead of the usual dark grey. This coincided with the background also now flashes sometimes randomly.

Video Clip from my twitch stream:
https://clips.twitch.tv/CautiousSnappyYamUnSane--73AoZr5TaYdgtJN

Are you able to bisect this?

Are you able to reproduce on the examples in the repo? Do you have code to share?

@mockersf @alice-i-cecile
After a lot of bad/good commit testing.
I found https://github.com/bevyengine/bevy/commit/35ac1b152ee1b2c7b2930f67d93be0db6f395b47
Is the cause of my pain.
WIth this commit the default background goes black, and will flash randomly.

I can't reproduce using Bevy examples, do you have code to reproduce? Which browser are you using? Is it happening on all of them?

Seems related? https://github.com/bevyengine/bevy/issues/5426

after so much trial and error.. i finally figured out the issue ..
I was calling this function right before I spawned camera. If i spawn the camera before and then call this function, everything works fine it seems.  The reason this was confusing was because this only broke with the commit i ref above https://github.com/bevyengine/bevy/commit/35ac1b152ee1b2c7b2930f67d93be0db6f395b47
For context this was the fn I was calling before spawning the camera:
fn fit_canvas_to_parent() {
    let canvas: HtmlCanvasElement = web_sys::window()
        .unwrap()
        .document()
        .unwrap()
        .query_selector("canvas")
        .unwrap()
        .unwrap()
        .unchecked_into();
    let style = canvas.style();
    style.set_property("width", "100%").unwrap();
    style.set_property("height", "100%").unwrap();
}

Happy to close this or you can leave it open if you think it's a bug to be fixed.

Realized this seems to be a Brave Browser issue.
@mockersf I put example code here that can reproduce the issue on brave browser: https://github.com/miketwenty1/wonder12/tree/fix-flash
I'm wondering if I'm doing something wrong even though it seems other browsers are able to handle rendering correctly.
fwiw, I've been using brave browser since version 0.5 of bevy without seeing inconsistencies between it and chrome.
Otherwise seems I'm going to need to switch to chrome I guess.
Tried running Brave latest didn't help. Release Notes v1.62.156 (Jan 31, 2024)

Seems related? #5426

It's definitely the same behavior to what I'm seeing based off the video.


:grey_question: [Question] Please help going away from ELK "Ingest pipelines" by using Open Search :runner:

:grey_question: Context

We have migrated from ELK to OpenSearch for logs management
Have started to migrate to OpenSearch for data and dashboard projects

:point_up: Still for a new project , the team came to use with a case which seems to be only implemetable with ELK, called Ingest pipelines
They could use this feature to strip multiple indexes on the fly into a new one...thanks to a common key.
To make short, with the folllowing two indices :
Index_1 :

customerId
name

1
My name is John and my phoneNumber is

2
Your name is Bob and my phoneNumber is

Index_2 :

customerId
phone

1
+687 00.00.00

2
+687 12.34.56

Then after operation ingestion (let's call that operator X), then...
Index_3 = Index_1 X Index_2 where Index_3 becomes :

customerId
name
phone

1
My name is John and my phoneNumber is
+687 00.00.00

2
Your name is Bob and my phoneNumber is
+687 12.34.56

:pray: Solution  I would like

Know if this kind of feature is available in Open Search (it not, when)
If the feture exists : how is it called and how can this be achieved

:sweat: Current alternative you've considered
We currently load the data with Logstash into ELK
:information_source:   Additional context
Our main pattern is to :

Consume data from Kafka
Load it into ELK
Perform live aggregation with ELK

:bookmark: Related content

ELK Ingest pipelines
Ping on AWS open source newsletter - 2022 in review

@dlvenable is this something possible with data prepper? or is there another recommendation?

That was my initial idea, but was not sure. Thanks for helping.

@dlvenable  can you share your insight?

Also, I see you are loading from Kafka. Data Prepper currently does not support loading from Kafka, but we do have an open issue: https://github.com/opensearch-project/data-prepper/issues/254. We expect to have this capability in the next couple of months though.

Hi @dlvenable , thank you so much for your valuable help. :pray:
I'll forward these informations to the project team :rocket:


build script not copying all image assets to dist/img

Version
3.0.0
Node and OS info
OS: Windows 10 Enterprise, node v8.11.2, npm 5.6.0
Steps to reproduce

execute vue create vue_cli_issue (choose default template)
add my-image.png to /src/assets
in Home.vue, duplicate img tag and change src attribute to<EMAIL_ADDRESS>execute npm run build

What is expected?
logo.png and my-image.png get renamed with cache-bust hashes and copied to /dist/img
What is actually happening?
only logo.png gets a hash and copied to /dist
if I npm run serve, my additional img tag isn't even being compiled into the template.  only img for logo.png is rendered into the dom

sample repo

The file is too small so it is inlined as base64 string in your javascript.

That's it!


--watch not running without sudo on Ubuntu 1604

The jest --watch is not running, unless I put sudo  before the command. After adding the sudo it works fine, but it adds a jest directory on root which contains some artifacts.
I found this from another project: https://github.com/truetandem/e-QIP-prototype/pull/21/files, it seems that they had same issue.
The same configuration works fine on mac, no sudo needed and no jest directory created.
npm-debug.log:
0 info it worked if it ends with ok
1 verbose cli [ '/home/xin/.nvm/versions/node/v7.5.0/bin/node',
1 verbose cli   '/home/xin/.nvm/versions/node/v7.5.0/bin/npm',
1 verbose cli   'run',
1 verbose cli   'test:jest:watch' ]
2 info using<EMAIL_ADDRESS>3 info using<EMAIL_ADDRESS>4 verbose run-script [ 'pretest:jest:watch',
4 verbose run-script   'test:jest:watch',
4 verbose run-script   'posttest:jest:watch' ]
5 info lifecycle search-desktop-frontend@1.0.34~pretest:jest:watch<EMAIL_ADDRESS>6 silly lifecycle search-desktop-frontend@1.0.34~pretest:jest:watch: no script for pretest:jest:watch, continuing
7 info lifecycle search-desktop-frontend@1.0.34~test:jest:watch<EMAIL_ADDRESS>8 verbose lifecycle search-desktop-frontend@1.0.34~test:jest:watch: unsafe-perm in lifecycle true
9 verbose lifecycle search-desktop-frontend@1.0.34~test:jest:watch: PATH: /home/xin/.nvm/versions/node/v7.5.0/lib/node_modules/npm/bin/node-gyp-bin:/home/xin/work/desktop-frontend/node_modules/.bin:/home/xin/.nvm/versions/node/v7.5.0/bin:/home/xin/.local/share/umake/bin:/home/xin/bin:/home/xin/.local/bin:/home/xin/.local/share/umake/bin:/home/xin/bin:/home/xin/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/snap/bin:/home/xin/.fzf/bin
10 verbose lifecycle search-desktop-frontend@1.0.34~test:jest:watch: CWD: /home/xin/work/desktop-frontend
11 silly lifecycle search-desktop-frontend@1.0.34~test:jest:watch: Args: [ '-c', 'jest --watch' ]
12 silly lifecycle search-desktop-frontend@1.0.34~test:jest:watch: Returned: code: 1  signal: null
13 info lifecycle search-desktop-frontend@1.0.34~test:jest:watch: Failed to exec test:jest:watch script
14 verbose stack Error<EMAIL_ADDRESS>test:jest:watch: `jest --watch`
14 verbose stack Exit status 1
14 verbose stack     at EventEmitter.<anonymous> (/home/xin/.nvm/versions/node/v7.5.0/lib/node_modules/npm/lib/utils/lifecycle.js:279:16)
14 verbose stack     at emitTwo (events.js:106:13)
14 verbose stack     at EventEmitter.emit (events.js:192:7)
14 verbose stack     at ChildProcess.<anonymous> (/home/xin/.nvm/versions/node/v7.5.0/lib/node_modules/npm/lib/utils/spawn.js:40:14)
14 verbose stack     at emitTwo (events.js:106:13)
14 verbose stack     at ChildProcess.emit (events.js:192:7)
14 verbose stack     at maybeClose (internal/child_process.js:890:16)
14 verbose stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:226:5)
15 verbose pkgid<EMAIL_ADDRESS>16 verbose cwd /home/xin/work/desktop-frontend
17 error Linux 4.8.0-44-generic
18 error argv "/home/xin/.nvm/versions/node/v7.5.0/bin/node" "/home/xin/.nvm/versions/node/v7.5.0/bin/npm" "run" "test:jest:watch"
19 error node v7.5.0
20 error npm  v4.1.2
21 error code ELIFECYCLE
22 error<EMAIL_ADDRESS>test:jest:watch: `jest --watch`
22 error Exit status 1
23 error Failed at the<EMAIL_ADDRESS>test:jest:watch script 'jest --watch'.
23 error Make sure you have the latest version of node.js and npm installed.
23 error If you do, this is most likely a problem with the search-desktop-frontend package,
23 error not with npm itself.
23 error Tell the author that this fails on your system:
23 error     jest --watch
23 error You can get information on how to open an issue for this project with:
23 error     npm bugs search-desktop-frontend
23 error Or if that isn't available, you can get their info via:
23 error     npm owner ls search-desktop-frontend
23 error There is likely additional logging output above.
24 verbose exit [ 1, true ]

This projects use Jest v17. Can you tell if this happens on Jest v19?

@thymikee : yes, still happens on v19, that's the version I'm using. And my node version is v6.9.5.

Does it work without --watch? I mean just jest in non watch mode and without sudo

Everything else is fine, even the --coverage works fine. It's the first
time I had this problem.
On Thu, Mar 30, 2017 at 7:18 PM, Rogelio Guzman<EMAIL_ADDRESS>wrote:

Does it work without --watch? I mean just jest in non watch mode and
without sudo
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/facebook/jest/issues/3231#issuecomment-290479957, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AYjDw6hU_ArWjClx1Wssy_BD6iZNHz8qks5rq-PVgaJpZM4MuB-y
.

What happens when you do --no-watchman?

@xin-nie any updates on this?

hi @thymikee it's still happening, so I add the jest to .gitignore as workaround. It might related to my machine configuration, so I will close the issue and let you know with new version of jest.


Add support for reading and producing a report for multiple files in the specified location on local file system

Apologies Yi Li,  was not meant to create these issues for you. :)
Closing now...


tk diff failing when user doesn't have permission to list namespaces

I'm trying out Tanka with a local OKD (OpenShift) cluster, where I do not have permission to list namespaces, and probably some other cluster-level tasks as well (I don't know if this is a general OKD ~limitation~ feature, or specific to our install). As a result tk diff just fails since it tries to list the namespaces first.
) tk --version
tk version v0.10.0-11-g62b18e4

) tk diff environments/default
Error from server (Forbidden): namespaces is forbidden: User "kretzke" cannot list namespaces at the cluster scope: no RBAC policy matched
listing namespaces: exit status 1

I am able to get a single namespace, so that suggests a slightly more cumbersome alternative could be getting each namespace individually.
I did a quick patch to make this a non-fatal error, but will look to make something more robust to properly address this.

Seeing this aswell when running tk apply environments/default
I ran tk env set environments/default --server-from-context <ctx name> before


[REVIEW-ONLY] Fixed python implementation for Apache Apex

This PR includes both stateless + stateful support based on High-Level APIs.

@PramodSSImmaneni  @tushargosavi
This PR includes all changes for python and we can reject earlier PR and move over to this one.

Why are you opening another PR? Keep on working on the existing PR to retain the communication trail.

Also see http://apex.apache.org/contributing.html#opening-pull-requests for how to open PRs.

@patilvikram PRs are updated with changes as they are reviewed, so that there is a single thread to follow the work. If you are not sure how that works after reading the guidelines, please consult other contributors in your office. Close #613 if you wan to continue here, but then please stick with it.

I have merged all changes here to #613  so closing this now.


[Discussion] Move middy into dedicated organisation

What do you think about moving middy to a dedicated middy organisation on GitHub?
I am personally up for it and I can provide few good reasons for it:

An independent organisation might seem more attractive to other contributors and the project could potentially reach a broader adoption (which, as a side effect, will also have a positive impact on Planet 9 in terms of validation and support)
We might use the new middy organisation to host related middy projects (external middlewares, benchmarks, website source, etc.)
We might be encouraged to spend some time even outside Planet 9

As a downside, of course, we might lose the support from Planet 9 which might not want to keep investing (a bit of) our time in developing it.
Let me know your view and vote 👍  or 👎  to this main comment if you are in favour or not to this idea.
CC: @padraigobrien @dkatavic @acambas @peterjcaulfield @techfort @codecrunchers @augeva @daveanderson-ie

i don't know that Planet9 should lose interest in supporting middy when our turnaround time on cards and the quality of our lambdas is improved thanks to it. It's only a matter of ROI, if middy takes 10 hours a month to develop and saves Planet9 20 hours of development manhours, then it's a no brainer.

Thanks for your comment @joe!
I see also @dkatavic gave a :+1:
I'd love to know also what the rest of the crew thinks before moving forward! @padraigobrien @peterjcaulfield @codecrunchers @augeva @daveanderson-ie .
 If we're only guessing that people won't contribute, I'd suggest testing that. Planet9 seems to have a good reputation, so you might find that people want to help our mission.

@daveanderson-ie I invited some developers to have a look (hence why we have some stars in the repo already) and they told me the project looks cool and that they will try to use it.
Nobody explicitly mentioned contribution, but of course this might not necessarily be related with the usage of Planet9 namespace.
Anyway I have been talking with a couple of famous open source developers recently about this issue and they told me that most of the time they prefer to create dedicated organisations (see fastify or Prosemirror).
No mathematical proof from them, but they also feel that it's easier to have the project(s) evolve from shared community efforts this way. This of course doesn't stop companies to keep promoting/sponsoring those projects. Actually it might even lead more companies to be involved in supporting the project (see fastify)

I'm more for moving it to a specific organization because we can use tools to improve it that are free if you are an organization that deals with open source. Tools like greenkeeper, circle ci...

I would be on for moving it to a specific organisation as well

@lmammino i think we have a quorum (Saša, Dom, you, me, Podge).

I would suggest to tackle this at standup tomorrow morning to discuss any possible blocker from @augeva and @daveanderson-ie.
Meanwhile, I already created the org middyjs and I'll start to send invitations to all of you

Moved :)


Thoughts on including react-testing-library in the default template?

Now that React is officially recommending people use react-testing-library, I wonder whether people would be in favor of including it by default. I made a video about what you need to do to add react-testing-library to create-react-app:
https://www.youtube.com/watch?v=Yx-p3irizCQ&list=PLV5CVI1eNcJgCrPH_e6d57KRUTiDZgs0u&t=60s
This commit is me adding the library and setup: https://github.com/kentcdodds/create-react-app-react-testing-library-example/commit/ad467aebee35f2ce040402658d3365c7c1f6335c

Note: In that commit and video I demo how to include jest-dom which I think would be good to include as well, but I have no problem if ya'll would prefer not to include that.

I'd love to see a :+1: if you're in favor and a :-1: if you're not. I promise to not tweet about this issue myself to avoid bringing unfair attention in my favor (though others can feel free to if they want :wink:).

Hey Kent. I think this would fit in nicely with #6270 as a template. What do you think?

I'm not sure what you mean. Are you suggesting this should be included in the -minimal template rather than the default? That seems counter-intuitive. I would assume that "minimal" would be as little as possible to make things work, and the default would have all the extra bells and whistles. Happy to have it included in any form though :)

I'd be fine with that. I don't have time to work on it myself (I was just bringing up the idea). It does make sense that the default template would be very bare bones and people could opt-into things like a testing library and other features via flags. :+1:

Just yesterday, I created a sample app based on create-react-app with react-testing-library just so I could use it "by default" on any new project I create.
Jest by itself is not enough for ui tests. Create-react-app, as an opinionated project, could adopt react-testing-library either by default or by a flag.

The adding as template idea is good, but as @gustavobini says jest is really not enough for react testing and it would make sense to add as a default (because otherwise people will just use enzyme as there is years of articles and docs about it).

I'd like to bring this up again. It's been several months and we've seen a steady growth in the popularity of React Testing Library in that time, especially among newcomers who are desperately wanting to know how to test their apps. I say let's make this the default.

This sounds reasonable to me. I'd love to get some input from someone on the React team. Dan's on vacation. Maybe @bvaughn?

I know that @threepointone has expressed this is something he's interested in as well.


Update storage blob sdk track1 to track2

Uptate storage blob track1 to track2
Change files:
1)tailwindtrader.py
2)requirements.txt
3)setting.py
4)settings.json
5)storage.py:  update storage blob sdk track1 to track2

@jongio for notification.

@isaacrlevin - Can you please review?

thanks @v-xuto and @jongio for the contribution!


Echo Dot - TTS not working

Describe the bug
My Echo Dot 3 is being discovered and I've and I see 7 entities, where some of the entities show as unavailable.

I'm testing TTS using microsoft_say which is working for my Sonos speakers but I just don't get any sound (speech) from my Echo Dot.
I tested it via the Development Tools in HA using the following code:
service: notify.alexa_media
data:
  message: "Hello World"
  target: media_player.stefan_s_echo_dot
  data:
    type: microsoft_say

Expected behavior
TTS is working for my discovered Echo Dot.
System details

Home-assistant (version): 2021.9.7
Hassio (Yes): (Please note you may have to restart hassio 2-3 times to load the latest version of alexapy after an update. This looks like a HA bug).
alexa_media  (version from const.py or HA startup): 3.10.10
alexapy (version from pip show alexapy or HA startup):
I cannot run pip show alexapy on my Home Assistant. pip is not installed. A search for alexypy also didn't find any files with this name.
Amazon 2FA is enabled (y/n). We will not debug login issues if unanswered:

Logs
I've enabled logging in my configuration.yaml as follows, but I don't see any logs I can share.
    custom_components.alexa_media: debug
    # for API debugging (verbose and intended for service debugging)
    alexapy: debug
    # for proxy debugging
    authcaptureproxy: debug

I just tested playing a sound and that works.
service: media_player.play_media target:   device_id: 13b87ed5c28318bb2f153ff5548a99ef data:   media_content_id: amzn_sfx_doorbell_chime_01   media_content_type: sound

I got it working. I had to use notify.alexa_media service instead of the tts.microsoft_say service.


mysql-workbench: 8.0.36 -> 8.0.38

Description of changes
This PR bumps the version of the mysql-workbench package.
Some old patches could be removed, since they have been addressed by upstream.
Another patch file needed to be regenerated, because too much of the surrounding code changed.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 324172 run on x86_64-linux 1

1 package built:

mysql-workbench


When filtering a tree don't hide unresolved folders (#66971)

This PR addresses #66971. When filtering a tree containing folders whose contents have not yet been fully resolved, retain these folders. This allows the user to expand any whose contents they think might match the filter. If after expanding all nested subfolders there are no matches the folder is excluded from the filtered tree.
Below is an example showing filtering the tree-view-sample Explorer tree for json files without previously having expanded the folders.
Before the change:

After the change:

Observe how the folders remain visible despite their names not matching the filter. Expanding src reveals one matching child. Expanding media results in that folder disappearing because it contains no matching children and no subfolders.

/assign @joaomoreno

Thanks for creating the PR. We will have to discuss this as from a UX perspective I think it's still a bit weird that you clicked media for example and it just dissapears

@lramos15 yes, a bit weird and I'll be interested to hear feedback from the UX sync. Perhaps some animation would help (fade, then close up the gap). But I think it's less weird than the current experience of no being able to use tree filtering to locate files in folders you haven't expanded at least once.

Nice job! 100% I hope this gets merged. Honestly the media folder disappearing when opened is a million times better than all folders disappearing when searching. Unless you guys with I expertise have a better idea, please don't let that stop you from merging.

I like the approach, and I agree with @ADTC: it's better than today.
I don't think the implementation is correct. The situation in which "a node has not yet been resolved" only happens in AsyncDataTree instances. It doesn't make sense to pollute the IndexTreeModel with unnecessary information. I'd like to see a fix around AsyncDataTree and, very possibly, AbstractTree.

The fix should be purely around AsyncDataTree and, possibly, AbstractTree.

I just submitted #167074 as an attempt to do this. It works, but a critical line of my change produces two TS compile errors. I need guidance about how to resolve these.

Closing in favor of https://github.com/microsoft/vscode/pull/167047


Remove MobileMiner References

MobileMiner was quite frankly amazing, and many of us have managed to jerry-rig our own versions to replace it.
But can we please finally update the main Git and remove all references to it?
I feel as if we're trying to sell a car with only three rubber wheels and one made out of cardboard by still advertising MobileMiner.  (Yes, you may read into my statement.)

@Raginglikeaboss references have been removed from the software in the latest release. Let me know where else you are seeing links and I'll get them removed.


[Sunstone] Virtual Routers Instances & Templates Tab

Description
Redesign and implement Virtual Routers Instances & Templates in FireEdge Sunstone.
Related to #5422
Tasks

Don't allow attach nics as alias as it is not supported by the core.

Progress Status

[ ] Code committed
[ ] Testing - QA
[ ] Documentation (Release notes - resolved issues, compatibility, known issues)

Add parameters from #6441

Missing separate one-6.8 PR (code + docs)


need to change the html test suite link href on the readme

still points to my repo (sorry about that) ~ should point to
https://rawgit.com/aliirz/kinwin.js/master/test/suite.html

Fixed in 955ee1476a676150c725a8fbcbf8592bce967033


Excel Validation reporting 0 errors on invalid document

Is this a:

[X] Issue with the OpenXml library

Description
Invalid Excel document that shows error message "We found a problems with some content...." while opening using Microsoft Excel 2019 is reported as valid by Open XML SDK Validator.
Information

.NET Target: .NET Core 3.1
DocumentFormat.OpenXml Version:  (2.10.1)

Repro
Create a Cell with string value and data type set to Number.
Validate the created excel using OpenXmlValidator return no errors.
Expected
The validation results contain errors.

@MoamenMohamed93 can you please share repro code for this problem? It is possible to create OpenXML packages that are not accepted by Word, PowerPoint and Excel but which look "valid".  Please share the code.

@tomjebo  Here you are https://github.com/MoamenMohamed93/ExcelValidationTest
Yes it looks as a valid xml, Is there any way I can check if a package is valid?

@MoamenMohamed93 I think the problem is just that the code you're using is setting the cell value DataType to "Number" when the content is a string. I changed it to this:
               sheetData.AppendChild(new Row(new Cell()                 {                     CellValue = new CellValue("StringValue"),                     DataType = CellValues.String                 }));
And this works just fine.
As far as validation, I don't think we check for this as it would require checking the content (CellValue) and represents more of a semantic validation.

As far as validation, I don't think we check for this as it would require checking the content (CellValue) and represents more of a semantic validation.

@tomjebo And there is no way to do the same semantic validation like what excel does?

@MoamenMohamed93 we could add this as a feature request. But I believe validation is schema validation in the current code. If there is semantic or other validation in our code (and there might be) it's likely added ad-hoc.

There is semantic validation, and I've done a bunch of work to make it easier to extend. We can potentially add this. We'll keep it as enhancement. I won't have time to address this for a while, but @MoamenMohamed93  if you want to take a look, feel free :)

A little late to this party but my 2 cents on this issue if anyone is interested:
There seems to be a disconnect with validation between the SDK and Microsoft Office ever since 2.0 of the SDK.  I've seen documents that passed sdk validation that Microsoft Office would not even open and documents that MS Office wouldn't have problems with that the SDK would have multiple failures on.  I always assumed the reasoning for this is because these items are checking two different topics, the SDK checking the XML content against the openxml sdk documented schema and MS Office checking for invalid file settings.  A prime example of this would be a worksheet row object (row 1) containing 5 cell objects with the cell reference all set to "A1".  I've seen this scenario where the document passed the open xml sdk validator but Excel wanted nothing to do with the file, for obvious reasons.
It would be nice to check for the things that MS Office checks for when opening documents but I fear that would be very difficult to accomplish.  However, I do feel that there is an opportunity to check for simple items, like an invalid cell data type and duplicate cell references within a row element. And if my assumption above is correct regarding the SDK validator, then this sort of check would be a new testing class within this project or a separate project altogether.

Yes, this is something that we could add and makes sense. Let's have this issue track cell value types. Feel free to open issues for other things the validator should handle.

If anyone is interested, here is a potential way to handle it (purely POC haven't actually tried it).

First would be to add a method to OpenXmlElement:

public class OpenXmlElement
{
  internal virtual void Validate(ValidationContext context)
  {
  }
}

Add a call to that in the validator around here:

https://github.com/OfficeDev/Open-XML-SDK/blob/3cb921efb711169c259f756171959d1281fb98dc/src/DocumentFormat.OpenXml/Validation/Schema/SchemaTypeValidator.cs#L45-L50
theElement.Validate(validationContext);

Implement logic for the CellValue type to check for correct states.

Not sure if that's the best way to do it, but should point anyone interested in exploring that in the right direction.

Added in #782


feat(slice): add Reverse

What?
add Reverse to the slice collection
this PR uses the code added on #95, so we have to merge that one first
Why?
because I want to reverse stuff
How?
using the generic function

Codecov Report
Patch coverage: 100.00% and no project coverage change.

Comparison is base (9d9fb07) 98.18% compared to head (1f7e83b) 98.19%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@           Coverage Diff           @@
##             main      #96   +/-   ##
=======================================
  Coverage   98.18%   98.19%
=======================================
  Files           7        7
  Lines        1103     1107    +4
=======================================
+ Hits         1083     1087    +4
  Misses         14       14
  Partials        6        6

Impacted Files
Coverage Δ

slice/collection.go
100.00% <100.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


id_open random_flight.ino broadcasting on a different wifi channel

I see in id_open.h, that WIFI_CHANNEL is set to 6. Is it possible to change this channel to any other channel in the 2.4 GHz band (specifically, any channel between 1 and 11)?

I assume you are asking about Wi-Fi Beacon, since Wi-Fi NaN must always be on channel 6 or 149.
I will let someone else comment on the functionality of the code but both the ASTM F3411-22a and the ASD-STAN FprEN_4709-002:2021 standards define that if you use channel 6 or channel 149 (in the 5GHz band) for Wi-Fi Beacon transmission, the messages must be sent at least once per second (or per third second for some message types, but since you have to use message packs for Wi-Fi Beacon, those message types effectively end up being transmitted also once per second).
If you use any other channel in the 2.4 GHz or the 5 GHz bands, the message transmit interval must be less than 200 TU (Time Unit, 1 TU = 1024 microsecond). The reason is to increase the chance that a receiver picks up the messages. For channel 6 the receiver only needs to scan a single channel but if any other channel is used, the receiver needs to cycle through all channels and can only listen on each one for a limited time.

Hi, thank you so much for the response, that makes a lot of sense. Can anyone still comment on the functionality of the code? I'm using the transmitter in order to test a receiver that I'm working on, that ideally can receive on any channel.

Is it possible to change this channel to any other channel in the 2.4 GHz band (specifically, any channel between 1 and 11)?

You can change it to whatever you want, but as Soren says, if you move away from 6, you should increase the rate (change BEACON_INTERVAL).
If you are going to be using an Android phone as a receiver, it's probably worth increasing the rate anyway. I've played around with the rate a bit over the last couple of years, IIRC the current default in the code is higher than the standard requires.

Thank you!


Add Helm and Docker packaging

:tada: This PR is included in version 8.4.0 :tada:
The release is available on:

8.4.0
GitHub release

Your semantic-release bot :package::rocket:


Readable code / html injection

Thanks for the code.
I managed to make something based on your code. Maybe its a good thing to rewrite some nice functions to get profile picture's / status, without direct injection in the dom..
https://github.com/zoutepopcorn/whatsfoto

Thank you but I won't refactor the code since this is a PoC and not some kind of supported piece of production ready software.


Dynamically detect non-time dims in regrid

Fixes failing distributed regrid regional writes to zarr store when input data has variable that is not "lat" or "lon" and does not depend on "time" dim. The error appears because all data regionally written to the zarr needs to depend on "time". The solution is to dynamically figure out which variables do or do not depend on time. Previously, this depended on a static, user-provided list of variables to exclude.
close #494

Potential alternative to https://github.com/ClimateImpactLab/dodola/pull/177

A test run of this change, using the data from #494 is here: https://argo.cildc6.org/workflows/default/distributed-regrid-dev-27wlw

Thanks for this alternative @brews, I will take a look in a bit !


fix(dashboard): allowed roles

The previous Roles section is renamed to Allowed Roles which is different from roles in general. Allowed roles are a subset of roles.

Codecov Report

Merging #1546 (8e8f6fd) into main (f34702f) will not change coverage.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@           Coverage Diff           @@
##             main    #1546   +/-   ##
=======================================
  Coverage   85.97%   85.97%
=======================================
  Files          83       83
  Lines        9236     9236
  Branches      516      516
=======================================
  Hits         7941     7941
  Misses       1295     1295

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Update Project.toml

Testing bump in Pardiso to avoid issues with versions

I tested locally on my M1 Mac that this solution works


The type declarations don't seem to be up to date with the actual implementation.

For example, the method add is implemented as
 add(other, options = { adjacent: false }) {
   ...
}

but the type declaration is add(other: DateRange): ?DateRange; for flow and add(other: DateRange): DateRange | undefined; for typescript – both missing the options parameter.
Maybe just use the declarations from @types/moment-range?

Also typings don't allow calling moment.range() w/o arguments

This is fixed in4.0.2 and will be published on Monday :)


HfAPI().create_inference_endpoint errors and does not follow documentation

Describe the bug
Using hf_api.create_inference_endpoint with configuration in documentation raises error.
https://huggingface.co/docs/huggingface_hub/en/package_reference/hf_api#huggingface_hub.HfApi.create_inference_endpoint.task
Instance types appear different in the available vendors too:
https://api.endpoints.huggingface.cloud/v2/provider
https://huggingface.co/docs/inference-endpoints/en/pricing
Terminology in vendor list does not match the API:
Eg. instanceSize  "small" != "x1"
Reproduction
from huggingface_hub import HfApi
api = HfApi()
create_inference_endpoint(
    "my-endpoint-name",
    repository="gpt2",
    framework="pytorch",
    task="text-generation",
    accelerator="cpu",
    vendor="aws",
    region="us-east-1",
    type="protected",
    instance_size="medium",
    instance_type="c6i",
)

Bad request:
400: Instance compute 'Cpu' - 'c6i' - 'medium' in 'aws' - 'us-east-1' not found

Logs
Traceback (most recent call last):
  File "/home/sim/.cache/pypoetry/virtualenvs/env-Nnk0OfKl-py3.10/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 358, in hf_raise_for_status
    raise BadRequestError(message, response=response) from e
huggingface_hub.utils._errors.BadRequestError:  (Request ID: cX-WLr)

Bad request:
400: Instance compute 'Cpu' - 'c6i' - 'medium' in 'aws' - 'us-east-1' not found

System info
- huggingface_hub version: 0.23.0
- Platform: Linux-6.8.0-76060800daily20240311-generic-x86_64-with-glibc2.35
- Python version: 3.10.13
- Running in iPython ?: No
- Running in notebook ?: No
- Running in Google Colab ?: No
- Token path ?: /home/sim/.cache/huggingface/token
- Has saved token ?: True
- Who am I ?: simkennedy
- Configured git credential helpers:
- FastAI: N/A
- Tensorflow: N/A
- Torch: 2.2.1
- Jinja2: 3.1.3
- Graphviz: N/A
- keras: N/A
- Pydot: 2.0.0
- Pillow: 10.2.0
- hf_transfer: N/A
- gradio: N/A
- tensorboard: N/A
- numpy: 1.23.5
- pydantic: 2.6.4
- aiohttp: 3.9.3
- ENDPOINT: https://huggingface.co
- HF_HUB_CACHE: /home/sim/.cache/huggingface/hub
- HF_ASSETS_CACHE: /home/sim/.cache/huggingface/assets
- HF_TOKEN_PATH: /home/sim/.cache/huggingface/token
- HF_HUB_OFFLINE: False
- HF_HUB_DISABLE_TELEMETRY: False
- HF_HUB_DISABLE_PROGRESS_BARS: None
- HF_HUB_DISABLE_SYMLINKS_WARNING: False
- HF_HUB_DISABLE_EXPERIMENTAL_WARNING: False
- HF_HUB_DISABLE_IMPLICIT_TOKEN: False
- HF_HUB_ENABLE_HF_TRANSFER: False
- HF_HUB_ETAG_TIMEOUT: 10
- HF_HUB_DOWNLOAD_TIMEOUT: 10

The naming was adjust. pinging @co42 here.

The naming here should be correct: https://huggingface.co/docs/inference-endpoints/pricing
can you try intel-icl and x4?

The Google example works. My mistake was the vendor name: "gcp", not "google" :)
The blog post example works when changed to:
    instance_type="nvidia-a100",
    instance_size="x2",

https://github.com/huggingface/blog/pull/2073

Thanks everyone for reporting/fixing this! Just to be sure, is there still something to fix on huggingface_hub's doc side or all good now?

Closing it now :) Just let me know if something remains unclear.


#frequencies for non-category vector should be consistent with that of category vector

For category:
2.2.1 :015 > v = Daru::Vector.new [1,2,2,1,3,4,2,3], type: :category
 => #<Daru::Vector(8):cataegory>
   0   1
   1   2
   2   2
   3   1
   4   3
   5   4
   6   2
   7   3
2.2.1 :016 > v.frequencies
 => #<Daru::Vector(4)>
   1   2
   2   3
   3   2
   4   1

For non-category:
2.2.1 :017 > a = Daru::Vector.new [1,2,2,1,3,4,2,3]
 => #<Daru::Vector(8)>
   0   1
   1   2
   2   2
   3   1
   4   3
   5   4
   6   2
   7   3
2.2.1 :018 > a.frequencies
 => {1=>2, 2=>3, 3=>2, 4=>1}

The #frequencies for non-category vectors should work in a similar manner as that for category vectors and both should be able to accept a :hash argument that will let them return a Hash containing the frequencies.

Can we skip the :hash argument because I one can always simply chain to_h at the end?

Ok works. Don't have the :hash argument. But don't change any current behavior for category vectors, though.


EXC_BAD_ACCESS: Attempted to dereference garbage pointer

Environment
System:
OS: macOS 10.15.7
CPU: (16) x64 Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
Memory: 1.61 GB / 32.00 GB
Shell: 5.7.1 - /bin/zsh
Binaries:
Node: 14.4.0 - /usr/local/bin/node
Yarn: 1.22.4 - /usr/local/bin/yarn
npm: 6.14.4 - /usr/local/bin/npm
Watchman: 4.9.0 - /usr/local/bin/watchman
Managers:
CocoaPods: 1.9.3 - /usr/local/bin/pod
SDKs:
iOS SDK:
Platforms: iOS 14.2, DriverKit 20.0, macOS 11.0, tvOS 14.2, watchOS 7.1
Android SDK:
API Levels: 28, 29, 30
Build Tools: 28.0.3, 29.0.2, 30.0.0
System Images: android-28 | Intel x86 Atom_64
Android NDK: Not Found
IDEs:
Android Studio: 4.0 AI-193.69<IP_ADDRESS>14223
Xcode: 12.2/12B45b - /usr/bin/xcodebuild
Languages:
Java: 1.8.0_252 - /usr/bin/javac
Python: 2.7.16 - /usr/bin/python
npmPackages:
@react-native-community/cli: Not Found
react: 16.13.1 => 16.13.1
react-native: 0.63.2 => 0.63.2
Platforms
iOS
Versions

iOS: 14.2
react-native-netinfo: "^5.9.6"
react-native: "0.63.2"
react: "16.13.1"

Description
I encountered this bug pointed out by bugsnag, I saw a closed issue about it, and I somehow managed to reproduce it consistently so I'm creating this issue.
I use react-navigation v5.
I have a screen where I use
    NetInfo.fetch().then(async (state) => {
      // 4G handling
      if (state.type !== 'wifi') {
        ...
      }
    });

Let's say I'm on WiFi, I navigate to this screen, navigate back, switch to 4G, navigate again to this screen and here it crashes.
If you go directly to this screen on WiFi or even on 4G no problem, but if you navigate back, change the state and navigate again, it crashes.
It also crashes the other way around if you are originally on 4G and switch to WiFi.
Any idea?

Thanks for reporting this, however, the crash does not indicate that this library is at fault.
If you do think this is the case then please provide a Minimal, Reproducible Example. These allow us to understand what the issue is and easily test any fixes which are made.
I am closing this issue, but please resubmit it with a full example and we will be happy to help.


container-loader: TS5 fix

Workaround an instance where TS5's more sophisticated assertion analysis coerces a type to never.

Thanks, @Abe27342 !