Add total field to get-tasks route

Pull Request
Related issue
Fixes #504
What does this PR do?

Adds total field to get-tasks route

PR checklist
Please check if your PR fulfills the following requirements:

[x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
[x] Have you read the contributing guidelines?
[x] Have you made sure that the title is accurate and descriptive of the changes?

Thank you so much for contributing to Meilisearch!

Regarding unit tests, since other tests enqueue tasks, the total returned from the API will be different each time. Adding a >=0 assertion seemed counter-intuitive since total will default to 0 as it is an unsigned int.
I was thinking of calling the delete-tasks API before running this test, but it may not work since the test runs are concurrent. Please let me know if any unit test can be added for this. Thanks!

bors merge

bors merge


auto-scale experiment plan

Fixed #395
Fixed #413

just found kube-dashboard has cpu and memory usage chart, that might be used in our report

Discussed with @putcn today, perhaps we need:

Check in all code for the experiment (easy for other people outside of PaddlePaddle team to reproduce an easy for us to reproduce in the future).
Collect time series data for plotting graph (e.g, cluster utilization v.s time).

@helinwang
Completely agree! Easy to reproduce the experiment is important.


Returning tasks with status other than COMPLETED and AVAILABLE

This is developed in accordance with the task to add the missed updates of a task to logs collection.
All the tasks which are not either COMPLETED or AVAILABLE will require bi-weekly updates (Wednesday and Saturday). Failing to do so will add an missed updates document to our logs collection.
In this PR, we have introduced a new possible value for status query param, NOT_COMPLETED.
To get this response the URL will be as follows: /tasks?status=NOT_COMPLETED&dev=true
This endpoint is currently behind the dev flag.
This endpoint is also paginated so we can also pass the size parameter to get the desired number of records
or, we can pass the page.

please include tests, demo without these cant review your PR

This not a new functionality, just trying to fix the existing one. The tests for this have already been written. You can see the stats and everything in that PR


[SPARK-34556][SQL][3.0] Checking duplicate static partition columns should respect case sensitive conf

What changes were proposed in this pull request?
Backport #31669 to branch-3.0. Add a new test in DDLParserSuite.scala since SQLInsertTestSuite.scala doesn't exist in branch-3.0.

Test build #135679 has started for PR 31714 at commit bf244b6.

Merged to branch-3.0.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40261/

Test build #135679 has finished for PR 31714 at commit bf244b6.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135679/


Check for exceptions and request failures

This is a quick attempt in solving #896
https://playwright.dev/python/docs/api/class-page#page-event-page-error
Reading exceptions from the console log is not done yet, and seems a bit tricky, see here:
https://stackoverflow.com/questions/76213013/playwright-page-onpageerror-exception-does-not-capture-console-error
Basics

[x] I added a line to changelog.md
[x] The PR is rebased with current master.

[x] References to issues, e.g. close #X, are in the commit messages and changelog.
[ ] The buildserver is happy.

Checklist

[ ] I have installed and I am using pre-commit hooks
[ ] I fully described what my PR does in the documentation
[ ] I fixed all affected documentation
[ ] I fixed the introduction tour
[ ] I wrote migrations in a way that they are compatible with already present data
[ ] I fixed all affected decisions
[ ] I added automated tests or a manual test protocol
[ ] I added code comments, logging, and assertions as appropriate
[ ] I translated all strings visible to the user
[ ] I mentioned every code or binary not directly written or done by me in reuse syntax
[ ] I created left-over issues for things that are still to be done
[ ] Code is conforming to our Architecture
[ ] Code is conforming to our Guidelines
[ ] Code is consistent to our Design Decisions
[ ] Exceptions to any guidelines are documented

Review

[ ] I've tested the code
[ ] I've read through the whole code
[ ] I've read through the whole documentation
[ ] I've checked conformity to guidelines

@4ydan I think this has highest priority. The issue doesn't seem to be connected?


Gateway API: support backend appProtocol

(This is used to request new product features, please visit https://discuss.istio.io for questions on using Istio)
Describe the feature request
Gateway API v1 has an experimental feature for specifying the backend protocol - ref. https://github.com/kubernetes-sigs/gateway-api/pull/1979
Describe alternatives you've considered
N/A
Affected product area (please put an X in all that apply)
[ ] Ambient
[ ] Docs
[ ] Dual Stack
[ ] Installation
[x] Networking
[ ] Performance and Scalability
[ ] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
Affected features (please put an X in all that apply)
[ ] Multi Cluster
[ ] Virtual Machine
[ ] Multi Control Plane
Additional context
There are two upstream conformance tests to test gateway support for HTTP/2 Prior knowledge and websocket backend support.
h2c https://github.com/kubernetes-sigs/gateway-api/pull/2456
websocket - https://github.com/kubernetes-sigs/gateway-api/pull/2495

Is there some place we are not doing this? AFAIK Istio has done this since day 0

Perhaps the ask is specific to the kubernetes.io/* protocols? I think there was already a PR submitted for that though

Nice I opened an issue since I didn't know.  Maybe we should leave this issue open so that Istio opt's into the following experimental features when running Gateway API conformance.
SupportHTTPRouteBackendProtocolH2C and SupportHTTPRouteBackendProtocolWebSocket
https://github.com/kubernetes-sigs/gateway-api/blob/ee42a6d5d81283d9f41a85627b93e4492b876638/conformance/utils/suite/features.go#L137-L142
But I'll leave it up to you how you want to track that. thanks

Definitely should turn those on and make sure they work. Thanks!
On Thu, Oct 26, 2023 at 4:38 PM Dave Protasowski @.***>
wrote:

Nice I opened an issue since I didn't know. Maybe we should leave this
issue open so that Istio opt's into the following experimental features
when running Gateway API conformance.
SupportHTTPRouteBackendProtocolH2C and
SupportHTTPRouteBackendProtocolWebSocket
https://github.com/kubernetes-sigs/gateway-api/blob/ee42a6d5d81283d9f41a85627b93e4492b876638/conformance/utils/suite/features.go#L137-L142
But I'll leave it up to you how you want to track that. thanks
—
Reply to this email directly, view it on GitHub
https://github.com/istio/istio/issues/47610#issuecomment-1782075805, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAEYGXPQBWIYAQUGNBY66ATYBLYARAVCNFSM6AAAAAA6RXGHV2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTOOBSGA3TKOBQGU
.
You are receiving this because you commented.Message ID:
@.***>

seems great.


infra: add ossf scorecard workflow and badge

Issue #, if available:
Description of changes:
Add in a scorecard to be more transparent around project standards and best practices. From https://github.com/ossf/scorecard.
This will give better goal setting around making changes that help with the score and security of the SDK.
Testing done:
Merge Checklist
Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.
General

[ ] I have read the CONTRIBUTING doc
[ ] I used the commit message format described in CONTRIBUTING
[ ] I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

[ ] I have added tests that prove my fix is effective or that my feature works (if appropriate)
[ ] I have checked that my tests are not configured for a specific region or account (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Revisiting at a later date.


Metadata discovery

Part of https://github.com/istio/istio/issues/41527.
Proxy receives metadata out-of-band instead of on the wire. This has major advantages:

interop between any mTLS with telemetry
interop with xDS planes, without custom LB programming
improved latency/bandwidth, with less bytes on the network

Implementation:

re-use ambient workload discovery in on-demand delta-mode.
async telemetry reporting in native stats filter, delay metrics push until metadata is in the proxy cache.
this will not be implemented for Wasm filters, due to limitations.
implement generic async logging in envoy https://github.com/envoyproxy/envoy/issues/10326, for OTel logger.
disable MX filters in istio.
may restrict to TCP first (since it pushes at 5s, no additional telemetry latency added).

cc @aryan16  @zirain @costinm

I think we will need some negotiation (ALPN?) to disable MX for backwards compat with old proxies. Or keep it around for a few releases first

Agree. We don't really support long living old versions of Envoy, apart from the upgrade process (which can force restart the application workloads), so one release is sufficient I think.

That might be the case but its not something we have solidified before; we have not broken data plane version skew support for many years. We regularly have folks upgrading from massive version skews like 1.4 to 1.16 with data plane connectivity.
So - it may be reason to say 1 release (or some X), but if we do we should have a broader discussion since it will be the first time we make that decision. At the version least we official support skipping one version, so it would need to be 2 versions at minimum.

Well if you have to support direct connectivity with Istio 1.4 then clearly the data path can never evolve, so that would be a very unreasonable policy decision :) This would make sense if Istio used standard protocols, but the ALPN/TLS hacks are not used anywhere else, so that bar is not met. There's no problem keeping old MX code around, and the control plane can just program both at the same time.

I am not saying that is the policy, I am saying there is none, so if we want to be the first to break it we will also need to come up with the policy and get approval from a broader group

We have never broken compatibility. This is proposing to break it. We need TOC approval to do so.

Compatibility with what? We're not changing any Istio API (and the only one affected which is Telemetry is not default anyways), this is just an internal mechanism.

Communication between different proxy version. Its not just an internal mechanism since this will have user facing impact on users running Istio v1.old with Istio v1.new.

The communication interface is regular mTLS without MX ALPN token. ALPN specification requires fallback so istio must fallback to the less capable protocol (regular mTLS). gRPC and others interoperate this way since they don't have MX network filter.

We need (if we want full compat) the old clients to actually do MX though, not just fallback, or their telemetry will be broken. We can chose not to do that (and thus change user facing behavior), if we get TOC approval.

Breaking client telemetry never stopped us from declaring protocol support (e.g. it doesn't work for gRPC or HBONE), so it would be inconsistent to hold that as a gate if it wasn't even used as a gate to add a feature. Telemetry was always add-on and never required for protocol support, which is why making changes to the telemetry pipeline is not a compatibility violation. The important telemetry (audit logging) is always server-side and that doesn't use MX.

I appreciate your perspective, but  I am asking you to please have the TOC review the design doc. Its okay if we don't agree on whether that review is needed or not, but the implementation cannot be merged without it.

I agree that TOC needs to review the item: "remove MX support", which I'm sure can be delayed after all Envoy work is done. That's just the icing on the cake, I think the native capability of Envoy to fetch metadata has a greater value outside of this Istio feature.

A few additional requirements:

Recommend this for small/default installations as well as installations using telemetry collectors.
Support graceful degradation with "workload key" as the value;
Define a principled guidance for the "split-brain" control planes (multi-network or multi-cluster setups with disjoint service registries)
Support workload trustworthy workload keys (pod IDs)


ioredis support for redis streams

Does io-redis support this library? I'd like to stream data from redis.
https://www.npmjs.com/package/redis-rstream

@RichardWright Doesn't seems to be a real good choice of library (unactive, unused..). You can totally work with redis-streams (https://redis.io/topics/streams-intro) with ioredis. I am doing so. Maybe I'll put something in public later.

https://github.com/luin/ioredis/pull/1376

@Rossb0b Sorry I never replied, but I'm not talking about redis streams, but a nodejs stream (aka https://nodejs.org/api/stream.html)

@Uzlopak what I'm looking for is a way to stream the contents of a get command using these (https://nodejs.org/api/stream.html).

This seems like a nice thing to have in the lib. I can pick this up


Help with BertTokenizer.from_pretrained

I am having difficulty using BertTokenizer.from_pretrained. This could be related to the fact that I am using pytorch_transformers rather than pytorch_pretrained_bert as my library (I haven't wanted to install the older library), maybe they are functionally different here? Is this something you are happy to look at? BTW if you would like a version of the BERT notebook reconfigured to use the new library I am happy to send it through, its just this one stumps me...
If I use the default suggested  BertTokenizer.from_pretrained(OUTPUT_DIR + 'vocab.txt', do_lower_case=False) in BERT_eval then I get a JSON decoder error, and I believe it could be related to the method expecting the class name as the first parameter, since I get info to this effect:
INFO:pytorch_transformers.tokenization_utils:Model name 'outputs/yelp/vocab.txt' not found in model shortcut name list
(bert-base-uncased, bert-large-uncased, bert-base-cased, bert-large-cased, bert-base-multilingual-uncased,
bert-base-multilingual-cased, bert-base-chinese, bert-base-german-cased, bert-large-uncased-whole-word-masking,
bert-large-cased-whole-word-masking, bert-large-uncased-whole-word-masking-finetuned-squad,
bert-large-cased-whole-word-masking-finetuned-squad, bert-base-cased-finetuned-mrpc).
Assuming 'outputs/yelp/vocab.txt' is a path or url to a directory containing tokenizer files.
INFO:pytorch_transformers.tokenization_utils:loading file outputs/yelp/vocab.txt
INFO:pytorch_transformers.tokenization_utils:loading file outputs/yelp/vocab.txt
INFO:pytorch_transformers.tokenization_utils:loading file outputs/yelp/vocab.txt

The error:
---------------------------------------------------------------------------
JSONDecodeError                           Traceback (most recent call last)
<ipython-input-18-152bb8aa9c91> in <module>
      1 # Load pre-trained model tokenizer (vocabulary)
----> 2 tokenizer = BertTokenizer.from_pretrained(OUTPUT_DIR + 'vocab.txt', do_lower_case=False)  #'bert-base-cased',

G:\Anaconda3\lib\site-packages\pytorch_transformers\tokenization_bert.py in from_pretrained(cls, pretrained_model_name_or_path, *inputs, **kwargs)
    198                 kwargs['do_lower_case'] = True
    199
--> 200         return super(BertTokenizer, cls)._from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
    201
    202

G:\Anaconda3\lib\site-packages\pytorch_transformers\tokenization_utils.py in _from_pretrained(cls, pretrained_model_name_or_path, cache_dir, *inputs, **kwargs)
    232                 kwargs[args_name] = file_path
    233         if special_tokens_map_file is not None:
--> 234             special_tokens_map = json.load(open(special_tokens_map_file, encoding="utf-8"))
    235             for key, value in special_tokens_map.items():
    236                 if key not in kwargs:

G:\Anaconda3\lib\json\__init__.py in load(fp, cls, object_hook, parse_float, parse_int, parse_constant, object_pairs_hook, **kw)
    297         cls=cls, object_hook=object_hook,
    298         parse_float=parse_float, parse_int=parse_int,
--> 299         parse_constant=parse_constant, object_pairs_hook=object_pairs_hook, **kw)
    300
    301

G:\Anaconda3\lib\json\__init__.py in loads(s, encoding, cls, object_hook, parse_float, parse_int, parse_constant, object_pairs_hook, **kw)
    352             parse_int is None and parse_float is None and
    353             parse_constant is None and object_pairs_hook is None and not kw):
--> 354         return _default_decoder.decode(s)
    355     if cls is None:
    356         cls = JSONDecoder

G:\Anaconda3\lib\json\decoder.py in decode(self, s, _w)
    337
    338         """
--> 339         obj, end = self.raw_decode(s, idx=_w(s, 0).end())
    340         end = _w(s, end).end()
    341         if end != len(s):

G:\Anaconda3\lib\json\decoder.py in raw_decode(self, s, idx)
    355             obj, end = self.scan_once(s, idx)
    356         except StopIteration as err:
--> 357             raise JSONDecodeError("Expecting value", s, err.value) from None
    358         return obj, end

JSONDecodeError: Expecting value: line 1 column 2 (char 1)

Maybe its due to something different on Windows????
However, if I supply 'bert-base-cased' as my first parameter, then I get the following INFO (but no error):
INFO:pytorch_transformers.file_utils:https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-cased-vocab.txt not found in cache, downloading to C:\Users\User\AppData\Local\Temp\tmp7ywr01h0
100%|███████████████████████████████████████████████████████████████████████| 213450/213450 [00:00<00:00, 223147.77B/s]
INFO:pytorch_transformers.file_utils:copying C:\Users\User\AppData\Local\Temp\tmp7ywr01h0 to cache at outputs/yelp/vocab.txt\5e8a2b4893d13790ed4150ca1906be5f7a03d6c4ddf62296c383f6db42814db2.e13dbb970cb325137104fb2e5f36fe865f27746c6b526f6352861b1980eb80b1
ERROR:pytorch_transformers.tokenization_utils:Couldn't reach server to download vocabulary.

In this format the function does not seem to understand that I am trying to load a vocab.txt from disk.
The signature for the function in the pytorch_transformers is this:
Signature:
BertTokenizer.from_pretrained(
    pretrained_model_name_or_path,
    *inputs,
    **kwargs,
)
Docstring:
Instantiate a BertTokenizer from pre-trained vocabulary files.

Source:
    @classmethod
    def from_pretrained(cls, pretrained_model_name_or_path, *inputs, **kwargs):
        """ Instantiate a BertTokenizer from pre-trained vocabulary files.
        """
        if pretrained_model_name_or_path in PRETRAINED_POSITIONAL_EMBEDDINGS_SIZES:
            if '-cased' in pretrained_model_name_or_path and kwargs.get('do_lower_case', True):
                logger.warning("The pre-trained model you are loading is a cased model but you have not set "
                               "`do_lower_case` to False. We are setting `do_lower_case=False` for you but "
                               "you may want to check this behavior.")
                kwargs['do_lower_case'] = False
            elif '-cased' not in pretrained_model_name_or_path and not kwargs.get('do_lower_case', True):
                logger.warning("The pre-trained model you are loading is an uncased model but you have set "
                               "`do_lower_case` to False. We are setting `do_lower_case=True` for you "
                               "but you may want to check this behavior.")
                kwargs['do_lower_case'] = True

        return super(BertTokenizer, cls)._from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File:      g:\anaconda3\lib\site-packages\pytorch_transformers\tokenization_bert.py
Type:      method

The updated library does have some differences (see here). When working with the updated version, I just let it download the vocab file since it's a tiny file. E.g:
tokenizer = tokenizer_class.from_pretrained('bert-base-cased')
Loading the model file is the exact same procedure.
config = config_class.from_pretrained('bert-base-cased')
model = model_class.from_pretrained('bert-base-cased')
The classes are BertConfig, BertForSequenceClassification, BertTokenizer
You will also need to modify your training code. To get the loss from the model output in the new library, you'll need something like this.
outputs = model(**inputs)
loss = outputs[0]  # model outputs are always tuples in pytorch-transformers (see doc)
When loading a fine-tuned model, you don't need to compress into tar.gz. You can simply provide the path to the directory containing config.json and pytorch_model.bin.

Thanks @ThilinaRajapakse  - I noticed that the vocab.txt exported by tokenizer.save_vocabulary was identical to the bert-base-cased-vocab.txt file - so just using the default makes sense. But I was surprised, I had thought the vocab would have expanded to include new words found in the Yelp data - I guess this is where Bert might differ in how it handles out of vocab words... But, if you were wanting to load a customized vocab how would you do it?
For loading the model, yes I can see that just supplying the directory is required - it was the vocab loading that I was hung up on...
Regarding training, the other difference is that AdamW must be used instead of BertAdam, in conjunction with a scheduler:
Preparing the optimizer and scheduler
num_warmup_steps = int(WARMUP_PROPORTION * num_train_optimization_steps)
optimizer = AdamW(optimizer_grouped_parameters,
                  lr=LEARNING_RATE,
                  correct_bias=False)  # To reproduce BertAdam specific behavior set correct_bias=False
scheduler = WarmupLinearSchedule(optimizer, warmup_steps=num_warmup_steps, t_total=num_train_optimization_steps)

In the training loop the scheduler.step() comes after the optimizer.step() if using Pytorch 1.1.0 or above, otherwise before it... see https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate

There's a vocabulary class as well that you can use just like the config and the model classes. I think it's BertVocabulary or something similar. I'll check it later and edit this with the correct name.
I do have a working notebook from my research that uses the updated library. I could adapt that one to the yelp dataset but I was unsure whether adding it to this repo would help or whether it would confuse people even more. Maybe I'll write a separate article and a repo for it.

Thanks. Because I've only just come to evaluating Bert I haven't had any experience with the previous class, so I find it confusing to work with approaches that do! So, for me at least, a version that uses the latest approach would be welcome :)


toggle 5th bit to switch between upper and lower case letters

Correction - toggling the 5th (instead of the 6th) bit switches between upper and lower case letters in ascii

When you say "the 5th bit", do you mean "bit 5"? It's confusing because I've always thought "the 1st bit" referred to "bit 0", and "the 2nd bit" referred to "bit 1", and so on. Which is why I wrote "the 6th bit" to refer to "bit 5".
Maybe "the 6th bit" should be changed to "bit 5" in the text. It's more of a standard way to refer to bits, and is more clear. If you want to make that change, I'll happily accept it in. Also, I suppose "the 6th and 7th bits" earlier in the paragraph should be changed to "bits 5 and 6" for the same reason.

Yeah, I meant "bit 5". Perhaps it's worth mentioning that the "1st bit" is usually referred to as "bit 0", to avoid confusing the uninitiated ?

That looks good. Thanks for the pull request!


Guidance on when to install AzureADPreview modules

I am refreshing some Developer laptop installation documentation for a colleague. Previously, I ran  Install-Module -Name AzureADPreview  however, I wonder this is only appropriate If I need the (latest) support for graph API xyz . Can you please advise?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: dbb1fe83-c1b3-3176-4d61-fe4f3ce1d598
Version Independent ID: c89f295b-4f00-c2c0-c75f-75fa50ecda65
Content: Connect to Office 365 PowerShell
Content Source: Enterprise/powershell/connect-to-office-365-powershell.md
Service: o365-administration
GitHub Login: @JoeDavies-MSFT
Microsoft Alias: josephd

@westerdaled Thank you for this inquiry
I am not sure on the answer to this. Let me get this over to the Enterprise team for investigation.
The team will get this prioritized into a sprint plan. Thank you for reporting and making the docs better. Much appreciated.
I made a note to request the team to update this when the work is complete.

@westerdaled Please ask this same question as a comment on this page: https://www.powershellgallery.com/packages/AzureADPreview/<IP_ADDRESS>. The product team for the Azure AD Preview PowerShell module should be able to answer your question. Thanks


Update dependencies to Nomad 0.9

Given the release of Nomad 0.9, this provider should have updated Nomad Golang api dependencies. This is a big task as it basically means a full rewrite of the provider and tests.

Currently being tackled here: https://github.com/acornies/faas-nomad-x


Remove cpe_utils dep from uber_helpers

This cookbook doesn't use any cpe_utils functions, plus cpe_utils is long gone.

Unfortunately we do still use cpe_utils internally because of namespace collisions. Being honest here, I blame how FB handled migrations (they didn't).
I have to close this for now but you all can continue to quasi fork it by removing this stuff for your own internal use.

This is something being tracked internally to fix as well. No ETA as it's a significant amount of work and there are other pressing details to work through within our chef environment.


Do not run EL6 tests against CBS

Follow-up to #33.
Running CBS tests on CentOS 6 is blocked by issues with CBS interaction
– there is no centos-packager package available, and using the koji client directly fails with SSL-related errors.
The first patch here installs the centos-packager package within the run.sh script and only when it will be actually used; this makes it possible to still run tests which do not interact with CBS on CentOS 6.
The second patch then disables generating the appropriate jobs, so only mirrors and buildlogs tests will remain for CentOS 6. As a side effect of how the configuration was regenerated, EOL test are dropped entirely. Note that no change on the Jenkins server was made yet; I will apply the changes after merging. The following commands should bring the Jenkins server up-to-date:
$ cd jenkins
$ ./run.sh clear-eol
$ for scl in $(awk '{print $1;}' <../PackageLists/collections-list-rh-el6); do ./local/bin/jenkins-jobs --config jenkins_jobs.ini delete SCLo-pkg-"${scl}"-rh-C6-{candidate,testing,release}-x86_64; done

I would be glad for another pair of eyes to review those changes; however, I will merge them even if no-one finds the time. I would like to have this resolved till the end of the week (2020-04-24).

Merged via fast-forwarding.


look into printing an autocomplete script

maybe as a separate command to be bundled as well
$ zenodraft-autocomplete
... prints something you can copy paste to your shell's configuration

https://stuff-things.net/2016/05/11/bash-autocompletion/
https://github.com/scop/bash-completion

done in 0.7.0


Microsoft Authenticator: Phone Sign-In Should Be Renamed

I think the Microsoft Authenticator's Phone Sign-In option should be renamed.  The Authenticator can be installed on non-phone devices such as Android tablets and iPads.  Users can easily mistake "phone" for voice.
I propose calling it "Echo Sign-in" because essentially you are echoing what is present on the screen.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 542a9166-8457-dc1d-cfa4-850380480249
Version Independent ID: 685603d9-f03d-8926-97bd-8ae25c80a622
Content: Microsoft Authenticator app authentication method - Azure Active Directory
Content Source: articles/active-directory/authentication/concept-authentication-authenticator-app.md
Service: active-directory
Sub-service: authentication
GitHub Login: @Justinha
Microsoft Alias: justinha

@mcleinweber
Thanks for your feedback! We will investigate and update as appropriate.

@mcleinweber
Thank you for your feedback!
For product feedback/improvement ideas such as this, it's recommended to leverage our User Voice forum since all of the feedback you share in the User Voice forum will be monitored and reviewed by our engineering teams.
Thank you for your time and patience throughout this issue.


[Integrations UI] Add remaining meshery integrations

Description
https://meshery.io/ website features only 80 integrations in contrast to the 150 integrations on the https://layer5.io/ website.
Expected Behavior
All the remaining integrations need to be added to the integrations section on meshery.io website.
Screenshots
Meshery.io website

Layer5 wesbite

Enviroment:

OS: Mac Linux Windows
Browser: Chrome Safari Firefox
Version:
Device: Desktop Mobile

Contributor Guides and Handbook
The meshery.io website uses Jekyll and GitHub Pages. Site content is found under the master branch.

📚 See the Contributing to Meshery.io Website section of the readme.md and other contributing instructions, too.
🎨 Wireframes and designs for Meshery UI in Figma
🙋🏾🙋🏼 Questions: Discussion Forum and Community Slack

@Shivam-AfA So remaining 70 integrations should be added to meshery.io website?
I can take up the issue....

@Savio629 this needs to be done programmatically. The solution here has to do with GitHub Workflow logic. @asubedy will you investigate?

Yeah it seems I just thought that I would have to copy the 70 integrations from layer5.io and add them in meshery.io. Sorry for directly hoping in, instead of exploring the issue a bit more from my side.

I am interested to work on this issue and I have gone through this issue in the CI call. So, can I get assigned to it?

Sure @gopivaibhav. Do consider this:

this needs to be done programmatically (and not by manually adding the integrations. The solution here has to do with GitHub Workflow logic.

@gopivaibhav any updates on this?

@gopivaibhav any updates on this?

The issue is almost done but I guess I need to change the styling as I can't see all the 150 integrations without scrolling in the table format. Please do let me know if this is fine or I will try to change the styling of the page.


[EventRequest] Codeunit 212 ResJnlPostLine.Code() - OnBeforePostTimeSheetDetail

Code snippet showing where to add the new event:
        ...
        ResLedgEntry."User ID" := UserId;
        ResLedgEntry."Entry No." := NextEntryNo;
        ResUOM.Get(ResLedgEntry."Resource No.", ResLedgEntry."Unit of Measure Code");
        if ResUOM."Related to Base Unit of Meas." then
            ResLedgEntry."Quantity (Base)" := ResLedgEntry.Quantity * ResLedgEntry."Qty. per Unit of Measure";

        if ResLedgEntry."Entry Type" = ResLedgEntry."Entry Type"::Usage then begin

            **//START ADD-NEW-CODE +**
            IsHandled := false;
            OnBeforePostTimeSheetDetail(ResJnlLine, IsHandled);
            if not IsHandled then
            **//END ADD-NEW-CODE -**

            PostTimeSheetDetail(ResJnlLine, ResLedgEntry."Quantity (Base)");
            ResLedgEntry.Chargeable := IsChargable(ResJnlLine, ResLedgEntry.Chargeable);
        end;

//START ADD-NEW-INTEGRATIONEVENT +
[IntegrationEvent(false, false)]
local procedure OnBeforePostTimeSheetDetail( var ResJournalLine: Record "Res. Journal Line"; var IsHandled: Boolean)
begin
end;

//END ADD-NEW-INTEGRATIONEVENT -

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.


Add "sideEffects": false to pkg.json

What kind of change does this PR introduce?
Feature/fix
What is the current behavior?
The package is not currently marked as side effect free so tree-shaking will be limited.
What is the new behavior?
Tree-shaking can be done properly.

I didn't see anything that has side effects in the package, but if you know any then this should not be done

Thanks for this @BeeeQueue . I had to have a think about it. I'm fairly certain there are no sideEffects here so I'll merge this and keep tabs of it in our builds

Thanks for this @BeeeQueue . I had to have a think about it. I'm fairly certain there are no sideEffects here so I'll merge this and keep tabs of it in our builds

:tada: This PR is included in version 1.2.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.2.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Memory leak in TangoSDK

When I use Tango3DR_clear it removes data from it but it does not deallocate memory (it is problem for texturing and reconstruction context). Also Tango3DR_ReconstructionContext_destroy does not deallocate it completely.
I did following test with cpp_mesh_builder_example:
-change resolution: Tango3DR_Config_setDouble(t3dr_config, "resolution", 0.005);
-make it scan more far: Tango3DR_Config_setDouble(t3dr_config, "max_depth", 7.5);
-remove mesh extraction (it is too slow for test)
-do measurement when clear button is pressed:
        text += new SimpleDateFormat("yyyy-MM-dd HH:mm:ss").format(new Date()) + ": ";
        ActivityManager.MemoryInfo mem = new ActivityManager.MemoryInfo();
        ActivityManager activityManager = (ActivityManager) getSystemService(ACTIVITY_SERVICE);

        //pause scanning and measure memory
        TangoJNINative.onToggleButtonClicked(false);
        activityManager.getMemoryInfo(mem);
        text += (mem.availMem / 1048576L) + "MB -> ";

        //clear context
        TangoJNINative.onClearButtonClicked();

        //measure memory and resume scanning
        activityManager.getMemoryInfo(mem);
        text += (mem.availMem / 1048576L) + "MB\n";
        TangoJNINative.onToggleButtonClicked(m3drRunning);

        //show result
        MeshBuilderActivity.this.runOnUiThread(new Runnable()
        {
          @Override
          public void run()
          {
            Toast.makeText(MeshBuilderActivity.this, text, Toast.LENGTH_LONG).show();
          }
        });

result:

Thank you for the bug report lvonasek, we are currently looking into it.

Thank you. The problem happens also after calling Tango3DR_TexturingContext_destroy

After update on Tango Ikariotikos memory leaks in Tango3DR_TexturingContext seems to be fixed but the problem with Tango3DR_clear still stays

Issue stays in release m20.


flutter_firestore:  Add a possibility to observe if FireStore is busy

Currently it seems there is no way telling if  FireStore is currently busy retrieving data. If I use a collection snapshot stream to display the collection with a StreamBuilder I have no chance to display a Spinner to signal the user to wait. My Page will stay empty until the data arrives which can take some seconds depending on my network.

@escamoteur You could use something like this
if (snapshots.connectionState == ConnectionState.active) {             return Container();           } else if (snapshots.connectionState == ConnectionState.waiting) {             return Container(child: Center(child: CircularProgressIndicator()));           }

But I need a event when the state changes / or a stream with busy states because otherwise how do I trigger a rebuild?

@escamoteur
This issue has been moved to https://github.com/FirebaseExtended/flutterfire/issues/729. Any further collaboration will be done there.


How to run 2 shared databases?

I've seen that the "Shared" And "Private" keys are set and cannot be changed, therefore I have no idea if one can be added.
 I was just thinking that this might not be possible right now.
Sorry if I'm spamming you over here!
    "shared": {
        "uri": "",
        "auth": {
            "username": "",
            "password": "",
            "passphrase": ""
        },
        "path": "Collabs/"
    }

Would be nice if I could add another "shared" and another "private". This way there could be some kind of user database structure I could create.
Thanks again for the amazing changes right now, I'm loving it!

I'm really sorry for naming the entries... I made an excuse.

// "private" and "shared" don't mean which is primary or not.
// They are even. But I made so many misconfigurations while debugging
// with the names "database_a" and "database_b",
// so it was just named as like this.

I thought, synchronize multiple vaults using multiple processes.
But you're right. It usually is used with multiple pairs of vaults.
It should be the default feature. So I implemented.

I didn't get any bugs when trying out the new version, believe me I tried :D


Problem with SST plot using v0.4 data

@tangq provided me some v0.4 climatology data for comparison to v1. The data is under
/global/cscratch1/sd/tang30/ACME_simulations/B1850C5_ne30_v0.4/pp/clim_rgr/0178-0197
The SST plot from ACM Diags does not look right. The masking of model data is not working properly and the RMSE is way off: 6.37 when it should be near 1.

It looks to me like you don’t have the updated HADISSTs
Jerry
Gerald L. (Jerry) Potter Ph.D.
Data and Analysis Consultant
Phone:<PHONE_NUMBER>
email<EMAIL_ADDRESS>
On Sep 29, 2017, at 2:14 PM, golaz<EMAIL_ADDRESS>wrote:
@tangq https://github.com/tangq provided me some v0.4 climatology data for comparison to v1. The data is under
/global/cscratch1/sd/tang30/ACME_simulations/B1850C5_ne30_v0.4/pp/clim_rgr/0178-0197
The SST plot from ACM Diags does not look right. The masking of model data is not working properly and the RMSE is way off: 6.37 when it should be near 1.
https://user-images.githubusercontent.com/15743046/31036236-28c6fcce-a520-11e7-99b2-1c44d6cb179e.png
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/ACME-Climate/acme_diags/issues/94, or mute the thread https://github.com/notifications/unsubscribe-auth/ANjM_L7O5lge-f6XgfuzveOoE0SfAlREks5snV2agaJpZM4PpPcz.

the masking is not functioning correctly for v0.4 data somehow. Min SST is -273.15. it's problematic. I will have to look at the data.

It’s probably something I did. I’ll  fix it by Monday
Sent from my iPad

On Sep 29, 2017, at 9:20 PM, Jill Chengzhu Zhang<EMAIL_ADDRESS>wrote:
the masking is not functioning correctly for v0.4 data somehow. Min SST is -273.15. it's problematic. I will have to look at the data.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

This is a plot of the ANN HADSST from the corrected HADSST. I though this data was in the new reference data. Apparently not. It is located in:
/space1/test_data/acme_diags_observations

@glpotter  Hey Jerry, no worries. I just moved the new SST data with correct sea ice mask to both ACME1 and Nersc. The problem is for the model plot not obs.  The mask did apply correctly to v0.4 model data.

Checked 0.4 model data. The problem is that it has both TS and SST as outputs. And SST is problematic. Note that minimum SST is 0 K

Solution: https://github.com/ACME-Climate/acme_diags/commit/8f954aaca7cd8e213efc35a1170d5ff79dcd0b26
Changed the order of entries for derived variable 'SST' to accommodate bad old SST output: put masked 'TS' before 'SST'
@golaz Please let me know if this works..

I fixed this.


Migrate to null safety

Migrate to null safety
closes #4

Hello, @prasadsunny1 ✋🏻
Thank you so much for taking part in the development of this package 🤝
Your changes will be available soon in a new package update on pub.dev


[tool_crash] _CastError: (#0      GradleWrapper.updateInner (package:flutter_tools/src/flutter_cache.dart:545:49))

Command
flutter --no-color pub get

Steps to Reproduce

...
...
...

Logs
_CastError: (#0      GradleWrapper.updateInner (package:flutter_tools/src/flutter_cache.dart:545:49))
#0      GradleWrapper.updateInner (package:flutter_tools/src/flutter_cache.dart:545:49)
#1      CachedArtifact.update (package:flutter_tools/src/cache.dart:812:11)
#2      Cache.updateAll (package:flutter_tools/src/cache.dart:681:24)
<asynchronous suspension>
#3      FlutterCommand.verifyThenRunCommand (package:flutter_tools/src/runner/flutter_command.dart:1271:7)
<asynchronous suspension>
#4      FlutterCommand.run.<anonymous closure> (package:flutter_tools/src/runner/flutter_command.dart:1161:27)
<asynchronous suspension>
#5      AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:150:19)
<asynchronous suspension>
#6      CommandRunner.runCommand (package:args/command_runner.dart:209:13)
<asynchronous suspension>
#7      FlutterCommandRunner.runCommand.<anonymous closure> (package:flutter_tools/src/runner/flutter_command_runner.dart:281:9)
<asynchronous suspension>
#8      AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:150:19)
<asynchronous suspension>
#9      FlutterCommandRunner.runCommand (package:flutter_tools/src/runner/flutter_command_runner.dart:229:5)
<asynchronous suspension>
#10     run.<anonymous closure>.<anonymous closure> (package:flutter_tools/runner.dart:62:9)
<asynchronous suspension>
#11     AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:150:19)
<asynchronous suspension>
#12     main (package:flutter_tools/executable.dart:94:3)
<asynchronous suspension>

[✓] Flutter (Channel stable, 2.10.3, on Microsoft Windows [Version 10.0.19043.1586], locale ar-SA)
    • Flutter version 2.10.3 at C:\Users\i_ziy\Srs\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 7e9793dee1 (2 weeks ago), 2022-03-02 11:23:12 -0600
    • Engine revision bd539267b4
    • Dart version 2.16.1
    • DevTools version 2.9.2

[✗] Android toolchain - develop for Android devices
    ✗ Unable to locate Android SDK.
      Install Android Studio from: https://developer.android.com/studio/index.html
      On first launch it will assist you in installing the Android SDK components.
      (or visit https://flutter.dev/docs/get-started/install/windows#android-setup for detailed instructions).
      If the Android SDK has been installed to a custom location, please use
      `flutter config --android-sdk` to update to that location.

[✓] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[!] Visual Studio - develop for Windows (Visual Studio Community 2022 17.1.1)
    • Visual Studio at C:\Program Files\Microsoft Visual Studio\2022\Community
    • Visual Studio Community 2022 version 17.1.32228.430
    ✗ Visual Studio is missing necessary components. Please re-run the Visual Studio installer for the "Desktop development with C++" workload, and include these components:
        MSVC v142 - VS 2019 C++ x64/x86 build tools
         - If there are multiple build tool versions available, install the latest
        C++ CMake tools for Windows
        Windows 10 SDK

[✓] Android Studio (version 2021.1)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.11+9-b60-7590822)

[✓] VS Code (version 1.65.2)
    • VS Code at C:\Users\i_ziy\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension can be installed from:
      🔨 https://marketplace.visualstudio.com/items?itemName=Dart-Code.flutter

[✓] Connected device (3 available)
    • Windows (desktop) • windows • windows-x64    • Microsoft Windows [Version 10.0.19043.1586]
    • Chrome (web)      • chrome  • web-javascript • Google Chrome 99.0.4844.74
    • Edge (web)        • edge    • web-javascript • Microsoft Edge 99.0.1150.39

[✓] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 2 categories.

Flutter Application Metadata
Type: app
Version: 1.0.0+1
Material: true
Android X: false
Module: false
Plugin: false
Android package: null
iOS bundle identifier: null
Creation channel: stable
Creation framework version: f4abaa0735eba4dfd8f33f73363911d63931fe03

Duplicate of #100242


When switching back to a database in Navigator, the connection is lost

Starting from 6.2.5 (and still happening in 6.3.0), when switching back to a database that has been accessed before, any query from already opened SQL editor tabs will encounter "not connected to database" error.  This is with Postgresql and the "auto-sync connection with navigator" is selected.
I can switch to a database in the navigator that has not been accessed in the current session of DBeaver and queries would work.  But if I use the navigator to switch back to a previous database accessed in the current session of DBeaver, I would get the error - even though the navigator shows the database as activated.  I have to restart DBeaver to access that database.
Thank you for your help!

Probably I'm doing it wrong. Anyhow - I can't reproduce this problem.
Some screenshot/video would be very helpful.

Thank you very much for looking into this.  I attached a series of screenshots taken in the order of steps to reproduce the issue:
1-SQLEditor-setting.jpg:  shows the SQL Editor setting of auto-sync connection with navigator.
2-access-acme.jpg: shows successful access to the acme database in navigator.  The query worked.
3-access-adirect.jpg: shows successful access to another db after switching to it in navigator.
4-access-acme-again.jpg: shows the connection error when running the same query after switching back to acme db in navigator.
Please let me know if more information is needed.

cannot reproduce it against 7.0.3. If issue is still actual for you - feel free to reopen the ticket


validation rules 'afterField' and 'beforeField' doesn't work

I believe that the following rules are not working:

afterField()
beforeField()
afterOrEqualToField()
beforeOrEqualToField()

I also opened a call on the github discussion. But no answers.
Package version
"@adonisjs/ace": "^6.9.4",
"@adonisjs/core": "5.0.0-preview-rc-1.11",
"@adonisjs/fold": "^6.4.0",
"@adonisjs/lucid": "^8.3.1",

Node.js and npm version
Node: v12.18.2
Npm: 6.14.5
Sample Code (to reproduce the issue)
public schema = schema.create({
  startDate: schema.date({ format: 'yyyy-MM-dd HH:mm:ss', }, [rules.beforeField('endDate')]),
  endDate: schema.date({ format: 'yyyy-MM-dd HH:mm:ss', })
})

BONUS (a sample repo to reproduce the issue)
https://github.com/fnoquiq/adonis-validator-test
Submit this body to http://<IP_ADDRESS>:3333:
{
  "startDate": "2222-02-02 02:02:02",
  "endDate": "2020-01-01 01:01:01"
}

Just remembering the rule being used in the validator:
public schema = schema.create({
  startDate:  [rules.beforeField('endDate')]),
  endDate
})

I came here to open an issue, currently having the same problem:
validator:
{
  first_invoice_reminder: schema.date.optional({}, [rules.after('today')]),
  last_invoice_reminder: schema.date.optional({}, [
  rules.afterField('first_invoice_reminder'),
  ]),
}

request:
{
  "first_invoice_reminder": "2020-08-15T18:00:25.800-03:00",
  "last_invoice_reminder": "2010-09-15T18:00:25.800-03:00",
}

and it is getting validated.


ci(workflow): optimize node CI

PR Checklist

[ ] Unit Tests have been added for new changes
[ ] API tests have been updated if applicable
[ ] All commented code has been removed
[ ] If you've added a dependency, you've ensured license is compatible with Apache 2.0 and clearly outlined the added dependency.

What are you changing?

Anything the reviewer should know when reviewing this PR?
If the there are associated PRs in other repositories, please link them here (i.e. open-amt-cloud-toolkit/repo#365 )

Codecov Report

Merging #492 (22defed) into main (2f0c65c) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head 22defed differs from pull request most recent head 57f9fe9. Consider uploading reports for the commit 57f9fe9 to get more accurate results

@@           Coverage Diff           @@
##             main     #492   +/-   ##
=======================================
  Coverage   65.67%   65.67%
=======================================
  Files          33       33
  Lines        1780     1780
  Branches      258      258
=======================================
  Hits         1169     1169
  Misses        611      611

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2f0c65c...57f9fe9. Read the comment docs.


added superseded to incompatibilities.properties.importance.oneOf

IT SHOULD BE VALID!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

can u not mess up the line endings thanks


TLD > BCP 47 function?

Probably not scope of your package but I am longing for a function to return me a BCP 47 language tag based by a top level domain (TLD).
Have initially reported the need in https://github.com/petert82/country-query/issues/3 but since it seems inactive, and yours comes - after some research - the most close, I wonder why not ask you about that?

Interesting problem! And hi, Michael 👋
First: this should definitely be another project. Maybe you could do a map of TLDs to BCP-47 tags, in JSON, but it should be outside bcp-47.
Second: There are quite some TLDs (generic, test, infrastructure) that do not map to anything related to your problem.
Third: TLDs are for countries (they’re often based on ISO 3166-1). BCP-47 is for languages. Some languages come with some geography information (e.g., en-GB for English as spoken in Greater Britain). But, regions could be added to any language. nl-GB, which would stand for Dutch as spoken  in GB, is valid.
To recap the biggest problem with your question: the .nl TLD (Netherlands), does not say anything about the site being in Dutch. Sites could be (and often are) in English or Frisian. Or anything else really.
Although Dutch is indeed the most common language in The Netherlands, not all regions have a favourite language.

hey dude
thanks for the good feedback. totally agree in all points. let me explain the use case i have here to crack that problem:
on www.videomail.io (try it out), users can enter recipient email addresses. when recipient views the videomail, the sent date is shown but always in the wrong format. hence i am thinking of a tld to bcp 47 converter for better date display. tld is based on the recipient's email address. that new project could be called email-to-bcp47 or tld-to-bcp47 whatever.
totally aware that this isn't entirely accurate (see your dutch example) but it is still better than always displaying the hardcoded date format
thoughts?
(or can i somehow extract the bcp-47 from the browser setting via JS? probably not ...)

I’d suggest using the Date JavaScript object to infer timezones (see moment, moment-timezone), and detecting the language the user prefers (see locale2) instead!
I’d sa it’s a bad idea to do anything with bcp-47, and anyway, it should be a separate package!


Module does not always work

Hello,
It appears that this module can help bypass some of the certificates but it doesn't always work.
For example, it works perfectly when connecting to HPE 3PAR api with self-signed certificated signed by HP but not with Redhat Satellite.
It generates the following error:
PS C:\tmp> Import-Module TunableSSLValidator
PS C:\tmp> [System.Net.ServicePointManager]::SecurityProtocol = [System.Net.SecurityProtocolType]'Ssl3,Tls,Tls11,Tls12'
PS C:\tmp> Invoke-WebRequest -insecure -uri "https://sat01.reducteddomain.com/api/v2/hosts/544/subscriptions"
Server SSL Certificate:
   Server: sat01.reducteddomain.com
  Subject: CN=sat01.reducteddomain.com, OU=SomeOrgUnit, O=Katello, S=North Carolina, C=US
     Hash: 6B8616E14BD36A42EDD7CD3045C8B23E6AAF968B
Effective: 2015/10/06 16:17:42
  Expires: 2035/10/08 16:17:43
   Errors: RemoteCertificateChainErrors
 Rejected: To accept, use Add-SessionTrustedCertificate to map the certificate and hostmask. Use the -LastFailed paramet
er to do it automatically.
Invoke-WebRequest : The underlying connection was closed: Could not establish trust relationship for the SSL/TLS
secure channel.
At line:1 char:1
+ Invoke-WebRequest -insecure -uri "https://sat01.reducteddomain.com/api/v2/hos ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidOperation: (System.Net.HttpWebRequest:HttpWebRequest) [Invoke-WebRequest], WebExc
   eption
    + FullyQualifiedErrorId : WebCmdletWebResponseException,Microsoft.PowerShell.Commands.InvokeWebRequestCommand

Powershell version: 5.1.14409.1018
Can you please help to resolve or to further debug this issue and understand why the behavior is not consistent?

Issue is fixed by adding the following command:
Disable-SSLChainValidation


Komodo

New Analytics

Windows System Binary Proxy Execution Compiled HTML File Decompile

New SSA Analytics

Windows OS Credential Dumping with Ntdsutil Export NTDS (Passed)
Windows OS Credential Dumping with Procdump (Passed)
Windows System Binary Proxy Execution MSIExec DLLRegisterServer (Passed)
Windows System Binary Proxy Execution MSIExec Remote Download (Passed)
Windows System Binary Proxy Execution MSIExec Unregister DLL (Passed)
Windows System Binary Proxy Execution Compiled HTML File Decompile (Passed)
Windows System Binary Proxy Execution Compiled HTML File URL In Command Line (Passed)
Windows System Binary Proxy Execution Compiled HTML File Using InfoTech Storage Handlers (Passed)

Updated:

Windows Ingress Tool Transfer Using Explorer
Windows LOLBin Binary in Non Standard Path
Dump LSASS via procdump

Screencap
HH

ssa___windows_os_credential_dumping_with_ntdsutil_export_ntds.yml
PASSED, 8 anomalies in 8 events

ssa___windows_os_credential_dumping_with_procdump.yml
PASSED, 6 anomalies in 10 events

ssa___windows_system_binary_proxy_execution_compiled_html_file_decompile.yml
PASSED, 3 anomalies in 5 events

ssa___windows_system_binary_proxy_execution_compiled_html_file_url_in_command_line.yml
PASSED, 1 anomaly in 22 events

ssa___windows_system_binary_proxy_execution_compiled_html_file_using_infotech_storage_handlers.yml
PASSED, 3 anomalies in 22 events

ssa___windows_system_binary_proxy_execution_msiexec_dllregisterserver.yml
PASSED, 1 anomaly in 33 events

ssa___windows_system_binary_proxy_execution_msiexec_remote_download.yml
PASSED, 1 anomaly in 33 events

ssa___windows_system_binary_proxy_execution_msiexec_unregister_dll.yml
PASSED, 1 anomaly in 33 events


Choose a minimum denomination of the staking token

This is the analogue of satoshi for BTC, wei for ETH, uATOM for ATOM, etc.
BTC: 1e-8 BTC
ETH: 1e-18 ETH
ATOM: 1e-6 ATOM
Choosing 1e-6 fits with the rest of the Cosmos ecosystem and is probably good enough. 1e-18 seems really excessive.

This was done in #283, the minimum denomination is 1e-6


HTTPCLIENT-2292: fix regression leading to invalid proxy

This seems to have caused a regression in 5.2.2.
java.lang.IllegalArgumentException: Invalid Proxy
    at java.base/java.net.Socket.<init>(Socket.java:216)
    at org.apache.hc.client5.http.ssl.SSLConnectionSocketFactory.createSocket(SSLConnectionSocketFactory.java:208)
    at org.apache.hc.client5.http.impl.io.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:158)
    at org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:447)
    at org.apache.hc.client5.http.impl.classic.InternalExecRuntime.connectEndpoint(InternalExecRuntime.java:162)
    at org.apache.hc.client5.http.impl.classic.InternalExecRuntime.connectEndpoint(InternalExecRuntime.java:172)

When the proxy is undefined or set to null, DefaultHttpClientConnectionOperator does the following:
Timeout soTimeout = socketConfig.getSoTimeout();
SocketAddress socksProxyAddress = socketConfig.getSocksProxyAddress();
Proxy proxy = socksProxyAddress != null ? new Proxy(Type.SOCKS, socksProxyAddress) : null;

The proxy object above is then null, which means the following call:
Socket sock = sf.createSocket(proxy, context);

...will eventually pass down to SSLConnectionSocketFactory which does this:
public Socket createSocket(Proxy proxy, HttpContext context) throws IOException {
    return new Socket(proxy); //this proxy cannot be null
}

I should mention that in the above case,
No SOCKS proxy is ever configured via the PoolingHttpClientConnectionManagerBuilder. setDefaultSocketConfig() method
No  SocketConfig.setSocksProxyAddress(socksaddr) exists and is always null.

Fixed by 6d60624cd3439f81030f7443e72cba21662e5d7b

Thank you!

FWIW, I ran into the same regression. Staying on 5.2.1 for now...

Unfortunately this is still causing issues for projects such as docker-java (see https://github.com/docker-java/docker-java/issues/2290). Currently this bug manifests as a backwards-imcompatible change to projects inheriting from PlainConnectionSocketFactory and SSLConnectionSocketFactory.
I've made an example fix https://github.com/apache/httpcomponents-client/pull/535 to pull the proxy null check higher out


better MemCacheUnit implement

improve the performance fo MemCacheUnit
Description

maintaining the total size to improve the performanece at runtime
make MemCacheUnit composed of OrderDict, not inherited from OrderDict
the default size_limit 0 means unlimit size
provide new methods set_limit and set_limit_size to control limit and size.

Motivation and Context

https://github.com/microsoft/qlib/issues/137#issue-771262875
How Has This Been Tested?

[x] Pass the test by running: pytest qlib/tests/test_all_pipeline.py under upper directory of qlib.
[ ] If you are adding a new feature, test on your own test scripts.

Screenshots of Test Results (if appropriate):

Pipeline test:
Your own tests:

Types of changes

[ ] Fix bugs
[ ] Add new feature
[ ] Update documentation

@hadrianl  It looks awesome!
Thanks so much!


GSD Request

--- GSD JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from v3.8 to before v5.15.6",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=f92363d12359498f9a9960511de1a550f0ec41c2",
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=8485649a7655e791a6e4e9f15b4d30fdae937184"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "f92363d12359498f9a9960511de1a550f0ec41c2",
      "note": "introduced"
    },
    {
      "type": "commit",
      "value": "8485649a7655e791a6e4e9f15b4d30fdae937184",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "scsi: mpt3sas: Fix kernel panic during drive powercycle test\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v5.15.6 by commit 8485649a7655e791a6e4e9f15b4d30fdae937184, it was introduced in version v3.8 by commit f92363d12359498f9a9960511de1a550f0ec41c2. For more details please see the references link."
}
--- GSD JSON ---

This issue has been assigned GSD-2021-1002533


Running claudie on Minikube/Kind

Description:
As we learned from Beta-testing program, some of the tester tried to run claudie in minikube/kind environment but faced issues in doing so. Since we believe that user might be running claudie on local machine, we want to make sure that claudie work on local environments like minikube and kind. We might also want to set some hardware recommendation in order to provide a clearer picture to user regarding if they can run claudie locally of not.
Exit criteria:

[ ] Run claudie on Minikube and Kind.
[ ] Find the breaking point by adjusting cluster resources allocated.

Hi Jas, I'll open an issue for multiarch images.
After that one is completed, we can test Minikube via @wULLSnpAXbWZGYDYyhWTKKspEQoaYxXyhoisqHf's "betatesting".

I tried claudie in minikube it worked for me without any major issues. Saw a restart of c-box but that was because of mongo taking time to be up and running

We now know Claudie works on Minikube. Perhaps @wULLSnpAXbWZGYDYyhWTKKspEQoaYxXyhoisqHf can try Claudie one more time on ARM64, and if it works, we can close this.

I was not able to make Claudie run in ARM Altra based GCP cluster, at all, and I don't have a sufficiently powerful ARM machine at hand that I could try this with.
I was able to run Claudie in kind, it has been a breeze, however, as should be apparent from the above, that was only on x86_64.
In the meanwhile, @Despire opened a related issue on bundling x86 binaries in all images (including ARM), which might be the root of the problem.
The ARM discussion could continue there, while this issue could be closed with the caveat that only x86 has been verified to work.

if decoupling this from the ARM thing, Claudie has been verified to work in both kind (with the podman "experimental" provider) and minikube.
I haven't unfortunatly paid much attention to the memory usage, perhaps a future effort could be dedicated to determining the limits precisely. my estimate is that the total usage of all Claudie's services is well under a 1GB of RAM.
cc @MarioUhrik
feel free to close this.


Removing GPL licenses from nbbuild/licenses, and a lot of various ref…

…erences to GPL.
Requested here:
https://mail-archives.apache.org/mod_mbox/incubator-general/201805.mbox/<E30631C0-2449-4520-8BB8-8F5F2B3DA7C1%40classsoftware.com>
and here:
https://mail-archives.apache.org/mod_mbox/incubator-general/201805.mbox/<f231a2a7-2ead-7494-8c74-681bc27a1959%40douma.nu>

I think when the 2nd donation hits you will have to re-add these licenses since all the newly donated modules will use CDDL and GPL w/CPE. Maybe library wrappers will be GPL w/CPE only.
Where do we keep track of the license of the compile time dependencies?

@emilianbold: it seems we should not have licenses for anything that is not relevant to releasing the sources, e.g., licenses for compile time dependencies are irrelevant and confusing to Apache.

Regarding 2nd donation: I think it is difficult to estimate what exactly will happen then. But if we push the new modules into the repository, then I assume we will:
a) relicense the sources to Apache
b) for any dependency that is CDDL+GPL, we will choose CDDL (i.e. no need to have CDDL+GPL)
c) we cannot release with hard runtime dependency on/bundle GPL library. So any GPL library will either need to be removed, upgraded to a version with a more acceptable license, or handled in some other way
d) even if the new modules are part of the same repository, we will run verify-libs-and-licenses, rat and other checks only on the basic cluster config, i.e. the new modules don't need to be perfect at the beginning, as they won't be checked. So there will be time to fix them into a releasable state.
Regarding where do we track the licenses, the answer is nowhere. I tried to explain why I think having the license for compile-time dependencies is important here:
<EMAIL_ADDRESS>And it was rejected here:
https://mail-archives.apache.org/mod_mbox/incubator-general/201805.mbox/<E30631C0-2449-4520-8BB8-8F5F2B3DA7C1%40classsoftware.com>
So, frankly, I am not sure what alternative there is other than to remove the licenses (and hence not track the licenses of the compile-time dependencies)? I.e. the opinion of the reviewers appears to be very clear and I don't see many alternatives.

@emilianbold: it seems we should not have licenses for anything that is not relevant to releasing the sources, e.g., licenses for compile time dependencies are irrelevant and confusing to Apache.

Regarding where do we track the licenses, the answer is nowhere.  [...]

I think there is great value in keeping track of licensing for all kinds of dependencies, including compile-time.
We just need to flag which ones are compile-time and not include the scary licensing info in the source release files.

So it's a matter of just removing some files when building the source release zip.
Not keeping track of licensing for compile-time means we might easily switch something from compile-time to run-time and not even notice.

I agree, that there is value in tracking license information for compile time dependencies and in fact Jan does too. However I tend to agree with Jan, as we are fighting an uphill battle and Jan tried to reason about it with the reviewers and failed as referenced.
The compile-time information is recorded in the "-license.txt" file in external. And they don't/did not end up in the assembled LICENSE/NOTICE file, but the reviewers were confused nonetheless. The machinery for the combination is in:
/nbbuild/antsrc/org/netbeans/nbbuild/extlibs/CreateLicenseSummary.java
That task is invoked from the build script and merges the informations.
I don't consider the approach of the ASF good practice - and at this point I would not move a project to the ASF, but that was/is Oracles decision.

We though I agree there's value in knowing the license, the reviewers apparently don't think so. If there's something in the repository and not in the release zip, some will be opposed to that (and, frankly, in this case I'd tend to agree - the release would then be materially different from what is the repository).
Please note VerifyLibsAndLicenses tries a little to mark cases where the license is missing and shouldn't be.
In any case: the convenience binary is built from the source release (and I believe that's the only sensible thing to do), so if the licenses are stripped while building the source release, we could (accidentally) switch the dependency to runtime about as easily as if the license is nowhere.

+1 to this PR

Closing, does not seem to be quite relevant right now. We can redo this, if needed.


Accordion: Add example of panels collapsing

Problem Statement:-
The accordion component should close on a second click.

Yes, I am working on this issue
How to duplicate:-
run the storybook through npm start -> try opening and closing the accordion component
No, I am not a salesforce employee
No, I do not plan to work on a new component

Please guide me out with this, whether I should work on it or not.

The accordion is “controlled”—that is you the consumer decide what is open and closed. If you'd like to add an example in the Storybook examples that demonstrates the ability to close, e would be open to that addition.

Follow up addition
Please use the expanded prop to control panels. I'm going to close this, but feel free to re-open with questions about adding an example that allows the closing of panels.

okay ,thanks for the guidance!


Styled components are cached incorrectly

Version
2.2.1
Reproduction
This is a 2.2.1 bug, 2.2.0 works well. Seems like it is a bug in a caching feature.
https://www.webpackbin.com/bins/-KvugYeqOLsl-sk21VeB (2.2.1)
Steps to reproduce
Click on a text.
Expected Behavior
Position should be changed every time you click on a text.
https://www.webpackbin.com/bins/-KvukacztYA0RLVrQqkH (2.0.0-10)
Actual Behavior
Position never changes.

Great catch @rtkhanas, sorry for the troubles—this is indeed an oversight in the caching mechanism, we only check if the component has functions in the styles!
PR to improve this very welcome, /cc @schwers

Seems like it is fix now!
Thank you @mxstbr and @schwers!

Yep, this is fixed, totally forgot to close this-thanks!


S.USV - Hardwareversion 1.0 not working

Hi,
since a couple of version  after a reboot/update it takes  a very long time to system comes up.
Today i update to the last version and here the same thing.
Now i analyzed the problem: The system hangs on the init-script for the s.usv-daemon (S51susvd).
Here is the susv-client the one who stalles on getting information from the usv-board.
I have the hardware-version 1.0 and it seems that on this version the susv-client from version 2.0 is not working. So i checked the init.script and there is a check for getting the firmware version. But it looks like that the susv-client only work on HW 2.0.
So the scripts checks only with susv and than stalls on HW 1.0. Here should timeout be used to kill the process after a couple of seconds and then if no version was found the check should be done again with the susv1 client.
The timeout command seems  not in the raspimatic-distribution.
I hope the problem is clear.
Kind regards Thorsten

This problem is more or less already known. See here:
https://homematic-forum.de/forum/viewtopic.php?f=65&t=39482&start=350#p427524
The problem is, that Olmatic hasn't released a new firmware for the V1 hardware boards to properly support to identify these boards so that during startup the correct firmware will be flashed and thus the correct client/daemon used.
As Olmatic stated, they are about to release a new firmware for the V1 hardware boards including a unified client/daemon for both hardware versions (see https://homematic-forum.de/forum/viewtopic.php?f=65&t=39482&start=360#p427977)
Let's see how long this will take. For the time being, I am afraid but there isn't a smooth solution and you would have to manually modify your /etc/init.d/S51susvd script to directly start the susv1 client binary instead.

Ok, thank's for your quick response ... i changed the init-script and for me it's a good workaround .....

New Firmware (V1.40) is here
https://s-usv.de/files/firmware/susv_fw_14_pi.tar.gz

@Gluehwurm All these firmware files are already delivered with the latest RaspberryMatic version (see /opt/susvd/fw). Thus, all a user would have to do is to use the firmware update command to update their S.USV using the well known susv update command in a SSH session.

This issue has been marked obsolete because time has passed and the content/topic of the issue seem to be not relevant anymore or does not match the current state-of-affairs. Thus, the issue had been closed. If you feel it is still relevant, please update the ticket accordingly with newer information and explain why you feel it is still relevant and should still be taken care of.


Allow custom matchers to be provided in options

This change aims to allow custom matchers to be provided to Jasmine, much in the same way as reporters are set. This removes the necessity for any Jasmine setup script and allows the configuration to be contained in the gulp task. The example below has been added to the documentation.
const gulp = require('gulp');
const jasmine = require('gulp-jasmine');
const myJasmineMatchers = require('./my-jasmine-matchers');

gulp.task('default', () => {
  return gulp.src('spec/test.js')
    .pipe(jasmine({
      matchers: myJasmineMatchers
    }));
});

Additionally, this PR modifies the test code structure in the test file, pushing as much setup logic in the pre-assertion functions to keep spec blocks concise and remove duplicated setup code.
It may help to view the files change with whitespace diffing disabled: https://github.com/sindresorhus/gulp-jasmine/pull/63/files?w=1

I was able to achieve the same outcome using a helpers file.
return gulp.src('path/to/tests/**/*.js')
  .pipe(gulpJasmine({
    config: {
      spec_dir: './',
      helpers: [
        'path/to/helpers/**/*.js'
      ]
    }
  }));

Given that this usecase can be achieved another way, which ties better with use with something like Jasmine-Matchers, I'll close this PR.
Let me know if you want this changes anyway and I can address the comments above and re-open.


Add left nav bar for server reports extension

Monitor section:

Performance section:

@kburtram Smitha might want me to replace icons tomorrow morning

with final icons


Optmize code, replace Deprecated class.

StringTemplate.java is @Deprecated, so I remove it and replace it by VariablesSubstitute.
Elasticsearch.java has any duplicate code, so I extract an common method.

refer #1631 .


Feat: allow controlling max procs, better autodetect of usable cpus o…

…n unix

cc @tobymao

doing this in #3084


TASK: TaskCollectionFactory ignores non existing configured handlerCass

I just had the case, that an invalid handleClass was written into the DB and had to remove it manually from there. With this PR, a configured tasks is checked with class_exists and if it doesn't exist, the this task is ignored and an info message is written to the system log.

@daniellienert The case, that a task is removed, still needs to be addressed. I could try to add some kind of auto cleanup, e.g. if a task is registered in the database but handlerClass doesn't exist, the task is removed from the DB. What do you think?
I would add this in another PR.


updates to NPSP sanity suite

Critical Changes

Updated Creation of an Organization
Updated Creation of a Household
Watch the Tests video here -

Changes
Issues Closed
New Metadata
Deleted Metadata

@jessingrass  @dashattuck Please review when you get a chance. Updated NPSP Organization and Household creation after watching @dgamboni  video for the tests.


Overwriting makeQuery method to use different query type

Hi 👋,
Thank you so much for the amazing ecosystem of Elasticsearch packages 🤗.
I see by default the search method is using query type query_string,
I think this makeQuery method is responsible for that,
https://github.com/babenkoivan/elastic-scout-driver/blob/485eb1fa671e9b907bcad78a4afba1ed481f47fb/src/Factories/SearchParametersFactory.php#L41-L64
So, is there any way, we can overwrite that method? 🤔
I checked the elastic-scout-driver-plus package , that allows us to write custom queries,
But, that doesnt allow us to use the scout methods e.g where, whereIn etc..
That package is very useful in writing complex queries,
However sometimes just to write basic query with the search method and to be able to override some stuff will be really helpful. 😊
Thanks again 🙏

Hi @Aniket-IN,
you can define your own SearchParametersFactory with a custom implementation of makeQuery and register it in the service provider.
I hope this helps 🙂


pbjson-types/build.rs doesn't respect change of CARGO_MANIFEST_DIR

Currently the CARGO_MANIFEST_DIR in build.rs is retrieved at compile time.
According to documentation https://doc.rust-lang.org/cargo/reference/environment-variables.html#environment-variables-cargo-sets-for-build-scripts it is set at execution time as well.
Currently the value, that is set at run-time is ignored.
This breaks caching of the build script, in build systems like bazel, where compilation is executed in sandboxes, and the path is different every time.
Are there any downsides of reading the value at runtime using std::env::var ?

Closed by https://github.com/influxdata/pbjson/pull/90


Add service OpenAITTSService

The OpenAI Text-To-Speech sounds very natural in different languages. Is this something pipecat wants to support?

In fact, you might want to try this forked branch with a OpenAI TTS service added

Make sure to set the correct sample rate in the daily params, OpenAI returns 24kHz audio:
transport = DailyTransport(
            room_url,
            None,
            "Say One Thing From an LLM",
            DailyParams(
                audio_out_enabled=True,
                audio_out_sample_rate=24_000,
            ),
        )

I tried implementing the service from the pr: I get a 404 error, did not find out yet why:
openai.NotFoundError: Error code: 404 - {'error': {'message': 'Invalid URL (POST /v1/audio/speech)', 'type': 'invalid_request_error', 'param': None, 'code': None}}

full stacktrace
Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/jwee/projects/alfabert/src/bot.py", line 210, in <module>
    asyncio.run(main(config.u, config.t))
  File "/usr/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/home/jwee/projects/alfabert/src/bot.py", line 182, in main
    await runner.run(intro_task)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/pipeline/runner.py", line 32, in run
    await task.run()
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/pipeline/task.py", line 69, in run
    await asyncio.gather(self._process_up_task, self._process_down_task)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/pipeline/task.py", line 92, in _process_down_queue
    await self._source.process_frame(frame, FrameDirection.DOWNSTREAM)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/pipeline/task.py", line 35, in process_frame
    await self.push_frame(frame, direction)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/processors/frame_processor.py", line 51, in push_frame
    await self._next.process_frame(frame, direction)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/pipeline/pipeline.py", line 65, in process_frame
    await self._source.process_frame(frame, FrameDirection.DOWNSTREAM)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/pipeline/pipeline.py", line 26, in process_frame
    await self.push_frame(frame, direction)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/processors/frame_processor.py", line 51, in push_frame
    await self._next.process_frame(frame, direction)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/openai.py", line 215, in process_frame
    await self._process_context(context)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/openai.py", line 141, in _process_context
    await self.push_frame(TextFrame(chunk.choices[0].delta.content))
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/processors/frame_processor.py", line 51, in push_frame
    await self._next.process_frame(frame, direction)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/ai_services.py", line 110, in process_frame
    await self._process_text_frame(frame)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/ai_services.py", line 98, in _process_text_frame
    await self._push_tts_frames(text)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/ai_services.py", line 102, in _push_tts_frames
    await self.process_generator(self.run_tts(text))
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/ai_services.py", line 34, in process_generator
    async for f in generator:
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/pipecat/services/openai.py", line 295, in run_tts
    async with self._client.audio.speech.with_streaming_response.create(
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/openai/_response.py", line 634, in __aenter__
    self.__response = await self._api_request
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/openai/resources/audio/speech.py", line 159, in create
    return await self._post(
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/openai/_base_client.py", line 1790, in post
    return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/openai/_base_client.py", line 1493, in request
    return await self._request(
  File "/home/jwee/envs/alfabert/lib/python3.10/site-packages/openai/_base_client.py", line 1584, in _request
    raise self._make_status_error_from_response(err.response) from None
openai.NotFoundError: Error code: 404 - {'error': {'message': 'Invalid URL (POST /v1/audio/speech)', 'type': 'invalid_request_error', 'param': None, 'code': None}}

It uses the official openai package. Please check if your installed version is up to date and you don't have any unknown envs set, that possibly override the OPENAI_BASE_URL. This service does not specify urls or paths at all.

I tried with openai 1.26.0 and openai 1.30.5. No environment variables set.
pip freeze ->
aiohttp==3.9.5
aiosignal==1.3.1
annotated-types==0.7.0
anyio==4.3.0
arrow==1.3.0
async-timeout==4.0.3
attrs==23.2.0
azure-cognitiveservices-speech==1.37.0
certifi==2024.2.2
charset-normalizer==3.3.2
click==8.1.7
daily-python==0.9.1
distro==1.9.0
dnspython==2.6.1
email_validator==2.1.1
exceptiongroup==1.2.1
fal_client==0.4.0
fastapi==0.111.0
fastapi-cli==0.0.4
filelock==3.14.0
frozenlist==1.4.1
future==1.0.0
grpcio==1.64.0
h11==0.14.0
httpcore==1.0.5
httptools==0.6.1
httpx==0.27.0
httpx-sse==0.4.0
idna==3.7
Jinja2==3.1.4
loguru==0.7.2
markdown-it-py==3.0.0
MarkupSafe==2.1.5
mdurl==0.1.2
multidict==6.0.5
numpy==1.26.4
openai==1.30.5
orjson==3.10.3
pillow==10.3.0
Pint==0.23
pipecat-ai==0.0.25
protobuf==4.25.3
pydantic==2.7.1
pydantic_core==2.18.2
Pygments==2.18.0
pyht==0.0.28
pyloudnorm==0.1.1
python-dateutil==2.9.0.post0
python-dotenv==1.0.1
python-multipart==0.0.9
PyYAML==6.0.1
requests==2.32.2
rich==13.7.1
scipy==1.13.1
shellingham==1.5.4
six==1.16.0
sniffio==1.3.1
starlette==0.37.2
tqdm==4.66.4
typer==0.12.3
types-python-dateutil==<IP_ADDRESS>40316
typing_extensions==4.11.0
ujson==5.10.0
urllib3==2.2.1
uvicorn==0.29.0
uvloop==0.19.0
watchfiles==0.21.0
websockets==12.0
yarl==1.9.4

I called the service with  model="gpt-4o", user error, cloding ticket

I called the service with model="gpt-4o", user error, closing ticket

Gpt-4o should work fine however, I ran my tests with this model

is the voice super low for you guys? voice is super low and slow. wondering if the assumption is the audio is 44khz (eleven labs) so its being stretched?
eleven labs tts works fine

I think the TwilioFrameSerializer serialize and deserialize assume 16000 instead of 24000. Having it take in frequency as an input/output respectively should fix it


Comparison against zero emits wrong JavaScript

In Script# 0.7.3 and 0.7.4, and possibly earlier versions, comparisons against zero emit the wrong JavaScript.
This C# code:
int? x = null;
if (x == 0) { }

Emits this JavaScript code:
var x = null;
if (!x) { }

Instead of the correct JavaScript code:
var x = null;
if (x === 0) { }

If the value being tested was a non-zero integer value like this:
int? x = null;
if (x == 1) { }

Then the correct code is emitted:
var x = null;
if (x === 1) { }

This is a problem not only for nullable types, but also for code that accepts external input where the variable type may not be correct (such as an empty string being passed in where an integer is expected).
A similar problem also exists with != comparisons:
int? x = null;
if (x != 0) { }

Results in this code:
var x = null;
if (!!x) { }

Which is at least consistent, since null is considered equal to zero in both cases.
The problem is worse in 0.7.4 now that constants and enums are inline.  In 0.7.3, constants and enums with a value of 0 would cause the correct comparison to be emitted.  Now that they are inline the incorrect comparison is emitted.
Comparisons in C# using == and != should emit === and !== respectively in JavaScript to avoid treating values like null as equal to zero.

This is also a problem for bool comparisons.
C# code like this:
bool? x = null;
if(x == false) {}

Results in this JavaScript:
var x = null;
if (!x) { }

Which results in null being considered equal to false.

Here is another version of the same bool comparison problem noted above -- it produces the same JavaScript:
bool? x = null;
if(!x.Value) {}

Agreed, I remember this was discussed in an earlier issue and changed. The strict equality operators should be favoured to truthy/falsy tests, the current output is almost never what I expect (or write in js by hand).
You end up having to explicitly test for null/undefined before the if to catch these corner cases.


Add Automation Service Accounts Output

Checklist

I applicable, I acknowledge that I have:

[X] Read the contributing guide
[X] Ran terraform fmt on all modified files
[X] Regenerated the relevant README.md files using tools/tfdoc.py
[ ] Made sure all relevant tests pass

Thanks for this PR, can you address the linting errors?

Hey @joshw123, thanks for this PR. I had a similar issue recently and decided to go with something like this in the FAST stage.
output "projects" {
  description = "Created projects."
  value = {
    for k, v in module.projects.projects : k => {
      number     = v.number
      project_id = v.id
      automation_buckets = {
        for kk, vv in module.projects.automation_buckets :
        trimprefix(kk, "${k}/") => vv.name
        if startswith(kk, "${k}/")
      }
      automation_service_accounts = {
        for kk, vv in module.projects.automation_service_accounts :
        trimprefix(kk, "${k}/") => vv.email
        if startswith(kk, "${k}/")
      }
    }
  }
}

This links the actual automation service account to the project that created it, and it also gives you the buckets as well.
What do you think?

Hey @joshw123, thanks for this PR. I had a similar issue recently and decided to go with something like this in the FAST stage.
output "projects" {
  description = "Created projects."
  value = {
    for k, v in module.projects.projects : k => {
      number     = v.number
      project_id = v.id
      automation_buckets = {
        for kk, vv in module.projects.automation_buckets :
        trimprefix(kk, "${k}/") => vv.name
        if startswith(kk, "${k}/")
      }
      automation_service_accounts = {
        for kk, vv in module.projects.automation_service_accounts :
        trimprefix(kk, "${k}/") => vv.email
        if startswith(kk, "${k}/")
      }
    }
  }
}

This links the actual automation service account to the project that created it, and it also gives you the buckets as well.
What do you think?

Ah nice, Yeah this is a nicer way of doing it :) Thank You

Hey @joshw123, thanks for this PR. I had a similar issue recently and decided to go with something like this in the FAST stage.
output "projects" {
  description = "Created projects."
  value = {
    for k, v in module.projects.projects : k => {
      number     = v.number
      project_id = v.id
      automation_buckets = {
        for kk, vv in module.projects.automation_buckets :
        trimprefix(kk, "${k}/") => vv.name
        if startswith(kk, "${k}/")
      }
      automation_service_accounts = {
        for kk, vv in module.projects.automation_service_accounts :
        trimprefix(kk, "${k}/") => vv.email
        if startswith(kk, "${k}/")
      }
    }
  }
}

This links the actual automation service account to the project that created it, and it also gives you the buckets as well.
What do you think?

Have you got a PR open for this already @juliocc Thank You!

@joshw123 I don't have any open PR for it. Feel free to include it directly in yours.

Ready to Approve when you are @juliocc @ludoo Thank You! :)

Thank You for taking a look at this @juliocc I completely forgot about it tbh 😄 ❤


Content type is read only

I got an error when I try to remove a content type from the list.
Remove-PnPContentTypeFromList : The content type "<mycontnettype>" at "/<mymanagedpath>/<mysite>/<mylist>" is read only.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f4c7ee0d-9f58-e62f-4d12-55aaf5eace53
Version Independent ID: 279235ea-0f9b-5a0a-5220-660e1c2b29a5
Content: Remove-PnPContentTypeFromList (sharepoint-pnp)
Content Source: sharepoint/sharepoint-ps/sharepoint-pnp/Remove-PnPContentTypeFromList.md
GitHub Login: @techwriter40
Microsoft Alias: kirks

@officedocsbot assign @yogkumgit

Hello @ravick4u how are you? Thanks for your feedback.
I could reproduce the error and it is expected when the Content Type is set as Read Only.
https://docs.microsoft.com/en-us/sharepoint/dev/schema/contenttype-element-contenttype
Please check if the content type that you are trying to delete is not read only.
Hope this information helps you.
Thanks.

@get-itips  Thank you very much for the contribution and sharing this explanation. @ravick4u
Hope this comment is helpful for you. Thanks for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.

@officedocsbot close


Update index.md

This challenge is bgged?

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Please use the issue tracker to create a new issue about the challenge.


Qusetion about the architecture of the CSM

Hey, your work is wonderful！And I have some questions here.

You said in the paper that "CSM  extends  CCM  with  random  3×3  convolutions",  but there is only a 1x1 conv in the FeatureFusionBlock? Are there any insights?
Did you try using VGG as Pretrained Feature Network? If not, why you did't try it?
Is there any analysis about why DeiT is better than ViT as Pretrained Feature Network?
When you choose DeiT as Pretrained Feature Network, the sizes of features from layers {3, 6, 9, 12} is [B, 196, 384]. How did you process them in the CSM?

Thank you in advance!

Hey :)

see here: https://github.com/autonomousvision/projected_gan/issues/20
Yes, we tried, it works but a bit worse. Results are here, CTRL+F for "vgg"
Generally, smaller networks work better as we described in the paper, why is still an open research question ;)
You can resize them to correspond to spatial maps, we follow the procedure proposed in DPT (https://github.com/isl-org/DPT)

Thank you again for your quick reply!
Regarding the 4. question, so you use the "Reassemble" modules from DPT to process the features from the ViT and DeiT?  So are the parameters of the "Reassemble" modules trained during PG training?

Basically, you plug this line
https://github.com/isl-org/DPT/blob/788a40f309128c7c4ffce02ce9a9e081f2a75e4a/dpt/models.py#L72
here (instead of self.pretrained.layer{i})
https://github.com/autonomousvision/projected_gan/blob/521eee5051cb51834393cda8aa61450db01113f0/pg_modules/projector.py#L114
Everything after remains as is (CCM +CSM). All parameters remain fixed.


It is better to add a cancel action next to moving messages activity log

Storage Explorer Version: 1.33.0-dev (96)
Build Number: 20240201.4
Branch: main
Platform/OS: Windows 10/Linux Ubuntu 22.04/MacOS Sonoma 14.3(Apple M1 Pro)
Architecture: x64/x64/x64
How Found: From running test cases
Regression From: Not a regression
Steps to Reproduce

Expand one storage account -> Queues.
Open one queue which contains more than 100 messages.
Select all the messages -> Click 'Move'.
Select one queue on the 'Move Messages' dialog -> Click 'Move' button.
Observe the move messages activity log.
Check whether there is a cancel action next to the activity log.

Expected Experience
It is better to add a cancel action next to the activity log.
Actual Experience
There is no cancel action next to the activity log.

Verified this issue on the build 20240328.5. Fixed.


Bump actions/upload-artifact to v4

See https://github.com/plone/volto/pull/6250#issuecomment-2286845833

I restarted the same 5 failed jobs that failed in #6250.
Here's an example of the failed command.
/usr/bin/make start-test-acceptance-webserver-seamless
/opt/hostedtoolcache/node/18.20.4/x64/bin/npx wait-on --httpTimeout 20000 http-get://<IP_ADDRESS>:55001/plone http://<IP_ADDRESS>:3000/ http://localhost
/etc/bash.bashrc: line 7: PS1: unbound variable
/etc/bash.bashrc: line 7: PS1: unbound variable
/etc/bash.bashrc: line 7: PS1: unbound variable
/etc/bash.bashrc: line 7: PS1: unbound variable
/etc/bash.bashrc: line 7: PS1: unbound variable
/etc/bash.bashrc: line 7: PS1: unbound variable
/etc/bash.bashrc: line 1: docker-compose: command not found
make: *** [Makefile:267: start-test-acceptance-webserver-seamless] Error 127
/home/runner/work/_actions/cypress-io/github-action/v6/dist/index.js:[39](https://github.com/plone/volto/actions/runs/10375646984/job/28733005594?pr=6253#step:5:40)00
                error = new Error(`The process '${this.toolPath}' failed with exit code ${this.processExitCode}`);
                        ^

Error: The process '/usr/bin/make' failed with exit code 2

I have no clue how to figure out how to start the server correctly. Help!

@stevepiercy docker-compose is deprecated and needs to be replaced with docker compose. I did this already on main and the 16.x.x branch, but missed 17.x.x

@davisagli thanks, gotta run, will do tonight.


Updates to run tutorial in installed mode

This PR updates the docker-compose-installed.yaml file to be able to run the tutorial of the documentation in installed mode. It makes it closer to the non-installed docker-compose.yaml file. The PR also includes separate commits for some minor documentation revisions and typos in comments or error message in rust files.

Hey @benoitrazet. We recently change sawtooth_sdk to sawtooth-sdk. Can you rebase to pick up those changes?

@agunde406 I rebased but Jenkins still have issues apparently: 09:30:27 docker: Error response from daemon: pull access denied for sawtooth-sabre-cli, repository does not exist or may require 'docker login'. not sure what's going on.

Thanks @benoitrazet I look into the issue


fixes datetime converstion issue ( issue #22)

this minor modification fixes issue  #22

Hi ematvey, can you please commit this change. I ran into the same issue and I verified that this is a solution.
Thanks in advance

Thanks!


Create cloud-api-adaptor image for azure provider

This is to track creation of container image for azure provider

If nobody is working on this. I would like to take on it.


Admin offer: Frontend{Host,HTTPPort,HTTPSPort} not set

In the Admin offer, I observe that when you deploy an app and view its Testing tab, the internal IP address, such as <IP_ADDRESS> is displayed.  This is useless.  Please modify the setup so that the IP address of the admin server is used as the Frontend{Host,HTTPPort,HTTPSPort}.  The cluster offers already do this.
Bonus points for creating an automated test to assert this does not regress.

AB#1161152

Though the frontend host is set, the test points url of application still show up with private IP.

Hello @sanjaymantoor , this is the issue that application test point url shows private IP. Please add your findings here.