Update retry policy to get OpenAI Embeddings for trial accounts

Description
Closes #333.
As a trial user, I am unable to index my data source due to rate limits imposed by OpenAI on trial accounts. As I'm not planning to switch to their paid version, I would like gpt_index to have a more flexible retry policy.
Changelog

⚡ updated retry policy to get embeddings from OpenAI

I keep getting the rate limit error even after this change:
INFO:openai:error_code=None error_message='Rate limit reached for default-global-with-image-limits in organization org-FEDu1CtZYrEVdItu1gw3u6q1 on requests per min. Limit: 60.000000 / min. Current: 70.000000 / min. Contact<EMAIL_ADDRESS>if you continue to have issues. Please add a payment method to your account to increase your rate limit. Visit https://platform.openai.com/account/billing to add a payment method.' error_param=None error_type=requests message='OpenAI API error received' stream_error=False
I have 312567 tokens, and the code is:
max_input_size = 400000
num_outputs = 512
max_chunk_overlap = 20
chunk_size_limit = 1000

llm_predictor = LLMPredictor(llm=OpenAI(temperature=0,
                                        model_name="text-davinci-003",
                                        max_tokens=num_outputs))

prompt_helper = PromptHelper(max_input_size,
                             num_outputs,
                             max_chunk_overlap,
                             chunk_size_limit=chunk_size_limit)

documents = StringIterableReader().load_data(texts)

index = GPTSimpleVectorIndex(documents,
                             llm_predictor=llm_predictor,
                             prompt_helper=prompt_helper)
index.save_to_disk('context_index.json')

Am I missing something here?

I see the same issue

im facing the same issue


NIFI-8783 Moved SingleUserAuthorizer Login Provider check

Description of PR
NIFI-8783 Moves the check for SingleUserLoginIdentityProvider from setProperties() to initialize() in SingleUserAuthorizer. This approach allows the SingleUserAuthorizer definition to exist in authorizers.xml but continues to prevent it from being used without the SingleUserLoginIdentityProvider being configured as the selected Login Identity Provider.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[X] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?

[X] Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[X] Has your PR been rebased against the latest commit within the target branch (typically main)?

[X] Is your initial contribution a single, squashed commit? Additional commits in response to PR reviewer feedback should be made on this branch and pushed to allow change tracking. Do not squash or use --force when pushing to allow for clean monitoring of changes.

For code changes:

[ ] Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
[X] Have you written or updated unit tests to verify your changes?
[ ] Have you verified that the full build is successful on JDK 8?
[ ] Have you verified that the full build is successful on JDK 11?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
[ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
[ ] If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

[ ] Have you ensured that format looks appropriate for the output in which it is rendered?

Note:
Please ensure that once the PR is submitted, you check GitHub Actions CI for build issues and submit an update to your PR as soon as possible.

@exceptionfactory There was a thread in Slack where someone noted similar behavior for the AzureGraphUserGroupProvider so I also checked the LdapUserGroupProvider and all will try to initialize whether or not they're being used resulting in startup failures, so I don't think this is a SingleUserAuthorizer issue alone.
I checked some commits back in April and this wasn't happening. Not sure where the problem is yet though.

@jfrazee this issue was specially for single-user-group authorizer because it was doing a check to ensure that it can only be used with the single-user-group login identity provider.
In general though, anything declared in the provider files should be able to be instantiated and configured, even if it is not directly used in NiFi properties. So if any other provider has an issue like this we should address that too with additional JIRAs/PRs.

Thanks for the feedback @jfrazee. As @bbende mentioned, this particular check is specific to the SingleUserAuthorizer.  The purpose is to prevent the SingleUserAuthorizer from being used with a Login Identity Provider other than SingleUserLoginIdentityProvider.  The setProperties() method that receives the instance of NiFiProperties gets called before initialize(), so moving the logic to initialize() allows the Authorizer to check its own identifier and thus be defined without necessarily being enabled.

@bbende @exceptionfactory Thanks. After working through it, it's just a superficially similar thing -- any userGroupProvider present (uncommented) must have a valid configuration whether or not it or the managed-authorizer is being used. There's been no change in behavior, just new ways to bump into it.

Ok, I verified that:
1. Starting up with a selected authorizer of single-user-authorizer and a login-identity-provider of ldap-provider correctly fails with `SingleUserAuthorizer requires org.apache.nifi.authentication.single.user.SingleUserLoginIdentityProvider to be configured`

2. Starting up with single-user-authorizer present in authorizers.xml, but with a selected authorizer of managed-authorizer and a login-identity-provider of ldap-provider now works.

Thanks for the verification @gresockj!


RL-based "Pick" skill support missing from OVMM environment

Hi there,
I am reading through your document & code for OVMM challenge. It looks like ovmm_agent does not support rl-type "pick" skill yet in the simulation:

For evaluation, in ovmm_agent.py, AGENT.SKILLS.PICK.type = "rl" leads to NotImplementedError https://github.com/facebookresearch/home-robot/blob/7c0a4dca0293fea2023a56ca3411d1e83a59edce/src/home_robot/home_robot/agent/ovmm_agent/ovmm_agent.py#L428
Also from the OVMM readme, training pick skill is not enabled for now: https://github.com/facebookresearch/home-robot/blob/7c0a4dca0293fea2023a56ca3411d1e83a59edce/projects/habitat_ovmm/README.md?plain=1#L105

I am wondering when do you plan to enable this feature for the OVMM challenge. I think this skill is necessary for the OVMM challenge, right?
Thanks in advance.

Habitat doesn't support training dynamic pick skills, so we assume the existence of a pick skill on the robot - similar to ALFRED. There is a real-world pick skill that you can use.


Is this experiment being continued in v12?

I know this is an experiment and an alpha. I also know it was last updated in January. I was excited about it because it looked like it was headed in the right direction.
Now I’m just interested in finding out what to expect for this one going forward. When something new is happening, it isn’t uncommon for a lot of the work to happen in private until there is something tangible and useful to show, except for a series of experiments to collect feedback on different areas.

Is there a second generation of the GURPS system in the works?
Will its documents be structured to use actors with embedded items in the customary way?
Are any new experiments expected from the effort?
Should I discard this experiment from my system at this point? Has it “served its purpose?”

Yes, yes, a resounding YES!   Unfortunately,  Reality has intruded in all of the author's lives.   Jeff's and my jobs started requiring us to go back into the office, and this really restricted our free time, and Mikolaj is getting married!  This is a hobby project, so we work on it when we can (which, as of late, hasn't been too much).
To answer your questions, this IS the second generation system.    The GURPS Game Aid (GGA) is the first generation.   It has a static model (which makes it hard to expand) and no character building tools.    It served its purpose, and it works well enough for what it does, but it cannot be enhanced easily... basically, it hit a dead end.
The GCS Game Aid (GCSGA) is built on the GCS character model, and implements the GCS functionality INSIDE Foundry.    Since the character creation logic is inside of Foundry, equipment can now correctly determine its values based on the individual character stats.   This was all Mikolaj's work, and Jeff and I jumped on the bandwagon to help.
I honestly don't know how we are handling equipment.    A fully fleshed out character from GCS may have hundreds of pieces of equipment.   I don't know if that affects the decision.
My biggest focus is to get back into coding and to migrate the OTF (On The Fly) system to the GCSGA.   Once that is started, I will be going through all of the configuration options available in the GGA, to see if they make sense to migrate.
Up to you... but I know there will be major efforts on this system in the fall.   Mainly because I am retiring in October 2024.
So if you can bear with us for a few more months, maybe we can surprise you.
I hope that helps,
Chris


Add buton to reset filtering dialog

Currently no way to clear filter selections without closing/reopening the filter selection dialog.

as of 5/24/23.
reset not working. Prior to testing i disabled the cache and refreshed the page.
selected a storm name.
hit the reset button.
nothing changed.
also selected more filters and tried to reset. dialog remains unchanged.


Google Speech API Key

Hi
I want know where I must put the API key?
I have this error:
Could not load the default credentials. Browse to https://developers.google.com/accounts/docs/application-default-credentials for more information
I share my code. Thanks
        $speech = new SpeechClient([
            'projectId' => 'PROJECT_ID'
        ]);

        $recognizeOptions = [
            'encoding' => 'LINEAR16',
            'languageCode' => 'fr-FR',
            'sampleRate' => 16000,
        ];

       // Recognize the speech in an audio file.
        $results = $speech->recognize(
            fopen(__DIR__ . $pathUploads.'/'.$fileAudio, 'r'),
            $recognizeOptions
        );

Have you obtained a service account keyfile from the console? If not, check out this guide (scroll down to the "On Your Own Server" section).
Once you have your keyfile, update your code like so:
        $speech = new SpeechClient([
            'keyFilePath' => '/path/to/keyfile.json'
        ]);

Make sure to change the /path/to/keyfile.json part to point at the key you downloaded from your developer's console.
If you're using GCE or App Engine, you shouldn't need to worry about this, but it doesn't appear that you are.
If you prefer not to worry about passing your keyfile into the API client, you can make use of the Application Default Credentials to automatically authenticate when you create a client. In this case, your code would look like this:
$speech = new SpeechClient();

Let me know if you have any trouble getting authenticated after following these instructions. :)

Hey @gustavo4, did you have any luck with this?

@jdpedrie Thanks
Now I have not the error, but I do not connect to Google Speech API, so, I have the result when I do:
$results = $speech->recognize(
fopen(DIR . $pathUploads.'/'.$fileAudio, 'r'),
$recognizeOptions
);
Where I must put the Google Speech API Key? into JSON File?
Thanks

@jdpedrie Thanks, now it's ok.

But how to using API key for testing only instead of "Service account"?

@songliqiangcn Any luck with your question? Were you able to find a solution?
Hi all, how do I use API key isntead of the json key file?

@Purus we currently do not have support for using an API key in speech.
@michaelbausor if it sounds good to you I'd be happy to add this in.

We were planning to have the SpeechClient authenticated by using either the Service account or the API keys based on the users preference. Is it possible as of today?

 $client = new SpeechClient([     'credentials' => PATH_TO_CONFIG_FILE ]);


Deployment to VPS

Hello. I´d like to use Capistrano to deploy the app to an VPS. Does this app have anything special to care when configuring Capistrano?

Hi @pmaojo - surely you can use it with Capistrano, things to remember:

Setting proper ENV values for the memcached cloud, sendgrid, S3, CDN and other present in secrets.yml and environments/production.rb
Precompile assets on deploy
Remove the "Heroku fix" section ( https://github.com/spark-solutions/spark-starter-kit/blob/master/Gemfile#L68 ) from Gemfile

Thankyou!

Hi, would the process be as a regular rails app? when I run passenger start, it does not run everything I need to use foreman...


Use “Project” space instead of “user” space (or support both!)

@drowenhorst-nrl please test

Creating a folder in a project using the GUI does not work.

Uploading to the root directory of a project doesn't work either.


fix: share wasi-sdk and wasmtime install

The previous version had differences in versions.
Instead of creating clang aliases,
this adds wasi-sdk to the beginning of the PATH.
This technique is taken from common-debian.sh in vscode-devcontainers
so that it is compatible with vscode and regular containers.

Bump.
Tested on linux and windows since the workspace/rust changes still bork on M1.


Retweet bot dev

Retweet bot
retweet_bot.py
Simple script that retweets any hashtag provided in it.
Issue no. #517
Self Check(Tick After Making pull Request)

[x] This issue was assigned to me.
[x] One Change in one Pull Request
[x] My file is in proper folder (Name of folder should be in lowercase with no space in between) (E.g. meet_schedular)
[x] I am following clean code and Documentation and my code is well linted with flake8.
[x] I have added README.md and requirements.txt (Include version numbers too e.g. pandas==0.0.1) with my script
[x] Just including required dependencies in requirements.txt (Don't include Python version too)

Wooh, good work @thevirtualbuddy

haha.. thanks @pawangeek . Had to check the log for the reason of failure of the lint check. Was using http://pep8online.com/ to verify the linting and it wasn't showing the lint error for import. :)


feat: R-BTC + logo change

What

Change all occurrences of RTBC to R-BTC
Change all occurrences of tRBTC to tR-BTC
Update RBTC logo to R-BTC logo

Why

The symbol and logo have changed

Refs

Ticket

@solangegueiros

I have 2 questions:
1- the tag "rbtc" need to be changed to "r-btc"?

I think it is OK to leave as it is, because we still want people who search for rbtc to find these pages.
What we might want to consider is doubling up on the tags, so we have both rbtc and r-btc.

2- Running locally, when I did search about "RBTC", it is returning all pages about "R-BTC". Is it correct?

Yeah, I would expect this behaviour.
I've also tested searching for R-BTC and they turn up in the search results, so it's good, we're covering both.


Error generating TDE

Hi - I'm creating a demo using ES on standards documents with a schema called STS. I've got the description up and working, can generate envelop documents, but when I go to validate and install the TDE I get this error:
[javascript] TDE-INVALIDTEMPLATE: (err:FOER0000) tde.templateInsert( -- Invalid TDE template: XDMP-NOTSIMPLE: Node does not have simple content: fn:doc("/source/models/sts-templ.xml")/tde:template/tde:templates/tde:template[2]/tde:templates/tde:template/tde:rows/tde:row/tde:columns/tde:column[2]/tde:scalar-type

I'm attaching my model and the generated template (as a .zip)
There is one array in the definition that defined entity for normative references attached to each standard.
The TDE seems to be stopping on line 132 where there is an empty scalar type.  Not sure what should be there to accomplish the definition of the normative refs.
I created all this with EA4 (9.020170113) but just ran it all again with 9.0-20170418. I'm running Mac OS.
Thanks in advance,
Matt
sts-demo.zip

Charles is out of town, so I'll take a stab. This is not a valid array item type definition.
        "norm-refs": {
          "datatype": "array",
          "items": {"std-ref": {"datatype": "string"}}
        }

It should be like this:
  "items": {"datatype": "string"}

If you want it to be a reference to some external entity type, then you could set the datatype value to "iri". If std-ref was an entity type defined within this model, then you could reference it  like this:
"items": { "$ref": "#/definitions/std-ref" }

Basically, the value of "items" has to have one of the forms you see here: http://docs-ea.marklogic.com/guide/entity-services/models#id_13962.
I am curious:
Did you not also run into problems with dashes in your property names? With my build, which admittedly is from 4/15, tde:validate rejected all the prop names containing dashes. I had to change them all to underscores to get at your scalar type problem.

Did you not also run into problems with dashes in your property names?

Yes, he did. Where are the rules for column names documented?

Oops - I forgot to mention that part as well. Yes I had to change all the names to conform to SQL column heading standards.
Not sure the best way to resolve that ... but that is also an issue.
I don't think I understand the proposed solution ... so let me just go with what I'm trying to do:
Each standard has a set of references called normative references.
I want to create, in the envelop document, the following pattern:
`<norm-ref>
<std-ref>XXX</std-ref>
<std-ref>YYY</std-ref>
</norm-ref>`

I also want these to define a separate 'table' in the SQL view.
So that's why I tried to use the array construct - but obviously my version isn't correct - with the current definition I was able to create envelope documents but now that I look at them they aren't correctly in an array.
<Standard>
<urn>iso:std:iso:1161:ed-5:v1:en
</urn>
<doc-number>1161
</doc-number>
<title>Series 1 freight containers — Corner and intermediate fittings — Specifications
</title>
<doc-type>IS
</doc-type>
<originator>ISO
</originator>
<secretariat>AFNOR
</secretariat>
<pub-date>2016-07-15
</pub-date>
<release-date>2016-07-15
</release-date>
<norm-refs datatype="array">ISO 1496-1
</norm-refs>
<norm-refs datatype="array">ISO 148-1
</norm-refs>
</Standard>

So how should I properly use the array type?
Thanks,
Matt

From what you've said, norm-refs represents another entity type. You should model it accordingly. Entity properties can only have 3 possible types: Scalar, array, and reference to another entity type.

Where are the rules for column names documented? Entity Services should generate templates that aren’t invalid by default.

Since the ES spec doesn't mention this restriction, I was unaware of it until Matt reported his problem. Ergo, it's not documented anywhere, atm. :) However, rest assured that I am going to add it.
Srikanth recently made me aware of a similar restriction on the model title, imposed by TDE.
I believe the TDE documentation covers this in that it states blah blah must be a valid SQL view name, but that's much too far a distance for a user to bridge. The ES documentation needs to cover it.

Entity properties can only have 3 possible types: Scalar, array, and reference to another entity type.

…today. We’re working on how to model “weak” entities, i.e. that aren’t free-standing, but represent some hierarchy under the main entity.

The ES documentation needs to cover it.

Shouldn’t we just transform the names in the TDE generation so that they’re valid, such as converting - to _?

Recall that Charles is out of town. For all practical purposes, that makes this WAI, and it should be documented. Perhaps, an RFE for the next release.

So can you guys give me pointers on how to create the proper model? Maybe give me the right way to do this?  Thanks,  Matt

I don't think you'll get exactly the structure you want using ES (unless, I suppose, you do something custom in your instance converter code), but a combination of arrays and perhaps a second entity type should get close.
Justin can probably speak more wisely to this than I can, isn't starting with the entity structure and trying to force the model to conform a bit of the tail wagging the dog?
In any case, I don't at all mean to blow you off, but I'm under a serious deadline crunch right now, so I don't have time to devote to this. Esp. since my expertise is not much beyond your own (if that). Perhaps Justin has time to chime in with better suggestions.

Shouldn’t we just transform the names in the TDE generation so that they’re valid, such as converting - to _?

It would be a good idea to rather add this rule to model-validate() so folks dont hit this issue in later stages.
@matt-turner
You can try editing norm-refs as below:
"norm-refs": {
"datatype": "array",
"items": {
"$ref": "#/definitions/Std_ref"
}
}

and adding another entity type as so:
"Std_ref": {
"properties": {
"std_ref": {
"datatype": "string"
}
}
}

With this you have to edit the generated conversion-module to add a "/*" as shown in Post Edit:
OOTB:
  =>es:optional('norm-refs',              es:extract-array($source-node/norm-refs, standard:extract-instance-Std_ref#1))
Post Edit:
  =>es:optional('norm-refs',              es:extract-array($source-node/norm-refs/*, standard:extract-instance-Std_ref#1))

Thanks - I'll give all that a try and report back (in a day or so).

OK - here is an update:

I am able to generate the templates for TDE with this new configuration
But I don't have the conversion working properly - my std_ref data elements in the envelope (and everywhere else) are not pulling the data values

I'm attaching a full set of files for this:

Current model
Current converter
Sample content that includes the right norm_ref -> std_ref structures

If someone can take a look and help me with the right way to put the path information into the converter that would be a huge help!
Thanks,
Matt
sts_samples2.zip

@bsrikan, do you have some bandwidth to help @matt-turner out? Much appreciated.

Sure yes. Looking into it.

So I made couple of changes to sts-0.0.2-conv.xqy to get them working:

Replaced $source-node/ref/std/std-ref with $source-node//std-ref
extract-instance-Standard() was missing $instance before =>   map:with('urn', .. etc

sts-0.0.2-conv.xqy.zip

Okay. The TDE would have passed validation but it doesnt surface the norm_refs table. This is because of - in the view name. Please edit following:

edit model to change norm-refs to norm_refs
You might want to regenerate instance converter module with this updated model and edit as before to add /*
edit generated tdex by replacing <val>std_ref</val> with <val>Std_ref/std_ref</val> to match XPath in the envelope

Now you can query for Standard and norm_refs table, see your data and hopefully be able to do joins:
select * from Standard;
select * from Standard_norm_refs

Nice thread!  Thank you for persistent experimentation @matt-turner and for your timely responses @bsrikan .  I'm digging out of an email hole and will loop back to this issue later.

Another update: by defining a separate Std_ref entity and then referencing that with norm_refs, I am able to extract data from the norm_refs to create envelope data. I also added a title element to those norm_refs. However that data remains in line, not nested under a single norm_ref element in the envelope.
<norm_refs datatype="array">
<Std_ref>
<std_ref>ISO 830:1999
</std_ref>
<ref_title>Freight containers — Vocabulary
</ref_title>
</Std_ref>
</norm_refs>
<norm_refs datatype="array">
<Std_ref>
<std_ref>ISO 1161:1984
</std_ref>
<ref_title>Series 1 freight containers — Corner fittings — Specification
</ref_title>
</Std_ref>
</norm_refs>

I can also now query a standard_norm_ref table in SQL, but all the values are null.
select * from standard_norm_refs =>

iso:std:iso:668:ed-6:v1:en	null	null
iso:std:iso:18185:-3:ed-2:v1:en	null	null
iso:std:iso:1161:ed-5:v1:en	null	null
iso:std:iso:1496:-1:ed-6:v1:en	null	null

@grechaw and I will be going through this shortly and will update this with new information after.
Thanks,
Matt

OK we have a fix (sort of):
I have edited the generated TDE template to understand the data location of the norm_ref data.
These lines in the generated TDE (attached) were changed:
<context>./norm_refs/Std_ref</context>
<!-- changed from /norm_refs -->
	  <rows>
	    <row>
	      <schema-name>Standard</schema-name>
	      <view-name>Standard_norm_refs</view-name>
	      <view-layout>sparse</view-layout>
	      <columns>
		<column>
		  <!--This column joins to property urn of Standard-->
		  <name>urn</name>
		  <scalar-type>string</scalar-type>
		  <val>../../urn</val>
<!-- changed from ../urn because of the new deeper context -->
		</column>

This does now generate the proper standards_norm_ref data ... and I can query it as expected.
However not sure if this is how it should work -> either the model is right OR the way the TDE template is right. But I don't think I should have to shift context from how I defined the model to what TDE is looking for to get it to work correctly.
I will leave it up to this list to determine if this is a bug and also to close this out once you make that call.
Finally, the approach to have each element in the array represented as siblings (and not nested) doesn't make sense to me in the XML world - but once everything is working it really doesn't matter ... as long as I only use the envelope data for TDE. I'm not familiar with the way it would work with JSON so this is just an opinion.
Thanks,
Matt

We'll take some action, or not, on this in the next WG meeting.
@matt-turner I'll put you on the optional invite in case you have an interest.


No nuspec file needed
No changes to the project file needed (besides updating the SDK version to the release that will contain this PR)
DACPAC file will be in the tools folder inside the package
Package will be created to /bin/debug/ProjectName.1.0.0.nupkg, configure package ID and version with MSBuild properties: https://learn.microsoft.com/nuget/reference/msbuild-targets#pack-target
Created package will have DACPAC as one of the package types

Doesn’t it seem weird to package a dapac, which is a zip file, inside a nupkg which is also a zip file ?

Doesn’t it seem weird to package a dapac, which is a zip file, inside a nupkg which is also a zip file ?

Probably not. The dacpac is a build artifact, and the expected result of dotnet pack is to copy those build artifacts into a nupkg.
Otherwise if you wanted to unzip it first...that would probably impact a lot of existing code on both the packaging and referencing sides.

Doesn’t it seem weird to package a dapac, which is a zip file, inside a nupkg which is also a zip file ?

Probably not. The dacpac is a build artifact, and the expected result of dotnet pack is to copy those build artifacts into a nupkg.
Otherwise if you wanted to unzip it first...that would probably impact a lot of existing code on both the packaging and referencing sides.

Yeah while both dacpac and nupkg are zip files, they have pre-defined underlying structures.
The ultimate goal of packing into nupkg is to be able to consume them as package references. We also plan on releasing the system dacpacs in nupkg form.

That would be awesome.  Dacpac package references are long overdue.  With this and sdk style sqlproj it looks like sql is at risk of being a first class citizen: ) now you just need to open source everything


docs: Update README.md

Pull Request Test Coverage Report for Build<PHONE_NUMBER>5
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>8:
0.0%

Covered Lines:
898

Relevant Lines:
898

💛  - Coveralls


Fix Ansible script warnings

What?
As reported by some friction-logs there some warnings during the ansible run. These are related to a deprecation notice for Python2.7 starting from Ansible 2.12. See an example warning below:
[DEPRECATION WARNING]: Ansible will require Python 3.8 or newer on the controller starting with
Ansible 2.12. Current version: 2.7.16 (default, Oct 10 2019, 22:02:15) [GCC 8.3.0]. This feature will
be removed from ansible-core in version 2.12. Deprecation warnings can be disabled by setting
deprecation_warnings=False in ansible.cfg.

/home/user/.local/lib/python2.7/site-packages/ansible/parsing/vault/__init__.py:44:
CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is
now deprecated in cryptography,  and will be removed in the next release.
  from cryptography.exceptions import InvalidSignature

We need to fix these warnings.
See attachment for an example of log output of the execution of these ansible scripts.
abm-edge-ansible.log

@Shabirmean is this issue still active?

Closing this issue in favor of https://github.com/GoogleCloudPlatform/anthos-samples/issues/312 since the sample has moved out of this repo


new release 4.61

new release 4.61

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.


Ex4-TDD

@ItamarShDev
@robi-y

Given a name, check if the map includes a location information for it (a place or geo. location),

Check if there are map inconsistencies, e.g., the same name with different locations.

those two where missing

@ItamarShDev

:+1:


All those static fields deleted and their content changed to buildConfigFields in gradle

hey! congratulations, it's a great example, I learned too much with it and I would like to help you turning this code lighter then I deleted that constant class and static fields in message model and just created some buildConfigsFields in gradle to make your example more organized. Great example! thank you!

Thanks for your PR, but I think these constants shouldn't be in buildConfigField, since these are not values for builds. Let me know when I'm missing something.

Ok no problem, because I don't think it's necessary to make a class just for some static fields, or maybe you can do enums, but no problem good job with this example


Crashing My GPU

I started using Wiuntil like 10 days ago and now all of a sudden my GPU drivers keeps disabling and going back to Microsoft driver which is very annoying as soon as i start playing game it just crashes.
i tried benchmarking for 10 mins not crashed as soon as i play game it crashed.
before using WinUtil everything was fine how do i revert back to the original settings.
thank you

Without knowing what exactly you did or why this could be happening, a first good step to reset any changes by winutil would be to select all tweaks and then clicking the undo button.


LookupError: unknown encoding: cesu-8

Trying to connect to SAP HANA give error:
Traceback (most recent call last):
File "C:\Users\u210990\IdeaProjects\wp3_daten_transfer\lesen_daten_hana.py", line 22, in
connection(host, port, user, pwd, sql)
File "C:\Users\u210990\IdeaProjects\wp3_daten_transfer\lesen_daten_hana.py", line 16, in connection
connection_parameter = pyhdb.connect(host=host_conn, port=port_conn, user=user_conn,
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb_init_.py", line 30, in connect
conn.connect()
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\connection.py", line 141, in connect
agreed_auth_part = self._auth_manager.perform_handshake()
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\auth.py", line 50, in perform_handshake
response = self.connection.send_request(request)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\connection.py", line 83, in send_request
payload = message.pack()  # obtain BytesIO instance
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\message.py", line 55, in pack
self.build_payload(payload)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\message.py", line 45, in build_payload
segment.pack(payload, commit=self.autocommit)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\segments.py", line 94, in pack
self.build_payload(payload)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\segments.py", line 80, in build_payload
part_payload = part.pack(remaining_size)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\parts.py", line 103, in pack
arguments_count, payload = self.pack_data(remaining_size - self.header_size)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\parts.py", line 591, in pack_data
payload = Fields.pack_data(fields)
File "c:\devsbb\eaio\python3\lib\site-packages\pyhdb\protocol\parts.py", line 48, in pack_data
field = field.encode('cesu-8')
LookupError: unknown encoding: cesu-8
I'm not sure if it is related to the python version 3.9?

Related with this issue, I opened the PR.
https://github.com/SAP/PyHDB/pull/150
Simple changing the encoding name 'cesu-8' to 'cesu8' might help you.

I'm also getting the same error, Mac OS Mojave + Python 3.9.0
LookupError: unknown encoding: cesu-8

I'm also getting the same error, Mac OS Big Sur 11.2.3 + Python 3.9.0
LookupError: unknown encoding: cesu-8
I dont get where to simply change the encoding name from 'cesu-8' to 'cesu8'.
If its the DB server, my DBA will not budge.

@ChethanChandra
You can find what to be changed from this link:
https://github.com/SAP/PyHDB/pull/150/commits/507a105a574f3a205ebf7c2f0a734ffa8fa22431
Apply these changes onto your local repository. And then, install this modified package from your local repo.

workaround without patching:
import pyhdb.cesu8
import codecs
codecs.register(lambda s: (
	pyhdb.cesu8.CESU8_CODEC_INFO
	if s in {'cesu-8', 'cesu_8'}
	else None
))

Closing due to the sunset of the project. Please check active maintained alternative: https://pypi.org/project/hdbcli/


grafana-agent helm chart should include CustomResourceDefinitions for PodMonitor, ServiceMonitor, Probe

What's wrong?
I'm currently setting up Grafana Agent in a new cluster and I noticed that the flow mode is the new preferred way how to do that and the Grafana Operator is no longer recommended. After installing the helm-chart I noticed that the ServiceMonitor, PodMonitor, Probe and PrometheusRule CRD were missing.
How am I supposed to use the prometheus.operator.servicemonitors,  prometheus.operator.podmonitors and mimir.rules.kubernetes when the Custom Resource Definitions aren't provided?
Steps to reproduce
Looking into the Helm-Chart it only provides CRD for Grafana CRD: https://github.com/grafana/agent/tree/main/operations/helm/charts/grafana-agent/charts/crds/crds
Comparing this to the Grafana Agent Operator Helm-Chart which provides all CoreOS CRD: https://github.com/grafana/helm-charts/tree/main/charts/agent-operator/crds
System information
No response
Software version
Grafana Agent Helm Chart 0.36.0
Configuration
No response
Logs
No response

Hi, this is a duplicate of #173; going to close it in favor of the existing proposal.


Question about x-pack

Does this project support the x-pack functionality within ElasticSearch?

Hi @okcjason, according to ESS Doc#installing-xpack

You must install Elasticsearch and Kibana before you install X-Pack. If you plan to use the X-Pack features in Logstash, you must also install Logstash before you install X-Pack.

I believe you can install X-Pack later after you successfully deploy ESS on Ambari using this project. More information can be found in the above doc link.


WhatsApp API in PHP

edited due to being advertising.

This is clearly not in the sense of this repository and advertisting. Please do not continue this.

I'm trying to register but looks like the register is not accepting new entries, what happened? Couldn't your server handle so many requests? Anyway, I'll keep trying here, thanks!
http://prntscr.com/kxh8bn


In gdscript we cannot break long expressions in more than one line...

Let's suppose I have a long "if" condition that I would want to "break" in more lines.
Example:
if (someLongCondition1 and someLongCondition2 or someLongCondition3):
    ...do something...

In Python you could do something like:
if (someLongCondition1 and
    someLongCondition2 or
    someLongCondition3):
   ...do something...

But in gdscript this doesn't work... In Python you could break lines with a "" character too and in gdscript this doesn't work either.
Of course, you could always do something like the following code, that will work in gdscript too:
var a = someLongCondition1
var b = someLongCondition2
var c = someLongCondition3
if (a and b or c):
   ...do something...

but, honestly, I wouldn't want having to define some variables (which very likely I will not use elsewhere in the code) only to split a long expression.
I noticed that in gdscript you can split an array definition in this way:
myArray = [1, 2,
           3]

but you cannot split on more lines the parameters passed to a function, so actually this is not possible in gdscript:
myFunction(param1, param2,
           param3)

Being that gdscript is a Python-based language, maybe its parser should be more "Python"-like too.

Love the feature!
but is it explained anywhere in the Godot Docs?
can't find either

explanation that you can escape GDScript's newline for if statements with \
nor that you can span if (condition) across multiple lines using parenthesis

Only relevant search results on docs.godotengine.org for "parenthesis"
is the Docs -> Learning -> Scripting -> GDScript -> GDScript Basics page mentioning

"Parenthesis around conditions are allowed, but not required."

But no mention of multi-line if statements.
Link to section: (2.1 docs) (same page in latest)
Does this documentation exist, or is this an undocumented feature?

@Grass-H0PEr Well, it isn't really documented, but you can freely use newlines as long as you are inside parenthesis. (if (condition): is just if condition: with additional parenthesis)

Note that v2.1 has some weird behavior when you consider method calls. This doesn't work:
some_method(1, 2,
    3, 4)

But the following do work:
# Explicitly breaking via `\`.
some_method(1, 2, \
    3, 4)

# Or having an inner set of parens
# (seems unnecessary given that we already have the method parens)
some_method(1, 2, (
    3), 4)

Haven't checked recent builds of Godot yet, though.


improve script for building manifest

only update models-resource urls for iframes since those are the only ones we need proxy
pretend to be chrome when fetching so sites like google fonts return the same thing we'd get if running in the browser
add switch to not fetch the activities when running the script, this is helpful when checking the static analysis since the lara content might change
simplify the test of url re-writing to make it easier to see what gets re-written to what
stop re-writing the plugin urls because those are not iframes so do not need to be proxied
only add slashes when the urls are re-written, that was a case in the content of a image that didn't have a extension, and the added slash broke it
look into proxied iframe html files to pick up the assets referenced by them
look for css and script references in the iframe html
fetch css files and look for absolute urls in the css files
look for urls in the netlogo html files
look for urls in the html content of the activity

Note this also fixes an issue with slashes being added to the xhtml text. This happened when the text had a url in it, which then triggered the url re-write code which adds a slash to everything if it doesn't end with an extension.


[Bug] "Jest did not exit one second after test run..." warning happens when image is fetched from a remote source

Describe the bug
It appears that when I use an image that is fetched from a source, it causes test-storybook to give the following warning:

Jest did not exit one second after the test run has completed.
This usually means that there are asynchronous operations that weren't stopped in your tests. Consider running Jest with --detectOpenHandles to troubleshoot this issue.

Steps to reproduce the behavior

Create a brand new Storybook project using Typescript following the documentation.
Add a new story with the following code:

import { Meta } from '@storybook/react';

export default {
  title: 'Example/Image Test',
} as Meta;

export const WithAnImage = () => <img src="https://place-hold.it/350x150" alt="My CDN placeholder" />;

Run test-storybook
See error

Expected behavior
I expected the tests to complete without giving me this warning.
Screenshots and/or logs

Environment

OS:  macOS Monterey 12.5
Node.js version: v19.2.0
NPM version: 8.19.3
Browser (if applicable): Headless browser: chromium
Browser version (if applicable): ??
Device (if applicable): N/A

Additional context
When I use an image that is located in the public directory, I do not see this warning.

Having the same issue occasionally. I used --eject to get the jest config file and pass it detectOpenHandles: true but that didn't do anything, no extra messages were printed and jest just waits forever.

I tried using https://github.com/Raynos/leaked-handles to see if I could debug this further and got the following issue:
tcp handle leaked at one of:
    at [...]/node_modules/playwright-core/lib/common/netUtils.js:39:33
tcp stream {
  fd: 38,
  readable: true,
  writable: true,
  address: { address: '<IP_ADDRESS>', family: 'IPv4', port: 43716 },
  serverAddr: null
}

This  doesn't seem super useful, but i'll continue looking into it...

As a temporary solution, running the test-runner with --eject and setting forceExit: true forces jest to exit.

I'm with the same problem, but not exactly loaded a image.


Adding Catalan Number code in Math section

🚀 Feature
Catalan numbers is a number sequence, which is found useful in a number of combinatorial problems, often involving recursively-defined objects.
Have you read the Contributing Guidelines on Pull Requests?
Yes
Assignees

C-Plus-Plus: @suprithars111
C-Sharp:
C:
Go:
Java: @rohangawhade
JavaScript:
Python: @iamRishabh07
Q-Sharp:

@Kajol-Kumari @iamrajiv @plazzy99  I want to work in C++ please assign me this.

@iamrajiv I want to work in python can you assign me.

I would like to work on this in java

I would like to work on this in C.

@iamrajiv  I want to work on this in C-sharp


[VTK 9] VTK_BUILD_TESTING is a string and not bool

Describe the bug
For VTK 9, VTK_BUILD_TESTING cmake var is a STRING not BOOL. This generates an error when building VTK. See the Build Settings section in VTK's build documentation.
Proposed Solution
Change the line below in bv_vtk.sh:
if [[ "$DO_VTK9" == "yes" ]] ; then
   vopts="${vopts} -DVTK_BUILD_TESTING:BOOL=false"

TO
if [[ "$DO_VTK9" == "yes" ]] ; then
   vopts="${vopts} -DVTK_BUILD_TESTING:STRING=OFF"

Thanks @griffin28, I ran into this recently but forgot to create a PR, great reminder!


[BUG] Anonymous user cannot change Global tenant

What is the bug?
The anonymous user opendistro_security_anonymous can only access the Global tenant. When I try to switch the tenant it still shows the Global tenant dashboards even if it says that the tenant is switched.
How can one reproduce the bug?

Activate anonymous in config.yml

config:
  dynamic:
    http:
      anonymous_auth_enabled: true

Activate anonymous in opensearch_dashboards.yml

opensearch_security.auth.anonymous_auth_enabled: true

Login using the admin user
Create a new tenant (public)
Map opendistro_security_anonymous to all_access role.
In the Global tenant add [eCommerce] Revenue Dashboard example data.
In the public tenant add [Logs] Web Traffic example data.
Logout
Go to https://locahost:5601/app/dashboards
Check that the user anonymous is in the Global tenant with [eCommerce] Revenue Dashboard dashboard

Switch to public tenant and the dashboard is still [eCommerce] Revenue Dashboard instead of [Logs] Web Traffic

The same but using the admin user and we can see that in the public tenant the dashboard is [Logs] Web Traffic

What is the expected behavior?
I expect the anonymous user (opendistro_security_anonymous) to have the same behavior as admin user. In step 11 the dashboard is [Logs] Web Traffic
What is your host/environment?

OS: Ubuntu
OpenSearch and OpenSearch Dashboards: 2.5.0 and the same behavior for all 2.x.y and 1.x.y

[Triage] @cwperks would you take a look at this issue?

We fixed this issue on: https://github.com/opensearch-project/security/pull/2459
The problem is related with the security plugin of OpenSearch.


[bug] Resource files cannot be accessed on Windows but works on MacOS

Describe the bug
The files in resources folders can be accessed on MacOS but not on Windows.
This is the main part of the code:
<script setup>
import {onMounted, reactive} from "vue";
import {resolveResource} from "@tauri-apps/api/path";
import {convertFileSrc} from "@tauri-apps/api/tauri";

const state = reactive({
  image: "",
});

onMounted(async () => {
  const path = await resolveResource('resources');
  state.image = convertFileSrc(`${path}/image.jpg`);
});
</script>

<template>
  <div class="container">
    <img :src="state.image" alt="image">
  </div>
</template>

When I run pnpm i && pnpm tauri dev on MacOS, the app opens with a sample image shown. But on Windows the exact same code will show a broken image (the url actually points to the right path, but seems the app lacks permission to access it)
This seems to be very similar to https://github.com/tauri-apps/tauri/issues/6962 but I tried to set assetScope to "**/*" (instead of "**"), it still doesn't work on Windows.
Reproduction
git clone git@github.com:vincent-lu/demo.git
cd demo
pnpm i
pnpm tauri dev

Expected behavior
The jpeg image stored at ./src-tauri/resources/image.jpg should be shown as a web image on the frontend on both MacOS and Windows.
Full tauri info output
[✔] Environment
    - OS: Windows 10.0.19045 X64
    ✔ WebView2: 120.0.2210.121
    ✔ MSVC:
        - Visual Studio Build Tools 2019
        - Visual Studio Build Tools 2022
    ✔ rustc: 1.75.0 (82e1608df 2023-12-21)
    ✔ cargo: 1.75.0 (1d8b05cdd 2023-11-20)
    ✔ rustup: 1.25.1 (bb60b1e89 2022-07-12)
    ✔ Rust toolchain: stable-x86_64-pc-windows-msvc (default)
    - node: 20.11.0
    - pnpm: 8.14.1
    - npm: 10.2.4

[-] Packages
    - tauri [RUST]: 1.5.4
    - tauri-build [RUST]: 1.5.1
    - wry [RUST]: 0.24.7
    - tao [RUST]: 0.16.5
    - @tauri-apps/api [NPM]: 1.5.3
    - @tauri-apps/cli [NPM]: 1.5.9

[-] App
    - build-type: bundle
    - CSP: unset
    - distDir: ../dist
    - devPath: http://localhost:1420/
    - framework: Vue.js
    - bundler: Vite

Stack trace
No response
Additional context
No response

The issue here is that if you use resolveResource and convertFileSrc like this you'll end up with a url encoded path that mixed forward and backward slashes. I'm not sure if we consider this a bug or simply expected behavior, but you can workaround it really easily.
This is how we intended the resolveResource api to be used (this would fix the issue here):
resolveResource("resources/image.jpg")

Alternative you can use path.resolve like
  const path = await resolveResource('resources');
  state.image = convertFileSrc(await resolve(`${path}/image.jpg`));

Ah ok, that worked. Thanks @FabianLars. I always thought forward slashes (sort of) already work on Windows.


Unauthorized user can call all APIs successfully

Steps

Create user test_api_1   (for example)
Create new api key for test_api_1
Create another user test_api_2   (for example)
Use the client_id and the client_secret of the user test_api_1  to generate access token
then use this access token to send get, put, post , delete requests for user  test_api_2

Actual result
Unauthorized user can call all the APIs successfully

Expected result
401 Unauthorized
Version
v0.9.9-30-gf150f6d

@ahmedelsayed-93 Are you sure there are not authorizations? This call should not even work like this:
https://github.com/itsyouonline/identityserver/issues/434

@robvanmieghem
user test_api_1 was authorized and i used its access token to call apis for user test_api_2

Caused by fa9ef9231e56577d291fc4457cf96ec8f561fd03

thanks @ahmedelsayed-93 for pointing out this critical issue


CentOS.yml is empty

It would be nice if you could create a CentOS 7 based yml for this project.

This Ansible role is no longer being maintained.


Docker integration failed

Environment
Docker
Version
0.10.3
Describe the problem
not too much to say, I installed hammer using the docker-compose template on this same GitHub. when activate docker in homer web page, it says "Did you forget to mount the docker socket?"
I search some information about this, but nothing appears at least I couldn't found
Additional info

Please tick the boxes

[X] You've read the docs
[X] You've checked for duplicate issues
[X] You've tried to debug yourself

Hi,
please read our documentation before opening any issues:
https://homarr.dev/docs/modules/built-in-modules/module-docker
The checkbox You've read the docs is there for a reason ✨

Actually running into the same issue. I read the docs and see I need to -v /var/run/docker.sock:/var/run/docker.sock
at startup but I used portainer/compose to create so not sure how to add this?
Thanks for the time and any help.

Hi, please read our documentation before opening any issues: https://homarr.dev/docs/modules/built-in-modules/module-docker
The checkbox You've read the docs is there for a reason ✨

ok thanks, I thought I read all the necessary, sorry.

Actually running into the same issue. I read the docs and see I need to -v /var/run/docker.sock:/var/run/docker.sock
at startup but I used portainer/compose to create so not sure how to add this?
Thanks for the time and any help.

easy, just add the lines under the Volumes in the compose
something like this
volumes:
- /xxx/xx/xxxxx/docker/homarr/configs:/app/data/configs
- /xxx/xxx/homarr/icons:/app/public/icons
- /var/run/docker.sock:/var/run/docker.sock

ok thanks, I thought I read all the necessary, sorry.

No worries 😊

easy, just add the lines under the Volumes in the compose something like this
volumes: - /xxx/xx/xxxxx/docker/homarr/configs:/app/data/configs - /xxx/xxx/homarr/icons:/app/public/icons - /var/run/docker.sock:/var/run/docker.sock
after that, update the stack, wait and that's all

Yes, that's exactly how you do it! Perhaps we should clarify this in the documentation?

Thanks appreciate the help. That solved my issue.

Nice! Can we close this issue then or are there still any questions? Hope you enjoy Homarr so far 🙏


Workflows crash with a segmentation violation after<EMAIL_ADDRESS>finishes and before<EMAIL_ADDRESS>starts

Recently, it has been happening from time to time (but not always) that my workflows crash with a segmentation violation right after<EMAIL_ADDRESS>finishes and before<EMAIL_ADDRESS>starts.
Here are two examples:
crash1.log
workflow1
crash2.log
workflow2
Since the crash happens randomly, I do not expect it will be trivial to debug. But it will still be great if you could have a look.
Thanks.

Can you give matlab-actions/setup-matlab@v2-beta a try? It may increase the time required to set up MATLAB (particularly with older releases) but it may also help address this crash.
Note: with setup-matlab v2, you need to explicitly specify the products required for your build with the products input like so:
- name: Install MATLAB
  uses: matlab-actions/setup-matlab@v2-beta
  with:
    release: latest
    products: |
      Simulink
      Deep_Learning_Toolbox

See the v2 README for more details.

Thank you @mcafaro . I will try it.

Hi @mcafaro ,

Recently, it has been happening from time to time (but not always) that my workflows crash with a segmentation violation right after<EMAIL_ADDRESS>finishes and before<EMAIL_ADDRESS>starts.
Here are two examples:
crash1.log workflow1
crash2.log workflow2

The problem comes back. It has been happening randomly that workflows crash with a segmentation violation right after matlab-actions/setup-matlab@v2-beta finishes and before matlab-actions/run-command starts. The syndrom is identical to what I reported before.
It would be nice if you could take a look. Thanks!
Best regards,
Zaikun

Hi Mark,
It seems to be happening randomly on all my MATLAB workflows. I have not identified a pattern yet. It happens about every 1 out of 10~20 times.
Thank you very much!
Best regards,
Zaikun

This seems to be happening more and more frequently now. Am I the only one who observes this?
I run ver at the very beginning of my run-command. This crash happens before the version information is printed.
Thanks.

Hi @zaikunzhang,
We have changed the way we start MATLAB in the new v2 releases of our actions (is it different from how setup-matlab@v2-beta started as well). I haven't seen this yet on v2 so I am curious if you will still experience it after upgrading to v2 for all matlab-actions. If we leave this issue open for a little while, can you update us here if you continue to see it?
Thanks,
David

Hi @davidbuzinski , sure, I will keep this in mind. If you don't receive my report in a month, then it will mean that the problem has been resolved by the new release.

Hi @zaikunzhang , have you still been seeing these errors sporadically? Is it okay if we close this issue?
Thanks,
David

Hi @davidbuzinski David,
Many thanks for keeping this in mind.
I haven't observed this recently. It should be fine now.
Zaikun


How many epochs will it take to get a good result?

I also have a question about the accuracy of the training time. I trained 24h with 8xA40, but only 150 epochs.

I've got good results with < 100 epochs. More than that and the images actually get worse as mentioned in the blog.

I've got good results with < 100 epochs for the fine-tuning example. More than that and the images actually get worse as mentioned in the blog.

Hi, do you know how to set epoch? I didn't find it.


feat: modular CLI + aztec test

Refactors the CLI package to work as a collection of dynamically importable commands in actual CLI programs, such as aztec.
Right now this doesn't add that much value besides avoiding code repetition between builder and CLI, but tidies up the packages and makes it so much easier to build different utilities by mix and matching different commands. This is going to be very useful when we strip the aztec binary of some internal commands, and even more so when we start building the infamous CLI wallet (which will certainly pull some of these commands in)
Besides that, it cleans up the sandbox so that no redundant aztecprotocol/cli image is pulled, and some of the commands are greatly simplified. The sandbox now does:
aztec: All the previous commands + all the old CLI ones without having to prefix them with cli
aztec-nargo: Same as always
REMOVED:
aztec-sandbox and aztec sandbox: now aztec start --sandbox
aztec-builder: now aztec codegen + aztec update
ADDED:
aztec test: runs aztec start --txe&& aztec-nargo test --use-legacy --oracle-resolver http://aztec:8081 --silence-warnings via docker-compose allowing users to easily run contract tests using TXE

Benchmark results
Metrics with a significant change:

avm_simulation_time_ms (Token:_increase_public_balance): 64.1 (+332%)
avm_simulation_time_ms (FPC:pay_refund_with_shielded_rebate): 110 (-32%)
protocol_circuit_witness_generation_time_in_ms (private-kernel-tail-to-public): 8,865 (+183%)
l1_rollup_calldata_gas (4): 9,476 (+44%)
l1_rollup_calldata_gas (8): 9,468 (+44%)
l1_rollup_calldata_gas (16): 9,476 (+44%)
l1_rollup_calldata_size_in_bytes (4): 1,412 (+99%)
l1_rollup_calldata_size_in_bytes (8): 1,412 (+99%)
l1_rollup_calldata_size_in_bytes (16): 1,412 (+99%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Proof generation
Each column represents the number of threads used in proof generation.

Metric
1 threads
4 threads
16 threads
32 threads
64 threads

proof_construction_time_sha256_ms
5,712
1,543
702
744
764 (-2%)

proof_construction_time_sha256_30_ms
11,803
3,171
1,409
1,445
1,466 (-1%)

proof_construction_time_sha256_100_ms
43,827
11,796
6,709 (+2%)
5,941 (+9%)
5,391

proof_construction_time_poseidon_hash_ms
78.0
34.0
34.0
59.0
88.0 (+1%)

proof_construction_time_poseidon_hash_30_ms
1,516
415
200
223 (-2%)
269 (+2%)

proof_construction_time_poseidon_hash_100_ms
5,597
1,516
674 (-1%)
720 (-4%)
746

L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
4 txs
8 txs
16 txs

l1_rollup_calldata_size_in_bytes
:warning: 1,412 (+99%)
:warning: 1,412 (+99%)
:warning: 1,412 (+99%)

l1_rollup_calldata_gas
:warning: 9,476 (+44%)
:warning: 9,468 (+44%)
:warning: 9,476 (+44%)

l1_rollup_execution_gas
613,504 (+5%)
613,647 (+5%)
613,806 (+5%)

l2_block_processing_time_in_ms
759 (+1%)
1,413
2,696

l2_block_building_time_in_ms
12,957
25,815
49,857 (-1%)

l2_block_rollup_simulation_time_in_ms
12,957
25,815
49,856 (-1%)

l2_block_public_tx_process_time_in_ms
10,913
23,596
47,635 (-1%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 8 txs.

Metric
3 blocks
5 blocks

node_history_sync_time_in_ms
7,259 (+3%)
10,071 (+1%)

node_database_size_in_bytes
12,415,056
16,191,568

pxe_database_size_in_bytes
16,254
26,813

Circuits stats
Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks.

Function
time_ms
bytecode_size_in_bytes

GasToken:_increase_public_balance
78.5 (+2%)
13,790

GasToken:set_portal
14.6 (-6%)
3,339

Token:constructor
103 (-4%)
23,692

FPC:constructor
72.4 (-2%)
13,592

GasToken:mint_public
64.5 (+4%)
10,158

Token:mint_public
50.2 (+8%)
19,034

Token:assert_minter_and_mint
68.3 (-27%)
12,925

AuthRegistry:set_authorized
33.8 (-9%)
7,812

FPC:prepare_fee
104 (-7%)
15,062

Token:transfer_public
28.3 (-19%)
31,218

FPC:pay_refund
129 (-2%)
25,260

Benchmarking:increment_balance
1,320 (-1%)
15,267

Token:_increase_public_balance
:warning: 64.1 (+332%)
15,006

FPC:pay_refund_with_shielded_rebate
:warning: 110 (-32%)
26,347

Public DB Access
Time to access various public DBs.

Function
time_ms

get-nullifier-index
0.152

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
256 leaves
512 leaves
1024 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.4
16.7
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.7
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.602
0.514
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
48.3
76.1 (+1%)
131
245
468

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
95.9
159
287
543
1,055

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.494
0.468 (+1%)
0.451
0.443 (-1%)
0.437

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
59.7
111
182
352
690

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
109
207
355
691
1,363

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.505
0.498
0.483
0.477
0.474

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
73.0
N/A
N/A
N/A
N/A

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
133
N/A
N/A
N/A
N/A

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
0.519
N/A
N/A
N/A
N/A

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
74,105
667,868

Transaction size based on fee payment method
| Metric |  |
| - |  |

Docs Preview
Hey there! 👋 You can check your preview at https://6694d6c3a9380d382ebd031b--aztec-docs-dev.netlify.app


Convert names to pills in Organization settings

In the User groups, Users, and Deactivated users panels of Organization settings, we should convert user/bot names from plain links to pills. For bots, this applies to both the bot name and the owner name. See the User groups panel for an example.
We will need to check whether these panels still load in a reasonable time after this transition. If not, we may decide to use the version of the pill without an avatar, but having the avatar would be preferred from a UX perspective.
We need to make sure long names are handled reasonably, including on narrow screens. This probably means abbreviating the name with a ... when needed.
We may need to check the help center for potential updates; this can be done as a follow-up.

@zulipbot claim

@zulipbot claim

Hey @alya, I just wanted to confirm before I start working on the issue. Should I implement the user pills like this?

Currently, we do not show a user-card popover when clicking these pills. Should I implement the popover too?

Should I implement the user pills like this?

Yes, pretty much, though they shouldn't have an x.

Currently, we do not show a user-card popover when clicking these pills. Should I implement the popover too?

Yes, we've already merged a PR to make names into links in the settings, and we should definitely preserve that functionality.

Unassigning myself from this Issue to work on other Issues, since I have already raised a PR and it is under review, will continue working on the PR for any required changes, Thanks.

@zulipbot  claim

unassigning myself as PR is raise which solves the issue.


Start of an Asp.Net Core port

Haven't had a lot of time to do much else, yet.  Coming weeks should provide more options.  Any chance you guys will be at Build event?  Would like to see a V1 of this published as nupkg's by then.  If you guys can provide some guidance / how IServiceCollection should/should not be used, etc.  that would be helpful.  Also, should it leverage the HttpRequest ApplicationServices property to do all resolution?  Do we need the Default Service functionality, or should that be handled as a default during registration using an option lambda on the extension method for Configuring WebHooks?

Does this look more in line with the approach you would expect?

Just a note about couple items that need input / review:

IOptions/IConfiguration setup for secrets / settings
CustomWebHookReceiver can't seem to read request body (it's all default initialized bytes of 0)  not sure what I've missed on that?
Configuration Extensions of Services / Resolution of Services may need some revision - was not sure how to setup configuration extensions with options Action to pass in configuration
Error Handling for various accept types in the MiddleWare (I changed all exceptions to use a custom Exception type to specify status code + message) since HttpResponseException is not part of ASP.Net Core.

Any further information / details regarding this?  Does it need to get updated to the current dev branch / RC2?  Is it a good time to do that, or should we hold off until it releases?

I am sorry it takes so long. I have poked the 'core' folks but I think they are busy. Will try again.

{

This file shouldn't be needed; the root folder's global.json should be enough.

Refers to: src/Microsoft.AspNetCore.WebHooks.Common/global.json:1 in 1b1edb7. [](commit_id = 1b1edb7bda4975b9dc7941504d951dd91d5e5389, deletion_comment = False)

Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "Src.AspNetCore", "Src.AspNetCore", "{668B3959-3928-472F-9341-06BF8C9BADE9}"

I might just be misreading the SLN file, but are the names and paths of the projects here correct?

Refers to: WebHooks.sln:145 in 1b1edb7. [](commit_id = 1b1edb7bda4975b9dc7941504d951dd91d5e5389, deletion_comment = False)

@rposener thank you for being so patient with us. As you may have seen earlier today, we just released ASP.NET Core 1.0 RC2, which was a long awaited released. Fortunately, that means I had a little bit of time to start reviewing this PR. I tried to focus most of my comments on the bigger questions and some other stuff that might help simplify the PR. Once we iterate on those I think things can speed up quite a bit.
Again, sorry for taking so, sooo very long to get back to you on this. I realize you've put a lot of effort into this and I want to make sure we can make WebHooks work super well with ASP.NET Core!

Excellent, thanks for the review.  I will get some time in the next couple days to iterate from your comments and help things move along here.  Excited to see RC2. Sounds like the cli will be simpler and a good move forward.

Looking forward for the updates! 😄

I am going to create a new pull request - start from middle tier and work my way out.  Will use a number of the same bits, but I have learned so much I really think this needs a full 1.0 revision like asp.net core instead of trying so hard to convert the prior.  Will work to same interfaces for receivers and handlers as well as extensions for controllers to initiate sending.

This sounds fantastic -- I very much appreciate all your work here!

👏

Sweet 😄

OK I've updated my fork with a bunch of new projects for the core stuff.  I have a few questions that I need some input on.

[ ] For Receivers Middleware now calls Receivers, which produce a Context if the Handlers should be called.  If no handler should be called (e.g. echo/Validation) then it just returns null.  Otherwise, they set the context, or in error situation throw.
[ ] All options are set via IOptions, and ServiceCollectionExtensions and MiddlewareExtensions have a setupAction to apply conifguration options as necessary.
[ ] NotificationDictionary is now IWebHookNotification (I created 2 classes to support existing items, but should provide nice options for DTO's for WebHooks.
[ ] Resources are not loading - trying to test sending of custom notification seems to die.  Not sure what/how I've messed up resources.  Any information anyone can provide would be helpful.
[ ] Overall it converted much easier on RC2, some is just my experience with asp.net core growing, some is the tooling!
[ ] Items not necessary for asp.net core have been omitted.  Projects should be setup a bit cleaner now.

Figured out my Resource Loading issue (https://github.com/dotnet/corefx/issues/8754)

Ok - custom senders and receivers are working with all the same interfaces implemented.  I have not made my way back to writing tests, but generally all the same tests as the .net project should be passing.
Question for Henrik - I had not paid attention to the Registrars before.  It doesn't look like any sample or other project implements them.  Is that there just in case someone needs to do some additional verification?  I also did not really get the point of the IdValidator along the same lines.  Could those not be just consolidated into a single validator, and leave it up to the implementation to decide what to validate?
I am heading out on Vacation till next Tuesday. If you guys can give this a bit of a review (Eilon) in the mean time, I will start on converting the tests, and look at updating the other receivers, which should not take too much effort to crank through.

@rposener @HenrikFrystykNielsen Hey folks, no milestone here, but it looks like it's getting close? Is there an ETA for this PR to get merged?

Well, I have had some time away where I was unable to work on it.  Should be able to get more done soon.  Kind of wish I could get some review from the asp.net core team to know if middleware is looking OK, and from Henrik based on questions above.  Certainly is close - just want a little confidence I'm not severely overlooking something.  If it's good, then we should be able to just start porting all the implementations and tests.
Or perhaps, the team wants it to be a single project that targets both frameworks.  If that is the case, a lot of refactoring is probably needed...  Open to input, and would love some feedback.

Should I just close this and let someone else start again?

I really appreciate all the work you have put into it and I apologize for the lack of response. Part of it has been because core has been in flux but with core 1.0 out it should be possible to get a stable model together. I absolutely do want this to run on core but it has been difficult to get things to align. Let me chat with some of the core folks and see how we can bring your work forward. thanks!

Any word on if and when this branch is going to be merged to master? We have a Webhook based running we are looking to Migrate to .net core. Thanks!

+1 it would be awesome if we can start developing webhooks in .net core

Any further update on this? It would be great if we could use WebHooks in .NET core

I'm super excited for this! Any eta? How else can I have my .net core mvc6 project auto-update itself, when my github branch receives a push?

Anyone try this yet?

It seems no one is paying attention

This would be very cool indeed

We have a project were this would be very useful, hesitant to use it though because there doesn't appear to be much recent work done on the project, is work going to continue on the project?

It is on the road map but the stars haven't aligned yet to make it come together. I will provide an update when that happens. Thanks! Henrik

Anything on this yet?

When can we expect to get WebHooks support in ASP.NET Core?  This blog post says:

A port to the ASP.NET Core is being planned so please stay tuned!

Could you share any more details on that?
@HenrikFrystykNielsen

Closing this PR because we're going with https://github.com/aspnet/WebHooks/pull/153 instead. Thanks!

Webhook is not working for ASP.NET core 2.1 with GitHub. Does any one have any working samples.

@ALMWEARE please log a new issue with details.


Accessing the "raw" JSON document

Is there a way to do this without adding these two lines: https://github.com/PierreRochard/coinbase-python/commit/01d4e69fb937fc55141b504371e61eb4b339c121 ?
Thanks,
Pierre

Hey @PierreRochard, there is not currently a public interface exposed to fetch the JSON object directly. However, you can call _get(...) directly and then get the JSON from the response object by calling json().


Some Layout menuProps don't seem to be working

As of ProLayout version "4.5.16"
The ones I have tried are:
selectedKeys: [0],
onClick: () => alert("clicked"),
onSelect: () => alert("selected")
Is there a plan to include these in the near future? Also, I maybe missing something here perhaps, but some of the others props work fine, such as 'theme', and 'mode'. I am using the ProLayout component as a direct import into a non umi project. Thanks for checking

try menuProps. layout only support openKeys and selectKeys

try menuProps. layout only support openKeys and selectKeys

how to get menu keys


How silent is --silent ?

The Gym action details that there is a silent flag that "Hide all information that's not necessary while building"
I have set this to be true, but still get pages and pages of console output which seems to be the same regardless of how the flag is set.
What exactly is silent supposed to filter? And am I experiencing an anomaly (FL v 2.102.0) or are other people seeing this too? (I don't see any previous issues about this...)

It seems like you have not included the output of fastlane env
To make it easier for us help you resolve this issue, please update the issue to include the output of fastlane env 👍

I wasn't sure that this was necessary for this question... happy to do so if needed though...

@JesseScott I agree with you, the "silent" mode is way too verbose.

Hey that's a great question, could you prepare a list of things that you want to be hidden when using the silent flag, and we can make sure to update gym to consider this 👍

Wait! I will get to this week!

@KrauseFx
Really thinking about this some more, ultimately what I would like to see within Fastlane (as a whole, not just the Gym action) is a more detailed Linux-style log level subsystem --> ie.

Log.Level.None
Log.Level.Debug
Log.Level.Info
Log.Level.Warning
Log.Level.Error
... and this could be set within the before_all lane... and potentially overridden by each action, Eg.

before_all do
    Log.Level.Error

end

lane build do
    Gym(
        log_level: Info
    )
end

Failing that (as i understand this likely means a fairly large refactor to the way Fastlane handles logging, grepping from subsystems, piping to files, etc...), Silent should actually mean silent (logically), but I don't feel that this would be too useful for most users, so I think it should default to the "Info" level.
This level I imagine as simply annotating the switching of lanes, context headers, and lane results
(think the ASCII table as seen in the docs at https://docs.fastlane.tools/actions/gym/ and then the final output of the lane... and that's it, none of the xcodebuild output...)

Still active!

@KrauseFx
Really thinking about this some more, ultimately what I would like to see within Fastlane (as a whole, not just the Gym action) is a more detailed Linux-style log level subsystem --> ie.

Log.Level.None
Log.Level.Debug
Log.Level.Info
Log.Level.Warning
Log.Level.Error
...
This level I imagine as simply annotating the switching of lanes, context headers, and lane results
(think the ASCII table as seen in the docs at https://docs.fastlane.tools/actions/gym/ and then the final output of the lane... and that's it, none of the xcodebuild output...)

This is exactly what I thought the --silent command actually did, as a matter of fact, so I find this approach by JesseScott an amazing suggestion to improve logging within Fastlane

Bump


⚠ AlphaRatio has degraded performance

In a736e75, AlphaRatio ($AR) experienced degraded performance:

HTTP code: 200
Response time: 2517 ms

Resolved: AlphaRatio performance has improved in b9ad469 after 6 minutes.


boards: add new test supported feature usbd

We have recently added a new platform where the USB controller is only
supported in the new USB device support. This forces us to introduce a
new supported feature tag to distinguish the dependency. Use "usbd",
which is also the prefix of the new device support.
There are many boards that already have new driver support, but we will
replace the "usb_device" feature when the old device support is
deprecated.
Fixes: #73004

What is really preventing us from deprecating the old USB stack? While it would be ideal to have the stable replacement available, is it necessary? The old stack has unfixable design issues and the sooner it is marked as deprecated the better IMHO.


Deprecation notice because of punycode

└─┬<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>my node version is 22.7.0

@Hugo-ter-Doest looks like an update of mongoose should solve this, do you want a pr?

mongoose should not be a required dependency


crates.io stub and docs.rs documentation

I really wish it was possible to view documentation for kani-the-lib, the one that provides all the any, assume, and proof stuff. However, since the kani crate on crates.io is a stub, docs.rs doesn't have any useful documentation.
So now if I want to read the docs, I have to
cd $KANI_HOME/kani-0.46.0/library/kani
cargo +nightly doc

which is not that convinient.
Could you please consider publishing an actual version of the lib to crates.io? If the reason for having it as a stub is to prevent users from downloading the wrong thing, maybe adding something like
#[cfg(not(docs)]
compile_error!("This is an internal crate. You were probably looking for `kani-verifier` instead.");

to the published version could be used?

Hi @GrigorenkoPV. Thanks for opening the issue. The documentation for the Kani library is currently available here:
https://model-checking.github.io/kani/crates/doc/kani/
This can be accessed from the Kani documentation page:
https://model-checking.github.io/kani/crates/index.html
We plan to publish the documentation on crates.io once we publish the kani crate.

Thank you for the response!

The documentation for the Kani library is currently available here:
https://model-checking.github.io/kani/crates/doc/kani/

We plan to publish the documentation on crates.io once we publish the kani crate.

Would it be feasible to update the stub in the meantime to feature a link to where the actual documentation can be found?

That's a good idea.


Add button for inserting a branching section

Closes #1262.
https://github.com/livebook-dev/livebook/assets/17034772/9e319c91-ff79-4c75-91a8-095351b0f104

if there are, pick the same parent as the previous

@josevalim I made it such that we always branch from the closest non-branching section. This way we are always branching out from the current main flow, which I consider more intuitive.

@josevalim updated :)


Hotfix/error message upload

Added error message if wrong json structure uploaded,
added tests for check it.
Closes #139

@pwalsh tests passed. I believe it is ready to be merged.

@gvidon can you please also deploy to heroku.


Error: "expected function but got 1" when trying to add 2 literals

Discord username
No response
What type of issue is this?
Permanent – Occurring repeatably
Is this issue blocking you from using Enso?

[ ] Yes, I can't use Enso because of this issue.

Is this a regression?

[ ] Yes, previous version of Enso did not have this issue.

What issue are you facing?
While exploratory testing Enso got weird bug:

While "1+2" returns proper result, the above renders error.
Expected behaviour
preview displaying result of the addition
How we can reproduce it?
create two integers
select one
create new node
type "+number2"
confirm creation of that node
watch error
Screenshots or screencasts
https://user-images.githubusercontent.com/108271897/235446623-e64a2fdc-41a6-4d37-be21-3b33d167d938.mp4
Enso Version
2023.5.1 nightly
Browser or standalone distribution
Standalone distribution
Browser Version or standalone distribution
standalone
Operating System
Windows
Operating System Version
Win11pro 22H2 22621.1555
Hardware you are using
12th Gen Intel(R) Core(TM) i9-12900HK / RTX3060 Laptop / Nvidia Drivers 531.68

Related #6485

We cannot interpret 1 +2 as an addition operation because Enso uses whitespace-precedence, meaning that
> 2 * 3+4
>>> 14

And not 10. Because 3+4 is bound more tightly, resulting in 2 * (3 + 4). This allows us to chain expressions without using brackets
1..100 . each random . take 10 . sort

Yes, I think when we finish the Epic with the component browser it should be visible for the user (as the input port will be visible, so it will be visible instantly that the spaces does not match). Or we could make a quick fix by just checking how many spaces we should add to have them equal in number.

@wdanilo please choose the solution from what @farmaazon is suggesting

@xvcgreg the description of this issue is confusing. You know the the case is n +n instead of n + n, as we were chatting about it on PW on Discord. This confusing description made @4e6 lose time to explain something we know. Sorry @4e6 for that.
Regarding the issue, when creating node +2 this way, the additional spacing should be automatically inserted. And I am OK with any solution that @farmaazon proposes here.

Also, I think I missed that in my previous reply - making it visible does not solve the issue. If we create a node while having other node selected +2 or .foo, the space should be automatically inserted even if it is visible that it will not match. So, if I have node 2 selected and I type +2 I end up with node1 + 2.
This solution has of course a downside. If the selected node output is a function and we want to provide to it a lambda (like +2), then it would be harder to do so. Then user would need to write (+2) or insert it with ctrl+enter. But I'm very OK with it as this use case is so rare, that we should optimize for more common cases.

Ok, let's clarify something:
Scenario 1
The user has some node selected and presses enter. The node appears with code
var1.| where | is a caret.
They type +. I guess at this moment we remove . (as it is in the design) and insert +, so we get
var1 + |
Or do we? Maybe doing it without space is better? (we just replace . without jumping too much).
var1+|
Scenario 2
The user has an existing node on their scene:
(some.very complex x->expression)+
I guess starting editing at the end and typing 2 should not add any space anywhere?

Scenario 1
This is more tricky. If the user writes +2 the code has to be either var1 + 2 or var1+2, because var1 +2 would not work. So we need to be careful about spacing from both sides of the operator. I'd always prefer a code with spaces, as it's easier to read. I'm not sure though if this answer provides you with the full answer to your question.
Scenario 2
No, we co NOT add any spacing here. We are talking only about more intelligent spacing when creatingg a new node after pressing tab when having a node selected prior to pressing tab.

Ad 1. I also think spaces looks nicer. So the result of typing + would be transition var1.| to var1 + |. However, there is:
Scenario 1A We have input var1.| and user wants to use operator >=. They type >: now, shall we put var1 > |? That would make adding = harder.


v2.0.4

[Switch] [TextField] enhancements to support Preact

Coverage remained the same at 91.989% when pulling 778c5e6eb7310882b4a03921245f285756f87d24 on v2.0.4-release into e7808e3c41941643d297a812f2f246b2c7d94f6f on master.


fix(plugin): type error and use talker() instead

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


[Bug]: On PDF export, hyperlinks do not navigate to the correct page

Minimal, reproducible example
import puppeteer from 'puppeteer';

const browser = await puppeteer.launch();
const page = await browser.newPage();

// Set test content.
await page.setContent(`<!DOCTYPE html>

    <meta charset="UTF-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Table of Contents Example</title>

Title Page

Welcome to this document.

Table of Contents

Page 1

Page 2

Page 3

Page 4

Page 1

Content for page 1.

Page 2

Content for page 2.

Page 3

Content for page 3.

Page 4

Content for page 4.

`);

    const pdfBuffer = await page.pdf({
      // format: 'A4',
      printBackground: false,
      preferCSSPageSize: true,
      waitForFonts: true,
      omitBackground: true,
      tagged: false,
    });

await browser.close();

// send the pdf buffer as API response

Background
I am trying to export my webpage to PDF. Everything seems to workfine except hyperlink navigations
Expectation
The navigation works fine on the webpage
Reality
On PDF export, navigation jumps ahead by few pages. There seems to be a pattern to the jump. The number of page breaks before the target seems to influence the jump offset,
Puppeteer configuration file (if used)
No response
Puppeteer version
22.13.0
Node version
20
Package manager
npm
Package manager version
10.5.0
Operating system
Windows

Sounds like a duplicate of https://github.com/puppeteer/puppeteer/issues/12601 Please let me know if it's not. The issue should be fixed in latest (Canary) Chrome builds.


config file error makes it impossible to reproduce

Hey,
I try to run the following code:
python3 src / main.py --config = categorical_qmix --env-config = sc2 with env_args.map_name = 2s3z
and
python3 src / main.py --config = tar_qmix --env-config = sc2 with env_args.map_name = 2s3z
I found that due to a config error, it cannot be run directly. I modified the runner: "parallel"-> runner: "parallel_x", and modified the representation of the parameters, such as 1e-2-> 0.01
But in the end it still can't run, can you provide complete and runable config file to help others to reproduce?

Hi,
Can you provide more debug information?

Below is the corresponding error message：
[ERROR 10:21:48] pymarl Failed after 0:00:42!
Traceback (most recent calls WITHOUT Sacred internals):
  File "src/main.py", line 35, in my_main
    run(_run, _config, _log)
  File "/home/xxxxxxx/NDQ/src/run.py", line 60, in run
    run_sequential(args=args, logger=logger)
  File "/home/x x x x x x x/NDQ/src/run.py", line 227, in run_sequential
    learner.train(episode_sample, runner.t_env, episode)
  File "/home/xxxxxxx/NDQ/src/learners/categorical_q_learner.py", line 184, in train
    loss.backward()
  File "/home/xxxxxxx/anaconda3/envs/sc_roma/lib/python3.6/site-packages/torch/tensor.py", line 195, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph)
  File "/home/xxxxxxx/anaconda3/envs/sc_roma/lib/python3.6/site-packages/torch/autograd/__init__.py", line 99, in backward
    allow_unreachable=True)  # allow_unreachable flag
RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.cuda.FloatTensor [32, 67, 5, 11]], which is output 0 of SliceBackward, is at version 1; expected version 0 instead. Hint: enable anomaly detection to find the operation that failed to compute its gradient, with torch.autograd.set_detect_anomaly(True).

It seems that this is not a config file error.

What is the version of your pytorch?

Changed to 0.4, it looks like it can run for a while. Thanks for the quick response.
I still suggest that you modify your current config file, the problems are as I mentioned above

Changed to 0.4, it looks like it can run for a while. Thanks for the quick response.
I still suggest that you modify your current config file, the problems are as I mentioned above

We have updated the README, including the detailed command to reproduce the results in our paper.
Thanks for your comments.

Thank you for your very quick reply and great work.


import base style.css errors on build

This is possibly a webpack issue and inexperience problem on my part. But after following the guidelines to allows all css to be loaded within the app
ie. import 'preact-material-components/style.css';
webpack throws a major hissy with the following
Unrecognised input. Possibly missing opening '{' in /node_modules/preact-material-components/style.css (line 6, column 5136)
Webpack version:
"webpack": "4.2.0",
"webpack-cli": "^3.1.0",
"webpack-dev-server": "^3.0.0"
Webpack Config CSS Rules
{
	// Transform our own .(less|css) files with PostCSS and CSS-modules
	test: /\.(less|css)$/,
	include: [path.resolve(__dirname, 'src/components')],
	use: ExtractTextPlugin.extract({
		fallback: 'style-loader',
		use: [
			{
				loader: 'css-loader',
				options: { modules: true, sourceMap: CSS_MAPS, importLoaders: 1, minimize: true }
			},
			{
				loader: `postcss-loader`,
				options: {
					sourceMap: CSS_MAPS,
					plugins: () => {
						autoprefixer({ browsers: [ 'last 2 versions' ] });
					}
				}
			},
			{
				loader: 'less-loader',
				options: { sourceMap: CSS_MAPS }
			}
		]
	})
},
{
	test: /\.(less|css)$/,
	exclude: [path.resolve(__dirname, 'src/components')],
	use: ExtractTextPlugin.extract({
		fallback: 'style-loader',
		use: [
			{
				loader: 'css-loader',
				options: { sourceMap: CSS_MAPS, importLoaders: 1, minimize: true }
			},
			{
				loader: `postcss-loader`,
				options: {
					sourceMap: CSS_MAPS,
					plugins: () => {
						autoprefixer({ browsers: [ 'last 2 versions' ] });
					}
				}
			},
			{
				loader: 'less-loader',
				options: { sourceMap: CSS_MAPS }
			}
		]
	})
},

The error seems to point to this line {--mdc-ripple-fg-opacity: .16}. I am presuming this is something to do with css-loader not understanding this. I will update the module and see if that negates the issue.

oh your config does not recognizes css variables, i am not sure how to fix it though

just closing cuz its a webpack issue, feel free to comment

OK understood. Thanks

As css-loader and postcss-loader don't have problems with it, I would probably have a look on the less-loader.


Installation failing on Ubuntu 19.x

Description
Installation failing on Ubuntu 19.x
Steps to Reproduce

Download the deb file Brackets.Release.<IP_ADDRESS>-bit.deb
sudo apt install

Expected behavior: Should install successfully
Actual behavior: Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
brackets : Depends: libcurl3 but it is not installable
E: Unable to correct problems, you have held broken packages.
Versions
Ubuntu 19.10
libcurl4 is installed already.

This solution worked for me on Debian 10
https://github.com/adobe/brackets/issues/14171#issuecomment-389584065


[PE-D][Tester B] Minimum Screen Resolution does not show Command entering and result panel

We don't even have a scroll pane vertically which hinders the user to know that command entering panel and result panel exists
Suggestion: Minimum resolution window should show all the panels currently in it

Labels: severity.Medium type.FunctionalityBug
original: Anvita2110/ped#21

Added into "Known Issues" section in the UG, @AlphaPyke can consider adding as an enhancement into the DG as well.


Colorbox add site logo in sidebar

This is a port of a similar feature in Pelican that allows specifying a logo filename to replace the text of the gallery name in the sidebar.

@brentbb - Thanks, it looks useful. However I think it would be better to put the logo by default in static/ directly (maybe not all themes have a images/ sub-directory) and btw avoid to hard-code images/ in the logo url.
Also it would great if you can squash your commits to remove the merge commits, and then you can add yourself to the AUTHORS file.

Merged manually (a102780), thanks!


Secure config api

Coverage decreased (-0.3%) to 89.744% when pulling b12e2d5f770ebe581e21aa64561b995beadc5726 on get-config-api into 5e8428d78758125c5e1f316ea42f4579991ea0b4 on master.


Parameter parsing

This wasn't actually very hard honestly.
Fix #39
Limitations:

doesn't know if the parameters are in the 'right' place. Eg you can't use a parameter in place of an identifier, but it doesn't know that. Eg, this is not valid SQL: select ? from foo, but this is: select x from foo where y = ?

@MasterOdin let me know what you think. This doesn't actually break the v2 API, just adds a new field.

Yeah, the limitation is centered around the fact that we aren't implementing a true AST parser here. I have plans to work on a general (with dialect support) SQL AST parser in JS, just haven't found the time yet to do it, which would certainly be a v3 or v4 addition to be more precise in parsing.

Thanks for doing the extra work on this! Been a crazy few weeks.


donet run error

i run dotnet run in vscode on mac and show error like
System.ArgumentOutOfRangeException: startIndex cannot be larger than length of string. (Parameter 'startIndex')
at System.String.Substring(Int32 startIndex, Int32 length)
at System.String.Substring(Int32 startIndex)
at Microsoft.DotNet.Tools.Run.RunCommand.TryGetTargetArchitecture(String runtimeIdentifier, Nullable`1& targetArchitecture)
at Microsoft.DotNet.Tools.Run.RunCommand.GetTargetCommand()
at Microsoft.DotNet.Tools.Run.RunCommand.Execute()
at Microsoft.DotNet.Tools.Run.RunCommand.Run(String[] args)
at Microsoft.DotNet.Cli.Program.ProcessArgs(String[] args, TimeSpan startupTime, ITelemetry telemetryClient)
at Microsoft.DotNet.Cli.Program.Main(String[] args)

Can you please share the exact command line which produces this error? Also, the output of dotnet --info will be helpful to identify the issue.


i18n(es): update solid-js

Description (required)
updates solid-js

Related issues & labels (optional)

Closes # N/A
Suggested label: i18n

Lunaria Status Overview
🌕 This pull request will trigger status changes.

Learn more
By default, every PR changing files present in the Lunaria configuration's files property will be considered and trigger status changes accordingly.
You can change this by adding one of the keywords present in the ignoreKeywords property in your Lunaria configuration file in the PR's title (ignoring all files) or by including a tracker directive in the merged commit's description.

Tracked Files

Locale
File
Note

es
guides/integrations-guide/solid-js.mdx
Localization changed, will be marked as complete.

Warnings reference

Icon
Description

🔄
The source for this localization has been updated since the creation of this pull request, make sure all changes in the source have been applied.


Constantly crashes on Windows. Will not re-open until system is rebooted

Hi guys,
Atom is repeatedly crashing on windows (it happens after about 5-10 minutes of usage). (version 1.2.4)
Nothing seems to fix the issue.
Unfortunately, when it crashes, it produces no reports that I can see.
The interesting part is that I can't re-open atom until I reboot windows. Even attempting to run it with the --safe tag makes no difference, it simply will not open. 3 processes start, and I can see them in task manager, but nothing I do causes any windows to open.

What if you launch with atom --safe the first time you run Atom after a reboot?
How did you install Atom?
Where did you install Atom?

Also, can you try the following:

Reboot your machine
Do not launch Atom yet
Move the $HOME\.atom directory somewhere else
Launch Atom using atom --safe

And see if that reproduces the issue.

What if you launch with atom --safe the first time you run Atom after a reboot?

Trying this now after deleting the .atom folder. So far no crashes. The only plugin I had installed though was the react.js one.

How did you install Atom?

Windows installer on the website

Where did you install Atom?

Default location from installer

I tried what you request

Let us know if moving the .atom folder fixes it. If so, it was either a wedged piece of serialized state or something in your configuration. If you wouldn't mind holding on to that moved folder, it might be helpful in debugging this later.

It sort of fixed it. It crashed again - running in safe mode. This time however I was able to start it back up in safe mode without rebooting windows.

Which version of Windows are you running?
/cc @raelyard @50Wliu for ideas on where crash logs might be stored.

I'm guessing Windows 7 - let's see if that's right.  Strange locks that don't resolve with a reboot is something I've seen there but nowhere else.  Perhaps duplicate of/related to #9644.
Crash dumps get written to: %LocalAppData%\Temp\Atom Crashes
Typically with a crash that writes a dump, you'll see a dialog saying "The Editor has crashed" or something like that.

I was running Windows 7.
After not being able to deal with the issue, I thought it mightve been some virus (had a few other issues and it had been years since I'd reformatted), I decided to reformat and install windows 10.
Unfortunately other weird file locking issues are persisting.
Up until a few minutes ago, I was having the same issue as this guy https://github.com/yeoman/generator-angular/issues/1208
For whatever reason, the grunt file watcher/cleaner doesn't seem to play well with atom at all.
I just randomly get locked out of files and have their permissions/ownership changed until I reboot.

Given you no longer have problems since upgrading to Windows 10 and that we don't have a repro I'm going to close this bug for now. Please re-open if the problem comes back.


Errors occur when connecting through corporate proxies.

Is this feature request related to a new or existing Amplify category?
No response
Is this related to another service?
No response
Describe the feature you'd like to request
Error downloading UI components when connecting through corporate proxies.
Describe the solution you'd like
I would like to see the HTTPS_PROXY environment variable referenced at the point where the node-fetch API is used so that the proxy is used.
Describe alternatives you've considered
As with /packages/amplify-cli-core/src/banner-message/index.ts, add proxy-agent as an option if the environment variable HTTPS_PROXY is set.
Otherwise we would like fetch to be called without proxy-agent.
Additional context
No response
Is this something that you'd be interested in working on?

[ ] 👋 I may be able to implement this feature request

Would this feature include a breaking change?

[ ] ⚠ This feature might incur a breaking change

Hey 👋 thanks for raising this! marking this as feature request.


Refer to GitHub repo for deployment steps

OPS Build status updates of commit d9cd2a6:
:warning: Validation status: warnings

File
Status
Preview URL
Details

bread/toc.json
:warning:Warning

Details

toc.json
:warning:Warning

Details

building-blocks/extending-templates/toc.json
:warning:Warning

Details

docs/reference-architectures/data/stream-processing-databricks.md
:white_check_mark:Succeeded
View

bread/toc.json

[Warning] Error happen when converting bread/toc.json to Pdf. Details: Could not find a part of the path 'T:\mvvu\bread\toc.json'.

toc.json

[Warning] Error happen when converting toc.json to Pdf. Details: Could not find file 'T:\mvvu\toc.json'.

building-blocks/extending-templates/toc.json

[Warning] Error happen when converting building-blocks/extending-templates/toc.json to Pdf. Details: Could not find a part of the path 'T:\mvvu\building-blocks\extending-templates\toc.json'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Remove PowerKPI screenshots for All env

@savvinsergey,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by Microsoft. We will now review your pull request.
Thanks,
Microsoft Pull Request Bot