Codegen does not produce compilable typescript queries.ts code

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
18.16.1
Amplify CLI Version
12.7.0
What operating system are you using?
Mac
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No
Describe the bug
After running amplify codgen to produce typescript code for a graphql API, the queries.ts file does not compile if the GraphQL API has a query function with no parameters.
Specifically the queries.ts code will have code like so that has a ts error:
` as GeneratedQuery<
  APITypes.GetProductsQueryVariables,
  APITypes.GetProductsQuery

The error is './graphql-schema' has no exported member APITypes.GetProductsQueryVariables
If you check the graphql-schema.ts file, you'll see there is no APITypes.GetProductsQueryVariables type defined. I assume because this function has no parameters and therefore there are no input variables to define.
Expected behavior
amplify codegen should produce syntactically correct queries.ts file.
Reproduction steps

Make sure you have a function in your graphql API that does not have any parameters, e.g:

type Query {
     getProducts: [Product!] @function(name: 'MyLambda-${env}')
}

Configure your .graphqlconfig.yml file to produce typescript graphql schema code like so:

projects:
   myGraphQLSchema:
    schemaPath: amplify/backend/api/MyAPI/build/schema.graphql
    includes:
      - frontend/projects/shared/graphql/**/*.graphql
    excludes:
      - ./amplify/**
    extensions:
      amplify:
        codeGenTarget: typescript
        generatedFileName: /my-graphql/graphql-schema.ts
        docsFilePath: my-graphql/
        region: us-east-1
        apiId: null
        maxDepth: 7
extensions:
  amplify:
     version: 3

Run amplify codegen and examine the resulting queries.ts file

Project Identifier
3def1a2bd59d61900f734d59f169a578
Log output

# Put your logs below this line

Additional information
No response
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

Hey @hisham, Thank you for bringing this to our attention. We were able to reproduce the issue by following the instructions outlined in the description. As a result, we're categorizing this as a bug for the team to investigate. Please note that the amplify push command is generating accurate queries.

looks like this has been fixed in the latest release btw.


Update based on feedback. Move of Button and made checkbox smaller

Coverage remained the same at 100.0% when pulling b1cc1b9206766a778dc1931808a2d10a78fb1365 on 193_HotFix_WronglyFormattedCheckbox into 704b4636bacb905d5eb2714a09bd05d390eff728 on dev.

Coverage remained the same at 100.0% when pulling 29b02c2b82c6864839187f3c9f6948097bf99100 on 193_HotFix_WronglyFormattedCheckbox into 704b4636bacb905d5eb2714a09bd05d390eff728 on dev.


Spawning duplicate components is inconsistent

Bevy version
Bevy 0.9.0 / 7231e00507
What I did
Since the addition of Bundle/Component agnostic spawns, the way bevy handles duplicate components is inconsistent.
Depending on how components are spawned, it either leads to a panic or just the first value of the component being overwritten.
Here, both SpatialBundle and TransformBundle have a Transform and GlobalTransform. When spawning them together with a spawn(<TUPLE>), it panics, but if I spawn them separately, it doesn't panic:
// THIS PANICKS!!!
commands.spawn((
  TransformBundle::default(),
  SpatialBundle::default(),
))
// THIS just overwrites the GlobalTransform and Transform components
commands.spawn(TransformBundle::default())
  .insert(SpatialBundle::default())

What I expect
I expect neither version to panic.

For your first example, how would do you propose we handle:
.spawn((TransformBundle {transform: Transform::from_xyz(10, 20, 30),
SpatialBundle {transform: Transform::from_xyz(30, 20, 10)}));

There's no meaningful sense by which not erroring can be the correct behaviour when completing the inserting in a single call, because there is no ordering within a Bundle, and adding that would also be a significant footgun (e.g. (CarefullyConstructedTransformIWant, BundleWithTransform) would delete your carefully constructed Transform). It would also make the field ordering public API, which is a terrible idea.
And if that's the case, then we may as well just panic for all these cases, rather than needing to think about the extremely awkward consequences of allowing overwriting; the bundle insertion code is already nasty enough without having to make sure this case would be sound too.
(Allowing it when both are exactly the Default would be permissible in theory, but it would also be an expensive footgun to check, and still has the issue of needing to make sure the implementation is sound).
If the issue is with it being inconsistent, perhaps we should make both versions panic?

A few things:

I found myself hitting that panic a few times already in different contexts, and had to revert to using the old "two inserts" way. So removing that escape hatch would be pretty annoying
I'd love to see a compile time error for this. Would it be possible? For a flat struct that derives Bundle this is trivially possible. I don't think duplicate in tuples is much an issue (as it wasn't an issue with the old way of doing it)
Currently it's very difficult to fix the code, because the panic message is very vague. It goes:

Bundle (bevy_pbr::bundle::MaterialMeshBundle<bevy_pbr::pbr_material::StandardMaterial>,
bevy_transform::components::transform::Transform) has duplicate components

For this particular example, it is fine, but when you have two distinct bundles with a matching component, especially from 3rd party crates, it becomes quickly intractable.
I'd be strongly against panicking in all case as long as the error message is not more helpful.
I'll give more concrete example where I hit this issue, but it's already late for me so I'll have to leave that for tomorrow.

#6660 contains a compelling use case for non-panicking duplicate components. Reproducing here.

Note: B0004 recommends adding a SpatialBundle to the parent entity. However, following the advice for this particular situation since 0.9 will result in a panic because both Camera3dBundle and SpatialBundle add the GlobalTransform and Transform components (see #6622).
Following this, user AllenDang decided to replace SpatialBundle with the ComputedVisibility component. But for visibility propagation to work, both ComputedVisibility and Visibility components must be present. Hence, the child light was still invisible.
The fix was to add VisibilityBundle  to the parent, rather than SpatialBundle or ComputedVisibility alone.

#6622

I think the current behavior should be the one adopted. I think the only thing necessary would be to document the behavior


full 8 bit quantization generates unreasonable quant_scale for uint8 on input tensor

1. System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 20.04
TensorFlow installation (pip package or built from source): pip package
TensorFlow library (version, if pip package or github SHA, if built from source): 2.6.0

2. Code
def representative_dataset():
    for img in imgs: # img are shape (224,640,3)
        data = np.expand_dims(img, axis=0)
        yield [data.astype(np.float32)]

converter = tf.lite.TFLiteConverter.from_keras_model(model) # path to keras model
converter.optimizations = [tf.lite.Optimize.DEFAULT]
converter.representative_dataset = representative_dataset
converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS_INT8]
converter.inference_input_type = tf.uint8
converter.inference_output_type = tf.uint8
#converter.experimental_new_quantizer = False

tflite_quant_model = converter.convert()
open(f"converted_model.tflite", "wb").write(tflite_quant_model)

Keras Model: https://cloud.haw-hamburg.de/index.php/s/FPxeczAoaJJgMly (Password: tf)
Tensorflow Lite converted Model: https://cloud.haw-hamburg.de/index.php/s/m9RKnJdOtHg8K3I (Password: tf)
3. Failure after conversion
If the conversion is successful, but the generated model is wrong, then state what is wrong:
The conversion succeeds but the quant_scale provided by the 'input_details["quantization"]' on the input tensor seems wrong. It is set to 0.029... which would map my float32 [0.0-1.0] images to [0-34] (zero_point = 0). That are a lot of details gone on the input, which makes the model perform bad.
When I set the 'experimental_new_quantizer' to 'False', it geneartes 0.0039... for quant_scale and still 0 for zero_point. That would map my images to [0-255], but the invoke fails with an error, that the input tensor lacks data.
To my knowledge, the quant_scale is calculated by (max-min) / quant_range. quant_range is 255 for uint8. Where does the min max come from? from the representative dataset? I have checked that my representative dataset does not go below 0.0 or above 1.0.

The latest recommended way is to use tf.int instead of tf.uint, is there any specific reason you're using uint?

just for convenience. If I convert my model using int8, I still get 0.027 as scale, just with -128 as zero point. That maps my float32 [0.0, 1.0] to [-128, -91]. I am wondering why I am getting these scales. A color depth of around 37 is not usable in my case.

When I try it on a different machine, I get a scale of 0.074 which is even worse. Any ideas?

Could you please provide the code for the model part to analyze more on this issue.
Refer to our post training quantization document for more details https://www.tensorflow.org/lite/performance/post_training_quantization

What is the "model part"? The only thing needed is the provided code above to reproduce the problem. By checking the quant_scale you can already see that there is something off. Besides, the quant scale differs with different tensorflow versions on the same model.

The Keras model which you have provided in the link here  https://cloud.haw-hamburg.de/index.php/s/FPxeczAoaJJgMly is not loading anything.
Could you please share the same Keras model information using the colab Gist. Thanks!


Add default manifest and API controller for loading it

This PR adds a copy of the v1.0.0 manifest at config/default-manifest.json, and adds a new API endpoint at /api/migration_analytics_manifest for fetching it in the UI.
The API call will:

Check to see if there is a user-provided manifest at /tmp/migration-analytics-manifest.json on the appliance, and use that manifest if it is present and contains valid JSON.
If no valid tmp_manifest is present, it will instead use the default manifest stored in the gem.
Return an object with the following properties:

tmp_manifest_present (boolean) - whether or not there is a file at /tmp/migration-analytics-manifest.json
tmp_manifest_valid (boolean) - whether or not there is a valid JSON file at /tmp/migration-analytics-manifest.json
path (string) - the path to the manifest JSON file being used
body (object) - the parsed contents of the manifest JSON

We can use this to load a manifest into the UI, and:

Display the current version of that manifest
Indicate whether the user's manually provided manifest is being used or is invalid
Pass it to the data collector API (still to be developed).

@Fryguy now that I'm adding some real Ruby code to this repo, we'll need to set up Ruby unit testing stuff and fix the setup/update scripts (https://github.com/RedHatCloudForms/cfme-migration_analytics/issues/2), which I could use some help with.
Also, based on some discussions with @agrare, I'm not sure exactly how we should move forward with the API for running the data collector and downloading the file. We'll need to:

Add an API endpoint that takes the manifest and selected providers, and calls Cfme::CloudServices::InventorySync::bundle_queue
Add some way of exposing the output .tar.gz file from that task as a URL the user's browser can download from (this is tricky, I have no idea where to start... @agrare suggested we could specify a server_guid when calling bundle_queue to make sure the file ends up on the same server as the API, and then make sure we're specifying a destination path that is within the apache root, and using that context to produce a URL?)
Add some mechanism for cleaning up the old .tar.gz files, maybe as a scheduled task? I also have no idea where to start here.

Are you guys (@Fryguy @agrare) still planning to develop all of the above, or do we need to get some help from @djberg96 and others? I know they are busy with Warm Migration for IMS, and I know you guys are busy too. But I'm a little worried that by offering to help take a stab at some of this stuff I gave the impression that I had it all covered, and if we do really need to get this done for the code freeze on Monday, I don't think I'll be able to build it on time myself considering I'm a JS guy learning Ruby/Rails as I go.
Thanks for all the help so far.
cc @bthurber

@abellotti can you help review this from the API side?

@mturley I tested with my local changes and I had to re-enable vmdb_plugin? in the engine here to get the manageiq-api to mount this plugin's API, after that it worked great

@agrare we have vmdb_plugin? disabled here just because @bthurber asked for the UI to be hidden in current builds. Do you think I should re-enable it in this PR? It would certainly make it easier to test these changes on appliance builds, but it would mean the UI can be reached if you know the URL. That's probably fine, I assume, but I'll check with others.

@agrare we have vmdb_plugin? disabled here just because @bthurber asked for the UI to be hidden in current builds. Do you think I should re-enable it in this PR? It would certainly make it easier to test these changes on appliance builds, but it would mean the UI can be reached if you know the URL (I think?). That's probably fine, I assume, but I'll check with others.

The only requirement we have is that MA isn't visible as an option under Migration in the UI with the ability to add it back to the menu if needed.  Similar to what we did for IMS 1.0 beta.

@agrare we have vmdb_plugin? disabled here just because @bthurber asked for the UI to be hidden in current builds. Do you think I should re-enable it in this PR? It would certainly make it easier to test these changes on appliance builds, but it would mean the UI can be reached if you know the URL (I think?). That's probably fine, I assume, but I'll check with others.

The only requirement we have is that MA isn't visible as an option under Migration in the UI with the ability to add it back to the menu if needed. Similar to what we did for IMS 1.0 beta.

Okay thanks @bthurber, I'm fine leaving vmdb_plugin? false for now but we'll need to turn it on for the API to work.  Without the UI the API isn't really helpful though anyway so its really just an issue for testing/development.

Ivanchuk backport details:
$ git log -1
commit 3b1e74f9e81a9812ce0358618b66be8bbcfe1194
Author: Adam Grare<EMAIL_ADDRESS>Date:   Thu Aug 8 11:57:10 2019 -0400

    Merge pull request #8 from mturley/manifest-api-endpoint

    Add default manifest and API controller for loading it

    (cherry picked from commit 3847740a36fa5bb0a4fcad174160d1419165cb7c)


[Wallet] Wallet connexion - Mobile behaviour

Feature: [Wallet] Wallet connexion - Mobile behaviour

As an end-user navigating the portal on a Mobile
I want to connect my wallet
So that I have access to my know balance in order to accomplish transactions on the portal

Acceptance criteria
Scenario 1: Log in - Keplr available on mobile
Given that I am an end-user navigating the portal (on mobile)
When I click on wallet icon

icon is white when disconnected

and I have keplr on my mobile
Then a redirection page is shown on the screen with the following text

OPENING KEPLR...
You are being redirected to Keplr App to connect your wallet. This may take a few seconds.

Scenario 2: Log in - Keplr not available on mobile
Given that I am an end-user navigating the portal (on mobile)
When I click on wallet icon

icon is white when disconnected

And I don't have keplr on my mobile
Then a snackbar page is shown on the screen with the following text

KEPLR APP NOT AVAILABLE ON YOUR MOBILE
Please download the app to connect your wallet

And the snackbar closes automatically after 5 seconds
When the snackbar is displayed
And I want to close it before 5s
Then I click anywhere on the screen outside the snackbar
Scenario 3 : Log in - Wallet connected (on mobile)
Given that I am an end-user
And Keplr app has launched
When my Keplr account is connected
Then the wallet icon changes its colour to orange with a light background
Scenario 3 : Wallet menu (on mobile)
Given that I am an end-user
And my Keplr account is connected
When I click on the orange wallet icon
Then the wallet menu is dropped down
And the menu has

Public key
KNOW balance
Log out Button

Scenario 4 : Log out button
Given that I am an end-user with a connected wallet
And the wallet menu is dropped down
When I click on the Log out button
Then my kepler wallet is to be logged out
And the menu takes its initial state of white wallet icon
Scenario 5 : Internationalisation
ENG:
Dropdown menu :

KNOW
Log out

Keplr not available snackbar :

KEPLR APP NOT AVAILABLE ON YOUR MOBILE
Please download the app to connect your wallet

Redirection screen :

OPENING KEPLR
You are being redirected to Keplr App to connect your wallet. This may take a few seconds.

FR
Dropdown menu :

KNOW
Déconnexion

Keplr not available snackbar :

L'APPLICATION KEPLR N'EST PAS DISPONIBLE SUR VOTRE MOBILE.
Veuillez télécharger l'application pour connecter votre portefeuille.

Redirection screen :

OUVERTURE DE KEPLR
Vous êtes redirigé vers l'application Keplr pour connecter votre portefeuille. Cela peut prendre quelques secondes.

DE
Dropdown menu :

KNOW
Abmelden

Keplr not available snackbar :

KEPLR APP NICHT AUF IHREM HANDY VERFÜGBAR
Bitte laden Sie die App herunter, um Ihre Geldbörse zu verbinden

Redirection screen :

ÖFFNEN VON KEPLR
Sie werden zur Keplr App weitergeleitet, um Ihre Brieftasche zu verbinden. Dies kann ein paar Sekunden dauern.

Resources
Mockups
More detail about the wallet is available in the design system and Figma Dev

Environment

staging URL: https://app.staging.okp4.network/

Additional informations
None.

Definition of ready

[ ] title, description, and value statement
[ ] acceptance criteria (scenarios)
[ ] mockups (all devices and themes)
[ ] labels added
[ ] US presented to DEV team (refinement)
[ ] attached to an epic
[ ] estimation (planning poker)
[ ] external dependencies if applicable

The colour of the drop down menu is to be edited @SpicySalm0n

Hey team! Please add your planning poker estimate with Zenhub @0xLodz @amimart @AnjaMis @ccamel @ErikssonJoakim @lolottetheclash


I'm looking for advice


Pow extensions in API mode

Hello,
is it possible to use pow extensions in API mode?
My first attempts to implement them (email confirmation and password reset) in an API (umbrella) app weren't successful so I'm wondering if it's already possible at all, since docs only talk about a browser pipeline and failure messages were revolving around flash messages.
In case it should already work, I can provide more detailed error messages.
Thanks a lot!

You can use parts of them, but you'll have to set it up manually just like general API auth. I've planned a full guide at some point: https://github.com/pow-auth/pow_site/issues/14
There are two examples by @mreishus in the linked issue that shows how it's achieved.

Oh great, I will go through them.
Thanks a lot to you @danschultzer and @mreishus.

By the way is it planned to have guides for this in the near future?
For me having pow extensions work in an API app would be really useful, @danschultzer and @mreishus maybe we can coordinate efforts on this, so can I somehow help out?
Greetings


renderer: delete collapse related funcs and property

Delete custom.d.ts as we don't need svg, so we don't need declare this file
Delete StepDiff.tsx state as we don't need it any more

BTW I found those files not needed either, please delete them.

src/components/img/*.svg
collapse property of ChangedFile interface within src/types/index.ts

You can search globally for collapse to make sure it's thoroughly removed.

@mRcfps  Very appreciate your great work !


clearing the selection of modified symbols should be available in military symbol editor

As of right now, when I'm editing symbols using the modify tab, and I save my edits, the symbol I edited is still selected until I clear my selection in the core map ribbon. I'd like to have a clear selection button within the symbol editor itself, next to the save edits button in the symbol and label tabs. The goal of this would be so that users don't have to figure out where to find a clear selection button somewhere else in Pro.
@csmoore what do you think of this idea?

Seems like a good idea, it would be very easy to do (if we can clear all selections-like the clear selection button does - and not just the one selected item if multiple are selected)


get_fallback_certificate, init_stable_store

Hello,
I've tried to install the library locally and I'm encountering two main errors:
1. Missing Function in AssetsUtils.mo
In AssetsUtils.mo, I'm getting the error field get_fallback_certificate does not exist in module at line 1430.
The get_fallback_certificate function is imported from the CertifiedAssets library. However, after reviewing the CertifiedAssets module, I couldn't find any reference to get_fallback_certificate.
I'm assuming this is the repository for Certified Assets: https://github.com/NatLabs/certified-assets
Could there be an unpublished version of CertifiedAssets?
2. Questions About init_stable_store
Is init_stable_store supposed to be callable in the actor? I'm asking because:

The first parameter is supposed to be the canister_id, but we can't access it in the body of an actor.
There seems to be a discrepancy between the README (which shows no parameters when calling Assets.init_stable_store) and the actual implementation

I love the work that is being done here; this is going to be massively useful for the Motoko ecosystem.  Thanks!

Hey, thank you for the bug report and the kind words!
I seem to have pushed the changes for this library without updating the certified-assets library. I've fixed this now and published version 0.1.0 to mops<EMAIL_ADDRESS>which should resolve the issues you encountered.

Is init_stable_store supposed to be callable in the actor? I'm asking because:
The first parameter is supposed to be the canister_id, but we can't access it in the body of an actor.

The DFINITY team released a new Motoko version recently, that supports this feature: https://github.com/dfinity/motoko/releases/tag/0.13.2.
I'm not sure if this has made it into dfx yet, but you can install it through mops with mops toolchain use moc and then set the environment variable with export DFX_MOC_PATH=moc-wrapper.
Yes, there was a mismatch between the README and the actual implementation. This was from the initial design that has since been updated. I've updated the README to reflect the current implementation.
Let me know if you run into any other issues.


Release directory filenames

I've been looking at the Release directory: https://github.com/rancher/k3s/releases/tag/v0.6.1
As a new user it was a little confusing and so can I suggest the following amendments
hyperkube - should this have a platform architecture added - hyperkube-amd64?
hyperkube-arm64
hyperkube-armhf
k3s - should this have a platform architecture added - k3s-amd64?
k3s-airgap-images-amd64.tar
k3s-airgap-images-arm.tar - should this be renamed to armhf from just arm?
k3s-airgap-images-arm64.tar
k3s-arm64 downloads as k3s-arm64.dms
k3s-armhf downloads as k3s-armhf.dms
sha256sum-amd64.txt
sha256sum-arm.txt - should this be renamed to armhf from just arm?
sha256sum-arm64.txt
Source code (zip)
Source code (tar.gz)

Closing due to age.


Define symbolic name for the most up to date version of a component: "current" or "latest"

Context: Initiated as gitter conversation, we can use this issue as record. I personally don't like not being able to review desitions processes.
Goal: [paraphrasing @mojavelinux ] The idea is that you can bookmark the doc and it will be stable (always showing the most recent docs). [...] we definitely need to settle because we don't want to have to maintain redirects because we change it after we go live ;)
@djenks mentioned:
"Reading that sentence, it seems sort of clear that "latest" would be a better name for the "latest" version.
"current" and "most recent" are not obvious synonyms to me. "Latest" and "most recent" are pretty clear synonyms."
/cc @Mogztter

For me "latest", sounds better and is the word that comes naturally to me when thinking about software releases.
Also according to the dictionary "current" refers to something in motion which does not match my idea of releases, witch to me are more like fixed snapshots.

I want also suggest stable. latest feeld like "something from the HEAD commit of repository".

Stable is always tempting, but quickly rendered meaningless when you realize that it could refer to any past stable release. And while it might be accurate to say that stable is meant to refer to the URL being stable, that would be way too confusing.
It's important to note that "latest" is very well defined in Antora. Latest is defined as the greatest non-prerelease. See https://docs.antora.org/antora/2.3/how-component-versions-are-sorted/#latest-version
Btw, I did do a poll about this. "latest" was the clear winner among those who responded (108 votes). See https://twitter.com/mojavelinux/status/1323543716796096514

The slightly uphill battle we're facing is that many new sites are adopting "current". However, to me, that is a problematic term. Current to whom? It could be interpreted as the release the user is currently on, which is not necessarily the one that was just released.
There isn't a perfect term. But from my perspective, "latest" has been long used in tech to mean the latest stable release. And something that isn't stable is labeled as such, such as "unstable", "alpha", "beta", "next", "dev", or generally "prerelease".

I should at least mention that it is possible to use no segment at all (e.g., /asciidoctor/syntax-highlighting/. However, doing so seems to leave me very nervous because it makes it harder to configure redirects if we ever have to change it.

Thanks @Mogztter for findind previous conversations:

https://github.com/asciidoctor/asciidoctor.org/issues/977#issuecomment-721040165
https://twitter.com/joschi83/status/1323545234651947008

Unless I am missing somehting, I think it's pretty much "latest" then.

Thanks for the feedback!

For the AsciiDoc docs component, we are going to continue to use the exact version name "current" (unrelated to this issue). That's because the language doesn't yet have versions, but we anticipate it will in the future. We're reserving space for it. When we say "current" in this context, we mean "how it is known currently". In essence, it's the odd one out of the bunch.

resolved by PR #28


Update signature for Deterministic Helper

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[x] Make sure the PR title is formatted like:
[BEAM-<Jira issue #>] Description of pull request
[x] Make sure tests pass via mvn clean verify.
[x] Replace <Jira issue #> in the title with the actual Jira issue
number, if there is one.
[x] If this contribution is large, please file an Apache
Individual Contributor License Agreement.

This can be a protected, final method that specifically indicates that a
coder that is a component of this coder is not deterministic, and have a
more specific error message.

This is a better change than #3029, which improves the name, and makes it more obvious how to use properly

R: @lukecwik @kennknowles
@davorbonaci

None of these methods are used in the Dataflow Worker.

Changes Unknown when pulling 95bb2373062cb3a3037bbf2d96612cc741cc5d17 on tgroh:coder_deterministic_helper into ** on apache:master**.

This will not make the first stable release, so will require some minor changes. Primarily:
The static method will not be removed, but instead deprecated. All SDK callers will be ported away from that method onto the introduced "validateComponentDeterministic" method.

@tgroh, is this really needed still? Perhaps the status quo is simpler.

Closing as backwards incompatible. Filed https://issues.apache.org/jira/browse/BEAM-2579 for future work.

Closing as backwards incompatible. Filed https://issues.apache.org/jira/browse/BEAM-2579 for future work.


Added configuration "ProxyRedirect" for changing the "Location" and "Refresh" header fields of proxy server responses.

Added configuration "ProxyRedirect" for changing the "Location" and "Refresh" header fields of proxy server responses.
Context:	Configs, domain, route

example：            "ProxyRedirect": {
"http://www.flomesh.com/aa": "http://$http_host/ab",
"http://www.flomesh.com/a0": "/a1"
}


[FEATURE REQUEST] Add a flag to automatically path traverse every directory level

Is your feature request related to a problem? Please describe.
When a linked local resource is found, feroxbuster automatically adds its containing path to the scan queue.
For example we have a linked resource of:
https://target.local/adminUI/ressources/includes/secrethive.json on https://target.local/index.php
AFAIK (please correct me) only https://target.local/adminUI/ressources/includes/ gets added to the scan queue.
but what is about the following, where each of them could have their own set of findings:
https://target.local/adminUI/ressources/
https://target.local/adminUI/
Describe the solution you'd like
A flag to automatically parse links into their parts and add each path level to the scan queue if it wasn't in there before.
Describe alternatives you've considered
Manually adding links is quite exhausting.

Howdy, and thanks for reaching out! This should be happening already. Can you run it through burp or similar and verify it is or isn't? This has been the expected behavior since I added link parsing, so if it's not working as I intended we may ha e a bug.

since this functionality is implemented here, i'm going to assume this issue is invalid.
if you confirm that ferox is misbehaving (i.e. not adding those subpaths), please reopen the issue and we can discuss.


Fixed syntax error (Using RingRayLib)

Hello.
The following markup position is wrong. Could you check it.
.. index::
pair: Using RingRayLib; Functions

Thanks


Fix cdb processing when a file is skipped

This fixes a bug introduced in the new code in 2.6.3. We should release 2.6.4.

Are there no regression tests for this?

None that would have caught this. I've noticed this during the backport of changes to blt/port_compiler.

I'll extract that into a variable for good measure.

Investigating a build failure in https://github.com/travelping/gen_socket.

Fixed handling of multiple specs.


Generalize nlp routes supporting the use of different nlp services

We currently have an acd route and a separate route to feed the acd route based on unstructured data retrieved from applicable fhir resources.
This should be generalized, such that the route that extracts unstructured data from fhir resources can feed an nlp service rather than a specific nlp services. This will give lfh users greater flexibility in supporting alternate nlp services, of which there are many.

From lfh team mtg > look at integrating through the Kong API layer.
Have a metadata layer where you can overload the metadata based on the nlp engine being used and pass in the data payload. (we currently do not have a metadata layer).
Would like to see a demo RE different AI engine based on Henry's data to predict the proper Dx.
Show folks he we generalize across the different AI engines RE unstructured data.
Possible use case: find adverse rx events w/in clinical notes.

Sample Requests
Google Healthcare NLP
curl -X POST \
   -H "Authorization: Bearer "$(gcloud auth application-default print-access-token) \
   -H "Content-Type:application/json" \
   --data "{
    'nlpService':'projects/PROJECT_ID/locations/LOCATION/services/nlp',
    'documentContent':'Insulin regimen human 5 units IV administered.'
   }" \
   "https://healthcare.googleapis.com/v1beta1/projects/PROJECT_ID/locations/LOCATION/services/nlp:analyzeEntities"

Amazon Comprehend
Amazon appears to push users towards using their SDKs versus making straight-up http requests. Their apis use SigV4 signatures for authentication. It's technically possible, but according to a reply by an Amazon employee in the following thread, they don't consider comprehend to be a restful api > https://forums.aws.amazon.com/thread.jspa?messageID=882228


Added a size limit to the dynamic memory.

Clamped the size of the memory with the lowest and highest value of the slider in game as I was able to request as much as I wanted and cause an overflow.

I was going to complain that the clamping should be done by the cvar instead.

Doesn't seem to be one, but it could be added if someone needs more memory.

I meant as in, cvars have a feature for a min/max value so that could be used, but now that you mention it, the upper limit should be defined by a cvar.


@conda-forge-admin,please add bot automerge

Hi! This is the friendly automated conda-forge-webservice.
I just wanted to let you know that I added bot automerge in conda-forge/tqdm-feedstock#72.


MINOR: Optimize metric recording when quota check not required

In the selector code path, we record some values for some sensors which do not have any metric associated with them that requires quota. Yet, a redundant check for quotas is made which consumes ~0.7% of CPU time in the hot path as demonstrated by the flame graph below.

This PR is a minor optimization which removes the redundant check for quotas in cases where it is not required in the hot path.
Flamegraph after this PR (note that checkQuotas CPU utilization has been removed)

@mimaison please take a look when you get a chance.

Merged to trunk. @divijvaidya Thanks for the patch!


Relax bounds for ghc-9.0.1

All tests pass with ghc-9.0.1.

Closing because it is just bounds. I read the contributing guidelines after creating the PR.


Embedded ext tools

Add required external binaries for supported architecture.

please remove binaries from git with rewriting history to not increasing repository size but build/get_ext_tools.sh run at build stage as name of this catalog tells

Do we have jira ticket for removing jq/yq requirements from doc?

Not yet. Anyway, except of the uninstall.sh, old flow is supposed to be compatible with the new package, just downloading yq/jq is not needed, so I think there is no need to strictly synchronize docs with release.

binary changes still in diff

binary still in diff

please remove binaries from git with rewriting history to not increasing repository size but build/get_ext_tools.sh run at build stage as name of this catalog tells

I'll give travis cache a try, if I can keep:

builds reasonably fast (caching)
security (sha256 validation)
then I'll try to remove binaries from git repo as suggested.


about the data input of the RODNet model

Hi,
I want to test the model on a  customer datasets, which is the range,  azimuth and reflection(rcs) value. And i have trained the RODNet model based on the CRUW dataset . So how can I use my own datasets to test the RODNet model ?
Thanks for you help.

Hi, I want to test the model on a customer datasets, which is the range, azimuth and reflection(rcs) value. And i have trained the RODNet model based on the CRUW dataset . So how can I use my own datasets to test the RODNet model ? Thanks for you help.

Or  the value rcs and azimuth represent the real and imaginary parts ？

We haven't tested our model on other kinds of radar hardware. But as long as you have the same data format and annotations as the CRUW dataset, RODNet is supposed to handle it.
For the data representation, please refer to https://github.com/yizhou-wang/cruw-devkit/issues/10.


Tailwind CSS not working

Verify canary release

[X] I verified that the issue exists in the latest Turborepo canary release.

Link to code that reproduces this issue
https://github.com/react18-tools/nextjs-themes/tree/tailwind/examples/tailwind
What package manager are you using / does the bug impact?
pnpm
What operating system are you using?
Windows
Which canary version will you have in your reproduction?
1.11.0
Describe the Bug
I was just trying to add a tailwind example for one of my packages. I have followed the official docs. However, it seems that I am making some silly mistake here. It doesn't seem to apply tailwind styles.
Here's the code - https://github.com/react18-tools/nextjs-themes/tree/tailwind/examples/tailwind
No errors are thrown but the styles are not applied either.
Expected Behavior
Tailwind styles such as underline should be applied.
To Reproduce
git clone -b tailwind https://github.com/react18-tools/nextjs-themes.git
cd nextjs-themes
pnpm i
yarn dev --filter tailwind

Additional context
No response

This doesn't look to be a Turborepo bug. Two ways I've determined this:

If I use npx create-next-app to create another Next.js + Tailwind app in your examples folder, it works correctly.
If I run the dev script in examples/tailwind directly (cd examples/tailwind && pnpm dev, not turbo dev), there are still no styles. Running the script directly means Turborepo wasn't involved in any way.

There is likely to be some small misconfiguration in the application. I couldn't tell what it was at a glance, unfortunately, but I trust you'll be able to find it!

As an aside, when I was looking at your repo, it looks like you're git ignoring your lockfile.  Quick explanation from AI: https://sdk.vercel.ai/s/MvppSyx


Container json schema should have image be optional

As per the title, the container json schema should allow image to be optional. It's perfectly reasonable to set some templateDefaults that look like this:
  templateDefaults:
    container:
      name: main
      image: my-company-docker.jfrog.io/my-company/my-container:0.1.2
      env:
        - name: FOO
          value: "BAR"

and then omit the image from each template, to DRY the yaml schema. However, that's not possible because it results in an error:

kind of a bug, kind of an enhancement. Apologies if mis-categorized.

Container definition is coming from #/definitions/io.k8s.api.core.v1.Container

@sarabala1979 Sure. Does that mean the schema says it's required, but Argo won't actually mind if image is omitted? Or will it enforce the schema?
If so, I think it's worth considering changing it and maintaining an argo-specific container schema. Being forced to put values everywhere totally defeats the purpose of having templateDefaults

I'd love to have some follow up on this, it's pretty silly to have to update the image tags everywhere when we have something that's intended to single source default them

Can we reopen this? It's pretty silly to have templateDefaults that allow you to define some, but not all defaults


[Feature Request] Right-justified Text for right-justified header/footer

There should be a header-right and footer-right that right-justifies the text, too.

This is easily accomplished via the card mod:
    card_mod:
      class: middle-right
      style: |
        ha-card {
          text-align: right;
        }

Thanks @smugleafdev. I think I like that solution instead of introducing another several sets classes.


pass correct flag value to ConvertDataStructureToLookup in order to c…

…onvert lists in the java backend

@dwightguth please review

Jenkins: test this please

@cos please review

looks good.


Lb/reallife training tests

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.
Motivation
Internal  JIRA task
Modification
This change:
Adds  NNs against PCD dataset (tests/test_ote_training.py)
Adjusts expected f-metrics tests/expected_metrics/metrics_test_ote_training.yml
Logs from internal ci will be provided in internal JIRA task

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.0 out of 4 committers have signed the CLA.:x: eugene123tw:x: druzhkov-paul:x: LeonidBeynenson:x: GalyaZalesskayaYou have signed the CLA already but the status is still pending? Let us recheck it.

Sorry, I'm afraid that you opened a wrong pull request.


[Bug] [DB] KeyError: 'db_name'

Search before asking

[X] I had searched in the issues and found no similar issues.

Operating system information
Linux
Python version information
3.10
DB-GPT version
main
Related scenes

[X] Chat Data
[ ] Chat Excel
[ ] Chat DB
[ ] Chat Knowledge
[ ] Model Management
[ ] Dashboard
[ ] Plugins

Installation Information

[X] Installation From Source

[ ] Docker Installation

[ ] Docker Compose Installation

[ ] Cluster Installation

[ ] AutoDL Image

[ ] Other

Device information
CPU: 36G
Models information
LLM:tongyi
Embedding model:tongyi
What happened
ERROR:    Exception in ASGI application

Exception Group Traceback (most recent call last):
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_utils.py", line 87, in collapse_excgroups
|     yield
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 190, in call
|     async with anyio.create_task_group() as task_group:
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 680, in aexit
|     raise BaseExceptionGroup(
| exceptiongroup.ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
+-+---------------- 1 ----------------
| Traceback (most recent call last):
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 399, in run_asgi
|     result = await app(  # type: ignore[func-returns-value]
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
|     return await self.app(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/cors.py", line 93, in call
|     await self.simple_response(scope, receive, send, request_headers=headers)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/cors.py", line 148, in simple_response
|     await self.app(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in call
|     await super().call(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/applications.py", line 123, in call
|     await self.middleware_stack(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call
|     raise exc
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call
|     await self.app(scope, receive, _send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 189, in call
|     with collapse_excgroups():
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/contextlib.py", line 153, in exit
|     self.gen.throw(typ, value, traceback)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
|     raise exc
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 191, in call
|     response = await self.dispatch_func(request, call_next)
|   File "/opt/soft/DB-GPT/dbgpt/util/tracer/tracer_middleware.py", line 49, in dispatch
|     response = await call_next(request)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 165, in call_next
|     raise app_exc
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 151, in coro
|     await self.app(scope, receive_or_disconnect, send_no_error)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 65, in call
|     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
|     raise exc
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
|     await app(scope, receive, sender)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 756, in call
|     await self.middleware_stack(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 776, in app
|     await route.handle(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 297, in handle
|     await self.app(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 77, in app
|     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
|     raise exc
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
|     await app(scope, receive, sender)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 72, in app
|     response = await func(request)
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/fastapi/routing.py", line 278, in app
|     raw_response = await run_endpoint_function(
|   File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
|     return await dependant.call(**values)
|   File "/opt/soft/DB-GPT/dbgpt/app/openapi/api_v1/editor/api_editor_v1.py", line 95, in editor_sql_run
|     db_name = run_param["db_name"]
| KeyError: 'db_name'
+------------------------------------

During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 399, in run_asgi
result = await app(  # type: ignore[func-returns-value]
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
return await self.app(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/cors.py", line 93, in call
await self.simple_response(scope, receive, send, request_headers=headers)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/cors.py", line 148, in simple_response
await self.app(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/applications.py", line 123, in call
await self.middleware_stack(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call
raise exc
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call
await self.app(scope, receive, _send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/contextlib.py", line 153, in exit
self.gen.throw(typ, value, traceback)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_utils.py", line 93, in collapse_excgroups
raise exc
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 191, in call
response = await self.dispatch_func(request, call_next)
File "/opt/soft/DB-GPT/dbgpt/util/tracer/tracer_middleware.py", line 49, in dispatch
response = await call_next(request)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 165, in call_next
raise app_exc
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 65, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 756, in call
await self.middleware_stack(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 776, in app
await route.handle(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 297, in handle
await self.app(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 77, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/starlette/routing.py", line 72, in app
response = await func(request)
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/fastapi/routing.py", line 278, in app
raw_response = await run_endpoint_function(
File "/root/miniconda3/envs/dbgpt_env/lib/python3.10/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
return await dependant.call(**values)
File "/opt/soft/DB-GPT/dbgpt/app/openapi/api_v1/editor/api_editor_v1.py", line 95, in editor_sql_run
db_name = run_param["db_name"]
KeyError: 'db_name'

What you expected to happen
i don't know....
How to reproduce
use tongyi.
Additional context
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

数据库里是有这个库的，所有的数据库，mysql，sqlite，starrocks连接都是正常，打开数据对话就显示错误

你选择的对话是mysql数据库还报错么,另外你的 dbgpt版本是多少 可以升级下最新的试一下,我这边数据库对话都没问题我用的还是0.5.6版本

你选择的对话是mysql数据库还报错么,另外你的 dbgpt版本是多少 可以升级下最新的试一下,我这边数据库对话都没问题我用的还是0.5.6版本

请问你的数据库需要导入scheme吗？


How can I pull down phantom in sbt?  Readme needs an example.

I'm trying to get phantom without much luck.  From Sonatype version 1.20.0 and 1.21.0 are there but the jar file is empty.  On bintray there are lots more versions but I can't guess the group etc. to get sbt to download them?
Can this be added to the beginning of the readme document?  Just need a simple cut 'n paste example 1-liner for sbt for both of your 2 delivery methods.
Thanks!

https://github.com/websudos/phantom/wiki/Integrating-phantom-in-your-project

Hi @gzoller,
We have moved most of the documentation to the GitHub Wiki pages, our reasoning being quite simple. We can update the Wiki immediately at any time, without needing to merge pull requests, run CI builds, etc.
In the future, odds are most of the things you are looking for are addressed in the wiki. Hope this helps.
Regards,
Flavian


[hotfix][doc] There is a link redirection problem in the Chinese document of Checkpointing

What is the purpose of the change
There is a link redirection problem in the Chinese document of Checkpointing.
When I wanted to click on the link of 'working with state' in the Chinese document to get more information, the page jumped to 404, but when I checked the English document, I found that turn to correct page. So i fix the link of 'working with state' in the Chinese document.

Brief change log

Modify the link of 'working with state' in the Chinese document of Checkpointing.

Verifying this change
Please make sure both new and modified tests in this PR follows the conventions defined in our code quality guide: https://flink.apache.org/contributing/code-style-and-quality-common.html#testing
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no) no
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no) no
The serializers: (yes / no / don't know) no
The runtime per-record code paths (performance sensitive): (yes / no / don't know) no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know) no
The S3 file system connector: (yes / no / don't know) no

Documentation

Does this pull request introduce a new feature? (yes / no) no
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented) no

@flinkbot  run azure

@flinkbot run azure

Hi, @MartijnVisser I am sorry i just do the wrong thing about 'git rebase'. Now i did it again for 'master' branch. I am sorry for my mistake.

@WTZ468071157 No worries, we'll see the build pass and then we can approve and get it merged!

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure

Is there any thing wrong with this pr? Is there anything I can do?

@WTZ468071157 There is an issue with external tests, which causes the build to fail (see https://issues.apache.org/jira/browse/FLINK-25426). We need to retry at this moment unfortunately :(

@flinkbot run azure

@flinkbot run azure

@WTZ468071157 Can you please rebase your branch?

@MartijnVisser Oh, the ci test success finally! Thank you very much for helping me accomplish this pr.


{Misc.} Use short link for extension command tree

Description

Use a short link to prepare for migration to AME subscription.
The extension sync pipeline now builds the extension command tree and upload to storage accounts of both Corp subscription and AME subscription. At some point in the future, we can stop updating the file in the Corp subscription.
Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change.
[Component Name 2] az command b: Add some customer-facing feature.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

Misc

Misc


Add support for DS3231 in backwards-compatible way

By moving a few defines to the header file and adding an optional argument with default value to the square wave routines, this library can also support the DS3231. To use with DS3231, just pass 0x0E to the square wave routines and it will use that as the control register address. All existing DS1307 code is unaffected.

pardon the delay in replying. perhaps it would make more sense to make a new subclass so that it has a new name? most of the code is identical, could be a fairly simple copy & paste + mod...

Sure, I'll rework this and push the changes when I build another clock (you can never have enough clocks). I want to do some more testing anyway as it failed a couple of times on me recently. It won't be quick but I should get onto it this year some time...


Workaround for mTLS enabled Dapr endpoint.

Allows the DaprClient to work with mTLS enabled grpc endpoint when https endpoint is provided with DaprClientBuilder.UseEndpoint
It will be cherry-picked into 0.5.0 branch to realse a new nuget package.
The change will be reverted from master branch for 0.6.0 when the issue is fixed in Dapr runtime.
Fixes https://github.com/dapr/dotnet-sdk/issues/261

@amanbha Just tested this and it's working!!!


QG checks (Release 24.05)

Quality Gate Checklist
Please keep this issue open until QG is concluded and will be managed by the Issue Creator!
We will inform you about finding and proposals in separated issues, this issue here is for the Overview of the Checks!
Please keep this issue open until QG is concluded!
Product Owner: Ciprian Herciu
Dev SPOC: Aditya kumar
Helm Chart Version: 2.1.17
App Version: 2.1.11
Release Managemnet Reference Issue:
Check of Tractus-X Release Guidelines

Currently implemented automatic checks can be found under your product on our Release Guidelines Checks Board
This QG Check is depending on the mandatory information from our current Release Guidelines

TRG 1 Documentation

[x] TRG 1.01 appropriate README.md
[x] TRG 1.02 appropriate install instructions either INSTALL.md or in README.md
[x] TRG 1.03 appropriate CHANGELOG.md
[x] TRG 1.04 editable static files

TRG 2 Git

[x] TRG 2.01 default branch is named main
[x] TRG 2.03 repository structure
[x] TRG 2.04 leading product repository
[x] TRG 2.05 .tractusx metafile in a proper format

TRG 3 Kubernetes

[x] TRG 3.02 persistent volume and persistent volume claim is used when needed

TRG 4 Container

[x] TRG 4.01 semantic versioning and tagging
[x] TRG 4.02 base image is agreed
[x] TRG 4.03 image has USER command and Non Root Container
[x] TRG 4.05 released image must be placed in DockerHub, remove GHCR references
[x] TRG 4.06 separate notice file for DockerHub has all necessary information

TRG 5 Helm

[x] TRG 5.01 Helm chart requirements
[x] TRG 5.02 Helm chart location in /charts directory and correct structure
[x] TRG 5.03 proper version strategy
[x] TRG 5.04 CPU / MEM resource requests and limits and are properly set
[x] TRG 5.06 Application must be configurable through the Helm chart
[x] TRG 5.07 Dependencies are present and properly configured in the Chart.yaml
[x] TRG 5.08 Product has a single deployable helm chart that contains all components
[x] TRG 5.09 Helm Test running properly
[x] #143
[x] TRG 5.11 Upgradeability

TRG 6 Released Helm Chart

[x] TRG 6.01 Released Helm Chart

TRG 7 Open Source Governance

[x] TRG 7.01 Legal Documentation
[x] TRG 7.02 License and copyright header
[x] TRG 7.03 IP checks for project content
[x] TRG 7.04 IP checks for 3rd party content
[x] TRG 7.05 Legal information for distributions
[x] TRG 7.06 Legal information for end user content
[x] TRG 7.07 Legal notice for documentation
[x] TRG 7.08 Legal notice for KIT documentation

TRG 8 Security

[x] TRG 8.01 Mitigate high and above findings in CodeQL
[x] TRG 8.02 Mitigate high and above findings in KICS
[x] TRG 8.03 Mitigate high and above findings in GitGuardian
[x] TRG 8.04 Mitigate high and above findings in Trivy

Hints
Information Sharing

Hi @ciprianherciu,
Can you please provide following information?
Product Owner:
Dev SPOC:
Helm Chart Version:
App Version:

Product Owner: Ciprian Herciu
Dev SPOC: Aditya kumar
Helm Chart Version: 2.1.17
App Version: 2.1.10

Hey, I approve the TRG issue. Thanks @RoKrish14 for participating in the checks! The versions are:

app version: 2.1.12
chart version: 2.1.18


[5.3] Generate resource controller with type-hinted model instead of just id

Many of my resource controllers are now with type-hinted models, so I do not have in my code findOrFail. I have created a new stub and a new option --model or -m to specify a model to use.

You the man, you the hero

Thanks. I'm using this feature in my resource controllers almost exclusively so it made sense to have it in Laravel.

Same here, makes things more readable imho


Mapping atom_feature to actual atom types

Hi,
I struggle to find a way to map the atom_feature attribute to the actual atom (e.g. carbon). I would be more than thankful if anyone could point me to e.g. where this is defined in the source code. Generally, I think it might be worth considering to mention this somewhere in the documentation as well.

Hi, you can find how the atom_feature is constructed here. For atom type, the one-hot feature is constructed according to atom_vocab, which you can find in the same file.

Thanks, not sure how I oversaw that class. However, one clarification in case anyone has a similar issue: atom_type represents the atomic number and not the number given in atom_vocab here.


Computer storage bit

What do you think about the gigabit, like in 2.0 Gb RAM? I annotated it as unknown unit type:
<measure type="value"><num>2.0</num> <measure type="UNKNOWN" unit="Gb">Gb</measure></measure> RAM

Is it ok?

bit is a measure for INFORMATION, so I would say a measure type to be added.


Remove deprecated stuff

This removes a bunch of deprecated stuff, since master is now going to be a new major version. I'll make corresponding pull requests for any internal IE projects that are affected.

Actually, that iterator stuff is bothering me a bit. I didn't like the old it != it.end() stuff because of it's non-standardness, and I don't much like the !it.done() thing either, although I like that it isn't fundamentally broken.
There's also this ticket where we talk about wanting python equivalents for the filtered and recursive iterators, and it's always bothered me that our suggested approach (a descendants method) doesn't really mirror the C++ code in any way.
I think C++11 gives us the opportunity to deal with all of this much more nicely with a range based for loop. So rather than our iterator approach, we'd do something more like this :
for( IntPlug *p : RecursiveIntPlugs( node ) )
{
}

And that would map naturally to Python as something like this :
for p in RecursiveIntPlugs( node ) :
   ...

Any thoughts on that? I think the C++ implementation might be a bit fiddly, and it might be annoying to have lots of RecursiveBlahs classes in the Gaffer python module (when exploring via dir() etc). But other than that I like that the syntax would match the new C++ idioms where the old matched nothing, and the closer match to python would be great too.
I still think we should merge this, because those old iterator methods can be buggy, but I'd like to consider this for the future.

Yeah, it would be nice to have the python equivalent for sure. It may still be a while before we can get to full c++11 support though...


Upgrade fluent-bit to 3.0.4

What this PR does / why we need it:
Upgrades to upstream fluent-bit version 3.0.4
Which issue(s) this PR fixes:

Fixes #1175
Does this PR introduced a user-facing change?

Upgrade fluent-bit to version 3.0.4 addressing CVE-2024-4323

Additional documentation, usage docs, etc.:

@els-ipatel Thanks you!


invalid password error when logging in to leetcode.com endpoint

🐛 Bug Report
It shows 'invalid password?' error when I tried to login to my leetcode account through vscode snippet
To Reproduce
Login to the leetcode.com endpoint using user name and password
Expected behavior
Expected successful login to the leetcode /com endpoint
Extension Output
v10.22.1
Active  Name               Version         Desc
×     solution.discuss   2019.02.03      Plugin to fetch most voted solution in discussions.
√     company            2017.12.18      Plugin to query by company for free user.
√     cache              default         Plugin to provide local cache.
√     retry              default         Plugin to retry last failed request if autologin.enable is on.
×     leetcode.cn        2018.11.25      Plugin to talk with leetcode-cn APIs.
√     leetcode           default         Plugin to talk with leetcode APIs.
Active  Name               Version         Desc
√     solution.discuss   2019.02.03      Plugin to fetch most voted solution in discussions.
√     company            2017.12.18      Plugin to query by company for free user.
√     cache              default         Plugin to provide local cache.
√     retry              default         Plugin to retry last failed request if autologin.enable is on.
×     leetcode.cn        2018.11.25      Plugin to talk with leetcode-cn APIs.
√     leetcode           default         Plugin to talk with leetcode APIs.
Active  Name               Version         Desc
√     solution.discuss   2019.02.03      Plugin to fetch most voted solution in discussions.
√     company            2017.12.18      Plugin to query by company for free user.
√     cache              default         Plugin to provide local cache.
√     retry              default         Plugin to retry last failed request if autologin.enable is on.
√     leetcode.cn        2018.11.25      Plugin to talk with leetcode-cn APIs.
√     leetcode           default         Plugin to talk with leetcode APIs.
Active  Name               Version         Desc
√     solution.discuss   2019.02.03      Plugin to fetch most voted solution in discussions.
√     company            2017.12.18      Plugin to query by company for free user.
√     cache              default         Plugin to provide local cache.
√     retry              default         Plugin to retry last failed request if autologin.enable is on.
×     leetcode.cn        2018.11.25      Plugin to talk with leetcode-cn APIs.
√     leetcode           default         Plugin to talk with leetcode APIs.
[ERROR] You are not login yet?
login: pass: - Signing in leetcode.com
[ERROR] invalid password?
login: pass: - Signing in leetcode.com
[ERROR] invalid password?
login: pass: - Signing in leetcode.com
[ERROR] invalid password?
Your Environment

os: Windows 10
extension settings: leetcode.com endpoint, other settings are as default
nodejs version: 9.5
vscode version: 1.77.3
extension version: v0.18.1

leetcode.com   seems like us leecode,  but prompt is us not supported , i'm confused.  Meanwhile, i dont't find leecode.cn


Logger interception can fail

an exception was raised:
    ** (RuntimeError) build without intercepted logger []
(language_server 0.15.1) lib/language_server/build.ex:109: ElixirLS.LanguageServer.Build.reload_project/0

Originally reported in https://elixirforum.com/t/error-in-mixproject-with-elixirls/57099

It still happens on a regular basis. The detail is below. The current solution is to erase/reinstall.
an exception was raised:
    ** (RuntimeError) build without intercepted logger []
        (language_server 0.15.1) lib/language_server/build.ex:109: ElixirLS.LanguageServer.Build.reload_project/0
        (language_server 0.15.1) lib/language_server/build.ex:20: anonymous fn/3 in ElixirLS.LanguageServer.Build.build/3
        (stdlib 5.0.2) timer.erl:270: :timer.tc/2
        (language_server 0.15.1) lib/language_server/build.ex:14: anonymous fn/3 in ElixirLS.LanguageServer.Build.build/3
        (kernel 9.0.2) global.erl:477: :global.trans/4ElixirLS

@ndrean Please post a minimal repro

Looks like your update did the trick.

Looks like your update did the trick.

Good to hear that but I'd still want to know how the the language server ended up erroring in that place

It didn't matter which repo I was working on, all had the same error, so a minimal repo didn't make sense. Now it's just gone. Must have been the Elixir version?


Not able to complete yarn setup command

When i run the yarn setup command and paste the api keys it gives following error:
The following 1 errors and 0 warnings occurred:

11:13:70 - Error: Status: 403 - Forbidden - Message: The access token you sent could not be found or is invalid. - Request ID: 19f8ca41f0674308b5056cbbfb9d3223

Stored the detailed error log file at:
C:\Users\HP\Desktop\mate-portfolio\contentful-import-error-log-gtvr7c3o44yv-2020-07-01T11-13-13.json
(node:3036) UnhandledPromiseRejectionWarning: ContentfulMultiError: Errors occured
    at C:\Users\HP\Desktop\mate-portfolio\node_modules\contentful-import\dist\index.js:202:28
    at tryCatcher (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\util.js:16:23)
    at Promise._settlePromiseFromHandler (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\promise.js:547:31)
    at Promise._settlePromise (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\promise.js:604:18)
    at Promise._settlePromise0 (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\promise.js:649:10)
    at Promise._settlePromises (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\promise.js:729:18)
    at _drainQueueStep (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\async.js:93:12)
    at _drainQueue (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\async.js:86:9)
    at Async._drainQueues (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\async.js:102:5)
    at Immediate.Async.drainQueues [as _onImmediate] (C:\Users\HP\Desktop\mate-portfolio\node_modules\bluebird\js\release\async.js:15:14)
    at processImmediate (internal/timers.js:456:21)
(node:3036) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag `--unhandled-rejections=strict` (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 3)
(node:3036) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
Done in 105.62s  ~.

Hello @Meet-shah, please check the video I recorded where I showed from where you have to take the token from Contentful --> https://www.youtube.com/watch?v=YviWsypJF9c

Thanks !! i


Az webapp up should enable logging by default

Please refer to https://docs.microsoft.com/en-us/cli/azure/webapp/log?view=azure-cli-latest#az-webapp-log-config

@panchagnula for consideration.

@panchagnula moving this to sprint 57

@yiliaomsft , looking more into this, turning on this will cause an app recycle & so we don't turn this on by default on Portal either. Please comment if you still think this is required.

Added a --logs parameter for now as an optional parameter


How do i use dummy table in ql?

Hi,
I'm not well versed in SQL and ql. I'm adding ql support to one object relational mapper. When I was implementing many to many support I came across this query.
INSERT INTO blog_tags
            (blog_id,
             blog_locale,
             tag_id,
             tag_locale)
SELECT $1,
       $2,
       $3,
       $4
WHERE  NOT EXISTS (SELECT *
                   FROM   blog_tags
                   WHERE  blog_id = $1
                          AND blog_locale = $2
                          AND tag_id = $3
                          AND tag_locale = $4)

A quick google and some tinkering I came across the dummy table thing. This query works fine in postgres but it does not work in ql. I was wondering if there is a way I can write a query like this.
Thanks

@gernest So far I'm not sure I understand what is the question. Assuming the query above does not work: What's failing and/or what feature is needed/missing? I'm unfortunately not able to infer that from "the dummy table thing". Please explain it a bit more or provide additional context/reproduction case etc., thank you.

@cznic
In the query  portion above
SELECT $1,
       $2,
       $3,
       $4
WHERE  ...

We are selecting values $1,$2,$3    from nothing.  postgresql supports that. And from stackoverflow they say mysql support by having DUAL which will be something like.
SELECT $1,
       $2,
       $3,
       $4
 FROM DUAL WHERE  ...

In ql I get this error
 unexpected WHERE, expected field expression optional AS clause or logical or operator or one of [',', AS, FROM, OR, ||]

Just to be clear. I'm not an expert in SQL. I just want to be able to use the object relational mapper with ql without worrying about query building. So, I might be missing something here.

I have tried to reproduce it.
postgres
postgres=# select 30 where 1=1;
 ?column?
----------
       30
(1 row)

ql
$ ql 'select 10 where 1=1'
2017/03/26 02:42:18 BEGIN TRANSACTION; select 10 where 1=1; COMMIT;
2017/03/26 02:42:18 1:30 unexpected WHERE, expected field expression optional AS clause or logical or operator or one of [',', AS, FROM, OR, ||]

Is there any way I can have the same outcome in ql as in the postgres example?

Thank you very much for the added information.

Is there any way I can have the same outcome in ql as in the postgres example?

Right now it seems feasible to me, but I have to look into it more thoroughly. I will investigate.

My pleasure.
Thanks for the amazing work.  And please don't don't forget to ping me when something comes up from your investigation as I have to wait  for your insight before I opt to  look for a work around.

@gernest I've tweaked the grammar to accept all the new constructs (missing FROM, WHERE [ NOT ] EXISTS ( SELECT ...) as well as capturing the added parsing values to the respective structs.
The rest is just a question of a non-trivial amount of work.

Tweak all places which assume the selectStmt.from.sources are always non-nil and change the implementation to cope with it.
Implement the new [ NOT ] EXISTS predicate of the WHERE clause.
Adjust the planner to optimize all of the above.
Adjust the documentation accordingly.

I can implement this, but it may take months for me to do that. If you would like to give it a try by yourself, I can offer guidance and code reviews. It would not be easy, it would probably not make it happen any sooner - but you will learn a lot about ql, which you might be interested in. WDYT?

@cznic cool!
I will be more than happy to try this. So, maybe a hint on where to start will be appreciated.

As a starter, already failing code paths can be used to indicate the "must" places in need of change. Consider
jnml@4670:~/src/github.com/cznic/ql$ git branch
  issue141
  issue142
  issue151
* issue155
  master
jnml@4670:~/src/github.com/cznic/ql$ go test
--- FAIL: TestMemStorage (0.51s)
	storage_test.go:364: recreated source does not compile: 1:1 unexpected '%!'(MISSING), expected Start or one of [$end, ';', ALTER, BEGIN, COMMIT, CREATE, DELETE, DROP, EXPLAIN, INSERT, ROLLBACK, SELECT, TRUNCATE, UPDATE, parse expression prefix]
		---- orig
		-- 1347 // https://github.com/cznic/ql/issues/155
		SELECT 42;

		---- recreated
		%!s(PANIC=runtime error: slice bounds out of range)
	storage_test.go:356: 1348 error: internal error 052
--- FAIL: TestFileStorage (1.29s)
	storage_test.go:364: recreated source does not compile: 1:1 unexpected '%!'(MISSING), expected Start or one of [$end, ';', ALTER, BEGIN, COMMIT, CREATE, DELETE, DROP, EXPLAIN, INSERT, ROLLBACK, SELECT, TRUNCATE, UPDATE, parse expression prefix]
		---- orig
		-- 1347 // https://github.com/cznic/ql/issues/155
		SELECT 42;

		---- recreated
		%!s(PANIC=runtime error: slice bounds out of range)
	storage_test.go:356: 1348 error: internal error 052
--- FAIL: TestOSFileStorage (1.29s)
	storage_test.go:364: recreated source does not compile: 1:1 unexpected '%!'(MISSING), expected Start or one of [$end, ';', ALTER, BEGIN, COMMIT, CREATE, DELETE, DROP, EXPLAIN, INSERT, ROLLBACK, SELECT, TRUNCATE, UPDATE, parse expression prefix]
		---- orig
		-- 1347 // https://github.com/cznic/ql/issues/155
		SELECT 42;

		---- recreated
		%!s(PANIC=runtime error: slice bounds out of range)
	storage_test.go:356: 1348 error: internal error 052
FAIL
exit status 1
FAIL	github.com/cznic/ql	3.516s
jnml@4670:~/src/github.com/cznic/ql$

The fail starts here because s.from.sources is now allowed to be nil. Try to fix this particular place (difficulty: easy). I'll give you access rights to the repo in a moment. Please push your changes to the issue155 branch. Please expect about/at most one round of feedback from me per day (~ a handful rounds per week) due to me beeing focused, unfortunately, on a different, long term task right now. Feel free to push more changes before I can respond if you think you're on the right track. Watch go test results, specifically for those in testdata.ql before number 1347, they must all continue to work after any changes of yours and before pushing them to the repo, thank you.

@cznic thanks!
For now, I will be working on the issue155 branch on my fork. I will push changes there and see if I can fix those tests. I will submit a PR when I succeed. So you can just focus on what you have been occupied with without worrying about this.
I don't feel confident enough to push changes directly to the repo 😄 . That can wait till I get more familiar with ql, for now PR based workflow looks more convenient!

No problem, works for me :smile:

@cznic thanks for the initial PR!
Please ping me when you add test case for finally addressing this! I will  fix them with a new PR!
I can't wait to have a full fledged object relational mapper that works with ql! 😄

@gernest
I've added a couple of tests, two of them are failing (one existing, one new). The failing existing test no. 1348 is my fault and it must confused you when you wrote the implementation. My apologies.
Another thing which does not seem right: Why are the plans for no. 1350-1352 iterating no rows?
However, I guess it's just a minor problem to fix.

@cznic
I think that iterate no row is a result of embedding *nullPlan I wanted to ask you for suggesting a good message but I forgot. see https://github.com/cznic/ql/blob/issue155/plan.go#L2826  which is used here https://github.com/cznic/ql/blob/issue155/ql.go#L549
If you suggest the explain message then I can submit a separate PR to fix it.

can you explain why test case 1348  is failing?

judging from the query, only one row macthes so it should have been
BEGIN TRANSACTION;
	CREATE TABLE t (i int);
	INSERT INTO t VALUES (1);
	INSERT INTO t VALUES (2);
	INSERT INTO t VALUES (3);
COMMIT;
SELECT * FROM t WHERE EXISTS (SELECT * FROM t WHERE i == 2) ORDER BY i;
|"i"
[2]

can you explain why test case 1348 is failing?

Unfortunately not as I haven't yet a chance to look into it. But see test no. 1353 for illustration.

judging from the query, only one row macthes so it should have been

Then the query would be equal to
BEGIN TRANSACTION;
	CREATE TABLE t (i int);
	INSERT INTO t VALUES (1);
	INSERT INTO t VALUES (2);
	INSERT INTO t VALUES (3);
COMMIT;
SELECT * FROM t WHERE i == 2 ORDER BY i;

But that's not what the new construct is supposed to do. The WHERE clause in
WHERE EXISTS (SELECT * FROM t WHERE i == 2)

evaluates in this case to true because
SELECT * FROM t WHERE i == 2

Returns a non empty record set. So the outer WHERE clause is equal to WHERE true, cf. again no. 1353.

Thanks, now i understand

Uh! It looks like I will need to reimplement everything regarding where exists. The pieces don't match at all.

It's my fault. Once again, I am sorry.
But I don't think it needs too many changes. However, I am an hopelessly optimistic person ;-)

no problem! I will give it another spin..

@gernest Thanks for all your hard work! Branch issue155 is now ready to be merged into branch master. You have all the rights to do that by your self. Feel free to squash or not to squash according to your preferences.

@cznic  thanks! I prefer to keep history, just in case one day we invent time traveling  machine! 😄

I'm closing this issue now.


request

[*** LOG ERROR #0001 ***] [2020-07-16 07:31:21] [default] {cannot switch from manual to automatic argument indexing}
I did not call the app().run()
but logoutput error
{cannot switch from manual to automatic argument indexing}
What it means

When I use asio to create a tcp link

This log is not generated by Drogon, It is different from drogon log format. please check other components of your program.


Fix YAML serialization for Advanced Activations

Fix https://github.com/fchollet/keras/issues/2871#issuecomment-237365465
The problem occurs because PyYAML can't recognize numpy's data types.

LGTM


Euclidean Distance

Hello,
I am writing a code to calculate the Euclidean distance between two vectors, where both of them are encrypted. and I have yet to master SEAL, so I have some questions.

what I did so far is the subtraction and the squaring, however, for the summation I am using evaluator.add_many which is supposed to accept a vector as a first argument and a destination on the second. the squaring result is declared as a Ciphertext, I get  "cannot convert argument 1 from Ciphertext to vector", then when I try to declare it as a vector the evaluator.square doesn't work because of the expected input datatypes. How can I use add_many? .... I tried to convert all of the ciphertexts to vector<Ciphertext> but it caused an error to the header file.

The square root was mentioned in a talk that it could be approximated. would using the power function suffices?

I am attaching the code in hopes that it would shed the light on what's wrong

void testDistance() {

    EncryptionParameters parms(scheme_type::bfv);;
    size_t poly_modulus_degree = 8192;
    parms.set_poly_modulus_degree(poly_modulus_degree);
    parms.set_coeff_modulus(CoeffModulus::BFVDefault(poly_modulus_degree));
    parms.set_plain_modulus(PlainModulus::Batching(poly_modulus_degree, 50));

    SEALContext context(parms);

    print_parameters(context);
    cout << endl;

    auto qualifiers = context.first_context_data()->qualifiers();
    cout << "Batching enabled: " << boolalpha << qualifiers.using_batching << endl;

    KeyGenerator keygen(context);
    SecretKey secret_key = keygen.secret_key();
    PublicKey public_key;
    keygen.create_public_key(public_key);
    Encryptor encryptor(context, public_key);
    Evaluator evaluator(context);
    Decryptor decryptor(context, secret_key);

    BatchEncoder batch_encoder(context);

    size_t slot_count = batch_encoder.slot_count();
    size_t row_size = slot_count / 2;
    cout << "Plaintext vector row size: " << row_size << endl;

    vector<int64_t> x_vector(slot_count, 0ULL);

    x_vector[0] = 1;
    x_vector[1] = 2;
    x_vector[2] = 3;
    x_vector[3] = 4;
    x_vector[4] = 5;
    x_vector[5] = 6;
    x_vector[6] = 7;

    cout << "x plaintext vector: " << endl;
    print_matrix(x_vector, row_size);

    Plaintext x_plain_vector;
    print_line(__LINE__);
    cout << "Encode plaintext x vector: " << endl;
    batch_encoder.encode(x_vector, x_plain_vector);

    Ciphertext x_encrypted_vector;
    cout << "Encrypt plain_vector x to encrypted_vector." << endl;
    Stopwatch sw("Encryption Time");
	encryptor.encrypt(x_plain_vector, x_encrypted_vector);
        cout << "    + Noise budget in encrypted_matrix: " << decryptor.invariant_noise_budget(x_encrypted_vector) << " bits"
            << endl;

    vector<int64_t> y_vector(slot_count, 0ULL);
    y_vector[0] = 7;
    y_vector[1] = 6;
    y_vector[2] = 5;
    y_vector[3] = 4;
    y_vector[4] = 3;
    y_vector[5] = 2;
    y_vector[6] = 1;

    cout << "y plaintext vector:" << endl;
    print_matrix(y_vector, row_size);

    Plaintext y_plain_vector;
    cout << "Encode plaintext y vector:" << endl;
    batch_encoder.encode(y_vector, y_plain_vector);

    Ciphertext y_encrypted_vector;
	Ciphertext squared;
    Ciphertext subtracted;

	encryptor.encrypt(y_plain_vector, y_encrypted_vector);
        cout << "    + Noise budget in encrypted_matrix: " << decryptor.invariant_noise_budget(y_encrypted_vector) << " bits"
            << endl;
    cout << "Encrypt plain_vector y to encrypted_vector." << endl;

	evaluator.sub(x_encrypted_vector, y_encrypted_vector, subtracted);
	evaluator.square(subtracted, squared);

    Ciphertext addition;
    /* Here I am supposed to use add_many for addition*/

    //evaluator.add_many(squared, addition);

      // Decrypt the result
    Plaintext x_plain_result;
    decryptor.decrypt(addition, x_plain_result);

    vector <uint64_t> pod_result;
    cout << "    + Decode plaintext matrix ...... Correct." << endl;
    batch_encoder.decode(x_plain_result, pod_result);

    for (int i = 0; i < 7; i++) {

        cout << pod_result[i] << endl;

    }

}

Thank you in advance.

Don't use add_many if you have a single Ciphertext then.

would using the power function suffices?

What do you mean by the power function?

Thank you Mr. @WeiDaiWD for taking the time to answer my question, I understand I am asking questions coming from inexperience.

Don't use add_many if you have a single Ciphertext then.

I used rotate rows and and then I added it to the first cell of a copied squared ciphertext. I kept rotating and adding, I am sure there is a more efficient way to store the calculated total, but for some reason when I used add the destination parameter kept resetting and not incrementing. I guess I could store it in a vector and then finally I could use add_many on that vector :D

What do you mean by the power function?

As for the power function, I keep thinking of alternative ways to approximately calculate a root but I am not sure what would work in an encrypted domain, what I meant by power function is to use the power to scale down a ciphertext's plaintext value. Or maybe multiplying it with a constant that could result in a number close to the expected. However, I am not sure how to do the approximation as these two vectors should represent image features and I am not confident that the result won't be too tailored for some and doesn't work on others.


error when running read_new_unfccc_crf_for_year

read_new_unfccc_crf_for_year does not commit it's results because of the error
OSError: [Errno 7] Argument list too long: 'git'
This is probably from the very long list of files that are affected by the commit and passed to datalad. To get rid of this message we could commit country by country or dig deeper and find another solution. As manually committing after the error in the script work fine it's not urgent to solve this issue.

Possible solutions off the top of my head:

using datalad.api.run from Python instead of the CLI—no limitations on str length there
using globbing instead of specifying everything explicitly

I do run datalad.api.run from python

ah, okay, the error is from within datalad when it tries to run git?

If you add a full traceback I can forward it upstream

Viewing the full output I now think it's  known issue and a workaround exists (there was a lot of datalad output chucked in between the error output, so I didn't see the first part of the error)
Here is the (shortened) output:
[INFO] == Command exit (modification check follows) =====
[ERROR] Caught exception suggesting too large stack size limits. Hint: use 'ulimit -s' command to see current limit and e.g. 'ulimit -s 8192' to reduce it to avoid this exception. See https://github.com/datalad/datalad/issues/6106 for more information.
[WARNING] Received an exception OSError([Errno 7] Argument list too long: 'git'). Canceling not-yet running jobs and waiting for completion of running. You can force earlier forceful exit by Ctrl-C.
[INFO] Canceled 0 out of 0 jobs. 0 left running.

<some info on 'unlock', 'run', and 'add' command follows (all ok)>

Traceback (most recent call last):
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 368, in _iter_threads
    raise _FinalShutdown()
datalad.support.parallel._FinalShutdown

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "UNFCCC_GHG_data/UNFCCC_CRF_reader/read_new_UNFCCC_CRF_for_year_datalad.py", line 26, in <module>
    read_new_crf_for_year_datalad(
  File "<repo_path>/UNFCCC_GHG_data/UNFCCC_CRF_reader/UNFCCC_CRF_reader_prod.py", line 407, in read_new_crf_for_year_datalad
    datalad.api.run(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/interface/base.py", line 773, in eval_func
    return return_func(*args, **kwargs)
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/interface/base.py", line 763, in return_func
    results = list(results)
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/interface/base.py", line 873, in _execute_command_
    for r in _process_results(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/interface/utils.py", line 319, in _process_results
    for res in results:
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/core/local/run.py", line 297, in __call__
    for r in run_command(cmd, dataset=dataset,
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/core/local/run.py", line 1091, in run_command
    for r in Save.__call__(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/interface/base.py", line 873, in _execute_command_
    for r in _process_results(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/interface/utils.py", line 319, in _process_results
    for res in results:
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/core/local/save.py", line 391, in __call__
    yield from ProducerConsumerProgressLog(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 535, in __iter__
    for res in super().__iter__():
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 265, in __iter__
    yield from self._iter_threads(self._jobs)
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 417, in _iter_threads
    self.shutdown(force=True, exception=self._producer_exception or interrupted_by_exception)
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 233, in shutdown
    raise exception
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 401, in _iter_threads
    done_useful |= self._pop_done_futures(lgr)
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 463, in _pop_done_futures
    raise exception
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/parallel.py", line 329, in consumer_worker
    for r in res:
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/core/local/save.py", line 310, in save_ds
    for res in pds_repo.save_(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/gitrepo.py", line 3579, in save_
    self._save_post(message, chain(*status_state.values()), need_partial_commit, amend=amend,
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/annexrepo.py", line 3556, in _save_post
    super(AnnexRepo, self)._save_post(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/gitrepo.py", line 3331, in _save_post
    GitRepo.commit(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/support/gitrepo.py", line 1449, in commit
    _ = self._call_git(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/dataset/gitrepo.py", line 398, in _call_git
    for file_no, line in self._generator_call_git(args,
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/dataset/gitrepo.py", line 355, in _generator_call_git
    for file_no, content in generator:
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/runner/gitrunner.py", line 299, in run_on_filelist_chunks_items_
    for chunk_generator in self._get_chunked_results(cmd=cmd,
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/runner/gitrunner.py", line 184, in _get_chunked_results
    yield self.run(
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/runner/runner.py", line 206, in run
    results_or_iterator = threaded_runner.run()
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/runner/nonasyncrunner.py", line 343, in run
    return self._locked_run()
  File "<repo_path>/venv/lib/python3.8/site-packages/datalad/runner/nonasyncrunner.py", line 403, in _locked_run
    self.process = Popen(self.cmd, **kwargs)         # nosec
  File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.8/subprocess.py", line 1704, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
OSError: [Errno 7] Argument list too long: 'git'
TaskFailed - taskid:read_new_unfccc_crf_for_year
Command failed: './venv/bin/python UNFCCC_GHG_data/UNFCCC_CRF_reader/read_new_UNFCCC_CRF_for_year_datalad.py --submission_year=2022  --re_read' returned 1


Update ctkLogger

Update ctkLogger adding support for log level: Set default level based on the build config.
Update ctkErrorLogLevel enum values defining "Unknown" as 0

@Punzo @lassoan There changes were originally part of https://github.com/commontk/CTK/pull/1165 and have been factored out into an independent pull request.

Now that we removed support for Qt4, for new classes, I think we should instead standardize on using QLoggingCategory and avoid ctkLogger.
See https://doc.qt.io/qt-5/qloggingcategory.html

 [ENH: Update ctkErrorLogLevel enum value setting "Unknown" as 0](/commontk/CTK/pull/1181/commits/2a8f6e13c2e8cda9340589c0e81f434578fa03e8)

ok, perfect!

I revisited the default level associated with the ctkLogger functions and also added a multiple tests.


Force bump for renovate to catch up

recheck

Do we have a build failure in neutron-operator?
+ [[ quay.io != \q\u\a\y\.\i\o ]]
++ curl -s 'https://quay.io/api/v1/repository/openstack-k8s-operators/neutron-operator-bundle/tag/?filter_tag_name=like:d6bbc917719e'
++ jq -r '.tags[].name'
+ SHA=
+ '[' -z '' ']'
+ echo 'Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators'
Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators

/test openstack-operator-build-deploy-kuttl

Do we have a build failure in neutron-operator?
+ [[ quay.io != \q\u\a\y\.\i\o ]]
++ curl -s 'https://quay.io/api/v1/repository/openstack-k8s-operators/neutron-operator-bundle/tag/?filter_tag_name=like:d6bbc917719e'
++ jq -r '.tags[].name'
+ SHA=
+ '[' -z '' ']'
+ echo 'Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators'
Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators

Yepp we do https://github.com/openstack-k8s-operators/neutron-operator/actions/runs/5747638504
 Error: podman exited with code 125
Error: trying to reuse blob sha256:e023e0e48e6e29e90e519f4dd356d058ff2bffbd16e28b802f3b8f93aa4ccb17 at destination: Requesting bear token: invalid status code from registry 500 (Internal Server Error)

Do we have a build failure in neutron-operator?
+ [[ quay.io != \q\u\a\y\.\i\o ]]
++ curl -s 'https://quay.io/api/v1/repository/openstack-k8s-operators/neutron-operator-bundle/tag/?filter_tag_name=like:d6bbc917719e'
++ jq -r '.tags[].name'
+ SHA=
+ '[' -z '' ']'
+ echo 'Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators'
Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators

Yepp we do https://github.com/openstack-k8s-operators/neutron-operator/actions/runs/5747638504
 Error: podman exited with code 125
Error: trying to reuse blob sha256:e023e0e48e6e29e90e519f4dd356d058ff2bffbd16e28b802f3b8f93aa4ccb17 at destination: Requesting bear token: invalid status code from registry 500 (Internal Server Error)

I have triggered a new build

Do we have a build failure in neutron-operator?
+ [[ quay.io != \q\u\a\y\.\i\o ]]
++ curl -s 'https://quay.io/api/v1/repository/openstack-k8s-operators/neutron-operator-bundle/tag/?filter_tag_name=like:d6bbc917719e'
++ jq -r '.tags[].name'
+ SHA=
+ '[' -z '' ']'
+ echo 'Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators'
Error: SHA is empty, Could not find container with tag d6bbc917719e in https://quay.io/api/v1/repository/openstack-k8s-operators

Yepp we do https://github.com/openstack-k8s-operators/neutron-operator/actions/runs/5747638504
 Error: podman exited with code 125
Error: trying to reuse blob sha256:e023e0e48e6e29e90e519f4dd356d058ff2bffbd16e28b802f3b8f93aa4ccb17 at destination: Requesting bear token: invalid status code from registry 500 (Internal Server Error)

I have triggered a new build

The new build succeeded so the neutron bundle is now available

recheck

recheck

recheck

recheck

/lgtm

recheck

recheck

recheck

recheck

recheck

recheck

recheck


Why did this die?

It has a lot of use for new and experienced Docker users... is there a community fork? If not I'll make one!

Why did this die?

It's not dead, it's just pining for the fjords.
If you mean, "why isn't X supported?" or "why isn't this up-to-date"  there is a simple answer.
The maintainers (myself included) have departed Docker and have other projects we're working on.
There have been very few pull requests from the community to add/update anything and I personally haven't had time to work on it.

is there a community fork?

I think that's putting the cart before the horse (see above re: community activity).
Contributions are still very much welcome here, but it might take me a week or two to get to reviewing them.

Oh dang, I didn’t actually expect you to reply! I completely understand, and I’ll maybe experiment with updating my fork in the future :3
Thanks again for replying!

This idea is actually dope, I will try to see if I can update it or anybody can try updating it.
probably no one will help me with it.

Contact me on Discord and we can try updating it together: AstroOrbis#9797