Fixed iOS DismissProgressDialog Issue

General items:

[ ] I have updated the relevant documentation files under docs/
[ ] My code follows the:

[ ] Google Java style guide (for .java files)
[ ] Google JavaScript style guide (for .js files)

[ ] ant tests passes on my machine

If your code changes how something works on the device (i.e., it affects the companion):

[ ] I branched from ucr
[ ] My pull request has ucr as the base

Further, if you've changed the blocks language or another user-facing designer/blocks API (added a SimpleProperty, etc.):

[ ] I have updated the corresponding version number in YaVersion.java
[ ] I have updated the corresponding upgrader in YoungAndroidFormUpgrader.java (components only)
[ ] I have updated the corresponding entries in versioning.js

For all other changes:

[ ] I branched from master
[ ] My pull request has master as the base

What does this PR accomplish?

Adds a CustomAlertView array to allow for handling of multiple dialogs. Before, the Dismiss progress dialog would not even appear on top of the choose dialog. Now, both work as intended based on the given app code; the dismiss dialog dismisses after 3 seconds and the choose dialog correctly cancels when clicked.

Fixes #3218.

Resolves # .

Can one of the admins verify this patch?

@AppInventorWorkerBee OK to test.


SDK support for Database-type Streams

Migrated from GitLab: https://gitlab.com/meltano/sdk/-/issues/74
Originally created by @aaronsteers on 2021-03-31 18:16:33

This feature would add formal support for Database type streams.
Background

We removed database-type streams from the initial 0.1.0 on the basis of being a lower priority versus API-type streams.
Unlike SaaS taps, for DB-type taps, we can assume:

Catalogs are less stable. We should expect cached catalogs will require explicit refreshing.
Catalog detection should be decoupled from Stream definition. We expect the catalog to be defined by querying the information_schema or similar - and it should be much more performant to query this at the DB-level or schema-level, versus individually for each stream/table.
Fewer Stream classes are needed. One Stream class per source or one per extraction type is probably sufficient.
Catalogs are more authoritative. If a catalog declares a table and column, the Tap should assume it exists as defined in the catalog.

Types need to be overridable. Moreso than other stream types, we know database-type sources have a history of type incompatibilities. When provided, we should take care that we apply custom type declarations as given in the input catalog.

Implementation Proposal
Decoupling Streams from Catalog Discovery
Instead of streams objects reporting back their own schema, a SQLCatalogDiscovery class (or similar) will create a full catalog. Then, instances of the appropriate Stream class can be instantiated from the discovered catalog. This also means that the if an input catalog is provided, we can skip the discovery process entirely.
Docs links:

https://docs.sqlalchemy.org/en/14/core/reflection.html#reflecting-all-tables-at-once

Entry-Level capabilities with SQLAlchemy
The SQLAlchemy tool (powered by DB-API 2.0) can provide out-of-box catalog discovery capabilities as well as entry-level select capabilities. This means that given a valid SQLAlchemy driver and connection URI, we can provide generic discovery and get_records() capabilities.

NOTE: We should probably develop a generic tap-sqlalchemy or tap-dbapi which purely leverage SQL Alchemy generic constructs. This would never be as performant as a custom-built tap but it would be good in general for interop purposes.

Developers Provide Performance improvements
There is probably little case for overriding discovery unless SQLAlchemy does not support Inspection for the database type in question. Since catalog discovery is generally not a performance bottleneck, and since it is likely to be cached anyway, a generic implementation should be "good enough" for 95% of DB types.
Provide developers with bulk-based performance boosts
The SQLAlchemy library will be good at generic selects but will not be able to take advantage of batching capabilities. I suggest we tap into the discussions around #9 (batch message type) to allow developers to define their batch capabilities.

View 13 previous comments from the original issue on GitLab


ResolvedVariantResult getResolvedVariant() is sometimes null

Expected Behavior
ResolvedVariantResult getResolvedVariant() is never null.
Current Behavior
The project in https://issuetracker.google.com/214259374#comment1 hits a corner case where ResolvedVariantResult getResolvedVariant() returns null.
Context
Android Studio switched to requesting a rewritten dependency model from Android Gradle Plugin from version 7.2.0-alpha05, where the model builder walks the dependency graph and now depends on ResolvedVariantResult.getResolvedVariant, and this broke sync for projects that hit this issue in Gradle.
Steps to Reproduce
Open the project described in https://issuetracker.google.com/214259374#comment1 (with Android Studio C canary 5).
Your Environment
See linked issue

Sorry for the late reply.
The issue is in the backlog of the relevant team and is prioritized by them.


NOTIFICATION_TRANSFORM_CHANGED only happens once

Godot version
3.5.1
System information
Linux Mint
Issue description
Setting the position on a parent node does only triggers NOTIFICATION_TRANSFORM_CHANGED on the child nodes once.

This is due to an error in the design of:
CanvasItem::_notify_transform()
Namely, the notification is ignored if global_invalid is set to true.
if (/*p_node->xform_change.in_list() &&*/ p_node->global_invalid) {
	return; //nothing to do
}

p_node->global_invalid = true;

global_invalid is only set to false in  CanvasItem::get_global_transform()
Which is not called.
The concept of 'don't put this thing in the list twice' should not be overlapped with the concept of 'the global transform is dirty'.
I am surprised and confused this issue has been undetected for so long.
I am sure you are surprised too, so I have attached a reproduction project to prove the existence of the bug.
Steps to reproduce
Test script that moves the grandparent, parent or child every second:
extends Node2D

onready var child := $Parent/Child as Node2D
onready var parent := $Parent as Node2D

func _ready():
	var move_delta := 100.0
	var i := 0
	while true:
		yield(get_tree().create_timer(1.0), "timeout")
		print("\n")
		match i:
			0:
				print("moving grandparent")
				position = position + Vector2.RIGHT * move_delta
			1:
				print("moving parent")
				parent.position = parent.position + Vector2.RIGHT * move_delta
			2:
				print("move child")
				child.position = child.position + Vector2.RIGHT * move_delta
		i = (i + 1) % 3

Listening script:
extends Node2D

func _ready():
	set_notify_transform(true)

func _notification(what):
	match what:
		NOTIFICATION_TRANSFORM_CHANGED:
			print("NOTIFICATION_TRANSFORM_CHANGED")

Output:
moving grandparent
[Child] NOTIFICATION_TRANSFORM_CHANGED

moving parent

move child

Minimal reproduction project
NotificationTransformChanged.zip

The comment "nodes are dirty, will get the notification anyway" seems to no longer be true.

Workaround for those who find this issue:
func _notification(what:int):
    match NOTIFICATION_TRANSFORM_CHANGED:
        # Clear CanvasItem::global_invalid such that more NOTIFICATION_TRANSFORM_CHANGED can be received
        get_global_transform()

I can confirm this issue in Godot v4.0.beta.custom_build [2e3662acb]. The MRP works also with minimal adjustments (@onready & await)

Workaround for those who find this issue:
func _notification(what:int):
    match NOTIFICATION_TRANSFORM_CHANGED:
        # Clear CanvasItem::global_invalid such that more NOTIFICATION_TRANSFORM_CHANGED can be received
        get_global_transform()

Issue is still present in 4.2.beta, but at least this workaround is still working 👍


Sponsor Logos (Quality)

The quality of the sponsor logos has been reduced for the initial versions of this theme to reduce the impact on load time.
This issue will be resolved before v0.9

Resolved in V0.9


Specify that the gem doesn't work with Active Support 6

@dasch what is the problem with AS6?

@mensfeld there was a regression in CI.
     NoMethodError:
       undefined method `monotonic_time' for Concurrent:Module
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/instrumenter.rb:140:in `now'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/instrumenter.rb:79:in `start!'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/subscriber.rb:132:in `start'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/fanout.rb:156:in `start'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/fanout.rb:58:in `block in start'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/fanout.rb:58:in `each'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/fanout.rb:58:in `start'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/instrumenter.rb:36:in `start'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications/instrumenter.rb:22:in `instrument'
     # ./vendor/bundle/ruby/2.5.0/gems/activesupport-6.0.0/lib/active_support/notifications.rb:180:in `instrument'
     # ./lib/kafka/instrumenter.rb:21:in `instrument'
     # ./lib/kafka/connection.rb:97:in `send_request'
     # ./lib/kafka/broker.rb:200:in `send_request'
     # ./lib/kafka/broker.rb:44:in `fetch_metadata'
     # ./lib/kafka/cluster.rb:409:in `block in fetch_cluster_info'
     # ./lib/kafka/cluster.rb:404:in `each'
     # ./lib/kafka/cluster.rb:404:in `fetch_cluster_info'
     # ./lib/kafka/cluster.rb:384:in `cluster_info'
     # ./lib/kafka/cluster.rb:446:in `controller_broker'
     # ./lib/kafka/cluster.rb:197:in `create_topic'
     # ./lib/kafka/client.rb:572:in `create_topic'
     # ./spec/spec_helper.rb:66:in `create_topic'
     # ./spec/spec_helper.rb:61:in `create_random_topic'
     # ./spec/functional/async_producer_spec.rb:5:in `block (2 levels) in <top (required)>'

Merging this for now, as the test suite is otherwise broken, but we need a fix for this issue.

sidenote: that's why things like AS should not be part of RK. We should just have a general interface with a AS api.

It's a soft dependency. I'd rather if ActiveSupport::Notifications was extracted to a separate gem, though.


Not all folders have readme.md files

The lids in particular are missing readme files.
Individual display mounts also lack a readme with BOM.

The documentation bypasses this. I'm instead trying to remove old readmes.


UNKNOWN: unknown error, readlink

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
v16.13.2
Amplify CLI Version
10.5.1
What operating system are you using?
Windows
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No manual changes made"
Describe the bug
report-1671116691554.zip
Expected behavior
amplify status should give me the status of my app
Reproduction steps
amplify pull
make changes
amplify update api
amplify status
Project Identifier
3719f5f550ffd4fb8c429a52aba28300
Log output

# Put your logs below this line

Additional information
No response
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

Hey @anu-IV :wave: thanks for raising this! As we begin to look at this in more depth, would you mind sharing the full error you're receiving and full reproduction steps? Is the CLI erroring reading a specific file? Does this error only occur with amplify status?

This issue is resolved for me now.
Thanks and Regards,
Anu.
From: josef @.>
Sent: Tuesday, January 3, 2023 11:03 AM
To: aws-amplify/amplify-cli @.>
Cc: Anubhuti Srivastava @.>; Mention @.>
Subject: [EXTERNAL] Re: [aws-amplify/amplify-cli] UNKNOWN: unknown error, readlink (Issue #11612)
Hey @anu-IVhttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fanu-IV&data=05|01|asrivastava%40intervision.com|168069397242417adb2408daeda3f50d|52163c7cf4174149971e3e0cb126f714|1|0|638083585706130344|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=8Nyfthadf16NaPL8krlYUdQtQnE0jnmq3%2BAI%2BcOZ8Gs%3D&reserved=0 I wanted to follow-up on this one after the holiday season to see if you're still experiencing this?

Reply to this email directly, view it on GitHubhttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Faws-amplify%2Famplify-cli%2Fissues%2F11612%23issuecomment-1369941497&data=05|01|asrivastava%40intervision.com|168069397242417adb2408daeda3f50d|52163c7cf4174149971e3e0cb126f714|1|0|638083585706130344|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=T6F%2FNLFeXRQQvNFYLjgbqwc5Sm6iDGimBmZ7Ia4W%2FqA%3D&reserved=0, or unsubscribehttps://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAXLSWJQ3Y5XFIUCNKLULGXLWQRESLANCNFSM6AAAAAAS723FTU&data=05|01|asrivastava%40intervision.com|168069397242417adb2408daeda3f50d|52163c7cf4174149971e3e0cb126f714|1|0|638083585706286583|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=V11K3JelNQv66y%2Fvv66rnkLZytpvG%2B1jKV6kNIRnnx4%3D&reserved=0.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>STOP & THINK BEFORE you CLICK links and/or OPEN attachments! This is an EXTERNAL EMAIL.
We appreciate our valued clients & partners and take securing assets & information very seriously. If you suspect phishing, report using the "Phish Alert Report" button.


No OnDevice examples in the unit tests project even though the docs say there are

The documentation page for OnDeviceExtension says that there "You can find more examples in the unit tests."
I can't find any such tests.
Please can the documentation for this page be updated.
If there are unit tests for this class can the link point to the specific tests rather than the root of the UnitTests directory.
If no tests exist, remove the link and text saying to look for them.
If there really are no such tests, is there an issue somewhere to track adding them? Have there never been tests for this functionality? How much other code in the toolkit is without tests? 😟🤔

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 60d3b7a7-60dd-a7f9-ec19-742c83c0f8ae
Version Independent ID: d9167035-d063-39a3-8358-11002de9eaed
Content: OnDeviceExtension - Windows Community Toolkit
Content Source: docs/extensions/OnDeviceExtension.md
Product: community-toolkit
GitHub Login: @sonnemaf
Microsoft Alias: mhawker

Thanks, @mrlacey for highlighting this issue. Looping in @RosarioPulella and see if he can provide insight on the unit test ⬆

Yeah, I don't think we had unit tests here. Think this would be hard to add some for, as we'd just be mocking the system API to fake which device is going on...
@mrlacey thoughts on adding unit tests or just removing that section from the doc?

@mrlacey thoughts on adding unit tests or just removing that section from the doc?

I'd start by removing that section from the doc.
I found this because I was looking at how this functionality was documented and tested. (Because I'm looking to document and test similar functionality elsewhere.)
I agree that most of the functionality here would have little value from having unit tests added. However, I worry (generally--about all code, not just this repo) that saying "this code is hard to test so we won't do any" is a bad precedent. At the very least, I'd hope any code base with code that can't easily have automated code tests added has written instructions for manual testing of that functionality. Without any kind of documentation for what a piece of functionality is supposed to do (and not do) or how to test it, it makes it increasingly susceptible to becoming broken in the future because it's easy to forget about or not spot edge cases or non-obvious behaviors that someone modifying this in the future may not know about.
For example, does this markup extension work with things other than hardcoded values. (I haven't checked--yet!) What if it does but a future change stops that from working? It's likely that this wouldn't be discovered until someone using it in production reported the break in functionality.
Potential separate issues prompted by thinking about this:
How many other places do the docs have a general pointer to the unit tests when there aren't any?
How many other places do the docs have a general pointer to the unit tests rather than specific examples?
Where is pointing to the unit tests a cop-out for providing useful examples in the docs?

I haven't checked--yet!

I have now.
It does work with resources.
But, I can't find a way to get it work with localized content without using code-behind at which point the value of using the markup extension becomes questionable.

Sorry for my late response, I was out of office. It is true that there are no Unit tests. I have no Idea how I would be able to implement this. It should be removed from the docs.


Warn for invalid keys for classifiers

Rasa version: 2.0.0
Issue:
If you pass an invalid key to a classifier no warning or error is thrown during training
Command or request that led to lack of error:
rasa train

Content of configuration file (config.yml) (if relevant):
pipeline
- name: FallbackClassifier
   confidence_threshold: 0.7

(should be threshold)

Here's a similar issue with responses. button_type is not valid at this location, but validate and train don't throw an error.
  utter_ask_feedback:
  - buttons:
    - button_type: inline
    - payload: /feedback{"feedback_value":"positive"}
      title: 👍
    - payload: /feedback{"feedback_value":"negative"}
      title: 👎
    text: How is this conversation going?

The trouble with responses is depending on the channel, those keys may be valid or not. With built in classifiers, the possible keys are known.

would be great to find a general solution which also works for other NLU components than classifiers

The defaults should already give us that information 🤔

Do all possible options have defaults?

looks like it. I'll use that then

wait - so you're working on this?

I'm about to unless someone else started already?

Fine for me - it's just for the 2.1 release plan 🚀


Update readme

The values example is still empty because I'm waiting to have a stable working version of the app before adding it.

Maybe keep this PR in draft until you add the values.yaml example.

Fine with me :shrug:


spike: Explore LM based legacy delivery solution

Description
Our current delivery solution for legacy devices is quite lacking. This ticket captures the need to improve our story around this. One suggestion has been to consider the use of Liquid Metal as an host-based agent that we could use to deliver software to legacy systems using the ocm-controller toolset.

Liquid Metal seems like a Virtual Kubelet. I do not completely see the use can, perhaps we need to discuss.


multiple elements with same name are not

Your solution seems to not work when a form has multiple elements with same name. Can you add a step that concatenates values from the same 'name' elements somehow?

take a look here this is why data dont show on your sheet

@rodriguesk I was wondering if a solution was found for concatenating the values of inputs with the same name?


Which Rancher version works on 1.16.4 kubernetes version ?

What kind of request is this (question/bug/enhancement/feature request):
Question
Which version of Rancher supports kubernetes 1.16.4 ?
we have a 2.2.1 and we tried to import a 1.16.4 cluster and it went to 'Waiting' stage forever
Steps to reproduce (least amount of steps as possible):
Result:
Other details that may be helpful:
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI):
Installation option (single install/HA):

Cluster information

Cluster type (Hosted/Infrastructure Provider/Custom/Imported):
Machine type (cloud/VM/metal) and specifications (CPU/memory):
Kubernetes version (use kubectl version):

(paste the output here)

Docker version (use docker version):

(paste the output here)

Supported k8s versions are listed in each release under https://github.com/rancher/rancher/releases/, and 1.16 was made default in 2.3.2 (see https://github.com/rancher/rancher/issues/22965). As 1.16 deprecated API versions (https://kubernetes.io/blog/2019/07/18/api-deprecations-in-1-16/) it will probably not work until the later versions.
With v2.2.1 being close to a year old, it is recommended to update aside from the 1.16 support.


Unhandled Rejection (Invariant Violation): invalid RawDraftContentState

Hello,
I'm trying to implement megadraft to write articles. Creating an article works fine, and I can save it by calling
		let content = editorStateToJSON(this.state.editorState)

When I save it to my DB, I do it this way
//dummy function call
db.save(JSON.stringify(content))

When I try to load it back into an editor to be able to modify/view the article, I retrieve the editor state by doing

editorStateFromRaw(JSON.parse(string_from_db))

The only thing that I see as plausible is that I initialize my state with editorStateFromRaw(null), but I don't see any other way of doing this.

editorStateToJSON returns a string, not an object, so you don't need to use JSON.stringify.

Thank you! That solved it!


Feat: Allow usage of native Mistral FA when no sample_packing

@NanoCode012 don't forget to pin transformers to the new commit in requirements.txt

@NanoCode012 seems like we need to split the tests to run independently. Once the patch is loaded for the sample packing case, it continues to use that for the next test that is supposed to use the transformers fa2 patch w/o sample packing


Script for COLMAP SAM

Hello,
I have created a script that will utilize the COLMAP data structure and via the sparse data, determine which SAM masks belongs to what frames.
For example, a trash bin that is viewed from different view points in a room, the code will be able to group together those masks together, or a tree from different views, or whatever object, even if the object comes out of frame. As long as COLMAP sees it, my masking program will connect them together spatially.
Is that something that would be useful for you? Is that what your code does at the moment?

I think what you have implemented is cool. From my understanding, you can associate the masks of one object across multiple views by leveraging the visibility information from COLMAP. I think this is quite similar to the idea of SAM3D but they have denser point cloud as input.
As a comparison, OmniSeg3D can also associate object masks from multiple views (even the object is incomplete in some views), and that's why we can achieve multi-view consistent segmentation i.e. 3D segmentation. After training, you can rendered multi-view semantic feature maps, on which if you choose one object (actually its feature), you can get the same object mask on the other images.
Besides, since the output of SAM may not be consistent in multi-view images, explicit association may be ambiguous. Instead, OmniSeg3D implicitly associate them in a feature field (in 3D space) using a hierarchical contrastive learning strategy, which respects all the input segmentation masks and results in a multi-view consistent hierarchical feature field for interactive segmentation.


[automation_test] fix action

This PR is for:

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.moleyi seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Can't install new packages (gyp WARN install got an error, rolling back install)

Prerequisites

[ X] Put an X between the brackets on this line if you have done all of the following:

Reproduced the problem in Safe Mode: https://flight-manual.atom.io/hacking-atom/sections/debugging/#using-safe-mode
Followed all applicable steps in the debugging guide: https://flight-manual.atom.io/hacking-atom/sections/debugging/
Checked the FAQs on the message board for common solutions: https://discuss.atom.io/c/faq
Checked that your issue isn't already filed: https://github.com/issues?utf8=✓&q=is%3Aissue+user%3Aatom
Checked that there is not already an Atom package that provides the described functionality: https://atom.io/packages

Description
Hi,
I installed the last version of Atom for Windows 7 64bit and i can install any new packages.
yes, i've checked every method/ post that has the same issue and still can't resolve it.
anyone can help please?
also i don't a use proxy and i set:
apm config set proxy null
apm config set https-proxy null
npm config set proxy null
npm config set https-proxy null
Versions
apm -v
apm 1.18.12
npm 3.10.10
node 6.9.5 x64
atom 1.24.0
python 2.7.14
git 2.16.1.windows.4
visual studio 2015
Windows 7 64bit

Hello Liran ...
You also posted in the Slack team this screenshot:

:point_up: This appears to be the true source of the problem. As we mentioned multiple times on Slack, this appears to be a problem with your machine, network configuration, npm or some combination of those three. Until you clear up that problem, we will be unable to help you since Atom requires npm to be working properly in order to do its job.
I appreciate the frustration this must be causing you. Unfortunately, there is simply nothing Atom can do to fix this problem.
Thanks


fix: fixed dynamic_gas_queried_success_fees metric name

Closes: #4145
Description

Fixes a typo in metric name. This is what now curl localhost:3001/metrics responds:
# TYPE dynamic_gas_paid_fees histogram
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.0025"} 0
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.005"} 0
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.01"} 2
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.05"} 2
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.1"} 2
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.5"} 2
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="1"} 2
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="5"} 2
dynamic_gas_paid_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="+Inf"} 2
dynamic_gas_paid_fees_sum{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version=""} 0.01166
dynamic_gas_paid_fees_count{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version=""} 2
# HELP dynamic_gas_queried_fees The EIP-1559 base fee queried
# TYPE dynamic_gas_queried_fees histogram
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.0025"} 0
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.005"} 0
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.01"} 2
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.05"} 2
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.1"} 2
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.5"} 2
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="1"} 2
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="5"} 2
dynamic_gas_queried_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="+Inf"} 2
dynamic_gas_queried_fees_sum{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version=""} 0.01166
dynamic_gas_queried_fees_count{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version=""} 2
# HELP dynamic_gas_queried_success_fees The EIP-1559 base fee successfully queried
# TYPE dynamic_gas_queried_success_fees histogram
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.0025"} 0
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.005"} 0
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.01"} 2
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.05"} 2
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.1"} 2
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="0.5"} 2
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="1"} 2
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="5"} 2
dynamic_gas_queried_success_fees_bucket{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version="",le="+Inf"} 2
dynamic_gas_queried_success_fees_sum{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version=""} 0.01166
dynamic_gas_queried_success_fees_count{identifier="neutron-1",service_name="unknown_service",otel_scope_name="hermes",otel_scope_version=""} 2

Prometheus seems to not complain about it anymore, so guess it's good.

PR author checklist:

[ ] Added changelog entry, using unclog.
[ ] Added tests: integration (for Hermes) or unit/mock tests (for modules).
[ ] Linked to GitHub issue.
[ ] Updated code comments and documentation (e.g., docs/).
[ ] Tagged one reviewer who will be the one responsible for shepherding this PR.

Reviewer checklist:

[ ] Reviewed Files changed in the GitHub PR explorer.
[ ] Manually tested (in case integration/unit/mock tests are absent).

@ljoss17 By the way, can you please remind me why we have these two metrics instead of just one?

@ljoss17 By the way, can you please remind me why we have these two metrics instead of just one?

There are actually three metrics, and the issue here is that two of them had the same label.
The reason we have multiple is to identify if the query for dynamic gas fees fails. In order to still try to relay, we fallback to the configured gas price to still try and relay the packet if the query fails.
So we have:

dynamic_gas_queried_success_fees will be the gas price queried from the endpoint
dynamic_gas_queried_fees will be the retrieved gas price, this can be the queried value or the configured gas price if the query failed
dynamic_gas_paid_fees will be the gas price used to relay, this can be the queried value or the configured gas price if the query failed, after reducing the price if it exceeds the configured max value


Attachment Field

Hi,
Is there any possibility of you adding an example of using the Attachment field? Or, in the case that I somehow missed (definitely a possibility...), point me to where I can find something in the docs?
Cheers!

Or should I just stick to using elasticsearch.py directly for anything with an attachment?

@gileadslostson, with the Stackoverflow dataset, there's not really a natural example for handling attachments... so yes, just using the Python client for handling attachments (via the Ingest plugin?) should be straightforward..

@karmi cheers! It is fairly straightforward =) I was just hoping for a way to use it in DSL. Thanks anyway.


[question]can't disable CP for specific (unsupported) SDPA op

Problem
currently the API of context parallel have five problems.

only support apply CP to whole model. if we have some cross attn in prep part of model with unsupported shape, it's impossible to apply CP since _context_parallel always override all SDPA and need to wrap whole backward.
no shard/unshard with gradient support. when I try to apply CP to transformer blocks only and remain other SDPA replicate, the  context_parallel_unshard in pytorch has no_grad decorator.
weight gradients inside CP region is divided by size of CP mesh because we reduce them in DP+CP, this may work for optimizer with norm support, but make unit test harder to write, we have to scale them back to get same gradients as model without CP.
The length of the sequence must be divisible by the number of CP (CP * 2 for robin).
replicate input of CP region may contain wrong gradient because its gradient may be Partial, we have to check every replicate input and use to_local(grad_placements=[Partial()]).

To resolve problem 1 above, I remove context_parallel context to disable SDPA override, only enable _enable_cp_dispatcher context, then we can enable CP SDPA iff all inputs are converted to DTensor. problem 2 is easy  to resolve, just write some auto grad functions.
here is my questions:

is there a better way to support CP region?
do you have any plan to support CP region officially and resolve issues above?

We do see some requests to apply CP to only some region. This will require some communication before SDPA as we will have to borrow some ranks from the DP sharding dimensions. Current CP doesn't support this for sure. We will discuss how and what is the best way to support this feature.


fixed build and changed wrong package references with project references

I wasn't able to build the project clean from commandline.
The issue was that you used package references instead of project references for some parts.
Also my last PR was not so fine, so it broke the build :(
but this PR makes the trick :)

This is done with #29 so we can close this


(PDB-5553) Remove foreign keys from report partitions

We have not released this migration, otherwise a separate migration would be needed.
Postgres foreign keys are implemented with bidirectional triggers this means that even after we have detached the partition from the parent table, dropping it will still require access exclusive locks on all the tables that we reference with foreign keys.

The tests look reasonable. Re-running the lint job.
The only issue I see is what I raised above about PE latest z upgrades. I don't know if we've done this before and if so how much of an issue it's every been.

Okie dokie; I think that just leaves the linter fix.


Implement Max typehint annotation

Annotation already existing in: PropertyTypeHintAnnotation.kt (already there, needs to be uncommented.
Add typehint and typelimiting support in PropertyHintTypeMapper.kt

Closing in favor of #155


Scroll multiple Items at once not possible (Android)

When trying to scroll multiple months or years at once, the animation is shown but jumps back to the previous selected item. From a user perspective it feels weird to be resetted after scrolling a few months at once.
In my case only tapping item by item through the list makes it possible to select something.
Also as a sidenote: It would be awesome to be able to jump from December 2020 to January 2021 with one click.
Hit me up, if you need further information

Hey @crystalcase ! thanks for using the lib. Are you sure is not jumping back because you have set either a min or max dates?

Regarding the sidenote, I'm working on a month infinite scroll atm, to accomplish what you're proposing, but don't have an eta yet 😞

Hey @crystalcase ! thanks for using the lib. Are you sure is not jumping back because you have set either a min or max dates? Because that's the expected behaviour when you set those props.

Yes you are right, I set those props and forgot to change them. I set both to new Date() and did not notice it. Although max and min dates do not have the expected behaviour, because I can still select dates beyond. Just with single taps. I would expect everything beyond max and min being disabled. Is the current behaviour intended?

Regarding the sidenote, I'm working on a month infinite scroll atm, to accomplish what you're proposing, but don't have an eta yet 😞

Sounds great, with fixing the scrolling it is fine and would just be a nice to have feature.

@crystalcase not expected, but on Android it has a weird behavior when you are fast-scrolling I couldn't fix. I'll give it a shot during the holidays.

@crystalcase not expected, but on Android it has a weird behavior when you are fast-scrolling I couldn't fix. I'll give it a shot during the holidays.

Not exactly what I mean. If January 2021 is max I can fast scroll to January 2021. With single tapping I can choose February 2021, too. Not what I expected by setting a max date

But when you tap on a date above max (or below min) it should go back to the previous set value. If not, there is a bug there.

But when you tap on a date above max (or below min) it should go back to the previous set value. If not, there is a bug there.

Maybe you should test it, but in my usage it looks like a bug

Will do. Keep posted for new versions. Thank you for taking the time to test the library and sharing your findings 👍🏼


Enable the CodeQL workflow to pull submodules similar to the regular workflow.

Enable the CodeQL workflow to pull submodules similar to the regular workflow.
This also removes a "fetch-depth: 0" that as far as I understand documentation of "checkout" has been taking up unnecessary disk space.

Is this specifically to include the updates from the WIL submodule? @JakobL-MSFT

Is this specifically to include the updates from the WIL submodule? @JakobL-MSFT

Yes!  More specifically our "Code Analysis" workflow is currently failing with:
D:\a\Windows-driver-samples\Windows-driver-samples\audio\sysvad\APO\SwapAPO\SwapAPO.h(21,10): fatal  error C1083: Cannot open include file: 'wil\com.h': No such file or directory [D:\a\Windows-driver-samples\Windows-driver-samples\audio\sysvad\APO\SwapAPO\SwapAPO.vcxproj]
We did not see this initially because we by mistake was throwing away the build error. That is being fixed with https://github.com/microsoft/Windows-driver-samples/pull/881 .  Example: https://github.com/microsoft/Windows-driver-samples/actions/runs/4178466959/jobs/7237296142 .


Need help for adding other languages

I've been debugging this code for making GPT SoVits works with portuguese and other languages, i modified the code to adapt the Bert and hubert, but for adding other phonemes to the code i need to add on symbols, and to add on symbols.py, a people said for me that need to retrain a pretrain s2G, but i don't know how to work with this pretrain, how to train this pretrain again because i don't know what classification it uses

Sorry for the inconvenient, i've founded the code for pretrain the s2
For anyone that don't know, to train the s2 you need use the https://github.com/innnky/ar-vits repository

我一直在调试此代码，以使 GPT SoVits 适用于葡萄牙语和其他语言，我修改了代码以适应 Bert 和 hubert，但是为了在代码中添加其他音素，我需要添加符号，并添加 symbol.py，有人对我说需要重新训练一个预训练 s2G，但我不知道如何使用这个预训练，如何再次训练这个预训练，因为我不知道它使用什么分类

请问您训练成功了吗，使用了多少数据呢

I haven't done any training yet, but I thought it might be the way I'm going to do it. There's the ar-vits project that has s2 training, but I still don't have enough datasets for the training.

I haven't done any training yet, but I thought it might be the way I'm going to do it. There's the ar-vits project that has s2 training, but I still don't have enough datasets for the training.

I am currently planning to try training a small language. If you also have the same plan recently, we might be able to discuss it together.

Well that would be really cool, I'm currently trying train Portuguese (the language of Brazil), it is not small, but it does not have a strong community on artificial intelligence, it would be great to have help.


Support markdown linter

based on: https://gitlab.com/fluidattacks/product/-/tree/master/makes/utils/lint-markdown
Document it.

Done.


Relax types

🚀 Snapshot Release (alpha)
The latest changes of this PR are available as alpha on npm (based on the declared changesets):

Package
Version
Info

fets
0.0.11-alpha-20230316111950-642e4ff
npm ↗ unpkg ↗

💻 Website Preview
The latest changes are available as preview in: https://a2e85d59.fets.pages.dev

💻 Website Preview
The latest changes are available as preview in: https://8592bea0.fets.pages.dev


 implement virtual scrolling（ 组件提供虚拟滚动）

This function solves the problem (这个功能解决的问题)
Large data volume  rendering lag problem（大数据量  渲染卡顿问题）
Expected API (期望的 API)
<n-list
    :data="data"
    :max-height="250"
    :scroll-x="1800"
    virtual-scroll
  >
    <template v-slot="{ item, index }">
     </template>
</n-list>

Won't do.
You can use some third party virtual list component.

With third party virtual list components it's pretty tricky to get these lists to work inside n-scrollbar to get it's nice consistent look in all browsers


Fix calculation of link-only sample size for u-training

Type of PR

[x] BUG
[ ] FEAT
[ ] MAINT
[ ] DOC

Is your Pull Request linked to an existing Issue or Pull Request?
Closes #1232
Closes #1000
Also solves an undocumented issue where cluster_studio_dashboard would fail for sqlite if using random clusters.
These issues also apply to postgres - this fixes the equivalent of #1232 there, with the rest just requiring an equivalent update to PostgresLinker._random_sample_sql.
Give a brief description for the solution you have provided
The calculation in estimate_u_using_random_sample for link-only jobs gave the wrong sample_size (i.e. the number of source nodes to sample). This didn't affect spark or duckdb as they used the proportion which was calculated correctly.
I have:

corrected this calculation
fixed a logical error in sqlite _random_sample_sql which meant we sampled the wrong number when there was more than one data-set (by including the source dataset in the effective id)
allowed sqlite _random_sample_sql to find the unique id column + source dataset column from settings, rather than being hard-coded (in the former case)
added a test covering some lesser-used settings options (relevant in particular for this PR: unique_id_column_name)
now pass table (being sampled from) and unique id to _random_sample_sql, as we need this info for sqlite, as this SQL is also used for building the cluster studio
moved the base _random_sample_sql from SplinkDataFrame (where it was unused) to Linker (to help clue subclasses)

PR Checklist

[N/A] Added documentation for changes
[N/A] Added feature to example notebooks at tutorials in splink_demos (if appropriate)
[x] Added tests (if appropriate)
[x] Made changes based off the latest version of Splink
[x] Run the linter

☝ investigating test issue - seems that there is a problem when running on pyspark version in CI - version 3.4.0 works fine locally

@ThomasHepworth I have made an identical change to the postgres linker now that #1251 is merged.
Not sure why the autoblack workflow is failing - looks like maybe an issue with cached env?

(it was - have reset the lint cache and worked okay)


(dropbox) issue with helper.ps1

@AdmiringWorm @majkinetor @gep13
This will fix Issue #1270
Due to a Posh v3 variable used that defaults to null in Posh v2 systems. Changed to use same variable if not defined. Fixed the version check to check for pre version suffix and remove it.

Description

Motivation and Context

How Has this Been Tested?

Screenshot (if appropriate, usually isn't needed):
Types of changes

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Migrated package (a package has been migrated from another repository)

Checklist:

[x] My code follows the code style of this repository.
[ ] My change requires a change to documentation (this usually means the notes in the description of a package).
[ ] I have updated the documentation accordingly (this usually means the notes in the description of a package).
[x] All files are up to date with the latest Contributing Guidelines
[ ] The added/modified package passed install/uninstall in the chocolatey test environment.
[ ] The changes only affect a single package (not including meta package).

Original Location

Original Repository
Open Issues Add the different issues underneath, and tick those that are fixed in this PR

[x] Issue #1270
[ ] Issue 2 Link

[ ] Include the link to the opened PR that removes the package from the original location
[ ] The migration guidelines have been followed

:white_check_mark: Package verification completed without issues. PR is now pending human review

:white_check_mark: Package verification completed without issues. PR is now pending human review

:white_check_mark: Package verification completed without issues. PR is now pending human review

I'll force out a new stable release of dropbox with this fix.


User's roles edition needs mass assignment which leeds to major security issue

I'm using CanCan here, but this would also be an issue for other authentication systems I guess.
In my app I'd like to allow admins to edit the roles of other users, so I allowed the guys with admin role to :
can :manage, User
can :read, Role (apparently needed by RailsAdmin just to list the roles in the HABTM form and therefore allow edition)

but that wasn't working, so I googled around and found that I needed to add :role_ids to the attr_accessible fields in my User model.
And indeed it's now working.
But what I realized a bit later is that it's a major security issue since anyone can just mass-assign it's roles !
I then googled a bit to see if there was some way to define a dynamic attr_accessible, and then found this Railscasts explaining the use of the mass_assignment_authorizer method, so I added this to my User model :
private
def mass_assignment_authorizer
  super + [:role_ids]
end

And since it's now preventing a user from mass-assigning his roles (unless he is admin), I lost the ability to edit them in the RailsAdmin window.
Any idea how I could have both a secure app and an easy and RailsAdmin-ish way to change my users roles ?

You can use :role with :attr_accessible. And then tell RailsAdmin which :role to use depending on the user.
It's in the readme.

Ben is correct, you can limit access to the field based on an ActiveModel role, is a new feature in Rails 3.1
http://www.enlightsolutions.com/articles/whats-new-in-edge-scoped-mass-assignment-in-rails-3-1/

A limitation creating a security issue for me is limitation on assignable values based on role.  I want 'employees' to update 'unconfirmed clients' to 'confirmed clients'  but not to update anyone to admin.  Admin's can update to any role.
Now I filter the enum's, but this doesn't give me protection on the server.  (fortunately my users will not be sophisticated)  So an authenticated employee has access to that field, but I don't want him to change himself to admin.  Is there any way to do this with RailsAdmin?
Model still doesn't know who is updating.  This would have been something on the controller, but we have no controllers in RailsAdmin.

If you can access current_user through Thread.current or such, you can check values when they come back (overriding ActiveRecord default accessors for your protected field)

So accessing Thread.current in the model validations and looking for a current_user?  I didn't think of that, thank you.


Title: Adding navbar to your website

Which pre-existing JavaScript project will you be working on?
I will be integrating many features into my fitness and nutrition website to enhance user navigation and overall usability.
Describe your enhancement/improvement
I aim to enhance the website's user experience by adding a responsive navbar. This navbar will provide easy navigation across the website's pages, improving accessibility and user interaction.
Anything you need to say to the Reviewers
Could you plz assign me this issue under GSSOC'24
Add any other context or relevant screenshots about the enhancement here.
No response

@harshmishra19 Than you for providing your insight but it is not required as of now.


Refactor filesystem_watcher_system with let-else

Objective
filesystem_watcher_system previously used if let in
a way that could be cleanly replaced by let else.
Inside the loop,  there were a match followed by a if let
that could be merged together.
Solution
Use let else and merge the match and if let

Related: #7104
It looks like rustfmt still doesn't support let else.

Oooh, I thought #7104 was merged already and this was an oversight. Hmm, not sure if I should keep this open


[Elasticsearch VectorStore] Could not find trained model

Checked other resources

[X] I added a very descriptive title to this issue.
[X] I searched the LangChain documentation with the integrated search.
[X] I used the GitHub search to find a similar question and didn't find it.
[X] I am sure that this is a bug in LangChain rather than my code.

Example Code
from langchain_community.vectorstores.elasticsearch import ElasticsearchStore
from langchain_community.document_loaders import DirectoryLoader
from elasticsearch import Elasticsearch

loader = DirectoryLoader('../', glob="**/*.pdf", show_progress=True)
docs = loader.load()

print(docs[0])

es_connection = Elasticsearch(
    hosts=['https://XXXXXXX.es.us-central1.gcp.cloud.es.io'],
    basic_auth=('XXXXX', 'XXXXX')
)

vector_store = ElasticsearchStore(
            index_name="test-elser",
            es_connection=es_connection,
            strategy=ElasticsearchStore.SparseVectorRetrievalStrategy(
                model_id=".elser_model_2_linux-x86_64"
            ),
        )

vector_store.add_documents(docs)

Error Message and Stack Trace (if applicable)

First error reason: Could not find trained model [.elser_model_1]
Traceback (most recent call last):
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/langchain_elser/vector_store.py", line 23, in
vector_store.add_documents(docs)
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/langchain_core/vectorstores.py", line 119, in add_documents
return self.add_texts(texts, metadatas, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/langchain_community/vectorstores/elasticsearch.py", line 1040, in add_texts
return self.__add(
^^^^^^^^^^^
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/langchain_community/vectorstores/elasticsearch.py", line 998, in __add
raise e
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/langchain_community/vectorstores/elasticsearch.py", line 981, in __add
success, failed = bulk(
^^^^^
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/elasticsearch/helpers/actions.py", line 521, in bulk
for ok, item in streaming_bulk(
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/elasticsearch/helpers/actions.py", line 436, in streaming_bulk
for data, (ok, info) in zip(
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/elasticsearch/helpers/actions.py", line 355, in _process_bulk_chunk
yield from gen
File "/Users/gustavollermalylarrain/Documents/proyectos/labs/langchain-elser/.venv/lib/python3.11/site-packages/elasticsearch/helpers/actions.py", line 274, in _process_bulk_chunk_success
raise BulkIndexError(f"{len(errors)} document(s) failed to index.", errors)
elasticsearch.helpers.BulkIndexError: 2 document(s) failed to index.

Description
The ELSER ingestion is not working if I use a different elser model id than the default.
I tried with both ElasticsearchStore.from_documents and ElasticsearchStore.add_documents with no luck
System Info
System Information

OS:  Darwin
OS Version:  Darwin Kernel Version 23.3.0: Wed Dec 20 21:30:44 PST 2023; root:xnu-10002.81.5~7/RELEASE_ARM64_T6000
Python Version:  3.11.6 (main, Nov  2 2023, 04:39:43) [Clang 14.0.3 (clang-14<IP_ADDRESS>.1)]

Package Information

langchain_core: 0.1.23
langchain: 0.1.7
langchain_community: 0.0.20
langsmith: 0.0.87

Packages not installed (Not Necessarily a Problem)
The following packages were not found:

langgraph
langserve

It is possible to get into an inconsistent state when the index was first created with the default model ID (strategy=ElasticsearchStore.SparseVectorRetrievalStrategy()) because . elser_model_1 is then set in the index settings. If you then change only the model ID but you keep the index, it still tries to use the previous model.
@llermaly Was this possibly your situation? Did you try deleting the test-elser index and then re-running the code above with .from_documents?

I had the same issue as OP and the suggestion by maxjakob solved the issue :). Thank you.

Thanks @maxjakob you've been a lifesaver, this issue gave a deep migraine before I hit your comment here


Feature Request: Add Script to Generate IGV Browser Screenshots

Develop a script that generates screenshots of the alignment of the variants in the IGV browser. This will aid in the visual validation of the filtering results.
Acceptance Criteria:

Create a script to generate IGV screenshots for specified variants.
Ensure the script is configurable for different IGV settings.
Update the README with instructions on how to use the new script.

The script should be able to take multiple BAM files including Tumor, Normal, and Controls.


HKG: add Kia Seltos 2024 Non-SCC platform

Checklist

[x] harness Type: Hyundai L
[x] architecture: CAN

Link to all physical parts during installation

comma 3X
car harness kit

Hyundai L

Thanks to the community 2024 Kia Seltos Non-SCC owner jeroid_ (Discord).

Did you mean to pr this sunypilot or openpilot bro?

Did you mean to pr this sunypilot or openpilot bro?

It is meant for sunnypilot as it does not have SCC :)

@sunnyhaibin - hello hello 👋🏼, any objection if we expand this PR to support a 2023 Kia Seltos non-scc as well?
Harness is the same as above: Hyundai L
Hardware is a C3
Issues / bug so far:

Forward collision avoidance gets switched off / disabled (just confirming). Lamp indication is ON on instrument cluster as well.
Assuming this will be fixed with the added finger printing, but upon first install and connection to the car, it does take a few restarts of C3 and car to successfully detect. If I recall, the error was the classic "CAN connection failure, check cables"
Steering control seems to drop off at random when stopped and only becomes active again after a +-25km/h OR changing lanes / inputting manual steering. I haven't been able to pinpoint the exact cause but can definitely say it stops getting applied. Will see if I can locate a route with this.
Once in a blue moon, the car will freak out and display the "take break" on the instrument cluster, while C3 errors and has the "take control immediately". No route saved, will make note of this next time.
In order to activate MADS, I have to press the LKAS button first, and then Cruise Main.
"Camera Frame Rate Low" alert is shown every time when car starts.
Shifting gear into S / manual mode causes C3 to freak out.

Let me know if you need any more info <3
Full FW dump:
'carFw': [{'address': 2004,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'eps',
                          'fwVersion': b'\xf1\x00SP2 MDPS C 1.00 1.01 56300Q5920          ',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 2012,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'\xf1\x006V2B0_C2\x00\x006V2D4051\x00\x00CSP2N20KL1\xf1\xf7\xe2\x10',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 2001,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'abs',
                          'fwVersion': b'\xf1\x00SP ESC \r 100"\x04\x01 58910-Q5510',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 2009,
                          'subAddress': 0},
                         {'address': 1988,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'fwdCamera',
                          'fwVersion': b'\xf1\x00SP2 MFC  AT AUS RHD 1.00 1.02 99210-Q5500 220624',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 1996,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'\xf1\x81616G2051\x00\x00\x00\x00\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2004,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'eps',
                          'fwVersion': b'\xf1\x87           \xf1\x00SP2 MDPS C 1.00 1.01 56300Q5920          ',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2012,
                          'subAddress': 0},
                         {'address': 2001,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'abs',
                          'fwVersion': b'\xf1\x8758910-Q5510\xf1\x00SP ESC \r 100"\x04\x01 58910-Q5510',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2009,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'\xf1\x87CXNUG49078092JH2\x89\x97iv\xa9UuW\xaaevW\x99\x98\x89\x88Vx\x9f\xffx\xff\xff\xff\x0b\n\xf1\x816V2D40'
                                       b'51\x00\x00\xf1\x006V2B0_C2\x00\x006V2D4051\x00\x00CSP2N20KL1\xf1\xf7\xe2\x10',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 1988,
                          'brand': 'hyundai',
                          'bus': 0,
                          'ecu': 'fwdCamera',
                          'fwVersion': b'\xf1\x00SP2 MFC  AT AUS RHD 1.00 1.02 99210-Q5500 220624',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 1996,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'SPD5P2AS6G2A\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'>\x00', b'"\xf1\x82'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'CSP2N20KL1',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'>\x00', b'"\xf1\x82'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'CSP2N20KL1',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x82'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'SPD5P2AS6G2A\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x82'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'volkswagen',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'\xf1\x82SPD5P2AS6G2A\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x89\xf1\x82'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'volkswagen',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'\xf1\x87CXNUG49078092JH2\x89\x97iv\xa9UuW\xaaevW\x99\x98\x89\x88Vx\x9f\xffx\xff\xff\xff\x0b\n\xf1\x896V2D40'
                                       b'51\x00\x00\xf1\x82CSP2N20KL1',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x89\xf1\x82'],
                          'responseAddress': 2025,
                          'subAddress': 0}],```

@sunnyhaibin - hello hello 👋🏼, any objection if we expand this PR to support a 2023 Kia Seltos non-scc as well?
Harness is the same as above: Hyundai L Hardware is a C3
Issues / bug so far:

Forward collision avoidance gets switched off / disabled (just confirming). Lamp indication is ON on instrument cluster as well.
Assuming this will be fixed with the added finger printing, but upon first install and connection to the car, it does take a few restarts of C3 and car to successfully detect. If I recall, the error was the classic "CAN connection failure, check cables"
Steering control seems to drop off at random when stopped and only becomes active again after a +-25km/h OR changing lanes / inputting manual steering. I haven't been able to pinpoint the exact cause but can definitely say it stops getting applied. Will see if I can locate a route with this.
Once in a blue moon, the car will freak out and display the "take break" on the instrument cluster, while C3 errors and has the "take control immediately". No route saved, will make note of this next time.
In order to activate MADS, I have to press the LKAS button first, and then Cruise Main.
"Camera Frame Rate Low" alert is shown every time when car starts.
Shifting gear into S / manual mode causes C3 to freak out.

Let me know if you need any more info <3
Full FW dump:
'carFw': [{'address': 2004,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'eps',
                          'fwVersion': b'\xf1\x00SP2 MDPS C 1.00 1.01 56300Q5920          ',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 2012,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'\xf1\x006V2B0_C2\x00\x006V2D4051\x00\x00CSP2N20KL1\xf1\xf7\xe2\x10',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 2001,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'abs',
                          'fwVersion': b'\xf1\x00SP ESC \r 100"\x04\x01 58910-Q5510',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 2009,
                          'subAddress': 0},
                         {'address': 1988,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'fwdCamera',
                          'fwVersion': b'\xf1\x00SP2 MFC  AT AUS RHD 1.00 1.02 99210-Q5500 220624',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 1996,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'\xf1\x81616G2051\x00\x00\x00\x00\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2004,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'eps',
                          'fwVersion': b'\xf1\x87           \xf1\x00SP2 MDPS C 1.00 1.01 56300Q5920          ',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2012,
                          'subAddress': 0},
                         {'address': 2001,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'abs',
                          'fwVersion': b'\xf1\x8758910-Q5510\xf1\x00SP ESC \r 100"\x04\x01 58910-Q5510',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2009,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'hyundai',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'\xf1\x87CXNUG49078092JH2\x89\x97iv\xa9UuW\xaaevW\x99\x98\x89\x88Vx\x9f\xffx\xff\xff\xff\x0b\n\xf1\x816V2D40'
                                       b'51\x00\x00\xf1\x006V2B0_C2\x00\x006V2D4051\x00\x00CSP2N20KL1\xf1\xf7\xe2\x10',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x81\xf1\x00'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 1988,
                          'brand': 'hyundai',
                          'bus': 0,
                          'ecu': 'fwdCamera',
                          'fwVersion': b'\xf1\x00SP2 MFC  AT AUS RHD 1.00 1.02 99210-Q5500 220624',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x00'],
                          'responseAddress': 1996,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'SPD5P2AS6G2A\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'>\x00', b'"\xf1\x82'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'CSP2N20KL1',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'>\x00', b'"\xf1\x82'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'CSP2N20KL1',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x82'],
                          'responseAddress': 2025,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'subaru',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'SPD5P2AS6G2A\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x82'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2016,
                          'brand': 'volkswagen',
                          'bus': 1,
                          'ecu': 'engine',
                          'fwVersion': b'\xf1\x82SPD5P2AS6G2A\x00\x00\x00\x00',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x89\xf1\x82'],
                          'responseAddress': 2024,
                          'subAddress': 0},
                         {'address': 2017,
                          'brand': 'volkswagen',
                          'bus': 1,
                          'ecu': 'transmission',
                          'fwVersion': b'\xf1\x87CXNUG49078092JH2\x89\x97iv\xa9UuW\xaaevW\x99\x98\x89\x88Vx\x9f\xffx\xff\xff\xff\x0b\n\xf1\x896V2D40'
                                       b'51\x00\x00\xf1\x82CSP2N20KL1',
                          'logging': False,
                          'obdMultiplexing': True,
                          'request': [b'"\xf1\x87\xf1\x89\xf1\x82'],
                          'responseAddress': 2025,
                          'subAddress': 0}],```

So seems like your car is also CAN platform then! Neat. I'll update the PR with your model year.

Forward collision avoidance gets switched off / disabled (just confirming). Lamp indication is ON on instrument cluster as well.
That's a weird one. We supposedly don't touch anything with FCW with these cars. Got a route of this?

Steering control seems to drop off at random when stopped and only becomes active again after a +-25km/h OR changing lanes / inputting manual steering. I haven't been able to pinpoint the exact cause but can definitely say it stops getting applied. Will see if I can locate a route with this.
Sounds like there's a low-speed lockout that's not well-understood yet. Got a route?

Once in a blue moon, the car will freak out and display the "take break" on the instrument cluster, while C3 errors and has the "take control immediately". No route saved, will make note of this next time.
This seems to be something similar to some CAN-FD platforms cutting out due to attention monitoring from the stock system. This needs further investigation with upstream.

In order to activate MADS, I have to press the LKAS button first, and then Cruise Main.
Does pressing the CRUISE MAIN button engage SCC immediately on this platform?

Shifting gear into S / manual mode causes C3 to freak out.
Got a route of this? Might need to have the non-Drive gear handled.

Assuming this will be fixed with the added finger printing, but upon first install and connection to the car, it does take a few restarts of C3 and car to successfully detect. If I recall, the error was the classic "CAN connection failure, check cables"
"Camera Frame Rate Low" alert is shown every time when car starts.
I would keep an eye on these errors, and reach out to comma support if it gets worse.


Feedback for “Goodies”

Forgot to pass the statement as an arg to db.execute() for Postgres

This is correct now. Thanks for the report.


[java] OneNote Page Update snippet is wrong

See #288 for the issue description.
See #427 for the C# counterpart of the fix.
AB#7807

re-evaluate with Kiota version.


ImportError: cannot import name 'Layer'

Rasa Core version:0.13.2
Python version: python3.6.8
Operating system (windows, osx, ...):win10
Issue:
Traceback (most recent call last):
File "C:/Users/Admin/Desktop/building-chatbots-with-python-master/Chapter IV/Chapter IV Code horoscope_bot/horoscope_bot/train_initialize.py", line 27, in
validation_split=0.2
File "D:\Python\lib\site-packages\rasa_core\agent.py", line 520, in train
**kwargs)
File "D:\Python\lib\site-packages\rasa_core\policies\ensemble.py", line 63, in train
policy.train(training_trackers, domain, **kwargs)
File "D:\Python\lib\site-packages\rasa_core\policies\keras_policy.py", line 162, in train
shuffled_y.shape[1:])
File "D:\Python\lib\site-packages\rasa_core\policies\keras_policy.py", line 93, in model_architecture
from tensorflow.keras.models import Sequential
File "D:\Python\lib\site-packages\tensorflow\keras_init_.py", line 20, in
from . import layers
File "D:\Python\lib\site-packages\tensorflow\keras\layers_init_.py", line 8, in
from tensorflow.python.estimator.keras import Layer
ImportError: cannot import name 'Layer'
I am a beginner,this problem gets me,i do not know how to do ,i hope you can help me,thanks.
Content of domain file (if used & relevant):

I have a same issue using jupyter notebook.
During:         import rasa
Help me.


Feature/ebsCsiAddon

New EBS CSI Driver add-on
Fixes #232
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Add example to examples/blueprint-construct/index.ts so it gets tested with our e2e tests.

@askulkarni2 and @shapirov103: As discussed,  I refactored the coreAddOn to take an optional policy document and namespace. Those are then used to create the service account using the sa-utils createServiceAccount function.
I also refactored the ebs csi driver to extend the new version of the coreAddOn.
Let me know if there is anything else we can improve upon and want to do at this time.
Thanks!

/do-e2e-tests

Hmm, the test failed due to karpenter failure. @camba1 did you run e2e with Karpenter in your account?

/do-e2e-tests

@camba1 e2e tests are failed twice with the same error, so appears to be a consistent failure on Karpenter. Have you observed the same in your account?

@shapirov103: I ran cdk list, npm test and they ran fine. However when I try deploying Karpenter and EBS to EKS in my account, I just got a time out waiting for the condition. error. Is that the same error are you seeing? Where can I see it? How do I enable e2e tests

@camba1 you can see what the CI test is doing in ci/buildspec.yml. This will deploy all clusters. For you purposes you can just run cdk deploy eks-blueprint-vpc and cdk deploy blueprint-construct-dev.
Yes, we get the same error in the CI account. Only a couple of contributors have access to the account atm, but normally if it runs in your account it should work in the CI account as well.
For the namespace create, please try createNamespace(name, cluster, true).

@shapirov103: Thanks for the info about ci/buildspec.yml. I will start running that on a regular basis.
In terms of the Karpenter error, I played with it on a test cluster. I noticed the error is thrown if Karpenter is added to a cluster containing ebs driver. But, if the ebs driver is added to a cluster that already has Karpenter running, then some of the ebs drivers pods are not scheduled as the scheduler complains that there is not enough cpu. So, I added a second node to the cluster using:
const clusterProviderProps: MngClusterProviderProps = {
    minSize: 2,
    maxSize: 2,
    desiredSize: 2,
    version: KubernetesVersion.V1_20
}

And at that point I was able to deploy everything properly without any other changes. Should we update the size of the cluster we are using for testing?
On the ebs driver throwing an error when explicitly creating the namespace. I still get the same error even with createNamespace(name, cluster, true)

@camba1 you can add the desired node size as part of the PR to the blueprint-construct-dev cluster. i assume the cluster CA should scale it up but it fails on a timeout.
With respect to the namespace: it is seems odd, since the overwrite flag means it will be applied with kubectl apply as per this.
Can you check if that change made into the synthesized template just to make sure? If it fails consistently let's discuss on the plan.

I have upgraded the test cluster. It now will instantiate 2 m5.xlarge which successfully deploys everything. I tried with 2 m5;large, but that still saw the same error. In the end, there was just not enough cpu in the m5 for all the add-ons we are deploying for testing
For the namespace issue, the error is throw during cdk list/synth, so it is not even making it to Kubernetes.  If I remove the line and do cdk synth, there is one reference in the stack to that object:
Metadata: aws:cdk:path: blueprint-construct-dev/kube-system-namespace-struct/Resource/Default.  within the kubesystemnamespacestructA6B3FF7C resource

/do-e2e-tests

e2e failing with a timeout from i observe. No errors. I will give it another try. I think more than 2 hours for an e2e test is a bit pushing it.

/do-e2e-tests

@camba1  the e2e test failure is due to a timeout. Let's do the following:

Comment out the custom AMI blueprint creation for now. I will address it with my PR for multi-node group support. It is under bin/main.ts lines 37 and all the way down.
For the blueprint construct let's keep the node group to desired size of 1 and use a bigger box, e.g. m5.2xlarge.

@shapirov103  I made the changes we discussed:

Removed the namespace option from core-addon and ebs csi add-on
Commented out second for custom AMI creation blueprint
Updated blueprint construct to use one node (default) and use a m5.2xLarge box
Blueprint cluster creation was successful and took 23 minutes in my environment

Thanks!

/do-e2e-tests

/do-e2e-tests


Levenshtein distance, is it implemented?

Hi there,
I see in the C code that there is a levenshtein distance calculation function. But AFAIK, it is not implemented in AQL. Are there any plans to implement it? It would be very useful!
Thanks!

AQL currently does not have a levenshtein distance function, but it's trivial to add one yourself using a JavaScript custom AQL function like this:
require("org/arangodb/aql/functions").register("my::levenshtein", function (a, b) {
  if(a.length === 0) return b.length;
  if(b.length === 0) return a.length;
  var matrix = [];
  var i;
  for(i = 0; i <= b.length; i++){
    matrix[i] = [i];
  }
  var j;
  for(j = 0; j <= a.length; j++){
    matrix[0][j] = j;
  }
  for(i = 1; i <= b.length; i++){
    for(j = 1; j <= a.length; j++){
      if(b.charAt(i-1) == a.charAt(j-1)){
        matrix[i][j] = matrix[i-1][j-1];
      } else {
        matrix[i][j] = Math.min(matrix[i-1][j-1] + 1, Math.min(matrix[i][j-1] + 1, matrix[i-1][j] + 1));
      }
    }
  }
  return matrix[b.length][a.length];
});

The actual function code is from here.
You can then call the function my::levenshtein() from within an AQL query as any other function.

Thank you for the helpful reply!
However, I guess a native implementation, as the one that you've done here, would probably be faster when you need to compare with thousands of names. I'll try this javascript solution and see how it goes, anyway!
Thanks!

Yes, a native implementation may be faster when called often.
However, it's not there at the moment, requires proper implementation and testing, new binaries being built etc.
Therefore I wanted to present a solution that works right now.

Sure, thank you. I'll try it.

The performance of a single Levenshtein calculation is usually not so important, because of ~n² complexity if you compare each and every string with all others. For 1 million strings, there would be 1 trillion calculations. No matter what the speed difference between JS and C++ is, it will last weeks, months or even years.
Algorithms like Soundex might be more suitable for some use cases, if you can filter by example (equality). Or use Levenshtein with a (small) sliding window to massively reduce the number of required calculations if your problem allows that.

Hmmm. I guess soundex wouldn't work for my case, since what I need is to match user input against scientific names, not common words. I'll see how can I optimize this javascript function (e.g. I can restrict the calculation to words that start with the same letter, as the user usually does not misspell the first letter; or use a cut off distance within the function to abort...).
Thanks for the hints anyway.

Hello,
Will ArangoDB allow pluggable native functions in the future?

Yes, we have been discussing this lately. In the end you would only have to implement an .so / .dll with a special hook registering the AQL-functions into the table (which is currently static).
We also ported most functions from .js to c++ with the 2.8 release - since the cost of making data visible in .js functions can't be ignored.
I.E appinding json values to a string:
https://github.com/arangodb/arangodb/blob/devel/arangod/Aql/Functions.cpp#L887
which is registered here:
https://github.com/arangodb/arangodb/blob/devel/arangod/Aql/Executor.cpp#L239
However, this will also require to have a stable and mature API for those plugins, which we currently don't know when we will get it.
The other solution for getting your own implemented native function running is to send a pull request ;-)

Yeah it would be great to provide a simple means of plugging in user defined functions in native code. Just like the MySQL UDFs, which I used a lot in other projects, and are fairly simple to implement in C, yet very powerful in speed. I usually have special needs for the queries, which require some processing to be done in the native code, usually against a BLOB of a C array/structure. (looking forward for the BLOB support also! actually, for me a "BSOB" would be enough!)

Does AQL have something similar to soundex function at latest versions?

There is no built-in support for Soundex or related functions. You could implement it in JS like the Levenshtein function however.

v3.4.0-RC.4 is out for testing and comes with a LEVENSHTEIN_DISTANCE() function: https://docs.arangodb.com/3.4/AQL/Functions/String.html#levenshteindistance

Closing - As already stated, both the LEVENSHTEIN_DISTANCE() function and the SOUNDEX() function are implemented since v.3.4.0-RC.4.

It was actually in the first preview release already (v3.4.0-preview.1), which means also in RC.1, but it wasn't in milestone0. See the respective Git(Hub) tags.


Yocto firmware generation error (ceph)

While generating the firmware with cqfd the following errors always occur:

I followed the steps of the documentation for preparing and generating the firmware. After using the  cqfd -b host_efi_test command in the terminal the firmware generation is started. After some time the error messages shown above occur in the terminal. The same thing happend with other cqfd flavors like host_efi.
I expected the generation to run further and as a result getting the desired firmware.
I tried the firmware generation on a virtual machine with the following specifications:
Ubuntu 22.04.4 Desktop amd64
8 GB RAM
4 Cores of the i7-4790S
400 GB storage space
The error occured also on the following system:
Intel NUC 12
Ubuntu 18
i7-1260P
64 GB DDR4 RAM
2 TB M.2 SSD
This is a screenshot of the corresponding log file:

Hi.
Sorry for missing this issue.
It seems it was a problem of ceph compilation at the time on the meta-virtualization.
I compiled ceph on a fresh installation today and the problem is gone.
I closed this as not applicable anymore, feel free to reopen if needed.


user have to scroll to send sats

while sending sats in iOS (small devices user have to scroll to Use CTA "Confirm and Send ".

Need to check when iOS release will come.

completed (495)


TaskVineExecutor: Improve serverless

Description
This PR brings changes that addresses concerns in PR #2849.

Added and edited comments and debug messages so they are accurate or more meaningful.
Fixed the issue where function and arguments are serialized twice. Now they are serialized once.
Added stronger type hints and checking in several places.
Added a default function execution mode option in the Executor interface to support for applications that want to exclusively run functions in either mode. Users can still override this global option by specifying the execution mode at the function level via parsl_resource_specification.
Use multiprocessing.Event to signal the stopping condition instead of Value.
Other minor fixes.

Fixes # (issue)
Type of change
Choose which options apply, and delete the ones which do not apply.

Bug fix (non-breaking change that fixes an issue)

Further comments
This PR works with the newest commit from CCTools, and each worker only runs one function at a time. More improvements are coming.

This PR depends on CCTools latest commit so let's make it a draft PR for now.

On my laptop, I get around 100 tasks per second with serverless mode turned on, with the below config.
This compares against (variable) 300 tasks/second using parsl/tests/configs/workqueue_ex.py.
I haven't investigated any further into what is actually going on to see where time is being spent.
from parsl.config import Config
from parsl.executors.taskvine import TaskVineExecutor
from parsl.executors.taskvine import TaskVineManagerConfig

from parsl.data_provider.http import HTTPInTaskStaging
from parsl.data_provider.ftp import FTPInTaskStaging
from parsl.data_provider.file_noop import NoOpFileStaging

def fresh_config():
    return Config(executors=[TaskVineExecutor(manager_config=TaskVineManagerConfig(port=9000, shared_fs=True),
                                              worker_launch_method='factory',
                                              function_exec_mode='serverless',
                                              storage_access=[FTPInTaskStaging(), HTTPInTaskStaging(), NoOpFileStaging()])])

I think the relevant latest cctools is released now, so this can be merged, right? @tphung3

Yes, I can add minor fixes in later in a separate PR. @benclifford


Fix display of default instance exists in WDS status

Currently, the logic for displaying a success or error icon on the "Default instance exists" row in the WDS status modal is broken. The display logic is written as if the status were a boolean, but it is actually a string.
Before
Default instance does not exist, but it's shown as successful.

After

Was this not in a test somewhere?  Or did the test have it as a boolean so do we need to update the test?

https://github.com/DataBiosphere/terra-ui/blob/dev/src/components/data/WdsTroubleshooter.test.ts
There's no test case where defaultInstanceExists is false, but there are also no tests for the icons.


Indexer: increase GOMAXPROCS variable

Goal of this PR
While investigating ways to improve Badger performance, I came across an interesting entry in their FAQ, that pointed me to a Go mailing list discussion (found in the code comment of the PR).
In summary, when talking about disk I/O, the interaction between the Go runtime and the OS scheduler creates a situation where Go routines can be starved off having an OS thread to run on, even when some CPU cores are idle. So the default value of GOMAXPROCS is too low for disk I/O intensive applications.
Dgraph themselves, which is built on Badger, uses a value of 128, so I have just used the same here.
Checklist

[x] Is on the right branch
[x] Documentation is up-to-date
[ ] Tests are up-to-date

Interesting read. Did you measure the impact?

Interesting read. Did you measure the impact?

No.


yt-dlp: 2024.7.7 -> 2024.7.9

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[x] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 325964 run on aarch64-darwin 1

30 packages marked as broken and skipped:

ani-cli
cplay-ng
cplay-ng.dist
curseradio
curseradio.dist
dmlive
dra-cla
ff2mpv
ff2mpv-go
gonic
hydrus
hydrus.doc
invidtui
klipperscreen
mov-cli
mov-cli.dist
mpc-qt
mpv
photoqt
plex-media-player
python311Packages.mpv
python311Packages.mpv.dist
python312Packages.mpv
python312Packages.mpv.dist
somafm-cli
subtitleedit
tomato-c
wtwitch
youtube-tui
ytfzf

37 packages built:

botamusique
catt
catt.dist
gallery-dl
gallery-dl.dist
moodle-dl
moodle-dl.dist
mopidy-youtube
mopidy-youtube.dist
mpvScripts.mpv-playlistmanager
parrot
persepolis
python311Packages.tubeup
python311Packages.tubeup.dist
python311Packages.yark
python311Packages.yark.dist
python311Packages.yt-dlp
python311Packages.yt-dlp-light
python311Packages.yt-dlp-light.dist
python311Packages.yt-dlp.dist
python312Packages.tubeup
python312Packages.tubeup.dist
python312Packages.yark
python312Packages.yark.dist
yt-dlp (python312Packages.yt-dlp)
yt-dlp-light (python312Packages.yt-dlp-light)
yt-dlp-light.dist (python312Packages.yt-dlp-light.dist)
yt-dlp.dist (python312Packages.yt-dlp.dist)
spotdl
spotdl.dist
yewtube
yewtube.dist
ytcc
ytcc.dist
ytdownloader
ytmdl
ytmdl.dist


This hides the government row from the list of Fuel Suppliers

#231
This hides the Government row from the Fuel Suppliers Table

@kuanfandevops yes please deploy to test. Thank you!

@justinlepitzki @matthewhall78 deployed on test. Let me know when you want it with previous changes deployed on prod.


paintWorklet is now under CSS namespace

Changing window.paintWorkletto window.CSS.paintWorklet

Thank you very much, @artdiniz!


tweaked SetVol.txt to set mute flag

it kept bothering me the setting the volume to 0 would turn the volume off, but not update the [audio]::Mute flag, and therefore the mute icon would not be shown on the taskbar. I added an if/else to SetVol.txt so that now it does.

Yea that is an option I had implemented at first, I left it out because if you want to up the volume from zero/“mute” you would then have to unmute and raise the volume instead of only raising the volume 😉 I left a how to use bit in the .txt so it is still clearly an option for people like you that like to tinker around.
Thanks for the input anyways ✌

Now that i think about it...
Having the mute option and volume set both would be even better. That way you would always have a specific volume when unmute after a restart.
But i'm kinda done with tinkering on this program so feel free to make it so if you wish.


Transition: Bedford social emotional transition notes processor

Who is this PR for?
Bedford students, families, counselors
What does this PR do?
Adds processor for social emotional transition forms.  These aim to map this just to restricted notes, although we may process them separately again to map to services.
Checklists
Which features or pages does this PR touch?

[x] Social emotional processor to notes

Does this PR use tests to help verify we can deploy these changes quickly and confidently?

[x] Included specs for changes

selfie


#6: Excel Reader > Event listeners

ReflectiveExcelReader fires various events while a table is read. We added table, header and row
read events. Fired events:

Before a table is read.
When a row is skipped.
After table headers are read.
When some specified headers are missing.
When a row is skipped.
After a row is read.
After a table is read.

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
Attention: Patch coverage is 95.57522% with 5 lines in your changes missing coverage. Please review.

Files with missing lines
Patch %
Lines

.../reflectiveexcel/reader/event/HeaderReadEvent.java
83.33%
1 Missing :warning:

...lectiveexcel/reader/event/MissingHeadersEvent.java
83.33%
1 Missing :warning:

...com/reflectiveexcel/reader/event/RowReadEvent.java
85.71%
1 Missing :warning:

.../reflectiveexcel/reader/event/RowSkippedEvent.java
83.33%
1 Missing :warning:

...m/reflectiveexcel/reader/event/TableReadEvent.java
87.50%
1 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Files with missing lines
Coverage Δ
Complexity Δ

...m/reflectiveexcel/reader/ExcelReadingSettings.java
100.00% <100.00%> (ø)
9.00 <1.00> (+1.00)

...ava/com/reflectiveexcel/reader/ReadingContext.java
92.59% <100.00%> (-0.14%)
21.00 <0.00> (ø)

...iveexcel/reader/event/listener/EventListeners.java
100.00% <100.00%> (ø)
7.00 <7.00> (?)

...om/reflectiveexcel/reader/readers/TableReader.java
100.00% <100.00%> (ø)
25.00 <13.00> (+14.00)

...tiveexcel/reader/table/DeserializedCellValues.java
100.00% <100.00%> (ø)
4.00 <1.00> (+1.00)

.../com/reflectiveexcel/reader/table/TableHeader.java
97.05% <100.00%> (+0.28%)
17.00 <2.00> (+2.00)

.../reflectiveexcel/reader/event/HeaderReadEvent.java
83.33% <83.33%> (ø)
2.00 <2.00> (?)

...lectiveexcel/reader/event/MissingHeadersEvent.java
83.33% <83.33%> (ø)
2.00 <2.00> (?)

...com/reflectiveexcel/reader/event/RowReadEvent.java
85.71% <85.71%> (ø)
3.00 <3.00> (?)

.../reflectiveexcel/reader/event/RowSkippedEvent.java
83.33% <83.33%> (ø)
2.00 <2.00> (?)

... and 1 more

... and 1 file with indirect coverage changes


fix build error

Coverage increased (+43.6%) to 51.133% when pulling 645543a2d26d92d0b69f72dd741617bf1f88d7c3 on reasonerjt:build-fix into b8169f251e3cc6a7820f577d48d10ea3c4fcad27 on vmware:master.

LGTM