Vectorize base64 decoding

Base64 encoding is used quite a lot. i.e. in RRSIG and DNSKEY records. Wojciech Muła and Daniel Lemire wrote the paper "Faster Base64 Encoding and Decoding Using AVX2 Instructions" in which they outline use of SIMD instructions to improve performance. The current implementation is very basic and improving it is extremely likely to result in a significant performance boost. More research is available too and even improving the current scalar implementation is a big gain.

The flamegraph for parsing an .se zone looks nice and balanced, except for base64 data as the parser spends about 30% of the time in parse_base64.

Sort-of, but I don't think they're an issue(?) Spaces (among others) are delimiters within zone files so we get a separate token for each block of characters (we require this data to be specified as contiguous, so no spaces inside the token). However, we will need to track state because there may be multiple tokens (at least for RRSIG (presentation format)).
An example of how this occurs in zone data:
host.example.com. 86400 IN RRSIG A 5 3 86400<PHONE_NUMBER>3103 (
<PHONE_NUMBER>3103 2642 example.com.
                               oJB1W6WNGv+ldvQ3WDG0MQkg5IEhjRip8WTr
                               PYGv07h108dUKGMeDPKijVCHX3DDKdfb+v6o
                               B9wfuh3DTJXUAfI/M0zmO/zz8bW0Rznl8O3t
                               GNazPwQKkRN20XPXV6nwwfoXmJQbsLNrLfkG
                               J5D6fwFm8nN+6pBzeDQfsS3Ap3o= )

Looking at .se they cut the signature up into blocks of 56 characters (without ( ... ), so one line), while .com seems to keep it as one set of contiguous characters.

This is an important problem. Node.js has a related issue.
See
https://github.com/nodejs/performance/issues/128
I want to work on solving this issue as soon as I can.

Sounds good @lemire! The client9 decoders are probably good to have as fallback(?) At least the base64 one got adopted and modified by @aklomp. The same can be done for base16 (hex). At least, I am planning to do so. The stream decoding interface fits simdzone nicely. Something I noticed in the modified version is that whole blocks need to be written. So the base64 AVX2 version requires at least 45 bytes of input (8 bytes for the fallback) to ensure proper output. Since simdzone guarantees enough padding in input and output buffers, we can perhaps let that requirement go. That may make things speedier/easier(?) Of course, this may or may not apply to Node.js. I'm currently focused on getting the SVCB RRTYPE done, after that testing and api cleanup to get to a first release, but if you need me to look at something, I'd be happy to help!

The main challenge I am concerned with are the spaces in the input… The overflows can be handled in some way but I agree that simdzone can benefit of faster routines than other systems.

Of course, this may or may not apply to Node.js

I am not sure how much of a difference this makes. It is an empirical issue and it is easy to implement both padded and strict versions.

I/we'd have to test. Adding the faster base64 decoder made a big difference for the .se zone. Going by that example, any TLD zone that has widespread DNSSEC usage (such as .nl) will benefit. A really simple test would be to replace consecutive dec_loop_generic_32_inner calls in dec_loop_generic_32 by one (or more) SIMD function replacements. Also note that we don't have to account for spaces in the input. That part is handled automatically because they're separate tokens (base64 is to be written as <contiguous> not <quoted>, except for svcb parameters, but there we simply do not allow spaces), so we can quite easily select the right decoder based on token length.

I'd have to study the library a bit better, but the loop currently selects for rounds 8, 4, 2 and 1. As 8x4 = 32 and 4x4 = 16, we could simply add AVX2 and SSE versions there.

I'll be working on this (starting 'now'). My current 'vision' is to make it configurable so one can explore the usage space.

Sounds good :+1:

So I think I solved the problem, although maybe not for simdzone directly.
The way the problem appears in simdzone is somewhat non-standard and I wanted to work on a more generic problem. So I have worked on the WHATWG forgiving-base64 problem: you must decode base64 in a string but there might be arbitrary ASCII spaces all over the string. It is part of the latest release of simdutf.
We have currently integrating it in Node.js with decent results: https://github.com/nodejs/node/pull/52428 It passes all the tests in simdutf and in Node.js, so it is pretty solid and it is fast.
Whether it applies to simdzone as is is trickier because simdzone has the pattern where the location of the white spaces are known before you start parsing.
So maybe it is worth experimenting.

Thanks for the update @lemire. Looked at the numbers, that's another impressive boost!
(sorry for the overlong/overcomplete reply)
Indeed, simdzone tokenizes based on whitespace (amongst other delimiters), so situation is a little different. The work may still be very useful. There are quite some RR TYPEs where the RDATA section contains base64 data. e.g. OPENPGPKEY, DNSKEY, RRSIG, etc. While it may be possible to pop all tokens of the tape and use the work to decode those sequences, simdzone does not read the entire file at once, but in blocks. Popping a token may lead to the parser flushing the buffer and proceding to read the next section. The scanner merely guarantees the complete token is available until the next one is read. Of course, it's entirely possible to alter tape operation for these types of sequences. Whether that's worth the effort is something to investigate. Another complexity is the possible uses of parentheses to wrap newlines. For example, this is a valid RRSIG RR (RFC4034 section 3.2):
host.example.com. 86400 IN RRSIG A 5 3 86400<PHONE_NUMBER>3103 (
<PHONE_NUMBER>3103 2642 example.com.
                                  oJB1W6WNGv+ldvQ3WDG0MQkg5IEhjRip8WTr
                                  PYGv07h108dUKGMeDPKijVCHX3DDKdfb+v6o
                                  B9wfuh3DTJXUAfI/M0zmO/zz8bW0Rznl8O3t
                                  GNazPwQKkRN20XPXV6nwwfoXmJQbsLNrLfkG
                                  J5D6fwFm8nN+6pBzeDQfsS3Ap3o= )

However, the RDATA section may use parentheses, without nesting, anywhere. i.e. this is valid too:
host.example.com. 86400 IN RRSIG A 5 3 86400<PHONE_NUMBER>3103 (
<PHONE_NUMBER>3103 2642 example.com.
                                  oJB1W6WNGv+ldvQ3WDG0MQkg5IEhjRip8WTr
                                  ) ( PYGv07h108dUKGMeDPKijVCHX3DDKdfb+v6o
                                  ) ( B9wfuh3DTJXUAfI/M0zmO/zz8bW0Rznl8O3t
                                  ) ( GNazPwQKkRN20XPXV6nwwfoXmJQbsLNrLfkG
                                  ) ( J5D6fwFm8nN+6pBzeDQfsS3Ap3o= )

Of course, no one ever writes/generates this, but it is something to consider.


Create a style guide

Create a style guide for consistent documentation.
For example, my_function vs my_function().

Some questions I would want answered:
[ ] Using ! for my_macro_name!
[ ] Periods at the end of bullet lists
[ ] Full sentences/periods for inline code comments
[ ] Hardlinks vs relative links
[ ] UK vs US English
[ ] Capitalization of terms (module names, Substrate, etc...)
probably more, hopefully other will add to the list

Should style guide also contain some documentation philosophy?
i.e. different kinds of docs:

Reference Documentation
Tutorials
High Level Concepts
etc...

"Precise, Concise, and Accurate"
etc...

I don't think this should include frameworks for different kinds of docs. The idea is that reading docs from Parity should have a similar feel, but not to define what each type of doc includes.
UK vs US English is hard, because there is no definition of either one. (As in, France actually has a state-run language academy). For "US English" there is AP style guide, Chicago manual of style, Strunk & White... However, I will list common inconsistencies and mistakes that I see.
Anyway, will get a version out today and we can discuss what's missing.

For function names, macros etc we should look to how Rust does it, it's deep enough that we should have some consistency with other Rust docs, assuming people have some familiarity with that already (or will have through reading the rust book first and things like that)

@joepetrowski on Riot, I think we agreed to use US English before 1.0 release, which prompted me to make this issue: https://github.com/paritytech/substrate/issues/1768


Add some examples for graph introspection

What about putting this 3 examples in a subfolder inside rclc, just like the configured examples folder?

What about putting this 3 examples in a subfolder inside rclc, just like the configured examples folder?

Sounds totally right to me

Ok, I'm merging when the examples are in their folder


Migration API for record-based entities

This PR extends the RecordBasedRepository with API to perform the migration of stored entities to account for the model changes.
Migration API
The repository is extended with applyMigration(ID, Migration) and applyMigration(Set<ID>, Migration) methods.
The Migration is a transformation operation which accepts entities one-by-one and modifies their state, lifecycle flags or can even delete the entity record. This class (or rather its descendants, ProjectionMigration and ProcessManagerMigration) can be inherited to create custom user-defined migration operations.
The applied entity modification can be configured by implementing the method apply(entityState):
class ProjectMigration extends ProjectionMigration<...> {

    // A mapper from the "old" to a "new" state.
    public Project apply(Project state) {
        return state.toBuilder()
                    .setName("new_name")
                    .build();
    }
}

The new state returned from apply will then be injected into the entity under migration.
In apply(...), it's also possible to call additional modification methods like markArchived() or removeFromStorage(). See Migration for details.
Each migration is preceded by the entity lookup by ID and is finalized by either saving the modified entity back to the repository or deleting the entity record, if it is configured by the Migration.
All changes are applied to entity under an active Transaction, with the last step of migration being a transaction commit. This means all entity lifecycle events are triggered normally, enabling subscription updates and other system-events-dependent features.
The posted events will have an instance of newly introduced MigrationApplied system event as a producing message.
Columns update
The standard migrations provided by Spine include the UpdateColumns migration for both projections and process managers. When applied, such migration triggers the recalculation of interface-based columns of an entity, propagating the new values to the storage fields as well as to the serialized entity state.
The column update can be applied as follows:
// Projection.
projectionRepository.applyMigration(ImmutableSet.of(id1, id2), new UpdateColumns<>());

// Process manager.
pmRepository.applyMigration(ImmutableSet.of(id1, id2), new UpdateColumns<>());

Other migrations
The framework also provides MarkArchived, MarkDeleted and RemoveFromStorage migrations which can mark entity archived, mark entity deleted and physically remove an entity record from the storage respectively. The migrations are available for both projections and process managers under the respective migration packages.
Other
This PR also fixes an issue with Nullable interface-based columns propagation and improves the description of Columns.valuesIn(...) operation.
Version
Spine version advances to 1.4.10.

@armiol, @yuri-sergiichuk PTAL.

@yuri-sergiichuk PTAL again.

@armiol PTAL again.


Update requirements, python version and dependencies

This is probably going to be a big PR. It'll involve:

[x] update requirements
[x] drop python version 3.8, add python version 3.12
[x] update pyproject.toml (project management script)
[x] update Github actions scripts (also add dependabot)
[x] update precommits
[x] update test, replace deprecated code, remove/replace deactivated code

Before this can be closed a lot of code is still going to be updated such that it works with latest versions of packages it depends on. For example scikit learn deprecated parts of the code we depend on, so it needs an update.
Things to consider for another PR:

[ ] (reconsider or better integrate optbinning?)
[ ] (consider replacing/wrapping parts of the code by other tools who do it better/became new industry standard?)

@adri0 @PaulZhutovsky could you perhaps approve it? Now it should work again and allow us to release an updated version.


Popover - Wrongly positioned when parent has transform properties

Bug description:
When transform: translateX(0); is added on the parent, the popover is incorrectly positioned because its coordinates are computed based on the top-left corner of the window while it should be based on the parent one.
This behavior is pretty close from setting position: relative on the parent, but this case is already handled.
Link to minimally-working plunker that reproduces the issue:
http://plnkr.co/edit/hWJ5aeZjffmeulQldeqR?p=preview
Version of Angular, UIBS, and Bootstrap
Angular: 1.5.3
UIBS: 1.3.1
Bootstrap: 3.3.2

Not sure if there's much we can do about this specific case... @RobJacobs what do you think? This could open a whole can of worms when it comes to stuff like skew or other transforms, and calculating could get impossibly hard.

For now, I've found a workaround: just add position: relative to the parent.
Maybe a check that test if a parent use a transform property can be added like for non-static parents:
https://github.com/angular-ui/bootstrap/blob/master/src/position/position.js#L71

Once relative is added the parent, popover position is correct even if the transform translate is above 0: http://plnkr.co/edit/pG0kTAUtR0Yfvej8XWJo?p=preview

A check isn't enough to handle all of the transform cases - this is a rabbit hole I want to say we don't want to support because the different transform options have differing calculations necessary, and this will be very easy to miss edge cases & easily cause the library to balloon, but I'll wait for @RobJacobs' opinion here.

I don't think we should try and get that exotic with how the placement calculates, especially since the work around is as simple as adding position: relative to the class or parent element.


Dataframe is null when parent and child tag names are same

Following valid XML returns a null Dataframe:
<Parent>
<Child></Child>
<Parent></Parent>
</Parent>
when row-tag is given as <Parent>

Yea, this is an issue. Thanks!

This is fixed in #161


FIXED

Problem:
You were working on using Langchain RAG for your DocGenie project. The goal was to divide the process into two main steps: indexing, where you load documents and store embeddings, and retrieval, where you find the right embeddings to generate responses. You created two files, store.py for indexing and genie.py for answering questions using the stored data. However, when you ran genie.py, it threw an error.
Issue Details:
The error pointed to a problem with the OpenAI API key. Specifically, it said the "OPENAI_API_KEY" environment variable wasn't set.
Initial Attempt:
Originally, the code tried to set the "OPENAI_API_KEY" environment variable using os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY").
Identified Problem:
The error happened because os.getenv("OPENAI_API_KEY") returned None when the environment variable wasn't set. Trying to assign this None value to os.environ["OPENAI_API_KEY"] caused a TypeError.
Solution Steps:
Checked if the "OPENAI_API_KEY" environment variable was already set using "OPENAI_API_KEY" not in os.environ.
If not set, printed an error message and exited the script using sys.exit(1).
Set the "OPENAI_API_KEY" environment variable using os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", ""). This ensured that if os.getenv("OPENAI_API_KEY") returned None, an empty string was used as a default value.
Result:
Now, the script checks if the "OPENAI_API_KEY" environment variable is set before using it. If the key is missing, the script prints an error message and exits, preventing the NoneType error.
User Action:
To run the script successfully, you just need to set the "OPENAI_API_KEY" environment variable in your environment or in a .env file before running the script

Actually, the issue is not with OPENAI_API_KEY. The issue is with the chroma_db. Please create a .env file add your OPENAI_API_KEY and run the genie.py file. You should be able to reproduce the issue

@itsayopapi any update on this?


Update changelog for 3.2.0

@khanaffan worth mentioning table-valued functions (json_each et al) here?

@calebmshafer please review.


add a missing 'not'.

Adding a missing 'not', so the documentation would say that the label must not be empty instead of currently saying the label must be empty.

I signed it

I signed it

/retest

/test

/ok-to-test

/retest

/lgtm

/test

/retest


You have been creating or deleting too many calendars or calendar events in a short time

Hi There,
It seems like this error keeps coming up even after not touching it for two days.
In addition, the calendar sometimes sync duplicates and it shows up on the google calendar twice.

Sorry nobody answered this issue. Closing this as it seems like a user issue.


Add FORMAT function

I think about combination of these functions

T-SQL FORMAT()
MySQL FORMAT()

Plus there are some other Oracle and Postres formatting functions.

Added to requests so people can vote for it
http://feathub.com/agershun/alasql/+26


Errors in Typings

the following errors are thrown by the index.d.ts when using TypeScript

(176,11): error TS2320: Interface 'FormInputProps' cannot simultaneously extend types 'InputProps' and 'ReactFormEvents<HTMLInputElement>'.
  Named property 'onChange' of types 'InputProps' and 'ReactFormEvents<HTMLInputElement>' are not identical.

(25,1): error TS2308: Module './dist/commonjs/elements/Container' has already exported a member named 'Container'. Consider explicitly re-exporting to resolve the ambiguity.

Duplicate #1180.


Change Ubuntu Bionic to use 'python3' package in leiu of a more specific version

Change Ubuntu Bionic to use 'python3' package in leiu of a more specific version:
python3-dev requires python3-distutils, but python3.6-dev and python3.7-dev don't.
python3-distutils is required for pip installation

Heh, you caught me adding features without actually testing them O:-) Still working on getting kitchen-docker to play nice with 18.04.

You can override this locally via options package_name: 'python3' for now.

None of this makes any sense. python-dev should be required to hack on Python itself, but distutils is part of the Python standard library.  Working on getting in contact with them.

That should take care of it. Not thrilled about the special case but so it goes :)


Fix stopping tserver groups in accumulo-cluster

Describe the bug
Recent changes to accumulo-cluster blew away the group specific call to ZooZap introduced in https://github.com/apache/accumulo/pull/5114
The accumulo-cluster script needs to be modified again to support passing a group arg to the ZooZap command
Versions (OS, Maven, Java, and others, as appropriate):

Affected version(s) of this project: [e.g. 1.10.0] 4.0

This is blocked by the merging of #5174 into 2.1 and 2.1 into 3.1 and main


Suggestion for AnimationTransitionDelegate

Hello everyone! I was trying to make the transitionDelegate dynamic depending if the platform was Flutter Web or not. When I tried to do a ternary condition for changing between the  DefaultTransitionDelegate()  and the  NoAnimationTransitionDelegate() an error was popped:
The argument type 'Object' can't be assigned to the parameter type 'TransitionDelegate<dynamic>'.
Apparently, this two both mentioned here were the same but they were not.
The workaround I used to get this done is to create a dynamic variable outside and use that as transitionDelegate.
final dynamic transition =
    (!kIsWeb) ? DefaultTransitionDelegate() : NoAnimationTransitionDelegate();
final routerDelegate = BeamerDelegate(
  transitionDelegate: transition,
  locationBuilder: SimpleLocationBuilder(
    routes: {
      '/': (context, state) => MainPage(),
      '/create': (context, state) => CreateTablePage(),
      '/join': (context, state) => JoinTablePage(),
      '/about': (context, state) => AboutPage(),
    },
  ),
);

Hi @gabxap
Thanks for creating an issue!
Hm, strange. I remember doing
BeamerDelegate(
  transitionDelegate: myCondition ? NoAnimationTransitionDelegate() : DefaultTransitionDelegate(),
  ...
)

without problem before, but can confirm that this issue is present now. I'm using flutter master and the problem seems to be in DefaultTransitionDelegate.
Beside your suggestion, we can also do this:
BeamerDelegate(
  transitionDelegate: kIsWeb
    ? NoAnimationTransitionDelegate()
    : DefaultTransitionDelegate() as TransitionDelegate,
  ...
)


Add inspect ramp threshold

Should be a button in settings. Should display a vertical line at the chosen indeces by the threshold on pressure event plots.

Add same for pump threshold

Due to #37, this is no longer necessary. Additionally, once pump slope is determined it should not be changed.


Two python script: generate-binary-license.py and generate-binary-notice.py fails with pyyaml 6.0

Building from source with mvn clean install -DskipTests -Pdist -Dmaven.javadoc.skip=true with current pyyaml 6.0, it would fail with following:
[INFO] --- exec-maven-plugin:1.6.0:exec (generate-binary-license) @ distribution ---
=== Generating the contents of LICENSE.BINARY file ===

Traceback (most recent call last):
  File "/Users/kai.sun/falcon_druid/druid_source/druid/distribution/bin/generate-binary-license.py", line 181, in <module>
    generate_license(apache_license_v2, license_yaml)
  File "/Users/kai.sun/falcon_druid/druid_source/druid/distribution/bin/generate-binary-license.py", line 140, in generate_license
    licenses_list = list(yaml.load_all(registry_file))
TypeError: load_all() missing 1 required positional argument: 'Loader'
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
    at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404)

This is a pyymal version back compatible problem.
The following would fix them:
diff --git a/distribution/bin/generate-binary-license.py b/distribution/bin/generate-binary-license.py
index e69bc7025e..e08fe04710 100755
--- a/distribution/bin/generate-binary-license.py
+++ b/distribution/bin/generate-binary-license.py
@@ -137,7 +137,7 @@ def generate_license(apache_license_v2, license_yaml):
     # Print Apache license first.
     print_outfile(apache_license_v2)
     with open(license_yaml, encoding='utf-8') as registry_file:
-        licenses_list = list(yaml.load_all(registry_file))
+        licenses_list = list(yaml.load_all(registry_file, Loader=yaml.FullLoader))

     # Group licenses by license_name, license_category, and then module.
     licenses_map = {}
diff --git a/distribution/bin/generate-binary-notice.py b/distribution/bin/generate-binary-notice.py
index a7778812b9..5ab1d7cf85 100755
--- a/distribution/bin/generate-binary-notice.py
+++ b/distribution/bin/generate-binary-notice.py
@@ -57,7 +57,7 @@ def generate_notice(source_notice, dependences_yaml):
     # Print Apache license first.
     print_outfile(source_notice)
     with open(dependences_yaml, encoding='utf-8') as registry_file:
-        dependencies = list(yaml.load_all(registry_file))
+        dependencies = list(yaml.load_all(registry_file, Loader=yaml.FullLoader))

     # Group dependencies by module
     modules_map = defaultdict(list)

Closing this one. Filed and use https://github.com/apache/druid/issues/12274 with issue templates.


🐛 BUG:Access violation error on Windows with Wrangler

Which Cloudflare product(s) does this pertain to?
Wrangler
What version(s) of the tool(s) are you using?
"wrangler": "^3.60.3"
What version of Node are you using?
v18.18.0
What operating system and version are you using?
windows 10
Describe the Bug
Observed behavior
I encountered an access violation error when trying to run wrangler dev on my Windows machine.
Expected behavior
Please describe.
Wrangler should start the Workers runtime without errors.
Steps to reproduce
Install Wrangler globally: npm install -g wrangler
Run wrangler dev in my project folder.
below is the error i am getting
X [ERROR] There was an access violation in the runtime.
On Windows, this may be caused by an outdated Microsoft Visual C++ Redistributable library.
System Information:
Node.js version: v18.18.0
Wrangler version: 3.60.3
OS: Windows 10
Additional Information: I have updated the necessary Visual C++ Redistributable libraries, but the error persists. I’ve also tried running as administrator and in local mode (wrangler dev --local), but the issue remains.
A git repo we can clone and run a test suite on, or which has a README with step-by-step instructions, is even better. In this case, please use the field below to provide a link to the minimal repro.
https://github.com/amandwivedi1357/serverless-backend
Please provide a link to a minimal reproduction
No response
Please provide any relevant error logs

⛅ wrangler 3.88.0
⎔ Starting local server...
X [ERROR] There was an access violation in the runtime.
On Windows, this may be caused by an outdated Microsoft Visual C++ Redistributable library.
See https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist.
See https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist.
X [ERROR] The Workers runtime failed to start. There is likely additional logging output above.

Could you try updating to the latest version of Wrangler, and provide the exact versions of Wrangler, Node, Windows and the Microsoft Visual C++ Redistributable library?

hi @amandwivedi1357  :) we haven't heard from you in a while, so we’re going to close this issue for now. if this is still a problem, please feel free to open a new issue referencing this one. please be sure to include an updated summary and additional detail in response to @penalosa 's comment above, and we will revisit and investigate further. thanks!


multiple dex files

I am getting this error during build:
 Multiple dex files define Lcom/google/android/gms/location/places/zzl;
Here is my app/build.gradle:

I have gone through the solutions of https://github.com/geektimecoil/react-native-onesignal/issues/20, https://github.com/geektimecoil/react-native-onesignal/issues/48, and https://github.com/geektimecoil/react-native-onesignal/issues/51, https://github.com/geektimecoil/react-native-onesignal#issue-1---multiple-dex-files-define, https://github.com/geektimecoil/react-native-onesignal#issue-2---multiple-dex-files-define-again, and https://github.com/geektimecoil/react-native-onesignal#issue-4---make-react-native-onesignal-work-with-react-native-maps but no luck
thanks!

I also tried this https://github.com/geektimecoil/react-native-onesignal/issues/220

This fixed it:
dependencies {
    compile project(':react-native-onesignal')
    compile project(':react-native-google-places')
    compile project(':react-native-maps')
    compile project(':react-native-fetch-blob')
    compile project(':react-native-svg')
    compile project(':react-native-vector-icons')
    compile project(':react-native-image-crop-picker')
    compile fileTree(dir: "libs", include: ["*.jar"])
    compile "com.android.support:appcompat-v7:23.0.1"
    compile "com.facebook.react:react-native:+"  // From node_modules
    compile project(path: ':react-native-testfairy')
    compile 'com.google.android.gms:play-services:10.2.0' // THIS FIXED IT
}

@ddeanto Thank you for your comments, this issue is annoying, and I'm still getting it, even with your last advice.. don't know what to do


fix: client_auth: unquote clientID and secret with Basic auth

Hi @c00kiemon5ter ,
I've run into an issue with clientID and secret encoding when using Basic auth.
With Basic auth, clientID and secret should be URI-encoded before used as username and password to form the Basic auth header:
https://datatracker.ietf.org/doc/html/rfc6749#section-2.3.1
Existing OpenIDConnect implementations follow the standard and encode the clientID and secret ... and the client authentication for the token endpoint then fails with either
pyop.exceptions.InvalidClientAuthentication: Incorrect client_secret
or
pyop.exceptions.InvalidClientAuthentication: client_id '1621892763.....%2B%2F' unknown

when characters like '+' or '/' are used in either the clientID or secret.

This happens only for client_secret_basic - but not for client_secret_post.
Fix this by explicitly URI-decoding the clientID and secret extracted from the Basic auth header (but only in this flow).
Hope this fix can be easily merged - please let me know if I need to clarify anything.
Cheers,
Vlad

Merged by 3658fdc

thank you!


Erome doesn't work

Ripme version: 1.7.21
Java version:  Java 8 Update 161
Operating system:   Windows 10
Exact URL you were trying to rip when the problem occurred: https://www.erome.com/a/tDI1vj3o
Please include any additional information about how to reproduce the problem:

Nothing happens when clicking rip
Expected Behavior
Want to rip the album/webpage/profile of erome user/page
Actual Behavior
Enter erome website then it shows "Erome album detected" then when I click rip nothing happens show a blank log page.
Shows this in the Ripme log:
java.lang.NullPointerException
at com.rarchives.ripme.ripper.rippers.EromeRipper.getAlbumTitle(EromeRipper.java:50)
at com.rarchives.ripme.ripper.AlbumRipper.setWorkingDir(AlbumRipper.java:196)
at com.rarchives.ripme.ripper.AbstractRipper.setup(AbstractRipper.java:140)
at com.rarchives.ripme.ui.MainWindow.ripAlbum(MainWindow.java:1074)
at com.rarchives.ripme.ui.MainWindow.ripNextAlbum(MainWindow.java:1033)
at com.rarchives.ripme.ui.MainWindow.access$600(MainWindow.java:69)
at com.rarchives.ripme.ui.MainWindow$4.intervalAdded(MainWindow.java:794)
at javax.swing.AbstractListModel.fireIntervalAdded(Unknown Source)
at javax.swing.DefaultListModel.add(Unknown Source)
at com.rarchives.ripme.ui.MainWindow$RipButtonHandler.actionPerformed(MainWindow.java:1108)
at javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
at javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
at javax.swing.DefaultButtonModel.setPressed(Unknown Source)
at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
at java.awt.Component.processMouseEvent(Unknown Source)
at javax.swing.JComponent.processMouseEvent(Unknown Source)
at java.awt.Component.processEvent(Unknown Source)
at java.awt.Container.processEvent(Unknown Source)
at java.awt.Component.dispatchEventImpl(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
at java.awt.Container.dispatchEventImpl(Unknown Source)
at java.awt.Window.dispatchEventImpl(Unknown Source)
at java.awt.Component.dispatchEvent(Unknown Source)
at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.awt.EventQueue.access$500(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.awt.EventQueue$3.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.awt.EventQueue$4.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.awt.EventDispatchThread.run(Unknown Source)
2018-03-02 20:02:55,840 INFO  utils.Utils .saveConfig() Saved configuration to C:\Users

I can't repo this on Ubuntu 16.02 with ripme 1.7.21

What does can't repro mean

Does can't repro mean cant reprogram it?

It's means I can't reproduce it. I can rip the url https://www.erome.com/a/tDI1vj3o without getting any errors

What do you suggest I do?


Remove old warning suppression from Storage

That line was introduced back in 2020, when Core did not have Json, and Storage had its own copy.
First of all, the condition is not sufficient - it should have been "if (MSVC)" and not "if (WIN32)" - because I got a customer who is using Clang on Windows, and this breaks their build.
But second, and most important - that line is no longer needed.

Should we add Clang+Windows CI pipeline? - #5111

Vcpkg PR to fix the currently published port: https://github.com/microsoft/vcpkg/pull/34883


Malformed UTF-8 characters, possibly incorrectly encoded

PHP Version
7.4.26
Shopware Version
6.4.7
Expected behaviour
Using the Admin API, trying to update product variants should work
Actual behaviour
Using the Admin API, trying to update product variants doesn't work and throws this error: "Malformed UTF-8 characters, possibly incorrectly encoded" which I saw it's happening when you send some non existing ids to shopware. The ids that I send to shopware are valid, I checked them.
How to reproduce
Use the endpoint /api/_action/sync to create some product variants, and then try to use it to update them and the error will happen.
Using v6.4.0 works fine.

This is related too https://github.com/shopware/platform/pull/2289
Apply the patch from there to have the exception behind that.

This is related too #2289
Apply the patch from there to have the exception behind that.

Thanks for reply. So what will be the new behaviour after that patch? I am sending some wrong ids and after this, the error will be more helpful and tell me what's wrong?

You should see the SQL error which is happening with your API request

@shyim
Can you think of a reason why I encounter this only only on v6.4.7? While doing the same thing on v6.4.0 it works fine.
I applied the patch as you said and now I can see this in the logs but I don't understand what is wrong:
An exception occurred while executing 'INSERT INTO product_configurator_setting (id, version_id, product_id, product_version_id, property_group_option_id, created_at) VALUES ('RQ\u0013�THp�p�Y�\u0016�@','\u000f�\u001c��jK¾K��u,4%','B���(�C\\r���ؔd�M','\u000f�\u001c��jK¾K��u,4%','\fi�Cp�OA��r.s�Ȗ','2022-02-09 21:25:36.633');':\n\nSQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'B\\xB0\\x82\\xE9(\\xCEC\\x0D\\x91\\xAA\\xAD\\xD8\\x94d\\xAFM-\\x0F\\xA9\\x1C\\x' for key 'product_configurator_setting.uniq.product_configurator_setting.prod_id.vers_id.prop_group_id'","status":"500","title":"Internal Server Error"}]}]}},"deleted":[],"extensions":[],"notFound":[],"success":false},400],"class":"Symfony\\Component\\HttpFoundation\\JsonResponse","file":"/app/platform/src/Core/Framework/Api/Controller/SyncController.php","function":"__construct","line":174,"type":"->"},{"args":[{"data":{"anotherExternalProductId":{"extensions":[],"result":[{"entities":[],"errors":[]}]},"excludeFromResponse":{"extensions":[],"result":[{"entities":[],"errors":[{"code":"0","detail":"An exception occurred while executing 'INSERT INTO product_configurator_setting (id, version_id, product_id, product_version_id, property_group_option_id, created_at) VALUES ('RQ\u0013�THp�p�Y�\u0016�@','\u000f�\u001c��jK¾K��u,4%','B���(�C\r���ؔd�M','\u000f�\u001c��jK¾K��u,4%','\fi�Cp�OA��r.s�Ȗ','2022-02-09 21:25:36.633');':\n\nSQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'B\xB0\x82\xE9(\xCEC\x0D\x91\xAA\xAD\xD8\x94d\xAFM-\x0F\xA9\x1C\x' for key 'product_configurator_setting.uniq.product_configurator_setting.prod_id.vers_id.prop_group_id'","status":"500","title":"Internal Server Error"}]}]}}


orb-ui: identical to JJ-prod

orb-ui as a service, to be installed in next KK release, had many issues that needed to be resolved so that we have the same experience as in JJ-prod, the current version on Orbs.
Hopefully this will address all of the differences.

thank you @TheButlah for the review 👍
I took the comments into account :)
I don't have time for the optional stuff though 😁


Dataset

I apologize for bothering you again.
I am feeling a bit puzzled regarding the dataset. I have noticed that there are two versions available for the validation and test dataset: one with "uniq" and one without.  I am uncertain about the reason behind having two versions of the dataset and their respective purposes.  I would greatly appreciate it if you could kindly provide some clarification on this matter. Thank you for your patience and assistance.

No problem at all. I'm happy to help you. The "uniq" versions of the dataset contain only one record per protein rather than all interactions. They are primarily designed for convenience during generation, as they only require protein information. They don't serve any other specific purpose.

Thank you for your kindly response and for resolving the issue!


doc: Bluetooth: Add skeleton for contribution page

We want to start documenting some "common knowledge" that regular Bluetooth contributors have.
A topic that comes up often in pull requests is the coding style, that is, the style that is not easily checked by tools like checkpatch or clang-format.
This patch add a section with some first rules, in order to reduce friction in adding more later.
See also: https://github.com/zephyrproject-rtos/zephyr/issues/55281

I would personally suggest flagging this for discussion in the Process Working Group. I am absolutely not against the idea but I think we perhaps need some kind of framework to ensure contribution guidelines are not all over the place. At a minimum, one thing that comes to mind would be to make sure that area/subsystem-specific sets of rules such as the ones this PR proposes are referenced in e..g https://docs.zephyrproject.org/latest/contribute/guidelines.html#contribute-guidelines
cc @keith-zephyr

area/subsystem-specific sets of rules

Looks like other subsystems also have different preferences.
Basically what I want to achieve is not having to do this (from above link)

compliance is enforce culturally by the maintainer of the area

Such coding style comments (and their long discussion threads) distract the reviewers from the functional changes. Unnecessary review cycles also tire out the authors, the reviewers and the Zephyr CI.
I'm definitely for adding a link to those per-subsys guidelines to make them more discoverable of course :+1:

Process WG notes
@jhedberg - These Bluetooth recommendations are not in conflict with general Zephyr guidelines.
@nashif - Why is this needed for Bluetooth?
@jhedberg - in favor of enhancing general guidelines
@dleach02 - the Bluetooth specific guidance should be moved to Zephyr contribution guidance
@fabiobaltieri - BT maintainers are currently asking reviewers for these extra guidelines
@nashif - doesn't like setting a precedence for subsystem adopting their own guidelines
@nashif - coding guidelines should be global.  editorconfig should be in the general guidelines.
@dleach02 - agrees editorconfig should be in general guidelines
@keith-zephyr - USB subsystem has pushed back against clang-format.
@nashif - in favor of adopting one standard.  Probably best to run whole clang-format against entire tree  to avoid one line changes cascading to multiple formatting changes.  This would be done only if entire project adopted a clang-format policy.
@jhedberg - tab whitespace rule is not enforced uniformally.  Checkpatch isn't catching all violations.
@dleach02 - general guidelines should add clarity for the whitespace
@nashif - clang-format might have checks for the tab/whitespace, but agrees this needs to be specified in the general guidelines.
@nashif - fundamentally the project needs to agree on one style.
@nashif - PR author should submit these changes to the general guidelines first and work with the community to get changes adopted.
@nashif - the friction for changes to guidelines is a separate problem.  But the changes should be proposed to the general guidelines first.
@kartben - it's important to move the whole community forward with a single guideline.
@dleach02 - if BLE absolutely needs exceptions, it should reference the general Zephyr guidelines first.  But this isn't very scalable.
@nashif - subsystems can adopt rules, design patterns, etc.
@jhedberg - consistency is important
@fabiobaltieri - adopting naming conventions for a susbsystem are okay for a subsystem to document.

@jori-nordic The consensus from the Process WG is that these changes are not specific to the Bluetooth subsystem.  Please rework the PR to submit changes to the general Zephyr guidelines.
I'm the maintainer of the coding guidelines, so I will help make sure the PR gets attention and moves towards a approval.

Alright, I'll work on it if I have the time. I have my hands full fixing bugs right now.

@jori-nordic The consensus from the Process WG is that these changes are not specific to the Bluetooth subsystem. Please rework the PR to submit changes to the general Zephyr guidelines. I'm the maintainer of the coding guidelines, so I will help make sure the PR gets attention and moves towards approval.

Just my 2 cents on this:
We are currently in a state where coding guidelines are incomplete and too much is left up to reviewers.
This was an attempt to agree on something for BT (without conflicting with the overall guidelines).
Disallowing this, keeps up in a state where we have incomplete guidelines, and it seems like we will never get complete guidelines because we have several subsystems with maintainers that do not agree.
So because subsystems cannot agree, the overall guidelines are worse (incomplete), and all attempts I've seen over the 5 last years are always being shot down immediately.
If we cannot allow BT to have it's own set of additional guidelines on top of the general Zephyr ones, can we at least start forcing some of the other subsystems to adopt new (and better/complete) guidelines?

Discussed in Bluetooth WG:
Having a global set of rules is a good goal, but we should still allow for a per-subsystem style document, .editorconfig and .clang-format.
Our main concern should be the well-being and efficiency of the project. What we want is to reduce the time spent reviewing code.
For that we want to put existing informal rules in writing. The fact is that there are disagreements between subsystems about style. Having global rules is better, no disagreement there, and we must strive to unify. We also agree that the subsystem rules cannot override global rules.
@carlescufi would you have time to drive this forward?


Disabling user auth also disables the API token requirement for /metrics

📑 I have found these related issues/pull requests
-/-
🛡 Security Policy

[X] I agree to have read this project Security Policy

Description
I have an API token to access /metrics which worked well.
I have now disabled user authentication and added Authelia as a middleware, with both the /metrics and /api/push endpoints configured as 'bypass', with everything else requiring authentication.
To my surprise. the API token is no longer required anymore to access /metrics.
👟 Reproduction steps
see above
👀 Expected behavior
I expected that the /metrics endpoint still requires an API token. According to the docs,

By default, HTTP basic authentication is used to secure access to the Prometheus metrics endpoint. As soon as you add your first API key, the use of basic authentication for the endpoint will be permanently disabled.

😓 Actual Behavior
/metrics was unprotected
🐻 Uptime-Kuma Version
1.23.11
💻 Operating System and Arch
louislam/uptime-kuma:alpine (x64)
🌐 Browser
n/a
🖥 Deployment Environment
n/a
📝 Relevant log output
No response

Disabling auth disables auth, so far this is not a bug from my standpoint.
I a agree that we might want to draw more attention to what this does here (and in the docs)

Thanks. As /metrics can disclose a lot of private details, the documentation and GUI should be very clear and explicit about this.
I would suggest to allow disabling user/GUI auth separately from service/API auth and/or requiring deletion of all API keys before the built-in API auth is disabled.
Feel free to close the issue or keep it as a heads-up for other users as long as necessary.

Changing the helptexts in the disable-auth popup seems sufficient to me. No need to introduce more complexity than needed.

@CommanderStorm This, too: https://github.com/louislam/uptime-kuma/wiki/API-Keys

Where/How?
I think that disabling auth disables auth entirely has the logical cause that no auth is present any longer. => don't think this needs to be added there.

Oh well, I tried ¯\_(ツ)_/¯

Resolved by #4723


Support Builds on Windows

We ultimately want to support Windows builds via cmake and bazel. This issue will track the progress.
With a bit of tweaking, the bazel build mostly works for:
iree/tools/run_module (the simplest e2e example)

With PR22, I've mostly got things building and testing on Windows. There are some e2e tests that appear to be failing on some mysterious FileCheck pipeline issue that is not immediately obvious (and has he smell of something subtly Windows specific).
I'll write a doc on how to setup your Windows build environment.


HHH-16892 LocalXmlResourceResolver does not resolve dtd URLs that use https scheme

https://hibernate.atlassian.net/browse/HHH-16892
Backported to:

branch 6.2 as #6940
branch 5.6 as #6941

Approved on Zulip: https://hibernate.zulipchat.com/#narrow/stream/132094-hibernate-orm-dev/topic/HHH-16892


feat: remove legacy docs

remove app/docs folder
update document url

@thucpn have all these docs been migrated to the new docs? Just scared of breaking https://legacy.ts.llamaindex.ai/

Cloud you update the link in the new doc? And remove the banner


Update chaosmeta logo and homepage

Pre-submission checklist:
Please check each of these after submitting your pull request:

[x] Are you only including a repo_url if your project is 100% open source? If so, you need to pick the single best GitHub repository for your project, not a GitHub organization.
[ ] Is your project closed source or, if it is open source, does your project have at least 300 GitHub stars?
[x] Have you picked the single best (existing) category for your project?
[x] Does it follow the other guidelines from the new entries section?
[x] Have you added your SVG to hosted_logos and referenced it there?
[x] Does your logo clearly state the name of the project/product and follow the other logo guidelines?
[x] Does your project/product name match the text on the logo?
[x] Have you verified that the Crunchbase data for your organization is correct (including headquarters and LinkedIn)?
[x] ~30 minutes after opening the pull request, the CNCF-Bot will post the URL for your staging server. Have you confirmed that it looks good to you and then added a comment to the PR saying "LGTM"?

Project Traas-Chaos change name to ChaosMeta, I am the  main developer of ChaosMeta(Traas-Chaos).


chore(main): release 1.27.6

:robot: I have created a release beep boop
1.27.6 (2024-12-05)
Bug Fixes

♻ Fixed repeated dependency issues (9777622)

Performance Improvements

♻ Optimized contextBridge related improvements for stability (0e098c3)
♻ Reduce build package size by removing redundant dependencies (7b61b25)
🚀 Update to scrcpy v3.0.2 (7510548)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

v1.27.6
:sunflower:


REGRESSION: copy() casts unicode indices to object

Dataset.copy(deep=True) and DataArray.copy (deep=True/False) accidentally cast IndexVariable's with dtype='<U*' to object. Same applies to copy.copy() and copy.deepcopy().
This is a regression in xarray >= 0.12.2. xarray 0.12.1 and earlier are unaffected.

In [1]: ds = xarray.Dataset(
   ...:     coords={'x': ['foo'], 'y': ('x', ['bar'])},
   ...:     data_vars={'z': ('x', ['baz'])})

In [2]: ds
Out[2]:
<xarray.Dataset>
Dimensions:  (x: 1)
Coordinates:
  * x        (x) <U3 'foo'
    y        (x) <U3 'bar'
Data variables:
    z        (x) <U3 'baz'

In [3]: ds.copy()
Out[3]:
<xarray.Dataset>
Dimensions:  (x: 1)
Coordinates:
  * x        (x) <U3 'foo'
    y        (x) <U3 'bar'
Data variables:
    z        (x) <U3 'baz'

In [4]: ds.copy(deep=True)
Out[4]:
<xarray.Dataset>
Dimensions:  (x: 1)
Coordinates:
  * x        (x) object 'foo'
    y        (x) <U3 'bar'
Data variables:
    z        (x) <U3 'baz'

In [5]: ds.z
Out[5]:
<xarray.DataArray 'z' (x: 1)>
array(['baz'], dtype='<U3')
Coordinates:
  * x        (x) <U3 'foo'
    y        (x) <U3 'bar'

In [6]: ds.z.copy()
Out[6]:
<xarray.DataArray 'z' (x: 1)>
array(['baz'], dtype='<U3')
Coordinates:
  * x        (x) object 'foo'
    y        (x) <U3 'bar'

In [7]: ds.z.copy(deep=True)
Out[7]:
<xarray.DataArray 'z' (x: 1)>
array(['baz'], dtype='<U3')
Coordinates:
  * x        (x) object 'foo'
    y        (x) <U3 'bar'

Introduced by https://github.com/pydata/xarray/commit/c04234d4892641e1da89e47c7164cdcf5e4777a4

Correction, DataArray.copy(deep=False) is not affected. Is it intentional that the default for deep is True in DataArray and False in Dataset?

Is it intentional that the default for deep is True in DataArray and False in Dataset?

I suspect this was intentional, but perhaps it should be changed. I tend to this of a Dataset as closer to a Python dict versus a DataArray, which is closer to a NumPy array.


[stable/elasti-stack] update filebeat dependency version

Signed-off-by: Bagrat Lazaryan<EMAIL_ADDRESS>
@rendhalver @jar361 @christian-roggia
What this PR does / why we need it:
This PR updates filebeat dependency from chart version 1.5.0 to 1.7.0.
Which issue this PR fixes

none

Checklist

[x] DCO signed
[x] Chart Version bumped
[x] Variables are documented in the README.md

/ok-to-test

/assign @rendhalver

@rendhalver @christian-roggia Can you please merge this or provide feedback?

/lgtm


feat: CategoryTheory/Sites/CoverLifting -- compatibility between sheafification and pullback

I'll close https://github.com/leanprover-community/mathlib/pull/14512 once this is merged.

bors r+


Fix stream download

Fix the following issues:

When downloading a non-existed artifact, the download hangs until timeout.
When downloading a non-existed artifact, the download creates an empty file.
Missing code coverage for negative flows in Artifact download.

Codecov Report

Merging #56 (5797b9c) into master (a262066) will increase coverage by 2.10%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #56      +/-   ##
==========================================
+ Coverage   93.11%   95.22%   +2.10%
==========================================
  Files          14       14
  Lines         276      272       -4
  Branches       38       36       -2
==========================================
+ Hits          257      259       +2
+ Misses         17       11       -6
  Partials        2        2

Impacted Files
Coverage Δ

src/Artifactory/ArtifactoryDownloadClient.ts
96.77% <100.00%> (+16.77%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a262066...5797b9c. Read the comment docs.


feature update! happy new year!

This is what we will implement in the next 2019 and some bugs that have not been fixed.

support

[ ] add ios platform support
[ ] add android platform support
[ ] add xbox platform support
[ ] remove system.drawing in desktopgl platform
[ ] use sdl-ttf in desktopgl instead of system.drawing font.

known bug

[ ]  caretPosition is wrong. it cant be move.

add oil!

希望能支持MacOS
测试了，在MonoGame.MacOS，简单的按钮这些能运行。
如果移除 System.Drawing，不知道能否兼容。
非常好的框架，先在unity中使用吧。


Test just syntax in an action

We should make a check that runs just and then checks the syntax of the files in the PR so we don't land syntax errors:
https://github.com/marketplace/actions/setup-just

@castrojo attempted to fix this, let me know if this is what you wanted!

@castrojo #155 merged, we should close this now


[CI] Install tools at the start on the macOS Gitlab jobs

What does this PR do?
This PR runs inv -e install-tools at the start of the macOS Gitlab jobs.
Motivation
In the current state if we bump a tool version, it won't be bumped on the macOS runners because we're not running the install-tools invoke task meaning the runner would rely on the already-installed tool.
Describe how to test/QA your changes
Possible Drawbacks / Trade-offs
Additional Notes

/merge


Add all_manifests metadata table with tests

Implements all_manifests metadata table - https://github.com/apache/iceberg-python/issues/1053
Have refactored the code tor re-use logic of manifests metadata table.
The schema of all_manifests contains an additional column as compared to manifests table - reference_snapshot_id which indicates the snapshot id those manifests are contained in.
Ref - Iceberg implementation - here and here

@soumya-ghosh I see this one is still pending, are you still interested to get this in?

Hey @Fokko nothing major is pending on my side, awaiting your approval. I will resolve the conflicts shortly.

@Fokko bumping this up for review


Idle and Timer events

Is there a way to specify Idle and Timer events?
So that I can override the handlers in my derived frame (or app or whatever)?

You can add any event name to the 'Events' tab.

I will add an easier way to add events, but that will not happen soon.
Anyway, for usage questions please use the mailing list. This here is an issue tracker, not a support forum.

ok.  thanks Dietmar :)

Generated event code (for EVT_IDLE and EVT_TIMER) does not work with wxPython 4.1.2 (4.1.2a1.dev5412+727f3aff)
Example generated code.
class Main_Frame_WXG(wx.Frame):
    def __init__(self, *args, **kwds):
        # begin wxGlade: Main_Frame_WXG.__init__
        ...
        self.Bind(wx.EVT_IDLE, self.on_idle, self)
        self.Bind(wx.EVT_TIMER, self.on_timer, self)

        # end wxGlade

It works if I manually change the generated code to replace the Bind() calls as follows.
        self.Bind(wx.EVT_IDLE, self.on_idle)
        self.Bind(wx.EVT_TIMER, self.on_timer)


Project Tutorial Proposal - Sujith Kumar Dola

Hello World Flask App - Beginner
Telegram Bot with Python - Intermediate
ISS [ International Space Station]  Tracker with Python - Beginner
Ethereum Wallet With Python - Beginner

Let's do the ISS one!!! 🛰
Can you write the final solution code first before writing the tutorial? cc @Bobliuuu @asiqurrahman

Hey @sonnynomnom, Do you prefer the console version or a GUI version?

Whichever you think you are more comfortable in!

Whichever you think you are more comfortable in!

Here's The Gist: https://gist.github.com/Sujithkumardola/bc203083e9ec0c7e8cc3e41833d02e59

Reviewed!

Reviewed!

Can I start writing the tutorial?

@Sujithkumardola Yep! Just make sure to apply the changes to your solution code highlighted by the team, and make sure to follow the formatting guide 😄

@sonnynomnom Take a Look at This Gist : https://gist.github.com/Sujithkumardola/e49cf45a247f6fb1968de7c5bbf6b872
Details
This Version Uses :

Flask
Folium
ARC GIS

Screenshots

CC @Bobliuuu

@Sujithkumardola
Everyone on the team loves this project! It's come a really long way from where it started.
Two notes:

Can you change the icon to a satellite or a blinking gif to show that it's live
Can you add a dotted line behind the icon of where it's already been(past 30 minutes or so)? We think this would take the project to the next level!

@Sujithkumardola
Everyone on the team loves this project! It's come a really long way from where it started.
Two notes:

Can you change the icon to a satellite or a blinking gif to show that it's live
Can you add a dotted line behind the icon of where it's already been(past 30 minutes or so)? We think this would take the project to the next level!

Yeah, I'll try

@Sujithkumardola
Everyone on the team loves this project! It's come a really long way from where it started.
Two notes:

Can you change the icon to a satellite or a blinking gif to show that it's live
Can you add a dotted line behind the icon of where it's already been(past 30 minutes or so)? We think this would take the project to the next level!

Yeah, I'll try

Hey Guys,
I've been busy in over the last few weeks.
Folium now supports V6 FA icons as a result of my recent PR. But for this project, let's use V4.
Showing the ISS's path is not a big deal, but explaining it will be quite difficult due to the astronomy material involved.
Suggest me an Icon from FA V4 instead of the satellite Icon from V6. A1

Hi @Sujithkumardola, can we use V6 for this project? There are a lot more icons in V6, so the satellite icon would be best for this project.
Don't worry about showing the path if it's too complicated.
How is the project tutorial coming along?

Hi @Sujithkumardola, can we use V6 for this project? There are a lot more icons in V6, so the satellite icon would be best for this project.
Don't worry about showing the path if it's too complicated.
How is the project tutorial coming along?

The tutorial is coming very well Except it's on paper.

Hey Sujith, what do you mean it's on paper?

Hey @Sujithkumardola, any updates on this project?


SSR Schematics uses by default API being in developer preview state

Command
new
Is this a regression?

[x] Yes, this behavior used to work in the previous version

The previous version in which this bug was not present was
19.0.0-next.9
Description
Schematics for SSR generates new application with the following API that is in dev preview:

AngularNodeAppEngine with writeResponseToNodeResponse and createNodeRequestHandler in server.ts file
server routes in app.config.server.ts

Compared to previous functionalities introduced as dev preview, e.g. provideClientHydration, the API mentioned above is not optional but used by default.
Minimal Reproduction

generate new app by running npx<EMAIL_ADDRESS>new my-app (with SSR)
verify shape of server.ts

Exception or Error
No response
Your Environment
Angular CLI: 19.0.0-next.11
Node: 22.8.0
Package Manager: yarn 1.22.22
OS: darwin arm64
Angular:
...
Package                      Version
@angular-devkit/architect    0.1900.0-next.11 (cli-only)
@angular-devkit/core         19.0.0-next.11 (cli-only)
@angular-devkit/schematics   19.0.0-next.11 (cli-only)
@schematics/angular          19.0.0-next.11 (cli-only)
Anything else relevant?
No response

Hi @alan-agius4 . Thanks for taking this issue under discussion in the Angular Team.
Let me share our usecase, to help provide more context for an informed debate:
Our Angular library
We're maintaining an Angular library for creating ecommerce sites (SAP Spartacus), where we depend on SSR APIs a lot. And as an enterprise product, we care adapt new APIs of Angular only when they are declared Stable API. Otherwise we would risk too many/frequent breaking changes for our users, which we want to avoid for our users.
Our library is installed via schematics
Our storefront app is scaffolded in 2 steps:

ng new ... (create new angular app)
ng add @spartacus/schematics ... (install our library and scaffold a storefront app).

Why ng new using Developer Preview APIs is cumbersome for us
And if the app created in the step 1 uses Angular APIs being in Developer Preview, then we have to write our own funky schematics steps that revert usage of Developer Preview APIs, and replace with the Stable APIs - which is cumbersome.
So ideally, I'd love if ng new could by default create apps using only stable APIs, but Developer Preview APIs would be used only when an optional CLI arg is provided to ng new.
Many thanks for your effort. Respect to your choices
All that said, I want to thank you for all your hard work on improving Angular SSR Developer Experience. And I respect your software design choices, acknowledging they are often very hard to make.


Modify the Drum Kit

Hello  @swapnilsparsh this is Shelja Sharma , GSSOC'2022 participant , I want work on your existing "Drum Kit" project, as it is not properly designed
I want to fix some things and I want to make it look more perfect and attractive.
Thank you for your time!! and looking forward to work on it.

I want to work on this under GSSOC2022. Here is my discord profile DHANANJOY DEY | Contributor#7903 can you assign me?


Add TO Go delete cdns/name

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/incubator-trafficcontrol-PR/1621/
Test PASSed.


tflite gpu delegate create and load model use v2 api is very slow compare with v1 api(10x) why ?

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): android
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary):
TensorFlow version (use command below): 2.2 rc2
Python version:
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:

i compile tflite.a (2.2 rc2) from source and use ndk c++ api to run tflite model as follow:
`
#ifdef V2
TfLiteGpuDelegateOptionsV2 tOptions = TfLiteGpuDelegateOptionsV2Default();
if (m_bGPUAllowFP16)
{
tOptions.is_precision_loss_allowed = 1;
}
tOptions.inference_preference = 1;
m_pGPUDelegate = TfLiteGpuDelegateV2Create(&tOptions);

#else
TfLiteGpuDelegateOptions tOptions = {.metadata = nullptr, .compile_options = {.precision_loss_allowed = 0, .preferred_gl_object_type = TFLITE_GL_OBJECT_TYPE_FASTEST, .dynamic_batch_enabled = 0,},};
if (m_bGPUAllowFP16)
{
tOptions.compile_options.precision_loss_allowed = 1;
}
m_pGPUDelegate = TfLiteGpuDelegateCreate(&tOptions);

#endif
auto iRetCode = m_pInterp->ModifyGraphWithDelegate(m_pGPUDelegate);
if (iRetCode != kTfLiteOk)
{
    return -1;
}

`
but the time cost is very different, v1 load time cost is only 10% of v2 load time.  the model has Conv2DTranspose op, if use v1 api the inference time is 4x of v2 api, so why has this performance different?

Could you share logcat output for v2 API?

i use time count around the init op, logcat has no other tflite output log, i test the follow set, the load time is fast but still low than v1 load time:
tOptions.inference_preference = TFLITE_GPU_INFERENCE_PREFERENCE_FAST_SINGLE_ANSWER;
170     tOptions.inference_priority1 = TFLITE_GPU_INFERENCE_PRIORITY_MIN_LATENCY;
171     tOptions.inference_priority2 = TFLITE_GPU_INFERENCE_PRIORITY_MAX_PRECISION;
172     tOptions.inference_priority3 = TFLITE_GPU_INFERENCE_PRIORITY_AUTO;

Can you share your model?

can use the official model mobilenetv2, or tensorflow object detection api trained ssd mobilenetv2 model.   my model only retrained these model, no other change

Our benchmark tool is using v2 API and I don't see any issue with it.
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/tools/delegates/gpu_delegate_provider.cc#L113
You'd better check it to figure out if your delegate creation code is correct or not.

this is all the create code

The backend type might have the difference. FYI, you can explicitly select backend with this.
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/delegates/gpu/delegate.h#L70
BTW, I don't have this issue. You mentioned that you have the issue with Pixel 2 and Samsung Galaxy. Could you share which SW version you're using for those devices?
Could you confirm that if you see the same issue with the original mobilenetv2 here?
https://github.com/tensorflow/models/tree/master/research/slim/nets/mobilenet
If you do, could you also tell me which specific mobilenetv2 you used?

i download the mobilenet_v2_1.0_224 and load tflite model on two devices:
one on MTK pad <Android 9, Kernel: 4.14.87>:
V2 api:
load model: "input: 224/224, type: 1, output type: 1, time cost: 1592 ms"
model forward avg time: 60ms
V1 api :
load model: "input: 224/224, type: 1, output type: 1, time cost: 1184 ms"
model forward avg time: 100ms
one on Samsung Galaxy Note8 <Android 9, Kernel: 4.4.153-17975032>:
V2 api:
load model: "input: 224/224, type: 1, output type: 1, time cost: 1424 ms"
model forward avg time: 10ms
V1 api:
load model: "input: 224/224, type: 1, output type: 1, time cost: 333 ms"
model forward avg time: 50 ms
two device performance is different a lot, but V2 api load model time all most the same, and more slow than V1 api, but forward time is much faster than V1 api.
used tflite2.2 version to compile static lib and use jni & ndk cross compile

@terryheo any guide for me to process this problem?

Passing to @impjdi , any idea on this?

OpenCL compilation takes much longer than OpenGL even if you turn off tuning (TFLITE_GPU_INFERENCE_PREFERENCE_FAST_SINGLE_ANSWER); this is not what we can change.  If this slow init is not desirable, I would suggest to use OpenGL instead.

Is there a way to precompile and cache the OpenCL kernels? Maybe as part of the tflite export? Or maybe the GPU delegate can cache the kernels locally on the device?

Is there a way to precompile and cache the OpenCL kernels? Maybe as part of the tflite export? Or maybe the GPU delegate can cache the kernels locally on the device for subsequent runs?

+1

While this functionality is present (was just added about a month ago), it doesn't follow the paths of the GPU delegate, and there is a lot more involved in getting the plumbing done.  You can take a look at tensorflow/lite/delegates/gpu/cl/serialization.h and make your experiment with it (sorry, no official documentation or support).  Note that the generated binary is not universal, i.e. it differs by mobile vendor, device, OS version, and GPU driver.  So for each new model, you would have to run & generate it once on that particular user device and store it.  You also need to know when you're going to flush it with a new OS version, GPU driver, and your ML model, so you'll need quite a lot of logic around this.

While this functionality is present (was just added about a month ago), it doesn't follow the paths of the GPU delegate, and there is a lot more involved in getting the plumbing done. You can take a look at tensorflow/lite/delegates/gpu/cl/serialization.h and make your experiment with it (sorry, no official documentation or support). Note that the generated cache binary is not universal, i.e. it differs by mobile vendor, device, OS version, and GPU driver. So for each new model, you would have to run & generate it once on that particular user device and store it. You also need to know when you're going to flush it with a new OS version, GPU driver, and your ML model, so you'll need quite a lot of logic around this.

i use mnn(https://github.com/alibaba/MNN) framework which support gpu cache, only the first time load will cost lot of time

While this functionality is present (was just added about a month ago), it doesn't follow the paths of the GPU delegate, and there is a lot more involved in getting the plumbing done. You can take a look at tensorflow/lite/delegates/gpu/cl/serialization.h and make your experiment with it (sorry, no official documentation or support). Note that the generated cache binary is not universal, i.e. it differs by mobile vendor, device, OS version, and GPU driver. So for each new model, you would have to run & generate it once on that particular user device and store it. You also need to know when you're going to flush it with a new OS version, GPU driver, and your ML model, so you'll need quite a lot of logic around this.

@impjdi   hi impjdi,   could you give a example?  it's very useful to save init time!!
mycode as follows, but i don't how to use Encode API in  serialization.h.
Thanks!
    // Load model
    std::unique_ptr<tflite::FlatBufferModel> model =
      tflite::FlatBufferModel::BuildFromFile(model_file);

    tflite::ops::builtin::BuiltinOpResolver resolver;
    tflite::InterpreterBuilder builder(*model, resolver);
    builder(&_interpreter);

    TfLiteGpuDelegateOptionsV2 gpu_opts = TfLiteGpuDelegateOptionsV2Default();
    auto delegate = CreateGPUDelegate(&gpu_opts);

    _interpreter->ModifyGraphWithDelegate(delegate.get());

While this functionality is present (was just added about a month ago), it doesn't follow the paths of the GPU delegate, and there is a lot more involved in getting the plumbing done. You can take a look at tensorflow/lite/delegates/gpu/cl/serialization.h and make your experiment with it (sorry, no official documentation or support). Note that the generated cache binary is not universal, i.e. it differs by mobile vendor, device, OS version, and GPU driver. So for each new model, you would have to run & generate it once on that particular user device and store it. You also need to know when you're going to flush it with a new OS version, GPU driver, and your ML model, so you'll need quite a lot of logic around this.

@impjdi   hi impjdi,   could you give a example?  it's very useful to save init time!!
mycode as follows, but i don't how to use Encode API in  serialization.h.
Thanks!
    // Load model
    std::unique_ptr<tflite::FlatBufferModel> model =
      tflite::FlatBufferModel::BuildFromFile(model_file);

    tflite::ops::builtin::BuiltinOpResolver resolver;
    tflite::InterpreterBuilder builder(*model, resolver);
    builder(&_interpreter);

    TfLiteGpuDelegateOptionsV2 gpu_opts = TfLiteGpuDelegateOptionsV2Default();
    auto delegate = CreateGPUDelegate(&gpu_opts);

    _interpreter->ModifyGraphWithDelegate(delegate.get());

I tried to initialize multiple tflite models with GPU delegate v2 api at the same time through multi-threading, but found that it takes about the same time for multi-threading to initialize multiple models at the same time and single-threading to initialize multiple models sequentially，Can someone explain why~

@impjdi : I have been testing with delegate serialization in tflite 2.7. It seems to be working well, but I have a question about your comment above "Note that the generated cache binary is not universal, i.e. it differs by mobile vendor, device, OS version, and GPU driver. So for each new model, you would have to run & generate it once on that particular user device and store it. You also need to know when you're going to flush it with a new OS version, GPU driver, and your ML model". With 2.7's serialization, does this still apply? If so, how does the cache get cleaned for OS version or GPU driver version? We are very interested in shipping this feature, but need to understand how to manage the cache. I don't see any real guidance in the 2.7 docs. Thanks!

@lauriebyrum If you are using Android's getCacheDir as the serialization directory, then it will get cleaned automatically for OS version update. @impjdi does the GPU delegate know if the GPU driver version has been updated? In the general case, user may have to append the GPU driver version to serialization_dir to avoid incorrect cache hits.

If we need to append the driver version, sample code would be very much appreciated...

(how bad is it if the cache doesn't get cleaned across these version updates? by any chance, does tflite ignore incompatible caches or are we going to get failures?)

by any chance, does tflite ignore incompatible caches or are we going to get failures?
how bad is it if the cache doesn't get cleaned across these version updates?

The TFLite layer will pass on the cached representation if it finds one; @impjdi will the GPU delegate crash (or just be suboptimal) if the GPU driver version has changed underneath?

Chances are high that it'll crash with driver version update.  I unfortunately don't have a code snippet that checks the driver version.  So far, we used this caching only in a setting where the app is updated with the OS update only, and there are no individual graphics driver update from Play Store, and we never ran into this issue ourselves =/

Thanks, @impjdi . To make sure I understand your comment: do third party apps need to somehow watch out for gpu driver updates or not? If they only occur during OS updates, we don't, but if there's some way they can happen outside of that, we do and I don't understand how to do that. Thanks!

A colleague did some research and found https://www.gizmochina.com/2020/03/25/gpu-driver-update-tool-play-store/ and https://www.androidauthority.com/gpu-driver-updates-phones-1096423/ . So it sounds like we app developers really do need to worry about gpu driver updates separate from OS updates. Does Google have guidance on handling this? We are hoping to ship with this in January, so we don't have much time.

Hey @lauriebyrum , sorry for the delay. I confirmed with our internal GPU team, and looks like the serialization data will automatically get re-initialized in case of a GPU driver update. This happens within the internal code that does serialization in tensorflow/lite/delegates/gpu/cl/serialization.cc, where the GetPlatformVersion() check fails if there is an update. Additionally, if you use CacheDir() from Android, your serialization folder will get reset for app or OS updates. Does that sound good?

That's fantastic news! Thanks @srjoglekar246

@srjoglekar246 : one more question. We are storing our serialized models in a subdir under getCacheDir so we can just throw away the subdir if things seem to be unstable for a user. I happened to have a pending android security update for one of my phones, so I went ahead and updated and the serialized bits did not get deleted during the update. That said, the serialization still seemed to work, so maybe the update was smart enough to realize that deleting the bits wasn't needed? Does this match your expectation? I was expecting that android updates would just toss out the caches generally, but it seems I'm wrong?

@lauriebyrum My bad, can you try using getCodeCacheDir?

tflite gpu delegate supported Conv2DTranspose????


[Bug]: compatible con "Home Assistant Core version 2022.7.5"

Current Behavior
Hello, is it compatible with the new version of HA?
"Home Assistant Core
installed version
2022.7.5"
The cards don't come out pretty, they're too dark
Expected Behavior
No response
Steps To Reproduce
No response
Environment
- OS:
- Node:
- Version:
- Hassio:

Anything else?
No response

Yes it's compatible. It's certainly an issue with your theme.


General: Add hover effect for sidebar-card-medium

Checklist
General

[x] This is a small issue that I tested locally and was confirmed by another developer on a test server.
[x] Language: I followed the guidelines for inclusive, diversity-sensitive, and appreciative language.
[x] I chose a title conforming to the naming conventions for pull requests.

Client

[x] Following the theming guidelines, I specified colors only in the theming variable files and checked that the changes look consistent in both the light and the dark theme.
[x] I added multiple screenshots/screencasts of my UI changes.

Motivation and Context

There were issues regarding consistency. Most elements have a hover effect, this is not the case with the sidecard-card-medium. It did not feel right to hover over these elements. Fixes #9651.
Description

I added a CSS class for the hover effect of the sidebar-card-medium (which is used for exercises) and added it to the classes in the html file.
Steps for Testing

Prerequisites:

1 Instructor
1 Programming Exercise

Log in to Artemis
Navigate to the Course
Hover over the Programming Exercise
You should see the hover effect (change color)

Exam Mode Testing

I'm not sure if the tests are that different than the tests from above. In sidebar-card-medium.component.html there is a mention of the Exam Mode. I'm not sure whether this needs to be tested more thoroughly.
Testserver States

[!NOTE]
These badges show the state of the test servers.
Green = Currently available, Red = Currently locked
Click on the badges to get to the test servers.

Review Progress

Performance Review

[ ] I (as a reviewer) confirm that the client changes (in particular related to REST calls and UI responsiveness) are implemented with a very good performance even for very large courses with more than 2000 students.
[ ] I (as a reviewer) confirm that the server changes (in particular related to database calls) are implemented with a very good performance even for very large courses with more than 2000 students.

Code Review

[ ] Code Review 1
[ ] Code Review 2

Manual Tests

[ ] Test 1
[ ] Test 2

Exam Mode Test

[ ] Test 1
[ ] Test 2

Performance Tests

[ ] Test 1
[ ] Test 2

Screenshots

https://github.com/user-attachments/assets/bbc97764-402f-4a17-a80d-ef2cad84a77b

Summary by CodeRabbit

New Features

Introduced a hover effect for sidebar cards, enhancing visual feedback when users interact with them.

Style

Added a new CSS class .hover-effect to improve the user experience with a background color change on hover.

Could someone please review this PR.
I would be very grateful.

Is there a reason why this was not successfully deployed to the test servers yet?

Please unstale. Would be great if this could get some more rewies as not many are missing.


Initial shard slot number

Issue
Currently, the initial shard state slot is set to PHASE_1_GENESIS_SLOT by setting shard_state.slot = pre.slot
For example, if PHASE_1_GENESIS_SLOT is 32:

The shard block 32 cannot exist and both B_32 and B_33 point to initial shard state.
How to fix it
IMO the scenario would be neater if we set initial shard slot to compute_previous_slot(pre.slot).

/cc @djrtwo @protolambda

This does seem reasonable, but one thing we need to be careful about is that for a system that is started from Phase 1 a GENESIS_SLOT, the shard states at B0 would be for slot 0 (because of how compute_previous_slot handles 0 input.
I do expect some systems to want to  start phase 1 from slot 0 so we should at least ensure that nothing is broken here. OR we put some sort of requirement taht PHASE_1_GENESIS_SLOT is at least GENESIS_SLOT + SLOTS_PER_EPOCH

This does seem reasonable, but one thing we need to be careful about is that for a system that is started from Phase 1 a GENESIS_SLOT, the shard states at B0 would be for slot 0 (because of how compute_previous_slot handles 0 input.

I have this particular kind of setup (PHASE_1_GENESIS_SLOT = GENESIS_SLOT = 0). The following list of patches did help to sort the things out:

get_shard_transition returns empty shard transition if GENESIS_SLOT
validate_attestation allows for empty shard transition root if GENESIS_SLOT
process_shard_transitions skips crosslink processing if compute_previous_slot(state.slot) == GENESIS_SLOT


[BUG - 3.0.0] Game crash on startup

Branch or Release
3.0 Release
Game and Engine Version
TRIBES 3: Rivals Demo (5.3)
Describe the bug
Bypassing EAC and launching goes as normal, but as soon as it reaches adding GUObjectArray listeners, it crashes due to over memory allocation. I haven't run into this with any other game during my testing time today.
Mods directory
N/A
To Reproduce
Steps to reproduce the behavior:

Launch game
Crash

Expected behavior
Game to not crash due to memory allocation error
Screenshots and UE4SS Log
Crash log in console:

UE4SS.log
Desktop (please complete the following information):

OS: Win11

Additional context
N/A

Online PVP games are not supported.


Documentation bug: format issue in the document of mxnet.contrib.quantization.quantize_model_mkldnn

Description
There is a format issue in the document of mxnet.contrib.quantization.quantize_model_mkldnn  in the Parameter and Returns section.
Link to the document: https://mxnet.apache.org/versions/1.6/api/python/docs/api/contrib/quantization/index.html#mxnet.contrib.quantization.quantize_model_mkldnn

Error Message
(Paste the complete error message. Please also include stack trace by setting environment variable DMLC_LOG_STACK_TRACE_DEPTH=10 before running your script.)
None
To Reproduce
(If you developed your own code, please provide a short script that reproduces the error. For existing examples, please provide link.)
None
Environment
We recommend using our script for collecting the diagnositc information. Run the following command and paste the outputs below:
curl --retry 10 -s https://raw.githubusercontent.com/dmlc/gluon-nlp/master/tools/diagnose.py | python

# paste outputs here

OS: ubuntu 18.04
Python: 3.7.6
pip: 20.0.2
numpy: 1.18.5
mxnet: 1.6.0

@mxnet-label-bot remove [Bug, needs triage]
@mxnet-label-bot add [Doc, MKLDNN, v1.x]

@mxnet-label-bot add [Doc, MKLDNN, v1.x]

@szha - issue is fixed, please close


Add decodeFirstPage

Whenever a number is signed, we add MIN_INT, right? How do we know which ones are signed? Do we have some docs on this encoding to refer to?

The encoding is defined in the python codebase we've been given


Remove unrelated revdeps from the list of revdeps to check

I'm quite embarrassed, the solution was so simple from the start... Thanks to @rjbou for the help!
Fixes https://github.com/ocurrent/opam-repo-ci/issues/76

hah, I totally missed that too! Thanks @kit-ty-kate and @rjbou! :-)


[contracts] RoutersFacet tests

Unit tests for RoutersFacet.sol

r4r https://github.com/connext/nxtp/pull/1230


Update app-service-mobile-offline-data-sync.md

Maybe was a typo. Should be two equals.

Hi @YidingW, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@YidingW : Thanks for your contribution to the Azure documentation! The author, @wesmc7777, has been notified to review your proposed change.

#sign-off


Minor code cleanup

Changes

Added code comment for digital gov script.
Consolidated if statement in on-demand landing page.

Review

@sebworks
@jimmynotjim
@KimberlyMunoz

👍


Trigger the "Common Button callback" by code without having a real touch event?

hello Calvin,
I want to run a WebServer parallel with my TFT in which I want to operate certain functions.
As an example I want to have the same button on the TFT and also on the web Page.
My question would be:
Is there a possibility to trigger the call "Common Button callback" also by code without having a real touch event?
According to my understanding I would get the button info (e.g. "E_ELEM_BTN9") from the Web Page, because I know the button I pressed.
With this value I would like to trigger the "Common Button callback" routine and execute the code stored there.
This would save me a lot of program code.
Do you see a possibility for this?
Would be great if you have an approach for me....
Thanks a lot
stefan
Translated with www.DeepL.com/Translator (free version)

@kellers76 Not sure exactly how much functionality you really need for what you are  doing but in the specific case you mentioned you could create a element reference to Button 9 (or any other ones you want) and simply call cbBtnCommon.
example:
//<Save_References !Start!>
gslc_tsElemRef* m_pElemBtn9       = NULL;
//<Save_References !End!>

  gslc_teTouch dummy_touch = GSLC_TOUCH_UP_IN;
  (void)cbBtnCommon((void*)m_pElemBtn9, dummy_touch, 0, 0);

I can't say this has any advantage to creating common functions that both cbBtnCommon case  E_ELEM_BTN9 and your web app call.
Now if you are trying to traverse the TFT UI with buttons highlighted and data input from a web app then that's really complex and requires basic support from GUIslice much like Calvin has added for input buttons and is beyond my help.
Paul--

hallo Paul,
thank you for answering so quickly.
The basic approach of you works!
I just tried to get the call executable....
With the following lines I don't get any error message when compiling, however the call doesn't seem to work properly yet:
//<Save_References !Start!>
gslc_tsElemRef* m_pElemBtn9 = NULL;
gslc_tsElemRef* m_pElemBtn10 = NULL;
gslc_tsElemRef* m_pElemBtn5 = NULL;
//<Save_References !End!>
gslc_teTouch dummy_touch = GSLC_TOUCH_UP_IN;
CbBtnCommon(&m_gui,m_pElemBtn9, dummy_touch, 0, 0);
With my m_pElemBtn9 on the web page I trigger a call, but the one for the m_pElemBtn10.
Also if I try another button with the m_pElemBtn5 the function of the m_pElemBtn10 is also triggered.
Maybe only a small thing is missing, so that I can execute the call correctly.
lg
stefan

@kellers76 if you post zip file of your attempt I'll do a quick desk check to see if I can determine the problem

hallo Paul,
I have found my mistake.
I didn't fill the ElementRef in the builder and so the mapping didn't work correctly.
After I corrected this, your code works wonderfully!!!
Thanks a lot for your perfect support
best regards
stefan


Check an existence of an active stake request against gateway

The following assert from OSTComposer::requestStake
require(
    stakeRequestHashes[msg.sender][address(_gateway)] == bytes32(0),
    "Request for this staker at this gateway is already in process."
);

should be replaced by checking an active stake request existence for the current staker from _gateway input of OSTComposer::requestStake.
A proposal is to introduce a new external function within gateway that returns boolean wrt existence of an active stake request for the passed staker address.

stakeRequest is different state from ongoing stakes in gateway


Store function arguments in catalog "babelfish_schema_permissions"

Description
Store function argument in the catalog babelfish_schema_permissions. Use that function argument while recreating GRANT statements at the time of REVOKE on SCHEMA statement in grant_perms_to_objects_in_schema.
Signed-off-by: Sharu Goel<EMAIL_ADDRESS>Check List

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is under the terms of the Apache 2.0 and PostgreSQL licenses, and grant any person obtaining a copy of the contribution permission to relicense all or a portion of my contribution to the PostgreSQL License solely to contribute all or a portion of my contribution to the PostgreSQL open source project.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 24 (100.0%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.006%) to 72.591%

Totals

Change from base Build<PHONE_NUMBER>:
0.006%

Covered Lines:
41021

Relevant Lines:
56510

💛  - Coveralls


Tags and Featured Post

App version: 1.2.2
Android version: 4.4.4
Device name: Samsung Galaxy Note 2

1.) Tags cant have a space in between in app. Like in "Getting Started".
2.) Featured post option seems to be not available in app.

Hi Dennis, this is great feedback - thanks! I've fixed the first issue (tags can't have spaces) in commit 243e5a5. The new behaviour is to separate tags with commas instead.
I'll get to the second one (featured post) in some time.

Great thanks for fixing.


Fix issue #950: Reduce TimeLLM setup time for training

Regarding the issue (#950) with the TimeLLM model taking a long time, the root cause is as follows:
During the save_hyperparameters stage of the Pytorch Lightning module, the weights of the llm are saved, resulting in a long processing time and preventing the model from being moved to the GPU for training.
To address this issue, I have defined the llm model name in the TimeLLM definition and modified the TimeLLM model to load the llm weights internally. This prevents the weights from being saved during the save_hyperparameters stage.
The changes are limited to the timellm.py file.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hey @ive2go, thank you for your contribution! Can you please restore the changes on the examples?

@jmoralez I have restored the examples folder to its previous state. Please review the changes. Thank you.

Thanks! Can you please also revert the changes to nbs/models, nbs/models.softs and the permissions change to neuralforecast/_modidx.py?

Thanks! Can you please also revert the changes to nbs/models, nbs/models.softs and the permissions change to neuralforecast/_modidx.py?

Thank you for the feedback! I have reverted the changes to nbs/models.ipynb, nbs/models.softs.ipynb, and the permissions change to neuralforecast/_modidx.py as requested.

Note
We have proposed an alternative approach to address the same issue (#950) in a new PR(#1086). Both approaches aim to optimize the initialization time for the TimeLLM model, but they use different methods.

This PR:

Modifies the timellm.py file to handle the issue.
Loads the LLM weights internally within TimeLLM by passing only the model name and saves information about which LLM was selected in the hyperparameters.
Limitation: The approach restricts LLM options to three models (GPT-2, LLAMA, BERT).

Alternative PR(#1086):

Modifies the _base_model.py file to exclude LLM weights during the save_hyperparameters stage.
The LLM model information is not saved in the PyTorch logs, but it can be inferred from the config file or tokenizer.
Advantage: This approach provides flexibility in choosing any LLM model.

I personally prefer the new approach as it seems more flexible. However, I proposed the method in this PR because modifying the _base_model.py impacts not only the TimeLLM model but also other models that inherit from this parent class.
Reviewers can choose between these two solutions based on their preferences and the project's requirements. We appreciate your feedback and will respond to any additional suggestions or comments.
Thank you for reviewing both PRs.

Thanks for all the work! See my comments

Thank you for your feedback. I have made the suggested changes throughout the code. Please review and let me know your thoughts.

Hello @ive2go, can you solve the conflict in the notebook? I really want to move forward with this PR! Thanks!

Hello @ive2go, can you solve the conflict in the notebook? I really want to move forward with this PR! Thanks!

Hi @marcopeix, I have removed the conflict markers and committed the changes, but the conflict still appears unresolved. Could you please check if I missed anything in the conflict resolution process? I want to ensure everything is correctly resolved so we can proceed with this PR. Thanks!

For some reason, I was not able to update this PR, so I opened another PR with the sames changes and solved the conflicts there #1139

Merged PR #1139 which fixes the conflicts in this PR. Thank you @ive2go for your work!


Add support for nostr IDs

The default derivation path for nostr IDs are: m/44'/1237'/0'/0/0
Allow users to manager their nost Ids and key-pairs using the extension on this path.
New separate identities should increment the account value, which is hardened path. Should not use the last two sections, which in a normal wallet is change/receive address and address (key) index.
A secondary identity should be: m/44'/1237'/1'/0/0
NIP-06: https://github.com/fiatjaf/nostr/blob/master/nips/06.md

Closed with #de39b9f4a8d07ec427775b88ac6958b461a517de


🐛 Mode of Interest "quality text" has errors

I discovered this while testing my metric vs imperial changes, but have realized it's a bug in the whole dashboard, not just my branch, example of what I mean (from production):

The mode_specific_timeseries in particular is creating this issue with the quality text. It stems from the fact that pandas groupby is now creating ALL combinations not just those with nonzero values, but then in scaffolding it counts the length of the dataframe rather than summing the trip counts ...
ex:
a dataset has 30 labeled trips from 5 users across 10 days and there are 3 possible modes
when we call groupby every possible combination in generated = 5103 = 150
even narrowing to 1 mode is still 50 trips, so when we compare 50 with 30 we're getting > 100%
One way to help this is to drop the day/user/mode combinations that have a trip count of 0, but I'm not sure that fixes the whole issue
A more principled fix would be to get the total mode of interest count by adding up rows rather than taking the length of the dataframe, this seems like it would be more accurate. I'm not sure how we got here, but it might have to do with pandas updates to the ways that groupby works, indicated by these warnings:
FutureWarning: Not prepending group keys to the result index of transform-like apply. In the future, the group keys will be included in the index, regardless of whether the applied function returns a like-indexed object.

More about the code in mode-specific-timeseries, with the fix I've added so far:
mode_counts = data.groupby(['user_id','date_time','mode_confirm'], as_index=False).size()
mode_counts.rename(columns={'size':'trip_count'}, inplace=True)
#the scaffolding code counts the length! So even if 0 trips of that mode it was counting!
mode_counts = mode_counts[mode_counts['trip_count'] != 0]

in scaffolding.py:
def get_quality_text(before_df, after_df, mode_of_interest=None, include_test_users=False):
    """ Inputs:
    before_df = dataframe prior to filtering (usually participant_ct_df)
    after_df = dataframe after filtering (usually expanded_ct)
    mode_of_interest = optional detail to include in the text string
    """
    # CASE 1 of https://github.com/e-mission/em-public-dashboard/issues/69#issuecomment-1256835867
    after_pct = (len(after_df) * 100) / len(before_df) if len(before_df) != 0 else np.nan #compares lengths!
    cq = (len(after_df), unique_users(after_df), len(before_df), unique_users(before_df),
        after_pct, )
    interest_str = mode_of_interest + ' ' if mode_of_interest is not None else ''
    total_str = 'confirmed' if mode_of_interest is not None else ''
    user_str = 'testers and participants' if include_test_users else 'users'
    quality_text = f"Based on %s confirmed {interest_str}trips from %d {user_str}\nof %s total {total_str} trips from %d users (%.2f%%)" % cq
    print(quality_text)
    return quality_text

Actually, looking at these, maybe passing in what we do in mode_specific_timeseries is just the wrong move - what get_quality_text expects is a dataframe with all the trips (all the labeled trips in this case) and all the (labeled) trips of a given mode

quality_text = scaffolding.get_quality_text(expanded_ct, expanded_ct[expanded_ct['mode_confirm'] == mode_of_interest], mode_of_interest, include_test_users) is a call that gets the proper quality text as proven by the print statements below:
the length is the length of mode_counts_of_interest (mode_counts from the code above filtered to just the mode of interest, the sum is that of all the trip count values in that same dataframe. The increase is explained by the fact that users can take more than one walk trip in a day (and often will - if you walk somewhere you usually walk back)

I'll plan to roll this change into my ongoing PR and watch out for other places we could be having this problem!

@Abby-Wheelis Great catch! This is why we need better testing of the public dashboard, and a principled way to update pandas versions. We have found multiple such issues while upgrading the server code, for which we do indeed have proper tests.


failed to cherry pick PR 3820 from ty-dc, to branch release-v0.9

commits 8c86d24b219c000c08bdaa4790aecb9b03eb5967 of ty-dc conflict when merging to branch release-v0.9, please manually cherry pick it by yourself.
PR https://github.com/spidernet-io/spiderpool/pull/3820 ,  action https://github.com/spidernet-io/spiderpool/actions/runs/10258946281
Auto-merging README-zh_CN.md
CONFLICT (content): Merge conflict in README-zh_CN.md
Auto-merging README.md
CONFLICT (content): Merge conflict in README.md
error: could not apply 8c86d24b... Merge pull request #3820 from ty-dc/remove/support-release-v0.7
hint: After resolving the conflicts, mark them with
hint: "git add/rm <pathspec>", then run
hint: "git cherry-pick --continue".
hint: You can instead skip this commit with "git cherry-pick --skip".
hint: To abort and get back to the state before "git cherry-pick",
hint: run "git cherry-pick --abort".
hint: Disable this message with "git config advice.mergeConflict false"

#3841


Playbooks template "Block-AADUser_alert" bug

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

Hi @tabarik,
Thanks for notifying us. Can you please elaborate the issue and share the data which helps in reproducing it.
Thanks