Parallelize commitlog reader

This is PR 2 in three PR's that together will improve the performance of the commitlog bootstrapper.
This PR parallelizes the commitlog bootstrapper (specifically it parallelizes the msgpack decoding)

Coverage increased (+0.2%) to 77.348% when pulling fa91b122a413d4c43ee8afa693afbd773534968e on richardartoul:ra/parallelize-commitlog-reader into b400c41816f489b6f33b13c0849a41e7fc1cb540 on m3db:master.

Coverage increased (+0.07%) to 78.427% when pulling 5ab6af8248f3220ce00e89a5a70bcaadba043bab on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.07%) to 78.427% when pulling 5ab6af8248f3220ce00e89a5a70bcaadba043bab on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.03%) to 78.334% when pulling 6dbd0f7f0f9a9709793688c1c05f8fb044d78286 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.01%) to 78.373% when pulling bab7b280bf5e3e2530743b9082d991758897e882 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.1%) to 78.498% when pulling b123f783112e983459ee17433cb8646608a7db14 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.1%) to 78.223% when pulling 2c5309e71d3b9eb328649284dcfaa40bf136c6e6 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.06%) to 78.423% when pulling c309484b9182546de74e0b7dcd39c736a66ba397 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.06%) to 78.423% when pulling c309484b9182546de74e0b7dcd39c736a66ba397 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.2%) to 78.526% when pulling 76815a4d1d02ff17c98ebadbfc5f53bc44b3b24f on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.07%) to 78.289% when pulling b56f938ad9e38d500314e943f4531bd9bb666590 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.05%) to 78.412% when pulling 13f0da52cce93fc1ee0248b2b9d64cbd8d4f614c on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

@robskillington I made the reader explicitly un-reusable and added an associated unit test. Let me know if there is anything else that needs to change before I land

Coverage decreased (-0.1%) to 78.264% when pulling 68d43c508724d073a2501695be399524288bcadb on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.1%) to 78.466% when pulling 3a6a1e18c3a6003ba09b811cf68cca3e8d07021e on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.05%) to 78.414% when pulling 8f81c74518fe81d1e43dda6b1da2c366ac966278 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.05%) to 78.414% when pulling 8f81c74518fe81d1e43dda6b1da2c366ac966278 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.136% when pulling b09541389ac7cf4a85739cf3354872570266f103 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.136% when pulling b09541389ac7cf4a85739cf3354872570266f103 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.3%) to 78.045% when pulling 934036238ac86c5035107e0c18d42de69e999704 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.126% when pulling 2f05ea1f74a96f6e0103fdb12fc5db55d23bfb1d on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.126% when pulling 2f05ea1f74a96f6e0103fdb12fc5db55d23bfb1d on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.117% when pulling f6467f4ed27ec7d059f0e114e13ddb013715a140 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.08%) to 78.437% when pulling f6467f4ed27ec7d059f0e114e13ddb013715a140 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.158% when pulling 6a6df55a1351e1f1f151e03c182cd2e149862e73 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage decreased (-0.2%) to 78.188% when pulling 7bacf50ac2a576722992a201310f4b8ca66d2427 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.1%) to 78.481% when pulling 353ba382669deea14dcca6e939bf5f69a9754842 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.1%) to 78.481% when pulling 353ba382669deea14dcca6e939bf5f69a9754842 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.2%) to 78.561% when pulling 913fabd45e6f533edb4c4fb6611366b893c5f576 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.2%) to 78.561% when pulling 913fabd45e6f533edb4c4fb6611366b893c5f576 on richardartoul:ra/parallelize-commitlog-reader into 16ef86362dcdc02d3b7ad8f8bc3f25c3661e5a1d on m3db:master.

Coverage increased (+0.06%) to 78.463% when pulling caaa039855b5949f9637fb109b52f956e0440a7c on richardartoul:ra/parallelize-commitlog-reader into caa283a70486c9d414bdfe3f075f36c81d503864 on m3db:master.

Coverage increased (+0.04%) to 78.437% when pulling 9c5e38a22531208383381002f52654f2e23a850d on richardartoul:ra/parallelize-commitlog-reader into caa283a70486c9d414bdfe3f075f36c81d503864 on m3db:master.

Coverage decreased (-0.02%) to 78.375% when pulling 982362c5e7d099c904a024628aac2503759b0cf4 on richardartoul:ra/parallelize-commitlog-reader into caa283a70486c9d414bdfe3f075f36c81d503864 on m3db:master.


Can't browse directories named with special characters

Wonderful app! This is the issue I am encountering: it seems rclonebrowser can't navigate directories named with special characters. I have directories with French characters such as ç or é and è etc. and I can't browse these folders, the triangle disappears after refresh.

I am able to browse them with rclone by adding "" to the name of these folders. Would there be anyway to do the same with rclone browser? I have so many subfolders and files with special characters that it would take an enormous amount of time to rename them all.
Thanks for your help!

I assume you are doing this on macOS? I tried using creating çéè folder on Google Drive and could browse it successfully on Windows 10 and Linux. I'll check later what happens on macOS.
Do I understand correctly that simply doing rclone ls remote:path/to/MP3/2004-01-24 & 25-François-... on CLI doesn't correctly show contents? And to make folders appear you append two quotes like this:
rclone ls remote:path/to/MP3/2004-01-24 & 25-François-..."" ?

That's correct, I am using macOS 10.11.
On CLI if I append the folder(s) with special characters with"" like this  rclone ls remote:path/to/MP3/"2004-01-24 & 25-François-..." it works.

I was able to reproduce problem on macOS. Now I'll need to find out how to fix it, not sure how, yet.
It seems that Qt is passing passing unicode string with cedilla combining characters, but rclone (and go) doesn't automatically normalize and the remote server also doesn't do that.
Basically ç character which is encoded in utf-8 as 0xc3 0xa7 gets passed as 0x63 0xcc 0xa7 as bytes which are c◌̧ characters (regular ascii c followed by U+0327 codepoint).
Tricky! I'll look how can I fix this.

It would save an incredible amount of time to all international mac people I am sure! Thanks for your help!


3213 Migrate from container registry to artifact registry

Motivation and Context
We are moving our images to an artifact registry.
What has changed

Update image URIs

How to test?
Check the new image URIs are correct
Links
https://trello.com/c/0LziJk8R/3213-migrate-from-container-registrys-to-artifact-registry-using-standard-repository-8

No longer supporting this service


[Connector API] Update endpoint stability

Changes
Connector management endpoints are marked as beta: https://www.elastic.co/guide/en/elasticsearch/reference/master/connector-apis.html
This PR updates experimental -> beta stability for connector management endpoints.

Please don't commit the output/schema/dangling-types/dangling.csv file - we'll commit it or ignore it in a future pull request.

Ahh sorry! Missed that it got included in this change, fixing


Recommending readonly SAS urls

@avnerms : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off

@ktoliver : Thanks for your contribution! The author(s) have been notified to review your proposed change.


[SPARK-23903][SQL] Add support for date extract

What changes were proposed in this pull request?
Add support for date extract function:
spark-sql> SELECT EXTRACT(YEAR FROM TIMESTAMP '2000-12-16 12:21:13');
2000

Supported field same as Hive: YEAR, QUARTER, MONTH, WEEK, DAY, DAYOFWEEK, HOUR, MINUTE, SECOND.
How was this patch tested?
unit tests

Test build #91396 has started for PR 21479 at commit a1a4db3.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3762/
Test PASSed.

What about day_of_week?

Test build #91396 has finished for PR 21479 at commit a1a4db3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91396/
Test PASSed.

Test build #91407 has started for PR 21479 at commit c9d2bc3.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3770/
Test PASSed.

Merged build finished. Test PASSed.

Test build #91409 has started for PR 21479 at commit 0ad3dd7.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3771/
Test PASSed.

Test build #91407 has finished for PR 21479 at commit c9d2bc3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91407/
Test PASSed.

Test build #91409 has finished for PR 21479 at commit 0ad3dd7.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91409/
Test FAILed.

Jenkins, retest this please.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3774/
Test PASSed.

Test build #91412 has started for PR 21479 at commit 0ad3dd7.

Test build #91412 has finished for PR 21479 at commit 0ad3dd7.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91412/
Test FAILed.

Test build #91415 has started for PR 21479 at commit 0ad3dd7.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3777/
Test PASSed.

Merged build finished. Test PASSed.

Test build #91415 has finished for PR 21479 at commit 0ad3dd7.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91415/
Test PASSed.

Thanks! merging to master.


CI for Node

App
✕ Contains the compiled JavaScript (5 ms)
Game
Game
✕ Initializes with two players (2 ms)
✕ Starts the game with a random player
nextPlayer
✕ Sets the current player to be whoever it is not (1 ms)


Rename vscode extension typespec

All changed packages have been documented.

:white_check_mark: typespec-vscode

Show changes
typespec-vscode - feature ✏

Rename vscode extension from "TypeSpec for VS Code" to "TypeSpec"

You can try these changes here

🛝 Playground
🌐 Website
📚 Next docs


Reading row groups

Hi,
Thanks a lot for developing and maintaining this super useful library!
I was wondering about reading "row groups"; is that possible?
The way I understand this, this should allow one to lazy-load a subset of rows from a large data set?

Hi @tischi, thanks for your kind words!
As far as I know it is not possible directly: row groups are an internal parquet structure used in predicate pushdown. Predicate pushdown is not yet implemented (and there is no plan to do it in the near future).
If your use case is to read only the first N rows we could add that feature in the options, let me know if this would fit your needs.

Hi @ccleva,
Let me provide you with give some context:
Currently, I am not using Parquet yet, but exploring the options.
My main application, ideally, would be lazy loading from a big S3 hosted table into a Java JTable, such that data is only loaded while people move around in the JTable UI, both lazy-loading rows and columns on-demand from the object store.
It would become part of this Java application: https://www.nature.com/articles/s41592-023-01776-4
There, we already can lazy-load very well the image data, using a S3 Zarr backend, however the tables are currently stored as CSV on github an must be downloaded as a whole.
Do you know whether such lazy-loading of rows and columns from Parquet/S3 into a JTable should, in principle, be possible?

Thank you!
That's a bit of a bummer ;-)
I actually hoped that Parquet would "natively" support chunked loading and writing (from S3...).
I googled a bit and it seems that the python pyarrow library does support both chunked loading and saving chunks?!
https://blog.clairvoyantsoft.com/efficient-processing-of-parquet-files-in-chunks-using-pyarrow-b315cc0c62f9
For the saving, as you mentioned, there are actually now a number of files, but the library seems to help quite a bit with the creation of those chunk files, so that would be fine (for me).
And for the loading, I would hope that parquet_file.read_row_group(i, i + chunk_size) would be smart enough to only touch the files that contain relevant data?
What do you think? Is it that the parquet file format in principle would support chunking, but maybe the current Java implementations don't have all the features?

Yes, pyarrow supports chunking, partitioning, predicate pushdown, and reading from s3. There are some nice examples here.
Other libraries might also provide this (like awswrangler), but it is not a "native" feature of parquet, more a feature of the library reading and writing the files.

I see, and there is no Java equivalent to pyarrow...?

The java arrow implementation (arrows is a memory data format) includes support for reading parquet files but some of the features for manipulating the data afterwards are not pure Java implementations.
This is why I started this project: I wanted a pure Java implementation of a dataset (tablesaw is kind of a pandas equivalent) that can be used with parquet files...

Moving this to the discussions


Vulnerability roundup 103: gupnp-1.2.0: 1 advisory [8.1]

search, files

[ ] CVE-2021-33516 CVSSv3=8.1 (nixos-20.09)

Scanned versions: nixos-20.09: 86d3781c390.

Looking at the gupnp changelog, we should backport bumps up to 1.2.4 + the CVE patch PR.

20.09 is EOL.


Adds dictionary support to launcher

Commit Message:

Adds --dict to launcher.py
Adds fuzzing_dictionary as an implicit argument to fuzzing_launcher
Adds dict_dir directory with valid and invalid dictionaries
Adds empty_fuzz_test_with_dict and empty_fuzz_test_with_invalid_dict

Additional Description:
The second issue described in #43 is not clear to me yet, waiting to fix.
Testing:
Local testing and CI testing
Docs Changes: N/A
Fixes #43
Signed-off-by: tengpeng<EMAIL_ADDRESS>modified:   examples/BUILD
new file:   examples/dict_dir/invalid.dict
new file:   examples/dict_dir/valid.dict
modified:   fuzzing/cc_deps.bzl
modified:   fuzzing/common.bzl
modified:   fuzzing/tools/launcher.py

This PR adds a target that is expected to fail, but we don't check anywhere that it actually fails. Should we capture this somewhere?

Discussed this morning, the test for the dictionary support is de-prioritized due to the limit time.


Update DiabetesNotebook.ipynb

The notebook is not complete with the training the model and predicting the output of the trained model. So I would like to solve this issue by adding both these things to this DiabetesNotebook.ipynb
I am a participant of GSSOC'21.

Go ahead @aayushibansal2001 , make sure to save the model and try to make more visuals if possible, Happy Coding :)

The model made in this notebook ( RandomForest ) is having only 80% accuracy. I will like to improve the accuracy of same by trying other models.
I am also in GSSOC21


Fix #101: set colours for Verbatim without using private Sphinx macros

This avoids using private Sphinx macro \spx@verbatimfcolorbox which got
renamed at Sphinx 5.1.0 and whose definition would thus remain without
effect.
Fixes: #101

In second commit I remove \makeatletter/\makeatother as @ is not used. But anyhow as this is a .cls file a priori if used normally (i.e. not directly via \input but in \documentclass) then the @ needed no such extra set-up actually.

Thanks @jfbu, this code looks good to me.


Add new command to allow for refreshing Tasks without having to restart Obsidian

⚠ Please check that this feature request hasn't been suggested before.

[X] I searched previous Ideas in Discussions didn't find any similar feature requests.
[X] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description
Sometimes, Tasks seems to not notice that data has changed and there is current not a great way to refresh state without restarting the app. Ideally, changes to notes, locally, via sync, etc would always detect change and the refresh would be transparent and the data always correct.
The ask is to add a method that allows the user to refresh Tasks state so they do not have to restart the app. When there is only a single Obsidian window involved, it's not hard to restart quickly. If you use multiple windows though, they have to be moved back into place on their correct desktop on Linux.
✔ Solution
Add a new command to the Command Palette Force Refresh and Blocks that effectively clears the existing state and rebuilds data structures then triggers tasks blocks to re-query based on the new state to handle any discrepancies caused by Sync, date rollover, etc.
❓ Alternatives
No response
📝 Additional Context
I run Obsidian Sync on 3 to 4 machines and I've noticed that sometimes, that the task queries do not update at the end of the sync and that I have to restart Obsidian so that the queries return correct data. This happens most frequently on my Linux laptop which sleeps/hibernates at night.
When mine gets stuck, I just restart Obsidian and the initialization sequence "fixes" the state views. Not a huge deal, but I do keep multiple Obsidian windows open on multiple desktops, so I have to move them back onto the correct desktop after a restart.

Brilliant. Thank you very much.
For reference, this arose from https://github.com/obsidian-tasks-group/obsidian-tasks/issues/1289#issuecomment-1642578741.
In that discussion, I had not appreciated that the request is for two things:

re-parse every file in the vault that is in a format that Tasks supports
then refresh every open Tasks query block (that is in Reading or Live Preview modes

For performance reasons, it is important that redrawing of Tasks query blocks does not start until the re-parsing has finished.

Add a new command to the Command Palette Force Refresh and Blocks that effectively clears the existing state and rebuilds data structures then triggers tasks blocks to re-query based on the new state to handle any discrepancies caused by Sync, date rollover, etc.

Is there a word missing in Force Refresh and Blocks - was it perhaps meaning Force Refresh Tasks and Blocks?

@donthorp
Hi, your thoughts, please... 😄

Is there a word missing in Force Refresh and Blocks - was it perhaps meaning Force Refresh Tasks and Blocks?

@claremacrae sorry you had to bump me.

Is there a word missing in Force Refresh and Blocks - was it perhaps meaning Force Refresh Tasks and Blocks?

Force Refresh All Tasks and Blocks is what I intended.

That's a much better name - thanks @donthorp!

I'm guessing this would help with a similar issue: when I have a note always open on my desktop showing tasks with the filter "due before tomorrow", they generally don't automatically update when it's a new day.  I have to manually drag my cursor through all my task filters to get the new ones to show (and I imagine opening/closing Obsidian or the tab, itself, would work similarly). A "Force Refresh All Tasks and Blocks" that I could tie to a hotkey would certainly save some steps and be appreciated. If I'm wrong about this being related to the issue in this thread, please let me know and I'll open a new one. Thanks!

I'm guessing this would help with a similar issue: when I have a note always open on my desktop showing tasks with the filter "due before tomorrow", they generally don't automatically update when it's a new day. I have to manually drag my cursor through all my task filters to get the new ones to show (and I imagine opening/closing Obsidian or the tab, itself, would work similarly).

Hi @AaronOldenburg, Please see this section of the documentation, and up-vote the linked issue. Thanks.

https://publish.obsidian.md/tasks/Queries/Filters#Troubleshooting+date+searches

Hi @AaronOldenburg, Please see this section of the documentation, and up-vote the linked issue. Thanks.

https://publish.obsidian.md/tasks/Queries/Filters#Troubleshooting+date+searches

Funnily enough, the linked issue links to this one - neither of them have any upvotes - 👍

Ah, great, thanks for pointing that out!


feat(technical): make ontology generated documentation visible

After the changes in https://github.com/okp4/ontology/pull/229, set up Docusaurus to include the ontology's generated documentation in the "Technical Documentation" section.

Summary by CodeRabbit

New Features

Introduced an 'Ontology' section with a dedicated navigation path and version dropdown, enhancing the documentation structure.

Documentation

Updated technical documentation overview and improved navigation with revised labels and links for key topics such as "Smart Contracts," "Governance Predicates," "Modules," and "Command Line Interface."
Enhanced readability and organization of sidebar navigation with visual separators.

@MdechampG I suggest we merge this one as it is and then address #407 to make the necessary improvements, if you agree.

@MdechampG I suggest we merge this one as it is and then address #407 to make the necessary improvements, if you agree.

Yes sure @ccamel


Language/runtime: transactionContext association

right now, TransactionContexts are stored in the various remoteObjects that are currently undergoing the transaction.  This will break if we have concurrent or nested transactions.  Better idea is to modify levelCall(...) to take in transaction context along with Cache and Store.  As stopgap, we could implement this by storing the TransactionContext in the Cache or Store.

fixed in efd2fe1b241df6ca57866c4957edb49c9425f273


show clap help text by default

add by default clap help text by adding AppSettings::ArgRequiredElseHelp to the app settings
expected behavior:
if running the binary without any command, show the --help automatically
to keep the bumblefoot_lib usage example, I move the login to validate the cmd

sure, i'll close this PR and open a new one


This method is not supported for ReactViewGroup instances

This method is not supported for ReactViewGroup instances
setBackground
ReactViewGroup.java:133
When I integrate React Native pages into Android Native Fragment Component,app crashed above 5.0 system！
private ReactRootView mReactRootView;
private ReactInstanceManager mReactInstanceManager;

@Override
public View onCreateView(LayoutInflater inflater, ViewGroup container,
                         Bundle savedInstanceState) {
        mReactRootView = new ReactRootView(mContext);
        mReactInstanceManager = ReactInstanceManager.builder()
                .setApplication(getActivity().getApplication())
                .setBundleAssetName("index.android.bundle")
                .setJSMainModuleName("index.android")
                .addPackage(new MainReactPackage())
                .setUseDeveloperSupport(BuildConfig.DEBUG)
                .setInitialLifecycleState(LifecycleState.RESUMED)
                .build();
        mReactRootView.startReactApplication(mReactInstanceManager, "XXX", null);
    return mReactRootView;

}

Closing this issue because it has been inactive for a while. If you think it should still be opened let us know why.


[REQUEST] DefaultMediaCost modification

Windows 10 is very persistent about installing certain things (such as GPU drivers) no matter your group policy or other registry settings. One exception is if the connection is marked as a metered connection, which is the most reliable way to get Windows not to download anything until you're ready.
The setting that governs whether or not a connection type is, by default, metered, is in the registry key  HKLM\SOFTWARE\Microsoft\Windows NT\CurrentVersion\NetworkList\DefaultMediaCost, which lists  3G, 4G, Ethernet, and WiFi. (As well as 'Default', but this should probably be left alone as it likely governs any connection type that does not fall into the previous 4 and is just as likely not to be very easily toggled.) 3G and 4G have a value of 2, which is metered, and Ethernet and WiFi have a value of 1, which is unmetered.
So, for this purpose, Ethernet and WiFi need to be set to 2, but there's a problem here: the DefaultMediaCost registry key is owned by TrustedInstaller, and taking ownership of registry keys through the CLI is not very intuitive, and it's equally as befuddling to try and give ownership back to TrustedInstaller if desired.
Right now, I'm resorting to mounting install.wim, mounting filesystem, mounting the registry hive, and doing it manually through regedit, then writing the changes to install.wim, building the ISO, and only then running Optimize-Offline.
 (Perhaps a TrustedInstaller folder within the Registry folder, in which all .reg files contained within have their keys taken ownership of and then having their ownership given to TrustedInstaller?)
I apologize if there's an easy way of doing this already that I'm just overlooking.

The easiest method, I think, is to convert the registry change you want to make to a 'merge style' of REG code and add each required registry change to this projects provided "Additional Tweaks.reg"
Example of a TrustedInstaller required reg code I add
[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\DoSvc]
; Set Delivery Optimization service disabled
"Start"=dword:00000004
*** Alternative ***
Temporarily get the needed privileges to run some registry changing code.
Use sordum.org PowerRun or GitHub NSudo to run a PowerShell script or DOS command REG ADD to make your changes. Easier and less of a hassle than the permanent changes you've described.

I didn't realize Optimize-Offline's Additional feature bypassed the TrustedInstaller permission. I tried to do this using it once before and it didn't work. But perhaps I did something wrong. I'll have to re-review the documentation and try again.

@Phatastik Does it have to be added to Additional Tweaks specifically? The readme in the directory said any reg file in the directory would work. I added two files to this directory and set 'RegistryTemplates' to 'True' in Config.ini:
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\ReserveManager]
"ShippedWithReserves"=dword:00000000

Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\NetworkList\DefaultMediaCost]
"Ethernet"=dword:00000002
"WiFi"=dword:00000002

While my ShippedWithReserves tweak was applied correctly, the DefaultMediaCost one was not applied.

@ImportTaste I think you're right. It sounds like you can drop your own independent *.reg. files into the RegistryTemplates folder. I've been sticking them at the end of 'Additional Tweaks.reg'
Sorry, I wasn't 100% clear.
I was expecting you to do a practice install into a VM machine. I wasn't expecting you to tech-ninja mount the pre-installation raw registry hive!
The reason you're seeing what you've found in the pre-installation raw registry hive is that the registry changes in the RegistryTemplates folder get applied during one of the phases of image installation. I just googled "install phase OOBE" and found a page with a bunch of pictures (https://docs.microsoft.com/en-us/windows/deployment/upgrade/troubleshoot-upgrade-errors) that might help if you're a visual learner
The registry hive you were looking shows the default settings before installation.
The default "ShippedWithReserves" setting is "0." Meaning that you're intended change will not change anything!
FYI, there is some debate as to whether Microsoft will allow you to control the ShippedWithReserves setting. The only way to find out is to see what happens when they ship the next giant feature update.
Just to be extra clear
The Registry additions aren't "bypassing TrustedInstaller"
The installation phase where the .reg. files in the RegistryTemplates folder get applied happens at the Trusted Installer privilege level. Think about it like the reg changes are getting applied by the TrustedInstaller "owner."  . . . But you have to actually commit to the installation to see the changes.

What I'm saying is that the ShippedWithReserves reg file is being applied by Optimize-Offline correctly. I verified it by mounting the registry hive from the finished iso and checking.
The same is not true of the DefaultMediaCost reg file. It is not applied. If Optimize-Offline is supposed to have the TrustedInstaller privilege level for applying RegistryTemplate files, then this is a bug that needs to be fixed.

Registry templates that users can add to be automatically imported into the offline registry hives are not granted the token privileges required for access to protected registry keys. Only certain values applied by the script itself are granted these privileges.


Revert test code to use URLSession instead of Kitura-net.

I created the following issue on Swift Jira https://bugs.swift.org/browse/SR-2974
We can revert test code once this has been addressed.

Looks like a SwiftRuntime issue has been created based on my bug report: https://github.com/IBM-Swift/SwiftRuntime/issues/237

I believe many of the URLSession issues have been fixed, including this one in swift 3.1. Whenever there is an official release, we can try to use URLSession again.


Removing babel

Because we want alle building alle, we can't have dependencies like babel.

Pull Request Test Coverage Report for Build 42

15 of 15 (100.0%) changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 40:
0.0%

Covered Lines:
54

Relevant Lines:
54

💛  - Coveralls


chore: try again with new contributor label

Add the new-contributor label if there are at most 5 exisiting PRs by this author. Also adds a CI status line "New Contributor Check (push) — Found n PRs by this author." regardless.

Scott, thank you!  And thanks for the vote of confidence of being able to check this PR!
I do not really understand why the checks for permissions are there: it seems to work and this is great!
Also, I think that before the logic was to add the label by checking against closed PRs, while now it is checking open PRs.  Thus, your PR got labelled with the limit of 50, even though you have over 800.  In particular, if 22 of your PRs got closed immediately, then your next one would be labeled as new-contributor!
Having said that, I am happy to have the bot erroneously label as new contributors someone who has very few open PRs.  If it becomes annoying, we can always change the logic afterwards!
maintainer-merge

maintainer merge

@adomani, I think that actually what's happening is there is a limit of 30 results in the query, and it is in fact returning all PRs, whether open or closed. In particular I only have 26 open PRs, so the fact that the status line reports that I have 30 means it is seeing more than the open ones (I hope).
Perhaps we could make this clearer by adding:

an explicit upper bound for the number of results in the query, and/or
detecting if there are exactly 30 results, and in that case having the status line say "Found \ge 30 PRs ...".

I looked for the status report, but could not find it, even though I see that it should print the relevant number.
Anyway, I probably prefer to merge this as is and see how it works "in the wild".  I think that it is good automation if the bot adds the label to new contributors.  If sometimes the label gets added to a not-too-new contributor, then we can amend.

I looked for the status report, but could not find it, even though I see that it should print the relevant number.
Anyway, I probably prefer to merge this as is and see how it works "in the wild". I think that it is good automation if the bot adds the label to new contributors. If sometimes the label gets added to a not-too-new contributor, then we can amend.

The status is in the CI results:

bors d=adomani

I looked for the status report, but could not find it, even though I see that it should print the relevant number.
Anyway, I probably prefer to merge this as is and see how it works "in the wild". I think that it is good automation if the bot adds the label to new contributors. If sometimes the label gets added to a not-too-new contributor, then we can amend.

The status is in the CI results:

I had no idea that this message was accessible, so I did not even think of looking there!

Thanks!  Let's see how this performs and then fine-tune later, if needed!
bors r+


[Test] v2alpha1 PR #6016 and #6020

@kacpersaw is this still needed? 🙂

No it's not - it was created to build test version :) Closing.


Make docs.sh resilient to not having dart in the path

Had to make a few more changes to the scripts to point to the right dart.


Increasing Search test retry delays considerably for throttling

Creating indexes on a free account gets throttled and the ends of our test passes are failing.  I'm increasing the timeouts a lot while we explore what works for our tests.  The default exponential retry policy will randomly jitter any individual retry between 80% and 120% of the following targets:
  1:  0:01
  2:  0:02
  3:  0:04
  4:  0:08
  5:  0:16
  6:  0:32
  7:  1:04
  8:  2:08
  9:  4:16
 10:  8:32
Max: 10:00

We cap any single request at 10 minutes.  If that's not enough to get around index throttling, we'll need to change the type of resources we're using.

Don't they send a retry-after header?

Don't they send a retry-after header?

No, I don't believe so.  Here's an example from this morning's log:
d934bf2c-f4b2-40fe-93bb-41f3fc0f52c6
  status: 429
  reasonPhrase:
  headers:
    Cache-Control:no-cache
    Pragma:no-cache
    request-id:d934bf2c-f4b2-40fe-93bb-41f3fc0f52c6
    elapsed-time:45
    OData-Version:4.0
    Preference-Applied:REDACTED
    Strict-Transport-Security:REDACTED
    Date:Tue, 12 May 2020 12:46:45 GMT
    Content-Type:application/json; odata.metadata=minimal
    Content-Language:REDACTED
    Expires:-1
    Content-Length:250
  seconds: 0.071649243

Can we file a service issue about it?

In the case I pasted above, they probably couldn't fix it easily.  Here's the body it returned: {"error":{"code":"","message":"Index quota has been exceeded for this service. You must either delete unused indexes first, add a delay between index creation requests, or upgrade the service for higher limits. Maximum number of indexes allowed: 3"}}.
Here's a specific throttling example returning {"error":{"code":"","message":"You are sending too many requests. Please try again later."}} that probably should have a suggested Retry-After:
96bf0290-fa2d-487b-9ef8-df72c0f35f60
  status: 503
  reasonPhrase: Service Unavailable
  headers:
    Cache-Control:no-cache
    Pragma:no-cache
    throttle-reason:rateLimitExceeded
    request-id:96bf0290-fa2d-487b-9ef8-df72c0f35f60
    elapsed-time:11093
    OData-Version:4.0
    Preference-Applied:REDACTED
    Strict-Transport-Security:REDACTED
    Date:Tue, 12 May 2020 12:45:59 GMT
    Content-Type:application/json; odata.metadata=minimal
    Content-Language:REDACTED
    Expires:-1
    Content-Length:92
  seconds: 11.119866373

I'll ping folks on the service team.


Sample code in Entity documentation contains useless statement

name: Bug report
about: Sample code in Entity documentation contains useless statement

Describe the bug
The function getCreated() in section "Handling Business Logic" of the documentation contains the following code:
public function getCreatedAt(string $format = 'Y-m-d H:i:s')
{
...
        return $format === true ? $this->created_at : $this->created_at->format($format);
}

If the function requires as a parameter a string $format === true can never be true.
CodeIgniter 4 version
CodeIgniter 4.0.0 alpha 2
Affected module(s)
Documentation section "Working with Entities" sub-section "Handling Business Logic".

Fixed in #1540


User details missing in launch data and id_token

Hi everyone, I try to open that tool (game) from my LMS (OpenEdx).  I have configured all the files as per the LMS details. Log in and launch done successfully. But I can't get the user name from " $launch->get_launch_data()['name']". If I decode the id_token there are also no user details.
Can someone please share some information? @ohammersmith @mylescarrick @jbasdf @oxtralite @furstenberg
Thanks in advance!

OpenEdx tutor installation does not send user details in JWT.


'mat_mul` is painfully slow.

Calling mat_mul(C, A, B) with C and A being arrays of abstract_vectors and B a square matrix seems to be painfully slow.
I have been running some performances tests for computing the leading singular vectors of the resolvent operator. For the most demanding case (1024 grid points, 2048-dimensional real vector), getting the singular vectors from the Krylov bases seems to take as much as twice the time spent calling a dozen time the gmres solver with the exponential propagator.
We need to investigate this a bit more and see if we can get any performance benefits.
I ain't sure yet, but I think the culprit might be the repeated calls to get_vec. I'll look into it next week.

Found the culprit. I'll send a PR with a patch to dev tomorrow morning.
Closing this issue.


Migration issue with multiple nested "OwnsOne" after upgrading to v.2.2.2

I get error message when I try to update the database after generating a migration. Before upgrading to 2.2.2  - it works fine.
Exception message: System.InvalidOperationException: The entity type 'EFError1.Models.SubAddress' cannot be added to the model because a weak entity type with the same name already exists.
Stack trace:System.InvalidOperationException: The entity type 'EFError1.Models.SubAddress' cannot be added to the model because a weak entity type with the same name already exists.
   at Microsoft.EntityFrameworkCore.Metadata.Internal.Model.AddEntityType(EntityType entityType)
   at Microsoft.EntityFrameworkCore.Metadata.Internal.Model.AddEntityType(String name, ConfigurationSource configurationSource)
   at Microsoft.EntityFrameworkCore.Metadata.Internal.InternalModelBuilder.Entity(TypeIdentity& type, ConfigurationSource configurationSource, Boolean allowOwned, Boolean throwOnQuery)
   at Microsoft.EntityFrameworkCore.Metadata.Internal.InternalModelBuilder.Entity(String name, ConfigurationSource configurationSource, Boolean allowOwned, Boolean throwOnQuery)
   at Microsoft.EntityFrameworkCore.Metadata.Builders.ReferenceOwnershipBuilder.FindRelatedEntityType(String relatedTypeName, String navigationName)
   at Microsoft.EntityFrameworkCore.Metadata.Builders.ReferenceOwnershipBuilder.HasOne(String relatedTypeName, String navigationName)
   at EFError1.Migrations.Initial.<>c.<BuildTargetModel>b__2_7(ReferenceOwnershipBuilder b3) in D:\SandBox\EFIssues\EFError1\EFError1\Migrations\20190312102225_Initial.Designer.cs:line 128
   at Microsoft.EntityFrameworkCore.Metadata.Builders.ReferenceOwnershipBuilder.OwnsOne(String ownedTypeName, String navigationName, Action`1 buildAction)
   at EFError1.Migrations.Initial.<>c.<BuildTargetModel>b__2_6(ReferenceOwnershipBuilder b2) in D:\SandBox\EFIssues\EFError1\EFError1\Migrations\20190312102225_Initial.Designer.cs:line 118
   at Microsoft.EntityFrameworkCore.Metadata.Builders.ReferenceOwnershipBuilder.OwnsOne(String ownedTypeName, String navigationName, Action`1 buildAction)
   at EFError1.Migrations.Initial.<>c.<BuildTargetModel>b__2_3(ReferenceOwnershipBuilder b1) in D:\SandBox\EFIssues\EFError1\EFError1\Migrations\20190312102225_Initial.Designer.cs:line 101
   at Microsoft.EntityFrameworkCore.Metadata.Builders.EntityTypeBuilder.OwnsOne(String ownedTypeName, String navigationName, Action`1 buildAction)
   at EFError1.Migrations.Initial.<>c.<BuildTargetModel>b__2_1(EntityTypeBuilder b) in D:\SandBox\EFIssues\EFError1\EFError1\Migrations\20190312102225_Initial.Designer.cs:line 86
   at Microsoft.EntityFrameworkCore.ModelBuilder.Entity(String name, Action`1 buildAction)
   at EFError1.Migrations.Initial.BuildTargetModel(ModelBuilder modelBuilder) in D:\SandBox\EFIssues\EFError1\EFError1\Migrations\20190312102225_Initial.Designer.cs:line 34
   at Microsoft.EntityFrameworkCore.Migrations.Migration.<.ctor>b__4_0()
   at Microsoft.EntityFrameworkCore.Internal.LazyRef`1.get_Value()
   at Microsoft.EntityFrameworkCore.Migrations.Migration.get_TargetModel()
   at Microsoft.EntityFrameworkCore.Migrations.Internal.Migrator.GenerateUpSql(Migration migration)
   at Microsoft.EntityFrameworkCore.Migrations.Internal.Migrator.<>c__DisplayClass13_2.<GetMigrationCommandLists>b__2()
   at Microsoft.EntityFrameworkCore.Migrations.Internal.Migrator.Migrate(String targetMigration)
   at Microsoft.EntityFrameworkCore.Design.Internal.MigrationsOperations.UpdateDatabase(String targetMigration, String contextType)
   at Microsoft.EntityFrameworkCore.Design.OperationExecutor.UpdateDatabase.<>c__DisplayClass0_1.<.ctor>b__0()
   at Microsoft.EntityFrameworkCore.Design.OperationExecutor.OperationBase.Execute(Action action)
The entity type 'EFError1.Models.SubAddress' cannot be added to the model because a weak entity type with the same name already exists.

Steps to reproduce
For reproduce this issue create test project, add EF core 2.2.2, and do the migration using the classes described below
Partial code listings:
public class Root
    {
        public int Id { get; set; }
        public MainAddress Address1 { get; set; }
        public MainAddress Address2 { get; set; }
    }

public class MainAddress
    {
        public int Id { get; set; }
        public string Name { get; set; }
        public  SubAddress SubAddress { get; set; }
    }

public class SubAddress
{
    public int Id { get; set; }
    public string Name { get; set; }
    public int Number { get; set; }
    public SubSubAddress SubSubAddress { get; set; }
}

public class SubSubAddress
{
    public int Id { get; set; }
    public string Text { get; set; }
}

public class RootConfig : IEntityTypeConfiguration<Root>
    {
        public void Configure(EntityTypeBuilder<Root> builder)
        {
            builder.ToTable("Roots");

            builder.HasKey(it => it.Id);

            builder.OwnsOne(root => root.Address1, address =>
            {
                address.OwnsOne(a => a.SubAddress, subAddress =>
                {
                    subAddress.OwnsOne(it => it.SubSubAddress);
                });
            });

            builder.OwnsOne(root => root.Address2, address =>
            {
                address.OwnsOne(a => a.SubAddress, subAddress =>
                    {
                        subAddress.OwnsOne(it => it.SubSubAddress);
                    });
            });
        }
    }

public class TestContext : DbContext
    {
        public TestContext(DbContextOptions<TestContext> context) : base(context)
        {

        }

        public DbSet<Root> Roots { get; set; }

        protected override void OnModelCreating(ModelBuilder modelBuilder)
        {
            base.OnModelCreating(modelBuilder);
            modelBuilder.ApplyConfiguration(new RootConfig());
        }
    }

Further technical details
EF Core version: 2.2.2
Database Provider: Npgsql.EntityFrameworkCore.PostgreSQL 2.2.0
Operating system: Windows 10
IDE: Rider 2018.3

@ASBrattsev What version are you upgrading from?

2.1.8

The problem has a temporary solution, but I don't like it. I changed the example a bit. It is necessary to comment out the first mentions of a triple attachment of a double "OwnsOne", as on the picture, and then everything works. (sorry if not clearly written, I don't know how to write it in my native language, not that English =) )

Duplicate of #18183


Feature/simpler package structure

Before vs After

Current coverage is 100.00%

Merging #43 into develop will not affect coverage as of 0c0a188

@@            develop     #43   diff @@
=======================================
  Files            21      21
  Stmts           518     518
  Branches         66      66
  Methods           0       0
=======================================
  Hit             518     518
  Partial           0       0
  Missed            0       0

Review entire Coverage Diff as of 0c0a188

Powered by Codecov. Updated on successful CI builds.


OIDC JpaServiceRegistry Leak Detection Error

If you use jpa service registry for oidc services and define scopes in your service than you the getConsentPolicy method creates an endless chain consentPolicies in the database. The new class of OidcServiceRegistryListener introduce this error because it runs during transaction of load services method of the JpaRepository. So the OidcRegisteredService changes and JPA writes the object back to the database. With every call of the load method the consent policies get one more ChainingRegisteredServiceConsentPolicy.
Database Object:
 o   r   g   .   a   p   e   r   e   o   .   c   a   s   .   s   e   r   v   i   c   e   s   .   c   o   n   s   e   n   t   .                  D   e   f   a   u   l   t   R   e   g   i   s   t   e   r   e   d   S   e   r   v   i   c   e   C   o   n   s   e   n   t   P   o   l   i   c   y

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Should there be test cases to verify the fix here?

For future releases it would be better. There are two possibilities. The first is to make unit test for this method. The second is to make an integration test for this scenario. The second is not trivial because there are many components involved.
Do not exists OidcServiceRegistryListener test cases for this class?
At the moment we are heavily implementing on our project. Because of this we could not implement some test cases at this time. But we are still needing this fix.

Thanks for the note. Given this seems like a crucial and non trivial bit of code, it'd better to guard against failures with test cases. I'll double check if there might be any and will add more; this is required before we can merge.


Make the plugin automatically add the capability

"You should enable Sign in with Apple capability in Xcode"
No, I should expect a fully configured product when I run cordova build --release. Why would you make people go into Xcode every time they want a build?
I've spent hours figuring out why sign in didn't work on TestFlight, and am logging this issue in great frustration.

@jpike88 #45 should fix this issue.


[Bug Report] Stone Soup

What is the issue you are having?
As soon as people puts down the new Raid Feast, Stone Soup, I get this error
What is the expected behavior?
Not giving me an error?
What actually happened?
.
Suggested Solution/Workaround
No response
Errors
31x ...ilisUI\Mainline\Modules\Skins\FrameXML\UIWidgets.lua:37: Attempt to access forbidden object from code tainted by an AddOn
[string "=[C]"]: in function `SetAlpha'
[string "@ElvUI_MerathilisUI\Mainline\Modules\Skins\FrameXML\UIWidgets.lua"]:37: in function <...ilisUI\Mainline\Modules\Skins\FrameXML\UIWidgets.lua:34>
[string "@ElvUI_MerathilisUI\Mainline\Modules\Skins\FrameXML\UIWidgets.lua"]:145: in function <...ilisUI\Mainline\Modules\Skins\FrameXML\UIWidgets.lua:144>
[string "=[C]"]: in function `Setup'
[string "@Blizzard_UIWidgets\Blizzard_UIWidgetManager.lua"]:459: in function `ProcessWidget'
[string "@Blizzard_UIWidgets\Blizzard_UIWidgetManager.lua"]:495: in function `ProcessAllWidgets'
[string "@Blizzard_UIWidgets\Blizzard_UIWidgetManager.lua"]:227: in function `RegisterForWidgetSet'
[string "@FrameXML\CompactUnitFrame.lua"]:1131: in function `CompactUnitFrame_UpdateWidgetSet'
[string "@FrameXML\CompactUnitFrame.lua"]:329: in function `CompactUnitFrame_UpdateAll'
[string "@FrameXML\CompactUnitFrame.lua"]:182: in function `CompactUnitFrame_SetUnit'
[string "@Blizzard_NamePlates\Blizzard_NamePlates.lua"]:417: in function `OnAdded'
[string "@Blizzard_NamePlates\Blizzard_NamePlates.lua"]:118: in function `OnNamePlateAdded'
[string "@Blizzard_NamePlates\Blizzard_NamePlates.lua"]:56: in function <...eBlizzard_NamePlates\Blizzard_NamePlates.lua:47>

Locals:
(*temporary) = <unnamed> {
 0 = <userdata>
}
(*temporary) = 0

ElvUI Changelog/Troubleshooting

[X] I have confirmed that I have read the Changelog and done the Troubleshooting Steps.

I'll have to do that tonight as I'm about to go for work in an hour :)
As for the version; I'm using v. 4.90, which I believe is the current version? I always look for updates before each raid night, and this bug was happening Monday night during raid.
I do believe it's the actual nameplate/progress bar above the Stone Soup which is giving me the above error.

I'll have to do that tonight as I'm about to go for work in an hour :) As for the version; I'm using v. 4.90, which I believe is the current version? I always look for updates before each raid night, and this bug was happening Monday night during raid. I do believe it's the actual nameplate/progress bar above the Stone Soup which is giving me the above error.

The error you are getting mention line 37 on my UIWidget.lua file... there are no line 37 in this file :>

Try now version 4.92

A fix for this should be now in ElvUI itself.

Hey, sorry for the (really) late reply.
At first, I found out that BugGrabber/BugSack was some part of the problem. As soon as I disabled them, the error stopped coming.. Weird, right?
I just tested it now, with the update from ElvUI and Merathilis, and with BugGrabber/BugSack enabled, and no error has yet to occur.


feat(coin-eth): CW-6231 Fix EIP1559 issue

Checklist:

README.md includes:

[ ] The details of signing data and transaction data, this includes parameters.
[ ] Official docs or white paper.
[ ] Website or api can query assets and broadcast transaction.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

Task linked: CW-6231 Fix ETH EIP-1559 function


Update quill to version 6.1.0

Quill is header only library but provides native support for cmake, however the existing port only copies the header files.
This PR updates to the latest version of the library and also adds the native cmake support back

[x] Changes comply with the maintainer guide.
[x] SHA512s are updated for each updated download.
[x] The "supports" clause reflects platforms that may be fixed by this new version.
[x] Any fixed CI baseline entries are removed from that file.
[x] Any patches that are no longer applied are deleted from the port's directory.
[x] The version database is fixed by rerunning ./vcpkg x-add-version --all and committing the result.
[x] Only one version is added to each modified port's versions file.

Still active: #40365.

Apologies I didn't know that the previous one was still open.
Anyone can give some guidance why installation is failing with :
-- Using source at D:/b/quill/src/v6.1.0-d602161d0e.clean
CMake Error at ports/quill/portfile.cmake:13 (vcpkg_cmake_configure):
  Unknown CMake command "vcpkg_cmake_configure".
Call Stack (most recent call first):
  scripts/ports.cmake:192 (include)

I spent more than half a day and I can not find how to fix it

I will close this PR for now since there is an open one for 6.0.0 and reopen it later once I find out how to resolve this issue

Unknown CMake command "vcpkg_cmake_configure".

This command is provided by a script port, 'vcpkg-cmake`. You must add a dependency before you can use it.


Update MSL version to 3.2.3

MSL 3.2.3 has been released almost one year ago, with some maintenance fixes, and is currently the standard version used by all Modelica tools. I would recommend you use it for your library

@nytschgeusen Looks good to me, please merge.


PROBLEMS WITH NAVIGATION IN MICROFRONT FEDERATION

Ask your Question

Context: In a directory I have two directories, "host" and "app1", in "app1" I have a 2-screen navigation and I expose that file in webpack.
In the "host" I import the microfront as follows: const App1 = React.lazy(() => Federated.importModule('app1', './RoutesApp1'));
When I launch the application I get the following error: Invariant violation: I tried to register two views with the same name RNCSafeAreaProvider.
I already share the most relevant files. It already changes versions in the react-navigation dependencies but it continues to throw that error. This only happens to me with navigation. If I have a microfront without navigation there is no problem.

How could I solve this issue

FILES APP1:
index-navigation

app1.tsx

index.js

package.json

plugin of webpack

FILES HOST:
index-navigation

app.tsx - host

index.js -host

package.json

plugin of webpack

hi @sergiohortua,
you need to add every dependency with native module as shared to the ModuleFederationPlugin configuration in all of your webpack.configs.

your host needs to provide all dependencies that have native modules - for JS-only dependencies there is no need for that.
Example:
Host has 4 dependencies, all declared as shared
App1 has 5 dependencies, 4 same as host + react-native-reanimated (as an example)
In this example you would need to add react-native-reanimated to the host app, even though host app doesn't use it. You also need to import it in the index.js of host so it doesn't get stripped way like this:
import 'react-native-reanimated';

If you don't do this, your app will crash since the native module is not present in the host app.

@jbroma
thank you my app funtionality perfect


[Unreal Tournament 3] Server Request

Would it be possible to make a Unreal Tournament 3 Script?
I would be very pleased if you could make it.

Can you confirm that there is a linux server for UT3 ? I'd be glad to work on it when i got home (holidays), i love that game :)

Yes there is!
FYI:

https://forums.epicgames.com/threads/599751-How-to-set-up-a-Linux-Dedicated-Server
http://www.fragme.info/content/cracked-ut3-dedicated-server-linux
https://unrealbyfusilade.wordpress.com/unreal-development-tutorials/unreal-tournament-games/ut3-specific/unreal-tournament-3-server-installation-guide/

I tried installing it myself and got it working. Only problem is that it is not showing up in de server list.

Ok, cool ! Let me a few days to go back home and i'll see if i think it's feasible. Then we're gonna see if we can set this up with master dgibbs64 :)

Well, i can't find any relyable source to download the server in the links you provided. Plus with the close of this crappy gamespy we're gonna have some trouble.
What about Unreal Tournament Pre Alpha ? Seems like a better UT, and free to play.

Yeah but that one isn't finished yet and has no vehicles in it.. :(

Do we have a relyable way to at least download the server ?

https://github.com/GameServerManagers/LinuxGSM/pull/1123 now released


Improve on seeding

The current seeding function needs improvement: if the number of seeds is small it may not be uniformly sampled visually. One way to do this is first divide the whole domain into multiple chunks of the same size, and then select random seeds from them.

I have a better idea. The problem with a random number generator for small samples is that it won't be evenly distributed visually. Besides, for better visualizations we need to take the structure of the field into consideration, i.e. having few points in steady regions and more points in rapidly changing regions.
Therefore, a better way to do this is:

split the whole domain into sub-regions, e.g. 10x10 in xy (Matplotlib's streamplot by default uses 30x30, if I remember correctly).
for each sub-domain, select the center location as the starting point, or do random sampling within that sub-domain. This should visually give better coverage of seeds. It would be even better to consider the gradient of the field: more seeds should lie in the largest gradient direction, whereas fewer points should lie in the small gradient direction.

Partially done in e3d7facaf5a. The seeding depending on gradients may come later.


seg fault on register

for some reason client throws segfault after connecting to server queue in register process but not in login (?)

How to replicate problem?

I've registered several users and logged in on them and not found the problem yet. Previous problem, where when registering already existing user, segfault occured was already fixed in Hotfix in dev branch

Could you describe the problem more precisely and provide replication instructions?

Problem fixed.


add a dataset that loads arrow files

replaces: https://github.com/foundation-model-stack/foundation-model-stack/pull/127

this depends on a PR that didn't actually land... will need to re-land 126.


custom redirect_uri, onCancel handler, token request issue fix

added option to pass custom redirect_uri
added onCancel handler for when user cancels login process before finishing
added option to exclude client secret when fetching token, (some users have had errors regarding this)

@felixsouthworks Thanks for your update. I have no longer maintained this project but will notify people Sheda to have a look at this PR.


Fix uninitialized variable m_QuickstartGen

I noticed this on an x64 build on VS 2017 15.9.8
I also re-ordered the variables so that it's easier to spot an uninitialized one.

I think this PR should be accepted. I had to manually apply it some days ago because I ran into the same issue.

Sorry for slow response. This was lost in my feed!


support for belongs_to with custom source

Leverages Ecto.Schema reflection to match the source/alias:

__schema__(:field_source, field) - Returns the alias of the given field;

fixes #4

@sax @eahanson Please take a look when y'all can 🙏


LFS-283: The form's save button is slightly shifted to the right

Nicer fix using "sticky" positioning which allows the button to scroll up with its container when positioned at the bottom of the container.
Upon reviewing the request, please evaluate if the support for sticky can be considered satisfactory: https://caniuse.com/#feat=css-sticky

The reason why it doesn't work is the overflow:auto set on mainPanel. Removing that property doesn't seem to have any negative effects, but it also doesn't fully fix the button, which is now stuck on the left.


.get() resolves and returns null

Hi
I explicitly "remove" the variable "user" from Storage, but .get still return a resolved Promise, with value = null.
Can you help please ?
Thanks
           this.storage.ready().then(() => {
		return this.storage.remove('user').then( () => {
			return this.storage.get('user');
		})
	})
	.then(val => {
		console.log("user is in Storage:", val);
		this.splashScreen.hide();
	})
	.catch(e =>  {
		//we don't have the user data so we will ask him to log in
		this.nav.push(LoginPage);
		this.splashScreen.hide();
	});

in the console.log:  user is in Storage: null.
$ ionic info
Your system information:
Cordova CLI: 6.5.0
Ionic Framework Version: 2.2.0
Ionic CLI Version: 2.2.1
Ionic App Lib Version: 2.2.0
Ionic App Scripts Version: 1.1.4
ios-deploy version: Not installed
ios-sim version: Not installed
OS: Linux 4.4
Node Version: v7.4.0
Xcode version: Not installed
$ npm list | grep "storage"
├─┬<EMAIL_ADDRESS>│ ├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>

Ionic Storage is using localForage as far as I know. According to the api docs at https://localforage.github.io/localForage/#data-api-getitem the behaviour is correct.
getItem:

Gets an item from the storage library and supplies the result to a callback. If the key does not exist, getItem() will return null.

Yes indeed you're right!
Thank you


cli prover-id  not generate    and  not copy prover  on web

cli prover-id  not generate    and  not copy prover  on web

open Console and run this one to get it:
localStorage.getItem('flutter.proverId');

console.log(localStorage.getItem('flutter.proverId'));


fix(gha): prevent gha from running on forks

Fixes https://github.com/awslabs/cdk8s/issues/76
Only runs release scripts if on the awslabs/cdk8s repository.
Signed-off-by: campionfellin<EMAIL_ADDRESS>By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

Can you change the title to “chore” so it won’t appear in the change log?


feature TabContainer option: tab position top/bottom

Issue description (what happened, and what was expected):
I cont create a tab container where the tabs are listed at the bottom so I have to programm one by myself. (HBottonarray and a script...)
missing feature
there should be an option in the tabContainer Node that lets me choose if I want to have the tab at the bottom or at the top. (Like the option tab align: left/right/center or: tab visible true/false)

Feature and improvement proposals for the Godot Engine are now being discussed and reviewed in a dedicated Godot Improvement Proposals (GIP) (godotengine/godot-proposals) issue tracker. The GIP tracker has a detailed issue template designed so that proposals include all the relevant information to start a productive discussion and help the community assess the validity of the proposal for the engine.
The main (godotengine/godot) tracker is now solely dedicated to bug reports and Pull Requests, enabling contributors to have a better focus on bug fixing work. Therefore, we are now closing all older feature proposals on the main issue tracker.
If you are interested in this feature proposal, please open a new proposal on the GIP tracker following the given issue template (after checking that it doesn't exist already). Be sure to reference this closed issue if it includes any relevant discussion (which you are also encouraged to summarize in the new proposal). Thanks in advance!


GEODE-5424: Changing all awaitility calls to use consistent timings

We have a lot of Awaitility calls in our tests. Each test was picking
its own timeout. That lead to some tests picking too small of a timeout
and failing spuriously.
With this change, all tests will use a new factory,
GeodeAwaility.await(), rather than Awaitility.await(). This new factory
sets a default timeout of 5 minutes. It also sets a sensible pollDelay
and pollInterval.
The custom timeouts used in all tests have been removed, in favor of
this new factory, except for a couple of tests that had waits greater
than 5 minutes.
Thank you for submitting a contribution to Apache Geode.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[ ] Is there a JIRA ticket associated with this PR? Is it referenced in the commit message?

[ ] Has your PR been rebased against the latest commit within the target branch (typically develop)?

[ ] Is your initial contribution a single, squashed commit?

[ ] Does gradlew build run cleanly?

[ ] Have you written or updated unit tests to verify your changes?

[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?

Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and
submit an update to your PR as soon as possible. If you need help, please send an
email to<EMAIL_ADDRESS>

+1 to use GeodeAwaitility to impose a new set of defaults.

With the introduction of GeodeAwaitility, should there be a static analysis rule that checks for use of raw Awaitility in other places? How do we help people do the right thing in their tests?

@dhemery


helm upgrade error in release pipeline - Java x Spring x AKS

The below error was happened in release pipeline (not build pipeline, build was passed).

[error]Error: invalid argument "900s" for "--timeout" flag: strconv.ParseInt: parsing "900s": invalid syntax

It seems very simple fix but I couldn't find the release pipeline definition in this repository so I can't find out how to fix by myself.
situation

DevOps Project choice: Java x Spring x AKS 1.15.5 (it reproduced with 1.15.7 as well)

I didn't check other versions for example 1.14.x, 1.13.x.

error detail
2020-02-19T11:01:13.7824445Z ##[section]Starting: Helm upgrade
2020-02-19T11:01:13.7831737Z ==============================================================================
2020-02-19T11:01:13.7831852Z Task         : Package and deploy Helm charts
2020-02-19T11:01:13.7832010Z Description  : Deploy, configure, update a Kubernetes cluster in Azure Container Service by running helm commands
2020-02-19T11:01:13.7832129Z Version      : 0.164.3
2020-02-19T11:01:13.7832251Z Author       : Microsoft Corporation
2020-02-19T11:01:13.7832346Z Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/deploy/helm-deploy
2020-02-19T11:01:13.7832493Z ==============================================================================
2020-02-19T11:01:15.6991427Z [command]/opt/hostedtoolcache/helm/2.16.3/x64/linux-amd64/helm upgrade --namespace devd123 --install --force --wait --set image.repository=****.azurecr.io/**** --set image.tag=159 --set applicationInsights.InstrumentationKey=**** --set imagePullSecrets={****} --timeout 900s azuredevops /home/vsts/work/r1/a/Drop/drop/sampleapp-v0.2.0.tgz
2020-02-19T11:01:15.7666863Z Error: invalid argument "900s" for "--timeout" flag: strconv.ParseInt: parsing "900s": invalid syntax
2020-02-19T11:01:15.7777325Z ##[error]Error: invalid argument "900s" for "--timeout" flag: strconv.ParseInt: parsing "900s": invalid syntax

2020-02-19T11:01:15.7789358Z ##[section]Finishing: Helm upgrade

Thanks for reporting the issue. The issue occurred due to helm install task is installing 2.16.3 version instead of 3.x, which is caused due to API provided by helm is returning latest version as 2.16.3 instead of 3.x.
The workaround for this issue is to uncheck the download latest helm checkbox in helm install task. This will install 3.0.2 helm version and you also don't need to make 900s change.

@vineetmimrot It worked. Thank you!


dotnetcore web app and blazorwasm client side together

which one of the following scenarios I am able to implement?
publishing blazorwasm client-side into exe file( instead of using IIS or apache or Nginx) so I can run it as a windows service
OR
Embedding a dot net core app and blazorwasm client-side (not server side which I know about it already) into the same project
Any idea ???

publishing blazorwasm client-side into exe  => instead of using IIS or apache or Nginx !!!

Thanks, fo comment.
In the client-side blazor, we have to register App.razor using "app.AddComponent("app");" in the startup file which means we have to inject IComponentApplicationBuilder which we don't have this interface in the dot net core web applications. I have tried to import blazor dependencies in the project file. which leads to a conflict between blazor and aspnetcore dependencies.
As you said, I can go for option 2 and load .razor pages inside .cshtml pages. but by doing so, then _ won't have blazorwasm routing(e.g. I have to use asp routing) which means it's not SPA anymore..
What I really like to have is to be able to host boazorwasm in the windows services (the same as aspnetcore web application)by executing as exe file instead of using apache or IIS.
Do you think I am able to do that?

@alikarooni that is possible by setting up the hosted app as a windows service.
Create a Blazor hosted app and follow the steps in here:
https://docs.microsoft.com/en-us/aspnet/core/host-and-deploy/windows-service?view=aspnetcore-3.0&tabs=visual-studio

I have looked at it already.
I am going to describe the situation a bit in more detail if you bare with me.
first, Check this out https://hackernoon.com/aspnet-core-blazor-hosting-models-2c35330qz.
This guy explains all possible types of blazor. There is NO way to create a windows server to host blazorwasm client-side, the same way that we can create dotnetcore application in the link you have provided (just client side. No signal-R connection. No server-side blazor. something the same as react). I am talking about Razor Components and App.razor. not .cshtml, who can host .razor pages and not server-side blazor.

I also create a blazorwasm project template and have put these lines :
3.0
Exe
preview
true
into the project file. As you can predict, no exe file would create.

https://docs.microsoft.com/en-us/dotnet/core/whats-new/dotnet-core-3-0#single-file-executables
The link that you have sent to me just works for .netcoreapp. but when you run "dotnet new blazorwasm" the template framework is netstandard2.0.
that's why it raises an error while publishing. and that's why I said you cannot make an .exe file from blazorwasm client-side.
Do you have any more idea?

After all, this could help a bit.
dotnet new blazorwasm -ho and publish single-file executable for the host is the closest you are going to get. You need an HTTP server to serve the files.
You can run the web app as a windows service. See https://docs.microsoft.com/en-us/aspnet/core/host-and-deploy/windows-service?view=aspnetcore-3.0&tabs=visual-studio
I've read somewhere that blasorwasm is kind of in-process (the same as all .netcore3.0) and that's why you can only create a template using CLI and it is not in the visual studio new project dialog yet, but I think they would implement the part to creating an exe file from blasorwasm client-side without any requirement of combination, or I think they should think about implementing it.


Use IPs instead of localhost for nodetool commands

ONLY for scylla instances
reiteration of https://github.com/scylladb/scylla-ccm/pull/170
but now with cassandra instances in mind

@bhalevy @fruch what tests should I run locally so you would accept this patch?
I guess if I won't break anything, this patch will be allowed, or are there more conditions?

@bhalevy @fruch what tests should I run locally so you would accept this patch?
I guess if I won't break anything, this patch will be allowed, or are there more conditions?

@tarzanek you can run CASSANDRA_DIR=../scylla/build/dev NOSE_PROCESSES=1 nosetests -s -v --process-timeout=1800 migration_test:TTLWithMigrate.big_table_with_ttls_test nodetool_additional_test:TestNodetool.cfstats_test

Benny @bhalevy  check https://github.com/scylladb/scylla-ccm/issues/174
I already run that, that works with this patch :-)

% bg:0 Wed Sep 18,14:47 taz@tublat:~/git/_dtest_clean/scylla-dtest
➜  scylla-dtest git:(next) CASSANDRA_DIR=../scylla/build/release NOSE_PROCESSES=1 nosetests -s -v --process-timeout=1800 migration_test:TTLWithMigrate.big_table_with_ttls_test nodetool_addit
ional_test:TestNodetool.cfstats_test
running
['/home/taz/.dtest/dtest-plAuqY/test/node1/data/ks/cf-a3c69dc0da1211e98e25000000000000/mc-33-big-Data.db']
-- mc-33-big-Data.db -----

(EE)  (EE)  [node1 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/taz/.ccm/repository/3.11.3/logs/gc.log due to No such file or directory
[node3 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/taz/.ccm/repository/3.11.3/logs/gc.log due to No such file or directory
[node2 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/taz/.ccm/repository/3.11.3/logs/gc.log due to No such file or directory
[node4 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/taz/.ccm/repository/3.11.3/logs/gc.log due to No such file or directory
(EE)  running
['/home/taz/.dtest/dtest-EpoLuu/test/node1/data/ks/cf-01037b70da1311e9bea87b2996a7d701/mc-1-big-Data.db', '/home/taz/.dtest/dtest-EpoLuu/test/node1/data/ks/cf-01037b70da1311e9bea87b2996a7d70
1/mc-2-big-Data.db']
-- mc-1-big-Data.db -----
Cannot find file /home/taz/.dtest/dtest-EpoLuu/test/node1/data/ks/cf-01037b70da1311e9bea87b2996a7d701/mc-1-big-Data.db

-- mc-2-big-Data.db -----

big_table_with_ttls_test (migration_test.TTLWithMigrate) ... ok
cfstats_test (nodetool_additional_test.TestNodetool) ... ok

----------------------------------------------------------------------
Ran 2 tests in 344.366s

OK

works with this same patch

Note that scylladb/scylla-dtest#1110 adds big_table_with_ttls_test to next-gating tests


CUDA error when training with fused-SSIM after 1000 iterations.

loss=0.279| sh degree=1| depth loss=0.022742| :   3%|████▋                                                                                | 1022/30000 [01:24<40:07, 12.04it/s]
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/app/cache/gsplat/examples/simple_trainer.py", line 990, in
cli(main, cfg, verbose=True)
File "/usr/local/lib/python3.10/dist-packages/gsplat/distributed.py", line 360, in cli
return _distributed_worker(0, 1, fn=fn, args=args)
File "/usr/local/lib/python3.10/dist-packages/gsplat/distributed.py", line 295, in _distributed_worker
fn(local_rank, world_rank, world_size, args)
File "/app/cache/gsplat/examples/simple_trainer.py", line 935, in main
runner.train()
File "/app/cache/gsplat/examples/simple_trainer.py", line 556, in train
ssimloss = 1.0 - fused_ssim(
File "/usr/local/lib/python3.10/dist-packages/fused_ssim/init.py", line 41, in fused_ssim
return map.mean()
RuntimeError: CUDA error: an illegal memory access was encountered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

cc @rahul-goel

Hi.
Looks like this is distributed training setting. I've not tested this in such a setting due the lack of proper access to multiple GPUs. @zhj296409022 Does this work fine with a single GPU in your environment? Can you let us know? This will help us confirm this suspicion.
@liruilong940607 It is probably best to turn of fused-ssim for multi-GPU for now if this is the case. I haven't looked at how multi-GPU in gsplat is working and I'm not confident about fused-ssim working in such a setting yet.
Rahul

Ha right! I think you just need to guard the device in cuda kernels of fused-ssim (like what we do in gsplat), then it should be able to work nicely for the multi GPU case.
https://github.com/nerfstudio-project/gsplat/blob/2d6a967f92187daaa19f198613a7309e4d1a00dc/gsplat/cuda/csrc/fully_fused_projection_2dgs_bwd.cu#L170
I would be happy to PR it to fused-ssim and test it out over the weekend, if this hasn't been solved by then.

sorry for the late reply. This is related to the CUDA device ID. I encountered an error when running with cuda:1, while cuda:0 works fine. I haven't checked the code; is it possible that it's not adapted?

@liruilong940607 I'll wait for your PR to fused-ssim and then you can bump the commit it up here. I would do it myself but can't due to limited compute.

Fused-SSIM has added the guard; thanks to @liruilong940607. Please feel free to bump up the version here.


support for download via proxy

If you're trying to install behind a (corp) proxy, the http client doesn't attempt to make the connection via the users HTTP(S)_PROXY envvar.
I have a patch ready if this would be useful.
Only caveat is that the URL in the HTTP_PROXY envvar begins with a protocol e.g. HTTP_PROXY=http://localhost:3128. HTTP_PROXY=localhost:3128 wont work, due to limitations in Node's url parsing function.

Is this merged? My module can't complete downloading(version 0.0.9).

it was closed, not merged.


Add Support for STM32L562E-DK Discovery

The patches add support for the STM32L562E-DK Discovery board, including the support for the STM32L562QE SoC.

LGTM but please squash the fix commits:
as we're using fast-forward merges (all your commits are put on top of master branch), so we expect only cleans commits.

The fixes have been squashed into their original commits. Please help to review if I did it correctly. Thanks.


[Story] Build and publish Sage Monorepo Docs with MkDocs Material

What projects is this story for?
No response
As a user, I want
As a Developer, I want the documentation of this monorepo to be visible and accessible so that I can quickly locate the information I need.
Description
In #1735, we have identified that we want to publish the Sage Monorepo docs in Markdown format with MkDocs/MkDocs Material.
The goal of this story is to create a GitHub workflow that builds and publish the Markdown files with MkDocs to GitHub Pages. The files to consider are:

docs/*.md
apps/**/README.md
libs/**/README.md
README.md

An example of GitHub workflow is provided by the Trivy project here:

https://github.com/aquasecurity/trivy/tree/main/docs
https://github.com/aquasecurity/trivy/blob/main/.github/workflows/test-docs.yaml
https://github.com/aquasecurity/trivy/blob/main/.github/workflows/mkdocs-dev.yaml
https://github.com/aquasecurity/trivy/blob/main/.github/workflows/mkdocs-latest.yaml

Acceptance criteria

The Markdown files are visible on GitHub Pages

Tasks
No response
Anything else?
No response
Have you linked this story to a GitHub Project?

[X] I have linked this story to a GitHub Project and set its metadata.

Tentatively assigning to Verena

Resolved with #2409


WorldWind extent calculations need to be improved

The extent being used in the render calculations will sometimes be too small resulting in clipped graphics when they should not be


CB-14839 suites_log and integcb/logs should be compress to save space

to have longer te4st result retention time

retest this please!

retest this please!


Resolution date and sometimes scores not showing properly for resolved subquestions

Desired behavior: When a subquestion (i.e. choice) in a group question is resolved, should show that subquestion's resolution date.
The resolution date and sometimes scores for resolved subquestions don't seem to be showing properly, see the video. I just resolved this group question, using different resolution dates for many of the subquestions, and clicking through it shows below it "October 12, 2024" for all subquestions, though I don't think I used that date for any of them. That's the originally scheduled close date.
Additionally, as I click through, two of the subquestions don't show scores for the community at all.
Note that I did have to un-resolve and re-resolve some of these to enter the right "date resolution was known", which I initially hadn't entered properly. Unclear if that's contributing.
https://github.com/user-attachments/assets/f80fdc03-c0e6-465d-9bde-8df50b1c8902

The issue with resolution dates is ready for testing on dev.
Regarding the second one, it seems to be BE-related, as there is no data returned in the aggregation array, which results in missing scores section. @lsabor would you have a chance to take a look?

Fixed manually! Just had to re-score them.
Closing accordingly


add a user profile retrieval endpoint

related to #265

looks like this is resolved.
see e.g. curl https://sola.acdh-dev.oeaw.ac.at/apis/api/users/ | jq


Disable coverage report on PyPy tests job

PyPy tests job takes 17-18 minutes with coverage, and just 4 minutes without it. Since we don't have any PyPy specific tests, and due to slowness let's disable the coverage report for this job to avoid wasting CI time.
Refs: https://github.com/jazzband/pip-tools/pull/1967#discussion_r1298907385

Thanks @theryanwalker!


Improve Chinese translation，and make help frame display utf-8 text

That won't work unfortunately.
Can you try to replace resource/font/font.ttf with a Chinese font instead? That should work properly and we can then include that font in the bundle.

Not work? 😂
Yes, I can replace font, it is work. but the Chinese font a little big. (10MB)

Which font did you have in mind? I tried a few but they didn't work...

I am using this font -> SimSun.
Are you testing Chinese? Or test English?
This code is work in my Chinese environment.

Does this code make it impossible to run?
if yes, Then give up this code.

My English is not so good . please forgive me.

Yes, You fixed it. It works.


Vector support

Hi, I have started to play with Crystal. For now, I'm trying to migrate some scripts I had in ruby with some algorithms implementations (about all ML algorithms). I could migrate some matrices using this library, but I couldn't find support for Vector class in Crystal and neither crystalla.
http://ruby-doc.org/stdlib-2.2.1/libdoc/matrix/rdoc/Vector.html
Can you help me? I am willing to contribute with these kind of libraries when I have enough knowledge and experience with Crystal , I think it has an enormous potential for Data Science, and I eventually want to use it in some real data oriented projects 😄

Hi! I'll be glad to help you, but I'd rather not just port Vector from Ruby's stdlib. When starting Crystalla, I was trying to borrow ideas and APIs mainly from Matlab and Numpy, which I think are much more mature  for this particular domain.
So a couple of goals for Crystalla would be:

Provide bindings for LAPACK and BLAS, with idiomatic Crystal APIs on top of them, but without sacrificing performance (which may mean you'll need to keep in mind their choices on memory layout).

Try to find a sweet spot between Matlab, Octave, R, Numpy and Crystal itself in terms of API.

I guess a resulting non-goal is: to support existing Ruby scripts out of the box.
It's a bit analogous to one of Crystal's own goals: "Have a syntax similar to Ruby (but compatibility with it is not a goal)".
Let's do this, if you are still on board with that direction, why don't you share one of the Ruby code snippets you're trying to port here? We can explore together organic ways of extending Crystalla to provide all the necessary features.
WDYT?

Sure, thanks for your response. Here's a simple sample of k-Nearest Neighbors using vectors to represent coordinate minutes, and there are others applications for Vector class, but I totally understood what you said, I will take a look to Matlab and numpy implementations/alternatives for some libs and try to figure out how to work on a similar API in Crystal.
require "matrix"

class HouseValidator

  def initialize(data, position)
    @data = data
    @position = position
  end

  def find_nearest
    @data.sort_by {|point,v|
      distance(point, @position)
    }.first
  end

  def find_nearest_with_k k
    @data.sort_by {|point, v|
      distance(point, @position)
    }.first(k)
  end

  private

  def distance v1, v2
    (v1 - v2).magnitude
  end

end

# Distance in minutes for lng and lat
neighborhoods_data = {
  Vector[56, 13] => "Safe",
  Vector[23, 9] => "Unsafe",
  Vector[45, 28] => "Safe",
  Vector[12, 3] => "Unsafe",
  Vector[15, 7] => "Unsafe",
  Vector[7, 3] => "Unsafe",
  Vector[49, 31] => "Safe"
}

house_1 = Vector[10, 10]
house_2 = Vector[40,20]
house_3 = Vector[32,10]

h1 = HouseValidator.new(neighborhoods_data, house_1)
p h1.find_nearest

h2 = HouseValidator.new(neighborhoods_data, house_2)
p h2.find_nearest

h2 = HouseValidator.new(neighborhoods_data, house_3)
p h2.find_nearest

Thanks for sharing! Actually, we don't have a Vector abstraction but we do have some convenience methods to create row and column vectors in Matrix. For example, see:
https://github.com/mverzilli/crystalla/blob/master/spec/matrix_spec.cr#L71
That spec file should provide a lot of hints on what's currently possible with the lib.
Also, it seems you're only using two Vector operations: subtraction and "magnitude". I don't have time to test it right now, but I think my first attempt would be to:

Replace Vector constructors like Vector[32,10] with Matrix.row_vector(32,10).
Subtraction should work out of the box, so no prob there.
Implement "magnitude" as an auxiliary function that receives a Matrix right there on the script.
Check results.

If that works, the only pending issue would be to decide how to implement "magnitude". Maybe we could add a "norm" method to Matrix... I think the norm of a vector is just a special case of the norm of a matrix (but I should revisit my Linear Algebra bibliography :P).

This seems to exhibit the same behaviour as your script:
require "crystalla"
include Crystalla

class HouseValidator
  def initialize(data : Hash(Matrix, String), position : Matrix)
    @data = data
    @position = position
  end

  def find_nearest
    point, v, distance = @data.map { |point, v| {point, v, distance(point, @position)} }
                              .sort_by { |(point, v, distance)| distance }.first
    {point, v}
  end

  private def norm(m : Matrix)
    raise "norm is only defined for row vectors" unless m.row_vector?

    square_norm = 0
    m.each_row do |r|
      square_norm = r.map { |x| x * x }.sum
    end

    Math.sqrt(square_norm)
  end

  private def distance(v1, v2)
    norm(v1 - v2)
  end
end

# Distance in minutes for lng and lat
neighborhoods_data = {
  Matrix.row_vector [56, 13] => "Safe",
  Matrix.row_vector [23, 9]  => "Unsafe",
  Matrix.row_vector [45, 28] => "Safe",
  Matrix.row_vector [12, 3]  => "Unsafe",
  Matrix.row_vector [15, 7]  => "Unsafe",
  Matrix.row_vector [7, 3]   => "Unsafe",
  Matrix.row_vector [49, 31] => "Safe",
}

house_1 = Matrix.row_vector [10, 10]
house_2 = Matrix.row_vector [40, 20]
house_3 = Matrix.row_vector [32, 10]

h1 = HouseValidator.new(neighborhoods_data, house_1)
p h1.find_nearest

h2 = HouseValidator.new(neighborhoods_data, house_2)
p h2.find_nearest

h2 = HouseValidator.new(neighborhoods_data, house_3)
p h2.find_nearest

Note the implementation of norm is far from elegant :P. I guess that's because we lack an Enumerable implementation over rows or cols... We'll need to think about that and seek some inspiration from Numpy :)

I guess sooner than later we'll need to implement something like Numpy's n-dimensional array. Being able to operate with matrices and slice them into submatrices (as you generally would in Matlab) is really nice, but it's kind of limited to 2-dimensional matrices. Typical ML libs and algorithms need to work in n-dimensional structures, so matrices will only get us so far. I guess it's time to roll up our sleeves and take Crystalla in that direction!

Wow, thank you @mverzilli. Now I have a crystal version running and a better idea about how to migrate other scripts from ruby to crystal 🎆
time ruby ~/vector_sample.rb
0.07s user 0.05s system 52% cpu 0.240 total
time ./vector_sample
0.00s user 0.00s system 76% cpu 0.006 total
I'm falling in love with Crystal and the community 😃  and I want contribute in the future to this library and crystal itself. For now I am going to report any problem during some experiments while migrating more advanced algorithms, and take a closer look to Numpy and Matlab for ideas.
What would you recommend me to read, do or take a look, to be able to contribute in the future? Do you have a kind of roadmap for crystalla?
Thanks!

Hey, thanks for the kind words! I started Crystalla because I'm a pathological procrastinator. I had decided to follow this tutorial: http://deeplearning.stanford.edu/tutorial/, but when I started it I said "you know what, it'd be nice if you could do all the exercises in pure Crystal, so I'll take my time and try to implement what's necessary". And the first obvious need was to have a nice and efficient implementation of matrices.
@spalladino, another guy from Manas, suggested that we used LAPACK and BLAS so I wrote the bindings and some basic operations. Then we benchmarked against Numpy and we got these results: http://manas.com.ar/blog/2015/10/30/linear-algebra-in-crystal-from-lapack.html. It turned out to be a good
idea!
As you can see, there's no roadmap. When I have some spare time and the mental energy to program, I go back to the tutorial and check what's the next thing to implement in Crystal, and just do that.
I guess one interesting next step would be to port all the functionality we already have in Matrix to an n-dimensional array implementation

That said, definitely keep on bringing roadblocks and concrete use cases! It's a lot nicer to shape the library based on real world problems.

This is super relevant to understand some of the implications of using LAPACK et al: https://scottlocklin.wordpress.com/2016/05/26/numeric-linear-algebra-code-an-appreciation/

That said, definitely keep on bringing roadblocks and concrete use cases! It's a lot nicer to shape the library based on real world problems.

Absolutely! I'd suggest trying to pick a problem at a time, and implement the required functionality to support it. MNIST using PCA was my first (and only, so far) test subject, but it could be interesting to pick other solutions and implement them as well.

@g3ortega Not sure if you're still interested, but a quick update on this: @MatthiasRMS is working on an initial NdArray implementation. We're discussing the details here: https://github.com/mverzilli/crystalla/pull/15
Feel free to chip in!

Hi!  Is work on this package continuing, or is there a replacement package?  Thanks!

Hi! At the moment I'm not putting time into this. You can check the discussions here to get some candidate replacements: https://github.com/crystal-community/crystal-libraries-needed/issues/15


Log warning

Kopf is logging a warning message whenever a controller makes a status change. The message says "Paching failed with inconsistencies".
This warning does not interfere with the operation of the operator, but it would be good to understand the cause of this message and correct this problem.

This problem was fixed in the new release of kopf issue


Improve the fixRmSmallIncreasedQOffers amendment

This amendment fixes edge cases missed by its predecessor by increasing its threshold for IOU -> XRP offers.
https://github.com/XRPLF/XRPL-Standards/discussions/74
High Level Overview of Change
This amendment introduces a new method called minFundedOfferAmount on both XRPAmount and IOUAmount. This method returns the newly elevated threshold for the fixRmSmallIncreasedQOffers logic.
Type of Change

[x] Bug fix
[x] Breaking change

Test Plan
An automated test script can be found at https://github.com/Mwni/xrpl-tests/tree/master/small-offers-quality. Ideally, this should be ran against a validator with, and without this amendment.

Thanks for the contribution! I have some issues/thoughts with this and I am going to be thoroughly reviewing this in the next couple of days. Apologies for the long delay.

Hi Manuel,
Can you please fix clang-format and change default vote to no?


Add another "timestamp" attribute to the execution object when represents a time execution has been started

Right now we have start_timestamp which is set when an execution is scheduled (aka requested by the API or other service) and stop_timestamp which is set by the runner container when execution finishes.
There could be a delay (for whatever reason) between when execution is scheduled (start_timestamp) and when it actually starts being executed by the runner. We should add another timestamp attribute to the ActionExecutionDB model (dunno, execution_start_timestamp or similar, but ideally we would probably rename existing start_timestamp to scheduled_timestamp, but this is a bit of a painful change) which indicates a timestamp when action execution has been started by the runner.
Originally reported by Sayli K. on Slack.

I cannot help but agree with @enykeev. We need some sort of audit-trail of activities on a single execution.

I agree, ideally we would log all the state transitions and events related to executions.
We already kinda do that in the logs, but it's not really in a consistent and structured format and that makes it hard to use and query.
In any case, I think this additional timestamp would still be beneficial, even if we had this even stream, or whatever we want to call it.

Note that we change status to running when we dispatch it to MQ [1] and there is really no limit on how long it might be there before it gets picked up by the worker. Also note that the way st2 is designed, worker has a pretty decent chance to be running on the different machine with local time being skewed one way or the other.
So where exactly do we want to sample this execution_timestamp for it to be useful for debugging purposes? On dispatch, on worker run or on both? Do we want to start solving the problem if we're pretty much agree we can't solve it good enough without per-execution event log?

Do we want to start solving the problem if we're pretty much agree we can't solve it good enough without per-execution event log?

We can punt it but I am pretty sure we won't work on event log in next few months. I'd rather have a timestamp now and build event log later. As far as where you should start ticking the time for running, it looks like we actually have a bug that we set status to running even before dispatching. So I think we need a new state dispatched. This is anyways needed and the right thing to do. We should mark the action as running when the worker picked it up. I know this is more work but I don't think it's a week of work. Thoughts everyone?

This has been resolved by #2718, closing.