KAFKA-9362: Missing GC logs when running Kafka with Java 11 with OpenJ9 VM

Modified bin/kafka-run-class.sh to use Java 8-like way of enabling GC logs when using a Java version based on OpenJ9 JVM, because this JVM does not support JEP 158 new options for GC logging.
To test the change, I ran the Quickstart with various types of Java:

ORACLE Java 8
AdoptOpenJDK8 with HotSpot
AdoptOpenJDK11 with HotSpot
AdoptOpenJDK8 with OpenJ9
AdoptOpenJDK11 with OpenJ9

Without this PR, running Quickstart with AdoptOpenJDK11 with OpenJ9 led to JVMJ9VM085W  errors in Zookeeper and in Kafka server output, and no GC logs were generated. With this PR, there are no more OpenJ9 errors and GC logs are produced as expected.
Also ran the graddle tests just for non-reg.

Thank you for your contribution. I verified this patch with Ubuntu 18.04 + openjdk-11-jdk, but it seems like it does not work in this case.

It seems like we need to refine java version detection logic.

Could you wait a little bit? I have a little parser script for this task. As soon as I refine it, I will notify you - for you can include it in your PR. :smiley:

@dongjinleekr, isn't your Ubuntu 18.04 + openjdk-11-jdk  setup based on an HotSpot type of VM instead of an OpenJ9 one?
As far as I known, only OpenJ9 VMs show "J9" as part of the output of their java -version command...
What exactly does not work on your setup with my PR ? do you see the JVMJ9VM085W  error in Zookeeper and/or in Kafka server output ?

Thanks @avermeer for the PR.
It's worth noting the OpenJ9 team have said they are not planning to implement JEP 158 at the moment: https://github.com/eclipse/openj9/issues/3999#issuecomment-447207173

@avermeer OMG, I'm sorry. I misunderstood that the problem is also applied to other Java 9 distributions.

Is this the only issue affecting J9? We use a number of other flags that are HotSpot specific like G1GC, MaxInlineLevel (recent addition), etc. Does J9 ignore them?

@ijuma there is potentially other issues affecting the use of Apache Kafka with OpenJ9.
The scope of this PR is to specifically solve the missing GC logs one.
This will allow me to have some insights on how to adapt (if needed) other options.
Hope it is clear,
Alexandre

@avermeer You can run with the changes in this PR to get such insights right now, correct?

@ijuma I will need more time to investigate which specific OpenJ9 GC configurations options are needed, this is why I propose to decorrelate this PR and its JIRA ticket from this upcomping investigation.
I will be happy to fill in a new JIRA and share my OpenJ9 JVM setting once done.
BTW, can this PR be merged, so that this modest contribution will be part of next Kafka releases?


Add ObserveAny

/fix:refcache

/fix:refcache

Oh, this needs to be rebased before it can use the updated /fix:refcache functionality.

Nope, my bad for not fixing the right action 🤷🏼♂. Here goes another try:
/fix:refcache

/fix:refcache

Well, the /fix:refcache job succeeded: https://github.com/open-telemetry/opentelemetry.io/actions/runs/5835447937/job/15827024654
The push didn't work. I think that it's because we need to force push in some cases. I'll try that next.
Apologies for the comment "noise" @heyanlong as I try to get one of your actions to work.

Nope: I can't even manually make updates to this PR. @heyanlong - you'll need to rebase this PR, and if possible, update the refcache file: locally run npm run check:links and commit the updated file. Thanks!

@heyanlong I think you'll need to to git rebase main && git push -f this branch. Unfortunately your branch is considered "out of date", even though your changes are compatible. Sorry for the headache.


⚠ Bofrost.at has degraded performance

In c1d6d39, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2397 ms

Resolved: Bofrost.at performance has improved in 4cde9c2.


New version: TeamViewer.TeamViewer version 15.35.9

- [X] Have you signed the Contributor License Agreement?

[X] Have you checked that there aren't other open pull requests for the same manifest update/change?

[ ] Have you tested your manifest locally with winget install --manifest <path>?
[X] Does your manifest conform to the 1.2 schema?

Microsoft Reviewers: Open in CodeFlow

@msftbot run

@wingetbot run


chore: Remove endomorphism coefficient from ecc_add_gate

Resolves #2608
Checklist:
Remove the checklist to signal you've completed it. Enable auto-merge if the PR is ready to merge.

[ ] If the pull request requires a cryptography review (e.g. cryptographic algorithm implementations) I have added the 'crypto' tag.
[ ] I have reviewed my diff in github, line by line and removed unexpected formatting changes, testing logs, or commented-out code.
[ ] Every change is related to the PR description.
[ ] I have linked this pull request to relevant issues (if any exist).

Benchmark results
Metrics with a significant change:

note_trial_decrypting_time_in_ms (8): 5.00 (-95%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit 6c20b459 and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
128 txs

l1_rollup_calldata_size_in_bytes
45,444
179,588
716,132

l1_rollup_calldata_gas
222,960
868,232
3,449,312

l1_rollup_execution_gas
842,047
3,595,340
22,204,681

l2_block_processing_time_in_ms
2,007 (-1%)
7,622 (+2%)
29,759 (+1%)

note_successful_decrypting_time_in_ms
303 (+2%)
874 (+2%)
3,183 (+1%)

note_trial_decrypting_time_in_ms
:warning: 5.00 (-95%)
81.0 (+19%)
135 (+1%)

l2_block_building_time_in_ms
13,193
52,430 (+1%)
209,397 (+1%)

l2_block_rollup_simulation_time_in_ms
11,870
47,162 (+1%)
188,005

l2_block_public_tx_process_time_in_ms
1,284 (+1%)
5,139 (+1%)
20,899 (+2%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
21,287 (-1%)
41,665 (-1%)

note_history_successful_decrypting_time_in_ms
2,007
3,938 (+1%)

note_history_trial_decrypting_time_in_ms
120 (-2%)
142 (-1%)

node_database_size_in_bytes
1,628,127
1,095,750

pxe_database_size_in_bytes
27,188
54,187

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
72.5 (+1%)
61,697
18,841

private-kernel-ordering
43.4 (-1%)
24,233
8,089

base-rollup
1,769
656,309
811

root-rollup
80.0 (+3%)
4,072
1,097

private-kernel-inner
53.1
81,504
18,841

public-kernel-private-input
41.7 (+1%)
41,455
18,841

public-kernel-non-first-iteration
26.7 (+1%)
41,497
18,841

merge-rollup
0.884
2,592
873

Miscellaneous
Transaction sizes based on how many contracts are deployed in the tx.

Metric
0 deployed contracts
1 deployed contracts

tx_size_in_bytes
8,723
27,240


Hashing Vector2i often results in a hash collision

Godot version
v4.0.dev.custom_build [60eb508fb]
System information
Arch Linux
Issue description
Hashing Vector2i often results in a hash collision. Does not happen with Vector2.
For example:
print(hash(Vector2i(0, 33))) prints 5859942
print(hash(Vector2i(1, 0))) prints 5859942
Steps to reproduce
extends Node2D

var dict := {}

func _ready():

	for x in 100:
		for y in 100:
			var vec2i := Vector2i(x, y)
			var vec2i_hash := hash(vec2i)
			if dict.has(vec2i_hash):
				dict[vec2i_hash].append(vec2i)
			else:
				dict[vec2i_hash] = [vec2i]

	for key in dict:
		var value: Array = dict[key]
		if len(value) > 1 :
			print('Vector2i %s have same hash() -> %s' % [value, key])

Minimal reproduction project
hash_vector2i.zip

Godot uses djb2:
hash = ((hash << 5) + hash) + c; /* hash * 33 + c */
So (0, n*33) will collide with (n, 0)
A fix would be use djb2a which doesn't have this issue:
hash = ((hash << 5) + hash) ^ c; /* hash * 33 ^ c */
I prefer FNV-1a, as it seems to have a better random distribution. But that is subjective.

Changing the vector hash may break compatibility with existing projects in subtle ways. I suppose we can still do this in 3.4, we have to duly note it in the changelog.

A fix would be use djb2a which doesn't have this issue:
hash = ((hash << 5) + hash) ^ c; /* hash * 33 ^ c */

Feel free to open a pull request to use djb2a :slightly_smiling_face:

Steps to reproduce
extends Node2D

var dict := {}

func _ready():

	for x in 100:
		for y in 100:
			var vec2i := Vector2i(x, y)
			var vec2i_hash := hash(vec2i)
			if dict.has(vec2i_hash):
				dict[vec2i_hash].append(vec2i)
			else:
				dict[vec2i_hash] = [vec2i]

	for key in dict:
		var value: Array = dict[key]
		if len(value) > 1 :
			print('Vector2i %s have same hash() -> %s' % [value, key])

In v4.0.beta4.official [e6751549c] it prints nothing. Most likely fixed by #61934. Hence closing.


parse error when blend with hsl()

.test {
  color: color(hsl(210, 10%, 85%) blend(hsl(330, 50%, 70%) 50%));
}

Error message says: Unable to parse color from string "hsl(330,"
can get the bug here too: http://cssnext.io/playground/

This module is just a wrapper of https://github.com/ianstormtaylor/css-color-function.
Please report the issue over there. Thank you.


sdk/state: ingest transactions and update state with balance changes

The channel needs some way of having its internal state updated by transactions that can be seen on the network.
If the state package sees a transaction that alters the balance of either escrow account it should update the internal balance for the account stored in the state package.
Related to #202 #215 #218

See #204 for the code to build on.


Add Drupal core SA-CORE-2021-001

when using drupal through composer, is Archive_Tar bundled inside drupal/core or installed as a composer dependency ? If it is installed by composer, there is no point making an advisory for drupal packages for that. The advisory on the archive_tar library (already added in https://github.com/FriendsOfPHP/security-advisories/blob/master/pear/archive_tar/CVE-2020-36193.yaml) will be reported for the project when using a vulnerable version.

when using drupal through composer, is Archive_Tar bundled inside drupal/core or installed as a composer dependency ? If it is installed by composer, there is no point making an advisory for drupal packages for that. The advisory on the archive_tar library (already added in https://github.com/FriendsOfPHP/security-advisories/blob/master/pear/archive_tar/CVE-2020-36193.yaml) will be reported for the project when using a vulnerable version.

Hm good point. It's not bundled inside any of those packages, but the recommended way is to use drupal/core-recommended which pins it's dependencies. But as I said, that is another package I guess, which is not covered by this repo

Hm good point. It's not bundled inside any of those packages, but the recommended way is to use drupal/core-recommended which pins it's dependencies. But as I said, that is another package I guess, which is not covered by this repo

@eiriksm the dependency pinning is not an issue. you will still get the pear/archive_tar package in you composer.lock and so its advisory will be detected when needed.
drupal/core-recommended does not appear in this repo because it would not make sense: this is a metapackage so it does not contain any source code. Not having any source code prevents having vulnerable source code (dependencies on vulnerable dependencies are not the point here, as the advisory is set on the dependency)

@eiriksm the dependency pinning is not an issue. you will still get the pear/archive_tar package in you composer.lock and so its advisory will be detected when needed.
drupal/core-recommended does not appear in this repo because it would not make sense: this is a metapackage so it does not contain any source code. Not having any source code prevents having vulnerable source code (dependencies on vulnerable dependencies are not the point here, as the advisory is set on the dependency)


[BUG] - Invite button does not work on Linux

Hi, i seem to have a similar issue as described here: https://github.com/Morph21/MercuryTrade-Community-Fork/issues/67
Describe the bug
Clicking the invite button does not invite the player. Instead the requested item name will pasted and send in the local chat.
To Reproduce
0. (Install Linux, download the .jar of Mercury Trade)

Launch PoE via Steam
Set the game to windowed mode
Enable Vulkan
Start Mercury Trade
Wait for a trade request or use a test notification
Click the green plus symbol to invite the player
The name of the requested item will be send in local chat

Expected behavior
The player should be invited to the group.
Desktop:

Version 1.2.5

Additional context
Here is my recent log: https://pastebin.com/LNhRYM5d
I play PoE on Linux with Steam and Proton. Sadly, not a single overlay for Path of Exile works perfectly fine on any of my (previous) Linux systems. So this might just a Linux related Problem. Right now I combine Mercury Trade with Awakened PoE Trade, which works quite well, besides of game focus issues, but that is absolutely a Linux problem. My bug also occurs when Awakened PoE Trade is not running.
Thank you - and thank you even more for supporting Linux!!

Mercury Trade doesn't support linux. It uses internal Windows dll (microsoft interface functions) to take focus for window and few other things so it won't work on linux sadly.


(MODULES-2636) Fix mongodb_user role management

Switch to comparing current roles value with @property_hash[:roles] value, and fix failing tests as a result.

@mentat Whilst you're on a roll, any chance you could take a look at this one?

Have just rebased off master, so should merge cleanly now :)

@jonnytpuppet


fix: add issue and pr templates

This address' #68

@SputNikPlop You need to rebase to resolve the linting issue right now from the workflow

@Melkeydev Passed the checks, merge whenever.


Raiplay broken

Checklist

[x ] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.07.28
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl https://www.raiplay.it/video/2020/07/La-Grande-Storia---Verita-nascoste-bd22fbde-01fa-49f4-8f60-67297edfba5c.html --ignore-config --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.raiplay.it/video/2020/07/La-Grande-Storia---Verita-nascoste-bd22fbde-01fa-49f4-8f60-67297edfba5c.html', u'--ignore-config', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.07.28
[debug] Python version 2.7.16 (CPython) - Linux-5.8.1-rockchip64-aarch64-with-debian-10.5
[debug] exe versions: ffmpeg 4.1.6-1, ffprobe 4.1.6-1, rtmpdump 2.4
[debug] Proxy map: {}
[RaiPlay] bd22fbde-01fa-49f4-8f60-67297edfba5c: Downloading video JSON
ERROR: bd22fbde-01fa-49f4-8f60-67297edfba5c: Failed to parse JSON  (caused by ValueError('No JSON object could be decoded',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 899, in _parse_json
    return json.loads(json_string)
  File "/usr/lib/python2.7/json/__init__.py", line 339, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python2.7/json/decoder.py", line 364, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python2.7/json/decoder.py", line 382, in raw_decode
    raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 797, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/rai.py", line 174, in _real_extract
    '%s?json' % url, video_id, 'Downloading video JSON')
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 892, in _download_json
    expected_status=expected_status)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 876, in _download_json_handle
    fatal=fatal), urlh
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 903, in _parse_json
    raise ExtractorError(errmsg, cause=ve)
ExtractorError: bd22fbde-01fa-49f4-8f60-67297edfba5c: Failed to parse JSON  (caused by ValueError('No JSON object could be decoded',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

Raiplay parser does not work, while passing directly the video file link still works smoothly.

https://github.com/ytdl-org/youtube-dl/pull/23040 should fix this, sadly it still hasn't been merged it seems.
It works and it always worked in my case.
I have to manually apply the patch after each youtube-dl update

It works perfectly. I am just wondering why it is not yet merged. Thank you for the prompt help, much appreciated.


Expose the InfluxDB and Cassandra ports to host

Expose the InfluxDB's HTTP API port 8086 and  Cassandra's CQL port 9042 from the containers
to the host machine, in order to enable easier exploration of the data stored in the databases
from the host machine and development of apps which connect and use the data stored in the databases.
Fixes #437

Codecov Report

Merging #441 into master will increase coverage by 0.11%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #441      +/-   ##
==========================================
+ Coverage   90.97%   91.09%   +0.11%
==========================================
  Files          46       46
  Lines        1706     1706
==========================================
+ Hits         1552     1554       +2
+ Misses        105      103       -2
  Partials       49       49

Impacted Files
Coverage Δ

things/service.go
93.47% <0%> (+1.44%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 694d67a...362e6be. Read the comment docs.

@chombiom thanks for the PR, just one question - do we need similar for MongoDB?

@drasko the ports for mongdb are already exposed.

@chombium Can you remove expose where there are ports for other services too?

@drasko, @anovakovic01 I fixed all the expose and ports doubles. I've tested locally in dockerized environment all the request based on the getting started guide and everything works properly.


Adding functional helpers to WTAHelpers

Once this is pulled in we'll also need to pull that into master and add the label for cocoapods...


Added new segment DMX modes

Adds descriptions for

new DMX preset mode
new DMX effect segment modes
missing docs of multiple RGBW mode

Coming from: https://github.com/Aircoookie/WLED/pull/2891
Note: These changes describe WLED versions > 0.14.0-b1 - as the PR got merged.
For b2 or 0.14.0 release: This is a breaking change in E131 sync behavior. It shall be mentioned in release notes. Existing user DMX setups using Effect mode may break. Solution: External DMX channel mappings must adopt accordingly.

IMO this is now ready. Added version info so it should be save to publish ..

@Aircoookie please make a note regarding breaking change when releasing 0.14.


[FEATURE REQUEST] ... Green color for covered credit balance in left hand pane

I'd like it if in the left hand pane, credit card negative amounts were colored green rather than red if and only if that negative amount were fully covered in the credit card payment category. Obviously it would still have the minus sign next to it, but it wouldn't be red.
Currently, you have to look at your balance and then your payment amount to see if they match. I would rather the color just be green so I know I'm good...one step, not two. Also, I don't like that it is red because I have money to cover that. Red means bad, not fair when I'm being a good YNABer and staying off the credit card float.

I think that's a great idea. I don't like seeing red even though it's fully covered! When, I get the time I'll try to implement this feature.

Sounds great, thanks!

@michael1588 We have a feature called "Paid in Full Credit Card Assist" which is meant to help you see that you're "good at a glance."
I understand what you mean about the color of credit cards being red but I kinda don't want to change that because it makes sense in the context of your "balance" that a credit card amount is negative (red just means negative, not bad!)
Let me know if you have any thoughts on whether our existing feature is enough to accomplish what you're asking for.

I'm going to close this issue. I'm hesitant to change the color of the actual balance because green actually means something different than "good"/"bad". It's also kind of a pain to add more noise to the account sidebar. YNAB themselves I think have trouble adding "notification" symbols there since there's not much real-estate.


Record is not validated on 'TransformBuilder.addRecord'

When I'm adding a record via 'TransformBuilder.addRecord' method, it is added regardless of whether the record attributes correspond to the schema. In the example, you can see the 'name' attribute of the records with the type 'planet' should have the type 'boolean'. The record is added despite the fact the type of the 'name' attribute is 'string'.
Example here:
https://codesandbox.io/s/orbit-add-record-9nd0w?file=/src/index.ts

@Thomasan1999 thanks for reporting!
Orbit v0.16 currently just uses the type of attributes to customize the serialization of records in certain sources, such as the JSONAPISource.
In the upcoming Orbit v0.17, we're working to add validation at different layers of the system and in more sources. For instance, transform and query builders will be able to optionally validate records, and more robust validation will be added to the RecordValidationProcessor that controls whether records are allowed into record-cache-based sources.
I'm working on improving record normalization and validation currently and hope to land this in the next beta.

This will be addressed by #842, which introduces validators to query + transform builders.

Resolved in v0.17.0-beta.16


On gramercy card, display recipient Twitter handle

On the example below, you can't tell which gramercy belongs to which recipient.  A moderator may want to approve for one recipient and reject for another.

Glad I could help attempt to break things ;)
This code base isn't my strong suit, but I think I can nail this one. PR should be coming soon.


Set up and document Kogitos Quarkus extensions

Coming from https://github.com/apache/incubator-kie-issues/issues/909

Verify that call Kogito Quarkus extensions have the right metadata in the quarkus-extension.yaml or add it if needed.
After the release, add all the extensions in the Quarkus extensions catalog

More insights: https://kie.zulipchat.com/#narrow/stream/232677-drools/topic/Quarkus.20extension/near/419812623


Unable to open nativescript application from android appwidget.

Hi team,
I was created android appwidget in android studio then exported as package .aar library "org.nativescript.appwidget".
Then it is importing as tns plugin add " .aar system plugin directory path" into nativescript application. Appwidget is working fine.
I didn't know how to open nativescript application from android appwidget library?
My requirement is when I am clicking on android appwidget then it will open my nativescript application.

Hi, @katturajam
Currently there is no working demo for this scenario. If there is I'll be sure to link it here.

You can use android package manager to open your application.

Do you have any other ideas?

duplicate of: https://github.com/NativeScript/android-runtime/issues/356


Fix atomic snapshot creation

Compress gzip files to a temporary file first and then do an atomic rename.
In our setup we have an indexer which does snapshoting for the instances serving the requests. Since currently the snapshoting mechanism is replacing the file in place therefore the indexer could not share the snapshot with a live instance.
With this small patch we first create a new temporary file in the same directory as the snapshot dir and then we do an atomic rename therefore the snapshot path would always contain a valid snapshot.
After applying this change it would be enough to simply restart the serving instances to pick up the new snapshot from a shared storage without worrying them to die because of an incomplete snapshot.

bors try

All good! we merge that. Thanks for your contribution @raszi :)

bors r+

bors merge


Dec 1 and 2 done

Hi @sona444  Hope you're doing well.
Thank you for taking the time to solve the all the questions. We really appreciate your efforts. We will verify your submission and your certificate will be sent to you in your email. Thank you for participating. Keep an eye on our social media page for our upcoming events.

@sona444 Can you please specify your college/institution name for the certificate?

@sona444 Can you please specify your college/institution name for the certificate?

Manav Rachna International Institute of Research and Studies


Using wrong version of phaser-tiled

In the package.json it references 2.0.0, but the build is being generated with gulp, which I believe is set to ^1.2.1. I've got them side-by-side and they don't match.
PS. I'd like to help but I feel like there's a lot more moving parts than I would expect for a simple game. Don't get me wrong, LTTP and phaser-tiled are cool, but there seems to be some strange barriers to helping. 1) LESS. There's almost no CSS. Why? 2) EJS. There's almost no HTML. Why? 3) Gulp and webpack? I don't get it. 4) Inheriting Phaser classes makes it difficult to reason where things happening, in LTTP or in Phaser. 5) TypeScript - already a big step, and many JS devs will not bother with non-raw JS libraries, and the gains are questionable here - outside of the core game engine.

Seems like that's the map asset packer, nevermind. Still getting my head around this please bare with me.

LESS. There's almost no CSS. Why?

Why not? webpack and npm do all of this for you, you shouldn't even notice it is less.

EJS. There's almost no HTML. Why?

because we inject values into it during webpack build.

Gulp and webpack? I don't get it.

Webpack builds the bundle js file, but there is more to it than that. We need to build asset packs for the maps, lint the code, watch for changes on all things (not just bundle js), etc.

Inheriting Phaser classes makes it difficult to reason where things happening, in LTTP or in Phaser.

Not sure I understand what you are saying here.

TypeScript - already a big step, and many JS devs will not bother with non-raw JS libraries, and the gains are questionable here - outside of the core game engine.

Typescript is used as ES6 + types here. If no typescript was used, the code would look nearly identical since it would be ES6. I'm not worried about adoption or getting other devs on-board. I'm just building something I find fun to work on.


Commit for documentation update for meta annotation

Documentation update for meta annotation training to include training for bert and 2 phase learning.

Regarding meta_annotation_training.ipynb:

Is it just BERT or just LSTM MetaCATs? Would a mixture also work? Or does it simply not make a lot of sense? Maybe document that little bit - i.e the user should run 1 of the 2 code blocks, and not both of them; and potentially how a user could know whether the MetaCATs they've got are BERT or LSTM based, how they would find out.
Is there a reason the saving of the results was omitted?

Regarding meta_annotation_training_advanced.ipynb:

It feels more like a tutorial, or perhaps even a showcase. Though there is value in having both a tutorial as well as a script to be used in deployment. I just want to make sure this is how someone would use

I've added a code block using which the user can see which model is used for that particular model pack.
I've also added the saving results back in.


how can i find probabilities of skill?

Hello there
Appreciate your codes first!
btw i wanna know its probability of skill and can you pls let me know how can i find it?
Many thanks

I believe I worked out how to do this. We can get the probabilities by using the predict method for the fitted model:
model.predict(train_set)

This will throw an error however. Something wrong happens with the padded sequence dimensions when predicting, even though we don't have that problem when fitting the model initially. Changing "Step 7" in data_utils.py as follows can eliminate that error:
# Step 7 - Pad sequences per batch
max_sequence_length = max(df.groupby('user_id').agg(seq_length=('user_id', len))['seq_length'])
dataset = dataset.padded_batch(
    batch_size=batch_size,
    padding_values=(MASK_VALUE, MASK_VALUE),
    padded_shapes=([max_sequence_length, None], [max_sequence_length, None]),
    drop_remainder=True
)

Is there any way the padded part is not used in the predcitions ?


How can I get skins in glTF?

Is your feature request related to a problem? Please describe.
I need skins to do the inverse kinematics. However there is no way to get this at FilamentAsset.
Describe the solution you'd like
Supports getter function for skins at FilamentAsset.
Describe alternatives you've considered
Actually I only needs the skin name and joints for the inverse kinematics. So supporting skin name and joints gatter function will be enough.

Please let me know your ideas. I will create a PR for this when I hear your thought.

Yes I think it's a good idea to add queries for this to FilamentAsset.  I think we are already storing the information you need, look for "SkinVector".

Thank you!  Be careful not to expose std::vector, we try not to use STL containers in public API's.  We will probably need two getter methods, one for the count.

@prideout Skin's variables use std::vectorso I make more getter functions.

@daemyung Can it be added to jni as well?thanks.

@August1996 It will be fine because it's an internal bug.

@August1996 Ok I will.

@August1996 Ok I will.

Which version of the skin-related api will support jni? 😊

@August1996 Check #5363 out.


CESM2.2 CAM6 Perturbed Parameter Ensemble (PPE) PD Time Series Monthly Averages

Dataset Name
CESM2.2 CAM6 Perturbed Parameter Ensemble (PPE) PD Time Series Monthly Averages
Dataset URL
https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.pd_timeseries.atm.hist.monthly_ave.html
Description
This dataset will be used as the dataset for us to test newly developed emulators. The PPE will be also used for parameter estimation using the emulator and inversion method that we come up with.
Note that this is only a subset of the complete CESM2.2 CAM6 Perturbed Parameter Ensemble (PPE) (see: https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.html). We focus on CESM2.2-CAM6 PPE PD Time Series Monthly Averages for now as a testbed that might be used for the LEAP Summer REU and Momentum Programs.
Size
Unknown
License
Unknown (see
Data Format
NetCDF
Data Format (other)
No response
Access protocol
HTTP(S)
Source File Organization
Within the link given above, there are many links under the "Child Datasets".
Each link within the "Child Datasets" corresponds to a variable that is generated from the climate model simulation.
Within each link, there is a "Download Options" button.
Clicking on the "Download Options", there are 262 nc files.
The 262 nc files are different  in the parameter values that are used during the running of the climate model.
All nc files share the same coordinates in time and space. Their difference is the variable that they store and the parameters adopted to generate the simulation.  This can be seen in the file names, for example:
File name "cc_PPE_250_ensemble_PD.000.h0.ACTNI.nc" suggests that the variable it stores is ACTNI, and it is from the 000th simulation, namely from the first set of parameters.
Example URLs
https://tds.ucar.edu/thredds/fileServer/datazone/campaign/cgd/projects/ppe/cam_ppe/rerun_PPE_250/PD/PD_timeseries/PPE_250_ensemble_PD.000/atm/hist/cc_PPE_250_ensemble_PD.000.h0.ACTNI.nc?api-token=TGLy7EMWBpimnosAbrfUyvvlyAHRvHUjzrna0Mqz

Authorization
No; data are fully public
Transformation / Processing
No need for right now.
Target Format
Zarr
Comments
The data needs to be accessed with a OrcID/google account.

Thanks for submitting the request @yiqioyang.
I just tried to follow the links and got as far as this:

So I think getting the authentication right will be the biggest issue here. Could you find out if they provide HTTP username/password-based authentication for these datasets at all?

Hi @jbusecke , it is strange that I didn't get to see the screenshot that you attached here.
Can you try this link (second one in my post): https://www.earthsystemgrid.org/dataset/ucar.cgd.cesm2.cam6.ppe.html ?
After this link, you will see:

Click on the "CESM2.2-CAM6 PPE PD Time Series", and then select "CESM2.2-CAM6 PPE PD Time Series Monthly Averages", which will show the data we want for now. In this way to access the data, I could either simply get the download link or need to sign-in with an orcid or google account (not sure if this would cause the similar issue with authentication). Can you give it a try and see if that works?
Or let me know if I made myself clear. Thanks!

I did click that, signed in, and then got an authorization denied?

I saw here that they give you an option to get a wget script? Can you generate that and post it here (or send it via slack). I hope we can reverse engineer this to get a simple http link .

Or even simpler maybe, can you click through there and copy the link under the download button?
Happy to iterate on this some time next week, its just hard to progress here without access.

Hi Julius, thanks for the patience, and yes, will get those to you once

Hi Julius, yes, will get back to you when I hear some updates (what variables we want and etc) from others.
Thanks for the patience!


Screens

Implemented:
Screen Open, Screen Close, Screen Display, Screen Clone, Screen, Screen To Front, Screen To Back, Screen Hide, Screen Show, Screen Height, Screen Width, Screen Colour, Scin, Wait VBL,
Not implemented yet:
Default, Load Iff, Save Iff, Screen Offset, =Screen, Default Palette, Get Palette, CLS, Screen Copy, Def Scroll, Scroll, Fade, Appear, Flash, Shift Up, Shift Down, Shift Off, Set Rainbow, Rainbow, =Rain, Zoom.
Don't know how they work or not sure if they are needed:
Auto View On/Off, View,
Not going to support:
Copper Off, Copper On, Cop Move, Cop Movel, Cop Wait, Cop Reset, Cop Logic, Dual Playfield, Dual Priority, LogBase, PhyBase, Physic, Logic.

Implemented all I want to implement for now, 99% done.


Do a cache burst when either a prompt or config file change

Modifying the configuration file should trigger a fresh run. We're currently needing to modify the prompt file to achieve this.

Thanks for this report.  #113 has a fix


Add exclude option for Function to exclude certain directories

When creating a Function, there is no option to exclude directories from the srcPath. This exclude should be able to interact with CDK's AssetOption.exclude directly
One usage of this would be for python sources that have their .venv in the same directory as the Pipfile.
Without the exclude of .venv, the .venv is bundled together with the lambda, including the packages installed by the dependency builder on the docker, effectively copying the packages twice. This bloats the python runtime lambda code and can lead to failed deployments due to exceeding the 250MB Deployment package size

Exclusion is needed in case of using Poetry. Bundling will try to include .sst folder in bundle, causing error. This happens when having poetry.lock in root folder together with sst.config.ts.
Offending line here: https://github.com/sst/sst/blob/eebcb438bdac4b17e2ecdf2ffa87666484b1a2dd/packages/sst/src/runtime/handlers/pythonBundling.ts#L137C1-L139C6

We are transition this repo to https://github.com/sst/v2 and are closing this issue for now. If it is still relevant please reopen it there - sorry for the trouble


Is it possible to add a basic mapper between two classes?

Based on the docs https://fast-endpoints.com/docs/domain-entity-mapping#mapping-logic-in-a-separate-class I can map between Request, Domain Model and Response but in my case I want to map the Request to a Command object first. The result of the Command should get mapped to the Response.
Example:
public class Request
{
    public string Foo { get; set; }
}

public class Response
{
    public string Bar { get; set; }
}

public class Command : ICommand<string>
{
    public string Text { get; set; }
}

public class RequestToCommandMapper : Mapper<Request, Command>
{
    public override Command ToEntity(Request r) => new()
    {
        Text = r.Foo
    };
}

public class CommandToResponseMapper : Mapper<Command, Response>
{
    public override Response FromEntity(Command c) => new()
    {
        Bar = c.Text
    };
}

Drawbacks:
This would require to change the Endpoint class from Endpoint<TRequest, TResponse, TMapper> to Endpoint<TRequest, TResponse, TMapper1, TMapper2, TMapper3>
I would prefer having a mapper utility so you can use the mapping features of FastEndpoints outside from handlers and basically wherever you want to. So you don't have to use FastEndpoints and other mapping libraries in addition.
I am not an expert! Please let me know if this is already possible or if there are workarounds to achieve this :)

the actual constraint on the TMapper on the endpoint class is simply a marker interface IMapper. so you can just create any kind of mapper class like so:
sealed class MyMapper : IMapper
{
    public Command ToCommand(Request request)
        => new() { Text = request.Foo };

    public Response ToResponse(Command command)
        => new() { Bar = command.Text };
}

[HttpPost("test"), AllowAnonymous]
sealed class MyEndpoint : Endpoint<Request, Response, MyMapper>
{
    public override async Task<Response> ExecuteAsync(Request req, CancellationToken ct)
    {
        await Task.CompletedTask;

        var cmd = Map.ToCommand(req);

        return Map.ToResponse(cmd);
    }
}


Making the Project Name be rguilayout consistently

Fixed what looked like placeholder / default naming for the main .c file.

Actually this is the expected value because it is update at build time with GitHub Actions workflows.


editorState.toHtml() is empty

editorState.toHtml() returns empty
my code:
import React, { useState } from "react";
import BraftEditor from "braft-editor";
import { Box } from "@chakra-ui/core";
import "braft-editor/dist/index.css";
import { Props } from "./custom-layout-cf.model";

const CustomLayoutCF: React.FC<Props> = (props: Props) => {
  const [editorState, setEditorState] = useState(
    BraftEditor.createEditorState(null)
  );

  const handleChange = (newEditorState) => {
    console.log(newEditorState.toHTML()); //Issue here
    console.log(newEditorState.toText()); //this works fine

    setEditorState(newEditorState);
  };

  return (
    <Box maxWidth="96%" m="0 auto" mt={5} mb={5}>
      <BraftEditor value={editorState} onChange={handleChange} language="en" />
    </Box>
  );
};

export default CustomLayoutCF;

Note that, I'm using: "braft-editor": "^2.3.9" and "draft-js": "^0.11.7"
What to do?

I am having the exact same issue, toHtml() returns nothing.

I am having the exact same issue, toHtml() returns nothing.

I have the same problem

I have the same problem

I got the same problem too, but I finally solved it by npm uninstall draft-js as I saw someone saying that this problem was due to draft-js version. After "npm uninstall", you may need to npm install braft-editor --save back again, just execute it and things may be all right. Hope this will help.

I also encountered the same problem. My solution is to reduce the version of braft-editor and lock the version, that is, change braft-editor to the original ^2.3.9 in package.json Change to 2.3.8.
Analyze the reasons:
The braft-editor depends on the updated version of draft-js in the package. If the version of draft-js is reduced, the version of the dependency package draft-js will also be reduced (to 0.10.5), so that it is back to the normal usability before. The version is locked so that the latest minor version dependency package is not actually downloaded.

这么好的一个编辑器，因为无法toHtml()就这样停摆了？


Instafade can cut off Hitcircles

very_helpful_logs.txt
On some skins, using the "Instafade Hitcircles" option will cut off part of the hitcircle. This is the case for example with JesusOmega Planets NM.
Stock

Instafaded

In this case, (all @2x) the stock hitcircle file is 240x240, default-0 is 100x100 and hitcircleoverlay is 294x294, the instafaded default is 300x300.
There seems to be some kind of issue occuring during a resize, and as a result the circle gets cut off at the extremes.
The error occurs not only with @2x circles, but also at regular size

thanks for reporting this bug, it's been fixed in the latest release. just launch osu! skin mixer to update

Thanks for the quick fix!


About the experimental results of RAP

Hello, I used RAP for defense on sst-2, but the experimental result was very poor, the FAR was close to 1.0, may I ask if it is normal? If it is not normal, how should I set the details of the experiment

May i ask whether your problem is solved yet? i met the same problem when i run demo_defend.py too.

May i ask whether your problem is solved yet? i met the same problem when i run demo_defend.py too.

Finally, I used the code of the original paper and modified the learning rate

Thanks a lot. Since I have some further questions to consult, could we possibly communicate on Wechat, please?  Thanks again.


ignore stdio to avoid bufsize issue when inheriting io

When using the module in a http server pdflatex locked up after partially processing the input, probably due to limited stdout or stderr buffer size inherited from the parent process. Setting stdio to 'ignore' resolved the issue. We don't seem to use stdio here anyway; any errors are looked up via the log file.

Thanks!


Hercules CI agent that pushes to an ad hoc Attic cache

Let's do this after it https://github.com/mlabs-haskell/cardano.nix/issues/3 and https://github.com/mlabs-haskell/cardano.nix/issues/2 since it should conceptually the same.

Milestone 1 was accepted without this. Superseded by #17


Altering Table with "rework"

I've tried several times to follow the 'postgres tutorial', just except instead of altering a function, I'm changing a field name in table. But it ends up with same error.
╰─$ sqitch verify
Verifying sqtest_db
  * appschema .... ok
  * contact ...... ok
Undeployed change:
  * contact
Verify successful
╭─dacodekid@mbp  ~/dev/sqtest
╰─$ sqitch deploy
Deploying changes to sqtest_db
  + contact .. psql:deploy/contact.sql:10: ERROR:  relation "contact" already exists
not ok
"/usr/local/bin/psql" unexpectedly returned exit value 3

Deploy failed

This is my before tagged and after tagged deploy query
BEFORE
BEGIN;
CREATE TABLE sq_schema.contact
  (
    log_date DATE NOT NULL,
    emp_name CHARACTER VARYING(100) DEFAULT ''
  );
COMMIT;

AFTER
BEGIN;

CREATE TABLE sq_schema.contact
  (
    log_date DATE NOT NULL,
    employee_name CHARACTER VARYING(100) DEFAULT ''
  );

COMMIT;

Rework is intended for making idempotent changes, such as CREATE OR REPLACE FUNCTION. The CREATE TABLE statement is not idempotent. If you want to add a column to a table, I suggest either:

If you have not released your database, just modify the CREATE TABLE statement in the original change and sqitch rebase to revert all changes and redeploy with the updated table. This is ideal when doing development.

Otherwise, add a new change, named $table_$column or some such, and use an ALTER TABLE statement to add the new column. This is the approach to take if you have released the database already, though you can also do it before release if you like.

If you have any more questions, the mail list is the best place to post them. Hope to see you there!

@theory, ALTER TABLE makes sense. I asked it in SO, but will use mail list from now on. Appreciate it.

Right, thanks for the SO pointer. I posted the answer there, too.

@theory Thank you so much for all of this. I too had this question after reading the tutorial. Might be useful to specifically call this out.


Reparing training

training now work as expected

LA PR EST CASSEE :rotating_light: :rotating_light: :rotating_light: :rotating_light:


Register Middleware

Hi, I made a middleware. Now how do I register a middleware in the module and use it?

Good first create a Module or if you already have add this, let's make 2 examples:
The First Mode
php artisan module:make Example
Then open ExampleServiceProvider and add

The second mode is more professional
we repeat the first step,

then in boot we add "$this->registerMiddleware();",

finally at the end we add private "private function registerMiddleware()".


build 2.12.0 :snowflake:

tensorflow-text 2.12.0 :snowflake:
Destination channel: Snowflake
Links

PKG-4136
Upstream repository

Explanation of changes:

patched build scripts to avoid bazel version verification and setting tensorflow version

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_dapj4n9r2j/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:42: missing_license_file: The recipe is missing the about/license_file or about/license_url key.

===== ERRORS =====

clone/recipe/meta.yaml:20: patch_must_be_in_build: patch must be in build when source/patches is set.
===== Final Report: =====
1 Error and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_33aes2weyg/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:42: missing_license_file: The recipe is missing the about/license_file or about/license_url key.

===== ERRORS =====

clone/recipe/meta.yaml:20: patch_must_be_in_build: patch must be in build when source/patches is set.
===== Final Report: =====
1 Error and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_544l8i3g8u/clone` failed. (See above for error)
The following problems have been found:
===== ERRORS =====

clone/recipe/meta.yaml:22: patch_must_be_in_build: patch must be in build when source/patches is set.
===== Final Report: =====
1 Error and 0 Warnings were found

This package is empty, there is no build script!
Shouldn't 0001-fix-build.sh be broken into a patch and a build script?

Apologies for the hasty review, I didn't even notice the absence of the build script. Fixing this now.

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_ecu4gvtik4/clone` failed. (See above for error)
The following problems have been found:
===== ERRORS =====

clone/recipe/meta.yaml:44: missing_pip_check: For pypi packages, pip check should be present in the test commands
clone/recipe/meta.yaml:38: missing_python: For pypi packages, python should be present in the host and run sections. Missing in {}
clone/recipe/meta.yaml:44: missing_pip_check: For pypi packages, pip check should be present in the test commands
===== Final Report: =====
3 Errors and 0 Warnings were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_91hxvfqijg/clone` failed. (See above for error)
The following problems have been found:
===== ERRORS =====

clone/recipe/meta.yaml:45: missing_pip_check: For pypi packages, pip check should be present in the test commands
clone/recipe/meta.yaml:45: missing_pip_check: For pypi packages, pip check should be present in the test commands
===== Final Report: =====
2 Errors and 0 Warnings were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_56a2q2_3m9/clone` failed. (See above for error)
The following problems have been found:
===== ERRORS =====

clone/recipe/meta.yaml:45: missing_pip_check: For pypi packages, pip check should be present in the test commands
clone/recipe/meta.yaml:45: missing_pip_check: For pypi packages, pip check should be present in the test commands
===== Final Report: =====
2 Errors and 0 Warnings were found

@boldorider4 tensorflow 2.12.0 isn't available for py312:
tensorflow-2.12.0-eigen_py310h205ab9b_0.tar.bz2
tensorflow-2.12.0-eigen_py311h689d69b_0.tar.bz2
tensorflow-2.12.0-eigen_py38h4f56085_0.tar.bz2
tensorflow-2.12.0-eigen_py39h767e93f_0.tar.bz2

So skip py>=313

@boldorider4 @lorepirri
An error on linux-64:
ModuleNotFoundError: No module named 'tensorflow'.
linux-aarch64 fails because of pip check:
tensorflow 2.12.0 requires jax, which is not installed.
tensorflow 2.12.0 requires libclang, which is not installed.
tensorflow 2.12.0 requires tensorflow-io-gcs-filesystem, which is not installed.

I think we can disable pip check.
osx fails:
ERROR: /private/var/tmp/_bazel_builder/80da974a5de4318d08ddace5a1f6b9ab/external/com_google_sentencepiece/BUILD.bazel:51:11: Compiling src/bpe_model.cc failed: undeclared inclusion(s) in rule '@com_google_sentencepiece//:sentencepiece_processor':

this rule is missing dependency declarations for the following files included by 'src/bpe_model.cc':

  'bazel-out/darwin_arm64-opt/bin/external/com_google_absl/absl/base/config.cppmap'

  'bazel-out/darwin_arm64-opt/bin/external/com_google_absl/absl/base/core_headers.cppmap'
...

Is there missing dependency abseil-cpp and/or absl-py? See https://github.com/search?q=repo%3Atensorflow%2Ftext+absl&type=code&p=2

osx fails:
ERROR: /private/var/tmp/_bazel_builder/80da974a5de4318d08ddace5a1f6b9ab/external/com_google_sentencepiece/BUILD.bazel:51:11: Compiling src/bpe_model.cc failed: undeclared inclusion(s) in rule '@com_google_sentencepiece//:sentencepiece_processor':
  'bazel-out/darwin_arm64-opt/bin/external/com_google_absl/absl/base/core_headers.cppmap'

Is there missing dependency abseil-cpp and/or absl-py? See https://github.com/search?q=repo%3Atensorflow%2Ftext+absl&type=code&p=2

Thank you @skupr-anaconda, I will try to add abseil-cpp, but I'm pretty convinced that this issue is related to an ill bazel configuration. Probably some cc_library section needs to be added to the BUILD file. That's my best guess right now.

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_90dseog4jl/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:50: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
clone/recipe/meta.yaml:49: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
clone/recipe/meta.yaml:52: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
clone/recipe/meta.yaml:51: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 4 Warnings were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_226zo9sl4z/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:54: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

An error on linux-aarch64:
ERROR: /root/.cache/bazel/_bazel_root/64fcdfd97ddf52e17bc9efd752bb0399/external/local_config_python/BUILD:78:8: Executing genrule @local_config_python//:python_include failed: (Exit 1): bash failed: error executing command (from target @local_config_python//:python_include) /bin/bash -c ... (remaining 1 argument skipped)

cp: cannot stat '/croot/tensorflow-text_1715211032599/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_p/include/python3.8/Python-ast.h': No such file or directory

It's weird because Python-ast.h exists in our Python 3.8 https://conda-metadata-app.streamlit.app/?q=pkgs%2Fmain%2Flinux-aarch64%2Fpython-3.8.19-h4bb2201_0.conda

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_earv9m37wq/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:54: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_f8gmara7iu/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:54: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_f6z0qgzzzx/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:54: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(124): `conda run conda-lint /tmp/abs_21yd1atds2/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:53: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

tests pass locally on both linux-64 and linux-aarch64. In attachment there is one success log for py311 on linux-aarch64.
aarch64-py311-test.txt

after careful review with @JeanChristopheMorinPerso, we decided that fixing the bezel configuration on the CI is way too hard. Packages have been built locally for both linux archs, py38..py311.
Packages have been uploaded to https://anaconda.org/sfe1ed40/tensorflow-text.

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_70dil21129/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:53: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found


removing optional docker registry settings from Arc data controller ARM templates

This PR removes the docker registry settings from all Arc data controller ARM templates. These settings are now optional going forward, and the registry info will be extracted from the Arc data services k8s extension.

Related to #1669


Standardize Webhooks

Processing the webhook
Managing the existence in shopify

I renamed and edited the issue #51 actually so closing this one.


addressing a couple of lineplot viz stuffs

This will address https://github.com/VEuPathDB/web-eda/issues/1079, which the required tasks are summarized at https://github.com/VEuPathDB/web-eda/issues/1079#issuecomment-1152401516.
Here are example screenshots with PRISM data

before applying this PR: the first screenshot is without removing the error message (taken from the ticket) and the second one is by simply removing the error message in the code, which causes 500 error instead

a)

b)

after applying this PR: now proportion can be used without error message & numerator = denominator & showing 1

after applying this PR: other variable for test the case of numerator = denominator & showing 1

@bobular Since you are the most familiar with the Lineplot Viz, I chose you as a reviewer 😄 Can you please check if this PR satisfies the requirement summarized by Danica, https://github.com/VEuPathDB/web-eda/issues/1079#issuecomment-1152401516? Above screenshots may be helpful too, I suppose 🤔

hi @moontrip this is what we want, thanks.
can you confirm that -- if you have subsetted the data in a way that the numerator and denominator ends up being the same -- that the plot is not throwing an error and we still get a line at y=1?
For example, in GEMS1 case control, apply a filter for Country = Bangladesh
In the line plot, you can plot x=sleeping rooms in dwelling count & y=country. then configure the proportion so that the numerator is Bangladesh & India and denominator is all countries:

@danicahelb I have tested the case and unfortunately, it failed: if I manually adjust the numerator and denominator as Bangladesh, then it worked.
I have briefly looked at the code and it looks to me that the list of numerator and denominator does not respect the filter. So, I think that if we limit the list by considering filters, then it would work, I suppose. I will try and see if I can do that myself, as the proportion was made by Bob

hey @moontrip the other issue I identified has its own ticket: https://github.com/orgs/VEuPathDB/projects/11/views/1
maybe check in with @asizemore about implementing?

@asizemore Thank you for your explanation and sounds great to me 👍 I didn't know the presence of the backend work you were doing, so I thought it might have been a frontend stuff. I will see if I can make it from my side as well, though it's a bit tricky.
When your work is merged, please let me know so that I can test it (with GEMS1 Danica tested) too!

I have briefly looked at the code and it looks to me that the list of numerator and denominator does not respect the filter. So, I think that if we limit the list by considering filters, then it would work, I suppose. I will try and see if I can do that myself, as the proportion was made by Bob

Hi @moontrip
I don't think it will be easy to customize the numerator and denominator choices based on the current filters. Well, it might be possible with a whole new back end request, but I don't think we want to add new complexity like that at the current late stage in release 58!


Restructure project to allow for extension modules

There currently are 2 requests for argument types that would introduce unwanted requirements/dependencies:

java.nio.file.path PathArgumentType implementation requires Java 7.
org.apache.hadoop.fs.Path HdfsPathTypeArgument implementation would introduce a dependency on Hadoop.

These issues can be resolved in extension modules, so the main argparse4j module does not need Java 7 or dependencies on other projects. But for this the project structure has to be changed. I propose the following directory structure (in parentheses the artifact ID and the packaging are shown):
<root> (argparse4j-root, POM)
+-- extensions (argparse4j-extensions, POM)
|   +-- java7 (argparse4j-java7, JAR)
|   \-- hadoop (argparse4j-hdaoop, JAR)
\-- main (argparse4j, JAR)

I agree with the proposed directory structure.  Thank you.

Great, thanks!


Empty genome download

Downloading sequences from here in FASTA produces empty zip
https://patricbrc.org/view/GenomeList/?keyword("2763046.3")
But downloading from here, using the DNA FASTA option gives the correct number of contigs
https://patricbrc.org/view/GenomeList/?keyword("2763046.3")#view_tab=sequences

It seems like the genome is recently indexed and possibly we haven't generated the download files yet.

If there is going to be such a large lag in the FTP generation perhaps we should shift the download dependency to SOLR.
12/03/20 this is still broken

Gives only 252 features
But this works


Carve + Extract gives misleading output

Not clear to me if this is the intended functionality or not. Here's the steps:

Create a file that contains a gzip'd something (in this case, an image)
Run binwalk on that file with the flags for both extracting and carving
Notice that the output from binwalk claims that it extracted a .png.gz file and also that it extracted a .png.
Check the output directory to discover that the .gz is not there, only the png

My guess is this is a byproduct of running gunzip or something on the file, which actually does the unzipping but also has the effect of removing the original file.
My view on this is, if the user asks for both carve and extract, then the files disovered from both should be there, even if one is simply gzip'd version of the other. Important, for instance, if there are comments or other forensic information relevant in the gzip.
In this example, layer2.png.gz is not present in the output directory.
+---------+------------------+---------------------------------------------------------------------------------------------------------------------+---------------+
| 0x1d4f6 | Carved | gzip compressed data, maximum compression, has original file name: "layer2.png", last modified: 2020-06-27 13:44:15 | layer2.png.gz |
| 0x1d4f6 | Extracted | gzip compressed data, maximum compression, has original file name: "layer2.png", last modified: 2020-06-27 13:44:15 | layer2.png |
| 0x1d539 | Carved | Zlib compressed data, default compression | 1D539.zlib |
| 0x1d539 | Extracted | Zlib compressed data, default compression | 1D539 |
+---------+------------------+---------------------------------------------------------------------------------------------------------------------+---------------+

Ref ticket that brought this to my attention: https://github.com/bannsec/stegoVeritas/issues/28

The --carve option, when used by itself, does nothing; it is only useful when paired with the --extract option, so the following assumes you are running binwalk with both these options specified.
When --extract is specified, you're asking binwalk to extract some data that is inside some other file. In order to do that, binwalk must do two things:

Carve the data of interest out of the file (in your case, this is the gzip data containing the compressed PNG image)
Execute some code or external utility to cover the carved data into something useful (e.g., execute the gunzip utility to decompress the compressed data)

When --carve is specified along with --extract, you're telling binwalk to do step 1, but NOT perform step 2:
-z, --carve                  Carve data from files, but don't execute extraction utilities
So you would have only one output file, which would be the gzip file. However, this sounds like the opposite of the output that you are getting.
By default when binwalk extracts files (--extract) both the original carved gzip data (from step 1) and the resulting decompressed data (from step 2) would remain on disk, so you'd have two output files (in your example they should be named "layer2.png.gz" and "layer2.png" respectively).
If you've specified the --rm option, then after step 2 has completed, the carved file from step 1 is deleted, so you would be left with just the PNG file. This sounds to me like the output that you're getting, but that would mean that you're specifying the --rm option, not --carve.
I'm not sure what you mean by Notice that the output from binwalk claims that it extracted a .png.gz file and also that it extracted a .png. Binwalk's textual output is the same with or without the --extract and/or --carve options (unless you're talking about debug output?)
As a test, I took a JPG image and gzipped it. Here's what Binwalk's output looked like:
eve@ubuntu:/tmp$ binwalk image.jpg.gz --extract --carve

DECIMAL       HEXADECIMAL     DESCRIPTION
--------------------------------------------------------------------------------
0             0x0             gzip compressed data, has original file name: "pngtree-pink-watercolor-brushes-171474-png-image_1733978.jpg", from Unix, last modified: 2020-09-17 17:39:30

eve@ubuntu:/tmp$ ls _image.jpg.gz.extracted/
pngtree-pink-watercolor-brushes-171474-png-image_1733978.jpg.gz


Add new context parameter for using concurrent locks

This PR introduces a new task context flag useConcurrentLocks.
This can be set for an individual task or at a cluster level using druid.indexer.task.default.context.
When set to true any appending task would use an APPEND lock and any other ingestion task would use a REPLACE lock when using time chunk locking.
If not, we fall back on the context flag taskLockType and then useSharedLock.
This PR has:

[x] been self-reviewed.

[ ] using the concurrency checklist (Remove this item if the PR doesn't have any relation to concurrency.)

[ ] added documentation for new or modified features or behaviors.
[ ] a release note entry in the PR description.
[ ] added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
[ ] added or updated version, license, or notice information in licenses.yaml
[ ] added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
[ ] added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
[ ] added integration tests.
[ ] been tested in a test Druid cluster.

Merging as failure is unrelated.


Date-time picker displays date object in a different format

My sm-date-time-picker template:

When I select just a date, the input model shows (think the moment object) 'Tue Dec 13 2016 11:02:19 GMT-0800' before I make my selection on hour and minute. Once I select the hour and minute, it returns to the format desired. Can this be made consistent? like it always shows up in the format that we send in template?

Yes this can be fixed. I will fix it

Thanks !
Sent from my iPhone

On Dec 13, 2016, at 12:31 PM, Samir<EMAIL_ADDRESS>wrote:
Yes this can be fixed. I will fix it
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Don't forget close if is resovled @praveenk-telsiz ;)

@mominsamir Any updates on this?

@mominsamir  , any update on this?


Minor corrections on code PaperDC

Hi @agdestein 👋
I've been looking and running the code that you have under IncompressibleNavierStokes.jl/lib/PaperDC.
I've found a couple of typos that are worth updating to get the code running.

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 50.32%. Comparing base (3ba3c68) to head (1a6596d).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##             main      #77   +/-   ##
=======================================
  Coverage   50.32%   50.32%
=======================================
  Files          34       34
  Lines        3376     3376
=======================================
  Hits         1699     1699
  Misses       1677     1677

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Thanks!


allow for different line widths in lines

At the moment is possible to do several lines at once by NaN separation. Different colours also works, however passing a set of values for different line widths is not supported, as in linesegments. It would be nice to have this feature for lines, which in all my tests is the fastest one to plot thousands of lines at once.

Yes, here is the MWE I have in mind:
using GLMakie
x=LinRange(0,2pi,100)
lines(x, sin.(x), linewidth = 0.19) # works
lines(x, sin.(x), linewidth = collect(x)) # does not

we get:
julia> lines(x, sin.(x), linewidth = collect(x)) # does not
Error showing value of type Makie.FigureAxisPlot:
ERROR: MethodError: Cannot `convert` an object of type Vector{Float32} to an object of type Float32

I was thinking more like:
using GLMakie
points = [Point2f(0.0, 0.0), Point2f(0.0, 1.0), Point2f(NaN, NaN),
    Point2f(1.0, 0.0), Point2f(1.0, 1.0)]
lines(points; color = [1, 1, 1, 2, 2], linewidth = 5)

this one works, but this one
points = [Point2f(0.0, 0.0), Point2f(0.0, 1.0), Point2f(NaN, NaN),
    Point2f(1.0, 0.0), Point2f(1.0, 1.0)]
lines(points; color = [1, 1, 1, 2, 2], linewidth = [2,5])
#lines(points; color = [1, 1, 1, 2, 2], linewidth = [2,2,2,5,5]) # does not work also

fails.

Different linewidth in connected lines is a bit cumbersome... linesegments supports it though, since it doesn't need to worry about joins.

yes linesegments works at some level. In my case it crashes my Julia session for large numbers whereas lines is completely ok and fast. Bottom line, I was just wondering about the possibilities. For now I'm adding a transparency for small line widths which helps hiding a little bit those lines.

In my case it crashes my Julia session for large numbers whereas lines is completely ok and fast

Oh thats pretty weird...Linesegments should be way more efficient...

ahh, plus I forgot to mention my lines are not straight ones, which is the use case of line segments.

Different linewidth in connected lines is a bit cumbersome... linesegments supports it though, since it doesn't need to worry about joins.

How come, Plots.jl provides it

Can you show an example of Plots.jl? I can imagine that it works if segments separated by NaNs have constant linesegments, otherwise the Cairo/vector graphics limitations should apply.

https://bifurcationkit.github.io/BifurcationKitDocs.jl/dev/tutorials/Swift-Hohenberg1d/#d-Swift-Hohenberg-equation-(Automatic)

How come, Plots.jl provides it

I didn't say it's impossible 🤷 And as I said, with linesegments it's pretty easy, wouldn't be surprised if that's what plots does for different linewidths. Maybe there could be a hybrid to just start a new connected line with every linewidth change...

yes linesegments works at some level. In my case it crashes my Julia session for large numbers whereas lines is completely ok and fast

Can you open an issue with an MWE? That must be a bug!

I see,  should I write my own using dispatch on linewidth?

https://bifurcationkit.github.io/BifurcationKitDocs.jl/dev/tutorials/Swift-Hohenberg1d/#d-Swift-Hohenberg-equation-(Automatic)

Hm, that does look like proper connected joints though... I guess our best bet to support that right now, would be via bands or generating our own mesh...

Although, when I look at it again, it looks like the scatter markers hide all the joints, so can't really tell if they have proper joints... So, I guess with a scatter like that, one may get away with linesegments

Plots.plot(x, sin.(x), linewidth = vcat(ones(50), 10 .*ones(50)))

Ok so you see that it's actually all linesegments, no joins. Which makes sense


Fallback if browsers don't support adoptedStyleSheets

This repository needs to be on divriots org I think.
And I think we need to prefix this @divriots

@gqio I agree. Can you merge and release this?

@gqio I agree. Can you merge and release this meanwhile?

Sadly I can't, since it's a personnal fork of @gluck


ZEVA - IDIR user cannot view supplementary report tab

Describe the Bug
For IDIR users they are unable to view the supplementary details tab after the reassessment is issued by government. If this exists it should be available for IDIR users to view as a locked snapshot. In the instance where there was no supplmntary report becuase the reassessment was inititatied by goivenrment then the supp details tab should be greyed out to show it doe snot exist.
Expected Behaviour
IDR user should always be able to click to view the supplementary report details if  a supplier has submitted a supplmentary report, even after a resulting reassessment has been issued.
Actual Behaviour
When the IDIR user tries to view the supp report tab, after a re-assessment has been issued, they can't click on it and a hover over message appears that says no supp report found.
Implications
A clear and concise description of any implications.
Steps To Reproduce
Steps to reproduce the behaviour:
User/Role:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Hey team! Please add your planning poker estimate with Zenhub @AlexZorkin @emi-hi @jig-patel @JulianForeman @tim738745 @vibhiquartech

This may already be resolved


Move to UBI

Move to UBI Base Image.
Add permissions to couch script to allow non-root (but root group) user to exec.
Alter path used for updated firstRoom json to be in a location writable by arbitrary non-root user.
Minikube/Docker testing required before non-draft

This change is

Minikube/Helm/Istio tested OK.

Docker tested OK.


Support for data-parallelism for mismatch algorithm

Contributes to fixing #2333
Proposed Changes

Creates CPO for sequential_mismatch
Adapts datapar mismatch
Adds datapar mismatch unit tests

bors merge


Fixes #261 partially

add version detect commands and version check regex
added description in README

The changes so far has been tested on a ubuntu 22.04 docker image.
Some utilities that are not yet tested:
Packages:
libmkl-dev
linux-tools

Thank you @Oseltamivir for your changes. Can you please tell if you are from an MLCommons member organization? Can you please sign the CLA?

recheck

Thank you @Oseltamivir The CLA test now passes. There is a problem for md5sum version detect though as the version output is different on macos. Should we change the re to r"\b\d+\.\d+(?:\.\d+)?\b" or do you have some better idea here?
md5sum --version
Microbrew md5sum/sha1sum/ripemd160sum 0.9.5 (Wed Dec  6 12:48:56 EST 2006)
  Compiled Dec  6 2006 at 17:48:56
Written by Bulent Yilmaz

Copyright (C) 2004,2006 Microbrew Software

@Oseltamivir yes, thats correct. Most times the version detection shouldn't change depending on the package manager but we still need to test. Would you like to join the weekly 30 minutes CM sync to discuss on this? It is at GMT 6:05pm Tuesdays.
https://meet.google.com/jtf-crbz-ezz?

I apologise but I dont think I can make it. I'm in GMT+8 which is around 3am... maybe I'll try next week.

No worries @Oseltamivir Let me know a good time and we can sync separately. Usually GMT 9-12 works best for me.

I think next week's CM sync should be fine. I just need to plan ahead. Sleeping nowadays at 3am anyway ¯_(ツ)_/¯

No worries. Good night! :)

@Oseltamivir Your PR was a big motivation for us to add the cm test automation which we now use to test any CM script. For get-generic-sys-util the tests are run for all variations on ubuntu-20.04, ubuntu-22.04, ubuntu24.04 and rhel9. You can see the results here

@arjunsuresh Awesome! Also, if you celebrate it, Happy Diwali!
Let me know if there are any regexes/tasks you need me to do regarding this aspect. Meanwhile, I will try to resolve issues and see if i can contribute to this repo and mlcommons/inference - my current focus is attempting to make the default reference implementation use all GPUs on a single node.

Thank you @Oseltamivir It'll be great if this PR is fixed and merged as it adds a very useful feature.
"reference implementation use all GPUs on a single node"
This is very useful as and some of the reference implementations like for llama2-70b already use all available GPUs on a node. But most of them don't.

Sure. No prob. I'll try to slowly go thru the failing tests

Got very frustrated over a specific library
pstree --version prints to stderr instead of stdout!!!! Spent the last 2 days ripping my hair out over why the regex isn't working.
Added a specific clause in the .sh that detects if command is pstree --version which will write to tmp-ver.out from stderr instead of stdout. It is a messy way but I think it is sufficient for now unless other libraries write to stderr`.
Got a feeling the errors for bzcat --version in the build tests are also caused by printing to stderr...
I will move onto check the other regexes soon. Currently wondering why dpkg -l | grep libnuma-dev failed on ResNet50... I think it might not be installed... @arjunsuresh Should we run the install command in _cm.json if tmp-ver.out is empty?

Oh. That's an interesting find. Thank you for digging into it.
I think it's better to set the below variable in _cm.json for the packages that needs error stream so that the bash script becomes cleaner.
env['CM_SYS_UTIL_VERSION_CMD_USE_ERROR_STREAM'] = yes

If tmp-ver.out is empty, but no error happens, I think we'll need to handle case by case. One option can be to say "version-undetected" but for this we need to make sure that the installation is successful.

Current issues:
For macOS build:
md5sum: command not found

I don't really understand why this error occurs except that installation wasn't successful With the correct software, it should work. Tested on a macbook.

For ubuntu:
dpkg -l | grep libnuma-dev
no packages found matching libnuma-dev
Not sure why this errors... on a numa supported device it shld work. Tested to be working on docker from runner and ubuntu bare metal.

@Oseltamivir I guess I have fixed the errors on macos - the problem is md5sum --version works fine but it still returns 255 on macos. So, added a grep suffix to the version detect command. Also, for the newly added version regular expression the group number is 0 and not 1.

@arjunsuresh I'm gonna work on the CM_REPO_PATH part for a bit, I can only access an ubuntu server on weekdays to properly test the scripts. Running docker on my macbook right now is quite limiting.
Is next week's meet still using the link: https://meet.google.com/jtf-crbz-ezz?  ?
Also, if it is possible, I hope my contributions can count towards my team's points in SCC24

Hi @Oseltamivir I removed the version detection ones which are failing and those which reply on dpkg or pkg_config as currently we assume that when version detection of a package is successful, the package is installed and available. We can fix these later. Currently all the tests are passing.


Multinomial regression

I'm not quite sure I understand how multinomial regression works. Can you explain a bit about the structure of the data matrix X and response y? Also, in the example for multinomial logistic regression the W_est does not seem anywhere near the true simulated W, even if I increase sample size n to 10000, is this expected?
In particular I am trying to fit a multinomial logistic regression to lagged response variables, how do I pass those in?

Is this package still supported? The documentation seems very lacking. I am interested in multinomial regression, but I am unsure about what the output from this package is. Which category is used as base category? What does the solution correspond to?

For multinomial logistic regression, the parameter W is not unique. For instance, W and W+1 yield the same value for the loss function. You may want to check first whether the loss function is correctly minimized or whether the classification is correctly done.
Ref: http://spark.apache.org/docs/latest/mllib-linear-methods.html

Can anyone help me figure out how to get similar results as R's multinomial regression? My data can be found here:
https://www.dropbox.com/s/1h7uns55t34c8fr/timeseries.txt?dl=0
Here is how I called R:
library(nnet)
data <- read.table("Dropbox/scripts/timeseries.txt",header=TRUE)
multinom(y~X1+X2,data)
```R
# weights:  12 (6 variable)
initial  value 10985.024274
iter  10 value 10438.503738
final  value 10438.503529
converged
Call:
multinom(formula = y ~ X1 + X2, data = data)

Coefficients:
  (Intercept)        X1        X2
2   0.4877087 0.2588725 0.2762119
3   0.4421524 0.5305649 0.3895339

Residual Deviance: 20877.01
AIC: 20889.01

using Julia my first attempt is:
using DataFrames
using Regression
import Regression: solve, Options, predict
dat = readtable("timeseries.txt", separator='\t')
X = convert(Matrix{Float64},dat[:,2:3])'
y = convert(Vector{Int64},dat[:,1])

ret = solve(mlogisticreg(X,y,3), reg=ZeroReg(),  options=Options(verbosity=:iter))
ret.sol
3x2 Array{Float64,2}:
 -0.591374  -0.442353
  0.17479    0.168595
  0.416584   0.273758

Note the response variables are just the discretized time-lagged response i.e.
julia> dat[1:3,:]
3x3 DataFrames.DataFrame
| Row | y | X1 | X2 |
|-----|---|----|----|
| 1   | 3 | 1  | 0  |
| 2   | 3 | 0  | 1  |
| 3   | 1 | 0  | 1  |

for row 2 you can see that the response (0, 1) means the previous observation was a 3. Similarly (1,0) means previous observation was a 2 and (0,0) means previous observation was a 1.


WIP: libtorch-bin: 1.10.0 -> 1.12.1

Description of changes

[x] Check on x86_64 without CUDA support.
[ ] Check on x64_64 with CUDA support.
[ ] Figure out how to fix CUDA library dependency: if you look at PyTorch download page you can mention that library is implicitly depends on libcuda (for example libtorch 1.12.1 depends on libcuda 11.3), but this is not specified in NIX configuration.
[ ] Figure out how to make version configurable in right way.
[ ] Fix hashes.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

Hello there! I am not fluent with NIX and if someone helps me -- I would be glad!

@junjihashimoto @bobby285271, can we merge it or should I do something else?

I think it can be merged, but I do not have the auth.

@SuperSandro2000, hi! Can i ask for merge?


chore: fix gitter integration

Coverage remained the same at 84.827% when pulling 2d4ef7a14212f3fb85ec6b82d75e60895db7b852 on patch/fix-gitter-integration into bd4905110cccbc9cea5c58bcbc3a3a8856a2ce09 on release/1.0.

Coverage remained the same at 84.827% when pulling 7803bd218beed64b5848ee9415174fae265df01e on patch/fix-gitter-integration into bd4905110cccbc9cea5c58bcbc3a3a8856a2ce09 on release/1.0.


[2.6] fixed k3s check for etcd

https://github.com/rancher/cis-operator/issues/108
Problem
The logic that checks for k3s clusters was not looking at the agent logs.  This caused scans to fail due to missing results.
Solution
Added a check for agent logs to the etcd check
Testing

tested on an HA k3s cluster with a sql backend
tested on HA k3s with embedded etcd
tested on single node k3s

all 3 clusters reported scan failures with the current image.  With these changes in a new rancher-security image all tests passed.

@paynejacob can you please describe what error was seen in the Sonobuoy run? Were we skipping etcd checks on nodes running k3s agent?


Sort, Filter, Search Optimization

Implemented memoization in filter and search. Accounted for edge cases. Filter is currently broken as it is in the process of being optimized for a multi-column filter. Fixed bug with arrows persisting despite a different column being sorted.

Functionality looks awesome!


Development

All my changes to-date.

I'm merging to Dev first. We can merge to master after.
Any objections?

Looks alright to me.

After all, :+1:. Great that code is working with newest version of Starbound! \o/

After a bit of discussion in the IRC, we are going to stick with the use of if len(x) == 0 style of condition. The changes you're suggest are more pythonic, but do not provide any performance benefit. In this case, being explicit is likely to be better, and we don't suffer from any ambiguity in the process.


After creating a vault the account card becomes unavailable

Describe the bug
After creating a vault the account card becomes unavailable, it's not possible to check the multisig details
To Reproduce
Steps to reproduce the behavior:

Create multisig vault
Wait until it sync
Click on vault acc card
See error

Expected behavior
A clear and concise description of what you expected to happen.
Desktop (please complete the following information):

OS: MacOS
Browser  chrome
Version 122

Additional context
Reproducible on the dev branch
https://github.com/superhero-com/superhero-wallet/assets/69896204/2299858b-d4ce-4825-8b04-2e8e3870841d

Not reproducible for me on the current dev branch


feat: 🎸 MSDK-756 Change totalSupply to initialSupply on asset creation

BREAKING CHANGE: 🧨 TickerReservation.createToken now takes initialSupply instead of
totalSupply parameter for specifying amount of tokens that will be
minted on creation

:tada: This PR is included in version 13.0.0-alpha.2 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 14.0.0-alpha.1 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 14.0.0-beta.1 :tada:
The release is available on:

npm package (@beta dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Build history-history on demand

We can actually do this with any final history by walking back the transaction time. replace the hardcoded one for /replay_demo and provide this for all tests

we can replay anything now!


Bunch of bugfixes

Replace readarray with read for backwards compatibility with older versions of bash. (#3, #4)

Exit when extracting core failed, and ask user to install/update nodejs and npm. (#5)

Strip whitespace from flavors to prevent failures.

Snap's location on Fedora is not /snap, but rather /var/lib/snapd/snap. Detect that using Snap's $XDG_DATA_DIRS.

 (I tried to make it simpler but it failed to properly kill Flatpak Discord.)

This change is

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, 6 unresolved discussions.

betterdiscordctl, line 111 at r1 (raw file):

      ;;
    -f|--flavors)
      if [ -n "${2// }" ]; then

Could this be changed to just [ -n "$2" ]?

betterdiscordctl, line 117 at r1 (raw file):

      ;;
    --flavors=?*)
      if [[ "${1#*=}" =~ ^[[:space:]]+$ ]]; then

Same thing here, with letting the user decide whether they want to pass an empty argument? This seems to deviate from normal command line behavior without much benefit.

betterdiscordctl, line 231 at r1 (raw file):

      for flavor in "${flavors[@]// }"; do
        if [ "$snap" ]; then
          if snap run --shell "discord" <<< 'echo "$XDG_DATA_DIRS"' | grep -q '/var/lib/snapd'; then

Could this be turned into a check for the Discord directory in each of the dirs provided? You should be able to eliminate the hardcoded else that way.

betterdiscordctl, line 272 at r1 (raw file):

    done
  else
    flavor="$flavors"

What's the point of this?

betterdiscordctl, line 303 at r1 (raw file):

    core_patched=yes
    if [ -h "$core/core/node_modules/betterdiscord" ]; then
      linked_dir="$(readlink -m "$core/core/node_modules/betterdiscord")"

Why does this need to be canonical?

betterdiscordctl, line 390 at r1 (raw file):

  printf 'Killing %s processes...\n' "$process_name" >&2
  pkill -ex -SIGKILL $(ps ax | awk "BEGIN{IGNORECASE=1}/discord(-){0,1}${flavor}/{print \$5}" | rev | \

Could this instead be accomplished with a pgrep call?

Comments from Reviewable

This seems to deviate from normal command line behavior without much benefit.

Fair point, I changed it back.

Could this be turned into a check for the Discord directory in each of the dirs provided?

No, but I found a better way of doing it.

What's the point of this?

Required by uninstall for PTB and Canary. Otherwise, it will only be able to kill Stable.

Why does this need to be canonical?

To avoid readlink being weird with Snap.

Could this instead be accomplished with a pgrep call?

Sadly, pgrep lacks a case-insensitive option.

Reviewed 1 of 1 files at r2.
Review status: all files reviewed at latest revision, 4 unresolved discussions.

betterdiscordctl, line 117 at r1 (raw file):
Previously, bb010g (Brayden Banks) wrote…
Same thing here, with letting the user decide whether they want to pass an empty argument? This seems to deviate from normal command line behavior without much benefit.

OK once the proper indentation is restored.

betterdiscordctl, line 303 at r1 (raw file):

To avoid readlink being weird with Snap.

What's the issue with readlink, exactly? (Also, if you could reply on Reviewable, this would be a bit easier to thread.)

betterdiscordctl, line 390 at r1 (raw file):
Previously, bb010g (Brayden Banks) wrote…
Could this instead be accomplished with a pgrep call?

OK for now then, I suppose.

Comments from Reviewable

The readlink issue should no longer be present since I've improved the Snap directory detection, and removed ${flavor,,} (as Snap Discord doesn't have any flavors, at least not yet). Before, the issue was the following:
When the modules directory for Snap Discord doesn't exist, betterdiscordctl looks for a Snap called discordcanary. However, there is no such Snap and readlink returns an error. Then, since there's no Snap data to read from, betterdiscordctl uses the default /snap path for Canary and PTB, despite having used /var/lib/snapd/snap for Stable.
I'll start using Reviewable next time.

Reviewed 1 of 1 files at r3.
Review status: all files reviewed at latest revision, 1 unresolved discussion.

betterdiscordctl, line 6 at r3 (raw file):

# Constants
VERSION=1.1.1

Changing this to 1.2.0 due to the Snap changes and it's ready to merge.

Comments from Reviewable

Reviewed 1 of 1 files at r4.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable


Callouts No Longer Wrapping

Is the bug present when using the default Obsidian theme?
No
Is the bug present when snippets and plugins are disabled?
Yes
Minimal theme version
7.0.5
Describe the bug

Callouts are no longer wrapping in the latest release, and is only reproducible with Minimal. Default theme does not have this issue and the callout correctly wraps. Tested with and without snippets/plugins.
Debug info
SYSTEM INFO:
Obsidian version: v1.3.5
Installer version: v1.3.5
Operating system: Darwin Kernel Version 22.3.0: Mon Jan 30 20:39:35 PST 2023; root:xnu-8792.81.3~2/RELEASE_ARM64_T8103 22.3.0
Login status: logged in
Catalyst license: none
Insider build toggle: off
Live preview: on
Legacy editor: off
Base theme: light
Community theme: Minimal v7.0.5
Snippets enabled: 5
Restricted mode: off
Plugins installed: 17
Plugins enabled: 17
1: Templater v1.16.0
2: Tasks v4.1.0
3: Archiver v0.23.2
4: Advanced URI v1.36.3
5: Better Command Palette v0.15.0
6: Better Word Count v0.9.6
7: Copy button for code blocks (fixed version manifest) v0.2.1
8: Dataview v0.5.56
9: Editor Syntax Highlight v0.1.3
10: Hider v1.2.5
11: Image Gallery v1.1.1
12: Minimal Theme Settings v6.3.1
13: Natural Language Dates v0.6.1
14: Natural Language Syntax Highlighting v0.3.0
15: Omnisearch v1.14.2
16: Paste URL into selection v1.7.0
17: Style Settings v1.0.6
RECOMMENDATIONS:
Custom theme and snippets: for cosmetic issues, please first try updating your theme and disabling your snippets. If still not fixed, please try to make the issue happen in the Sandbox Vault or disable community theme and snippets.
Community plugins: for bugs, please first try updating all your plugins to latest. If still not fixed, please try to make the issue happen in the Sandbox Vault or disable community plugins.

the table is also


provide flag value autocomplete for --env

Description of problem
app devs appreciate efficiency and convenience.
providing broad support for autocompleting flag values makes it possible for people to NOT remember names of items added previously by them or others.
providing autocomplete for flag values inconsistently is a bad UX and we should do all that we can to consistently deliver on the contract.
Proposed solution
apps plugin already supports autocomplete for some flag values (e.g. --namespace --- will return list of possible namespaces)
Add similar support for --env
When I've typed --env  then press <TAB>, all the current env vars keys associated with my workload are auto-suggested

Not migrated because carto v2 interactions will take place via submission of a workload.yaml with limited flag support.


RLS: configuration settings in CONFIG.md are inaccurate

For example, the instructions for RLS say that the server accepts configuration via the settings key, and lists options in "available settings" like:

rust-client.engine
rust.build_on_save
rust.rust-analyzer

That information would lead me to believe that this is a valid call to nvim_lsp.rls.setup:
nvim_lsp = require'nvim_lsp'

nvim_lsp.rls.setup {
    settings = {
        ["rust-client"] = {
            engine = "rust-analyzer",
        },
        rust = {
            build_on_save = false,
            ["rust-analyzer"] = {
                completion = {
                    addCallArgumentSnippets = false,
                    addCallParenthesis = false,
                },
            },
        },
    },
}

However, it looks like all of the settings that begin with rust-client actually don't belong inside settings, so the call should look like this...
nvim_lsp.rls.setup {
    ["rust-client"] = {
        engine = "rust-analyzer",
    },
    settings = {
        rust = {
            build_on_save = false,
            ["rust-analyzer"] = {
                completion = {
                    addCallArgumentSnippets = false,
                    addCallParenthesis = false,
                },
            },
        },
    },
}

...and nvim-lsp still complains "LSP[rls][Warning] Unknown RLS configuration: `rust_analyzer`" when opening a Rust file (which is a separate issue, filed as #274).
There are clearly some things that need to be fixed with the configuration instructions for this language server (and maybe others), but it looks like they're auto-generated, and I'm not really sure where to start. If anyone could point me in the general direction of what needs to change to fix this, I'm very happy to try, though.

Sorry, accidentally submitted early :) I'm editing now

I have somewhat related problem. I want to disable snippets, and I configure everything according to the docs but there is no effect. Snippets are still offered...
https://github.com/neovim/nvim-lsp/issues/276

it looks like they're auto-generated, and I'm not really sure where to start. If anyone could point me in the general direction

we pull those settings from vscode or whatever repo is set in docs.package_json
https://github.com/neovim/nvim-lspconfig/blob/96976f5ccf92d7f7f76926e360bbe1957bc15392/scripts/docgen.lua#L138

The main source of confusino with this, is we're passing the vscode settings automatically, when in reality these don't correspond to the settings RLS accepts, but the settings the vscode extension here. The ["rust-client"] and ["rust-analyzer"] keys are unique to vscode.
All settings for RLS are always under the settings.rust and are defined here
And documented [here](
(https://github.com/rust-lang/rls/blob/4d5e9df12b6a75d7ab48a7de060a97265ce49cee/rls/src/config.rs#L125-L177)
All of these settings should go under the settings key. I'll remove vscode parsing for this config and update the docs to make it more clear.
nvim_lsp.rls.setup {
    settings = {
        rust = {
            build_on_save = false,
            },
        },
    },
}

The main source of confusino with this, is we're passing the vscode settings automatically, when in reality these don't correspond to the settings RLS accepts, but the settings the vscode extension here. The ["rust-client"] and ["rust-analyzer"] keys are unique to vscode.
All settings for RLS are always under the settings.rust and are defined here
And documented [here](
(https://github.com/rust-lang/rls/blob/4d5e9df12b6a75d7ab48a7de060a97265ce49cee/rls/src/config.rs#L125-L177)
All of these settings should go under the settings key. I'll remove vscode parsing for this config and update the docs to make it more clear.
nvim_lsp.rls.setup {
    settings = {
        rust = {
            build_on_save = false,
            },
        },
    },
}


Add questionable dependency types?

Would it be worth including dependency types like the following?

MSI - e.g. simplify kicking off an MSI install once a file download or file system dependency has run, without requiring an external 'Task' script.
Archive - ditto, for extracting archives.  Many distribution sources offer an archive, not the raw data needed for a dependency
Command - Run the specified PowerShell command.  Introduces opportunity for injection, but would be much handier than requiring an external script, which is still theoretically an injection target (unless signed, ha)

Open to feedback, but I'm leaning towards including these, for convenience.
Cheers!

Closing this out.  If folks are interested in adding these and others, feel free to open issues / PRs!


Refactor ResolveAssemblyReference_Tests.

Move to AssemblyDependency folder (to match Tasks code).
Move classes to their own file.

Making this it's own PR before I make changes and add tests. I did not make any changes to the code itself.

git blame is making me very sad about this. Even with -C -C -C10 -w it's attributing most of the diffs to you :(
But I tried doing just a single class at a time in the hopes that doing that would provide a better hint for Git's heuristics and it didn't work. So might as well do it all at once.
Rainer.DisdainForGitIntegrationRecordHandling++;
LGTM