Fail Gracefully when Additional Telemetry Stats are Unavailable

Reported via https://discuss.elastic.co/t/es-jvm-use-zgc-esrally-cant-work/246253
Describe the feature:
This may require further investigation to identify potential areas where Rally could be more robust to missing JSON keys in ES responses. The case above occurs when using ZGC and ES is unable to provide GC statistics through the node stats api.

Hi，gingerwizard
By commenting out some code, I can now test es cluster with ZGC using esrally.
at File /Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/esrally/telemetry.py
at def on_benchmark_stop(self):
956                # young_gc_time = max(jvm_stats_end["young_gc"] - jvm_stats_start["young_gc"], 0)
957                # old_gc_time = max(jvm_stats_end["old_gc"] - jvm_stats_start["old_gc"], 0)
959                 # total_young_gen_collection_time += young_gc_time
960                 # total_old_gen_collection_time += old_gc_time
962                 # self.metrics_store.put_value_node_level(node_name, "node_young_gen_gc_time", young_gc_time, "ms")
963                 # self.metrics_store.put_value_node_level(node_name, "node_old_gen_gc_time", old_gc_time, "ms")
978         # self.metrics_store.put_value_cluster_level("node_total_young_gen_gc_time", total_young_gen_collection_time, "ms")
979         # self.metrics_store.put_value_cluster_level("node_total_old_gen_gc_time", total_old_gen_collection_time, "ms")
at def jvm_stats(self):
996            # old_gen_collection_time = gc["old"]["collection_time_in_millis"]
997            # young_gen_collection_time = gc["young"]["collection_time_in_millis"]
999                # "young_gc": young_gen_collection_time,
1000               # "old_gc": old_gen_collection_time,
If there is no mistake, just comment out these lines of code.
Although this is not a good way, the rest does not affect the test.
Because es does not support ZGC, esrally's code is still compatible with the interface data of young GC and old GC in the past, which leads to the current problem.

Hi，gingerwizard
By commenting out some code, I can now test es cluster with ZGC using esrally.
at File /Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/esrally/telemetry.py
at def on_benchmark_stop(self):
956                # young_gc_time = max(jvm_stats_end["young_gc"] - jvm_stats_start["young_gc"], 0)
957                # old_gc_time = max(jvm_stats_end["old_gc"] - jvm_stats_start["old_gc"], 0)
959                 # total_young_gen_collection_time += young_gc_time
960                 # total_old_gen_collection_time += old_gc_time
962                 # self.metrics_store.put_value_node_level(node_name, "node_young_gen_gc_time", young_gc_time, "ms")
963                 # self.metrics_store.put_value_node_level(node_name, "node_old_gen_gc_time", old_gc_time, "ms")
978         # self.metrics_store.put_value_cluster_level("node_total_young_gen_gc_time", total_young_gen_collection_time, "ms")
979         # self.metrics_store.put_value_cluster_level("node_total_old_gen_gc_time", total_old_gen_collection_time, "ms")
at def jvm_stats(self):
996            # old_gen_collection_time = gc["old"]["collection_time_in_millis"]
997            # young_gen_collection_time = gc["young"]["collection_time_in_millis"]
999                # "young_gc": young_gen_collection_time,
1000               # "old_gc": old_gen_collection_time,
If there is no mistake, just comment out these lines of code.
Although this is not a good way, the rest does not affect the test.
Because es does not support ZGC, esrally's code is still compatible with the interface data of young GC and old GC in the past, which leads to the current problem.


Two CSS bugs in settings

While translating, I noticed two bugs in the styling of the Settings page:

In the websites subitem, between screen widths 770px and 1200px, the buttons to edit, share etc will flow beyond their parent div, overlapping the domain URL next to it in German and Dutch. These languages (and probably others) use more characters than their counterparts in Chinese and English;
When below 990px in width, the submenu with websites, accounts and profile will have a higher z-index than the dropdown-menu for language selection, overlapping it.

Thanks, will take a look

Fixed in #130


3 New Features

https://trello.com/c/xfKk7DQq
https://trello.com/c/UEFFrJTE
https://trello.com/c/aq0Ptwqd

If we get this approved and merged in I will pull in Spencer's branch and get that merged in as well


Add forward page type to NavigatingEventArgs

ForwardPageType lets know the page type NavigationService is navigating
to.

Let's call it TargetPageType and let's also include TargetPageParameter, right?

@JerryNixon Sounds good!


fix(deps): update dependency bootstrap-vue to v2.0.0-rc.15

This PR contains the following updates:

Package
Type
Update
Change
References

bootstrap-vue
dependencies
patch
2.0.0-rc.14 -> 2.0.0-rc.15
homepage, source

Release Notes

bootstrap-vue/bootstrap-vue
v2.0.0-rc.15
Compare Source
Released: 2019-03-18
Bug Fixes v2.0.0-rc.15

carousel: fix touchmove handler to re-enable swipe gestures
(#2844)
(a067f8c)
form-radio/form-checkbox: ensure required prop propagated in group mode (fixes
#2839)
(#2842)
(fc24589)
pagination-nav: fix race condition with clicking prev/next buttons
(#2834)
(42f14e1)
table: allow string for pagination prop types
(#2824)
(31d2044)
table: don't emit row-clicked when user is selecting text (Closes
#2791)
(ecf0689)
util/loose-equal: handle comparing sparse arrays
(#2813)
(6ac8ade)
utils/get: handle cases when field value is not array or object (closes
#2807)
(#2808)
(c656fa3)
utisl/observeDom: make sure to check for browser enviroment
(#2838)
(8471f31)

Features v2.0.0-rc.15

docs: get recommended Vue.js and Bootstrap version from package.json
(#2840)
(3a6702e)
pagination-nav: auto-detect current page based on $route/URL. Add support array of links
(#2836)
(65e12f8)
table: new option to disable footer sorting
(#2802)
(bc443a3)

Renovate configuration
:date: Schedule: At any time (no schedule defined).
:vertical_traffic_light: Automerge: Disabled by config. Please merge this manually once you are satisfied.
:recycle: Rebasing: Whenever PR is stale, or if you modify the PR title to begin with "rebase!".
:no_bell: Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/cc @rmathis


Support for reshaping tensors

I'm wondering what the preferred method of reshaping a tensor is? The method I've been using thus far has been
# a is some node with shape (2,2,2)
a = tn.Node(a.tensor.reshape((4,2)))

It seems like there should be a way already built-in, but I have not been able to find anything in the documentation.

What's your goal?

I have a generic method that acts on MPOs, where each MPO is represented as a list of L rank 4 nodes. From a different method, I've constructed an MPO where the bottom-most tensor is rank 3, and I wanted to reshape that with a trivial leg to feed it back into my method that acts on MPOs. Of course, I could just catch this particular case in my first method or take an outer product with a trivial vector, so my question is less motivated by this particular goal, and more by wanting to learn how to use the library properly Is the philosophy to just provide the methods that generally make reshaping necessary (e.g., split_nodes_qr)?

Aw I see. For now your method would work but it would be nice to add some sort of reshaping feature.
We have an issue open for #150 which would get you close to what you want. Full reshapes however could get messy once nodes are connected to each other so I'm not sure we will support that (especially since your method works well enough).

Thanks!


Fix Kabsch algorithm (rigid alignment)

Hi! Thank you for this piece of work. I noticed a mistake in your rotation matrix computation (part of the Kabsch algorithm for alignment) here:
# Rotation matrix
R = V.mm(U.T)

should be replaced with
# Rotation matrix
R = V.mm(U.T)
# Ensure R is a proper rotation matrix
if torch.det(R) < 0:  # reflection
    V[:, -1] *= -1  # flip the sign of the last column of V
    R = V.mm(U.T)

See this link for justification

Thanks for looking into this and for the quick PR.


Add support for CC-BY-4.0

Add support for CC-BY-4.0
Related issue
#19

Added in commit https://github.com/philips-software/bom-bar/commit/175e83e89bc78b57a225e4facdeb604aaae55efb


Download stuck at attachment working fine if try skip attachment

I try to download 3 courses, but every time they stuck when the user tries to download attachments, I try to skip attachments and it worked. need a fix asap

Check the new alternative version:
https://github.com/FaisalUmair/udemy-downloader-gui/pull/631


Support for Steam, Meta, Vive stores

Proposal
Google and Apple aren't the only mobile dev platforms - any consideration for other stores, like Steam, the Meta/Quest stores, and the Vive store?
What this achieves / problem(s) it solves
Mobile Apps developers frequently work with Unity and other applications, and release their mobile apps (VR) on the Quest store, and PC apps on Steam, and both on the Vive Store; then do another mobile release on the traditional stores.
Building pipelines for these as well as the traditional Tramline would be useful. I do see frequent releases on both the App/Play stores, as well as the Quest store for a similar app (or a non VR build).
Steam isn't mobile, but again quite often it's the same Unity project, just different build options.
Alternatives
Custom CI/CD, or Unity paid services
Additional context
Not always mobile builds, but integrating into stores is still a bit of a mess.

Hi @jgwinner, thanks for the proposal.
You are absolutely right. There are definitely other stores than just those 2. And not just stores, SDKs for example, ship to different distribution environments, like maven.
We do support other distribution environments, like Firebase App Distribution and our interfaces are designed in a way that we can easily add new stores or store-like distribution platforms.
In general, our distribution environments are classified as:

Rolloutables (staged/phased rollouts on app store or play store supported)
Depositories (just artifact shipping)

Since you took the time to write this out, I'm assuming you need this. Would love to talk to you about what you're building and if we can help add support. Feel free to book a call here.
...also curious, how did you discover us? :)


Warning Supression

I believe that I suppressed or fixed the 11 warnings that popped up.
Task Card: https://trello.com/c/i8tHu9zP/929-programming-fix-or-suppress-warnings

Looks good to me.


Can't Reblog Posts

Using the following:
t.post('post/reblog', params={'id':someid,'reblog_key':somereblog_key})

I get:
Invalid ID or reblog_key specified

I have double checked the reblog key on the post and the id, these are correct, however no matter what I do I get that result, I even built my own module to reblog posts in request_oauthlib!

Can you send over the reblog key and the blog you're trying to post to?

@michaelhelmick
'id': '148261317949'
'reblog_key': 'AmhAWZ1X'

I really wonder if it has to do with the fact that the api documentation say it wants a number for the reblog key, but you can only get a str/int mix from the posts endpoint

@MaxLFarrell Hm, that really could be it. :/ Have you tried reaching out to any Tumblr (API?) devs on TwitteR?


CFFL

CFFL

Linter check found the following problems:
The following problems have been found:
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:16: pip_install_args: pip install should be run with --no-deps.
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:21: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:28: missing_imports_or_run_test_py: Python packages require imports or a python test file in tests.
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:28: missing_pip_check: For pypi packages, pip check should be present in the test commands
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:34: missing_license_family: The recipe is missing the about/license_family key.
WARNING: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:34: missing_description: The recipe is missing a description
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:34: missing_dev_url: The recipe is missing a dev_url
ERROR: /tmp/abs_46eo0d6hqu/clone/recipe/meta.yaml:34: missing_documentation: The recipe is missing a doc_url or doc_source_url
Errors were found


Rendering inconsistency between Jekyll-now and Github Pages

@barryclark
I am totally new to Github, css and markdown, so please bare with me. Can anyone please explain why the .md files on Github are rendered in a nice way, whereas they get messed up (especially if they have tables) by Jekyll-now? Perhaps there is something I am missing.
I have produced this .md file using Jupyter and R:
https://github.com/zizzipupp/zizzipupp.github.io/blob/master/_posts/2017-05-05-Modern-Italian-immigrants-in-Canada-and-Preferential-Attachment.md
When turned into a blog post with Jekyll-now, its appearance is somewhat different (e.g., tables are not displayed correctly and the font is different):
https://zizzipupp.github.io/Modern-Italian-immigrants-in-Canada-and-Preferential-Attachment/
Thanks!

The .md markdown file is displayed on Github and uses the default style of Github and the CSS they display .md files in. When you view the post on your site it uses the CSS/SCSS from Jekyll-Now and the styling from that. Both of which are different hence the different display styles.
You can override the styling from Jekyll-Now by editing the scss file or by creating your own css file and following a similar process to what is mentioned in this issue here https://github.com/barryclark/jekyll-now/issues/381.


Databases: Created seeding for order_items table

Description
Created seeding for order_items table
Fixes #105
How to test?
using the command: npm run db:setup
Checklist

[X] I have performed a self-review of my own code
[X] I have followed the name conventions for CSS Classnames and filenames, Components names and filenames, Style filenames, if you are in doubt check the the project README.MD and here https://github.com/HackYourFuture-CPH/curriculum/blob/master/review/review-checklist.md
[X] I have commented my code, particularly in hard-to-understand areas, if you code was simple enough mark the box anyway
[X] I have made corresponding changes to the documentation, if you code was simple enough mark the box anyway
[X] This PR is ready to be merged and not breaking any other functionality

Merged and closed this PR after the approval from the reviewers 👍


Redis subscription not receiving messages

I'm currently observing the problem, that my echo server is connecting and subscribing to the Redis server, but either redis does not notify the Echo server on changes or the echo server somehow ignores them.
What I can say is, that the connection to Redis is not the problem, as I see
1525869918.408567 [0 <IP_ADDRESS>:44670] "info"
1525869918.411548 [0 <IP_ADDRESS>:44670] "psubscribe" "*"

in the Redis monitor (redis-cli monitor) everytime I start the Echo server.
I am pretty sure that the fault is not on the client side either, as the client gets notified perfectly fine when I send the event via http request to the Echo server.
Currently the request looks as following:
POST http://domainname.local:6001/apps/APP_ID/events?auth_key=XYZ...

{
  "channel": "songs",
  "name": "changed",
  "data": {
      "key": "value"
  },
  "socket_id": "xyz..."
}

and the client side code:
window.Echo = new Echo({
	broadcaster: 'socket.io',
	host:        window.location.hostname + ':6001'
});

window.Echo
	.channel('songs')  // does not work with queues:songs either
	.listen('.changed', function ( message ) {
		console.log('msg:', message);
	});

Furthermore the connection between Laravel and Redis looks like its working too, as I clearly see a select and rpush event in the monitor everytime I trigger a new event:
1525870254.030392 [0 <IP_ADDRESS>:47390] "SELECT" "0"
1525870254.030476 [0 <IP_ADDRESS>:47390] "RPUSH" "queues:songs" "{\"displayName\":\"App\\\\Events\\\\SongQueueChanged\",\"job\":\"Illuminate\\\\Queue\\\\CallQueuedHandler@call\",\"maxTries\":null,\"timeout\":null,\"timeoutAt\":null,\"data\":{\"commandName\":\"Illuminate\\\\Broadcasting\\\\BroadcastEvent\",\"command\":\"O:38:\\\"Illuminate\\\\Broadcasting\\\\BroadcastEvent\\\":7:{s:5:\\\"event\\\";O:27:\\\"App\\\\Events\\\\SongQueueChanged\\\":4:{s:14:\\\"broadcastQueue\\\";s:5:\\\"songs\\\";s:9:\\\"\\u0000*\\u0000status\\\";s:7:\\\"playing\\\";s:11:\\\"\\u0000*\\u0000playlist\\\";a:3:{i:0;s:6:\\\"Song 1\\\";i:1;s:6:\\\"Song 2\\\";i:2;s:7:\\\"Song 90\\\";}s:6:\\\"socket\\\";N;}s:10:\\\"connection\\\";N;s:5:\\\"queue\\\";N;s:15:\\\"chainConnection\\\";N;s:10:\\\"chainQueue\\\";N;s:5:\\\"delay\\\";N;s:7:\\\"chained\\\";a:0:{}}\"},\"id\":\"dq7qal9tZfdhtF7bUc8FqdTrHaLPXfsB\",\"attempts\":0}"

Additionally, why I think the subscription itself does not work properly, is because I only see joined and left channel messages in the Echo servers output:
[15:17:45] - imnvaWIivq-XBL3qAAAA joined channel: songs
[15:17:47] - imnvaWIivq-XBL3qAAAA left channel: songs (transport close)

But there are additional outputs when sending events via http (I assume they should be there too when getting events via Redis?)
Channel: songs
Event: changed

So either I am overseeing something or this may be a bug in the echo server?
If anyone has an idea or an hint on what could be wrong, I'd appreaciate any help.
Just to be complete, my event looks like this:
class SongQueueChanged implements ShouldBroadcast {

		use Dispatchable, InteractsWithSockets, SerializesModels;

		public $broadcastQueue = 'songs';

		protected $status;
		protected $playlist;

		public function __construct ( $status, $playlist ) {
			$this->status   = $status;
			$this->playlist = $playlist;
		}

		public function broadcastWith () {
			return [
				'status' => $this->status,
				'queue'  => $this->playlist
			];
		}

		public function broadcastAs () {
			return 'changed';
		}

		public function broadcastOn () {
			return new Channel('songs');
		}
	}

and I'm triggering the event like this:
$status   = 'playing';
$playlist = [
	'Song 1',
	'Song 2',
	'Song ' . rand( 3, 99 )
];

event( new SongQueueChanged( $status, $playlist ) );

The laravel-echo-server.json:
{
	"authHost": "http://domainname.local",
	"authEndpoint": "/broadcasting/auth",
	"clients": [
		{
			"appId": "APP_ID",
			"key": "XYZ..."
		}
	],
	"database": "redis",
	"databaseConfig": {
		"redis": {
			"port": "6379",
			"host": "domainname.local"
		}
	},
	"devMode": true,
	"host": null,
	"port": "6001",
	"protocol": "http",
	"socketio": {},
	"sslCertPath": "",
	"sslKeyPath": "",
	"sslCertChainPath": "",
	"sslPassphrase": "",
	"apiOriginAllow": {
		"allowCors": false,
		"allowOrigin": "",
		"allowMethods": "",
		"allowHeaders": ""
	}
}

Echo server output on startup:
$ laravel-echo-server start

L A R A V E L  E C H O  S E R V E R

version 1.3.6

⚠ Starting server in DEV mode...

✔  Running at localhost on port 6001
✔  Channels are ready.
✔  Listening for http events...
✔  Listening for redis events...

Server ready!

Node.js v8.9.1 (using NVM)
Laravel Framework 5.6.21
Redis Version: 3.0.6
Laravel Echo Server Version 1.3.6
on Ubuntu 16.04 LTS (I did not have the time to check on another machine yet)

Same situation here :(

As I see, currently this is not implemented.
If you broadcast an event via API, its only broadcasts to clients hanging on the sockets. So the event is not published on Redis or the other drivers.
See: https://github.com/tlaverdure/laravel-echo-server/blob/134f9093392cc098660a0e945999811aad983500/src/subscribers/http-subscriber.ts#L47


ELK Loader - Error convert float to long

Running ELK loader and it's erroring when trying to publish to Elastic 9200
{"took":17,"errors":true,"items":[{"index":{"_index":"metrics","_type":"_doc","_id":"9As5yn0BUnE7cHQyOcUs","status":400,"error":{"type":"illegal_argument_exception","reason":"mapper [runtimeManagerMetrics.cloudhub.applications.sandbox.details.vcoresUsed] cannot be changed from type [float] to [long]"}}},{"index":{"_index":"metrics","_type":"_doc","_id":"9Qs5yn0BUnE7cHQyOcUs","status":400,"error":{"type":"illegal_argument_exception","reason":"mapper [runtimeManagerMetrics.rtf.applications.sandbox.details.coresReserved] cannot be changed from type [long] to [float]"}}}]}

Appears that we need to adjust some dataweave to ensure that 0 == 0.0
Elastic is not happy with the difference between these values


Add affected populations dashboard with a single table.

Adding the table that was crowding the ICU projections dashboards as a separate single table.

Per your suggestion I'll add this back into your dashboard under a collapsable element.  I'll tag you for review on that shortly


Update README.md

don't do these pr please

okay bro just checking if everything on insta was true or not
On Fri, Feb 9, 2024 at 12:41 AM Shourya Maker Lab @.***>
wrote:

don't do these pr please
—
Reply to this email directly, view it on GitHub
https://github.com/expressjs/expressjs.com/pull/1459#issuecomment-1934773964,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASKAZV4JBTVRDDFHN3LVELLYSUPNFAVCNFSM6AAAAABDAINHBGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMZUG43TGOJWGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

@Aayush-Joshi-01 please contribute meaningfully. Closing this for now as it's a invalid PR.


Investigate WebGPU support

WebGPU is coming, although it's still in a early stage and needs years for wide supports, for sure now is the right time to do some investigations.
IMHO, with a simple and low level design, regl has the potential to migrate to WebGPU in a smooth way with few backward compatible API changes. And that would be a great news for all the regl users.
References:

#378 Investigate WebGL 2.0 support
WebGPU implementation status
 (Three.js issue) Will there be WebGPU based renderer?
(Babylon.js issue) WebGPU support
(Babylon.js doc) Introduction of WebGPU extension

Honest question: would a regl-like wrapper be necessary with WebGPU? A big part of regl's value is that it shuffles state under the rug by wrapping the underlying stateful API. (As an internal detail, of course, regl goes quite a bit further and performs lots of code generation to accomplish this efficiently.)
If I understand correctly, and I probably don't, WebGPU's representation actually has default values, e.g. Depth/Stencil state so it's not immediately clear to me that you simply draw using whatever state the last command happened to leave the GPU in.
I could be mistaken. I haven't actually worked with it, but my initial sense was that the setup is probably fairly verbose and could really benefit from something like regl that makes it simple, fun, and convenient to work with, but that the state management piece, which is where perhaps 70% of regl's effort goes, may simply not be a problem with WebGPU.

Looks like someone already made a WebGPU version of REGL: https://github.com/stackgpu/Simple-GPU

You can pay attention to GEngine, the engine provides a Model class that can be used for basic rendering packaging, very flexible and easy to use


cannot import name 'SCOPES' from 'core.config'

Error on clean install...
  File "./main.py", line 6, in <module>     from core import urls   File "./core/urls.py", line 8, in <module>     from apps.oauth2.urls import router as router_oauth2   File "./apps/oauth2/urls.py", line 4, in <module>     from apps.oauth2.views.token_access import router as router_token_access   File "./apps/oauth2/views/token_access.py", line 12, in <module>     from core.config import SCOPES ImportError: cannot import name 'SCOPES' from 'core.config' (./core/config.py)

Thanks for reporting and it fix today on tag 0.1.2


When user defines a new tier attribute given a name of an existing tier attribute, system updates only the attribute value of the original to updated.

Description:

Issue Description
When there is an already defined custom attribute for application level tier, on the edit view of the tier attributes (admin dashboard > throttling tiers > 'Edit tier' page ) are visible as non editable fields.
Yet when user adds an attribute, given an attribute name same as existing attribute with a different value system updates the original attribute's name with the new value and when user saves changes system saves and exit from the edit tier page.
Expected

attributes also should be editable.
When user tries to add an attribute given the same name system should validate for duplicates

From https://wso2.org/jira/browse/APIMANAGER-4521

This behavior is slightly different in APIM 3.0.0 milestone pack and the users are allowed to add duplicate attributes for subscription throttling tiers (same parameter key with same parameter value and the old attribute value is not getting replaced with the new one)

Invalid due to  ui revamp


New analytics/monitoring host

Deploy a new host on Digitalocean that handle analytics and monitoring in one place:
Debian Bullseye
Jupyter 4.7.1
Pandas/Numpy/Seaborn & co
Netdata 1.29.3
Prometheus 2.24.1
Receive syslog
This will make it easier to do analyze data from different data sources. Also remove need to manage version updates and security fixes manually.

The host is deployed. The logging will be done as part of https://github.com/ooni/backend/issues/323


Add instructions to setup kubeflow using ArgoCD

This change is

/assign @jlewi

/ok-to-test
This is great; just a few comments.

@jlewi Thanks, and I just pushed some changes to address your comments! Can you take another look when you have a chance?

/lgtm
/approve


Add missing clear API in GenericTraitUpdatableDataSink interface

Codecov Report

Merging #485 into master will decrease coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #485      +/-   ##
==========================================
- Coverage   54.05%   54.04%   -0.01%
==========================================
  Files         344      344
  Lines       59060    59060
==========================================
- Hits        31922    31919       -3
- Misses      27138    27141       +3

Impacted Files
Coverage Δ

src/lib/support/ASN1Writer.cpp
87.39% <0%> (ø)
:arrow_up:

src/lib/profiles/security/WeaveCert.cpp
88.5% <0%> (-0.46%)
:arrow_down:

src/lib/profiles/security/WeaveToX509.cpp
88.17% <0%> (ø)
:arrow_up:

src/test-apps/TestCASE.cpp
95.89% <0%> (-0.23%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1d46cb9...67bc891. Read the comment docs.


Deparment of Defense Common Access Card Malware - Does this count?

https://krebsonsecurity.com/2022/05/when-your-smart-id-card-reader-comes-with-malware/
I think it does. @bentztozer ???

I think it does as well.  Do you want me to add it to the list?
Bentz Tozer
In-Q-Tel
Vice President
Cyber Practice
Office:<PHONE_NUMBER>
Mobile:<PHONE_NUMBER>
From: John Speed Meyers @.>
Sent: Thursday, May 19, 2022 8:42 AM
To: IQTLabs/software-supply-chain-compromises @.>
Cc: Tozer, Bentz @.>; Mention @.>
Subject: [IQTLabs/software-supply-chain-compromises] Deparment of Defense Common Access Card Malware - Does this count? (Issue #30)
https://krebsonsecurity.com/2022/05/when-your-smart-id-card-reader-comes-with-malware/https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkrebsonsecurity.com%2F2022%2F05%2Fwhen-your-smart-id-card-reader-comes-with-malware%2F&data=05|01|btozer%40iqt.org|7aa5db00e9f94753416508da3994eb6c|4e14f559d5ad4de78710d763a7bf84d8|0|0|637885609020958906|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=rEgxVwNw83Zl0gli8%2FroGw6pbe6AXnRuVFQDBrEG09o%3D&reserved=0
I think it does. @bentztozerhttps://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fbentztozer&data=05|01|btozer%40iqt.org|7aa5db00e9f94753416508da3994eb6c|4e14f559d5ad4de78710d763a7bf84d8|0|0|637885609020958906|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=rT%2FNPHNIpDqv%2BrB4Daih63y%2BWquCHDCQ2q79O1Qzg%2Bw%3D&reserved=0 ???

Reply to this email directly, view it on GitHubhttps://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FIQTLabs%2Fsoftware-supply-chain-compromises%2Fissues%2F30&data=05|01|btozer%40iqt.org|7aa5db00e9f94753416508da3994eb6c|4e14f559d5ad4de78710d763a7bf84d8|0|0|637885609020958906|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=6hQ1FIQMNfmK3ZMw%2Bgd1fC7m%2BFyAH76zgZVe%2B529TIk%3D&reserved=0, or unsubscribehttps://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FASHRBDJBORJQGK3AU53I2QLVKYZIHANCNFSM5WMC6BMA&data=05|01|btozer%40iqt.org|7aa5db00e9f94753416508da3994eb6c|4e14f559d5ad4de78710d763a7bf84d8|0|0|637885609020958906|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=t2QcNpfpuqJYtTc1c8BxDkJACTF1UwqGWA36ziZaQU8%3D&reserved=0.
You are receiving this because you were mentioned.Message ID: @.***>

Yes please! Also, did you mean to copy in that info above? I think you can edit the comment.

Thanks for the heads up, and will do.


[Minor] Some typos I found in the paper and the docs

Paper

Line 24: dislay
Line 31: snub.io.add_splikeplot

Docs

Homepage: snub.io.add_splikeplot
Calcium imaging tutorial: There are also a behavior annotations (the "a" should be removed).

Wow thank you for catching these! Fixed here https://github.com/calebweinreb/SNUB/commit/389dde73608ff707c720cb2e053fc66d789083d6


Update API swagger on direct file changes

Currently the swagger file updates are supported only when the user interacts with the xml file via the UI. But ideally we must track any changes that the user makes directly to the xml file and update the swagger accordingly.

The latest release v1.1.1 has resolved this issue. Please reopen if the problem persists.


cURL commands do not have a common base URL

Right now the server URL is hardcoded into the cURL scripts; this makes it tedious to change the scripts to use with a different location (such as the Heroku application).
A config script to output the base URL should be created, and the cURL scripts should extract the URL like so:
base_url.sh:
#!/bin/sh

base_url="http://localhost:8080"
echo $base_url

post_entity_command.sh:
#!/bin/sh

base_url=$(./base_url.sh)
...
(cURL command here)

Resolved in above-referenced commit.


Fix #1355: add general-purpose Feature flag system

What this PR does:
Adds extensible Feature-Flag system to allow both default, system prop setting, and per-request overrides.
Initially just a single feature is added, "tables":

As YAML Config entry: stargate.feature.flags.tables
As HTTP header: Feature-Flag-tables (case-insensitive)

That is: when starting; may specific fixed enabled/disabled via application.yaml or system property; latter like:
./mvnw quarkus:dev -Dstargate.jsonapi.operations.database-config.local-datacenter=dc1 \
  -Dquarkus.log.console.darken=2  -Dstargate.feature.flags.tables=true

but if no setting specified (and ONLY in that case), per-request curl header like:
curl -i --location --request POST ... --header 'Feature-Flag-tables: true'

can be used to enable/disable processing
Which issue(s) this PR fixes:
Fixes #1355
Checklist

[x] Changes manually tested
[ ] Automated Tests added/updated
[ ] Documentation added/updated
[x] CLA Signed: DataStax CLA

Ready for initial review: need to think about how this could be tested better.

Ok: situation at the end of week:

Things work wrt Config, Header overrides, with manual testing
Addressed doc/comment suggestions
Figured out how to do ITs, to verify same as (1)
Ran out of time to address one last major thing ("I really want to get the DataApiRequestInfo onto the CommandContext and remove the dependency injection. ") -- hoping to check that on monday.
Aside from (4), ready for re-review!

reviewed in person, Done for me . Will approve, and then we need to get the error object V2 flag to use features config

Last changes; will merge once CI passes.


Christmas Minecraft Server

Look, it's almost Christmas, it's Cyber Discovery, it's basically the law that we make a Minecraft server.
In #announcements on the Discord server you can vote between modded and vanilla. Here you can add additional comments (modpack suggestions and the likes).

And is everyone going to actually use this?

h o w a b o u t n o
Yes
No but seriously what does Christmas have to do with Minecraft?
Well, when it's christmas eve and no snow's falling down, and you're all around, no there's no one around, you play minecraft
And is everyone going to actually use this?
Yes

And is everyone going to actually use this?
Yes

It was you THERE'S the Minecraft Christmas link ☹ I am very upset and disappointed at having the song in my head @thebeanogamer you should be ashamed and feel awful

It was, I'm sure you are, I am, I do

Close I beg lol

Nah

vanilla best

Please dont make me do what I had to last year which was to ask beano to give me a step by step guide on how to install the mods

are you that incapable fuze? lol

Please dont make me do what I had to last year which was to ask beano to give me a step by step guide on how to install the mods

If we do modded, and we will, I'll make a guide on the activity night wiki

I've messaged beano about this, but I'll also go ahead and post this here to offer my two cents and personal experiences, so if you guys do vote for modded, there's already some ideas on the table!
In no particular order, here are some recommendations.
FTB Stoneblock - My personal favourite so far. Changes quite a few of the mechanics of how you actually play minecraft, with lots of mods and end-game content to add to that. Can be found on Twitch launcher I believe.
RLCraft - If you're after something truly brutal. I wouldn't really recommend this for a CD minecraft server without confirming with anyone interested first, as this modpack is truly just unfair lol. This is also on the Twitch launcher.
Technic Pack is always a safe bet. (Obviously, on the Technic launcher)
Tekkit (regular) can also be similar to the above. Also on the technic server.

Considering another kind - something like Skyblock? This would be more work to set up (which I'd be willing to help with), but would certainly make an interesting change from the types we've run before! Perhaps this could be a nice middle ground - vanilla minecraft, but with variant maps!

Also - CD game nights. Why not bring on a good bit of MC Survival Games to spark things up?```

I would probably be wary of skyblock as a fun Christmas server, because it's really hard to actually collaborate on skyblock. You either end up with lots of people on a single island, which gets hectic, or everyone on their own islands, which kills the social aspect of it. Vanilla skyblock is also super dead unless you have stuff like "server shops" etc where you can get actually useful resources, because without that there's little to do other than build huge structures and farms for little purpose.

@Bottersnike You raise very fair points - but keep in mind that was just a suggestion. Sure, I agree, Skyblock kills the social, working-together aspect greatly. There are however other alternatives!

Haha yeah. I'd have chipped in with modpack suggestions but I haven't played modded in sufficiently long that I can't really rattle off any decent ones (that you don't need a super-powered rig to use) off the top of my head :joy:

(that you don't need a super-powered rig to use)
All of the modpacks I recommended ran easily at 60fps on my 8gb RAM, i5-8250U, MX150 laptop!
I can't say what it would have been for integrated graphics solutions, but they're by no means Hexxit level ;)

8gb RAM, i5-8250U, MX150

You shouldn't expect people to have such a decent laptop.

@NilsIrl I don't - there will be people wkth better, and people with much worse, of course. But it's also fairly likely that a good chunk of the playerbase have better-specced PCs too

@thebeanogamer Even if the server is voted to vanilla I would suggest you implement one player sleep so the whole server does not have to wait for it to become day. You can do this with a simple data pack: https://www.madcatgaming.com/one-player-sleep-data-pack/ . And maybe make a new option “slightly modded” for mods that don’t really affect gameplay such as a mod that makes chests into presents etc.

If we go with vanilla, could we have a few quality of life datapacks, like the ones at https://vanillatweaks.net/picker/datapacks/  ?

Not that many @Geek202 then it’s not vanilla at all anymore.

I would suggest you implement one player sleep so the whole server does not have to wait for it to become day

Not enabling that can also create a sort of challenge. Depends on what the server aims to be.

chests into presents

That is something that is best done client side using resourcepacks.

Not enabling that can also create a sort of challenge. Depends on what the server aims to be.

Fun is the goal over all else

That is something that is best done client side using resourcepacks.

That happens automatically at Christmas. Alternatively: https://bdcraft.net/downloads/xmasbdcraft-minecraft/

I would suggest you implement one player sleep so the whole server does not have to wait for it to become day.

Be very wary of this with a modded server. Sure, easy and simple to implement in a vanilla server build, probably not possible in a modded server. I know Forge doesn't support it, and I'd be surprised if something like CraftBukkit did either.

I know Forge doesn't support it, and I'd be surprised if something like CraftBukkit did either

I have 0 doubt that you could make a Bukkit plugin that would do that

I have 0 doubt that you could make a Bukkit plugin that would do that

I'm not sure you know, but Forge, the most common modded-minecraft binary, doesn't support bukkit plugins

Or, you know... https://www.curseforge.com/minecraft/mc-mods/morpheus

Or, you know... https://www.curseforge.com/minecraft/mc-mods/morpheus

Sure, that works too

I'm not sure you know, but Forge, the most common modded-minecraft binary, doesn't support bukkit plugins

Or you know...
https://www.spigotmc.org/resources/one-player-sleep.31585/
https://dev.bukkit.org/projects/sleep
https://www.curseforge.com/minecraft/bukkit-plugins/singleplayersleep2

I'm not sure you know, but Forge, the most common modded-minecraft binary, doesn't support bukkit plugins

Or you know...
https://www.spigotmc.org/resources/one-player-sleep.31585/
https://dev.bukkit.org/projects/sleep
https://www.curseforge.com/minecraft/bukkit-plugins/singleplayersleep2

Again. These are bukkit plugins. Forge does not support these.

Forge does with the help of catserver or something similar ;)
https://github.com/Luohuayu/CatServer

Forge does with the help of catserver or something similar ;)
https://github.com/Luohuayu/CatServer

I mean, sure, there are hacks to get plugins working with Forge. I can't find any decent documentation on CatServer, nor anyone discussing it on forums (from a quick google search), though


Upgrade camunda platform helm chart

Description
Our dependency on the Camunda platform was outdated, for quite a while. This is problematic since we are not testing features, we have built and also not the setup of Camunda platform helm chart anymore.
Changes
Several things have changed: the support of ES 8, migration to a different ES helm chart (bitnami), the curator was replaced by ILM, labels have changed, and no longer sub-charts in Camunda Platform (only sub-folders in the templates as of now).
The PR includes several adjustments to the values files to cover these changes.
Closes https://github.com/zeebe-io/benchmark-helm/issues/127
Closes https://github.com/zeebe-io/benchmark-helm/issues/126
Closes https://github.com/zeebe-io/benchmark-helm/issues/125
Security context:

We need to make sure that we don't overwrite existing values, from containerSecurityContext (there are now existing defaults)
The init container for pyroscope needs to be run as non-root as well, and has to be configured in this way

Elasticsearch:

Upgrade ES to supported 8.9.x version
Enable new ILM retention configuration, and set useful configuration for minimumAge
ES configuration didn't worked anymore, we had to migrate this to the bitnami ES helm data structure
Prometheus elasticsearch metrics: The ES URI has changed and had to been adjusted

Furthermore, due to the sub-chart to sub-folder migration in the camunda platform charts, several path have changed, which we had to adjust in our golden tests.
Benchmark
Right now we have a benchmark running to verify whether everything works, especially ILM and elasticsearch setup etc.
https://grafana.dev.zeebe.io/d/zeebe-dashboard/zeebe?orgId=1&var-DS_PROMETHEUS=prometheus&var-cluster=All&var-namespace=ck-test-helm&var-pod=All&var-partition=All&from=1705065208717&to=1705067183123

Elasticsearch metrics can be found here
https://grafana.dev.zeebe.io/d/elasticsearch/elasticsearch?orgId=1&var-datasource=prometheus&var-cluster=All&var-namespace=ck-test-helm&var-index=All

I investigated further the ILM deletion, and thought first it doesn't work with the ILM settings which is why I made it possible to create hourly based indices https://github.com/camunda/zeebe/pull/15953
Turned out I was wrong. I have a running benchmark without changing the indices and the smaller disk size (16 gig) and it is running strong.

Based on the logs we can see that the indexes need to go through different phases before getting deleted (I just selected on index for s:
# Creation
[2024-01-16T19:59:00,325][INFO ][o.e.x.i.IndexLifecycleTransition] [zeebe-benchmark-test-elasticsearch-master-1] moving index [zeebe-record_variable_8.5.0-snapshot_2024-01-16] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [zeebe-record-retention-policy]
[2024-01-16T19:59:00,783][INFO ][o.e.c.r.a.AllocationService] [zeebe-benchmark-test-elasticsearch-master-1] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[zeebe-record_variable_8.5.0-snapshot_2024-01-16][0]]])." previous.health="YELLOW" reason="shards started [[zeebe-record_variable_8.5.0-snapshot_2024-01-16][0]]"

# start of deletion
[2024-01-16T20:18:59,809][INFO ][o.e.x.i.IndexLifecycleTransition] [zeebe-benchmark-test-elasticsearch-master-1] moving index [zeebe-record_variable_8.5.0-snapshot_2024-01-16] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"delete","action":"delete","name":"wait-for-shard-history-leases"}] in policy [zeebe-record-retention-policy]

[2024-01-16T20:28:59,772][INFO ][o.e.x.i.IndexLifecycleTransition] [zeebe-benchmark-test-elasticsearch-master-1] moving index [zeebe-record_variable_8.5.0-snapshot_2024-01-16] from [{"phase":"delete","action":"delete","name":"wait-for-shard-history-leases"}] to [{"phase":"delete","action":"delete","name":"cleanup-snapshot"}] in policy [zeebe-record-retention-policy]

# Now it gets deleted 30 min after creation
[2024-01-16T20:28:59,797][INFO ][o.e.x.i.IndexLifecycleTransition] [zeebe-benchmark-test-elasticsearch-master-1] moving index [zeebe-record_variable_8.5.0-snapshot_2024-01-16] from [{"phase":"delete","action":"delete","name":"cleanup-snapshot"}] to [{"phase":"delete","action":"delete","name":"delete"}] in policy [zeebe-record-retention-policy]

@npepinpe I think we can go ahead and merge this change. I will try tomorrow how the charts behaves when we upgrade from an older version of the chart to a newer version, based on the results we might want to pin the release charts to the older version for now.

I have a benchmark with the mixed setup (incl. Operate running) here
How to set up:
helm install zeebe-benchmark charts/zeebe-benchmark \
> --set starter.rate=5 \
        --set worker.replicas=1 \
        --set timer.replicas=1 \
        --set timer.rate=5 \
        --set publisher.replicas=1 \
        --set publisher.rate=5 \
        --set camunda-platform.operate.enabled=true \
        --set camunda-platform.operate.image.repository=camunda/operate \
        --set camunda-platform.operate.image.tag=SNAPSHOT    \
        --set camunda-platform.elasticsearch.master.persistence.size=128Gi \
        --set camunda-platform.zeebe.retention.minimumAge=1d \
        --set camunda-platform.operate.retention.minimumAge=30m


Update registry with SymbolicRegression.jl

Closes https://github.com/alan-turing-institute/MLJ.jl/issues/1032
(I wasn't sure if we were supposed to do it ourselves or not; feel free to close if needed. I just followed the instructions in<EMAIL_ADDRESS>Since the SymbolicRegression.jl docstrings are technically invalid right now as they describe the @load API: https://astroautomata.com/SymbolicRegression.jl/dev/api/, let me know the timescale for the registry update and if I should update the docstrings with a temporary fix.
Thanks!
Miles

@OkonSamuel @ablaom sorry to bother you, but I was wondering when this could be put up on the registry? I am just a bit worried about new users, because the SymbolicRegression.jl docstrings currently have the @load syntax, but this will not work until the registry is updated.
Thanks! Miles

I planned to close this today.

Codecov Report

Merging #520 (ba8fbe7) into dev (c72e67c) will decrease coverage by 0.25%.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@            Coverage Diff             @@
##              dev     #520      +/-   ##
==========================================
- Coverage   76.92%   76.67%   -0.25%
==========================================
  Files          16       16
  Lines        1157     1162       +5
==========================================
+ Hits          890      891       +1
- Misses        267      271       +4

see 3 files with indirect coverage changes

closing in favor of #521

Thanks!

Yes. I'll go ahead and tag a new release.


doesn't format when top level is an unnamed array

doesn't format when top level is an unnamed array
[
{
"cnt":1,
"name":"American",
"pk":7
},
{
"cnt":2,
"name":"Celebrities",
"pk":3
},
{
"cnt":1,
"name":"Region",
"pk":9
}
]

:+1:

+1

+1

Weird, top-level arrays work correctly for me:

Can anyone give me a live URL showing the bug?

also working for me

this might be fixed, or at least works for me in one case, with a similar unnamed array being returned.
i'm using chrome: Version 47.0.2526.111 m
Keith

Probably doesn't work when Content-Type-Header is set to text/html.

will reopen this if someone can give me a URL that shows the problem.


Grafana

As part of the Observability epic, we spin up a Grafana instance in ECS to monitor GOV.UK ECS apps
and other components of the new platform e.g. billing.
Features

Grafana spinned up in new cluster Monitoring to seperate concerns
Grafana is accessed via GitHub auth
Configuration of Grafana dashboards is via Terraform

Testing

Grafana accessible via VPN at https://grafana-ecs.test.govuk.digital

Deployment
Process is documented in docs/applying-terraform.md#monitoring
Future Work

Subsequent apply of the terraform config for internal Grafana
configuration fails, workaround is documented in the deployment process.
Add teams to GitHub authorised users rather than the whole org
Alphagov
Deployment of the monitoring stack via Concourse

Ref:

trello card

Nice work 👏 Thanks for adding documentation, too!
I've added some comments inline - let me know if you have any questions.
We don't need to separate the ECS Task Definition and ECS Service deployments for Grafana. We separate out the deployments for apps so we can hook into deploys and run steps like database migrations, but I'm not sure we need to do that in this case - it's just the app module pushes us to do it.
We could merge the deployments (monitoring-test/grafana/base and monitoring-test/grafana/app-config) for Grafana into a single deployment (perhaps monitoring/grafana) and remove a few files, as with Statsd. What do you think?

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

Nice work 👏 Thanks for adding documentation, too!
I've added some comments inline - let me know if you have any questions.
We don't need to separate the ECS Task Definition and ECS Service deployments for Grafana. We separate out the deployments for apps so we can hook into deploys and run steps like database migrations, but I'm not sure we need to do that in this case - it's just the app module pushes us to do it.
We could merge the deployments (monitoring-test/grafana/base and monitoring-test/grafana/app-config) for Grafana into a single deployment (perhaps monitoring/grafana) and remove a few files, as with Statsd. What do you think?

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

What HTTP calls does the app-config make, that it needs to be a separate module? Could you explain this a bit more - sorry I'm a bit confused.

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

What HTTP calls does the app-config make, that it needs to be a separate module? Could you explain this a bit more - sorry I'm a bit confused.

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

What HTTP calls does the app-config make, that it needs to be a separate module? It sounds like we create the ECS Service and then the grafana provider makes the HTTP calls to set the config for grafana?
I wonder, could grafana pull config from an S3 bucket, or could we build a grafana image with our config built in? This might be a way to solve the problem, given we need to apply terraform every time a new container is cycled.

Yes, you are right: "The ECS Grafana Service is first created and then the Grafana Terraform provider makes the HTTP calls to set the config for Grafana".
We can persist this change by backing Grafana with a database as mentioned above: https://grafana.com/docs/grafana/latest/administration/set-up-for-high-availability/

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

What HTTP calls does the app-config make, that it needs to be a separate module? It sounds like we create the ECS Service and then the grafana provider makes the HTTP calls to set the config for grafana?
I wonder, could grafana pull config from an S3 bucket, or could we build a grafana image with our config built in? This might be a way to solve the problem, given we need to apply terraform every time a new container is cycled.

Yes, you are right: "The ECS Grafana Service is first created and then the Grafana Terraform provider makes the HTTP calls to set the config for Grafana".
We can persist this change by backing Grafana with a database as mentioned above: https://grafana.com/docs/grafana/latest/administration/set-up-for-high-availability/

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

What HTTP calls does the app-config make, that it needs to be a separate module? It sounds like we create the ECS Service and then the grafana provider makes the HTTP calls to set the config for grafana?
I wonder, could grafana pull config from an S3 bucket, or could we build a grafana image with our config built in? This might be a way to solve the problem, given we need to apply terraform every time a new container is cycled.

Yes, you are right: "The ECS Grafana Service is first created and then the Grafana Terraform provider makes the HTTP calls to set the config for Grafana".
We can persist this change by backing Grafana with a database as mentioned above: https://grafana.com/docs/grafana/latest/administration/set-up-for-high-availability/

Let's not introduce a database if we can help it. That's a big leap in complexity and it shouldn't be necessary for what should be a stateless app which reads some config at startup.

You can't run these 2 together because the app-config make HTTP calls the grafana app after it has been up (i.e. after ecs service stable).

What HTTP calls does the app-config make, that it needs to be a separate module? It sounds like we create the ECS Service and then the grafana provider makes the HTTP calls to set the config for grafana?
I wonder, could grafana pull config from an S3 bucket, or could we build a grafana image with our config built in? This might be a way to solve the problem, given we need to apply terraform every time a new container is cycled.

Yes, you are right: "The ECS Grafana Service is first created and then the Grafana Terraform provider makes the HTTP calls to set the config for Grafana".
We can persist this change by backing Grafana with a database as mentioned above: https://grafana.com/docs/grafana/latest/administration/set-up-for-high-availability/

Let's not introduce a database if we can help it. That's a big leap in complexity and it shouldn't be necessary for what should be a stateless app which reads some config at startup.

Fantastic 👍 You just have some conflicts.
I'm wondering if we could make the app module simpler by avoiding having grafana use it, but feel free to ignore that comment.
It might be nice to write followup cards to look into resolving some of issues we didn't get to (e.g. cycling grafana instances leads to grafana not being configured).

Yes, I will.

Fantastic 👍 You just have some conflicts.
I'm wondering if we could make the app module simpler by avoiding having grafana use it, but feel free to ignore that comment.
It might be nice to write followup cards to look into resolving some of issues we didn't get to (e.g. cycling grafana instances leads to grafana not being configured).

Yes, I will.


PX4 10.0.1 Stable, Hard Fault in file:armv7-m/up_hardfault.c

Hello,
I encountered an issue with PX4 1.10.1 Stable where the copter seems to make a 180° flip upside down. I am using a MoCap pose input over MavRos, mapped to the vision pose topic as described in the tutorial. The logs indicate that this seems to be a software crash, thus the movement might be a random result due to the underlying error. The Pixhawk 4 gives multiple beeper signals after engaging the killswitch.
Both logfiles below show 'Type:Hard Fault in file:armv7-m/up_hardfault.c at line: 148 running task: init'
To Reproduce
Steps to reproduce the behavior:

Map the MoCap pose to the vision pose topic
Enable the vision pose estimate
Start the copter in altitude mode and take off
Switch to position mode
The copter holds its position stable for ~5 seconds until the described issue occurs

Expected behavior
The copter should hold its position.
Log Files
MoCap at 120Hz, the log indicates I2C3 low on the stack:
https://logs.px4.io/plot_app?log=92b60ea2-4b1e-4fac-9402-e1c797494866
MoCap at 30Hz, the log does not point out a clear error but the same issue occurred:
https://logs.px4.io/plot_app?log=afa24f21-0f51-42a4-bd2e-9b90ef29b14c
Hardware
Pixhawk 4 Holybro

Hello @dagar,
are there any updates from your side regarding this issue? We are planning to downgrade to 1.10.0 stable next week and test if the error occurs for this version as well.

Hello @dagar,
are there any updates from your side regarding this issue? We are planning to downgrade to 1.10.0 stable next week and test if the error occurs for this version as well.

Would you be able to quickly try master (what's going to become v1.11.0 soon)? If you're able to reproduce the failure there it might help if we can setup a call and debug together.

I have actually come across the same error. A link to the log can be found below:

Hello everyone,
I seem to have the same problem, the software crashes shorty after take-off with a fixed-wing airplane using a black HEX cube. The log file can be found below:
https://logs.px4.io/plot_app?log=8572edab-7b45-4eb3-8ae8-d6a7036de909


Add option to use included-apr

Are there any cases where this would be necessary and required ?

Passing on this in favour of migrating httpd24 into httpd in Homebrew/homebrew-core (https://github.com/Homebrew/homebrew-core/pull/17726). Sorry that there was no response for so long.


Axe-core trademark use

Thanks for using axe-core! Could you please ensure that you are adhering to the trademark policy? Axe-core is a trademark of Deque Systems. Here are some common tips that should help:

Ensure that the language surrounding your reference to axe-core does not imply in any way that you own it or have any formal partnership with Deque without prior written permission.
Include the following attribution notice: “Axe-core® is a trademark of Deque Systems, Inc. in the US and other countries.” Adding this to your readme is a common approach.
Axe-core® is capitalized at the beginning of a sentence. When used within a sentence, axe-core® is lowercase. Don’t stress attempting to include the ® symbol everywhere you say axe-core. If you include it in a prominent place, in addition to the attribution notice above, you should be good.
Do not mistake the broader axe® brand name for the axe-core® open source project.
Don’t stress renaming your entire project. If you adhere to the above tips, you should be covered in most cases.

Please comply with this request in 30 days time and let us know when to expect to see the changes live.
Regards,
The team at Deque

I can fork this library and comply with trademark, huge fan of both tools but I also want to address accessibility features and tie in some other thigns to the report I think would benefit the community

Thanks so much. Forking probably isn't necessary. Perhaps you could update
your readme instead? A note like this would be sufficient:
"Axe-core https://github.com/dequelabs/axe-core is a trademark of Deque
Systems, Inc https://www.deque.com/. in the US and other countries."
On Sun, Jul 7, 2024 at 1:48 PM 'jsdev' via trademarks @.***>
wrote:

I can fork this library and comply with trademark, huge fan of both tools
but I also want to address accessibility features and tie in some other
thigns to the report I think would benefit the community
—
Reply to this email directly, view it on GitHub
https://github.com/lpelypenko/axe-html-reporter/issues/27#issuecomment-2212521177,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BGBKTYUKIUJDYASQPBL43Y3ZLF5OBAVCNFSM6AAAAABDPTC3V6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMJSGUZDCMJXG4
.
You are receiving this because you authored the thread.Message ID:
@.***>

Sorry for the late reply. I will work on it in next days.

Pull request: https://github.com/lpelypenko/axe-html-reporter/pull/30

Another pull request: https://github.com/lpelypenko/axe-html-reporter/pull/31

Reviewed the latest changes and update templates. Closing the request.
Thank you for your patience.


Overlapping settings sections when one is empty

VSCode Version: Code 1.13.1 (379d2efb5539b09112c793d3d9a413017d736f89, 2017-06-14T18:21:47.485Z)
OS Version: Windows_NT ia32 10.0.15063
Extensions:

Extension
Author
Version

Bookmarks
alefragnani
0.15.1

swagger-viewer
Arjun
1.4.0

vscode-markdownlint
DavidAnson
0.9.1

xml
DotJoshJohnson
1.8.0

csharp
ms-vscode
1.10.0

vscode-docker
PeterJausovec
0.0.16

swaggitor
qnsolutions
0.1.1

Steps to Reproduce:

File -> Preferences -> Settings
Scroll to a section that has no items (in my case "Swaggitor configuration")

Result: When not expanded, following sections overlap

Note: See issue #24154, related.

Will fix it for June milestone. Sorry for that.


Rename this repo

Post merge this repo may need to be renamed or branched to account for:

iojs.org
nodejs.org (current)
post-merge nodejs.org

Possibilities (for this repo)

nodejs/iojs-org
nodejs/iojs.org
nodejs/website-iojs
etc.

Cross-linked to our next WG meeting agenda #352

FYI: https://github.com/nodejs/evangelism/issues/79

cc: @marocchino

who in @nodejs/build can help us with the transition so that we can avoid downtime?

for a repo rename I just need to tell the server to start looking for events from org/reponame in /etc/github-webhook.json (and the github-webhook service needs to be restarted), @kenperkins has access to do that as well, @jbergstroem probably does too as does @indutny I think. Just ping one of us.
In terms of hosting the websites, we'll probably talk about that at our next convergence meeting https://github.com/nodejs/build/issues/100

I am +1 on explicitly naming the git repository after the FQDN e.g.
iojs.org

What will be the new website's repository's name?

I'd favor iojs.org as well.

:+1: iojs.org

@rvagg / @jbergstroem / @kenperkins could we do that today? Just let me know when you're read and I'll rename this repo.

@Fishrock123 I'll be around but I haven't really messed around with the website stuff so I'd prefer if @rvagg is. If not, I'll figure it out.

I'm here, make it so, this is just an update for /etc/github-webhook.json I think, perhaps also the build script it points to

Done, awaiting build confirmation.

good to go I think, let me know if the next push doesn't make it!


Check with AccessCheck for permission to write to directory on Windows

Using AccessCheck to check if we have access to write for the directory resource
Solves #1936
cc @btm @smurawski @adamedx @ksubrama

ccing @chef/client-engineers and @schisamo since you seem to have touched this code as well :smile:

So very :+1: on seeing this fixed.

@lamont-granquist added comment and spec

:cake:

:+1: and the updated specs pass locally too.


Can't exchange or add liquidity error message "Insufficient UTXOS to perform add liquidity"

Good day Defichain,
Having an issue as per subject, since last night. Can you please have a look at this?

defi_log_3.log

defi_log_3.log

found the way to transfer tokens to coins following steps posted here.

found the way to transfer tokens to coins following steps posted here.

Hi @MarsaXod , thanks for your feedback. Glad that you managed to fix it. Should you face the same issue, you may refer to this link https://github.com/DeFiCh/app/issues/195. I'll close this issue for now.

Hi @MarsaXod , thanks for your feedback. Glad that you managed to fix it. Should you face the same issue, you may refer to this link https://github.com/DeFiCh/app/issues/195. I'll close this issue for now.


Warning. The sensor parameter is no longer required for the Google Maps JavaScript API.

I get one warning from Google during the usage of the module
Warning:

"SensorNotRequired: https://developers.google.com/maps/documentation/javascript/error-messages"

Thank you.
There is already a PR for that: #28. Hopefuly I'll have enough time to merge this and release a new version this week.

I have the same problem. My code is:
GoogleMapsLoader.SENSOR     = false;
GoogleMapsLoader.LIBRARIES = [ 'places' ];
GoogleMapsLoader.load(function(google) {
geocoderStatus = google.maps.GeocoderStatus;
geocoder       = new google.maps.Geocoder();
});
But it's still showing the SensorNotRequired warning. How can I avoid the warning or set the Sensor false? Thanks

I'll try to create a new pull request, since this problem seems pretty important and the current PR can not be merged..

Fixed with #34


Fix section web part background

Category

[x] Bug Fix
[ ] New Feature
Related issues: fixes #323

What's in this Pull Request?
Added support for section backgrounds to all webparts.

@eoverfield I understand that this PR is not valid anymore with the new webpart projects in place but we still need support for section backgrounds in them. Would I have any luck in getting this merged if I ported it to the new webpart project in Starter Kit V2?

@patrikhellgren Yeah, I apologize for the delay in this as it didn't get added into V1 before the conversion to V2. Your contributions are absolutely appreciated.
The large PR's that hit all webparts are very challenging for us to process. My suggestion, if you are willing, is to pick one webpart to start. Make the suggested update you want and submit a PR. Give the community an opportunity to submit any feedback / recommendations. We can then merge that in, as well as update the general provisioning template to include that as well. Then we could look to burn through all of the webparts.
Would that work for you?
Thanks!

@patrikhellgren @eoverfield You do not specify a section background as inline style these should be removed. There current version only needs the setting of  "supportsThemeVariants": true
Documentation will be updated soon but is currently not accurate.

@StfBauer thank you for the clarification. @patrikhellgren I would suggest you see if the supportsThemeVariants setting in the webpart manifest delivers what you are looking for. The Personal Tasks webpart already does include this. If this isn't what you are looking for, let's continue the discussion here.

@StfBauer Thank you for the info, that was enough to get it working. For how long has this been working this way? Or has the documentation (Supporting section backgrounds) always been inaccurate?
@eoverfield The Personal Tasks webpart uses the same way to handle section theming as I had implemented in this PR so that is not really valid according to what @StfBauer suggested and which seems to be working. Should I then make the change in the rest of the webparts (including Personal Tasks) and submit one PR per webpart or how would you like me to proceed?

@patrikhellgren I guess it was always working this way but because people read the documentation used it this way. The future will move to a documentation more like the described method here.
https://n8d.at/develop-spfx-web-parts-for-different-section-designs-using-css/

@eoverfield maybe you missed my question above, at least I never got an answer to how you want us to proceed with the section background update. I now thought I would make a PR for at least one of the webparts to get things going but then I notice that a lot of them has been reverted from SPFx 1.9.1 to 1.4.1. I guess this has to do with 2019 support. So since "supportsThemeVariants" was added in 1.8 this is now a no go.
Since some of the webparts is on at least 1.9.1 and able to support "supportsThemeVariants" we would get an inconsistent look on the different webparts and the 1.4.1 ones doesn't look good in a modern intranet using different section backgrounds.
What is your idea on how to move forward with this?


Emitting to all sockets in a room in current instance

Hey, so here's my use case:
I have a socket.io server, which listens for changefeeds from RethinkDB and passes the messages to the clients that are in a specific room. This server runs in 2 instances. Some upcoming functionality however requires me to use the redis adapter for shared rooms and because of that, every changefeed message would be sent twice. Is there a way I can only emit to the current instance sockets?
I could use an MQ in front to make sure that each changefeed message is sent once, but that would only add further complexity, so hopefully there's a built in solution.

Would the solution proposed here answer your need?

That's exactly what I need, thanks! 👍


added testing for django5

Problem
django5 support.
Solution
Updated tox config
TODO

Currently warns on deprecation

coverage: 100.0%. remained the same when pulling 485a877e7d88659bf5527b264860df0705ee67b4 on matthewhegarty:django-5 into 09a08cd926271b406231f1bdfc182d86082323f8 on django-import-export:main.


Explain how to test a multi-tenant app

Fixed in https://github.com/stancl/tenancy/commit/85b2274d1d9aba4989e918b45ce049cc42a995b1


Logout method for API

I login to api via Guardian.encode_and_sign(xxx). I cannot use Guardian.Plug.sign_out(conn) to logout from api. It said "cannot fetch_session". and method Guardian.revoke! do nothing with authentication data in header

Hi @vernomcrp. When you're logging out of a session it depends on if you're using something like GuardianDb to keep track of tokens you have out in the wild.
If you're not using GuardianDb or something similar, then on your client just forget the token. If you have a token and it checks out then it is valid. If you want something more robust, that's what GuardianDb was developed for.
When using GuardianDb, to logout a session you should use the Guardian.revoke! function which will cause the token to be deleted from the db. This will make that token invalid in the future if someone tries to use it again.


Add sw-cache snippet to the bottom of the template with fingerprinted path

BEFORE YOU SUBMIT please read the following:

[ ] I'm submitting a bug report
[ ] I'm submitting a feature request
[ x] I'm submitting a support request

webpack version:
2.5
sw-precache-webpack-plugin version:
0.9.2
Please tell us about your environment:
OSX 10.x
Current behavior:
I'm currently using sw cache plugin to load the sw cache worker. I'm following the instructions there (copy the snippet to the bottom of the page:
 <script>
	if ('serviceWorker' in navigator) {
		 navigator.serviceWorker
			  .register("/sw-cache.js")
			  .then(function() {
			      console.log('Service worker registered!');
			  })
			  .catch(function(error) {
			      console.log('Error registering service worker: ', error);
			  });
	}
</script>

Expected/desired behavior:
Current behaviour is fine, but doesn't take advantage of contenthash resource names from webpack. Now, creating the fingerprint sw cache is easy, injecting it in the template is not. Is there a way to use webpack to inject the snippet with the proper production "sw-cache.js" path?
My main issue with this is that, whenever I release a new version of a pwa app with new assets, loading the cached sw-cache is loading the invalidated set of assets.

Can you use an environment variable for the .register(PATH)?
Btw, you need to specify cache-control: no-cache header on the service worker. Maybe neeed to draw more attention to that somewhere in the readme

Can you use an environment variable for the .register(PATH)?

I guess not. Webpack contains the information about the generated build file names, so I'd say this is a build-time decision. That'd be the same as manually updating my template before updating the server. The idea is to make it dynamic, or at least "at build time" decision.

Btw, you need to specify cache-control: no-cache header on the service worker.

It's true, this might solve part of the issue. Or even setting Max-Age to 0. The thing is, will this still be necessary if the sw files are fingerprinted? Shouldn't this cache invalidation mechanism suffice?

Just thinking on this, if one were to cache their main index.html, where the service worker, service-worker.v1.js is registered, then we try to deploy a new build, service-worker.v2.js, index.html still points to service-worker.v1.js, so I don't think we will be able to install the new service worker, preventing any new builds from being deployed.

Well, I guess that's an entirely different problem, which is out of scope here. Are you delivering the template as is? Are you rendering it through smth like express? Not the issue to address here


Includes visual guide representing chains config options

Changes

Includes visual guide representing chains config options
Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[X] Has Docs included if any changes are user facing
[X] Has Tests included if any functionality added or changed
[X] Follows the commit message standard
[X] Meets the Tekton contributor standards (including
functionality, content, code)
[X] Release notes block below has been updated with any user facing changes (API changes, bug fixes, changes requiring upgrade notices or deprecation warnings)
[X] Release notes contains the string "action required" if the change requires additional action from users switching to the new release

Release Notes
NONE

Thanks for the pr 🙂
This would really help the users I think
LGTM

/ok-to-test

Thanks for the pr 🙂 This would really help the users I think
LGTM

@PuneetPunamiya Thankyou. As you have highlighted the drawio.svg allows for future edit.

/test pull-tekton-chains-integration-tests


feat: port Algebra.ContinuedFractions.Computation.CorrectnessTerminating

Do you have a sense of what field_simp is lacking? It would be good to fix this, if you're able to come up with a #mwe.

Do you have a sense of what field_simp is lacking? It would be good to fix this, if you're able to come up with a #mwe.

@semorrison If l1 and l2 as shown below are used in place of tmp_calc and tmp_calc', then with the helper lemma hfr (that in similar forms is also needed to fix the two other non-trivial – i.e. more than just fixing names – problems in this file), ac_rfl alone (as in the mathport output) closes the goal and the theorem compiles:
theorem compExactValue_correctness_of_stream_eq_some :
      -- ...
      rw [this]
      -- two calculations needed to show the claim
      have l1 : (↑⌊1 / ifp_n.fr⌋ * pA + ppA) + pA * Int.fract (1 / ifp_n.fr) = (pA * (1 / ifp_n.fr) + ppA) := sorry
      have l2 : (↑⌊1 / ifp_n.fr⌋ * pB + ppB) + pB * Int.fract (1 / ifp_n.fr) = (pB * (1 / ifp_n.fr) + ppB) := sorry
      have : Int.fract (1 / ifp_n.fr) ≠ 0 := by simpa using ifp_succ_n_fr_ne_zero
      -- now unfold the recurrence one step and simplify both sides to arrive at the conclusion
      have hfr : (IntFractPair.of (1 / ifp_n.fr)).fr = Int.fract (1 / ifp_n.fr) := rfl
      field_simp [compExactValue, continuantsAux_recurrence s_nth_eq ppconts_eq pconts_eq,
        nextContinuants, nextNumerator, nextDenominator, this, hfr, l1, l2]
      ac_rfl

And field_simp cannot turn tmp_calc and tmp_calc' into l1 and l2. Here's an MWE based on the file:
import Mathlib.Tactic.FieldSimp

variable {K : Type _} [Field K] {f pA pB pC pD ppA ppB g : K} (h0 : f ≠ 0) (h1 : g ≠ 0)

theorem fails (t1 : pC / f + pA = (pA / g + ppA) / f) (t2 : pD / f + pB = (pB / g + ppB) / f) :
    (ppA * g + pA) / (ppB * g + pB) = (pC + pA * f) / (pD + pB * f) := by
  field_simp [h0, h1, t1, t2]
  ac_rfl

theorem passes (l1 : pC + pA * f = (pA / g + ppA)) (l2 : pD + pB * f = (pB / g + ppB)) :
    (ppA * g + pA) / (ppB * g + pB) = (pC + pA * f) / (pD + pB * f) := by
  field_simp [h0, h1, l1, l2]
  ac_rfl

The #mwe doesn't seem right. field_simp fails in the same way in mathlib3:
import tactic.field_simp

variables {K : Type _} [field K] {f c d x y : K} (h0 : f ≠ 0) (h1 : y ≠ 0)

theorem fails (t1 : c / f = x) (t2 : d / f = y) :
    x / y = c / d :=
begin
  field_simp [t1, t2],
  ac_refl
end

I think to understand the regression we need an example where it succeeds in mathlib3 but fails in mathlib4.


A simple example of 32-bit Windows code execution

I wrote a simple program here: https://github.com/hozuki/plus
---
I'll expand that into a real JIT if I have time. 👍s

Thanks for joining our crowdfunding of time :laughing:
I will keep writing my guide for now.

OK full functions went live just now. Feel free to check it out (with CMake, Windows, and MinGW/Cygwin). 😆

x86 and x86-64, Windows and Unix, all supports are live. 🐸


Status isn't reported

Hi @wglass,
Great plugin!
Just one question, I can't find anything in the docs about the status of a server, e.g UP/DOWN etc, isn't that information sent to collectd?

@larsha I think it is still WIP (https://github.com/wglass/collectd-haproxy/commit/4728dd503b6af4763097a28cbe9f22953df09e56).
but I really love to have this feature in the next release.


python3Packages.opuslib: init at 3.0.3

Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[X] Fits CONTRIBUTING.md.

going to wait for ofborg to eval, and then merge

@thelegy congrats on your first addition to nixpkgs :)

thanks


[Request] Space Engineers

Can you make a script for Space Engineers? Plz.....

Yes, I second this and would be willing to test!


VillagerAcquireTradeEvent

Name(s)
on villager recipe//trade unlocks
Triggers
when a villager/entity unlocks a new trade due to player trading.
Cancellable
This event can be cancelled. This adds 'context.cancelled', and determines 'CANCELLED' and 'CANCELLED:FALSE'
Context

<context.entity> Returns the dEntity of the villager/entity
<context.trade> // <context.recipe> Returns a dList of the recipe.

Determine

dList to set a new recipe.

1.14 will feature a new villager type. This may or may not be split into a different entity later down the line, and there may be a different event by spigot (or may already be -- or not, since Spigot has 1.14 pre builds).

Just for reference - link the javadocs and don't create your own meta in the future.
https://hub.spigotmc.org/javadocs/spigot/org/bukkit/event/entity/VillagerAcquireTradeEvent.html
This would also be nice to implement: https://hub.spigotmc.org/javadocs/spigot/org/bukkit/event/entity/VillagerReplenishTradeEvent.html

The monkey said to pull an event from that page and post it as a feature, so that's what I did. Figured I'd work out the idea with examples of meta.

I also implied (but didn't really state clearly) to do that if you need an event to be available.
What even do you need this event for?!

I'd like to adjust villager trades as they are being generated?

@MusicScore this might be an issue for you to do?

Funny story was, I did do some work with the acquires and replenishes trade events, but they were both unfortunately purged when I did a small reorganization of my workspace.
I'll see if I can dredge up any of my past work on it. If not, I'll work on this after I get attack cooldown stuff up and running.

This has been implemented.


npm run test:manual fails on Windows environment

Seems like there are a few issues popping up regarding viewing the tests in browser. Let me know if I should file separate issues for this.
This is what happens on Firefox Quantum 61.0.2 (64-bit) when running npm run test:manual (npm run test works perfectly in the chrome headless browser):

And this error in Chrome 69.0.3497:

I'm running in the dreaded Windows 10 environment.
Edit: Funnily enough, it works in Microsoft Edge.

I'm gonna try to tackle the Firefox issue and see what may be causing it, if that's alright.

Seems like when you choose to not remember history or do private browsing in Firefox, this Indexedb issue pops up. Firefox says that Private browsing automatically blocks IndexedDB but it doesn't say that not remembering history does the same as well.
To recreate the Chrome issue, you have to clean out the test cache (rm -rf .cache tests/dist) and then run the manual again to get that memory leak warning. If you refresh the page, the issue is fixed.

If you're in a Private Browsing tab, yes, this is a known limitation for Filer.  Firefox currently doesn't allow IndexedDB storage in private browsing, since it would allow for fingerprinting of a user.  Chrome does allow it, but deletes the DB after you close the tab.  There are bugs in Firefox to fix this, but it's an ongoing issue.
If the problem here is really related to Private Browsing, we can probably close this, as it's filed elsewhere in Filer and in Firefox.


bdd-spring-1557151320 to 0.0.1

Promote bdd-spring-1557151320 to version 0.0.1

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Expose the current audio's metadata

When using youtube-dl, look into exposing the current playing audio's metadata, such as title/artist. Should it make the result of --dump-json available somehow upon playing? Or a separate getMetadata function?

Since playYouTube etc block until they're done playing, to pass back data upon start there needs to be an MVar or something..... which could make the interface very very clunky. I'm imagining things like:
playYouTubeWith'
:: String  -- The name of the FFmpeg executable
-> (String -> [String])  -- The arguments to pass to FFmpeg
-> String -- The name of the youtube-dl executable
-> String -- The search query (or video URL)
-> MVar YouTubeData -- filled in with youtube-dl metadata upon playing
-> ConduitT ByteString ByteString (ResourceT DiscordHandler) () -- Any processing that needs to be done on the audio data
-> Voice ()

To read from the MVar, there needs to be a new forked thread..., and all-in-all it's not a good solution.
Still in search for a different method.

With the V2.4.0 redesign of play to take an AudioResource, and createYoutubeResource to return an AudioResource, we can now embed the audio's metadata within that datatype.


Not an issue, just a thank you...

Hey there,
Since GitHub doesn't have private messaging (anymore) I wasn't sure how to contact you to thank you for making this C# wrapper for libjpeg-turbo. I am building an over-network game capture application and was using the .Net Image.Save method to compress to Jpeg but it was slowing down my frame rate. Using your NuGet package I was able to increase the frame rate 5-10 FPS with two lines of code. That actually brought my apps FPS right up to 60 which is exactly where I wanted it to be. Anyway, I really appreciate it, thank you!
--Robert

Hi @robault ,
You're welcome, thanks for the feedback, really appreciate it!
Frederik.


[Bug] IndentationError: expected an indented block after 'with' statement on line 47

Prerequisite

[X] I have searched Issues and Discussions but cannot get the expected help.
[X] The bug has not been fixed in the latest version.

Type
I have modified the code (config is not considered code), or I'm working on my own tasks/models/datasets.
Environment
{'CUDA available': True,
'CUDA_HOME': '/usr/local/cuda',
'GCC': 'gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0',
'GPU 0,1,2,3,4,5,6,7': 'NVIDIA GeForce RTX 4090',
'MMEngine': '0.10.4',
'MUSA available': False,
'NVCC': 'Cuda compilation tools, release 12.1, V12.1.66',
'OpenCV': '4.10.0',
'PyTorch': '2.4.0',
'PyTorch compiling details': 'PyTorch built with:\n'
'  - GCC 9.3\n'
'  - C++ Version: 201703\n'
'  - Intel(R) oneAPI Math Kernel Library Version '
'2023.1-Product Build 20230303 for Intel(R) 64 '
'architecture applications\n'
'  - Intel(R) MKL-DNN v3.4.2 (Git Hash '
'1137e04ec0b5251ca2b4400a4fd3c667ce843d67)\n'
'  - OpenMP 201511 (a.k.a. OpenMP 4.5)\n'
'  - LAPACK is enabled (usually provided by '
'MKL)\n'
'  - NNPACK is enabled\n'
'  - CPU capability usage: AVX512\n'
'  - CUDA Runtime 12.4\n'
'  - NVCC architecture flags: '
'-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_90,code=sm_90\n'
'  - CuDNN 90.1\n'
'  - Magma 2.6.1\n'
'  - Build settings: BLAS_INFO=mkl, '
'BUILD_TYPE=Release, CUDA_VERSION=12.4, '
'CUDNN_VERSION=9.1.0, '
'CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, '
'CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=0 '
'-fabi-version=11 -fvisibility-inlines-hidden '
'-DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO '
'-DLIBKINETO_NOROCTRACER -DUSE_FBGEMM '
'-DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK '
'-DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC '
'-Wall -Wextra -Werror=return-type '
'-Werror=non-virtual-dtor -Werror=bool-operation '
'-Wnarrowing -Wno-missing-field-initializers '
'-Wno-type-limits -Wno-array-bounds '
'-Wno-unknown-pragmas -Wno-unused-parameter '
'-Wno-unused-function -Wno-unused-result '
'-Wno-strict-overflow -Wno-strict-aliasing '
'-Wno-stringop-overflow -Wsuggest-override '
'-Wno-psabi -Wno-error=pedantic '
'-Wno-error=old-style-cast -Wno-missing-braces '
'-fdiagnostics-color=always -faligned-new '
'-Wno-unused-but-set-variable '
'-Wno-maybe-uninitialized -fno-math-errno '
'-fno-trapping-math -Werror=format '
'-Wno-stringop-overflow, LAPACK_INFO=mkl, '
'PERF_WITH_AVX=1, PERF_WITH_AVX2=1, '
'PERF_WITH_AVX512=1, TORCH_VERSION=2.4.0, '
'USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=1, '
'USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, '
'USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, '
'USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, '
'USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, '
'USE_ROCM_KERNEL_ASSERT=OFF, \n',
'Python': '3.10.14 (main, May  6 2024, 19:42:50) [GCC 11.2.0]',
'TorchVision': '0.19.0',
'numpy_random_seed':<PHONE_NUMBER>,
'opencompass': '0.2.6+8fe75e9',
'sys.platform': 'linux'}
Reproduces the problem - code/configuration sample
            try:
                exec_globals = {}
                with swallow_io():
                    with time_limit(timeout):
# WARNING
# This program exists to execute untrusted model-generated code. Although
# it is highly unlikely that model-generated code will do something overtly
# malicious in response to this test suite, model-generated code may act
# destructively due to a lack of model capability or alignment.
# Users are strongly encouraged to sandbox this evaluation suite so that it
# does not perform destructive actions on their host or network. For more
# information on how OpenAI sandboxes its code, see the accompanying paper.
# Once you have read this disclaimer and taken appropriate precautions,
# uncomment the following line and proceed at your own risk:
#                         exec(check_program, exec_globals)
                result.append("passed")
            except TimeoutException:
                result.append("timed out")
            except BaseException as e:
                result.append(f"failed: {e}")

### Reproduces the problem - command or script

CUDA_VISIBLE_DEVICES=0,1,3,4,5,6 python run.py --datasets humaneval_gen_8e312c --hf-type base --hf-path /opt/LLM/Qwen1_5_0_5B_Chat --hf-num-gpus 6 --max-num-workers 2 --max-seq-len 512 --debug

### Reproduces the problem - error message

Traceback (most recent call last):
  File "/opt/wei.jiao/opencompass/run.py", line 4, in <module>
    main()
  File "/opt/wei.jiao/opencompass/opencompass/cli/main.py", line 344, in main
    runner(tasks)
  File "/opt/wei.jiao/opencompass/opencompass/runners/base.py", line 38, in __call__
    status = self.launch(tasks)
  File "/opt/wei.jiao/opencompass/opencompass/runners/local.py", line 131, in launch
    task.run()
  File "/opt/wei.jiao/opencompass/opencompass/tasks/openicl_eval.py", line 112, in run
    self._score()
  File "/opt/wei.jiao/opencompass/opencompass/tasks/openicl_eval.py", line 223, in _score
    result = icl_evaluator.score(**preds)
  File "/opt/wei.jiao/opencompass/opencompass/datasets/humaneval.py", line 74, in score
    from human_eval.evaluation import evaluate_functional_correctness
  File "/opt/wei.jiao/opencompass/human-eval/human_eval/evaluation.py", line 10, in <module>
    from human_eval.execution import check_correctness
  File "/opt/wei.jiao/opencompass/human-eval/human_eval/execution.py", line 59
    result.append("passed")

Other information
No response

Please check the comments in humaneval

Feel free to repoen if needed


Error selecting date field - invalid selector for date: a.rounded-md

Given the following configuration:
[rsspls]
output = "/tmp"

[[feed]]
title = "DeepLearning.ai"
filename = "deeplearning-ai.rss"

[feed.config]
url = "https://www.deeplearning.ai/the-batch/"
item = "article"
heading = "h2"
link = "a.absolute"

[feed.config.date]
selector = "a.rounded-md" # or "a.relative"
type = "Date"
format = "[month repr:short] [day], [year]"

It always fails with the following error:
 INFO  rsspls > processing https://www.deeplearning.ai/the-batch/
 ERROR rsspls > error processing feed for https://www.deeplearning.ai/the-batch/

Caused by:
    invalid selector for date: a.rounded-md

I'm pretty sure document.querySelectorAll("article a.rounded-md") returns the date elements in my browser. What could be the problem?
As a workaround, I used selector = "div a", which seems to work, but with some warnings:
 WARN  rsspls > unable to parse date ''
 WARN  rsspls > unable to parse date ''
 WARN  rsspls > unable to parse date ''

Wow the markup of that page is the antithesis of semantic HTML. I think the issue is that the article selector is too broad. It's selecting items in the "Popular Articles" section, which don't have an element matching a.rounded-md.
article.h-full looks like it will select the big article as well as the smaller ones following it.


harfbuzz: disable docs if cross compiling

Description of changes
This disables the gtk-doc builds when cross-compiling harfbuzz.
I needed this PR in order to build #148618.
Things done

Built on platform(s)

[X] x86_64-linux (cross to aarch64-multiplatform)
[X] powerpc64le-linux (cross to aarch64-multiplatform)
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

@ofborg eval

Closed because this appears unnecessary; see: https://github.com/NixOS/nixpkgs/pull/148618#issuecomment-1112874857
Still not sure why builds fail for me without this, but it must be a local issue.

FYI, probably this: https://github.com/NixOS/nixpkgs/pull/168753


DESX incorrect output

Inputs:
cleartext: {0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0xde, 0x7f, 0x00,
0x00, 0x00, 0x00, 0xff, 0xe0, 0x10, 0x00} (16 bytes)
cipher iv: {0x11, 0x01, 0xee, 0x42, 0x08, 0x00, 0x00, 0x10} (8 bytes)
cipher key: {0x00, 0x14, 0x64, 0x00, 0x00, 0x00, 0xfb, 0xf7, 0x00,
0x00, 0x00, 0x14, 0x13, 0x00, 0x00, 0x00,
0x06, 0x05, 0x00, 0x01, 0x00, 0x00, 0x1e, 0x00} (24 bytes)
cipher: DESX_CBC
OpenSSL (all versions) produce:
ciphertext = {0xdb, 0x21, 0xb3, 0xb3, 0xbe, 0xc5, 0x56, 0x3e, 0xe9,
0x94, 0xbc, 0xc3, 0xfa, 0xac, 0x03, 0xeb,
0xb8, 0x72, 0x23, 0x21, 0xd1, 0x62, 0xc8, 0xe8} (24 bytes)
but both Botan and Crypto++ produce:
ciphertext = {0xae, 0x62, 0x4c, 0xc9, 0x56, 0xab, 0x18, 0xc9, 0xa4,
0xe1, 0xdf, 0x8a, 0x00, 0x11, 0x4e, 0x27,
0xec, 0x98, 0x06, 0xf7, 0x01, 0x7e, 0x87, 0x86} (24 bytes)
making it likely that OpenSSL gets it wrong.

Least I didnt break this one :)

Least I didnt break this one :)

... yet :laughing:

I think this is a problem of lack of standards. I could not find a definitive standard to describe DESX and most importantly how keys are represented. This wikipedia article gives a good overview of how it works:
https://en.wikipedia.org/wiki/DES-X
Essentially in DESX there are 3 keys, which I will call key0, key1 and key2. Each key is 8 bytes long. A DESX operation on an 8 byte plaintext is:
XOR(key2, DESX(key0, XOR(key1, plaintext)))
So key1 is xor'd with the plaintext first. Then key0 is used as a standard DES key to encrypt the output of the XOR operation. Finally the output is XORd again using key2.
However, from an API perspective we (and presumably other libraries) represent these 3 keys as a single 24 byte key. But since there doesn't seem to be a standard behind this, I can't find a definitive reference to how those 3 keys should be combined together to form that 24 byte key.
OpenSSL assumes that the 3 keys are concatenated together in the order key0, key1, key2. However if I take your key and reorder it so that it becomes key1, key0, key2 then I get the same output from OpenSSL that you do for Botan and Crypto++.
Therefore I conclude that OpenSSL is acting correctly and the difference is due to a different interpretation of how keys should be represented.

Thanks for researching this Matt! I will make a subdivision into DESX_A and DESX_B in Cryptofuzz so this discrepancy doesn't show up.


Add OpenSSH Article and Cover Image 2

@Menmarin did you verify that this renders correct locally?

@Menmarin did you verify that this renders correct locally?

Yeah, Im using VSCode and it has a plugin that let's me view markdown as I write it and I have no issues with it rendering.

@Menmarin did you verify that this renders correct locally?

Yeah, Im using VSCode and it has a plugin that let's me view markdown as I write it and I have no issues with it rendering.

No, you can't just preview the markdown. You need to run docker-compose up and browse it to make sure it renders in Jekyll.

@Menmarin did you verify that this renders correct locally?

Yeah, Im using VSCode and it has a plugin that let's me view markdown as I write it and I have no issues with it rendering.

No, you can't just preview the markdown. You need to run docker-compose up and browse it to make sure it renders in Jekyll.

I just ran it through docker-compose up and havent got any errors.

I just ran it through docker-compose up and havent got any errors.

That's not sufficient. You need to make sure it renders properly too. I spotted an error, which is why i wanted you to find it. In any case, too much going back-and-forth on this. I will merge this PR and fix it myself.

@Menmarin see https://github.com/WoTTsecurity/wott-io/commit/3f4db98d690f24e3e234e83966eab50c53405e35 for the changes I made.


@popperjs/core

@Saeed-Pooyanfar
it's a custom to provide short explanation on why this one should be added. Backward link to your PR is perfectly OK

@Saeed-Pooyanfar
it's a custom to provide short explanation on why this one should be added. Backward link to your PR is perfectly OK

https://github.com/DefinitelyTyped/DefinitelyTyped/pull/50437
Thanks

https://github.com/DefinitelyTyped/DefinitelyTyped/pull/50437
Thanks


Fast Encryption broken due to wrong logger initialization

Fast Encryption's script would always crash due to having a null pointer reference when trying to log.

+1 ;-( rip transmitter


Moving archive categories to bottom in Discord

Below the nonarchive categories

From dev discussion today: Potentially impossible?

Seems to be possible through positions argument: https://discord.com/developers/docs/resources/channel
It is not really behaving as I expected (position = 0 is not creating a category at the top), maybe due to the permissions or sth 🤷♀