Support Kubernetes Lists

Validating Lists does not seem to be supported:
stdin - failed validation: could not find schema for List

kubeconform should recognize the kind and validate items individually.
We mostly use it to validate Jsonnet deployments, this format allows the output to be directly passed to kubectl apply -f - (since JSON does not have an equivalent to YAML document streams). An example out there if that can clarify:
https://github.com/brancz/kubernetes-grafana/blob/master/examples/basic.jsonnet
This is supported in kubeval 0.15.0+. Here is the initial implementation and follow up fixes if that helps:
https://github.com/instrumenta/kubeval/pull/221
https://github.com/instrumenta/kubeval/pull/283
https://github.com/instrumenta/kubeval/pull/284

From a quick look at the code, it seems we can only identify Kind: List from this line:
https://github.com/yannh/kubeconform/blob/fa1cb3702047eb194086d80ba2666bf438cc4689/pkg/validator/validator.go#L115
We would probably need to unmarshall before ValidateResource(), if we want to benefit of the parallel workers:
https://github.com/yannh/kubeconform/blob/fa1cb3702047eb194086d80ba2666bf438cc4689/cmd/kubeconform/main.go#L116-L124

Hi @maxbrunet , thanks for the report. Kubeconform should work as a dropin replacement for kubeval and therefore support Lists. I am looking into this :+1:

WIP: https://github.com/yannh/kubeconform/pull/54/files
The results of the signature call is actually cached, so this should not have an impact in most cases. We'll need a second unmarshall when the resource is a list, but that is likely unavoidable.

@maxbrunet this should be good to go https://github.com/yannh/kubeconform/pull/54/files
Want to review?

Went ahead and released v0.4.8, lmk if this works for you!

Wow thank you @yannh, that was fast!
I had started doing some work, but not much, mostly tried to get around with a single unmarshall.
I had spotted this:
https://github.com/yannh/kubeconform/blob/c4b044f3be2e06922b4409e4ccafce02b91d166d/pkg/resource/stream.go#L51
It works for small regular deployments, but I have a 17MB output for our Grafana deployment, mainly dozens of dashboards in ConfigMaps: 😛
Summary: 0 resource found parsing stdin - Valid: 0, Invalid: 0, Errors: 0, Skipped: 0

Note: Like kubeval, I am assuming noone is weird enough to make recursive lists ;)

Good news, lists cannot be nested, items must be APIResources: https://pkg.go.dev/k8s.io/apimachinery/pkg/apis/meta/v1#APIResourceList
Although there are other types of APIResourceLists. For example, RoleBindingList and RoleList are used here:
https://github.com/prometheus-operator/kube-prometheus/blob/f9fd5bd499482486de1485abc73effbb6a51f35f/jsonnet/kube-prometheus/components/prometheus.libsonnet#L135-L139
I used to flatten those in my deployment, until I reconfigured it differently and stopped needing them. They have schemas, but I guess kubeconform (or kubeval as of now) would not fail if it sees them inside a List and does not validate the resources inside (likely just a nitpick).

@maxbrunet the results of the unmarshall to get the signature are cached, so it should save an unmarshall down the line and be ok in the end.  Mhhhh, could you confirm it works for at least a part of that file?I did add a test so it works with stdin... it's a pretty big file but I would expect it to work? If you strip down to keep just the first 3 resources, does it work?
Thanks!

Yes, I confirm, as I said it works for an output of less than 4MB.
And yes, a configurable maxResourceSize could do the trick.
But have you tried to use a default buffer with io.Copy() and let it resize itself like in https://github.com/instrumenta/kubeval/pull/220? Does that use a lot more memory?
If you want to reproduce, here's a couple quick and dirty scripts to generate large files:

json.go
package main

import "fmt"

const (
	N = 20000
)

func main() {
	fmt.Println(
		`{
    "apiVersion": "v1",
    "kind": "List",
    "items": [`,
	)

	for i := 0; i < N; i++ {
		fmt.Printf(
			`        {
            "apiVersion": "v1",
            "kind": "ConfigMap",
            "metadata": {
                "name": "yet-another-confimap-%d"
            },
            "data": {
                "key": "value"
            }
        }`,
			i,
		)
		if i == N - 1 {
			fmt.Println()
		} else {
			fmt.Println(",")
		}
	}

	fmt.Println(`    ]
}
`)
}

yaml.go
package main

import "fmt"

func main() {
	fmt.Println(
		`apiVersion: v1
kind: List
items:`,
	)

	for i := 0; i < 50000; i++ {
		fmt.Printf(
			`- apiVersion: v1
  kind: ConfigMap
  metadata:
    name: yet-another-confimap-%d
  data:
    key: value
`,
			i,
		)
	}
}

@maxbrunet I think the problem is slightly different - if the support for lists works, would you mind opening a new ticket for large resource files? :pray:


Weird performance issue with the hamburger menu

One of things I often experience as a performance issue in the app is that right after opening the app, I often want to open the hamburger menu/drawer widget.
However, oddly, sliding out the the drawer works fine for several seconds before the hamburger menu works (I even tried opening the drawer, closing it again, and hitting the hamburger menu, and it still delays).
This is from testing against chat.zulip.org.

Closing as resolved.
We should keep improving the performance and keep an eye on any regressions.


Add url callback in the Cuckoo REST API (/tasks/create/file and /tasks/create/url)

Add a field callback to resources (/tasks/create/file and /tasks/create/url) on REST API.
This field can be used to report the a finished analysis.

Closed as duplicates #420


[BUG] Do not use the 'search' queue for everything

v 2.11.1
Our cluster was stable on a r5.2xlarge instance, hovering at ~10% CPU usage. Then we enabled windows detectors and even a r5.8xlarge isn't enough.
We were experimenting with detectors. But they essentially brought down our entire instance.
The main issue can be boiled down to the fact that it's all running in the same 'search' queue. The detector UI is backed by 'search', the detectors themselves are backed by 'search' etc.
Why is this the worst idea ever?
Because as the detectors fill up the queue and cause literally millions of searches to be rejected, ~48 Million per hour were observed overnight.
While this is a tuning and scaling issue, it also completely killed ingestion (our spark pipeline kept failing to write to OS and dropped it in our DLQ) and all dashboards no longer work since the UI also uses the 'search' queue.
So it wasn't just detectors that were failing. Everything started to fail. We couldn't even stop the detector because that request kept failing as well.
We have tried tuning the queues, but even a queue size of 100K is still filling up and we're still running into memory issues.
Management wanted us to try to use Detectors as they were hoping we'd no longer have to maintain our own rules engine with Sigma rules. But it can do the job with far less resources on the exact same data set and not affect anything else if it falls behind.
We are no longer moving forward with OS security analytics.

hi @mvanderlee , we have a bunch of performance fixes we're planning to release for 2.13. We're aware of the high cpu & high jvmmp issues caused by running security-analytics detectors.
These issues should go away once the 2.13 release is out.

also, some of the optimizations which you can already try out is using an index alias to configure a detector instead of an index pattern. Here are the steps to do it.
1. ISM Changes

Define Component Template with mappings

PUT /_component_template/test-alias-template458
{"template" : {
  "mappings": {
    "properties": {
      "hello": {
        "type": "text"
      }
    }
  }
}}

Define Index template with the component template

POST /_index_template/test-index-template458
{
  "index_patterns": [
    "test-index458-*"
  ],
  "composed_of": [
    "test-alias-template458"
  ]
}

Create Initial Index

PUT /test-index458-1
{
  "aliases": {
    "test-alias458": {
      "is_write_index": true
    }
  }
}

Index data via the alias

POST /test-alias458/_doc
{
  "hello": "world"
}

use the alias test-alias458 to create the detector now.

@sbcd90 glad to hear it.
Until then, can you confirm if rejected tasks mean that events are not being analyzed by the detector, and thus not be alerted upon?

And we already have aliases, but they don't show up as options in the Data source dropdown. We'll try just entering it manually.
It'd be great if it could show aliases in the UI and preferably prioritize them.

@mvanderlee already working on showing the aliases in the dropdown and should be available in 2.13


[SUPPORT] hudi is incurring emrfs eTag inconsistency issue with s3 and emrfs consistent view

Received the following error using the default installation of Hudi in EMR 5.29.0 (Hudi version 5.0.0):
RetryInvocationHandler: Exception while invoking ConsistencyCheckerS3FileSystem.open over null. Retrying after sleeping for 35000ms. com.amazon.ws.emr.hadoop.fs.consistency.exception.ConsistencyException: eTag in metadata for File '<s3 path>/.hoodie_partition_metadata' does not match eTag from S3!
This is typically happening due to eTag verification in emrfs consistent view, which verifies that for a file on s3, we are using the latest version of the file (based on the eTag stored in dynamoDB table). We posed this question on stack overflow and saw someone commented that this happens when you are writing files without using emrfs, but rather with standard AWS-SDK. Is current hudi implementation working on emrfs consistent view (a solution we put in earlier to overcome S3 eventual consistency issues in spark)? If so, do we need to disable fs.s3.consistent.metadata.etag.verification.enabled?

@umehrot2 : Can you help answer this question. Thanks.
Balaji.V

@tsolanki95 Does this happen at the time read? In my tests, I noticed etags are not being in sync for .hoodie folder.
Also what are your reasons to enable consistent view when using hudi.

We put in consistent view as a solution earlier, based on AWS support, to solve issues with using spark with S3 eventual consistency model. We are now looking towards changing some of our datasets to utilize hudi but our compute resources still utilize EMRFS consistent view. As part of the transition, when some of our datasets utilize hudi and some do not, it would be good to be able to run spark with hudi on EMRFS consistent view.

This is also a field where data quality, precision, and accuracy are important. EMRFS consistent view helps us keep us having issues with s3 consistency, some of the features that hudi provides with rollback capabilities, and auditing and tracking changes made to our table are incredibly powerful for helping find and isolate data quality errors and rollback and rerun data with fixed input data/code.

@tsolanki95 have you tried using hoodie.consistency.check.enabled which is Hudi's in-built mechanism for avoiding eventual consistency issues instead ?
As for this particular issue with EmrFS consistent view are these temporary errors which resolve on retrying or is it causing the job to fail ? Yes disabling fs.s3.consistent.metadata.etag.verification.enabled could be a way ahead if this is blocking you while EMR team can try investigating this issue.
cc @bschell who actually worked on the etag feature in EmrFS. Do you see any obvious cause for this ? Else, we can possibly have them open a ticket to AWS EMR support and investigate from there.

Also on a side note, we always recommend using latest EMR releases as it has latest fixes and version of applications. So you may want to use emr-5.30.1 instead.

@tsolanki95 As mentioned, it would be good to know the steps that you take to encounter this issue. Is this consistently reproducible? Does it resolve on retry? Otherwise it might be best to open a ticket with AWS EMR Support.

@tsolanki95 : This would be best addressed by opening a ticket with EMR support. Closing this ticket. Please reopen if this is specific to hudi.

@tsolanki95 what resolved this issue, I am facing the same issue when reading data written in hudi format from S3


FieldRoot context not reactively updating to child components

Description
Hey there! 👋🏻
The invalid state passed to the FieldRoot component is correctly propagated to its child components at the time of initial creation. However, it does not reactively update the child components when the state changes later. As a result, the FieldErrorText component does not update to display the error message when the invalid state is updated.
Link to Reproduction (or Detailed Explanation)
https://codesandbox.io/p/devbox/8ydv2v
Steps to Reproduce

Open the reproduction.
Observe the Initial Error Message displayed by the FieldErrorText component.
Change the input, which sets the errorMessage of the first component.
See the invalid state change but observe that the FieldErrorText does not update to reflect the new error message.

Ark UI Version
4.5.0
Framework

[ ] React
[ ] Solid
[X] Vue

Browser
ZenBrowser
Additional Information
No response

I just pushed a fix for this. We'll release an update shortly.
If the issue persists after upgrading, I'll re-open it.


Finish documentation "Concepts" section

See:

https://github.com/rerun-io/rerun-docs/blob/main/docs/concepts.md
https://github.com/rerun-io/rerun-docs/blob/main/docs/concepts/

Concepts to cover:

[x] Entities and Components: https://github.com/rerun-io/rerun-docs/pull/8
[x] Path Hierarchy: https://github.com/rerun-io/rerun-docs/pull/8
[x] Spaces
[x] Blueprints
[x] Events and Timelines
[x] Transforms
[x] Batch Data
[x] Selections
[x] Apps and Sessions

batch data & apps and sessions went in as well now. DONE!!!! :)


Setting a Team breaks cross tracker cloning

When setting a value for Team, the cloning fails.

Fixed in 3.1.2 by treating Team in the same way as Planning Folder.
Both fields will be cleared for cross tracker clones.


Can we make Israel's settlements landuse fills?

Instead nation border?

There is no obvious way to remove these, other than turning off "states" under "borders"


munin-node service: apc_nis plugin is enabled and throws errors

Issue description
When I enable munin, the apc_nis plugin gets enabled automatically and is periodically throwing errors:
Error output from apc_nis:
Could not create socket: Connection refused
Service 'apc_nis' exited with status 111/0.

According to the plugin description, „apc_nis - Plugin to monitor APC UPS via the nis port of apcupsd“. I don't have any UPS running, though. Any idea why this plugin is enabled automatically, or how to disable it? Should I report that as an upstream bug?
Steps to reproduce
services.munin-node.enable = true;
Technical details

System: NixOS 17.03pre101636.183eeb3 (Gorilla)
Nix version:  nix-env (Nix) 1.11.6
Nixpkgs version: 17.03pre101636.183eeb3

Workaround I now use, which disables the plugin:
  services.munin-node.extraConfig = ''
    # Ignore the apc_nis plugin, as it throws errors as I don't have an UPS.
    # It's there because munin-node-configure is called with the contrib group,
    # and the plugin has no method to check whether there's a compatible UPS available.
    ignore_file ^apc_nis$
  '';

Which file should I paste this code into?


Date of birth input should use input view not calendar view

Avoid duplicates

[X] Bug is not mentioned in the FAQ
[X] Bug is specific for Android only, for general issues / questions that apply to iOS and Android please raise them in the documentation repository
[X] Bug is not already reported in another issue

Technical details

Device name: Google Pixel 3a emulator
Android version: 11
App version: 2.7.1 (and 2.9.0-RC0)

Describe the bug
The date picker for date of birth in the Rapid Test Profile and in COVID Test Certificate opens by default in calendar view. The recommended view for dates not near to the current date, like dates of birth, is input view.
The title of the date picker is not set. The default "SELECT DATE" is shown.
Steps to reproduce the issue

Set locale to English (United Kingdom)
Tap "Manage Your Tests"
Tap "Create Rapid Test Profile" (tap "CONTINUE" if prompted)
Tap "Date of Birth"
Note that the date picker appears in calendar view, with title "SELECT DATE" and today's date selected
Tap "CANCEL", tap back arrow
Tap "Scan QR Code", tap "ACCEPT"
Scan QR Code e.g. PCR Test QR Code
Tap "Date of Birth"
Note that the date picker appears in calendar view, with title "SELECT DATE"

Expected behavior
Follow the advice from https://material.io/components/date-pickers#mobile-pickers and use the mobile date input picker, not the calendar view.
Add the title "Date of Birth" to the data picker, so the user is reminded what data they are being asked to enter.
Possible Fix
After https://github.com/corona-warn-app/cwa-app-android/blob/97fbc95b71db96ed637af3eaa35118eb705a1611/Corona-Warn-App/src/main/java/de/rki/coronawarnapp/ui/coronatest/rat/profile/create/RATProfileCreateFragment.kt#L130-L132
add
.setInputMode(MaterialDatePicker.INPUT_MODE_TEXT)
.setTitleText(getResources().getString(R.string.rat_profile_create_birth_date_hint))

After https://github.com/corona-warn-app/cwa-app-android/blob/97fbc95b71db96ed637af3eaa35118eb705a1611/Corona-Warn-App/src/main/java/de/rki/coronawarnapp/ui/submission/covidcertificate/RequestCovidCertificateFragment.kt#L133-L135
add
.setInputMode(MaterialDatePicker.INPUT_MODE_TEXT)
.setTitleText(getResources().getString(R.string.request_green_certificate_birthdate_hint))

Workaround
Select input view from calendar view by tapping the pencil icon.

Additional context
https://material.io/components/date-pickers#mobile-pickers says
Don't
Don’t use a calendar picker to prompt for dates in the distant past or future, such as a date of birth. In these cases, use a mobile input picker or a text field instead.
Do
For dates that don’t require a calendar view, make the mobile date input picker as the default prompt.

Internal Tracking ID: EXPOSUREAPP-9128

@MikeMcC399 Thanks. Internal Tracking ID: EXPOSUREAPP-9128
I assume that you have tested this approach. Do you want to prove a PR?

@dsarkar
Yes, I did already try it out and I can provide a PR if dev would like this submission.
It is an enhancement, not a bug correction. It is just more inconvenient to enter a date of birth from the calendar view.
Let me know if the PR is wanted. If they say no, then that is OK with me.

@MikeMcC399 ok, thanks for the offer. Stand by, I check with them.

@MikeMcC399 devs need to check with UX team first. So, currently waiting for their feedback.

PR #3993
"Change date of birth entry from calendar to input view (EXPOSUREAPP-9128) (COMMUNITY)"
is merged into release/2.10.x

Verified on tag/v2.10.1.
Closing as fixed.


Merging recomm_sys

Adding the recommendation system experiments. Please ignore any changes outside the (examples/recomm_system) directory.

Adding the recommendation system experiments

@akkadhim Could you please export your noisy datasets to a CSV file for testing in other languages?

@akkadhim Could you please export your noisy datasets to a CSV file for testing in other languages?

Sure, below are different datasets for different noise ratios.
noisy_dataset_0.05.csv
noisy_dataset_0.005.csv
noisy_dataset_0.02.csv
noisy_dataset_0.2.csv
noisy_dataset_0.01.csv
noisy_dataset_0.1.csv

@akkadhim Thank you!

@akkadhim Is it correct that, after one-hot booleanization, your input data consists of 10709 bits? This includes 1350 unique product_ids + 317 categories + 9042 user_ids.

@akkadhim Is it correct that, after one-hot booleanization, your input data consists of 10709 bits? This includes 1350 unique product_ids + 317 categories + 9042 user_ids.
After expanding the original dataset and adding the noise, the unique features will be:
Users:  1193
Items:  1350
Categories:  211
I used the one_hot_encoding for the TM classifier, and at that step, the dataset split to train and test portions.

@akkadhim
Got it. However, the columns category and user_id contain lists of categories and users, joined by the "|" and "," characters. Why weren’t they split into individual unique categories and user IDs? Could you confirm if your method of booleanization is correct?

@akkadhim
I tested both booleanization methods (yours and mine) and obtained approximately the same validation accuracy.
I split your dataset such that the first 80% is used for training, and the last 20% for validation.
 However, the columns category and user_id contain lists of categories and users, joined by the "|" and "," characters (for example: "Computers&Accessories|Accessories&Peripherals|Cables&Accessories|Cables|USBCables" or "AH4BURHCF5UQFZR4VJQXBEQCTYVQ,AGSJLPK6HU2FB4HII64NQ3OYFFFA,AGG75KFRXNLCYVRAPA6D4ZBNTNSA"). Why weren’t they split into individual unique categories and user IDs? Could you confirm if your method of booleanization is correct?

For the user_id, the CSV formatting rules allow handling such cases by enclosing the value in double quotes, while the categories column format maintains the original structure of the dataset. Splitting these fields would alter the representation of hierarchical categories and associated user IDs.
Yes, it is correct.

@akkadhim I tested both booleanization methods (yours and mine) and obtained approximately the same validation accuracy. I split your dataset such that the first 80% is used for training, and the last 20% for validation.

Very impressive! Nice work, @BooBSD!


vaultwarden: 1.28.1 -> 1.29.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for vaultwarden is: Unofficial Bitwarden compatible server written in Rust
meta.homepage for vaultwarden is: https://github.com/dani-garcia/vaultwarden
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.29.0 with grep in /nix/store/jfs0mn2y52gl3vlxqrn78hxbfcykpxf9-vaultwarden-1.29.0
found 1.29.0 in filename of file in /nix/store/jfs0mn2y52gl3vlxqrn78hxbfcykpxf9-vaultwarden-1.29.0

Rebuild report (if merged into master) (click to expand)

6 total rebuild path(s)

6 package rebuild(s)

First fifty rebuilds by attrpath
nixos-install-tools
tests.nixos-functions.nixos-test
vaultwarden
vaultwarden-mysql
vaultwarden-postgresql
vaultwarden-sqlite

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/jfs0mn2y52gl3vlxqrn78hxbfcykpxf9-vaultwarden-1.29.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A vaultwarden https://github.com/r-ryantm/nixpkgs/archive/92da31ef941fe0a68e66277cc434134839632ed2.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/jfs0mn2y52gl3vlxqrn78hxbfcykpxf9-vaultwarden-1.29.0
ls -la /nix/store/jfs0mn2y52gl3vlxqrn78hxbfcykpxf9-vaultwarden-1.29.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package blacklisted:

nixos-install-tools

3 packages built:

vaultwarden
vaultwarden-mysql
vaultwarden-postgresql

Maintainer pings
cc @msteen @ivan for testing.

Duplicate of #242492.


Versions with non-digits are not interpreted correctly by UserAgentParser

WhichBrowser adds the nickname of the OS release before the version number. So the version is "Yosemite 10.10" and not just "10.10". UserAgentParser interprets this as "0.10".
See for example:
http://useragent.mkf.solutions/?userAgent=Kodi%2F14.0+(Macintosh%3B+Intel+Mac+OS+X+10_10_3)+App_Bitness%2F64+Version%2F14.0-Git%3A2014-12-23-ad747d9-dirty
This also happens with many other libraries with versions like "XP" for Windows XP. It is interpreted by UserAgentParser as "0".
See for example:
http://useragent.mkf.solutions/?userAgent=Microsoft+Office%2F14.0+(Windows+NT+5.1%3B+Microsoft+Outlook+14.0.4536%3B+Pro%3B+MSOffice+14)
The function getParts() should probably skip over any non digit characters in the version string before splitting it into parts.
Also when setComplete() is called, it first stores the original string as the $complete property, then hydrates all the parts. But the hydrateVersionParts() function calls setMajor(), setMinor() and setPatch() which in turn call calculateComplete() which overwrites the original $complete property that was initially set. This means the original string calculated by the parser is lost.

This seems to be a real problem which i not covered until yet.
After checking the two UA you provided, following providers are affected by this two examples

DonatjUAParser
SingergiBrowserDetector
PiwikDeviceDetector
WhichBrowser
YzalisUAParser

Major/minor/patch are numbers, which i want to keep clean with numbers only. The question is if their are real version numbers which are not numeric?
E.g. alpha, beta, RC, ...?? Or dates are sometimes also used as versioning? We need here some examples.
Reason is simple: Mixing is always bad, so comparisons like $os->getVersion()->getMajor() >= 7 wont work correctly anymore.
But OS nicknames are nice, so we should support them.
We may could/should also show it in the complete string. Or we split it to multiple methods.
$version->getNumberComplete(); // only numeric version with . (i dont like the method name yet)
$version->getComplete() // nickname with numeric version?
class Version{

    // number
    private $major;
    // number
    private $minor;
    // number
    private $patch;

    // numeric with . seperator
    private $completeNumeric

     // string e.g. XP
    private $alias;

    // string e.g. XP 5.1 | or only numeric?
    private $complete;

    // maybe a stability flag?
    private $stability;

}

Other things to keep in mind, if we do it in this kind of way

support stability flag (beta, rc, alpha,...)
..?

Beta example:
Mozilla/5.0 (X11; U; Linux i686; xx; rv:1.9b5) Gecko/2008052519 CentOS/3.0b5-0.beta5.6.el5.centos Firefox/3.0b5

Alpha example:
Mozilla/5.0 (Android 4.3.1; rv:6.0) Gecko/20100101 Firefox/26.0prealpha

WhichBrowser can provide the version in two ways:

A string that is meant to be displayed on screen
A string that is contains a version number - same specificity as the UA but reformatted

Sometimes the display string contains a prefix and the version number. Sometimes just an alias. And sometimes just the major version.
For example:

On OS X: "Yosemite 10.10" and "10.10"
On Windows: "XP" and "5.1"
And for Chrome: "30" and "30.0.1599.17"

This should be fixed now with PR #38

complete is always used as is
the hydration of major/minor/patch/alias was refactored that it should cover most cases

major/minor/patch is still number only
alias is populated when there is something else that number provided and not alpha/beta/...


Changing MAC Adress

Is there a way to change the MAC adress that is broadcasted from a peripherial?

@paulgavrikov this is not implemented currently.
Could you please provide more details on your use case?

I am working on a repeater device, which works by mirroring a peripheral. I know that some chinese devices support changing MAC, so I was wondering if this could work here, too.

On 27 Nov 2015, at 00:59, Sandeep Mistry<EMAIL_ADDRESS>wrote:
@paulgavrikov https://github.com/paulgavrikov this is not implemented currently.
Could you please provide more details on your use case?
—
Reply to this email directly or view it on GitHub https://github.com/sandeepmistry/bleno/issues/153#issuecomment-160007799.

@paulgavrikov bleno could support using a random BT address on Linux, but not a high priority currently.
For public address, you can use the BlueZ bdaddr tool can be used to change the address of most CSR and Broadcom adapters.
http://git.kernel.org/cgit/bluetooth/bluez.git/tree/tools/bdaddr.c

Thanks! I will try bdaddr!

On 27 Nov 2015, at 01:15, Sandeep Mistry<EMAIL_ADDRESS>wrote:
@paulgavrikov https://github.com/paulgavrikov bleno could support using a random BT address on Linux, but not a high priority currently.
For public address, you can use the BlueZ bdaddr tool can be used to change the address of most CSR and Broadcom adapters.
http://git.kernel.org/cgit/bluetooth/bluez.git/tree/tools/bdaddr.c http://git.kernel.org/cgit/bluetooth/bluez.git/tree/tools/bdaddr.c
—
Reply to this email directly or view it on GitHub https://github.com/sandeepmistry/bleno/issues/153#issuecomment-160009188.

@paulgavrikov no problem!


Help to build GEOSgcm on a new server

Hi @mathomp4,
Would you please help (provide instructions) @gmao-cda build:

baselibs
GEOSgcm

on measures1.umd.edu @gmao-cda is going to provide a list of compilers and libraries he currently has. Thanks a lot for the help!

@sanAkel I can give it a try. I'll need to know what compilers and MPI stacks they have. If they are new enough, it should be doable...unless that machine is a weird one.

Hi @mathomp4 ,
Thank you for the help!
Below is the server info:

Hardware:

CPU: Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz. (8 cores)
8GB RAM
4TB free space shared by users

Software:

OS: Red Hat Enterprise Linux Server release 7.9 (Maipo).
GNU compiler (gcc/g++/gfortran) gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC)
No MPI installed.

Oooh boy. Yeah, you'll need to install GCC 11.3.0 or 12.1.0 on the machine. And then Open MPI built by that compiler.
You might be able to install GCC 11/12 with the RHEL package manager but 7.9 is old enough that you might have to build it yourself. As for MPI, build that yourself as well as I never really trust MPI stacks from vendors. Better to build your own.

@mathomp4
Thanks for your guidance!
I will try to first install gcc and Open MPI first.
Do you know which branch (commits) of baselibs and GEOSgcm should I build on?
I previously had fortune to build the following packages on my home Desktop as my warm-up workout:

System info:
- Ubuntu 20.04 LTS (Linux_x86) + gnu version 11.2.0 (gcc, gfortran, g++) + openmpi 4.1.2
GEOS package info:
- EMSA-baselibs v6.2.14 [3b3c1e4]
- mepo [1310b69]
- GEOSgcm tag: v10.22.3 [8e8c40c]

It seems when I install the full version of ESMA (make install ESMF_COMM=openmpi), I need to tweak a little bit on my local machine.
The main problem I met was: EMSA-baselibs v6.2.4 does not include lib expat, which is required by udunits2, and udunits2 is required by cdo. I tweaked a little bit to install it.
I documented the whole installation process at https://github.com/cd10kfsu/GEOSgcm/wiki/Install-GEOS-GCM

If you are going to build it, I say go for the latest:

Baselibs v7.5.0
mepo main or latest tag (I think it's v1.45.0)
GEOSgcm v10.22.5

As for expat I'd do something different and just...not build it! You can get Baselibs and build as:
make install ESMF_COMM=openmpi BUILD=ESSENTIALS

This gets you the "essentials" of Baselibs. Many of the libraries are built for other reasons around GEOS, but you shouldn't need them. Maybe the one extra I can see as useful is nccmp but that can be built later. (Now, if you do need cdo then you have to do the expat fun. Though you should be able to get it from RPM/Yum/whatever RHEL is using now.)

Thank you @mathomp4.
On the cdo I have not used in a few years. I used to rely on it few years ago until I made friends with xarray and xesmf!

I started building gcc 11.3, got the following error:
configure: error: Building GCC requires GMP 4.2+, MPFR 3.1.0+ and MPC 0.8.0+.
Try the --with-gmp, --with-mpfr and/or --with-mpc options to specify
their locations.  Source code for these libraries can be found at
their respective hosting sites as well as at
https://gcc.gnu.org/pub/gcc/infrastructure/.  See also
http://gcc.gnu.org/install/prerequisites.html for additional info.  If
you obtained GMP, MPFR and/or MPC from a vendor distribution package,
make sure that you have installed both the libraries and the header
files.  They may be located in separate packages.
It seems I need to build a lot from scratch.
Will keep you updated.
Thank you!

Luther at ESSIC helped me build the gnu version 8.3.1, and openmpi 3.1.3 on the server. He confirmed it is not possible for him to build gnu compiler version 11.3 or 12.0 through RHEL package manager.

@gmao-cda Those prereqs are in the GCC source. For example, to build GCC 12.1 you can do:
wget https://mirrors.concertpass.com/gcc/releases/gcc-12.1.0/gcc-12.1.0.tar.xz
tar xf gcc-12.1.0.tar.xz
cd gcc-12.1.0
./contrib/download_prerequisites
cd ..
mkdir BUILD-gcc-12.1.0 && cd BUILD-gcc-12.1.0
../gcc-12.1.0/configure --prefix=/path/to/where/you/want/gcc-gfortran/12.1.0 --enable-languages=c,c++,fortran |& tee configure.log
make -j4 |& tee make.log
make install |& tee makeinstall.log

I think that should work

Then for Open MPI 4.1.4 something like:
mkdir build-gcc-gfortran-12.1.0
cd build-gcc-gfortran-12.1.0
../configure CC=gcc CXX=g++ FC=gfortran --prefix=/path/to/where/you/want/gcc-gfortran-12.1.0/openmpi/4.1.4 |& tee configure.gcc-gfortran-12.1.0.log
mv config.log config.gcc-gfortran-12.1.0.log
make -j4 |& tee make.gcc-gfortran-12.1.0.log
make install |& tee makeinstall.gcc-gfortran-12.1.0.log
make check |& tee makecheck.gcc-gfortran-12.1.0.log

BUT you want to make sure the gcc, g++ and gfortran are the ones you just built. So either put them in your PATH first or you'll need to use gcc-12, g++-12, and gfortran-12 and then be careful to do so ever after. You can write a modulefile to make that easier.

Thank you very much @mathomp4 ! your script is so clear.
I added the flag --disable-multilib when building gcc-12.1.0, due to this error message when configure

finish building GNU 12.1.0 (build duration: 2hours).

Finish building open MPI 4.1.4.
also built cmake-3.24.0, since no cmake on the current system.
(built duration: 58 min)

Finish building EMSA-baselibs v7.5.0
git clone --recurse-submodules -b v7.5.0 https://github.com/GEOS-ESM/ESMA-Baselibs.git
make install ESMF_COMM=openmpi BUILD=ESSENTIALS

-------+---------+---------+--------------
Config | Install |  Check  |   Package
-------+---------+---------+--------------
--   |   --    |   --    | antlr2
--   |   --    |   --    | gsl
ok   |   ok    |   --    | jpeg
ok   |   ok    |   --    | zlib
ok   |   ok    |   --    | szlib
--   |   --    |   --    | curl
ok   |   ok    |   --    | hdf4
ok   |   ok    |   --    | hdf5
ok   |   ok    |   --    | netcdf
ok   |   ok    |   --    | netcdf-fortran
--   |   --    |   --    | netcdf-cxx4
--   |   --    |   --    | udunits2
--   |   --    |   --    | nco
--   |   --    |   --    | cdo
--   |   --    |   --    | nccmp
ok   |   ok    |   --    | esmf
ok   |   ok    |   --    | xgboost
ok   |   ok    |   --    | GFE
ok   |   ok    |   --    | FLAP
--   |   --    |   --    | hdfeos
--   |   --    |   --    | hdfeos5
--   |   --    |   --    | SDPToolkit
-------+---------+---------+--------------

encountered error when using mepo clone:
mepo version: git clone https://github.com/GEOS-ESM/mepo.git
The error messages are:
(cda_suite) [cda@measures1 GEOSgcm]$ mepo clone
error: Unknown subcommand: get-url
usage: git remote [-v | --verbose]
   or: git remote add [-t <branch>] [-m <master>] [-f] [--tags|--no-tags] [--mirror=<fetch|push>] <name> <url>
   or: git remote rename <old> <new>
   or: git remote remove <name>
   or: git remote set-head <name> (-a | -d | <branch>)
   or: git remote [-v | --verbose] show [-n] <name>
   or: git remote prune [-n | --dry-run] <name>
   or: git remote [-v | --verbose] update [-p | --prune] [(<group> | <remote>)...]
   or: git remote set-branches [--add] <name> <branch>...
   or: git remote set-url [--push] <name> <newurl> [<oldurl>]
   or: git remote set-url --add <name> <newurl>
   or: git remote set-url --delete <name> <url>

    -v, --verbose         be verbose; must be placed before a subcommand

Traceback (most recent call last):
  File "/data2/cda/model/mepo/mepo.d/command/clone/clone.py", line 59, in run
    allcomps = MepoState.read_state()
  File "/data2/cda/model/mepo/mepo.d/state/state.py", line 76, in read_state
    raise StateDoesNotExistError('Error! mepo state does not exist')
state.exceptions.StateDoesNotExistError: Error! mepo state does not exist

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data2/cda/model/mepo/mepo", line 17, in <module>
    main()
  File "/data2/cda/model/mepo/mepo.d/main.py", line 6, in main
    command.run(args)
  File "/data2/cda/model/mepo/mepo.d/command/command.py", line 11, in run
    cmd_module.run(args)
  File "/data2/cda/model/mepo/mepo.d/command/clone/clone.py", line 61, in run
    mepo_init.run(args)
  File "/data2/cda/model/mepo/mepo.d/command/init/init.py", line 17, in run
    allcomps = MepoState.initialize(args.config,style)
  File "/data2/cda/model/mepo/mepo.d/state/state.py", line 70, in initialize
    complist.append(MepoComponent().to_component(name, comp, directory_style))
  File "/data2/cda/model/mepo/mepo.d/state/component.py", line 97, in to_component
    repo_url = get_current_remote_url()
  File "/data2/cda/model/mepo/mepo.d/state/component.py", line 170, in get_current_remote_url
    output = shellcmd.run(shlex.split(cmd), output=True).strip()
  File "/data2/cda/model/mepo/mepo.d/utilities/shellcmd.py", line 15, in run
    result.check_returncode()
  File "/data2/cda/pkg/miniconda3-4.12.0/envs/cda_suite/lib/python3.9/subprocess.py", line 460, in check_returncode
    raise CalledProcessError(self.returncode, self.args, self.stdout,
subprocess.CalledProcessError: Command '['git', 'remote', 'get-url', 'origin']' returned non-zero exit status 129.

Guess of cause
The git version of the server is <IP_ADDRESS>, seems to low to have get-url command.
Go to Try:
Will install a newer-version git now.

Installing lapack-3.10.1 for GEOSgcm build.
MKL not used for GEOSgcm. Is this appropriate? @mathomp4

Done.
It takes me a while to set LAPACK_LIBABRIES. Seems I still need to append blas static lib into LAPACK_LIBABRIES in addition to set BLAS_LIBRARIES, otherwise leading to linking error.
total item in install/bin: 391
(cda_suite) [cda@measures1 bin]$ ls -al * | wc -l
391`

@mathomp4 and @sanAkel , Thank you very much for all your help!
Is there any test data/low-res test run that I can try?

Is there any test data/low-res test run that I can try?

yes! Of course, let's get in touch tomorrow with @mathomp4 - as our schedules allow.

Sorry I missed all that, but it looks like you did well.  Oof. I should probably put in some sort of version check in mepo. I guess I forgot Git 1 could even still exist!
And as for test data, yes, I can probably get you some. I'll need to update a public spot we have, but I don't have write access so I'll need to contact someone who does.
Also, I now realize we probably could have had you "rpm install" Intel's compilers and MPI. I keep forgetting they are free now and, well, would have saved you a big GNU and Open MPI build. :/

Some other things:

MKL not used for GEOSgcm. Is this appropriate? @mathomp4

MKL is only required to run/compile RRTMGP with GEOS and you won't be doing that. So if it's missing, you just get a warning that RRTMGP can't be run.

It takes me a while to set LAPACK_LIBABRIES. Seems I still need to append blas static lib into LAPACK_LIBABRIES in addition to set BLAS_LIBRARIES, otherwise leading to linking error.

And this is interesting. If you had BLAS and LAPACK installed and CMake found it, it should have taken care of the linking for you. Hmm.

Thank you very much for your guidance on installing GNU compiler @mathomp4 !
I have never built GNU compiler from src codes, and your detailed and clear guidance makes it trivial.

@gmao-cda Well, it's a lot of experience doing it. What I do now to not forget is every time I do something like this and make a modulefile for it, I put my instructions at the top a la:
https://github.com/mathomp4/m1modulefiles/blob/main/Compiler/gcc-gfortran-12.1.0/openmpi/4.1.4.lua
Otherwise I'd forget 😄

It takes me a while to set LAPACK_LIBABRIES. Seems I still need to append blas static lib into LAPACK_LIBABRIES in addition to set BLAS_LIBRARIES, otherwise leading to linking error.

And this is interesting. If you had BLAS and LAPACK installed and CMake found it, it should have taken care of the linking for you. Hmm.

Thanks @mathomp4 , I created a lean blas/lapack test case for to find out why:

When I compiled, I used

cmake .. -DCMAKE_Fortran_COMPILER=gfortran \
-DBLAS_LIBRARIES=/data2/cda/model/lapack-3.10.1/librefblas.a \
-DLAPACK_LIBRARIES=/data2/cda/model/lapack-3.10.1/liblapack.a

where I explicitly assigned BLAS_LIBRARIES and LAPACK_LIBRARIES, which are the outputs of the FindBLAS and FindLAPACK.
This lets FindBLAS, and FindLAPACK skip the internal testing case and find the correct linking flags, which you can see from cmake output with no sgemm test
-- The Fortran compiler identification is GNU 12.1.0
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Check for working Fortran compiler: /data2/cda/pkg/gcc-12.1.0/bin/gfortran - skipped
-- Found BLAS: /data2/cda/model/lapack-3.10.1/librefblas.a
-- Found LAPACK: /data2/cda/model/lapack-3.10.1/liblapack.a
-- Configuring done
-- Generating done
-- Build files have been written to: /data2/cda/model/test/lorenz63_DA-master/src/build

Then I avoid assigning BLAS_LIBRARIES and LAPACK_LIBRARIES, and add CMAKE_LIBRARY_PATH

-- The Fortran compiler identification is GNU 12.1.0
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Check for working Fortran compiler: /data2/cda/pkg/gcc-12.1.0/bin/gfortran - skipped
-- Looking for Fortran sgemm
-- Looking for Fortran sgemm - not found
CMake Error at /data2/cda/libs/cmake-3.24.0/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find BLAS (missing: BLAS_LIBRARIES)
Call Stack (most recent call first):
  /data2/cda/libs/cmake-3.24.0/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
  /data2/cda/libs/cmake-3.24.0/Modules/FindBLAS.cmake:1337 (find_package_handle_standard_args)
  CMakeLists.txt:7 (find_package)

Now FindBLAS tries to find the blas lib under CMAKE_LIBRARY_PATH but still failed.
This is because for lapack downloaded from https://netlib.org/lapack/, the default built lib name with Makefile is librefblas.a, which is not recognized by FindBLAS.cmake (no BLA_VENDOR will leads to librefblas.a). Meanwhile, the new CMakeLists.txt
within the src codes creates libblas.a.

To solve this, I create a symlink libblas.a <---librefblas.a

ln -sf /data2/cda/model/lapack-3.10.1/librefblas.a /data2/cda/model/lapack-3.10.1/libblas.a

and rerun
cmake .. -DCMAKE_Fortran_COMPILER=gfortran \
-DCMAKE_LIBRARY_PATH=/data2/cda/model/lapack-3.10.1

Now it works !
-- The Fortran compiler identification is GNU 12.1.0
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Check for working Fortran compiler: /data2/cda/pkg/gcc-12.1.0/bin/gfortran - skipped
-- Looking for Fortran sgemm
-- Looking for Fortran sgemm - not found
-- Looking for Fortran sgemm
-- Looking for Fortran sgemm - found
-- Found BLAS: /data2/cda/model/lapack-3.10.1/libblas.a
-- Looking for Fortran cheev
-- Looking for Fortran cheev - found
-- Found LAPACK: /data2/cda/model/lapack-3.10.1/liblapack.a;/data2/cda/model/lapack-3.10.1/libblas.a
-- Configuring done
-- Generating done
-- Build files have been written to: /data2/cda/model/test/lorenz63_DA-master/src/build

@gmao-cda Would you please:

[ ] Confirm Baselibs are built
[ ] Model is built

If ⬆ are ✅ let's close this issue and move on to running the model. Thanks!

Yes. I confirmed

Thanks! Closing this issue.


Custom folder thumbnails

Description of the new feature / enhancement
Make it possible to set any image on the device as a folder thumbnail for any folder when using large or extra large icons in the file explorer. Also make it possible to assign a custom color to the folder graphics when using any of the icon preview sizes.

Scenario when this would be used?
In case you have a lot of folders that you need to navigate quickly, a custom visual thumbnail would give the opportunity to do so more efficiently.
Currently the system generates a preview of the files in the folder, but this may not be the most accurate representation of the folder's content in many cases. I have used the workaround of creating sub-folders to be able to keep a dedicated icon as the only "loose file" in the main folder for the system to pick it as the preview, but this creates even longer pathways to get to the desired destination and makes the folders more cluttered as a result. There's also the problem that each time you place another loose file in the folder, the preview changes so there is no guaranteed continuity or "getting used to" in this method. Ideally, it should be possible to keep all thumbnail files in one location on the computer and assign them to desired folders via a Power Toys feature.
Changing folder colors isn't possible at all even with a workaround so they always appear the same pale yellow. Providing a color picker to change the hue would be very efficient for categorizing vast amounts of folders.
Supporting information
Custom folder or album thumbnails are widely used on the web to make navigation much more intuitive. Think about Facebook's albums for example where you can pick any photo in the album as the preview for that specific album. The exact same function for Windows would not be ideal though, because not all folders on the PC are photo albums - thus the ability to pick a thumbnail from another folder would be crucial.
Categorizing similar content by color is also a widely used function in many applications, be it assigning custom colors to layers in Photoshop or to audio tracks in most DAW-s.

This is my favorite feature to add, especially changing the folder color


Request for size limit increase for cupy-cuda100 package

Hello,
I would like to request a size limit increase for cupy-cuda100 package to distribute CuPy wheels, because it contains dependency libraries (CUDA etc.).
The size of the wheel is currently approx. 300 MB. Could you please increase the limit to 350 MB?
Thanks in advance!

I can't find that package on PyPI currently. In order to adjust size limits, the package needs to exist.  Uploading a source distribution (sdist) first will register the project.

@jamadden Thank you for the followup.
I already uploaded and deleted the sdist, so the package should be in the database (although https://pypi.org/project/cupy-cuda100/ returns 404).

I've set the upload limit for cupy-cuda100 to 350MB on PyPI.

Thank you!


Windows Terminal uses purple/brightPurple instead of magenta/brightMagenta

It looks like Windows Terminal's settings schema uses purple/brightPurple instead of magenta/brightMagenta: https://github.com/microsoft/terminal/blob/master/doc/cascadia/SettingsSchema.md#schemes. The magenta settings currently get silently ignored.

I can confirm this one.

I've just fixed it. Thanks for the heads up!


show graph only superuser not basic user in admin page

hello, i'm very grad to find  this awesome library for django
so... I want to display graph from adminchratmixin only to Superuser account not general user
is there any great great idea?
very thank you in advance

Hey @aytekin827, I haven't messed with it, but I'd probably try something like this:
class MyModelAdmin(AdminChartMixin, admin.ModelAdmin):
    def changelist_view(self, request, extra_context=None):
        self._is_superuser = request.user.is_superuser
        return super().changelist_view(request, extra_context=extra_context)

    def get_list_chart_config(self, queryset):
        if not self._is_superuser:
            # Don't return any chart config if this isn't a superuser
            return {}
        return super().get_list_chart_config(self, queryset)

Hope that helps!


Added tests for false Color Mapping

Added test file for falseColorMapping.js. PTAL.

Coverage increased (+6.2%) to 51.951% when pulling 16fcff4c75f1ee8d0bd4048ac8e409493806ae4b on ComputerComps:falseColorMapping_tests into abd64cef48d489e7d0ea22a9063a7f254d06ecab on cornerstonejs:master.

Thanks!


Missing restore content?

The title says "Backup and restore actors". However, I do not see anything about restoring actors.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 74e19985-9884-00ec-8878-017b69364089
Version Independent ID: 691e9e3c-59b7-b90d-818a-b692e7f6485f
Content: Backup and restore Azure Service Fabric actors
Content Source: articles/service-fabric/service-fabric-reliable-actors-backup-and-restore.md
Service: service-fabric
GitHub Login: @vturecek
Microsoft Alias: vturecek

Thanks for the feedback! We are currently investigating and will update you shortly.

I respectfully disagree with the resolution of this ticket. The title of this document “Implement Reliable Actors backup and restore” suggests I will see implementation of backup AND restore functions within the framework. The simple help document offers a sample demonstration of backing up a custom actor service, which outlines the use of this.BackupAsync(new BackupDescription(PerformBackupAsync)); and will naturally lead me to learning more by looking up those methods. However, I see no similar example for the restore part of the title of the document in question, again that’s: document “Implement Reliable Actors backup and restore”.
The URL given: https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-backuprestoreservice-quickstart-azurecluster also does not contain any information about restoring from a backup. After reviewing the page given, I can list my backups, but I see no information about how to use such a backup to affect a restore.
If this feature (the restore) is automatic, it is lost on me. In the event I have a service failure, I do not believe this information will adequately help me preform a restore, even if I follow the examples outlined in either page.
Thank you for your consideration

In the Next Steps of the document I provided, which is the first link in the document you referenced:
https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-backuprestoreservice-quickstart-azurecluster
Points to:
https://docs.microsoft.com/en-us/rest/api/servicefabric/sfclient-index-backuprestore
Which lists "SF backup and restore" Restore Partition Rest URI and parameters:
https://docs.microsoft.com/en-us/rest/api/servicefabric/sfclient-api-restorepartition
You should NOT TEST THIS IN PRODUCTION, and should be trying this out on your OneBox.
Please let us know if satisfies your ask, or provide additional clarity on how we can provide supportability content for how to invoke SF's Rest API.
@MicahMcKittrick-MSFT
Please close this.


[EPIC] Support for ColumnLayer (extruded point values)

Context
I'd like to be able to use lonboard to create 3d mapping of data that include extruded column layers, like this (pure pydeck code below).

Issue
I'd like to be able to translate this pure-pydeck example into lonboard (i.e. as proof-of-principle for support for this layer).
import geopandas as gpd
import pydeck as pdk

DATA_URL = 'https://data.source.coop/cboettig/conservation-policy/Inflation_Reduction_Act_Projects.geojson'
df = gpd.read_file(DATA_URL)

column_layer = pdk.Layer(
    "ColumnLayer",
    data=df,
    get_position=["LONGITUDE", "LATITUDE"],
    get_elevation="FUNDING_NUMERIC",
    get_fill_color = [256,256,0, 140],
    elevation_scale=.01,
    radius=10000,
    pickable=True,
    auto_highlight=True,
)

INITIAL_VIEW_STATE = pdk.ViewState(latitude=35, longitude=-100, zoom=4, max_zoom=16, pitch=45, bearing=0)

r = pdk.Deck(
    column_layer,
    initial_view_state = INITIAL_VIEW_STATE,
    map_style=pdk.map_styles.CARTO_ROAD,
)
r

I think the key piece here is just adding support for "ColumnLayer", but not sure.  Ideally I'd like to be able to layer this kind of rendering with other layers also generated in lonboard.

Indeed, the primary functionality that needs to be added is support for ColumnLayer. It should be relatively straightforward.
Though on the JS side there's a question of whether to add this functionality to https://github.com/geoarrow/deck.gl-layers now that there's a semi-official fork in https://github.com/visgl/deck.gl-community that I haven't had time to engage with yet.

Oh actually there's already a ColumnLayer in deck.gl-layers https://github.com/geoarrow/deck.gl-layers/blob/main/src/column-layer.ts. So we only need to touch the Lonboard side

In case you have an interest in making a PR, adding the ColumnLayer should be very similar to adding the PolygonLayer, so you should be able to use that PR as guidance. https://github.com/developmentseed/lonboard/pull/330
It turns out that we already have the column layer on the JS side https://github.com/developmentseed/lonboard/blob/5560ead37e4bf02b8a39ef08b631c5b2f7108754/src/model/layer.ts#L264 so we only need to add the Python bits


🎉 4.0.4

ℹ About this release

Version: 4.0.4
Type: patch
Last Release: 4.0.3 (12/26/2023, 6:58:03 PM) [?]
Commits to merge: 31 [?]

📦 Dependencies

Update node-ical from ^0.17.1 to ^0.18.0

📦 Development Dependencies

Update @qiwi/semantic-release-gh-pages-plugin from ^5.2.10 to ^5.2.12
Update @types/node from ^20.10.2 to ^20.11.19
Update @typescript-eslint/eslint-plugin from ^6.13.2 to ^7.1.0
Update @typescript-eslint/parser from ^6.13.2 to ^7.1.0
Update c8 from ^8.0.1 to ^9.1.0
Update eslint from ^8.55.0 to ^8.57.0
Update eslint-plugin-jsonc from ^2.11.2 to ^2.13.0
Update mocha from ^10.2.0 to ^10.3.0
Update tsup from ^8.0.1 to ^8.0.2
Update typedoc from ^0.25.4 to ^0.25.8

:tada: This PR is included in version 4.0.4 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release
Docker container (sebbo2002/vestaboard2mqtt:4.0.4)
v4.0.4

Your semantic-release bot :package::rocket:


Update to grammar for manage-access.md-20200427

@TheronHowton : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Looks good. @TheronHowton Thanks for this typo fix.


VWAP Indicator Implementation

From: https://medium.com/@neonguru/it-would-be-nice-if-it-included-vwap-22fa4e80584f
It would be nice if it included VWAP.
More info: https://school.stockcharts.com/doku.php?id=technical_indicators:vwap_intraday

Hi, I can work on this issue.

Great @Glyphack !
I am here to help you too.
Best,
Dario

Any update on this? I may look into it unless its already in progress.

Actually I've been pretty busy and because of that I did not post any updates. I'll post updates today.

The indicator was implemented by @Glyphack here: https://github.com/bukosabino/ta/pull/140 and it has been added in the last version (0.5.18).
To update the library:
pip install -U ta

Thank you for your collaboration.
Best,
Dario


Wrong AzureUSGovernmentCloud Endpoint

What kind of request is this (question/bug/enhancement/feature request):
Bug
Related to: https://github.com/rancher/rancher/issues/23350
Steps to reproduce (least amount of steps as possible):
Attempt to provision a machine in the AzureUSGovermentCloud environment (--azure-environment AzureUSGovernmentCloud)
Result:
Error with pre-create check: "autorest#WithErrorUnlessStatusCode: POST https://login.microsoftonline.com/my-subscription-id/oauth2/token?api-version=1.0 failed with 400 Bad Request: StatusCode=400"; Timeout waiting for ssh key
Other details that may be helpful:
This issue is due to an incorrect endpoint in the Azure/go-autorest v7.2.1 library being used, which was later fixed in v9.7.1 (https://github.com/Azure/go-autorest/commit/6311d7a76f54cf2b6dea03d737d9bd9a6022ac5f)
The endpoints are defined in:
https://github.com/rancher/machine/blob/master/vendor/github.com/Azure/go-autorest/autorest/azure/environments.go
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI):
Rancher v2.3.0
User Interface v2.3.15
Helm v2.10.0-rancher12
Machine v0.15.0-rancher12-1

Installation option (single install/HA):
HA

Thought I opened this under https://github.com/rancher/machine but it doesn't look like you can open issues there; closing as a dupe of https://github.com/rancher/rancher/issues/23350


Enhances spo navigation node list, Closes #4415

This PR enhances spo navigation node list with the full response.
Closes #4415

You're on a roll, nice! We'll review it ASAP!

Timeout occured, can someone re run the checks please?

Seems like the pipeline needs a day off.

Merged manually, Thank you for your continuous contributions for the community!


Multisig address creation with uncompressed and compressed public keys

Im am trying to create multisig address from uncompressed and compressed public keys:
040986ca780a396ec974d03309c31b6d79ff4c8ec011859bf13a9fbcc2f33432818df1efef7a23a3237ca7c808bcde554f3e16241dd4cdec16c4ef5329a93d73cc
048777374ae236dc1556a0b35f733c420a1b95e96c2dae33094fc735549942b0180f7018749ee96718c2884d62e38c0a5ff0c84321b36a8b3b33553bb57932be90
037c1eac3fd87aa7c044353272f6cee6a4865067d7900789d4020815dd3aa82762
....
PublicKeyFactory::fromHex($pubKey);
....
$script = ScriptFactory::p2sh()->multisig(2, $pubKeyArray);
print $script->getAddress()->getAddress();

If you work with uncompressed keys only, it'll return the same address than https://coinb.in/#newMultiSig. If one of the addresses is compressed, the address is different.
Does bitcoin-php include a function to decompress a compressed public key before feeding it into PublicKeyFactory::fromHex ? I'd like to avoid the usage of additional modules.

If for some reason you need to take an already (compressed/uncompressed) key and convert it to (uncompressed/compressed), just instantiate a new PublicKey from the same values as that obtained by fromHex, but obviously set $compressed to whatever you'd like it to be.
It's probably a better idea to save the keys in the format you expect to use them, because as you're aware, fiddling produces different addresses, and you won't be looking for every possible form.

(Oh, and the prefix param should be set correctly too - check the code: https://github.com/Bit-Wasp/bitcoin-php/blob/master/src/Crypto/EcAdapter/Impl/PhpEcc/Key/PublicKey.php)
Hmm, does coinbin only support compressed keys or something? Generally you just work on whatever serialized form you have, and avoid having to switch in your code.

coinbin and bitcoin-js both support compressed and uncompressed keys. I suppose, they convert compressed pubkeys to uncompressed pubkeys before creating the multisig.
I'll convert and store all user entered pubkeys uncompressed, to avoid a mess down the road.
Thank you very much for your help, Thomas.


Fix the new nightly CI errors

Objective

CI is failing again
These failures result from https://github.com/rust-lang/rust/pull/85200

Solution

Fix the errors which result from this by using the given fields
I also removed the now unused Debug impl.

I suspect that we shouldn't use -D warnings for nightly CI - ideally we'd get a discord webhook message into some (non-#github) dedicated channel on warnings.
But this does not implement that.

Relevant: https://github.com/rust-lang/rust/issues/88900

bors r+


Required relationships showing as Nullable type in GraphQL Schema

Bug Report
From Discord

hey guys, regarding generated GraphQL types, i'm noticing that in some cases, when i have specified that a field is required, i still get a nullable type generated in the GraphQL schema. specifically i'm finding this always happens with relation fields. is this expected?

what i'm noticing is that it happens to any relation. if you've got a Payload instance handy with a relationship instance, you should see the nullable type in the graphQL schema

Expected Behavior
Required relationship shows as nullable
Detailed Description
Payload 1.0.31

I believe this expected behaviour is that a required field should show up an non-nullable in the GraphQL schema.

@pugbyte Correct, I was flying through it. Edited 👍

I actually think that this is intended behavior. If a field has any of the following conditions, it will NEED to be nullable in GraphQL, because it can potentially be missing:

If the field has a condition
If the field is localized
If the field has read access control that might prevent it from being populated

If the field has none of these things, and it is set to required, then the field will be correctly specified as non-nullable in GraphQL.
Does that make sense?


[New game]: Drag and Drop Puzzle game

🎮 Game Request
In this game, the user will drag and drop images on a broad and solve that puzzle.
Point down the features

Every single time when an image move or drag and drop then we will count as a move.
After every drop of the image, the position of the images will be shuffled.

Select program in which you are contributing
GSSoC23
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

Hey @priyam212001 !
Thank you for raising an issue 💗
You can self assign the issue by commenting /assign in comment 😀
Make sure you follow CODE OF CONDUCT and CONTRIBUTING GUIDELINES 🚀
Don’t Forget to ⭐ our GameZone🎮
Make sure you join our Discord🕹

/assign

Hey @priyam212001 ! Thank you so much for your raising the issue💗
It’s all yours, you can come anytime again and make some contributions! 🚀
Alone, we can do little, but together we can do so much! 😇


optimized translation index.md

Corrected web translator's mistake. More readable now.

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Hi,
As there has been no response from your end for a while, I am closing this PR.
Feel free to create request for this PR to be reopened, if you still wish to make the changes you originally added.  Also, remember to update your fork, so you have the latest version of master in case it has changed significantly.
Happy Coding!


[meson] Some build artifacts missing in meson builds

That's how build-bin looks in this pipeline run:
|-- build-bin
|   |-- hw
|   |   `-- top_earlgrey
|   |       `-- Vtop_earlgrey_verilator
|       |   `-- sim-verilator
|       |       |-- boot_rom
|       |       |   |-- boot_rom.elf
|       |       |   `-- chip_info.h
|       |       |-- examples
|       |       |   |-- hello_usbdev
|       |       |   |   `-- hello_usbdev.elf
|       |       |   `-- hello_world
|       |       |       `-- hello_world.elf
|       |       |-- exts
|       |       |   `-- common
|       |       |       `-- libriscv_crt.a
|       |       |-- lib
|       |       |   |-- libflash_ctrl_ot.a
|       |       |   |-- libgpio_ot.a
|       |       |   |-- libhmac_ot.a
|       |       |   |-- libirq_ot.a
|       |       |   |-- liblog_ot.a
|       |       |   |-- libmem_ot.a
|       |       |   |-- libpinmux_ot.a
|       |       |   |-- librv_timer_ot.a
|       |       |   |-- libspid_ot.a
|       |       |   |-- libuart_ot.a
|       |       |   `-- libusb_ot.a
|       |       `-- tests
|       |           |-- flash_ctrl
|       |           |   `-- flash_test.elf
|       |           |-- hmac
|       |           |   `-- sha256_test.elf
|       |           `-- rv_timer
|       |               `-- rv_timer_test.elf
|       `-- host
|           |-- spiflash
|           |   `-- spiflash
|           `-- vendor
|               `-- libmpsse.a

The tree looks strange as vmem and bin files are missing, but some "useless" binaries are there (like libmpsse.a). The "too many files" is a cosmetic problem, the "vmem and bin files missing" is critical.

So the problem is actually a bit more than that.

Since https://github.com/lowRISC/opentitan/pull/1031 vmem and bin files are not generated or copied into build-bin any more. CI didn't catch that since meson build outputs were not used.
Since https://github.com/lowRISC/opentitan/pull/1026 meson build outputs are used. CI on master did catch that, but the PR CI didn't (since the branch was based on an old master).

This leads to all CI jobs failing at the moment.
@mcy if you can come up with a quick solution that's appreciated, otherwise I'll back out #1026 to unbreak CI.

I've filed #1055 to fix the issue with the missing bin and vmem files. The issue with the .a and .h files is entirely cosmetic, and does not affect the distribution (this is a big reason why I wanted an explicit whitelist of files to export in the distribution). Hopefully they will go away once the make_build_bin step is contained within Meson.


Minor update to vreduce docstring.

Noticed this a while ago but figured I'd submit it.

Thanks!

No problem. Hopefully it's not perceived as pointless commits ^_^;


mysql max allowed packet size

in some rare cases I can see this error during a db:seed:
SQLSTATE[08S01]: Communication link failure: 1153 Got a packet bigger than 'max_allowed_packet' bytes (SQL: insert into league_size_schemes
FIX

fixed with setting in my.cnf in laradock


Implement index-sliced key-value iterators

Add iterators that iterate a sliced key-value range (sliced in the
order/index space).
Before merging, we'll look at if it's not better to express using views (from #47).
The main infidelity of the interface is the need to handle
Bound::Exclusive(std::usize::MAX) which does not have an equivalent in
the i..j or i..=j and slices can't handle it natively.
The scaffolding in src/util to create the .slice() and .slice_mut()
methods is somewhat verbose, but it allows us to write neat code where
it is used.
Fixes #103

Converting to Range makes sense, but I have been stuck on this thought that this way would be the optimal way to do it for removing as many bounds checks as possible. However, (now looking) the std slicing code does not pay attention to making the tightest possible code for RangeInclusive's bounds checking in slicing, so it is rather a moot point right now.


Azblob: DownloadBlobToWriterAt gets context cancelled

Bug Report
import azStorageBlob "github.com/Azure/azure-sdk-for-go/sdk/storage/azblob"
0.3.0
go version go1.17.7 linux/amd64
Attempts to download a blob with the following call:
func (rr *ReaderResponse) DownloadToWriter(ctx context.Context, w io.Writer) error {
        return rr.BlobClient.DownloadBlobToWriterAt(
                ctx,   /// context.BackGround() in most cases
                0,
                rr.CountToEnd,    /// standard MS constant
                newWriterAt(w),   /// convrets io.Writer to io.WriterAt with zero offset
                azStorageBlob.HighLevelDownloadFromBlobOptions{},
        )
}

when calling using a http.ResponseWriter as the io.Writer results in a context cancelled error most of the time.
About 1 in 4 attempts are successful.
The error is "copied to out with errors: context canceled"
Expected:
No context cancelled error and successful download
Similar code using the older azure-storage-blob-go repo worked. This was discovered whilst moving across to azure-sdk-for-go.

Note that various ctx args were tried such as context.Background() to no avail

I have reworked the code to get the Body and feed that as a Reader to io.Copy.
`       resp.BlobClient = azp.containerClient.NewBlobClient(identity)
resp.CountToEnd = int64(azStorageBlob.CountToEnd)
get, err := resp.BlobClient.Download(
ctx,
&azStorageBlob.DownloadBlobOptions{
BlobAccessConditions: &resp.blobAccessConditions,
Count:                &resp.CountToEnd,
},
)
if err != nil && err == io.EOF { // nolint
logger.Sugar.Infof("cannot get blob body: %v", err)
return nil, ErrorFromError(err)
}
resp.Reader = get.Body(&azStorageBlob.RetryReaderOptions{})
_, err = io.Copy(w, respReader)
if err != nil {
logger.Sugar.Infof("copied to out with errors: %v", err)
}

@eccles We are looking into it and get back to you for any additional information.

thank you for your attention - this is not urgent but will require a fix if we are to move to the new azure-sdk as recommended by yourselves.

This might have been due to an issue in azcore which has since been fixed.  https://github.com/Azure/azure-sdk-for-go/pull/17797
We've just released an updated version<EMAIL_ADDRESS>that contains this (and other fixes). Note that we've refactored the public surface area. However, we feel that it makes navigating the package much easier.  Can you please try it and report back?


consider limiting the scope of the library

Hey! I came here from the http://explained.ai/decision-tree-viz/index.html article (which is a great write-up 👍). One thing bothered me => unsolicited suggestion.
In the README you have:

This is the start of a python machine learning library to augment scikit-learn. At the moment, all we have is functionality for decision tree visualization and model interpretation.

From an user perspective: why not have a package just for tree visualization and interpretation, and have this planned "python machine learning library to agument scikit-learn" depending on a tree visualization & inspection package, if needed?
The task of inspecting trees looks quite specific, do you really need to add solutions for unrelated problems (some ML algorithms?) to the same package? Obviously, I don't know what you've planned for the whole library, so please excuse me if that doesn't make any sense :)
A few use cases, for having a dedicated tree viz library:

tree visualization has a few dependencies, which other code may not need; it can be the other way around as well - people who want tree visualization may have to install unrelated dependencies. It is solvable, but needs care.

https://github.com/TeamHG-Memex/eli5 is not developed actively right now, but we'd absolutely consider making your tree visualization a default, which implies having it as a dependency (probably an optional one); depending on a general-purpose ML library just for its visualization features is less nice than depending on a visualization/inspection library.

by having separate packages you may get different release schedules, different contributors, etc. In a large package some code usually gets outdated and deprecated over time. If deprecated code is a separate package, one can just leave it as-is - no need to remove it from an all-in-one library, and no need to maintain it if there is no motivation.

I'm going to rename to dtreeviz. :)

Fixed with https://github.com/parrt/dtreeviz/commit/8411604390803ccd183b8b100b8920d30587d2e1 renamed library to dtreeviz, adjusted packages and notebooks and readme.

Thanks a ton @parrt!


🐛 Bug Report: UnifiedTheme Root Level FontFamily Doesnt work.

📜 Description
When migrating from the BackstageTheme to the UnifiedTheme, the fontFamily parameter at the top level of the createUnifiedTheme function doesnt apply the supplied fonts.
After doing some digging I found that there is a typography field in the createBaseThemeOptions function which contains another fontFamily field and this one does apply the supplied fonts. The problem is that you have to override the entire typography field in order to just override the fonts when doing it this way.
👍 Expected behavior
The provided fontFamily should be applied to the site
👎 Actual Behavior with Screenshots
Defining fontFamily at the root of createUnifiedTheme still defaults to "Helvetica Neue", Helvetica, Roboto, Arial, sans-serif.
👟 Reproduction steps
You can see this behavior right now on the demo site: https://demo.backstage.io
Change the theme to the Aperture theme and inspect to see that the fontFamily doesnt match the one provided in the theme: https://github.com/backstage/demo/blob/master/packages/app/src/theme/aperture.ts#L82
📃 Provide the context for the Bug.
As mentioned above the configuration for the demo site has fontFamily defined but its still using the default values.
This can be solved currently by simply removing the root level fontFamily in favor of fontFamily in typography, however, the defaultTypography constant in createBaseThemeOptions.ts is not exported and every field is required on the typography field. In order to override the fontFamily you have to override everything in typography. If defaultTypography was exported we could simply do:
typography: {
  ...defaultTypography,
  fontFamily: "custom fonts"
}

🖥 Your Environment
I tested this in both Firefox and Chrome
I dont have the output of the cli info command
👀 Have you spent some time to check if this bug has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Are you willing to submit PR?
Yes I am willing to submit a PR!

This is being fixed in the Demo site by this PR: https://github.com/backstage/demo/pull/240. For the Demo it makes sense to have the full object so that we can show how you might customize it.
But a proper solution to this is also needed. Personally think exporting defaultTypography would be the most straightforward. I'm still a little puzzled why the original fontFamily stopped working 🤔

So it is definitly unfortunate that TypeScript does not catch this at the moment - the types definitly need fixing. Currently the UnifiedThemeOptions & the BaseThemeOptionsInput have the fontFamily & I'm wondering if it should be removed from the top level..
With which function are you creating the theme? Do you use createUnifiedTheme & UnifiedThemeOptions or do you use createUnifiedThemeFromV4 with a v4 theme?

I'm pretty sure they are just following what we did in the Aperture theme in the Demo site repo.
Discord thread: https://discord.com/channels/687207715902193673/1197265238756708412

I'm pretty sure they are just following what we did in the Aperture theme in the Demo site repo.
Discord thread: https://discord.com/channels/687207715902193673/1197265238756708412

Yes i was following the demo changes so not the v4 function

#22857 fixes this 🚀


Cannot get crouton to install a working version of linux

Please paste the output of the following command here: sudo edit-chroot -all

sudo: edit-shroot: command not found
Please describe your issue:
I am trying to install a working version of linux on my chromebook, and I personally have no clue what I am doing as I am entirely new to linux. I originally installed unity, but was roadblocked when i couldnt update out of 16.04 or even browse the internet. I tried using the apt get and apt install commands, but they didnt work. I also couldnt find the software updater in the OS. I then powerwashed my chromebook (just to make sure the previous installation wouldn't mess with a new one since it was already wiped anyways, and im stuck trying to install bionic.
All I really want is an up-to-date Linux operating system that can run alongside my chromeOS. If someone could explain to me how to get bionic 18.04 to install properly, or how to get 16.04 to update out of the stone age, that would be great.
If known, describe the steps to reproduce the issue:
Im going to put the output for my bionic installation here, but i cant seem to figure out the error it is giving me.
chronos@localhost / $ sudo crouton -n bionic -t x11,xorg,extension,keyboard,xfce -u
/usr/local/chroots/bionic already exists; updating it...
/bin/sh: 0: Can't open /tmp/crouton-installer-cache/crouton.1Dl/installer/debian/getrelease.sh
/bin/sh: 0: Can't open /tmp/crouton-installer-cache/crouton.1Dl/installer/kali/getrelease.sh
WARNING: bionic is an unsupported release.
You will likely run into issues, but things may work with some effort.
Press Ctrl-C to abort; update will continue in 5 seconds.
Preparing chroot environment...
Installing brightness into the chroot...
Installing croutonpowerd into the chroot...
Installing croutonversion into the chroot...
Installing host-dbus into the chroot...
Installing host-wayland into the chroot...
Installing volume into the chroot...
Installing pulseaudio-default.pa into the chroot...
Installing croutoncycle into the chroot...
Installing croutontriggerd into the chroot...
Installing croutonxinitrc-wrapper into the chroot...
Installing setres into the chroot...
Installing xinit into the chroot...
Installing xbindkeysrc.scm into the chroot...
Installing xorg-intel-sna.conf into the chroot...
Installing xserverrc into the chroot...
Installing xserverrc-xorg into the chroot...
Installing xserverrc-local.example into the chroot...
Installing croutonclip into the chroot...
Installing croutonnotify into the chroot...
Installing croutonurlhandler into the chroot...
Installing startxfce4 into the host...
Installing crouton-noroot into the chroot...
Installing startxfce4 into the chroot...
Installing startxiwi into the host...
Installing croutoncycle into the chroot...
Installing croutonfindnacl into the chroot...
Installing croutontriggerd into the chroot...
Installing croutonxinitrc-wrapper into the chroot...
Installing setres into the chroot...
Installing xinit into the chroot...
Installing xiwi into the chroot...
Installing xbindkeysrc.scm into the chroot...
Installing xiwi.conf into the chroot...
Installing xorg-dummy.conf into the chroot...
Installing xserverrc into the chroot...
Installing xserverrc-xiwi into the chroot...
Installing xserverrc-local.example into the chroot...
Installing startgnome into the host...
Installing crouton-noroot into the chroot...
Installing startgnome into the chroot...
Installing gnome-session-wrapper into the chroot...
Installing enter-chroot into the host...
Installing delete-chroot into the host...
Installing edit-chroot into the host...
Installing mount-chroot into the host...
Installing unmount-chroot into the host...
Installing crash_reporter_wrapper into the host...
Setting up debconf-i18n (1.5.66ubuntu1) ...
Setting up cron (3.0pl1-128.1ubuntu1.2) ...
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
Running in chroot, ignoring request.
invoke-rc.d: policy-rc.d denied execution of start.
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Processing triggers for systemd (237-3ubuntu10) ...
Processing triggers for mime-support (3.60ubuntu1) ...
Installing target core...
Preparing environment...
Preparing software sources...
Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Fetched 177 kB in 1s (237 kB/s)
Reading package lists... Done
Ensuring system is up-to-date...
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
The following NEW packages will be installed:
distro-info iso-codes libnetplan0 python-apt-common python3-apt python3-netifaces
python3-pkg-resources
The following packages will be upgraded:
apt apt-utils busybox-initramfs bzip2 ca-certificates console-setup console-setup-linux
cpio dbus distro-info-data dmsetup e2fsprogs fdisk file gpgv grep gzip initramfs-tools
initramfs-tools-bin initramfs-tools-core iproute2 iputils-ping isc-dhcp-client
isc-dhcp-common keyboard-configuration klibc-utils kmod libapparmor1 libapt-inst2.0
libapt-pkg5.0 libblkid1 libbsd0 libbz2-1.0 libc-bin libcom-err2 libcryptsetup12 libdb5.3
libdbus-1-3 libdevmapper1.02.1 libdns-export1100 libelf1 libexpat1 libext2fs2 libfdisk1
libfribidi0 libgcrypt20 libglib2.0-0 libglib2.0-data libgmp10 libgnutls30 libhogweed4
libicu60 libidn11 libidn2-0 libisc-export169 libjson-c3 libklibc libkmod2 liblz4-1 liblzma5
libmagic-mgc libmagic1 libmount1 libncurses5 libncursesw5 libnettle6 libnss-systemd
libp11-kit0 libpam-systemd libpcre3 libprocps6 libpython3-stdlib libpython3.6-minimal
libpython3.6-stdlib libseccomp2 libsepol1 libsmartcols1 libsqlite3-0 libss2 libssl1.1
libsystemd0 libtinfo5 libudev1 libunistring2 libuuid1 libxml2 libzstd1 linux-base locales
login mount ncurses-base ncurses-bin netcat-openbsd netplan.io networkd-dispatcher nplan
openssl passwd procps python3 python3-gi python3-minimal python3.6 python3.6-minimal
rsyslog sudo systemd systemd-sysv tzdata ubuntu-advantage-tools ubuntu-keyring
ubuntu-minimal udev util-linux vim-common vim-tiny xkb-data xxd xz-utils zlib1g
121 upgraded, 7 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/46.6 MB of archives.
After this operation, 22.7 MB of additional disk space will be used.
Extracting templates from packages: 100%
Preconfiguring packages ...
dpkg: error: cannot stat pathname '/tmp/apt-dpkg-install-DNaw46/8-libext2fs2_1.44.1-1ubuntu1.4_amd64.deb': Too many levels of symbolic links
E: Sub-process /usr/bin/dpkg returned an error code (2)
Failed to complete chroot setup.
Unmounting /mnt/stateful_partition/crouton/chroots/bionic...
Sending SIGTERM to processes under /mnt/stateful_partition/crouton/chroots/bionic...
If anyone can help me figure this out, I'll mail you a cookie :)

#4799


Allow NIOEchoClient to receive fragmented echo responses.

Allow NIOEchoClient to receive fragmented echo responses.
Motivation:
While sending a message to NIOEchoServer and receiving the echoed response, it is not guaranteed that the sent message arrives inside one channelRead() call. This would fail in the current implementation.
Modifications:
On channelRead the data will be written to a buffer until all sendBytes got received.
Result:
The updated NIOEchoClient can now buffer split InboundIn data and prints the result, when all sendBytes got received.
Tests:
Tests for executables require swift-tools-version 5.5. To recreate the tests of the new NIOEchoClient receive message argument from constructor instead of the readLine().  Additionally context.writeAndFlush() the received buffer instead of printing it.
let expectedMessage = "Expected to read"
let expectedBuffer = ByteBuffer(string: expectedMessage)

let handler = EmbeddedChannel(handler: EchoHandler(message: expectedMessage))
try handler.connect(to: .init(ipAddress: "<IP_ADDRESS>", port: 80), promise: nil)
// empty outbound buffer
_ = try handler.readOutbound(as: ByteBuffer.self)

// Test case: EchoHandler receives split buffer
try handler.writeInbound(ByteBuffer(string: String(expectedMessage.prefix(5))))
try handler.writeInbound(ByteBuffer(string: String(expectedMessage.dropFirst(5))))
XCTAssertEqual(try handler.readOutbound(as: ByteBuffer.self), expectedBuffer)

@swift-nio-bot test this please


peek bug

Microsoft PowerToys version
0.85.1
Installation method
Microsoft Store
Running as admin
Yes
Area(s) with issue?
Peek
Steps to reproduce
See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.
************** Exception Text **************
System.Runtime.InteropServices.COMException (0x8007139F): 组或资源的状态不是执行请求操作的正确状态。  Could you please provide more information about what you were doing when you experienced the bug? For example:

Which file type were you previewing?
Was this a one-off problem, or does it happen consistently with the same file?
Have you been able to preview other files of the same type with this version of Peek?
Has this just started happening with the current version of Peek, or has it always been a problem?

This will help us track down the issue more effectively. Thank you!

所有文本类型的文件（.js | .text | .css）等每次都不能预览，图片可以。
我是当前版本出现的问题
I've recently encountered a problem where I cannot preview any text files (.js, .text, .css, etc.). This issue has started happening in the current version. Image previews are unaffected.

每次都会出现
Every time, I cannot preview any text-type files (.js, .text, .css, etc.), but images can be previewed. This is a problem that has occurred in the current version.

My OS is Windows 11, 24H2 Chinese version.

Thanks, @ppyds.
Could you first try updating PowerToys to version 0.86. I have tried previewing .txt, .js, .css and other filetypes in that version and there weren't any issues.
If that doesn't fix the bug on your machine, please could you:

Access the System Tray area of the Windows Taskbar (you may need to click the ^ icon to show this):

Right-click on the PowerToys icon there and click Report Bug:

A file will be created on your desktop. (This may take several seconds.) Please attach this file to your next message.

The file includes the logs for each of the PowerToys tools, and will help to investigate the bug.
Thanks again!

PowerToysReport_2024-11-09-00-22-26.zip
还是不行

@htcfreek Could you direct someone with knowledge of the installer here, please?

@Aaron-Junker , @stefansjfw , @jaimecbernardo
Can you plz look at this. Is this an individual or general bug?
@davidegiacometti
Is this related to the changes for Registry Preview?

Hi everyone!
I checked what the installer is doing and also inspected the 0.85.0 installer: I can confirm that we aren't shipping Monaco sources in INSTALLDIR\WinUI3Apps\Assets but only in INSTALLDIR\Assets.
This is weird that the user is mentioning Peek but the error is related to Monaco PreviewHandler: this seems to another case #35831
My suspect is that the Peek Monaco previewer fail to be initialized due to the "missing file" and then Peek fallback to the shell preview handler previewer.
This is how the directory is determined.
https://github.com/microsoft/PowerToys/blob/ce5e5647b3e84e43d942cf1b400e0c373cce61fd/src/common/FilePreviewCommon/MonacoHelper.cs#L34-L47

@davidegiacometti
@ppyds deleting C:\Users\11535\AppData\Local\PowerToys\WinUI3Apps\Assets\Monaco should fix your issue 😃
删除应该可以解决你的问题。
按照这个步骤就好了，good Thanks you

@davidegiacometti Thanks very much for analysing this in depth!
Peek uses MonacoHelper to render the same files that are supported by the Explorer shell preview handler via the WebBrowserPreviewer (which is called before the ShellPreviewHandlerPreviewer in PreviewerFactory.Create()).
I assume the preview handler in Explorer was failing as well, but this isn't reported to the user. There are lots of errors in the user's file-explorer-log which look like this:
[2024-11-07 19:18:44.596167] [p-53456] [t-69488] [info] isApplied of HKCU\Software\Classes\CLSID\{D8034CFA-F34B-41FE-AD45-62FCBB52A6DA}\DisplayName:Monaco Preview Handler: RegOpenKeyExW failed: unknown error
[2024-11-07 19:18:44.596288] [p-53456] [t-69488] [info] isApplied of HKCU\Software\Classes\CLSID\{A5A41CC7-02CB-41D4-8C9B-9087040D6098}\DisplayName:Pdf Preview Handler: RegOpenKeyExW failed: unknown error
[2024-11-07 19:18:44.596692] [p-53456] [t-69488] [info] isApplied of HKCU\Software\Classes\CLSID\{D8BB9942-93BD-412D-87E4-33FAB214DC1A}\DisplayName:Pdf Thumbnail Provider: RegOpenKeyExW failed: unknown error
[2024-11-07 19:18:44.621855] [p-53456] [t-69488] [info] isApplied of HKCU\Software\Classes\CLSID\{D8034CFA-F34B-41FE-AD45-62FCBB52A6DA}\DisplayName:Monaco Preview Handler: RegOpenKeyExW failed: unknown error

I wonder if this is related, or whether it's just a by-product of the Monaco language files being in the wrong place 🤔

Prompt in Chinese:
是的我的资源管理器也无法预览文本格式的文件
English translation:
"Yes, my File Explorer is also unable to preview text format files."

@daverayment Monaco preview pane is running out of process (even when hosted by Peek) under PowerToys.MonacoPreviewHandler.exe process and doesn't have issue when that folder exists.
I can repro the issue for Peek after creating INSTALLDIR\WinUI3Apps\Assets\Monaco folder but Explorer preview pane is working.
I guess the preview pane not working is a different problem.


docs: Add Section for Restarting Validator After Shutdown

I've added a brief section in the validator documentation about restarting the validator node after an unexpected shutdown or restart. This came from a personal experience where I initially thought a full reinstallation was necessary, which turned out not to be the case.
The new section covers the essential steps: how to restart the Docker container and access the validator CLI again. I believe this could be really helpful, particularly for those who might face similar issues and are looking for a quick resolution while not being as tech savvy.

Hey @joaolago1113 , thanks for this, this looks great. Just one small suggestion , can you and any screenshot as well of the screen where you doing this?

Hello @swarna1101, I'm not sure I follow, but I've taken a screenshot of the added documentation running locally:

@swarna1101 I've taken a screenshot of the actual validator node after following the restart process. This image should give a clear view of the node's status post-restart, showing both the Docker commands up to and the node's operational CLI.

Please let me know if this is along the lines of what you were looking for or if there's anything else you need.
Thank you for your patience.

ok, I think lets not keep image, now I see rest pages does not have much image. I will merge it then


UIPBEX-5 Bursar exports configuration form (UI)

Purpose

https://issues.folio.org/browse/UIPBEX-5
Approach

Pre-Merge Checklist
Before merging this PR, please go through the following list and take appropriate actions.

[x] I've added appropriate record to the CHANGELOG.md
Does this PR meet or exceed the expected quality standards?

[x] Code coverage on new code is 80% or greater
[x] Duplications on new code is 3% or less
[x] There are no major code smells or security issues

Does this introduce breaking changes?

[ ] If any API-related changes - okapi interfaces and permissions are reviewed/changed correspondingly
[ ] There are no breaking changes in this PR.

If there are breaking changes, please STOP and consider the following:

What other modules will these changes impact?
Do JIRAs exist to update the impacted modules?

[ ] If not, please create them
[ ] Do they contain the appropriate level of detail?  Which endpoints/schemas changed, etc.
[ ] Do they have all they appropriate links to blocked/related issues?

Are the JIRAs under active development?

[ ] If not, contact the project's PO and make sure they're aware of the urgency.

Do PRs exist for these changes?

[ ] If so, have they been approved?

Ideally all of the PRs involved in breaking changes would be merged in the same day to avoid breaking the folio-testing environment.  Communication is paramount if that is to be achieved, especially as the number of intermodule and inter-team dependencies increase.
While it's helpful for reviewers to help identify potential problems, ensuring that it's safe to merge is ultimately the responsibility of the PR assignee.

was reviewed and approved in https://github.com/folio-org/ui-tenant-settings/pull/196