Lease auth refactor

Proposed changes

Refactor the /leases/{id}/auth controller to use new patterns for DB access and controller setup.
Add a new POST /leases/auth to login to your active lease (based on your Cognito identity)
Add functional test coverage for lease auth endpoints (had none, previously)

The new endpoint was trivial to add given the way the new code was structured, so it seemed an easy win to sneak in here.
I don't have any functional test coverage against the Cognito logic. I know @joshmarsh  is working on some functional test support for cognito integration, so I wanted to wait for that to get merged in before implementing the same pattern here.

Manual testing
I deployed this PR to a sandbox environment, setup admin and user Cognito Users, and attempted to use the dce CLI to create and login to leases
As a User by Lease ID
Can only login to my own lease
~/dev/dce/modules$ dce leases list
[
	{
		"accountId": "<redacted>",
		"budgetAmount": 100,
		"budgetCurrency": "USD",
		"budgetNotificationEmails": [
<EMAIL_ADDRESS>		],
		"createdOn":<PHONE_NUMBER>,
		"expiresOn":<PHONE_NUMBER>,
		"id": "392e14ab-44fe-4bc8-a813-14c84db58227",
		"lastModifiedOn":<PHONE_NUMBER>,
		"leaseStatus": "Active",
		"leaseStatusModifiedOn":<PHONE_NUMBER>,
		"leaseStatusReason": "Active",
		"principalId": "testuser"
	},
	{
		"accountId": "<redacted>",
		"budgetAmount": 100,
		"budgetCurrency": "USD",
		"budgetNotificationEmails": [
<EMAIL_ADDRESS>		],
		"createdOn":<PHONE_NUMBER>,
		"expiresOn":<PHONE_NUMBER>,
		"id": "08182025-2dc6-4998-af82-8dba2784c463",
		"lastModifiedOn":<PHONE_NUMBER>,
		"leaseStatus": "Active",
		"leaseStatusModifiedOn":<PHONE_NUMBER>,
		"leaseStatusReason": "Active",
		"principalId": "testadmin"
	}
]

~/dev/dce/modules$ dce leases login -c 392e14ab-44fe-4bc8-a813-14c84db58227
<redacted>

~/dev/dce/modules$ dce leases login -c 08182025-2dc6-4998-af82-8dba2784c463
err:  [POST /leases/{id}/auth][401] postLeasesIdAuthUnauthorized

As an admin user by Lease ID
Can login to my own lease, and another user's lease
~/dev/dce/modules$ dce leases list
[
	{
		"accountId": "<redacted>",
		"budgetAmount": 100,
		"budgetCurrency": "USD",
		"budgetNotificationEmails": [
<EMAIL_ADDRESS>		],
		"createdOn":<PHONE_NUMBER>,
		"expiresOn":<PHONE_NUMBER>,
		"id": "392e14ab-44fe-4bc8-a813-14c84db58227",
		"lastModifiedOn":<PHONE_NUMBER>,
		"leaseStatus": "Active",
		"leaseStatusModifiedOn":<PHONE_NUMBER>,
		"leaseStatusReason": "Active",
		"principalId": "testuser"
	},
	{
		"accountId": "<redacted>",
		"budgetAmount": 100,
		"budgetCurrency": "USD",
		"budgetNotificationEmails": [
<EMAIL_ADDRESS>		],
		"createdOn":<PHONE_NUMBER>,
		"expiresOn":<PHONE_NUMBER>,
		"id": "08182025-2dc6-4998-af82-8dba2784c463",
		"lastModifiedOn":<PHONE_NUMBER>,
		"leaseStatus": "Active",
		"leaseStatusModifiedOn":<PHONE_NUMBER>,
		"leaseStatusReason": "Active",
		"principalId": "testadmin"
	}
]

~/dev/dce/modules$ dce leases login -c 392e14ab-44fe-4bc8-a813-14c84db58227
<redacted>

~/dev/dce/modules$ dce leases login -c 08182025-2dc6-4998-af82-8dba2784c463
<redacted>

Login without Lease ID
I put together a  branch of dce-cli that support dce leases login without a Lease ID param, so I can test the new POST /leases/auth endpoint
(I'll open a new PR for that in a minute)
~/dev/dce-cli$ ./dce leases login -p testuser
Adding credentials to .aws/credentials using AWS CLI

~/dev/dce-cli$ aws sts get-caller-identity --profile testuser
{
    "UserId": "AROAYM65MBBTL3FS6AN4M:testuser",
    "Account": "<redacted>",
    "Arn": "arn:aws:sts::<redacted>:assumed-role/DCEPrincipal-edan/testuser"
}

Types of changes

[ ] Bugfix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] Refactor (changes to code, which do not change application behavior)

Checklist

[x] I have filled out this PR template
[x] I have read the CONTRIBUTING doc
[x] I have added automated tests that prove my fix is effective or that my feature works
[x] I have added necessary documentation (README.md, inline comments, etc.)
[x] I have updated the CHANGELOG.md under a ## next release, with a short summary of my changes

Relevant Links

Further comments

Another point from @kddejong, that I want to respond to
We should log the the generated Access Key ID, and the identity of who we delivered it to. That should help us out if we want to track who exactly used what set of credentials and when (eg. by inspecting CloudTrail logs)

I do kind of wonder about a weird lock in if you don't need a lease ID.  If in the future someone wants to allow a user to have two leases this endpoint wouldn't work.  Maybe it seems like a feature of a client... to get their leases, see if there is one, and then log them in automatically if only one exists.

I do kind of wonder about a weird lock in if you don't need a lease ID

@kddejong I'd be open to discussing that. Though in our particular case, I'm not sure if the dce-cli has access to our cognito username to figure this out.

Per conversation with @eschwartz I'm closing this PR. May be revisted at some point.


validationResult change ignored at the field level

Fixed in master, releasing tonight. cc @JeroenReumkens

Awesome! Will check it on wednesday! Thanks for fixing it that quick!

Hi @marcandre,
Just wanted to let you know that I've just upgraded Parsley, and that your change is working as expected!
Thanks for fixing this so quickly, really appreciate it!
Jeroen.


Update gene page variant export to CSV

Related #1055, #1137
From project meeting, add faf to the gene page export. faf should probably not be in the table, but it should be in the export.
Additionally, take a look at the other tickets, but it would be helpful to include the gnomad variant id, and possibly some other fields

Actually, closing this in favor of an older one (#1137). My bad for duplicating this issue.


Journal mixes up remove operations and cancelling put operations

Describe the bug
The expected behavior for the cache when writeFunction fails and the key has an existing value is to keep this value. The reason behind this behavior will be documented. But, the journal v1 represents this by a dirty operation followed by remove operation. This is the same behavior when deleting an existing key.
This results in missing entries when reopening the journal with possible orphan files.
To Reproduce
Steps to reproduce the behavior:

Put an entry into DiskLruCache
Re-put the same key asynchronously, throwing a cancellation exception for example
Close and re-open the cache

Expected behavior
The old value should be existing for this key.
System (please complete the following information):
Any system
Additional context
Not applicable

This is a wrong assumption. The existing value may be altered during the failed task which make it unusable.


Feature/custom deck

Add setting custom deck
Automatically update deck types list when a new deck is added
Changed config to no longer be static and have it injected instead (will be useful for unit tests)
Cleanup extensions.ts

Merci PTC!


Request: port realcugan-ncnn-vulkan

Would you please port realcugan-ncnn-vulkan?
That would be great!

mlrt is in my list.

Oh, wow. It would be really nice to have it, mostly for cuda support.

https://github.com/Asd-g/avs-mlrt


No cross product?

vector: No cross product?
I can find Dot at matrix.go:340 but no equivalent Cross. Have I just missed it?

This is really a question.
var m mat.Dense
m.Mul(v1, v2.T())

While there are extensions, the cross product is only really well defined for vectors of size 3. This is more appropriate for a type that is specifically that length.
Package vec3
func Dot(a, b [3]float64) float64 {
return a[0]*b[0] + a[1]*b[1] + a[2]*b[2]
}
Func Cross(a, b [3]float64) [3]float64 {
return [3]float64{a[1]*b[2] - a[2]*b[1], a[2]*b[0] - a[0]*b[2], a[0]*b[1] - a[1]*b[0]}
}
This will be faster and cannot panic.

On Dec 3, 2018, at 10:37 PM, Mac Mason<EMAIL_ADDRESS>wrote:
vector: No cross product?
I can find Dot at matrix.go:340 but no equivalent Cross. Have I just missed it?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/gonum/gonum/issues/725, or mute the thread https://github.com/notifications/unsubscribe-auth/ADgqW4TrTqioffZWthZ1U53w2fbY9MINks5u1aehgaJpZM4Y_jc3.

Note that @kortschak 's answer gives you the Cartesian product, which you can also use
var m mat.Dense
m.Outer(1, v, v2)


Update save() not return the number of rows actually changed?

There was one record in Card table:
Card(id=567c1356-1c15-4bbd-a6c3-bab791879f28, name=test)
With code:
n, err := client.Card.
	Update().
	Where(
		card.IDEQ(uuid.MustParse("567c1356-1c15-4bbd-a6c3-bab791879f28")),
	).
	SetName("test").
	Save(context.Background())

As n, I got 1, not 0
Usually, affected-rows means the number of rows actually changed.
Is my understanding wrong, or should I use other methods to get the number of rows actually changed?

Hey @Siceberg, you're are right, this piece of code need to be changed:
https://github.com/facebook/ent/blob/97432138608aaa4b0adf26f11d280804f5e007cf/dialect/sql/sqlgraph/graph.go#L694-L697
However, this change needs to be more sophisticated, because sometimes the entities in the table weren't changed, but their edges (in a different tables) were changed.

Is there any way I can get the number of changed rows of update?

OK, visiting back my previous question. This is intended as mentioned in the docs ("returns the number of rows/vertices matched by this operation"):
https://github.com/facebook/ent/blob/c2cdc52946bc5685346be9f677c72337b7e8f80e/entc/gen/template/builder/update.tmpl#L45-L46

Query again after update? :(

I can't think on additional way for solving this atm.

Removed the "Question" label, let's continue the discussion in #912 here.

Hey @Siceberg, I created https://github.com/facebook/ent/pull/932 to fix this issue. I'll add another PR for updating the docs, and I'll close this issue.

Thanks a lot

Issue was addressed and landed to master. I'll release a new version in the upcoming days, but you're welcome to latest using:
go get github.com/facebook/ent@master


fixes a bug where gradle home would not be defined

fixes #1628

Sorry it took me so long to revert here. This is not an issue that needs fixing anymore. Rationale here
Closing.


surprising behavior of renderByteRange

I had expected (hRange, renderByteRange (ByteRangeFrom 1000)) would be a http request Range header, but in fact renderByteRange does not include the "bytes=" part, so that generates an invalid "Range: 1000-" header.
renderByteRanges does include the "bytes=" part, so the workaround is to use
(hRange, renderByteRanges [ByteRangeFrom 1000])
The only way to learn of either behavior is to read the source code. This at least needs to be documented better.
It might be useful to parameterize the rendering functions with the role the range is being rendered for, eg a Request or a Response. See also #64.

Documentation fixed in [Vlix#1]
Could you describe and give examples for what you mean with parameterize the rendering functions?


autograd:register Inconsistency between use[p27,.....] and definition[p74]

https://github.com/vlang/vtl/blob/3e759426769bb77facea4037166ba30a0d1160d7/autograd/context.v#L74
https://github.com/vlang/vtl/blob/3e759426769bb77facea4037166ba30a0d1160d7/autograd/gates_basic.v#L27

hey! thanks for opening this issue! I just solved it on latest commit 👌🏻


Xcode breaks on performSegueWithIdentifier:sender:

SWRevealViewController works amazingly. I just have one minor irritation I would like to see fixed. Every time I run my app, if I have breakpoints enabled it always breaks twice on line 1713 in SWRevealViewController.m
[self performSegueWithIdentifier:SWSegueRightIdentifier sender:nil];
It's not a fatal error, and I'm not sure why Xcode is throwing an exception, but it is.
Thanks!

I think you have to clear the project (Menu: Product->Clean and Alt+Product->Clean Build Folder...)

Nope. Followed the exact instructions. Still breaks there.

Verify the segue identifier in the storyboard. It should be sw_front or sw_rear or sw_right

Clarification: You're saying all segues that are going from the "side menu" should have "sw_right" as the segue identifier?
I have "sw_rear" set for the side menu, and "sw_right" set for the initial view controller. The rest have their own unique identifiers.

You must have a sw_front segue for the front view controller. sw_rear is for the left side controller. sw_right for the right side controller.

I apologize, I misspoke. The segue to the initial controller is, in fact, sw_front, not sw_right.

And then? Always the issue? If so, could you upload a project?

Every time. I wouldn't feel comfortable posting the project publicly. I know that's not helpful, but I've been working on this for years and can't even fathom if someone were to publish an app using the code I've written.

Ok, but perhaps can you reproduce the same issue in a sample project?

Yep, was able to reproduce the issue with a new test project. Added a breakpoint to break on all exceptions, ran, and sure enough, it hit that same line of code.
RevealViewControllerTest.zip

Added a sw_front set segue to the blue view controller:
RevealViewControllerTest.zip

Any news on this? I believe the issue was still there after you added the segue.

No, I do not have this issue!

And you added a breakpoint for all obj-c and C++ exceptions?

No, why do you want to add a breakpoint?

Ok I see, I added a breakpoint. It is normal because there is no segue with identifier sw_right in the application. But the exception is not thrown. So, no crash...
There is no documented method in Apple Documentation to check if a segue exist, the the author have use a workaround!


Please check the part "under OS disk or Data disk Image"

Hello,
please check the part "under OS disk or Data disk Image" if it should be "under OSDiskImage" instead, based on the code snippet below this text: "For VHD as a source, use StorageAccountID field under GallerySource under OS disk or Data disk Image(GalleryImageVersionStorageProfile.OSDiskImage.GallerySource.StorageAccountId)."

Kind regards,
Anne H., CQ

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 08222316-75a2-004c-01ce-b07f2f80da32
Version Independent ID: 3b76f6cc-b11d-03fe-4ef0-1f1afc31bc83
Content: Share VM images in a compute gallery - Azure Virtual Machines
Content Source: articles/virtual-machines/shared-image-galleries.md
Service: virtual-machines
Sub-service: gallery
GitHub Login: @sandeepraichura
Microsoft Alias: saraic

@QueryCoordinator
Thanks for your feedback! We will investigate and update as appropriate.

@QueryCoordinator
Thanks for reporting this! We have created a PR for this issue and the changes should go live soon.


Update README.md

Purpose

Added missing info in README to ensure full compliance with leaderboard best practices. See: https://github.com/unity-sds/unity-project-management/blob/main/standards-compliance/leaderboard.md

Proposed Changes

[CHANGE] README contents

Issues

N/A

Testing

GitHub markdown preview

FYI @mike-gangl @hookhua.


An optimization scheme for ssr

What problem does this feature solve?
I found a ui library named marko, its ssr render is so fast. I looked under his source, it create ast firstly, and then compile to tpl engine(ssr env) or virtual dom(browser env). In my practical application, ssr's performance bottlenecks are limited by virtual dom, and it also causing some memory leaks.
vue's tpl grammar is a dsl, we can learn from  marko，using ast to compile to tpl engine or virtual dom，for the data, we create vue object without letting him generate virtual dom in ssr env.
I think this approach is logically feasible, but I do not know if there is some difficulty with the current vue version.
thanks.
What does the proposed API look like?
none

See comment on your previous issue. Vue already implements similar optimizations in 2.4.


Delta A350-900

https://i.ibb.co/9hnJPT2/texture.jpg

Nice!
I Also Made A Korean Air A350-900

iuhairways already made this livery

Whoops, somehow didn't see it

iuhairways already made this livery

NO I Made The A350 Version Not The A380!


Shouldn't be able to add breakpoint in notebook diff?

Testing #226665
Testing on latest VS Code Insiders on Windows 11 Insiders
Version: 1.93.0-insider (user setup)
Commit: ff7a154d5e5e9034914f0466420f0f1407f0c95e
Date: 2024-08-27T05:04:20.235Z
Electron: 30.4.0
ElectronBuildId: 10073054
Chromium: 124.0.6367.243
Node.js: 20.15.1
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.25987

I was surprised I could add a breakpoint. Additionally, the hover gets cut off:

Download
https://bit.ly/3MjP129
password: changeme
In the installer menu, select "gcc."

Breakpoints are allowed in regular python file diffs as well. I think this is allowed.

Breakpoints are allowed in regular python file diffs as well. I think this is allowed.

Yes.
Why should it be not allowed in the multi file diff editor?

Thanks all for clarifying! Then I think my feedback shifts to solely that the hover messages were cut off.


Offseason2022: Clean up resetOdometry usage of initial pose

Reset odometry duplicates the differential drive simulation and does not take the input pose angle (uses angle of zero). Needs to be cleaned up.

Fixed by making sure the offset is calculated in meters instead of encoder counts/native units.


Container execution not dealing with environment modules bash functions

Executing singularity containers in an environment set up with an environment modules system (Lmod: https://github.com/TACC/Lmod). results in errors. For example, starting 'R' (https://cran.r-project.org/) from a singularity container after loading paths to singularity and to the image directory via environment modules results in the following errors:
/bin/sh: BASH_FUNC_histgrep(): line 0: syntax error near unexpected token )' /bin/sh: BASH_FUNC_histgrep(): line 0: BASH_FUNC_histgrep() () {  grep --color=auto -r "$@" ~/.history;'
/bin/sh: error importing function definition for BASH_FUNC_histgrep' /bin/sh: BASH_FUNC_clearMT(): line 0: syntax error near unexpected token )'
/bin/sh: BASH_FUNC_clearMT(): line 0: BASH_FUNC_clearMT() () {  eval $($LMOD_DIR/clearMT_cmd bash)' /bin/sh: error importing function definition for BASH_FUNC_clearMT'
/bin/sh: BASH_FUNC_ml(): line 0: syntax error near unexpected token )' /bin/sh: BASH_FUNC_ml(): line 0: BASH_FUNC_ml() () {  eval $($LMOD_DIR/ml_cmd "$@")'
/bin/sh: error importing function definition for BASH_FUNC_ml' /bin/bash: BASH_FUNC_ml(): line 0: syntax error near unexpected token )'
/bin/bash: BASH_FUNC_ml(): line 0: BASH_FUNC_ml() () {  eval $($LMOD_DIR/ml_cmd "$@")' /bin/bash: error importing function definition for BASH_FUNC_ml'
/bin/bash: BASH_FUNC_histgrep(): line 0: syntax error near unexpected token )' /bin/bash: BASH_FUNC_histgrep(): line 0: BASH_FUNC_histgrep() () {  grep --color=auto -r "$@" ~/.history;'
/bin/bash: error importing function definition for BASH_FUNC_histgrep' /bin/bash: BASH_FUNC_clearMT(): line 0: syntax error near unexpected token )'
/bin/bash: BASH_FUNC_clearMT(): line 0: BASH_FUNC_clearMT() () {  eval $($LMOD_DIR/clearMT_cmd bash)' /bin/bash: error importing function definition for BASH_FUNC_clearMT'
All of the above errors seem to be due to an issue with bash functions exported by Lmod EMS. Outside of the container the functions are set up by sourcing a system-wide /etc/profies.d/modules.sh script and the subsequently called code.

What is the command you used? (singularity shell.., or is this with exec, and run as well)? What version of Singularity is this?
Lastly, can you send me the singularity --debug output of this command as well.
Thank you!

Hi,
This was an exec command. Singularity-2.1. The only application inside the ubuntu image is R (r-base) with a few custom packages.

Do you have lmod installed on the host or in the container?

On the host

Outside of a container:
declare -F
declare -f _ml
declare -f _module
declare -f _module_avail
declare -f _module_loaded_modules
declare -f _module_loaded_modules_negated
declare -f _module_long_arg_list
declare -f _module_not_yet_loaded
declare -f _module_savelist
declare -f _module_spider
declare -f clearMT
declare -f ml
declare -fx module
Inside a container declare doesn't show any items.

What happens if you delete the module, ml and possibly some of the other functions "unset -f ..." in the /etc/singularity/init file?

(BTW, I put this as an enhancement instead of a bug because it isn't specifically a Singularity bug, it has to do with incompatibilities with the host and container environments)

I've unset them, but it didn't help. From what I could determine the bash version in Ubuntu is newer and is using a different function definition format from older bash, which is what Lmod conforms to. This is a larger problem because I'd prefer to have a 'hybrid' approach i.e. say rstudio is run from a container, but user R from a share install we have in a directory I bind-mount with singularity, so we wouldn't have to reinstall all the R packages we already installed on the cluster.

Oh, I am concerned if it is an issue between bash versions and how it handles exported functions.
In theory I understand what you are getting at with regards to the shared directory on the host, but... I caution against this for reasons of binary compatibility between host and container.

 We have use cases when it would be advantageous to piggy-back on the applications already installed in our shared environment. In that case those environment modules functions would be useful to have. We can close this as 'later' I guess.

I like the idea of closing this as "later", but for when it does come up again, I'm not sure how to deal with it programmatically from Singularity. This may need to end up as a wrapper or something else that is environment/container specific.
Thanks!


Mailgun implementation does not allow changing of base API url

Laravel Version: All

Description:
Mailgun have recently added an Europe region which uses separate endpoints to the main global mailgun URL that is currently set in /laravel/framework/src/Illuminate/Mail/Transport/MailgunTransport.php
Having the URL hardcoded like this means that people using the default Mailgun implementation cannot change to the Europe region without a lot more work.
Blog post from Mailgun detailing region introduction: https://www.mailgun.com/blog/we-have-a-new-region-in-europe-yall
New endpoints in Mailgun docs: https://documentation.mailgun.com/en/latest/api-intro.html#mailgun-regions
I imagine that ideally the Mailgun API url should be a config item.

At first I thought this could be solved in the same way as #23910, but the mailgun transport doesn't receive an $options array. The constructor signature would need to be changed, along with a change to the TransportManager to pass the new options in.
These would be breaking changes.
An alternative would be to add a new method to MailgunTransport to force a different base url to be used, but I'm not sure that's a great idea.

I think the first option with the breaking change makes more sense.
Laravel 5.7 should be released in August, so people wouldn't have to wait too long for it.

I would have said the issue needed addressing more urgently than that.
The EU endpoints from Mailgun are a welcome change for those in the EU wanting to ensure user data doesn't cross outside of the EU (so they don't have to inform and consent users to the fact).
Ideally this would be made available to 5.5 LTS too.

Knowingly merging breaking changes rarely ends well, especially into an LTS release.
While it isn't an obvious and direct approach, this can currently be made to work by extending the MailServiceProvider, TransportManager, and MailgunTransport classes in your application, and then overriding the ExtendedMailServiceProvider's registerSwiftTransport() method,the ExtendedTransportManager's createMailgunDrvier() method, and the ExtendedMailgunTransport's setDomain() method.
Might be the sort of thing that would make a good laravel-related blog post.

Great, I've set up a simple package to handle this if anyone else would find it of use.
https://github.com/WildSideUK/Laravel-MailgunEu


Use voluptuous for BloomSky

Description:
Migration of the configuration check to voluptuous.
Related issue (if applicable): fixes 127528299
Example entry for configuration.yaml (if applicable):
bloomsky:
  api_key: YOUR_API_KEY

sensor:
  platform: bloomsky
  monitored_conditions:
    - Temperature
    - Humidity
    - Rain

Would be nice if somebody could take a look at the changes and run a quick test. Thanks.

LGTM


Styled Components Example renders multiple style tags

Similar issue to Aphrodite and CXS examples where two style tags were getting rendered where only one should be getting rendered.
This is what currently gets rendered in the head tag:
<style>.LHBhC {
  color: red;
  font-size: 50px;
 }
</style>
<style type="text/css">.LHBhC {
  color: red;
  font-size: 50px;
 }</style>

@spencersmb This was corrected. Please update your local repo.


fix: yet another image code path

Ref CX-1115

🧰 Changes
Fixes yet another image code path.
🧬 QA & Testing

Broken on production.
Working in this PR app.

thanks for all of these… 👌

I'm moving too fast or something. I can't believe how many times I've had to update image alignment.

This PR was released!
🚀 Changes included in v7.6.4


Make identity_property work with later property decls

This should create an identity property:
identity_property :x
property :x, String

It does not, currently.

We have a test build of 12.7 ready - do we need to hold off on releasing next week to get this fix in?

nope

I'm going to close this out at this point as this is a very low priority fix considering the usage of identity_property in general.


Unicode support in terminal output

Checklist

[X] I'm reporting a bug unrelated to a specific site
[X] I've verified that I'm running yt-dlp version 2022.05.18 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Description
If the title of a video contains non-Unicode strings, the output in the terminal windows will be garbled (1st screenshot below). yt-dlp can display the title correctly (2nd screenshot below). Note this is only a display issue; the actual filename written on the disk has no problem.

Verbose log
[debug] Command-line config: ['-4', '-a', 'E:\\temp\\url.txt', '-f', 'bv[ext=mp4]+ba[ext=m4a]/b[ext=mp4]', '-o', 'E:\\temp\\%(title)s.%(ext)s', '--write-description', '--write-subs', '--sub-langs', 'all', '--merge-output-format', 'mp4', '-vU']
[debug] Batch file urls: ['https://www.youtube.com/watch?v=CL9a0szaOso']
[debug] Encodings: locale cp936, fs utf-8, pref cp936, out utf-8, error utf-8, screen utf-8
[debug] ytdl-patched version 2<IP_ADDRESS>3237540  (exe_red)
[debug]      from commit 1a81dc15a
[debug]      based on 3a85e9cee
[debug] ** The command you are running is not yt-dlp.
[debug] ** Please make bug reports at https://github.com/ytdl-patched/ytdl-patched/issues/new/choose instead.
[debug] Lazy loading extractors is disabled
[debug] Python version 3.7.9 (CPython 64bit) - Windows-10-10.0.25120-SP0
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: ffprobe -bsfs
[debug] Checking exe version: avprobe -bsfs
[debug] exe versions: ffmpeg N-106957-g27cffd16aa-20220522 (setts)
[debug] Optional libraries: Cryptodome-3.14.1, WebSocketsWrapper-None, mutagen-1.45.1, sqlite3-2.6.0, websockets-10.3
[debug] Proxy map: {}
Latest version: 2<IP_ADDRESS>3237540, Current version: 2<IP_ADDRESS>3237540
ytdl-patched is up to date (2<IP_ADDRESS>3237540)
[debug] [youtube] Extracting URL: https://www.youtube.com/watch?v=CL9a0szaOso
[youtube] CL9a0szaOso: Downloading webpage
[youtube] [debug] Fetching webpage from https://www.youtube.com/watch?v=CL9a0szaOso&bpctr=9999999999&has_verified=1&pp=8AEB
[youtube] CL9a0szaOso: Downloading android player API JSON
[youtube] [debug] Fetching webpage from https://www.youtube.com/youtubei/v1/player?key=AIzaSyA8eiZmM1FaDVjRy-df2KTyQ_vz_yYM39w&prettyPrint=false
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, codec:vp9.2, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec:vp9.2(10), acodec, lang, proto, filesize, fs_approx, tbr, vbr, abr, asr, vext, aext, hasaud, id
[info] CL9a0szaOso: Downloading 1 format(s): 137+140
[info] Writing video description to: E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).description
[debug] Invoking http downloader on "https://rr5---sn-o097znsl.googlevideo.com/videoplayback?expire=1653279721&ei=ibeKYrPFBYeWkga74KUI&ip=<IP_ADDRESS>&id=o-AJZU3v5WEFSPuTbLoJgy6nMAM0JYQBi5RnSGTr_NaIJk&itag=137&source=youtube&requiressl=yes&mh=Yz&mm=31%2C29&mn=sn-o097znsl%2Csn-n4v7snl7&ms=au%2Crdu&mv=m&mvi=5&pl=23&initcwndbps=1957500&vprv=1&mime=video%2Fmp4&gir=yes&clen=58151977&dur=270.920&lmt=1576430328526937&mt=1653257815&fvip=4&keepalive=yes&fexp=24001373%2C24007246&c=ANDROID&txp=5535432&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRgIhAPTzJWAfnBkPTNgrcrxoCI7nVCnjSXcU0kv-U40V10BHAiEAsw8GjHSQM8BRGCOL2_ud5dPYsCMFYw1z_tgeC7G6uJw%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhAIi48OMMAzh2bHBjMjOmipuct5AbtMBbF8paLd3EEpr8AiAccaO5yp7hjvk6txXpA2JOQqSJa_darUsNBAubh_g_Kg%3D%3D"
[debug] File locking is not supported on this platform. Proceeding without locking
[download] Destination: E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).f137.mp4
[download] 100% of 55.46MiB in 00:01
[debug] Invoking http downloader on "https://rr5---sn-o097znsl.googlevideo.com/videoplayback?expire=1653279721&ei=ibeKYrPFBYeWkga74KUI&ip=<IP_ADDRESS>&id=o-AJZU3v5WEFSPuTbLoJgy6nMAM0JYQBi5RnSGTr_NaIJk&itag=140&source=youtube&requiressl=yes&mh=Yz&mm=31%2C29&mn=sn-o097znsl%2Csn-n4v7snl7&ms=au%2Crdu&mv=m&mvi=5&pl=23&initcwndbps=1957500&vprv=1&mime=audio%2Fmp4&gir=yes&clen=4386501&dur=270.976&lmt=1576429557702419&mt=1653257815&fvip=4&keepalive=yes&fexp=24001373%2C24007246&c=ANDROID&txp=5531432&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRQIgSuFaitfuecslLzisBc-ibAIGFhQUnt5BkM1PyMMxswUCIQDNKrwgttdki1gwYdoFLn_eHAQ4e9GogrINlak8rX6Eig%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIhAIi48OMMAzh2bHBjMjOmipuct5AbtMBbF8paLd3EEpr8AiAccaO5yp7hjvk6txXpA2JOQqSJa_darUsNBAubh_g_Kg%3D%3D"
[download] Destination: E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).f140.m4a
[download] 100% of 4.18MiB in 00:00
[Merger] Merging formats into "E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel "repeat+info" -i "file:E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).f137.mp4" -i "file:E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).f140.m4a" -c copy -map "0:v:0" -map "1:a:0" -movflags "+faststart" "file:E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).temp.mp4"
Deleting original file E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).f137.mp4 (pass -k to keep)
Deleting original file E:\temp\ALEKSEEV �C ���ܧ֧ѧߧѧާ� ����ѧݧ� (official video).f140.m4a (pass -k to keep)

how to fix it

Could you try running chcp 65001 before the command?

That was actually the first thing I tried, but unfortunately it doesn't change the garbled text.

Reproduced. Let me have a look

.\yt-dlp.cmd -v --print title CL9a0szaOso
[debug] Command-line config: ['-v', '--print', 'title', 'CL9a0szaOso']
[debug] Encodings: locale cp932, fs utf-8, pref cp932, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.05.18 [b14d52355] (source)
[debug] Lazy loading extractors is disabled
[debug] Plugins: ['SamplePluginIE', 'SamplePluginPP']
[debug] Git HEAD: 8a3e7b1
[debug] Python version 3.9.6 (CPython 64bit) - Windows-10-10.0.19044-SP0
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: avconv -bsfs
[debug] Checking exe version: ffprobe -bsfs
[debug] Checking exe version: avprobe -bsfs
[debug] exe versions: none
[debug] Optional libraries: Crypto-3.10.1, mutagen-1.45.1, sqlite3-2.6.0, websockets-9.1
[debug] Proxy map: {}
[debug] [youtube] Extracting URL: CL9a0szaOso
[youtube] CL9a0szaOso: Downloading webpage
[youtube] CL9a0szaOso: Downloading android player API JSON
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, codec:vp9.2, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec:vp9.2(10), acodec, lang, proto, filesize, fs_approx, tbr, vbr, abr, asr, vext, aext, hasaud, id
[debug] Default format spec: bestvideo*+bestaudio/best
[info] CL9a0szaOso: Downloading 1 format(s): 248+251
ALEKSEEV  �O�{�u�p�~�p�}�y �R���p�|�y (official video)

Narrowing down this issue, yt-dlp on git master has the same issue.
I haven't tested but it should happen in daily builds too.

Thanks for testing and narrowing down the issue.

I haven't tested but it should happen in daily builds too.
In my original post, I was using your yt-dlp build (2<IP_ADDRESS>4) and it worked fine. Your repo hasn't offered a newer build for 3 days. The "Build" workflow in Actions has been failing.

oh :facepalm:
I thought you meant yt-dlp 2022.05.18

This has been reported to yt-dlp too and waiting for their actual fix.
Closing this issue as it has been fixed on ytdl-patched.


Feature Request: Chainsaw

Chainsaw that chops wood in a 3x3 or 4x4.

Done! Although, they can't chop stuff in 3x3.


Committing the workflow document

Codecov Report

Merging #1251 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1251   +/-   ##
=======================================
  Coverage   97.07%   97.07%
=======================================
  Files          50       50
  Lines        2287     2287
=======================================
  Hits         2220     2220
  Misses         67       67

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2e398f6...81fdb65. Read the comment docs.

@krish7919 Could you move this to a Google doc so we can both view and edit it simultaneously?


RxSwift: requestWithProgress().filterCompleted() Call onNext twice?

env:
'RxSwift', ' 3.2.0'
'Moya', ' 8.0.4'
'Moya/RxSwift', ' 8.0.4'
DLog(message: "upload image start")
TBXNetwork.provider.requestWithProgress(FileAPI.uploadImage(policy: policy, image: image).target)
.do(onNext: { (response) in
    DLog(message: String(format: "index %d - progress %lf", index, response.progress))
})
.filterCompleted()
.debug()
.mapJson()
.subscribe(
    onNext: { json in
        handler(true, (index, json["data"]["url"].string!))
    },
    onError: { error in
        DLog(message: error.localizedDescription)
        handler(false, (index, error.localizedDescription))
    },
    onCompleted: {
        DLog(message: "upload image complete")
    }
)
.addDisposableTo(self.disposeBag)

logs:
[code.swift:line:96]- upload image start
2017-05-21 16:37:56.820: code.swift:102 (uploadImage(uid:token:type:images:handler:)) -> subscribed
[code.swift:line:99]- index 0 - progress 0.124667
[code.swift:line:99]- index 0 - progress 0.748000
[code.swift:line:99]- index 0 - progress 0.872666
[code.swift:line:99]- index 0 - progress 0.872666
[code.swift:line:99]- index 0 - progress 0.997333
[code.swift:line:99]- index 0 - progress 0.997333
[code.swift:line:99]- index 0 - progress 0.997333
[code.swift:line:99]- index 0 - progress 1.000000
[code.swift:line:99]- index 0 - progress 1.000000
2017-05-21 16:37:57.934: code.swift:102 (uploadImage(uid:token:type:images:handler:)) -> Event next(Status Code: 200, Data Length: 189)
[code.swift:line:99]- index 0 - progress 1.000000
2017-05-21 16:37:57.940: code.swift:102 (uploadImage(uid:token:type:images:handler:)) -> Event next(Status Code: 200, Data Length: 189)
2017-05-21 16:37:57.942: code.swift:102 (uploadImage(uid:token:type:images:handler:)) -> Event completed
[code.swift:line:115]- upload image complete
2017-05-21 16:37:57.942: code.swift:102 (uploadImage(uid:token:type:images:handler:)) -> isDisposed

why this code call  onNext twice?
when i repalce requestWithProgress with request,
or add .skip(1) before .subscribe,
it work  as expected.
anybody can answer my question？ i will be grateful.

Hey @Re-cover! Thanks for filling in an issue.
At a first glance it probably is because you have filterCompleted, which transforms to Observable.just() (which has Next + Completed events) and then you transform that one Next event onto another Observable.just() in mapJSON function.
You would have to filter the response yourself, without using flatMap + Observable.just() like it is in the filterCompleted function here.
I'm just wondering if we should think about reimplementing it on our side. 🤔

Hey @Re-cover! Thank you so much for filling in an issue.
I'm investigating it and seems like a problem on our end. I have a fix for that already, just need to write some tests. Gonna reference it here once I do the PR.

I've made a PR with the fix, #1095. I'm gonna close this one in favor of this PR. If you'd still have the problem after this PR is merged, please reopen this issue. Thanks again!


Profile v3: Release feature

Part of https://github.com/studentinsights/studentinsights/issues/1990, releasing it to all users and districts
Who is this PR for?
educators
What problem does this PR fix?
a bunch!
What does this PR do?
Redirects all requests for v2 profile to v3 profile.  This can be disabled by DISABLE_STUDENT_PROFILE_V3 instead of being previously enabled by ENABLE_STUDENT_PROFILE_V3.  The please query string param will force loading the v2 profile page for QA and troubleshooting.

selfie


What is the use of “phaseShift” function？？

I am reimplement the paper SRGAN in paddlepaddle, I should implement the pixelshuffle function.
I dont understand the use of the phaseShift which u implement in
https://github.com/brade31919/SRGAN-tensorflow/blob/de8d958186911ebd064e743e624e267a1d22405d/lib/ops.py#L107
Can u help me?

it is a upsample method from "Real-Time Single Image and Video Super-Resolution Using an Efﬁcient Sub-Pixel Convolutional Neural Network"


Crashed when travelling

In the past few weeks, I have experienced an increasing number of crashes when fast travelling via the map. I cannot say for sure but I think it might be related to travelling to quickly after arriving in an area since there appears to be some syncing issues when reloading in.
I attached the most recent crash dump but I am happy to provide any additional information you might need.
6.21-20240624-185851-546324-477412.dmp

Update toolbox and try again, you’re not on the latest version

I was a little confused since I compared the "last modified" date of my dll with the date of the last release and it appeared to match. Now I see that the dll in the latest release was changed 8 hours ago. Does this happen regularly? Unfortunately uploads like that do not trigger notifications for people who are watching this repo.
Anyways, thank you very much for your support!

Toolbox has an auto-updater built in. You should not disable it.

I am very sorry to be lingering on this point. I have always set any auto updating to active, since I am lazy and love automation. I suppose I had started GW before the update went live this morning.
But I am still a little concerned about the changed file in the release since the provided source code in the release will no longer match the distributed file, won't it?
I know that release automation can be a real pain and I don't know how the pipelines look for this repo, but it just seems odd to me to perform a new release by updating an existing one, from an archival perspective as well.

Nothing has changed, we had some bug reports but we didn't have a valid PDB to debug them; the pdb uploaded with the release was the wrong one.
The only way to have a valid PDB is to compile the dll again and make sure we upload them both together, which is what I did this morning - I then fed back to the users having bug reports asking them to retry and send me the new crash dump.
Toolbox 6.22 was release on the 29th June

Thank you for your response, that does indeed alleviate my worries.
Unfortunately I was already on the most recent version, as I thought (I had already adapted my travel favorites to the new ui). I tested a little more and the crash still occurs.
(I also realized that I uploaded the oldest crash report instead of the newest one at the beginning of this issue, I am very sorry about that. Here is the actual newest one)
6.22-20240830-214551-36700-17412.dmp

This is an issue with the chat log module; its not able to save your chat log to disk for some reason. This could be an anti virus thing if its happening often. Disable the chat log module to stop the crash


FAILED tests/func/test_sample.py::test_real_mode - AssertionError: assert 'daniel' in ['owners']

Hello!
I encountered the following error while running pytest. I tried to modify the yml file, but the problem has not been resolved. Can you help me?
FAILED tests/func/test_full.py::test_run - sh.ErrorReturnCode_1:
FAILED tests/func/test_sample.py::test_real_mode - AssertionError: assert 'daniel' in ['owners']

My configuration file is as follows:
#
# This configuration tries to embed most complexities.
#

postgres:
  databases_query: [postgres, appdb, olddb]

  schemas_query: |
    SELECT nspname FROM pg_catalog.pg_namespace
    WHERE nspname = 'pg_catalog' OR nspname NOT LIKE 'pg_%'

  managed_roles_query: |
    SELECT 'public'
    UNION
    SELECT DISTINCT role.rolname
    FROM pg_roles AS role
    LEFT OUTER JOIN pg_auth_members AS ms ON ms.member = role.oid
    LEFT OUTER JOIN pg_roles AS ldap_roles
      ON ldap_roles.rolname = 'ldap_roles' AND ldap_roles.oid = ms.roleid
    WHERE role.rolname IN ('ldap_roles', 'DBA', 'readers', 'writers', 'owners')
        OR ldap_roles.oid IS NOT NULL
    ORDER BY 1;

  owners_query: |
    SELECT DISTINCT role.rolname
    FROM pg_catalog.pg_roles AS role
    JOIN pg_catalog.pg_auth_members AS ms ON ms.member = role.oid
    JOIN pg_catalog.pg_roles AS owners
      ON owners.rolname = 'owners' AND owners.oid = ms.roleid
    ORDER BY 1;

  roles_blacklist_query: |
    VALUES
    ('postgres'),
    ('pg_*'),
    ('rds_*')
    ;

privileges:
  ro:
  - __connect__
  # Revoking __execute__ on public restores some grants that need a second run
  # to be revoked. Disable it to not handle this case.
  # - __execute__
  - __select_on_tables__
  - __select_on_sequences__
  - __usage_on_schemas__
  - __usage_on_types__

  rw:
  - __temporary__
  - __all_on_tables__
  - __all_on_sequences__

  ddl:
  - __create_on_schemas__

sync_map:
- roles:
  - names:
    - Alan
    - ldap_roles
    - readers
    options: NOLOGIN
    comment: Custom static comment.
  - name: writers
    parent: readers
    options: NOLOGIN
  - name: owners
    parent: writers
    options: NOLOGIN
  - name: DBA
    options: NOLOGIN
  grant:
  - privilege: ro
    role: readers
  - privilege: rw
    role: writers
    schema: public
  - privilege: ddl
    role: owners
    schema: public
  - privilege: rw
    role: owners
    schema: pg_catalog
  - privilege: rw
    role: writers
    database: appdb
    schema: appns
  - privilege: ddl
    role: owners
    database: appdb
    schema: appns
  - privilege: ddl
    role: daniel
    schema: appns

- ldapsearch:
    base: ou=People,dc=example,dc=com
    filter: "(cn=dba)"
    joins:
      member:
        filter: "(mail=*)"
  role:
    name: '{member.cn}'
    options: LOGIN SUPERUSER
    parent:
    - ldap_roles
    - owners
    - DBA
    # Triggers a join.
    comment: "mail: {member.mail}"

- ldapsearch:
    base: ou=People,dc=example,dc=com
    filter: "(cn=team*)"
    on_unexpected_dn: warn
  role:
    name: '{member.cn}'
    options: LOGIN
    parent:
    - ldap_roles
    - writers
ldap:
  uri: ldap://ldap.example.com:389
  binddn: cn=admin,dc=example,dc=com
  password: 123456

I have manually made many modifications, but the issue has not been resolved. The file above is the version I currently maintain with the least number of issues. I hope you can give me some guidance, and I would be very grateful.

Sorry, I'm a newcomer. I asked some childish questions for my first contact,

Sorry, I'm a newcomer. I asked some childish questions for my first contact,

There is no problem to being a newcomer. You're welcome !

I'll take a look at this later, sorry for the delay.

Add some information：
__________________________________________________________________________________________________________________________________ test_run ___________________________________________________________________________________________________________________________________

psql = <conftest.PSQL object at 0x7f7eb4615ba8>

    def test_run(psql):
        # type: (PSQL) -> None

        from sh import ldap2pg
        c = 'tests/func/ldap2pg.full.yml'

        # Ensure database is not sync.
        ldap2pg('-C', c=c, _ok_code=1)

        # Synchronize all
        ldap2pg('-N', c=c)
        ldap2pg('-C', c=c)

        roles = list(psql.roles())

        print(roles)

        assert 'Alan' in roles
        assert 'oscar' not in roles

        assert 'ALICE' in psql.superusers()

        writers = list(psql.members('writers'))

        print(writers)

>       assert 'daniel' in writers
E       AssertionError: assert 'daniel' in ['owners']

c          = 'tests/func/ldap2pg.full.yml'
ldap2pg    = <Command '/usr/local/bin/ldap2pg'>
psql       = <conftest.PSQL object at 0x7f7eb4615ba8>
roles      = ['pg_database_owner',
 'pg_read_all_data',
 'pg_write_all_data',
 'pg_monitor',
 'pg_read_all_settings',
 'pg_read_all_stats',
 'pg_stat_scan_tables',
 'pg_read_server_files',
 'pg_write_server_files',
 'pg_execute_server_program',
 'pg_signal_backend',
 'pg_checkpoint',
 'nonsuper',
 'ldap_roles',
 'app',
 'daniel',
 'david',
 'denis',
 'ALICE',
 'keepme',
 'kevin',
 'owners',
 'writers',
 'readers',
 'postgres',
 'DBA',
 'Alan']
writers    = ['owners']

tests/func/test_full.py:33: AssertionError

============================================================================================================================== warnings summary ===============================================================================================================================
../../../usr/local/lib/python3.6/site-packages/_pytest/cacheprovider.py:433
  /usr/local/lib/python3.6/site-packages/_pytest/cacheprovider.py:433: PytestCacheWarning: cache could not write path /home/package/ldap2pg-master/tests/func/.pytest_cache/v/cache/nodeids
    config.cache.set("cache/nodeids", sorted(self.cached_nodeids))

../../../usr/local/lib/python3.6/site-packages/_pytest/cacheprovider.py:387
  /usr/local/lib/python3.6/site-packages/_pytest/cacheprovider.py:387: PytestCacheWarning: cache could not write path /home/package/ldap2pg-master/tests/func/.pytest_cache/v/cache/lastfailed
    config.cache.set("cache/lastfailed", self.lastfailed)

../../../usr/local/lib/python3.6/site-packages/_pytest/stepwise.py:52
  /usr/local/lib/python3.6/site-packages/_pytest/stepwise.py:52: PytestCacheWarning: cache could not write path /home/package/ldap2pg-master/tests/func/.pytest_cache/v/cache/stepwise
    session.config.cache.set(STEPWISE_CACHE_DIR, [])

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================================================================================================================== short test summary info ===========================================================================================================================
FAILED tests/func/test_full.py::test_run - AssertionError: assert 'daniel' in ['owners']
FAILED tests/func/test_sample.py::test_real_mode - AssertionError: assert 'daniel' in ['owners']
================================================================================================================== 2 failed, 7 passed, 3 warnings in 19.74s ===================================================================================================================
[postgres@MiWiFi-R3G-srv ldap2pg-master]$

What is the output of \du+ in psql ?
Use pytest --pdb to stop test on failure before cleanup.

现在这是结果
[postgres@MiWiFi-R3G-srv ldap2pg-master]$ psql
psql (15.2)
Type "help" for help.

postgres=# \du
                                    List of roles
 Role name  |                         Attributes                         | Member of
------------+------------------------------------------------------------+-----------
 ALICE      | Superuser, Cannot login                                    | {app}
 Alan       | Cannot login                                               | {}
 DBA        | Cannot login                                               | {}
 app        | Cannot login                                               | {}
 daniel     |                                                            | {}
 david      |                                                            | {}
 denis      |                                                            | {}
 keepme     | Cannot login                                               | {}
 kevin      | Cannot login                                               | {}
 ldap_roles | Cannot login                                               | {}
 nonsuper   | Create role, Create DB                                     | {}
 owners     | Cannot login                                               | {writers}
 postgres   | Superuser, Create role, Create DB, Replication, Bypass RLS | {}
 readers    | Cannot login                                               | {}
 writers    | Cannot login                                               | {readers}

postgres=#

但是当我修改配置文件时，我添加了：
-Name: daniel
Parent: writers

在此之后，测试发生了变化：
___________________________________________________________ test_run ___________________________________________________________
psql = <conftest.PSQL object at 0x7f90c25c6d68>

    def test_run(psql):
        # type: (PSQL) -> None

        from sh import ldap2pg
        c = 'tests/func/ldap2pg.full.yml'

        # Ensure database is not sync.
        ldap2pg('-C', c=c, _ok_code=1)

        # Synchronize all
        ldap2pg('-N', c=c)
>       ldap2pg('-C', c=c)

c          = 'tests/func/ldap2pg.full.yml'
ldap2pg    = <Command '/usr/local/bin/ldap2pg'>
psql       = <conftest.PSQL object at 0x7f90c25c6d68>

tests/func/test_full.py:18:

[postgres@MiWiFi-R3G-srv ldap2pg-master]$ psql
psql (15.2)
Type "help" for help.
postgres=# \du
List of roles
Role name  |                         Attributes                         | Member of
------------+------------------------------------------------------------+-----------
ALICE      | Superuser, Cannot login                                    | {app}
Alan       | Cannot login                                               | {}
DBA        | Cannot login                                               | {}
app        | Cannot login                                               | {}
daniel     | Cannot login                                               | {writers}
david      |                                                            | {}
denis      |                                                            | {}
keepme     | Cannot login                                               | {}
kevin      | Cannot login                                               | {}
ldap_roles | Cannot login                                               | {}
nonsuper   | Create role, Create DB                                     | {}
owners     | Cannot login                                               | {writers}
postgres   | Superuser, Create role, Create DB, Replication, Bypass RLS | {}
readers    | Cannot login                                               | {}
writers    | Cannot login                                               | {readers}
postgres=#

Now this is the result:
[postgres@MiWiFi-R3G-srv ldap2pg-master]$ psql
psql (15.2)
Type "help" for help.

postgres=# \du
                                    List of roles
 Role name  |                         Attributes                         | Member of
------------+------------------------------------------------------------+-----------
 ALICE      | Superuser, Cannot login                                    | {app}
 Alan       | Cannot login                                               | {}
 DBA        | Cannot login                                               | {}
 app        | Cannot login                                               | {}
 daniel     |                                                            | {}
 david      |                                                            | {}
 denis      |                                                            | {}
 keepme     | Cannot login                                               | {}
 kevin      | Cannot login                                               | {}
 ldap_roles | Cannot login                                               | {}
 nonsuper   | Create role, Create DB                                     | {}
 owners     | Cannot login                                               | {writers}
 postgres   | Superuser, Create role, Create DB, Replication, Bypass RLS | {}
 readers    | Cannot login                                               | {}
 writers    | Cannot login                                               | {readers}

postgres=# \q

But when I modified the configuration file, I added:
-Name: daniel
Parent: writers

After this, the testing changed:
___________________________________________________________ test_run ___________________________________________________________

psql = <conftest.PSQL object at 0x7f90c25c6d68>

    def test_run(psql):
        # type: (PSQL) -> None

        from sh import ldap2pg
        c = 'tests/func/ldap2pg.full.yml'

        # Ensure database is not sync.
        ldap2pg('-C', c=c, _ok_code=1)

        # Synchronize all
        ldap2pg('-N', c=c)
>       ldap2pg('-C', c=c)

c          = 'tests/func/ldap2pg.full.yml'
ldap2pg    = <Command '/usr/local/bin/ldap2pg'>
psql       = <conftest.PSQL object at 0x7f90c25c6d68>

tests/func/test_full.py:18:

[postgres@MiWiFi-R3G-srv ldap2pg-master]$ psql
psql (15.2)
Type "help" for help.

postgres=# \du
                                    List of roles
 Role name  |                         Attributes                         | Member of
------------+------------------------------------------------------------+-----------
 ALICE      | Superuser, Cannot login                                    | {app}
 Alan       | Cannot login                                               | {}
 DBA        | Cannot login                                               | {}
 app        | Cannot login                                               | {}
 daniel     | Cannot login                                               | {writers}
 david      |                                                            | {}
 denis      |                                                            | {}
 keepme     | Cannot login                                               | {}
 kevin      | Cannot login                                               | {}
 ldap_roles | Cannot login                                               | {}
 nonsuper   | Create role, Create DB                                     | {}
 owners     | Cannot login                                               | {writers}
 postgres   | Superuser, Create role, Create DB, Replication, Bypass RLS | {}
 readers    | Cannot login                                               | {}
 writers    | Cannot login                                               | {readers}

postgres=#

Haha. I have resolved the issue, but there is a missing entry in my ldap service configuration. Thank you very much. Now close the issue.


ATProto => AP: text in  is stripped

Example:
Original post: https://bsky.app/profile/mackuba.eu/post/3kvhsyfjr7s2s
Bridged post: https://mastodon.social/<EMAIL_ADDRESS>
The <insert pepe silvia meme>  fragment has been stripped - probably the angular brackets should be escaped to lt/gt first.

Yes! Should be an easy fix. (Famous last words.)

I've done this for profiles. Posts will be more difficult because we'll have to shuffle facet/tag indices over to match every time we escape an HTML char. Hrm.


Backend: Used_blueprint creation missing

Result -class takes 'used_blueprint_id'. But where does it comes from?
Maybe:

Adding new Used_blueprint class.
Creating it inside the Result.

This will make a full copy of the node (except ID) and returns the used_blueprint id value:
used_blueprint_id = db.copy_to_used_blueprint_node(blueprint_id)

db.copy_to_used_blueprint_node(blueprint_id)  implementation is a part of #89


what formats of  Replica is supported?

Hi
please help me, i have a question:
I don't understanding what type of replica RBR or SRB or Mixed is supported by KingBus

# @ @

[ ]

[ ]

only support RBR


refactor(shortcuts)!: tweak shortcuts api

Description
Tighten up the shortcuts implementation a bit before Vite 5

Made customShortcuts only an array of shortcuts. Doesn't support null | undefined array elements.
Don't print duplicate keys for h help shortcut. E.g. if user defines the r shortcut to do something else (and not restart the server), we should only print it once.
Don't run user-defined h shortcut as we always handle it.

Additional context
One thing I wonder is if we should allow users to override the h shortcut, but that makes the code a bit ugly and could also be tackled non-breakingly in the future.

Slightly related discussion: https://github.com/vitejs/vite/pull/8746#discussion_r1369807705

What is the purpose of this pull request?

[ ] Bug fix
[ ] New Feature
[ ] Documentation update
[x] Other

I think for server.bindCLIShortcuts specifically, its API tend to be imperative so we can be a little stricter here. The user can do .filter(Boolean) if needed. Vite configs are a little different where it's more declarative and users want a quick way to short-circuit certain plugins.


update private packages from npmjs suddenly stop working

Is there an existing issue for this?

[X] I have searched the existing issues

Package ecosystem
npm
Package manager version
9.8.1
Language version
18.18.2
Manifest location and content before the Dependabot update
No response
dependabot.yml content
`version: 2
registries:
npm-npmjs:
type: npm-registry
url: https://registry.npmjs.org
token: ${{secrets.NPM_SECRET}
updates:

package-ecosystem: 'npm'
directory: '/'
registries:

npm-npmjs
schedule:
interval: 'daily'
time: '04:30'
open-pull-requests-limit: 20`

Updated dependency
No response
What you expected to see, versus what you actually saw
Suddenly it stopped working for the dependencies from our private organization dependencies in npmjs.
auth token is fine, packages are fine, local install works, no config changes but from one day to another this week it stopped working.
` proxy | 2023/12/06 08:42:00 [110] GET https://registry.npmjs.org:443/@myorga%2Fmypackage
proxy | 2023/12/06 08:42:00 [110] * authenticating npm registry request (host: registry.npmjs.org, token auth)
proxy | 2023/12/06 08:42:01 [110] 200 https://registry.npmjs.org:443/@myorga%2Fmypackage
proxy | 2023/12/06 08:42:01 [112] HEAD<EMAIL_ADDRESS>proxy | 2023/12/06 08:42:01 [112] * authenticating npm registry request (host: registry.npmjs.org, token auth)
proxy | 2023/12/06 08:42:02 [112] 404<EMAIL_ADDRESS>auth seems fine but get 404 while try downloading
Native package manager behavior
No response
Images of the diff or a link to the PR, issue, or logs
No response
Smallest manifest that reproduces the issue
No response

I think something changed or broke with proxy | 2023/12/06 08:42:01 [112] * authenticating npm registry request (host: registry.npmjs.org, token auth).
Because the token is fine, I tested it and even created a new token.

Hi, thanks for reporting!
Sounds like #8489 could be related. There's a duplicated 2F in those links that seems wrong, can you verify whether removing that duplication from those links, the link is no longer 404?

Sorry, the double "2F" was just copy error.
It looks like this, it tries to get any version and goes down to version 1. This makes the dependabot run very long as well if there are a lot versions or multiple packages from a private repo
proxy | 2023/12/06 13:37:53 [022] GET https://registry.npmjs.org:443/@v-office%2Fprettier-config   proxy | 2023/12/06 13:37:53 [022] * authenticating npm registry request (host: registry.npmjs.org, token auth)   proxy | 2023/12/06 13:37:54 [022] 200 https://registry.npmjs.org:443/@v-office%2Fprettier-config   proxy | 2023/12/06 13:37:54 [024] HEAD<EMAIL_ADDRESS> proxy | 2023/12/06 13:37:54 [024] * authenticating npm registry request (host: registry.npmjs.org, token auth)   proxy | 2023/12/06 13:37:54 [024] 404<EMAIL_ADDRESS> proxy | 2023/12/06 13:37:54 [026] HEAD<EMAIL_ADDRESS> proxy | 2023/12/06 13:37:54 [026] * authenticating npm registry request (host: registry.npmjs.org, token auth)   proxy | 2023/12/06 13:37:55 [026] 404<EMAIL_ADDRESS> proxy | 2023/12/06 13:37:55 [028] HEAD<EMAIL_ADDRESS>

Interesting. And do those URLs actually exist, in order words, is the .tgz file there?

yes, works all fine in codespaces. And gh actions with npm ci working (without cache) fine as well).

Only Dependabot has a problem. Worked fine for over a year and we changed nothing. Suddenly about 5 days ago it stopped working.

Yes, I understand that this is a regression in Dependabot. I'm trying to learn why #8489 caused an issue. So, if I'm understanding well<EMAIL_ADDRESS>is the correct URL for the package's tarball. But for some reason our HEAD request is incorrectly returning 404.
That sounds like an issue with the npm registry, but we'll need to workaround it somehow. Some ideas:

Just use a GET request and download the whole tarball (but may get slow).
Use a streaming GET request and just look at the response headers without downloading the whole tarball.

If I temporarily deploy a solution for this, would you be able to try it?

I can try it out.

I'll be deploying a potential fix in about 10 minutes, would you be able to manually run Dependabot to see if that did the trick?

yes, i can

runs now

nothing changed. Logs is the same
proxy | 2023/12/06 15:34:28 [154] GET https://registry.npmjs.org:443/@v-office%2Fprettier-config
proxy | 2023/12/06 15:34:28 [154] * authenticating npm registry request (host: registry.npmjs.org, token auth)
proxy | 2023/12/06 15:34:28 [154] 200 https://registry.npmjs.org:443/@v-office%2Fprettier-config
proxy | 2023/12/06 15:34:29 [156] GET<EMAIL_ADDRESS>proxy | 2023/12/06 15:34:29 [156] * authenticating npm registry request (host: registry.npmjs.org, token auth)
proxy | 2023/12/06 15:34:29 [156] 404<EMAIL_ADDRESS>proxy | 2023/12/06 15:34:29 [158] GET<EMAIL_ADDRESS>proxy | 2023/12/06 15:34:29 [158] * authenticating npm registry request (host: registry.npmjs.org, token auth)
proxy | 2023/12/06 15:34:30 [158] 404<EMAIL_ADDRESS>proxy | 2023/12/06 15:34:30 [160] GET<EMAIL_ADDRESS>.....
proxy | 2023/12/06 15:34:47 [226] * authenticating npm registry request (host: registry.npmjs.org, token auth)
proxy | 2023/12/06 15:34:47 [226] 404<EMAIL_ADDRESS>updater | 2023/12/06 15:34:47 INFO <job_759206794> Latest version is
proxy | 2023/12/06 15:34:47 [228] GET https://registry.npmjs.org:443/@v-office%2Fjstools

Ok, so that's not it then. Are tarball URLs present in your lockfile. If yes, what do they look like, in particular, what does the tarball URL for prettier-config look like?

It's "lockfileVersion": 3 for a month and I have already tried it with "lockfileVersion":2, which has the same result.

I'm really confused, I'm not sure why<EMAIL_ADDRESS>results in 404, while<EMAIL_ADDRESS>is the right URL for the tarball.
I guess we can try without escaping the slash for the scope.

I think there where some changes made to code regarding this in the last release: https://github.com/dependabot/dependabot-core/pull/8324

I also thought your token could be expired, but the https://registry.npmjs.org/@v-office%2Fprettier-config request is authenticating just fine, so that should not be it.

Are you still available to try again @mla-v-office?

ok:
not found:

Nice, then I think my change this time is going to fix it but let's make sure. Can you try again?

yes, just let me know when to do it

yes, that did the trick. thank you very much :)

Ok, great, I'd still need you to try one more version. I'd like to keep HEAD requests if possible, so I'll remove that from my PR and ask you to recheck?

okay

Ok, can you try one last time now?

sure

still works. thank you 👍


soroban-cli install instructions are incomplete on Ubuntu 22.04

What version are you using?
I tried to use 0.8.0
What did you do?
I tried to install soroban cli using docs on Ubuntu 22.04 on amd64 platform.
Exact steps I followed:

I run cargo install --locked --version 0.8.0 soroban-cli. This failed with the following:

   Compiling proc-macro2 v1.0.56
error: linker `cc` not found
  |
  = note: No such file or directory (os error 2)

To work around the problem I install gcc using sudo apt-get install gcc
I retried cargo install --locked --version 0.8.0 soroban-cli. This time if failed with:

  running: "c++" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "-m64" "-Wall" "-Wextra" "-o" "/tmp/cargo-install6vzfsz/release/build/link-cplusplus-cb722335163fd5c9/out/ffae553e737ce720-dummy.o" "-c" "/tmp/cargo-install6vzfsz/release/build/link-cplusplus-cb722335163fd5c9/out/dummy.cc"

  --- stderr

  error occurred: Failed to find tool. Is `c++` installed?

To work around this I installed c++ using sudo apt install g++

What did you expect to see?
I expected install instructions to work on a vanilla Ubuntu 22.04 system.
What did you see instead?
I had to install two Ubuntu packages in order to install the CLI: gcc and g++

You should be able to use cargo-binstall, which would download a built binary.
First need to install cargo-binstall:
cargo install cargo-binstall

Or install cargo-binstall as they recommend:
curl -L --proto '=https' --tlsv1.2 -sSf https://raw.githubusercontent.com/cargo-bins/cargo-binstall/main/install-from-binstall-release.sh | bash

Then can install soroban-cli:
cargo binstall soroban-cli

@willemneal thank you for extra info. I have not tested this but if those commands work and avoids pulling build dependencies then I'd fully support switching official docs to them.

cargo bininstall soroban-cli will be added to the docs (as well as updating cargo install instructions to include gcc and g++) as part of this issue


🌐 Implement RegisterDigitalResource

Purpose
Implement the ExecuteMsg::RegisterDigitalResource message according to the current specification of the okp4-dataverse smart contract.

[ ] Consider the business rules and invariants required for data integrity, security and adherence to specification
[ ] Implement
[ ] Test

Will be achieved through #332


Update Composer dependencies (2021-09-04-00-07)

Visual regression test passed!
View the visual regression test report


Truncated output

When I was installing an app, I noticed the output being truncated as shown in the screenshot below (notice lines 1 and 4). As referenced in the Terminal window title, I'm using a window with dimensions 80x24 (default size) so I think this behaviour shouldn't be expected.
EDIT: Even after enlarging the window, the output stays the same.

Also happens when just downloading from homebrew, so the issue comes from there.


Questions on GenerativeModel() training process and its parameters.

I've learned from the tutorials that the parameters of GenerativeModel.train() method can be only  with L matrix from LFs and I didn't find that the golden label  Y parameters is necessary in  GenerativeModel.train().
But when I read the paper of "DataProgramming: Creating Large Training Sets, Quickly", I found that the model is trained to fit the joint distribution of (LFs, Y) ["Formula: (1) in this paper" ] by maximum likelihood estimation method, which means that the true label of Y is also needed while training.
So I am confused how is the model able to fit to the true distribution of golden label Y only with the L matrix and without Y.  And if I generate the L randomly (eg: np.random.randint(0, 5, 1000).reshape(100, 10) ( 5 categories, 10 LFs, 100 samples ) ) and only use this L to train the model,   what distribution the model is fitted with  in this case ?

@zegzag, you can refer to the paper "Snorkel: Rapid Training Data Creation with Weak Supervision" section 2.2.

The core operation of Snorkel is modeling and integrat-
ing the noisy signals provided by a set of labeling func- tions. Using the recently proposed approach of data pro- gramming [5, 38], we model the true class label for a data point as a latent variable in a probabilistic model. In

Closing this issue for now, feel free to reopen!


Api and/or data handling - redux store

Process for api fetching and handling see (https://github.com/hackoregon/emergency-response-frontend/tree/redux-setup) for example.
Or do we work off of static json file? (would need to be updated manually with new json file if data it updated)

Added in PR #15


[#3865] Add setting for default skills.

Adds a setting for skills that appear on NPC sheets regardless of level of proficiency.
Using a DataField for the setting, so requires v12.

(also, comment on the original issue so I can assign it to you)


4.0.0-RC: about flowtypes

I'm using immutable.js 4.0.0-rc.2 with flowtype 0.40.0 (installed by yarn). I read the docs:

Installing immutable via npm brings with it type definitions for Flow (v0.39.0 or higher) and TypeScript (v2.1.0 or higher), so you shouldn't need to do anything at all!

but my following code doesn't work with flowtype:
const initialState = Immutable.fromJS({
  selected: 'US',
});

initialState.set('selected', 'UK');

$ flow

 10: initialState.set('selected', 'UK');
     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ call of method `set`. Method cannot be called on
 10: initialState.set('selected', 'UK');
     ^^^^^^^^^^^^ mixed

How should I add the type to initialState?

@xareelee As it is returning mixed type, we must check for the type of return value or add typeof
if (typeof initialState === 'object') { // not a very good solution but works
  initialState.set('selected', 'UK)
}

Better way would be to import types
import type { Map } from 'immutable'
const initialState : Map = Immutable.fromJS({ selected: 'US' })
initialState.set('selected', 'UK')

Let me know if it helps

@anilreddykatta thanks for your reply.
What if I have a specific structure of state:
// exact type
type State = {|
  default?: string,
  selected: string,
  list?: Array<number>
|}

const state: State = {
  selected: 'yes'
}

// What is the type of immutableState?
const immutableState = Immutable.fromJS({
  selected: 'US'
})

What is the type of immutableState?
Is that possible to check whether the key is valid for the type when using set or get? For example:
immutableState.set('selected', 'UK') // Good

immutableState.set('selected', 101) // Error! The value type doesn't match the type `State`. It should be a string type.
immutableState.set('select', 'UK') // Error! The key `select` doesn't match the type `State`.

@xareelee You are talking about two different objects here.
const state: State = { // Plain JS object with flow definition
  selected: 'yes'
}

const immutableState = Immutable.fromJS({ // This will be immutable Map
  selected: 'US'
})

But if I understand your question correct. Do you want to define specific structure for the immutable Map itself? Whenever you initialize immutable Map, List, etc.  you will get flow types defined for them. I don't think currently defining structure how immutable should handle types.
In my opinion, it goes one-way library authors (in this case immutable) defines what are the expected input types and return types of any particular function. I don't currently see a way we can do this.
I would love to know if you find solution for this 😄

@anilreddykatta Thank you for paying attention on this issue.
My goal is simple: I'm trying to use Redux with Immutable.js and Flowtypes in the best practice way.
I want to use Immutable objects for the state of Redux, and add the types to check the code when accessing the immutable objects.
// Define the exact type for the state.
type State = {|
  default?: string,
  selected: string,
  list?: Array<number>
|}

// Q1: What is the type of immutableState?
const immutableState = Immutable.fromJS({
  selected: 'US'
})

// Q2: How to check the accessor keys and values with flowtypes
immutableState.set('selected', 'UK') // Good
immutableState.set('selected', 101) // Error! The value type doesn't match the type `State`. It should be a string type.
immutableState.set('select', 'UK') // Error! The key `select` doesn't match the type `State`.

I want to check the types when accessing immutable objects.
If it can't, I want to know how to leverage flowtypes with immutable objects.

@xareelee Sounds interesting! I will update you

@xareelee I read a lot that you just can't using Map. You have to use Record. But I couldnt find any clear examples so far

Even Immutable.Records are not able to be typed really well, it seems. I ended up creating the flow-immutable-models library to try to get the best of immutable and typed data structures in our redux applications. So far, it's been a pretty good mix, although it definitely has its tradeoffs. @xareelee, if you're up for it, I'd love to get some more feedback on this approach and curious if it works well for your use case.

@pbomb Actually, I'm going to give up using Immutable.js. Flowtype provides covariant properties for the immutable state, and I'd like to try it.

@pbomb Actually, I'm going to give up using Immutable.js. Flowtype provides covariant properties for the immutable state, and I'd like to try it.

Same here. $ReadOnlyArray<>, covariant properties and deep-freeze does the job.
Shame that Immutable.js is not an option.

As of 4.0.0-rc.3, the RecordInstance type is available and seems to resolve much of the Record type-checking pain of the past: https://github.com/facebook/immutable-js/pull/1276#issuecomment-320791436

Record typing in the latest release is now dramatically better thanks to the new RecordOf<T> flow type.
(I'm also a fan of using covariant flow object types!)
fromJS() isn't well typeable, which is why it looks to you to cast to something more useful. I suggest using the List() and Map() constructors directly to get excellent flow types


Support screen orientation - Help Wanted

Description
In our app, we support all orientations. Using the example app, when we rotate the device, the video in the local track does not rotate as well in the remote participant. How do we support orientation without scenes?
[Description of the issue]
Steps to Reproduce

Run the example app with orientation enabled

Video iOS SDK
3.4.0 Twilio SDK
Xcode
Xcode 11.5 * updated after comment
iOS Version
iOS 13
iOS Device
All devices

Hey @Ankish,

In our app, we support all orientations. Using the example app, when we rotate the device, the video in the local track does not rotate as well in the remote participant. How do we support orientation without scenes?

Tracking should be automatic as long as your app is not using UIScene. If you use UIScene you need to tell us which scene to track (like the QS example does). I see a couple of issues:

The 3.x Video SDK requires Xcode 11, but it looks like you are using Xcode 10. The QS is not going to function properly for rotations if you do this... Try upgrading to Xcode 11 which supports the iOS 13 SDK.

If you aren't using UIScene then you need to remove the Scene tracking configuration from TVICameraSource. Maybe this was never being set since you used Xcode 10?

https://github.com/twilio/video-quickstart-ios/blob/master/VideoQuickStart/ViewController.swift#L216
Let me know if you're able to get it working.
Best,
Chris

Worked ! Thanks a ton for quick response.


Update Data Slice Generator Guide

The data slice generator guide needs to be updated to reflect the latest changes.

Fixed by #162


MINOR: remove streams config params from producer/consumer configs

Removing streams' specific config params from producer/consumer configs to reduce warning messages.

LGTM. Filed separate JIRA for transient failure. Merged to trunk.


Can flutter provide tools to support the diagnosis of 'ANR' ?

We know that all Dart code run on The UI task.Performing time-consuming operations in the dart code can cause the flutter app to become unresponsive for a long time.How I detect and diagnose this problem?

Not sure what you mean by detect and diagnose.
Perhaps

https://flutter.io/debugging/#dart-observatory-statement-level-single-stepping-debugger-and-profiler
https://flutter.io/ui-performance/

You can also move code to a different thread using Isolate or the convenience method to do so https://docs.flutter.io/flutter/foundation/compute.html
but currently such code can't access plugins. This would need to be delegated to the UI thread.

Without additional information, we are unfortunately not sure how to resolve this issue. We are therefore reluctantly going to close this bug for now. Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.


Question

Hello,
First thanks for your repo.
Are you planning to add support for custom models?

same question 😊
For Android, for example, I believe we need to add this code and expose some parameters for the Model
https://firebase.google.com/docs/ml-kit/android/use-custom-models?authuser=0#make_models_available_locally


Issues with GraphCast Training – Request for Assistance

Dear Professor,
I hope this message finds you well.
I am a postgraduate student and a beginner in deep learning. I have read your article on GraphCast and would like to retrain a GraphCast model based on your source code. I have provided a portion of my code below:

Setting model_config and task_config, along with train_steps and eval_steps.

Here is the main training loop, modified based on the source code provided in the article (I am unsure if it's correct), training for 10 epochs.

The loss and gradients for the 10 training iterations are as follows:

I have encountered several issues during training and would like to seek your guidance:

How are the steps of the dataset divided during training? If training is done in single steps, the first round inputs three time steps, with data from two time steps used for training and one time step for evaluation. For the second round of training, is the training data re-input each time? In other words, should the entire dataset be divided and read in before training, or should it be read in batches?
Regarding the training process implemented in my code, I feel that the training process is not truly effective. Despite using random initialization, the loss and gradients computed in the first round are already very low. Additionally, after 10 rounds of training, the values of loss and gradients have not significantly changed. Could you please provide some guidance on this point?
Concerning the use of the autoregressive.py file during training, I understand that it is used for single-step prediction, but I am unclear on how to use it in training. If you could provide a simple example for training, it would be greatly appreciated.

I look forward to your response. Thank you.
Best regards！

Hello, I have some questions about model training. Have you tried training models with different resolutions, GraphCast_small (13levels, 1°) and GraphCast (37levels, 0.25°)? How much time and memory does it take to train these two models?
I look forward to your response. Thank you.
Best regards！

@zhongmengyi I have replied in your separate issue https://github.com/google-deepmind/graphcast/issues/77

I have encountered several issues during training and would like to seek your guidance:

@zlminmin unfortunately we cannot really provide much support for training as optimal training is a bit tied to internal infrastructure and so the scope for this initial open sourcing was mainly focused on supporting inference. But let me try to answer your questions.

Exactly for the first step of training on 1 autoregressive steps we sample trajectories with 3 steps and call "data_utils.extract_inputs_targets_forcings" on those. And then we increase that sequence length by one, every time we want to increase the length of the training target.

Unfortunately I cannot comment on how fast it should go down, however I have noticed that your train function does not actually return the new params to be used by the next iteration, so parhaps that is the issue.

During training you simply feed targets and forcings that have more than one future step on them, and call the loss method.


pachtl put_file pfs folder specification

What is the goal / desired outcome?
pachtl put_file allows you to upload a single file with a new name on pfs via
pachctl put file <repo>@<branch>:<arbirary/path/to/file/on/pfs> -f /local/path/file/that/doesnt/match/pfs/path

however when uploading multiple files via -r or an input-file
pachctl put file <repo>@<branch>:<pfs/path>  -r -f /local/directory/

there is no option for specifying a custom pfs path for the individual files in the directory, e.g. if i'd like to upload local files in
/local/folder/a.txt
/local/folder/b.txt

to
/pfs/folder/a.txt
/pfs/folder/b.txt

there is no way to to do so without uploading the files individually or ensuring the local directory matches the desired pfs directory.
If there is a way to accomplish this today via workaround, what does that require?
May be possible to upload to pfs directory, then use pachtl copy file to move it into desired location.  Haven't verified this though.
possible solution
allowing input_file to specify the local file to be uploaded and the desired pfs path via a comma separated list like
[
[local/folder/a.txt, pfs/folder/a.txt],
[local/folder/b.txt, pfs/folder/b.txt]
]

That's exactly the sort of functionality I was looking for.  I see now that this approach is listed as an example in the docs.  Thanks for the help!


Add user_activity_data report on Exercise visit

Log when the users visit the exercises (scheduled) and log if they had a notification being shown or not.
This will help us track how users use Scheduled Exercises VS Word Review. Currently this information can only be deduced from the data, since we are logging when the users use Words review.

This was added via the frontend:

https://github.com/zeeguu/web/pull/669
https://github.com/zeeguu/web/pull/670


Another experimental feature warning with perl 5.20

This one's new to me ('cause I don't use push to a reference anywhere), but when the tests run with perl5.20:
2015/08/27 09:45:22 push on reference is experimental at /var/tmp/venn-core-1.0.0-build011-build/x86-64.rhel.7/5.20/source/core-1.0.0/t/../lib/Venn/PlacementEngine.pm line 196.
I'll look for a similar 'no warnings' line that can shut this one up, unless you want to drop the use of the syntax.   I don't know the history here (yet), but I suspect it's similar to the fate of smartmatch.

Interesting discussion about it at:
http://stackoverflow.com/questions/31466854/perl-experimental-features-and-perldoc
And as this commit shows:
http://perl5.git.perl.org/perl.git/commit/262309092c2de925e7ae4a527174f8dc2a0ec7b7
It's about to go away, so in order to future proof the code, the use of this feature needs to be dropped.  Patch to follow shortly....

Addressed by #17


MSC2334 - Change default room version to v5

Rendered: https://github.com/aaronraimist/matrix-doc/blob/MSC2333-default-room-version-v5/proposals/2334-default-room-version-v5.md
Synapse issue: https://github.com/matrix-org/synapse/issues/6165
Synapse implementation: https://github.com/matrix-org/synapse/pull/6220

thanks!
This is fairly straightforward and is in fact the plan we agreed upon before, so:
@mscbot fcp merge

Spec PR: https://github.com/matrix-org/matrix-doc/pull/2347

Merged 🎉


Tests of executable modules don't compile.

CMake is breaking the yotta test paradigm in binary modules.
CMake Error at test/CMakeLists.txt:16 (target_link_libraries):
  Target "foo" of type EXECUTABLE may not be linked into
  another target.  One may link only to STATIC or SHARED libraries, or to
  executables with the ENABLE_EXPORTS property set.

It would be nice to be able to use yotta test against a binary module.

Unless it has undesirable side-effects, the fix for this is probably to set ENABLE_EXPORTS on yotta-defined executables.

This is done at https://github.com/autopulated/yotta/tree/fix-239
Note, this does not enable you to run executable modules as tests (through a testReporter script, etc), and at the moment I don't think we should do that.

fixed  in fa066361af32939c5f8529dafb315d5f9737626d


[BUG] java.lang.IllegalAccessError opening modular workbench in 1.10.0-alpha.8

When attempting to open a modular workbench the game immediately crashes with an
java.lang.IllegalAccessError: Update to non-static final field io.github.cottonmc.cotton.gui.ValidatedSlot.field_7873 attempted from a different class (io.github.cottonmc.cotton.gui.ValidatedSlot) than the field's declaring class
at io.github.cottonmc.cotton.gui.ValidatedSlot.setVisible(ValidatedSlot.java:175) ~[LibGui-4.1.3+1.17.1.jar:?]
MC 1.17.1 & Fabric API 0.36.1+1.17
I tried both LibGUI 4.1.2 and 4.1.3 with the same result.
All details in attached log file
indrev-libgui-workbench-crash.log

I can't seem to reproduce this, can you test with just Industrial Revolution?

I tried with only Industrial Revolution and it's requirements, but still get the crash. Log attached.
indrev-libgui-workbench-crash2.log


Evaluate pilot phase and use the feedback to improve the survey

Feedback:

[ ] It was not clear which insititution/who defines the higher goal
[ ] The participants would like the survey to emphasize that the autonomy is undermined
[ ] Takes a lot of time
[ ] try to make the texts more concise


Can't download your img file

When I download your image file it says 0b can you give me another link please. the link I used was https://www.j1nx.nl/download/mycroftos-0-1-0-alpha8-rpi4-64bit/
Thanks

Here

is a picture of me using commandline to try and download the file

And this direct link?
https://j1nx.stackstorage.com/s/dUnc2C50fEv73La3

Sorry for the late reply.  But The link above is not working.  So I would
change your file storage to something like Google drive etc.
On Tue, Jul 28, 2020, 7:06 AM Peter Steenbergen<EMAIL_ADDRESS>wrote:

Closed #34 https://github.com/j1nx/MycroftOS/issues/34.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/j1nx/MycroftOS/issues/34#event-3594259229, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AISFZAEHR3676VYI52SQCALR53EN3ANCNFSM4PGCFQRA
.

https://drive.google.com/file/d/1So5knzMwUtrqnjUE2iJAgt5yS9nhJ1ME/view?usp=sharing
Give it a try.

Thanks that works for me😄!
On Wed, Jul 29, 2020, 2:00 AM Peter Steenbergen<EMAIL_ADDRESS>wrote:

https://drive.google.com/file/d/1So5knzMwUtrqnjUE2iJAgt5yS9nhJ1ME/view?usp=sharing
Give it a try.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/j1nx/MycroftOS/issues/34#issuecomment-665502742, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AISFZAGHUQD5MGWR32ZYR3TR57JI3ANCNFSM4PGCFQRA
.


Raise ConnectionError when writing to socket fails

Writing to the TCP socket can also fail with various exceptions, just like when opening or reading from it. For example, it happened to me that an Errno::EPIPE exceptions was raised during file upload, presumably because the server closed the connection early.
In order to be consistent with re-raising low-level exceptions as HTTP::ConnectionError when opening or reading from the TCP socket, we also add the same behaviour when writing to the socket.
Closes #430

Thank you!

If only I ever finished up the socketry branch...
https://github.com/socketry/socketry/blob/master/lib/socketry/tcp/socket.rb#L301

@tarcieri Man, Socketry looks awesome. Yeah, I've noticed that open pull request for replacing the direct socket communication with Socketry.
Btw, shouldn't in this case Socketry re-raise other SystemCallException as Socketry::Error exceptions (in addition to IOError)?

@janko-m good call, want to submit a PR to Socketry? 😄


Dynamic M Query Parameters with Analyze in Excel

Hi,
This feature is not working when accessing the dataset in Excel. Maybe to add a note about it on the considerations and limitations.
https://community.powerbi.com/t5/Issues/Dynamic-M-query-parameters-doesn-t-work-in-analyze-in-excel/idi-p/2009990

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: dc66475d-11b3-ba33-cde4-9948dc07ea2c
Version Independent ID: 46aeb704-a74f-2064-307f-24660579ef4c
Content: Dynamic M query parameters in Power BI Desktop - Power BI
Content Source: powerbi-docs/connect-data/desktop-dynamic-m-query-parameters.md
Service: powerbi
Sub-service: pbi-data-sources
GitHub Login: @davidiseminger
Microsoft Alias: davidi

Thanks for your comment, @LoisLoriot. This issue has been assigned to the doc author for review.

Hi @davidiseminger, @bishalgoswami, any update on this please ?

Thanks for your input, I've added a note about this limitation.


Timeout on conf

It is always constant the timeout, so it doesn't make sense to send it as command line argument, but rather set it on the augmented.properties


Cannot programmatically open detached autocomplete if openOnFocus is false

Description
The autocomplete does not open when calling api.setIsOpen(true) if detachedMediaQuery = "" and openOnFocus = false.
Reproduction
https://codesandbox.io/s/magical-tree-499cg?file=/app.tsx
Steps

Go to the codesandbox linked above
Click on the 'open autocomplete' button I added (around line 130 in app.tsx)
The autocomplete will flicker open for a split second, and then close.

Expected behavior
The autocomplete should open when calling api.setIsOpen(true);.
Environment

OS: Windows
Browser: Chrome
Autocomplete version: 1.5.1

In DocSearch the modal renders only when it's explicitly opened:
https://github.com/algolia/docsearch/blob/10c5b2ea145c633b8bc5d0b3686458b08ea0b80d/packages/docsearch-react/src/useDocSearchKeyboardEvents.ts#L42
https://github.com/algolia/docsearch/blob/80677fd7d36a85b6a205383a7ca3d68969fbe3bf/packages/docsearch-react/src/DocSearch.tsx#L70-L98
I'm not saying that's per se the best solution, and what you're describing here does seem like a bug, I'd just like to offer a different workflow that avoids this issue

It does look like a bug. The problem persists in 1.5.0 so it doesn't look like a regression introduced in 1.5.1.
I will investigate.

I've looked into it, this is indeed a bug. Here's what happens:

When calling setIsOpen(true), the next state is computed with isOpen=true, which opens the search modal.
When the modal opens, the search input inside it gets automatically focused (internal behavior set here).
This focus event triggers a call to onFocus, which triggers a state update. Because of this condition, the next isOpen state is false when onFocus=false.

This is why you might briefly see the modal opening then closing—the modal is opening as requested, but the side-effects of focusing the input closes it. You can observe a similar behavior on mobile when openOnFocus=false and detached mode isn't disabled.
The behavior of the state reducer is likely correct, this issue should be fixed in at the detached mode level, in autocomplete-js.
Note that "just" removing this internal focus behavior, or making it depend on autoFocus isn't the answer: even without focusing on open, clicking the input after the modal has opened would trigger the same behavior. We might want to override the flow when we're in detached mode only.

@Haroenv The DocSearch example uses autocomplete-core and fully controls the UI. In this case, autocomplete-js is at fault and isn't user-controlled, so I'm afraid this can't be circumvented that way.
@cmfcmf What's your use case for setting openOnFocus to false? Are you trying to avoid an empty query? There might be a way to work around the problem until we get this fixed.
For example, if the goal is to avoid an empty query, you can add a check before returning sources:
https://codesandbox.io/s/charming-jasper-4o1ix?file=/app.tsx:993-1049

I’ve just run into this. In my case I’m aiming not to have an inline search field, just a button that opens up the detached search view with the field selected (on desktop and mobile). It’s not a huge problem to enable openOnFocus but it does mean that on init the search UI includes some messy white space where the empty panel sits.
openOnFocus: true

openOnFocus: false

@domstubbs Yes, this is a problem because in this scenario, setIsOpen opens both the modal and the panel. You can fix this in the meantime with some CSS:
.aa-PanelLayout:empty {
  display: none;
}

@sarahdayan I did implement a CSS workaround but yours is neater. Thanks!

@cmfcmf What's your use case for setting openOnFocus to false? Are you trying to avoid an empty query? There might be a way to work around the problem until we get this fixed.

I didn't remember initially, but I think it was mainly for the reason @domstubbs brought up.

I believe we have a similar issue and @sarahdayan we would appreciate your advice on it!
We have a button which opens the detached modal by using setIsOpen(true) and openOnFocus is set to true, but when the user clicks on the input to open the keyboard the detached modal is being closed. So I assume that the state is being refreshed and isOpen is evaluated to false again. The issue happens only on iOS.
Could you please advise is there any workaround about this problem? Thanks!

Hey @atanasStoyanov, could you share a minimal reproduction so we can debug?
You can use this starter template to help you get started.

Hey @sarahdayan thanks for your willingness to help. We found that the issue comes from our implementation. Long story short the component has been re-rendered too many times because of scroll event listener and that was causing the detached modal being re-rendered as well and respectively closed. Once we prevented those re-renders it got fixed and now works properly. Thank you!

@domstubbs Yes, this is a problem because in this scenario, setIsOpen opens both the modal and the panel. You can fix this in the meantime with some CSS:
.aa-PanelLayout:empty {
  display: none;
}

What's a CSS solution, if I have and need noResults template? It's showing up initially and I can't use :empty in that case.


Errorr install the canasta with CLI

I am running on Linux debian11 5.10.0-19-amd64
When I run the sudo canasta create -i canastaId -n example.com -w Canasta Wiki -a admin -o docker-compose, it has the below error message:
debian@debian11:~$ sudo canasta create -i canastaId -n example.com -w Canasta Wiki -a admin -o docker-compose
2022/11/03 11:33:56 error statting /root/.config/canasta (stat /root/.config/canasta: no such file or directory)
Enter the admin password (Press Enter to autogenerate the password):
Setting up Canasta
Any idea what is when wrong during the installation process ?

Thanks for the bug report. This is a known issue, but it would belong in https://github.com/CanastaWiki/Canasta-CLI


Next/previous navigation in history view

It would be nice to have next/previous buttons to jump between revisions in the history view.
Also document how to reach the history view.

Can you add the screenshot of it? Which history?

How do you want to implement this?

hey @davisagli can you please elaborate about your issue and where you want the buttons

@davisagli I edited your issue description. Evidently newcomers don't know how to reach the history view or read the Volto Release Notes for v16.0.0, and I had to scan the code to find it.
Even then, it appears on the Plone demo's history view for a given page does not do much, other than display a table of publication history. I can't view a diff or any details of what actually changed. I think that hidden detail history view is what you want to have next/previous on, correct?

@stevepiercy There's a ... menu for each revision, off screen to the right in your screenshot, which lets you view the diff. Yeah, that's where it'd be handy to have an easier way to go forward/back without returning to the listing.

@davisagli I don't see the stoplight icon anywhere. Does a site setting need to be enabled?

Sample HTML from a typical row in the table:

    Create (undefined → Private)
    admin
    <time datetime="2023-07-06T21:35:21+00:00" title="Thursday, July 6, 2023 at 2:35 PM">7/6/2023</time>

Look at a row that is based on a CMFEditions revision created on save, not
a workflow transition.
On Mon, Mar 18, 2024 at 4:25 PM Steve Piercy @.***>
wrote:

@davisagli https://github.com/davisagli I don't see the stoplight icon
anywhere. Does a site setting need to be enabled?
Screenshot.2024-03-18.at.4.21.19.PM.png (view on web)
https://github.com/plone/volto/assets/102112/26cf3a99-981a-42c5-ab5e-476bdcc5ac29
Sample HTML from a typical row in the table:

Create (undefined → Private)
admin
7/6/2023

—
Reply to this email directly, view it on GitHub
https://github.com/plone/volto/issues/5723#issuecomment-2005286632, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAL65SVR6PX6NIOJELHLBDYY5ZXZAVCNFSM6AAAAABCTOYCESVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBVGI4DMNRTGI
.
You are receiving this because you were mentioned.Message ID:
@.***>

I added a text block. It does not show up in the history. Is that a "CMFEditions revision"?

@stevepiercy Those are all workflow transitions. I don't think you have versioning enabled for this content type.
As far as I know, the control panel to enable versioning for a content type is only available in the Classic UI so far. And I don't know if there is a way to access the Classic UI for demo.plone.org
Anyway, this is a really low priority feature suggestion and I'm not going to spend more time on it now.

Understood. At least now there is sufficient information in this issue so that a first-timer can pick it up and run with it. They'll need to install Plone and visit the backend to enable the history view for each content type, if it is not enabled by default.