Stuck in starting emailproxy with --no-gui

Hi Simon
having the standard mail problem with my cameras I tried to get your emailproxy running but go stuck:
Environment:
Raspberry (old)
OS: Bookworm
All updates made
python -m pip install -r requirements-core.txt
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Ignoring pyasyncore: markers 'python_version >= "3.12"' don't match your environment
Ignoring pyoslog: markers 'sys_platform == "darwin"' don't match your environment
Requirement already satisfied: cryptography>=2.2 in /home/gipsy58/.local/lib/python3.11/site-packages (from -r requirements-core.txt (line 6)) (43.0.1)
Requirement already satisfied: prompt_toolkit in /home/gipsy58/.local/lib/python3.11/site-packages (from -r requirements-core.txt (line 15)) (3.0.48)
Requirement already satisfied: pyjwt>=2.4 in /home/gipsy58/.local/lib/python3.11/site-packages (from -r requirements-core.txt (line 18)) (2.9.0)
Requirement already satisfied: cffi>=1.12 in /home/gipsy58/.local/lib/python3.11/site-packages (from cryptography>=2.2->-r requirements-core.txt (line 6)) (1.17.1)
Requirement already satisfied: wcwidth in /home/gipsy58/.local/lib/python3.11/site-packages (from prompt_toolkit->-r requirements-core.txt (line 15)) (0.2.13)
Requirement already satisfied: pycparser in /home/gipsy58/.local/lib/python3.11/site-packages (from cffi>=1.12->cryptography>=2.2->-r requirements-core.txt (line 6)) (2.22)
looks good to me.... but
python emailproxy.py --no-gui
Traceback (most recent call last):
File "/home/gipsy58/emailproxy/emailproxy.py", line 55, in
from cryptography.fernet import Fernet, MultiFernet, InvalidToken
File "/home/gipsy58/.local/lib/python3.11/site-packages/cryptography/fernet.py", line 14, in
from cryptography.exceptions import InvalidSignature
File "/home/gipsy58/.local/lib/python3.11/site-packages/cryptography/exceptions.py", line 9, in
from cryptography.hazmat.bindings._rust import exceptions as rust_exceptions
ImportError: libssl.so.1.1: cannot open shared object file: No such file or directory
Any help?
Thanks

This is an issue importing the Cryptography package, which is required by the proxy. It looks like your environment has a problem with LibSSL. This is something you'll need to resolve before the proxy will work, but is not anything caused by the proxy itself.


Dependency Check 6.5.3 does not report vulnerable version of dom4j-1.6.1

Describe the bug

Web application uses dom4j-1.6.1.jar
no suppression configured
nvdcve-1.1-2020.json is downloaded and contains CVE-2020-10683
scan using dependency check 6.5.3 does not report this vulnerability

Version of dependency-check used
The problem occurs using version 6.5.3 of the cli (cli, gradle plugin, maven plugin, etc.)
Also the problem could be reproduced using an older version 5.3.2 cli
Log file
When reporting errors, 99% of the time log file output is required. Please post the log file as a gist and provide a link in the new issue.
---- not there yet
To Reproduce
Steps to reproduce the behavior:

Create a folder to scan with dom4j-1.6.1.jar
execute dependency check sh via cli
check reporting
CVE-2020-10683 is not reported

Expected behavior
CVE-2020-10683 should be reported and dom4j-1.6.1.jar should be listed as vulnerable component
Additional context

In line with expectation, as the error is in the NIST NVD datastream, which lists only the 2.x version of dom4j affected as per NVD Listing

Configuration 1

cpe:2.3:a:dom4j_project:dom4j:*:*:*:*:*:*:*:*
From (including)2.0.0
Up to (excluding)2.0.3

cpe:2.3:a:dom4j_project:dom4j:*:*:*:*:*:*:*:*
From (including)2.1.0
Up to (excluding)2.1.3

I will send out notice to them that the 1.x range is also affected so that the affected software can be changed by them and DependencyCheck will correctly flag it as affected.

NIST has updated the NVD listing of the CVE. False negative should be resolved once the update has synced to their datastreams.


object api performance improvements case #5443

Hey @wouterv, did you check all tests pass?

Up to server they did, but there was something wrong in the server module
that seemed unrelated to me..
Op 9 dec. 2015 9:56 p.m. schreef "Luca Garulli"<EMAIL_ADDRESS>
Hey @wouterv https://github.com/wouterv, did you check all tests pass?
—
Reply to this email directly or view it on GitHub
https://github.com/orientechnologies/orientdb/pull/5444#issuecomment-163389385
.

@lvca I just did a clean checkout of the 2.1.x branch (without these changes) and the same failures occur, so the problem is probably not in my changes.

@lvca ok it looks like the server module just builds using travis, but if you look at the log, somehow the jvm got killed while running orient-tests, I tried to run from the orient-tests module locally with my changes (first did mvn -DskipTests clean install, then mvn clean install -rf :orient-tests), and it doesn't get killed, it builds fine.

Yes, Travis kills all the build with exec time >20mins. We're replacing it with CloudBee.

@lvca is there anything else you need for this pull request

Hi @wouterv,
This solution use static variable, will be cool if you can move this implementation in some instance linked to OEntityManager ?

@tglman I don't understand, the info stored is static, class information like fields and so on, why do you want to link it to an instance?

In some environment like inside an application server or an OSGI environment use static fields can bring to problems, we have some configuration for handle some of this cases for OSGI, so is better not introduce additional static variable and use the existent one, and anyway one of the responsibility of OEntityManager is to handle class definition.

I get the point about OSGi, I will make a rewrite using the OEntityManager.

@tglman Would using OObjectEntitySerializer.OObjectEntitySerializedSchema a good place to put the caches? Looks like it is already done like that for some other stuff.

@wouterv yes

@tglman @lvca created new pull request for this: #5462


Create codeql-analysis.yml

Why:
Closes [issue link]

What's being changed (if available, include any code snippets, screenshots, or gifs):

Check off the following:

[ ] I have reviewed my changes in staging (look for the "Automatically generated comment" and click the links in the "Preview" column to view your latest changes).
[x] For content changes, I have completed the self-review checklist.

Writer impact (This section is for GitHub staff members only):

[ ] This pull request impacts the contribution experience

[ ] I have added the 'writer impact' label
[ ] I have added a description and/or a video demo of the changes below (e.g. a "before and after video")

Thanks for opening this pull request! A GitHub docs team member should be by to give feedback soon. In the meantime, please check out the contributing guidelines.

I need some help please I’m not sure how to revert all this using the
GitHub desktop? I will be thankful if I can get a hand with this please
thank you..!
On Sat, Jul 16, 2022 at 5:06 PM github-actions[bot] <
@.***> wrote:

👋 Hey there spelunker. It looks like you've modified some files that we
can't accept as contributions. The complete list of files we can't accept
are:
.devcontainer/**
.github/actions-scripts/**
.github/workflows/**
.github/CODEOWNERS
assets/fonts/**
data/graphql/**
Dockerfile*
lib/graphql/**
lib/redirects/**
lib/rest/**
lib/webhooks/**
lib/search/indexes/**
package*.json
scripts/**
translations/**
content/actions/deployment/security-hardening-your-deployments/**
You'll need to revert all of the files you changed in that list using GitHub
Desktop
@.***/desktop/contributing-and-collaborating-using-github-desktop/managing-commits/reverting-a-commit>
or git checkout origin/main . Once you get those files
reverted, we can continue with the review process. [image: :octocat:]
—
Reply to this email directly, view it on GitHub
https://github.com/github/docs/pull/19059#issuecomment-1186304517, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AZ523NTFIZLF4P5RCRNUM5DVUMW7PANCNFSM53YWTDAA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>


Add CACHES Redis as alternative

It now uses django-environ, see https://github.com/django-oscar/django-oscar/blob/master/sandbox/settings.py#L43


F5 Telemetry to use latest api v2 for Datadog.

Is your feature request related to a problem? Please describe.
F5 case C3850281
Describe the solution you'd like
Datadog requests v2 api support with Telemetry.
Ticket that was opened with F5 support we are sending too much data and also logging shows that we are not supporting v2.
https://docs.datadoghq.com/api/latest/metrics/#submit-metrics

Tracking with TS-685. Thank you

Fix released on August version of TS


feat: add health probe

This adds basic health probe endpoint (using the controller-runtime
options) and exposes the port via the existing OBO service

@sthaha that's what I am working on :)

Since this is new feature, it would be nice to if it can be tested as well.

I suppose that if we add liveness/readiness probes to the OBO deployment, it will be tested automatically?

I suppose that if we add liveness/readiness probes to the OBO deployment, it will be tested automatically?

indeed! the operator in a ready state is a good test!


Spacing inconsistencies between header and titles

Originated from the UXD Team Feedback table:
https://docs.google.com/document/d/1_AhqX8rPaZ2mfO-cI4lkhGbJLKLTWpo4HcCJ_KRhDjM/edit#heading=h.bjkplule4p3l
Spacing between header and titles should be consistent across the flow

I believe this is related to https://github.com/integr8ly/tutorial-web-app/issues/222?

Fixed with PR #229


daemon: deprecate --endpoint-interface-name-prefix option

The option doesn't have any effect since commit 8a039e9e1c39 ("iptables:
Don't match device on egress proxy rules"). Mark it as deprecated and
remove it for 1.13.

 Marking as ready to merge.


AMBARI-23257. Address stack changes to create apps and user directories

Create files/dirs in all nameservices as advised by HDFS team.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/1180/
Test FAILed.
Test FAILured.

retest this please

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/1183/
Test FAILed.
Test FAILured.

retest this please

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/1192/
Test PASSed.


Error during installation, React 17

I'm submitting a...

[ ] Regression (a behavior that used to work and stopped working in a new release)
[x] Bug report
[ ] Performance issue
[ ] Feature request
[ ] Documentation issue or request
[ ] Other...  ERESOLVE unable to resolve dependency tree npm ERR! npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/react npm ERR!   peer react@"*" from<EMAIL_ADDRESS>npm ERR!   node_modules/@testing-library/react npm ERR<EMAIL_ADDRESS>from the root project npm ERR!   peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!   node_modules/react-dom npm ERR!     peer react-dom@"*" from<EMAIL_ADDRESS>npm ERR!     node_modules/@testing-library/react npm ERR<EMAIL_ADDRESS>from the root project npm ERR<EMAIL_ADDRESS>from the root project npm ERR!     1 more (@minoru/react-dnd-treeview) npm ERR!   5 more (react-scripts, recoil, the root project, ...) npm ERR! npm ERR! Could not resolve dependency: npm ERR! peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR! node_modules/react-dnd-multi-backend/node_modules/react-dnd-preview npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!   node_modules/react-dnd-multi-backend npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!     node_modules/@minoru/react-dnd-treeview npm ERR!       @minoru/react-dnd-treeview@"*" from the root project npm ERR! npm ERR! Fix the upstream dependency conflict, or retry npm ERR! this command with --force, or --legacy-peer-deps npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
Full report:
eresolve-report.txt
Environment

Libs:
- react version: 17.0.2

For Tooling issues:
- Node version: 16.5.0
- NPM version: 7.20.2
- Platform:  Windows

@Nerevar123 Thanks for the error report!
I checked it in npm version you reported and found the error on my environment as well, so I fixed the dependency.
I've just published it as v1.5.4, so please try again.
npm install @minoru/react-dnd-treeview

Now it works, thank you


Can't install this package for Laravel 5.3

hi,
this is my command 👍
composer require "vsch/laravel-translation-manager:~2.3"

You are running composer with xdebug enabled. This has a major impact on runtime performance. See https://getcomposer.org/xdebug
./composer.json has been updated
Loading composer repositories with package information
Updating dependencies (including require-dev)
Your requirements could not be resolved to an installable set of packages.

  Problem 1
    - Installation request for vsch/laravel-translation-manager ~2.3 -> satisfiable by vsch/laravel-translation-manager[2.3.1].
    - Conclusion: remove symfony/finder v3.1.4
    - Conclusion: don't install symfony/finder v3.1.4
    - vsch/laravel-translation-manager 2.3.1 requires symfony/finder 3.0.* -> satisfiable by symfony/finder[v3.0.0, v3.0.1, v3.0.2, v3.0.3, v3.0.4, v3.0.5, v3.0.6, v3.0.7, v3.0.8, v3.0.9].
    - Can only install one of: symfony/finder[v3.0.0, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.1, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.2, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.3, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.4, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.5, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.6, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.7, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.8, v3.1.4].
    - Can only install one of: symfony/finder[v3.0.9, v3.1.4].
    - Installation request for symfony/finder (locked at v3.1.4) -> satisfiable by symfony/finder[v3.1.4].

Installation failed, reverting ./composer.json to its original content.

Thanks for your help !

@vince749, thanks for the catch. I missed a few dependencies in composer.json.
Dependencies updaed to laravel 5.3 versions and released a new version.

Good job ! Thanks !


增加获取url和header授权签名方法

最近公司的项目有个获取sign的需求，于是自己根据文档和auth源码做了下，包括获取url的sign和header两种方式的sign，方便前端直接在http header或url中直接提交请求资源

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Coverage decreased (-51.6%) to 39.545% when pulling f9c059971a1200a59456d97c3b8905ff798e53f0 on Anteoy:master into ef36e0f00cc978c753b90b87b15637d18399b960 on aliyun:master.

1.5.0支持该功能，谢谢您的共享。


Standardise on starting the y-axis from zero

This reduces the surprise factor of this library by ensuring that the y-axis on both line and XY
charts starts from zero to match that of bar charts.
This shows no visible change on the current example line/XY graphs because they all have values very close to zero already. If you think it would be beneficial to have an additional example to show this say and I will add one.
This will change the behaviour of existing line/XY graphs and so do say if you would prefer that this was a configuration option and I can extend it to be.
Finally this will not play well with having y values which are less than zero. None of your examples show this so I am not sure how much this is an issue. Do let me know if you want this covered.

Is there anything else you want with respect to this PR?

Hi, @mocoso Thanks for the PR, but I am a little busy building other stuff, will try and merge this PR ASAP when I got free time

@timqian I understand. Please don't feel there is any pressure to merge this there is no urgency

Closing because it is over a year old


Add ReadyToRun Flags to Module and Method Events

@AndyAyersMS added new ReadyToRun flags to the module and method events that will allow us to understand if a module is a ReadyToRun module and if a method was JIT-compiled because its ReadyToRun code was rejected.  These were implemented in https://github.com/dotnet/coreclr/pull/15801.
This PR adds these flags to the appropriate flags enums so that they are resolved in the Events view.
I've also added a few more flags in this PR to match the values present in CoreCLR.

Brian I have not checked, but I suspect that the testing failed because there are events that set some of the bits you just defined, and thus some of the 'events' lines now have symbolic names when they did not before.
You just need to copy the new baselines (run the tests locally and they should fail, and then follow the directions in the failure message to copy the new baseline).
Including these baseline updates should fix things.

You are correct - just pushed a fix for these.


High CPU usage with Spigot

Apparently, if stdin is disconnected (when it is service mode) Spigot will up CPU usage to 100%. Adding the --noconsole to the jar run options should fix it.
https://www.spigotmc.org/threads/high-cpu-usage-solved.87634/page-2

I can open a PR to fix this, but I think it breaks docker attach usage.

Hi, I added an option to disable the console. Let's hope it will fix the issue
docker run -d -e NOCONSOLE=true


Add to Porn List

Hello @StevenBlack and @Sinfonietta,
Here is an additional list of porn sites to be added to the filter:
Fapdungeon.com
packsvids.com
sinsofteens.com
booru.plus
https://vipreddit.blogspot.com/?m=1
Mangatoto.com
https://oldfashionbootyblog.blogspot.com/?m=1
exposedtostrangers.com
javsky.tv
xxx-sexhub.com
porngirlhd.net
world18hd.com
https://nerdyslutsch.blogspot.com/?m=0
3movs.com
hotxteens.net
videohd18.com
hentaicom.com
Thank you for your continued work on this list!

Thank you for this @g1t3m.
Here you provide 17 domains, didn't bother to clean up the protocol or the path and query parameters, thus creating work.  I cleaned that up only to find, we already carry 7 of those 17 domains.
Please don't post minimum-effort, zero-check, drive-by issues here.  We have contributing repositories that specialize in listing porn.  Please submit there.
Closing.


What about tests in the framework?

I just discover this framework and its look Awesome, but what about testing?

Hi @NetanelBasal !
@thetutlage is currently working on this.
If you don't want to wait for it, you can use Zombie.js to do acceptance/integration testing and Mocha (or whatever you want) for unit testing.
Here's an example application which is tested that you can take a look.
You may also want to take a look at this issue: Best practice for writing tests

Cool, Thanks!


fix dim issue of next_token_logits in sample, or else logits_processo…

…r has issue if repetition_penalty is used
Fixes # (issue)
it will core dump if set following in text generation example
generation_config.do_sample=True
generation_config.repetition_penalty=0.75
coredump trace like
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/work/chatbot/inference/generate.py", line 529, in generate_output
return model.generate(
File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/work/optimum-habana/optimum/habana/transformers/generation/utils.py", line 627, in generate
return self.sample(
File "/work/optimum-habana/optimum/habana/transformers/generation/utils.py", line 1531, in sample
streamer.put(next_tokens.cpu())
RuntimeError: [Rank:0] FATAL ERROR :: MODULE:PT_BRIDGE syn compile encountered : Graph compile failed. 26 compile time 55892013 ns

@regisss @yao-matrix please have a review.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@sywangyi You should have received an invitation to join the collaborators of this repo. That way you'll be able to push branches directly here and the whole CI will be enabled in your PRs :slightly_smiling_face:


Looks great

Hey. This looks awesome.
I am adding this to my vault, do you have documentation how you configure the plugins? If not, then I can submit a pr with documentation for that :)

Wondering if you can commit a vault with the plugin configs? Then I can replicate and document.

I think I have the config for dataview and customJS, but the QuickAdd is a bit harder :) Would really appreciate it if you can share how that is set up.

Same, found out all configs, but buttons seem not to work, would appreciate if you could show us how it works :)
This gym log is exactly what I was looking for!

I understand that the quickadd config is a bit tricky. Promise to provide the needed info as soon as I find the time! Hopefully in the beginning of next week.

I've updated the Readme to include instructions on how QuickAdd is configured. I've also commited the .obsidian folder containing the configurations files for the vault, so it should contain everything needed to work now.
Do you need anything more to get it working on your end?

I will try it out tomorrow :) Thanks!

It works now and looks like all the settings synced as well.
Looking forward to try it out ! Thanks!


Go ApiView omits most of azcore

For example, this is what I get from b3f0e107 (tip of main at time of writing): https://apiview.dev/Assemblies/Review/7c4c805bac53407dbc59492e237ac893

Spent some time investigating this. One problem, maybe the problem, is that apiviewgo includes only exported type declarations in its output. It excludes internal types we export with aliases. For example:
package azcore

import "github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared"

type AccessToken = shared.AccessToken

AccessToken is a selector expression in the AST, not a type declaration, so apiviewgo overlooks it. I don't see a quick fix. I suppose a solution would look something like

stop trimming non-exported nodes in loadPackage(), because we don't yet know which types are exported by an alias
while traversing the AST, track which internal types are referenced by exported selector expressions
add those internal types and their methods to the output

Probably several gotchas in there e.g., given the above example, would we need to do some trickery to document the type as azcore.AccessToken instead of internal/shared.AccessToken?


Add LG telemetry

ref： #2783
add LG telemetry client.

I found IBotTelemetryClient would be obsolete in this pr #3440.
Should this PR wait for the above PR and use the new class LogTelemetryClient?

@Danieladu yes, this should follow what @garypretty  is doing for all up telemetry/ adaptive telemetry. @garypretty can you please add relevant PR #s to this for reference?

We are just finalising the details of the other PR today. Once we have done that I'll reflect here.

@Danieladu @vishwacsena IBotTelemetryClient will now remain. The decision has been taken to extend this interface.

@garypretty can you take a look and approve if this is in line with your changes to instrument adaptive dialogs?

This is the adaptive PR https://github.com/microsoft/botbuilder-dotnet/pull/3491/files

We should just leverage the same telemetry client inside action (IDialog) and log the generation behavior in dialog level, and leave LG alone for now


Content Corrections

Why: Some syntactical corrections have been made.
Closes:

What's being changed (if available, include any code snippets, screenshots, or gifs):

Check off the following:

[x] I have reviewed my changes in staging, available via the View deployment link in this PR's timeline (this link will be available after opening the PR).

For content changes, you will also see an automatically generated comment with links directly to pages you've modified. The comment won't appear if your PR only edits files in the data directory.

[x] For content changes, I have completed the self-review checklist.

@SumaiyaTarannumNoor Thanks so much for opening a PR with this fix! I'll update the branch and get this merged once tests are passing 🍏

@nguyenalex836 Thank you so much. 😊😊

@SumaiyaTarannumNoor We appreciate your contributions! 💛


Actual size of the volume is bigger than max size

Hi,
I discover that one of my volume is bigger that the size maximum size allowed. Is this normal ?
What can i do about it ? How is this even possible ?
Here some informations :
State: attached
Health:No node redundancy: all the healthy replicas are running on the same node healthy
Frontend:Block Device
Attached Node & Endpoint :
node01
/dev/longhorn/pvc-77d0fdfc0ab611e9
Size:8 Gi
Actual Size:37.6 Gi
Base Image:
Engine Image:rancher/longhorn-engine:v0.5.0
Created:9 months ago
Last Backup:
Last Backup At:
Namespace:prometheus
PVC Name:prometheus-server
PV Name:pvc-77d0fdfc0ab611e9
PV Status:Bound
Pod Name:prometheus-server-74b4655c7d-8x8jp
Pod Status:Running
Workload Name:prometheus-server-74b4655c7d
Workload Type:ReplicaSet

root@node01:/var/lib/rancher/longhorn/replicas# ls -l | grep pvc-77d0fdfc0ab611e9
drwxr-xr-x 2 root root 4096 Oct  1 03:15 pvc-77d0fdfc0ab611e9-4121b00b
drwxr-xr-x 2 root root 4096 Oct  1 03:26 pvc-77d0fdfc0ab611e9-cd981b3e
drwxr-xr-x 2 root root 4096 Oct  1 03:15 pvc-77d0fdfc0ab611e9-eaac43fb

root@node01:/var/lib/rancher/longhorn/replicas# du -h | grep pvc-77d0fdfc0ab611e9
38G     ./pvc-77d0fdfc0ab611e9-cd981b3e
38G     ./pvc-77d0fdfc0ab611e9-4121b00b
38G     ./pvc-77d0fdfc0ab611e9-eaac43fb

if you need more info or a bundle i will be happy to help.
Thanks for your amazing support

@Angelinsky7 There was a bug in v0.5.0 which prevents the snapshot purging from completion. You can try again later after upgrade to the upcoming v0.6.2 release.
One side note: if you only have one node in the cluster, it's unnecessary to have 3 replicas. Two would be enough even for the potential replica disk failure. But it's recommended to backup the volume to the outside of the cluster, just in case the disk failure.

@yasker ok, perfect, i'll update the issue when i'll go to 0.6.2
great thanks, i'll update to 2 replicas.
I backup with nfs every day my volume that hold data...

@Angelinsky7 Is the NFS server running inside the cluster or outside the cluster? I just want to make sure if the node's disk is gone then the NFS server still have the data.

@yasker :-)
outside :-) different machine, different hdd
thanks for your concern :-)


Add "A walk through latent space with Stable Diffusion" to multi backend keras

change imports and ops

Codecov Report
All modified lines are covered by tests :white_check_mark:

Comparison is base (f23d482) 72.66% compared to head (70c0ad4) 63.96%.
Report is 3 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #18499      +/-   ##
==========================================
- Coverage   72.66%   63.96%   -8.71%
==========================================
  Files         331      331
  Lines       31980    31984       +4
  Branches     6244     6246       +2
==========================================
- Hits        23239    20457    -2782
- Misses       7212    10096    +2884
+ Partials     1529     1431      -98

Flag
Coverage Δ

keras
63.96% <ø> (-8.66%)
:arrow_down:

keras-jax
?

keras-numpy
?

keras-torch
63.96% <ø> (+<0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.
see 58 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Thank you for the PR! Can you provide the git diff between the new file and the original one?

Thank you for the PR! Can you provide the git diff between the new file and the original one?

I just added the original file and then the new changes - here is the git diff - https://github.com/keras-team/keras/pull/18499/commits/89f5398e8bce1c2138526092d78e0c63393cfc53


Why does tsui client publish not work?

"tsui client publish --gas-budget 100000000"
Unable to find package manifest in '/home/xxx/suibase/workdirs/testnet/logs/sui.log' or in its parents
Does publishing via the client not work anymore, and are you obliged to use "testnet publish"?

This is a bug in suibase. "tsui" should work as "sui".
Until this bug is fix, a workaround is to specify on your command line the [package path] instead of defaulting to the current directory:
Like "tsui client publish --gas-budget 100000000 /home/user/myproject/"
Usage:
tsui client publish [OPTIONS] --gas-budget <GAS_BUDGET> [package_path]
What is the bug?
A while ago the sui client was polluting the filesystem with a bunch of sui.log written by default in the current directory, so a trick was for the suibase script to change the current directory to "logs/sui.log" before calling the sui client.
That cause trouble with commands that rely on using the current directory (there is another case with a keytool command forcing its output file into the current directory).
Now the sui client behave better for its sui.log... so may be that trick of changing the current directory should be removed.

Encountered this issue again.
"lsui move test" also gives the error:
Unable to find package manifest in '~/suibase/workdirs/localnet/logs/sui.log' or in its parents
It's a bit cumbersome having to add -p  to every command IMO.

Summary
Thanks for reporting this.
The fix for 'lsui move' done.
Work-in-progress for 'lsui client publish' (more complicated than expected).
Implementation Details
Correction on 'What is the bug?'
They changed back and forth the fix to sui.log being noisy so I am NOT removing yet the "trick" of Suibase changing the current directory.
The fixes instead are to compensate (by adding options to current directory at the time the script was started) for when the user does not specify a path.
Why was the fix done for 'lsui move' quickly but not done for 'lsui client'?
'move' was easy because they provide unambiguous  --path and --install-dir options.
There are no such options for 'lsui client publish' requiring significantly more complicated command line parsing to find if the user did specify a path or not (which can be inserted anywhere among the options, can't assume always at the end of the command line).

All fix now commited.
Did fix also scenario where the user specify a relative path with "." or ".." (e.g. 'lsui move test -p ./some_directory'). The relative path will now be properly interpreted to be from the current dir.
Do not hesitate to re-open if finding new cases. Thanks.


React: Change [Card Group] component to include use case with 4 cards

User Story

As a [user role below]:
IBM.com Library developer

I need to:
create/change the Card group with 4 cards

so that I can:
provide the ibm.com adopter developers components they can use to build ibm.com web pages

Additional information

Story within Storybook with corresponding knobs
Utilize Carbon
See the Epic for the Design and Functional specs information

Where there are 4 cards in a card group, Card grouping with card group default and content block cards default, create a variation where if there are 4 cards, they can be viewed as 2 columns with 2 rows and 2 cards per column (4 by 4 matrix)

Functional specs here: https://ibm.box.com/s/rpki0q23o6wyrtvx22je74tbfx1xkcsn
React Visual QA testing issue (#5521 )
Prod QA testing issue (#5522 )

Acceptance criteria

[ ] Built as a pure React component/variant
[ ] Include README for the react component and corresponding styles
[ ] Add any necessary stable selectors
[ ] Create codesandbox example under /packages/react/examples/codesandbox and include in README
[ ] Minimum 80% unit test coverage
[ ] Update the Carbon for ibm.com website component data file to be sure the web site Component Status and Storybook links are correct
[ ] If a design is provided, the Designer is included as a Reviewer in the Pull Request
[ ] Provide a direct link to the deploy preview for the designer in the Pull Request description
[ ] A comment is posted in the Design QA issue, tagging Designer, when development is finished
[ ] The Storybook link is added to the Design QA issue for their testing
[ ] A comment is posted in the Prod QA issue, tagging Praveen when development is finished

@Praveen-sr This component is ready to be tested.
cc:  @kennylam


regressions in flask endpoints for gc support

looks like this was caused by https://github.com/superphy/backend/commit/07ae827ff02dcaa8e8b0c9eaed282fafabf05bc1

Fixed for both reactapp and spfy as of https://github.com/superphy/backend/commit/d71b0c298e8c15e34263f95e6772ac1c4eb6e3c7

Merged in https://github.com/superphy/backend/pull/85


Update Mapster.Tool to include .net7.0 as target framework

When trying to run dotnet mapster model (version '8.3.0') in .net 7 project I'm getting:
Could not load file or assembly 'System.Runtime, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'. The system cannot find the file specified.
I think it is simmilar issue as https://github.com/MapsterMapper/Mapster/pull/390

Have you tried the prerelease version?


Add Linode Form: Remove hide/show for single input

Hide/show for single input was discussed as weird, can be inlined to be more clear.

can be inlined to be more clear.

Or just dropped would be fine in this case too.


Support for Polymorphism

Hi,
Does/will catatumbo support polymorphism, so that we can define a polymorphic hierarchy of related entity classes, and then load and query them without knowing the specific subtype?
Similar to  objectify: https://github.com/objectify/objectify/wiki/Entities#polymorphism
Many thanks,
David

@davidjoh0 - Currently Catatumbo does not support what Objectify does - store related entities as 'One Kind' in the Datastore.
Entities in Catatumbo can extend from a MappedSuperClass, but each concrete entity is mapped to its own Kind in the Datastore. Not sure if that works for you. I will mark this as an enhancement request.


2 container communication not working

Hi,
This is a great plugin but encountered the issues with accessing two containers each other attached two different VFs to each container. Appreciate for your help in advanced.

@paisakya Hi! Have you solved this issue?


SharpZipLib version 1.3.2 is having security vulnerability

Current integrated version  of SharpZipLib 1.3.2 which is integrated with NPOI 2.5.5 is having security vulnerability.
When we are expecting new NPOI with latest SHarpZipLib 1.3.3.
Attached is the screenshot.

similar issue is already being tracked.


Either fix or comment how to specify a templates_path.

In conf.py I managed to get a template to work, but it was ugly:
templates_path = ['../../../../../_templates']
This is of course a consequence of the issue mentioned elsewhere, that relative directories don't work in conf.py. You really have to get into the guts of how all of the pieces work to get this correct. It also does not really match what the comment says:
# Add any paths that contain templates here, relative to this directory.
That is only correct if indeed you understand that it is relative to where conf.py will be when it moves.
We either need to somehow document this, or figure out how to copy the templates folder into the same relative position to the actual place where conf.py is invoked.

As you noted, this relative path idea is quite counterintuitive. It's also flaky because the relative path right now depends on where the conf.py is displaced and/or invoked from.
I don't have a good solution for this now, but I had a similar thought as you did: the "relative"-ness of the templates_path between the source conf.py and the invoked conf.py needs to stay the same.

One possible approach to this is to run conf.py in its original position, then extract the variables from there. Then get all paths, and make sure they are absolute. See https://github.com/rkent/rosdoc2/tree/prerun_conf_py for an implementation of this. That works for me, with conf.py in doc folder, and templates_path = ['_templates']
One downside of that the original conf.py can manipulate tags. From the documentation:

There is a special object named tags available in the config file. It can be used to query and change the tags (see Including content based on tags).

I suspect though that this is not common.


Slow in chrome (using hammer.js)

I have been using the exact demo-code as in http://ariutta.github.io/svg-pan-zoom/demo/custom-event-handlers.html
In firefox / microsoft edge the SVG is extremely fast and snappy. However, in Chrome it loads significantly slower and the pan&cropping takes about 2 seconds. This is on both Chrome desktop as Chrome mobile.
HTML code:
<div class="monument">
    <embed id="monumentSvg" class="wall" type="image/svg+xml" src="monument.svg style="width: 100%; height: 500px;"/>
</div>

The SVG file consists of a lot of text, which can be found here: http://jmu.martijnsch.net/monument/design/monument.svg
Could anyone help me out with this?
EDIT: I've tried different SVG's and it seems to be an issue with the  tspan element.

Fixed it by generating the SVG in Adobe Illustrator. Now it's using test elements instead of tspan. This fixed the issue.


Open Stateful site from panels.

Handle a new onSiteOpen event that the Cloud Panel app sends when a button should open Platform's site.

Code looks straightforward to me. @pastuxso, please run through an integration test as part of your review. Assigned the final review to you.


Update README with correct URL

Patch by @andy-5 , the URL needs to be suffixed with /webapi/

Thank you both. :+1:


added bower file

Hey dude,
Created this to make the package work with bower-installer (needs a main definition) =)

Cool man, thanks. LGTM.


nextcloud-client: 3.1.3 -> 3.2.0

Motivation for this change
Bump to the latest version. (at the time of making this PR).
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

LGMT too.


Fix installing the move-analyzer language server cargo command

From here:
https://docs.sui.io/build/install#ide
We suggest and link to:
https://marketplace.visualstudio.com/items?itemName=move.move-analyzer
That recommends:
cargo install --git https://github.com/diem/diem move-analyzer to install the move-analyzer

Which yields this error:
claymurphy@Clays-MacBook-Pro sections % cargo install --git https://github.com/diem/diem move-analyzer
    Updating git repository `https://github.com/diem/diem`
error: could not find `move-analyzer` in https://github.com/diem/diem with version `*`

So I found the move-analyzer in our newly moved Move docs repo here:
https://github.com/move-language/move/tree/main/language/move-analyzer
And attempted to install with either:
cargo install --git https://github.com/move-language/move/tree/main/language move-analyzer

Or:
cargo install --git https://github.com/move-language/move/tree/main/language/move-analyzer move-analyzer

But both result in a network error:
Updating git repository `https://github.com/move-language/move/tree/main/language`
warning: spurious network error (2 tries remaining): unexpected http status code: 404; class=Http (34)
warning: spurious network error (1 tries remaining): unexpected http status code: 404; class=Http (34)
error: failed to fetch into: /Users/claymurphy/.cargo/git/db/language-d657c5b4a82ca85f

Caused by:
  network failure seems to have happened
  if a proxy or similar is necessary `net.git-fetch-with-cli` may help here
  https://doc.rust-lang.org/cargo/reference/config.html#netgit-fetch-with-cli

Caused by:
  unexpected http status code: 404; class=Http (34)

So there is likely some user error on my part in attempting this fix. But the existing command definitely does not work as intended.
Adding Sam, Adam and Xun for guidance as we should be able to update the marketplace page above. If not, we should provide an alternative that works on our site and link to that instead.
Marking this medium priority given the option to download and build does exist. Noting the vscode extension install does work as intended, just not the language server install.

The correct comment is cargo install --git https://github.com/diem/move move-analyzer: the move repo location changed

@Clay-Mysten - does @huitseeker's comment address this?

@Clay-Mysten - does @huitseeker's comment address this?

Yes, thanks Francois and Todd. Fixed in:
https://github.com/MystenLabs/sui/pull/1428
We may need Sam's guidance to update the Marketplace page.

Sam, if I can help with that Marketplace page command fix, let me know.

I added a comment to help users there:
https://marketplace.visualstudio.com/items?itemName=move.move-analyzer&ssr=false#review-details


Added support for Material Design Icons

@JamesCoyle
https://github.com/JamesCoyle/tool-bar/blob/b30a07e410724533fd89a6d9647ff4be61ba59f0/iconsets/mdi/materialdesignicons.css#L4
Should you change font's url to atom://tool-bar/iconsets/mdi/materialdesignicons-webfont.woff.

LGTM :)

@JamesCoyle Thanks :ship:


Shift to disable zones doesn't work since update to 0.19.0

Environment
Windows build number: [run "ver" at a command prompt] Microsoft Windows [Version 10.0.19041.329]
PowerToys version: 0.19.0
PowerToy module for which you are reporting the bug (if applicable): FancyZones

Steps to reproduce

Ensure that "Hold Shift key to activate zones while dragging" is unticked

. Previous version 0.18.2 allowed the shift key to disable zones when in this mode
Expected behavior

Drag a window and it will show the zone guides. Depress the shift key and the zone guides should stop, and the window won't re-size to a zone.
Actual behavior

Drag a window - the zones will activate even when the shift key is held down. The window must now be placed in a zone
Screenshots

@solar-1992
this will be fixed in 0.19.1
Closing as duplicate of https://github.com/microsoft/PowerToys/issues/4646
Thanks.


Data from ws.recv sometimes is partial

I was trying to make RGB strip work with this, but if I send ~10 packets/second it starts to receive partial data. I'm not sure if it's desired behavior because my code expects data with fixed length and anything less than that will throw error. I've tried to rewrite that to use Queue I still get the same trouble...

It is preferable to view complete example. May be you've got phisycal limitations of your controller. Ten packets per second - it is approximately 100 ms per packet. When I've tested this client, time parameters modifications strongly affect behaviour.

Yeah, I've also tried mqtt and it wasn't able to handle this kind of throughput, though it was a little better. In the end I've settled on raw UDPing it. Works almost flawless :)

Yes. This client is not suitable for such throughput, at least on ESP32S.


pandas.CSVDataset imports unnecessary packages such as google-cloud-bigquery

Description
Importing pandas.CSVDataset runs unnecessary modules such as kedro.extras.datasets.pandas.gbq_dataset.py in addition to kedro.extras.datasets.pandas.csv_dataset.py due to
kedro.extras.datasets.pandas.__init__.py
Context
I'm trying to use pandas.CSVDataset, but I get an error in google-cloud-bigquery package which is not necessary.
Steps to Reproduce

Import pandas.CSVDataset

Expected Result
Run only kedro.extras.datasets.pandas.csv_dataset.py
Actual Result
I get
File "/usr/local/lib/python3.6/dist-packages/google/cloud/bigquery/schema.py", line 17, in <module>
    from six.moves import collections_abc
ImportError: cannot import name 'collections_abc'

Your Environment
Include as many relevant details about the environment in which you experienced the bug:

Kedro version used (pip show kedro or kedro -V): The latest develop branch (commit e2c271be3646d6c564a67960b67fb74c6ba1ece8)
Python version used (python -V): 3.6.8
Operating system and version: Ubuntu 18.04.3 LTS

Hi @Minyus 👋!
Thanks for raising this and I'm totally on board with your concerns. The reason we moved to the kedro.extras.datasets model in the first place was to cut down on dependencies and give users more granular control over what they need. I think we haven't got this quite right and we have an internal ticket open on our backlog pending a technical design session to discuss this and settle on a decision.
The issue stems from us allowing users to specify the dataset type via pandas.CSVDataSet which means we need to place CSVDataSet in the __init__ of kedro.extras.datasets.pandas and so everything in kedro.extras.datasets.pandas gets loaded in.
We'll keep you updated on what we decide and if you have any ideas you'd like to contribute, please feel free to share them here!

Hi @mzjp2
Thank you for explanation.
I understood that the current design came from the installation commands.
Then the following ways seem to be modular and make more sense (at least to me).

pip install kedro[bigquery] to use GBQTableDataSet in  gbq_dataset.py
pip install kedro[sqlalchemy] to use SQLTableDataSet in sql_dataset
pip install kedro[pyarrow] to use ParquetDataSet in parquet_dataset.py

Those make sense, but some of the tradeoffs are that we lose consistency with our extra_requires (some are groups, and others are individual datasets) and is pip install kedro[pyarrow] really that helpful over pip install pyarrow for example? Is it also scaleable as we people contribute more and more datasets? These are the questions we're wrestling with when trying to design a solution to this.

Yes, I understand designing a solution is tough.
I'm now wondering that lazy loading (deferring to load the module until the dataset object is actually used after importing) could be a solution.

Just a quick update on this, I have a prototype up and being dogfooded currently, will update here once I get some feedback and make some more progress.
The lazy loading was a good idea and was my initial first thought too, but ended up being a massive pain re: linting/typing/parsing and so I ditched it. Currently going for try/excepts in the __init__ files and also doing some refactoring to be able to tell when an import fail because of dependencies missing so we can raise the right error message.

Hi @Minyus, another update. I'm going to go ahead and close this via https://github.com/quantumblacklabs/kedro/commit/16604ec0203432b9897abb34e3bb4d1c59d1f81d -- you can see the commit for the solution we ended up designing. I think it's an all around win:

Lets you selectively install dataset dependencies and will let you use a specific dataset within a group without having all other dependencies for that group installed.
Keeps smart error messages for missing dependencies that you do need to run your pipeline that happens on config load and not at runtime of the pipeline itself.

Fair enough. Users can now use pandas.CSVDataSet as long as the actual dependency of the DataSet is met. Thanks @mzjp2 !


HDDS-7126. Clean deletedBlock records of deleted containers

What changes were proposed in this pull request?
By default DeletedBlockLog fetches 20,000 records per iteration and send the deleteBlock command to datanodes.
There is a chance that the db of deletedTable has a lot of records of deleted containers, and these records won't be cleaned, which leads to the idle iteration of the fetches, thus causing SCM failed to send commands to datanodes.
This ticket is to clean the records of deleted containers to recover SCM's delete block operation.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-7126
How was this patch tested?
unit test.

Hi @symious, my understanding of the change here is that containers that have been deleted will not need individual blocks deleted anymore. However, the requirement for a container to be deleted is that all replicas report zero blocks/keys. See LegacyReplicationManager#deleteContainerReplicas. This means all block deletes for that replica should have been processed and removed from the log. Is there still a  situation where deleted containers can end up in the DeletedBlockLog?

@errose28 Thanks for the review.
I see the container state is updated in LegacyReplicatioNmanager#deleteContaienrReplicas, but I didn't find the remove operation on records in DeletedTable, please correct me if I'm wrong.

Right, I believe the reason there is no removal for deleted containers from being processed for block deletes is that a container cannot be deleted until all blocks from all its replicas are deleted. This should imply that the deleted block log has no more entries for that container.

DeletedBlockLogImpl#commitTransactions checks that all replicas have processed a block deletion for a container before removing the entry.
LegacyReplicationManager#deleteContainerReplicas checks that all replicas have deleted all blocks.

Since the container cannot be deleted until all blocks have been deleted, the deleted block log/table should not have any entries for the container by the time it is deleted. Do you see a case where this could fail and there are lingering delete block entries for a container which has already been deleted?

Haven't looked into why the inconsistence occurs, might it be related to the container report from Datanode?
Anyway, the issue is causing our Prod cluster stuck in deleting blocks, and the PR helps to resolve the issue.

Sorry for the late response here. It's good to hear that this patch resolves the observed issue, but we should really try to understand why deleted containers are ending up in the deleted block log to make sure we have the correct fix. I would like to investigate this but have not had the time. @symious if you have time perhaps you could look in to how this case occurs as well, which will help us validate this fix.

@swamirishi will be looking at a way to reproduce this issue.

@errose28 @symious
DeletedContainers can occur in this the list of deleteBlockTransactionsBlocks. Following is the flow when we try to delete blocks.Blocks
Blocks from DeleteBlockTransaction are picked up and Blocks are marked for deletion and a DeleteCommandStatus response. So based on this response the SCM tries to commit the transaction DeleteBlockTransaction. The particular record from the table is removed only if min(# Replicas Deleted, Total Number of Replicas)>=Replication Factor(In case of Under Replication this won't be removed).
When the blocks are deleted InMemoryBlockCounters are reduced in datanode side & these counters are sent along with the heartbeat. Hence on the SCM side LegacyReplicationManager checks if max(# of blocks) in closed container replica=0. If it is 0 the container is deleted.
Hence as the block deletion & actual block deletion are asynchronous this can cause the record to stay in the deleteBlockTransaction Table even if the containers have been deleted.
The above patch actually fixes this issue.

Thanks for the analysis @swamirishi. Coordinating between the deleted block log and replication manager will be challenging so I think removing DELETED containers from the deleted block log when they are encountered like this patch is doing should be a good fix. I will review this PR. @symious can you please resolve the merge conflict?

@errose28 @swamirishi Thank you for the review. PR updated.

LGTM

@errose28 @symious Since it has been long, would it be better to rebase with master & run CI so that things don't fail?

Thank you @symious for the contribution


feat(server): Add server RBAC. Closes #3525

Checklist:

[ ] Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this is a chore.
[ ] The title of the PR is (a) conventional, (b) states what changed, and (c) suffixes the related issues number. E.g. "fix(controller): Updates such and such. Fixes #1234".
[ ] I've signed the CLA.
[ ] I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
[ ] My builds are green. Try syncing with master if they are not.
[ ] My organization is added to USERS.md.

Closes #3525
This PR is a PoC to see if we could do very basic RBAC using Casbin and that treats the URL as the obj and HTTP method as the act.

Replaced by #4198


Is it possible to set the initial state manually?

...
Hello CellRank,
When running the low-level mode using GPCCA, the terminal state can be mannually set by estimator.set_terminal_states_from_macrostates() or estimator.set_terminal_states(). But GPCCA cannot set the initial state. Could you please tell us whether there is a way to set the initial state mannually in CellRank?
Thanks!
Best,
YJ

GPCCA has 2 hidden functions, GPCCA._compute_initial_states and GPCCA._set_initial_states_from_macrostates, which work exactly as they terminal_states counterpart, but currently, there's no set_initial_states.

Thanks for the information!

A bit off-topic but highly appreciated your help about how to compute the initial states with the GPCCA. In the tutorial it says we have to set backward=True for the estimator and (?) re-compute compute_schur() and macrostates()? Many thanks!

If by compute the initial states with the GPCCA you mean use the states set by e.g. GPCCA._compute_initial_states, then unfortunately, there isn't an easy way - you'd have to overwrite I think 1 attribute, can post the code here if this is what you want.
The intended approach is to change the directionality of the kernel objects.
You'd have to re-initialize the kernel objects with backward = True e.g.:
# backward doesn't matter in this case, but has to still be set, will not be required in #791
ck = cr.tl.kernels.ConnectivityKernel(adata, backward=True)
ck = ck.compute_transition_matrix()
vk = cr.tl.kernels.VelocityKernel(adata, backward=True)
# backward_mode can be either 'transpose' or 'negate'
vk = vk.compute_transition_matrix(backward_mode=...)
k = (0.8 * vk + 0.2 * ck)

g = cr.tl.estimators.GPCCA(k)
# continue as usual, the terminal states correspond to root states, not final states

Note that almost surely, the initial states you got using GPCCA with a forward kernel (backward=False) will be different than the terminal states from GPCCA with a backward kernel (outlined above).

Hi,
Thanks for answering in this post. It helped me a lot.
I am following the real time series tutorial and using wot kernel + connectivity kernel to compute terminal and initial states. My data has 3 real-time points: 0.5, 1.0, 2.0. The terminal states computation worked okay and I get expected macrostates. However, I doubted if I successfully compute initial states. The macrostates computed in both forward and backward modes are the same... also random walk simulation looks fairly similar... Can you help me to have a look at my code?
random walk when backward=false

random walk when backward=true

Below is my code to compute initial states: (for terminal states, I removed backward=true argument)
sc.pp.neighbors(adata, random_state=0)

# Estimate growth rate
wkb = WOTKernel(adata, time_key="Time", backward=True)
wkb.compute_initial_growth_rates(organism="mouse", key_added="growth_rate_init_bwd")

# Compute transition matrix
wkb.compute_transition_matrix(
    growth_iters=3, growth_rate_key="growth_rate_init_bwd", last_time_point="connectivities"
)

# Simulate random walks
wkb.plot_random_walks(
    n_sims=300,
    max_iter=200,
    start_ixs={"Time": 0.0},
    basis="umap",
    c="Time",
    legend_loc="none",
    linealpha=0.5,
    dpi=150,
)

# Compute macrostate
ckb = ConnectivityKernel(adata, backward=True)
ckb.compute_transition_matrix()
combined_kernel_A_WT_bwd = 0.9 * wkb + 0.1 * ckb

# Initiate GPCCA estimator
gb = GPCCA(combined_kernel_adata_bwd)

# Plot Schur decomposition
gb.compute_schur()
gb.plot_spectrum(real_only=True)

# Compute macrostates, and show top 30 most confidently assigned cells
gb.compute_macrostates(n_states=2, cluster_key="cell_type")
gb.plot_macrostates(discrete=True, basis="umap", legend_loc="right")

# set initial state
gb.set_terminal_states_from_macrostates(["celltype1"])

Thank you!
Youran

Hi @yourann3, you could try computing initial states directly from the forwards estimator object by computing a few marcostates, checking how much these overlap with your time-points, and manually choosing one that overlaps with only day 0.5 cells. When you simulate random walks for the backwards Markov chain, maker sure to adapt the value of start_ixs={"Time": 0.0}. Also, the computation of initial states should be much easier in version 2, which is pretty much available on the main branch, and documented here: https://cellrank.readthedocs.io/en/latest/
See for example the new tutorial about the RealTimeKernel: https://cellrank.readthedocs.io/en/latest/notebooks/tutorials/kernels/500_real_time.html
Or the new tutorial about initial and terminal states: https://cellrank.readthedocs.io/en/latest/notebooks/tutorials/estimators/600_initial_terminal.html


[Feature] Indicator for Creature Classification (Rare/Elite/Boss)

Describe the feature
Would love to have indicators for classifications (rare, elite, boss, etc.) of creatures.
Describe the implementation
Implementation could be either standalone widget with icon, or as tags for use in text widgets (akin to Shadowed Unit Frames.)
Included screenshots of SUF implementation.

This was actually on my personal todolist before I released the addon, but seems I crossed it out without actually implementing it 😆
Will add it to the backlog 👍


YQL-15941 llvm14 initial commit

Revert commit rXXXXXX, External build system generator release 64
KIKIMR-19521 BTreeIndex FeatureFlag
ci: better architecture choice of TESTMO_SOURCE based on architecture and suffix, not by runner_label as before
ci: add directory existence check

add ydb-canondata-sync tool
Fix UT KIKIMR-19987
YQ Connector:disable ClickHouse debug output
Fix memory issue, launch load tablets with different ids on different nodes, KIKIMR-20348
Intermediate changes
add ydb/tools/ydbd_slice/image dir
YQL-17148: Fix column writing for printing plan
Consider all WITH Linux-syscall-note licenses as REQUIRE_CITATION
One more WITH Linux-syscall-note
Update vendor/github.com/openconfig/ygot to 0.29.15
Intermediate changes
Cosmetic tweaks following up rXXXXXX.
Align protoc version for java with one in Arcadia
clean
KIKIMR-19880: dont read all immediately if request has limit (q23 1.4s->200ms)
Intermediate changes
Update contrib/python/boto3/py3 to 1.29.3
ui.sh
Remove files with bad license from contrib/libs/linux-headers
add BETWEEN SYMMETRIC
Fix typo in handling serialization version
Change "config.yaml"
Update contrib/libs/aws-sdk-cpp to 1.11.37
Intermediate changes
Fix clashing macro
fix topic write sdk bug
paths to the actors library
Automatic release build for ya_bin3, os_ya, ya_bin, test_tool, test_tool3
aws region has been added
Add logs, KIKIMR-20102
YT-20546: Add DisableBalancingOnSingleAddress option
Fix error formatting KIKIMR-20254
Update yfm-docs for ya make to Build time: 10.304ms
(refactoring) Move CMS related functions to separate file KIKIMR-20254
Correct operators' evalutaion order, KIKIMR-20348
Intermediate changes
Add enable-spilling option
Revert commit rXXXXXX,Fix clashing macro
YQL-17089 default values in CREATE TABLE
insert a newline after the comma if comma is on a newline
KIKIMR-20324 Wilson Trace for puts in base tablet
Move macos and msvc platforms to internal
Use full folder service in YDBD
Increase timeout to decrease test flaps
Simplify numpy
Intermediate changes
Add devtools to allowed dirs
YT-20504: Add path/query tags to trace contexts of client rpc requests ModifyRows/SelectRows
Rework wilson spans in KQP KIKIMR-20216
Intermediate changes
ydb-oss sync: add clang16-rt/ to additionalPathsToCopy
yql doc fix
KIKIMR-20380: fix case with new column on merging
Copy fyamlcpp to ydb/library
KIKIMR-20387: intervals sharding preparation
Add /limit gauge for throughput throttlers
Add sematic attributes, refactor java.conf, scripts for manual check yexport output for yt, ydb, catboost
Add string_utils lib
Fix yaml handling for non subscribers
YT-20350: Sequoia Set command
ci: replace org check membership in favour of repo check collaborator
add LD_LIBRARY_PATH
YT-18655  Support prerequisite transactions in dynamic tables write
Fix converter behaviour for multiple tenants
Automatic release build for ya_bin3, ya_bin, os_ya, test_tool, test_tool3
Do not clear ConfigUpdater.Id OnPipeDisconnected() KIKIMR-20395
YQ Connector:fix ydb/core/kqp/ut/federated_query/generic tests
import tracing
External build system generator release 65
YT: Limit count in viable peer registry
references instead of pointers
IEventHandle Upcast/Downcast
Change "pr_check.yml"
Update contrib/python/setuptools/py3 to 69.0.0
Intermediate changes
Restore mapping for lld
KIKIMR-20380: optional statistics
Multiple consumers in TEvStatus and response
YQL-17289: fixed example, extended local usage tutorial
YT-20547: OperationId is strongly typed
Update contrib/python/fonttools to 4.45.0
YQ Connector:handle MDB's 403 responses in DatabaseResolver
TEvWrite constructor + Orbit
Require EMasterReign to be monotonic

KIKIMR-20373: Reset changes in normalizer
KIKIMR-20329 Wilson Trace for gets in base tablet
deprecate DisableAnsiOrderByLimitInUnionAll pragma
add condition: copy if lib file exists locally
Fix memory leak of thread-local storage in log_manager
CREATE / DROP VIEW at SchemeShard level
some safety
Fix inconsistency in rpc protocol
fixes for tracking object distribution with restarts KIKIMR-19696
KIKIMR-19512 Setting for memory limit in first stage combiner.
Use volatile TLS in library/cpp/yt
YQL-17264 Pg Dq integration
Use ProjectedFSLib.{h,lib} from Windows SDK
KIKIMR-18878: use TablePointLookup operator only for lookups by full pk
Change "ext_mapping.conf.json"
ci: pr-check: use github pat instead of org token
Intermediate changes
parsing promos
Missed resurce for actors
Add federated query sources/sinks to KQP plan

Upd libc++ to 12 July 2022 81c48436bbd29736f77a111fc207e28854939907
KIKIMR-20406: Fix ArrowSchema initialization
Enable/disable spilling in local worker manager
[misc] improve readme
Improve configs introspection
Update contrib/python/wcwidth/py3 to 0.2.12
Update contrib/python/setuptools/py3 to 69.0.2
Fix broken CSA macro
library/yson: Add NodeFromJsonStringIterative
Fix EvaluateExpr for optional types
Fix ut
Check ABORTED_BY_USER metering
Remove legacy example in docs
Prepare host before granting permission KIKIMR-20254
YT-20547: TIncarnationId is strongly typed
refactor column constraints (yql & pg) KIKIMR-20022
Change "kqp_service_ut.cpp" KIKIMR-20405
Fix str/bytes for regexp
YQL-17295 write YT schema into lineage too
Rework push down limit to support both v2 and v1
S3 proxy resolver: config & impl KIKIMR-16190
Fix build
YT-20519: Optimize execution pool removal in fair share thread pool
KIKIMR-20380: scheme modification repercusion fixes for compaction
KIKIMR-19852: fix race on select in case move sources and check ones in time
Prepare -> EvictVDisks KIKIMR-20254
YQL-17264 fix proto enum
ydb-oss: add some go depends
unnecessary fields in TTabletTxInfo
Update contrib/python/boto3/py3 to 1.29.5
Update dns, uuid, websocket for import
Intermediate changes
Added ToFlow operator to JSON plan
Added constant folding to KQP
YT: Add no such tablet error code to GetTabletByIndexOrThrow
YQL-17297 [lineage] better support of subquery
YQL-17038 [pg] ignore locking clause for now
ci: add release-msan preset, add sanitizer builds in the nightly build
fix columns save/load info reading from proto
ban pg large object functions
Add FeatureFlag EnablePDiskHighHDDInFlight KIKIMR-20161
Update golang.org/x/* deps for import
YQL-9853: implement WalkFolders
Change primary marker KIKIMR-10864
Support for single-threaded backtrace_state
Add option --evict-vdisks KIKIMR-20254
Make async query abort for YQL
YT-18346: Enhancing journals io rate monitoring
YT-20519: Do not use atomic for last usage time
Update contrib/python/boto3/py3 to 1.29.6
External build system generator release 68
Intermediate changes
YQ Connector:ch datetime overflow
Avoid duplication of "original_error_depth" attribute during deep error reserialization
KIKIMR-19582: dont merge in case fully empty intervals
YQ Connector: move rdbms dir into datasource
public_metrics
Ignore zero (empty) metrics in aggregated stats
Remove the observer before return from function
Add executor thread ctx, KIKIMR-18440
generic query auto detection
added ttl for lease table
Fix wrong naming of Parquet
YQL-17296 [lineage] fix for inner lambdas
move http api tests to ydb
AddObserver in ut_upload_rows
efficiency comparision for dict encoding in case different compressors
Change "ya.conf"
Fix elapsed microsec, KIKIMR-18440
Revert Y_DEBUG_ABORT_UNLESS
preserve newlines before binary operators
fix too deep recursion detect in match_recognize pattern
import tracing: tid removed from event key
correctly handle the case with MaxInFlight > MaxMovements
Handle long-lasting Put queries in DS proxy correctly -- part 1 KIKIMR-9016
Intermediate changes
Add access control to query tracker and queries APIs #175
YQ Connector:export ydb/library/yql/providers/generic/connector/debug to github
Remove UnitedPool, KIKIMR-18440
[util] Store policy should preserve constructor's is_constructible trait
YT-20651: codestyle edits
Partition direct read
Automatic release build for ya_bin3, os_ya, ya_bin, test_tool, os_test_tool_3, test_tool3
Support OffsetFetch endpoint for KafkaAPI in Logbroker
KIKIMR-20072: fix tests
fix OSS compile
Try enable TSAN on report unit-tests
host_os.ya.make.inc support
Revert commit rXXXXXX, Automatic release build for ya_bin3, os_ya, ya_bin, test_tool, os_test_tool_3, test_tool3
YT-19441: Shared write locks post-commit fixes.
YDB SDK Sync from git
YQL-17264 [pg][yt] fix drop table, commit, rollback
[yql] Don't ignore async results
Parse attributes tree with - as divider in generator spec and semantics
Intermediate changes
split joins in plans
fix2
update note about Decimal datatypes_primitive_number.md
restore tests
[yql] Failure injector in mrrun/dqrun
remove verbose logs from yt io discovery
Intermediate changes
Make support_retries() and get_type()  methods of object instead of class ones. Reduce get_type_name() usage.
Update kiwisolver to 1.2.0
invalid function name
YQL-17271 postpone view AST cleanup during evaluation
Add build dependences
Update kiwisolver to 1.3.2
switch to dynamic libfuse in opensource
YT-20637: Sample async spans only if parent is sampled
ci: add testmo-proxy, split junit into multiple parts, generate summary and post comment after tests logs upload
add one more test to defaults and fix issues with generating defaults for non-key columns KIKIMR-19547
Update contrib/python/fonttools to 4.45.1
Update contrib/python/Pygments/py3 to 2.17.2
Update contrib/python/clickhouse-connect to 0.6.21
Intermediate changes
Update contrib/libs/pfr to 2.2.0
Intermediate changes
Update contrib/python/ipython/py3 to 8.18.0
Update contrib/python/matplotlib/py3 to 3.8.2
Intermediate changes
Update contrib/python/idna/py3 to 3.6
Intermediate changes
Add eviction_period and eviction_tick_time_check_period to TResponseKeeperConfig, rename max_eviction_busy_time to max_eviction_tick_time.
Invert logging condition for "disk is full" message
clean
[docs] try to enable dark theme
Intermediate changes
YQL-17296 [lineage] fix for Member
Intermediate changes
KIKIMR-20422: Remove schema versions
Externalize tablet transactions
Intermediate changes
YT-20593: Support Zstd dictionary compression in yt/core
description of the "ydb workload transfer topic-to-table" command
Automatic release build for ymake, os_ymake
update docs_release.yaml
Update contrib/python/pexpect/py3 to 4.9.0
Update contrib/python/prompt-toolkit/py3 to 3.0.41
Intermediate changes
Automatic release build for ya_bin3, ya_bin, os_ya, test_tool, os_test_tool_3, test_tool3
Add Drain method for TBlockingQueue
KIKIMR-19763 lazy init for prepared objects
[ydb/library/yql/tests/sql/sql2yql] Remove redundant dependency from DEPENDS
windows: fix yqlworker build
YQL-17080 NearbyInt
ci: check ya test generated junit.xml as a test run success
YQL-17256: Fallback from RPC Reader
Limit s3 read tasks on limit push down
Removed unneccessy file from docs folder
Use AggrAdd for Limit.
Fix any join absence after key columns cast
Remove unused fields from TKqpSchemeOperation
Added support for optional for predicate selectivity
Better use AggrAdd for limits.
Intermediate changes
Canonization fix.
YQL-16196 Add FileOptions pragma and bypass_artifact_cache option for MR job spec
Add host_os.ya.make.inc files to piglet-sync
Fix bug KIKIMR-11082
KIKIMR-20451: Pass TTLSettings on column table create
ci: add missing ydb/ci sync
pg-make-test saves stderr
Prepare to rename py3_flake8 tests to flake8
Intermediate changes
add attribute to detect lifetime bound errors
Handle long-lasting Put queries in DS proxy correctly -- part 2 KIKIMR-9016
Handle RaiseError calls in OffsetFetchActor
Не работает ResourceManager.resource_filename вместе с Y_PYTHON_SOURCE_ROOT
Intermediate changes
Fix inconsistency in rpc protocol
, YT-18091: Do not schedule pollable shutdown in finalizer invoker
Update contrib/python/traitlets/py3 to 5.14.0
Intermediate changes
Update contrib/python/ipython/py3 to 8.18.1
YT-20658: add two fields to Bundle Controller API
Moved cmake files to generator dir and updated generator.toml
Update doc content
[dq] Refactor dq gateway session handling
Disable data validation in opensource
unknown data source has been fixed
Removed wrong copy
add kms's symmetric_crypto_service for nbs
KIKIMR-19831: exclude right columns from left only stream join result
YQL-17080 fix win build + adjust bounds
YQL-17117: optimize PgCast unknown->text
Fix verify requirement !PipeToBalancer failed
Y_DECLARE_OUT_SPEC for NKikimrDataEvents
YQL-17346 more columns in pg_type
Traffic agg task metrics + YQ public metrics
ci: cache tests results
Update contrib/python/s3transfer/py3 to 0.8.0
Intermediate changes
KIKIMR-19861: fix compaction task volume limit
YQL-16196 Add docs for FileOption pragma
Rewrite switching pools for executor thread, KIKIMR-18440
Create postcommit.yml
Consider used columns in index chooser
YQL-17352 YQL-17356 YQL-17347 more pg_catalog tables
Fix build problem KIKIMR-9016
fix typo in port number section + add note on ports for multiple dynnodes per server
Add build support for cortex-m23 platform
Support override distutils from setuptools
YQ Connector: prepare code base for S3 integration
Test for duplicate data in anyjoin
Intermediate changes
Introduce convenient _B literal for bytes
Support std::filesystem::path in TFile and TFileHandle
feat setuptools: revert/fix UnionProvider
ci: don't fail to fast on test run, add POST suffix for push checks
Update Python 3 to 3.11.7
Add GO_MOCKGEN_CONTRIB_FROM macro to generate mockgens from contribs
Support Python 3.12 for future
Intermediate changes
Support Python 3.12 for cffi
drop unused MaxDPccpDPTableSize
fix return code UNSUPPORTED to UNAVILABLE
updated roadmap for 2024
not found behaviour has been changed for get script execution
Support Python 3.12 for tornado-4
Automatic release build for ya_bin3, ya_bin, os_ya, test_tool, os_test_tool_3, test_tool3
YT-20686: Fix TResponseKeeper
ci: quote log file path
Pass DiscoveryEndpoint in to DiscoveryMutator
Intermediate changes
KIKIMR-20179: remove deprecated reader from tests
serial execution in simple write session
ci: testmo-proxy use RequestException instead of ConnectionError
Handle long-lasting Put queries in DS proxy correctly -- part 3
add a whitelist for pooltrees pragma
ci: use ya from repo, fix memory sanitizer run, always try generate summary
Intermediate changes
Remove excessive EOL spaces in blobstorage code
Intermediate changes
Better relational operators for TStrongTypedef
[yql] test auto partition
YQL-16196 Move internal link into internal docs (PRAGMA FileOptions)
KIKIMR-20482: Remove duplicates on schema versions
Print time in shutdown logging
Fix comparison key
Intermediate changes
Fix fluky test. We can get CLIENT_CANCELED status at driver shutdown.…
RowCount/ColCount should be used in move/parse
KIKIMR-20042 Wilson uploader fix
,allow optional timestamp in insert into monitoring
YT-20425: Optional offset in pull_consumer
primary keys naming unification
fix stream-write refresh-token rights
support default values in create table for pg syntax KIKIMR-20022
PR from branch users/nsofya/KIKIMR-19564
Fix build, KIKIMR-18440
fix codestyle: remove semicolon
finer check of lifetimebound attribute support
Use generic node count, not datashards only
[yql] extend dq_file test parts
Fix an attribute list cannot appear here from clang-cl16
Fix modernize-use-emplace reported by clang-tidy16
FS_TOOLS to python3
[yql] extend yt_native_file test parts
Update contrib/restricted/nlohmann_json to 3.11.3
Intermediate changes
Stricter platform check for prebuilt protoc-gen-go
Automatic release build for ya_bin3, ya_bin, os_ya, test_tool, os_test_tool_3, test_tool3
Update COPY_FILE macro
Replace rep.erase with rep.erase_one in THashSet::erase
fix typo in public method name
Move ApplyJitter impl to inl file
Add fake PDisk key to kikimr_cfg, KIKIMR-20141
Allow using std::filesystem::path when constructing TFileInput / TFileOutput
Switch windows builds to clang16
Remote development
KIKIMR-19521 BTreeIndex Loader & Dump
KIKIMR-19521 BTreeIndex Charge Interface
Intermediate changes
KIKIMR-20432, KIKIMR-20431: support pg and not null types for stream lookup join
KIKIMR-19512 Push down binary arithmetic operations and use YQL kernels.
Split postcommits in two workflows
TEvWriteResult Origin
YQL-17353 YQL-17355 YQL-17357 YQL-17358 YQL-17360 YQL-17361 YQL-17362 more tables (mostly empty)
PR from branch users/zverevgeny/YQL-17279_mr_permute
KIKIMR-20538: background processes disabling
KIKIMR-20009:dont remove blobs in case failed main data writing
External build system generator release 69
KIKIMR-19900 switch arcadia to python ydb sdk from contrib
SpillingEngine pragma propagation to resource allocator.
Intermediate changes
KIKIMR-20484: switch required fields to optional in generic config
KIKIMR-18888 query classic schema when not found
YT-20123: make proto config && check it on const values Bundle Controller API
Fix WriteTableToStream in pgrun
Attempt to fix CloseSessionsWithLoad test. KIKIMR-20405
KIKIMR-19512 Add 'Coalesce' kernel.
UT for dq actors (initial)
Use clang-tidy via RESOURCE_LIBRARY
,allow optional timestamp in insert into monitoring, add tests
Continue with test on build fail
Revert "YT-20123: make proto config && check it on const values Bundle Controller API"
Reorder a bit and remove unneeded var
Fix names of + and - in json.
Switch to use object attributes for consumer
Refactor OutputChannel reads in task_runner_actor
Correct v1/v2 totals
Update contrib/libs/backtrace to 2023-11-30
YT: Introduce schema for TYsonStruct
Rename py3_flake8 to flake8
Move fyamlcpp and yaml_config to NKikimr namespace
[yql] Common zero-sampling optimizer for both yt/dq providers
federated topic write
Enable COPY_FILE with text context for UNION and PACKAGE
Better follback in ranges multiplier
YT-16482: Fix GROUP BY
Fix channel garbage collection issue KIKIMR-20525
Intermediate changes
Simplify AddOperation
Add UT for consequent major updates, KIKIMR-20283
Intermediate changes
skip empty metrics KIKIMR-20270
YT-19944: Add key filter metrics
Intermediate changes
KIKIMR-19452: Pg insert from selection by column order
timeout logs have been moved to error
detect dangling references in MapFindPtr and utility helpers
Intermediate changes
detect dangling references to temporary TStringBuilder object
Remove TCoordinatorInfo::TabletId
Intermediate changes

pg varchar as primary key
YQL-17378 simple obfuscation of SQL query
Intermediate changes
Finalizing full result write via writing queue to avoid early finish
YQL-17276: Fix hybrid for TopSort case
Do not update index record in case of upsert with value equal to already present one
Fix double hard gc KIKIMR-20525
Remove more old patches
Intermediate changes
Use dynamic vendored libs when put in cache
DataShard EvWrite Immediate
Fix yson parsing in yql_agent
KIKIMR-19512 Set combiner limit from mkql heavy limit.
Intermediate changes
detect dangling references in TMaybe object
Update contrib/python/clickhouse-connect to 0.6.22
Intermediate changes
for darwin-arm64
Static libs
Run checks switches
Support \pset null in pgrun
Offload "annotations" attribute handling
Use aggregate for Sequoia replicas
Update contrib/restricted/boost/predef to 1.84.0
Update contrib/restricted/boost/config to 1.84.0
Intermediate changes
Update contrib/restricted/boost/variant to 1.84.0
Update contrib/restricted/boost/mp11 to 1.84.0
Update contrib/restricted/boost/math to 1.84.0
Update contrib/restricted/boost/conversion to 1.84.0
infly metrics have been fixed
Update contrib/restricted/boost/core to 1.84.0
Intermediate changes
Update contrib/restricted/boost/utility to 1.84.0
Intermediate changes
Update contrib/restricted/boost/any to 1.84.0
Update contrib/restricted/boost/winapi to 1.84.0
Update contrib/restricted/boost/endian to 1.84.0
Update contrib/python/fonttools to 4.46.0
Fix crash caused by StdNormalRandom producing a value out of expected range
Root CMakeLists.txt generation with jinja
Release opensource ya & test_tool
Reset tests cache
Intermediate changes
Fix SCHEME_ERROR from DS KIKIMR-20297
Update contrib/restricted/boost/atomic to 1.84.0
Update contrib/restricted/boost/bind to 1.84.0
USE_OPENSOURCE_TEST_TOOL=yes
re-enable clang::reinitialized attribute for non-CUDA target platforms
Update contrib/restricted/boost/ratio to 1.84.0
Checks switch fix
Update contrib/restricted/boost/smart_ptr to 1.84.0
Update contrib/restricted/boost/function to 1.84.0
Update contrib/restricted/boost/tuple to 1.84.0
Update contrib/restricted/boost/array to 1.84.0
Update contrib/restricted/boost/thread to 1.84.0
Update contrib/restricted/boost/optional to 1.84.0
fix tests after
Add KDevelop (#495)
do not use adaptive thread pool (#536)
add uniq node id validation to ydb cfg (#538)
ci: add defalut for put_build_results_to_cache (#546)
Enhance error message (#539)
support api proto files in go (#543)
Test error delivery in result receiver (#548)
Refactor DQ Channel Storage to accept external actor system (#547)
Do not include data_events/events.h in do datashard.h. Ydb import fix. (#552)
YQL-17145: fix autoparametrization of null values and refactor settings (#555)
YQL-17393: Fix dq tests (#551)
KIKIMR-20042 Wilson enchancements (#540)
Add tstool and tsserver into ydb/tools (#545)
KIKIMR-20079: create/alter/drop group (#501)
ci: put build results to cache for PR checks and fix log extraction in the transform-ya-junit script (#561)
Remove unused include (#559)
KIKIMR-20042 KeyValue tablet toplevel tracing (#526)
GetSubmatrix (#556)
Refactored CBO interface for DQ (#558)
Fix plans and cannonize tests with aggr functions. (#550)
Fix missed subscription for non local request cancelation. (#527)
Optimize TString creation in TSpan ctor (#568)
Optimize heartbeats emission KIKIMR-20392 (#557)
Report nodeId with create session response. (#562)
Optimize TSpan methods to prevent unneeded object construction KIKIMR-15449 (#575)
KIKIMR-20042 Enchanced VDisk tracing (#571)
Mote YT plugin to ydb/library/yql (#573)
KIKIMR-20042 Added table with statistics to LoadActor html report (#565)
fix sequence requests lost and add debugging tools to sequence proxy (#570)
added GetOpenTelemetryTraceParent() to IRequestCtxBaseMtSafe (#577)
KIKIMR-16087 Replace Y_ABORT_UNLESS (#569)
Update pr_check.yml (#583)
ci: start testmo run before starting tests (#580)
ci: run CheckAllowedDirs on all branches (#581)
YQL-17393: Fix Dq tests (#560)
TaskRunnerActor accepts unknown events (#576)
Flush queue and end Final message immidiately on full result writer error (#582)
Disable YQL YT plugin under non-linux platforms (#588)
Implement CREATE/DROP EXTERNAL DATA SOURCE/EXTERNAL TABLE in QueryService. Without IF NOT EXISTS/IF EXISTS support yet (#524)
YQL-17087: Move DqChannelStorage to separate file and use interface (#591)
[dq] Peephole integration + some transform helpers (YQL-17386) (#572)
YQL-9853: add documentation for WalkFolders (#585)
Mutetests1 (#578)
YQL-17434 Ignore TEvStatistics (#598)
Update README.md (#602)
YQ-2323: YQ Connector:  use Connector docker image for YQL Generic provider integration tests  (#604)
init

ydb/library/yql/minikql/comp_nodes/llvm14/ut/TMiniKQLCombineFlowPerfTest.TestMinMaxSumTupleKey-LLVM | 1m 44.060s | ydb/library/yql/minikql/comp_nodes/llvm14/ut/[6/60] chunk chunk | 0.000s | FAIL |
ydb/library/yql/minikql/computation/llvm14/ut/[0/10] chunk chunk | 0.000s | FAIL |
ydb/library/yql/minikql/computation/llvm14/ut/[1/10] chunk chunk | 0.000s | FAIL |
ydb/library/yql/minikql/computation/llvm14/ut/[2/10] chunk chunk
это ожидаемый фейл, там есть проблема с llvm_shudown


Update Visitor Information

MOB-1019

Why don't you use the reformat code to follow the code style?


Default userDisplayName to empty string when not specified

Describe the issue
The definition of PublicKeyCredentialUserEntity.displayName was refined in L3 to declare that it is preferable to set this value to an empty string when it's not needed:

A human-palatable name for the user account, intended only for display. The Relying Party SHOULD let the user choose this, and SHOULD NOT restrict the choice more than necessary. If no suitable or human-palatable name is available, the Relying Party SHOULD set this value to an empty string.

(Emphasis mine)
I should update generateRegistrationOptions() accordingly to match this behavior. Right now it defaults to the same value as userName when not specified.

This change is now available in the recently-published<EMAIL_ADDRESS>✌


Getting XMLHttpRequest error for Web platform

I have a GraphQL operation by using Ferry which works fine on Android platform, but if I try to run that operation for Web platform I get an error message found in linkException property from an OperationResponse<TData, TVars> object:
XMLHttpRequest error., originalStackTrace:
dart-sdk/lib/_internal/js_dev_runtime/patch/core_patch.dart 963:28                get current
packages/http/src/browser_client.dart 69:22                                       <fn>
dart-sdk/lib/async/zone.dart 1653:54                                              runUnary
dart-sdk/lib/async/future_impl.dart 147:18                                        handleValue
dart-sdk/lib/async/future_impl.dart 766:44                                        handleValueCallback
dart-sdk/lib/async/future_impl.dart 795:13                                        _propagateToListeners
dart-sdk/lib/async/future_impl.dart 557:7                                         [_complete]
dart-sdk/lib/async/stream_pipe.dart 61:11                                         _cancelAndValue
dart-sdk/lib/async/stream.dart 1587:7                                             <fn>
dart-sdk/lib/_internal/js_dev_runtime/private/ddc_runtime/operations.dart 334:14  _checkAndCall
dart-sdk/lib/_internal/js_dev_runtime/private/ddc_runtime/operations.dart 339:39  dcall
dart-sdk/lib/html/dart2js/html_dart2js.dart 37341:58                              <fn>
, parsedResponse: null

I'm using these packages:
dependencies:
  ...
  built_value: ^8.4.1
  ferry: ^0.11.2+1
  ferry_flutter: ^0.6.2
  gql_http_link: ^0.4.4+1
  ...

dev_dependencies:
  flutter_test:
    sdk: flutter
  flutter_lints: ^2.0.0
  build_runner: ^2.3.2
  flutter_gen_runner: ^5.0.2
  ferry_generator: ^0.6.1

Environment info:

Flutter 3.3.5
Dart 2.18.2
EndeavourOS Linux x86_64, Kernel: 6.0.2-zen1-1-zen
Flutter path: ~/Applications/flutter
VSCode version: 1.72.2

closing this in favor of https://github.com/gql-dart/gql/issues/358


[nrf noup] testspec: Add audio

Add filter for audio tests

Tested in: https://github.com/nrfconnect/sdk-nrf/pull/12968


download third_part lib failed

下载依赖包失败

maven settings.xml

alimaven
aliyun maven
http://maven.aliyun.com/nexus/content/groups/public/
central

is there an update on this? sdk has been unusable since may for this reason.


Automate update of OpenStack versions

Latest OpenStack versions should be in sync with https://releases.openstack.org.

With the switch to stable branches, this is no longer necessary.


Notification not received on real device, works on Simulator

I am first time user for the plugin, and though I get the notification using Console firebase to send push notification in DEBUG mode to simulator, as well as my PHP script is able to send it. But when I make a Release copy of it on real device I get the Refresh Token but didn't recieve the notification.
I try to put app in foreground, background, reboot phone and didn't start app or App killed or closed. nothing works. Since simulator is working I do not doubt I did something wrong in code. Maybe it is some compile time setting that is causing Issue. I have "Link" as SDK only. Thanks``
EDIT: I was able to test it successfully with someone else's device .. but now can you help me figureout what might be issue with my own device it is Android 12.5 or something.

I have no idea how, but it looks like i fixed my problem on Android 12/13.
Can you show me your AndroidManifest.xml content?
Also, what is the Minimum Android Version, Target Android Version, and your Compiled Android Version (Target Framework)?


Enable HEAD request instead of ony GET

Some ZARR-applications use HEAD requests instead of GET requests. Found out that FASTAPI returns "Method not allowed" for HEAD requests where only GET requests are defined. This would enable it by returning the same as the GETs.

@wachsylon, can you give some examples of what zarr apps need to be making HEAD requests? I'm struggling to see how this aligns with the classic call patterns against HTTP Zarr stores.

i was a bit unspecific: I think that this specific app first tries to find out whether there really is sth to GET before it actually gets it.

use HEAD requests instead of GET requests

so rather "in addition" than "instead of GET".
I needed it for a zarr-js app.

I'm struggling to see how this aligns with the classic call patterns against HTTP Zarr stores.

I thought that we just do not want xpublish to return "method not allowed" for HEADs anyway, no matter what the standard actually is.


Content not showing on scroll

So I'm currently trying to implement AOS I tested the implementation on CodePen beforehand as a quick way of testing it, however, when moving the code to my project it doesn't work.
Here is the codepen https://codepen.io/ben_bagley/pen/rowJpw
and here is the implementation of my project

I'm getting no console errors, by the way, the content just isn't showing on scroll.

same here...


Add build process

First step, main file (oakwood.scss) compile to some temporary css file.
Step two, apply postcss's modules (nsBuilder and Autoprefixer) to compiled file.
Step three, put compiled file to /compiled/oakwood.css
Last step, apply postcss's module to compress to file /compiled/oakwood.min.css
Links:
Autoprefixer
nsBuilder
postcss-CLI

if you know better name for this folder, please use it
compiled was just example

@XiBOR what about font-files? Are there necessarily to copy fonts to  folder?

Look tasks #16


Convert HTML canned responses to more valid plain text when emailing

Have two boxes: one for HTML and one for plain text.

Superceded by #365


Reformat and update the Quickstart Guide

Rework the structure of the Quickstart guide:

Prioritise Storage Node configuration ahead of deploying mayastor on the cluster
Provide a definition of what a Storage Node is, within the context of mayastor
Update tested platforms with AKS information
Update example commands given for checking and setting 2MB huge page support.
(sudo tee now used as this works on AKS)
Update example commands given for creating storage classes, to clearly identify the transport
(ie. nbd vs iscsi)

Also, remove reference to NVME_TCP module in "Requirements" section as this isn't supported by the CSI driver in this release

@blaisedias We came to consensus on (ie. Jeffry told us) the correct capitalisation for Mayastor quite some time ago.  If there are any camel case instances now then they have been left in by myself in error, and I'll correct them.


EPA source classification codes

I'm trying to determine consistent source classification codes (SCCs) for using NEI data in our historic GHG inventory.

Closed with #104


IPv6: Envoy Pilot JSON

The pilot/docker/envoy_pilot.json file sets the localhost address to <IP_ADDRESS>, and any address to <IP_ADDRESS>. For IPv6, these need to be [::1] and [::], respectively. More importantly, there needs to be a way to make this configurable, based on whether the cluster is operating in IPv4 or IPv6 mode.

marking this not stale since it's still an issue


Improve Conflict Detection in Parallelization by Considering Slots to Reduce False Positives

PR description
This update improve conflict detection during transaction parallelization by checking storage slot changes. By considering modified slots in addition to addresses, we improve the accuracy of conflict detection.
Key Changes:

Added storage slot consideration in conflict detection.
Reduced false positives by more accurately identifying conflicts between transactions and block state.

Fixed Issue(s)

Thanks for sending a pull request! Have you done the following?

[ ] Checked out our contribution guidelines?
[ ] Considered documentation and added the doc-change-required label to this PR if updates are required.
[ ] Considered the changelog and included an update if required.
[ ] For database changes (e.g. KeyValueSegmentIdentifier) considered compatibility and performed forwards and backwards compatibility tests

Locally, you can run these tests to catch failures early:

[ ] unit tests: ./gradlew build
[ ] acceptance tests: ./gradlew acceptanceTest
[ ] integration tests: ./gradlew integrationTest
[ ] reference tests: ./gradlew ethereum:referenceTests:referenceTests

This new conflict detection improved the number of parallelized transactions from ~40% to ~60%.
The numbers in the charts below are TPS.
Before this PR (24.10.0 running with  --Xbonsai-parallel-tx-processing-enabled=true)

With this PR (running with  --Xbonsai-parallel-tx-processing-enabled=true)

With more transactions executed in parallel, we noticed around 20% performance improvement compared to the last parallelization implementation. The numbers below are from instances running both EL and CL and are not using high spec flag.

We can notice also almost twice better performance when comparing to besu 24.10.0 with Teku as a CL

we need to do stability tests before merging


refactor(sdk)!: improve mock context provider async processing

Issue being fixed or feature implemented
Mock context provider seems to not work correctly (deadlock detected).
What was done?

Sdk::set_context_provider() no longer requires &mut self
Created abstraction layer to execute async code in sync context (block_on() method)
Refactored load_expectations as sync code
Moved core_client to core module and exposed it publicly

How Has This Been Tested?
GHA
Integrated with third-party software
Breaking Changes

Sdk::set_context_provider no longer requires &mut self.
In Mock Sdk, load_expectations() is deprecated in favort of load_expectations_sync()

Checklist:

[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have added or updated relevant unit/integration/functional/e2e tests
[ ] I have added "!" to the title and described breaking changes in the corresponding section if my code contains any
[ ] I have made corresponding changes to the documentation if needed

For repository code-owners and collaborators only

[ ] I have assigned this pull request to a milestone

@coderabbitai review

@coderabbitai review


Input and output on STDIO using JSON

Greetings, not really expecting you to merge this, but checking if you'd be interested in this type of change. I kept the diff minimal to make it easy to review. The idea is if you pass a flag on the command line, the sensors will output JSON which can be piped to the display devices.
If you like this idea, I can clean it up. I don't want to make your example scripts very complicated, though so would appreciate style guidance.
We're using this device at work for some experiments on security and privacy so JSON would be helpful for us.
For instance, to send the distance sensor to the LCD:
sudo python distance.py  --json-stdio | sudo python lcd.py --json-stdio
To send the distance sensor to the segment display:
sudo python distance.py  --json-stdio | sudo python segment.py --json-stdio
To send the RFID sensor to the LCD:
sudo python RFID/Read.py --json-stdio|sudo python lcd.py --json-stdio
Status: At this stage, we've only plugged together a few sensors as an
experiment. If it's of interest, we'll add more.

Greetings! We're going to wrap up this work this week, so please do let me know if you're interested. Otherwise, we probably will get too far off master to make a clean PR.

Hi @SyntaxPolice, sorry for the late reply.
I've looked into the code and it's quite impressive - well done.
Unfortunately, I'm afraid we won't be able to merge it into the master currently as it makes the examples too complicated for total beginners.
As well force us to change the images we've made and update them with the new branch and change the python lessons we've created accordingly.
Would be great if you forked the repository and made the changes on your own fork - I'm sure it will be super useful for a lot of people.

Thanks @Zontex . One thing: I hadn't intended for the last 2 commits to be on this branch, assuming you don't need & want the encrypted version of this. I had just meant for the JSON input & output to go upstream to you. Let me know if you want a cleaner PR to evaluate. Sorry about that.
In any case, no problem at all. I totally understand wanting to keep these examples as simple as possible for the purposes of this awesome kit. Please feel free to close the PR.


Make aligned heap alloc public

currently mi_heap_malloc_zero_aligned_at is not on the public api, and there is no aligned heap api's, it should be fairly simple and useful to have this as a public api right?
I can make a PR if wanted, I just got curious why it isn't so already.

Hi Santagada, thanks for your feedback: there are many alignment functions, see:
https://microsoft.github.io/mimalloc/group__aligned.html
The mi_heap_malloc_zero_aligned_at is the internal function that all the others use.
The function mi_zalloc_aligned does zero initialized aligned allocation.
Hope that helps :-)

none of these take a heap as a parameter, that is my problem, doing aligned allocations on a particular heap

Ah I see! I will add this to the API surface.

Done in the latest dev branch :-)


'Building...' message in status bar

As soon as I open a .scpt file the status bar message changes to "Saving as Binary Property List". No saving is going on and the message doesn't go away. ST3 on OS X 10.11.6.
Sorry for bombarding you with these issues. Having them separate makes it easier, I think.

Thanks, that's a left-over from the BinaryPlist package (which served largely as the blueprint for this)

Sorry for bombarding you with these issues. Having them separate makes it easier, I think.

No worries, that's the way to do it properly 😃

The message doesn't come up with .applescript files, so I'll close this one.


design exciting UI/visual element(s) that signify dev X signed app by dev X ("dev signed app status")


dependency check can not collect evidence for windows dlls

I am using PE Explorer for dependencies of my sdk file. The output of tool  was list of windows dlls.
Now ,I want to scan these file such as GDIPLUS. But the report is shown empty result.  why? ( While GDIPLUS is a vulnerable dll)

ODC can only analyze .NET assemblies. Pretty sure GDIPLUS is not a .NET assembly.


PowerToys Run Windows Settings plugin does not open "Check for Updates" settings page anymore

Microsoft PowerToys version
0.63.0
Running as admin

[ ] Yes

Area(s) with issue?
PowerToys Run
Steps to reproduce
press Alt+SPACE to open Powertoys Run
type: "$ Check for Updates" - the dropdown shows the correct "Windows Update - Check for Updates" selection
Press Enter
✔ Expected Behavior
It should open the Settings app on the Windows Update page
❌ Actual Behavior
It opens the windows Settings app on the System page, instead of on the Windows Update page.
Other Software
No response

These are my Windows details as per the Settings page:
Edition	Windows 11 Pro
Version	22H2
Installed on	05/10/2022
OS build	22621.608
Experience	Windows Feature Experience Pack 1000.22634.1000.0

I attached here the bug report zip:
PowerToysReport_2022-10-10-17-42-29.zip

@LoZeno
Is this still an issue? /needinfo

@htcfreek yes, it hasn't been resolved yet

@LoZeno
Can you please post a screenshot of the expected settings page. /needinfo

@htcfreek this is the page that should open:


Do not copy FILE objects

Fixes error in Android, where FILE is only accessible as opaque type and therefore fails to compile with incomplete type error.
Code now complies with: FIO38-C. Do not copy a FILE object, See: https://wiki.sei.cmu.edu/confluence/display/c/FIO38-C.+Do+not+copy+a+FILE+object

FILE object is copied so a temporary FILE can be used for std output and input streams testing, and at the end of each test case the captured FILE object are reverted back to the original values.
By disabling the FILE object copy testing involving assertions on the output streams will stop working.
The best approach I can think of now is to add a macro that will exclude the FILE capture feature during compilation and the flag to exclude the feature at runtime:
CESTER_NO_STREAM_CAPTURING
--cester-nostreamcapture

I will make an update to the framework to selectively compile FILE capturing feature

Thanks, interesting. Why provide a runtime flag though?

Issue 65 may be an alternative solution to the error in Android.

Thanks, interesting. Why provide a runtime flag though?

I provide an alternate runtime flag, in in case the feature wants to exclude after the test has been compiled.