How should this work?

The goal of this repository is to provide an extension that Sphinx developers can use to conditionally add assets (JS and CSS files) to a page. This way they aren't forced to load assets on every page, even when those assets won't be used. This could reduce unnecessary data transfer etc.
Our thinking so far has been to provide a function like add_js_file and add_css_file that also allows you to specify a condition that will trigger whether the file makes it in to the final page.
A few conditions we should consider:

Is a certain element in the page doctree?
Is the current page explicitly listed in a whitelist?
Is there a current html_context variable that triggers the file to be added?

How would the file adding/removing work?
We'd probably use the regular sphinx add_js_file and remove that file during the html-page-context event unless the condition were met.
See https://github.com/sphinx-doc/sphinx/issues/6241#issuecomment-705070598 for some examples and discussion.
cc @pradyunsg @akhmerov I added this repo to have a place to discuss outside of the mathjax-specific one

I'm still wondering if sphinx-proper is not a better place for this. Although perhaps making an extension first and moving it to sphinx is the fastest way to move forward.

Longer term I think that'd be a better home, but at least we can have a place to pay around with implementations  and use it more quickly than if it were in Sphinx

How is this different than adding a meta field to a page:
:customjs: download.js

Then adding a condition in the theme's layout.html (sloppy code):
{%- if meta is defined and meta is not none and 'customjs' in meta %}
     {%- set customjs = meta.get('customjs') %}
     <script src="_static/{{ pathto(customjs, 1) }}"></script>
{%- endif %}

and dropping download.js in the _static directory?

I think the challenge is how an extension could do this that is not a theme. I'm not sure how to modify a template on-the-fly at build time in a way that could work across multiple extensions.

Yea, we're basically trying to conditionally include js from sphinx.ext.mathjax, only on the pages w/ math elements.
I think for an MVP, that's what we should probably target.
I don't think we need a "solution that an extension can use", but rather have the user setting a value in conf.py - it might work out easier to implement, and pretty straight forward for a user familiar w/ HTML/JS (which is basically a prerequisite to understand the point of this). Obviously, we'd have a sane default but I don't imagine we need to cover all the bases here.

(no I've not looked at the code in this repo)
(yes, it's 5am and I've not slept - don't tell mom)

(no I've not looked at the code in this repo)

well there is no code in this repo, so you're in luck :-)

I don't think we need a "solution that an extension can use"

Well mostly I just want to also be able to use the pattern for https://github.com/executablebooks/sphinx-thebe/pull/14

@choldgraf one way could be to add a theme config collector to the html writer that collects boolean values, for example, if visit_math is executed then we would set a boolean value that could used by a default layout.html template to include mathjax on that page. Would want to define a spec if we were to pursue this avenue for context driven theme inclusions so all themes would adopt a naming convention (or extend from a base jupyter-book layout.html file).

Just pushed a proof-of-concept to main and updated some docs. Maybe @pradyunsg / @mmcky / @akhmerov would be interested in trying out this extension?
https://sphinx-conditional-asset.readthedocs.io/en/latest/

A few questions:

Do we have a clear use case that doesn't fit into a "doctree selector finds something in a document" approach that is used in sphinx-thebe now?
Should there be a way for the end user, not an extension author to achieve the same effect? As an example: the user is preparing documentation of their own jupyterlab extension for say drawing electrical circuits and doesn't want to make a separate sphinx extension. If yes, is it within the extension scope?
Does the extension make any promises about the order of including the assets?
Is it possible to override already existing behavior? (Mathjax I'm looking at you)


Named listeners

Support for named listeners analogous to similar capability in Kafka.

@rigelbm - i'm having second thoughts about putting the config related changes in rest-utils - please hold off reviewing until i've sorted that through.


Line breaks in usage

My generated usage text is way too long, so it generates a very narrow scrolling window in order view it all.
It would be awesome if there was a way to insert line breaks in the usage to make it look prettier.

Based on my skimming, this relates most closely to #19

Are you referring specifically to "usage" lines, such as this: https://github.com/fidelram/deepTools/blob/master/deeptools/computeMatrix.py#L61-L62 ?
At least in cases such as that with html output you can insert \n where ever you like. Regarding the documentation for the actual options, I agree that it'd be nice to choose between scrolling down and sideways.

@dpryan79 I'm talking more about the scrolling, I think. See my comments here for more info.
Happy to help dig in to this. Thanks for the reply!

This was annoying me too but the solution has nothing to do with sphinx-argparse. You end up needing to override the CSS style sheet that's applied. There are some nice step-by-step instructions here. I'll add a link to that in the documentation, since I expect many people would like to change this.

This is now documented in the develop branch.

Awesome thanks! @dpryan79++ 😄


WIP: Add sonarqube checking

This commit enables sonarqube and adds it to the push
action.
It is not able to run through successfully yet, since java
15 is not yet supported by it
Closes #6 once merged
Signed-off-by: Anton Oellerer<EMAIL_ADDRESS>

Sonarqube does not support java 15 with pattern matching instanceof yet (https://jira.sonarsource.com/browse/SONARJAVA-3505)


console-subscriber build error vs tokio v1.21.0

What crate(s) in this repo are involved in the problem?
console-subscriber
What is the issue?
One of the changes to make task::Builder::spawn* methods fallible in tokio 1.21.0 I think is causing a build error in console-subscriber
How can the bug be reproduced?
In this repo I just did cargo update and cargo build
Logs, error output, etc
   Compiling console-subscriber v0.1.7 (/Users/redshiftzero/Documents/console/console-subscriber)
error[E0308]: mismatched types
    --> console-subscriber/src/lib.rs:1066:12
     |
1061 | ) -> tokio::task::JoinHandle<T>
     |      -------------------------- expected `tokio::task::JoinHandle<T>` because of return type
...
1066 |     return tokio::task::Builder::new().name(_name).spawn(task);
     |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected struct `tokio::task::JoinHandle`, found enum `Result`
     |
     = note: expected struct `tokio::task::JoinHandle<_>`
                  found enum `Result<tokio::task::JoinHandle<_>, std::io::Error>`

For more information about this error, try `rustc --explain E0308`.
error: could not compile `console-subscriber` due to previous error
warning: build failed, waiting for other jobs to finish...

Versions
tokio 1.21.0
Possible solution
No response
Additional context
No response
Would you like to work on fixing this bug?
maybe

I have same problem

This should be an easy fix.


Do not depend on tachiyomiSy

Describe your suggested feature
If you can make a fork of original Mihon it will be better than tachiyomiSy
Other details
No response
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] If this is an issue with an official extension, I should be opening an issue in the extensions repository.
[X] I have updated the app to version 1.10.5.
[X] I will fill out all of the requested information in this form.

TachiyomiSY regularly takes updates from Mihon too. Is there any particular issue you think TachiyomiSY is worse than Mihon, I would love to know.

TachiyomiSY regularly takes updates from Mihon too. Is there any particular issue you think TachiyomiSY is worse than Mihon, I would love to know.

To be fare, tho I love tachiSY(and I think that froking from it is better), since it's using sql databases and reading from them then searching is much slower(or something like that can't remember correctly)

There is another opened issue mention that. I will try to see if I can merge Mihon's database management. Thanks.

Both Mihon & TachiyomiSY using same SQLite mechanism so nothing is different.


Chests not found.

The only chests that are being detected are the regular chest.

Thanks for the report! I've fixed it in the latest version of the mod.


Add a deprecated flag

When reviewing a crate, it would be nice to be able to flag a crate as deprecated (a boolean in the review file most likely). When listing dependencies, deprecated crates should appear with its own custom format/color.
Example of output:
deprecated   1  1    17700     91937 0/2 crate_name               0.0.1

The rules for declaring a crate as deprecated should be strict and non opinionated (sometimes, people tend to judge as "deprecated" a bit too fast ;)). I think that only crates declared as deprecated by their own author should be treated as such.

I think you should just mark it as rating: negative and put comment: deprecated. I want to avoid creating too many states, fields and concepts, because while it helps one use-case, it complicates everything else.

And then we can create a deprecation-bot we all trust to automatically give negative ratings & comments to deprecated crates. But if the bot makes an error, can we change/revoke a review, according to https://github.com/dpc/crev/issues/104 we should just update it by writing a new neutral review, however since neutral means "secure but with flaws" crev-lib/rc/doc/editing-package-review.md, neutral is not neutral, so either update the meaning of neutral or create a new status?
Also, since distrust propagates better than trust (a theory I remembered from reading some WoT papers), can we mark a user to trust just for distrust/negative reviews? :)

@bwbroersma That's a good comment.
Maybe I should just allow null (yaml ~ i believe) on rating to mean "no score".

Advisories are now implemented with critical field being a boolean. A non-critical advisory would pretty much mean that an upgrade is advised, for non-critical reasons.

I'm closing this one as done.


Datasource Name updation in Partition query

Hi Daniel ,
I am trying to deploy model through CICD , in my CD pipeline i am passing -S switch to run a script before deploying to update Data source name , credentials etc .
Command line passed from Devops :
TabularEditor.exe "$(ModelFilePath)"  -S "$(SetConnectionStringFromEnv)" -Deploy "Provider=MSOLAP;Data Source=$(AASServerUrl);User ID=$(AASAdminUser);Password=$(AASAdminPassword)" "$(ModelName)" -O -C -V -E
Script content : (updating name,credential and then looping through partition expression and replacing old data source name with new name)
var Con = Model.DataSources[0] as StructuredDataSource;                // Variable to store the first Connection
var Con1 = Model.DataSources[0] as StructuredDataSource;
Con.Name =  Environment.GetEnvironmentVariable("Name"); // Update DataSource Display Name
Con.AuthenticationKind="UsernamePassword";
Con.Username = Environment.GetEnvironmentVariable("SQLUserName");     // Update the SQL Username
Con.Password = Environment.GetEnvironmentVariable("LOADER-EDW-PWD");     // Update the SQL Password from KeyVault
Con.Database=Environment.GetEnvironmentVariable("SQLDatabaseName");   // Update the SQL Database Name
Con.Server=Environment.GetEnvironmentVariable("SQLServerName");      // Update the SQL Username
Con.Credential["path"]=Environment.GetEnvironmentVariable("ServerPath");   // Updates connection
foreach(var p in Model.AllPartitions.OfType())
{
p.Expression = p.Expression.Replace(Con1.Name,Con.Name);
}
The issue I am facing is that the connection name changes but in partition query data source name is still pointing to the old name due to which refresh fails with below error :

When I just run this c# script in Tabular editor's advanced scripting window  it works fine , even it automatically replaces connection in partition without specifying the partition loop to replace name at the end .
Not sure where I am going wrong here , could you help me on this .

Hi @debashish10
This code:
var Con = Model.DataSources[0] as StructuredDataSource; // Variable to store the first Connection
var Con1 = Model.DataSources[0] as StructuredDataSource;

Con.Name = Environment.GetEnvironmentVariable("Name"); // Update DataSource Display Name
//...
p.Expression = p.Expression.Replace(Con1.Name,Con.Name);

does nothing. Con1 and Con are references to the same object. So when you change Con.Name you will also have changed Con1.Name. Instead, store the original name in a variable:
var Con = Model.DataSources[0] as StructuredDataSource; // Variable to store the first Connection
var ConName = Con.Name; // Store the original name of the first connection

Con.Name = Environment.GetEnvironmentVariable("Name"); // Update DataSource Display Name
Con.AuthenticationKind="UsernamePassword";
Con.Username = Environment.GetEnvironmentVariable("SQLUserName"); // Update the SQL Username
Con.Password = Environment.GetEnvironmentVariable("LOADER-EDW-PWD"); // Update the SQL Password from KeyVault
Con.Database=Environment.GetEnvironmentVariable("SQLDatabaseName"); // Update the SQL Database Name
Con.Server=Environment.GetEnvironmentVariable("SQLServerName"); // Update the SQL Username
Con.Credential["path"]=Environment.GetEnvironmentVariable("ServerPath"); // Updates connection

foreach(var p in Model.AllPartitions.OfType())
{
p.Expression = p.Expression.Replace(ConName,Con.Name);
}

@otykier : Thanks a lot again , will try this right away .
Just one more question: can we avoid the loop to update in partition expression, as I can see in tabular editor once we change the name it automatically updates in partition query .

@otykier : for some reason the new script as suggested above also did not update the source name in partition , although the script perfectly works within tabular editor when I run in advanced scripting tab .

Hi @otykier : For some reason it still does not work , the script only changes the connection name but not data source name in partitions . I have tried with 3 different model now and it does not work . Not sure what am I missing here .

Maybe your problem is related to #662 and #559 ?

Hi Daniel,
Yes as the updation of source name is required one time in partitions i have  been doing this by using the -P flag. That solves the problem for me. Thanks a lot !!!


Add davinci-sdk instructions

See https://github.com/Cerebellum-Network/Freeport-Smart-Contracts/pull/31


Readme a bit confusing

After reading the documentation I'm not confident that I know how this works.
I already have existing projects that share a common linked package I have to relink to a shared folder. Do I run zelda for each of these and will magically maintain the links forever or do I have to rerun zelda after npm install? I'm not clear on how this works.
Also now I have a linked directory after running zelda on one of my projects "node_modules -> ." and all of my projects now see to automatically be linked.
All my projects are under in a single directory.

front (angular)
api (fastify)
cli (oclif)
shared

I ran zelda in my api folder.
edit: lots of edits because I accidently submitted before finishing.

This issue appears stale since it has been open for a while with no activity. I'm going to close it for now. If this is still issue, please feel free to leave a comment or open a new issue.


Training params

Can you describe the parameters format? I noticed that the param_all_norm.pkl file contains 62 extracted parameters of each image from you dataset. By the FaceProfiling code (http://www.cbsr.ia.ac.cn/users/xiangyuzhu/projects/HPEN/main.htm) I generated a dataset containing my own profiles, but I didn't understand how to create the pkl file using FaceProfiling output variables.

Thank you @cleardusk !
Just two more issues:

I think the expression param is 29, don't you?
Is the f scale factor the same generated by the FaceProfiling output?

Sorry for my mistake, the dimension expression param is exactly 29. The f scale factor is one of the fitting params, depending on the input image.

Great! Thank you again!

@cleardusk for pose param, have I to convert to rotation matrix and join the result to the translation array in order to obtain a 3x4 final matrix (consequently the 12-d pose param)?

I recommend using the matrix form, and normalize them with mean and std.

@cleardusk @julioalvess @joaootavio93  well, I'm still confused, I just reshape the 12-d pose param to 3x4 matrix form, then decomposite it to scale factor, rotation matrix and translation. Use the Rotation matrix to calculate pitch,yaw and roll, did I do something wrong?

May I ask the 12-d pose param is 3x4 camera matrix? The paper is said that 6-d pose parameters [f, pitch, yaw, roll, t2dx, t2dy].

same as @darchonyzx
Also, can somebody please give me a reference to understand more about FaceProfiling output variables and what those 199 shape params and 29 expression params are about? Because I don't really understand why 40 first params out of 199 are selected for this project...

@cnaaq You could refer the main.py and the python files it imports, and you will know how to use it. But as the owner @cleardusk  puts it the dlib face detecter may not be useful for the large pose face as 90 angle.
I test the pre-train model under the Multiple Face dataset, and there is a deviation for the 90 face. it works fine for the 75 ~ -75

@cnaaq the former 12 param of output is the pose param, the last column is the offset ,the former 3x3 is the rotation.

@darchonyzx Dlib has another version detector trained by CNN, but I had no chance to validate it. face_recognition project has related code and details. While I recommend using published detector framework based on CNN like MTCNN, SSH or your private detector for large pose face.

@cnaaq darchonyzx is right, main.py covers all the details.

@darchonyzx @cleardusk
Many thanks for your answers.
I still have two questions:
1. I can infer that offset (3 x 1 vector) is the offset of a fixed points (like tip of the nose) according to the center (or edge) of the image. but I don't understand why it should be 3D vector? We are dealing with 2D images.
2. As mentioned in this paper 'A 3D Face Model for Pose and Illumination Invariant Face Recognition', the focus is on neutral faces. According to this, I don't understand where 29 expression params and 10 params selected out of it come from.
Thanks again.

homogeneous coordinates.
199-d and 29-d are PCA coefficient params, the first 40-d and 10-d params are enough to represent 3D face.

How to convert the pose parameters (seven dimensions) of the 300W-LP data set into the parameters of 12 dimensions in your code? Could you please teach me how to achieve it?

何实现它吗？

Have you solved it yet?

@cnaaq输出的前12个参数是位姿参数，最后一列是偏移量，前3x3是旋转。

Hi, I was wondering, is there any connection between it and the Pose_Para (7-dimensional parameter) in the 300W-LP dataset?

@cnaaq输出的前12个参数是位姿参数，最后一列是偏移量，前3x3是旋转。

Hi, I was wondering, is there any connection between it and the Pose_Para (7-dimensional parameter) in the 300W-LP dataset?
Hello, have you found the solution to this problem?


in_list expression not working

Describe the bug
I am getting an error when i try to use the in_list expression: "Error during planning: Invalid function 'in_list'"
documentation link
To Reproduce
I am running this query in SessionContext::sql btw
select in_list('word', list) from data
where list is a utf8 array
Expected behavior
to return 'true'

In_list did not register as a UDF function.
the doc last updated by @izveigor.
hope @izveigor  help for check.

@izveigor sSorry I am a bit confused, can you give an SQL example?

@BubbaJoe, the document you linked is not for SQL functions. SQL scalar and aggregate functions can be found at https://arrow.apache.org/datafusion/user-guide/sql/scalar_functions.html#.
I believe we do not have an SQL function to check if an expression is in an array.

@jiangzhx Basically some of the functions and operators here:
https://www.postgresql.org/docs/9.2/functions-array.html
The most important being: array_length(anyarray), unnest(anyarray), and checking if an item is in an array.
Example: (select * from any(items) = 'item')
BTW this query seems to parse correctly in datafusion, i just get an Unsupported/implemented error. I would perfer this way instead of something like array_contains(anyarray, anyelement)
This is the error i get: "This feature is not implemented: Unsupported ast node in sqltorel: AnyOp(Identifier(Ident { value: \"items\", quote_style: None }))"

@izveigor Doesn't even parse the sql, it would need something like unnest to make the array elements into rows to be able to process it as a subquery.

https://github.com/apache/arrow-datafusion/issues/6075

Let me close this issue since in_list isn't here: https://arrow.apache.org/datafusion/user-guide/sql/scalar_functions.html
Thanks for the clarification!


Code highlight on README.md

"Informing" GitHub on code language will make sure highlight will work, improving readability.

Thanks!

Thanks!


Timholy teh/cm specialization

fixed the wrong type annotation.
This also needs better tests and dev documentation

Compile Times benchmark


Fix the invalid version comparison of apt packages.

Description
The strings of dpkg versions are more complex than the Gem::Version
and not compatible with it.
Using Gem::Version to compare versions of dpkg packages will cause
mistakes or raise the exeption of 'Malformed version number..'.
please see a simple example:
https://gist.github.com/komazarari/c6b33b29a0e31e9c62bbc2f0b2091647
Prefer to use the dpkg cli.
https://debian-handbook.info/browse/en-US/stable/sect.manipulating-packages-with-dpkg.html
[Please describe what this change achieves]
Issues Resolved
none
Check List

[ ] New functionality includes tests
[ ] All tests pass
[ ] RELEASE_NOTES.md, has been updated if required (not required for bugfixes, required for API changes)
[x] All commits have been signed-off for the Developer Certificate of Origin. See https://github.com/chef/chef/blob/master/CONTRIBUTING.md#developer-certification-of-origin-dco

Fwiw, this should fix: https://github.com/chef/chef/issues/6549

this looks reasonably fine.  i'm not positive the defensive programming is necessary.  the only real concern i'd have is performance, but it looks like it gets used at the tail end of a big if-else block in the superclass, so it isn't going to be called in most of the happy paths, and at any rate if performance becomes an issue then we just need to copy the c source into ruby -- and i'd vastly prefer to avoid that work if possible.

should also ideally include some unit tests, tho, for the cases that we broke

I've confirmed locally that this does the right thing when the package version contains a tilde


[drush] add 13

https://github.com/drush-ops/drush/releases/tag/13.0.0
https://www.drush.org/13.x/install/

actually duplicate of #5598


Set the window callback on the mock activity so callback is never null when the activity is created

Goal

Testing

Release Notes

WHAT:
WHY:
WHO:

#508  👈
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @bidetofevil and the rest of your teammates on  Graphite


Resize small iOS snapshot images

Kind (Required)

Improvement

Overview (Required)

If you use it a little more, it may be used up, so I think it would be better to make the image a little smaller if possible, but is it possible?

Links

@takahirom
Sorry for late response 🙇🏼

it would be better to make the image a little smaller if possible

I think so too. But if make the image smaller, snapshot tests are failed even if I specified lower precision value (0.6).
So I think there are some choices about this.

Continue with current image size
Stop to use Git LFS
Stop to test iOS snapshot testing

If above choices are not good, this is okey I think.

@ry-itto
Thank you for your response 🙏

I think so too. But if make the image smaller, snapshot tests are failed even if I specified lower precision value (0.6).

Did you use the scale option?
https://github.com/pointfreeco/swift-snapshot-testing/pull/396/files#diff-3e1681b0623d05afda1993aa39ee2ae8641918d2e1df61acf80b1a367dada06fR14

@takahirom
Thank you for your suggestion!
When I tried to use it, it works. (about reducing 75% in my local environment)
So I will make a pull request about it 🙏🏼

Thank you for addressing this issue!

Current 👀


One OEM key was not accepted

OEM Product Key: 22495-OEM-0081478-38834
That key was not accepted when installing W95 OSR2.5 OEM (win95c_osr2.5_OEM-FullSetup_PLUS_cd_type09_19971201.iso).
I generated a new key (OEM Product Key: 09496-OEM-0091004-83890) and it worked.

Thank you for the report! This has been fixed in v1.0.3


Custom post path parameter

Fix #319
Hi, guys.
I really need a feature like that, once that my application uses a proxy for receiving events.
I created that issue some time ago but got no answer, so I decided to fork it and do it by myself using the snowplow/snowplow-objc-tracker#409 as an example.
It's my first time opening a pr in an opensource tool, so please tell me if I'm doing something wrong. :pray:
Thanks.

Coverage increased (+0.07%) to 76.852% when pulling 8689b327f215a6748cdd0e9d72c361066b564ab5 on theosato:feature/post-path-parameter into 4aec6ffcd83eafb9b4fdf66d9dd78cb262dd815f on snowplow:master.

Hi @theosato thanks so much for your PR!  This should go into the next release after 1.3.0 but will let @oguzhanunlu confirm...

Hi @theosato , thanks for the contribution! Please sign the CLA first and then we can incorporate your work into the next release after 1.3.0.

@theosato , this is an important issue and we've decided to hold 1.3.0 release to include this. Please sign the CLA at your earliest convenience so that we can proceed.

@oguzhanunlu already signed the forms with CLA stuff. Do I need to do something else in that PR? :slightly_smiling_face:

Thanks, man! You rock, guys! :+1:

Hi @oguzhanunlu, One question here, I was looking in the Snowplow Emitter documentation if there is way to send requests to a custom path on POST for data analysis purposes and I came up with this opened PR.
I see that the Proposed changes were approved but they were not released and they only exist on the release/1.3.0-copy branch , is there any plan to recap them and release or should we fork from here ?

Hi @soulrainx , thanks for the heads up. I'll take care to merge this feature in the next Android version.

Closing as the code has been imported on PR #356


Normalization

Hello,
It seems that you do not normalize your entropy values in Leibovici Entropy. Are there reasons why you chose not to?
Thanks

This package offers merely just the direct implementation of the two entropy, as for any post processing it’s just no in consideration.


Add method for getting all cache keys

Implemented the (*cache) Keys() method returning a sorted slice of all
keys in the cache.

Found this fork: https://github.com/arp242/zcache


crate2nix: init at 0.8.0

crate2nix is a tool that "generates nix build files for rust crates
using cargo".

Motivation for this change
For flakes-enabled Rust projects, it would be very nice to rely on crate2nix through Nixpkgs, rather than having to add a non-flake input. If it's in Nixpkgs, it's built by Hydra, and the result will be uploaded to the cache, meaning users don't have to rebuild it every time (themselves, at least).
Closes https://github.com/kolloch/crate2nix/issues/137.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

cc @andir @kolloch: I added you two as maintainers for obvious reasons -- if, for whatever reason, you'd rather not be added, let me know and I'll remove your name.

Result of nixpkgs-review pr 104027 1

1 package built:

crate2nix

Wouldn't it make sense to include tools.nix as well to generate the build file on the fly?

Can't say I've ever used tools.nix. Feel free to open a PR adding the functionality you expect, but I'm totally unfamiliar with it / what it would be used for.

Wouldn't it make sense to include tools.nix as well to generate the build file on the fly?

You should be able to use ${crate2nix.src}/tools.nix in a string context when #117560 is merged.


avoid buffer overflow in selectCharset

selectCharset() could overflow when called with incorrect parameters.
if CharSets.all.keys.contains(p [1]){ a few lines down fails if count < 2 and by returning early this can no longer happen.

Thank you for this change!


Any way to reset the context/state of the wizard?

I was wondering if there is a way to reset the state of the wizard so that it can be used again after finishing without reloading the page?
Thanks in advance.

Hi @hiddedv9, right now it is not that easy to reset a finished wizard without reloading the page. Technically you can add an event on the last step to RESET the process, and use "send" to send RESET event on onComplete, though I haven't fully tested that workaround. I'm working on restructuring how the wizard looks and also the logic to support this in the upcoming days, so the next version will have this feature supported.


URL query parameter nogui  not working.

Using the latest version of both, I'm trying to use ?nogui=true in the URL, and it seems like it is not supported with LiveAtlas.

I'm also interested in that feature, it would be helpful when using iframes!


Add ability to "kill"/stop a scanpipe run in progress

It would be useful to have the ability to "kill"/stop a scanpipe run in progress

The work on this is happening in https://github.com/nexB/scancode.io/issues/176


Uninstall does not delete Image automation CRD

Hi, I'm using Image automation CRDs in my cluster. My cluster is has a set up to fetch images from Azure ACR and there was an issue with fetching the images. So I tried to uninstall the flux and reinstallling the flux, but flux uninstall command does not clean up the image automation ACRs.
flux uninstall
Are you sure you want to delete Flux and its custom resource definitions: y
► deleting components in flux-system namespace
► deleting toolkit.fluxcd.io finalizers in all namespaces
► deleting toolkit.fluxcd.io custom resource definitions
✔ CustomResourceDefinition/imagepolicies.image.toolkit.fluxcd.io deleted
✔ CustomResourceDefinition/imagerepositories.image.toolkit.fluxcd.io deleted
✔ Namespace/flux-system deleted
✔ uninstall finished

after the delete
k get crd -A
...
imagepolicies.image.toolkit.fluxcd.io            2022-09-08T22:32:15Z
imagerepositories.image.toolkit.fluxcd.io        2022-09-08T22:32:15Z

Even I tried to force delete, it still does not work:
 k delete crd imagepolicies.image.toolkit.fluxcd.io --force --grace-period=0
warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
customresourcedefinition.apiextensions.k8s.io "imagepolicies.image.toolkit.fluxcd.io" force deleted

After that, it still shows up
k get crd -A
NAME                                             CREATED AT
..
imagepolicies.image.toolkit.fluxcd.io            2022-09-08T22:32:15Z
imagerepositories.image.toolkit.fluxcd.io        2022-09-08T22:32:15Z
...

Can someone help me how to clean up the CRD properly?

This seems to be the finalizer setting in the CRD - once the finalizers are removed manually, CRD were cleaned up. However, I believe this needs to be sorted by flux uninstall command

Are you using the latest version of Flux? If not get the latest and see if it fixes the issue for you.

Here is the flux version of the issue:
flux --version
flux version 0.30.2

flux version
flux: v0.30.2
helm-controller: v0.22.2
image-automation-controller: v0.24.1
image-reflector-controller: v0.20.0
kustomize-controller: v0.27.0
notification-controller: v0.25.1
source-controller: v0.26.1

I will update it with newest version of flux shortly

k get crd
NAME                                             CREATED AT
alertproviders.flagger.app                       2022-08-31T20:41:08Z
alerts.notification.toolkit.fluxcd.io            2022-09-12T22:47:02Z
authorizationpolicies.security.istio.io          2022-08-31T20:40:38Z
buckets.source.toolkit.fluxcd.io                 2022-09-12T22:47:03Z
canaries.flagger.app                             2022-08-31T20:41:08Z
certificaterequests.cert-manager.io              2022-08-31T20:40:01Z
certificates.cert-manager.io                     2022-08-31T20:40:01Z
challenges.acme.cert-manager.io                  2022-08-31T20:40:02Z
clusterissuers.cert-manager.io                   2022-08-31T20:40:02Z
destinationrules.networking.istio.io             2022-08-31T20:40:38Z
envoyfilters.networking.istio.io                 2022-08-31T20:40:38Z
gateways.networking.istio.io                     2022-08-31T20:40:38Z
gitrepositories.source.toolkit.fluxcd.io         2022-09-12T22:47:01Z
helmcharts.source.toolkit.fluxcd.io              2022-09-12T22:47:01Z
helmreleases.helm.toolkit.fluxcd.io              2022-09-12T22:47:02Z
helmrepositories.source.toolkit.fluxcd.io        2022-09-12T22:47:01Z
imagepolicies.image.toolkit.fluxcd.io            2022-09-12T22:47:02Z
imagerepositories.image.toolkit.fluxcd.io        2022-09-12T22:47:01Z
imageupdateautomations.image.toolkit.fluxcd.io   2022-09-12T22:47:03Z
issuers.cert-manager.io                          2022-08-31T20:40:02Z
istiooperators.install.istio.io                  2022-08-31T20:40:38Z
kustomizations.kustomize.toolkit.fluxcd.io       2022-09-12T22:47:01Z
metrictemplates.flagger.app                      2022-08-31T20:41:08Z
ocirepositories.source.toolkit.fluxcd.io         2022-09-12T22:47:01Z
providers.notification.toolkit.fluxcd.io         2022-09-12T22:47:03Z
receivers.notification.toolkit.fluxcd.io         2022-09-12T22:47:02Z
...
...

After:
...
ocirepositories.source.toolkit.fluxcd.io         2022-09-12T22:47:01Z
...

This issue still exists with ocirepositories.source.toolkit.fluxcd.io crd

k edit crd ocirepositories.source.toolkit.fluxcd.io

# Please edit the object below. Lines beginning with a '#' will be ignored,
# and an empty file will abort the edit. If an error occurs while saving this file will be
# reopened with the relevant failures.
#
apiVersion: apiextensions.k8s.io/v1
kind: CustomResourceDefinition
metadata:
  annotations:
    controller-gen.kubebuilder.io/version: v0.7.0
  creationTimestamp: "2022-09-12T22:47:01Z"
  deletionGracePeriodSeconds: 0
  deletionTimestamp: "2022-09-13T19:56:51Z"
  finalizers:
  - customresourcecleanup.apiextensions.k8s.io
  generation: 1

I see finalizer is still there after the deletion, which I had to update manually.
This issue went aware with other crd like
imagepolicies.image.toolkit.fluxcd.io            2022-09-12T22:47:02Z
imagerepositories.image.toolkit.fluxcd.io        2022-09-12T22:47:01Z
imageupdateautomations.image.toolkit.fluxcd.io   2022-09-12T22:47:03Z

Also, I downloaded fluxcd via terrafrom provider 0.18.0 which is the latest

I think this may be resolved in Flux 0.34.0
There are some labels which are placed on the Flux CRDs to make them detected for the uninstaller to delete them. I noticed in a recent version that for some reason, I was not seeing OCIRepository deleted, for example. When I upgraded to Flux 0.34.0, I noticed that issue went away. (I was also testing with Flux 0.33.x prior to that when I noticed the issue.)
If the labels are missing in the current version and you've tried upgrading everything today, then it may be a bug in the Terraform provider. Please test again with the current version and let us know what you find. I think it's unconventional to use flux uninstall together with the Terraform Provider, but I don't think there is any reason why it shouldn't work.


[ADAP-781] [Feature] Add an option to use INFORMATION_SCHEMA for partition info retrieval

Is this your first time submitting a feature request?

[X] I have read the expectations for open source contributors
[X] I have searched the existing issues, and I could not find an existing issue for this feature
[X] I am requesting a straightforward extension of existing dbt-bigquery functionality, rather than a Big Idea better suited to a discussion

Describe the feature
So far there are few places where dbt-bigquery access partitions information:

In incremental materialization, _dbt_max_partition is declared (when used in a model) and stores the max partition
In get_partitions_metadata macro that returns the partitions information for input model
In incremental insert_overwrite materialization and before the MERGE statement with dynamic partitions to store them in dbt_partitions_for_replacement and use it in the predicate
In incremental insert_overwrite materialization and before the copy partitions statement with dynamic partitions to iterate on the partitions to replace

Allowing to use INFORMATION_SCHEMA data would reduce the amount of data scanned.
More details are available on https://cloud.google.com/bigquery/docs/information-schema-partitions.
As this table is still in Preview, it's likely safer to provide as an alternative to current method.
To access that new method, adding partition_information settings to partition_by config block so that without value the default is current behavior or with explicit value "model" or use information schema with value "information_schema" to use the new approach.
This issue is similar to https://github.com/dbt-labs/dbt-bigquery/issues/286 but intend to rely on existing macros and solutions as well replacing under the hood accesses to improve overall performances.
Describe alternatives you've considered
We could try to set the config at connection level (profiles.yml) but doing so would change the API for existing macros and wouldn't be as convenient as accessing model config block.
Who will this benefit?
Anyone using incremental strategy with fairly large partitions as the current approach can be costly and and slightly slow compared to the metadata approach.
Are you interested in contributing this feature?
yes
Anything else?
No response

I just though about one usecase where it doesn't exactly work the same way: if you do MAX(my_partition_timestamp). Then with INFORMATION_SCHEMA, it would be truncated to HOUR or DAY since it's the partition_id that we would use.
Having an hybrid mode where we would have the the partition id retrieved and then filtered on the actual MAX(my_partition_timestamp). I tested it manually and it's much more efficient.

implementing #914 surfaced that some partition info is not available in the INFO SCHEMA, namely the partitions associated with a materialized view Internal Slack thread.
@wazi55 provided a workaround using the python client, but tacking onto this issue that it should be there.

Moving to python instead of SQL for that case appears to be adding quite a lot of complexity in my opinion.
Is it a blocker that materialized views are not fully supported? The implementation I'm offering is allowing to use the current strategy ("model") and we might discuss with Google team to support MV in INFORMATION_SCHEMA.

You should be able to use a python model https://docs.getdbt.com/docs/build/python-models and reference the model as a part of your dbt model. There is a ticket raised internally at Google, but like anything, it will take a few weeks to get implemented.

I'm closing this for now due to a project we have picking up to be announced soon that should make this a more delightful experience.


Implement operator overloading methods (for external opaque types)

I am implementing a derivation of a Semver in rust. Since there's a fair bit of logic behind it, I want to implement it as an opaque type.
And since the type is implemented in an external rust crate (from: https://cjycode.com/flutter_rust_bridge/guides/miscellaneous/methods), it looks like this:
#[frb(external)]
impl MyVersion {
    #[frb(sync)]
    pub fn new(
        _major: u8,
        _minor: u8,
        _patch: u8,
        _extrabit: u8,
        _modifier: u8,
    ) -> Self {
    }

Now, I'd like to be able to use the dart comparison overloads (==,>,=>, etc) to make the api nicer to work with (Strict reference/pointer equality is not important). In the docs, you describe that this can be implemented using arbitrary dart_code (https://cjycode.com/flutter_rust_bridge/guides/miscellaneous/dart-code). However, that annotation seems only usable on struct definitions, not on impl blocks.
I think that, ideally, operators should be first-class citizens, much like pyo3 handles magic functions. Probably even something simple like function renaming #[frb(name="operator==")] would work, although then you'd still need to somehow declare the need for @overload.
What do you think?

Looks pretty reasonable! One way may be the rename you mentioned, and another way may be utilize the PartialEq / Eq / Ord / ....

I meant @override in Dart. Since that is what things like operator== require

I see. Indeed that is optional - the linter will be unhappy without it, but it is just linter instead of compiler, and you can // ignore_for_file for it


Mock-SAS for test WINNF.FT.D.REG.4 accepts CAT B devices

Test title WINNF.FT.D.REG.4 in Winnforum 122 document is for CAT A CBSDs. However Mock-SAS accepts in Registration Request also CAT B CBSDs for this test case.

Can this be solved by adding "cbsdCategory": "A" in the expected json file for this test case?
I think this is the simplest solution.

Fixed in pull-request #77

Issue fixed in latest release. Closing issue.


fix(versions): update Activiti/example-runtime-bundle versions into master

UpdateBot pushed helm dependency: common to: 0.0.1

UpdateBot commands:
updatebot push-version --kind helm common 0.0.1


AddressBook with multiaddr confidence

As part of the PeerStore improvements epic, we intend to add multiaddr confidence into the AddressBook.
Background
When js-libp2p dials a peer, it tries to dial several known addresses of a peer in parallel. We use a token based dialer to not use a lot of resources to a single connection. However, we don't have a good way of deciding which subset of addresses we should try first. If we gather metrics from peer addresses stored in the PeerStore, we can create a scoring function for the addresses.
Goals

Know when multiaddrs are successful and when they fail so we can keep track of their confidence (take aborted dials into account)
Understand the confidence in each multiaddr of a peer so we can manage addresses we store/use/exchange

WIP Notes

If we dial multiple addrs, and we abort the slower addrs, take into account the confidence of the fastest address

Update on success, update on failure, aborts are no ops
When the Abort is a timeout abort, treat as a failure for all addresses that were tried

Need to account for low dial timeouts poisoning potentially valid address confidence

Potentialy weight low dial timeout confidence adjustments

Parameters: latency, availability, last connection timestamp
Score function

Relevant Issues

libp2p/specs#164

This is no longer relevant as we no longer dial peers in parallel https://github.com/libp2p/js-libp2p/issues/2090 and we also sort multiaddrs per peer to be dialled via smart dialling https://github.com/libp2p/js-libp2p/issues/2010


Class 'Dingo\Api\Auth\Provider\OAuth2' not found

Has this been removed?

but it still in the document


unable to install

Connecting to github.com (<IP_ADDRESS>:443)
wget: server returned error: HTTP/1.1 404 Not Found
tar: invalid magic
tar: short read
ERROR: Service 'openvpn' failed to build: The command '/bin/sh -c apk add --update bash openvpn easy-rsa iptables  &&     ln -s /usr/share/easy-rsa/easyrsa /usr/local/bin &&     wget https://github.com/pashcovich/openvpn-user/releases/download/v1.0.4/openvpn-user-linux-${TARGETARCH}.tar.gz -O - | tar xz -C /usr/local/bin &&     rm -rf /tmp/* /var/tmp/* /var/cache/apk/* /var/cache/distfiles/*' returned a non-zero code: 1

full log
Building openvpn
Step 1/6 : FROM alpine:3.16
---> 187eae39ad94
Step 2/6 : ARG TARGETARCH
---> Running in 0e6e95bb771f
Removing intermediate container 0e6e95bb771f
---> db79a1c8010d
Step 3/6 : RUN apk add --update bash openvpn easy-rsa iptables  &&     ln -s /usr/share/easy-rsa/easyrsa /usr/local/bin &&     wget https://github.com/pashcovich/openvpn-user/releases/download/v1.0.4/openvpn-user-linux-${TARGETARCH}.tar.gz -O - | tar xz -C /usr/local/bin &&     rm -rf /tmp/* /var/tmp/* /var/cache/apk/* /var/cache/distfiles/*
---> Running in 367306a8af32
fetch https://dl-cdn.alpinelinux.org/alpine/v3.16/main/x86_64/APKINDEX.tar.gz
fetch https://dl-cdn.alpinelinux.org/alpine/v3.16/community/x86_64/APKINDEX.tar.gz
(1/17) Installing ncurses-terminfo-base (6.3_p20220521-r1)
(2/17) Installing ncurses-libs (6.3_p20220521-r1)
(3/17) Installing readline (8.1.2-r0)
(4/17) Installing bash (5.1.16-r2)
Executing bash-5.1.16-r2.post-install
(5/17) Installing openssl (1.1.1v-r0)
(6/17) Installing easy-rsa (3.0.8-r0)
(7/17) Installing libmnl (1.0.5-r0)
(8/17) Installing libnftnl (1.2.3-r0)
(9/17) Installing iptables (1.8.8-r1)
(10/17) Installing libcap (2.64-r1)
(11/17) Installing libbz2 (1.0.8-r1)
(12/17) Installing fts (1.2.7-r1)
(13/17) Installing xz-libs (5.2.5-r1)
(14/17) Installing libelf (0.186-r0)
(15/17) Installing iproute2-minimal (5.17.0-r0)
(16/17) Installing lzo (2.10-r3)
(17/17) Installing openvpn (2.5.6-r1)
Executing openvpn-2.5.6-r1.pre-install
Executing busybox-1.35.0-r17.trigger
OK: 14 MiB in 31 packages
Connecting to github.com (<IP_ADDRESS>:443)
wget: server returned error: HTTP/1.1 404 Not Found
tar: invalid magic
tar: short read
ERROR: Service 'openvpn' failed to build: The command '/bin/sh -c apk add --update bash openvpn easy-rsa iptables  &&     ln -s /usr/share/easy-rsa/easyrsa /usr/local/bin &&     wget https://github.com/pashcovich/openvpn-user/releases/download/v1.0.4/openvpn-user-linux-${TARGETARCH}.tar.gz -O - | tar xz -C /usr/local/bin &&     rm -rf /tmp/* /var/tmp/* /var/cache/apk/* /var/cache/distfiles/*' returned a non-zero code: 1

TARGETARCH variable is not defined in your case.
It looks like  you use  old version  Docker packages, try to update them


Automated Package Upgrade

:tada: This PR is included in version 7.0.170 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Get the basic FACTS workflow running!

kd_running is branched off of dev

Using the python3 runFACTS.py experiments/X.py method to try launching the runs

[ ] ar5k14.rcp26
[ ] ar5k14.rcp45
[ ] ar5k14.rcp85
[ ] bamber19.ssp245
[ ] bamber19.ssp585
[ ] coupling.ssp119
[ ] coupling.ssp126
[ ] coupling.ssp245
[ ] coupling.ssp370
[ ] coupling.ssp585
[ ] coupling.ssp585.larmipextrap
[ ] dummy
[ ] dummy.input
[ ] emulandice.ssp585
[ ] esl.ssp126
[ ] esl.ssp585
[ ] fittedismip.ssp585
[ ] global.coupling.ssp245
[ ] larmip.ipccar6.ssp585
[ ] onemodule
[ ]  tlm.global
[ ] tlm.local


Move checkpointing code from Composable onto _checkpointable class

All attributes, methods related to checkpointing should be moved onto the writer classes (which inherit from _checkpointable.
Specifically, the methods Composable.job_done() and the attribute Composable.checkpointable should be shifted onto _checkpointable. The redundant attribute self._checkpointable should be removed.

We have eliminated support for checkpointable apps.


Highlight js is removing the indentation when displayed

This snippet of css should fix it.
td.hljs-ln-code {
	white-space: pre-wrap;
}


Plot xxx.plot has a farmer public key that is not in the farmer's pk list.

Unable to detect my plot file using "Chia Start Harvester",The error message was "Plot XXX. Plot has a farmer public key that is not in the farmer's PK list.", but I used" Chia plots to check" it was normal

thx

then you set wrong keys when plotting, make sure farmer and public key are not flipped

then you set wrong keys when plotting, make sure farmer and public key are not flipped

Yes, I sure farmer and public key are not flipped, these are my running parameters
chia_plot -n 1 -r 4 -t /mnt/ssd/ -d /mnt/ssd/ -p a2f9...ce0a -f 817e...5969

chia plots check will just show whatever you give chia_plot, you have to compare to chia keys show.


InternalError (see above for traceback): Blas SGEMM launch failed

I cloned and executed this code in my server with a single GPU, but the error message is shown as follows:
E tensorflow/stream_executor/cuda/cuda_blas.cc:372] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED
W tensorflow/stream_executor/stream.cc:1390] attempting to perform BLAS operation using StreamExecutor without BLAS support
E tensorflow/stream_executor/cuda/cuda_blas.cc:372] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED
W tensorflow/stream_executor/stream.cc:1390] attempting to perform BLAS operation using StreamExecutor without BLAS support
Traceback (most recent call last):
File "rnn.py", line 340, in
test_RNN()
File "rnn.py", line 322, in test_RNN
stats = model.train(verbose=True)
File "rnn.py", line 270, in train
train_acc, val_acc, loss_history, val_loss = self.run_epoch(new_model=True)
File "rnn.py", line 234, in run_epoch
loss, _ = sess.run([loss, train_op])
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 766, in run
run_metadata_ptr)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 964, in _run
feed_dict_string, options, run_metadata)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1014, in _do_run
target_list, options, run_metadata)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1034, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Blas SGEMM launch failed : a.shape=(1, 70), b.shape=(70, 35), m=1, n=35, k=70
[[Node: MatMul = MatMul[T=DT_FLOAT, transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/gpu:0"](concat, Composition/W1/read)]]
[[Node: add_6/_17 = _Recvclient_terminated=false, recv_device="/job:localhost/replica:0/task:0/cpu:0", send_device="/job:localhost/replica:0/task:0/gpu:0", send_device_incarnation=1, tensor_name="edge_299_add_6", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/cpu:0"]]
Caused by op u'MatMul', defined at:
File "rnn.py", line 340, in
test_RNN()
File "rnn.py", line 322, in test_RNN
stats = model.train(verbose=True)
File "rnn.py", line 270, in train
train_acc, val_acc, loss_history, val_loss = self.run_epoch(new_model=True)
File "rnn.py", line 230, in run_epoch
logits = self.inference(tree)
File "rnn.py", line 50, in inference
node_tensors = self.add_model(tree.root)
File "rnn.py", line 107, in add_model
node_tensors.update(self.add_model(node.left))
File "rnn.py", line 107, in add_model
node_tensors.update(self.add_model(node.left))
File "rnn.py", line 108, in add_model
node_tensors.update(self.add_model(node.right))
File "rnn.py", line 111, in add_model
curr_node_tensor=tf.nn.relu(tf.matmul(child_tensor,W1) + b1)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/math_ops.py", line 1729, in matmul
a, b, transpose_a=transpose_a, transpose_b=transpose_b, name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/gen_math_ops.py", line 1442, in _mat_mul
transpose_b=transpose_b, name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/op_def_library.py", line 759, in apply_op
op_def=op_def)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 2240, in create_op
original_op=self._default_original_op, op_def=op_def)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 1128, in init
self._traceback = _extract_stack()
InternalError (see above for traceback): Blas SGEMM launch failed : a.shape=(1, 70), b.shape=(70, 35), m=1, n=35, k=70
[[Node: MatMul = MatMul[T=DT_FLOAT, transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/gpu:0"](concat, Composition/W1/read)]]
[[Node: add_6/_17 = _Recvclient_terminated=false, recv_device="/job:localhost/replica:0/task:0/cpu:0", send_device="/job:localhost/replica:0/task:0/gpu:0", send_device_incarnation=1, tensor_name="edge_299_add_6", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/cpu:0"]]
My GPU information:

This code works fine with CPU server, but I can't figure out what's wrong with my GPU server......
Is there any suggestion? Thanks.

I just settled this by setting the configuration in the sessions of the functions "predict" and "run_epoch" as follows:
config = tf.ConfigProto()
config.gpu_options.allow_growth = True
tf.Session(config=config)


Question regarding nested routers

I'm trying to build an API with paths like so:
domain.com/api/v1/sites/:siteId/a/sub_a/xyz,
domain.com/api/v1/sites/:siteId/b/sub_b/abc
domain.com/api/v1/sites/:siteId/b/sub_b/abc/1
To make things simpler, I would like my directory structure to mirror the API structure. I almost have it setup correctly such that /routes/v1/index.ts is the base route, and then I import the sub-path routers from the directories below and router.use(a.routes()), etc. The problem is, you can create a path like domain.com/api/v1/totalgibberish/moregibberish/a and it matches and goes to a's router. Basically, any prefix+endpoint that I've route.use()'d can just be tacked on the end of an invalid route and it becomes valid.
Is there a way to implement this approach properly? I like the idea of that the sub-paths don't need to know anything about what's above them in the hierarchy, they just get imported by the thing above them. I know I could use some middleware or the like to check the full path at each sub-route to see if it's valid, but that defeats the purpose.

Stack Overflow is probably the best place to ask questions like this—I don't think you'll find as much help on the issues board here.


Example code not working

Running the example code throws the following exception:
AttributeError: 'module' object has no attribute 'SendGridClient'
https://sendgrid.com/docs/Integrate/Code_Examples/v2_Mail/python.html

Hello @DannyLee12,
What version of the Python library are you using?
I'm guessing that you are using a version of our library that does not support v2. In that case, this would be the example you would use.

Thanks, I'm using the latest version which I assume is version 3 and it works fine. Should be in big block letters on your FAQ: If you get AttributeError: 'module' object has no attribute 'SendGridClient', you are using V3
Otherwise, if possible, can you add the following code to your code example. I think that many if not all people who use this need to send mails to multiple addresses.
        sg = sendgrid.SendGridAPIClient(apikey=SENDGRID_API)
        from_email =<EMAIL_ADDRESS>'workflow')
        content = Content("text/plain", text)
        to_email =<EMAIL_ADDRESS>'Daniel Lee')

        mail = Mail(from_email, subject, to_email, content)

        # Add Other email addresses to the Personalization class
        personalization = Personalization()
<EMAIL_ADDRESS>'Test Account 1'))
<EMAIL_ADDRESS>'Test Account 2'))
<EMAIL_ADDRESS>'Test Account 3'))

        # Add the personalization class to the mail class
        mail.add_personalization(personalization)

        # Send mail and get info
        response = sg.client.mail.send.post(request_body=mail.get())

Think about it, I can do it in a PR but this Issue is closed regardless.

Hi @DannyLee12,
Thanks for the follow up!
Regarding your multiple email example, could you please lend your vote to this issue, to help bump it up the queue?
Regarding the documentation change, I'd like to get feedback on @eschallock on that one.
Could you also please describe your path to that page? I think that will help us think about the overall workflow. Thanks!


Update README.md

Added some links #2

@gabrysia694 amazing work!!! Thankyou. Im building another project called Starter Hive, would love to collab with you on that.


Restore database from pv backup

Hi - first of all, fantastic repository. Great to see all the hard work you've put into this.
I have in mind a scenario and would like to know to what extent this is supported already or would need to be a feature request:
After a catastrophic event, the entire cluster is deleted. However, the administrator specified a reclaim policy of retain on the  storage class that backed the original database volumes, and the cloud provider has retained these volumes, which are immediately re-mounted to a new cluster as persistent volumes. Since the old cluster has been destroyed, the administrator would like to quickly restore the database by referencing the new volume he just created in a new Kubegres deployment.
Something like this comes to mind:
apiVersion: kubegres.reactive-tech.io/v1
kind: Kubegres
...
restoreFromVolume: [pv-name]

Thanks!

Thank you for your message. Sorry I could not reply earlier. I was away for a couple of weeks.
I agree that the support of kind: "VolumeSnapshot" would be very valuable.
I am adding this feature in backlog. However, it may take sometimes before it is implemented because I am the only resources assigned to Kubegres from my company. Unless if another dev decides to help by sending a pull request for this feature.

It might be nice for the automated backups to allow for backups to object storage rather than assuming volume-based backups (for example, I pg_dumpall to S3).

Hi, thank you for your kind feedback.
Currently the way we do restoration is manual: we create a new cluster of Postrgres with Kubegres with one Primary only (no replicas). Using kubectl we directly access to the Primary Pod and we use the Postgres official liberaries to apply restorations from an external volume. The external volume is manually mounted by editing the Primary's Statefulset.
Once the restoration is completed, we increase the number of instances of Postgres in the cluster with Kubegres YAML which then creates Replica Pods.
If I understand, you would like to automatise the process above by introducing a new field (restoreFromVolume) in the YAML?

Hi, using this thread instead of creating a new issue as I have queries related to this issue.
From your earlier reply, am I right to say that the only way I am able to access the backed up files is to create a new Pod and mount it with the PVC? Also, could you elaborate more on increasing the number of instances of Postgres with Kubegres YAML? Sorry if I'm asking something that has been asked before, I tried looking around but could not find anything.
Thanks in advance!


ro.product.device isn't universal

The ro.product.device property is set for a Glowlight 3 (aka nook_ntx_6sl), so flashing factory updates from BN on a Glowlight Plus fail due to the mismatch.
(Easy enough to fix, just annoying)

Uploaded new release (3.3.1), ro.product.device now changed to "ntx_6sl".


set housingneeds_type to none of the above if no housingneeds selected

Should this have a test? Does it require updating prod data?

Should this have a test? Does it require updating prod data?

@baarkerlounger, no changes needed to the prod data, not sure about the test. I guess it should be covered by the import tests, but I think all that tests is that importing it twice imports it the same way (?)

@kosiakkatrina how come no production data changes? Aren't we introducing a new value here? Or are we saying there's currently no logs in production with this scenario?
For tests I meant a failing test for this change.

@baarkerlounger I've already updated it when I did the update for the previous PR. I just realised that the import needs to be updated too


raise exception when an empty config file is passed to load_kube_config

load_kube_config currently fails with a nondescript TypeError: 'NoneType' error if an empty kube_config file is used.
Error log
~/miniconda3/envs/dask/lib/python3.8/site-packages/kubernetes/config/kube_config.py in load_kube_config(config_file, context, client_configuration, persist_config)
    790         config_file = KUBE_CONFIG_DEFAULT_LOCATION
    791
--> 792     loader = _get_kube_config_loader(
    793         filename=config_file, active_context=context,
    794         persist_config=persist_config)

~/miniconda3/envs/dask/lib/python3.8/site-packages/kubernetes/config/kube_config.py in _get_kube_config_loader(filename, config_dict, persist_config, **kwargs)
    744         **kwargs):
    745     if config_dict is None:
--> 746         kcfg = KubeConfigMerger(filename)
    747         if persist_config and 'config_persister' not in kwargs:
    748             kwargs['config_persister'] = kcfg.save_changes

~/miniconda3/envs/dask/lib/python3.8/site-packages/kubernetes/config/kube_config.py in __init__(self, paths)
    671             self._load_config_from_file_like_object(paths)
    672         else:
--> 673             self._load_config_from_file_path(paths)
    674
    675     @property

~/miniconda3/envs/dask/lib/python3.8/site-packages/kubernetes/config/kube_config.py in _load_config_from_file_path(self, string)
    693                 if os.path.exists(path):
    694                     self.paths.append(path)
--> 695                     self.load_config(path)
    696         self.config_saved = copy.deepcopy(self.config_files)
    697

~/miniconda3/envs/dask/lib/python3.8/site-packages/kubernetes/config/kube_config.py in load_config(self, path)
    703             config_merged = copy.deepcopy(config)
    704             for item in ('clusters', 'contexts', 'users'):
--> 705                 config_merged[item] = []
    706             self.config_merged = ConfigNode(path, config_merged, path)
    707         for item in ('clusters', 'contexts', 'users'):

TypeError: 'NoneType' object does not support item assignment

I have added a check to raise a ConfigException error if an empty file is encountered.

Signed the CLA.

Signed the CLA.

The travis error on functional tests seems to be because of a minikube error.
W0125 15:54:45.089355    4821 out.go:181] X Exiting due to RSRC_INSUFFICIENT_CORES: Requested cpu count 1 is less than the minimum allowed of 2
493X Exiting due to RSRC_INSUFFICIENT_CORES: Requested cpu count 1 is less than the minimum allowed of 2
494I0125 15:54:45.089376    4821 out.go:119]
495
496

The travis error on functional tests seems to be because of a minikube error.
W0125 15:54:45.089355    4821 out.go:181] X Exiting due to RSRC_INSUFFICIENT_CORES: Requested cpu count 1 is less than the minimum allowed of 2
493X Exiting due to RSRC_INSUFFICIENT_CORES: Requested cpu count 1 is less than the minimum allowed of 2
494I0125 15:54:45.089376    4821 out.go:119]
495
496

/assign @fabianvf

/retest

/ok-to-test

/retest

Travis seems to be failing due to an unrelated test. Any ideas what's happening here?

Just wanted to check in to see if this looks okay :)

/lgtm

/assign @yliaog

/approve


Add Carthage instructions for FLEX exclusion from release builds

Hi!
I mostly use Carthage for my projects, and needed a way to properly exclude FLEX from release builds. I found one and added instructions to the readme file. This provides a more detailed answer to issue #131, which has been closed.
I did not include any screenshot since yours seem hosted on your own. Here is an example if you want to upload it with the others and update the readme file accordingly:

Thanks for considering this (small) contribution to your awesome project!
Best regards.

Great! This will be super helpful to those using Carthage. Thanks for the contribution!
I no longer have access to the location that has been hosting the media files. Could we simply link to the image in this PR?


SQL Folding: support for nested folds

The current implementation relies on the fact that folding blocks can not intersect. This prevents us from adding support for nested folds.

great idea 👍

I founded in PostgreDialect.java sources that block bound was commented
// In PgSQL there are no blocks. DO $$ ... $$ queries are processed as strings
    public static final String[][] BLOCK_BOUND_KEYWORDS = {
//        {SQLConstants.BLOCK_BEGIN, SQLConstants.BLOCK_END},
//        {"LOOP", "END LOOP"}
    };

but is partly true because postgre has several languages for procedures and fucntions definitions like: sql, c, plpgsql.
Of course, queries are processed as strings when it sql-like script but developers like me need nested foldings for another languages.
It may not be right to simply uncomment this piece. I believe that you need to write a lot of code so that DBaver can react correctly in accordance with the context (the language in which the procedures or functions are written). At first we must make code for detecting the language declaration like LANGUAGE [plpgsql | c | sql] or DO $$ BEGIN END $$   or etc. And only after that implement support for the corresponding language constructs.


Unable to Add T17+ running Braiins

Version of the custom_component
Miner:
V1.1.0
Home Assistant
Core 2024.1.5
Supervisor 2023.12.1
Operating System 11.4
Frontend 20240104.0
Braiins:
Version: 2022-06-20-0-288861e4-22.05-plus
Describe the bug
After Upgrading to the latest version I am unable to add the Antminer T17+ running Braiins.
I was able to add an S9 and an S19 without issue.

Debug log

2024-01-25 11:06:03.297 ERROR (MainThread) [aiohttp.server] Error handling request
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/aiohttp/web_protocol.py", line 452, in _handle_request
    resp = await request_handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/aiohttp/web_app.py", line 543, in _handle
    resp = await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/aiohttp/web_middlewares.py", line 114, in impl
    return await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/security_filter.py", line 85, in security_filter_middleware
    return await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/forwarded.py", line 227, in forwarded_middleware
    return await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/request_context.py", line 28, in request_context_middleware
    return await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/ban.py", line 80, in ban_middleware
    return await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/auth.py", line 233, in auth_middleware
    return await handler(request)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/headers.py", line 31, in headers_middleware
    response = await handler(request)
               ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/view.py", line 149, in handle
    result = await handler(request, **request.match_info)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/decorators.py", line 63, in with_admin
    return await func(self, request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/config/config_entries.py", line 177, in post
    return await super().post(request, flow_id)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/http/data_validator.py", line 72, in wrapper
    result = await method(view, request, data, *args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/data_entry_flow.py", line 110, in post
    result = await self._flow_mgr.async_configure(flow_id, data)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 320, in async_configure
    result = await self._async_handle_step(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 416, in _async_handle_step
    result: FlowResult = await getattr(flow, method)(user_input)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/config/custom_components/miner/config_flow.py", line 150, in async_step_login
    return await self.async_step_title()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/config/custom_components/miner/config_flow.py", line 154, in async_step_title
    title = await self._miner.get_hostname()
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pyasic/miners/base.py", line 288, in get_hostname
    return await self._get_hostname()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pyasic/miners/backends/braiins_os.py", line 766, in _get_hostname
    grpc_miner_details = await self.web.grpc.get_miner_details()
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 400, in get_miner_details
    return await self.send_command("get_miner_details", GetMinerDetailsRequest())
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 95, in send_command
    metadata.append(("authorization", await self.auth()))
                                      ^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 119, in auth
    await self._get_auth()
  File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 131, in _get_auth
    await stream.send_message(req, end=True)
  File "/usr/local/lib/python3.11/site-packages/grpclib/client.py", line 241, in send_message
    await self.send_request()
  File "/usr/local/lib/python3.11/site-packages/grpclib/client.py", line 173, in send_request
    protocol = await self._channel.__connect__()
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/grpclib/client.py", line 748, in __connect__
    self._protocol = await self._create_connection()
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/grpclib/client.py", line 725, in _create_connection
    _, protocol = await self._loop.create_connection(
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 1085, in create_connection
    raise exceptions[0]
  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 1069, in create_connection
    sock = await self._connect_sock(
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/asyncio/base_events.py", line 973, in _connect_sock
    await self.sock_connect(sock, address)
  File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 628, in sock_connect
    return await fut
           ^^^^^^^^^
  File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 668, in _sock_connect_cb
    raise OSError(err, f'Connect call failed {address}')
ConnectionRefusedError: [Errno 111] Connect call failed ('<IP_ADDRESS>', 50051)

You need to update the S17 to the most recent possible version for it to work properly.  pyasic is too lazy to track what versions have what features, or even check what version a miner is unless you ask for it, so it just assumes that S17s and S19s have both been updated enough to use gRPC.

I have this same error on a T17 that is on the latest braiins 2023-01
I cannot add it. It was working before updating home assistant and miner.

I have this same error on a T17 that is on the latest braiins 2023-01 I cannot add it. It was working before updating home assistant and miner.

Can you send logs from setup?

You need to update the S17 to the most recent possible version for it to work properly. pyasic is too lazy to track what versions have what features, or even check what version a miner is unless you ask for it, so it just assumes that S17s and S19s have both been updated enough to use gRPC.

Silly me, should have throught to check the version. Just assumed it kept itself upto date.
Now running Version: 2024-01-15-0-e8253ec1-23.12.1-plus works for me.

You need to update the S17 to the most recent possible version for it to work properly. pyasic is too lazy to track what versions have what features, or even check what version a miner is unless you ask for it, so it just assumes that S17s and S19s have both been updated enough to use gRPC.

Silly me, should have throught to check the version. Just assumed it kept itself upto date. Now running Version: 2024-01-15-0-e8253ec1-23.12.1-plus works for me.

Where did you find that version of braiins? Their latest for T17+ is 23.01

Try https://feeds.braiins-os.com

Try https://feeds.braiins-os.com

Braiins support say not to update T17 past 23.01

I ran the update via the braiins toolbox.
Interesting about the don't update past.

I've reached out to some people on support directly, he's asking the support group, we'll get an answer here shortly.  Not sure why they wouldn't want you to update, but if toolbox is letting you then I don't see an issue.

I've reached out to some people on support directly, he's asking the support group, we'll get an answer here shortly. Not sure why they wouldn't want you to update, but if toolbox is letting you then I don't see an issue.

Apparently anything past 23.01 on the x17 models the auto tune never finishes

Genius.  I'm going to do some complaining directly to the devs, maybe eventually this fix this.

Sweet, I must have just got lucky.

Thanks for the heads up though @Chris-S44

I can see the same issue on my HA instance. I could not solve it so removed haas-miner and added again , started fresh. Still the same situation. I cannot add miner.

Antminer S19J Pro NoPic
Braiins OS+	2024-01-15-0-e8253ec1-23.12.1-plus (latest version)

Home Assistant
Core 2024.1.5
Supervisor 2023.12.1
Operating System 11.4
hass-miner 1.1.1

Logger: aiohttp.server
Source: /usr/local/lib/python3.11/site-packages/aiohttp/web_protocol.py:421
Error handling request
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/aiohttp/web_protocol.py", line 452, in _handle_request
resp = await request_handler(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/web_app.py", line 543, in _handle
resp = await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/aiohttp/web_middlewares.py", line 114, in impl
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/security_filter.py", line 85, in security_filter_middleware
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/forwarded.py", line 100, in forwarded_middleware
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/request_context.py", line 28, in request_context_middleware
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/ban.py", line 80, in ban_middleware
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/auth.py", line 233, in auth_middleware
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/headers.py", line 31, in headers_middleware
response = await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/view.py", line 149, in handle
result = await handler(request, **request.match_info)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/decorators.py", line 63, in with_admin
return await func(self, request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/config/config_entries.py", line 177, in post
return await super().post(request, flow_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/http/data_validator.py", line 72, in wrapper
result = await method(view, request, data, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/data_entry_flow.py", line 110, in post
result = await self._flow_mgr.async_configure(flow_id, data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 320, in async_configure
result = await self._async_handle_step(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 416, in _async_handle_step
result: FlowResult = await getattr(flow, method)(user_input)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/miner/config_flow.py", line 150, in async_step_login
return await self.async_step_title()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/miner/config_flow.py", line 154, in async_step_title
title = await self._miner.get_hostname()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pyasic/miners/base.py", line 288, in get_hostname
return await self._get_hostname()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pyasic/miners/backends/braiins_os.py", line 766, in _get_hostname
grpc_miner_details = await self.web.grpc.get_miner_details()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 400, in get_miner_details
return await self.send_command("get_miner_details", GetMinerDetailsRequest())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 95, in send_command
metadata.append(("authorization", await self.auth()))
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 119, in auth
await self._get_auth()
File "/usr/local/lib/python3.11/site-packages/pyasic/web/braiins_os/grpc.py", line 132, in _get_auth
await stream.recv_initial_metadata()
File "/usr/local/lib/python3.11/site-packages/grpclib/client.py", line 393, in recv_initial_metadata
self._raise_for_grpc_status(status, message, details)
File "/usr/local/lib/python3.11/site-packages/grpclib/client.py", line 345, in _raise_for_grpc_status
raise GRPCError(status, message, details)
grpclib.exceptions.GRPCError: (<Status.UNAUTHENTICATED: 16>, 'Bad credentials', None)

This should really be a separate issue, what you're talking about is completely unrelated.  It's a credential issue with gRPC, vs not having gRPC at all on different miners.
Regarding the actual issue, try to default password?  I have no idea how the gRPC instance syncs passwords with the main API, so it's very possible it hasn't been changed.

Also on 23.01 for my S17s. Rolled back to 1.1.0-beta for the time being.

Looks like it's fixed in the latest version of pyasic to work with X17s on braiins 23.01
https://github.com/UpstreamData/pyasic/issues/104


HBASE-25547: Thread pools should release unused resources

Still marked as a WIP because the defaults have not been tuned yet.
All the code is in place, I still need to identify the low priority
thread pools and tune them to release unused threads quickly.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 34s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+1 :green_heart:
mvninstall
4m 18s
master passed

+1 :green_heart:
compile
3m 21s
master passed

+1 :green_heart:
checkstyle
1m 15s
master passed

+1 :green_heart:
spotbugs
2m 12s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 50s
the patch passed

+1 :green_heart:
compile
3m 18s
the patch passed

+1 :green_heart:
javac
3m 18s
the patch passed

-0 :warning:
checkstyle
1m 12s
hbase-server: The patch generated 2 new + 163 unchanged - 0 fixed = 165 total (was 163)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
19m  3s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0.

+1 :green_heart:
spotbugs
2m 19s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 13s
The patch does not generate ASF License warnings.

50m  4s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2922

JIRA Issue
HBASE-25547

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile

uname
Linux 6d04eba9160e 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / b6649a8784

Default Java
AdoptOpenJDK-1.8.0_232-b09

checkstyle
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt

Max. process+thread count
86 (vs. ulimit of 30000)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/console

versions
git=2.17.1 maven=3.6.3 spotbugs=3.1.12

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

So far, we are starting off with terminating core worker threads if no tasks arrive in keepAlive time only for EventTypes:
RS_LOG_REPLAY_OPS, RS_PARALLEL_SEEK, MASTER_SNAPSHOT_OPERATIONS, MASTER_MERGE_OPERATIONS. Is that correct? In HMaster#startServiceThreads, only MASTER_MERGE_OPERATIONS has this comment. Let's also add same comment for other 3 EventTypes?
Also, I might have missed it somewhere, but do we not want to keep allowCoreThreadTimeout as true by default? If the core threads are terminated, and if new task arrives, they are re-initiated right?
     * Sets the policy governing whether core threads may time out and
     * terminate if no tasks arrive within the keep-alive time, being
     * replaced if needed when new tasks arrive.

Let's also add same comment for other 3 EventTypes?

Instead moved it to the actual method. Copy-pasting it to multiple places seems redundant.

If the core threads are terminated, and if new task arrives, they are re-initiated right?

JVM thread creation is expensive. It involves initializing the stack memory, creating a corresponding native thread etc.. We may not want to do it for all thread pools for performance sake. We can add other thread pools over time as we see fit but turning it on by default might have some unintended and hard to track down performance issues.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 31s
Docker mode activated.

-0 :warning:
yetus
0m  4s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
3m 54s
master passed

+1 :green_heart:
compile
0m 59s
master passed

+1 :green_heart:
shadedjars
6m 31s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 39s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 35s
the patch passed

+1 :green_heart:
compile
0m 57s
the patch passed

+1 :green_heart:
javac
0m 57s
the patch passed

+1 :green_heart:
shadedjars
6m 39s
patch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 38s
hbase-server generated 5 new + 16 unchanged - 0 fixed = 21 total (was 16)

_ Other Tests _

+1 :green_heart:
unit
144m  3s
hbase-server in the patch passed.

170m 43s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2922

JIRA Issue
HBASE-25547

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 704a2643703c 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / b6649a8784

Default Java
AdoptOpenJDK-1.8.0_232-b09

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/artifact/yetus-jdk8-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/testReport/

Max. process+thread count
5019 (vs. ulimit of 30000)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/5/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Oh Great, you are right. Thread creation should be considered only if necessary for tasks like merge regions (recent change), where we are certain that it might happen for less than 1% of total cluster's available times.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+1 :green_heart:
mvninstall
4m  3s
master passed

+1 :green_heart:
compile
3m 17s
master passed

+1 :green_heart:
checkstyle
1m 12s
master passed

+1 :green_heart:
spotbugs
2m  7s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 48s
the patch passed

+1 :green_heart:
compile
3m 19s
the patch passed

+1 :green_heart:
javac
3m 19s
the patch passed

-0 :warning:
checkstyle
1m 12s
hbase-server: The patch generated 2 new + 163 unchanged - 0 fixed = 165 total (was 163)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
19m  4s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0.

+1 :green_heart:
spotbugs
2m 18s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 12s
The patch does not generate ASF License warnings.

49m 34s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2922

JIRA Issue
HBASE-25547

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile

uname
Linux 83db8f3c1252 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / b6649a8784

Default Java
AdoptOpenJDK-1.8.0_232-b09

checkstyle
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt

Max. process+thread count
86 (vs. ulimit of 30000)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/console

versions
git=2.17.1 maven=3.6.3 spotbugs=3.1.12

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 31s
Docker mode activated.

-0 :warning:
yetus
0m  4s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
3m 28s
master passed

+1 :green_heart:
compile
0m 58s
master passed

+1 :green_heart:
shadedjars
6m 36s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 38s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 30s
the patch passed

+1 :green_heart:
compile
0m 58s
the patch passed

+1 :green_heart:
javac
0m 58s
the patch passed

+1 :green_heart:
shadedjars
6m 33s
patch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 38s
hbase-server generated 5 new + 16 unchanged - 0 fixed = 21 total (was 16)

_ Other Tests _

+1 :green_heart:
unit
144m  0s
hbase-server in the patch passed.

170m  9s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2922

JIRA Issue
HBASE-25547

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 9300f05f3340 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / b6649a8784

Default Java
AdoptOpenJDK-1.8.0_232-b09

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/artifact/yetus-jdk8-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/testReport/

Max. process+thread count
4352 (vs. ulimit of 30000)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 15s
Docker mode activated.

-0 :warning:
yetus
0m  5s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
4m 34s
master passed

+1 :green_heart:
compile
1m 12s
master passed

+1 :green_heart:
shadedjars
7m 30s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 42s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
4m 37s
the patch passed

+1 :green_heart:
compile
1m 12s
the patch passed

+1 :green_heart:
javac
1m 12s
the patch passed

+1 :green_heart:
shadedjars
7m 25s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 43s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
200m 22s
hbase-server in the patch passed.

231m 31s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2922

JIRA Issue
HBASE-25547

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 0710a3a11ae1 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / b6649a8784

Default Java
AdoptOpenJDK-11.0.6+10

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/testReport/

Max. process+thread count
3537 (vs. ulimit of 30000)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2922/6/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@bharathv When you commit, can you please mention 4 EventTypes for which this commit is going to consider releasing unused core threads in thread pools? Maybe you can mention them in Release notes as well.

I just figured that I missed the commit that rolls the op-code into the ExecutorConfig, let me create an addendum.


fix(casperf): subcommand is not required

bonus: make URI required

bors merge

bors merge

bors merge

bors merge

bors merge

bors merge


Import image via COS

can you remove the vendoring?

I can but then it will not pass the jobs

can you remove the vendoring?

I can but then it will not pass CI

if you just run go mod tidy but not go mod vendor and add the updated go.sum, then it should get past that CI error

what instlal-config.yaml changes do we need to use this?

what instlal-config.yaml changes do we need to use this?

You just need to set the imageName to the file name in the bucket. For example
imageName: "rhcos-410-84-202111011607-0-ppc64le-powervs.ova.gz"

Currently if you want to use a specific region for the bucket, you can specify it in imageBucketRegion but if you leave that out, it will just use the same region as the VPC.


Update X_bearer_of_X.yaml

updated description and template for text def

looks like this was moved over to the CL repo:
https://github.com/obophenotype/cell-ontology/tree/master/src/patterns/dosdp-pattern-workshop
closing


无法找到 0.1.2版本

depends on getx_scaffold 0.1.2 which doesn't match any versions, version solving failed.
You can try the following suggestion to make the pubspec resolve:

Consider downgrading your constraint on getx_scaffold: flutter pub add getx_scaffold:^0.1.1

0.1.2 今天更新，如果使用国内的pub源可能暂未同步。


Implement DDM rate limiting (Python SDK)

See https://github.com/getsentry/sentry/issues/61040

Duplicate, closing.


Ensure that scripts have execute permissions

Is there any progress on this? I've been bitten twice by this issue already and would like to see this get merged.

Hi, sorry! This project will likely be abandoned in favor of https://github.com/pradyunsg/installer.


Improves the Layers menu in the panel for dimension filters.

Is your feature request related to a problem? Please describe.
Change the menu form.
Describe the solution you'd like
Change the decision about how to sort and select to the submenu.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

@AnnieHwang 디자인 공유드립니다

@eltriny Please proceed development.


When buying storage, if the UI window is not maximised,  the 'allowance' box interferes with the 'accept' and 'cancel' buttons

What is the resolution of your screen? I forget what our minimum recommended resolution is, but I think it's at least 1000 pixels wide, which would be half the width of a 1080p screen, or about 75% of a 720p screen.

Fixed in #433


How to warmup models?

Hello!
running the very first detection really takes a lot of time. Moreover, it depends on the actual language detected:
detector.detectLanguageOf("This is an example") // takes ~8 seconds
detector.detectLanguageOf("This is an example") // takes ~4 ms
detector.detectLanguageOf("Questo è un esempio") // takes ~14 seconds

So my question is: how can I create a "warmup" procedure to run once and have all models loaded?
Very trivial implementation: run detect with a multi-language sample. Is there anything more elegant than that?
Thank you!

Hi Davide, thanks for your question.
The behavior you are describing is on purpose. The language models are loaded only for those languages which are possible for the given input text. That is why the first detection takes more time than the second one. The third detection takes again more time because special characters are encountered for which all fitting models are loaded.
I could change this behavior to load all models before the first detection but why should I do that? The total running time of your three detections would be the same.
Do you have any specific problem with the current behavior?

Hi @pemistahl !
No doubt this behavior is perfect for some use cases! Not intended to complain as it was bug :)
My idea would be to have an optional way to pre-load all models at once (and maybe even in parallel with multithreading).
Why this can be useful? Imagine if you want to expose the service to your users: you would like to pre-load models at startup time, this way you avoid having some initial requests take 1000x what it is supposed to take in terms of time per request.
Is there a way I can achieve that without having a list of sentences in all languages, and manually detect them at the beginning?
Thanks!

You are right. For this use case, preloading all models at once would be beneficial. At the moment, this is not possible. But I could implement an optional setting to allow this in the next release. I will put in on my bucket list. :)
Thanks again for your input and for using my library. Very much appreciated.

Thank you @pemistahl !