Add HUAWEI Ascend NPU backend support

Reminder

[X] I have read the README and searched the existing issues.

Reproduction
can we add Add HUAWEI Ascend NPU backend support for QWEN 7B/72B？
Expected behavior
can we add Add HUAWEI Ascend NPU backend support for QWEN 7B/72B？
System Info
can we add Add HUAWEI Ascend NPU backend support for QWEN 7B/72B？
Others
can we add Add HUAWEI Ascend NPU backend support for QWEN 7B/72B？

Replicate of https://github.com/hiyouga/LLaMA-Factory/pull/975


Feat -> Landing Page -> Desktop and Mobile Design Implementation -> Static Page

Mobile Design
Desktop Design

I would like to work on this

I would like to work on this

Yes please go for it.


Import typo in text_removal.py script

Line 13 in text_removal.py should be this:
from hamlet.tools.image import check_text
not:
from hamlet.tools.image import checek_text

Good catch! Typo is fixed.
From: Thomas Jaensch @.>
Sent: Thursday, April 6, 2023 1:57 PM
To: scotthlee/hamlet @.>
Cc: Subscribed @.***>
Subject: [scotthlee/hamlet] Import typo in text_removal.py script (Issue #13)
Line 13 in text_removal.py should be this:
from hamlet.tools.image import check_text
not:
from hamlet.tools.image import checek_text
—
Reply to this email directly, view it on GitHubhttps://github.com/scotthlee/hamlet/issues/13, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AED63N2FJJDGFOO4F5RYVXDW737X3ANCNFSM6AAAAAAWVWWCEQ.
You are receiving this because you are subscribed to this thread.Message ID: @.***>


Allow using the owned String type for phf dynamic code generation.

In version 0.7 of phf the owned String type could be used but with
changes in 0.8 this is no longer possible without this implementation of
FmtConst for String.
This is a minimal change of #185, as that pull request is remaining
opened with outstanding comments.

@abonander - this is minimal version of #185 which does not add implementations for Vec<_>. Could this be merged in for the next release?

Again I think the tests are failing due to the test environment being setup to use rustc 1.32 however this project is making use of rust features added since then. When I run tests locally they pass.


fix old boots for strapping

This worked fine for me to get the "Regenerate build.jl" stage to work in GEOSBuilder.
Can be removed again once MbedTLS.jl v0.6.8 is released.

Thanks @visr


UpgradeDependencyVersion upgrading to Alpha version instead of the Final version

Hi,
Still working on the Quarkus 3 upgrade recipes and I noticed an undesired behavior.
I have this artifact: https://repo1.maven.org/maven2/io/quarkiverse/githubapp/quarkus-github-app/maven-metadata.xml which has a few 2.0.0.Alphas and a 2.0.0.
When applying the following rule:
 - org.openrewrite.maven.UpgradeDependencyVersion:
      groupId: io.quarkiverse.githubapp
      artifactId: '*'
      newVersion: 2.x

I end up with an upgrade to 2.0.0.Alpha2 and not 2.0.0.
I'm not sure exactly how you resolve the version but currently https://central.sonatype.com/artifact/io.quarkiverse.githubapp/quarkus-github-app/2.0.0.Alpha2/versions doesn't have the 2.0.0 indexed as there apparently are some issues with some of the mirrors.
In any case, I had a few questions:

Could you confirm that you use an ordering that will put 2.0.0 as newer than 2.0.0.Alpha2?
I suppose you're relying on Maven Central directly and not using REST APIs (from central.sonatype.com or search.maven.org) to get the versions, am I right? So I suppose it could be a mirror problem?

/cc @knutwannheden
Thanks!

FWIW, I have confirmed that using the following recipe upgrades to the final version so it can somehow find the new version (I also tested that if the version is not around, it won't update it). There might be something fishy with the way versions are ordered:
  - org.openrewrite.maven.UpgradeDependencyVersion:
      groupId: io.quarkiverse.githubapp
      artifactId: '*'
      newVersion: 2.0.0

No it doesn’t explain it. I have the problem locally and I see the proper metadata and the final artifact on the mirror I end up hitting.

For now, I pinpointed all the Quarkiverse versions but that’s a bit of a shame.

I can confirm that the version comparison logic is flawed. In your use case it was expecting the alpha qualifier to be all in lowercase (so alpha rather than Alpha). This doesn't comply with the Maven implementation.

It is not a goal to comply with Maven version ordering here, but rather to provide the most usable selectors which are usable for both Maven and Gradle ultimately. Simply make the Alpha comparison case insensitive and we can move along.


Cannot Access Nodes in Custom VNET

Is this a request for help?: Yes

Is this an ISSUE or FEATURE REQUEST? (choose one): ISSUE

What version of acs-engine?: v0.8.0

Orchestrator and version (e.g. Kubernetes, DC/OS, Swarm) Kubernetes
What happened: Everytime I deploy a Custom VNET the entire deployment process goes perfect.

I can ssh into the master.
I can 'kubectl describe all', but I only get:

NAME             CLUSTER-IP   EXTERNAL-IP   PORT(S)   AGE
svc/kubernetes   <IP_ADDRESS>             443/TCP   18m
The PROBLEM is: I cannot see any of my nodes. :(
Even if I 'kubectl get nodes' on the master node itself. I get:
No resources found.
What you expected to happen:
I would like to see & access my nodes.
How to reproduce it (as minimally and precisely as possible):
Deploy a custom VNET
Anything else we need to know:

The problem was that I deployed the vnetarmtemplate/azure.kubernetes.json if you use the pre and post deploy scripts everything work fine.


Composer requirement not found

Trying to update via composer I get the following error:
Problem 1
      - Installation request for tractorcow/silverstripe-fluent dev-master -> satisfiable by tractorcow/silverstripe-fluent[dev-master].
      - tractorcow/silverstripe-fluent dev-master requires symbiote/silverstripe-gridfieldextensions ^3.0.3 -> no matching package found.

symbiote/silverstripe-gridfieldextensions 3.0.3 does not exist

What does your composer.json look like? do you have "minimum-stability": "dev"?

True that 3.0.3 doesn't exist. I'll lower this constraint a little =)

I still have problems updating:
 Problem 1
      - Installation request for tractorcow/silverstripe-fluent dev-master -> satisfiable by tractorcow/silverstripe-fluent[dev-master].
      - tractorcow/silverstripe-fluent dev-master requires symbiote/silverstripe-gridfieldextensions ^3.0 -> no matching package found.

My composer.json looks like:
    "require": {
        "php": ">=5.6.0",
        "silverstripe/recipe-plugin": "^1",
        "silverstripe/recipe-cms": "1.1.0@stable",
        "silverstripe-themes/simple": "~3.2.0",
        "tractorcow/silverstripe-fluent": "dev-master",
        "symbiote/silverstripe-gridfieldextensions": "dev-master",
        "g4b0/simple-gallery": "dev-master"
    },

@g4b0 that looks like only a selection of the composer.json and not all of it. Can you provide all of it.
Also, I'd recommend you do not use dev-master as a constraint ever. I'm also confused that you've got "symbiote/silverstripe-gridfieldextensions": "dev-master" when the failure is to install 3.0... Something funky is going on in general.

Wow, changing my composer json with
"symbiote/silverstripe-gridfieldextensions": "^3.0"
did the trick!

Yep, you need to stop using dev-master or you're going to be in a world of pain

Like the good old days of SS 3.0-dev :)
Thanks a lot


Permission checks are imperfect and produce false negatives

https://discord.com/channels/@me/1105802106948030495/1105820328669757540

Permission checks work differently now and I hope this bug is fixed now. If you experience the same thing feel free to comment on this and I will reopen it!


update to 2.0 miss some files

in windows environment after update to 2.0 in node-red palette there are notifications that some files under \systemprofile.node-red\node_modules\node-red-contrib-filemaker\src\client\ does not exist like \databases.html  \productInfo.html \duplicate.html \layouts.html \layout.html \scripts.html
apparently everything seems to work

it was only appearance, the nodes no longer work

@maxalone This looks like an issue for node-red-contrib-filemaker, not fms-api-client. Did you mean to file this issue there?


Add table aws_sagemaker

Below use cases needs to be validated

Amazon SageMaker notebook instances should not have direct internet access


vim extension is not working

Web Browser: Chrome 88.0.4324.96
Local OS: macOS Catalina 10.15.7
Remote OS: CentOS Linux release 7.4.1708 (Core)
Remote Architecture: x86_64
code-server --version: 3.8.0

I've just upgraded vim extension to version 1.18.7 and it doesn't work with following console messages

and I rollbacked it to version 1.16.0 I'd used well and it works now.
Is it early to upgrade brand new vim extension until new code-server version would be released?
Thanks

Hi @sangchul! It looks like this may be a duplicate (see #2319 which I think you opened?)
We're doing everything we can do fix this as soon as possible. In the meantime, there are two workarounds:

use 1.16.0 (which you know works)
use the neovim extension (see this comment)

@jsjoeio Oh. thanks reminding me. The post I wrote grew so fast!. I will check it. thanks again


skip-tests: false

Not merged until test implementation is complete and then deleted depending on later updates


What if We make an Executable Instead of Individual Scripts and Add an Option to Execute in Silent Mode

You can execute it in silent mode yourself by adding a few lines of code.

Also, the whole point of this thing is it being written in PS, and, technically, PS1 files are executables, they're just only executable in PowerShell. Having to make an executable for this script would just be a hassle.


vCenter monitoring fails for non oneadmin users

Description
VMs launched by no oneadmin users fails to be monitored.
To Reproduce
Launch a VM with a user not in the oneadmin group. After a while it goes automatically to poweroff
Expected behavior
The VM to be filly monitored
Details

Affected Component: IM driver
Hypervisor: vCenter
Version: 5.12.1

Additional context

Progress Status

[ ] Branch created
[ ] Code committed to development branch
[ ] Testing - QA
[ ] Documentation
[ ] Release notes - resolved issues, compatibility, known issues
[ ] Code committed to upstream release/hotfix branches
[ ] Documentation committed to upstream release/hotfix branches

testing needs to be extended


manually adjusting pointer speed doesnt work

OS
macOS Sonoma Beta4 (23A5301h)
LinearMouse
0.9.3
Describe the bug
i set acceleration to 0 and want to adjust the mouse speed but it doenst change.
it is the same speed with for example with pointer speed set to 0,069 and 1,0.
To reproduce
No response
Expected behavior
No response
Anything else?
No response

Thanks for your feedback.
Could you reproduce this issue and export the logs from the General settings?

LinearMouse.log
this is with my Logitech MX Master. same behaviour. Acceleration Set to 0 and Speed doesnt do anything.

I can confirm that the mouse pointer speed is not working properly on macOS Sonoma, while the trackpad pointer speed is functioning correctly. I will look into this more later. Thank you!

Weird, Trackpad Pointer Speed is also not wokring for me. Macbook internal Trackpad and the external Magic Trackpad

If you are an M2 user, then yes, you can refer to issue #270 for more information.

i have an M2 MB Air yes, but my Trackpads get listet

Yes, I have received multiple reports indicating that the pointer speed does not function properly for M2 internal trackpads. For example, #279 and #492. This issue remains reresolved.

I've figured out why the pointer speed wasn't functioning properly. I disabled the pointer acceleration in the System Settings. Kindly verify if you have done the same.

I turned it on again and the pointer speed now works.

after enabling Pointer acceleration in the System Settings i can configure the external Magic Trackpad and my Logitech with LinearMouse.


Help with maintenance of jupyterlab_spellchecker

Which repository do you want to maintain:

[ ] All
[X] https://github.com/jupyterlab-contrib/jupyterlab_spellchecker

What do you want to do (multiple choices accepted):

[X] Address reported issues and feature requests
[ ] Update a Archived repository to make it work on the latest JupyterLab version
[X] Improve an extension (if so please describe, what you want to achieve)
- fix BUGs
- support more languages
- integration with the language packages inside jupyterlab>3

Which level of help, would you need (choose one of):

[ ] Total beginner but enthusiast (you are more than welcome and we will help in your learning of the Jupyter ecosystem)
[X] Good reviews with tips would be appreciated
[ ] I am a experienced developer with Jupyter ecosystem

Hey thanks a lot for the proposal. I invited you as Maintainer on the GitHub repo.
Could you tell me your ID on npmjs.com so I can give you the rights to publish the extension as well?

Thnx for the invitation, on npmjs.com my ID is ocordes :-) Luckily I was able to get the same ID almost everywhere in the develoment sector ...

Nice ;-)
You should receive the npmjs invitation soon. Let me know if you did not.

Everything is OK. It is correct that npmjs lists the extension with the same name @ijmbarr/jupyterlab_spellchecker as before? I checked the link which points to the old github page which is now redirected to the new one, which is nice. I'm just asking how much we have to do to adjust the package to his new institution.

It is correct that npmjs lists the extension with the same name @ijmbarr/jupyterlab_spellchecker as before?

Yes this is a feature of npmjs that allow to group extension from various namespace into a common organization to ease access management (I wish so much Pypi as such feature...).
Personally I prefer to keep the previous name as it simplifies the update for users. And in this case, it is nice to keep the name of the original author.
So I'm closing this issue. And thanks again to come help with that extension.


Json result storage

Redesigning the interface between the website parts and the Python backend parts to interchange JSON files instead of generating HTML files.
This makes for a simpler system, where display is handled on the display side, and only data is handled on the backend side.

@louquillio can you look at the style application functions and Javascript?
The CSS handling looks terribly hacky to me.

PTAL

lgtm for python parts


Use retries/timeouts to improve reliabilty of downloads from S3

Currently the Python CNB makes a single download attempt for the Python runtime archive on S3.
We should add retries/timeouts to improve reliability in case there are network/S3 issues, similar to what the classic buildpack does.
Internal tracking epic

Example failure:
[Installing Python]
Installing Python 3.12.7

[Error: Unable to download Python]
An error occurred whilst downloading the Python runtime archive.

In some cases, this happens due to an unstable network connection.
Please try again and to see if the error resolves itself.

Details: https://heroku-buildpack-python.s3.us-east-1.amazonaws.com/python-3.12.7-ubuntu-24.04-arm64.tar.zst: Dns Failed: resolve dns name 'heroku-buildpack-python.s3.us-east-1.amazonaws.com:443': failed to lookup address information: Try again

ERROR: failed to build: exit status 1

(From: https://github.com/heroku/cnb-builder-images/actions/runs/11281440483/job/31376753868#step:6:21)


PWA-127 search suggestions dont disappear with empty phrase

…ciding to render

Pull Request Test Coverage Report for Build 1163

1 of 1 (100.0%) changed or added relevant line in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.03%) to 44.338%

Totals

Change from base Build 1162:
0.03%

Covered Lines:
1856

Relevant Lines:
4030

💛  - Coveralls


[DISCUSS] call_tir convention

One of the key goals of Relax is to allow the high-level Relax IR to directly interact with and call into lower level TensorIR PrimFunc and PackedFunc. call_tir is an intrinsic in Relax to achieve this goal. It's implemented as a special Op and its current signature is:
call_tir(output_shape: Expr, lowlevel_func: Expr, inputs: Tuple[Expr]) -> Expr, which means calling into a low-level destination-passing-style function (including PrimFunc and PackedFunc) and returning the output. For more details about it please check out Relax Architecture Overview.
However, besides the output_shape, we also need the output_dtype information to decide how much memory we should allocate for the returned value.
There are two options with regard to specifying the output shape and dtype of call_tir:

O0. Keep shape and dtype as argument and type_args of call_tir
The convention would be call_tir<out_type>(out_shape, func, [a, b]) -> Expr.
O1. Annotate shape and dtype in the shape_ and checked_type_ fields of call_tir
The convention would be call_tir(func, [a, b]) -> Expr. The shape and dtype info are in the CallNode's shape_ and checked_type_ fields.

To compare these two options, let's use the following program transformation as a concrete example.
def fn_before(x: Tensor[(n, m), "float32"]):
  v0: Tensor[(n, m), "float32"] = call_tir((n, m), tir0, x, dtype="float32")

def fn_after(x: Tensor[(n,), "float32"]):
  v0': Tensor[(n,), "float32"] = call_tir((n,), tir0, x, dtype="float32")

In the transformation above, we want to rewrite the input of a Relax function from x: Tensor[(n, m)] to x': Tensor[(n,)]. Since the argument x to the call_tir changes, the mutator will need to create a new call_tir. If we take the O0 approach, the mutator only changes the type_args and the output_shape argument of the call node, while leaves shape_ field and checked_type_ field to be automatically deduced; While if we take the O1 approach, the mutator directly mutates its shape_ and checked_type_ fields to annotate the output shape and output dtype of the new call_tir.
Normally, the shape_ and checked_type_ of a CallNode are automatically deduced. For example, if we rewrite the inputs of a Relax.add op, the mutator will create a new CallNode with Relax.add as the op, do eager shape and type inferences based on the new arguments(via InferShape and InferType), and fill the checked_type_ and shape_ of the new CallNode.
If we take the O0 approach, the rule is simple: shape_ and checked_type_ of a CallNode are always deduced, instead of serving as an annotation for some Op. And during rewriting, whenever the inputs of a CallNode are changed, the shape_ and checked_type_ are re-deduced. If we take the O1 approach, we need to clarify in what circumstances shape_ and checked_type_ can be manually annotated, and when they are automatically deduced.
TVMScript syntax sugar
Note that even we adopt the O0 approach, the user written TVMScript and printed IR can still have syntax sugar and be simplified. Some choices are:
C0. shape and dtype annotation on the lhs of binding:
v0: Tensor(shape, dtype) = call_tir(func, [a, b])

C1. shape and dtype annotation on the rhs of binding:
v0 = call_tir(output_shape, func, [a, b], dtype="float32")

Followup discussions about shape/type deduction rules:
The goal is to clarify the deduced value(which needs to re-deduced when some part changes) versus what can be directly modified by mutator:

shape_ and checked_type_ of Expr are deduced values. For example, when we alter the argument or type_args of a call_tir as below, the shape_ and checked_type_ of both the lhs Var and rhs CallNode of the binding need to be re-deduced.

def fn_before(x: Tensor[(n, m), "float32"]):
  v0: Tensor[(n, m), "float32"] = call_tir((n, m), tir0, x, dtype="float32")

def fn_after(x: Tensor[(n,), "float32"]):
  v0: Tensor[(n,), "float32"] = call_tir((n,), tir0, x, dtype="float32")

This automatic deduction is done through BlockBuider::Normalize called in VisitExpr of ExprMutator, inside witch the InferShape/InferType attributes registered to ops are called: https://github.com/tlc-pack/relax/blob/47da9537eaccb7526801df11069c05fc457c71bd/src/relax/ir/expr_functor.cc#L544.

type_annotation and type_args can be directly mutated by the mutator.
For example, when we want to change the dtype of parameters to a function from float32 to float16, we can override ExprMutator::VisitType: https://github.com/tlc-pack/relax/blob/47da9537eaccb7526801df11069c05fc457c71bd/src/relax/ir/expr_functor.cc#L396

Currently we don't have shape_annotation in VarNode, but only type_annotation. One discussion point is whether we want to have type_annotation and shape_annotation in VarNode, versus we store their type and shape in its checked_type_ and shape_.

Currently, the shape_ field of an Expr being nullptr has two semantics:

The shape has not been deduced yet;
The shape is data dependent on the input data (e.g. unique operator).

Without distinguishing these two cases, when shape_ is Null, BlockBuider::Normalize always deduces the shape by calling InferShape:
https://github.com/tlc-pack/relax/blob/47da9537eaccb7526801df11069c05fc457c71bd/src/relax/ir/block_builder.cc#L522-L527
If we introduce a DataDependentShape(name is subject to change) Expr, we can distinguish these two cases: If we see a Tensor's shape_ being nullptr, it means the shape is not deduced, so we will trigger deduction, otherwise we don't need to retrigger the deduction unless the arguments or type_args of a CallNode change.

Implemented in #83, #94, and #117.


Alpheios integration: words annotated, but disambiguation data sometimes does not show up

Using the treebanks https://nevenjovanovic.github.io/treebank-template/fragment-SBJ-10-1-10/11 and https://nevenjovanovic.github.io/treebank-template/fragment-SBJ-10-1-10/12 (the same sentence, without the treebank diagram and with a partial one), at our site integrated with Alpheios and treebanks http://croala.ffzg.unizg.hr/eklogai/theca/10-sent-sbj/ the words 3, 5, 9-13, 20, 24, 26-28, 30 do not show disambiguation data, even those words which have multiple possible morphological identification.
Don't understand why is this happening, because the morphological data and lemmata are present in the source, for example:
<word id="24" form="ἀήθεις" lemma="ἀήθης" postag="a-p---ma-" relation="" head=""/>
<word id="25" form="," lemma="punc1" postag="u--------" relation="AuxX" head="0"/>
<word id="26" form="τροφῆς" lemma="τροφή" postag="n-s---fg-" relation="" head=""/>
<word id="27" form="δ’" lemma="δέ" postag="d-------p" relation="" head=""/>
<word id="28" form="ἡμέρου" lemma="ἥμερος" postag="a-s---fgp" relation="" head=""/>
<word id="29" form="παντελῶς" lemma="παντελῶς" postag="d-------p" relation="" head=""/>
<word id="30" form="ἀνεννοήτους" lemma="ἀνεννόητος" postag="a-p---ma-" relation="" head=""/>
<word id="31" form="." lemma="punc1" postag="u--------" relation="AuxK" head="0"/>

On the other hand, at another page of the same site: http://croala.ffzg.unizg.hr/eklogai/theca/ps-xen-athen-2-14-2/ all words are disambiguated according to source https://nevenjovanovic.github.io/treebank-template/ps-xen-2-14-2-16/1
I use mkdocs to produce the pages, but the sentences aligned with treebanks are HTML fragments.
Tested in Firefox and Chrome.

investigating...

This is caused by an inconsistency in how we handle encoding in Alpheios and Arethusa.  Alpheios sends a normalized to NFC version of the word text to Arethusa to find in the sentence, but Arethusa does not on its end apply the same normalization to the text in the treebank and thus it's not finding a match. I had taken this into account on the Alpheios end when data is received from Arethusa, but not in Arethusa when data is received from Alpheios.
So, this is a fix I need to make in Arethusa and I'll transfer the issue there.
In the meantime @nevenjovanovic there are two ways to workaround it:

you could normalize the treebank data files using the same algorithm as we do in Alpheios  (we use the javascript String.normalize('NFC') function

for words that aren't being found, you could specify the word_id specifically in the html attributes, as in the following example from the instructions:

Alpheios and Arethusa will use the context to try to find the word within the treebank data for a sentence that corresponds to the word in the text on the page. In most cases this will work well, but in certain circumstances, you may need to override the default behavior and specify which tokens in the treebank data correspond to the word on the page. The data-alpheios_tb_word attribute can be used to do this.

περὶ πολλοῦ ἂν ποιησαίμην, ὦ ἄνδρες, τὸ τοιούτους ὑμᾶς ἐμοὶ δικαστὰς περὶ τούτου τοῦ πράγματος γενέσθαι,
          οἷοίπερ ἂν ὑμῖν αὐτοῖς εἴητε τοιαῦτα πεπονθότες·


UDP socket programming is not working - Data is not reaching wsl adapter

Version
Microsoft Windows [Version 10.0.19044.2130]
WSL Version

[X] WSL 2
[ ] WSL 1

Kernel Version
5.10.16
Distro Version
Ubuntu 20.04
Other Software
No response
Repro Steps
with windows are server , create a socket and try to send messages to wsl2
Expected Behavior
message reaching wsl2 network adapter
Actual Behavior
message not reaching wsl2 network adapter
Diagnostic Logs
No response

Howdy, could you be a bit more specific, some more details? If you're trying to access via localhost:UDP that isn't currently implemented.

Well I was trying to create a socket programming to communicate between Windows and WSL2 Ubuntu . Even though data has been send from the windows network adapter , the data is not getting received in WSL2 adapter

You really need to give me more detail. Knowing if the host is attempting to address localhost or the generated private address is example.

It is trying to connect to a private address


TDI-38699:Can't save connection parmeter successfully when edit azure

wizard
What is the current behavior? (You can also link to an open issue here)
https://jira.talendforge.org/browse/TDI-38699
What is the new behavior?
Please check if the PR fulfills these requirements

[ ] The commit message follows Talend standard
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features) ?
[ ] The code coverage on new code >75%
[ ] The new code does not introduce new technical issues (sonar / eslint)

What kind of change does this PR introduce?

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build / CI related changes
[ ] Other... Please describe:

Does this PR introduce a breaking change?

[ ] Yes
[ ] No

If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:

Pull request test result: failure :x:

Pull request test result: failure :x:

Pull request test result: failure :x:

This PR doesn't make sense. It will never be called after click finish.


Use the getNamedAccounts feature of hardhat-deploy instead.

For example things like: https://github.com/smartcontractkit/chainlink-hardhat-box/blob/main/deploy/01_Deploy_PriceConsumerV3.js#L12

addressed in https://github.com/smartcontractkit/chainlink-hardhat-box/pull/6.


Add Palenight Dribblish Theme

Adds the Palenight Dribblish theme I've been using for the past few months with an image in readme.
This is based off of the IntelliJ Idea / JetBrains Palenight material theme.
See https://www.material-theme.com/docs/reference/color-palette/

I think this scheme is just slightly different from existed Dracula and Horizon schemes and it doesn't bring anything new to the table. And it's not that hard to bring
Thanks for your contribution anyway, I'm glad that you like it enough to add your personal taste to it!


helm chart pull returns ref may only contain a single colon character (:) unless specifying a port number

Output of helm version:
version.BuildInfo{Version:"v3.4.1", GitCommit:"c4e74854886b2efe3321e185578e6db9be0a6e29", GitTreeState:"clean", GoVersion:"go1.14.11"}
Output of kubectl version:
Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.3", GitCommit:"1e11e4a2108024935ecfcb2912226cedeafd99df", GitTreeState:"clean", BuildDate:"2020-10-16T20:43:08Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}
Cloud Provider/Platform (AKS, GKE, Minikube etc.):
Any
Issue:
Running:
helm chart pull https://charts.yugabyte.com/yugabytedb/yugabyte:2.5.1
Returns the error:
Error: ref may only contain a single colon character (:) unless specifying a port number
This is happening in the cluster, locally, etc... Am I doing something incorrectly?

helm chart pull cannot pull from a chart repository. It can only pull from an OCI registry.
From https://charts.yugabyte.com/:

Add the charts repository by running the below command

helm repo add yugabytedb https://charts.yugabyte.com

Because charts.yugabyte.com is a chart repository, use helm fetch instead.

Thanks, the issue I am experiencing is related to how ArgoCD pulls them down, this is the command it is attempting to run. I will open an issue with them. Thanks!


HUM-653 Autocreate success when already created; typos

Pretty much this just cleans up the logs a bit. The error wasn't getting propagated all the way back to the client before, it was just a bit of log spam and didn't seem "correct" to me.

This race condition retry stuff is always kind of ugly isn't it? 👍


Make SIAlertViewTransitionStyleBounce a little less bouncy

Is it possible to edit the CAKeyframeAnimation so that it is a little less springy?
Otherwise, amazing product, thank you so much

Any update?


Wrong steps in the Release notes (0.10.0)

What

Fix
Replace chmod +x ./install for chmod +x install.sh

@camilamacedo86 thanks for pointing this out. I've updated the release notes with your suggestion!


 Let me know if you want it broken up.
I updated/added a few detectors/readers

WipeoutDetector
WhiteButtonDetector for both L Stick and A button with dark background
MenuOptionReader along with a menu option session for changing the settings
PokemonMovesReader
TutorialDetector

Credits to Nymphea for the majority of the autostory code.

I added a few commits to refactor test_segments, to use std::vector<std::function<void()>> instead of a large switch statement.

Without having looked into this in detail yet, let's break out all the detectors into separate PRs if they're able to stand alone.

I'll submit AutoStoryTools as its own PR once #482 and #483 are merged, since it depends on those.


WIP: 1-norm isoparametric invF termination

This is to demonstrate a point in the discussion of the use of an algebraic sum in the termination criterion for the Newton iteration in MappingIsoparametric.invF #249.  A 1-norm seems more appropriate but fails five tests:

3 in test_assembly
1 in test_convergence
1 in test_mapping

The five errors in https://travis-ci.com/kinnala/scikit-fem/builds/136629782 are all
ValueError: Inverse mapped point outside reference element!

as in #244.

In more detail:

tests.test_assembly

IntegrateFuncOverBoundary
IntegrateFuncOverBoundaryPart
IntegrateOneOverBoundaryHex1

tests.test_convergence.TestHexFacet
tests.test_mapping.TestIsoparamNormals

Actually all five failures are for MeshHex rather than MeshQuad.

Completed and subsumed by #252.


Handle deployment settings in a new collection in the database

We have a number of settings on the frontend and backend that are currently set using environement variables. It would be nice for admins to be able to set many of these settings from the app itself.
To do this, we will need a new database collection called "settings" (or similar), that holds a document with settings for the overall deployment, as well as documents for individual block types. Many of the settings in resources.js could be stored here, as well as things like API keys for llm models, configuration for login types, etc. These settings could be changeable by admins from the new admin panel that is in development.

This general approach will be followed by #667 at some point too


Add image resize extension

Hi, sorry I only tested in my own repo, not sure if any CI works need to be added to this PR.
I also update the tailwind config so that the align-center can has an accurated position.
Result:

@wwayne Thanks for the PR, it's a nice feature. I'll check it out soon.

@arikchakma thanks, no worries : )
I didn't check the coding format of the original project
Plz feel free to close this PR and add your own version if it would save your time

@wwayne No worries, The code seems fine to me. I'm just busy with some internal work, I'll check it and make some changes whenever I get time. Again Thanks for the PR man.

@wwayne Hey man, unfortunately, it's not working for me.

@wwayne What do you think if we use this solution maybe?

oh no : ( , I will take a try when I have time.
I'm not sure the solution you mentioned, but if it works then we can close this PR can use that one haha

Maybe it's because of the inline logo that I've? I'm not able to message you on twitter, mind pinging me there?

@wwayne Hey man I'm able to make it work. I'll make some tweaks and merge it, thanks, man.

Cool good to know that : )

I found after adding this image-resize extension, when dragging the image to another place, you can see the blurred image placeholder is in a incorrect position.
I will take a close look when i have time, and I was thinking maybe the solution you mentioned above https://github.com/steven-tey/novel/blob/main/packages/core/src/ui/editor/extensions/image-resizer.tsx is better, will take a try as well

But I don't see it, I've been fixing some from it. I'm almost done.

@wwayne I move this into #25 here, please let me know what you think. I've added some edge cases like preventing from scaling more than the container.


Sort ignoring lesser values in ascending order

Hello,
Using this sample data:
http://www.sharecsv.com/s/9096d32f98aa0ac671a1cca16fa43be8/SalesJan2009.csv
I can sort largest to smallest with :Sort! n on the price column, but :Sort! doesn't seem to correctly go in ascending order, as I would expect it.
If you sort on the header, "13,000" is first followed by 1200, skipping lesser values like 250.
Is this expected?
Thanks!

Hi jungle-boogie!
On Mo, 17 Aug 2015, jungle-boogie wrote:

Hello,
Using this sample data:
http://www.sharecsv.com/s/9096d32f98aa0ac671a1cca16fa43be8/SalesJan2009.csv
I can sort largest to smallest with :Sort! n on the price column, but :Sort! doesn't seem to correctly go in ascending order, as I would expect it.
If you sort on the header, "13,000" is first followed by 1200, skipping lesser values like 250.
Is this expected?

The default without the 'n' flag does not a numeric sort but an
alphabetic sort. So you probably want :Sort n to sort numbers in
ascending order.
Best,
Christian
Nur der ist weise, der weiß, daß er es nicht ist.
-- Sokrates (470-399 v.Chr.)

Hi,

So you probably want :Sort n to sort numbers in ascending order.

Yes, that's perfect!
Thanks!


Document Version-n-go process

Description
As a DevOps Engineer, I'd like to have documentation on the version-n-go process, in order to understand how to work with application teams.
Acceptance Criteria
Reference: [Done-Done Checklist] (https://github.com/Microsoft/code-with-engineering-playbook/blob/master/Engineering/BestPractices/DoneDone.md)

[ ] Should ‹testable condition that should be satisfied›
[ ] Should ‹testable condition that should be satisfied›
[ ] …

Also, here are a few points that need to be addressed:

Constraint 1;
Constraint 2;
Constraint 3.

Resources
Tech Design (Link to PR until Merged into master)
Mockups
Tasks
Stories are intended to be completed in a single sprint; if task breakdown creates addition work then team should discuss promoting the Story to an Epic.
Reference: [Minimal Valuable Slices] (https://github.com/Microsoft/code-with-engineering-playbook/blob/master/Engineering/BestPractices/MinimalSlices.md)
Reference: [How to Write Better Tasks] (http://agilebutpragmatic.blogspot.com/2012/04/splitting-story-into-tasks-how-to-write.html)
Assignee should break down work into tasks here

From a conversation during planning today, it seems that this issue needs to introduce two example artifacts for consumers to take advantage. They would be described in the docs (vs shipped as two additional files).


chore: correct README.md

This PR corrects the README.md as requested by @DanDucky on #6

Thanks your Contribution!!


Support for shoulda-context

Great/superclean wrapper.
Any chance of adding support for the quite popular shoulda-context context framework (TestNearest, rest works), which is quite popular amongst Rails devs?

I investigated shoulda-context, but for some reason it produces too unpredictable method names. The following:
require "minitest/autorun"
require "shoulda-context"

class CalculatorTest < Minitest::Test
  should "be shiny" do
    # ...
  end

  context "addition" do
    should "be possible" do
      # ...
    end
  end
end

produces methods that are equivalent of the following:
require "minitest/autorun"

class CalculatorTest < Minitest::Test
  define_method('test_: addition should be possible.') do
    # ...
  end

  define_method('test_: Calculator should be shiny.') do
    # ...
  end
end

These are actual methods in quotes, I just needed to use define_method because they contain a : and a .. Notice in the second method how it transformed "CalculatorTest" into "Calculator".
So, because of that, I cannot construct reliable regexes. I honestly don't know what people see in shoulda-context, its functionality is already supported by minitest/spec.

Glad we had the same results regarding method names.
Its the difference between …

… which becomes hard to read soon, an this …

… which really makes a difference in more sophisticated tests with different contexts, regarding readability etc. and I guess its what makes people use shoulda context.
But thanks for the immediate try, thats really appreciated.

But isn't shoulda-context reimplementing minitest/spec? I get that with test/unit (before minitest) it was really useful, but minitest has minitest/spec, which does the same thing, but much more transparent, so test.vim supports it.

No, not really, it just adds some context and should blocks while it allows you to stick with your good old minitest syntax.
Using minitest/spec is a matter of taste, a couple of Minitest users prefer to avoid the specification style and instead use minitest/test, as it's closer to the metal and uses a more vanilla Ruby syntax.

That's exactly the part I don't get :). If someone uses minitest/spec, then they don't need shoulda-context, since minitest/spec already provides that syntax. On the other hand, I prefer the minitest/test syntax, because I like the explicitness of it. But then again why would I ruin it by adding shoulda-context? So why would I ever use it? :)


Introduce Agent platform

The Agent platform uses cluster-api-provider-agent to match existing Agent resources with Machines. This is a platform-agnostic way of adding workers.

/hold all comments addressed, testing to validate

github.com/openshift/hypershift/hypershift-operator/controllers/nodepool

hypershift-operator/controllers/nodepool/nodepool_controller.go:520:21: undefined: AgentMachineTemplate
make: *** [hypershift-operator] Error 2
Also please squash/rephrase "Fix review comments" commit.

lgtm other than https://github.com/openshift/hypershift/pull/760#discussion_r768630748.
This is a good first step, let's update the repo ref and ship it. We can then do iterative follow ups and make sure there's docs and e2e test before we claim this is supported.

As mentioned above, this is just an enabler development step towards eventually support an agent based workflow which will require docs and e2e testing.
This sets the basis for the agent based workflow and enable us to keep figuring and refining the right boundaries for multi-platform extensibility along with https://github.com/openshift/hypershift/pull/779.
/approve

/cancel hold

/hold cancel


Added Google Drive Python API tutorial for beginners

This tutorial demonstrates the different capabilities of the Google Drive Python API, including creating folders, uploading files, adding custom file properties, and searching using these properties.
I started using the Google Drive API two weeks ago and I faced a lot of challenges that I hope others won't have to if they read through this tutorial. Here is an example. I am open to discussing any changes or potential inaccuracies in this tutorial.

@mhdadk great tutorial! Helped me a lot getting started with drive.


update registry, so that docker hub registry works

Hi,
Firstly I am not sure if this is a good implementation but I saw https://github.com/jupyterhub/binderhub/issues/486 and wanted share how we managed to use docker hub public registry. gcr should still work without changing any configuration.
Configuration to use docker hub registry:

secret.yaml:

registry:
  username: <docker_hub_username>
  password: <docker_hub_password>

config.yaml:

registry:
  enabled: true
  prefix: <user/organization_name>/<image_prefix>
  authHost: index.docker.io/v1
  authTokenUrl: https://auth.docker.io/token?service=registry.docker.io&scope=repository:{image}:pull
  imageManifestUrl: https://registry.hub.docker.com/v2/{image}/manifests/{tag}

Nice! It seems like we can simplify this a bit.
What if we had:
registry:
   host: https://gcr.io
   authTokenUrl: https://gcr.io/v2/token?service=gcr.io

and we add the scope=image:{image}:pull as part of our implementation? Is there any case where this can vary if it's a docker registry?
The imageManifestUrl should always be {host}/v2/{image}/manifests/{tag} for any docker registry, right? So that doesn't need to be configurable beyond host as well. And there are only two hosts: the one in authTokenUrl and the actual registry  host, right?

yes, we can add the scope=image:{image}:pull as part of the implementation.
And also yes, the imageManifestUrl should always be {host}/v2/{image}/manifests/{tag} for any docker registry as far as I know. But there are actually 3 hosts for docker hub registry: the one in authTokenUrl (auth.docker.io), the one in config.json (index.docker.io/v1) for authentication and the actual docker registry host (registry.hub.docker.com).
So actually we need:
registry:
  host: https://registry.hub.docker.com
  authHost: https://index.docker.io/v1
  authTokenUrl: https://auth.docker.io/token?service=registry.docker.io

and host and authHost are same for gcr (https://gcr.io).

@bitnik thanks! Let's do that, and make the default BinderHub.auth_host be the same as BinderHub.host, so that only .host needs to be specified if they are the same:
auth_host = Unicode(...)

@default('auth_host')
def _default_auth_host(self):
    return self.host

@minrk I updated the commit. Can you check it?

Thanks!


feat(sbb-toggle): full width clickable on small options

Preview only. tests missing

Codecov Report

Merging #1625 (547eef0) into master (ab917b0) will decrease coverage by 1.89%.
The diff coverage is 50.98%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##           master    #1625      +/-   ##
==========================================
- Coverage   54.85%   52.96%   -1.89%
==========================================
  Files          49       79      +30
  Lines        1659     3574    +1915
  Branches      406      960     +554
==========================================
+ Hits          910     1893     +983
- Misses        671     1550     +879
- Partials       78      131      +53

Impacted Files
Coverage Δ

...mponents/sbb-accordion-item/sbb-accordion-item.tsx
0.00% <0.00%> (-37.21%)
:arrow_down:

src/components/sbb-icon/sbb-icon.tsx
91.66% <ø> (ø)

src/components/sbb-image/sbb-image.helper.tsx
62.06% <ø> (-2.45%)
:arrow_down:

src/components/sbb-image/sbb-image.tsx
69.09% <ø> (+6.12%)
:arrow_up:

...mponents/sbb-journey-header/sbb-journey-header.tsx
88.23% <ø> (+1.27%)
:arrow_up:

...onents/sbb-journey-summary/sbb-journey-summary.tsx
80.55% <ø> (ø)

src/components/sbb-link-list/sbb-link-list.tsx
84.00% <ø> (-4.24%)
:arrow_down:

src/components/sbb-link/sbb-link.tsx
60.41% <ø> (-31.02%)
:arrow_down:

src/components/sbb-logo/sbb-logo.tsx
0.00% <ø> (ø)

src/components/sbb-menu-action/sbb-menu-action.tsx
65.21% <ø> (ø)

... and 85 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


[Scheduled Maintenance] Database Maintenance

We'll be performing some database maintenance in order to reclaim disk space from statuses that have been deleted. This will require a brief downtime - probably around 10 minutes, but possibly up to 60.

Only turned off the sidekiq workers, ran in 10 minutes or so. Had to free up 18+ GB of disk space to be able to actually run the vacuum.


Implementing CirclePlot - not finished

Hi!
This is where I managed to get so far :)
To be honest, the pixel/coordinate transformations got me confused a bit. Also, I am not sure how to lock the created circle to coordinate positions, so when i zoom in/out (with AxisScaleLock(true)), the circle size should follow it dynamically (this should be also optional i guess?).
Maybe you can give me some help in this? :)
Otherwise it does draw a circle at least :)
Thanks!
formsPlot1.Plot.AddCirclePlot(0, 0, 150);
//formsPlot1.Plot.SetAxisLimits(-150, 150, -150, 150);
formsPlot1.Plot.AxisScaleLock(true);
formsPlot1.Plot.Render();
formsPlot1.Refresh();

Hmm, I am not really good at this :)
I should first better understand the pixel/coordinate calculations inside ScottPlot :)
This attempt works fine if XY= 0,0 , otherwise wrong width/height :)
public void Render(PlotDimensions dims, System.Drawing.Bitmap bmp, bool lowQuality = false)
        {
            // Use ScottPlot's GDI helper functions to create System.Drawing objects
            using var gfx = ScottPlot.Drawing.GDI.Graphics(bmp, dims, lowQuality);
            using var pen = ScottPlot.Drawing.GDI.Pen(Color, LineWidth, LineStyle);

            // Use 'dims' methods to convert between axis coordinates and pixel positions
            float xPixel = dims.GetPixelX(X - Radius);
            float yPixel = dims.GetPixelY(Y - Radius);

            // Render data by drawing on the Graphics object
            gfx.DrawEllipse(pen, xPixel, yPixel, dims.GetPixelX(Radius * 2) - dims.GetPixelX(X), dims.GetPixelY(Radius * 2) - dims.GetPixelY(Y));
            //gfx.DrawEllipse(pen, xPixel, yPixel, dims.GetPixelX(Radius * 2), dims.GetPixelY(Radius * 2));
        }

Hi @bukkideme, thanks so much for getting this started!
I'll start working on this now and make some commits to this branch and possibly merge it in. I recommend not making additional commits while I'm working on it to avoid merge conflicts. Hopefully the changes I implement from here will help answer your questions!
Even though the code in its present state isn't working perfectly, getting this PR started was still a big help, so thanks! I'll follow-up with a message shortly to indicate my progress.

Thanks very much for continue the implementation, i will certainly learn from the commits you will make! I do not commit new things from now then!

See 6364e92
I had to convert Radius from coordinate units to pixel units before the ellipse was drawn. Because X and Y scales may be different sizes (pixels per unit), I had to calculate it independently for X and Y.
Plot plt = new();
plt.AddCirclePlot(0, 0, 5);
TestTools.SaveFig(plt);

I'm adding legend support while I'm in here too

... and while the hood was popped, I made some changes elsewhere in the code base using this pull request. I hope it's not too confusing! 😅
This looks great, and I'm going to merge in a few minutes and hopefully release a new version of ScottPlot at the end of this weekend 🚀

Awesome! :) I did not hope for such quick release! :) 🚀


Add Support for Consumables Search

maybe you should point out that in 1.0.4 consumables is not working now....its buying players now instead.

 This worked pretty well in a script I made last year

Yes ive noticed, bought me some shitty players but it's not a problem, now
im using 1.0.3 with wait time 10-20
Il Dom 11 Ott 2020, 13:35 suave123<EMAIL_ADDRESS>ha scritto:

maybe you should point out that in 1.0.4 consumables is not working
now....its buying players now instead.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/chithakumar13/Fifa21-AutoBuyer/issues/8#issuecomment-706691227,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AHVHOHAYJEE4MUFNJOGKTM3SKGKBPANCNFSM4SLV77AQ
.

I have the same problem with consumables, it buys players only. I working now with master bot

Same probleme for consumables too

Consumable search is working fine , please take the latest binaries from release

Are you sure because Im bought all players with shadow :D

@humam91  , yeah its fixed download from the updated js files if you havent


Alias ZEXTERN, ZEXPORT and ZEXPORTVA to Z_EXTERN, Z_EXPORT and Z_EXPORTVA respectively.

See #914.
I chained the defines so any changes to zlib-ng defines are mirrored to stock zlib defines if not overwritten.

While I now kind of regret it, we do include the other backwards compatible types and defines in zconf-ng.h too, so I guess we should add these there too.
I think we will rather plan to deprecate and remove them again later, once more programs have converted.

Maybe our porting document should contain a list of all the defines and types that are deprecated and going away, along with the replacement define/type for each of them. Makes it easier for people to do a search for them.

The reason I don't think it should go in zconf-ng.h is because that API is not intended for it to be zlib-compatible. I think the purpose of the zlib-compat API should be to aid adoption, but not the zlib-ng API. I would be in favor of removing the deprecated types from zlib-ng API sooner rather than later.

We could start by adding the (gcc) deprecated attribute to the typedefs, that would trigger a warning whenever someone uses one of them.
https://gcc.gnu.org/onlinedocs/gcc-3.2/gcc/Type-Attributes.html
And we could add pragmas trigger warnings when someone uses the defines.
https://stackoverflow.com/questions/2681259/how-to-deprecate-a-macro-in-gcc

Not having them does mean it would be harder for applications to implement support for both zlib and zlib-ng though.

The way this pull request implements the defines is that if someone tries to define using the old names on command-line, it will most likely fail. As such it only allows using the defines as they are defined using the new names in this same file... I was pondering possibility to default value of the new defines based on old defines possibly specified in command line, but that would have made the patch a lot more complex.
We currently don't have macro that hides the differences between compilers in how they declare deprecated macros, functions etc., so marking them as deprecated in non-compat mode would have to be separate pull request.


Setup Ottawa DevOps Days

https://gcdevopsleague.slack.com/messages/CK8QG4PL4/

Does the GoC count as one org, or would each department be a different org?
Find contacts from within GoC

[x] Contact DevOps days organizers
[x] Contact Values and Ethics
[x] Meet with Values and Ethics
[x] Contact GitHub

Will need to contact more external partners. GitHub are looking into their capacity to be co-organizers (they've been one in the past).
Part of the question here is that co-organizers are not necessarily sponsors: they are organizing and will be collecting money from both sponsors and attendees which is why this will be a GC DevOps league initiative rather than an ESDC one. I'd close the issue here.


Does not build on arm64

The issue is in your cmake file. You do STRING(FIND ${CPUINFO} "sse4_1" SSE4_1_TRUE) which sets SSE4_1_TRUE=-1 when "sse4_1" is not found. Then you do IF (SSE4_1_TRUE) and since -1 is a non-zero number it evaluates to true.

Looks like it works if you change the if statement to IF (SSE2_TRUE GREATER 0)

After fixing that I am now getting a linker error:
#0 61.06 [100%] Linking CXX executable leviosam2
#0 61.12 /usr/bin/ld: liblvsam.a(aln.cpp.o): in function `Aln::align_ksw2(char const*, char const*, Aln::AlnOpts const&, std::vector<unsigned int, std::allocator<unsigned int> >&, int&)':
#0 61.12 aln.cpp:(.text+0x28d0): undefined reference to `ksw_extd2_sse'
#0 61.12 /usr/bin/ld: aln.cpp:(.text+0x29d0): undefined reference to `ksw_extz2_sse'

If you don't have access to an M1 mac I'm happy to test out a PR

I don't have an M1 Mac. I just pushed the cmake changes to branch arm64, which compiled for me on linux x86_64 and mac x86_64. It'd be great if you can test a PR.

That resolves the cmake issue but it still fails on the linker issue. I am guessing there needs to be a conditional depending on whether sse instructions are available to determine whether to use the sse or non-see versions of ksw fuctions.

We will explore non-SSE solutions to complement the ksw2 module when we have bandwidth. We expect Rosetta emulation to be a tentative solution on Mac M1.

Hello,
I create a PR for this which have tested on an ARM SBC. It would help getting this PR approved if you can test whether it works on Apple M1, too.

This is addressed in #43 (thanks to @ch4rr0) and #45. I'm interested in supporting an image based on arm64 in the future.


Possible subtitle bug when stream on manual

Bug report
Your Environment

Netflix add-on version: 0.15.5
Operating system version/name: Android 8
Device model:  Mibox

Used Operating system:

[x] Android
[ ] iOS
[ ] Linux
[ ] OSX
[ ] Raspberry-Pi
[ ] Windows

Describe the bug
First of all thank you very much for this addon.
I'm only able to get to 4k if set the stream to manual on inputstream adaptive addon, i tried to set Min Bandwidth to over 16,000,000 (I guess it should be enough to get 4k, if not how much???), but if i do that I'm not able to select any subtitle
Expected behavior
On subtitle setings it should be able to choose among subtitles languages
Actual behavior
It doesn't show any subtitle avaliable
Steps to reproduce the behavior

Enable all setings to be able to run in 4k
Set inputstream adaptive addon stream selection to manual
Try to choose a subtile

Possible fix
Disabling doubly digital seems to "fix" but it doesn't show all the subtitles that are available, if u change to auto it does
Thanks again

You have a wrong inputstream configuration
Stream selection > Auto (manual is only to debug scope and if ON cause problems with streams)
Override HDCP > ON
Ignore display resolution > ON if kodi resolution is less than 4k else OFF

ill try that, how much should i set Min Bandwidth to get 4k? If I set it to auto i can't get 4k, I need to check if kodi resolution is 4k or try to ignore display. Thanks for the fast reply and for the amazin job with this addon

Worked like a charm, the kodi was set as 1080, i changed ignore display to on set the stream to auto and 18,000,000 for min Bandwidth, sorry for my ignorance and thanks for your patience

can you tell me the exact model of your Mibox device?
I would like to make a list of devices that work in 4k

Of course, Mibox MDZ-16-AB global version

would you have time to help me with ESN?
can you send to my email your ESN in use? (my email on first github page)
Thanks, i need it only to understand the structure


Great app, it's a shame it's abandoned.

Great app, it's a shame it's abandoned.

We're both sorry but we were both run off by everyday life and weren't able to return to it. I'll soon take it off from the Obsidian store. If you'd like to contribute feel free to fork!


[py2py3] futurize src/python/WMCore/Configuration.py

Fixes #9973
Status
Ready
This is the best that we can do at the moment to modernize Configuration.py.
I do not consider this to be absolutely the best final version that I can guarantee works in py3, but this is a good starting point.
Unit test passed, so I am reasonably confident this is py2 compatible, too.
I would suggest merging this now, then I will open a new issue about the python3 validation of Configuration.py
Description
Run futurize on WMCore/Configuration.
What stll needs to be sorted out:

[x] Fix storm of errors in unit tests
[ ] import imp

current implementation in kind of a hack, this will need to be tested in py3
They say that imp is deprecated since python 3.4, but it is currently working for us in python 3.8
Getting out of imp and into importlib likely requires more careful investigation on how to adapt our modules to be compatible with new importlib API.

[x] Implementing __eq__ without also implementing __hash__ (eq-without-hash)

hash() - python official doc
Our class ConfigSection have mutable members, such as  self._internal_settings = set(): self._internal_docstrings = {}; self._internal_children = set(), so ConfigSection objects are not hashable
This warning from pylint is considered a false positive

[x] isinstance(value, unicode)

keep in mind that we faced https://github.com/dmwm/WMCore/issues/10381, so we can only afford a temporary hack at the moment

[ ] validation in py3 environment

Is it backward compatible (if not, which system it affects?)
It should be. However, any bug would affect directly
'WMCore_WMStats',
'WMQuality_WebTools',
'WMCore_Locale',
'WMCore_JobSplitting',
'WMCore_WMInit',
'WMCore_Agent',
'WMCore_WebTools',
'WMCore_DataStructs',
'WMCore_FwkJobReport',
'WMCore_ReqMgr',
'WMCore_MicroService',
'WMQuality_Emulators',
'WMCore_WMSpec',
'WMComponent_AnalyticsDataCollector',
'WMCore_REST'

External dependencies / deployment changes
requires python-future, but we already have that

I only pushed the changes proposed by futurize, but these are not nearly enough. These should be considered only as suggestions, some help to spot potential failure points in the migration. This is why I would need the help of @amaltaro or @todor-ivanov .
Rationale: the main potential source of bugs in this PR is how we deal with types that change between py2 and py3.
basestring
In python2 basestring is used to check if an object is an instance of str or unicode. Here I have the first question: why do we have
if PY3:
    basestring = str

?
If the purpose is to match both types, we could simply import from past.builtins import basestring, which provide a new type in python3 that matches both bytes (which is py2 str) and str (which is py2 unicode).
unicode
We currently have
if isinstance(value, unicode):
       value = str(value)

which in py2 converts value from unicode to str.
But then I see
if PY3:
  unicode = str

We should notice that if in py2 str is a sequence of bytes, in py3 str is a sequence of unicode codepoints. So, while  unicode = str is a tautology in python3, it would have no effect on if isinstance(value, unicode): value = str(value). Moreover, since str changed meaning between py2 and py3, right now we are converting it to a sequence of bytes, in python3 we would leave it unchanged to a sequence of unicode.
In any case, such a value would be used in object.__setattr__(self, name, value), in python3 such a value can be either a stror bytes and in py2 it can be either str or unicode, and in self._complexTypeCheck(name, value), which in case of str or bytes would only check that they are in _SimpleTypes list, so this should make no difference.
I would propose to remove   unicode = str and if isinstance(value, unicode): value = str(value). do you see any possible side effect?
int and long
in py2 int and long are different types. In py3 the equivalent of int disappeared and long has been renamed int. what we can do instead of
if PY3:
    long = int

would be importing from past.builtins import long. These two options should be identical, you should decide the one that you prefer.

test this please

I think that the only way to get out of this haystack is to wait for the py3 environment. It is super unlikely that we can get this right without it :grimacing:

Hi @amaltaro I will run some tests right now.
@mapellidario  did you manage to create a separate issue just for the action regarding the validation of this module as you mentioned here:

I would suggest merging this now, then I will open a new issue about the python3 validation of Configuration.py

Here we go @todor-ivanov! #10488

Thank @mapellidario ! Working on it now.

@todor-ivanov if you haven't started testing this PR, then do not worry. I'm testing mine for the Dashboard removal and I also have this patch in my setup.

Quick update on this, it seems to be working fine in python2 (checked on both WMAgent and central services).

@mapellidario I do not know if you plan to fix any explicit problems with python3 stack(?) If you do, then here is an error while deploying wmagentpy3 with your changes:
*** Initializing the agent ***
Initialising Agent...
Traceback (most recent call last):
  File "/data/srv/wmagent/v1.4.9.pre2-comp2/sw/slc7_amd64_gcc630/cms/wmagentpy3/1.4.9.pre2-comp2/bin/wmcore-db-init", line 96, in <module>
    cfgObject = loadConfigurationFile(config)
  File "/data/srv/wmagent/v1.4.9.pre2-comp2/sw/slc7_amd64_gcc630/cms/wmagentpy3/1.4.9.pre2-comp2/lib/python3.8/site-packages/WMCore/Configuration.py", line 597, in loadConfigurationFile
    modPath = my_importlib.find_module(cfgBaseName, [cfgDirName])
AttributeError: module 'importlib' has no attribute 'find_module'
Traceback (most recent call last):
  File "/data/srv/wmagent/v1.4.9.pre2-comp2/sw/slc7_amd64_gcc630/cms/wmagentpy3/1.4.9.pre2-comp2/bin/wmagent-couchapp-init", line 292, in <module>
    wmagentConfig = loadConfigurationFile(os.environ["WMAGENT_CONFIG"])
  File "/data/srv/wmagent/v1.4.9.pre2-comp2/sw/slc7_amd64_gcc630/cms/wmagentpy3/1.4.9.pre2-comp2/lib/python3.8/site-packages/WMCore/Configuration.py", line 597, in loadConfigurationFile
    modPath = my_importlib.find_module(cfgBaseName, [cfgDirName])
AttributeError: module 'importlib' has no attribute 'find_module'
Done!

Is this present even with this PR in place? because I added here
# FIXME: python3 deprecation. This will no longer be needed when running in py3
if PY3:
    import importlib as my_importlib
else:
    import imp as my_importlib

and it should fix your problem

test this please


[web-visualization] fix visualization issue after refresh

The issue was introduced by #82

Codecov Report

Merging #89 into master will decrease coverage by 0.08%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master      #89      +/-   ##
==========================================
- Coverage   39.97%   39.89%   -0.09%
==========================================
  Files          16       16
  Lines        2444     2444
==========================================
- Hits          977      975       -2
- Misses       1447     1449       +2
  Partials       20       20

Impacted Files
Coverage Δ

web/site/bindata.go
99.20% <ø> (ø)

web/web.go
42.02% <0.00%> (-2.90%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5205ac8...7803491. Read the comment docs.

LGTM.
Interesting. Why would this cause the nodes to lose states?

No state is lost for any node. It's just that Javascript code stopped running due to errors.

@simonlingoogle , please resolve conflicts.

@simonlingoogle , please resolve conflicts.

done


Update README.md

Added physics- and symbolic-based RL environments for safe and robust robot control.
Used in https://arxiv.org/abs/2108.06266

Thank you very much for your contribution. A very interesting project.


Repo sync for protected CLA branch

The pull request is created from master637377744034575225 to master to fix git push error for protected CLA branch

@cmcclister : Thanks for your contribution! The author(s) have been notified to review your proposed change.


test_lr_with_slow_safekeeper is flaky because logical_replication_sync not waiting for tablesync

Multiple failures of test_lr_with_slow_safekeeper, e.g.:
https://neon-github-public-dev.s3.amazonaws.com/reports/pr-10238/12486246775/index.html#/testresult/455c25d1ecd98aac
with the following diagnostics:
test_runner/regress/test_logical_replication.py:317: in test_lr_with_slow_safekeeper
    assert [r[0] for r in vanilla_pg.safe_psql("select * from t")] == [1]
E   assert [] == [1]
E     Right contains one more item: 1
E     Full diff:
E     - [1]
E     ?  -
E     + []

pgdata-vanilla/pg.log:
2024-12-24 21:29:09.658 UTC [92514] LOG:  logical replication apply worker for subscription "sub1" has started
2024-12-24 21:29:09.666 UTC [92226] LOG:  received fast shutdown request
2024-12-24 21:29:09.666 UTC [92576] LOG:  logical replication table synchronization worker for subscription "sub1", table "t" has started
2024-12-24 21:29:09.666 UTC [92226] LOG:  aborting any active transactions
2024-12-24 21:29:09.666 UTC [92576] FATAL:  terminating logical replication worker due to administrator command

Or https://neon-github-public-dev.s3.amazonaws.com/reports/pr-10238/12486246775/index.html#/testresult/4efed0c5fa7cc95b
test_runner/regress/test_logical_replication.py:317: in test_lr_with_slow_safekeeper
    assert [r[0] for r in vanilla_pg.safe_psql("select * from t")] == [1]
E   assert [] == [1]
E     Right contains one more item: 1
E     Full diff:
E     - [1]
E     ?  -
E     + []

pgdata-vanilla/pg.log:
2024-12-24 21:29:04.111 UTC [88099] LOG:  logical replication apply worker for subscription "sub1" has started
2024-12-24 21:29:04.123 UTC [88067] LOG:  received fast shutdown request
2024-12-24 21:29:04.126 UTC [88067] LOG:  aborting any active transactions
2024-12-24 21:29:04.126 UTC [88099] FATAL:  terminating logical replication worker due to administrator command

show that the logical_replication_sync call in the test:
    vanilla_pg.safe_psql("create table t(a int)")
    connstr = endpoint.connstr().replace("'", "''")
    vanilla_pg.safe_psql(f"create subscription sub1 connection '{connstr}' publication pub")
    logical_replication_sync(vanilla_pg, endpoint)

    vanilla_pg.stop()

doesn't wait for the table synchronization to finish. On a successful run, pg.log contains:
2024-12-25 14:33:55.575 EET [2152526] LOG:  database system is ready to accept connections
2024-12-25 14:33:55.868 EET [2152610] LOG:  logical replication apply worker for subscription "sub1" has started
2024-12-25 14:33:55.918 EET [2152625] LOG:  logical replication table synchronization worker for subscription "sub1", table "t" has started
2024-12-25 14:33:55.952 EET [2152625] LOG:  logical replication table synchronization worker for subscription "sub1", table "t" has finished
2024-12-25 14:33:56.420 EET [2152526] LOG:  received fast shutdown request

This test failure can be easily reproduced with a sleep added inside TablesyncWorkerMain():
@@ -1714,6 +1714,7 @@ TablesyncWorkerMain(Datum main_arg)

     SetupApplyOrSyncWorker(worker_slot);

+pg_usleep(1000000);
     run_tablesync_worker();

I've discovered that the above recipe for reproducing doesn't work on each test run because of another issue. With the additional logging added to logical_replication_sync:
@@ -4927,6 +4928,10 @@ def logical_replication_sync(subscriber: PgProtocol, publisher: PgProtocol) -> L
     """Wait logical replication subscriber to sync with publisher."""
     publisher_lsn = Lsn(publisher.safe_psql("SELECT pg_current_wal_flush_lsn()")[0][0])
     while True:
+        res = subscriber.safe_psql("select * from pg_catalog.pg_stat_subscription")
+        log.info(f"pg_stat_subscription: {res}")
+        res = subscriber.safe_psql("select latest_end_lsn from pg_catalog.pg_stat_subscription")
+        log.info(f"latest_end_lsn(s): {res}")
         res = subscriber.safe_psql("select latest_end_lsn from pg_catalog.pg_stat_subscription")[0][

I'm seeing the following messages (with line breaks added) in the test log:
2024-12-28 07:57:19.668 INFO [neon_fixtures.py:300] Executing query: create table t(a int)
2024-12-28 07:57:19.743 INFO [neon_fixtures.py:300] Executing query: create subscription sub1 connection 'host=localhost port=16016
 user=cloud_admin dbname=postgres options=''-cstatement_timeout=120s ''' publication pub
2024-12-28 07:57:19.779 INFO [neon_fixtures.py:300] Executing query: SELECT pg_current_wal_flush_lsn()
2024-12-28 07:57:19.784 INFO [neon_fixtures.py:300] Executing query: select * from pg_catalog.pg_stat_subscription
2024-12-28 07:57:19.785 INFO [neon_fixtures.py:4932] pg_stat_subscription:
[(16387, 'sub1', 'apply', 2698456, None, None, '0/292FCC0', datetime.datetime(2024, 12, 28, 7, 57, 19, 784847,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), datetime.datetime(2024, 12, 28, 7, 57, 19, 784988,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), '0/292FCC0', datetime.datetime(2024, 12, 28, 7, 57, 19, 784847,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))))]
2024-12-28 07:57:19.788 INFO [neon_fixtures.py:300] Executing query: select latest_end_lsn from pg_catalog.pg_stat_subscription
2024-12-28 07:57:19.789 INFO [neon_fixtures.py:4934] latest_end_lsn(s): [(None,), ('0/292FCC0',)]
2024-12-28 07:57:19.792 INFO [neon_fixtures.py:300] Executing query: select latest_end_lsn from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.296 INFO [neon_fixtures.py:300] Executing query: select * from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.298 INFO [neon_fixtures.py:4932] pg_stat_subscription:
[
(16387, 'sub1', 'table synchronization', 2698460, None, 16384, None, datetime.datetime(2024, 12, 28, 7, 57, 19, 785883,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), datetime.datetime(2024, 12, 28, 7, 57, 19, 785883,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), None, datetime.datetime(2024, 12, 28, 7, 57, 19, 785883,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200)))),
(16387, 'sub1', 'apply', 2698456, None, None, '0/292FCC0', datetime.datetime(2024, 12, 28, 7, 57, 19, 784847,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), datetime.datetime(2024, 12, 28, 7, 57, 19, 784988,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), '0/292FCC0', datetime.datetime(2024, 12, 28, 7, 57, 19, 784847,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))))]
2024-12-28 07:57:20.300 INFO [neon_fixtures.py:300] Executing query: select latest_end_lsn from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.302 INFO [neon_fixtures.py:4934] latest_end_lsn(s): [(None,), ('0/292FCC0',)]
2024-12-28 07:57:20.305 INFO [neon_fixtures.py:300] Executing query: select latest_end_lsn from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.809 INFO [neon_fixtures.py:300] Executing query: select * from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.810 INFO [neon_fixtures.py:4932] pg_stat_subscription:
[
(16387, 'sub1', 'table synchronization', 2698460, None, 16384, '0/29301B0', datetime.datetime(2024, 12, 28, 7, 57, 20, 810037,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), datetime.datetime(2024, 12, 28, 7, 57, 20, 810057,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), '0/29301B0', datetime.datetime(2024, 12, 28, 7, 57, 20, 810037,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200)))),
(16387, 'sub1', 'apply', 2698456, None, None, '0/29301B0', datetime.datetime(2024, 12, 28, 7, 57, 20, 793298,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), datetime.datetime(2024, 12, 28, 7, 57, 20, 793393,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))), '0/29301B0', datetime.datetime(2024, 12, 28, 7, 57, 20, 793298,
 tzinfo=datetime.timezone(datetime.timedelta(seconds=7200))))]
2024-12-28 07:57:20.813 INFO [neon_fixtures.py:300] Executing query: select latest_end_lsn from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.814 INFO [neon_fixtures.py:4934] latest_end_lsn(s): [('0/2930228',)]
2024-12-28 07:57:20.817 INFO [neon_fixtures.py:300] Executing query: select latest_end_lsn from pg_catalog.pg_stat_subscription
2024-12-28 07:57:20.818 INFO [neon_fixtures.py:4939] subscriber_lsn=0/2930228
2024-12-28 07:57:20.818 INFO [neon_fixtures.py:4941] Subscriber LSN=0/2930228, publisher LSN=0/292FCC0
2024-12-28 07:57:20.818 INFO [neon_fixtures.py:2901] Running command '.../neon/pg_install/v17/bin/pg_ctl -w
 -D .../neon/test_output/test_lr_with_slow_safekeeper[release-pg17]/pgdata-vanilla stop'

That is, "select * from pg_catalog.pg_stat_subscription" returns two records:
(16387, 'sub1', 'table synchronization', 2698460, None, 16384, None, ...),
(16387, 'sub1', 'apply', 2698456, None, None, '0/292FCC0', ...)

and the first record contains latest_end_lsn == None, so code below the check "if res:" is not reached in this case until the "table synchronization" disappears. But as the query lacks "order by", the "apply" record can be the first as well and then the query might fail with the sleep added (or without, due to concurrent load).
"select latest_end_lsn from pg_catalog.pg_stat_subscription where latest_end_lsn is not null" makes the test work (fail) deterministically.


Support vendor widevine library

This adds support for a vendor-supported Widevine library.
This fixes #229

The information pane will look like this:

Kodi information

Kodi version: 18.5
Kodi platform/architecture: Linux/arm

InputStream information

InputStream Helper version: 0.4.3
InputStream Adaptive version: 2.4.0

Widevine information

Widevine version: 4.10.1440.18 (supplied by vendor)

Please report issues to:

https://github.com/emilsvennesson/script.module.inputstreamhelper/issues

We need to test this functionality on Windows and macOS, mostly to test the behavior using hardlinking and exception handling.

@horstle Hardlinking here is not just useful to save disk space, but it makes testing if two files are the same file a lot more efficient than the worst case scenario: comparing complete content. Especially if this has to happen on every playback...

I don't have any problem with (hard)links. I just prefer avoiding/minimising differences in behaviour on different platforms, but let's not start that discussion again.

@horstle Oh, I didn't want to start a polemic, I just found a better reason to use them (when they are supported)

@samnazarko Would it be useful to show the library timestamp as well in the information pane (i.e. ctime or mtime) so the user has an indication when the library was made/added?

I don’t think it’s necessary to show any significant versioning details for vendor based Widevine libs.
I’ll send our current version to your email shortly so you can have a look
On 23 Dec 2019, at 11:03, Dag Wieers<EMAIL_ADDRESS>wrote:

@samnazarkohttps://github.com/samnazarko Would it be useful to show the library timestamp as well in the information pane (i.e. ctime or mtime) so the user has an indication when the library was made/added?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/emilsvennesson/script.module.inputstreamhelper/pull/240?email_source=notifications&email_token=AAHDWLDCWL27KVY3LGOJPQDQ2CLJXA5CNFSM4J6OCP3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHQ4GNQ#issuecomment-568443702, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAHDWLA5TYBN6PZOLVHJWE3Q2CLJXANCNFSM4J6OCP3A.

@samnazarko Without versioning information, how would users relate issues to versions/updates. Especially in the light of regressions (as have been reported in the past).

From a distribution perspective, we would expect a user to say it worked in the January version of OSMC but broke / regressed in February. Our release notes would show a version bump.
Our lib is stable and is somewhat pegged to CDM updates. I know there have been regressions with SW decoding but don’t anticipate this for HW decoding - it either works or it doesn’t.
On 24 Dec 2019, at 19:41, Dag Wieers<EMAIL_ADDRESS>wrote:

@samnazarkohttps://github.com/samnazarko Without versioning information, how would users relate issues to versions/updates. Especially in the light of regressions (as have been reported in the past).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/emilsvennesson/script.module.inputstreamhelper/pull/240?email_source=notifications&email_token=AAHDWLEJFSN7XGHHBAMBLLDQ2JQWNA5CNFSM4J6OCP3KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHTSCVY#issuecomment-568795479, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAHDWLCCABTTTAKNYZOYLNTQ2JQWNANCNFSM4J6OCP3A.

I've emailed through our current Widevine package.

I had to rework this PR for a big code restructure and prefered to start from scratch while keeping the original branch. So there is now a new PR #311 with the necessary changes for vendor widevine support.
Most of the non-vendor related changes in this PR were recently merged as part of #310
And we can close this one.


Custom ssq_freqs with custom shape [workaround included]

Hello,
I have a known set of frequencies that I am most interested in evaluating the synchrosqueezed CWT of a signal for. Let's say this frequency vector f_vect is defined as:
f_vect = 10**(np.arange(np.log10(fmin), np.log10(fmax), log_fstep))
I was hoping to provide this f_vect as the ssq_freqs optional input to the ssq_cwt() function, so as to get an output CWT whose columns match the time samples of a given signal and whose rows correspond to the desired frequencies (or scales that map directly to my given frequency vector). In pseudo-code, this would look like:
SSQ_CWT, CWT, ssq_freqs, scales = ssq_cwt(data, fs=fs, wavelet='gmw', ssq_freqs=f_vect)

print(SSQ_CWT.shape[0] == ssq_freqs.shape[0])
> True

But instead, the shape of the SSQ_CWT array is the default shape of ( len(scales), len(data) ), rather than my expected ( len(f_vect), len(data) ). As I understood the documentation, passing a np.ndarray into the ssq_freqs option should map the CWT scales onto the desired synchrosqueeze frequencies. What am I missing here?

Thanks for the report, I confirmed the bug.
I've not attended to this feature beyond the original implementation, and it appears fully custom ssq_freqs wasn't supported. Fixing this isn't trivial, I might get around to it in the future. It's also not overwhelming; I'll accept a PR for it.
In the meantime, one can do a workaround with minimal performance overhead:
WORKAROUND EXAMPLE
# -*- coding: utf-8 -*-
import numpy as np
from ssqueezepy import ssq_cwt
from ssqueezepy.visuals import imshow

def extend_log(vi, ssq_freqs0):
    """Assumes `ssq_freqs` and `vi` are log-spaced."""
    vi_len = len(vi)
    if min(vi) >= min(ssq_freqs0):
        start_idx = 1
    else:
        start_idx = 0

    v = np.zeros_like(ssq_freqs0)
    dvil = np.log10(vi[1]) - np.log10(vi[0])
    vi_first = vi[0]
    vi_last = vi[-1]

    v[start_idx:start_idx + vi_len] = vi
    if start_idx == 1:
        v[0] = 10**(np.log10(vi_first) - dvil)
        n_pts = len(v) - vi_len - 1
    else:
        n_pts = len(v) - vi_len
    startl = np.log10(vi_last) + dvil
    endl = startl + (n_pts - 1) * dvil
    v_ext1 = np.logspace(startl, endl, n_pts)

    if start_idx == 1:
        v[vi_len + 1:] = v_ext1
    else:
        v[vi_len:] = v_ext1

    # make crop slice
    crop_slc = slice(len(v) - start_idx - vi_len, len(v) - start_idx)
    return v, crop_slc

def energy(x):
    return np.sum(abs(x)**2)

# make signal, embed sine
np.random.seed(0)
x = np.random.randn(2048)
x += np.cos(2*np.pi * (.05 * len(x)) * np.linspace(0, 1, len(x)))
# first transform
Sx_full, _, ssq_freqs0, scales0 = ssq_cwt(x, scales='log')

# your frequencies
vi = np.logspace(np.log10(.001), np.log10(.1), 100)
ssq_freqs, crop_slc = extend_log(vi, ssq_freqs0)

# final transform
Sx, Wx, *_ = ssq_cwt(x, scales=scales0, ssq_freqs=ssq_freqs)
Sx = Sx[crop_slc]

#%% Visualize
print(Sx.shape, Wx.shape, ssq_freqs.shape, sep='\n')
imshow(Sx_full, abs=1, yticks=ssq_freqs0, h=.8, title="original ssq_freqs")
imshow(Sx, abs=1, yticks=vi[::-1], h=.8, title="custom ssq_freqs")

#%% Confirm energies
E_x0 = energy(Sx_full.real.sum(axis=0))
E_x = energy(Sx.real.sum(axis=0))
E_x0_ext = energy(Sx_full[np.argmin(abs(ssq_freqs0 - max(vi))):].real.sum(axis=0))
print("%-4.3g -- `x` energy per Sx_full" % E_x0)
print("%-4.3g -- `x` energy per Sx" % E_x)
print("%-4.3g -- `x` energy per Sx_full inside of `vi` freqs" % E_x0_ext)
# NOTE: exact match not guaranteed

101  -- `x` energy per Sx_full
45.9 -- `x` energy per Sx
45.9 -- `x` energy per Sx_full inside of `vi` freqs

How it works: we make the desired ssq_freqs a subset of the full required format. Let the portion of interest be vi, and the full input be v:

1A) If min(vi) > min(ssq_freqs): Make v[1:1 + len(vi)] = vi, and make the rest of indices their log continuation (or "log-piecewise"). That's because if min(vi) is higher than the default min(ssq_freqs), it's assigned to v[0].
1B) If min(vi) <= min(ssq_freqs): Make v[:len(vi)] = vi, and do continuation the same way as in 1A.
2 ) Crop the output to only include vi.

Note, we can only validate energy via inversion, per energy of transform vs energy of signal.
As an aside, I'm not a fan of ssq_freqs docs saying Scale-frequency mapping is only approximate and wavelet-dependent, the "only approximate" part. I guess I mimicked/copied that in early days; it's not "wrong" per se but can be misleading, an explanation here.

Note, original scales can be any (can remove scales='log' in my example).

Hope this problem can be fixed soon. Customizable ssq_freqs will greatly improve its user-friendliness and practicality

Hope this problem can be fixed soon. Customizable ssq_freqs will greatly improve its user-friendliness and practicality,.

Apart from the ssq_freqs , with a same signal sequence, when I try to change the input fs, only the output ssq_freqs is updated, while the ploted time frequency spectrum show no change.


A desperate request for addPolylines in iOS

First of all, I would like to thank @EddyVerbruggen for all the amazing plugins he builds. I've been using several of them and they are well documented, ready to use and constantly updated.
I am a designer, self-thought on how to code in Nativescript and who, thru try-and-error, learned also a few things to edit some of NS plugins (including Mapbox to auto-rotate maps).
Saying that, I am getting desperate because I really need my app (https://itunes.apple.com/us/app/ppg-finder/id1244768482?ls=1&mt=8) to render route paths (via addPolylines), as it does in Android.
I've been monitoring this open issue https://github.com/EddyVerbruggen/nativescript-mapbox/issues/41, having offered my time, payment, whatever, to get it implemented but, unfortunately, nobody seems to be checking that issue anymore.
If you have tried in the past to code it without success, please share your code and I will do my best to re-evaluate/test/pray/fast/whatever!!!!
Sorry for opening another case for the same topic but, like I said "it is desperation time".
Cheers,
Alex

The problem is:
As you can see here the iOS SDK expects an Array of coordinate objects, and those are exposed like this through NativeScript's metadata.
I haven't had the need to specify an array through this kind of pointer or reference construct so I don't know how to do that.

I've added the code (to GitHub) that comes close to what should be done, but it doesn't do much because of my previous remarks.

Thanks for sharing Eddy! Have you talked about this with someone at Progress/Telerik? Is this something that needs to be address by the NS team or Mapbox?

Not yet, but I think asking in the #ios channel on Slack would be a good start. I'm not able to do that atm though.

You mean Slack channel of NS or Mapbox iOS?

NativeScript Slack

Or https://discourse.nativescript.org/latest?order=activity

@EddyVerbruggen I did some adjustments to your code and I finally got some polylines in the map (yeah!!!):

However, as you can see above, the route path is not the same as it should be (see the Android results). Any ideas why?
Here's the modification I did to your code:
var coord;
for (var p in points) {
      var point = points[p];
      coord = CLLocationCoordinate2DMake(point.lat, point.lng);
}
const polyline = MGLPolyline.polylineWithCoordinatesCount(coord, points.length);
theMap.addAnnotation(polyline);

That's a start! 😍
Can you share the app code to generate that "circle" on Android please?

The "circle" is a real path saved on a Firebase database (thanks to your great Firebase plugin). App is huge, with several pages, Facebook login, etc. What is the best way to share it with you (I have no idea on how to use Github "repos/whatever you call them" :)
Also, in order to get the same results of the "circle" you are going to have to log with my Facebook credentials. SO, let me know the best way to share it with you and I will gladly do that.

Ah, ok, I was just wondering what you're doing to get that circle.. do simply call addPolyline several times, or only once with several points? Perhaps you can console.log how you're calling the method and share that?

I got it. In fact, I just call it once, after finishing a flight (having saved it on FB database):
map.addPolyline({
     id: 1, // optional, can be used in 'removePolylines'
     color: '#30BCFF', // Set the color of the line (default black)
     width: 5, //Set the width of the line (default 5)
     points: JSON.parse(JSON.stringify(flightData))
});

flightData is an array built by data from FB Realtime DB (full code below):
var onQueryEvent = function(result) {
      var flightData;
      if (!result.error) {
         flightData = result.value["data"]
         map.addPolyline({
                                id: 1, // optional, can be used in 'removePolylines'
                                color: '#30BCFF', // Set the color of the line (default black)
                                width: 5, //Set the width of the line (default 5)
                                points: JSON.parse(JSON.stringify(flightData))
         });
      }; //end if onQuery

} //end onQuery

firebase.query(
                onQueryEvent,
                "/flights/"+fbUID+"/"+fid,
                {
                    // set this to true if you want to check if the value exists or just want the event to fire once
                    // default false, so it listens continuously.
                    // Only when true, this function will return the data in the promise as well!
                    singleEvent: true,
                    // order by company.country
                    orderBy: {
                        type: firebase.QueryOrderByType.CHILD,
                        value: 'fid' // mandatory when type is 'child'
                    }
                }
);

So if you're also using that on iOS then I don't get why this:
var coord;
for (var p in points) {
      var point = points[p];
      coord = CLLocationCoordinate2DMake(point.lat, point.lng); // reassign
}
const polyline = MGLPolyline.polylineWithCoordinatesCount(coord, points.length);
theMap.addAnnotation(polyline);

.. produces multiple lines (as per your screenshot).
Because in the for loop that coord variable seems to be reassigned every time and only the last state is passed to polylineWithCoordinatesCount... so I expect that coord variable to be an Array. So weird..

Using your code below "as is" did not produced any lines, as you probably know:
// TODO this is not sufficient
 for (let p in points) {
      let point = points[p];
      const coord = CLLocationCoordinate2DMake(point.lat, point.lng);
      const coordRef = new interop.Reference<CLLocationCoordinate2D>(coord);
      const polyline = MGLPolyline.polylineWithCoordinatesCount(coordRef, 1);
      theMap.addAnnotation(polyline);
}

this was the reason I tried to move the last two lines out of the "for" loop.
I also tried to simply leave the last 2 lines into the loop (commenting the coordRef one) without any success.
I think the solution is really close but, not being a "pro developer", I believe your knowledge can get the trick faster.

@d3mac123 I've spent the morning taking the geojson route and seem to have something working. Don't worry, the API won't change as I'm leveraging geojson internally, that stuff will be hidden for the user.

This took me way longer than I hoped, but it's working now! Please update to 3.0.2.

i think i am going to cry! :) thank you very much!


docs: add required packages to docker build example

Lgtm if it works, merge it ☺
Aaron Levy<EMAIL_ADDRESS>schrieb am Mi., 25. Nov. 2015 15:34:

You can view, comment on, or merge this pull request online at:
https://github.com/coreos/rkt/pull/1798
Commit Summary

docs: add required packages to docker build example

File Changes

M Documentation/hacking.md
https://github.com/coreos/rkt/pull/1798/files#diff-0 (2)

Patch Links:

https://github.com/coreos/rkt/pull/1798.patch
https://github.com/coreos/rkt/pull/1798.diff

—
Reply to this email directly or view it on GitHub
https://github.com/coreos/rkt/pull/1798.


SingleQuoteFixer fix more use cases

This helps fixing more use cases for the single quote fixer.
For example:
<?php $a = "foo \$bar5";

<?php $a = 'foo $bar5';

hmmm.. maybe the \$ only is better...

hmmm.. maybe the $ support only is better...

:+1:

:-1: for this idea.

:-1: for this idea.

Also against fixing "\$" to '$'?

Why closed?

I try to figure out if I can change just the \$ case, which I think is still valid. So I closed it to prevent people wasting time reviewing something I know needs to be reverted.

All cleaned up :)

Looks much better now. :+1:

:+1:

:+1:

:+1:

Thank you @SpacePossum.


Can't install dotnet-sdk nightly from debian feed

From @bazzilic on September 7, 2017 12:42
Steps to reproduce
I am trying to install dotnet SDK nightly build on a clean ubuntu 16.04, so I run this as per README.md:
echo "deb [arch=amd64] http://apt-mo.trafficmanager.net/repos/dotnet/ xenial main" > /etc/apt/sources.list.d/dotnetdev.list     && \
apt-key adv --keyserver apt-mo.trafficmanager.net --recv-keys 417A0893 && apt-get update                                        && \
apt-get install -y $(apt-cache search dotnet-sdk | tail -n 1 | cut -d' ' -f1)

Expected  behavior
Dotnet SDK install nicely.
Actual behavior
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 dotnet-sdk-2.1.0-preview1-007172 : Depends: aspnetcore-store-2.1.0-preview1-26623 but it is not installable
E: Unable to correct problems, you have held broken packages.

Looking through apt-cache search asp shows that there are no packages at all named aspnetcore-store. An extensive googling for a debian feed I might be missing resulted in nothing, I couldn't even find what repo this package builds from.
Any ideas? Thanks.
Environment data
Clean ubuntu 16.04 xenial (in a docker container).
Copied from original issue: dotnet/cli#7609

Hi @bazzilic thank you for the post.
Although the upload of package dotnet-sdk-* is stable after recent change, aspnetcore-store is absent from the feed. Move this issue to store repo

hi @JunTaoLuo @joeloff we talked about adding daily feed for store package. We need aspnet-store package to be in the feed in order to complete the scenario above.
I added a C# client/msbuild task for the feed with retry logic, so far the upload is very stable. You can use it as reference
https://github.com/dotnet/cli/pull/7460

Hello.I'm having the same problem

The following packages have unmet dependencies:
dotnet-sdk-2.1.0-preview1-007186 : Depends: aspnetcore-store-2.1.0-preview1-26623 but it is not installable

but i don't see how this is resolved?

Hi @JunTaoLuo @joeloff @muratg, is there any update on this issue? Daily feed is still blocked by it cc: @livarcocc

Haven't prioritized this as our efforts have been focused on reworking our 2.0.x servicing build infrastructure. @muratg @Eilon to decide if we want to bump the priority of this task.

Any update on this? This is blocking me to do: https://github.com/OmniSharp/omnisharp-vscode/wiki/Remote-Debugging-On-Linux-Arm

@JunTaoLuo Are we just missing the nightly installer for Debian?  IoW do we still produce generic .tar.gz's?

We should investigate how to publish our installers to the debian feeds. We produce the generic .tar.gz's but we do not publish it anywhere that's publicly available.

Sorry for asking again. But this is still open. I would really like to test remote debugging.

@wli3 - ASP team needs to publish their part of the install to the existing feed. Could this step possibly be added to your code the publishes the CLI?
cc @JunTaoLuo

@leecow I will be hard to maintain. To keep up with the normal insertion need effort already. Also, it is strange for CLI to publish asp.net's package.

We will retriage this item for preview 2. cc @muratg @Eilon

@JunTaoLuo how much work is left on this one?

I'll get to it this week, I need to port over @wli3's implementation for uploading to the debian nightly feed as well as get the proper credentials for the actual push.

Quick :up::date: I have the code in a branch right now but I can't proceed further until I have the push credentials to the debian feed. I have sent an email for this so as soon as I hear back I'll start on this again.

@leecow @wli3 Can one of you confirm that we no longer plan to publish debian installers to daily feeds? The offline discussion in the email threads seems to point towards direct downloads of debian installers from the azure blobs.

Confirmed that this is not needed.


Move build from positional args to named.

It'd be nicer if the image-builder build subcommand takes named arguments instead of positional arguments. Currently it looks like this:
image-builder build --distro fedora-41 minimal-raw blueprint.toml

I propose:
image-builder build --distro fedora-41 --type minimal-raw --blueprint blueprint.toml

This would allow for multi-type builds (a very strong advantage of the osbuild system):
image-builder build --distro fedora-41 --type iso --type qcow2 --blueprint blueprint.toml

And would allow us to in the future have other inputs except the built-in image types such as a custom YAML file for custom images.

Fwiw, I like that it's more "uniform" this way, i.e. to me it feels a bit unbalanced that we currently have "--distro centos-9" but type is just an positional argument and has no --type. But then its a bit more typing for our users.
We should probably have a brainstorm again in the new year.


Use virtio for faster network/disk operation

Take advantage of virtio for faster disk and network operation.
Fixes #30.

I've had several more changes in https://github.com/dhiltgen/docker-machine-kvm/pull/53 , including these.

Closing since #53 looks the better patch.  Thanks @mykaul !
@dhiltgen please check soon so we can see a better performing docker-machine-kvm!


📖 Short Lived Data

User Story
As a… member of the AP team
I need/want/expect to… data uploaded by users to not become stale
So that… we are not storing data unnecessarily
Value / Purpose
No response
Useful Contacts
No response
User Types
Analytical Platform Users
Hypothesis
If we... establish a flow for the lifecycle of data
Then... we will save money by not storing redundant data and be able to identify Data Owners more easily.
Proposal
Essentially this would an option, when a user created Data in the AP, there is a time period the data is valid for - say 90 days. After this period the data would be moved - to another bucket for example. After another period of 30 days, it would be deleted. All of this would be wrapped in Slack Notifications and emails to the Data Owner via SNS.
If the Data Owner left the org, then this process would pick that up and 'we' would have an opportunity to identify another Data Owner. Thereby stopping 'Can we delete this? We don't know who owns it.' conversations years down the line.
Additional Information
This is based off of this Slack thread.
Definition of Done
Needs refining if desired, should be part of an Epic / Milestone related to Data Ingestion.

[ ] Do user research
[ ] Define the ingestion frontend in the dashboard - new ticket
[ ] Define the workflow in AWS - new ticket

User - Research


Port Cluster Rotate Encryption action from Ember UI

See:

see https://github.com/rancher/ui/blob/a9166ce3fbc6e44ed9ca7acf54350a084923fbe2/app/models/cluster.js#L280

You must provision a cluster with the Advanced Option 'Secrets Encryption' enabled.

I can rotate encryption key even without etcd backup from emberUI.
I can't click Rotate button without backup in dashboard.
Is this intended change?
Otherwise it works fine on master-head (4d18400)

@kravciak By default etcd snapshots are enabled on RKE1 clusters (Ember UI). Can you double check if a recurring snapshot was not available when doing Rotate Encryption action on cluster in Ember UI?

Can you double check if a recurring snapshot was not available when doing Rotate Encryption action on cluster in Ember UI?

It was available, I deleted it manually.

I created DO-rke1 and custom clusters in emberUI, then switched to Dashboard:
Dashboard -> Cluster Management -> cluster menu (...)

Rotate Certificates button is not visible in the menu
Rotate encryption keys button is visible, even though secrets encryption is not enabled
When I enable secrets encryption I can see Rotate Certificates button

It seems that logic for button visibility is swapped between certificate / encryption keys.
Rotating encryption keys results in error (there is no encryption so it's expected)

I tested the same few days ago (4d18400) and it was working fine.
Tested on master-head (d44698d)

I believe this has been resolved now

Works fine on master-head (cf5a75f):
Key rotation is available based on cluster secret encryption. Key rotation calls v3 API.
Secrets are reencrypted after rotation, I tested it with following steps:
# generate secret
kubectl create secret generic thesecret --from-literal=key1=supersecret
kubectl get secret thesecret -o jsonpath="{.data.key2}" | base64 --decode

# ssh to node with etcd container and display my secret
etcd_id=$(docker ps -f name=etcd -q)
docker exec -it $etcd_id etcdctl get /registry/secrets/default/thesecret

# rotate key from dashboard UI and check secret was reencrypted
docker exec -it $etcd_id etcdctl get /registry/secrets/default/thesecret

I tested with DO infra provider cluster created in emberUI and dashboard.
Certificate actions are available only for rke1 cluster. Is this ok?

@kravciak Yes, this is okay


The Structure of the datasets

Hello,author!
Would you please show  us what the structure of the datasets are!
Thanks!

hi @onetwochu
Can you fine-tune the model using self dataset?
I want do segment image of rs image, but don't know how  fine-tune model to downstream task?