Drosophila subset

Hello!
Could you create a slim subset for Drosophila?
Attaching file with 'name' 'ID' - 151 terms. Let me know if you need something different.
subsetdef: goslim_drosophila "Drosophila GO slim"
Drosophila_slim.txt

@hattrill I cannot get to that file - can you paste the 151 terms here ?
Thanks, Pascale

Here they are:
Term Name	GOID
DNA recombination	GO:0006310
DNA repair	GO:0006281
DNA replication	GO:0006260
DNA catabolic process	GO:0006308
mRNA metabolic process	GO:0016071
tRNA metabolic process	GO:0006399
rRNA metabolic process	GO:0016072
snRNA metabolic process	GO:0016073
snoRNA metabolic process	GO:0016074
piRNA metabolic process	GO:0034587
miRNA metabolic process	GO:0010586
transcription, DNA-templated	GO:0006351
RNA catabolic process	GO:0006401
gene silencing	GO:0016458
lipid metabolic process	GO:0006629
carbohydrate metabolic process	GO:0005975
cellular amino acid metabolic process	GO:0006520
nucleobase-containing small molecule metabolic process	GO:0055086
generation of precursor metabolites and energy	GO:0006091
sulfur compound metabolic process	GO:0006790
alcohol metabolic process	GO:0006066
cofactor metabolic process	GO:0051186
protein catabolic process	GO:0030163
protein maturation	GO:0051604
glycoprotein metabolic process	GO:0009100
protein lipidation	GO:0006497
protein modification by small protein conjugation or removal	GO:0070647
mitochondrial translation 	GO:003254
cytoplasmic translation	GO:0002181
vesicle-mediated transport	GO:0016192
ion transport	GO:0006811
mitochondrial transport	GO:0006839
nucleocytoplasmic transport	GO:0006913
protein targeting	GO:0006605
cytoskeleton-dependent intracellular transport	GO:0030705
lipid transport	GO:0006869
protein secretion	GO:0009306
cellular protein localization	GO:0034613
protein transmembrane transport	GO:0071806
RNA localization	GO:0006403
mitochondrion organization 	GO:0007005
cilium organization	GO:0044782
chromosome organization	GO:0051276
actin cytoskeleton organization	GO:0030036
microtubule cytoskeleton organization	GO:0000226
nucleus organization	GO:0006997
endomembrane system organization	GO:0010256
membrane organization	GO:0061024
synapse organization	GO:0050808
ribosome biogenesis	GO:0042254
protein folding	GO:0006457
autophagy	GO:0006914
intracellular signal transduction	GO:0035556
G protein-coupled receptor signaling pathway	GO:0007186
cell surface receptor signaling pathway	GO:0007166
meiotic cell cycle	GO:0051321
mitotic cell cycle	GO:0000278
cell death	GO:0008219
cell division	GO:0051301
cell growth	GO:0016049
cell population proliferation	GO:0008283
cell adhesion	GO:0007155
nervous system development	GO:0007399
muscle structure development	GO:0061061
epithelium development	GO:0060429
pattern specification process	GO:0007389
cuticle development	GO:0042335
respiratory system development	GO:0060541
gastrulation	GO:0007369
sensory perception	GO:0007600
cognition	GO:0050890
cell motility	GO:0048870
cell differentiation	GO:0030154
cell morphogenesis	GO:0000902
cell redox homeostasis	GO:0045454
chemical homeostasis	GO:0048878
immune response	GO:0006955
immune system development	GO:0002520
locomotory behavior	GO:0007626
reproductive behavior	GO:0019098
circadian rhythm	GO:0007623
response to chemical	GO:0042221
response to stress	GO:0006950
response to external stimulus	GO:0009605
molting cycle	GO:0042303
transferase activity, transferring glycosyl groups	GO:0016757
methyltransferase activity	GO:0008168
ubiquitin-like protein transferase activity	GO:0019787
transferase activity, transferring acyl groups	GO:0016746
transferase activity, transferring alkyl or aryl (other than methyl) groups	GO:0016765
phosphotransferase activity, alcohol group as acceptor	GO:0016773
kinase activity	GO:0016301
nucleotidyltransferase activity	GO:0016779
peptidase activity	GO:0008233
hydrolase activity, acting on carbon-nitrogen (but not peptide) bonds	GO:0016810
carboxylic ester hydrolase activity	GO:0052689
lipase activity	GO:0016298
nuclease activity	GO:0004518
phosphatase activity	GO:0016791
ATPase activity	GO:0016887
GTPase activity	GO:0003924
hydrolase activity, acting on glycosyl bonds	GO:0016798
oxidoreductase activity	GO:0016491
ligase activity	GO:0016874
isomerase activity	GO:0016853
lyase activity	GO:0016829
enzyme regulator activity	GO:0030234
guanyl-nucleotide exchange factor activity	GO:0005085
signaling receptor activity	GO:0038023
receptor ligand activity	GO:0048018
transmembrane transporter activity	GO:0022857
structural constituent of cuticle	GO:0042302
structural constituent of ribosome	GO:0003735
structural constituent of cytoskeleton	GO:0005200
extracellular matrix structural constituent	GO:0005201
cytoskeletal protein binding	GO:0008092
transcription factor binding	GO:0008134
histone binding	GO:0042393
unfolded protein binding	GO:0051082
molecular adaptor activity	GO:0060090
chromatin binding	GO:0003682
carbohydrate binding	GO:0030246
chitin binding	GO:0008061
lipid binding	GO:0008289
metal ion binding	GO:0046872
enzyme binding	GO:0019899
RNA binding	GO:0003723
DNA binding	GO:0003677
translation regulator activity	GO:0045182
DNA-binding transcription factor activity	GO:0003700
transcription coregulator activity	GO:0003712
extracellular matrix	GO:0031012
extracellular space	GO:0005615
external encapsulating structure	GO:0030312
cell junction	GO:0030054
endosome	GO:0005768
coated vesicle	GO:0030135
secretory vesicle	GO:0099503
plasma membrane	GO:0005886
cilium	GO:0005929
cytosol	GO:0005829
nucleus	GO:0005634
chromosome	GO:0005694
nucleolus	GO:0005730
mitochondrion	GO:0005739
vacuole	GO:0005773
Golgi apparatus	GO:0005794
endoplasmic reticulum	GO:0005783
peroxisome	GO:0005777
cytoskeleton	GO:0005856
synapse	GO:0045202

Done https://github.com/geneontology/go-ontology/pull/18137
Should have all 151 terms.

That was quick! Thanks


Add test cases

Add atleast one extra test case in each code.

Hey I want to work on it I can add test cases efficiently involving all corner cases and TLE cases. Please assign it to me as a part of  GSSOC - 21

Hi, I would also like to contribute to Algo-tree by adding test cases which would ensure full coverage of code.
It would be great if it could be assigned to me as a part of GSSOC - 21

@abhijeet010304 It's more than 15 days and you haven't open any PR yet so I am unassigning it to you.

@Srishti20022 Go ahead.


CASMINST-3566-1.2 minor typo referring to Getting Started Guide

Summary and Scope
CASMINST-3566-1.2 minor typo referring to Getting Started Guide
Issues and Related PRs
Testing
Tested on:
Test description:
Risks and Mitigations
Pull Request Checklist

/backport release/1.2.5

/backport main


Add chat user starball to users.yml and Tavern in rooms.yml

Chat around here: https://chat.meta.stackexchange.com/transcript/message/9388273#9388273

ahoy!


Performance struggles from operations

Running a Source program that isn't performing operations that are too complex has already been said to cause some lag before the shape is ready (and gets rendered). Needs more info.

May be possible to do GPU rendering for performance, but not easy


See if KHR_parallel_shader_compile can be used to speed up tensorflow initialization

https://developer.mozilla.org/en-US/docs/Web/API/KHR_parallel_shader_compile

Engine_COMPILE_ONLY https://github.com/tensorflow/tfjs/issues/7372
Older parallel https://github.com/tensorflow/tfjs/pull/5826
Good discussion: https://github.com/tensorflow/tfjs/issues/6970


Create cloud.txt

They changed the domain for school emails

Here is the link for the school, but I'm in high school, not uni. I submitted this before under netmail and it was accepted. But they changed the addresses when they started the renovations for the school. And for the last point, the only thing that the school offers is a single "computers" class that still teaches VB from a terrible book made by the IT guy in 2007. We don't even have any year-long courses.

@iamtis Thank you for clarification. Just for the record: it is related to #1634, the links to email domain proof is https://threeoakshighschool.wordpress.com/teacher-emails/
Pull request merged.


XP Leaderboards

🚀 Feature Proposal
Possibly turn the XP leaderboards into a more rs version, where it is ranked on total level and then XP?
Have 3 collumns, name - Total - XP.

This is how it is now :)

This is how it is now :)


Lineage reports section is inlined, create a component

Unit view and Capability view (plus others?)

@kamransaleem


HOOBS Certification

I wanted to let you know we have certified this plugin.
We run and test your plugin in HOOBS, and offer support for you.
The plugin page can be found here.
https://plugins.hoobs.org/plugin/homebridge-hue
Your plugin works as of 3.2.5+

We also certified homebridge-zp
https://plugins.hoobs.org/plugin/homebridge-zp

See #694.
I have never used HOOBS, nor will I ever do so.  I did not ask for HOOBS certification.  I do not want HOOBS support.
Please use the HOOBS support channels to support HOOBS users.

Hay man, I'm just trying to be friendly.
I don't know what your image is of us, but I feel it is wrong. HOOBS is a project of mine that I personally use. I don't make any money from it and any donations we get or profit, from hardware sales, go straight to our cloud provider.
I think you have great plugins, and I just want to coloraborate with you. No hard feelings, keep up the great work.


[docs] Refining the product identifier menu

[x] I have followed (at least) the PR section of the contributing guide.

Closes https://github.com/mui/material-ui/issues/31201
Preparing for the post-migration.
Currently iterating a bit, let me know what you think.
Preview: https://deploy-preview-31262--material-ui.netlify.app/base/getting-started/installation/

@siriwatknp Yeah, felt the same way. I'll try your suggestion!

Is there a specific reason to remove the data grid sub-menu? It feels a bit strange that links are not on the same scope for both core and x
About the description, you could use Tooltip with an "Info Icon" to let users know there is more information available.

Is there a specific reason to remove the data grid sub-menu?

It's because if there was a Data Grid option as a sub-option of MUI X (as Material UI, Base, and System are for MUI Core) it would seem like there was one documentation for each X component, instead of one for them all. If we did that, we'd have to keep consistency and continue adding all other X components, and then the list would eventually be huge - and, essentially, the same list you'd expect seeing in the "Components" folder on the side nav!

@siriwatknp Iterated with your suggestion but I'm still a bit unsure 🤔  The height flickering is what bothered me the most:

@alexfauquette the tooltip above the already elevated menu also doesn't seem like the best way to go 😕

@danilo-leal What's about this?
https://user-images.githubusercontent.com/18292247/156490377-3153b3a6-190d-4341-8cd8-af33bf4c278c.mov

@siriwatknp Looks better! The fixed height and the smoothness you added definitely made it better. Could you commit this iteration?

@siriwatknp Looks better! The fixed height and the smoothness you added definitely made it better. Could you commit this iteration?

pushed!

I think we can improve the transition further, so that the title does not move up (for example the Material UI text). The transition could happen by showing the description opening it below without moving the title.

I think we can improve the transition further, so that the title does not move up (for example the Material UI text). The transition could happen by showing the description opening it below without moving the title.

Done! Indeed much better.
Must say though — very nit-picky — what bothers me about this solution is the excessive whitespace there is when none of the options is hovered:

I don't expect that this list will grow very much, so I don't mind it. The transition looks much much better in my opinion 🚀 I would maybe even add a bit of padding above Material UI to be the same as the spacing after MUI System (not sure about this :))

@siriwatknp Just noticed now that what I did to implement Marija's suggestion is not yet 100% 😅 Check this out, there is a very minor flickering with the product name - from a distance, it seems it is not moving but when zooming in I think you can notice. Do you know how to tackle that?
https://user-images.githubusercontent.com/67129314/156771492-824a3dfc-88c0-4acd-9802-aef3838c7001.mov

@danilo-leal Pushed some updates, please review the transition again.

The product title is still moving a bit, the idea is to have it fixed when hovering it!

After selecting MUI X, the menu changes to display its subproducts (currently just the data grid) like in the following screenshot:

Since the menu is different after selecting MUI X, would it make sense to display the MUI X on top of the list?

Since the menu is different after selecting MUI X, would it make sense to display the MUI X on top of the list?

Don't think this is an intended behavior 😅 Missed that, wasn't aware!

The product title is still moving a bit, the idea is to have it fixed when hovering it!

Got it, can you try it again.
https://user-images.githubusercontent.com/18292247/157164292-3539a0c1-6816-494f-9190-adc56d08cc03.mov

@siriwatknp This is now looking perfect, thank you Jun! 🎉

@samuelsycamore Would you want to do a double-check on the way we're describing each product?!

Regarding the description of MUI Core: "Ready-to-use foundational components, free forever."
Is that technically accurate? Is MUI System (a subset of Core) a set of "components"? Because it's described as a set of utilities. Is Core more than just components?
Is there a better term we could use to describe what MUI Core is?
This ties in with my proposed copy revisions for the marketing site: #31283
Specifically, this discussion with @mbrookes in which I described MUI Core as a "library" that includes Material UI (also itself a library). I guess I kind of see Core as a "library of libraries" but that's not a great way to say it. 😅

@samuelsycamore Yeah, these are all pretty good questions, and just realized that the current Core copy might not make sense.
Let's do this: as we have the target to release the docs migrated one month, for now, I'd figure we have enough time to settle the copy discussions on your PR. I'll merge this one and once we get to a final stage there, I'll open a new PR to adjust the product identifier copy.
How does that sound? Don't want to have this open for too long and we also avoid having the same discussion in two places!

Sounds good to me @danilo-leal. Once we get the wording pinned down on the homepage, we should be able to use that as our single source of truth to spread throughout the docs.


added image volume type in ephemeral volumes

Image volume type falls under ephemeral volumes.

This is still an alpha feature right? Is that worth noting here?

This is still an alpha feature right? Is that worth noting here?

I was excited about this feature and didn't find in ephemeral page.
So though to create my first PR.
Should I close this PR.

This is still an alpha feature right? Is that worth noting here?

I was excited about this feature and didn't find in ephemeral page. So though to create my first PR. Should I close this PR.

What @salaxander suggested was that the stage of the feature should be mentioned somewhere.
This is not a blocker to document it.
I'm as excited by this feature as you, and my perception is that we need to document this feature in more details so that people get to know about its usage and caveats.

I'm as excited by this feature as you, and my perception is that we need to document this feature in more details so that people get to know about its usage and caveats.

ok, but the detailed info is already available here

/lgtm

/sig storage
/approve


Update GitHub workflows to run on Ubuntu 20.04

This PR elevates the Ubuntu version used both in CI and in our Dockerfiles to 20.04.
A recent merge to master (https://github.com/tenzir/vast/pull/972) has corrupted the Docker build due to a missing dependency for flatbuffers. This branch also covers the fix of the current master.

We agreed to merge this despite the failing CI in the standup; the failing unit tests with gcc-8 / debian-buster will be addressed as part of #978, which addresses the root cause.
Before merging, as one last step, we should adapt the Dockerfile to build and test in separate steps:
RUN cmake --build build --parallel
RUN CTEST_OUTPUT_ON_FAILURE=1 cmake --build build --target test
RUN cmake --build build --target integration
RUN cmake --build build --target install


Fix two memory safety issues.

I've got an application which happens to re-size the allocate lmdb mapping by closing and re-opening the database, as that happens to be easier than ensuring the DB is quiescent first in this case.
I ended up finding that my program would segmentation fault when beginning transactions, or whilst the runtime was cleaning up an exited thread. Using valgrind, I tracked down two issues:
in Database::open, we allocate an  Option<CString> to hold the database name. However, Option::map consumes it's value, so any contained CString is dropped after the call to CString::as_ptr, but before we pass it to mdb_dbi_open. So we have an effective use-after-free.
I'd found that a MDB_txn was getting freed twice inside of mdb_txn_abort, and then in mdb_env_close. It turns out that an earlier call to mdb_txn_comit was failing, so the transaction had been marked as finished, but the use of the lmdb_call! macro meant we didn't zero out the TxHandle content. So, we ended up calling mdb_txn_abort on an already finalized handle. Then, because of the state of the transaction flags, we ended up freeing the memory that was referenced by the environment, as it's me_txn0 member.
Anyway, I hope this helps, and thanks for the library!

Thanks for the PR @cstorey! I actually thought mdb_txn_commit() left the transaction open if it fails, but as you hinted it does in fact call mdb_txn_abort() implicitly.
This looks good on all points, merging.

Uploaded 0.2.1 with this fix.


removes hardcoded import names

I noticed while QA'ing for the next release that these names are hardcoded.  I see no reason that doing so benefits us - and it's a 1-line change to update it.
before:

after:

@wdawson should we display in this much detail with versions? For instance, we don't need to show older Insomnia formats. People don't usually know which format file they have, and should safely assume that all Insomnia export versions can be imported. And the Postman ones are now separated into "Postman" and "Postman Environment", and I'm not sure what the difference is between the two.
IMO we don't need to show the level of detail of supported formats; Insomnia will error if it's not able to import. Or we could de-clutter the tab and show the full (and potentially growing) list in a tool-tip, for instance.

(@dimitropoulos I initially approved, and then disabled auto-merge because I wanted Wils's opinion. Then figured I'll dismiss my review because I have an outstanding question, so I re-enabled auto-merge again like you had done so initially 😅)

Sure, it's no rush

I definitely wouldn't bold the list. I like the tooltip suggestion. People need some place to see what's supported (the full list). That could live in the docs eventually if things get too out of hand. But tooltip would work nicely for now. "Supported import formats include: x, y, z"


[Fix #11088] Fix an error when specifying SuggestExtensions: true

Fixes #11088.
This PR fixes an error when specifying SuggestExtensions: true.
It's no wonder users think they can set SuggestExtensions: true when they can specify SuggestExtensions: false.
So, suggest default extensions if SuggestExtensions: true. Anyway, it shouldn't be an error.

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[x] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[x] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

Looks good. Thanks!


Fix review app banner for IE8

Pull banner styles into the IE8 stylesheet
Fix a link style as IE8 doesn't support :not

It'd be good to fix the font size (I think it just needs a px fallback, or maybe just update it to use the proper responsive mixin) but otherwise this looks good to me 👍


Test decommission failure when N <= replication factor

pending https://issues.apache.org/jira/browse/CASSANDRA-12510

+1 once 12510 is committed


Issue with openzeppelin ERC721 contract when compiling to C#

GIVEN
// SPDX-License-Identifier: GPL-3.0
pragma solidity >=0.6.0 <0.9.0;

import<EMAIL_ADDRESS>
contract TstNonFungibleToken is ERC721 {
    constructor() ERC721("Test","TST") {
    }
}

THEN "Compile and code generate CSharp contract definition"
WILL Give the following error in the generated service (TstNonFungibleTokenService.cs):

And the following error in the generated definition (TstNonFungibleTokenDeployment.cs):

Yes I am aware of that thanks!!

Yes I am aware of that thanks!!

Any ideas whether these issues are fixable? If so when can we expect a fix? :-)

Any ideas whether these issues are fixable? If so when can we expect a fix? :-)

Yes there is a small fix implemented in a pull, but it needs further work before i release as it is a big breaking change. Once I release the first Nethereum templates I will get to work on that (as I want to add extra stuff for code generation)

Yes there is a small fix implemented in a pull, but it needs further work before i release as it is a big breaking change. Once I release the first Nethereum templates I will get to work on that (as I want to add extra stuff for code generation)

Fixed now !!


task runner updates

Coverage remained the same at 100.0% when pulling 90b53fe89f3eb7f091e573342bbb170abe7f08f7 on dev into 48b9a8670fd6e066c2110381fe5efa6207452b08 on master.


Can't train MelGAN-STFT discriminator

I have been training MelGAN-STFT by finetuning it on the LJSpeech model. When it gets to discriminator_train_start_steps, it stops and tells me to restart. When I restart with the discriminator on less than the steps of the latest checkpoint (210k vs 220k), I get this:
ValueError: in user code:

    <ipython-input-13-8bd0e2e9cdea>:110 _one_step_generator  *
        p_hat = self.discriminator(y_hat)
    /content/TensorflowTTS/tensorflow_tts/models/melgan.py:441 call  *
        outs += [f(x)]
    /content/TensorflowTTS/tensorflow_tts/models/melgan.py:386 call  *
        x = f(x)
    /content/TensorflowTTS/tensorflow_tts/utils/group_conv.py:283 call  *
        self._convolution_op = nn_ops.Convolution(
    /usr/local/lib/python3.6/dist-packages/tensorflow/python/ops/nn_ops.py:1063 __init__  **
        filter_shape[num_spatial_dims]))

    ValueError: number of input channels does not match corresponding dimension of filter, 16 != 4

Also, all my predictions have heavy metallic noise. I'm assuming this is due to lack of discriminator training.

@ZDisket https://github.com/dathudeptrai/TensorflowTTS/blob/master/tensorflow_tts/utils/group_conv.py#L283. Plese repce nn_ops.Convolution to Convolution. That is a mismatch between my local code and public code, sorry, fix now :)). You need to train around 700-800k to have a good quality :D.

BTW, what is ur training speed :D

@dathudeptrai

BTW, what is ur training speed :D

About 10.8it/s on a P100.

@ZDisket too fast :)) how about tacotron now ?

@dathudeptrai
I don't have it right now but I don't remember it changing from the last figure I told you earlier.

ok :D. Ur dataset seem very good :)).  It's the least I can do after you made this awesome repo and helped me.

@ZDisket t thought that is private dataset and cann't be share ?

@dathudeptrai
It's "private" as in only me and a few others know about its existence, but not private as in that it's forbidden or problematic to share it.

@ZDisket it' good if you make pull request to share an audio samples end2end or pretrained model for that datasets (Don't need share dataset :D). That will prove that model in this repo can be train efficiently on expressive dataset

@dathudeptrai If the model turns out good, can I email you the models and audio samples instead? I'm not entirely familiar with this repo's organization.

@ZDisket  yes, you can. I will copyright of you.


Database commands above v4

How to use database commands in version above v4?
In earlier version it was possible to e.g. get database indexes and constraints;
.Call("db.indexes()")
.Call("db.constraints()")

In newer version of neo4j these calls was deprecated and replaced with the SHOW command. But the SHOW command was removed for the client in version v4+?
Is there no way to execute these commands like these to neo4j using the current client?

This is a VERY good catch -
SHOW does actually exist in the client - it's just unusable.
So... let me fix that!

Version 5.1.6 of the client should have all this in!

Example use:
var query = client.Cypher
    .Show("databases")
    .Yield("name")
    .Return (name => name. As<string>());

Thank you for the quick response and fix! Works as expected 👍


Posting note to ticket doesn't update updated_by for ticket

Like events or any changes to ticket, I think posting a note should update the updated_by field of the ticket.

Completed for when a note is added.  I wondered if it might be desired to update updated_at when a note is updated.  For consistency sake, I think yes, but I also feel a correction of a note doesn't represent something new to the ticket, so will leave it as is for now.


Webhook Connections

Hi there! I'm new and going through product training.  It took me to a doc page that didn't have any info.
On this page https://help.sumologic.com/docs/manage/connections-integrations/webhook-connections/ , there is no content about webhook connections other than the prerequisites.  When I click the button, it just reloads the same page.
Thanks!
Slack Message

@stacykor , yes I assigned to myself yesterday to handle post-Algolia


Feature: Filter transactions by account

The Request
The ability to see transactions scoped to an account address.
Problem
Right now, Rivet displays every transaction across all blocks and accounts on the "Transactions" tab. There is no way to filter transactions by account address.
Solution
As a user, I would like the ability to filter/scope transactions on the "Transactions" tab by account address.

@jxom , I just designed at UI of filter component.
I was thinking to manipulate transactions  data while filtering data by addresses.


Get rid of #pragma no cover

We need to find a way to generate code that is specific to the python version that the framework is running under, so that bugs don't sneak in to the sections of our code that we currently have to disable coverage reporting on.
This could happen dynamically, when a module is loaded, or at setup time.

This was fixed in version 1.0.0 of the framework.


Helm chart README does not mention needing a InterStepBufferService CR

Hi all, when installing from the helm chart as documented with latest README, I was getting an error saying interstepbufferservices.numaflow.numaproj.io "default" not found.
 % kubectl apply -f https://raw.githubusercontent.com/numaproj/numaflow/main/examples/1-simple-pipeline.yaml

Error from server (BadRequest): error when creating "https://raw.githubusercontent.com/numaproj/numaflow/main/examples/1-simple-pipeline.yaml": admission webhook "webhook.numaflow.numaproj.io" denied the request: interstepbufferservices.numaflow.numaproj.io "default" not found

This was pretty confusing at first, as I'm pretty new to numaflow. However, I eventually found in the Quick Start  guide that I needed to install a InterStepBufferService like below.
cat <<'EOF' | kubectl create -f -
apiVersion: numaflow.numaproj.io/v1alpha1
kind: InterStepBufferService
metadata:
  name: default
spec:
  jetstream:
    version: latest
EOF

The readme mentions running these steps

installing the helm repo
installing the helm chart
doing a verification that the pods are up
running a pipeline

I think it would be useful to add a step in-between step 3 and 4 mentioning the InterStepBufferService.

Thanks for updating the readme!


 Information like git commit ids or other scm data should be available inside the report. This should be implemented before #3054.
Remark
Make sure the SecHub plugins can handle this newly introduced report data.

Is duplicate of #3095 and #3093


refactor: register workspace dropdown menu to left menu

Description
Refactor workspace dropdown menu from  CollapsibleNavHeader to be registered from workspace plugin.
Issues Resolved

Screenshot

Testing the changes

Check List

[ ] All tests pass

[ ] yarn test:jest
[ ] yarn test:jest_integration
[ ] yarn test:ftr

[ ] New functionality includes testing.
[ ] New functionality has been documented.
[ ] Update CHANGELOG.md
[ ] Commits are signed per the DCO using --signoff

Codecov Report

Merging #90 (a6b4bf8) into workspace (b49aa1f) will decrease coverage by 11.07%.
Report is 2 commits behind head on workspace.
The diff coverage is 40.00%.

@@              Coverage Diff               @@
##           workspace      #90       +/-   ##
==============================================
- Coverage      65.78%   54.71%   -11.07%
==============================================
  Files           3334     1188     -2146
  Lines          64441    23827    -40614
  Branches       10258     3981     -6277
==============================================
- Hits           42390    13038    -29352
+ Misses         19482    10154     -9328
+ Partials        2569      635     -1934

Flag
Coverage Δ

Linux_1
?

Linux_3
?

Windows_1
?

Windows_2
54.71% <40.00%> (+0.04%)
:arrow_up:

Windows_3
?

Windows_4
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed
Coverage Δ

src/core/public/chrome/constants.ts
100.00% <ø> (ø)

...c/core/public/chrome/ui/header/collapsible_nav.tsx
87.87% <ø> (ø)

...public/chrome/ui/header/collapsible_nav_header.tsx
60.00% <0.00%> (+31.42%)
:arrow_up:

src/core/public/utils/workspace.ts
75.00% <ø> (+33.82%)
:arrow_up:

src/core/public/workspace/workspaces_service.ts
50.00% <37.50%> (-16.67%)
:arrow_down:

src/core/public/core_system.ts
91.86% <100.00%> (ø)

... and 2503 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


array_merge bug in the mergeConfigFrom (Illuminate\Support\ServiceProvider)

\Illuminate\Support\ServiceProvider.php line 67 function "mergeConfigFrom"
$this->app['config']->set($key, array_merge($config, require $path));
The bug is array_merge($config, require $path) .. need to use the array_merge(require $path, $config) instead.
When I use the "mergeConfigFrom" my config options (same key) should be overwritten. Try to debug this feature with the custom "auth" config (useful for multiauth).

We intentionally override in the order that we do.

You need to call the merge config method in the BOOT method, AFTER the user config has loaded.


Supporting of generic feature

I would like to be able to define generic features, but the problem is, the generated host does not support it.
Instead of following
public class BaseControllerLifecycleFeature extends Feature<BaseControllerLifecycleFeatureHost, Context>
{
    @FeatureEvent
    protected void onConstructor(Controller controller) {}
}

I would like to be able to define something like this:
public class BaseControllerLifecycleFeature<T extends Controller> extends Feature<BaseControllerLifecycleFeatureHost<T>, Context>
// or public class BaseControllerLifecycleFeature<T extends Controller> extends Feature<BaseControllerLifecycleFeatureHost, Context>
{
    @FeatureEvent
    protected void onConstructor(T controller) {}
}

Would it be possible to support this?

As for now, annotation processor requires two parameters in the feature class. Thus the following will compile well.
public class BaseControllerLifecycleFeature<T extends Controller, C extends Context> extends Feature<BaseControllerLifecycleFeatureHost, C> {
    @FeatureEvent
    protected void onConstructor(T controller) {}
}

Technically this is possible, but I cannot commit to support for it soon.

I tried that and as soon as I do it, I get following error:
Error:(20, 83) error: cannot find symbol class BaseControllerLifecycleFeatureHost
Error:(23, 20) error: unsupported kind: TYPEVAR

You are right, this is not supported. I am not sure when I can find time to support it.

No problem, I'm deriving from the base class and make this one generic and just cast the controller to T there... Would just be more beautiful the way above.

Hi @MFlisar. I've just deprecated the project in favor of Knot library. Featured library can be used further and I might even be able to provide some fixes, if needed. Nevertheless feel free to start writing new features using Knot.
I'm closing this PR as "won't fix" because it's outdated anyway.

No problem, thanks for the feedback. I already have something for state management as I use MVI in most of my projects and/or redux like stores.


cmake: Using symlinks on unix like os'es for dependencies

Fixes: #8380
This commit fixes the side-effect of PR #8211 where a 'ninja clean'
would try to remove dependency folders.
Changes:

Symlinks are created during build and CMake targets now depends on
the symlinks. Thus, same behavior is achived with regards to
dependency handling, while at the same time, the output can be
cleaned as the dependencies are now attached to the symlinks.
Dependencies have been changed so that generation of json files
depends on the trigger file and CMake depends upon the subdir txt
file. This prevents additional CMake runs after a clean.

Signed-off-by: Torsten Rasmussen<EMAIL_ADDRESS>

Codecov Report

Merging #8403 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #8403   +/-   ##
=======================================
  Coverage   64.61%   64.61%
=======================================
  Files         421      421
  Lines       40296    40296
  Branches     6803     6803
=======================================
  Hits        26037    26037
  Misses      11126    11126
  Partials     3133     3133

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a3fe7af...671e1d8. Read the comment docs.

@tejlmand can you rebase this?

Done


[incubator-kie-issues-834] Support Dynamic GraphQL query registering in Data Audit

issue: https://github.com/apache/incubator-kie-issues/issues/834

PR job #4 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer
build-chain build full_downstream  -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-apps -u https://github.com/apache/incubator-kie-kogito-apps/pull/1962 --skipParallelCheckout
NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/test/job/mcimbalek/job/kogito/job/main/job/pullrequest_jobs/job/kogito-apps-pr/job/PR-1962/4/display/redirect
Test results:

PASSED: 2857
FAILED: 1

Those are the test failures:

org.kie.kogito.app.audit.quarkus.QuarkusAuditQueryRegistryServiceTest.testRegisterQueryWithDateTime
Expected size: 1 but was: 6 in:[{"eventDate"="2024-01-24T15:03:31.385Z", "eventId"="15ba01c1-2152-4699-9243-dd6c91315e0f"},    {"eventDate"="2024-01-24T15:03:32.275Z", "eventId"="47755a29-3373-4f61-a050-ff981c58145f"},    {"eventDate"="2024-01-24T15:03:31.438Z", "eventId"="7efb595a-58a4-4d5f-bd81-b0a1752d6733"},    {"eventDate"="2024-01-24T15:03:31.442Z", "eventId"="a81f8c5e-899a-47ce-bb4c-7bc439c48cae"},    {"eventDate"="2024-01-24T15:03:31.445Z", "eventId"="ae6f9ea7-0510-41a7-b099-ab3d8215b9a7"},    {"eventDate"="2024-01-24T15:03:31.457Z", "eventId"="283f92be-244f-41c0-b9af-25ec0d84b955"}]

PR job #5 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer
build-chain build full_downstream  -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-apps -u https://github.com/apache/incubator-kie-kogito-apps/pull/1962 --skipParallelCheckout
NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-apps-pr/job/PR-1962/5/display/redirect
Test results:

PASSED: 2857
FAILED: 1

Those are the test failures:

org.kie.kogito.app.audit.quarkus.QuarkusAuditQueryRegistryServiceTest.testRegisterQueryWithDateTime
Expected size: 1 but was: 6 in:[{"eventDate"="2024-01-24T15:00:53.568Z", "eventId"="80a1759f-eee3-43d2-86cd-0ec164ab8794"},    {"eventDate"="2024-01-24T15:00:54.458Z", "eventId"="dc68c298-3c16-4c85-9b2c-183150f30d0e"},    {"eventDate"="2024-01-24T15:00:53.625Z", "eventId"="6ed3bca5-2b31-4616-80fc-180806f53037"},    {"eventDate"="2024-01-24T15:00:53.629Z", "eventId"="b6aeb95a-0268-4253-81ad-69ba42969475"},    {"eventDate"="2024-01-24T15:00:53.632Z", "eventId"="7185e815-5f9d-4a2c-baa1-2d746d1cd36c"},    {"eventDate"="2024-01-24T15:00:53.644Z", "eventId"="e259817a-9852-4937-9933-ab8bdad22062"}]

@elguardian look at https://github.com/apache/incubator-kie-kogito-apps/pull/1962#issuecomment-1908415243 I'm also facing same issue locally

PR job #6 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer
build-chain build full_downstream  -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-apps -u https://github.com/apache/incubator-kie-kogito-apps/pull/1962 --skipParallelCheckout
NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-apps-pr/job/PR-1962/6/display/redirect
Test results:

PASSED: 2854
FAILED: 3

Those are the test failures:

org.kie.kogito.index.ProcessDataIndexMongoDBIT.testProcessInstanceEvents
1 expectation failed.JSON path errors doesn't match.Expected: null  Actual: <[{message=Exception while fetching data (/UserTaskInstances[0]/schema) : Runtime service URL not defined, please review the kogito.service.url system property to point the public URL for this runtime., locations=[{line=1, column=85}], path=[UserTaskInstances, 0, schema], extensions={classification=DataFetchingException}}]>

org.kie.kogito.app.audit.quarkus.QuarkusAuditQueryRegistryServiceTest.testRegisterQueryWithDateTime
Expected size: 1 but was: 6 in:[{"eventDate"="2024-01-24T18:35:37.901Z", "eventId"="2102ff47-7a30-4c6b-b78f-5ed718339f8e"},    {"eventDate"="2024-01-24T18:35:39.115Z", "eventId"="6f9bdacf-119a-4990-8d19-f082ab61e0f9"},    {"eventDate"="2024-01-24T18:35:37.975Z", "eventId"="f98f47bd-0669-46e3-be1f-13b7b11edc92"},    {"eventDate"="2024-01-24T18:35:37.980Z", "eventId"="e4557dda-6015-4504-99b6-e047f33dcc4e"},    {"eventDate"="2024-01-24T18:35:37.985Z", "eventId"="4b538011-5c45-42be-b11a-626fe3eade64"},    {"eventDate"="2024-01-24T18:35:37.999Z", "eventId"="d92de807-cc92-4645-8f11-334bb9a05c0c"}]

org.kie.kogito.trusty.service.common.KeycloakTrustyServiceIT.(?)
java.lang.RuntimeException: Failed to start quarkus

QuarkusAuditQueryRegistryServiceTest passes if it is run in isolation, but fails if run within the whole testsuite, so it seems the issue is related to data cleanup across tests.
I opened up apache/incubator-kie-issues/issues/857 to capture the need for a delete endpoint.


Unable to insert Subtitles

Describe the bug
Unable to insert Subtitles
To Reproduce
Steps to reproduce the behavior:

Run code Below with Video with this WEBVTT

/* qa.vtt file name */
WEBVTT

00:00:14.901 --> 00:00:17.900
text text text text text text

00:00:20.600 --> 00:00:24.600
text text text text text

00:00:24.867 --> 00:00:28.867
text text text text text

00:00:29.967 --> 00:00:33.967
text text text text text

after running, no error code given, just 500. Monolog and FFMpeg log also show no error.

Expected behavior
Show/encode Subtitles.
Desktop/Server (please complete the following information):

Linux
Ubuntu 20.04 with Latest patches
FFmpeg vesion 4.2.4

Additional context
        $r_480p  = (new Representation)->setKiloBitrate(1024)->setResize(720, 480)->setAudioKiloBitrate(256);
        $english = new HLSSubtitle('./same-dir-as-phpfile-executing/qa.vtt', 'english', 'en');
        $video->hls()
        ->subtitles($english)
        ->encryption($save_to, $url, intdiv($encode_time,4))
        ->x264()
         ->setFormat($format,$time)
        ->addRepresentations([$r_480p])
        ->save($server_dir.$time.'/part');

$server_dir.$time = /var/tmp/e
$video = /home/e/run
All folders are 777. The WebVTT is 4:08 mins, the Video is 4:15 mins.
Also note, there are commas in the subtitles.

Maybe you set your PHP env to not show the error. Run the script below to see the error message.
ini_set('display_errors', 1);
ini_set('display_startup_errors', 1);
error_reporting(E_ALL);

$r_480p  = (new Representation)->setKiloBitrate(1024)->setResize(720, 480)->setAudioKiloBitrate(256);
$english = new HLSSubtitle('./same-dir-as-phpfile-executing/qa.vtt', 'english', 'en');

$video->hls()
      ->subtitles($english)
      ->encryption($save_to, $url, intdiv($encode_time,4))
      ->x264()
       ->setFormat($format,$time)
      ->addRepresentations([$r_480p])
      ->save($server_dir.$time.'/part');


[#18] StackOutputPlugin#process now returns a promise

This allows this plugin to execute in the order in which it is included
in the plugins section of serverless.yml
Closes #18

Since the original package doesn't seem to be maintained. I've merged #18 + #19 and published on npm under @anttiviljami/serverless-stack-output

@sbstjn This looks like a useful PR to include in the package. Are you accepting PRs for this project?


invalid benchmark (and memory leak)

This library has a built-in cache, so any comparison to other libraries or native functions is useless and the documentation is misleading for developers.
Please correct the documentation and include information about the cache, which can be dangerous in some situations.

yep, repeat-string have an unfair advantage in there bench test.
they don't show/compare the time it takes to do it just 1 time cuz it only looks bad in their bench result
...or when the cache is disabled (as in using different strings every time you call the repeat function)
here are some result of just comparing the raw power of using native vs repeat-string (\w cache turned off)
async function code1() {
  const mod = await import('https://jspm.dev/repeat-string')
  const repeat = mod.default

  const str1 = `Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book. It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged. It was popularised in the 1960s with the release of Letraset sheets containing Lorem Ipsum passages, and more recently with desktop publishing software like Aldus PageMaker including versions of Lorem Ipsum.`

  const str2 = `It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has a more-or-less normal distribution of letters, as opposed to using 'Content here, content here', making it look like readable English. Many desktop publishing packages and web page editors now use Lorem Ipsum as their default model text, and a search for 'lorem ipsum' will uncover many web sites still in their infancy. Various versions have evolved over the years, sometimes by accident, sometimes on purpose (injected humour and the like).`

  let i = 100_000
  console.time('repeat-string')
  while(i--) {
    repeat(str1, 10)
    repeat(str2, 10) // to clear cache
  }
  console.timeEnd('repeat-string')
}

async function code2() {
  const str1 = `Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book. It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged. It was popularised in the 1960s with the release of Letraset sheets containing Lorem Ipsum passages, and more recently with desktop publishing software like Aldus PageMaker including versions of Lorem Ipsum.`

  const str2 = `It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has a more-or-less normal distribution of letters, as opposed to using 'Content here, content here', making it look like readable English. Many desktop publishing packages and web page editors now use Lorem Ipsum as their default model text, and a search for 'lorem ipsum' will uncover many web sites still in their infancy. Various versions have evolved over the years, sometimes by accident, sometimes on purpose (injected humour and the like).`

  let i = 100_000
  console.time('native')
  while(i--) {
    str1.repeat(10)
    str2.repeat(10)
  }
  console.timeEnd('native')
}

const blob1 = new Blob([code1.toString() + ';code1()'], { type: 'text/javascript' })
const blob2 = new Blob([code2.toString() + ';code2()'], { type: 'text/javascript' })

new Worker(URL.createObjectURL(blob2), { type: 'module'})
new Worker(URL.createObjectURL(blob1), { type: 'module'})

Chrome: 104
native: 6.642822265625 ms
repeat-string: 8.089111328125 ms
Safari: 15.6
native: 17.117 ms
repeat-string: 19.190 ms

Honestly you don't need any repeat library just use built in String.prototype.repeat instead... it's fast enough and don't leak anything. it probably also have smarter internal ways to make a variable repeat n number of times that are more memory efficient


broken syntax highlighting when using spread operator

Syntax highlighting is completely broken when using the beautiful spread-operator.

If your have configured your normal JavaScript to use a highlighting package that supports this, then it's not being used for the script inside Vue files. Disable Sublime's default JavaScript package to make it work.


[question]Is it possible to use freertos to build an OS like google wear OS?

Can I build an OS like google wear os with freertos?

Hi - thanks for your question - grateful if you can post it on the support forum here: https://forums.freertos.org


Enhance style sharing feature

To do list

[x] remove radios from the dialog, and save all layers' style.json as default
[x] I think it can be better if layer name will be put in style name as default instead of using the same text.
[x] add a column to store $layerList object at style table in database
[x] save $layerList object to database. add classification property as a property of style.json
[x] add edit button in dashboard
[ ] #1005

let me close this one


d2i_PKCS7_bio() libctx/propq behaviour

d2i_PKCS7_bio() seems to have added support for libctx/propq by reusing the libctx/propq from the destination variable. I think this is problematic because:

It's the only type we do this for.
It's non-documented and unexpected behaviour that will likely lead to bugs.
It makes the reuse of old structures that are passed worse.

The function should be reverted to:
PKCS7 *d2i_PKCS7_bio(BIO *bp, PKCS7 **p7)
{
    return ASN1_item_d2i_bio(ASN1_ITEM_rptr(PKCS7), bp, p7);
}

A new function should be created:
PKCS7 *d2i_PKCS7_bio_ex(BIO *bp, PKCS7 **p7)
{
    return ASN1_item_d2i_bio_ex(ASN1_ITEM_rptr(PKCS7), bp, p7, libctx, propq);
}

The ossl_pkcs7_resolve_libctx() call should be done somewhere else.
And the internal callers that want this new behaviour should get updated to use the new function.

I do not think we can change this behavior. At the best we can document it.

OTC:

This isn't a bug, it's a feature request.
We cannot revert the behaviour.
We need to document the current behaviour (which could go to 3.0 and 3.1).
We should add something to make using a libctx easier.


Nfc Sample - Not Clear What it Does

The Nfc sample does not have a "Specifically, this sample shows how to" section or go into what this sample actually dues.  I suppose that those who know what Nfc stands for will understand, but the novice and beginner needs more explanation.

It does the two thing described in the README and in the sample scenarios.

HCE NFC Tap+Pay
NFC card reader

NFC stands for Near-field communication. I'll add a definition to the README.


Guild Land Settings?

Have a GUI to enable/disable/customize specific guild land settings?
maybe:

Animal Protection
PvP (Enable for allies/enemies/general...?)
Title messages?
Guild homes...?
Guild Flag Customizer?

Fire Spread..?


AttributeError: 'bool' object has no attribute 'read'

Getting this exception for some MP4s – let me know what other info I can provide:
2017-10-08 17:00:03 ERROR (MainThread) [aiohttp.server] Error handling request
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/aiohttp/web_protocol.py", line 422, in start
    resp = yield from self._request_handler(request)
  File "/usr/lib/python3.6/site-packages/aiohttp/web.py", line 306, in _handle
    resp = yield from handler(request)
  File "/usr/lib/python3.6/asyncio/coroutines.py", line 213, in coro
    res = yield from res
  File "/usr/lib/python3.6/asyncio/coroutines.py", line 213, in coro
    res = yield from res
  File "/usr/lib/python3.6/site-packages/homeassistant/components/http/ban.py", line 58, in ban_middleware_handler
    return (yield from handler(request))
  File "/usr/lib/python3.6/site-packages/homeassistant/components/http/__init__.py", line 428, in handle
    result = yield from result
  File "/usr/lib/python3.6/site-packages/homeassistant/components/camera/__init__.py", line 340, in get
    response = yield from self.handle(request, camera)
  File "/usr/lib/python3.6/site-packages/homeassistant/components/camera/__init__.py", line 360, in handle
    image = yield from camera.async_camera_image()
  File "/config/custom_components/camera/yi.py", line 126, in async_camera_image
    url, output_format=IMAGE_JPEG, extra_cmd=self._extra_arguments)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/tools.py", line 76, in get_image
    extra_cmd=extra_cmd)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/core.py", line 104, in open
    self._generate_ffmpeg_cmd(cmd, input_source, output, extra_cmd)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/core.py", line 38, in _generate_ffmpeg_cmd
    self._put_input(input_source)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/core.py", line 50, in _put_input
    input_cmd = shlex.split(input_source)
  File "/usr/lib/python3.6/shlex.py", line 305, in split
    return list(lex)
  File "/usr/lib/python3.6/shlex.py", line 295, in __next__
    token = self.get_token()
  File "/usr/lib/python3.6/shlex.py", line 105, in get_token
    raw = self.read_token()
  File "/usr/lib/python3.6/shlex.py", line 136, in read_token
    nextchar = self.instream.read(1)
AttributeError: 'bool' object has no attribute 'read'

Can you provide the config? You can send me a private message in discord/Home-Assistant

This is coming from a new camera platform I'm working on: https://github.com/home-assistant/home-assistant/pull/9743. You won't be able to access a stream, per se, but I could send you a sample MP4 that the platform downloads; would that help?

Saw this again today:
2017-10-16 21:01:47 ERROR (MainThread) [aiohttp.server] Error handling request
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/aiohttp/web_protocol.py", line 422, in start
    resp = yield from self._request_handler(request)
  File "/usr/lib/python3.6/site-packages/aiohttp/web.py", line 306, in _handle
    resp = yield from handler(request)
  File "/usr/lib/python3.6/asyncio/coroutines.py", line 213, in coro
    res = yield from res
  File "/usr/lib/python3.6/asyncio/coroutines.py", line 213, in coro
    res = yield from res
  File "/usr/lib/python3.6/site-packages/homeassistant/components/http/ban.py", line 58, in ban_middleware_handler
    return (yield from handler(request))
  File "/usr/lib/python3.6/site-packages/homeassistant/components/http/__init__.py", line 428, in handle
    result = yield from result
  File "/usr/lib/python3.6/site-packages/homeassistant/components/camera/__init__.py", line 340, in get
    response = yield from self.handle(request, camera)
  File "/usr/lib/python3.6/site-packages/homeassistant/components/camera/__init__.py", line 360, in handle
    image = yield from camera.async_camera_image()
  File "/config/custom_components/camera/yi.py", line 119, in async_camera_image
    url, output_format=IMAGE_JPEG, extra_cmd=self._extra_arguments)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/tools.py", line 76, in get_image
    extra_cmd=extra_cmd)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/core.py", line 104, in open
    self._generate_ffmpeg_cmd(cmd, input_source, output, extra_cmd)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/core.py", line 38, in _generate_ffmpeg_cmd
    self._put_input(input_source)
  File "/config/deps/lib/python3.6/site-packages/haffmpeg/core.py", line 50, in _put_input
    input_cmd = shlex.split(input_source)
  File "/usr/lib/python3.6/shlex.py", line 305, in split
    return list(lex)
  File "/usr/lib/python3.6/shlex.py", line 295, in __next__
    token = self.get_token()
  File "/usr/lib/python3.6/shlex.py", line 105, in get_token
    raw = self.read_token()
  File "/usr/lib/python3.6/shlex.py", line 136, in read_token
    nextchar = self.instream.read(1)
AttributeError: 'bool' object has no attribute 'read'


Detector option support

like this

https://firebase.google.com/docs/reference/swift/firebasemlvision/api/reference/Classes/VisionFaceDetectorOptions
https://firebase.google.com/docs/reference/ios/firebasemlvision/api/reference/Classes/FIRVisionFaceDetectorOptions
https://firebase.google.com/docs/reference/android/com/google/firebase/ml/vision/face/FirebaseVisionFaceDetectorOptions

Now supporting in face detector.


load stop changes

made 2 changes:

Generate a csv file of the stop changes with the stop names.  Use this for the Service Planners to validate our data is correct.
Add the 'replaced by micro' column to the notebook and json outputs.

looks great! i checked the notebook to see if "direction" was used, and it is!


Add new wiring : 'ASSY-77>Adpt.A64-Om32_2x-sm>two_RHD2132'

@alejoe91
this is a new wiring.
Could you check this blindly ?
You will need this:

https://gin.g-node.org/spikeinterface/probeinterface_library/issues/6
https://docs.google.com/presentation/d/18sMWuAIgtgmPcJw-0TC9f3JDNe64icD7pVA97QaMiuc/edit?usp=sharing

And then compare with my solution
https://docs.google.com/spreadsheets/d/1Q6eAaRmn2c18Q_3H2A5WFX_ecxnq3gejkc2MP3pDMg4/edit?usp=sharing

@alejoe91 this is a new wiring.
Could you check this blindly ?

The presentation and images are too low resolution to actually see the values on the omnetics connector...

Hi guys,
I did this mapping for one of our customers recently. Here is my version if
that helps. Also just to make a note that both Neuronexus and Cambridge
Neurotech make an ADPTA64-Om32x2 with different mapping so if you can find
a way to delineate these adapters in the wirings that would be great.
All the best,
Jessie

Jessie Goins M.S, NeuroTech Expert*
http://cambridgeneurotech.com/

On Thu, Aug 11, 2022 at 11:08 AM Alessio Buccino @.***>
wrote:

@alejoe91 https://github.com/alejoe91 this is a new wiring.
Could you check this blindly ?
The presentation and images are too low resolution to actually see the
values on the omnetics connector...
—
Reply to this email directly, view it on GitHub
https://github.com/SpikeInterface/probeinterface/pull/120#issuecomment-1212121691,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AK5GQJX45K45SXQUCMGCKPDVYUJODANCNFSM55AV7AEA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Here is the mapping document
https://docs.google.com/spreadsheets/d/1IntjKPPXXsbM8zIX17VhXT-Vv0sfwlQThJLm0aw4wOs/edit?usp=sharing

Jessie Goins M.S, NeuroTech Expert*
http://cambridgeneurotech.com/

On Thu, Aug 11, 2022 at 11:19 AM Jessie Goins @.***>
wrote:

Hi guys,
I did this mapping for one of our customers recently. Here is my version
if that helps. Also just to make a note that both Neuronexus and Cambridge
Neurotech make an ADPTA64-Om32x2 with different mapping so if you can find
a way to delineate these adapters in the wirings that would be great.
All the best,
Jessie

Jessie Goins M.S, NeuroTech Expert*
http://cambridgeneurotech.com/

On Thu, Aug 11, 2022 at 11:08 AM Alessio Buccino @.***>
wrote:

@alejoe91 https://github.com/alejoe91 this is a new wiring.
Could you check this blindly ?
The presentation and images are too low resolution to actually see the
values on the omnetics connector...
—
Reply to this email directly, view it on GitHub
https://github.com/SpikeInterface/probeinterface/pull/120#issuecomment-1212121691,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AK5GQJX45K45SXQUCMGCKPDVYUJODANCNFSM55AV7AEA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Hi guys, I did this mapping for one of our customers recently. Here is my version if that helps. Also just to make a note that both Neuronexus and Cambridge Neurotech make an ADPTA64-Om32x2 with different mapping so if you can find a way to delineate these adapters in the wirings that would be great. All the best, Jessie * Jessie Goins M.S, NeuroTech Expert* http://cambridgeneurotech.com/
…
On Thu, Aug 11, 2022 at 11:08 AM Alessio Buccino @.> wrote: @alejoe91 https://github.com/alejoe91 this is a new wiring. Could you check this blindly ? The presentation and images are too low resolution to actually see the values on the omnetics connector... — Reply to this email directly, view it on GitHub <#120 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK5GQJX45K45SXQUCMGCKPDVYUJODANCNFSM55AV7AEA . You are receiving this because you are subscribed to this thread.Message ID: @.>

I think we can have NN-ADPTA64-Om32x2 and CN-ADPTA64-Om32x2

@samuelgarcia you had 1 mistake: 39 and 40 were inverted.
It's correct in both mine and Jessie's solution (here is mine: https://docs.google.com/spreadsheets/d/1YyRSpU2ab0R91y9LAovrWLKNOxUDvDNbskKYnAdcrQY/edit?usp=sharing).
As @jgoins17 suggested, to differentiate between the NeuroNexus and Cambridge Adpt.A64-Om32_2x-sm versions I appended a -NN to the Adpt.A64-Om32_2x-sm in the pathway. Note that I did the same for the 'ASSY-77>Adpt.A64-Om32_2x-sm-NN>two_RHD2132'.
Merging! Thanks again @jgoins17 for double checking!

cool.
Thanks.


⚠ Bofrost.be has degraded performance

In 86f3b44, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1259 ms

Resolved: Bofrost.be performance has improved in dc7211a after 13 minutes.


[AgriFood] Adding Nov 2022 API version update with STAC Feature GET and Search APIs

Data Plane API - Pull Request
Adding two new APIs for STAC (Spatio Temporal Asset Catalog) Feature get and Search features Functionality. No breaking changes, as this API Preview version is not yet exposed to customers.
Get feature:
GET /scenes/collections/{collectionId}/features/{featureId}
this will accept an input of: collectionId, featureId and returns STAC Feature in the given collection Id.
Search feature:
POST /scenes/collections/{collectionId}:search
Input: geometry (bbox or polygon, multipolygon), start and end datetime and collectionId, (optional array) feature_id(s)(size of array [0,5]), limit (size of returned list) and next (next token to get next set of results).
Ouput: List of Features, next token and returned no of features.
##Other Spec Updates:
1)Adding new satellite source Sentinel_2_L1C.
2) Changing CropVariety to CropProduct.
3) Adding errorCode in jobs response body.
4) Updating Weather Data example and method name.
API Info: The Basics
Most of the information about your service should be captured in the issue that serves as your engagement record.

Link to engagement record issue: https://github.com/Azure/azure-rest-api-specs/issues/22336

Is this review for (select one):

[ ] a private preview
[ ] a public preview
[ ] GA release

Change Scope
This section will help us focus on the specific parts of your API that are new or have been modified. Please share a link to the design document for the new APIs, a link to the previous Open API document (swagger) if applicable, and the root paths that have been updated.

Design Document:
Previous Open API Doc:
Updated paths:

❔Got questions? Need additional info?? We are here to help!

 Contact us!
The Azure API Review Board is dedicated to helping you create amazing APIs. You can read about our mission and learn more about our process on our wiki.

💬 Teams Channel
💌 email

Click here for links to tools, specs, guidelines & other good stuff
Tooling

Open API validation tools were run on this PR. Go here to see how to fix errors
Spectral Linting
Open API Hub

Guidelines & Specifications

Azure REST API Guidelines
OpenAPI Style Guidelines
Azure Breaking Change Policy

Helpful Links

Azure DevTools Wiki

/azp run

/azp run

I've re-run the CI. Please check SemanticValidation and ModelValidation first.

I've re-run the CI. Please check SemanticValidation and ModelValidation first.

I see the failures in json validation, but I don't find those semantic and model validation errors when checked with avocado locally. The error points to the first line itself, but unable to figure out what is the error. Check with external json validators also, didn't find any issue.

@raych1
Hi Ray, do you know what's the reason of SemanticValidation?
I seem not able to read useful information from logs.

@raych1 Hi Ray, do you know what's the reason of this SemanticValidation on 1:1?
I seem not able to read useful information from logs.

@bhanuprakash-1
Ray mentioned it could be BOM in your JSON. You might want to open it in editor and see if it got option to encode to UTF without BOM.

@raych1 Hi Ray, do you know what's the reason of this SemanticValidation on 1:1?
I seem not able to read useful information from logs.

@bhanuprakash-1 Ray mentioned it could be BOM in your JSON. You might want to open it in editor and see if it got option to encode to UTF without BOM.

Thanks @weidongxu-microsoft , errors are gone after changing the encoding from UTF+BOM  to UTF-8. Not sure how BOM cropped in.

/azp run

/azp run

/azp run

/azp run

Hi @weidongxu-microsoft , can you please approve the PR?
We have noted down the below suggestions for future versions:

agrifood currently return STAC data directly, do we recommend them keep the exact STAC specs, i.e. “stac_version”; or use Azure camelCase, i.e. “stacVersion”; or leave it as a future discussion, as I understand that backend  is still private preview?

Establish a plan now to handle new versions of the STAC, what is the back-up plan when third party providers do breaking API schema changes?

Please check the URL for the action pattern should be/weather-data:fetch .

More more "TODO" is the "WeatherDataForPassthrough" by Jatin.

Recommend to separate the processed data, and the raw data from provider. (down-side seems that this might increase payload size)


Cloud9 Environment - Platform

Description
Please provide a clear and concise description of the issue you are encountering, and a reproduction of your configuration.
If your request is for a new feature, please use the Feature request template.

[ ] ✋ I have searched the open/closed issues and my issue is not listed.

Under Create a Cloud9 environment in the SetupCloud9 section, it says that you should pick Amazon Linux 2 for the platform you install on your EC2 instance. However, when if you choose Amazon Linux 2 and are using Node.js version 18, you will run into issues when you run this command:
npm install -g aws-cdk
The error you will likely see is this:
node: /lib64/libm.so.6: version `GLIBC_2.27' not found (required by node)
node: /lib64/libc.so.6: version `GLIBC_2.28' not found (required by node)

In order to have it working with no issues you will either have to downgrade to Node.js version 16. If you would like to use Node.js version 18, you will have to choose Amazon Linux 2023 for the platform you run on your EC2 instance. Furthermore, on the AWS console, it does say that the recommended platform is Amazon Linux 2023.
Versions

Module version [Required]:

AWS CDK version:

2.138.0
Reproduction Code [Required]

Steps to reproduce the behavior:

Expected behavior

Actual behavior

Terminal Output Screenshot(s)

With Amazon Linux 2:

With Amazon Linux 2023:

The recommended platform on the console:

Additional context

Thank you very much for the update! I'll make a change to the Create a Cloud9 environment  doc!

Done


New resource proposal: xSQLServerAlwaysOnAvailabilityGroup (could replace xSQLAOGroupEnsure)

I have an existing resource that could be moved into this module
https://github.com/johlju/xSqlServerAlwaysOn/tree/dev/DSCResources/xSQLServerAlwaysOnAvailabilityGroup
This resource adds or removes the Primary Replica. The resource validate so that changes that are required to be done on the Primary Replica is only attempted when the node is Primary Replica. Before changing it verifies that the node is the Primary Replica, in this case when removing the Availability Group. It also handles if the state is no longer desired. If options has changes, this resource will set them back.
This resource already has a few more options and functionality than xSQLAOGroupEnsure. But to replace the resource xSQLAOGroupEnsure we need to add the following parameters ReadableSecondary,ReadableSecondary and BackupPriority.
Schema
[ClassVersion("<IP_ADDRESS>"), FriendlyName("xSQLServerAlwaysOnAvailabilityGroup")]
class xSQLServerAlwaysOnAvailabilityGroup : OMI_BaseResource
{
    [Key, Description("The SQL Server instance name of the primary replica.")] String InstanceName;
    [Required, Description("The host name or FQDN of the primary replica.")] String NodeName;
    [Key, Description("The name of the availability group.")] String Name;
    [Write, Description("If the availability group should be present or absent."), ValueMap{"Present","Absent"}, Values{"Present","Absent"}] String Ensure;
    [Write, Description("The availability mode for the primary replica"), ValueMap{"SynchronousCommit","AsynchronousCommit"}, Values{"SynchronousCommit","AsynchronousCommit"}] String AvailabilityMode;
    [Write, Description("The failover mode for the primary replica"), ValueMap{"Automatic","Manual"}, Values{"Automatic","Manual"}] String FailoverMode;
    [Write, Description("The length of time, in milliseconds, after which the availability group declares an unresponsive server to be unhealthy.")] UInt32 HealthCheckTimeout;
    [Write, Description("The automatic failover behavior of the availability group"), ValueMap{"OnServerDown","OnServerUnresponsive","OnCriticalServerErrors","OnModerateServerErrors","OnAnyQualifiedFailureCondition"}, Values{"OnServerDown","OnServerUnresponsive","OnCriticalServerErrors","OnModerateServerErrors","OnAnyQualifiedFailureCondition"}] String FailureConditionLevel;
};

I think this is a great idea. It'll really simplify the configs and make this resource more focused on doing one thing.

If this resource proposal is choosen, anyone is more than welcome to bring the resource over here.

@randomnote1 If you feel your changes is better done to this resource, you are more than welcome to fetch the code and PR it in here, new and improved. 😄

Cool, it sounds like you're pretty well along here. I'll pull it down and check it out. Thx!

Awesome! 😄  If you need help later on writing test or anything. Let me know. I'm happy to help. 😄
It is fully working. I installed a AlwaysOn cluster with that code. See full example in the Examples folder.

Is there a preferred method for me to lift the files from your repo and add them to the xSQLServer repo? Or will a simple copy/paste work fine for our purposes?

Since my repo is not based on xSQLServer I think it would be easier for you to copy the files into a working branch in your clone of xSQLServer and then PR in that working branch.
And also make sure it uses helper functions of xSQLServerHelper.psm1 where applicable.

Excellent, thanks!

I suppose I should also ask about deprecating xSQLServerAOGroupEnsure in favor of xSQLServerAlwaysOnAvailabilityGroup. We can probably discuss that down the road when this gets fleshed out a bit more.

I think we issue a separate issue discussing, and take action, on that once this are merged. That will become a breaking change which because of that needs a separate issue.


Cannot write file - System.ObjectDisposedException cannot access a closed file

Hi.
I use your library for reading SPSS files and trimming existing libraries. This works well. However, I have just tried to create one for scratch and I get an error "System.ObjectDisposedException cannot access a closed file".
To recreate, simply create a .net 7 console application and copy and paste the code from your GitHub homepage. The SPSS file is created correctly but the application crashes on closure.
At the moment, I am mitigating this by using someone elses fork but thought you should know.
Chris.

Hi, Chris!
Sorry for a long reply and thanks for a bug report.
Unfortunately, I can't reproduce the bug. I've created a simple .NET 7 app as you write, copied and and pasted the code of reading SPSS file, and all works fine without exception.
Please, can you give us more details to help reproduce the bug? For example, dotnet SDK version, Curisoity.SPPS package version. Test SPSS file is also appreciated.

I found mistake in readme example - SpssReader instance wasn't disposed. I've placed it in using. Maybe, this fix can help you. But in my environment and with my test files all works fine without this fix.


Fix tests

The last few PRs have failed, and I suspect master would fail as well if re-run on CI.
Fixes an error in test_line_comments_active_in_dev and fixes a warning in test_css_compressor_config_item_may_be_nil_in_test_mode.

Thanks!


plasma6: kcm modules broken outside plasma desktop

Describe the bug
Plasma 6 KDE Config Modules don't work outside a plasma 6 session.
Steps To Reproduce
Steps to reproduce the behavior:

Enable plasma6, as well as another window manager such as sway
Start sway
Either open systemsettings and click sound in the left hand side,
or
run systemsettings kcm_pulseudio from a terminal
Exit sway and start plasma6
Repeat step 3.

Expected behavior
The plasma5 equivalent, systemsettings5, can be run outside of the plasma session. It is useful to be able to set some KDE settings even if you're not actually running KDE/plasma (e.g. if you use KDE applications, you can configure their behaviour and appearance).
Actual behaviour
The KCM GUI can't find some of its runtime dependencies (kirigami-addons for this specific KCM: others have other missing dependencies) when run outside of a plasma6 session. The following appears in a terminal.
> systemsettings kcm_pulseaudio
qt.qml.typeresolution.cycle: Cyclic dependency detected between "qrc:/qt/qml/org/kde/desktop/private/TextFieldContextMenu.qml" and "qrc:/qt/qml/org/kde/desktop/MenuItem.qml"
kf.kcmutils: Error loading QML file qrc:/kcm/kcm_pulseaudio/main.qml
kf.kcmutils:     qrc:/kcm/kcm_pulseaudio/main.qml:19:1: module "org.kde.kirigamiaddons.components" is not installed
    import org.kde.kirigamiaddons.components 1.0 as KirigamiComponents
    ^
qrc:/qt/qml/org/kde/desktop/private/TextFieldContextMenu.qml:235:5: QML MenuItem: Binding loop detected for property "implicitWidth"

The system settings application UI appears, but the "Sound" / pulseaudio page doesn't load and displays the same errors "Error loading QML file." and "qrc:/kcm/kcm_pulseaudio/main.qml:19 module "org.kde.kirigamiaddons.components" is not installed" instead.
I assume plasma6 must be setting the QT_PLUGIN_PATH or some other environment variable to include the runtime qml dependencies that the kcm modules need.
Notify maintainers
@NixOS/qt-kde

Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
 - system: `"x86_64-linux"`
 - host os: `Linux 6.1.66-rt19, NixOS, 24.05 (Uakari), 24.05.20240314.d691274`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.1`
 - nixpkgs: `/home/thrall/nixpkgs`

Add a :+1: reaction to issues you find important.

Related pr: https://github.com/NixOS/nixpkgs/pull/296619

I think kcmutils needs to propagate kirigamiaddons. What do you think @K900 ?

kcmutils shouldn't, plasma-pa should, if anything, but then we have the whole propagatedUserEnvPackages mess again...

I agree that it should be plasma-pa that has the dependencies. The KCM (KDE Configuration Modules) are supposed to be modular, so each module should include its own dependencies. If we suppose that plasma-pa is the only KCM module whose config GUI needs kirigami-addons (It almost certainly isn't in reality), then in theory it should be possible for a system without plasma-pa to install and use systemsettings without pulling in kirigami-addons.
I experimented with adding kirigami-addons and kitemmodels to pkgs/kde/plasma/plasma-pa/default.nix, but neither adding them to extraBuildInputs nor extraPropagatedBuildInputs made any difference.
On a 'conventional' linux system, all these dependencies would install their bits in the same location e.g. /usr/share/qt6/plugins or something, which would be included in an environment variable such as QT_PLUGIN_PATH, so . On NixOS, I believe it adds each individual /nix/store/<package>/share/whatever to the environment variable, but I haven't yet had a chance to study how NixOS constructs qt6 / plasma 6 plugins paths.
Random thoughts:

This whole "find the qt plugins in the path at runtime" thing is completely unnecessary on nixos, since we instantiate an entire system instead of just shoehorning new packages into an existing system
NixOS is bad at optional dependencies (i.e. the idea that package X can be installed without package Y, but if both X and Y are installed, X will automatically gain optional functionality from Y)


feat(interrupt): Initial implementation of the interrupt policy

gravitee-io/issues#7883

Gravitee.io Automatic Deployment
🚀 A prerelease version of this package has been published on Gravitee's private artifactory, you can:

use it directly by updating your project with version: 1.0.0-issues-7883-interrupt-policy-SNAPSHOT
download it from Artifactory here

:tada: This PR is included in version 1.0.0 :tada:
The release is available on:

1.0.0
GitHub release

Your semantic-release bot :package::rocket:


Vue3: API Key Create Page: numberical input rockers fail to work

Setup

Rancher version: dev 2.10.0

Describe the bug

Custom expiration unit input field broken, rockers clear value and produce console warning
could be related to https://github.com/rancher/dashboard/issues/11722?

To Reproduce

Nav to User Avatar --> Account & API Key --> Create API Key --> toggle to Custom

Result

0 is replaced with empty text
in console The specified value "[object Event]" cannot be parsed, or is out of range.

Expected Result

rockers work, no console warning

Was this catched by an existing test?

I believe this was caught manually. There was no failing automated test associated with this issue when I raised the PR; keep in mind that we had a lot of tests marked as skipped at the time.
Even today with a more comprehensive test suite, I don't think this specific issue will be covered.

@rak-phillip got it move it to done. Thanks


Facing issue in broadcast listener

Hi
Hope all is good
I'm using this plugin to detect the incoming message. Me and my team are facing stability issue in the broadcast receiver. Sometimes we are getting the output sometimes the SMS is not getting listened. We tried to implement the functionality in native android and it was working fine. While receiving the SMS it's not getting entered in the onReceive method.
My doubt here is does this issues is happening because of any kind of react-native restrictions? also the SMS is not getting detected in when the app is in background state
From code point of view we added the lines only present in the documentation given by your team. Kindly note
Device used for testing:

Redmi 6 pro - Pie OS

Please do the needful

Hey @EsaMohammed1110 - I am so sorry for this, currently I'm not actively maintaining this library and TBH, I haven't been working with React Native stuff for a while.
However, I do know that there's some issues regarding permissions you might want to check.


New HSBC statements page breaks OBIS

I'm aware that HSBC UK have now updated their statements pages, meaning that OBIS no longer works. I'll be updating the parser soon.

Commit 02f7b652a7ff2987df07a31b7da232a05aa18c29 introduces a parser for the new dojo-based HSBC UK web app, which means you can run OBIS from a [ View statement ]  page again.
I'm afraid multi-statement download is a more difficult job than before, and I've not tackled it yet, meaning it's a one-at-a-time task to download your statements in OFX/QIF/JSON/etc. formats. :(

Also note: HSBC does not calculate running-balances correctly, so you'll see a few "Calculation discrepancy" warnings in the OBIS statement-viewer.
The exported data should be fine despite this, although it will not be consistent with the old formats, so be careful if you plan to re-import the same statements again.

This is absolutely fab shuckster. Really appreciate the work on this. Any news on an update to address the new statement pages? Any way this parser can download multiple statements from two separate bank accounts with HSBC at the same time?

Thanks masterell, glad you’ve found it helpful! I must admit I’ve not made any further changes since this report. I do need to use OBIS very soon though, so expect a few tweaks when I come across the same issues as you!
I’m not sure about multiple statement download for the time being. This was much easier to achieve with their old website and worked well. I’ll see what I can do though.

Thanks! Really appreciate that. I guess even if OBIS opens all the different accounts/statements in different tabs with the download options available in each individual tab, it would be handy. HSBC don't make things easy!!

Just had a look through myself. I'm not particularly well versed with Dojo but from what I can see there doesn't appear to be an easy way to parse multiple statements at once (let alone multiple statements from multiple accounts). One could attempt to parse the statements via the PDFs as their links are readily available from the "View/Download Statements" page, but this would be quite messy and not perfect. I've started looking into the various scripts HSBC runs to generate the statements.
It appears this is the form template they use:

Which uses the following script:

Which takes:

Wow, thanks so much for the digging! As you can probably tell I'm being pulled away from this at the moment, so apologies for my late replies. But I'll be back on it before too long!

I used OBIS about a year ago and it worked fine (thanks!) but had to reinstall the bookmarklet today after a Chrome issue and can't get it to run at all.  Nothing happens when I hit the bookmark.  Any suggestions?

Hi @Sprocket2020, I'll take a look at it this weekend. Been a while since I've used it myself!

Many thanks.  HSBC is so awful with their statements that I can hardly believe that I'm still using it!

I hear that!
I've just tried OBIS and it seems to be working okay. Here's a screenshot:

You do have to download statements from My Accounts > Manage > Statements, then click View statement for the statement you wish to download, then the OBIS bookmark:

It may take a moment or two for the controls in the first screenshot to appear. It depends on how responsive Github Pages is. If it's been a while since you used the site you could try clearing your cookies/cache for the hsbc.co.uk domain.
Let me know how it goes!

I just spent a miserable afternoon cutting and pasting transactions from pdf files to Excel.  I'll try OBIS again right now.

Wow!  My fault, it seems.   :-(
The good news is that I have another account to do which I was just about to start so that's going to make life lots easier.  Many thanks!

Excuse my (total) lack of modern coding experience, but am I right in thinking that the bank creates the pdf files on demand for the older statement downloads and OBIS compiles its various data formats from the same source?  If so, why don't they allow useful downloads for at least the period required for UK tax reporting?

I can't be sure that HSBC's own PDF statement are generated on-the-fly, but certainly they would use their own API to build them. OBIS uses the data in the HTML page to offer different formats.
Actually, last time I checked the statement-data can now be accessed in a global JS object, so the parser could be simplified.
But quite why HSBC can't offer formats other than PDF is probably more to do with political reasons, since it's not exactly a difficult technical problem for them!

Have recent changes broken this? I can't get statements on the web page any more (like in the 10 Jan screenshot above). There is just a page for downloading old pdf statements (and MiData which only goes back 12 months). Any ideas how to reach the previous statement pages, or gone now?

Hi @prisonblues - I've been working on-and-off on a new version of OBIS that's compatible with more recent HSBC changes, but wasn't aware that the old one had broken.
I'll take a closer look in the next couple days, but I'm trying to prioritise the new version currently!

Turns out I had to update the user-content URLs, but doing so has not completely solved the problem.
Unfortunately, the HSBC statements-page has been completely updated and is only offering PDF downloads. There is no HTML page that would be easy to scrape anymore.
The other problem is that the updated page has a new CSP -- or Content Security Policy -- forbidding the Bookmarklet to load. It was highly unlikely that OBIS would work anyway on this new statements page, but the CSP is another obstacle to getting it working again.
Anyway, I'm still tinkering around. If I have any luck I'll let you know!

I used OBIS in 2o19 but had to resort to a commercial product last year.  Bank2CSV by ProperSoft worked OK for taking the details from the PDFs and I only needed to subscribe for a month at a time so not wasteful, given I only need to use it once a year.  The best part for me was that You can set it to work on all twelve months in one batch which is a big time saver.  I hope you manage to get OBIS running again and I'll revert.

Hey @Sprocket2020 , and everyone else too
I've completely rewritten OBIS. It works a treat locally, but it looks like Chrome's CORB security-measures prevent OBIS from loading via Github.
Still, you can try it out locally if you want by cloning the project. I use pnpm, but npm should work fine:
git clone https://github.com/shuckster/OBIS.git
cd OBIS
pnpm i
pnpm run debug:live

At this point an express-server should be running, and a local bookmarklet will have been built in dist/ that points to it.
Let me know how you get on!

Better instructions now in README.


Crashlytics iOS Documentation Issue [Legacy/New Build System, Last Build Script]

Problem Description:
Crashlytics documentation has a note in step 3 about fact that we need to be sure that the new run script will be run as the last build script.
Step 3: Initialize Crashlytics
Note: Make sure your new build phase is the project's last build phase or Crashlytics can't initialize properly.
https://firebase.google.com/docs/crashlytics/get-started
We can guarantee this only with the Legacy Build System, but on New Build System this phase may not necessarily be the last one.
https://medium.com/xcblog/five-things-you-must-know-about-xcode-10-new-build-system-41676cd5fd6c
Conclusion:
If you have already updated the code and it works correctly on the New Build System, please let us know and update the documentation.
If the code does not work correctly on a New Build System, please indicate in the documentation that only the Legacy Build System should be used, since only in it we can guarantee that the script will be executed last.

Thanks for the heads up. The Crashlytics scripts should work correctly with the new build system, though the docs may need to be updated.

Ok, thanks for the quick response!
Then, as I understand it, if we provide input files and execute the necessary scripts on a new build system without taking into account the remark in the documentation that the scripts must be executed last - will everything work correctly?

They really only need to be executed after the binary compilation is finished and the dSYMs have been generated, according to my knowledge.


Make Unobtrusive Ajax available on Bower

Related to #2015

Now at https://github.com/aspnet/jquery-ajax-unobtrusive
On bower:


HR CustomDataset Finetuning

Hi, I have a question so I'm leaving an issue.
I currently have around 9000 HR custom dataset and I am training by adding a path to the Plus_Ultra.yaml config file. (We are also training the learning dataset specified in the Plus_Ultra.yaml.)
However, The more I train the model, the lower the performance of the model.(almost 10 epoch)
May I ask you a few questions as I want to solve the cause of a problem like this?

Is it right to include LR datasets (ECSSD, FSS-1000, …) when creating models with 1024x1024 inputs?
Is there a reason to use dynamic_resize instead of static_resize for the test part of Plus_Ultra.yaml config?

If you have any other solution, I would appreciate it if you could let me know.

Hi @ZeVicTech, first of all, sorry for the late reply. I cannot guarantee that I can give you the right answer since I cannot access to your custom dataset and test myself, but please make sure that your dataset annotation strategy is identical to the salient object detection task.
For example, when your target is to generate a segmentation mask of a human hair only, then the rest of the public training datasets are not helpful for the finetuning. Try using your custom dataset only with lower learning rate, and start from our pre-trained model. You can refer to https://github.com/plemeri/InSPyReNet/issues/40 for finetuning.
For the dynamic resize, we follow CascadePSP. It helps to produce better boundary accuracy by maintaining the aspect ratio of the image while reducing the size of the image to the plausible size for the GPU memory.

I'll give it a try as you advise, thank you


Pass password when using ssh key

Currently it is not possible to use a ssh key with a passphrase.
paramiko defines password as follows:
password (str) – a password to use for authentication or for unlocking a
private key

This change passes the password when using a private key allowing the
use of a passphrase protected private key.
<!-- Make sure you have read http://napalm.readthedocs.io/en/latest/contributing/index.html --!>

Coverage decreased (-0.1%) to 78.2% when pulling 3d9bf7d93b261c2ad0badd6d16fc898516abedab on loverend:pass_password_ssh_key into 6dd35460b9c082f4d28b7257378f4ea87e726da0 on napalm-automation:develop.


Are pretty URLs possible?

Hi
I have integrated your code and paging works, but the URLs are not pretty URLs. What I would like them to be is:

http://www.mysite.com/suppliers/page/1
http://www.mysite.com/suppliers/page/2

And so on. Is this possible? Right now I'm getting:

http://www.mysite.com/suppliers/page?page=2

Any help would be greatly appreciated.

Yes, this is possible with custom routes. See http://demo.taiga.nl/mvcpaging/SimplePaging. The route configuration for this page is:
routes.MapRoute("SimplePaging", "SimplePaging/{page}",
                new { controller = "Paging", action = "Index", page = UrlParameter.Optional });

For the scenario above, you could probably use something like:
routes.MapRoute("DefaultPaged",  "{controller}/{action}/page/{page}",
                new { controller = "Home", action = "Index", page = 1 },  // Parameter defaults


Add USART support for LPC845

@david-sawatzke Here's my work-in-progress. I'll try to finish this up and get it merged tomorrow.
Looks like you have some stuff in your PR that I'm missing. I'm going to integrate that after RustFest.

Seems good enough as a POC otherwise

Unfortunately I wasn't able to get this to work. Not sure why, and unfortunately I didn't bring a logic analyzer with me to Barcelona.
I'll leave this open. I'll try to find some time to merge our two approaches later.

Update: I don't think I'll be able to finish this any time soon. If anyone else is interested, feel free to take it.

Closing in favor of #175. It's more fully featured, and has the distinction of actually working.


install-node: Upgrade Node.js to 18.15.0.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

I don't have cycles to debug the failure right now, and they've restored the 18.14.1 package which started to 404, so I'm going to close this for now.


Theshold from which avatars are hidden could be customizable

Hi @Toby-Hacker thank you for feedback, could you please give me an example or more detailed explanation.


Publish random fail

Publish failed at 3rd step but then worked after 1-2 minutes just by clicking submit again. Might be something regarding gas estimation, needs investigation

Might be something regarding gas estimation, needs investigation

I think if it was running out of gas there should be a failed transaction recorded. Do you have a link to the address that you've used?


Implementing BERT embeddings into NPA model

Description
Hello Evryone,
I tried to use BERT embeddings with the NPA model, I generated the embeddings for the news titles, but I didn't understand what changes should I make in my code to get the real results of the BERT embeddings with NPA.
Other Comments

FYI @Leavingseason

thanks for your replay @miguelgfierro,
did you mean that @Leavingseason can help? or what?