feat: Reset Password

🍰 Pullrequest
reset the password on the server.
PROBLEMS

it looks like you can receive a session_id via loginViaEmailVerificationCode only once per code. Is this on purpose?
We do not know the email at this point in the form.

Either the server sends also the email after successful login via verification code (better user experience)
or the user must type in the email again and we need an email field on password reset
or, the server finds the email by the verification code
or, we include the email in the link

How to test it:

Click on 'Forgot Password' on the login view
Enter a already registered email
check the table email_opt_in of gradido_login. email_opt_in_type_id should be 2
copy the verification code given in the table
navigate to: /reset/<verification_code>


Vuetify global components type are any

Repro :
npx nuxi@latest init my-app
npm i vuetify-nuxt-module -D
# add 'vuetify-nuxt-module' to nuxt modules

The type of any vuetify global components are any in the template.

in components.d.ts in GlobalComponents when we change
'VBtn': typeof import("../node_modules/vuetify/lib/components/VBtn/index")['VBtn']
to
'VBtn': typeof import("../node_modules/vuetify/lib/components/VBtn/index.d.mts")['VBtn']
or to 'VBtn': typeof import("vuetify/components")['VBtn']
The typing becomes correct on the template :

I tested this with npm and pnpm in wsl node 19.8.1 and on windows with node 18.12.1 both with vscode typescript and volar takeover mode.
If someone can reproduce this to confirm.

@pierresaid can you try with 0.4.10?
Tests with the playground after running nr dev:prepare:
Auto import:

VDialog is global:

It works awesome thanks !


Please sort the lists of sources alphabetically in each catory

https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-data-sources
Please sort the lists in each category alphabetically, to make it easier to locate specific entries without resorting to find feature, ie
68.	Adobe Analytics
69.	appFigures (Beta)
70.	Asana (Beta)
71.	Assemble Views
72.	Automation Anywhere
73.	Automy Data Analytics (Beta)
74.	Azure DevOps (Boards only)
75.	Azure DevOps Server (Boards only)
76.	Data.World - Get Dataset (Beta)
77.	Dynamics 365 (online)
78.	Dynamics 365 Business Central
79.	Dynamics 365 Business Central (on-premises)
80.	Dynamics 365 Customer Insights (Beta)
81.	Dynamics NAV
82.	Emigo Data Source
83.	Entersoft Business Suite (Beta)
84.	eWay-CRM
85.	FactSet Analytics
86.	GitHub (Beta)
87.	Google Analytics
88.	Hexagon PPM Smart API
89.	Industrial App Store
90.	Intune Data Warehouse (Beta)
91.	LinkedIn Sales Navigator (Beta)
92.	Marketo (Beta)
93.	Microsoft Exchange Online
94.	Mixpanel (Beta)
95.	Palantir Foundry
96.	Planview Enterprise One - CTM (Beta)
97.	Planview Enterprise One - PRM (Beta)
98.	Product Insights (beta)
99.	Projectplace for Power BI
100.	Quick Base
101.	QuickBooks Online (Beta)
102.	Salesforce Objects
103.	Salesforce Reports
104.	SharePoint Online List
105.	Smartsheet
106.	SoftOne BI (beta)
107.	SparkPost (Beta)
108.	Spigit (Beta)
109.	SweetIQ (Beta)
110.	TeamDesk (Beta)
111.	Twilio (Beta)
112.	Webtrends Analytics (Beta)
113.	Witivio (Beta)
114.	Workplace Analytics (Beta)
115.	Zendesk (Beta)
116.	Zoho Creator (Beta)
I made a copy of the page so I could sort the entries. I also numbered them just to get an easy count. Maybe simply add a count to the document. Being able to say that PQ in PBI can access 160 different data sources is "impressive".
.
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bb95c243-439b-5f81-51ae-c28efa0d22c3
Version Independent ID: 7e0c5adf-c752-4ebf-5022-e3bd64f3f8d3
Content: Data sources for Power BI - Power BI
Content Source: powerbi-docs/connect-data/service-get-data.md
Service: powerbi
Sub-service: pbi-data-sources
GitHub Login: @davidiseminger
Microsoft Alias: davidi

Thanks for your suggestion @ronssssss. Passing it on to the doc author for consideration.

That's a good idea - thanks!


Easier way to run commands from external component

I was wondering if there is an easier way to run commands from an external component?
Currently I have a button that provides the user the option to clear the terminal without having to type in the command. The code I am using to perform this is:
    this.instance.runCommand(this.instance.getChildContext().instances[0].instance, 'clear');

I think something more along the lines of:
    this.instance.runCommand('clear');

or
    this.instance.runCommand('clear', this.instance.currentTab);

where this.instance is a ref to the <Terminal /> instance.

runCommandOnActive will be added to the next version
runCommandOnActive('clear')

new version is out 4.0.0

Could someone give an example of how to use this? The function is not exposed as a prop so I have no idea how to access it. This also isn't included in the readme

@mkskitka,  Here an exapmle:
Define ref:
 <Terminal
        ref={(terminal) => { this.terminalObj = terminal; }}
        commands={{
            'my-cmd' : (args, print, runCommand) => {
                 print('hello  my-cmd !');
             }
         }}
   />

Use the ref :
this.terminalObj.runCommandOnActive('my-cmd')


Fixing an NPE in RetryingReadRowsOperation

This should fix #1492

Any timeline on when the snapshot/release will be available with this fix?


chore: Add benchamrks files for using as a demo

Copied over from services before removing index service

will split this out into another issue too

will split this out into another issue too

Okay mate.
@crookse maybe we don't need to revert and test previous versions of Drash. Maybe we just run current Drash against these benchmarks.


[Code Cleaning]: Use "HaveLen()" instead of "len(...).To(Equal(..)" in vm test

What this PR does / why we need it:
This small PR replaces all appearences of Expect(len(X)).To(Equal(Y)) to Expect(X).To(HaveLen(Y)) for better readability and error presentation.
Release note:

NONE

/retest

/lgtm


Execute the eslint immediately after the file changes.

Description
hello! I have an idea, that could I use lint-staged to test my code immediately instead  of waiting to commit it? so that I can fix my code as soon as possible.

You can try your luck with https://github.com/rizowski/eslint-watch. This question has very little to do with lint-staged. You should probably try to identify the solution in the context of eslint.

@sudo-suhas thanks!


chore: initialize Langium component

Closes partially #433.
Summary of Changes

Initialize Langium component with their Yeoman generator
Add a small excerpt of the grammar
Add test utils

🦙 MegaLinter status: ❌ ERROR

Descriptor
Linter
Files
Fixed
Errors
Elapsed time

✅ JSON
eslint-plugin-jsonc
7
0
0
1.08s

❌ JSON
jsonlint
7

1
0.18s

✅ JSON
npm-package-json-lint
yes

no
0.52s

✅ JSON
prettier
7
5
0
0.61s

✅ JSON
v8r
7

0
4.4s

✅ KOTLIN
ktlint
4
2
0
10.06s

✅ MARKDOWN
markdown-link-check
1

0
0.64s

✅ REPOSITORY
git_diff
yes

no
0.04s

❌ TYPESCRIPT
eslint
17
4
50
4.11s

✅ TYPESCRIPT
prettier
17
10
0
1.3s

See detailed report in MegaLinter reports
Set VALIDATE_ALL_CODEBASE: true in mega-linter.yml to validate all sources, not only the diff
MegaLinter is graciously provided by

:tada: This PR is included in version 0.2.0 :tada:
The release is available on:

Visual Studio Marketplace
GitHub release

Your semantic-release bot :package::rocket:


rusqlite 0.31.0

@ryanfowler can we please get a crates publishing of this lib with rusqlite-0.31.0?

Just published v0.3.0 that uses rusqlite 0.31.0 😄


[VS Code] Request was cancelled

Error:
Request was cancelled
Steps to Reproduce:

Version Data

extensionName
VSLS

extensionVersion
1.0.125

protocolVersion
2.2

applicationName
VSCode

applicationVersion
1.32.3

platformName
Linux

platformVersion
3.10.0-957.10.1.el7.x86_64

Thanks for reaching out. Can you give us more details on your issue? Did a retry fix the problem? Also, your logs may provide us with helpful information. You can access them via the Live Share: Export Logs command from the command palette (ctrl + shift + p) and attach them to this issue.

I am going to close this issue as it is not active. Also, it seems to be a duplicate of #469, so let's continue the conversation there if you still see this issue. Thanks for using LiveShare!


Pretrained weight problem

I used the pretained weight to test the sceneflow test set, it only get epe 0.57 (different from paper 0.54). Is that a different checkporint or is the problem of my cuda and torch version.
My environment: cuda11.8, torch2.3.1.

It is the same checkpoint as that used in the paper. I checked locally before uploading. Since the gap between 0.57 and 0.54 seem to be small, it may caused by version difference between torch 2.x and torch 1.x.

Thank you for your answer! I can get the same result after using the same version of pytorch.


NC bigwage single

NC bigwage single
http://taxsim.nber.org/out2psl/nc
Emulator has siitax of  47569, TaxAct says 46894.

This is due to the computation of the use tax which is $675 in this case - will be fixed by PR #88


feat: add blas/base/zcopy

Description

What is the purpose of this pull request?

This RFC proposes to add a routine to copy values from one complex double-precision floating-point vector to another complex double-precision floating-point vector as defined in BLAS Level 1 routines. Specifically adding @stdlib/blas/base/zcopy is proposed.
Related Issues

Does this pull request have any related issues?
None.

Questions

Any questions for reviewers of this pull request?

No.
Other

Any other information relevant to this pull request? This may include screenshots, references, and/or implementation notes.

No.
Checklist

Please ensure the following tasks are completed before submitting this pull request.

[x] Read, understood, and followed the contributing guidelines.

@stdlib-js/reviewers

@aman-095 Are you planning on adding the C and Fortran implementations in a follow-up PR? Or will you be adding them to this PR?

@kgryte I'll correct the implementation and yes I will add the C and Fortran implementation in this PR itself.

@aman-095 Great! Thanks!


Can I pass a precomputed value to AbslHashValue?

I could not find a chat, so I leave the question here:
I have a big collection of strings that I've calculated the hash for, at compile-time(using XXH3) - I've already checked(at compile-time) all of these for hash collisions.
Is there a way to avoid paying the cost of another hash(the internal CityHash) over my numbers?

Nope. The design intent of the Abseil hashing framework is to make it easy
to identify the values/bytes that go into a hash, without exposing users to
the details of calculating a hash (which they often get wrong or make
choices based on inaccurate information about how hash probing works).
If you've got compile-time constants for all of your hash values, I'm not
sure that Abseil hashes / hash containers are the right solution: it feels
like a Perfect Hash may be a better direction, but I don't know the precise
constraints on your problem.
On Tue, Dec 10, 2019 at 7:32 AM Lilian Anatolie Moraru <
<EMAIL_ADDRESS>wrote:

I could not find a chat, so I leave the question here:
I have a big collection of strings that I've calculated the hash for, at
compile-time(using XXH3) - I've already checked(at compile-time) all of
these for hash collisions.
Is there a way to avoid paying the cost of another hash(the internal
CityHash) over my numbers?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/abseil/abseil-cpp/issues/568?email_source=notifications&email_token=AC7CRX7ULMKDWLKVZSOT2QDQX6D45A5CNFSM4JY5XLTKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4H7OEILA,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC7CRXYX2IZ2HBD5TY2OFS3QX6D45ANCNFSM4JY5XLTA
.

I know that collection of strings at compile-time but there are a few more that are added/generated at run-time, which I cannot predict the hash for.
I use my custom type as a flat_hash_map Key, but I see that like any other map, I can pass a custom Hash(I was hoping I can avoid that, to make the life of the user easy), so I think will do that.
I was going the wrong route, thanks!

The concern is that the Abseil hash containers require a very particular
(very uniform, highly mixed) bit distribution for hashing. Replacing with
an arbitrary hash, especially one that is based on different assumptions
(prime table sizes, for instance) will result in extraordinarily bad
performance. So you certainly can replace the Hash, but you should do so
carefully and have good benchmarks.
On Tue, Dec 10, 2019 at 8:44 AM Lilian Anatolie Moraru <
<EMAIL_ADDRESS>wrote:

I know that collection of strings at compile-time but there are a few more
that are added/generated at run-time, which I cannot predict the hash for.
I use my custom type as a flat_hash_map Key, but I see that like any
other map, I can pass a custom Hash(I was hoping I can avoid that, to make
the life of the user easy), so I think will do that.
I was going the wrong route, thanks!
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/abseil/abseil-cpp/issues/568?email_source=notifications&email_token=AC7CRXY7JYQBIKWKGVA7GC3QX6MNXA5CNFSM4JY5XLTKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEGPIVTY#issuecomment-564038351,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC7CRX377KM3EGI6BFSLH3DQX6MNXANCNFSM4JY5XLTA
.


Cannot run any scan from Bluesky

In [23]: RE(count([sclr], num=1))
Transient Scan ID: 93098     Time: 2020-07-07 13:47:36
Persistent Unique Scan ID: 'ca142d2d-2438-4260-a22a-c409dc7a4af2'
New stream: 'baseline'

AttributeError                            Traceback (most recent call last)
~/.ipython/profile_collection/startup/97-standard-plans.py in
----> 1 RE(count([sclr], num=1))
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in call(self, *args, **metadata_kw)
751                     # it (unless it is a canceled error)
752                     if exc is not None:
--> 753                         raise exc
754
755             if self._interrupted:
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in _run(self)
1260             self._reason = str(err)
1261             self.log.exception("Run aborted")
-> 1262             raise err
1263         finally:
1264             # Some done_callbacks may still be alive in other threads.
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in _run(self)
1148                     else:
1149                         try:
-> 1150                             msg = self._plan_stack[-1].send(resp)
1151                         # We have exhausted the top generator
1152                         except StopIteration:
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in call(self, plan)
1292         plan = monitor_during_wrapper(plan, self.monitors)
1293         plan = baseline_wrapper(plan, self.baseline)
-> 1294         return (yield from plan)
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in baseline_wrapper(plan, devices, name)
1147         return (yield from plan)
1148     else:
-> 1149         return (yield from plan_mutator(plan, insert_baseline))
1150
1151
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
167                     continue
168                 else:
--> 169                     raise ex
170         # if inserting / mutating, put new generator on the stack
171         # and replace the current msg with the first element from the
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
120             ret = result_stack.pop()
121             try:
--> 122                 msg = plan_stack[-1].send(ret)
123             except StopIteration as e:
124                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in monitor_during_wrapper(plan, signals)
788     plan1 = plan_mutator(plan, insert_after_open)
789     plan2 = plan_mutator(plan1, insert_before_close)
--> 790     return (yield from plan2)
791
792
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
167                     continue
168                 else:
--> 169                     raise ex
170         # if inserting / mutating, put new generator on the stack
171         # and replace the current msg with the first element from the
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
120             ret = result_stack.pop()
121             try:
--> 122                 msg = plan_stack[-1].send(ret)
123             except StopIteration as e:
124                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
167                     continue
168                 else:
--> 169                     raise ex
170         # if inserting / mutating, put new generator on the stack
171         # and replace the current msg with the first element from the
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
120             ret = result_stack.pop()
121             try:
--> 122                 msg = plan_stack[-1].send(ret)
123             except StopIteration as e:
124                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in fly_during_wrapper(plan, flyers)
846     plan1 = plan_mutator(plan, insert_after_open)
847     plan2 = plan_mutator(plan1, insert_before_close)
--> 848     return (yield from plan2)
849
850
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
167                     continue
168                 else:
--> 169                     raise ex
170         # if inserting / mutating, put new generator on the stack
171         # and replace the current msg with the first element from the
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
120             ret = result_stack.pop()
121             try:
--> 122                 msg = plan_stack[-1].send(ret)
123             except StopIteration as e:
124                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
167                     continue
168                 else:
--> 169                     raise ex
170         # if inserting / mutating, put new generator on the stack
171         # and replace the current msg with the first element from the
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
120             ret = result_stack.pop()
121             try:
--> 122                 msg = plan_stack[-1].send(ret)
123             except StopIteration as e:
124                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/plans.py in count(detectors, num, delay, md)
65                                       num=num, delay=delay))
66
---> 67     return (yield from inner_count())
68
69
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/utils.py in dec_inner(*inner_args, **inner_kwargs)
1009                 plan = gen_func(*inner_args, **inner_kwargs)
1010                 plan = wrapper(plan, *args, **kwargs)
-> 1011                 return (yield from plan)
1012             return dec_inner
1013         return dec
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in stage_wrapper(plan, devices)
937         return (yield from plan)
938
--> 939     return (yield from finalize_wrapper(inner(), unstage_devices()))
940
941
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in finalize_wrapper(plan, final_plan, pause_for_debug)
498     cleanup = True
499     try:
--> 500         ret = yield from plan
501     except GeneratorExit:
502         cleanup = False
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in inner()
935     def inner():
936         yield from stage_devices()
--> 937         return (yield from plan)
938
939     return (yield from finalize_wrapper(inner(), unstage_devices()))
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/utils.py in dec_inner(*inner_args, **inner_kwargs)
1009                 plan = gen_func(*inner_args, **inner_kwargs)
1010                 plan = wrapper(plan, *args, **kwargs)
-> 1011                 return (yield from plan)
1012             return dec_inner
1013         return dec
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in run_wrapper(plan, md)
314         metadata to be passed into the 'open_run' message
315     """
--> 316     rs_uid = yield from open_run(md)
317
318     def except_plan(e):
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/plan_stubs.py in open_run(md)
711     :func:bluesky.plans_stubs.close_run
712     """
--> 713     return (yield Msg('open_run', **(md or {})))
714
715
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
75             # if we have a stashed exception, pass it along
76             try:
---> 77                 msg = plan_stack[-1].throw(exception)
78             except StopIteration as e:
79                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/utils.py in single_gen(msg)
134         the input message
135     '''
--> 136     return (yield msg)
137
138
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
192         try:
193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
195         except GeneratorExit:
196             # special case GeneratorExit.  We must clean up all of our plans
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
192         try:
193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
195         except GeneratorExit:
196             # special case GeneratorExit.  We must clean up all of our plans
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
75             # if we have a stashed exception, pass it along
76             try:
---> 77                 msg = plan_stack[-1].throw(exception)
78             except StopIteration as e:
79                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/utils.py in single_gen(msg)
134         the input message
135     '''
--> 136     return (yield msg)
137
138
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
192         try:
193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
195         except GeneratorExit:
196             # special case GeneratorExit.  We must clean up all of our plans
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
192         try:
193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
195         except GeneratorExit:
196             # special case GeneratorExit.  We must clean up all of our plans
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
75             # if we have a stashed exception, pass it along
76             try:
---> 77                 msg = plan_stack[-1].throw(exception)
78             except StopIteration as e:
79                 # discard the exhausted generator
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/plan_stubs.py in trigger_and_read(devices, name)
800     from .preprocessors import rewindable_wrapper
801     return (yield from rewindable_wrapper(inner_trigger_and_read(),
--> 802                                           rewindable))
803
804
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in rewindable_wrapper(plan, rewindable)
678                                             restore_rewindable()))
679     else:
--> 680         return (yield from plan)
681
682
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/plan_stubs.py in inner_trigger_and_read()
796             if reading is not None:
797                 ret.update(reading)
--> 798         yield from save()
799         return ret
800     from .preprocessors import rewindable_wrapper
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/plan_stubs.py in save()
55     :func:bluesky.plan_stubs.create
56     """
---> 57     return (yield Msg('save'))
58
59
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
192         try:
193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
195         except GeneratorExit:
196             # special case GeneratorExit.  We must clean up all of our plans
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in _run(self)
1206                         # exceptions (coming in via throw) can be
1207                         # raised
-> 1208                         new_response = yield from coro(msg)
1209
1210                     # special case CancelledError and let the outer
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in _save(self, msg)
1715                    time=ttime.time(), data=data, timestamps=timestamps,
1716                    seq_num=seq_num, uid=event_uid, filled=filled)
-> 1717         yield from self.emit(DocumentNames.event, doc)
1718         self.log.debug("Emitted Event with data keys %r (uid=%r)", data.keys(),
1719                        event_uid)
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/asyncio/coroutines.py in coro(*args, **kw)
118         @functools.wraps(func)
119         def coro(*args, **kw):
--> 120             res = func(*args, **kw)
121             if (base_futures.isfuture(res) or inspect.isgenerator(res) or
122                     isinstance(res, CoroWrapper)):
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in emit(self, name, doc)
2319         "Process blocking callbacks and schedule non-blocking callbacks."
2320         schema_validators[name].validate(doc)
-> 2321         self.dispatcher.process(name, doc)
2322
2323
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/run_engine.py in process(self, name, doc)
2339         doc : dict
2340         """
-> 2341         exceptions = self.cb_registry.process(name, name.name, doc)
2342         for exc, traceback in exceptions:
2343             warn("A %r was raised during the processing of a %s "
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/utils.py in process(self, sig, *args, **kwargs)
332             for cid, func in list(self.callbacks[sig].items()):
333                 try:
--> 334                     func(*args, **kwargs)
335                 except ReferenceError:
336                     self._remove_proxy(func)
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/utils.py in call(self, *args, **kwargs)
413             mtd = self.func
414         # invoke the callable and return the result
--> 415         return mtd(*args, **kwargs)
416
417     def eq(self, other):
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/event_model/init.py in call(self, name, doc, validate)
69             instance as doc, a copy of doc, or a different dict altogether.
70         """
---> 71         output_doc = getattr(self, name)(doc)
72         if validate:
73             schema_validators[DocumentNames.name].validate(output_doc)
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/event_model/init.py in event(self, doc)
88     def event(self, doc):
89         event_page = pack_event_page(doc)
---> 90         output_event_page = self.event_page(event_page)
91         # Subclass' implementation of event_page may return a valid EventPage
92         # or None.
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/event_model/init.py in event_page(self, doc)
231         descriptor_uid = doc['descriptor']
232         for callback in self._factory_cbs_by_descriptor[descriptor_uid]:
--> 233             callback('event_page', doc)
234         for callback in self._subfactory_cbs_by_descriptor[descriptor_uid]:
235             callback('event_page', doc)
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/callbacks/best_effort.py in call(self, name, doc)
91             return
92
---> 93         super().call(name, doc)
94
95     def start(self, doc):
/opt/conda_envs/collection-2019-3.0-six/lib/python3.7/site-packages/bluesky/callbacks/core.py in call(self, name, doc)
15     def call(self, name, doc):
16         "Dispatch to methods expecting particular doc types."
---> 17         return getattr(self, name)(doc)
18
19     def event(self, doc):
AttributeError: 'BestEffortCallback' object has no attribute 'event_page'

Seconding @mrakitin's comment from email

It is strange this issue came up as you are running the same conda environment as in the last cycle, and we didn’t touch it. Was any library updated under us?

can you confirm the current versions of bluesky and event_model, like:
import bluesky, event_model
bluesky.__version__
event_model.__version__

Hi All,
Thanks for your emails.
To  the  best of my knowledge, no library was updated in these locked-down months.
Regarding the version numbers:
bluesky.version • 1.5.3
event_model.version • 1.10.0
Thanks,
Valentina
From: Dan Allan<EMAIL_ADDRESS>Reply-To: NSLS-II/Bug-Reports<EMAIL_ADDRESS>Date: Tuesday, July 7, 2020 at 2:57 PM
To: NSLS-II/Bug-Reports<EMAIL_ADDRESS>Cc: "Bisogni, Valentina"<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [NSLS-II/Bug-Reports] Cannot run any scan from Bluesky (#205)
Seconding @mrakitinhttps://github.com/mrakitin's comment from email
It is strange this issue came up as you are running the same conda environment as in the last cycle, and we didn’t touch it. Was any library updated under us?
can you confirm the current versions of bluesky and event_model, like:
import bluesky, event_model
bluesky.version
event_model.version
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/NSLS-II/Bug-Reports/issues/205#issuecomment-655058473, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AF2TZRU3SCOERT4TVTQVZQTR2NV25ANCNFSM4OTFGK4Q.

Thank you, Valentina. I just double-checked the versions of the packages in the environment, and they match the expected ones:
$ conda activate /opt/conda_envs/collection-2019-3.0-six
$ conda list
...
bluesky                   1.5.3                    py37_1    nsls-ii-2019C3.0
...
event-model               1.10.0                   py37_0    nsls-ii-2019C3.0

Thanks.
Do you have any suggestion for any check I can do?
I only have today at the beamline for the next two weeks. I manually propagated the beam down the detector, but I need to do scans in order to refine things and measure. So, currently I am stuck.
Thanks.
Valentina
From: Maksim Rakitin<EMAIL_ADDRESS>Reply-To: NSLS-II/Bug-Reports<EMAIL_ADDRESS>Date: Tuesday, July 7, 2020 at 4:00 PM
To: NSLS-II/Bug-Reports<EMAIL_ADDRESS>Cc: "Bisogni, Valentina"<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [NSLS-II/Bug-Reports] Cannot run any scan from Bluesky (#205)
Thank you, Valentina. I just double-checked the versions of the packages in the environment, and they match the expected ones:
$ conda activate /opt/conda_envs/collection-2019-3.0-six
$ conda list
...
bluesky                   1.5.3                    py37_1    nsls-ii-2019C3.0
...
event-model               1.10.0                   py37_0    nsls-ii-2019C3.0
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/NSLS-II/Bug-Reports/issues/205#issuecomment-655095335, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AF2TZRXDTID6JC4VENXFV63R2N5F3ANCNFSM4OTFGK4Q.

This was resolved by using the newer conda environment (collection-2020-1.0rc1), which was used for testing the changes to profile_collection to support multiple runs (https://github.com/NSLS-II-SIX/profile_collection/pull/26).


Failing test for dcerpc last response not logged

This test should ideally pass as there exists a request response pair for call ID of 20.

Fixed by https://github.com/OISF/suricata/commit/9f9c29a14a91f86c1bda92285e876e026dc9e3a4


createEffect is not showing isRouting state

when i am trying to get isRouting status i am only getting false even if routing from Home page to about page
MainLayout.jsx
export default function MainLayout() {
  const isRouting = useIsRouting();

  createEffect(() => console.log(isRouting()));
  return (
    <div>
      <Navbar />
      <main className="py-14">
          <Show when={!isRouting()} fallback={<Loader />}>
            <Outlet />
          </Show>
      </main>
    </div>
  );
}

App.jsx
 <Routes>
      <Route path="/" element={<MainLayout />}>
        <Route path="" element={<Home />} />
        <Route path="about" element={<About />} />
      </Route>
 </Routes>

The isRouting hook just exposes Solid's transition pending signal. This means it will only change when the navigation event causes a concurrent transition to go pending which requires a resource to be read within a suspense boundary. The primary use case for this hook is to toggle a loading indicator while a navigation is suspended because of a resource is blocking. In your example, the navigation happens completely synchronously and there is no transition period.

can you show me some simple  working example  ?

Here is an example that might help: https://codesandbox.io/s/solid-app-router-92-y044lc

@rturnq thanks now i am able to integrate.

Seems useIsRouting() doesn't have reactivity.
This is my trick to show nprogress on navigating.
function Loader() {
    const location = useLocation()
    const [path, setPath] = createSignal(location.pathname)

    const Progress = () => {
        onMount(() => {
            nProgress.start()
            setPath(location.pathname)
        })
        onCleanup(() => {
            nProgress.done()
        })
        return <></>
    }

    // Validate with pathname
    return <Show when={location.pathname !== path()}><Progress /></Show>
}

Seems useIsRouting() doesn't have reactivity. This is my trick to show nprogress on navigating.
export default function Loader() {
    const location = useLocation()
    const [path, setPath] = createSignal(location.pathname)

    const Progress = () => {
        if (!isServer) {
            nProgress.start()
        }

        onMount(async () => {
            nProgress.done()
            setPath(location.pathname)
        })

        return <></>
    }

    // Validate with pathname
    return <Show when={location.pathname !== path()}><Progress /></Show>
}

I am just using useLocation as a signal seems to work fine

I am just using useLocation as a signal seems to work fine

Yesh, now it has true reactivity.


Unify order of output

Currently, there are many different ways the json output is ordered in different tools (csaf-validator-lib, csaf-validator-service, csaf_validator).

When this is done, we also need to update the documentation and the TOC in the README

The preferred output should use the order:
   {
      "errors": [],
      "warnings": [],
      "infos": [],
      "isValid": true,
      "name": "informativeTest_6_3_9"
    }

Originally posted by @tschmidtb51 in https://github.com/secvisogram/csaf-validator-lib/issues/88#issuecomment-1470038086


Test

Documentation is missing.

BUG: Please provide more details.

Documentation is missing.

BUG: Please provide more details.


Files deleted on probing stage aren't included in reports

Expected Behavior
When a file is deleted during probing, it should appear in the slim version of the image. Deleting a file means access, and that automatically should qualify the file as used.

Actual Behavior
When some files are deleted during probing, they aren't included in the creport.json file and the files folder. It happens because the artifact dumping logic fails to copy those files. Preserving files also don't mitigate the issue because that same logic iterates over the preserved files, but tries to check the existence of the original files too (and fails).

Steps to Reproduce the Problem

Here is a (skipped for now) E2E test

Specifications

Version: 1.37+
Platform: All

Good that we just need the file name... We have it in the initial file list that the agent collects before kicking off the target app.


Contradicting comments removed

@talumbau : Your comment is handled now, Thanks!

Can one of the admins verify this patch?

@talumbau Can you please take a look on this PR? Thanks!


Can MAZTER-mine code be applied to small RNA-seq data?

Dear Miguel,
I am using MAZTER-mine code to analyze my RNA fragment which was digested by mazF.
It was really interesting to analyze your tutorial data with these computational pipelines - bam2ReadEnds.R and mazter_mine.R. Now, I'm trying to analyze my data - especially small RNA libraries which was constructed by SMARTer smRNA-Seq Kit for Illumina - with the help of your code.
I'm afraid I'm not sure my data satisfies the required form of your Input Library.
My library was processed from other lab, and it is paired-end data, the read length is 101 bp but I performed adapter trimming and the processed read length is about 15 ~ 98 bp - RNA fragments digested by mazF.
When I tried to apply this trimmed data to your bam2ReadEnds.R code, it didn't make R data appropriate for mazter_mine.R because the size of RData output was too small - maybe it's because my data doesn't match for the exon block created by the exonBlockGen function in bam2ReadEnds.R.
I thought this could be the problem during STAR alignment because there were too many unmapped reads because of the small size of smRNA data. So I added some STAR parameters recommended for smRNA analysis (--outFilterMismatchNoverLmax 0.05 --outFilterMatchNmin 16 --outFilterScoreMinOverLread 0 --outFilterMatchNminOverLread 0), and I got many uniquely mapped reads.
But when I applied this reads to the bam2ReadEnds.R code, the results were similar to previous output. This didn't match for the exon block and got really small sized RData.
I think this would be silly question for you, but could you please help me apply this smRNA data for your code?
Thank you very much,
Sincerly,
Seoyeon

Hello Seoyen.
Could you please provide me the files and code to reproduce your analysis.
Without it is hard to understand what may be the problem.
I would need mainly from the bam files onward. After alignment
Best
On Tue, Jun 15, 2021 at 4:47 PM Seoyeon Kim @.***>
wrote:

Dear Miguel,
I am using MAZTER-mine code to analyze my RNA fragment which was digested
by mazF.
I'm new to bioinformatics and this is first time making issues on github,
so I hope this issue doesn't bother you..
It was really interesting to analyze your tutorial data with these
computational pipelines - bam2ReadEnds.R and mazter_mine.R. Now, I'm trying
to analyze my data - especially small RNA libraries which was constructed
by SMARTer smRNA-Seq Kit for Illumina - with the help of your code.
I'm afraid I'm not sure my data satisfies the required form of your Input
Library.
My library was processed from other lab, and it is paired-end data, the
read length is 101 bp but I performed adapter trimming and the processed
read length is about 15 ~ 98 bp - RNA fragments digested by mazF.
When I tried to apply this trimmed data to your bam2ReadEnds.R code, it
didn't make R data appropriate for mazter_mine.R because the size of RData
output was too small - maybe it's because my data doesn't match for the
exon block created by the exonBlockGen function in bam2ReadEnds.R.
I thought this could be the problem during STAR alignment because there
were too many unmapped reads because of the small size of smRNA data. So I
added some STAR parameters recommended for smRNA analysis (--outFilterMismatchNoverLmax
0.05 --outFilterMatchNmin 16 --outFilterScoreMinOverLread 0
--outFilterMatchNminOverLread 0), and I got many uniquely mapped reads.
But when I applied this reads to the bam2ReadEnds.R code, the results were
similar to previous output. This didn't match for the exon block and got
really small sized RData.
I think this would be silly question for you, but could you please help me
apply this smRNA data for your code?
Thank you very much,
Sincerly,
Seoyeon
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/SchwartzLab/mazter_mine/issues/6, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACHMOKJGBXBWXX4MNGVSHQDTS5KY5ANCNFSM46XJ7NBA
.

--
Miguel Angel García Campos
Website https://angelcampos.github.io/ | Twitter
https://twitter.com/GarciaCamposM | GScholar
https://scholar.google.com/citations?user=-J7nzzcAAAAJ&hl | Instagram
https://www.instagram.com/garciacampos_m/
PhD candidate at the SchwartzLab
https://www.weizmann.ac.il/molgen/Schwartz/, Molecular Genetics
Department, Weizmann Institute of Science.

Hello Miguel,
Thanks for your reply. I uploaded the data on dropbox and here is the link -
This is a small RNA data from human U2OS cell mRNA digested by mazF RNase
and the library was constructed by SMARTer smRNA-Seq Kit for Illumina.
I trimmed all the adapter sequences included in the fastq.gz file and due to the small size of reads after trimming,
I performed STAR alignment with following parameters. And among these the parameters that I mentioned on the first message was the ones recommended by Alex Dobin for the small sized RNAs.
--outFilterMismatchNoverLmax 0.05 \
--outFilterMatchNmin 16 \
--outFilterScoreMinOverLread 0 \
--outFilterMatchNminOverLread 0 \
-–alignIntronMax 300 \
-–alignMatesGapMax 1000 \
--outSAMunmapped Within \
--quantMode TranscriptomeSAM GeneCounts \
--runThreadN 8 \
--twopassMode Basic

After getting bam file, I ran the bam2ReadEnds.R code with hg38 v32 BED file. The code made some outputs, but the RData output was too small to be used in mazter_mine.R code.
When I run the bam2ReadEnds.R code line by line, I found out that some problems are associated with pairEndReadsToGenes function - because the reads weren't seemd to be matched properly with exon blocks made from gene annotation file.
I wonder why the reads couldn't make enough match with the annotation data.
Thanks again for making mazter_mine pipeline and for your help.
Please let me know f there's anything else I should do.
Sincerly,
Seoyeon

I'm trying to load the file into different programs, namely R, IGV, and
samtools, and I'm having trouble.
At the very least it should be sortable and indexable using samtools, but
it seems that is not even possible.
This command was not able to sort the file:
samtools sort U2OS2-9_output_20210612Aligned.out.bam -o
U2OS2-9_output_20210612Aligned.sorted.out.bam @.***
It should be possible to sort it and indexed with the following commands:
samtools sort U2OS2-9_output_20210612Aligned.out.bam -o
U2OS2-9_output_20210612Aligned.sorted.out.bam @.***
samtools index U2OS2-9_output_20210612Aligned.sorted.out.bam
Can you please check the file and/or create it again and send it back
sorted and the index file along?
The BED file that you used for gene annotation would be also be of help
PS: Could you make a double-check that your gene annotation corresponds to
the genome you are aligning to. From the problem you mentioned it could be
that that is the problem.
On Tue, Jun 15, 2021 at 7:30 PM Seoyeon Kim @.***>
wrote:

Hello Miguel,
Thanks for your reply. I uploaded the data on dropbox and here is the link
https://www.dropbox.com/s/87kxkbhxe7r5qdn/U2OS2-9_output_20210612Aligned.out.bam?dl=0
This is a small RNA data from human U2OS cell mRNA digested by mazF RNase
and the library was constructed by SMARTer smRNA-Seq Kit for Illumina.
I trimmed all the adapter sequences included in the fastq.gz file and due
to the small size of reads after trimming,
I performed STAR alignment with following parameters. And among these the
parameters that I mentioned on the first message was the ones recommended
by Alex Dobin for the small sized RNAs.
--outFilterMismatchNoverLmax 0.05 \
--outFilterMatchNmin 16 \
--outFilterScoreMinOverLread 0 \
--outFilterMatchNminOverLread 0 \
-–alignIntronMax 300 \
-–alignMatesGapMax 1000 \
--outSAMunmapped Within \
--quantMode TranscriptomeSAM GeneCounts \
--runThreadN 8 \
--twopassMode Basic
After getting bam file, I ran the bam2ReadEnds.R code with hg38 v32 BED
file. The code made some outputs, but the RData output was too small to be
used in mazter_mine.R code.
When I run the bam2ReadEnds.R code line by line, I found out that some
problems are associated with pairEndReadsToGenes function - because the
reads weren't seemd to be matched properly with exon blocks made from gene
annotation file.
I wonder why the reads couldn't make enough match with the annotation data.
Thanks again for making mazter_mine pipeline and for your help.
Please let me know f there's anything else I should do.
Sincerly,
Seoyeon
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/SchwartzLab/mazter_mine/issues/6#issuecomment-861649787,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACHMOKKOCXFUN3HZBVJV2ZTTS552HANCNFSM46XJ7NBA
.

--
Miguel Angel García Campos
Website https://angelcampos.github.io/ | Twitter
https://twitter.com/GarciaCamposM | GScholar
https://scholar.google.com/citations?user=-J7nzzcAAAAJ&hl | Instagram
https://www.instagram.com/garciacampos_m/
PhD candidate at the SchwartzLab
https://www.weizmann.ac.il/molgen/Schwartz/, Molecular Genetics
Department, Weizmann Institute of Science.

Dear Miguel,
I really appreciate for your help.
After receiving your reply, I've been recreating and sorting my bam files, and I found out that there might be some problem in STAR alignment when I used my data as paired-end reads.
All of my reads (Read1 and Read2) are almost exactly overlap, maybe this is because my data is small RNA-seq data.
The overlapping mates were causing low mappability, and aligning data with only Read1 indeed resulted in a much better mappability.
This appears to be the cause of generating too small and inappropriate RData after running bam2ReadEnds.R code.
But I found out that your mazter_mine pipeline requires paired-end reads, so I would like to ask you if I could apply single end data for your mazter_mine pipeline. I would like to know if I can apply my data as singled-end reads for mazter_mine pipeline.
Thank you for reading my post, and hope you have a good day.
Sincerly,
Seoyeon

Good to hear you made some progress trouble shooting your data. Sorry to
not come back sooner, I've been busy. I'm reaching the end of my PhD.
The problem with mapping only read1 is that the end of the fragment is not
mapped correctly. The whole pipeline is built considering an RNA-seq
library that will be paired-end sequenced with strand awareness, this is,
all the sequences are in principle in the same sense as the original
transcript and not as the reverse complement, which would happen in
non-strand-aware RNA-seq. These requirements are needed for the pipeline to
work correctly.
About the removal of adapters I didnt use any adapter removal. It may be
part from the preprocessing that the RNAseq unit does automatically when we
give them the sequences of our adapters. But as STAR can soft-clip having
adapter sequences should in principle not be a problem when using STAR.
Another way for controling for this is checking if you have rthose
sequences with FASTQC and remove them with Trim Galore.
Hope you manage to align your data.
Best
Miguel Angel García Campos
PhD candidate at the SchwartzLab, Molecular Genetics Department, Weizmann
Institute of Science.
On Tue, Jun 22, 2021, 19:41 Seoyeon Kim @.***> wrote:

Dear Miguel,
I really appreciate for your help.
After receiving your reply, I've been recreating and sorting my bam files,
and I found out that there might be some problem in STAR alignment when I
used my data as paired-end reads.
All of my reads (Read1 and Read2) are almost exactly overlap, maybe this
is because my data is small RNA-seq data.
The overlapping mates were causing low mappability, and aligning data with
only Read1 indeed resulted in a much better mappability.
This appears to be the cause of generating too small and inappropriate
RData after running bam2ReadEnds.R code.
But I found out that your mazter_mine pipeline requires paired-end reads,
so I would like to ask you if I could apply single end data for your
mazter_mine pipeline. I would like to know if I can apply my data as
singled-end reads for mazter_mine pipeline.
Thank you for reading my post, and hope you have a good day.
Sincerly,
Seoyeon
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/SchwartzLab/mazter_mine/issues/6#issuecomment-866151085,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACHMOKMAXZAHZDQTRL5NGUDTUC4MPANCNFSM46XJ7NBA
.


FindInBatches over Offset instead of Primary Key increments

Actually find in Batches works using the primary key as an increment, so it assumes that the Batch is sorted with the PrimaryKey, which means that it will fail if the query contains any other Sort attribute.

I suggest to use the "offset" clause in order to iterate. Here is a suggestion of such a replacement function (I could do a Pull Request but I'm not comfortable with it on my current environment) :
// FindInBatches find records in batches
func (db *gorm.DB) FindInBatch(dest interface{}, batchSize int, fc func(tx *gorm.DB, batch int) error) *gorm.DB {
	var (
		tx = db.Session(&gorm.Session{})
		queryDB      = tx
		rowsAffected int64
		batch        int
	)

	for {
		result := queryDB.Limit(batchSize).Offset(batch*batchSize).Find(dest)
		rowsAffected += result.RowsAffected
		batch++

		if result.Error == nil && result.RowsAffected != 0 {
			tx.AddError(fc(result, batch))
		} else if result.Error != nil {
			tx.AddError(result.Error)
		}

		if tx.Error != nil || int(result.RowsAffected) < batchSize {
			break
		}
	}

	tx.RowsAffected = rowsAffected
	return tx
}

The motivation is to get a more universal (and more simple function), but I probably miss out something (like Offset clause not being available on all SQL databases?).

I ended up doing a PR :)

i see that the PR was closed and the changes weren't merged. is there a way to override the function and not use the primary key in the order by clause?


Scroll-to-top feature on iOS is blocking touches

The scroll-to top-feature of Scaffold on iOS is blocking/consuming touches, even when there is no main scroll view attached to the Scaffold. This is an issue when creating a custom header for the Scaffold which may include custom widgets (like buttons etc).
The code that needs a small fix is in scaffold.dart.
Perhaps only add the GestureDetector if _primaryScrollController.hasClients.
    if (themeData.platform == TargetPlatform.iOS) {
      _addIfNonNull(
        children,
        new GestureDetector(
          behavior: HitTestBehavior.opaque,
          onTap: _handleStatusBarTap,
          // iOS accessibility automatically adds scroll-to-top to the clock in the status bar
          excludeFromSemantics: true,
        ),
        _ScaffoldSlot.statusBar,
        removeLeftPadding: false,
        removeTopPadding: true,
        removeRightPadding: false,
        removeBottomPadding: true,
      );
    }

@cbracken can likely provide more details

I've added a test case here: https://github.com/vlidholt/flutter_bugs

@rockingdice Quick fix is to comment out the code in material/scaffold.dart that adds the gesture detector at the top of the screen.

@vlidholt thank you, I fix it in your way and it's working now.

As a reminder, I still find these codes in the latest code (master channel). I don't know if this issue is fixed or not. I have to keep the codes commented.

Hi @vlidholt
Are you still experiencing this issue on latest stable?
If so, can you please provide your flutter doctor -v and flutter run --verbose? Also, to better address the issue, would be helpful
if you could post a minimal code sample to reproduce the problem
Thank you

Without additional information, we are unfortunately not sure how to resolve this issue. We are therefore reluctantly going to close this bug for now. Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.
Could everyone who still has this problem please file a new issue with the exact descriptions what happens, logs and the output of 'flutter doctor -v'  please.
All system setups can be slightly different so it's always better to open new issues and reference related issues.


Pipeline refactor: Remove elasticsearch

Remove the use of elastic search in pipeline process steps.
To be process overview with ES feeds attached.

We need to review which indexes are actually used by the API, and which are used by subsequent pipeline stages

Decision taken to close most associated issues based upon low priority and value at this point in platform refactor.
Pending further strategic decisions on use of ES and Graph DB and plans around move to GraphQL.


The reset() method is triggering on change event and causing an infinite loop when used on certain contexts

The reset() method triggers the change event and causes an infinite loop when used for instance inside the change event listener.
An example can be simulated in this codepen and here's what happening:

Fixed in release v1.0.43.


M_PI not defined

make
gcc -Iinclude -Wall -O3 -std=c99 -c src/histogram_grid.c -o histogram_grid.o
src/histogram_grid.c: In function ‘grid_update’:
src/histogram_grid.c:56:64: error: ‘M_PI’ undeclared (first use in this function); did you mean ‘__P’?
int new_x = pos_x + (int) floor(cells * cos(data.direction * M_PI / 180));
^~~~
__P
src/histogram_grid.c:56:64: note: each undeclared identifier is reported only once for each function it appears in
Makefile:12: recipe for target 'histogram_grid.o' failed
make: *** [histogram_grid.o] Error 1

Hi @spkadam, thanks for reporting this bug. I haven't been taking care of this codebase as I should... :)
I believe I fixed this issue with f2fe008.


feat: Track Emergency Button Usage

closes: #163

design

Assume Number of Emergency button for each player as 1 (because over 2 is very very rare.)

what I couldn't do

Electron Layout

could not run on my machine because electron-overlay-window does not work

Awesome thank you, I will be reviewing it this weekend and hopefully releasing it this weekend also. Hope you do not mind if end up changing some stuff around.
I want to thank you for constantly updating the Japanese translations and adding this. I really appreciate your contribution.


Use atom-message-panel

Thinking it might be nice to use https://github.com/tcarlsen/atom-message-panel

Thanks for the suggestion. Is it animated?

I don't really understand what you mean by animated but I'll try and give you and answer.
It animates when toggling between fold and unfold and there's a fast animation when closing the panel.
But I believe you're referring to your animated icon when meteor is working. This should be as easy as just setting the title to raw html with an animated icon when you wan't to show an animated gear and then setting the title to the original title with the static meteor logo when there's no work being done.
There's still some work needed from the package, i.e. states to easier check if panel is hidden or shown but it's coming. The nice thing about it is the more packages using it the more unified the look and feel of addon packages panels will be.

Sounds nice. I like the unified look and I would like to make Atom more "animated". I'll definitely have a look into it. Thanks again.


Using splash.gif

Is this possible to use an animated file such as splash.gif instead of splash.png ?

did you used it ?


Maintain platform subaccounts and SAP Web IDE permissions

"Step 7: Give SAP Web IDE access to everyone" has changed
"Step 7: Give SAP Web IDE access"
To enable users to work with Web IDE you have to explicitly assign the DiDeveloper Role to each of them.

Go to Roles
Select DiDeveloper Role
Press Assign in the role's section for individual users. A pop up opens.
Enter the required User's ID
Press Assign in the pop up

Done in QA

@mervey45 @Liebherr Is this issue resolved?

resolved by the big last changes


add headers to *.textproto

fix https://github.com/CycloneDX/specification/issues/392

used to automated mod: (fish shell syntax)
for f in *.textproto; mv "$f" "$f".o; and echo -e '# proto-file: schema/bom-1.6.proto\n# proto-message: Bom\n' > "$f"; and cat "$f".o >> "$f"; and rm "$f".o;  end


[wasi-nn] Got unexpected results when running tflite_birds_v1_image example

If compared with the expected result from wasmedge, got a different result when running a tflite_birds_v1_image with iwasm.
The expected result:
 '1.) [166](198)Aix galericulata',
 '2.) [158](2)Coccothraustes coccothraustes',
 '3.) [34](1)Gallus gallus domesticus',
 '4.) [778](1)Sitta europaea',
 '5.) [819](1)Anas platyrhynchos'

WAMR result:
 '1.) [526](136)Cathartes burrovianus',
 '2.) [482](128)Turdus plumbeus',
 '3.) [590](128)Anous stolidus',
 '4.) [614](128)Buteogallus anthracinus',
 '5.) [826](128)Anas clypeata'

@tonibofarull Would mind taking a look at it? Even debugging suggestions are helpful.

Log:
$ pwd
somewhere/WasmEdge-WASINN-examples/tflite-birds_v1-image

$ somewhere/wasm-micro-runtime/product-mini/platforms/linux/build/iwasm --native-lib=somewhere/wasm-micro-runtime/product-mini/platforms/linux/build/libwasi-nn-tflite.so --map-dir=.:. ./wasmedge-wasinn-example-tflite-bird-image.wasm ./lite-model_aiy_vision_classifier_birds_V1_3.tflite bird.jpg

Read graph weights, size in bytes: 3561598
[wasi_nn.c:194 DEBUG] Running wasi_nn_load [encoding=4, target=0]...
[wasi_nn_app_native.c:54 DEBUG] Graph builder array contains 1 elements
[wasi_nn_app_native.c:90 DEBUG] Graph builder 0 contains 3561598 elements
[wasi_nn.c:82 DEBUG] Initializing wasi-nn context
[wasi_nn_tensorflowlite.cpp:446 DEBUG] Initializing models.
[wasi_nn_tensorflowlite.cpp:451 DEBUG] Initializing interpreters.
[wasi_nn.c:136 DEBUG] Returning ctx
[wasi_nn.c:225 DEBUG] wasi_nn_load finished with status 0 [graph=0]
[wasi_nn.c:277 DEBUG] Running wasi_nn_init_execution_context [graph=0]...
[wasi_nn.c:136 DEBUG] Returning ctx
INFO: Initialized TensorFlow Lite runtime.
[wasi_nn_tensorflowlite.cpp:278 WARNING] Default encoding is CPU.
[wasi_nn.c:298 DEBUG] wasi_nn_init_execution_context finished with status 0 [ctx=0]
Loaded graph into wasi-nn with ID: Graph#0
Read input tensor, size in bytes: 150528
[wasi_nn.c:308 DEBUG] Running wasi_nn_set_input [ctx=0, index=0]...
[wasi_nn.c:136 DEBUG] Returning ctx
[wasi_nn_app_native.c:166 DEBUG] Converting tensor_wasm to tensor
[wasi_nn_app_native.c:158 DEBUG] Number of dimensions: 4
[wasi_nn_app_native.c:186 DEBUG] Dimension 0: 1
[wasi_nn_app_native.c:186 DEBUG] Dimension 1: 224
[wasi_nn_app_native.c:186 DEBUG] Dimension 2: 224
[wasi_nn_app_native.c:186 DEBUG] Dimension 3: 3
[wasi_nn_app_native.c:188 DEBUG] Tensor type: 2
[wasi_nn_app_native.c:189 DEBUG] Total number of elements: 150528
[wasi_nn_tensorflowlite.cpp:296 DEBUG] Number of tensors (1)
[wasi_nn_tensorflowlite.cpp:343 DEBUG] input tensor: (scale, offset) = (0.007812, 128.000000)
[wasi_nn.c:334 DEBUG] wasi_nn_set_input finished with status 0
[wasi_nn.c:341 DEBUG] Running wasi_nn_compute [ctx=0]...
[wasi_nn.c:136 DEBUG] Returning ctx
[wasi_nn.c:355 DEBUG] wasi_nn_compute finished with status 0
[wasi_nn.c:371 DEBUG] Running wasi_nn_get_output [ctx=0, index=0]...
[wasi_nn.c:136 DEBUG] Returning ctx
[wasi_nn_tensorflowlite.cpp:381 DEBUG] Number of tensors (1)
[wasi_nn_tensorflowlite.cpp:424 DEBUG] output tensor: (scale, offset) = (0.003906, 0.000000)
[wasi_nn.c:399 DEBUG] wasi_nn_get_output finished with status 0 [data_size=965]
   1.) [526](136)Cathartes burrovianus
   2.) [482](128)Turdus plumbeus
   3.) [590](128)Anous stolidus
   4.) [614](128)Buteogallus anthracinus
   5.) [826](128)Anas clypeata
[wasi_nn.c:463 DEBUG] --|> deinit_native_lib
[wasi_nn.c:148 DEBUG] Freeing wasi-nn
[wasi_nn.c:149 DEBUG] -> is_model_loaded: 1
[wasi_nn.c:150 DEBUG] -> current_encoding: 4
[wasi_nn_tensorflowlite.cpp:475 DEBUG] Freeing memory.
[wasi_nn_tensorflowlite.cpp:513 DEBUG] Memory free'd.

Hi, which commit of WAMR are you using?
Can it be because of https://github.com/bytecodealliance/wasm-micro-runtime/pull/3530#discussion_r1639662614 or are you using WASM_ENABLE_WASI_EPHEMERAL_NN=0?
Thanks!

It could be reproduced with commit before #3530, like 8f86b37616f4fe52367b6b0ab05bc869ec403058(WAMR-2.1.0). And WASM_ENABLE_WASI_EPHEMERAL_NN is enabled (so, all imports, wasi_ephemeral_nn.xx, can be linked correctly).

@tonibofarull I tried to debug it and basically found the root cause, and submitted PR https://github.com/bytecodealliance/wasm-micro-runtime/pull/3597 for a review. After applying the change, the running result of iwasm is basically same as that of wasmedge, except the order of item 2 and item 3:
wasmedge:
   1.) [166](198)Aix galericulata
   2.) [158](2)Coccothraustes coccothraustes
   3.) [34](1)Gallus gallus domesticus
   4.) [778](1)Sitta europaea
   5.) [819](1)Anas platyrhynchos

iwasm:
   1.) [166](198)Aix galericulata
   2.) [158](2)Coccothraustes coccothraustes
   3.) [34](1)Gallus gallus domesticus
   4.) [778](1)Sitta europaea
   5.) [819](1)Anas platyrhynchos

I am not sure whether the modification is valid/complete, so I changed it to draft, could you help have a look? Thanks.

BTW, I used API TfLiteTensorCopyFromBuffer and TfLiteTensorCopyToBuffer instead, the related document can be found:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/core/c/c_api.h#L57-L71
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/core/c/c_api.h#L632-L641
And they are also used in WasmEdge's implementation:
https://github.com/WasmEdge/WasmEdge/blob/master/plugins/wasi_nn/tfl.cpp#L135-L140
https://github.com/WasmEdge/WasmEdge/blob/master/plugins/wasi_nn/tfl.cpp#L166

This is similar as what it was reported here https://github.com/bytecodealliance/wasm-micro-runtime/issues/2611#issuecomment-1741595890.
The conclusion that we had there is that if the model is quantized the de-quantization was meant to be done inside the engine, not the user.
How do you want to proceed? Do we discuss with wasi-nn interface designers?

@tonibofarull Thanks for the explanation. To be frankly, I am not familiar with wasi-nn, I just tried to debug the issue and happened to make the example run good after comparing the code with wasmedge. From https://github.com/bytecodealliance/wasm-micro-runtime/issues/2611#issuecomment-1743801757, I think we don't need to add interface to wasi-nn spec, right? To make it more friendly and flexible, like what you said, maybe we can add options for developer to decide how to use, for example, export API:
wasi_nn_ctx_t wasm_runtime_get_wasi_nn_ctx(wasm_module_inst_t instance);

and add API:
bool wasm_nn_ctx_set_quantize(wasi_nn_ctx_t wasi_nn_ctx, ...);

And in iwasm command line, add argument like iwasm --wasi-nn-quantize=xxx?
This is just an idea, we can change them with better API and argument if needed. And if it is necessary to add interface to wasi-nn spec, I think we had better discuss it first, and then consult with wasi-nn interface designers. How do you think?

I just tried to debug the issue and happened to make the example run good after comparing the code with wasmedge

Totally! Thanks for the effort.

maybe we can add options for developer to decide how to use

This would be good for the developer using WAMR, but we need to agree on how to do it for any interpreter. So I think it would be good to talk to the WASI-NN API designers.

Is there any idea from you about how to add the wasi-nn interface? And when should it be called?

Let me ask @sunfishcode and @abrown!

@tonibofarull I forwarded the issue to @abrown in internal meeting and he mentioned there are similar requirements from other developers and they are planning to add wasi-nn interfaces to set the metadata, e.g. to the context and to the tensor. Please feel free to contact him, or maybe we can open an issue in zulip wasi-nn channel for a track:
https://bytecodealliance.zulipchat.com/#narrow/stream/266558-wasi-nn


Return the message id from the sendgrid adapter mirroring other adapters

See
https://sendgrid.com/docs/API_Reference/Web_API_v3/Mail/index.html#-Response-Example
for the description of the different headers.

Might be better to extract the header part in test into a function. Otherwise LGTM.

FYI I'm visiting family in China, and Steve was travelling too last time we talked. Forgive us if there isn't much communication in the next few days/weeks! Oh, and thanks for the contribution!


lockglyph on side of the screen?

lockglyph is on the side of my screen instead of where it's supposed to be for some reason. was this made like this in an update? or is it a bug?

Is this on an iPad?
Sent from my iPhone
On Feb 25, 2017, at 6:11 PM, dairishspartan <notifications<EMAIL_ADDRESS>wrote:
lockglyph is on the side of my screen instead of where it's supposed to be for some reason. was this made like this in an update? or is it a bug?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/Sticktron/LockGlyphX/issues/35, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAbAtTzPS1MuxQV4uXeR7MZbxkSeRvoVks5rgLUUgaJpZM4MMK-d.

no it's on my iphone, but it fixed itself while i wasn't using my phone


Fail to download balsamiq-mockups. Error 403.

Already did:
brew doctor
brew update
brew upgrade

But keep getting this error message:
$ brew cask install balsamiq-mockups
==> Downloading https://s3.amazonaws.com/build_production/mockups-desktop/Balsam

curl: (22) The requested URL returned error: 403 Forbidden
Error: Download failed on Cask 'balsamiq-mockups' with message: Download failed: https://s3.amazonaws.com/build_production/mockups-desktop/Balsamiq_Mockups_3.0.3.dmg

@vitorgalvao I suspect this is because the S3 URL for Balsamiq is versioned.
I just updated cask and it is still referring to version 3.0.8 at https://s3.amazonaws.com/build_production/mockups-desktop/Balsamiq_Mockups_3.0.8.dmg (download breaks).
The current version is 3.1.1 (as of today) at https://s3.amazonaws.com/build_production/mockups-desktop/Balsamiq_Mockups_3.0.8.dmg (download works).


Kernel Sessions for Console

When I open a new Console in Jupyter lab, no kernel session is shown in Running tab. Is there any reason for that or it's something under development?

Hi @marami52, this is planned for 1.0, tracked in #161.

Thank you!


Ignore Missing Entity on Parent Requests

The Rewrite module for example can result in HttpApplication.EndRequest being called multiple times - once for the original (parent) request and once for the child request which has the rewritten URL. The parent request will skip BeginRequest and will not be populated with an X-Ray Entity. It is the child request which is the important one and the parent request will only fail when AddHttpInformation is called anyway. So bail out here in the parent request.

"The parent request jumps ahead in the pipeline to the end request notification, and waits for the child request to complete."
https://github.com/microsoft/ApplicationInsights-dotnet/issues/1744

"When a client requests a specific URL (webpage), IIS may sometimes re-request the same URL or another URL on the server side. The client's original request is called the parent request, and the request that IIS executes is called the child request.
https://docs.microsoft.com/en-us/troubleshoot/developer/webapps/iis/development/duplicate-aspnet-events

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Here are a few more details as the issue that this pull request addresses is still affecting us.
URL Rewrite is a very popular extension to IIS that is provided and supported by Microsoft. One of its core features is to map URLs that are exposed to users to internal URLs. When this happens, the 'parent' request spawns a 'child' request with the mapped URL. This is passed through the complete request and response processing pipeline. The 'parent' request skips most of that and 'waits' for the 'child' request at the end of the pipeline (see the links that I provided above for some more details). The effect is that the parent request does not trigger a call to AWSXRayASPNET.ProcessHTTPRequest but does result in a call to AWSXRayASPNET.ProcessHTTPResponse as can be seen in the stack trace below.
There is an implicit assumption in AWSXRayASPNET.ProcessHTTPResponse that a segment was started in a call to AWSXRayRecorderImpl.BeginSegment in AWSXRayASPNET.ProcessHTTPRequest. That is not the case for a 'parent' request and an EntityNotAvailableException is thrown.
I think that the only reasonable way to handle this scenario is to bail out of AWSXRayASPNET.ProcessHTTPResponse for the 'parent' request. I.e. Not attempt to add HTTP information to a segment that does not exist because it was never started.
@srprash Any thoughts?
Amazon.XRay.Recorder.Core.Exceptions.EntityNotAvailableException: Entity doesn't exist in HTTPContext
   at Amazon.XRay.Recorder.Core.Internal.Context.HybridContextContainer.InjectEntityInTraceContext()
   at Amazon.XRay.Recorder.Core.AWSXRayRecorderImpl.AddHttpInformation(String key, Object value)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Amazon.XRay.Recorder.Core.AWSXRayRecorderImpl.AddHttpInformation(String key, Object value)
   at Amazon.XRay.Recorder.Handlers.AspNet.AWSXRayASPNET.ProcessHTTPResponse(Object sender, EventArgs e)
   at System.Web.HttpApplication.SyncEventExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute()
   at System.Web.HttpApplication.ExecuteStepImpl(IExecutionStep step)
   at System.Web.HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously)

Hi @srprash,
I was able to reproduce this scenario in a new project based on the following Visual Studio 2022 project template.
ASP.NET Web Application (.NET Framework)
These are the changes that I made.
Add this as a child of the configuration element in Web.config. It will rewrite a URL where the path is '/rewrite' to target the root path.
<system.webServer>
	<rewrite>
		<rules>
			<rule name="Rewrite">
				<match url=".*"/>
				<conditions>
					<add input="{PATH_INFO}" pattern="^\/rewrite$" />
				</conditions>
				<action type="Rewrite" url="/" />
			</rule>
		</rules>
	</rewrite>
</system.webServer>

Add this to the MvcApplication class in Global.asax.cs.
    protected void Application_BeginRequest(object sender, EventArgs args)
    {

    }

    protected void Application_EndRequest(object sender, EventArgs args)
    {

    }

To test, I set breakpoints on both BeginRequest and EndRequest above and then browsed to the following URL.
https://localhost:44327/rewrite
I inspected Request.Url as the breakpoints were hit and this is what I saw.
BeginRequest and then EndRequest were hit for the following URL (the 'child request').
https://localhost:44327/
Then EndRequest (but not BeginRequest) was hit for the following URL (the 'parent request').
https://localhost:44327/rewrite
I hope this shows that assuming in EndRequest that a segment will have been created in BeginRequest is not valid.

Thanks @srprash! Do you have any idea when this will make it through to the NuGet package?


Why reject title filter dont work?

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm asking a question and not reporting a bug or requesting a feature
[X] I've looked through the README
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've searched known issues and the bugtracker for similar questions including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Please make sure the question is worded well enough to be understood

yt-dlp   --no-warning --max-filesize 800M --username oauth2 --password '' --check-formats  --retries 1000 --fragment-retries 20 --retry-sleep 120 --limit-rate 800k --write-description --download-archive archive.txt -o "%(title)s_[%(id)s].%(ext)s" --reject-title "walking street | Afternoon Walk | Gangnam Street | GANGNAM, SEOUL | GANGNAM Seoul | shopping | vlog | 10 hours | minecraft | Fortnite" --match-filter '!is_live & live_status!=is_upcoming' --  "ytsearch2000:Gangnam style"

However, both  "10 hours" (yt id: 45Vaf7GeNc0) and "Gangnam Street" (yt id: x9RQBPmXpEQ) have been downloaded which both are included in rejected phrases/words that were defined in yt-dlp.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
]
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>from yt-dlp/yt-dlp [ff0779267] (zip)
[debug] Python 3.11.9 (CPython x86_64 64bit) - Linux-6.1.0-15-amd64-x86_64-with-glibc2.38 (OpenSSL 3.2.2-dev , glibc 2.38)
[debug] exe versions: ffmpeg 6.1.1-4 (setts), ffprobe 6.1.1-4, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.11.0, brotli-1.1.0, certifi-2023.11.17, mutagen-1.46.0, pyxattr-0.8.1, requests-2.31.0, sqlite3-3.45.3, urllib3-1.26.18, websockets-10.4
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests
[debug] Extractor Plugins: TTUser (TikTokUserIE), oauth2 (YoutubeBaseInfoExtractor), oauth2 (YoutubeClipIE), oauth2 (YoutubeConsentRedirectIE), oauth2 (YoutubeFavouritesIE), oauth2 (YoutubeIE), oauth2 (YoutubeMusicSearchURLIE), oauth2 (YoutubeNotificationsIE), oauth2 (YoutubeSearchDateIE), oauth2 (YoutubeSearchIE), oauth2 (YoutubeSearchURLIE), oauth2 (YoutubeTabBaseInfoExtractor), oauth2 (YoutubeTabIE)
[debug] Plugin directories: ['/home/elias/.local/lib/python3.11/site-packages/yt_dlp_plugins']
[debug] Loaded 1810 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
[debug] Downloading _update_spec from https://github.com/yt-dlp/yt-dlp/releases/latest/download/_update_spec
[debug] Downloading SHA2-256SUMS from https://github.com/yt-dlp/yt-dlp/releases/download/2024.05.26/SHA2-256SUMS
Current version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
Latest version<EMAIL_ADDRESS>from yt-dlp/yt-dlp
Current Build Hash: bb2214f4b33d58f9ef0decf0c007c2c3de3f176781ee0222733e50e28e436159

it needs to be a valid regex pattern
--reject-title "(walking street|Afternoon Walk|Gangnam Street|GANGNAM, SEOUL|GANGNAM Seoul|shopping|vlog|10 hours|minecraft|Fortnite)"


emp destroy fails due to network

Hello,
Today I tried to delete an app that was created a couple of months ago and never really used:
$ emp destroy APPNAME
warning: This will destroy APPNAME and its add-ons. Please type "APPNAME" to continue:
> APPNAME
error: http: server closed connection

After I type APPNAME, it hangs for about 1 minute, then the error message appears before exiting.
I then tried to destroy another app and it went fine. The problem happens only with this specific app.
I am using version 0.10.1 of the client.

Hey @skorpios - can you take a look at the empire daemon logs to see what is going on on the daemon side?  What version of the empire daemon are you running?  How did you set up the environment (did you roll your own setup?  use stacker? use the demo cloudformation template?)?
Thanks.

Thanks for your answer @phobologic. The only related lines I can see in the daemon logs are:
t=2016-07-11T16:14:43+0000 lvl=info msg=request.start request_id=5f75626f-20f1-497a-b933-192c8c73c511 method=DELETE path=/apps/APPNAME
t=2016-07-11T16:14:43+0000 lvl=info msg=authenticated request_id=5f75626f-20f1-497a-b933-192c8c73c511 user=skorpios

These lines appear just after I type the name of the app in emp destroy. When emp destroy displays the error and exits, I can't see anything related in the logs of the daemon.
The daemon is at version 0.10.1 too, and we have our own setup.
One thing I noticed is that the ELB of the app doesn't have any EC2 instance. I'm not sure if this is due to emp destroy partially working, or the instance being manually removed earlier.

When you do a emp apps does the app still show up?  Has Empire been upgraded since you deployed the app?  Do you know what version of Empire it was deployed under?  Had you tried migrating to the experimental cloudformation backend?

Yes, emp apps is still showing the app. Empire has been upgraded since we created the app on the 4th of March. We were probably using 0.10.0 at the time. We didn't try migrating to the experimental cloudformation backend, do you think we should?

I wouldn't try and switch backends - that'll probably cause issues.  It's really strange that there are no other errors in the logs around the destroy - the error you got on the CLI comes from when a request takes more than the ELB timeout on the controllers (usually 60 seconds), though I can't imagine what might be taking it so long. Can you tell me more about the app?  How many entries in the Procfile?  How many configured processes?
One last thing - could you restart the empire daemon processes on all your hosts, and attempt it again?  Thanks!

I've seen this happen once before myself, and it was due to a database lock not being released. Can you post the output of select * from pg_locks?
Restarting the Empire daemon should cause all of the locks to be released and allow you to destroy the app.

Thanks for your help. I stopped the daemon and I couldn't see any locks. When it started again, I queried the database for blocking processes and here was the output:
 blocked_pid | blocked_user | blocking_pid | blocking_user |               blocked_statement               | current_statement_in_blocking_process
-------------+--------------+--------------+---------------+-----------------------------------------------+---------------------------------------
        2636 | empire       |         2635 | empire        | UPDATE ports SET taken = NULL WHERE port = $1 | DELETE FROM "apps"  WHERE ("id" = $1)

Do you only have a single empire daemon, or do you have multiple?  DId you restart all empire daemons?
First: Can you do select * from pg_locks on the database.
Second: If you see any locks, go ahead and shutdown all Empire daemons.
After that check the locks again, there shouldn't be any in theory.  Then try deleting the app again.
Thanks!

Thanks all for your time. In fact, the issue was due to database locks. A select * from pg_locks was showing a steady number of locks (~150), and getting rid of all them solved the issue.
The blocking statements where mostly UPDATE ports and DELETE FROM "apps" statements (as shown in my previous comment), and the oldest ones started when the problem appeared.
I don't know what was the root cause, and I'm wondering if it would be possible to output a hint pointing to database locks in that particular case. I consider my problem being solved anyway :) Thanks!

@skorpios awesome, thanks for the update and glad the issue was resolved. It's hard to say what would have caused the lock without a repro.
Probably something that we should do is set some reasonable statement_timeout's and lock_timeout's when postgres connections are opened, so that statements can't lock up the database indefinitely like this.


Rework data transfer buttons

This PR makes a couple of changes:

Now, the data transfer buttons are enabled by default. This allows the user to e.g. run classic ImageJ plugins like TrackMate from the napari-imagej searchbar and then transfer the data back into napari. Of course, getting that data into ImageJ might be tricky, but it should be possible with the Open... command, or by opening an example image.
Also, we add popups instead of logging messages - the logs might not be seen by the user, leading to confusion.

This should also close #188, as we no longer have to wait for these buttons to be enabled!

Codecov Report
Patch coverage: 60.00% and project coverage change: -0.09 :warning:

Comparison is base (315a28c) 89.86% compared to head (24fc7e9) 89.78%.

:exclamation: Current head 24fc7e9 differs from pull request most recent head 3d51ef2. Consider uploading reports for the commit 3d51ef2 to get more accurate results

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #196      +/-   ##
==========================================
- Coverage   89.86%   89.78%   -0.09%
==========================================
  Files          45       45
  Lines        4232     4228       -4
==========================================
- Hits         3803     3796       -7
- Misses        429      432       +3

Impacted Files
Coverage Δ

src/napari_imagej/widgets/menu.py
77.86% <53.84%> (-1.15%)
:arrow_down:

tests/widgets/test_menu.py
71.85% <100.00%> (-0.52%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


 version=0.25.0 commit=276f7bb9936a6989a324caa60f8accdc35d24ab3 date=2024-10-31T04:32:30Z
time=2024-10-31T23:39:45.076Z level=INFO msg="Start downloading" creator_id=@noil-poisoncat
time=2024-10-31T23:39:45.241Z level=ERROR msg="fanbox-dl Error" error="failed downloading of "@noil-poisoncat": get pagination: status is 403 Forbidden"
time=2024-10-31T23:39:45.241Z level=ERROR msg="The error log seems a bug, please open an issue on GitHub" url=https://github.com/hareku/fanbox-dl/issues
PS F:\Fanbox Downloader>

Related https://github.com/hareku/fanbox-dl/issues/39#issuecomment-2450235481

I tried a VPN and this didn't fix the issue


BouncyCastle EC math is slow in Blazor WebAssembly

It takes about a second to derive the next key from an ExtendedKey. Perhaps this library can make use of JSInterop for the Webcrypto APIs when the platform is 'browser'.

I am surprised it even works. WASM does not support Span? Because if you use the netstandard2.1 version of NBitcoin it is not using Bouncycastle, but something which should be more efficient.

I am surprised it even works. WASM does not support Span? Because if you use the netstandard2.1 version of NBitcoin it is not using Bouncycastle, but something which should be more efficient.

I can do a special build of NBitcoin for WASM environment, but you will need to guide me here about what should be done for browser environment.

I can do a special build of NBitcoin for WASM environment, but you will need to guide me here about what should be done for browser environment.

I built it with following compilation symbols set:

NOCUSTOMSSLVALIDATION
NETSTANDARD
NO_ARRAY_FILL
NULLABLE_SHIMS
USEBC
NONATIVEHASH
NO_NATIVESHA1
NO_NATIVERIPEMD160
NO_NATIVE_RFC2898_HMACSHA512
NO_NATIVERIPEMD160
NO_NATIVE_HMACSHA512

This way, I managed to build it for target 'netstandard2.0'. Blazor WASM has no support for System.Security.Cryptography, that's why I toggled "USEBC". Or is there perhaps a more efficient implementation that is not using System.Security.Cryptography? (in that case I must have missed it)
I'm don't recall exactly if I was able to use Span, I can investigate this later.

I built it with following compilation symbols set:

NOCUSTOMSSLVALIDATION
NETSTANDARD
NO_ARRAY_FILL
NULLABLE_SHIMS
USEBC
NONATIVEHASH
NO_NATIVESHA1
NO_NATIVERIPEMD160
NO_NATIVE_RFC2898_HMACSHA512
NO_NATIVERIPEMD160
NO_NATIVE_HMACSHA512

This way, I managed to build it for target 'netstandard2.0'. Blazor WASM has no support for System.Security.Cryptography, that's why I toggled "USEBC". Or is there perhaps a more efficient implementation that is not using System.Security.Cryptography? (in that case I must have missed it)
I'm don't recall exactly if I was able to use Span, I can investigate this later.

Can you try to toggler HAS_SPAN?

Can you try to toggler HAS_SPAN?

Also check if you can use
using (var sha = new SHA256Managed())
			{
				return sha.ComputeHash(data, offset, count);
			}

So we can find what is supported or not.

Also check if you can use
using (var sha = new SHA256Managed())
			{
				return sha.ComputeHash(data, offset, count);
			}

So we can find what is supported or not.

I checked the code, toggling HAS_SPAN might already improve things if WASM support it.

I checked the code, toggling HAS_SPAN might already improve things if WASM support it.

I will try. Should this speed up the bouncy castle EC math?
I can try the SHA256Managed, but this is probably not the slowest part.

I will try. Should this speed up the bouncy castle EC math?
I can try the SHA256Managed, but this is probably not the slowest part.

If you set HAS_SPAN it will use BC only for hash things. Not EC.

If you set HAS_SPAN it will use BC only for hash things. Not EC.

I tried it again, now targetting 'netstandard2.1'.
I had to add these 2 compilation symbols, because System.Security.Cryptography is not supported in wasm:

NO_NATIVE_HMACSHA512
NO_NATIVE_RFC2898_HMACSHA512

However, the project won't compile like this, because the BouncyCastle source files get removed from the project when targetting 'netstandard2.1'. I can restore the files by editing the csproj file to switch RemoveBC off:
<RemoveBC>false</RemoveBC>
The next problem is that NBitcoin.BouncyCastle.Crypto.Digests.Sha256Digest doesn't implement interface IDigest

I tried it again, now targetting 'netstandard2.1'.
I had to add these 2 compilation symbols, because System.Security.Cryptography is not supported in wasm:

NO_NATIVE_HMACSHA512
NO_NATIVE_RFC2898_HMACSHA512

However, the project won't compile like this, because the BouncyCastle source files get removed from the project when targetting 'netstandard2.1'. I can restore the files by editing the csproj file to switch RemoveBC off:
<RemoveBC>false</RemoveBC>
The next problem is that NBitcoin.BouncyCastle.Crypto.Digests.Sha256Digest doesn't implement interface IDigest

Also check if you can use
using (var sha = new SHA256Managed())
			{
				return sha.ComputeHash(data, offset, count);
			}

So we can find what is supported or not. Same with SHA512Managed

They are not supported

Also check if you can use
using (var sha = new SHA256Managed())
			{
				return sha.ComputeHash(data, offset, count);
			}

So we can find what is supported or not. Same with SHA512Managed

They are not supported

@NicolasDorier please review my pull request:
https://github.com/JVanloofsvelt/NBitcoin/pull/1
As I wrote earlier, managed SHA256 and SHA512 are not supported in Blazor wasm. After applying the changes from my patch/pull-request, you should be able to build the project for netstandard2.1 and get it to work in Blazor wasm. You'll need to set RemoveBC to false, and add the following compilation symbols:
NO_NATIVESHA1;NONATIVEHASH;NO_NATIVE_HMACSHA512;NO_NATIVE_RFC2898_HMACSHA512
Now the sad news: in Blazor wasm it takes my system 300-500ms to derive an ExtPubKey from a parent key, which is slow.

@NicolasDorier please review my pull request:
https://github.com/JVanloofsvelt/NBitcoin/pull/1
As I wrote earlier, managed SHA256 and SHA512 are not supported in Blazor wasm. After applying the changes from my patch/pull-request, you should be able to build the project for netstandard2.1 and get it to work in Blazor wasm. You'll need to set RemoveBC to false, and add the following compilation symbols:
NO_NATIVESHA1;NONATIVEHASH;NO_NATIVE_HMACSHA512;NO_NATIVE_RFC2898_HMACSHA512
Now the sad news: in Blazor wasm it takes my system 300-500ms to derive an ExtPubKey from a parent key, which is slow.

@JVanloofsvelt you did not open the PR on the right repo, you did on your fork. I will check what I can do about the RemoveBC. I should be smarter about it.

@JVanloofsvelt you did not open the PR on the right repo, you did on your fork. I will check what I can do about the RemoveBC. I should be smarter about it.

I think rather than <ItemGroup Condition=" '$(RemoveBC)' == 'true' "> in the csproj, I should just look for the NO_BC constant.

I think rather than <ItemGroup Condition=" '$(RemoveBC)' == 'true' "> in the csproj, I should just look for the NO_BC constant.

@JVanloofsvelt I am wondering if instead of relying on BC, we could not just import SHA256Managed.cs inside NBitcoin (keep it internal, change the namespace)

@JVanloofsvelt I am wondering if instead of relying on BC, we could not just import SHA256Managed.cs inside NBitcoin (keep it internal, change the namespace)

Looking at the source code of dotnet I found implementation:
https://github.com/dotnet/runtime/blob/1d9e50cb4735df46d3de0cee5791e97295eaf588/src/libraries/System.Security.Cryptography.Algorithms/src/Internal/Cryptography/SHAHashProvider.Browser.cs
Which is very strange, as the name of the file seems to indicate it is supported by browsers oO

Looking at the source code of dotnet I found implementation:
https://github.com/dotnet/runtime/blob/1d9e50cb4735df46d3de0cee5791e97295eaf588/src/libraries/System.Security.Cryptography.Algorithms/src/Internal/Cryptography/SHAHashProvider.Browser.cs
Which is very strange, as the name of the file seems to indicate it is supported by browsers oO

@NicolasDorier I opened the pull request on your repo this time, sorry for that.

I'll leave it up to you to use NO_BC or not when deciding whether or not to include those BC files.
I believe HAS_SPAN was set to 'true' without any action on my part (perhaps because I was targetting netstandard2.1?).

@NicolasDorier I opened the pull request on your repo this time, sorry for that.

I'll leave it up to you to use NO_BC or not when deciding whether or not to include those BC files.
I believe HAS_SPAN was set to 'true' without any action on my part (perhaps because I was targetting netstandard2.1?).

Checking on here if we can't just copy/paste dotnet managed code rather than depending on BC
https://github.com/dotnet/runtime/issues/40074
I don't know if hashing is the reason why it is slow though.
The EC operations if HAS_SPAN is set is using secp256k1 in C# which is normally very efficient.

Checking on here if we can't just copy/paste dotnet managed code rather than depending on BC
https://github.com/dotnet/runtime/issues/40074
I don't know if hashing is the reason why it is slow though.
The EC operations if HAS_SPAN is set is using secp256k1 in C# which is normally very efficient.

@NicolasDorier I tried it once more, with the same configuration as I described here, but now using Microsoft Edge. The key derivation is taking only 10s of milliseconds (as opposed to 100s). In Firefox the Blazor app seems to hang.
My dotnet version is 5.0.102 by the way.

@NicolasDorier I tried it once more, with the same configuration as I described here, but now using Microsoft Edge. The key derivation is taking only 10s of milliseconds (as opposed to 100s). In Firefox the Blazor app seems to hang.
My dotnet version is 5.0.102 by the way.

I don't know if that's worth it, as I don't know if that's the real bottleneck.

I don't know if that's worth it, as I don't know if that's the real bottleneck.

@JVanloofsvelt can you reply to https://github.com/dotnet/runtime/issues/40074 they say hash functions are supported on .net5.0

@JVanloofsvelt can you reply to https://github.com/dotnet/runtime/issues/40074 they say hash functions are supported on .net5.0

@NicolasDorier Hi Nicolas, I verified it, and indeed hash functions seem to be supported.
The problem with NBitcoin is that for the HMACs it either uses a native HMAC with a native hash function, or it uses BC HMAC with BC hash function. I modified the code a little so that it can use BC HMAC with a native hash function.
My changes allow me to switch on compilation symbol "NO_BC" again. Furthermore, I can drop "NONATIVEHASH" which I had switched on earlier. This is a win.
I will create another pull request.

@NicolasDorier Hi Nicolas, I verified it, and indeed hash functions seem to be supported.
The problem with NBitcoin is that for the HMACs it either uses a native HMAC with a native hash function, or it uses BC HMAC with BC hash function. I modified the code a little so that it can use BC HMAC with a native hash function.
My changes allow me to switch on compilation symbol "NO_BC" again. Furthermore, I can drop "NONATIVEHASH" which I had switched on earlier. This is a win.
I will create another pull request.

Pull request: https://github.com/MetacoSA/NBitcoin/pull/965
Using following compilation symbols to get a build that works in Blazor wasm:
NO_NATIVE_HMACSHA512;NO_NATIVESHA1;NO_NATIVE_RFC2898_HMACSHA512;NOCUSTOMSSLVALIDATION;NO_NATIVERIPEMD160;NETCORE;HAS_SPAN;NO_BC
The gist being that you need to add NO_NATIVE_HMACSHA512 and NO_NATIVE_RFC2898_HMACSHA512.

Pull request: https://github.com/MetacoSA/NBitcoin/pull/965
Using following compilation symbols to get a build that works in Blazor wasm:
NO_NATIVE_HMACSHA512;NO_NATIVESHA1;NO_NATIVE_RFC2898_HMACSHA512;NOCUSTOMSSLVALIDATION;NO_NATIVERIPEMD160;NETCORE;HAS_SPAN;NO_BC
The gist being that you need to add NO_NATIVE_HMACSHA512 and NO_NATIVE_RFC2898_HMACSHA512.

@JVanloofsvelt have you also check if the perfs were better?


Feature Request:  Sidekick displays doc comments

Documentation comments {-| doc comment place before function -} in the current project would be awesome to see in the sidekick.  I have a few functions in one of my modules that I like to see the doc of to see how to format certain parts of the input but the sidekick only displays, for example SomeApp.SimpleHelpers.flagsContain : List String -> String -> Bool instead of the documentation comment associated with it as well.

It's in the to do list, but low priority.  You can submit a PR haha.

Lol, should I get time for it I would.  ^.^

I'm already working on this :-)

Added in the latest version (2.5.4.).


Authenticating from SecretsManager with expired session always fails

Describe the bug
When trying to authenticate using Secrets Manager and there is an expired session store in Secrets Manager, XCI fails (Authentication error) but does not prompt for new credentials. It obliges users to call signout and storesecrets again to unlock
To Reproduce
ec2-user@ip-172-31-5-69 ~ % xcodeinstall authenticate -s us-east-1
Retrieving Apple Developer Portal credentials...
Authenticating...
🛑 Invalid username or password.

Expected behavior
When authentication fails and Secrets Manager is used, the command should ask for credentials again and restart a clean cycle
Desktop (please complete the following information):

OS: [e.g. macOS 12.5]
xcodeinstall version [e.g. 0.1] : 0.5

Additional context
Only when using Secrets Manager

Closing this as authentication is not required anymore https://github.com/sebsto/xcodeinstall/pull/19


Make Makefile tests handle optimization more gracefully.

Fixes #30

Max PTAL.

This idea was suggested by @vanhauser-thc. Thanks!

actually the idea came from @hexcoder- I just proxied his change in afl++ to here ;)


[logging] Remove structured log entry

Overview
Removes the previous StructuredLogEntry, moves Security logs, tracing, and a config log all to the new logging system!  Figured I'd finish the cleanup of the logs now to remove this mode.
I've been trying to keep naming of certain types consistent, and if they would conflict to have a different name.

/land


Inquiry about “max_epoch” values for pre-training and fine-tuning

I would like to inquire about the max_epoch values set for pre-training and fine-tuning. Are they set to 5 and 3 as  in the config file, respectively? I tried running the fine-tuning code with these values, but the results were not as coherent as the fine-tuned models provided by the official repository. Therefore, I would like to confirm if these are the correct values.
Thank you for your help and for sharing your work with the community.

Great to receive your feedback on fine-tuning Video-LLaMA. We find that we haven't updated the yaml files for fine-tuning the VL branch of Video-LLaMA, which could be a probable reason that causes the inconsistency.
Please refer to our latest commit https://github.com/DAMO-NLP-SG/Video-LLaMA/commit/ed86c27b881700a7422215a2d53396e7be47b10e for more details:

I found that you did not modify the value of 'max_epoch' in the updated 'video_llama_stage2_finetune.yaml' file. I would like to clarify whether max_epoch is set to 3 during the actual fine-tuning?

Yes, it is 3.

Thank you, and thank you again for your selfless sharing.

Got it. Thank you again for your selfless sharing.


fix: apply correct chip variant

Please check the following

[ ] Do the tests still pass? (see Run the Tests)
[ ] Is the code formatted properly? (see Linting (Formatting))
For New Features:

[ ] Have tests been added to cover any new features or fixes?
[ ] Has the documentation been updated accordingly?

Please describe additional details for testing this change
Resolves #312 by applying correct chip style (elevated or outlined)

Resolves #312