load test for gaps

trying to see how reliable the gap resolution is

sample output from my test:
Choose a test:
1. Append with ExpectedVersion.Any
2. Read all
3. Append max count
4. Many steam subscriptions
5. Test gaps
Choose an option: 5

Appends events to streams and reads them all back in a single task.

Store type:
1. InMem
2. MS SQL (SqlLocalDB, NamedPipes)
Choose an option: 2
Data Source=(localdb)\MSSQLLocalDB;Initial Catalog=StreamStoreTests-b555a5fa8f484e0ab4e89b3868b81e20;Integrated Security
=True;MultipleActiveResultSets=True
Number of streams: 30
Size of Json (kb): 2
Number of messages per stream append: 100
Read page size: 1024
< from 0
< from 0
< from 0
< from 0
< from 0
< from 0
< from 0
< from 0
< from 0
< from 0
< from 4
< Gap found 99 and 109
< from 4
< Gap found 99 and 109
< from 104
< Gap found 308 and 310
< from 104
< from 104
< Gap found 308 and 310
< Gap found 308 and 310
< from 205
< from 104
< Gap found 308 and 310
< from 104
< Gap found 308 and 310
< from 104
< Gap found 308 and 310
< from 104
< Gap found 308 and 310
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 104
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
System.Data.SqlClient.SqlException (0x80131904): Transaction (Process ID 56) was deadlocked on lock resources with anoth
er process and has been chosen as the deadlock victim. Rerun the transaction.
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInA
ction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectio
nLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, B
ulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
   at System.Data.SqlClient.SqlDataReader.TryConsumeMetaData()
   at System.Data.SqlClient.SqlDataReader.get_MetaData()
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOption
sString)
   at System.Data.SqlClient.SqlCommand.CompleteAsyncExecuteReader()
   at System.Data.SqlClient.SqlCommand.InternalEndExecuteReader(IAsyncResult asyncResult, String endMethod)
   at System.Data.SqlClient.SqlCommand.EndExecuteReaderInternal(IAsyncResult asyncResult)
   at System.Data.SqlClient.SqlCommand.EndExecuteReader(IAsyncResult asyncResult)
   at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction,
Task`1 promise, Boolean requiresSynchronization)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<AppendToStreamExpectedVersionAny>d__4.MoveNext() in C:\Dev\SqlStreamStore\src\Sql
StreamStore.MsSql\MsSqlStreamStore.AppendStream.cs:line 152
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<RetryOnDeadLock>d__3`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at SqlStreamStore.MsSqlStreamStore.<RetryOnDeadLock>d__3`1.MoveNext() in C:\Dev\SqlStreamStore\src\SqlStreamStore.MsS
ql\MsSqlStreamStore.AppendStream.cs:line 119
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<AppendToStreamInternal>d__1.MoveNext() in C:\Dev\SqlStreamStore\src\SqlStreamStor
e.MsSql\MsSqlStreamStore.AppendStream.cs:line 48
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at LoadTests.TestGaps.<RunWrites>d__3.MoveNext() in C:\Dev\SqlStreamStore\src\LoadTests\TestGaps.cs:line 164
ClientConnectionId:69d07875-a1a2-4aaa-abf1-36600d7b930c
Error Number:1205,State:51,Class:13
System.Data.SqlClient.SqlException (0x80131904): Transaction (Process ID 57) was deadlocked on lock resources with anoth
er process and has been chosen as the deadlock victim. Rerun the transaction.
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInA
ction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectio
nLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, B
ulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
   at System.Data.SqlClient.SqlDataReader.TryConsumeMetaData()
   at System.Data.SqlClient.SqlDataReader.get_MetaData()
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOption
sString)
   at System.Data.SqlClient.SqlCommand.CompleteAsyncExecuteReader()
   at System.Data.SqlClient.SqlCommand.InternalEndExecuteReader(IAsyncResult asyncResult, String endMethod)
   at System.Data.SqlClient.SqlCommand.EndExecuteReaderInternal(IAsyncResult asyncResult)
   at System.Data.SqlClient.SqlCommand.EndExecuteReader(IAsyncResult asyncResult)
   at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction,
Task`1 promise, Boolean requiresSynchronization)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<AppendToStreamExpectedVersionAny>d__4.MoveNext() in C:\Dev\SqlStreamStore\src\Sql
StreamStore.MsSql\MsSqlStreamStore.AppendStream.cs:line 152
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<RetryOnDeadLock>d__3`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at SqlStreamStore.MsSqlStreamStore.<RetryOnDeadLock>d__3`1.MoveNext() in C:\Dev\SqlStreamStore\src\SqlStreamStore.MsS
ql\MsSqlStreamStore.AppendStream.cs:line 119
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<AppendToStreamInternal>d__1.MoveNext() in C:\Dev\SqlStreamStore\src\SqlStreamStor
e.MsSql\MsSqlStreamStore.AppendStream.cs:line 48
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at LoadTests.TestGaps.<RunWrites>d__3.MoveNext() in C:\Dev\SqlStreamStore\src\LoadTests\TestGaps.cs:line 164
ClientConnectionId:ffee455d-1278-4d93-9e75-d3383aedc336
Error Number:1205,State:51,Class:13
System.Data.SqlClient.SqlException (0x80131904): Transaction (Process ID 73) was deadlocked on lock resources with anoth
er process and has been chosen as the deadlock victim. Rerun the transaction.
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInA
ction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectio
nLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, B
ulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
   at System.Data.SqlClient.SqlDataReader.TryConsumeMetaData()
   at System.Data.SqlClient.SqlDataReader.get_MetaData()
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOption
sString)
   at System.Data.SqlClient.SqlCommand.CompleteAsyncExecuteReader()
   at System.Data.SqlClient.SqlCommand.InternalEndExecuteReader(IAsyncResult asyncResult, String endMethod)
   at System.Data.SqlClient.SqlCommand.EndExecuteReaderInternal(IAsyncResult asyncResult)
   at System.Data.SqlClient.SqlCommand.EndExecuteReader(IAsyncResult asyncResult)
   at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction,
Task`1 promise, Boolean requiresSynchronization)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<AppendToStreamExpectedVersionAny>d__4.MoveNext() in C:\Dev\SqlStreamStore\src\Sql
StreamStore.MsSql\MsSqlStreamStore.AppendStream.cs:line 152
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<RetryOnDeadLock>d__3`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at SqlStreamStore.MsSqlStreamStore.<RetryOnDeadLock>d__3`1.MoveNext() in C:\Dev\SqlStreamStore\src\SqlStreamStore.MsS
ql\MsSqlStreamStore.AppendStream.cs:line 119
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at SqlStreamStore.MsSqlStreamStore.<AppendToStreamInternal>d__1.MoveNext() in C:\Dev\SqlStreamStore\src\SqlStreamStor
e.MsSql\MsSqlStreamStore.AppendStream.cs:line 48
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at LoadTests.TestGaps.<RunWrites>d__3.MoveNext() in C:\Dev\SqlStreamStore\src\LoadTests\TestGaps.cs:line 164
ClientConnectionId:a6fd2833-bd11-43db-9764-b79dfd78f8cf
Error Number:1205,State:51,Class:13
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< Gap found 308 and 310
< from 205
< Gap found 308 and 310
< from 205
< Gap found 308 and 310

> 3000 messages written in 00:00:16.9826685 (177 m/s)

> 3000 messages written in 00:00:17.0285861 (176 m/s)

> 3000 messages written in 00:00:17.1015665 (175 m/s)

> 3000 messages written in 00:00:17.0903132 (176 m/s)

> 3000 messages written in 00:00:17.1114769 (175 m/s)

> 3000 messages written in 00:00:17.1224457 (175 m/s)
> 3000 messages written in 00:00:17.1147767 (175 m/s)
> 3000 messages written in 00:00:17.1218248 (175 m/s)

> 3000 messages written in 00:00:17.1340959 (175 m/s)

> 3000 messages written in 00:00:17.1280178 (175 m/s)
Writes finished

< 1212 messages read 00:00:17.1431881 (71 m/s)

< 1212 messages read 00:00:17.1438695 (71 m/s)

< 1112 messages read 00:00:17.1445118 (65 m/s)

< 1112 messages read 00:00:17.1387154 (65 m/s)

< 1512 messages read 00:00:17.1395134 (88 m/s)

< 1212 messages read 00:00:17.1465774 (71 m/s)

< 1112 messages read 00:00:17.1471713 (65 m/s)

< 1412 messages read 00:00:17.1479892 (82 m/s)

< 1212 messages read 00:00:17.1432716 (71 m/s)

< 1212 messages read 00:00:17.1503522 (71 m/s)
Actual gaps:
- 99 : 109
- 308 : 310
- 409 : 415
- 514 : 524
- 623 : 637
- 736 : 746
- 945 : 954
- 1053 : 1063
- 1162 : 1172
- 1271 : 1280
- 1379 : 1389
- 1488 : 1498
- 1597 : 1606
- 1705 : 1715
- 1814 : 1824
- 1923 : 1932
- 2031 : 2040
- 2139 : 2149
- 2248 : 2258
- 2357 : 2367
- 2466 : 2476
- 2575 : 2585
- 2684 : 2694
- 2793 : 2803
- 2902 : 2912
- 3011 : 3021
- 3120 : 3130

< 3000 messages read 00:00:00.0631622 (47619 m/s)
Done


NotificationManager keeps references to NotificationArea from closed window

Hello,
Thank you for maintaining this library, it's very helpful for adding notifications to my application.
I noticed that NotificationManager has a static readonly field Areas which contains a list of NotificationAreas. When a NotificationArea gets constructed, it calls NotificationManager.AddArea(this). However, if the parent window of the NotificationArea is closed, the Areas field continues to hold a reference to it, keeping the parent (and anything that it references) from being GC'd.
I suggest adding a function to the NotificationManager class to remove areas which are no longer in use. Example below:
internal static void RemoveArea(NotificationArea area) => Areas.Remove(area);

You could then remove the NotificationArea from the Area list when it is unloaded.
private void NotificationArea_Unloaded(object sender, RoutedEventArgs e)
{
    NotificationManager.RemoveArea(this);
}

When doing this, the NotificationArea will be removed when the control is Unloaded, so I suggest moving the call to NotificationManager.AddArea() to the control's Loaded event rather than in its constructor, in case of the control being removed and added to the visual tree through something like navigation.

Hi mate,
You can supplement the code and send Pull request, I will definitely look at the solution.

updated to v<IP_ADDRESS>
Thank you.


Loose early stopping

This branch adds a one additional iteration when a maximum was reached instead of exiting immediately.
This is an addition to #67 which fixes early stopping in general.

Did you do the fix for vuseful like we discussed on Zoom?


Add more detail to payload title when running inside a beforeEach hook

@georgecrawford change looks good to me, could you make sure that the tests are passing before you merge? Thanks!

Tests are failing, and it's also not quite doing what I need yet, so don't merge this yet!


threema-desktop: fix build

Description of changes
fixes https://github.com/NixOS/nixpkgs/issues/329108
cc @eyJhb

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

All those impure setuptools we now find 😂


feat(Storage): Custom Key Resolver

Issue #, if available:
Description of changes:
What is changing?
This PR introduces a mechanism to provide a custom prefix for S3 requests when performing storage APIs. Currently the storage request (StorageAccessLevel, targetIdentityId) is used to perform S3 prefix resolution and maps closely with the Amplify CLI configured S3 bucket policies (https://docs.amplify.aws/lib/storage/configureaccess/q/platform/ios). This hook into the plugin options allows developers to provide their own logic for resolving the the prefix string.
Why are we introducing this change?

We have seen customer requests to allow them to change the prefix added by the plugin to align with their own S3 bucket rules
a. iOS Issue: https://github.com/aws-amplify/amplify-ios/issues/916
b. Android Issue: https://github.com/aws-amplify/amplify-android/issues/910
c. Flutter Issue: https://github.com/aws-amplify/amplify-flutter/issues/416

JS has a similar mechanism (https://docs.amplify.aws/lib/storage/configureaccess/q/platform/js#customization)

CLI provides the ability to import their own S3 bucket. This allows developers to successfully use the plugin by making use of the mechanism to provide their own prefixes prepended to the key to make requests to S3. (https://docs.amplify.aws/cli/storage/import)

Who is impacted?
Developers who have a S3 bucket with existing IAM policies will be unblocked to use the plugin to provide their own prefix resolution.
What do I have to do?
Define your custom prefix resolution logic
struct CustomOverrideKeyResolver: AWSS3PluginCustomKeyResolver {
      func resolvePrefix(for accessLevel: StorageAccessLevel,
                         targetIdentityId: String?) -> Result<String, StorageError> {
          switch accessLevel {
          case .guest:
              return .success("customPublic/")
          case .protected:
              return .success("customProtected/")
          case .private:
              return .failure(.configuration("`.private` StorageAccessLevel is not used", "", nil))
          }
      }
  }

or if you are performing operations to the S3 root, you can simply use AWSS3PluginOptions.passThroughKeyResolver to perform no custom logic.
Then pass the resolver to pluginOptions of the request
// Use case 1. PassThroughKeyResolver
let uploadOptions = StorageUploadDataRequest.Options(pluginOptions: AWSS3PluginOptions.passThroughKeyResolver)
Amplify.Storage.uploadData(key: key, data: data, options: uploadOptions)

// Use case 2. Or use your custom resolver
let pluginOptions = AWSS3PluginOptions(customKeyResolver: CustomOverrideKeyResolver())
let uploadOptions = StorageUploadDataRequest.Options(pluginOptions: pluginOptions)
Amplify.Storage.uploadData(key: key, data: data, options: uploadOptions)

Where do I make these changes?
Use your custom resolver in every request you want the resolution logic to be used.
Related docs: https://github.com/aws-amplify/docs/pull/3321
Check points:

[ ] Added new tests to cover change, if needed
[ ] All unit tests pass
[ ] All integration tests pass
[ ] Documentation update for the change if required
[ ] PR title conforms to conventional commit style

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #1277 (afdbcda) into main (9c3fcf9) will increase coverage by 0.00%.
The diff coverage is 81.81%.

@@           Coverage Diff           @@
##             main    #1277   +/-   ##
=======================================
  Coverage   60.14%   60.15%
=======================================
  Files         653      655    +2
  Lines       19472    19481    +9
=======================================
+ Hits        11711    11718    +7
- Misses       7761     7763    +2

Flag
Coverage Δ

API_plugin_unit_test
63.60% <ø> (+0.20%)
:arrow_up:

AWSPluginsCore
76.22% <ø> (ø)

Amplify
48.42% <ø> (+0.04%)
:arrow_up:

Analytics_plugin_unit_test
73.41% <ø> (ø)

Auth_plugin_unit_test
82.31% <ø> (ø)

DataStore_plugin_unit_test
74.75% <ø> (ø)

Predictions_plugin_unit_test
33.51% <ø> (ø)

Storage_plugin_unit_test
57.38% <81.81%> (-0.35%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...uest/StorageRequestOptions+CustomKeyResolver.swift
0.00% <0.00%> (ø)

...oragePlugin/Support/Utils/StorageErrorHelper.swift
3.12% <0.00%> (+0.03%)
:arrow_up:

...gin/Support/Utils/StorageRequestUtils+Getter.swift
93.54% <ø> (-0.74%)
:arrow_down:

...WSS3StoragePlugin/Request/AWSS3PluginOptions.swift
88.88% <88.88%> (ø)

.../Operation/AWSS3StorageDownloadDataOperation.swift
72.05% <100.00%> (+1.22%)
:arrow_up:

.../Operation/AWSS3StorageDownloadFileOperation.swift
75.00% <100.00%> (+1.47%)
:arrow_up:

...Plugin/Operation/AWSS3StorageGetURLOperation.swift
88.88% <100.00%> (+3.47%)
:arrow_up:

...gePlugin/Operation/AWSS3StorageListOperation.swift
88.37% <100.00%> (+2.95%)
:arrow_up:

...Plugin/Operation/AWSS3StorageRemoveOperation.swift
88.63% <100.00%> (+3.52%)
:arrow_up:

...in/Operation/AWSS3StorageUploadDataOperation.swift
78.66% <100.00%> (+1.74%)
:arrow_up:

... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9c3fcf9...afdbcda. Read the comment docs.

For those trying this feature out from this branch, please be aware of the latest changes

"PassthroughPrefixResolver" has been removed, and so if developers require to upload to the root, please define it yourself
Adding the resolver to the request option has been removed, and only way is to define it at config time. Let us know if this doesn't solve the use case for you.
Naming changed to AWSS3PluginPrefixResolver


May I ask if spnn.conv3d is a submanifold sparse convolution or a regular sparse convolution?

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
May I ask if spnn. conv3d in torch sparse is a submanifold sparse convolution or a regular sparse convolution? How to distinguish like spconv.SubMConv3d and spconv.SparseConv3d in spconv?
Expected Behavior
No response
Environment
- GCC:
- NVCC:
- PyTorch:
- PyTorch CUDA:
- TorchSparse:

Anything else?
No response

We support both submanifold and regular sparse convolution in spnn.conv3d. Just change the stride parameter to run the two types of convolution.


Radial plots? Polar scales?

Please consider this comment an 'up vote' for radial Plot capability.

Told @Fil I’d post my non-pie-chart use case!

Not a very practical solution, but here’s a demonstration of pie and donut charts using Plot’s azimuthal-equal-area projection: https://observablehq.com/@observablehq/pie-to-donut-chart

Spiral heatmap with an azimuthal-equidistant projection and a custom line interpolation that follows the parallels rather than the great arcs.
https://observablehq.observablehq.cloud/pangea/plot/spiral-heatmap


Update openbrush-follow-up-2.md

Project Abstract
This is an update of an already accepted grant.
We want to do some additions, however, I have noticed that after this PR the changes we previously made to the grant application and which were accepted in this PR were discarded, so I am adding these changes as well as one new change regarding ink! 4.0. As we are updating OpenBrush to use ink! 4.0, and the storage was reworked in ink! 4.0, we will need to do many changes in OpenBrush and it may increase the original delivery time and cost, and we want to have it covered in this grant. We also had some team adjustments, they are addressed in this PR.
Grant level

[ ] Level 1:  Up to $10,000, 2 approvals
[ ] Level 2:  Up to $30,000, 3 approvals
[X] Level 3:  Unlimited, 5 approvals (for >$100k: Web3 Foundation Council approval)

Application Checklist

[x] The application template has been copied and aptly renamed (project_name.md).
[X] I have read the application guidelines.
[X] A BTC, Ethereum (USDC/DAI) or Polkadot/Kusama (aUSD/USDT) address for the payment of the milestones is provided in the application.
[X] The software delivered for this grant will be released under an open-source license specified in the application.
[X] The initial PR contains only one commit (squash and force-push if needed).
[X] The grant will only be announced once the first milestone has been accepted (see the announcement guidelines).

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hi @Noc2 and thank you for response. I have signed it.

@coreggon11 note that we no longer pay in USDT on Ethereum. Could you provide a Kusama or Polkadot address if you still want to be paid in USDT? The same goes for the other two amendments. Feel free to have a look at the current list of payment currencies.

@alxs thanks for the reply, and sorry for waiting, we needed to discuss this. I see you already approved the changes, but for others, I changed the payment method to DAI (and the same for other PRs)

Hello guys, a pleasure to meet you. I’m Fedor, Head of Operations at Brushfam. @TtomaS7 resigned from her position in 727 ventures, so the grants she initiated will be transferred to me.
OpenBrush
Typechain
Sol2ink
Toma, please confirm this)

I confirm it!


Event request CU 7301 OnBeforeBinContentInsert

Please add new event to CU 7301 "Whse. Jnl.-Register Line"
  OnBeforeBinContentInsert(BinContent, WhseEntry);
  BinContent.INSERT;

LOCAL [IntegrationEvent] OnBeforeBinContentInsert(VAR BinContent : Record "Bin Content";WhseEntry : Record "Warehouse Entry")
Thank you
S.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


MAINT: inverse gamma distribution accuracy

closes https://github.com/scipy/scipy/issues/6245

The CI failure is real.
https://github.com/scipy/scipy/blob/master/scipy/stats/morestats.py#L213

The problem was in the last few digits of a doctest. The analogous unit test used a relative tolerance of 1e-9 whereas the doctest checks exact ascii equality, so I've updated the doctest. A related issue is https://github.com/scipy/scipy/issues/674.

Yeah, it'd be good to figure out a way of not printing/checking too many digits in doctests.

I don't think it's exact ASCII equivalence though

I see that it tries to be clever enough to handle strings like https://github.com/scipy/scipy/blob/master/tools/refguide_check.py#L530
but it looks like it fails to parse Variance(statistic=10.0, minmax=(3.1767242068607087, 24.459103821334018)), because I think the change due to this PR should have passed allclose.

This PR should be good to go, unless we want to go down a doctests infrastructure rabbit-hole before it is merged.

Nearly pressed the green button, just before the last commit :-)

sorry, that was in response to https://github.com/scipy/scipy/issues/6259#issuecomment-225680881

btw, when I run $ python runtests.py --refguide-check locally I see
scipy/stats/mstats_basic.py", line 2091, in describe
Failed example:
    describe(ma)
Expected:
    DescribeResult(nobs=array(3), minmax=(masked_array(data = 0,
                 mask = False,
           fill_value = 999999)
    , masked_array(data = 2,
                 mask = False,
           fill_value = 999999)
    ), mean=1.0, variance=0.66666666666666663, skewness=masked_array(data = 0.0,                 mask = False,
           fill_value = 1e+20)
    , kurtosis=-1.5)
Got:
    DescribeResult(nobs=3, minmax=(masked_array(data = 0,
                 mask = False,
           fill_value = 999999)
    , masked_array(data = 2,
                 mask = False,
           fill_value = 999999)
    ), mean=1.0, variance=0.66666666666666663, skewness=masked_array(data = 0.0,
                 mask = False,
           fill_value = 1e+20)
    , kurtosis=-1.5)

ERROR: refguide or doctests have errors

This is an unrelated error?

ok this passes the CI now

No idea about that other error, but it does not seem related anyway. Thanks Alex


[go] Make purl compatible with cdxgen 10.3.x and DT

Now that cdxgen 10.3.0 is released with purl compatibility fixes for go, similar breaking changes must be performed in blint to construct namespace for package names.
https://github.com/owasp-dep-scan/blint/blob/main/blint/sbom.py#L553

2.1.0 release with this fix.


Format jupyter notebooks

We currently lint and fix python files and jupyter notebook but only format python files.
Formatting jupyter notebooks can reuse the infrastructure we use to lint and fix them, it should mostly be a matter of formatting each cell in a loop (being mindful of leading and trailing newlines) and adding a test.

This isn't required for the Beta but it'd be nice to have for the release announcement and such.

I have a working version of this going.


'Create folder' errors for marklogic and couchbase in http interface

In the couchbase mount, when I click on 'Create folder' I get the error:
There was a problem creating the directory: Resource not found

In the marklogic mount, when I click on 'Create folder' I get the error:
There was a problem creating the directory: An unknown error ocurred: 500 "{ \"error\": { \"status\": \"Error persisting uploaded data.\", \"detail\": { \"errors\": [ { \"status\": \"Failed to write data.\", \"detail\": { \"message\": \"Failed to write data: Malformed content URI: /Untitled Folder/temp-dzqCn7oqIf/11e70d9e4c9a65448141fa2ea4c03a59.\", \"data\": { } } } ] } } }"

I haven't tested 'Create folder' for spark. It succeeds for mongo.

Oh, I should probably put this bug report in the slamdata repo.

@alissapajer Is this a root folder within a CB mount? If so, that isn't currently supported. #1740 will address it.

@drostron Yes it's a root folder within a CB mount. If I try to make a folder inside beer-sample, for example, that succeeds.

@alissapajer Ok, then yes, that failure is currently expected. The error message is unfortunately opaque and not helpful.

I was unable to reproduce this issue with Marklogic. I believe the frontend has changed the way it creates new folder since I don't see requests similar to the ones in the issue description. However, I did try your request but Quasar returns 200, no matter how much I try to make it fail
curl -vvv 'http://localhost:20223/data/fs/Untitled%20Folder/temp-dzqCn7oqIf/11e70d9e4c9a65448141fa2ea4c03a59.' -X PUT  -H 'Content-Type: application/json;mode=readable' --data-binary '[{}]'

Is there something missing in my request?
Would you mind helping me reproduce this on Monday (June 19th) @alissapajer?

@jsantos17 I just tested this against quasar 18.5.0 and slamdata v4.2.2-qa-prerelease-7 and I was unable to reproduce. I successfully created new folders in marklogic (xml and json), couchbase, mongo, and spark.
So this can be closed as no longer reproducible.

@zeeiyerWork closing this as not reproducible.


Consider providing a Cargo.lock

Current Rust best practices recommend committing Cargo.lock even for libraries: https://blog.rust-lang.org/2023/08/29/committing-lockfiles.html
Additionally, this makes downstream packaging easier in some places, like nixpkgs, where a Cargo.lock is mandatory for Rust packages.
Since this package is likely to be consumed by non-Rust sources, providing a Cargo.lock feels sensible even under old guidelines.

This is something I was not super clear on: pyrage is meant to be exposed only as a Python library, so I wasn't sure if checking the Cargo.lock file into the repo meant sense. Everything you've said sounds reasonable, though, so I'll add it when I have time.


Try casting structs by name before by position

Which issue does this PR close?
Part of #4908.
Rationale for this change
Supports more flexible struct to struct conversions.
What changes are included in this PR?
Struct to struct cast already works by casting each field by position (to_fields.zip(from_fields)). #5221
This PR adds cast by name method and if cast by name is not possible, it fallbacks to cast by position (current method).
We can first try casting by matching field names if both structs have the same field names and the corresponding fields can be cast. If casting by name is not possible, it can fall back to casting by position.
Are there any user-facing changes?
No breaking api change. But user behavior may change. The struct, that is previously casted via position, could cast by name now.

Alternative is to let the user decide on which approach to use. But, we need to pass cast_struct_by_name as an option to can_cast_type, which is api change.

I'm not sure about this, casting by name comes with its own sets of issues, from performance to potential ambiguity.
I wonder if this is really the right level to be implementing this logic, or whether this really belongs in some sort of higher-level schema adapter.
Tagging @alamb as there is a fair amount of such schema munging logic in DF.
Regardless this is a breaking API change as written

I'm not sure about this, casting by name comes with its own sets of issues, from performance to potential ambiguity.

I agree it is non obvious and this the user should have to explicitly request this behavior

I wonder if this is really the right level to be implementing this logic, or whether this really belongs in some sort of higher-level schema adapter.

I personally think it makes sense in the cast kernel as it is a common operation (e.g. to convert structs with the same fields but in different order)
However that being said, a Struct is basically like a Schema (named fields with types) so I can see the argument that by supporting this type of cast in arrow-rs it will evolve over time into a schema adapter / matching code (e.g. filling out missing columns with NULLs, reordering columns, etc)

Tagging @alamb as there is a fair amount of such schema munging logic in DF.
Regardless this is a breaking API change as written

I agree. I also think it would be nice to avoid a breaking change if not necessary and I don't think it is necessary in this case.
Tto make it not a breaking change I think we could introduce can_cast_types_with_options to mirror cast_with_options  and then control the field level rearranging based on the fields of CastOptions

so I can see the argument that by supporting this type of cast in arrow-rs it will evolve over time into a schema adapter / matching code

Right, and then you're doing potentially non-trivial work per batch, matching columns, etc... as opposed to per-schema. For example DF's SchemaAdapter computes the mapping once and can then apply that to multiple batches.
I guess what I am suggesting is that rather than baking this into the cast kernel, if we add a first-party schema adapter into arrow-rs. Potentially upstreaming the one already in DF with some modifications?

I guess what I am suggesting is that rather than baking this into the cast kernel, if we add a first-party schema adapter into arrow-rs. Potentially upstreaming the one already in DF with some modifications

For anyone interested, here is the API that is in DataFusion (it now even has ASCII art and Examples, thanks to @itsjunetime and myself):

https://docs.rs/datafusion/latest/datafusion/datasource/schema_adapter/struct.DefaultSchemaAdapterFactory.html

We can/should probably change the names and reduce the levels of indirection of we upstreamed this into arrow-rs

100%, but I think the level of complexity that component has grown highlights my concern of trying to shoehorn all of this logic into the cast kernel directly.

We can/should probably change the names and reduce the levels of indirection of we upstreamed this into arrow-rs

100%, and I think the level of complexity that component has grown highlights my concern of trying to shoehorn all of this logic into the cast kernel directly.

I filed https://github.com/apache/arrow-rs/issues/6735 to track this idea

Sorry for all this back and forth @aykut-bozkurt  -- what do you think about the discussion so far?

Sorry for all this back and forth @aykut-bozkurt -- what do you think about the discussion so far?

That makes sense to me. The proposal lets us do even more useful things (e.g. handle missing columns) with hopefully better performance.

Closing as the consensus appears to be to proceed with #6375


Change "choose one" to "choose_one" in languages

The key is incorrectly specified which causes the mutually exclusive
group radio buttons to display "choose_one" instead of the proper
language value like "Choose One".

👍 thanks!


Method to check if pixel is on

It would be nice to have a method that would return a Boolean value if a pixel(x,y) is on or off.
example:
if (lmd.getPixel(x,y)) lmd.setPixel(x,y,false);

I will take this into consideration.

Available in v 0.2.0.


added code to HTML file

This PR adds all of the HTMl we need for the prework study guide application

Added code to HTML file


#729-Fix NPE in FunFactsActivity.java

Description
Replaced Objects#requireNonNull with simple null check. It seems like this is enough to be able to open the fun fact without any problems.
Fixes #729
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

How Has This Been Tested?

[x] ./gradlew assembleDebug assembleRelease
[x] ./gradlew checkstyle

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings

Great @marcoebbinghaus

@Florence-Njeri Please take care of this when adding upward functionality in other activities too


Wrong comment separator in the Javascript script

A comment in the Javascript script was wrongly  identified by the separators <!- and -->. The separators were replaced by /* and */

/* When Tx is ON the red LED image is shown on top of the FT-857 image.
When OFF the image is hidden to display the original image with a green LED  */


Model methods are not available in where closure

When grouping conditions in where() callback query builder loses the context of a model.
This means that it's not possible to use methods like whereHas(), orWhereHas(). It's quite plausible that using query scopes is also not possible.
Example code triggering error:
Route.get('/', async ({ request }) => {
  await User.query()
    .where((builder) => {
      builder.whereHas('tokens')
    })
    .fetch()
})

Error message:

Expected result: fetched users list which have tokens.
I've created repository with the error: https://github.com/radmen/adonis-lucid-missing-where-has

Yes, this is what expected, since the where closure gets the knex query builder chain and not the model query builder.
Can u share what exactly you are trying to achieve here?

Actually, I was posting this issue on behalf of a friend from work.
Here's the exact piece of code which failed for him:
const userProducts = await this.Product
  .query()
  .with('stylist')
  .with('category')
  .with('brand')
  .where('status', 'accepted')
  .where(function () {
    this.whereHas('seasons', (builder) => {
      builder.where('seasons.id', user.season_id)
    })
    .orWhereHas('shapes', (builder) => {
      builder.where('shapes.id', user.shape_id)
    })
    .orWhereHas('styles', (builder) => {
      builder.whereIn('styles.id', userStyleIds)
    })
  })
  .orderBy('created_at', 'desc')
  .fetch()

He tried to fetch only those products which had at least one of related models.
For him, it was quite obvious that it is possible to use whereHas inside grouped where clause.

Sure whereHas should work as expected inside the closure. But my questions is what's the need of wrapping this query inside a closure.
If I get it correctly, it will make similar query to the following.
select * from `products` where `status` = 'accepted' and (where <subqueries>)

But my questions is what's the need of wrapping this query inside a closure.

We wanted to group or clauses. Without it, query could return different results as expected.

Okay makes sense after looking at the orWhere. I’ll post a fix soon


Add trending items for today/week?

Hi, just wondering if daily/weekly trending items can be added other than the popular items listed?

Unfortunately this is not possible, the TMDB API does not provide this type of search. See more at: https://developers.themoviedb.org/3/discover/movie-discover


Implement Exponential Backoff

I am currently using this tool on a website that uses AWS CloudFront to host all their images. However, if you do too many queries to their urls, you will receive a 429 Error that does not provide any Retry After header field. This means that img2dataset will just keep hammering the CloudFront causing the ban to be extended. The only way to still allow images to be downloaded is to have an exponential backoff applied. This is also just good practice when scraping websites so it would be great if it could be included.

Yeah, unfortunately, it is unclear what the limit is. The docs say we
should implement Exponential Backoff which is probably a good policy
uniformly.
On Thu, Jul 20, 2023 at 2:09 PM Romain Beaumont @.***>
wrote:

I'm afraid that will not work if you are scraping a single host. You will
need to scrape slowly.
On Thu, Jul 20, 2023 at 11:07 PM Aaron Gokaslan @.***>
wrote:

I am currently using this tool on a website that uses AWS CloudFront to
host all their images. However, if you do too many queries to their
urls,
you will receive a 429 Error that does not provide any Retry After
header
field. This means that img2dataset will just keep hammering the
CloudFront
causing the ban to be extended. The only way to still allow images to be
downloaded is to have an exponential backoff applied. This is also just
good practice when scraping websites so it would be great if it could be
included.
—
Reply to this email directly, view it on GitHub
https://github.com/rom1504/img2dataset/issues/331, or unsubscribe
<
https://github.com/notifications/unsubscribe-auth/AAR437QZX23KBWWF5563XW3XRGM2VANCNFSM6AAAAAA2R7KQFQ>

.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

—
Reply to this email directly, view it on GitHub
https://github.com/rom1504/img2dataset/issues/331#issuecomment-1644612489,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAPVMX3N42WNXFKHRM4VZODXRGNCHANCNFSM6AAAAAA2R7KQFQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

it does not make sense to implement exponential backoff while maximizing the number of parallel calls.
Simply reduce the number of parallel calls

@rom1504 Depending on the settings of the host though, you could hit the rate limit with non-parallel calls in a extreme case though.

yes, but in that case maybe just do a loop with a wget and a sleep and it'll be simpler and not slower

I am currently using this tool on a website that uses AWS CloudFront to host all their images. However, if you do too many queries to their urls, you will receive a 429 Error that does not provide any Retry After header field. This means that img2dataset will just keep hammering the CloudFront causing the ban to be extended. The only way to still allow images to be downloaded is to have an exponential backoff applied. This is also just good practice when scraping websites so it would be great if it could be included.

It probably means they don't want you to crawl it~

Not necessarily, they just don't want you crawling it that fast. Some websites even send a retry after header to tell you to slowdown and try after x seconds.


docs(operators): add documentation for operator map

Add initial version of documentation for creation operator 'empty'. WIP since JSbin is down and cannot test embedded link.
closes #117

Codecov Report

Merging #153 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #153   +/-   ##
=======================================
  Coverage   88.46%   88.46%
=======================================
  Files           7        7
  Lines          78       78
  Branches        7        7
=======================================
  Hits           69       69
  Misses          6        6
  Partials        3        3

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c3e4561...1f36536. Read the comment docs.

@natmeg 👍

thx for helping review @sumitarora! @natmegs let us know how we can help you get to the finish line!

@ladyleet I pushed a change for the JSbin last night! Is there anything left that I've forgotten? Thanks!

@natmegs can you go ahead and rebase? @sumitarora anything else?

@ladyleet @sumitarora  Alright, I believe the branch is now up to date. If any other changes are needed I'll get them fixed up asap. Thanks for all the help with this one. The next one will be much smoother now!

Woot thanks so much @natmegs for your contribution! :)


Cancelling out of pasture causes crash

logging bug causes app to crash on attempting to log deleted realm obj

submitted for review in 4.0.1 218


export messages to file

hi,
Maybe I'm just being blind, but is there a way to export all queues messages to a file?
I can view the data, but don't see option to export them?

It is a bit hidden. Select multiple messages and then right click.

I hope that answered your question. Reply here if it didn't.


Fix metadata inference with pandas and dask

Prevents Dask from passing pd.NA to the filters for type inference on the scoring and filtering functions. Also fixes some issues with task decontamination working with pandas 2.0 strings and exploding.
With task decontamination, we convert the document text column (dtype=string) to a list of split documents (dtype=object). When calling explode on this column of split documents, the column maintains its object datatype even though now it's only strings. We need to recast the column for newer versions of pandas/dask where string and object are different datatypes.

cc: @rjzamora if you want to take a look


Data Grid Editable Cell not updated after blur

Package name(s)
Data Grid v1.0.0 (@salt-ds/data-grid)
Description
After editing a cell value, clicking away will revert cell value instead of accepting it
Steps to reproduce

Go to data grid storybook
Found "Editable cells" example
Double click any of the editable cell to enter edit mode
Make some changes to the value
Click away to other cells
Cell value reverted to original value

Expected behavior
Cell value changed to new value entered, unless used "Esc" key
Operating system

[X] macOS
[ ] Windows
[ ] Linux
[ ] iOS
[ ] Android

Browser

[X] Chrome
[ ] Safari
[ ] Firefox
[ ] Edge

Are you a JPMorgan Chase & Co. employee?

[X] I am an employee of JPMorgan Chase & Co.

@james-nash  @origami-z  if possible i can work on this ./Assign

@james-nash  @origami-z  if possible i can work on this ./Assign

Feel free to raise a PR and link to this

@origami-z  Raised PR . https://github.com/jpmorganchase/salt-ds/pull/1434 . First PR so not knowing the convention your guidance would be highly appreciated


MacOS Mojave Error with debug using external terminal

Hi,
I'm getting errors when trying to debug with python using the external terminal. This first appears when I upgraded to MacOS Mojave.
I suspect the issue is more to do with security permisions 'somewhere' in the system preferences, but not sure where.
Environment data

VS Code version: 1.28.2
OS and version: MacOS Mojave 10.14
Python version: Python 2.7.10

Actual behavior
When trying to run the debug option the error is

/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/parts/execution/electron-browser/TerminalHelper.scpt: execution error: Not authorised to send Apple events to Terminal. (-1743)

The configs in the launch.json file is
 {       "name": "Python: Terminal (external)",       "type": "python",       "request": "launch",       "program": "${file}",       "console": "externalTerminal",       "stopOnEntry": true     },

Note: We don't directly launch the terminal, VS Code does this.
So, if it still doesn't work please report this upstream.
This works at my end, though I did get the following prompt:


Consider reorganizing the "data" to have init_params subsection at the top level or as a subfolder

In #149


ModuleNotFoundError: No module named 'models.dgcnn'

Hi, you wrote from models.dgcnn import DGCNNDiscriminator in loss_handler.py, but I don't find dgcnn in the models folder?

@yongpan0715 thank you for pointing out the import error!
I just pushed a fix to it, by including the dgcnn model in the models directory. However, keep in mind that the discriminator experiments are not documented in the readme file, nor in the original paper. These were extra experiments I conducted while working on the project, but turned out they were not working as expected.
I'll leave the issue open for now, let me know if the issue has been solved :)


Create DbRef.cs

Source Code Example Reference for the 'DbRef' concept-Data Modelling

It's not clear what this pull request aims to achieve, and it is too old to keep open.


esp_spi.c

I've been trying to get SPI port 1 going on my esp8266 (NodeMCU) board.
I am using esp_spi.c driver from the esp-open-rtos core library.
I configured the pins for SPI port 1 per the pin out in esp_spi.c. The pins on the SPI port do not transition. I don't see the SCLK moving on the scope.
Has anyone used, or is anyone using the esp_spi.c file for SPI transactions on SPI1 port?

I'm using SPI1 with NodeMCU and MAX7456.
NodeMCU pinout:

You can test it with minimal program:
#include "espressif/esp_common.h"
#include "esp/uart.h"
#include "esp/spi.h"

void user_init(void)
{
    uart_set_baud(0, 115200);
    printf("SDK version:%s\n", sdk_system_get_sdk_version());

    const spi_settings_t my_settings = {
	 .mode = SPI_MODE0,
	 .freq_divider = SPI_FREQ_DIV_4M,
	 .msb = true,
	 .endianness = SPI_LITTLE_ENDIAN,
	 .minimal_pins = true
	};
	const char out_data [] = "HELLO WORLD";
	char in_data [sizeof(out_data)];

	spi_set_settings(1, &my_settings);
	while (true)
	{
		spi_transfer(1, out_data, in_data, sizeof(out_data), SPI_8BIT);
		in_data[sizeof(in_data) - 1] = 0;
		printf("Sent: %s, got: %s (", out_data, in_data);
		for (size_t i = 0; i < sizeof(in_data); i ++)
			printf("0x%02x ", in_data[i]);
		printf(")\n");
	}
}

When I run this test, should I still use "esp_spi.c" since the functions you use:
spi_set_settings
spi_transfer
are all defined in esp_spi.c
I did run the test with esp_spi.c included in my project, and I get all "0x00".
What is sent is NOT what is received.
I'm running the test with the module stand alone, nothing else connected to it. Since this is a wraparound test it shouldn't need to be connected to any other device.

Try to short GPIO12 and GPIO13. In terminal you should see something like this:
Sent: HELLO WORLD, got: HELLO WORLD (0x48 0x45 0x4c 0x4c 0x4f 0x20 0x57 0x4f 0x52 0x4c 0x44 0x00 )

@UncleRus I did short GPIO12 and GPIO13 (MISO and MOSI), but I didn't get the same output you're getting.
I'm getting all 0x00 from the the HSPI port.

Please note that I did compile file esp_spi.c with my project.

Where can one find the actual detailed reference guide for the esp8266 processor?
I haven't seen any reference guide that has details on register mappings and how each module works.

@UncleRus ... I read your previous comments and compiled the simple example with the code you provided. It is working!
I had taken the esp_spi.c file in core.c and built it as part of my project. I think I confused the linker since, the files in the esp-open-rtos core folder are actually built as a library. The functions I was calling weren't doing anything because they weren't liking to the "core" library.
I will remove esp_spi.c from my project.
Thanks for your help.

This is an old thread but wonder if anyone has got code working on an ESP32 and MAX7456?


Ctrl-click on link opens browser

It'd be nice to be able to ctrl-click on a link, image or email address and have the corresponding app open...

Notice: This plugin is no more maintained and it has been removed from Jetbrains plugins repository. There is a Markdown plugin officially supported by Jetbrains.


Add shift+space support for keyboard

Hello @noraesae , native scrollbars have shift+space keymap for scrolling upwards so I thought it might be good to have that in perfect-scrollbar as well.

Great work. Thanks!


Could not decode message - error unpackb() got an unexpected keyword argument 'encoding'

So I am working with the general spider in the example dir.
I am using the disributed mode as described in the docs here.
Everything seems to start and work ok.

However the spider on encountering the URL triggers the following error.
error unpackb() got an unexpected keyword argument 'encoding'

As you can see there is some encoding/decoding issue ?
I have tried to

reinstall msgpack
re add seeds

Working with Ubuntu 18

@incognitozen Have you tried installing older version of msgpack (e.g. 0.6.2)?


GIF Support

Is there any plans to support GIFs?

You can make your own extension for UIImage and adopt UIImage for SKPhoto, what the problem?
SKPhoto.photoWithImage(UIImage.gifWithData(NSData(

gifWithData must be another extension? I've found a working framework to do this. Didn't know it was that simple aha.


Error - Unable to get Characteristic in Mac OS environment

I am unable to get the app working successfully. Running homebridge on an M1 Mac Mini. I have gone into terminal and installed python-kasa library and confirmed that it is running in terminal, but I am still getting three errors for error getting characteristic 'xxx' where xxx is brightness, hue/saturation, and on.
Do I need to tell the homebrige ui to look for Python-kasa somehow? Appreciate any help

This plugin just needs to be able to execute commands from the python-Kasa library. I’d start with confirming you can control your device using the commands from that library.
https://github.com/python-kasa/python-kasa

Hello and sorry for the delay. Life became quite busy and I didn’t have time to attempt making this work until recently.
I appreciate the reply before but perhaps I am confused about the process to get it working so let me explain more.
I am running this from my M1 Mac mini. I have installed the Kasa python library using the Mac’s terminal and can run commands there.
What I don’t understand is should I be installing python as a plug-in for homebridge? With running it from the max it seems like python will only run in that specific terminal window.
So to make things easier, I went out and got a raspberry pi instead. I am running the latest version of pi os and setup homebridge as a service. I have installed the Kasa strip plugin through the homebridge gui. I went into terminal and ran pip3 install Kasa-python and it installs the library. So far so good. I then type Kasa into the terminal and it tells me command not recognized 🤦
Please forgive me as the workings of python are still new to which might explain why I had issues on both devices.


[HOLD] New marker appears when clicking on the message option in the details page

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open the chat screen for userA and userB
sent message from userA to userB
click on name of userA in userB screen(it will show user details)
click on message option in details page

Expected Result:
should not show New marker
Actual Result:
New marker appears
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[ ] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: 1.2.44-0
Reproducible in staging?: y
Reproducible in production?: y
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos:
https://user-images.githubusercontent.com/43996225/209850004-890dd206-4e4e-4d94-a7c7-4177f506f004.mov
https://user-images.githubusercontent.com/43996225/209850032-30cdff51-9476-45db-9e5b-64a1317883df.mp4
Expensify/Expensify Issue URL:
Issue reported by: @gadhiyamanan
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1672147098865319
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~01782e2f06bca03f51
Upwork Job ID:<PHONE_NUMBER>366911488
Last Price Increase: 2022-12-28

this does aound like a bug, it might be affected by the changes to the sequenceNumber though. I will take this

I feel this should be internal regardless as there might be some Web work (I don't think so atm but it's possible)

will probably only work on it next week

Yep will work on this week

Probably tomorrow

Hmm, I think we need to wait for the sequence number deprecation to finish before we review this one.
Setting this to Hold, and weekly while we wait for that.

Here's the depreciate sequence numbers tracking issue - https://github.com/Expensify/Expensify/issues/227234
looks like this is still in the works so keeping this on hold

Deprecated sequence number is still WIP, seems closet to being finished though

I think sequence numbers is finished meaning we can probably remove this from hold

@Christinadobrzyn can you try to reproduce with the latest version?

[ ]  Android / native
[ ]  Android / Chrome
[X]  iOS / native v1.2.67-7
[X]  iOS / Safari v1.2.68-0
[X]  MacOS / Chrome / Safari v1.2.68-0
[X]  MacOS / Desktop v1.2.66-0

Action Performed:

Open the staging chat screen for userA and userB
sent message from userA to userB
click on name of userA in userB screen (it will show user details)
click on message option in details page
check to see if I get a 'new message' marker in the chat  > I did not

Result
I am not getting the new message marker

We don't have a C+ on this right? I can just pay out the @gadhiyamanan as the reporter if this is good to close!

That sounds good

Created job in Upwork:
Internal posting - https://www.upwork.com/ab/applicants/1623928469866430464/job-details
External posting - https://www.upwork.com/jobs/~01b2a651de89bc994f
Hired @gadhiyamanan as reported. Let me know when you've accepted the job and I'll pay you!

@Christinadobrzyn accepted

I believe we also need to do this checklist (at least the Test Rail step) - @sketchydroide let me know if I'm wrong.
BugZero Checklist: The PR fixing this issue has been merged!
[@sketchydroide] The PR that introduced the bug has been identified. Link to the PR:
[@sketchydroide] The offending PR has been commented on, pointing out the bug it caused and why, so the author and reviewers can learn from the mistake. Link to comment:
[@sketchydroide] A discussion in #expensify-bugs has been started about whether any other steps should be taken (e.g. updating the PR review checklist) in order to catch this type of bug sooner. Link to discussion:
[@sketchydroide & @Christinadobrzyn] Propose regression test steps to ensure the same bug will not reach production again.
[@Christinadobrzyn] Link the GH issue for creating/updating the regression test once above steps have been agreed upon:

Paid @gadhiyamanan 🎉 Closed the upwork job

Sorry, working on a regression test.

reached out for Regression Test Buddy check - https://expensify.slack.com/archives/C01SKUP7QR0/p1677056787584049

Regression Test GH request here - https://github.com/Expensify/Expensify/issues/263913
closing!


Update gitopsclusters CRD

[x] I have taken backward compatibility into consideration.

Sync https://github.com/open-cluster-management-io/multicloud-operators-subscription/pull/347 from upstream.

/lgtm


Release version 1.0.5

Thinking about why we ran into an already solved problem (#29), I observed that the last release downloadable from the website (1.0.4) is almost 3 years old.
Would it be worthwhile to release 1.0.5, given that some viable changes happened since then?

Same here. Anything I can do to help?

NPM has version 1.0.5 in it, but as mentioned, not the github release history.


Replace transparent proxy

Hrrmmmm. We account for that here: https://github.com/harvard-lil/scoop/pull/131/files#diff-e55f19734d7ccaefd7f79d8b8f0addc8bdfe78b02dc30e6cd0be65f08d85326eR37-R39
But it's disconcerting how high that number gets and it does feel more and more like it might be a memory leak. Trying to think about how to think about that.

🫡


zfs: 2.1.12 -> 2.1.13

Description of changes
https://github.com/openzfs/zfs/releases/tag/zfs-2.1.13
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

2.1.13 supports Linux 6.5 while 2.2.0-rc only supports Linux 6.4.

Aside: how does one overlay the kernel modules? I’ve used commit as an overlay for zfs in Nixpkgs, but ran into issues compiling the kernel which is pulling in a version from the original Nixpkgs. I tried pkgs.linuxPackages_x.extend (final: prev: { zfs = …; }). This built, but that followed up with extraModulePackages missing zfs. Added, zfs but then got this error:
error: builder for '/nix/store/bhifa6fz4m2j7sgcifhzjb4dw2d1bsf5-linux-6.5.5-modules-shrunk.drv' failed with exit code 1;
       last 10 log lines:
       >   copying dependency: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/drivers/gpu/drm/amd/amdgpu/amdgpu.ko.xz
       > root module: kvm-amd
       >   copying dependency: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/virt/lib/irqbypass.ko.xz
       >   copying dependency: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/arch/x86/kvm/kvm.ko.xz
       >   dependency already copied: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/drivers/base/firmware_loader/firmware_class.ko.xz
       >   dependency already copied: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/drivers/char/hw_random/rng-core.ko.xz
       >   copying dependency: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/drivers/crypto/ccp/ccp.ko.xz
       >   copying dependency: /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5/kernel/arch/x86/kvm/kvm-amd.ko.xz
       > root module: zfs
       > modprobe: FATAL: Module zfs not found in directory /nix/store/q244lms4jggjab57mlvsgncdqmg5lgrh-linux-6.5.5-modules/lib/modules/6.5.5
       For full logs, run 'nix log /nix/store/bhifa6fz4m2j7sgcifhzjb4dw2d1bsf5-linux-6.5.5-modules-shrunk.drv'.

Thanks! I can confirm that this works, rocking it now. A new AMD GPU on a system with ZFS is now possible :smile:
Had to search a bit for what was needed to run this. For posterity:
git clone -b the-pull-request-branch --depth 1 url-of-nixpkgs
sudo nixos-rebuild -I nixpkgs=/path/to/cloned/nixpkgs switch

Thanks! I can confirm that this works, rocking it now. A new AMD GPU on a system with ZFS is now possible 😄
Had to search a bit for what was needed to run this. For posterity:
git clone -b the-pull-request-branch --depth 1 url-of-nixpkgs
sudo nixos-rebuild -I nixpkgs=/path/to/cloned/nixpkgs switch

For posterity:
sudo nixos-rebuild -I nixpkgs="https://github.com/adamcstephens/nixpkgs/archive/94146957746e894891d3932423449c0d9d7577e0.tar.gz" switch

should probably also work ;).

Is boot broken with this? Pool doesn't seem to be importing on my end.

Not sure if related, but I have
error: builder for '/nix/store/xlwrxh9ad4bfdn531z3kvz1qkcnn3jl7-kernel-modules.drv' failed with exit code 25;
       last 1 log lines:
       > error: collision between `/nix/store/w71j5py9q6wlpaqmnjpna07b6k2q1485-zfs-kernel-2.1.13-6.5.5/lib/modules/6.5.5/extra/spl/spl.ko.xz' and `/nix/store/3jl326y3mx07cf7nfb06y80r6j2jwq72-zfs-kernel-2.1.13-6.5.5/lib/modules/6.5.5/extra/spl/spl.ko.xz'

I can confirm that using the ZFS kernel module from master works on linuxPackages_xanmod_stable. However, I'm finding you have to compile the whole Xanmod kernel, manually.
I may switch to stock Linux whilst I wait for this bump to either hit unstable or 23.05. It wasn't working in 23.05 or unstable (Xanmod and ZFS) last time I tried, which was this evening.
Have to admit, I don't really like using Git/unstable for kernels, but with the lack of a similar construct like this for Xanmod, I think I'll have to stick with it. Maybe lock Nixpkgs in my Flake.


How to get predictions for realtion extraction task using SciBERT

I tried to get predictions in that way:
allennlp predict out-1/model.tar.gz text.txt --include-package scibert
but i get error saying
allennlp.common.checks.ConfigurationError: 'No default predictor for model type text_classifier.\nPlease specify a predictor explicitly.'
Is there any way to get predictions for trained model / what allennlp predictor should i use?

can you try adding the argument --use-dataset-reader to your command line?

Getting same issue, with and without the --use-dataset-reader argument. Using google colab for training as detailed here. Trying to run the predict command as follows:
!echo '{"text":"the hip bone is connected to the leg bone."}\n' > dummydata.txt
!python -m allennlp.run predict --include-package scibert --use-dataset-reader modeltest0/model.tar.gz dummydata.txt

Which produces the following traceback:
2019-08-15 19:10:37,221 - INFO - allennlp.nn.initializers -    text_field_embedder.token_embedder_bert.bert_model.pooler.dense.weight
Traceback (most recent call last):
  File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/content/scibert/src/allennlp/allennlp/run.py", line 21, in <module>
    run()
  File "/content/scibert/src/allennlp/allennlp/run.py", line 18, in run
    main(prog="allennlp")
  File "/content/scibert/src/allennlp/allennlp/commands/__init__.py", line 101, in main
    args.func(args)
  File "/content/scibert/src/allennlp/allennlp/commands/predict.py", line 187, in _predict
    predictor = _get_predictor(args)
  File "/content/scibert/src/allennlp/allennlp/commands/predict.py", line 101, in _get_predictor
    return Predictor.from_archive(archive, args.predictor)
  File "/content/scibert/src/allennlp/allennlp/predictors/predictor.py", line 157, in from_archive
    raise ConfigurationError(f"No default predictor for model type {model_type}.\n"\
allennlp.common.checks.ConfigurationError: 'No default predictor for model type bert_text_classifier.\nPlease specify a predictor explicitly.'
2019-08-15 19:10:37,659 - INFO - allennlp.models.archival - removing temporary unarchived model dir at /tmp/tmpygi3zk4o

Looks like you need to add a dummy predictor for it to work, something like:
@Predictor.register('dummy_predictor')
class DummyPredictor(Predictor):
    pass

then in the command line add --predictor dummy_predictor

Thanks for your reply on this issue. I had deleted my comment because I think I solved the problem by explicitly specifying the predictor with --predictor text_classifier in the command line.


Rebuild for Python 3.7, GCC 7, R 3.5.1, openBLAS 0.3.2

Fixes #12

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.


Log output seems to be going to stderr

Not really a bug or feature request, but it would be nice to not have non-error output to go to stderr and thus be categorized as error output. This is an example from GCP showing successful health checks and tasks are logged as error:

Hi @c0bra,
Thanks for raising this issue, too 😉
And yes, indeed it would be nicer


kong 3.1.1 SSE once return

Is there an existing issue for this?

[X] I have searched the existing issues

Kong version ($ kong version)
3.1.1
Current Behavior

this is my nginx-kong.conf but  server return data once,not sse ,like this

how to do it.(kong 2.7 is work ,but kong 3.1.1 not work)
Expected Behavior
No response
Steps To Reproduce

Anything else?
kong 2.7 is work

hello, the description in your question is too vague for us to understand what happened in detail.
Making a smallest reproduce step is necessary for us (may be including some commands like curl and kong config).

proxy_cache off;  # Turn off caching
proxy_buffering off;  # Turn off proxy buffering
chunked_transfer_encoding on;  # Turn on chunked transfer encoding
tcp_nopush on;  # Turn on TCP NOPUSH option, disable Nagle algorithm
tcp_nodelay on;  # Turn on TCP NODELAY option, disable delay ACK algorithm
keepalive_timeout 300;  # Set keep-alive timeout to 65 seconds


feat: template inheritance

This PR makes it possible to extend a template with another template by adding a configuration file, .tk-config.json with the following content:
{
  "extends": "../path-to-other-template"
}

So with the following structure:
templates
├── vite-app
│   ├── index.html
│   ├── main.js
│   ├── package.json
│   ├── package-lock.json
│   └── style.css
└── vite-app-2
    ├── index.html
    └── .tk-config.json

The content of vite-app-2 and vite-app will be identical except for the index.html which will be the one living in vite-app.
Notes

Because this is a path, it's also possible to do something like ../../node_modules/tuto-templates/foo. So this means that if you have fixed templates that lives somewhere else, you can extend them. They won't be watched by the watcher though, so if they change it won't be reflected.
This PR technically  also adds support for _files and _solution because it made the code simpler. It might be something people want to use in the future though so this is probably a good thing?
:point_right: This PR also refactored a bit the webcontainer-files.ts a bit with extra tests to make it easier to maintain this code.

@AriPerkkio That is indeed a lot!! :exploding_head: :exploding_head:
Your PR alone really show how useful this feature is! Thanks for suggesting it :raised_hands:


coredump when run calc_server

#0  0x0000000000418961 in SimpleLoggerMgr::logStackBacktrace(unsigned long) at /home/xmly/NuRaft/examples/logger.cc:390
#1  0x0000000000418f74 in SimpleLoggerMgr::handleSegAbort(int) at /home/xmly/NuRaft/examples/logger.cc:451
#2  0x00000000000366d0 in __restore_rt() at sigaction.c:?
#3  0x00007f381686164b in gsignal() at ??:0
#4  0x00007f3816863450 in abort() at ??:0
#5  0x00007f38173da055 in _ZN9__gnu_cxx27__verbose_terminate_handlerEv() at ??:0
#6  0x000000000008fc46 in __cxxabiv1::__terminate(void ()()) at /usr/src/debug/gcc-7.1.1-20170622/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/libsupc++/../../../../libstdc++-v3/libsupc++/eh_terminate.cc:51
#7  0x000000000008fc91 in std::terminate() at ??:?
#8  0x000000000008fed4 in __cxa_throw() at ??:?
#9  0x000000000043b1ae in void asio::detail::throw_exceptionstd::system_error(std::system_error const&) at ??:?
#10 0x000000000043b482 in asio::detail::do_throw_error(std::error_code const&, char const) at /home/xmly/NuRaft/asio/asio/include/asio/detail/impl/throw_error.ipp:49
#11 0x00000000004341c3 in asio::detail::throw_error(std::error_code const&, char const*) at /home/xmly/NuRaft/asio/asio/include/asio/detail/throw_error.hpp:41
#12 0x0000000000423aba in std::__shared_count<(__gnu_cxx::_Lock_policy)2>::_M_swap(std::__shared_count<(__gnu_cxx::_Lock_policy)2>&) at /usr/include/c++/7/bits/shared_ptr_base.h:710
#13 0x000000000040adc7 in calc_server::init_raft(std::shared_ptrnuraft::state_machine) at /home/xmly/NuRaft/examples/example_common.hxx:183
#14 0x0000000000409148 in std::__shared_count<(__gnu_cxx::_Lock_policy)2>::~__shared_count() at /usr/include/c++/7/bits/shared_ptr_base.h:681
#15 0x00007f381684b4da in __libc_start_main() at ??:0
#16 0x000000000040977a in _start() at ??:?

Hi @michaelqxd ,
Thanks for bringing this issue, but unfortunately this stack dump itself doesn't help much.
Can you please elaborate more? At which step in here you got crash? Which OS did you run?
Apart from that, if we put wrong IP address and port, we'll see this stack trace.


ARROW-13568: [Gandiva] Support null data type for gandiva.

10884

 Quality gate: Passed
3 Issues

 3 Code issues

Details

 Quality gate: Failed
 Everything looks good
Details


Bell message missing value for claim winnings

Just claimed roughly $250 from claim proceeds....$115 was profit
The message also shows the wrong winning outcome
The bell message only shows a dash and not the value...

this is alert data:

This Is Fixed -closing


partial results are overwritten

The tutorial for running the initial scan says: "The partial results from the previous step are stored in assoc0file.startSnp_..matrix" Actually, this is not the case and all batch processes write to the same file specified with --assoc0file

Hi Matthias,
thanks a lot for trying out our software. I am really sorry that you are running into problems (again).
I am not sure if I understand completely why the files are overwritten. While it is true that the filename is specified with --assoc0file, the filenames are startSnp dependent: $ASSOC0FILE.startSnp_$i. I just tried it again on my computer and it generates the files:
lmm.startSnp_0..matrix
lmm.startSnp_10000..matrix
...
lmm.startSnp_*.matrix
which are then merged in the next step. In which file are your results written?
Best,
Barbara
P.S.: we also generalized the phenotype file reader such that any delimiter works.

Hi Barbara,
the files are all written to assoc0file without adding the suffix. Have you done any updates in the meantime? I am rerunning now and appending the suffix to the assoc0file  argument myself..
Best,
Matthias

Am 18.05.2016 um 21:13 schrieb brakitsch<EMAIL_ADDRESS>Hi Matthias,
thanks a lot for trying out our software. I am really sorry that you are running into problems (again).
I am not sure if I understand completely why the files are overwritten. While it is true that the filename is specified with --assoc0file, the filenames are startSnp dependent: $ASSOC0FILE.startSnp_$i. I just tried it again on my computer and it generates the files:
lmm.startSnp_0..matrix
lmm.startSnp_10000..matrix
...
lmm.startSnp_*.matrix
which are then merged in the next step. In which file are your results written?
Best,
Barbara
P.S.: we also generalized the phenotype file reader such that any delimiter works.
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub

Hi Matthias,
you were right and my description was indeed confusing. I added the suffixes by hand in the example usagel/ demo script and assumed in the tutorial that the user did this as well. I modified the code such that the suffixes are now automatically added in all steps.
Please let me know if you have any further problems.
Best,
Barbara


Update brats_segmentation_3d.ipynb

For "AsDiscrete", the argument "threshold" leads to an "unexpected argument" Type Error. I think the correct argument is "threshold_values"
Fixes # .
Description
A few sentences describing the changes proposed in this pull request.
Status
Ready/Work in progress/Hold
Checks

[ ] Notebook runs automatically ./runner [-p <regex_pattern>]

Hi @tommydino93 ,
Thanks for your interest here.
threshold is a slightly breaking change in MONAI v0.8, I think maybe you tested the tutorial with an older MONAI.
Could you please help try again with MONAI v0.8?
Thanks in advance.


how to configure mutiple api_domain for one project?

in .env file,there's a field named API_DOMAIN for dingo, but how to configure mutiple domains in one project?

i don't want to use API_PREFIX

origin laravel route support domain and rewrite app('api.router')


Make run-ios command play nicely with multiple Xcode versions

I started using Xcode 10 beta and spotted that even though react-native cli is using cli tools from Xcode 10 for building it tries to open simulator from Xcode 9.4. Turned out that path to simulator app is hardcoded and doesn’t care about active developer directory.
Test Plan

You have to have more than one Xcode version (ie. 9.4 and 10 beta).
Change active developer directory to Xcode beta (xcode-select -s /Applications/Xcode-beta.app/Contents/Developer).
Without fix react-native run-ios will open simulator from Xcode 9.4, with fix it'll open simulator from active developer directory.

Release Notes
[CLI][IOS] [BUGFIX] [./local-cli] - use simulator from active developer directory

Warnings

:warning:

:clipboard: Release Notes - This PR may have incorrectly formatted Release Notes.

  Generated by :no_entry_sign: dangerJS

This is great. I actually just ran into this snag myself.


Do not package tests

Checklist

[X] Used a personal fork of the feedstock to propose changes
[X] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[X] Ensured the license file is being packaged.

Same as https://github.com/napari/magicgui/pull/365

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.


Set default value for disable_shared_pid

Sharing PID namespace for Docker is enabled by default only in
Kubernetes 1.7. Explicitily disabling it by default could help reduce
unexpected results when upgrading to or downgrading from 1.7.

This change is being reverted with kubernetes 1.8 https://github.com/kubernetes/kubernetes/pull/51634 . I'm not sure on the appropriate way to handle this setting.

Yeah..pid namespace sharing is enabled by default until 1.6 and disabled in 1.7, and then enabled again in 1.8. Actually, we wasted one day for finding this when we upgraded from 1.6 to 1.7. This patch will keep the configuration enabled for others who don't care about it.

ci check this


Storymode button loads a week

Describe your problem here.
I'm trying to modify the main menu so that the story_mode button loads week 6 instead of the story mode menu.
For some reason it repeatedly crashes during the transition. (This image was taken in MainMenuState.hx), also attemption to make it load the week in hard mode.

Are you modding a build from source or with Lua?
Source
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
Changed the options in the main menu

I guess you can try directly loading the song instead of doing it from the custom week.

oh ye

but what about the other songs in the week?

and loading the song directly doesn't seem to work either


[Feature Request] Pagination pages as Link ()

Is your feature request related to a problem? Please describe.
No.
Describe the solution you'd like
To make it SEO friendly, it would be a good idea to be able to use pagination buttons as links so that crawler can follow them.
Describe alternatives you've considered
None.
Screenshots or Videos
No response

Hey please update to v2 https://nextui.org/blog/nextui-v2
https://nextui.org/docs/components/pagination#custom-items


btop: 1.2.13 -> 1.3.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/project/btop/versions.
meta.description for btop is: A monitor of resources
meta.homepage for btop is: https://github.com/aristocratos/btop
meta.changelog for btop is: https://github.com/aristocratos/btop/blob/v1.3.0/CHANGELOG.md
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.3.0 with grep in /nix/store/3dra0wks8ds96rnncixn74aafx0fm58y-btop-1.3.0
found 1.3.0 in filename of file in /nix/store/3dra0wks8ds96rnncixn74aafx0fm58y-btop-1.3.0

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
btop

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/3dra0wks8ds96rnncixn74aafx0fm58y-btop-1.3.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A btop https://github.com/r-ryantm/nixpkgs/archive/fcfec2be67eac9bdc7d5153c91d72a4a1eccff7b.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/fcfec2be67eac9bdc7d5153c91d72a4a1eccff7b#btop

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/3dra0wks8ds96rnncixn74aafx0fm58y-btop-1.3.0
ls -la /nix/store/3dra0wks8ds96rnncixn74aafx0fm58y-btop-1.3.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

btop

Maintainer pings
cc @rmcgibbo for testing.

It says in the changelogs that the newly added gpu support is not activated in the binaries they provide, but must be compiled in.
I'm just curious if this necessitates some config changes in the package.
In the readme it says the following:

GPU compatibility
Btop++ supports NVIDIA and AMD GPUs out of the box on Linux x86_64, provided you have the correct drivers and libraries.
Compatibility with Intel GPUs using generic DRM calls is planned, as is compatibility for FreeBSD and macOS.
Gpu support will not work when static linking glibc (or musl, etc.)!
For x86_64 Linux the flag GPU_SUPPORT is automatically set to true, to manually disable gpu support set the flag to false, like:
make GPU_SUPPORT=false (or cmake -DBTOP_GPU=false with CMake)
NVIDIA

You must use an official NVIDIA driver, both the closed-source and [open-source](https://github.com/NVIDIA/open-gpu-kernel-modules) ones have been verified to work.

In addition to that you must also have the nvidia-ml dynamic library installed, which should be included with the driver package of your distribution.

AMD

AMDGPU data is queried using the [ROCm SMI](https://github.com/RadeonOpenCompute/rocm_smi_lib) library, which may or may not be packaged for your distribution. If your distribution doesn't provide a package, btop++ is statically linked to ROCm SMI with the RSMI_STATIC=true make flag.

This flag expects the ROCm SMI source code in lib/rocm_smi_lib, and compilation will fail if it's not there. The latest tested version is 5.6.x, which can be obtained with the following command:

 git clone https://github.com/RadeonOpenCompute/rocm_smi_lib.git --depth 1 -b rocm-5.6.x lib/rocm_smi_lib

For the GPU support to work, I think this is what should be added to the derivation.
  nativeBuildInputs = [
    addOpenGLRunpath
  ];

  postFixup = ''
    addOpenGLRunPath $out/bin/btop
  '';

That at least makes it work on my system with an Nvidia GPU.  I don't have a machine with an AMD to test this on.

Superseded by https://github.com/NixOS/nixpkgs/pull/281155

For the GPU support to work, I think this is what should be added to the derivation.
  nativeBuildInputs = [
    addOpenGLRunpath
  ];

  postFixup = ''
    addOpenGLRunPath $out/bin/btop
  '';

That at least makes it work on my system with an Nvidia GPU. I don't have a machine with an AMD to test this on.

I'm on an AMD system and this did not work. I also tried adding rocm-smi to buildInputs .


Rename step.nextTitle for pf-wizard

Original comment this issue in the openshift web console.
It would be helpful to rename this:
step.nextTitle = 'Foo';

to something like:
ctrl.nextButtonText = 'Foo';

Perhaps something less verbose but more clear.  "Next Title" seems to imply it will be the title for the next step panel, when in fact, it is the text on the button in this panel, but clicking it will progress the user to the next step in the wizard.
Open to thoughts, I just find this name a bit misleading.

I'm not certain changing this at this time is warranted as it will break any previous uses. You can still use ctrl.nextButtonText and in the html use next-title="$ctrl.nextButtonText".
If you feel differently, please re-open.


bug: card modal does not remove safe area padding

Current behavior:

Opening a card modal in a Cordova/Capacitor app still shows the ion-header with safe area padding
Expected behavior:

Card modals should not have safe area padding applied since they are not near the edge of the screen.

Ideally we could do something like:
:host(.modal-card) ion-header ion-toolbar:first-of-type {
  padding-top: 0px;
}

but because ion-modal is a scoped component, the header and toolbar get the modal scope classes applied to it which is not desired functionality. The output selector is:
.modal-card.sc-ion-modal-ios-h ion-header.sc-ion-modal-ios ion-toolbar.sc-ion-modal-ios:first-of-type  (notice the header and toolbar receives .sc-ion-modal-ios)
As a workaround, developers can do the following in their modal's css:
ion-header ion-toolbar:first-of-type {
  padding-top: 0px;
}


Black borders on all videos

All the videos that I watch are with these black borders. I have reseted the YouTube Center settings but still the same.

Browser: Chrome 47.0.2526.80 m (64-bit)
YouTube Center version: Developer Version (Build 535)  (YouTubeCenter.crx)
Debug: https://gist.github.com/0fcdbbe089931843008e

+1
Browser name: Chrome
Browser version: 47.0.2526.80 m (64-bit)
Browser engine: Blink, I think? ^^
YouTube Center version: Developer Version - Build #535
Addon type: Chrome extension
Debug log: https://gist.github.com/5c0a412967d02233890a
Issue description:

How to reproduce the issue:
just import these settings:
https://gist.github.com/8721b9f20e05cfbbbf13

Go to Settings -> Player -> General and change Auto-hide bar to Both progressbar & controlbar.

@YePpHa
Thanks for the fix, it works now.
However, speaking of the auto-hide bar option. It seems to do nothing on the site. All options result in the same: Whole controls being hidden or visible based on mouse-over.
Not sure if I should really open a new issue for that, but worth a side note.

@YePpHa Thank you :-)


Wrong instructions?

If I follow the instruction.md correctly you end up with a project root folder with Makefile and /src /lib /bin
subfolders. However running make gives this:
Arduino.mk Configuration:
- [AUTODETECTED]       CURRENT_OS = LINUX
- [USER]               ARDUINO_DIR = /usr/share/arduino
- [USER]               ARDMK_DIR = /home/ppetrov/Documents/arduiono_example/Arduino-Makefile
- [AUTODETECTED]       ARDUINO_VERSION = 105
- [DEFAULT]            ARCHITECTURE =
- [DEFAULT]            ARDMK_VENDOR = arduino
- [DEFAULT]            ARDUINO_SKETCHBOOK =
- [USER]               AVR_TOOLS_DIR = /usr
- [COMPUTED]           ARDUINO_LIB_PATH = /usr/share/arduino/libraries (from ARDUINO_DIR)
- [COMPUTED]           ARDUINO_VAR_PATH = /usr/share/arduino/hardware/arduino//variants (from ARDUINO_DIR)
- [COMPUTED]           BOARDS_TXT = /usr/share/arduino/hardware/arduino//boards.txt (from ARDUINO_DIR)
- [USER]               USER_LIB_PATH = /home/ppetrov/Documents/arduiono_example/lib
- [DEFAULT]            PRE_BUILD_HOOK = pre-build-hook.sh
- [USER]               BOARD_SUB = atmega328P
- [USER]               BOARD_TAG = uno
- [COMPUTED]           CORE = arduino (from build.core)
- [COMPUTED]           VARIANT = standard (from build.variant)
- [USER]               OBJDIR = /home/ppetrov/Documents/arduiono_example/bin/arduiono_example/uno
- [COMPUTED]           ARDUINO_CORE_PATH = /usr/share/arduino/hardware/arduino//cores/arduino (from ARDUINO_DIR, BOARD_TAG and boards.txt)
/home/ppetrov/Documents/arduiono_example/Arduino-Makefile/Arduino.mk:780: *** At least one source file (*.ino, *.pde, *.cpp, *c, *cc, *.S) is needed.  Stop.

which makes sense since no source file in project root, did I miss something?

you have to run make in ./src/myProject

like from here https://github.com/ladislas/Bare-Arduino-Project/tree/master/src/BarProject

Thanks, that did it. But running then 'make upload' from same dir produces:
/usr/bin/avrdude -q -V -p atmega328p -C /usr/../avrdude.conf -D -c arduino -b 115200 -P /dev/ttyUSB0
-U flash:w:/home/ppetrov/Documents/arduiono_example/bin/FooProject/uno/FooProject.hex:i
avrdude: can't open config file "/usr/../avrdude.conf": No such file or directory
I fixed it manually, by pointing to /etc/avrdude.conf
still my board times out when flashed, not sure whether I need different .conf file for this specific board 'BQ ZUM Core'.

yeah, i've seen this error with avrdude before. sometimes it happens on linux and people need to fix it by hand.
I don't use linux so I can't help, but you might find something here: https://github.com/sudar/Arduino-Makefile/issues?utf8=✓&q=avrdude conf

Same issue on Ubuntu 16.04. Just add this to the Makefile:
AVRDUDE_CONF = /etc/avrdude.conf


[Enhancement] Please support uwp

This repo is awesome and I used it well
But.. I want to use this in my UWP project
Pease support
I hope to your reply

Hey @JaeWLee ,
Thanks for the feedback we are glad you enjoy using the plugin, right now we don't have in plans developing support for uwp, but we are definitely open to PR contributions to the project if anyone would like to take on this challenge :) 👍

I want to try implement for UWP, for before I want to update the nuget packages

Yes, Please support UWP!


tilix: 1.8.1 -> 1.8.3

Motivation for this change
Update to newest version of tilix.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Fits CONTRIBUTING.md.

No attempt on aarch64-linux (full log)
The following builds were skipped because they don't evaluate on aarch64-linux: tilix
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

$ tilix
Library libsecret-1.so.0 cannot be loaded, related functionality will not be available

it probably wants libsecret in its LD_LIBRARY_PATH.

Yes, libsecret is an optional dependency.
I added libsecret to the LD_LIBRARY_PATH.

No attempt on aarch64-linux (full log)
The following builds were skipped because they don't evaluate on aarch64-linux: tilix
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Attempted: tilix
Partial log (click to expand)
Wrapping program /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3/bin/tilix
Wrapping program /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3/bin/.tilix-wrapped
shrinking RPATHs of ELF executables and libraries in /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3
shrinking /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3/bin/..tilix-wrapped-wrapped
gzipping man pages under /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3/share/man/
strip is /nix/store/553rihc190vsyy8b22iqcq25a6489h8y-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3/bin
patching script interpreter paths in /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3
checking for references to /build in /nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3...
/nix/store/5h65llhsm2l1lp63wa70zfdv7jixg20w-tilix-1.8.3


feat(upgrade-job): add helm value set for jaeger-operator update

Requires PR 473

bors merge

bors merge

bors merge

bors merge


Version 2: i18n support

while i'm unable to actually do additional translations, i18n support should be added in the event that someone else would like to add support for their own languages

the ui itself isn't too bad, but a pass will need to be done to figure out how to efficiently handle strings for default options (speeds, skills, etc.)

initial support has been added. there's a lot more strings in here than i thought. will need to work through some issues if someone wants to translate, but the capability is there, just let me know!


DynamicCam v2.8.1 Error report: (Situation: Mounted (only airborne + Skyriding).Condition Script)

Error Message:
Error: Mounted (only airborne + Skyriding) (106), condition, runtime
Interface/AddOns/DynamicCam/SituationManager.lua:1009: attempt to call global 'UnitBuff' (a nil value)

I got the same error:
Error: Mounted (only Skyriding) (107), condition, runtime
Interface/AddOns/DynamicCam/SituationManager.lua:1009: attempt to call global 'UnitBuff' (a nil value)

Thanks for reporting. Should be fixed with release 2.8.2.


Add reset password page

Frontend functionality works fine. I mean the validation part. I tested "handleSubmit" function with a console.log(). It works. I mean the form submits only if the data entered is valid. In this case, if both passwords have relevant lengths and are matched with each other.

when submitting the form, "handleSubmit" function needs to be checked with the backend server since my backend server has an error starting due to a connection error with MongoDB.

@dineshigdd it would be great if this reset page would be mobile responsive


[dv,core_ibex] Allow instructions near the top of initialised IMEM

If you call the read() function on the memory model with an
uninitialised word, it generates a UVM error.
This is reasonable for data memory (where we never want to read
something without an architectural value) but is not reasonable for
IMEM, where Ibex runs ahead. Squash the error in this case, but force
bad integrity for the fetch to make sure we see something explode.
This was inspired by trying to debug riscv_csr_test. It still fails after this change, but for different reasons :-) Specifically, it's designed so that if a check fails then it jumps to the end of its instructions and loops forever. Before this change, it then died immediately when Ibex read ahead. Now it hangs (arguably not much of an improvement!)

Oh, good idea. I'll force it to all zeros (which is an unimplemented instruction in RISC-V).

Hmm. Or maybe something like 0xdeadbeef would be better: I'll feed it through objdump to find out whether it's disallowed :-)

I for one am disappointed we can't use D00D2BAD!


source code directories naming

I'm trying to use Elchemy as part of simple Elixir project (basically demo application to study Elm).
Name of application is ElchemyPoker and this name is used as first part of each module name (like in most of Elixir projects), something like this
module ElchemyPoker.Models.Card exposing (..)

Elm requires strict source directories structure (only in this case it compiles properly)
In my case it looks like this
./elm/elchemyPoker/models/Card.elm

Subject of issue is that Elchemy creates directory in lib as-is
./lib/elchemyPoker/models/Card.elchemy.ex

But Elixir standard is to use snake case like in standard mix project
./lib/elchemy_poker/models/Card.elchemy.ex

The Elixir/Elm conventional bridge is still heavily under construction.
The file copying is done in here
https://github.com/wende/elchemy/blob/master/elchemy#L94-L106
If there was some built-in linux tool to make camelCase a snake_case, then the change should be really trivial


Genomes not in alphabetical order in genome groups when in tool

When you are looking at a number of genomes, and you want to deselect a few, it would help if they were listed alphabetically.  Its hard to find individual genomes otherwise.

This is specific to outdated website.