Declare initializeNexusStagingRepository task at root project level

initializeNexusStagingRepository is declared in each project.
It results in awkward parallelism: Gradle tries to launch initializeNexusStagingRepository concurrently, however it makes no sense since all of them share the same server url, thus they are just blocked.
Could a single task be created in the root project instead?
It would reduce the number of tasks, and it would make build parallelism more sane.

It's probably not the most frequent use case but different subprojects could use different server URLs just like they can use different repositories. Since only a subset of publications might be published, we cannot create all declared staging repos in a single task. Thus I currently don't see an easy way to wire this differently. Do you?

different subprojects could use different server URLs

I see.

Thus I currently don't see an easy way to wire this differently. Do you?

For instance:

Create a single task in the root project
Make the task use WorkerAPI to concurrently create repositories
Make all the sub-projects depend on the main task

we cannot create all declared staging repos in a single task

Do you mean "it would look a bit awkward" :) ?

Do you mean "it would look a bit awkward" :) ?

That and we don't necessarily need to create all staging repos, e.g. when only the publishing task of one of the subprojects is executed. We could probably inspect the task graph and only create those that we need, though.

e.g. when only the publishing task of one of the subprojects is executed

Isn't that handled by regular task dependency?
In other words, even current implementation of nexus-publish-plugin adds dependency of publishTasks on initializeNexusStagingRepository.
What's wrong with using the same approach?
I don't see why task graph needs analysis.

That and we don't necessarily need to create all staging repos

Ok, then a task per repository would do.

This plugin is now deprecated in favor of the new Gradle Nexus Publish Plugin which provides additional tasks to close and release staging repositories. Please refer to the migration guide for details on how to make the switch. If this issue is still relevant to you, please open a new issue in the new repository.


Flutter Web : i got a lot of problems after upgrading Flutter

after upgrading Flutter to last version i got a lot of problems like Flutter compelator can't Identify some widget Properties like this:
image
error:
The named parameter 'child' isn't defined.
Try correcting the name to an existing named parameter's name, or defining a named parameter with the name 'child'
Flutter Doctor
[✓] Flutter (Channel beta, 1.23.0-18.1.pre, on Microsoft Windows [version 10.0.19041.572], locale fr-FR)

[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.3)
[✓] Chrome - develop for the web
[✓] Android Studio (version 3.0)
[✓] VS Code (version 1.50.1)
[✓] Connected device (3 available)

• No issues found!

can you give a some solution !

Did you try Flutter clean. If using Android Studio Try File-> Invalidate cache and restart

Restarting the IDE also solves this error

RaisedButton class is obsolete, please use ElevatedButton instead.
https://api.flutter.dev/flutter/material/ElevatedButton-class.html
Thansk


CORE-19493 Adding FlowStatusCleanup job to SchedulerProcessorImpl

Description:
This PR makes the following primary changes:

Adds the FlowStatusCleanupProcessor and FlowStatusDeletionExecutor to the FlowStatusLookupServiceImpl;
Deletes the existing FlowStatusCacheService, meaning the new FlowStatusLookupServiceImpl is now used instead;
Adds a scheduled task trigger to SchedulerProcessorImpl.

and the following minor changes:

Moved the definitions of FlowStatusCleanupProcessor and FlowStatusDeletionExecutor from /processors to /components;
Updates the FlowRestResourceServiceImpl to listen to the StateManager and REST configs, which are now used by the lookup service.
Removes the custom lifecycle event CacheLoadCompleteEvent which was used to signal when the onSnapshot() function had finished running in the original compacted processor.

Notes:
For simplicity, the cleanup subscriptions currently live inside the FlowStatusLookupService. This is done as they both operate on the StateManager, so this allows us to manage it in one place and pass it directly into all 3 subscriptions.
To avoid hitting the size limit for primary keys in the database (255 chars), we use a hash of the FlowKey as the primary key for FlowStatus storage (An MD5 hash of the [FlowKey.id] concatenated with the HoldingIdentity short hash).
Testing:
Smoke tests are passing locally using the combined worker, and I've manually debugged and verified both that:

The new lookup service, using the StateManager is in use.
The FlowStatusCleanupProcessor is being triggered every minute by the scheduler.

build e2e

Passing E2E test run against this PR: https://ci02.dev.r3.com/job/Corda5/job/corda5-e2e-tests/job/PR-444/3/

Why on earth did you remove the flow status websocket endpoint? It's the only way I can monitor flow status efficiently without polling.


README.md: fix typo in Ubuntu PPA install instructions

I discovered the APT repository command was mistyped in the documentation. This should take care of it.

What version of Ubuntu are you on? On both Lucid and Utopic, it appears that apt-add-repository is a symlink to add-apt-repository

Closing for the above reason. I can't find a supported Ubuntu version where this isn't the case.


try to fix import error

was getting ModuleNotFoundError: No module named 'android_checkin_pb2' errors trying to import push_receiver.register not sure if this will fix it or not

seems to of fixed it


Update Jomey's Bio

@jomey has graduated! 🎉 🎓
https://github.com/uwhackweek/jupyterbook-template/blob/31716111301ed43519232507742815169ad5f3f6/book/team.yaml#L154-L161

@jomey has graduated! 🎉 🎓

🥳 I did (somewhat) update that on the ICESat-2 2023 team. Still waiting to update this in the template with the next adventure (hopefully soon 🤞 )


Option to combine OB by using median + fix gamma filtering algorithm

[ ] revisit the way the calculate_corrected_normalized algorithm works and use median instead of sum/nbr_pixels


Potential network partitioning causes WSV collapse

The scenario was like that:

Create a network of 4 peers with the single (same) block supplied (genesis). The block includes 'admin' domain and a user in the domain creation.
1 of the peers couldn't start
When submitting a query from the user created within the genesis Iroha returns an error 'domain not found: admin'. Considering there might be a mess with WSV it's even more strange the query is not failed with smth related to the signature failure (assuming the block could be applied entirely only).

Need more details.

Fixed in DM


Update README: Replace API Key with Auth Token and Reflect Changes in…

… YAML File

Contributing to Twilio

All third-party contributors acknowledge that any contributions they provide will be made under the same open-source license that the open-source project is provided under.

[ x] I acknowledge that all my contributions will be made under the project's license.

@bnb Will you review this PR?

Should also be merged with #73

@sbrij001 merging these in to close this out


Laravel auto discovery ? [Request]

Hi, does it supports auto-discovery from L5.5 ??, that would be awesome.

Hi @hardevine, thanks for the suggestion!
We're not adding this yet, for reasons outlined in this PR.


[Feature request] Multi column editing

Is your feature request related to a problem? Please describe.
I can't select multiple lines / a whole column in the text file, like in Notepad++
Describe the solution you'd like
I think Notepad++ handles it well, hold alt and select multiple columns with the mouse, or shift + alt + arrow keys up/down
Describe alternatives you've considered
Manually editing each line, or using Notepad++ instead

Not supported by current design and implementation since it is depending on Windows 10 built-in RichEdit control which does not support such feature yet.


refactor(state,concurrency): remove state impl from VersionedStateProxy

This change is

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 77.39%. Comparing base (e66b8b2) to head (0f1d146).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1846   +/-   ##
=======================================
  Coverage   77.39%   77.39%
=======================================
  Files          60       60
  Lines        8556     8556
  Branches     8556     8556
=======================================
  Hits         6622     6622
  Misses       1494     1494
  Partials      440      440

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


LDAP setup options - CA certs, STARTTLS, user schema

Matching pull request to https://github.com/bihealth/sodar-server/pull/1799.

To keep the commit history clean I just force-pushed a new commit. Please check.


Add Expression as allowed value to Select

Static analysis fails if an Expression object is passed to some methods, thus the updated docblock.

Thanks @andreasschroth


Verify install keep going

Resolves https://github.com/istio/istio/issues/26276
When verify-install fails, it was only printing the first problem it found.  The user with multiple problems rarely wants to see only one, often a different problem is the underlying one.
This is especially burdensome when the CLI is on a different version than the control plane.  (There will be other PRs tacking that more specifically).  What was happening was that only the first difference between the CLI's expected install and the actual install was being shown.
With this change instead of stopping on the first mistake we print an error message for each one:
istioctl verify-install --context istio-test-paid2 -d manifests
✔ ClusterRole: istiod-istio-system.default checked successfully
...
✘ EnvoyFilter: metadata-exchange-1.9.istio-system: envoyfilters.networking.istio.io "metadata-exchange-1.9" not found
✘ EnvoyFilter: tcp-metadata-exchange-1.9.istio-system: envoyfilters.networking.istio.io "tcp-metadata-exchange-1.9" not found
✘ EnvoyFilter: stats-filter-1.9.istio-system: envoyfilters.networking.istio.io "stats-filter-1.9" not found
✘ EnvoyFilter: tcp-stats-filter-1.9.istio-system: envoyfilters.networking.istio.io "tcp-stats-filter-1.9" not found
✔ HorizontalPodAutoscaler: istio-ingressgateway.istio-system checked successfully
...
Checked 12 custom resource definitions
Checked 2 Istio Deployments
Error: installation errors found

@esnible: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

release-notes_istio
ea4d63f029a64ec2bd8ce3c3862b96c52d30fa24
link
/test release-notes_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@esnible: The following tests failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

release-notes_istio
ea4d63f029a64ec2bd8ce3c3862b96c52d30fa24
link
/test release-notes_istio

integ-telemetry-k8s-tests_istio
ea4d63f029a64ec2bd8ce3c3862b96c52d30fa24
link
/test integ-telemetry-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@esnible: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-pilot-k8s-tests_istio
d8790e21b6442c09f09270d9d5a79b90e8e52423
link
/test integ-pilot-k8s-tests_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


Add WebDAV support via a restic web subcommand

This PR adds a webdav endpoint to restic, built on top of the existing FUSE filesystem abstractions and the golang.org/x/net/webdav library.
I have tested it with the GVFS WebDAV browser, and it works correctly. Symlinks in the target repository are ignored by the WebDAV endpoint as WebDAV has no concept of them (though they could be handled as file-aliases via a command line flag - but the default behavior is "rsync-safe" in that you can't overwrite your working symlinks by copying out of webdav mountpoint).
Missing functionality:

The restic web command should expose a basic filesystem browser via a web-browser. Implementing a composed http.Fileserver / webdav.Handler interface should be able to support this.

Allow building the FUSE abstractions on Windows. At the moment they are gated behind build tags for unix-likes only, but the webdav endpoint should work as a Windows remote filesystem endpoint (and this is the case where it is most useful).

Hey, thanks for your contribution! Is this PR ready for a review? What about the style issues identified by Hound?

Me and hound disagree? :) I'll fix them.
I need to plan some time to see how this can be built and used on Windows (which the FUSE sections are tagged out at the moment) since that was a motivating factor for it. Also looks like the CI builds didn't like it :(

Great, I'm looking forward to it. Just let me know if you get stuck anywhere, I'm glad to help out.

Hey, did you find the time yet to have a look? Do you have any questions I can assist you with? :smiley:

Since there was no feedback for a while I'm going to close this PR for now. Please feel free to add a comment or get in touch when you want to work on it again. I'll be happy to provide feedback and guidance if needed :)


add nim-routine package

No nimble file in repo?

sorry, pushed the change to server, please take a look again. I don't know if it's OK the nimble file is not in the master branch, e.g. devel branch.

Looks good to me!


feat: restructure repository and add integrations

Move Python library into python folder
Update README files
Add integrations folder with initial fetch-holiday integration

Looks good from my perspective. @ejfitzgerald you good with this?


Show alert if request to restore session results in 500 error

Right now the following sequence is possible:

Log into Frontend.
The server has a problem and starts returning 500 errors.
Attempt to log into Frontend in a new tab.
No server error is shown. The login form is shown, but it cannot be submitted: if the user tries to submit it, Frontend shows the alert, "A user is already logged in. Please refresh the page to continue."

I think this sequence is part of what is happening in this forum post: https://forum.getodk.org/t/central-giving-login-access-issues/36746
Instead, I think Frontend should show the server error in this case. More specifically, if Frontend sends a request to restore the session, that request results in an error other than a 404, and the session expiration date is stored in local storage (preventing a submission of the login form), then the server error should be shown. In that case, the user will likely be redirected to the login page, where now they will see the server error. If the user tries to then submit the login form, they will still see "A user is already logged in." However, they will have more information than they do today.

Another example on the forum: https://forum.getodk.org/t/problem-with-central-1-4-upgrade-user-already-logged-in/37429


在项目使用了skywalking之后导致整个程序crash

目前生产环境每秒100并发的请求，但并不是每个服务都会被crash，一些大请求的服务没有被crash，反而一些小请求的服务被crash了

A fatal error has been detected by the Java Runtime Environment:

SIGSEGV (0xb) at pc=0x00007f19e85e6350, pid=2410, tid=139750430967552

JRE version: OpenJDK Runtime Environment (7.0_131) (build 1.7.0_131-mockbuild_2017_02_13_17_01-b00)
Java VM: OpenJDK 64-Bit Server VM (24.131-b00 mixed mode linux-amd64 compressed oops)
Derivative: IcedTea 2.6.9
Distribution: CentOS Linux release 7.3.1611 (Core) , package rhel-<IP_ADDRESS>.el7_3-x86_64 u131-b00
Problematic frame:
C  0x00007f19e85e6350

Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

An error report file with more information is saved as:
/tmp/jvm-2410/hs_error.log
Compiled method (nm)  175702  812     n       java.lang.Class::isInstance (native)
total in heap  [0x00007f1a543504d0,0x00007f1a54350860] = 912
relocation     [0x00007f1a543505f0,0x00007f1a54350648] = 88
main code      [0x00007f1a54350660,0x00007f1a54350860] = 512
Compiled method (c2)<PHONE_NUMBER>             java.lang.invoke.LambdaForm$NamedFunction::invoke_L_L (28 bytes)
total in heap  [0x00007f1a5449c7d0,0x00007f1a5449cab8] = 744
relocation     [0x00007f1a5449c8f0,0x00007f1a5449c918] = 40
main code      [0x00007f1a5449c920,0x00007f1a5449c9a0] = 128
stub code      [0x00007f1a5449c9a0,0x00007f1a5449c9d8] = 56
oops           [0x00007f1a5449c9d8,0x00007f1a5449c9e0] = 8
scopes data    [0x00007f1a5449c9e0,0x00007f1a5449ca28] = 72
scopes pcs     [0x00007f1a5449ca28,0x00007f1a5449ca88] = 96
dependencies   [0x00007f1a5449ca88,0x00007f1a5449ca90] = 8
handler table  [0x00007f1a5449ca90,0x00007f1a5449caa8] = 24
nul chk table  [0x00007f1a5449caa8,0x00007f1a5449cab8] = 16

English only. We need you to address why this happens. I can't tell you why.

some projects used agent, qps/tps 100,  but not all the proejcts crashed,  only several projects crashed
the error msg:
A fatal error has been detected by the Java Runtime Environment:
SIGSEGV (0xb) at pc=0x00007f19e85e6350, pid=2410, tid=139750430967552
JRE version: OpenJDK Runtime Environment (7.0_131) (build 1.7.0_131-mockbuild_2017_02_13_17_01-b00)
Java VM: OpenJDK 64-Bit Server VM (24.131-b00 mixed mode linux-amd64 compressed oops)
Derivative: IcedTea 2.6.9
Distribution: CentOS Linux release 7.3.1611 (Core) , package rhel-<IP_ADDRESS>.el7_3-x86_64 u131-b00
Problematic frame:
C 0x00007f19e85e6350
Compiled method (nm) 175702 812 n java.lang.Class::isInstance (native)
total in heap [0x00007f1a543504d0,0x00007f1a54350860] = 912
relocation [0x00007f1a543505f0,0x00007f1a54350648] = 88
main code [0x00007f1a54350660,0x00007f1a54350860] = 512
Compiled method (c2)<PHONE_NUMBER> java.lang.invoke.LambdaForm$NamedFunction::invoke_L_L (28 bytes)
total in heap [0x00007f1a5449c7d0,0x00007f1a5449cab8] = 744
relocation [0x00007f1a5449c8f0,0x00007f1a5449c918] = 40
main code [0x00007f1a5449c920,0x00007f1a5449c9a0] = 128
stub code [0x00007f1a5449c9a0,0x00007f1a5449c9d8] = 56
oops [0x00007f1a5449c9d8,0x00007f1a5449c9e0] = 8
scopes data [0x00007f1a5449c9e0,0x00007f1a5449ca28] = 72
scopes pcs [0x00007f1a5449ca28,0x00007f1a5449ca88] = 96
dependencies [0x00007f1a5449ca88,0x00007f1a5449ca90] = 8
handler table [0x00007f1a5449ca90,0x00007f1a5449caa8] = 24
nul chk table [0x00007f1a5449caa8,0x00007f1a5449cab8] = 16

What is the difference between crash and uncrash? Have you tried to remove plugins?

We need you to address the issue first, then we could discuss how to solve the issue.

when i removed agent, my projects were runing  well

This is unhelpful. I know this is caused by agent, but how and which part? Agent is complex, this could only be solved if you try to find out why.
Such as,

Try to remove all plugins, but still attaches the agent
Choose the plugin one by one, and add it back to plugin folder, and reboot.

No update in 9days.


settings: Adjust checkbox for message content in email properly.

It fixes the bug that checkbox for
message_content_in_email_notifications isn't properly adjusted when
enable_offline_email_notifications is changed.
GIFs or Screenshots:

Yeah... I somehow thought that the work of #9181 isn't enabled yet :/
actually it's a bug I found here at https://github.com/zulip/zulip/pull/10465#issue-212584146 where if we currently refresh the page with enable_offline_email_notifications as false then message_content_in_email_notifications checkbox and label comes disabled and if you check enable_offline_email_notifications then the (message content in email) checkbox and label still remains disabled.
Here is the GIF of what I'm referring:

So yeah as @YJDave reported there can be the case of stream missed messages so I think we should either remove this "Checkbox and label" dependency completely (from handlebars as well) or should set this type of behavior (in the changes in this PR + handlebars as well):
state of `message_content_in_email_notifications` =
             `enable_offline_email_notifications` OR `enable_stream_email_notifications`

Does this makes sense? @YJDave @timabbott @pragatiagrawal31

We shouldn't apply any logic on "Include message.." checkbox. So first step will be remove handler dependency completely from this checkbox.
We can not apply following as well,
state of `message_content_in_email_notifications` =
             `enable_offline_email_notifications` OR `enable_stream_email_notifications`

Cause there might be a case where user has enable email notification in particular stream but not in all stream, i.e. enable_stream_email_notifications is false but there might exist some stream which has email notification on.
Therefore, we should removing every dependency logic from message_content_in_email_notifications checkbox.
Thanks @shubhamdhama for finding this bug!

Yeah, that makes sense... so just removing this dependency is fine. Thanks for the explanation @YJDave

Merged, after removing the line of whitespace added to settings_notifications.js, thanks everyone!!


Whitespace characters aren't escaped properly in Message()

According to the documentation for strings in Q#, we should be able to write whitespace characters like \r\n and \t by using a backslash as the escape character, just like C# strings. I tried writing a few of these strings and called Message() with them:
operation StringEscapeTest () : Unit {
    Message("Normal line");
    Message("\tTab line");
    Message("\nNew line");
    Message("\r\nCRLF");
}

Produces this output:
Normal line
\tTab line
\nNew line
\r\nCRLF

It looks like the special characters aren't getting escaped properly.

@bettinaheim, I took a quick look and the string given by the compiler has the \ escaped itself, for example:
            Message.Apply("Normal line");
            Message.Apply("\\tTab line");
            Message.Apply("\\nNew line");
            Message.Apply("\\r\\nCRLF");

Looks like a problem with the escaping on the parser.

Ok, let me take a look then, and get that off our plate.


SetName bug fix

Found and fixed a Bug where two different SetNames where the 2nd SetName ends with the 1st would cause the application to crash if both of there options where used together (see example below).
Included is a test Fact that proves the bug.
For example:
    class Options
    {
        [Option(SetName = "web")]
        public string WebUrl { get; set; }

        [Option(SetName = "theweb")]
        public string SomethingElse { get; set; }
    }

After adding this Option to your parser call:
yourapp.exe --weburl something --somethingelse somethingelse

Expected:
ERROR(S):
  Required option 'in, i' is missing.
Option: 'weburl' is not compatible with: 'somethingelse'.
Option: 'somethingelse'' is not compatible with: 'weburl'.

Actual
your app crashes.

@kshanafelt, thanks for PR and for using this library. But I think what you're saying is not correct. :(
You can't specify together two options from two mutually exclusive sets.
This has nothing to do with name ending similar, you got the error for the reason I said.
See this fake type from here:
    class Options_With_Two_Sets
    {
        [Option(SetName = "web")]
        public string WebUrl { get; set; }

        [Option(SetName = "web")]
        public int MaxLinks { get; set; }

        [Option(SetName = "ftp")]
        public string FtpUrl { get; set; }

        [Option(SetName = "ftp")]
        public int MaxFiles { get; set; }
    }

Allowed:
$ app --weburl http://myweb.org
$ app --ftpurl ftp://mysite.it --maxfiles 10
$ # etc ...

Not Allowed:
$ app --weburl http://myweb.org --ftpurl ftp://mysite.it
$ app --weburl http://myweb.org --maxfiles 10
$ # etc ...

Hope this clarified. :)

@gsscoder
I understand that you can't specify together two options from two mutually exclusive sets.
I must have not being clear enough.
I was expecting an error message to printed the screen.  That is not what happened
What actually happened, was the application crashed due to an uncaught exception being thrown.
See this fake type from here
class Options_With_SetName_That_Ends_With_Previous_SetName
    {
        [Option(SetName = "web")]
        public string WebUrl { get; set; }

        [Option(SetName = "theweb")]
        public string SomethingElse { get; set; }
    }

Now try this:
 $ app --web http://myweb.org --theweb whatever

For me this prints a stack-trace, not the nicely formatted error + help message I was expecting.
I love your library. Keep up the good work.

@kshanafelt, yes, the exception part was missing from your post...
Give me some time and I'll deepen this.
Thanks again, for the moment! :)

@kshanafelt, sorry it was a period so full of duties... Now I see reviewing the code directly from GitHub that you're right! And thanks...
Just give me some time to work in locally and I'll merge.

Fixed in 2.0.261-beta -> master branch + NuGet. Check it out...
Thanks again! :)


RFC: Offline DB/API revamp

Problem
The repository is built into a relational database, in the form of an SQLite output, and Docker containers for Postgres + MariaDB.
This is great for a huge number of use-cases, however, the data (imo) is intrinsically document-based. That is not to say that relations do not exist, but that they're only useful for gleaning insights if you were querying the database blind and did not understand what it contains, which is often not the case.
In practice, this means that we end up transforming the data into a relational format, but to consume the data in a useful manner, we have to join it back together during runtime. This seems a little pointless and is the source of slowness.
Proposition
I can see the flexibility of the relational database being used in applications to do with data exploration and visualisation, so there is definitely a valid use-case to keep supporting this. But the majority of the time, the database is leveraged in a search-oriented fashion.
So, I propose that we provide a NoSQL/document-based format, which will facilitate high-speed querying offline, whilst maintaining our relational formats.
We'd want to expose this functionality through @shabados/database and expose any of our search features as wrappers, as we currently do. I would be personally happy with dropping the SQLite dependency from the JS library entirely, if need be.
Other options

Denormalisation: I did consider producing a denormalised SQLite output. But I suspect it'd be far too large for offline storage on consumer devices.

Design Considerations

Doesn't require too much more space than our current DB (~150MB normalised)
Fixed, local dataset, so write speed/concurrency/scale issues do not matter
Full-text/fuzzy is a bonus (but a full API should really deal with this)
Prioritising ease of use and speed regarding querying shabads, banis, and lines, and anyone who'd like to use it for other things can use the SQLite build to do so
Differential updates/sync in the future, so there could be an API server or master instance sitting somewhere, and streams DB updates to everyone
Useable on desktop and mobile
Local JS API publishable in a similar manner to the existing @shabados/database
Partial sync

Please post any additional considerations.
Solutions
Comments for suitable technologies and products would be appreciated.

https://realm.io/docs
https://www.couchbase.com/products/mobile
https://www.npmjs.com/package/dexie
https://www.npmjs.com/package/@nozbe/watermelondb
https://www.npmjs.com/package/nedb
https://www.npmjs.com/package/rxdb
https://github.com/nextapps-de/flexsearch (search only)
https://docs.mongodb.com/realm/get-started/introduction-mobile

I'm a big fan of this. Have you also considered a supplmentary lmdb for enhanced performance? Something specific to desktop/mobile, and perhaps not for other database users.
Check this out https://en.wikipedia.org/wiki/Lightning_Memory-Mapped_Database it's a key value but with improvements to narrow down the key faster. If we were to use this for all potential search queries it would be gross, we'd be talking in the gigabytes of storage, however if we were to use it smartly (perhaps using serialized ids/numbers for values and incomplete lists), we may be able to squeeze out even further performance than a document based db would.

Any thoughts on MongoDB / Redis btw?

Differential updates/sync in the future, so there could be an API server or master instance sitting somewhere, and streams DB updates to everyone

Will we control which sources are included in this? Can the developer only update/sync a few sources/publications for a variable number of compositions?

Notes so far

Search indexes use a LOT of storage, if you pregenerate the possible results for every query (about 86MB just for SGGS, with only line IDs attached).

2.5ms for fetching 50 results from the search table in SQLite. About 33ms with a LIKE query instead.
Compression would make repeating/denormalisation much more palatable.

A PouchDB is a single index. You need multiple to store different "views".

It's not amazingly fast (40ms) to fetch the list of results as ids from the index and then request the full docs from another PouchDB.
It is very fast to fetch everything in one shot (5ms?)

Denormalising SQLite entirely to reduce joins speeds up fetches (6-15ms) at the expense of storage (600mb including transliterations + translations, 158mb with translations, 20Mb for just Gurbani). Joining ONLY translations and transliterations 158mb to denormalised lines.

Perhaps we only need to solve one issue, aside from dropping the ORM. The smart sorting:
select * from `line_content` inner join `lines` on `lines`.`id` = `line_content`.`line_id` inner join `shabads` on `shabads`.`id` = `lines`.`shabad_id` inner join `writers` on `writers`.`id` = `shabads`.`writer_id` inner join `translations` on `translations`.`line_id` = `line_content`.`line_id` inner join `transliterations` on `transliterations`.`line_id` = `line_content`.`line_id` where `line_content`.`first_letters` like '%a%' limit 50
op: 12.902ms

vs
select * from `line_content` inner join `lines` on `lines`.`id` = `line_content`.`line_id` inner join `shabads` on `shabads`.`id` = `lines`.`shabad_id` inner join `writers` on `writers`.`id` = `shabads`.`writer_id` inner join `translations` on `translations`.`line_id` = `line_content`.`line_id` inner join `transliterations` on `transliterations`.`line_id` = `line_content`.`line_id` where `line_content`.`first_letters` like '%a%' order by CASE  WHEN first_letters LIKE 'a' THEN 0 ELSE 1 END asc limit 50
op: 297.052ms
```

the `CASE WHEN` sorting is pretty slow... Maybe giving 100-150mb to a search index isn't such a bad idea...

with generated serach index:
select * from `search_only` inner join `line_content` on `line_content`.`line_id` = `search_only`.`line_id`
inner join `lines` on `lines`.`id` = `line_content`.`line_id` inner join `shabads` on `shabads`.`id` = `lines`.`shabad_id` inner join `writers` on `writers`.`id` = `shabads`.`writer_id` inner join `translations` on `translations`.`line_id` = `line_content`.`line_id` inner join `transliterations` on `transliterations`.`line_id` = `line_content`.`line_id` where `search_only`.`query` = 'hggm' limit 50
op: 11.707ms

Maybe giving 100-150mb to a search index isn't such a bad idea

For offline support if we plan to bundle this @shabados/mobile wouldn't that just make app size even bigger? Is there a way we can split into small chunks to keep it smaller?

Indeed! Which is why Partial Sync support is planned for the next release!


ref(data): s/getDeisRCItems/getRCItems

This helper function was recently refactored; its original goal was to statically return ReplicationController objects in the "deis" namespace, but now its namespace (and other) specifications are passed in as an rc.Lister.
Thus, renaming the newer, generic rc items getter to getRCItems to reflect this.

Testing ramifications: this change is purely aesthetic (function rename), requiring no new tests (though I'm not speaking to any preëxisting unit test coverage issues in this area of code). Running make test locally is a fine way to sanity check.

Fixes #64


Unable to deploy agent to server

Description
Unable  to deploy  agent to the server
Repro
What steps were taken leading to this issue
Adding new server to IML
Arguments
{
  "host": "new-mgs-mds-01",
  "profile_name": "default",
  "token": "RegistrationToken object"
}

Backtrace

Failed to register host new-mgs-mds-01: rc=0
''
'/root/.bashrc: line 1: .bashrc: command not found
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:03 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:06 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:07 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:08 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:09 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:10 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:10 --:--:--     0
curl: (35) Proxy CONNECT followed by 789 bytes of opaque data. Data ignored (known bug #39)
'

Version
What version of IML?
<IP_ADDRESS>
What Operating System?
IML is installed on CentOS
Servers are RHEL
What Operating System version?
IML OS CentOS 7.4
Servers are RHEL 7.4

Do you have a proxy server in your environment?

Yes, thank you,  did not think  about  that

On Mar 14, 2018, at 20:17, Brian J. Murrell<EMAIL_ADDRESS>wrote:
Do you have a proxy server in your environment?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/intel-hpdd/intel-manager-for-lustre/issues/501#issuecomment-373103789, or mute the thread https://github.com/notifications/unsubscribe-auth/AJOsZVyyt3mMaAEMzXTrYrfJce7U12TQks5teVC9gaJpZM4SqpOD.

@Zubrania: So just to close out on this, you need to exempt the IML nodes from your proxy configuration so that communication between the nodes doesn't go through your proxy server.  Using the defacto standard environment variables this can be done with no_proxy.
Your mileage will vary depending on how you are configuring your nodes to use the proxy.
Feel free to reopen this issue if you need further help about it.

Hello Brian
Can you please share the link to the iml documentation or config file where no_proху parameter can be set?
Thank you
Kind Regards
Dzmitryj Jakavuk

On Mar 14, 2018, at 21:22, Brian J. Murrell<EMAIL_ADDRESS>wrote:
@Zubrania: So just to close out on this, you need to exempt the IML nodes from your proxy configuration so that communication between the nodes doesn't go through your proxy server. Using the defacto standard environment variables this can be done with no_proxy.
Your mileage will vary depending on how you are configuring your nodes to use the proxy.
Feel free to reopen this issue if you need further help about it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@Zubrania: no_proxy is not an IML configuration item.  It's a general proxy environment setting on Linux, if you are even using environment settings for your proxy.  I only provided that example as a starting point for you discover how proxing is configured in your own environment so that you can exempt internal network nodes from using the proxy.
So really, however you are exempting the rest of your internal network nodes from using the proxy will work equally well for IML.


ignore-article/ignore-mode doesn't work?

newsboat 2.11.1
Steps to reproduce the issue:

Put next lines into config :

ignore-article "*" "content =~ \".*foo.*\""
ignore-mode "display"

Start newsboat

Articles with foo in content still in the feeds

Perhaps somewhat connected to #111?

Reproduced. Judging by the log, content field simply doesn't get populated before ignores are checked. A few solutions come to mind:

just read contents on startup. Don't like this idea because it'll force us to read the whole DB into memory on startup. We've got enough performance problems already;
arrange it so that rss_item loads its contents automatically if matcher rule requests that field. I foresee some problems with resource management here, because we won't know when it's safe to drop the content—it might still be needed by some dialog after rule is matched.

Sorry, @unam3, I don't know when I'll be able to fix that. As a workaround, you can either:

use ignore-mode "download" (but that'll kill the articles for good); or
use query feeds to filter out the stuff you don't see (but that won't scale if you have a lot of feeds or a lot of stuff you don't want to see).

@minoru, It's seems like second proposed workaround deosn't work too:
ignore-article "*" "content =~ \".*foo.*\""
ignore-mode "download"

After updating feeds articles with foo still will be downloaded.

I just checked with an empty cache, and it does work. Note that ignore-mode "download" doesn't affect things that are already in your cache.db—only new articles will be put through the filter.
You can verify that by creating an Atom or RSS file somewhere on your disk and adding it to Newsboat with a URL like file:///home/unam3/feed.atom. You update it in Newsboat and observe how many articles you got. Then you add another entry to the file—an entry that matches the filter—and update in Newsboat again. Since it matches, you shouldn't see the entry in Newsboat.


Problem with duplicate migration classes

There are some duplicate class definitions for the migration classes:

AddTrackingToVehiclesTable is defined in

admin/database/migrations/2016_10_24_131444_add_tracking_to_vehicles_table.php
admin/database/migrations/2016_10_24_232831_add_tracking_to_vehicles_table.php

CreatePasswordResetsTable is defined in

admin/database/migrations/2016_05_16_223032_create_password_resets_table.php
admin/database/migrations/bu/2014_10_12_100000_create_password_resets_table.php

CreateUsersTable is defined in

admin/database/migrations/2016_05_16_223032_create_users_table.php
admin/database/migrations/bu/2014_10_12_000000_create_users_table.php

EmergencyCases is defined in

admin/database/migrations/bu/2016_01_10_005202_emergency_cases.php
admin/database/migrations/bu/2016_01_25_205542_emergency_cases.php

CreateOperationAreasTable is defined in

admin/database/migrations/2016_05_16_223032_create_operation_areas_table.php
admin/database/migrations/bu/2016_01_07_062412_create_operation_areas_table.php

CreateLanguagesTable is defined in

admin/database/migrations/bu/2014_10_18_195027_create_languages_table.php
admin/database/migrations/2016_05_16_223032_create_languages_table.php

Could you please clarify which are the ones to be used so that I can delete the wrong duplicates. Running composer displays a warning, running the migrations is simply not possible.

Has alreday been fixed with commit 1ce6933. Thanks!


Issue 17 - Use of md5 is not FIPS compliant. Provide ability to custo…

The minimum supported hash algorithm that is FIPS compliant is sha1. Realizing there are performance concerns with using sha1, i've provided a way to customize the hashing algorithm per node environment. This way, the change is transparent and does not affect any users of etag, and any team needing sha can either add code to set the NODE_ETAG_HASH_ALGORITHM algorithm, or just set it on the machines running their application.
This change does not affect the current unit tests, as they will just use md5 by default. Also, I felt it was not necessary to add any SHA tests, as it will just result in my adding the same tests and changing the hashed values. The algorithm customization will not affect functionality of the etag module.

I have a good answer for you on the issue, but need to actually get to a computer to write it up. As for this change, there are a few issues:

You added no tests
You added no documentation
There is no error handling for when that environment variable contains an invalid value.
Do not ever bump people's versions, as it is pretty rude to dictate what version this would be published as. It is a new feature, so your suggested bump does not even comply with semver.

I suggest closing this PR, especially from what I will type up later which will solve your issue without any changes to this or express.

Thanks @dougwilson for the pointers. I've never contributed to any modules, so I do appreciate the feedback. I definitely was not trying to be rude, and I'm sorry. I'll be very interested to hear your suggested solution to this :)


cloudformation update

existing
Runtime: python3.6
GlueVersion: 2.0
suggest to update to avoid error
Runtime: python3.7
GlueVersion: 3.0

Thanks for bring it up. This has been updated in latest version.


Add max and min scores on pokerp end

Add max and min scores on pokerp end

@jclg Can you accept this pull request?

@lira92 Thank you ;)

composer update isn't get my changes. Any idea?

Yeap, I forgot to update the projet on packagist. Can you try again please ?
Sorry for the slow response time. I am currently on vacation ;)


Maas 2979 info about data series in alert

WORK IN PROGRESS
Waiting for MR#21 in alamo-common

Coverage increased (+1.4%) to 90.969% when pulling 2db5f3ad568655175d3c1e5fc12ce4905f6f4bea on MAAS-2979-info-about-data-series-in-alert into b98c24684ffe59381c556f83e173c65bafe309b9 on develop.

Coverage increased (+1.4%) to 90.963% when pulling 0936ffe381f6b46f1e9ea792db7a1edda9cf4b61 on MAAS-2979-info-about-data-series-in-alert into b98c24684ffe59381c556f83e173c65bafe309b9 on develop.

Coverage increased (+1.3%) to 90.956% when pulling 1a967748899c5d018cf519db586f2491ca4e8b1b on MAAS-2979-info-about-data-series-in-alert into b98c24684ffe59381c556f83e173c65bafe309b9 on develop.


Having wrong final sum during checkout

Hi,
During the checkout using discount coupon code,
there's something wrong with the calculation in both (%) and (amount).
I am having wrong final sum.
Template Used : redlabel
Discount type : (%)

Discount type : (Amount)

Discount Coupons

Thanks.

Because of the comma in the amount part. PHP doesn’t accept the digit after comma as integer. Easiest way is turning the whole amount to integer before calculation. You can search Google by these keywords “ php type conversion “. Before calculation the amount should be converted to integer first.
iPhone’umdan gönderildi
studuino<EMAIL_ADDRESS>şunları yazdı (21 May 2020 02:23):

Hi,
During the checkout using discount coupon code,
there's something wrong with the calculation in both (%) and (amount).
I am having wrong final sum.
Discount type : (%)
[image]https://user-images.githubusercontent.com/2291009/82506894-efa74200-9b26-11ea-87cb-18a55bd5f0d6.png
Discount type : (Amount)
[image]https://user-images.githubusercontent.com/2291009/82506970-136a8800-9b27-11ea-801d-c3dc99103643.png
Discount Coupons
[image]https://user-images.githubusercontent.com/2291009/82507003-28471b80-9b27-11ea-9b1a-f8bc8fc69724.png
Thanks.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/kirilkirkov/Ecommerce-CodeIgniter-Bootstrap/issues/169, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2EKLIT5ZQPGPHPI2SV5X3RSRRAZANCNFSM4NGMLQCQ.

Hi @muratanka,
Thank you for your kind suggestion.
After the type conversion from text to float. it works as expected.


mp.mpf(numpy.int64(1)) fails with Python 3

from mpmath import mp
import numpy

mp.sqrt(numpy.int64(1))

fails with
TypeError: cannot create mpf from 1

under Python 3 (not 2). A similar bug exists in sympy, https://github.com/sympy/sympy/issues/13618.

Finished and pushed. Pull request in.

I am reorganizing my branches, will put in a new pull request for this shortly.


Exposing  color parameters for action buttons (Dialog Service)

This PR allows us to change colors for action buttons on dialog service.

This introduces UI code into the VIewMoels by passing in a Color object from the ViewModel or another service which goes against the stacked rules.
When I get the time I will see if I can devise a way to set the styles dynamically per dialog.

This introduces UI code into the VIewMoels by passing in a Color object from the ViewModel or another service which goes against the stacked rules.
When I get the time I will see if I can devise a way to set the styles dynamically per dialog.

Excellent!

Excellent!

@elhe26 I'm tracking this issue here. It will be completed in next week. Sorry for the delay.

@elhe26 I'm tracking this issue here. It will be completed in next week. Sorry for the delay.

@elhe26 actually I think I'm being a bit too romantic around "No UI code in the viewmodel and services". The color object is simply just a model to describe a color. It doesn't actually require Flutter to run. I'll merge this in now.

@elhe26 actually I think I'm being a bit too romantic around "No UI code in the viewmodel and services". The color object is simply just a model to describe a color. It doesn't actually require Flutter to run. I'll merge this in now.


Gnuplotpp::Vector2d coordinates

This is the current definition:
struct Gnuplotpp::Vector2d
{
    double x = 0;
    double y = 0;
};

it should be changed making the actual data private and exposing x() and y() methods so that is conformed to the LC library

See issue no. #16, also return nothing when none of the  streambufs can be read


Upgrade to guessit 0.9.3

This fixes https://github.com/Diaoul/subliminal/issues/389
The new version of guessit does not automatically check by default for camelCase properties.
If you should need it, it can be added to the guessit options.
See https://github.com/wackou/guessit/issues/160 for more info.

I forgot to update the dependencies and the way to access the guess_properties...

@Diaoul Can you also merge this upgrade?
This fixes some minor issues in guessit.
With my last commits (I forgot some...) the upgrade should be complete. ;)


{ungoogled-,}chromium,chromedriver: 120.0.6099.71/109 -> 120.0.6099.109/129

Description of changes
https://chromereleases.googleblog.com/2023/12/stable-channel-update-for-desktop_20.html
This update includes 1 security fix. Google is aware that an exploit
for CVE-2023-7024 exists in the wild.
CVEs:
CVE-2023-7024
Things done

Built on platform(s)

[x] x86_64-linux (only ungoogled-chromium)
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/) (only ungoogled-chromium)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Manual backport to 23.05 in #276053


More Robust Branding Guideline

This is just to further flesh out the branding guidelines as well as set up some friendly links to font foundry, webpack shop, and threadless as well a special treat for those that actually use the guidelines.

Nice. Can you check that proselint warning on Travis?

Only

content/branding.md:9:52: misc.tense_present 'in regards to'.

left I think.

I think it may be the file I added. If you like I can commit to core assets and hot-link to it or just remove. Most people in my slack channels seem to love it when I add these emojis so I thought it'd be fun.

Thanks for your help with the verbiage/tense issue btw as I was unaware that was a check here.

Hi,
I think ./assets/icon-square-small-slack.png is a relative import making the link check fail. I think going with /assets/icon-square-small-slack.png might fix the lookup as then it's relative to the root.

updated, let's hope this does the trick. gonna have to look into guidelines a bit further after this PR!

Hoooooray!!! Haha.

Nice work. Thanks!

Thanks! Coming from design(ish) background I love having brand guidelines easily accessible 💯

Awesome work @rouzbeh84!


Problems when array of coordinate bounds is 2D

Most of the netCDF data I work with stores, in addition to the coordinates themselves, the bounds of each coordinate value. Often these bounds are stored as arrays with shape Nx2, where N is the number of points for that coordinate.  For example:
$ ncdump -c /archive/Spencer.Hill/am3/am3clim_hurrell/gfdl.ncrc2-intel-prod-openmp/pp/atmos/ts/monthly/1yr/atmos.201001-201012.t_surf.nc
netcdf atmos.201001-201012.t_surf {
dimensions:
	time = UNLIMITED ; // (12 currently)
	lat = 90 ;
	bnds = 2 ;
	lon = 144 ;
variables:
	double average_DT(time) ;
		average_DT:long_name = "Length of average period" ;
		average_DT:units = "days" ;
		average_DT:missing_value = 1.e+20 ;
		average_DT:_FillValue = 1.e+20 ;
	double average_T1(time) ;
		average_T1:long_name = "Start time for average period" ;
		average_T1:units = "days since 1980-01-01 00:00:00" ;
		average_T1:missing_value = 1.e+20 ;
		average_T1:_FillValue = 1.e+20 ;
	double average_T2(time) ;
		average_T2:long_name = "End time for average period" ;
		average_T2:units = "days since 1980-01-01 00:00:00" ;
		average_T2:missing_value = 1.e+20 ;
		average_T2:_FillValue = 1.e+20 ;
	double lat(lat) ;
		lat:long_name = "latitude" ;
		lat:units = "degrees_N" ;
		lat:cartesian_axis = "Y" ;
		lat:bounds = "lat_bnds" ;
	double lat_bnds(lat, bnds) ;
		lat_bnds:long_name = "latitude bounds" ;
		lat_bnds:units = "degrees_N" ;
		lat_bnds:cartesian_axis = "Y" ;
	double lon(lon) ;
		lon:long_name = "longitude" ;
		lon:units = "degrees_E" ;
		lon:cartesian_axis = "X" ;
		lon:bounds = "lon_bnds" ;
	double lon_bnds(lon, bnds) ;
		lon_bnds:long_name = "longitude bounds" ;
		lon_bnds:units = "degrees_E" ;
		lon_bnds:cartesian_axis = "X" ;
	float t_surf(time, lat, lon) ;
		t_surf:long_name = "surface temperature" ;
		t_surf:units = "deg_k" ;
		t_surf:valid_range = 100.f, 400.f ;
		t_surf:missing_value = 1.e+20f ;
		t_surf:_FillValue = 1.e+20f ;
		t_surf:cell_methods = "time: mean" ;
		t_surf:time_avg_info = "average_T1,average_T2,average_DT" ;
		t_surf:interp_method = "conserve_order2" ;
	double time(time) ;
		time:long_name = "time" ;
		time:units = "days since 1980-01-01 00:00:00" ;
		time:cartesian_axis = "T" ;
		time:calendar_type = "JULIAN" ;
		time:calendar = "JULIAN" ;
		time:bounds = "time_bounds" ;
	double time_bounds(time, bnds) ;
		time_bounds:long_name = "time axis boundaries" ;
		time_bounds:units = "days" ;
		time_bounds:missing_value = 1.e+20 ;
		time_bounds:_FillValue = 1.e+20 ;

// global attributes:
		:filename = "atmos.201001-201012.t_surf.nc" ;
		:title = "am3clim_hurrell" ;
		:grid_type = "mosaic" ;
		:grid_tile = "1" ;
		:comment = "pressure level interpolator, version 3.0, precision=double" ;
		:history = "fregrid --input_mosaic atmos_mosaic.nc --input_file 20100101.atmos_month --interp_method conserve_order2 --remap_file .fregrid_remap_file_144_by_90 --nlon 144 --nlat 90 --scalar_field (**please see the field list in this file**)" ;
		:code_version = "$Name: fre-nctools-bronx-7 $" ;
data:

 lat = -89, -87, -85, -83, -81, -79, -77, -75, -73, -71, -69, -67, -65, -63,
    -61, -59, -57, -55, -53, -51, -49, -47, -45, -43, -41, -39, -37, -35,
    -33, -31, -29, -27, -25, -23, -21, -19, -17, -15, -13, -11, -9, -7, -5,
    -3, -1, 1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29, 31, 33,
    35, 37, 39, 41, 43, 45, 47, 49, 51, 53, 55, 57, 59, 61, 63, 65, 67, 69,
    71, 73, 75, 77, 79, 81, 83, 85, 87, 89 ;

 lon = 1.25, 3.75, 6.25, 8.75, 11.25, 13.75, 16.25, 18.75, 21.25, 23.75,
    26.25, 28.75, 31.25, 33.75, 36.25, 38.75, 41.25, 43.75, 46.25, 48.75,
    51.25, 53.75, 56.25, 58.75, 61.25, 63.75, 66.25, 68.75, 71.25, 73.75,
    76.25, 78.75, 81.25, 83.75, 86.25, 88.75, 91.25, 93.75, 96.25, 98.75,
    101.25, 103.75, 106.25, 108.75, 111.25, 113.75, 116.25, 118.75, 121.25,
    123.75, 126.25, 128.75, 131.25, 133.75, 136.25, 138.75, 141.25, 143.75,
    146.25, 148.75, 151.25, 153.75, 156.25, 158.75, 161.25, 163.75, 166.25,
    168.75, 171.25, 173.75, 176.25, 178.75, 181.25, 183.75, 186.25, 188.75,
    191.25, 193.75, 196.25, 198.75, 201.25, 203.75, 206.25, 208.75, 211.25,
    213.75, 216.25, 218.75, 221.25, 223.75, 226.25, 228.75, 231.25, 233.75,
    236.25, 238.75, 241.25, 243.75, 246.25, 248.75, 251.25, 253.75, 256.25,
    258.75, 261.25, 263.75, 266.25, 268.75, 271.25, 273.75, 276.25, 278.75,
    281.25, 283.75, 286.25, 288.75, 291.25, 293.75, 296.25, 298.75, 301.25,
    303.75, 306.25, 308.75, 311.25, 313.75, 316.25, 318.75, 321.25, 323.75,
    326.25, 328.75, 331.25, 333.75, 336.25, 338.75, 341.25, 343.75, 346.25,
    348.75, 351.25, 353.75, 356.25, 358.75 ;

 time = 10973.5, 11003, 11032.5, 11063, 11093.5, 11124, 11154.5, 11185.5,
    11216, 11246.5, 11277, 11307.5 ;
}

These 2-D bounding arrays lead to the "Buffer has wrong number of dimensions" error in #665.  In the case of #665, only the time coordinate has this 2-D bounds array; here other coordinates (namely lat and lon) have it as well.
Conceptually, these bound arrays represent coordinates, but when read in as a Dataset, they become variables, not coordinates.  Perhaps this is part of the problem?

Is it possible for you to share a netcdf file that reproduces the issue? Based on the ncdump result, I think xray should handle it fine...

I think ultimately, these are going to end up as Variables, not Coordinates.  The CF convention refers to them as "Boundary Variables", and although they are essentially metadata for the Coordinates, I don't think that sort of complexity makes sense for xray right now.
It shouldn't be too hard to fix the 2-d bounds problem though.

I think the reason one gets the "Buffer has wrong number of dimensions" error here is still because of the presence of the time_bounds variable.  If we drop time_bounds upon reading the file in, I think things work OK.
In [2]: xray.open_dataset('/archive/Spencer.Hill/am3/am3clim_hurrell/gfdl.ncrc2-intel-prod-openmp/pp/atmos/ts/monthly/1yr/atmos.201001-201012.t_surf.nc', drop_variables='time_bounds')
Out[2]:
<xray.Dataset>
Dimensions:     (bnds: 2, lat: 90, lon: 144, time: 12)
Coordinates:
  * lat         (lat) float64 -89.0 -87.0 -85.0 -83.0 -81.0 -79.0 -77.0 ...
  * lon         (lon) float64 1.25 3.75 6.25 8.75 11.25 13.75 16.25 18.75 ...
  * time        (time) datetime64[ns] 2010-01-16T12:00:00 2010-02-15 ...
  * bnds        (bnds) int64 0 1
Data variables:
    average_DT  (time) timedelta64[ns] 31 days 28 days 31 days 30 days ...
    average_T1  (time) datetime64[ns] 2010-01-01 2010-02-01 2010-03-01 ...
    average_T2  (time) datetime64[ns] 2010-02-01 2010-03-01 2010-04-01 ...
    lat_bnds    (lat, bnds) float64 -90.0 -88.0 -88.0 -86.0 -86.0 -84.0 ...
    lon_bnds    (lon, bnds) float64 0.0 2.5 2.5 5.0 5.0 7.5 7.5 10.0 10.0 ...
    t_surf      (time, lat, lon) float64 245.9 245.9 245.8 245.7 245.7 245.6 ...
Attributes:
    filename: atmos.201001-201012.t_surf.nc
    title: am3clim_hurrell
    grid_type: mosaic
    grid_tile: 1
    comment: pressure level interpolator, version 3.0, precision=double
    history: fregrid --input_mosaic atmos_mosaic.nc --input_file 20100101.atmos_month --interp_method conserve_order2 --remap_file .fregrid_remap_file_144_by_90 --nlon 144 --nlat 90 --scalar_field (**please see the field list in this file**)
    code_version: $Name: fre-nctools-bronx-7 $

Sorry, @spencerkclark is right, the ValueError issue we had was also due to the 2D time bounds array only.  For example: (the netCDF file used below is also at ftp://ftp.gfdl.noaa.gov/pub/s1h/atmos.201001-201012.t_surf.nc)
In [1]: ds = xray.open_dataset('/archive/Spencer.Hill/am3/am3clim_hurrell/gfdl.ncrc2-intel-prod-openmp/pp/atmos/ts/monthly/1yr/atmos.201001-201012.t_surf.nc')

In [2]: print(ds)
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-2-4d24098ddece> in <module>()
----> 1 print(ds)

/home/s1h/anaconda/lib/python2.7/site-packages/xray/core/dataset.pyc in __repr__(self)
    885
    886     def __repr__(self):
--> 887         return formatting.dataset_repr(self)
    888
    889     @property

...

/home/s1h/anaconda/lib/python2.7/site-packages/pandas/tseries/timedeltas.pyc in _convert_listlike(arg, box, unit, name)
     47             value = arg.astype('timedelta64[{0}]'.format(unit)).astype('timedelta64[ns]', copy=False)
     48         else:
---> 49             value = tslib.array_to_timedelta64(_ensure_object(arg), unit=unit, errors=errors)
     50             value = value.astype('timedelta64[ns]', copy=False)
     51

pandas/tslib.pyx in pandas.tslib.array_to_timedelta64 (pandas/tslib.c:47046)()

ValueError: Buffer has wrong number of dimensions (expected 1, got 2)

In [3]: ds2 = ds.drop('time_bounds')

In [4]: print(ds2)
<xray.Dataset>
Dimensions:     (bnds: 2, lat: 90, lon: 144, time: 12)
Coordinates:
  * lat         (lat) float64 -89.0 -87.0 -85.0 -83.0 -81.0 -79.0 -77.0 ...
  * lon         (lon) float64 1.25 3.75 6.25 8.75 11.25 13.75 16.25 18.75 ...
  * time        (time) datetime64[ns] 2010-01-16T12:00:00 2010-02-15 ...
  * bnds        (bnds) int64 0 1
Data variables:
    average_DT  (time) timedelta64[ns] 31 days 28 days 31 days 30 days ...
    average_T1  (time) datetime64[ns] 2010-01-01 2010-02-01 2010-03-01 ...
    average_T2  (time) datetime64[ns] 2010-02-01 2010-03-01 2010-04-01 ...
    lat_bnds    (lat, bnds) float64 -90.0 -88.0 -88.0 -86.0 -86.0 -84.0 ...
    lon_bnds    (lon, bnds) float64 0.0 2.5 2.5 5.0 5.0 7.5 7.5 10.0 10.0 ...
    t_surf      (time, lat, lon) float64 245.9 245.9 245.8 245.7 245.7 245.6 ...
...

The errors I was thinking of stemming from these lat- and lon-bounds were due to errors in my own code...my mistakes appear to be the unifying theme here!  Sorry for the confusion.


Make service clients findable

Depends on https://github.com/rusoto/rusoto/pull/541 .
Fixes https://github.com/rusoto/rusoto/issues/519 .

Needs a rebase now.


How to override PhantomJS onInitialized Global callback to run specific tasks every time new webpage is created but before a URL is loaded

Hi Dear florentbr!
Thanks allot for replying last issues which I submitted due to being newbie. As I come to know that PhantomJS driver offers onInitialized callback is invoked after the web page is created but before a URL is loaded. The callback may be used to change global objects.
I want to know how can we override this object to let our source/piece of code to be run every time once a new webpage object is created before the URL is loaded. I want to add some methods/functions to be run on webpage is created.
for example clicking on a[_blank] link cause open new page but before created the new page my code may be run once.
As described at http://phantomjs.org/api/webpage/handler/on-initialized.html
var webPage = require('webpage');
var page = webPage.create();
page.onInitialized = function() {
page.evaluate(function() {
document.addEventListener('DOMContentLoaded', function() {
console.log('DOM content has loaded.');
}, false);
});
};
But how do I add some code to be run once the webpage instance is initialized in SeleniumBasic 2.0.6 using VBA or VB6.
Thanks

The PhantomJS driver doesn't provide such capabilities with the Selenium API:
http://stackoverflow.com/questions/24515944/phantomjs-through-selenium-in-python


Merging original development branches

There are two development branches at the libdrizzle redux repos which might be worth merging into our fork.
I have made efforts to add parsing of binlog events in dive. However it seems better and cleaner to have libdrizzle parse the binlog event data and let the D code call this API.
@leandro-lucarella-sociomantic , @mathias-baumann-sociomantic , @ben-palmer-sociomantic
1 - Compiler fixes
https://code.launchpad.net/~linuxjedi/libdrizzle/5.1-compiler-fixes/+merge/162339

The address sanitizer cannot be used at the same time as the thread sanitizer. CLang actually enforces this but for some reason GCC doesn't.
When both are tried together the address sanitizer barfs on the thread sanitizer lib, I suspect this is due to the way it has to be linked.
The address sanitizer is probably more useful to libdrizzle right now so disabling the thread sanitizer.

2 - Extending the api to read binlog event data
https://code.launchpad.net/~2591kuldeep/libdrizzle/libdrizzle-binlogapi/+merge/180569

Currently only have api to read header for MySQL binlog events. I have built the extended api to read event data also. (libdrizzle/binlogevent)

I am not sure I really understand what 1) is for but 2) looks like it is something that would be useful to have.

Also reckon that 1) is of less importance, but 2) could be worth looking into.

I tried testing with the branch containing binlog eventdata parsing  https://code.launchpad.net/~2591kuldeep/libdrizzle/libdrizzle-binlogapi/+merge/180569
However it doesn't read the eventdata correctly, at least not with the supplied example
In spite of this, the modelling of Row Based Replication eventdata is complete and could therefore still be of use if we decided to work on adding parsing of binlog eventdata to libdrizzle redux

This issue was resolved with release v5.3.0


[FLINK-2594][client] implement a method to retrieve the accumulators …

…of a job

move SerializedValue from runtime to core
unified code to deserialize accumulators

LGTM, ready to merge, IMO.
Thanks!


store metric IDs instead of full metric names

in order to reduce the space in large table data, metrics should be treated as entities and all other tables should reference them with IDs instead of with the full metric name.

Same answer as in #73.


Washing machine timer

Hi ollo69,
First of all, this is awsome, you are awsome!
I was just woundering as you are the expert, is it easy to make a countdown timer of % progress bar for a wash that is running?
Like the "initial_time" - "remain_time" = % done or a timer?
Now I only have the binary sensor which is also handy but a timer would be even more awsome.
I have seen a few solutions but I think you would probably have a better solution :)

If possible indeed it would be interesting to get the ETA of the drying and washing machine. Keep up the good work here your plugins is working really well with my lg dryer and washer. thanks.

ETA is an attribute of the sensor (remain_time).
All additional value can be calculated using the platform "template".
The issue #13 was created to discuss about this and there are already some suggestion.
I'm available to add other attributes or dedicated sensors, but I'd like to see some discussion with the  community to identify what is really useful.

ETA is an attribute of the sensor (remain_time).
All additional value can be calculated using the platform "template".
The issue #13 was created to discuss about this and there are already some suggestion.
I'm available to add other attributes or dedicated sensors, but I'd like to see some discussion with the community to identify what is really useful.

Thanks ollo69!
I looked at #13 but found it had no real conclusion before I opened this ticket, but template is perfect, I still have to look at that Jinja code for a more advanced solution but this seems to work fine.
I managed to get something working with:  - platform: template
    sensors:
      wash_state:
        friendly_name: "Wash State"
        icon_template: mdi:washing_machine
        value_template: >
          {{state_attr('sensor.washer', 'remain_time')}}

It just simply counts down the remaining time which is pritty much all I really needed :)
For the washing machine I can't really think of any other improvements, maybe that you can start a spin cycle like you can do with the ThinQ app.
I will also get Google Assistant soon and start testing it with voice controls :)


✨  Find favicon in Ghost

refs #7688
Adds a util file to find a favicon in this order:

uploads (type 'upload')
assets/favicon.png in active theme (type 'theme-assets')
assets/favicon.ico in active theme (type 'theme-assets')
favicon.png in root of active theme (type 'theme-root')
favicon.ico in root of active theme (type 'theme-root')
favicon.png in ghost core/shared (type 'default')
favicon.ico in ghost core/shared (type 'default')

The found path to the favicon and type are then stored in the current config to make it accessible globally in ghost.

Needs a rebase 👍

Done 🌮


TurboFormMixin call super().form_valid()

An example is below where email is not sent on form validation in PasswordResetView:
class PasswordResetView(TurboStreamFormMixin, auth_views.PasswordResetView):
    target = "form-reset"
    template_name = "accounts/auth/password_reset.html"

This matches the behavior of Django FormMixin, which just does a redirect:
https://ccbv.co.uk/projects/Django/3.0/django.views.generic.edit/FormMixin/#form_valid
The idea should be to follow existing Django patterns as closely as possible.

@danjac - I completely agree with you. I did see the default FormMixin behavior and contemplated a lot before submitting a patch. I also tried to look around for some examples / inspiration to see if there is a better way of doing this, but couldn't find.
Thanks for merging!


Update README.md

Fix for this issue "https://github.com/layer5io/meshery/issues/1314#issuecomment-663921811":
The  previous link which was "https://meshery.layer5.io/docs/installation/minikube"  for Kubernetes was updated to this
"https://meshery.layer5.io/docs/installation/platforms/minikube"
Description
This PR fixes #
Notes for Reviewers
Signed commits

[x] Yes, I signed my commits.

please review the changes made and merge the pull request . Thank you

Hi @Anita-ihuman , I think you have missed to sign-off your PR, do if you can please make the update for that then, we are good to go with the PR.
Here are some resources for signing off your PR,
https://github.com/layer5io/meshery/blob/master/CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin.

Hi @Anita-ihuman , I think you have missed to sign-off your PR, do if you can please make the update for that then, we are good to go with the PR.
Here are some resources for signing off your PR,
https://github.com/layer5io/meshery/blob/master/CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin.

You can also checkout this link https://github.com/layer5io/meshery/pull/1329/checks?check_run_id=914833124


Command still hasn't been written into connection! Try to increase nettyThreads setting

Expected behavior
Actual behavior
I'm using redisson version 3.16.4, and confirm that there is a bug here where we have an instance of our application with a connection in it, and there has been a fixed connection that keeps reporting an error.   This error lasts as long as it occurs and does not recover until a reboot.
We've also looked at some previous issues that have added nettythread , which didn't work.
org.redisson.client.RedisTimeoutException: Command still hasn't been written into connection! Try to increase nettyThreads setting. Payload size in bytes: 0. Node source: NodeSource [slot=6076, addr=null, redisClient=null, redirect=null, entry=null], connection: RedisConnection@902022049 [redisClient=[addr=redis://xxx], channel=[id: 0xaad2183a, L:/1xxx - R:xxxxx], currentCommand=null, usage=0], command: (ZSCAN), params: [CACHE_CONTRACT_AUTOMATIC_GOODS_CODE_MAPPING_KEY_15262_8100339, 0, COUNT, 10] after 3 retry attempts
	at org.redisson.command.RedisExecutor$2.run(RedisExecutor.java:222)
	at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:669)
	at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:744)
	at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:469)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.lang.Thread.run(Thread.java:748)

This instance will consistently report errors and it will always be this connection！！！！！！
Here is the dump for this redissonConnection。。
@NioSocketChannel[
    logger=@LocationAwareSlf4JLogger[LocationAwareSlf4JLogger(io.netty.channel.socket.nio.NioSocketChannel)],
    DEFAULT_SELECTOR_PROVIDER=@EPollSelectorProvider[sun.nio.ch.EPollSelectorProvider@7e615922],
    config=@NioSocketChannelConfig[io.netty.channel.socket.nio.NioSocketChannel$NioSocketChannelConfig@1ee05eb],
    METADATA=@ChannelMetadata[io.netty.channel.ChannelMetadata@263c5862],
    EXPECTED_TYPES=@String[ (expected: ByteBuf, FileRegion)],
    flushTask=@[io.netty.channel.nio.AbstractNioByteChannel$1@12481cbd],
    inputClosedSeenErrorOnRead=@Boolean[false],
    logger=@LocationAwareSlf4JLogger[LocationAwareSlf4JLogger(io.netty.channel.nio.AbstractNioChannel)],
<EMAIL_ADDRESS>local=/xxxx  remote=xxxx]],
    readInterestOp=@Integer[1],
    selectionKey=@SelectionKeyImpl[sun.nio.ch.SelectionKeyImpl@320576e],
    readPending=@Boolean[true],
    clearReadPendingRunnable=@[io.netty.channel.nio.AbstractNioChannel$1@247bb415],
    connectPromise=null,
    connectTimeoutFuture=@ScheduledFutureTask[ScheduledFutureTask@74baf78a(failure: io.netty.util.concurrent.DefaultPromise$StacklessCancellationException, task: CANCELLED, deadline:<PHONE_NUMBER>8, period: 0)],
    requestedRemoteAddress=@InetSocketAddress[xx],
    $assertionsDisabled=@Boolean[true],
    logger=@LocationAwareSlf4JLogger[LocationAwareSlf4JLogger(io.netty.channel.AbstractChannel)],
    parent=null,
    id=@DefaultChannelId[aad2183a],
    unsafe=@NioSocketChannelUnsafe[io.netty.channel.socket.nio.NioSocketChannel$NioSocketChannelUnsafe@58a75ab],
    pipeline=@DefaultChannelPipeline[DefaultChannelPipeline{(RedisConnectionHandler#0 = org.redisson.client.handler.RedisConnectionHandler), (ConnectionWatchdog#0 = org.redisson.client.handler.ConnectionWatchdog), (CommandEncoder#0 = org.redisson.client.handler.CommandEncoder), (CommandBatchEncoder#0 = org.redisson.client.handler.CommandBatchEncoder), (CommandsQueue#0 = org.redisson.client.handler.CommandsQueue), (PingConnectionHandler#0 = org.redisson.client.handler.PingConnectionHandler), (CommandDecoder#0 = org.redisson.client.handler.CommandDecoder), (ErrorsLoggingHandler#0 = org.redisson.client.handler.ErrorsLoggingHandler)}],
    unsafeVoidPromise=@VoidChannelPromise[io.netty.channel.VoidChannelPromise@57752c53],
    closeFuture=@CloseFuture[AbstractChannel$CloseFuture@2ed7e1b4(incomplete)],
    localAddress=@InetSocketAddress[/xx],
    remoteAddress=@InetSocketAddress[xxx],
    eventLoop=@NioEventLoop[io.netty.channel.nio.NioEventLoop@4919cfcf],
    registered=@Boolean[true],
    closeInitiated=@Boolean[false],
    initialCloseCause=null,
    strValActive=@Boolean[true],
    strVal=@String[[id: 0xaad2183a, L:/xxxx - R:xxxx]],
    ATTRIBUTES_UPDATER=@AtomicReferenceFieldUpdaterImpl[java.util.concurrent.atomic.AtomicReferenceFieldUpdater$AtomicReferenceFieldUpdaterImpl@48d28fd9],
    EMPTY_ATTRIBUTES=@DefaultAttribute[][isEmpty=true;size=0],
    attributes=@DefaultAttribute[][isEmpty=false;size=3],
    $assertionsDisabled=@Boolean[true],
]

and found that the channel's isWritable is false. while all other normal channels are true.

Steps to reproduce or test case
Redis version
proxy  Redis 4.0 proxy
Redisson version
3.16.4
Redisson configuration

 @Bean
    RedissonClient redisson() throws Exception {
        Config config = new Config();
        ClusterServersConfig clusterConfig = config.useClusterServers()
            .setScanInterval(2000)
            .setKeepAlive(true)
            .setMasterConnectionPoolSize(80)
            .setMasterConnectionMinimumIdleSize(80)
            .setSlaveConnectionPoolSize(80)
            .setSlaveConnectionMinimumIdleSize(80)
            .setReadMode(ReadMode.valueOf(master))
            .setPingConnectionInterval(3000);
        for (String str : address) {
            clusterConfig.addNodeAddress(str);
            log.info("cluster address========"+str);
        }
        log.info("cluster redisson readMode======="+readMode);
        config.setCodec(new JsonJacksonCodec());
        return Redisson.create(config);
    }

Add some more information
tcp link initiated a large number of TCP dup ACK, indicating that there is a packet loss, and the server/client are asking for retransmission, in addition to no other packets, suspect that the link has failed, the need to rebuild the connection

channel information

channel outboundBuffer information

Can you try the latest version?

Can you try the latest version?

no,I can't,please fix this bug

@

Can you try the latest version?

Can you try the latest version?
no,I can't,please fix this bug @mrniko

Can you try the latest version?

no,I can't,please fix this bug

Can you try the latest version?

no,I can't,please fix this bug    @mrniko

unable to reproduce it with the latest version

unable to reproduce it with the latest version

Please give me a fix idea and guidance I need to fix it in this version  @mrniko

@mrniko  hi，Please give me some guidance, we did a lot of customization in this version 3.16.4 and would like to fix it in this version!

I can't find the code to call isWritable in the latest code, how did I have to fix it?  @mrniko

I'm sorry, but this version 3.16.x line isn't developed anymore.

Has this problem been solved?I encountered the same problem, what is the solution?

@wzgl998877
You need to refer to https://github.com/redisson/redisson/wiki/16.-FAQ#q-what-is-the-cause-of-redistimeoutexception


Not separating out into specified sections

I have several mods where I am configuring them to default to vanilla categories, however, their original categories remain but are empty.
https://imgur.com/a/5vDD72Y
I'm using the new ComfyMods build panel redesign that is a replacement for ComfyBuildExpansion, SearsCatalog (https://valheim.thunderstore.io/package/ComfyMods/SearsCatalog/1.0.0/).

Can I get you any other information for this issue? I'm happy to help in any way! It's so cumbersome having so many tabs with nothing in them :(

What mods are you using where their original categories remain? I see "VikingLibrary" in your screenshot but cannot find any mod by this name.

Sure!
https://valheim.thunderstore.io/package/JiuJitsu/Constructed_Kingdoms_Secret_Bookcases/1.0.1/
https://valheim.thunderstore.io/package/OdinPlus/OdinArchitect/1.1.1/
https://valheim.thunderstore.io/package/ComfyMods/PotteryBarn/1.4.0/
https://valheim.thunderstore.io/package/RagnarokHCRP/MoreGates/

Alright, after a bit of digging I found the issue. PlanBuild is adding categories for all pieces as well on a different tool, which wasn't distinguished by HammerTime and thought that the category must be enabled.
That's easy to fix, will release a fix with version 0.3.3


Data consistency issue

If Alluxio detects that the source data in UFS has changed during the data reading process, how will it handle it? Will this reading process directly report an error?

If you set the config alluxio.user.file.metadata.sync.interval = 0 in file "conf/alluxio-site.properties", when Alluxio detects that the source data in UFS has changed, data in alluxio will be Invalid，the reading process will go to UFS to get the data.


Filter out undefined rows

Same as #1457
Fixes #1456
New behaviour:

Nvm, this patch is already applied in this fork :)


Unable to boot fresh installation.

RF Kill Switch Status
I have a Raspberry Pi 4 4GB, external ssd, mini LCD screen attached. There is another ticket I found with this issue but it was said it could be he needed a built in LCD screen to see whats going on. I have the screen and it freezes there. I have no idea what the IP address would be or if it is connected to my network to log in via Putty

I was ab

I was able to use PuTTY and get in, Blockchain is syncing =D


Fix broken quick-start setup script

vault token-create is not a valid command. Removing the hyphen and making it vault token create is what is desired here.

Thanks!


Why does hyper not close the future once it is complete?

I did implement a very basic hyper request and i noticed that the future does not seem to get closed once the request is finished. In the following example this would mean that Done is never printed.
extern crate tokio;
extern crate futures;
extern crate hyper;

use futures::future::*;
use hyper::Client;

fn main() {
    let client = Client::new();
    let uri = "http://httpbin.org/ip".parse().unwrap();
    let task = client.get(uri)
            .and_then(|res| {
                println!("Response: {}", res.status());
                Ok(())
            })
            .map_err(|err| {
                println!("Error: {}", err);
            });

    tokio::run(task);
    println!("Done!");
}

What could be the reason for this?
My toml file is as follows:
[dependencies]
tokio = "0.1"
futures = "0.1"
hyper = "0.12"

Thanks in advance!

Hi folks! Should we fix the client example https://github.com/hyperium/hyper/blob/master/examples/client.rs then? It uses hyper::rt::run, which in turn uses tokio::run, which will hang the way described in this bug (I also got hit by it).


Update dependencies

While troubleshooting a message-ix-models CI failure, I noticed that I couldn't update to the latest version of the dependencies because of outdated dependency versions in ixmp4 0.6.0. So this PR will eventually bump these/all dependencies.
At the moment, though, it still faces several warnings that need to be addressed. I'm not sure we can remove all of these warnings, though:

pytest 8.0.0 is incompatible with pytest-lazy-fixture, whose main branch has not seen an update in two years. So for now, I've adapted all tests to not use pytest-lazy-fixture, but as you can see, this adds quite a bit of repetition. A friendly coder has posted a different possible fix; please take a look @meksor and let me know which you prefer.
pandas is considering to add pyarrow as a mandatory dependency in 3.0.0. While this is still debated, they have already introduced a DeprecationWarning so that users can add pyarrow to their dependencies already. However, simply doing that caused several test failures for me (all related to data/db/base.py:bulk_upsert_chunk() in the meta tests) as detailed here.
Mypy is now complaining about lines 189 and 285 of db/filters.py, where the result of field_info.json_schema_extra.get() can be a multitude of types, while we only expect to deal with specific ones (though for line 189, I'm not sure whether we're expecting a dict or a list).
There are also several new Future- and DeprecationWarnings from pandas that we should address.

However, once these are clarified, I suggest releasing the next minor version.
Side note: I also want to try if we can support python 3.12; we might need a more recent version of e.g. pluggy, but this is transitive, so I don't know how much work this might be.

@meksor I haven't quite figured out how to best address even the first pandas warnings that I started to look at. In particular, please check out data/db/meta/repository.py: the original solution is now triggering this:
tests/core/test_meta.py::test_run_meta[test_sqlite_mp]
tests/core/test_meta.py::test_run_meta[test_sqlite_mp]
tests/core/test_meta.py::test_run_meta[test_sqlite_mp]
tests/core/test_meta.py::test_run_meta[test_sqlite_mp]
tests/core/test_meta.py::test_run_meta[test_sqlite_mp]
  /home/fridolin/ixmp4/ixmp4/data/db/meta/repository.py:176: DeprecationWarning: DataFrameGroupBy.apply operated on the grouping columns. This behavior is deprecated, and in a future version of pandas the grouping columns will be excluded from the operation. Either pass `include_groups=False` to exclude the groupings or explicitly select the grouping columns after groupby to silence this warning.
    return df.groupby("type", group_keys=False).apply(map_value_column)

Until now, I haven't been able to replicate the exact behaviour of this without triggering warnings. The suggested solutions don't work for me; include_groups=False leads to an error because "type" is not available for being changed in map_value_column(), and the only way I found to select a group (get_group()) can only ever select one group, while we want to work on all groups. Maybe looping over groups is still the preferable solution here since the others aren't quite working either.
The other solutions all come from the same question on StackOverflow, specifically these answers:

the slowest, but almost working
faster, but not really working
apparently even faster and maybe closer to working

None of these are quite there yet, I feel the one from numba might even be closest, but numba.jit doesn't seem to support types generic enough to hold our value column, I'm afraid.
Please also note that my solution for the first FutureWarning was to just not use pd.DataFrame.fillna() at all since the test dataframe already contains only np.nan and None, but this might not generally be true for future use cases.

We also already receive warnings for the next big changed announced for pandas 3.0.0: Copy-on-Write will be the default on only mode of operation. Fortunately, there already exists a migration guide and we can invest some time to future-proof our code now.

lazy fixtures: the solution currently on this branch is a little confusing but its not too bad. My hunch is that its best to reimplement something close to what plf did and keep an eye on the project in case someone picks it back up.
not sure if its even wise to update pandas if there is so much commotion and uncertainty over this change. I would propose to wait on this if possible.
I for one think its probably a good idea to add one of the parallelized data libaries to pandas directly. if this change works out we may be able to drop dask from our deps (although i havent found the right operation yet).
Mypy: i think i already fixed those errors in my latest PR
hm, unsure how to continue with this. I guess performance isnt the deciding factor here as apply has always been very slow. But if you find a good solution its probably best to use it everywhere apply is used.
fillna: Hm not sure about that i think there was a specific reason to replace all the nans with Nones but it may be best to check with @danielhuppmann ? Its probably also wise to bake those requirements into a test once clarified.

Thanks for the feedback @meksor, I'll try to incorporate it further soon.
@danielhuppmann, @phackstock: I want to prioritize this PR to support Python 3.12, so we should aim for a release soon after following this PR. Hopefully, pyam-iamc can then follow suit and support 3.12, which would allow message-ix-models and message_data to support it. Currently, new users are running into issues by seeing that message_ix and ixmp do support 3.12 and not seeing that the rest of the stack doesn't necessarily.

Thanks @glatterf42, sounds good to me to support python 3.12, I'll make sure that pyam will follow suit after the ixmp4 release. It would be critical to have the pyam-ixmp4-release before end of February 22 so that users can directly query the ixmp4 ssp-extensions database via our Python tools (and the public launch of that project will be end of February).

Wrt lazy_fixtures, I'm actively following that discussion. Pytest might be incorporating lazy_fixtures in its core implementation, but that also might take some time.
I've reverted the pandas update and mypy is happy after the rebase, too.

The PR now also checks python 3.12 and it's going surprisingly well. Locally, I ran into another error with test_benchmarks_filter (in the api layer, will try to replicate tomorrow or so), but these don't happen here, so I don't know if we're good. I'll also check if dateutil and multimethod can be updated, but apart from these two warnings (and potentially some documentation), we seem to be almost good to go for 3.12 :)

Re: dateutil: This is not a direct dependency of ours and we don't call the deprecated function anywhere in our code. Dependencies like pandas and jupyter do depend on dateutil, though, which has last been released 2.5 years ago. Their current master branch already contains a fix for the DeprecationWarning we are seeing, but they haven't managed to publish a new release yet, despite there being large popular demand:

https://github.com/dateutil/dateutil/issues/1314
https://github.com/dateutil/dateutil/pull/1130 might need to be merged first

So for now, if we can live with the DeprecationWarning, I'd suggest keeping track of it with a new issue, but merging this PR anyway (if the other things are dealt with).

Re: multimethod: same here, this is a transitive dependency of ours. Pygments and pandera are using it and the issue arises due to an incompatibility of pandera 0.18.0 and multimethod 1.11.0. This issue has already been raised with pandera and a version pin introduced on their main branch, but this was just ten hours ago, so they didn't have time for a new release yet. We might get a notification about a new release by checking this PR:

https://github.com/unionai-oss/pandera/pull/1486

In this case, it seems more likely that a patch release is coming soon, so we might not need to keep track with a new issue.

 I receive the above error for every filter (0 through 5) for both test_pgsql_mp_generated and test_api_pgsql_mp_generated.

The current solution is to test once if a connection to a postgresql db can be established and skip all corresponding tests if it can't. This fix is now applied for all pqsgl_mp fixtures. My main question for @meksor is: do we need https://github.com/iiasa/ixmp4/blob/1013429d436706453869c1846fccc299c6daa75b/tests/conftest.py#L31-L32 to safely disconnect from the db? If yes, mypy would not be happy about that, I think.

Please check if we're missing stated-py3.12 support in the docs; apart from that, this might pretty much be good to go :)

Yes, we need backend.close! Why does mypy care?

Mypy is showing "Backend" has no attribute "close" Mypyattr-defined. Curiously, this error is not shown e.g. here: https://github.com/iiasa/ixmp4/blob/55a4774b54cbb9c9b6b61dcdccb6b6c0b77ae5c7/tests/conftest.py#L115-L118
And when I insert a yield mp statement between my mp = and mp.backend.close() lines, the mypy error goes away (even though yield is not allowed outside of a function). So my guess is that mypy assumes something is happening to mp after it's yielded such that it does have .backend.close() at the time we call it. Which is probably not what we want, it should probably just recognize the function the first time around.
In other news, what do you mean with 'we need backend.close? The tests seem to have been running fine even without it.

This PR should now be good to go; fixed the spelling mistake (that already existed before this PR) and updated all badges/docs in general.

Looks like the tests are currently failing because the Network at https://api.dev.manager.ece.iiasa.ac.at/v1/ is unreachable.

I'm going to merge this now, please let me know if we need any cleanup and I'll set up a new PR.


And for plain faster rcnn, when I use my own faster rcnn, and faster rcnn implemented by you to fit my dataset with the same parameter setting, the results are different and have a big difference. Do you think I should set different parameters? Do you have any advice about that? Thanks

Hi, thanks for your advice, finally, I get your results. But I am confused, for my faster rcnn and your plain faster rcnn. I need to use different parameters setting to get the same results on my own dataset. Can you provide some advice about that? thanks

I guess one difference might be how to set learning rate: https://github.com/bowenc0221/Decoupled-Classification-Refinement/blob/9c37d014212f2e9f335a7262e3b1c24cd6774e49/faster_rcnn/train_end2end.py#L152
rescale_grad  is 1/NUM_GPUS by default, but I set it to 1.0. So in this implementation, the actual learning rate is lr * NUM_GPUS.

thanks for your reply. I got it. The difference of weight decay of 0.0005 and 0.0001 have big influence on final performance? Thanks

Yes, weight decay has a very large influence. You should not change it.

thank you. Why it has a big influence?


Add apollo and relay example

it would be really nice to have an apollo and a relay example of usage of this package

Good call - has anyone implemented Relay support for this transport yet? If not, that would be the first step.

Has anyone found a example?

At the moment, we have a great example for subscriptions with Apollo: http://dev.apollodata.com/react/subscriptions.html

Nice @dotansimha Hopefully we get a relay modern example soon :) There isn't one anywhere yet. There are a couple of apollo examples already!

Here is my practice of fullstack todoMVC with apollo:
https://github.com/evenchange4/todomvc-subscriptions
Any feedbacks are welcome~

Thanks for the suggestion; we're doing a bit of house cleaning on this repo so we'll close this off, but if anyone is ever interested in doing this let us know. Hosting the example outside of the repo is probably best, but we'll link to it from the README. Thanks!


updated algorithms schema

In continuation of this PR: https://github.com/kube-HPC/hkube/pull/1971
Updated schema with the new variable name: unscheduledReason
Related Issue: kube-HPC/hkube#1970

This change is

/deploy


Sandbox support ?

hi~
I have test use Magick++ for cocoa app. but fail when sandbox enable;
crash like this:
libc++abi.dylib: terminating with uncaught exception of type Magick::ErrorModule: SmallImage: UnableToLoadModule '/usr/local/Cellar/imagemagick/7.0.5-4/lib/ImageMagick//modules-Q16HDRI/coders/jpeg.la': file not found @ error/module.c/OpenModule/1279

Hi @liufsd, I'm not sure I can really help with that.
But my guess would be that the problem is most likely with the installed dependencies (this problem is also present in this library) or the way library is used when sandbox mode is enabled.
I'm not even near the OSX app developer, so I can only guess.
This stack-overflow question has the link to the solution, maybe it will help.

hi~ thanks for response.
Sandbox close work like this: https://www.youtube.com/watch?v=7miwnp8iDm8.
I guess the sandbox enable will be not support link other library by using 'odules-Q16HDRI/coders/jpeg.la'  , maybe need build imagemagick and jpeg static lib for the sandbox  such as https://www.imagemagick.org/script/binary-releases.php ios  imagemagick_compile.sh ?
but no source for the cocoa app.

i have post my demo project here : https://github.com/liufsd/MagickCocoa
(you can close sandbox mod it will run success)

libc++abi.dylib: terminating with uncaught exception of type Magick::ErrorModule: MagickCocoa: UnableToLoadModule '/usr/local/Cellar/imagemagick/7.0.5-5/lib/ImageMagick//modules-Q16HDRI/coders/jpeg.la': file not found @ error/module.c/OpenModule/1266
if i open the sandbox enable ,it will crash


Debugging setup of grafana

I would like to deploy grafana to coessing.pangeo.2i2c.cloud so that we and admins can monitor activity. I am following @yuvipanda's instructions here. Here are the steps I'm taking:

From PR https://github.com/2i2c-org/pilot-hubs/pull/456, I have checked out the support/secrets.yaml file, and the updated .sops.yaml and deployer/hub.py files.
I am running python deployer deploy-support pangeo-181919 and everything passes
I have added the external IP of support-ingress-nginx-controller to the grafana.pangeo.2i2c.cloud DNS entry and I can see the login page at that address

Problem:
When I enter username admin and the decrypted admin key from support/secrets.yaml, I am told this is an incorrect password. Have I missed something?

@sgibson91 Did you do a prior deploy without the secrets.yaml file? If so, grafana autogenerates a password it doesn't tell you about (grumble grumble). Delete the support-grafana secret in the support namespace and try running deploy-support again?

Hmmm yeah, this doesn't seem to work. I think I'll try removing the support chart and reinstalling with the admin password from the start.

Fixed!
Note to self: I was not being as clever as I thought I was being when I ran the below
sops -d -i support/secrets.yaml && cat support/secrets.yaml | pbcopy && sops -e -i support/secrets.yaml

The cat probably needs to be a jq instead - but that's beside the point


/deleteprofile is not working in the new bot builder SDK v4

/deleteprofile command is not working to clear the state
Version
Bot Builder SDK 4.10 C#, Enterprise Bot template. Backend tried for state management CosmosDB and blob storage, in memory storage.
Describe the bug
/deleteprofile command does not clear the state. And there is not any other alternative to clear the state.
Expected behavior
It should clear the bot state.
[bug]

@darrenj - what should "/deleteprofile" do? @stevenic left it out of the v4 State Implementation deliberately, IIRC.

@cleemullins - Basically, it clears the current state data ( user state, conversation state and private converstaion state ) ( If i am not wrong ) . It was very useful command when we want to test anything in bot by clearing the state.

@darrenj we don't want to add this directly into the SDK -- perhaps we could add this into one of the samples or the enterprise template?