test: Debugging why CLI failing on CI

🤖 Generated by Copilot at f15c526
Summary
🚀🔧🖥

The pull request simplifies the GitHub workflows by removing unused or redundant ones and by enabling interactive terminal sessions for the publish workflow using upterm. This might improve the efficiency and reliability of the release process.

To publish on every push
They modified the workflow as such
They used upterm for sessions
To debug or test their expressions
And hope it won't break too much

Walkthrough

Change the publish workflow trigger from release to push (link)
Replace the bundling, gathering and uploading steps with an upterm session step in the publish workflow (link)
Delete the workflows for proto-sync, staging, validate-pr-title, release-please and release-candidate (link, link, link, link, link)

Current dependencies on/for this PR:

main

PR #3495   👈

This comment was auto-generated by Graphite.


install kube-ui v3 in kube-system namespace

@yanns will test this in a few hours and report back. Thank you!


[monorepo] Add changeset to checks

Adds enforcing that all PR's need changesets, to streamline releases.

Shouldn't the changeset check have failed since this PR doesn't include a changeset?

@bicknellr Good question! Changes to the top-level monorepo are exempt, as it turns out. In https://github.com/lit/lit/pull/2061/commits/b1e3b28391cf0f9052c725a200f682e86cf5272a I tested changing lit-html's README to confirm it does fail.


 IF YOU DO NOT FOLLOW THE FORMAT OR MAKE A GENERIC TOKEN REQUEST YOUR ISSUE WILL BE DELETED WITHOUT COMMENT
YOUR JUSTLIST MUST FOLLOW THE JSON SPECIFICATION
https://github.com/justswaporg/justlists/example.justlists.ts
Checklist

[x] I understand that this is not the place to request a token listing.
[x] I have tested that my JustList is compatible by pasting the URL into the add a list UI at justswap.org.
[x] I understand that filing an issue or adding liquidity does not guarantee addition to the justlists website.

Please provide the following information for your token.
JustList URL must be HTTPS.
JustList URL: https://raw.githubusercontent.com/Theflashcurrency-TFC/theflashcurrency-TFC/main/justlist.Untitled-1.json
JustList Name: The Flash Currency
Link to the official homepage of the JustList manager: https://theflashcurrency.com/

Sorry, your issue will be closed as you did not submit your information in the correct format.


vNext - Add 404 Handler to microapps-router

[ ] Redirect to default app option for app roots that 404?
[ ] Fancy 404 page on missing apps option?

This is no longer necessary as the router is not deployed by default anymore


Nowhere to add members in sandstorm implementation

Running sandstorm v 0.100 -
Installed Libreboard on Sandstorm no problem, but the menu sidebar is missing the button to add members.
EDIT for more clarity: Adding members via the share private link tool (the sandstorm way) doesn't add other sandstorm users as members to the project.

:+1:

Generally speaking (assuming sharing works properly, which I don't believe it does in 0.8.0), when you create a sharing link, and then that user clicks on that link (while logged into Sandstorm), then they get added to the board.

@ocdtrekkie this does not happen, at least when I tried it out on a sandstorm instance created a couple of days ago and a libreboard made a couple of hours ago. I can't see how to easily tell what version I'm running.

The version on the Sandstorm app list is 0.8.0, and it predates Sandstorm's new sharing model. Until 0.9.0 is released, sharing LibreBoard with Sandstorm doesn't work very well.

I needed Libreboard 0.9 with sharing working on sandstorm, so I created an spk from git.
I may upload new versions periodically here if I need them:
https://6zoa0lpoq1e4mn4nlkgh.oasis.sandstorm.io
Here is the latest (commit 4ef5a21):
https://6zoa0lpoq1e4mn4nlkgh.oasis.sandstorm.io/libreboard_0.9.0_4ef5a21.spk

@tiagoefreitas Have you tried using Sandstorm's share mechanic yet? (Send me an invite to a grain of yours to test?)

A test grain of tiago's SPK: https://oasis.sandstorm.io/shared/uhb45z9vIVNqyVtty6YR1xB76j4fhRB5mxRq1NBA1xh

This is fixed in the upcoming v0.9 — closing so I can keep track of the remaining tasks.


NIFI-1942 Processor to validate CSV against user-supplied schema

This processor is designed to validate a CSV formatted FlowFile against a user-supplied schema.
It leverages Cell Processors from super-csv library and gives the following options to define the expected schema:

ParseBigDecimal
ParseBool
ParseChar
ParseDate
ParseDouble
ParseInt
ParseLong
Optional
DMinMax
Equals
ForbidSubStr
LMinMax
NotNull
Null
RequireHashCode
RequireSubStr
Strlen
StrMinMax
StrNotNullOrEmpty
StrRegEx
Unique
UniqueHashCode

Nested cell processors are not supported except with Optional.

Hey @pvillard31, looks like this has merge conflicts. Could you address them?

Hey @JPercivall, that should be OK now, thanks!

@pvillard31 I left a couple comments. Do you by chance have a template and/or example csv data I can use to validate the processor?

Hey @JPercivall, thanks for the review! I believe I addressed all of your comments. I also added the new dependency in NOTICE files (let me know if it is OK). To validate the processor I used a simple flow to generate CSV data with a ReplaceText processor: I'm gonna add the template to the JIRA right now.

I'm trying to use a couple of the processors listed in the accompanying doc you link to[1] but there seem to be some processors that aren't available (notably "IsIncludedIn"). I was trying to make sure a column had a value in a set of strings ("male" or "female").
Is there a reason for not including all the processors available?
[1] http://super-csv.github.io/super-csv/cell_processors.html
[2] http://super-csv.github.io/super-csv/apidocs/org/supercsv/cellprocessor/constraint/IsIncludedIn.html

Hey @JPercivall

Reverted NOTICE changes
Separated the exception and changed the logging approach when there is an invalid CSV
Changed the error message when the user provides a wrong method in the schema property and added a test (let me know in case it is not what you were thinking about)
Added IsIncludedIn cell processor (my bad!).
Added list of supported cell processors in additional documentation.

For the other cell processors I am not sure to see how they would fit in a validating process. If I am missing something here, let me know. There are interesting cell processors to modify CSV content by writing a new CSV file (a new FlowFile). This could be nice but this is not only validation anymore, I assume this would be better in a different processor, no?

@pvillard31, sorry for not realizing this earlier but a great improvement that could be made is to route like RouteText does. Where it can either route the whole FlowFile when it fails or route each line to the respective valid/invalid destination. Where invalid rows would have an attribute detailing what went wrong.
I believe all that would need to be done is to create flowfiles with each reading of the row and if it fails add it to the invalid list (along with adding an attribute to it).

 I agree that offering the possibility to filter out the "wrong" lines is a nice feature. I chose the option to have one flow file containing valid lines and one containing invalid lines. WRT this choice, I am not sure it makes sens to add an attribute with an error message since the error could be different for each invalid lines. Let me know your thoughts! Thanks!

Hey @JPercivall, I think I've addressed most of your comments:

changed log level
fixed decrementation (was not related to header but rather to 'finally' in 'while' loop)
strategy naming and description
fixed first line handling and added a unit test for that and to confirm Unique() behavior when validating line by line
changed exception catching

It remains what you observed when displaying content of flow files after being processed by the processor. I've reproduced your observation but I didn't find any explanation. By any chance, do you know if there are some specific encoding related to the UI display? (I remember some discussions regarding how is processed the carriage return (shift + enter instead of \n) when used in a property in some processors) If you haves ideas, let me know!
Thanks.

@pvillard31, I know what the problem with the end-line characters is. When going from the UI to Java, the characters are escaped so that what you input is transferred over to Java as is. So when you type the characters "" and "\n" into the UI the Java string will end up being those two characters not the interpreted value "\n".
There's been some discussion about it before and how we need to make some change but it hasn't been a top priority. For now what is done, is something like is done here[1]. Where the default value is escaped and then in the OnScheduled[2] or as a separate method[3] it is interpreted.
[1] https://github.com/apache/nifi/blob/1373bf672586ba5ddcfa697c45c832ccc79425cb/nifi-commons/nifi-processor-utilities/src/main/java/org/apache/nifi/processor/util/listen/AbstractListenEventBatchingProcessor.java#L61-L61
[2] https://github.com/apache/nifi/blob/1373bf672586ba5ddcfa697c45c832ccc79425cb/nifi-commons/nifi-processor-utilities/src/main/java/org/apache/nifi/processor/util/listen/AbstractListenEventBatchingProcessor.java#L97-L97
[3] https://github.com/apache/nifi/blob/cd846c8d627efb2606f72b6af009358dec27be63/nifi-commons/nifi-processor-utilities/src/main/java/org/apache/nifi/processor/util/put/AbstractPutEventProcessor.java#L566-L566

Thanks @JPercivall !
I did the modification in the OnSchedule method and it is now working as expected. I also took the liberty to squash my commits. Let me know if there is something else.

+1
Visually verified code and did a contrib check build. In a standalone instance ran multiple different schemas through ValidateCSV testing each of the properties, all worked as expected. Thanks @pvillard31, I will merge it in.


fix incorrect nested array value

Summary

Checklist
Delete items not relevant to your PR:

[x] Unit and integration tests covering the common scenarios were added
[x] A human-readable description of the changes was provided to include in CHANGELOG
[ ] For significant changes, documentation in https://github.com/ClickHouse/clickhouse-docs was updated with further explanations or tutorials

Will merge tomorrow after benchmarking. The flaky tests on the other will be fixed(or disabled) in a separate PR.
-- works in 0.4.0
select [[1,2],[2,1],[3,4]]::Array(Array(Int8))

-- fixed 0.4.1
select [[1,2],[2,1],[3,4]]::Array(Array(Nullable(Int8)))
select [['aa','bb'],['cc','dd']]::Array(Array(String))
select [[['aa','bb'],['cc','dd']],[['aa2','bb1'],['cc1','dd2']]]::Array(Array(Array(String)))

The fix works at the cost of higher memory usage for nested arrays. Also I spotted issue in piped output stream during benchmarking. Should be good to merge this one first and fix other issues in separate PRs.


Upgrade react-cra example to use ts_project, jest_test & js_run_devserver

@jbedard The BUILD fine under src follows the conventions we are planning for BUILD file generation (minus the eslint_test target)


[libgpg-error] update to 1.42, add Windows support, arm fixes

Describe the pull request
Support Windows builds using ShiftMediaProject
Update to 1.42
Fix linux-arm build
Also convert CONTROL to JSON manifest format

Which triplets are supported/not supported? Have you updated the CI baseline?

Additional support for all Windows triplets, except ARM. No CI baseline update necessary.

Does your PR follow the maintainer guide?

Yes

@ras0219-msft I fixed the compilation issues I talked about on Slack. The libs build fine now, however, CI/CD static build fails, while not making much sense:
-- [COMMUNITY] Loading triplet configuration from: C:\a\1\s\triplets\community\x64-windows-static-md.cmake

(...)
-- Performing post-build validation
Expected Debug,**Dynamic** crt linkage, but the following libs had invalid crt linkage:
    D:/packages/libgpg-error_x64-windows-static-md/debug/lib/gpg-errord.lib: Debug,Static
Expected Release,**Dynamic** crt linkage, but the following libs had invalid crt linkage:
    D:/packages/libgpg-error_x64-windows-static-md/lib/gpg-error.lib: Release,Static

Surely something is off here with post-build validation?

@JonLiu1993 all fixed now

LGTM! Thanks for your contribution

Thanks @wrobelda :)


Make casting of string to integral throw if input contains space

This change makes it throw exception to cast string to integral
types (bigint, integer, boolean, etc), when cast_to_int_by_truncate=false,
to have the same behavior as Presto. For the CAST expression, previous
behavior is to accept leading and trailing whitespaces in input strings
and can cast successfully when cast_to_int_by_truncate=false.
For Presto, casting string to real & double accepts leading and trailing
whitespaces. So should keep the behavior as it is.
CAST expression accepts whitespace in input because it utilizes folly to do
conversion. folly explicitly accepts and processes leading and trailing
whitespaces of input strings. So we just need to override this part of behavior
and continue to utilize the rest.
https://github.com/facebook/folly/blob/00b7e630bdbd09e7f1cd173c80c2f52b1e631df6/folly/Conv.h#L1501-L1510
https://github.com/facebook/folly/blob/00b7e630bdbd09e7f1cd173c80c2f52b1e631df6/folly/Conv.h#L1458-L1466
Also add benchmark for the invalid cases of try_cast() and try(cast)) on strings
with whitespace.

we chatted offline

we chatted offline

@laithsakka @gggrace14 Laith, Ge, would you summarize this discussion?

we chatted offline

@laithsakka @gggrace14 Laith, Ge, would you summarize this discussion?

This change returns exception for casting strings with whitespace, which previously didn't throw. Talking with Laith for perf and reading his blog, I understand

To return exception, I can directly set the result to null or set the result to exception_ptr in CastExpr::applyCastKernel(), doing the same as we handle the empty string now. This avoids calling VELOX_CHECK, constructing Velox exception or throwing & rethrowing exceptions from folly, which are expensive.
For benchmarking, try_cast invalid case should be ~1.x ms. cast valid case should be kept ~2.x ms.

For benchmarking, after the change we should expect

The valid cases try_cast_valid & tryexpr_cast_valid & cast_valid doesn't see much increase to time.
The whitespace cases try_cast_invalid_whitespace & tryexpr_cast_invalid_whitespace has comparable time as the empty input cases try_cast_invalid_empty_input & tryexpr_cast_invalid_empty_input.

Before the change
[...]hmarks/ExpressionBenchmarkBuilder.cpp     relative  time/iter   iters/s
cast##try_cast_invalid_empty_input                          1.47ms    678.21
cast##tryexpr_cast_invalid_empty_input                    326.49ms      3.06
cast##try_cast_valid                                        2.17ms    461.16
cast##tryexpr_cast_valid                                    2.14ms    468.35
cast##cast_valid                                            2.13ms    470.30
After the change
[...]hmarks/ExpressionBenchmarkBuilder.cpp     relative  time/iter   iters/s
cast##try_cast_invalid_empty_input                          1.35ms    740.15
cast##tryexpr_cast_invalid_empty_input                    344.44ms      2.90
cast##try_cast_invalid_whitespace                           1.45ms    689.42
cast##tryexpr_cast_invalid_whitespace                     335.06ms      2.98
cast##try_cast_valid                                        2.10ms    475.13
cast##tryexpr_cast_valid                                    2.19ms    456.77
cast##cast_valid                                            2.18ms    459.71

@laithsakka @mbasmanova @Yuhta Hi Laith, Masha, Jimmy, I revised according to comments. Would you be able to help take a look again and approve if it looks okay to you?

After investigation and discussion, decide not to proceed with this change, as ANSI SQL standard accepts leading and trailing whitespaces which is current behavior. Follow-up, https://github.com/prestodb/presto/issues/21315


to #7005: transform params to SPRING_DATASOURCE_XXX

Purpose of the pull request
https://github.com/apache/dolphinscheduler/issues/7005
Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.
(or)
This pull request is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:

@kezhenxu94  please take a look at this

Codecov Report

Merging #7007 (6e60152) into dev (ef0cb46) will decrease coverage by 0.13%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##                dev    #7007      +/-   ##
============================================
- Coverage     32.75%   32.61%   -0.14%
+ Complexity     1610     1605       -5
============================================
  Files           431      431
  Lines         14338    14338
  Branches       1437     1437
============================================
- Hits           4696     4677      -19
- Misses         9190     9211      +21
+ Partials        452      450       -2

Impacted Files
Coverage Δ

...he/dolphinscheduler/common/enums/SqoopJobType.java
0.00% <0.00%> (-88.89%)
:arrow_down:

...r/plugin/registry/zookeeper/ZookeeperRegistry.java
47.27% <0.00%> (-8.19%)
:arrow_down:

...inscheduler/common/task/sqoop/SqoopParameters.java
74.00% <0.00%> (-2.00%)
:arrow_down:

...dolphinscheduler/remote/future/ResponseFuture.java
81.96% <0.00%> (-1.64%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ef0cb46...6e60152. Read the comment docs.

Please also adjust the env vars in e2e test. https://github.com/apache/dolphinscheduler/blob/ef0cb466619621556d9f2e886d55707f0b0b8a8e/dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/tenant/docker-compose.yaml#L24

Please also adjust the env vars in e2e test.
https://github.com/apache/dolphinscheduler/blob/ef0cb466619621556d9f2e886d55707f0b0b8a8e/dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/tenant/docker-compose.yaml#L24-L25

the number h2 url  of patterns  is too many, just skip it and use application-h2.yaml default config.

Ok. LGTM @CalvinKirs


Allow to override the Container registry URL

Description of the change:
Motivation for the change:
Checklist

[ ] Add or Modify a unit test for your change
[ ] Have you verified that tall the tests are passing?

How to backport a pull request to a different branch?

In order to automatically create a backporting pull request please add one or more labels having the following format backport-<branch-name>, where <branch-name> is the name of the branch where the pull request must be backported to (e.g., backport-7.67.x to backport the original PR to the 7.67.x branch).

NOTE: backporting is an action aiming to move a change (usually a commit) from a branch (usually the main one) to another one, which is generally referring to a still maintained release branch. Keeping it simple: it is about to move a specific change or a set of them from one branch to another.

Once the original pull request is successfully merged, the automated action will create one backporting pull request per each label (with the previous format) that has been added.
If something goes wrong, the author will be notified and at this point a manual backporting is needed.

NOTE: this automated backporting is triggered whenever a pull request on main branch is labeled or closed, but both conditions must be satisfied to get the new PR created.

depends on https://github.com/kiegroup/jenkins-pipeline-shared-libraries/pull/285

Openshift tests job #196 was: ABORTED
Possible explanation: Most probably a timeout, please review
Please look here: https://jenkins-kogito-tools.kogito-cluster-0ad6762cc85bcef5745bb684498c2436-0000.us-south.containers.appdomain.cloud/job/kogito/job/kogito-serverless-operator-PR-check/196/display/redirect
See console log:

Console Logs
openshift-multus                                   network-metrics-daemon-p9vdk                                      2/2     Running     0                44dopenshift-network-diagnostics                      network-check-source-64d5ff5774-sntpw                             1/1     Running     0                44dopenshift-network-diagnostics                      network-check-target-tzkft                                        1/1     Running     0                44dopenshift-network-diagnostics                      network-check-target-v26kv                                        1/1     Running     0                44dopenshift-network-operator                         network-operator-6b7968774f-mthnz                                 1/1     Running     1 (15d ago)      44dopenshift-operator-lifecycle-manager               catalog-operator-9767dc846-jwl9j                                  1/1     Running     0                10dopenshift-operator-lifecycle-manager               collect-profiles-28149870-4z4pn                                   0/1     Completed   0                35mopenshift-operator-lifecycle-manager               collect-profiles-28149885-g8b66                                   0/1     Completed   0                20mopenshift-operator-lifecycle-manager               collect-profiles-28149900-ldjnh                                   0/1     Completed   0                5m15sopenshift-operator-lifecycle-manager               olm-operator-74c479595c-tjq7w                                     1/1     Running     0                10dopenshift-operator-lifecycle-manager               package-server-manager-8b774486c-kbkrk                            1/1     Running     0                10dopenshift-operator-lifecycle-manager               packageserver-9d9cf79c-5szm8                                      1/1     Running     0                10dopenshift-operator-lifecycle-manager               packageserver-9d9cf79c-87jbk                                      1/1     Running     0                10dopenshift-roks-metrics                             metrics-9fd6fd97f-n2d2v                                           1/1     Running     0                67dopenshift-roks-metrics                             push-gateway-7dd6b9c999-ffczz                                     1/1     Running     0                67dopenshift-service-ca-operator                      service-ca-operator-687b9dfb6f-b5wjz                              1/1     Running     0                10dopenshift-service-ca                               service-ca-5fd7645d7b-cg4pv                                       1/1     Running     1 (15d ago)      44dteste                                              httpd-sample-7bdf74f5cd-b2rbf                                     1/1     Running     0                97dtigera-operator                                    tigera-operator-7dc6fddb9c-nnj9p                                  1/1     Running     0                10d[Pipeline] }[Pipeline] // scriptPost stage[Pipeline] archiveArtifactsArchiving artifacts[Pipeline] junitRecording test resultsNone of the test reports contained any result[Checks API] No suitable checks publisher found.[Pipeline] }[Pipeline] // withEnv[Pipeline] }[Pipeline] // timeout[Pipeline] }[Pipeline] // stage[Pipeline] }[Pipeline] // withEnv[Pipeline] }Lock released on resource [Sonataflow Operator OpenShift tests https://c107-e.us-south.containers.cloud.ibm.com:30353][Pipeline] // lock[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Declarative: Post Actions)[Pipeline] script[Pipeline] {[Pipeline] sh+ wget --no-check-certificate -qO - https://jenkins-kogito-tools.kogito-cluster-0ad6762cc85bcef5745bb684498c2436-0000.us-south.containers.appdomain.cloud/job/kogito/job/kogito-serverless-operator-PR-check/196/api/json[Pipeline] readJSON[Pipeline] shNo test report files were found. Configuration error?

Openshift tests job #197 was: UNSTABLE
Possible explanation: This should be test failures
Please look here: https://jenkins-kogito-tools.kogito-cluster-0ad6762cc85bcef5745bb684498c2436-0000.us-south.containers.appdomain.cloud/job/kogito/job/kogito-serverless-operator-PR-check/197/display/redirect
See console log:

Console Logs
openshift-network-diagnostics                      network-check-target-tzkft                                        1/1     Running     0                44dopenshift-network-diagnostics                      network-check-target-v26kv                                        1/1     Running     0                44dopenshift-network-operator                         network-operator-6b7968774f-mthnz                                 1/1     Running     1 (15d ago)      44dopenshift-operator-lifecycle-manager               catalog-operator-9767dc846-jwl9j                                  1/1     Running     0                10dopenshift-operator-lifecycle-manager               collect-profiles-28149885-g8b66                                   0/1     Completed   0                36mopenshift-operator-lifecycle-manager               collect-profiles-28149900-ldjnh                                   0/1     Completed   0                21mopenshift-operator-lifecycle-manager               collect-profiles-28149915-vpq42                                   0/1     Completed   0                6m56sopenshift-operator-lifecycle-manager               olm-operator-74c479595c-tjq7w                                     1/1     Running     0                10dopenshift-operator-lifecycle-manager               package-server-manager-8b774486c-kbkrk                            1/1     Running     0                10dopenshift-operator-lifecycle-manager               packageserver-9d9cf79c-5szm8                                      1/1     Running     0                10dopenshift-operator-lifecycle-manager               packageserver-9d9cf79c-87jbk                                      1/1     Running     0                10dopenshift-roks-metrics                             metrics-9fd6fd97f-n2d2v                                           1/1     Running     0                67dopenshift-roks-metrics                             push-gateway-7dd6b9c999-ffczz                                     1/1     Running     0                67dopenshift-service-ca-operator                      service-ca-operator-687b9dfb6f-b5wjz                              1/1     Running     0                10dopenshift-service-ca                               service-ca-5fd7645d7b-cg4pv                                       1/1     Running     1 (15d ago)      44dteste                                              httpd-sample-7bdf74f5cd-b2rbf                                     1/1     Running     0                97dtigera-operator                                    tigera-operator-7dc6fddb9c-nnj9p                                  1/1     Running     0                10d[Pipeline] }[Pipeline] // scriptPost stage[Pipeline] archiveArtifactsArchiving artifacts‘test/logs/**/*.log’ doesn’t match anything: ‘test’ exists but not ‘test/logs/**/*.log’No artifacts found that match the file pattern "test/logs/**/*.log". Configuration error?[Pipeline] junitRecording test resultsNone of the test reports contained any result[Checks API] No suitable checks publisher found.[Pipeline] }[Pipeline] // withEnv[Pipeline] }[Pipeline] // timeout[Pipeline] }[Pipeline] // stage[Pipeline] }[Pipeline] // withEnv[Pipeline] }Lock released on resource [Sonataflow Operator OpenShift tests https://c107-e.us-south.containers.cloud.ibm.com:30353][Pipeline] // lock[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (Declarative: Post Actions)[Pipeline] script[Pipeline] {[Pipeline] sh+ wget --no-check-certificate -qO - https://jenkins-kogito-tools.kogito-cluster-0ad6762cc85bcef5745bb684498c2436-0000.us-south.containers.appdomain.cloud/job/kogito/job/kogito-serverless-operator-PR-check/197/api/jsonNo test report files were found. Configuration error?[Pipeline] readJSON[Pipeline] sh


Changing types

Fixes #92

@JonasKruckenberg Also I wasn't sure if I'm supposed to rebuild the lib manually, but I didn't find a GA setup for this, so I did it anyway. Can drop if needed.

Oh sorry, one last thing: can you add a changefile summarizing what you did?

Closing due to inactivity in favor of #133


Inject kubernetes secrets to a function definition

Currently, I'm using https://github.com/Jimdo/serverless-dotenv to manage environment variables and secrets in a NodeJS runtime. The plugin works as expected and publishes the variables into the process.env. The problem is that anyone with permissions to describe the Kubernetes resources, for example, the function deployment can see in plain text the variables that were added using the dotenv file.
Therefore, is there any example or guidance on how to use the serverless-kubeless to inject a Kubernetes secret and consume it in a NodeJs runtime function?

Yes, unfortunately there are no docs for this. You can specify an array of secrets in your function and the will be mounted in your function using the path /<secret-name>. You can see the code related to that here:
https://github.com/serverless/serverless-kubeless/blob/master/lib/deploy.js#L161
Note that you need to create the secrets before-hand.

Thanks for pointing me in the right direction. Here is what I did to keep the same dotenv file usage.

Created a K8s secret:

kubectl create secret generic secret-dotenv-file  --from-file=.env

Added the secret key into the provider definition in the serverless.yml file:

provider:
  name: kubeless
  runtime: nodejs10
  ....

  secrets:
    - secret-dotenv-file

Inside the pod:

require('dotenv').config({
  path: '/secret-dotenv-file/.env',
})

You can mark this issue as resolved. Thanks again for helping out.

I opened this PR to include the above documentation in this repository https://github.com/serverless/serverless-kubeless/pull/198.


[FEATURE] Support configure rootfs layout (PERSISTENT_STATE_PATHS) through Harvester configuration

Currently, the rootfs layout is hardcoded in
https://github.com/harvester/harvester-installer/blob/111c75b62326b40dfefcefdc5f7ce0c657b7d0dd/pkg/config/templates/cos-rootfs.yaml#L9
Users must build their custom iso if they want to add some dirs to the PERSISTENT_STATE_PATHS.
Describe the solution you'd like

Support configure rootfs layout through Harvester configuration
Describe alternatives you've considered

Additional context

Test Plan follow https://github.com/harvester/harvester/issues/2405#issuecomment-1549634520

Verified this feature has been implemented.
Test Information

Environment: qemu/KVM single node
Harvester Version: master-b49e264e-head
ui-source Option: Auto

Verify Steps

Install Harvester with any nodes with configure option:

os:
  persistentStatePaths:
    - /var/lib/rook

Harvester should installed successfully
Login to console, folder /var/lib/rock should exist
Reboot the node, folder /var/lib/rock should still exist


Updated links for Web App Bicep samples

#95130
Added changes to links to point to the Azure Quick Start Templates repository.
Some of these could not be determined easily (they may have moved or been removed from the new source repo)

@seligj95
Can you review the proposed changes? IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

looks like the bicep team removed the dedicated bicep repo and merged with the general quickstarts samples repo so this is a good fix
#sign-off


M.A might not be available, you should use M.toarray()

In some versions of scipy(e.g. 1.14), M.A might not be available. In such cases, you should use M.toarray() to convert the sparse matrix to a dense one.

#412


Empty object on successful response 200 status code

Describe the bug
I am sending a POST request to my Opensearch cluster, on successful, I get the following response (empty object):
{ }
Expected behavior
The behavior that I am expecting is to have data that was submitted returned or list the available documents in the cluster.
Plugins
I am using Java - Spring Boot - Opensearch - Postman
Code:
`
public SearchResponse listIndexDocuments(String index) throws Exception{
        return this.myOpenSearchClient.opensearchClient().search((mySearch) -> mySearch.index(index), DataModel.class);
    }

`
Additional context
Add any other context about the problem here.

@alhusseindev isn't the search API a GET one?

@owaiskazi19

I am sending a GET request to listIndexDocuments.
I am sending a POST request to create an index.

Please clarify ?

I am getting an empty response when sending a GET request.

@alhusseindev Thank you for cutting this issue and apologies for the delay.
In order to deep dive further on this issue, would you mind share the repro steps and below details

OpenSearch version
Java, Sring boot, postman version.
Details on setup, how are you creating opensearch client, data ingestion etc. Is there any source code I can refer to repro this issue.

@dreamer-89

Opensearch 2.0
Java 17, Spring boot 3.0
I am using code from this link:
https://opensearch.org/docs/1.2/clients/java/

here is my code:
`
@Autowired
private final SearchRestClientConfiguration myOpenSearchClient;

public SearchService(SearchRestClientConfiguration openSearchClient){

    this.myOpenSearchClient = openSearchClient;
}

public SearchResponse listIndexDocuments(String index) throws Exception{
    return this.myOpenSearchClient.opensearchClient().search((mySearch) -> mySearch.index(index), DataModel.class);
}

`


SpatialDepthWiseConvolution

Hi guys,
Does CuDNN support depth-wise convolutions? If yes, is somebody working on the nn.SpatialDepthWiseConvolution equivalent?
Thanks!

No, it does not.


feat: Add includes metadata to BulkDownloadCGOverview

Pull Request
JIRA Ticket
CZID-9386
Description
This PR connects the rails server to the federation server and concats the sample metadata from the rails server to the NextGen generated CG overview data.
Tests

Should be able use bulk download type Consensus Genome Overview with the NextGen flag on

What was the reasoning again for having this endpoint be a custom one rather than being like a federated NextGen field? Was it because of the conflicts?

This endpoint it returns an CSV formatted array which no NextGen endpoint would do natively. We also have to go to the rails server to get the sample metadata if the next gen flag is on. We wanted to keep the logic out of the front end for now. It will make sense to put it in the front end once there is no more dual rights and once the sample metadata comes from next gen as well. But it would have to be rewritten wherever the logic was so it was just as good to put this logic on the fed server.
What do you think?

What was the reasoning again for having this endpoint be a custom one rather than being like a federated NextGen field? Was it because of the conflicts?

This endpoint it returns an CSV formatted array which no NextGen endpoint would do natively. We also have to go to the rails server to get the sample metadata if the next gen flag is on. We wanted to keep the logic out of the front end for now. It will make sense to put it in the front end once there is no more dual rights and once the sample metadata comes from next gen as well. But it would have to be rewritten wherever the logic was so it was just as good to put this logic on the fed server.
What do you think?

Got it. Maybe the long term approach should be that NextGen gives us an actual API that returns the CSV data, instead of doing it on the FE.


puller(ticdc):  cherry-pick 5658 to release-5.4

What problem does this PR solve?

Issue Number: ref #5610
What is changed and how it works?
Check List
Tests

Unit test
Integration test
Manual test (add detailed scripts or steps below)
No code

Questions
Will it cause performance regression or break compatibility?
Do you need to update user documentation, design documentation or monitoring documentation?
Release note
`None`.

/run-all-tests

/merge

/merge


New Wiki Major Enhancements

Major improvements in the mining guide.

Fully redesigned mining guide and overall upgrades.
Improvements include collapsing sections (mining guide & developer guide), a wholly redesigned mining guide, and updated content throughout the wiki.

Updating content from the current wiki
Adding current wiki Chinese & French-language content (currently hidden)
Cleaned up and organized the images folders under: /static/images for more straightforward future community contribution

@h4x3rotab & @shelvenzhou it is ready. Requires final approval.


Project won't build with package added by dependencies

If I'm installing package by adding it to the dependencies in manifest.json it works in editor but I can't build it to Android device. Getting a bunch of errors during build:

Console Errors
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(2,19): error CS0234: The type or namespace name 'UI' does not exist in the namespace 'UnityEditor' (are you missing an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(8,48): error CS0246: The type or namespace name 'LayoutElementEditor' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(6,6): error CS0246: The type or namespace name 'CanEditMultipleObjectsAttribute' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(6,6): error CS0246: The type or namespace name 'CanEditMultipleObjects' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(7,6): error CS0246: The type or namespace name 'CustomEditorAttribute' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(7,6): error CS0246: The type or namespace name 'CustomEditor' could not be found (are you missing a using directive or an assembly reference?)Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(68,48): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(22,30): error CS0115: 'LayoutElementExtendedEditor.OnInspectorGUI()': no suitable method found to override
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(51,33): error CS0115: 'LayoutElementExtendedEditor.OnEnable()': no suitable method found to override
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(10,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(11,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(13,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(14,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(15,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(16,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(17,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedValuePropertyDrawer.cs(7,61): error CS0246: The type or namespace name 'PropertyDrawer' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(18,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(19,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedEditor.cs(20,17): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedValuePropertyDrawer.cs(6,6): error CS0246: The type or namespace name 'CustomPropertyDrawerAttribute' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedValuePropertyDrawer.cs(6,6): error CS0246: The type or namespace name 'CustomPropertyDrawer' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedValuePropertyDrawer.cs(9,51): error CS0246: The type or namespace name 'SerializedProperty' could not be found (are you missing a using directive or an assembly reference?)
Assets\LayoutElementExtended\LayoutElementExtendedValuePropertyDrawer.cs(9,30): error CS0115: 'LayoutElementExtendedValuePropertyDrawer.OnGUI(Rect, SerializedProperty, GUIContent)': no suitable method found to override
Error building Player because scripts had compiler errors
Build completed with a result of 'Failed' in 13 seconds (13131 ms)
UnityEditor.BuildPlayerWindow:BuildPlayerAndRun()
UnityEditor.BuildPlayerWindow+BuildMethodException: 25 errors
  at UnityEditor.BuildPlayerWindow+DefaultBuildMethods.BuildPlayer (UnityEditor.BuildPlayerOptions options) [0x002bb] in <8004fcc221b54f98ba547350ea71d812>:0
  at UnityEditor.BuildPlayerWindow.CallBuildMethods (System.Boolean askForBuildLocation, UnityEditor.BuildOptions defaultBuildOptions) [0x00080] in <8004fcc221b54f98ba547350ea71d812>:0
UnityEditor.BuildPlayerWindow:BuildPlayerAndRun()

Then I've decided to pull whole example project and tried to build it on android so it runs perfectly. Then I've tried to remove all package dependencies in my original project, moved package from example project (it's inside Packages folder instead of Assets) and replaced all active scripts' path and project building properly now.

Can you uninstall the package and re-install it (to update to the latest) and try again? I was able to build to Android on the latest.
If that still doesn't work, what version of Unity are you using?

Well, I've tried to install it on both 2019.2 and 2019.4 versions and package files appeares in Packages and Library folders respectively. I don't really understand how it appeared in Assets folder last time so I guess I've just copied script from third-party resource. Now both projects build smoothly and without errors so I think it's okay to close the issue.


control bandwidth

Hello,
This is a suggest.
Is posible to have a opcion --bwlimit (limit socket I/O bandwidth) such as in rsync?.
This is interesting for don't occupy all bandwidth of wlan and affect to other programs.
Thanks

Same as #240
I would also like to have this option!

I have been tried to limit I/O bandwidth traffic of "drive" with command "trickle" like:

trickle -d 10 drive pull   -> limit traffic download at 10kb/s
trickle -u 10 drive push  -> limit traffic upload at 10kb/s

But this don't works with "drive", however with others command like "wget" or "ncftp" works ok

I haven't been able to investigate this but a simple way to dig through this would be to start a small script written in Go that gets from a URL and then use trickle, I am so busy right now that I don't know if I'll be able to fully investigate this but here is a script to help https://gist.github.com/odeke-em/62a2fa34a58ccf553e7e
package main

import (
	"fmt"
	"io"
	"io/ioutil"
	"log"
	"net/http"
	"os"
)

func main() {
	if len(os.Args) < 2 {
		fmt.Fprintf(os.Stderr, "expecting atleast one url\n")
		os.Exit(1)
	}
	rest := os.Args[1:]

	for _, url := range rest {
		log.Printf("Fetching %q\n", url)
		res, err := http.Get(url)
		if err != nil {
			log.Printf("err %v url %q\n", err, url)
			continue
		}

		log.Printf("Successfully fetched %q\n", url)
		n, _ := io.Copy(ioutil.Discard, res.Body)
		log.Printf("read %d bytes from %q\n", n, url)
	}
}

$ # go run dlMulti.go urls...
$ go run dlMulti.go https://google.ca https://blog.golang.org https://twitter.com

And you can use trickle or anything else to test out whether go allows for this. If it does then the next step will be to look through the Google Golang API client, let me know if the first investigation turns up anything useful.

Hello Odeke,
This is ok for used with url but I haven't to use that for drive pull or push. I don't know.


Fix for Unhandled rejection TypeError: Cannot read property 'valueConverters' of undefined

I am working on a project using i18n and ValidationController. In my translations file I wanted to be able to make a variable lowercase by using a ValueConverter:
"ERRORMESSAGES": {
"required": "${$displayName} is required",
"matches": "${$value} is not a valid ${$displayName| toLowercase }"
}
Using this I got the following error:
Unhandled rejection TypeError: Cannot read property 'valueConverters' of undefined
I inspected the code in vendor-bundle.js and found the problem was in ast.js of aurelia-binding. After changing the code it worked well. Now, where possible, the parameter lookupFunctions is passed to the chained evaluate method.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Roel Plieger seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Can't build after pnpm i

I think npm i will work, but when pnpm i
><EMAIL_ADDRESS>build /Users/linonetwo/Desktop/repo/noflo-ui
> grunt build

Loading "Gruntfile.js" tasks...ERROR
>> Error: Cannot find module 'workbox-build/build/options/schema/webpack-generate-sw'
>> Require stack:
>> - /Users/linonetwo/Desktop/repo/noflo-ui/node_modules/.pnpm/workbox-webpack-plugin<EMAIL_ADDRESS>>> - /Users/linonetwo/Desktop/repo/noflo-ui/node_modules/.pnpm/workbox-webpack-plugin<EMAIL_ADDRESS>>> - /Users/linonetwo/Desktop/repo/noflo-ui/webpack.config.js
>> - /Users/linonetwo/Desktop/repo/noflo-ui/Gruntfile.js
>> -<EMAIL_ADDRESS>>> -<EMAIL_ADDRESS>>> -<EMAIL_ADDRESS>>> -<EMAIL_ADDRESS>Warning: Task "build" not found. Use --force to continue.

If workbox-build not in package.json , pnpm won't install it. I think maybe this is due to Gruntfile? This seem to be a very old thing before I start coding...

webpack too
><EMAIL_ADDRESS>dev /Users/linonetwo/Desktop/repo/noflo-ui
> webpack serve

[webpack-cli] Unable to load '@webpack-cli/serve' command
[webpack-cli] TypeError: options.forEach is not a function
    at WebpackCLI.makeCommand (/Users/linonetwo/Desktop/repo/noflo-ui/node_modules/.pnpm/webpack-cli@4.5.0_webpack-dev-server@3.11.2_webpack@4.46.0/node_modules/webpack-cli/lib/webpack-cli.js:108:21)

@bergie Is anyone there?


RealTime API to generate TTS with ChatContext

Confirm this is a feature request for the Node library and not the underlying OpenAI API.

[X] This is a feature request for the Node library

Describe the feature or improvement you're requesting
To my understanding,

The TTS model generate Text2Speech without context using OAI voices. And can't change voice style
The RealtimeAPI can change voice style (like a Drunk Pirate) but requires a RealTime client ?

I'm looking for a very simple way (with Azure)

to send a ChatMessage (with context, etc ...)
and receive the text + audio on realtime model

This would open the path to many simple usecase to get audio aside the text but with all the amazing voice effects.
Additional context
I'm working with Azure Model and API keys not directly OpenAI. My starting point is this part of the documentation.
I tried using "client.audio.speech.create()" with realtime model but get the error:
Error: 400 The audio operation does not work with the specified model, gpt-4o-realtime-preview. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993.

Thanks for reporting!
This sounds like an issue with the underlying OpenAI API and not the SDK, so I'm going to go ahead and close this issue.
Would you mind reposting at community.openai.com?


/v1/embeddings OpenAI compatible API endpoint

Your blog post mentions you're considering it. We'd love it so that we can point our RAG apps at ollama. Thanks!

@pamelafox Its there now -> https://ollama.com/blog/openai-compatibility

It specifically says that embeddings API is not yet supported on that page (at the bottom).

One concrete point of incompatibility is the inability to pass in a vector of embedding requests. If one looks at the ollama source code, EmbeddingRequest clearly only takes in a single item rather than an array.
Would appreciate if maintainers would triage to bug / won't fix / feature request so I can adjust expectations accordingly. (Maintainers, you guys do a fantastic job with this project, any response is acceptable).

So, why is the Ollama endpoint at /api/embeddings and not at /v1/embeddings where it should be to be compatible with OpenAI or for example LM Studio?

I found this issue because i was trying to use Ollama Embeddings API for the Microsoft Semantic Kernel Memory functionality using the OPENAI provider with Ollama URL but I discovered the application is sending JSON format to API as "model" and "input" but Ollama embeddings api expects "model" and "prompt". So not sure if this is being considered as part of this OPENAI interface compatibility request but wanted to make you aware.

There is no v1 embeddings endpoint yet, only the standard one at api

I've just noticed the pull request (2476) and wanted to express my appreciation for the work put into it. Thank you for your contribution! Looking forward to its potential merge.

There seems to be an active PR for this https://github.com/ollama/ollama/pull/2925 by @tazarov  I haven't tested it yet.

Very curious of availability and capabilities.
My usecase is straight forward:

During BUILD I need to create Embeddings of a lot of content locally in order to give a try, reduce cost, and bootstrap a database.
During RUN I'll calling online APIs when it's needed.

When Ollama will be compatible with text-embedding-3-large, text-embedding-3-small and text-embedding-ada-002 it will open the door to run embedding both locally (with a good PC for Free) and Online

I think I see two PRs related to this (https://github.com/ollama/ollama/pull/2925 and https://github.com/ollama/ollama/pull/3642). As others have said, the fact that the api/embeddings endpoint doesn't accept an array of inputs AND the difference in the request structure vs. OpenAI's structure (per https://github.com/ollama/ollama/issues/2416#issuecomment-2082426079) are both major blocks to using Ollama in a variety of RAG applications.  Any word on where those PRs are prioritized?
Thank you all for your hard work on the project!

+1 here. Please implement the complete compatibility

Here is temporary solution while v1/embeddings in ollama is broken
https://github.com/severian42/GraphRAG-Local-UI/blob/main/embedding_proxy.py

@JPMoresmau how are you calling v1/embeddings? I'm unable to reproduce the error, this code is working as expected
from openai import OpenAI

client = OpenAI(
    base_url='http://localhost:11434/v1/',
    api_key='ollama'
)

response = client.embeddings.create(
  model="all-minilm",
  input=["input1", "input2"],
)

print(response)


Improve Compatibility with the Arduino IDE

Add library.properties metadata file to allow the Arduino IDE to recognize the library.
Make example sketch compatible with the Arduino IDE.
Fix error in example sketch.

Thanks!
Let me know if I need to bump the version number to do a release

Thanks!

You're very welcome.

Let me know if I need to bump the version number to do a release

It's nice to do, but the only situation where it is required is if you have added your library to the Arduino Library Manager index, which is like a package manager for Arduino libraries:
https://github.com/arduino/Arduino/wiki/Library-Manager-FAQ
If the users are only doing manual installations of the library, then the Arduino IDE doesn't care what the version value in library.properties is (though it does require that field to exist in the file and that the version value is compliant with "relaxed semver").
I understand that it's annoying to have to maintain two metadata files (library.json and library.properties). PlatformIO does support the use of library.properties instead of library.json, so it's possible to have a single metadata file (library.properties) that works for both Arduino and PlatformIO:
https://docs.platformio.org/en/latest/librarymanager/creating.html#creating-library
When the library contains both library.properties and library.json, PlatformIO uses only library.json.


Getting error Livestream for device T8200**** could not be stopped, because it is not running in logs

Describe the bug
I receive the following error in the log file of the EUFY Security Add On:
Livestream for device T8200*** could not be stopped, because it is not running
To Reproduce
Steps to reproduce the behavior:
Restart the add on. It seems to start fine. It reports:
2022-08-18 09:48:06.917  INFO  Push notification connection closed
2022-08-18 09:51:07.402  INFO  Push notification connection successfully established

Then some time later I receive:
2022-08-18 14:31:50.046  ERROR Message error
 LivestreamNotRunningError  Livestream for device T8200**** could not be stopped, because it is not running
error stack:
• message_handler.ts:146 handle
    src/lib/device/message_handler.ts:146:31
• task_queues:96 processTicksAndRejections
    node:internal/process/task_queues:96:5
• server.ts:103 receiveMessage
    src/lib/server.ts:103:21

My door bell card in home assistant no longer updates.
The ringing sensor no longer changes state when someone presses the door bell.
Expected behavior
Would like to know how to stop the error message occuring as I think when it does then I no longer get updates in home assistant.
Hardware Information about Cameras

Camera Model: Video Doorbell 2K (Wired)

https://github.com/fuatakgun/eufy_security/issues/592


Always remove finished transient_tasks.

The original code only remove tasks from self.transient_tasks when an exception occurs.
This lead to a high CPU scenario when the for loop checks all the tasks for their done status as the task list keeps growing forever.
This should fixes #236.

It also works on my side.
I've a question to your change: you remove all tasks that are 'done', the "exeption print" will not work any longer, right?
    async def _remove_finished_transient_tasks(self) -> None:
        while True:
            await asyncio.sleep(1)
            finished_tasks = [x for x in self.transient_tasks if x.done()]
            if not finished_tasks:
                continue
==> Your fix will remove all tasks that are "done" even the one with exceptions.
            for task in finished_tasks:
                self.transient_tasks.remove(task)
<==
            results = await asyncio.gather(*finished_tasks, return_exceptions=True)
            for i, exception in [
                x for x in enumerate(results) if isinstance(x[1], Exception)
                    raise exception
                except Exception:  # pylint: disable=broad-except
                    _LOG.exception("Exception in task: %r:", task)
==> you removed
                finally:
                    self.transient_tasks.remove(task)
<==

So we should first print the exceptions and then remove all tasks?
    async def _remove_finished_transient_tasks(self) -> None:
        while True:
            await asyncio.sleep(1)
            finished_tasks = [x for x in self.transient_tasks if x.done()]
            if not finished_tasks:
                continue
            results = await asyncio.gather(*finished_tasks, return_exceptions=True)
            for i, exception in [
                x for x in enumerate(results) if isinstance(x[1], Exception)
                    raise exception
                except Exception:  # pylint: disable=broad-except
                    _LOG.exception("Exception in task: %r:", task)
==> Your fix will remove all tasks after the exceptions
            for task in finished_tasks:
                self.transient_tasks.remove(task)
<==

Am I right?

self.transient_tasks.remove(task) only remove the reference to the tasks from the transient_tasks list. Eventually the finished tasks are still referenced in the finished_tasks list so the exception part will still work since it doesn't reference self.transient_tasks.


New Get API which returns additional information about the entry

enhancement: added new data struct Response, which will be returned when
calling GetWithInfo(). Caller can use this Response to check the status
of the Entry, whether its Expired or not. Default '0' means its still
in use.
minor lint changes
Test: added test case for the api and made sure all tests cases are
successful

Coverage decreased (-1.3%) to 89.4% when pulling f76359e4b1b989dc01f144a5baf225164608eea8 on jgheewala:get_api_info into 2d6fab29e9cd1d753a47f07e33126065067d6152 on allegro:master.

@mxplusb I forgot to add my test cases. Sorry about that. Have added it now.

Thank you @jgheewala


doesn't exclude some files

Hello, first of all, thank you for the program you've written. I'd like to talk about a problem I'm experiencing. I hope a solution can be found. I tried to describe my problem below.
"draw.folder.structure.exclude": [
"node_modules",
".git",
"dist",
".next",
"out",
".ico",
"manifest.json", --> *st.json
".txt",
".gitignore",
".md",
".png"
],
I tried various variations of all these, but it still didn't work. It only excludes when you write the file name completely. Otherwise, it doesn't see it. When you write ".png", it should exclude all png files, when you write "public/.png", it should exclude only png files in the public folder, when you write "logo*.png", it should exclude png files starting with logo. Or it would be great if it works this way.
In addition to all these, I hope you can add a feature that will give an image like the one below. Thank you very much in advance.

Same here. Won't exclude json with either of these:
    // Draw folder structure extension
    "draw.folder.structure.exclude": [
        ".json",
        "*.json",
    ],

Hi guys! Sorry for the delay and thanks for your feedback!
Currently the extension literally excludes what you write to it, it doesn't look for a .png or any other file extension. But it's a good idea and I'll get to work on it!
Thanks again for the feedback, I will keep you informed of changes from my X account.


Allow Desktop Shortcut Deletion

[x] I have read the contributing guidelines, and I agree with the Code of Conduct.
[x] Have you checked that there aren't other open pull requests for the same changes?
[x] Have you tested that the committed code can be executed without errors?
[x] This PR is not composed of garbage changes used to farm GitHub activity to enter potential Crypto AirDrops.
Any user suspected of farming GitHub activity with crypto purposes will get banned. Submitting broken code wastes the contributors' time, who have to spend their free time reviewing, fixing, and testing code that does not even compile breaks other features, or does not introduce any useful changes. I appreciate your understanding.

This pull request allows users to have UniGetUI delete shortcuts automatically added to their desktop. This will be off by default, behind a setting, and require explicit user confirmation before UniGetUI deletes anything.

[x] Change desktop shortcut storage to use the new complex settings
[ ] Copy the detection code to the InstallPackageOperation as well and have a layer setting (marticliment)

Closes #2942
Closes #2080
Closes #624
Relates to #2160

@marticliment - The base functionality for this PR is complete, however it felt odd to me to effectively have a copy paste of very similar code for the storage of the ignored updates and desktop shortcuts databases. I was thinking about maybe modifying both of them to use some sort of arbitrary mass configurator, like a settings system but allowing for more complicated storage; in these cases, dictionaries. This would also be useful for some other feature requests I was thinking about adding (unless you don't want me to; I wouldn't want to be a burden on your repository).
I haven't done a whole lot of thinking; I'll do much more if you're OK with me adding it but I'm thinking the rough (very rough!) behavior would be something like an ArbitraryMassConfigurator with a Get function that would return some implementation of a Configurator<T> that can store different types of data (with basic functions like Add(name, T), Change(name, T), and Remove(name)); maybe a KeyValueConfigurator<K, V> to store maps (like the IgnoredUpdates and DesktopShortcuts databases do) [Add(K, V)], a ListConfigurator<V> to store a list of values (useful for an operation history) [AddValue(T)], a KeyMapConfigurator<K, Map<K, V>> to store key-map pairs (for package installation options) [Add(K, Map<K, V>)], etc. Each configurator would then take inputs and convert them to JSON, handing it back to the ArbitraryMassConfigurator which would write it all to one file. That way, all settings that are non-trivial are handled together consistently.
Does that sound like something that would be helpful? If you're not interested I'll mark this PR as ready for review, but if you are I'll work on it here (or I suppose make a new one; up to you).

Also, when you test this, will you make sure the setting is off by default? I thought it was, but I'm having second thoughts now (but without a clean installation to test it).

I will be busy this weeks, but I should be able to get this reviewed and merged in a week or two.

I haven't done a whole lot of thinking; I'll do much more if you're OK with me adding it but I'm thinking the rough (very rough!) behavior would be something like an ArbitraryMassConfigurator with a Get function that would return some implementation of a Configurator<T> that can store different types of data (with basic functions like Add(name, T), Change(name, T), and Remove(name)); maybe a KeyValueConfigurator<K, V> to store maps (like the IgnoredUpdates and DesktopShortcuts databases do) [Add(K, V)], a ListConfigurator<V> to store a list of values (useful for an operation history) [AddValue(T)], a KeyMapConfigurator<K, Map<K, V>> to store key-map pairs (for package installation options) [Add(K, Map<K, V>)], etc. Each configurator would then take inputs and convert them to JSON, handing it back to the ArbitraryMassConfigurator which would write it all to one file. That way, all settings that are non-trivial are handled together consistently.

Perhaps the Settings class could be extended to load and store dictionaries and/or lists (perhaps with custom type parameters that can be serializable to JSON via ISerializable?). Feel free to experiment with it, but please open a new pr. Also, if possible, i'd like to discuss the implementation of it, so we can make sure it properly integrates with UniGetUI and the existing codebase.

This would also be useful for some other feature requests I was thinking about adding (unless you don't want me to; I wouldn't want to be a burden on your repository).

Again, feel free, but before implementation it'd be cool if we could discuss the implementation (a general sketch on how it'd work, etc.). Feel free to use the existing relevant issue, if any, or if not perhaps you can create the empty PR.

I will be busy this weeks, but I should be able to get this reviewed and merged in a week or two.

Of course. Take your time :)

Perhaps the Settings class could be extended to load and store dictionaries and/or lists (perhaps with custom type parameters that can be serializable to JSON via ISerializable?). Feel free to experiment with it, but please open a new pr. Also, if possible, i'd like to discuss the implementation of it, so we can make sure it properly integrates with UniGetUI and the existing codebase.

GitHub won't let me create an empty draft PR...
That's a much better idea, hence why I decided to run it past you first :) My thoughts now would be extending the settings object to support lists and dictionaries as well as just booleans on strings.
For lists, maybe Settings could have: (where T is ISerializable)

List<T> Settings.GetList<T>(string ListName)
void Settings.SetList<T>(string ListName, List<T> List)
T Settings.GetListItem<T>(string ListName, int Index)
void Settings.AddToList<T>(string ListName, T Item)
bool Settings.RemoveFromList<T>(string ListName, T Item)
bool Settings.RemoveFromList(string ListName, int Index)
void Settings.ClearList(string ListName)
void Settings.ListContains<T>(string ListName, T Item)
int Settings.ListCount(string ListName)

For dictionaries: (where K and V are ISerializable)

Dictionary<K, V> Settings.GetDictionary<K, V>(string DictName)
void Settings.SetDictionary<K, V>(string DictName, Dictionary<K, V> Dict)
V Settings.GetDictionaryItem<K, V>(string DictName, K Key)
void Settings.SetDictionaryItem<K, V>(string DictName, K Key, V Value) (also works as Add)
void Settings.RemoveDictionaryKey<K>(string DictName, K Key)
void Settings.ClearDictionary(string DictName)
void Settings.DictionaryContainsKey<K>(string DictName, K Key)
void Settings.DictionaryContainsValue<V>(string DictName, V Value)
int Settings.DictionaryCount(string DictName)

Although I suppose at the base level all it really needs is Set/Get if you don't want to add that many functions to the Settings class.
Obviously we could just serialize lists and dictionaries into strings for SetValue/GetValue, which I think would work for the ignored updates manager and desktop shortcuts manager, since they have their own database to abstract the complexity. But for things such as a recently updated list or package installation options it's much safer (less error-prone) and more thread-safe to have all of that abstracted since it just needs to call a settings function to get or add a list item rather than repeatedly serializing and deserializing the whole list, which is a lot of repetitive code. I think the above functions should cover everything including nested dictionaries, even excessively as you could technically just use Get().Count instead of .Count(). What do you think?

Obviously we could just serialize lists and dictionaries into strings for SetValue/GetValue, which I think would work for the ignored updates manager and desktop shortcuts manager, since they have their own database to abstract the complexity. But for things such as a recently updated list or package installation options it's much safer (less error-prone) and more thread-safe to have all of that abstracted since it just needs to call a settings function to get or add a list item rather than repeatedly serializing and deserializing the whole list, which is a lot of repetitive code. I think the above functions should cover everything including nested dictionaries, even excessively as you could technically just use Get().Count instead of .Count(). What do you think?

The interface you are proposing is amazing. The only thing I would say is that perhaps some methods could be considered redundant (remove(int index), Count(), ...), because while the idea is exposing a list that automatically saves and loads to/from disk, I can't really think of an usecase where you'd need the length without actually having the need to use the entire list.
Also, since modifying the returned lists or values does not update the values on the settings, I'd set the return values for lists and dicts to be IReadOnlyList and IReadOnlyDictionary, (which are inherited by List and Dictionary and hence only require a cast), so the action of modifying a returned list can not be misunderstood as updating the settings. What do you think about this?

The only thing I would say is that perhaps some methods could be considered redundant (remove(int index)

If you don't want a redundant remove item is it better to keep remove by index or remove by value? It's possible my C++ background and it's inability to remove something by value from a list without writing some ridiculous 95 character line is showing through here but I just wasn't sure about only leaving a remove by value method.

I can't really think of an usecase where you'd need the length without actually having the need to use the entire list.

That's a good point. Unless you want some sort of Tooltip on the operation history button to say how many there are? But I think that's a stretch.

Also, since modifying the returned lists or values does not update the values on the settings, I'd set the return values for lists and dicts to be IReadOnlyList and IReadOnlyDictionary, (which are inherited by List and Dictionary and hence only require a cast), so the action of modifying a returned list can not be misunderstood as updating the settings. What do you think about this?

Yes, that's a good idea. I didn't know about those.

The interface you are proposing is amazing.

Alright, I'll go work on this when it's not, you know, almost 2am.

If you don't want a redundant remove item is it better to keep remove by index or remove by value? It's possible my C++ background and it's inability to remove something by value from a list without writing some ridiculous 95 character line is showing through here but I just wasn't sure about only leaving a remove by value method.

Taking into account the usage the settings will have I would maintain the remove by value, as I don't see as useful remove by index in the usecases settings will be more needed for.

That's a good point. Unless you want some sort of Tooltip on the operation history button to say how many there are? But I think that's a stretch.

No, it is not a stretch, but I reckon this is the task of the operation history (or whichever class fetches said issue) to fetch the data efficiently and reuse the data read (which will need the entire list) for the tooltips and other info.

You should be able to pull main with the new complex settings

I have simplified the ContentDialog and moved some methods to the ShortcutManagerDatabase.
Please confirm that the changes I have made still work on your machine.

Everything works fine on my machine, and it all looks good aside from the comments I made.


PushIOManager.getPreference appears to be returning data as JSON or object depending on device platform

The data that PushIOManager.getPreference() returns is either JSON or object depending on the device platform. This should be returned consistently as object

Both platforms now return Object.


UX - Linkable Headings

cc: @bradystroud @adamcogan
Hi Brady,
For our site content it would be very convenient to be able to link directly to a heading in the page.
E.g. On the page: www.ssw.com.au/rules/record-better-audio
I would like to link to the heading "Record Locally" through a URL

Implement this bookmarks on red headings

Cheers,
Landon
AB#64408

Hey @landonmaxwell and @calumjs,

Implement this bookmarks on red headings

Done - h2, h3 & h4 tags are now linkable!
Please test them out on Staging


Unable to set secure flag for cookies using $cookies.putObject in Angularjs version 1.4.4

We are unable to set the secure flag for cookies using the $cookies service in Angularjs 1.4.4.
We are using the putObject() method mentioned in https://code.angularjs.org/1.4.4/docs/api/ngCookies/service/$cookies for the same.
Below is the same code snippet we are using for the same:
var config = {
    secure: true
 };
$cookies.putObject('foo', 'bar', config);

We cannot see the secure flag being set when we inspect the cookie that's being created.
Also, if we try to do a $cookies.getObject('foo') we get an undefined object in response. We already have all the necessary modules like "ngCookies" injected in our application.

@shahata can you take a look at this?

@anupkawtia can you create some form of reproduction for this issue? How are you checking the secure flag on the cookie? Are you sure you are trying to create the cookie on a secure web page? I've tried this out and it seems to work fine: https://jsbin.com/qijodawofe/edit?html,js,output
After clicking the "Write cookie" button you will see the value you entered in the text box appear near the "Cookie value" label. Also, in devtools -> resources tab -> cookies -> null.jsbin.com you can see that the secure flag is marked as expected.

@shahata We were getting an undefined value because we were trying to test with https disabled. When we tested with https enabled it worked fine and the cookie was getting set as secured correctly. Sorry for the inconvenience caused. You can close the issue.


fix: remove 'ois' from the error path

Closes #105

@Siegrift for some reason I'm unable to request you as a reviewer


Localisation issue

When using the game client with a locale other than enUS, an error occurs with an empty localization table.
The solution in the patchtable.lua file is to change the code section:
  for loc, _ in pairs(pfDB.locales) do
    if pfDB[db][loc] and pfDB[db][loc.."-turtle"] then
      loc_update = pfDB[db][loc.."-turtle"] or pfDB[db]["enUS-turtle"]
      patchtable(pfDB[db][loc], loc_update)
    end
  end

to
  for loc, _ in pairs(pfDB.locales) do
-- fix for other than enUS locale
    if pfDB[db][loc] and ( pfDB[db][loc.."-turtle"] or pfDB[db]["enUS-turtle"] ) then
      loc_update = pfDB[db][loc.."-turtle"] or pfDB[db]["enUS-turtle"]
      patchtable(pfDB[db][loc], loc_update)
    end
  end

Turtle offers multi-locales now?

Not yet, but I'm working on RU localization, I can give it for testing.

Hello. I did as you advised. But the text is still not translated.
for loc, _ in pairs(pfDB.locales) do
if pfDB[db][loc] and ( pfDB[db][loc.."-turtle"] or pfDB[db]["ruRU-turtle"] ) then
loc_update = pfDB[db][loc.."-turtle"] or pfDB[db]["ruRU-turtle"]
patchtable(pfDB[db][loc], loc_update)
end
end
Is this true or not?
If you're interested, I can help with the translation of quests.

This is not localization itself, this is just a fix for the addon so that it does not fall off when localization is enabled.
Localization can be downloaded from the link: RU_Turtle_small but it is not completed yet.
Unfortunately, I don't have much time to finish, so the process is slow.

Can you provide Chinese localization? I can translate it myself

Can you provide Chinese localization? I can translate it myself

Hi @tjjxlbj. Sure, I have now added the required zhCN translation tables in the latest version (https://github.com/shagu/pfQuest-turtle/commit/84191d31c37b174d01eecce8e5fe8a0eb3d466a0). Please send your translations with a github pull request or via Discord (shagu#7155).

How do I add your friends with Discord?

There's a green "Add Friend" Button


feat: implement 0x30 - ADDRESS Opcode

SinceGroupFrontierEnvironmental InformationIndex 1 is top of the stack. See PUSH.Stack outputaddress: the 20-byte address of the current account.ExampleInputOutput10x9bbfed6889322e016e0a02ee459d306fc19545d8Reproduce in playground.Error casesThe state changes done by the current context are reverted in those cases:Not enough gas.Stack overflow.

i did like to help with this, iiuc for this we need to push EvmAddress (stored in StaticExecutionContext) of the execution context to stack.

i did like to help with this, iiuc for this we need to push EvmAddress (stored in StaticExecutionContext) of the execution context to stack.

Let's do it:)! You understood correctly


Automated cherry pick of #3887: fix: host-add-netif requires index

Cherry pick of #3887 on release/2.10.0.
#3887: fix: host-add-netif requires index

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.10.0@132365c). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff                @@
##             release/2.10.0   #3888   +/-   ##
================================================
  Coverage                  ?   7.49%
================================================
  Files                     ?     418
  Lines                     ?   66655
  Branches                  ?       0
================================================
  Hits                      ?    4997
  Misses                    ?   61231
  Partials                  ?     427

Flag
Coverage Δ

#aFlag
7.49% <ø> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 132365c...b1e7141. Read the comment docs.


"Call a web API using App Roles" does not use separate App Registrations for API and SPA

Issue

Please provide us with the following information:

This issue is for the sample

    - [ ] 1-1) Sign-in with Azure AD
    - [ ] 1-2) Sign-in with Azure AD B2C
    - [ ] 2-1) Acquire a Token and call Microsoft Graph
    - [ ] 3-1) Protect and call a web API on Azure AD
    - [ ] 3-2) Protect and call a web API on Azure AD B2C
    - [ ]   4) Deploy to Azure Storage and App Service
    - [x] 5-1) Call a web API using App Roles
    - [ ] 5-2) Call a web API using Security Groups
    - [ ] 6-1) Call Microsoft Graph using on-behalf-of flow
    - [ ] 6-2) Call a multi-tenant web API

This issue is for a

    - [ ] bug report -> please search issues before submitting
    - [x] question
    - [ ] feature request
    - [ ] documentation issue or request

Minimal steps to reproduce
I'm wondering why, in this one example, the same App Registration is used for both the SPA and the API? The other examples all separate these out. It seems very counterintuitive.
There is this section in particular (emphasis mine):

###Configure the client app (msal-angular-app) to use your app registration
Open the project in your IDE (like Visual Studio or Visual Studio Code) to configure the code.
In the steps below, "ClientID" is the same as "Application ID" or "AppId".
Open the API\TodoListAPI\appsettings.json file.

The guide says to configure the client app, but then immediately gives directions for setting the config on the API.
Is it expected that both the front and backend applications will share an app registration in this scenario?
Any log messages given by the failure

n/a

Expected/desired behavior

n/a

Library version

n/a

Browser and version

n/a

Mention any other details that might be useful

n/a

Hi @AHarman -yes, the apps in this sample shares the same app registration. This is because both the client and service apps here make use of same app roles, and so by sharing the app registraiton they share the app roles configuration. Otherwise, you would have to duplicate the app roles settings in each app registration. To be clear, it is fine to use separate registrations if you would like to take that approach, but it's not convenient in this particular case.
Hope this clarifies -let us know!

closing due to inactivity. Please let us know if you have any other questions.


Header wont align at the correct column when the column order has been changed.

So iam changing the table Columns based on a filter in an Select menu. The first change works fine but the second one is a failure: Thead header aligns to the wrong tbody column.
Any Idea how to fix this?
here the fiddle
Cheers
A.

somewhere in the docs about using it with hidden columns there should have been a mention of getRowGroups method which returns row groups belonging to your table when the header is floated.


[Core]Support read external path in DataFileMeta

Purpose
https://cwiki.apache.org/confluence/display/PAIMON/PIP-29%3A+Introduce+Table+Multi-Location++Management

Tests

API and Format

Documentation

+1 Thanks @neuyilan for updating!


Error creating All:All matrix

Hi, I am trying out hictk to convert .mcool to .hic, and I am encountering an issue. After writing all by-chromosome pixels, it tries to create the All:All matrix and fails like this:
>hictk convert --threads 8 --tmpdir results/coolers_library_group         results/coolers_library_group/all.sacCer3.mapq_30.1000.mcool results/coolers_library_group/all.sacCer3.mapq_30.1000.hic

...
2024-05-22 13:55:03.595] [info]: writing pixels for All:All matrix...
FAILURE! hictk convert encountered the following error: an error occurred while writing file "results/coolers_library_group/all.sacCer3.mapq_30.1000.hic": an error occurred while writing the
All:All matrix to file "results/coolers_library_group/all.sacCer3.mapq_30.1000.hic": position is greater than chromosome size:<PHONE_NUMBER> >= 1531933

This is a tiny .mcool with some yeast data that we use for testing in distiller, the file is attached (changed the extension to txt so github doesn't complain)
all.sacCer3.mapq_30.1000.txt
Am I doing something wrong here?

Thanks again for reporting this issue.
The problem turned out to be having bin tables where all chromosomes have exactly one bin.
The code used in hictk to estimate the cache size when opening .hic files had the incorrect assumption that the longest chromosome in a genome has at least two bins.
Violating this assumption led to an integer overflow which resulted in the position is greater than chromosome size error.

Thank you for looking into it so quickly!


Compromised node with primary replica of a shard lies and says it doesn't have it

(This issue is somewhat specific to the behavior of RethinkDB.)
If node Charlie gets compromised and it holds the primary replica of shard 12, then all requests for documents in shard 12 will be routed to node Charlie.
If node Charlie goes down, then requests for shard 12 will automatically be re-routed to a node with a replica of shard 12, so that’s okay.
If node Charlie isn’t down, it could say to the client, “I don’t have that document, sorry!” The request won’t be automatically re-routed to another node. In that case, maybe the client should just try another node?
A more general solution would be for clients to always ask many server nodes, and to compare the responses. If the responses are all the same, then great. If some responses differ, then something is up!

BigchainDB 2.0 is coming out soon and:

doesn't support the use of RethinkDB out of the box.
works very differently from 1.3 and earlier.

We totally didn't understand the difficulty of detecting Byzantine nodes. It's not as easy as suggested. But anyway, it's also not our problem any more! I'm closing this issue.


add MLP decoder

Codecov Report

Merging #44 into master will decrease coverage by 0.21%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master      #44      +/-   ##
==========================================
- Coverage   18.62%   18.41%   -0.22%
==========================================
  Files          51       52       +1
  Lines        3066     3101      +35
==========================================
  Hits          571      571
- Misses       2495     2530      +35

Impacted Files
Coverage Δ

fastNLP/modules/decoder/MLP.py
0% <0%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ceac3f2...b54713d. Read the comment docs.


Classification of function STDDEV_POP

According to the Oracle documentation (Database SQL Language Reference) is
STDDEV_POP is an aggregate function.Hence the classification as logical function seems not to be correct:
    % AMMSCs
    {"^(?i)(AVG)$",             'AMMSC'},
    {"^(?i)(MIN)$",             'AMMSC'},
    {"^(?i)(MAX)$",             'AMMSC'},
    {"^(?i)(SUM)$",             'AMMSC'},
    {"^(?i)(COUNT)$",           'AMMSC'},

    % FUNs
    {"^(?i)(TO_CHAR)$",         'FUNS'},
    {"^(?i)(NVL)$",             'FUNS'},
    {"^(?i)(LTRIM)$",           'FUNS'},
    {"^(?i)(TO_DATE)$",         'FUNS'},
    {"^(?i)(UPPER)$",           'FUNS'},
    {"^(?i)(LOWER)$",           'FUNS'},
    {"^(?i)(TRUNC)$",           'FUNS'},
    {"^(?i)(ABS)$",             'FUNS'},
    {"^(?i)(ACOS)$",            'FUNS'},
    {"^(?i)(ASIN)$",            'FUNS'},
    {"^(?i)(ATAN)$",            'FUNS'},
    {"^(?i)(COS)$",             'FUNS'},
    {"^(?i)(COSH)$",            'FUNS'},
    {"^(?i)(COT)$",             'FUNS'},
    {"^(?i)(SIN)$",             'FUNS'},
    {"^(?i)(SINH)$",            'FUNS'},
    {"^(?i)(TAN)$",             'FUNS'},
    {"^(?i)(TANH)$",            'FUNS'},
    {"^(?i)(ATAN2)$",           'FUNS'},

    % Logical funs
    {"^(?i)(BOOL_AND)$",        'UFUN'},
    {"^(?i)(BOOL_OR)$",         'UFUN'},
    {"^(?i)(SELECTIVITY)$",     'UFUN'},
    {"^(?i)(STDDEV_POP)$",      'UFUN'},

Furthermore the following statement:
SELECT STDDEV_POP(name_column_3)
  FROM name_table_1
 WHERE name_column_1 = name_column_2

causes this syntax error:
  sqlparse_test:311: tests_gen (select)...*failed*
in function sqlparse_test:'-test_sql/3-fun-2-'/2 (test/sqlparse_test.erl, line 145)
**error:{assertEqual,[{module,sqlparse_test},
              {line,145},
              {expression,"Error"},
              {expected,ok},
              {value,"1: syntax error before: 'STDDEV_POP'"}]}
  output:<<"">>

The following similar statement:
SELECT STDDEV_SAMP(name_column_3)
  FROM name_table_1
 WHERE name_column_1 = name_column_2

causes no error.

Done with commit #48.


Resolve internal issue #557: bugs in eWiseApply

The grb::eWiseApply had several issues:

all variants did not check properly for ILLEGAL arguments in the presence of the dense descriptor;
in one variant (vector<-scalar<-vector, operator) performed an in-place update while the primitive should be out-of-place;
the implementation variant that is driven by the nonzero pattern of the mask, in the non-vectorised coda of its implementation, did not check whether both input vectors had an element assigned;
in the vector-driven sparse variant and for monoids, conditions could arise where nonzeroes in the output vector may be skipped, while their values would be correctly recorded.

These issues triggered rarely and should have low impact, and are all fixed in this MR.
This MR also

includes some minor code style fixes throughout the files touched;
updates the dispatch-to-inplace detection methods used within eWiseApply to use getID instead of pointer-based logic; and
handles trivial operations on empty vectors faster.

Thanks to Aristeidis for detecting issues 2-4!

Both CIs OK. Pending code review, and pending all unit tests run with LPF.

All unit tests with LPF OK. Pending code review before merge.

Rebased and code review OK. Waiting internal CIs OK and smoke test suite with LPF OK before merging

GitHub CI OK, smoke tests with LPF OK. Still waiting for internal CI

Internal CI OK, will merge


Allow puma_workers configuration

Now you are able to change the number of puma workers.
This also changes the max_connections when using postgres.
Question

How do I update the docs? I generated them locally, but couldn't figure out what files feed the doc generation process.

Test failures seem to be a jruby issue unrelated to this change. Should we change that to an allowed failure, or find a jruby expert?

@HParker Oh! Hi and thanks for improving the Configuration class!

The Gemstash documentation is written in Markdown.
A fancy set of extensions to Pandoc generate output files.
bundle exec rake doc starts the docs generation.
The source Markdown files are in man/.

Today I had trouble using the fancy extensions, so thanks for asking about that - I'll poke the right person about that.

@bundlerbot r+


New tutorial for scATAC-seq preprocessing

This PR adds a new tutorial for creating a count matrix from 10x scATAC-seq data.

@lldelisle that might be interesting for you.

Thanks @bgruening. For the moment, we don't have this data in the lab but this is indeed interesting.

SO EXCITING!

Currently, the tutorial is until matrix creation. I am thinking of extending this until filtering. I will update it later today.

Ready to review. I copied some blocks of text from bulk ATAC-seq, single-cell 10x preprocessing and 10x PBMC clustering tutorials.

The sATAC-seq count matrix filtering workflow failed with this error:
line 845, in get_group     raise KeyError(name) KeyError: 'nb_features'
This the test history: episcanpy test history

The sATAC-seq count matrix filtering workflow failed with this error:
line 845, in get_group     raise KeyError(name) KeyError: 'nb_features'
This the test history: episcanpy test history

The problem is that all the cells and features were filtered out. You need to get the full count matrix. The link is in the  tutorial.

Thanks both! And good luck for the workshop @pavanvidem!

Many thaks @gallardoalba and @bgruening


Update use-drive-shipping-to-import-pst-files-to-office-365.md

Removed the /sk (storage key ) which is no longer used.
@markjjo

@Durga-SC PR merged. Next time, please go to  https://review.docs.microsoft.com to change a topic and submit a PR (going to the https://review.docs.microsoft.com version of a topic and then clicking Edit will make changes in the private repo, which is preferable). See instructions here: https://review.docs.microsoft.com/en-us/office-authoring-guide/contribute-get-started-setup-quick-update?branch=master


Make SSH key optional

This allows the use of a running SSH agent to for communication with the remote server.

There's more coming but it builds on top of this :)


Documenting dumping to csv and other formats

This feature is inheritted from ipython-sql, we should document how to use it, which formats it works with etc. Probably the next step we can take is adding a flag, --to-csv --to-parquet or --to-file format (--to-file csv)etc.
result = %sql SELECT species FROM penguins.csv LIMIT 3
result.csv(filename='species.csv')

we have a section dedicated to it: https://jupysql.ploomber.io/en/latest/howto/csv.html
do you think we should change its contents?
I agree that exporting to other formats is valuable

ok, so I think these are the changes:

Support export to parquet via result.parquet (we an use pyarrow for this)
Create a new "Exporting data" section in the User Guide


[JSON stringify] Remove use of magic numbers

Stems from this comment:
https://github.com/Microsoft/vscode-cosmosdb/pull/535#discussion_r182191810
The intention+side-effects of this, and the squash merge policy compel me to make the change in a separate PR.

Closing as wontfix


I need more information

Only a recommendation. "The compiler accepts only syntax that is included in C# 8.0 or lower."
I appreciate the brevity of the definition page. However I don't think this is very much help at all. Every sentence is merely a copy of the previous one with a new value "8.0, 7.2, 7.1, 7.0", if this is all we can get then why copy and paste, just string along one line.
I have a TFS CI build that is throwing this error. I am guessing my build agents server is missing an SDK or something. I have projects that have only just had 8.0 enabled? What does it take for 8.0 to function on a build server. Possibly a link to the SDKs?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5026557b-74c1-888f-3362-0f1e5f35562a
Version Independent ID: 215af505-a5c6-239e-581e-041be8483e52
Content: Compiler Error CS1617
Content Source: docs/csharp/misc/cs1617.md
Product: dotnet-csharp
Technology: csharp-diagnostics
GitHub Login: @BillWagner
Microsoft Alias: wiwagn

Good point @haldiggs
I think what you would need is the .NET Core 3.1 SDK for C# 8.0.
I've added this to our backlog, and added the "up for grabs" label if any community members want to submit a PR with the fix.

@haldiggs Can you please confirm if the missing SDK was your problem?
I opened #20271 to add the following:

If you are using a valid value from the table above and still seeing the error, you may have an older SDK that doesn't support this language version. Make sure to install the latest .NET SDK.

@haldiggs Can you please confirm if the missing SDK was your problem?

@Youssef1313 Youssef1313 I actually had to install the VS 2019 on my build server, probably overkill to get the job done. I am building a WCF .Net application, not Core .Net, Now my issue is that I can build it on a Team City server that uses an older msbuild project, but not on my TFS 2018 server where I was trying to transition my CI builds. That last part has noting to do with the help page obviously. The error is now being seen on the TFS server where I do not yet know how to force the build tools setting.


Add python 3.7 build

Issue #, if available: #119
Description of changes: Updates GPy requirement to 1.9.8 (required to support python 3.7) and adds 3.7 build
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #205 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #205   +/-   ##
=======================================
  Coverage   89.47%   89.47%
=======================================
  Files         105      105
  Lines        2861     2861
  Branches      292      292
=======================================
  Hits         2560     2560
  Misses        249      249
  Partials       52       52

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eb95c10...0ab685f. Read the comment docs.

Now also removes python 3.5 build


Vignette and TreeSE

The vignette does not currently introduce the TreeSE/MAE functionality.
-> Add as the primary means to access, then show how to convert to phyloseq when necessary. In my opinion it would be sufficient to have the retrieval functionality written for TreeSE / MAE, and then mia functions to convert to phyloseq. Better than have (and maintain) getter functions into all these different formats?

The vignette text could be also otherwise checked to ensure up-to-date content.
A small "workflow" example would be nice for demonstration: get data, run analysis, plot figure.

Consider augmenting author info in the vignettes.

Also add a short text in the beginning about the history of the package, and how the version has been upgraded before submitting to Bioc. This can be helpful for established users.


scan_for_cameras.py cannot find Sony Alpha(α) a6000 or a6500

Using Sony PlayMemories, I established my Sony a6000 GUID on Windows. With the Send to Computer option. I am able to connect wirelessly, but running scan_for_cameras.py while the camera attempts to transfer media does not return anything.
Connecting to the access point (from Ubuntu) hosted via the Send to Smartphone option, I am able to connect. The camera shows Sharing... on the screen after what appears to be a "successful" connection. Running examples/scan_for_cameras.py with some added print statements, and you'll see that it could not find anything:
MESSAGE M-SEARCH * HTTP/1.1
HOST: <IP_ADDRESS>:1900
MAN: "ssdp:discover"
MX: 5
ST: urn:schemas-sony-com:service:ScalarWebAPI:1
USER-AGENT: pysony

ADDR <IP_ADDRESS>
PORT 1900
PACKETS dict_values([])
Available cameras: []

On a side note, connecting to the camera via Sony's Imaging Edge mobile app works nicely. Perhaps the SSDP address / port for mobile and computer is different? Might be related issue with https://github.com/Bloodevil/sony_camera_api/issues/60. Thanks.
EDIT: Just tested with Sony Alpha(α) 6500 as well, same issue.

Fix was to change how you're interfacing the camera via the network. Closing.

Sorry for bumping a two years old issue, but, can you explain more on the "how you're interfacing the camera via the network" part? I'm using A6000 as well


Factories miq server

We have a lot of code focused around creating a miq_server, and stubbing MiqServer.my_server to return it.

make calls to FactoryGirl.create(:miq_server) to be more similar, and use same stubbing.
make calls to EvmSpecHelper.create_guid_miq_server_zone more similar to each other. (and leverage above mentioned feature)
Replace @class variables with instance variables when dealing with servers, zones, and guids.

We have >4 ways of creating a MiqServer environment. I'd prefer to merge this and then have a discussion on which of those courses we want to merge.

@gtanzillo @jrafanie Please review

I'm really liking how this trims down a lot of the specs.  The master thing feels weird because it's not how it works, but maybe it's just a bad naming, and the concept itself is fine?  Let's discuss that piece.

@Fryguy made the suggested changes:

have a guid for all
have a zone for all - it is often passed as an override
change :miq_server_master => :miq_server, :is_master => true
change :miq_server, :my_server => :my_miq_server
change :master => @server => :zone => @server.zone (a few lines became too long on this one)

@matthewd updated to not use a factory, but rather EvmSpecHelper.local_miq_server
@Fryguy All set?

@Fryguy Anything to add?


Need class rename menu item in project browser

This menu item is present in JfD and is occasionally very useful.

Believed added as part of work for https://github.com/GemTalk/JadeiteForPharo/issues/133


sequence to sequence code with GPT2/GPT/BERT

Hi
I am looking for a sequence to sequence generation code with gpt2/gpt or BERT, I was wondering if you have a code available in this repo, and I greatly appreciate to tell me how I can run a sequence to sequence model with the mentioned models. thanks

Hello. Thanks for your interest in Texar. You can take a look at this example:
https://github.com/asyml/texar/tree/master/examples/gpt-2