Fix coredumps in server ct & change coverage calculation

Summary: Various improvements to the component tests/actions:

Check function source coverage of Interfaces, as coverage of declarations aren't calculated in lcov.
Fix coredumps in component tests where mocks were checked on worker thread while mocks were been set on the main thread.
Remove custom string matcher and use the given StrEq.
Fix Underflow component test failure where GST_STATE_PLAYING had not finished been handled and the client calls other methods.
Fix EncryptedPlayback test failure, where keyId buffer and data buffer were the same size so gmock got confused which gstBufferNewAllocate expectation to check.
Fix issue with ServerManagerStub where the ipcThread had not created the channel when getChannel was called.

Type: Fix
Test Plan: Unittests, Component Tests.
Jira: NO-JIRA

https://jenkins.code.rdkcentral.com/job/github-triggered/46024/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11352/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17022/ started.

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34694/

Sanity tests for ['BCM Reference Refapp2'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34695/

https://jenkins.code.rdkcentral.com/job/github-triggered/46142/ started

https://jenkins.code.rdkcentral.com/job/build-component/84853/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11441/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17091/ started.

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34741/

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/51/

Sanity tests for ['BCM Reference Refapp2'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34748/

https://jenkins.code.rdkcentral.com/job/github-triggered/46212/ started

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/53/

https://jenkins.code.rdkcentral.com/job/build-component/84897/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11495/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17133/ started.

build-rpi-refapp2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/223b7e630978461da89a448bfe1bf607

build-rpi4-mc Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/67bb3593c57eaffa3ffb3760a6b1c066

build-rpi4-hybrid Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/6d7a4fdd6a3c093529ffc6a080351482

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/54/

https://jenkins.code.rdkcentral.com/job/github-triggered/46214/ started

https://jenkins.code.rdkcentral.com/job/build-component/84898/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11496/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17134/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11497/ started

https://jenkins.code.rdkcentral.com/job/github-triggered/46216/ started

https://jenkins.code.rdkcentral.com/job/build-component/84900/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17136/ started.

build-rpi4-hybrid Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/dd7f638464459aa3ee5fa7c2b117b2ec

build-rpi-refapp2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/0f21212ddcf994cf9a41648bb3ade27b

build-rpi4-mc Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/4fe0d4b6372cec10b1855f9e2f869289

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/55/

build-rpi-refapp2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/8f1ba36eee93deafb9df55ed14e7541f

build-rpi4-mc Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/ec398d0b5f7ce0e6721f6f362c1d0b64

build-rpi4-hybrid Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/c3c411feb121fd6ff096bf4710939dc3

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/57ccafcf6e9864a52a5deda67b001e55

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/56/

https://jenkins.code.rdkcentral.com/job/github-triggered/46224/ started

https://jenkins.code.rdkcentral.com/job/build-component/84903/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11502/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17140/ started.

build-rpi-refapp2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/b63bed22ad14b055fc7acd74c9b27aac

build-rpi4-hybrid Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/9ab31758091eb8d9618be75ec11df43d

build-rpi4-mc Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/e806a824c70c2f6dee504c4e133eca75

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/aa7ba91c8d5a4fc168d2c1668e282d07

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/57/

https://jenkins.code.rdkcentral.com/job/github-triggered/46228/ started

https://jenkins.code.rdkcentral.com/job/build-component/84904/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11506/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17141/ started.

build-rpi-refapp2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/7ab6b45e532c4a6b09f1a2ee58256448

build-rpi4-mc Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/7c6f5193de613805eaa634c1b0b5509b

build-rpi4-hybrid Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/c8c28691eb7c37e78d6b272354511ec5

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/eea1a52825f09b5e2adafa8def64d9cb

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/60/

https://jenkins.code.rdkcentral.com/job/github-triggered/46316/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11583/ started

https://jenkins.code.rdkcentral.com/job/build-component/85012/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17255/ started.

build-rpi4-mc Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/a037014c16857fd1e0db903cf2f32199

build-rpi4-hybrid Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/e98607312303371ba636bdb3d8c2ba06

build-rpi-refapp2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/a6c39bc2614060dfb7deb6460b232b35

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/666f868a654db44f6198867bac06cb8a

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/61/

https://jenkins.code.rdkcentral.com/job/github-triggered/46318/ started

https://jenkins.code.rdkcentral.com/job/build-component/85013/ started.

https://jenkins.code.rdkcentral.com/job/github-triggered/46319/ started

https://jenkins.code.rdkcentral.com/job/build-component/85014/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11585/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17256/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11587/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17257/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11588/ started

https://jenkins.code.rdkcentral.com/job/github-triggered/46321/ started

https://jenkins.code.rdkcentral.com/job/build-component/85015/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17258/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11589/ started

https://jenkins.code.rdkcentral.com/job/github-triggered/46323/ started

https://jenkins.code.rdkcentral.com/job/build-component/85016/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17259/ started.

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/eaf4e62030082d96353cedd8066e40fd

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/93f7bc98865b94ec6941b080ade15350

https://jenkins.code.rdkcentral.com/job/github-triggered/46327/ started

https://jenkins.code.rdkcentral.com/job/build-component/85017/ started.

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/39153df0f8c3a55348dbf3abf9ed8d45

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11592/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17260/ started.

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34818/

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34819/

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/62/

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34820/

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34821/

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/7debff51486e7ab32848d28ccb4642a6

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34822/

Job for AI/job/AI_BUILDS/job/AI-Trigger-PullRequests started: https://pv-jen015.uk2.scp.bskyb.com/job/AI/job/AI_BUILDS/job/AI-Trigger-PullRequests/63/

https://jenkins.code.rdkcentral.com/job/github-triggered/46330/ started

https://jenkins.code.rdkcentral.com/job/build-component/85020/ started.

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/github-triggered/11595/ started

https://jenkinsrdkm.cmf.code.rdkcentral.com/job/build-component-platform/17263/ started.

build-brcm-refboard2 Console Log uploaded to Gist URL: https://gist.github.com/rdkcmf-jenkins/84f146471d030a90d514a7a7ee2e7f2d

Sanity tests for ['RPI4 Hybrid'] added.
https://jenkinsrdkm.cmf.code.rdkcentral.com/job/test-components-flow/34823/


sh: 0: Can't open /home/chronos/user/Downloads/crouton

Please paste the output of the following command here: sudo edit-chroot -all

Please describe your issue:
If known, describe the steps to reproduce the issue:

Please paste the output of the following command here: sudo edit-chroot -all

sudo: edit-chroot: command not found

@UserSops,

Can't open /home/chronos/user/Downloads/crouton

If you have not yet installed a crouton chroot then the edit-command will not yet be installed and will therefore not work.

Please describe your issue:
If known, describe the steps to reproduce the issue:

Hope this helps,
-DennisLfromGA

sudo install -Dt /usr/local/bin -m 755 ~/Downloads/crouton
install: cannot stat '/home/chronos/user/Downloads/crouton': No such file or directory


ARM support for agents

We're deploying containers in a configuration with a central x86 linux server and raspberry pi leaf agents (running raspbian). I'd like to be able to manage this entire swarm with shipyard, but there currently does not appear to be ARM support. Would it be possible for you to produce ARM builds and make them available on docker hub?
This is currently what happens:
[root@alarmpi ~]# curl -sSL https://shipyard-project.com/deploy > shipyard.sh && chmod +x shipyard.sh
[root@alarmpi ~]# ACTION=node DISCOVERY=etcd://...:4001 ./shipyard.sh
Adding Node
-> Starting Cert Volume
Unable to find image 'alpine:latest' locally
latest: Pulling from alpine
f4fddc471ec2: Pulling fs layer
f4fddc471ec2: Verifying Checksum
f4fddc471ec2: Download complete
f4fddc471ec2: Pull complete
alpine:latest: The image you are pulling has been verified. Important: image verification is a tech preview feature and should not be relied on to provide security.
Digest: sha256:fb9f16730ac6316afa4d97caa5130219927bfcecf0b0ce35c01dcb612f449739
Status: Downloaded newer image for alpine:latest
time="2015-10-22T22:26:43Z" level=fatal msg="Error response from daemon: Cannot start container 81fb828e7931f787caf68b07582f611be15b1defa52a5fd9f02dfe277632ed63: [8] System error: exec format error"

I think once we get multi-arch support in the official repos we could add this.  Would it be ok for this to be in a separate registry for the interim?

A separate registry would be fine :)

@didiersmith In the meantime you can use https://github.com/janeczku/docker-shipyard-armv7. I am running this on Scaleway's bare-metal ARM nodes.

Any updated on this (or the possibility of it being included in the main repo)? This would be really cool for some development and test environments I'm running, since I have some rPi 2s sitting around. Also thank you @janeczku for an excellent option. :smile:


Cloud App Security has been renamed Defender for Cloud Apps.

Cloud App Security has been renamed Defender for Cloud Apps.
I'm responsible for Defender for Cloud Apps documentation. Feel free to be in contact with me if you have questions about the rebrand.
Thanks,
David

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7297d65c-c9cc-cfb8-dde7-8201e1b6e079
Version Independent ID: 61d0a252-b4fc-43cc-b9d0-bd7526efeb1c
Content: azure.mgmt.securityinsight.models.DataConnectorKind enum
Content Source: preview/docs-ref-autogen/azure-mgmt-securityinsight/azure.mgmt.securityinsight.models.DataConnectorKind.yml
GitHub Login: @VSC-Service-Account

Dup of #22571


Add support for Linux platform

Fixes https://github.com/jillesvangurp/kt-search/issues/151
What I did was:

Uncommented the gradle config code
Include a small logic to add linker options (only for Linux source sets) relying on the LDFLAG environment variable.
Add an actual class, KtorRestClient.linux.kt that uses Curl
A few small changes to the build.gradle file removing warnings.
I'm not sure whether it should be included in this PR (or should be included at all), but I also added a small Nix flake to facilitate having a dev environment.

I only tested it (and it works pretty well, with no issues so far) on LinuxX64, both locally (my dev environment uses NixOS) and on docker images.

Still not passing in CI unfortunately, any ideas on how to fix this?
Run sudo apt-get install libcurl4-openssl-dev
Reading package lists...
Building dependency tree...
Reading state information...
Suggested packages:
  libcurl4-doc libidn11-dev libkrb5-dev libldap2-dev librtmp-dev libssh2-1-dev
The following NEW packages will be installed:
  libcurl4-openssl-dev
0 upgraded, 1 newly installed, 0 to remove and 33 not upgraded.
Need to get 386 kB of archives.
After this operation, 1698 kB of additional disk space will be used.
Get:1 file:/etc/apt/apt-mirrors.txt Mirrorlist [142 B]
Ign:2 http://azure.archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4-openssl-dev amd64 7.81.0-1ubuntu1.18
Ign:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4-openssl-dev amd64 7.81.0-1ubuntu1.18
Ign:2 http://security.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4-openssl-dev amd64 7.81.0-1ubuntu1.18
Err:2 mirror+file:/etc/apt/apt-mirrors.txt jammy-updates/main amd64 libcurl4-openssl-dev amd64 7.81.0-1ubuntu1.18
  404  Not Found [IP: <IP_ADDRESS> 80]
E: Failed to fetch mirror+file:/etc/apt/apt-mirrors.txt/pool/main/c/curl/libcurl4-openssl-dev_7.81.0-1ubuntu1.18_amd64.deb  404  Not Found [IP: <IP_ADDRESS> 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
Error: Process completed with exit code 100.

Also not really liking the nix/flake dependency. Can you get rid of that?

can you merge master? I removed the bit that attempts to install libcurl headers. Not sure if that is still needed for Linux support but wasn't working in any case.

can you merge master? I removed the bit that attempts to install libcurl headers. Not sure if that is still needed for Linux support but wasn't working in any case.

oh, I've just pushed another change installing libcurl, because indeed it's needed


AI Image is black

The scene renders as expected. The image that comes back from the cloud is black. I'm using Stable Horde (cloud). I don't know if this is a problem on my end or the cloud.
AI Render: 0.6.8
Blender: 3.4.1
Windows 10

I think Stable Horde recently changed their API. See #66 - hopefully we'll have this fixed soon!

Fixed in the latest release - update AI Render to get it


Terraform Automation Design

The base terraform layer has been reviewed by @lk86 and pushed into the mina-deployments repo.
https://github.com/MinaProtocol/mina-deployments/commit/cd1986f63e65be93d7599594acb51f474e6900a2


Update To Support v5 API

This PR updates the .NET API to support the v5 API.
Functionality Added

Update support from v4 to v5
Update README to show functionality of this API
Added option to control "limit" and "offset" for ListUsers() and ListVariables()

These methods were tested to make sure they support the v5 API. More details

[x] Conjur OSS
[x] DAP
[x] Instantiate with API key
[x] Instantiate with access token
[x] Configure from environment (See "Functionality to Add" bellow)
[ ] Configure from .netrc
[ ] Configure from .conjurrc
[x] Policy

Notes on what's possible: (PUT / PATCH / DELETE?)
Load Policy

[x] Get a secret value
[x] Set a secret value
[ ] Batch secret value retrieval
[x] Get list of resources visible to authenticating user (eg as in conjur list)

Methods
Client
Client Client(uri, account)

Create new Conjur instance

uri - URI of the Conjur server. Example: https://myconjur.org.com
account - Name of the Conjur account

LogIn(string userName, string password)

Login to a Conjur user

userName - Username of Conjur user to login as
password - Passwordof user

TrustedCertificates.ImportPem (string certPath)

Add Conjur root certificate to system trust store

certPath = Path to cert

<Client>.Credential = new NetworkCredential(string userName, string apiKey)

To login with an API key, use it directly

userName - Username of user to login as
apiKey - API key of user

IEnumerable<Variable> ListVariables(string query = null)

Returns a list of variable objects

name="query" - Additional Query parameters, not required

uint CountVariables(string query = null)

Count Conjur resource of kind variable

name="query" - Additional Query parameters, not required

Host CreateHost(string name, string hostFactoryToken)

Creates a host using a host factory token

name - Name of the host to create
hostFactoryToken - Host factory token

Policy
Policy <Client>.Policy(string policyName)

Create a Conjur policy object

policyName - Name of policy

policy.LoadPolicy(Stream policyContent)

Load policy into Conjur

policyContent - The policy

Variable
Variable <Client>.Variable(string name)

Instantiate a Variable object

name - Name of the variable

Boolean Check(string privilege)

Check if the current user has specified privilege on this variable

privilege - string name of the privilege to check for

Privileges: read, create, update, delete, execute

AddSecret(string val)

Change current Variable to val

val - Value to update current Variable to

String GetValue()

Return the value of the current Variable

Tests Fixed
api-dotnet.test.Conjur.Test.VariablesTest.GetVariableTest

Error: System.Collections.Generic.KeyNotFoundException : test:///secrets/test-account/variable/foo bar
Uses Uri.EscapeDataString
Changed + to %20

api-dotnet.test.Conjur.Test.UserTest.ListUserTest
api-dotnet.test.Conjur.Test.VariablesTest.ListVariableTest

Error: System.Collections.Generic.KeyNotFoundException : test:///resources/test-account/variable?offset=0&limit=10000
Both list tests have limit=10000 that's not in expected URIs
verify<>Info is the same for both
Test was assuming that offset and limit were variable in the API. They are static.
ListResources at the lowest level was not static, BUT for listing resources at the Variable and User level, there was no parameter that would go all the way down to Resources.ListResources to make limit and offset dynamic
Tests do not account for the multiple calls the ListResources method makes.
ListResources will make calls until the returned call has a count of 0, so a second call will be made that has a count of 0 for these tests but with an offset equal to limit

api-dotnet.test.Conjur.Test.ClientTest.ActingAsTest

Similar problem to ListUser and ListVariable of the default limit did not match the specified limit in the test

Outstanding Work
Tests to Fix
api-dotnet.test.Conjur.Test.AuthenticatorTest.TestTokenCaching
api-dotnet.test.Conjur.Test.AuthenticatorTest.TestTokenThreadSafe
api-dotnet.test.Conjur.Test.ClientTest.TestLogin

These 3 all use GetToken() which uses HttpWebRequest request = WebRequest.CreateHttp(this.uri), and it's not configured in WebMocker.
Cannot override the CreateHttp method to return a mocked HttpWebRequest object because "cannot override inherited member, because it is not marked abstract, virtual or override"
Issue: https://github.com/cyberark/conjur-api-dotnet/issues/45

api-dotnet.test.Conjur.Test.HostFactoryTest.TestCreateHost
api-dotnet.test.Conjur.Test.ResourceTest.TestCheck

System.TypeLoadException
Issue: https://github.com/cyberark/conjur-api-dotnet/issues/46

Functionality to Add

Although you can get manually get the environment variables and assign them to the needed variables to instantiate a Client, it would be nice if there was a built in way to do this like the Java API

Issue: https://github.com/cyberark/conjur-api-dotnet/issues/47

Adding batch secret retrieval as a feature of The API, so it doesn't need to be done in manually by user

Issue: https://github.com/cyberark/conjur-api-dotnet/issues/49

@JakeQuilty Also make sure to update the wording of the "update to dev" commit since it seems really slim and un-useful

@uCatu can you take a look at some of @sgnn7 's suggestions to your commit?

All cosmetic changes are done. The last commit is failing to build for the tests though

@JakeQuilty / @uCatu Can we figure out how to get the current tests passing so that we can get this merged?

Current errors:
[2020-05-22T17:11:00.545Z] /build/conjur-api/conjur-api.csproj (default targets) ->
[2020-05-22T17:11:00.545Z] /usr/lib/mono/4.5/Microsoft.CSharp.targets (CoreCompile target) ->
[2020-05-22T17:11:00.545Z]
[2020-05-22T17:11:00.545Z] 	Client.cs(66,16): error CS1043: Invalid accessor body `=>', expecting `;' or `{'
[2020-05-22T17:11:00.545Z] 	Client.cs(66,45): error CS1014: A get or set accessor expected
[2020-05-22T17:11:00.545Z] 	ApiConfigurationManager.cs(49,16): error CS1043: Invalid accessor body `=>', expecting `;' or `{'
[2020-05-22T17:11:00.545Z] 	ApiConfigurationManager.cs(73,16): error CS1043: Invalid accessor body `=>', expecting `;' or `{'
[2020-05-22T17:11:00.545Z]
[2020-05-22T17:11:00.545Z] 	 0 Warning(s)
[2020-05-22T17:11:00.545Z] 	 4 Error(s)

@sgnn7 @JakeQuilty is this even with some of the tests commented out, to be updated in follow-up issues? or are we not commenting out any test cases anymore?
I am ok with commenting some test cases and fixing them in follow-up issues, as long as we log the issues for them and reference them here

@izgeri the failures are with some tests already commented out. As far as I can tell, the project cannot build.

@sgnn7 The origin of those error is C#7 syntax.
In our environment we are building the SDK with up to date msbuild toolset so we even haven't pay an attention to this.
You can read more about syntax and versions there.
You can "rephrase" those code segments using C#6 or lower convention or to upgrade mono compiler. It looks that it supports "Expression-bodied constructors, finalizers and accessors".

@sashaCher Thanks for the explanation - makes sense! It may be useful to use the old syntax until we figure out what the bottom version for this API should be though but feel free to update the test runner instead if C#6 is end-of-life already.

Fixed the failing build by reverting all the get and set with => back to curly brackets


Read Places from Server

Description:
Before the hardware resources can be displayed they need to be retrieved from the backend/server. Therefore, in the frontend the REST method has to be called.
Acceptance criteria:

[ ] Call REST method of server
[ ] Save response in a suitable data structure

This should alse be closed as soon as #77 is merged


DebugMode Configuration

Current Debug Mode is Hardcoded with values. This aims to make it more dynamic

Debug Mode Features Added


New JSON data structur with API request

After I solved the OAuth v3 issue #41 for my environment I found some additional lines in the JSON data structure. When I call the /api/meters/aggregates the API delivers for all meters (site, solar, grid etc.) additionally:
"last_phase_voltage_communication_time":"0001-01-01T00:00:00Z",
"last_phase_power_communication_time":"0001-01-01T00:00:00Z",
"timeout":1500000000_
I don't see any specific use of these data but my scripted data picker delivered wrong data so I had to adjust my scripts. This is not an issue of this api itself but more a hint when you are running in simular issues.
(PW firmware version 20.49.0)
Maybe the sample response in this project could be updated with this information.

I think this was more for information so happy to close this issue.


eks-update-global-values

update values to match new scheme https://github.com/giantswarm/cluster-eks/pull/50

/run cluster-test-suites

EKS test passed, not sure what is the rest but this changes only values for EKS so it should not really matter for the rest.
and its kinda needed to merge to avoid errors for e2e for ESK as the chart already has the new scheme

not sure what is happening with all the test but the EKS test itself pass it fails at the end when its trying to remove the org, this was not the case yesterday

/run cluster-test-suites

yay green!


⚠ Bofrost.be has degraded performance

In 118708b, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1121 ms

Resolved: Bofrost.be performance has improved in 8215e80.


fix(docs): Fixed typos and example code of Named Messages

Thank you.

:tada: This PR is included in version 10.11.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


WaveFormat cannot be set for WASAPI Loopback Capture

i am trying to stream sound card ouput from server to client, so i need to encode the array bytes in the server and decode in client.

waveIn = new WasapiLoopbackCapture();
waveIn.WaveFormat = selectedCodec.RecordFormat;
waveIn.DataAvailable += soundStream_DataAvailable;
waveIn.StartRecording();

but

waveIn.WaveFormat = selectedCodec.RecordFormat;

throw exception

WaveFormat cannot be set for WASAPI Loopback Capture

i did the same thing to stream the microphone between two users using client/server architecture and it work perfectly.

yes, this is how wasapi loopback capture works. You have to capture at the wave format that the system audio is running - usually IEEE float, stereo at 44.1 or 48kHz.
If you want a different format you must convert it manually as a separate step

Thank you for the replay, can you give me please a link on how convert it manually as a separate step

I have tried this code to convert bytes from 32 to 16 bits and to resample, but all I get every time is just blank audio.
I convert the array bytes from 36 bits to 16 bits like this :

byte[] newArray16Bit = new byte[e.BytesRecorded / 2];
short two;
float value;
for (int i = 0, j = 0; i < e.BytesRecorded; i += 4, j += 2)
{
value = (BitConverter.ToSingle(e.Buffer, i));
two = (short)(value * short.MaxValue);
newArray16Bit[j] = (byte)(two & 0xFF);
newArray16Bit[j + 1] = (byte)((two >> 8) & 0xFF);
}

and then i resample like this :

Buffer.BlockCopy(newArray16Bit, 0, resampleStream.SourceBuffer, 0, newArray16Bit.Length);
int sourceBytesConverted = 0;
var convertedBytes = resampleStream.Convert(newArray16Bit.Length, out sourceBytesConverted);
if (sourceBytesConverted != (e.BytesRecorded / 2))
{
Console.WriteLine("We didn't convert everything {0} bytes in, {1} bytes converted", sourceBytesConverted, e.BytesRecorded / 2);
}
var converted = new byte[convertedBytes];
Buffer.BlockCopy(resampleStream.DestBuffer, 0, converted, 0, convertedBytes);

and finally to save :

waveWriter.Write(converted, 0, convertedBytes);
waveWriter.Flush();

the best way to troubleshoot issues like this is to save your audio to WAV file at intermediate problems. Try saving after the conversion to 16 bits and checking that is OK. If it's OK then you can focus more on the resampling which is more likely to be where the issue is.


added 'route' url and http 'method' for all JsonIndex examples

store route and http method in JsonIndex to show on index page
this can make understanding the API request simpler
no need to check detailed info of API request
closes #209

Looks good. Thanks


Possible missing DLL

While testing version 4.14.  RdlDesigner.exe (file save)... i get the following error:
Could not load file or assembly 'EncryptionProvider. Version=<IP_ADDRESS>. Culture=neutral, PublicKeyToken=null' or one of its dependencies. The system cannot find the file specified.
at fyiReporting.RdlDesign.MDIChild.doPossibleEncrytion(Uri file, String rdl)
at fyiReporting.RdlDesign.MDIChild.FileSave(Uri file, String rdl)

this should be fixed in 4.15
https://github.com/majorsilence/My-FyiReporting/releases/tag/version_4.15


chore(ci): add release-please for release-automation

This will make the release process easier to manage by providing an auto-updated PR with a changelog. Since release-please only manipulates the changelog and creates a GitHub release, this PR also updates the release workflow to build binaries and attach them to the newly created release.

As this is similar / based on what we did for wait-for-github, suggest adding ready_for_review to the types. This is because we're using the Actions bot when pushing to the PRs and so it doesn't trigger workflows. Undrafting is the trigger we use to make the release PR actually mergeable.
Are you planning to enable the merge queue? If so, you might as well add merge_group to the relevant workflows now.

For now I've create a custom app for this. I just need to transfer it into the correct account and install it here :)

This doesn't seem like a scalable approach, requiring every repository to have an app to be released using release-please. What is your wider plan?

This doesn't seem like a scalable approach, requiring every repository to have an app to be released using release-please. Also it adds a lot of effort into the process. What is your wider plan?

An alternative would also to create a single automation app that we use for all all the OSS repos. My assumption right now is, that we will have more workflows that should be triggered by other workflow actions and so a custom token would be favourable here.

Can you just quickly say what's wrong with what we're doing in wait-for-github, which doesn't require an app?

Ah no, we don't react to the release event in that repo.
One thing you could do is look at the release_created and/or upload_url output. Assuming that works it should be possible to push the assets from the same workflow that creates the release, using softprops/action-gh-release or something like it.

@iainlane I've merged the two workflows no so that no special token is required. I've tested the outcome on https://github.com/zerok/tanka/releases/tag/v0.29.0 (ignore the wrong version 🤣 )


Implement support for indirect calls via dynexec/procref

Now that 0xPolygonMiden/miden-vm#1078 is merged (which introduces dynexec), the groundwork for supporting indirect calls in Miden Assembly is there. Before we can make use of it though, we need the proposed procref instruction, which would push the hash of a specified function name on the stack. This is done prior to dynexec, which requires that hash in order to execute the indirect call. We need procref because we don't know the hash of the function until after compilation, which procref solves by relying on the Miden assembler to expand it into push.HASH as it knows the hashes of all the functions.
Once that is implemented, we can make use of it to implement indirect calls in the IR:
### Tasks
- [ ] Add a new `call.indirect` opcode, to be paired with the `PrimOp` instruction type
- [ ] Add a new `Type` variant, `Type::Function(Box<FunctionType>)` which will be used in conjunction with `Type::Ptr` to represent function pointers
- [ ] Add a new data segment to `Program` which represents every function in the compiled program as a table of hashes. Initialize this table at runtime using `procref`
- [ ] Translate Wasm function table to the above-mentioned data segment 1-to-1
- [ ] Lower indirect calls to MASM by treating the function pointer operand as an index into the function table, load the callee hash, and then dispatch via `dynexec`. Indexing beyond the bounds of the table should trap.

It might also be good to wait for https://github.com/0xPolygonMiden/miden-vm/issues/1091 - but, of course, not necessary.

Agreed, I think it is beneficial to wait for those changes, though we can at least lay the groundwork for indirect calls without supporting them in codegen. If it turns out that we reach a point where we have procref but not the changes proposed in that issue, we can experiment with what's there now, but I don't anticipate doing that unless indirect calls turn out to be more important than initially thought when compiling from Rust.

@bitwalker While translating the basic wallet Wasm component example PR I found a case where table is used as a parameter for module instantiation and I want to make sure we capture these semantics in the IR.
The gist of it is that the table is defined (but not initialized) and used in module A in call_indirect ops and this table is exported from module A. Then, module B which has a table import is supplied with module A's exported table as an argument on instantiation and initializes it with references to its own (module B) imported functions (component imports). So, call_indirect op in module A is calling functions from module B's imports.
A table argument (other module's export) to a module instantiation for the module's import is concatenated on module allocation to the module's defined(local) tables.
All tables in Wasm are stored in a global store (see module instantiation) which acts as a global state (see store).
I believe we can capture these semantics in the IR by storing tables in IR Component and using their references in whatever modules they are used in after resolving all import/export relations. However, since we support the core Wasm module compilation without the Wasm component model, we need to decide how we store tables in this case. Now, Wasm core module is translated into an IR Module. I think for the sake of unification, we could wrap such IR Module with an empty Component and store tables in it.


Robotswana 9: hints not displayed because of unfold

The unfold in the line
https://github.com/hhu-adam/Robo/blob/2fff9106b1e4610acb25dd09d4dfd2e4319ac95a/Game/Levels/MatrixTrace/L09_EvalOnEBasis.lean#L51
is necessary to close the goal with simp. However, if the user does not unfold, the following hints will not be displayed!

Without the following hint, the students got themselves into a very intransparent situation, in which two sides of an equation looked identical on the screen but where not indentical to lean (rfl failed).
apply nat_mul_inj' (n := n.succ)
rw [←smul_eq_mul, ← LinearMap.map_smul]
trans f (∑ x : Fin n.succ, E i i)
simp
rw [← smul_eq_mul]
rw [← LinearMap.map_smul]
rw [←smul_eq_mul]
rfl

I see, the intransparency is that the left the left • is for Mat[succ n, succ n][ℝ] as ℝ-module, while the right one is a scalar multiplication as Mat[succ n, succ n][ℝ]-module


Refactor LBaaS recon tests for generic mock client

LBaaS reconciliation tests now use the generic mock client provided by go-anxcloud.
Wow, this diff is small!

Checklist

[ ] added release notes to Unreleased section in CHANGELOG.md

References

generic mock client introduced in https://github.com/anexia-it/go-anxcloud/pull/139

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request

@marioreggiori I rebased this PR, let's merge this and then rebase #105? :)


Support of batched UPSERT and UPDATE queries

Hello,
I would like to use arel to build these 3 batch queries, I am now building manually for PG 9.5:

INSERT ON CONFLICT UPDATE with a where condition (UPSERT)

        values = hashes.map do |hash|
          "(#{all_attribute_keys_array.map { |x| ActiveRecord::Base.connection.quote(hash[x]) }.join(",")})"
        end.join(",")

        insert_query = %{
          INSERT INTO #{table_name} (#{all_attribute_keys_array.join(",")})
            VALUES
              #{values}
          ON CONFLICT (#{inventory_collection.unique_index_columns.join(",")})
            DO
              UPDATE
                SET #{all_attribute_keys_array.map { |x| "#{x} = EXCLUDED.#{x}" }.join(", ")}
              WHERE EXCLUDED.remote_data_timestamp IS NULL OR (EXCLUDED.remote_data_timestamp > #{table_name}.remote_data_timestamp)
        }

UPDATE FROM VALUES

        values = hashes.map do |hash|
          "(#{all_attribute_keys_array.map { |x| quote(hash[x], x, inventory_collection) }.join(",")})"
        end.join(",")
        cond = inventory_collection.unique_index_columns.map do |x|
          "updated_values.#{x} = #{table_name}.#{x}"
        end.join(" AND ")

        update_query = %{
          UPDATE #{table_name}
            SET
              #{all_attribute_keys_array.map { |key| "#{key} = updated_values.#{key}" }.join(",")}
          FROM (
            VALUES
              #{values}
          ) AS updated_values (#{all_attribute_keys_array.join(",")})
          WHERE #{cond}
        }

SELECT using IN with nested array

  model.where("(a,b,c) IN (('a1', 'b1', 'c1'), ('a2', 'b2', 'c2'), ...)")

Is something like this already supported in Arel, I couldn't find it, would it make sense to add it? There are few gems supporting at least the upsert, https://github.com/zdennis/activerecord-import and https://github.com/jesjos/active_record_upsert. But I don't see any for the other queries. Also we would prefer to use Arel.
Can anybody advise?

@tenderlove could you advise? Thank you in advance :-)

Per #523, Arel development is moving to rails/rails.
If this issue is still relevant, please consider reopening it over there. (Note that the Rails repository does not accept feature request issues, and requires reproduction steps that rely on Active Record's documented API.)


Fix idea plugin compatability

IDEA doesn't provide backward compatibility policy, and breaking changes can happen in any version, without prior deprecation:
https://plugins.jetbrains.com/docs/intellij/api-changes-list.html
Because of that, we can't remove plugin.until.build, and have to build Compose plugin for each new version of IDEA separately
What we should do after that commit, is make sure, that we don't forget to check this compatibility. And ship a new stable version for every new stable IDEA.
The ideal way is to run runPluginVerifier on CI for the latest version, which will fail the build, if our plugin isn't compatible.
But for some reason, there is no EAP for IDEA 2022.3 here:
https://jb.gg/intellij-platform-builds-list

We also need to release 1.2.2, because 1.2.1 is only compatible with IDEA 2022.1

It seems if we omit "until", it has a default value +8: https://plugins.jetbrains.com/plugin/16541-compose-multiplatform-ide-support/versions/Snapshots/223890


Improve UI responsiveness on /access page

A number of improvements are possible on the /access page. Currently all tables in all components are re-rendered on every tab change.
This is also causing a data grid warning, because some of the tables are rendered invisibly

Done


Code coverage metric in CI

Hi!
I was peering around CI (yay at signing CI builds!), and wondering whether a code coverage metric would be useful per push/PR to detect coverage regressions on new code.
https://github.com/sigstore/cosign/blob/ca5a8aa06525cc6a732812aef243eaa7f6bff6ac/.github/workflows/tests.yaml#L3
I'm very new to Go so don't know its extend of coverage profiling (how easy it is to filter files/generate reports), but this would be cool to have!

Yes! It's actually pretty easy to add coverage, but every continuous reporting system I've seen has been incredibly flaky/problematic. The one in Tekton never seems to work.
I'd be up for trying another one though if anyone has recommendations!
To do it in cosign now, you can run:
$ go test -tags=e2e -coverpkg=./... -coverprofile=cover.out ./...
$ go tool cover -html=cover.out


Can not view Applications.

Description of issue
Unable to view applications unless they are directly linked to me.
Steps
Went to https://authv2.kryptedgaming.com/applications as directed that did not work, Tried applications/view/ and it said i do not have the permission to view, also clicked the applications button and it said i do not have the permission to view
Url
Please paste the URL that caused this issue.
See above steps

Permissions are working as intended, however, you shouldn't have been able to view the application without those permissions. Will work on a fix.

Upon looking into it further, I've gone to the direct link to the application which i can open but i am unable to open the API's the error message i get is You do not have permission to view that. <QuerySet [<Group: BYTE>, <Group: EVE>]>

Fixed with
https://github.com/porowns/kryptedauth/commit/5bd813958fd35604b4b9481be234e22d77600ed8


Using dot notation on returned rows

It would be handy if the cursor's fetch() functions returned something like named tuples so that the fields can be accessed using dot notation rather than having to refer to them by index.
cursor.execute("select first_name, last_name from person")
row = cursor.fetchone()
print('Hello {}'.format(row[0]))          # this currently works
print('Hello {}'.format(row.first_name))  # this is not yet possible

I agree that this would be a convenient addition. I am not sure how this would impact performance. Also, I would have to create new named tuple types for each result set; this could be bad for applications that do lots and lots of small queries. I'll have to think about this one.

Perhaps this could be a flag in the connect() function, for example:
conn = turbodbc.connect(dsn='...', row_type=turbodbc.TUPLE)  # rows would be returned as tuples
conn = turbodbc.connect(dsn='...', row_type=turbodbc.LIST)  # rows would be returned as lists
conn = turbodbc.connect(dsn='...', row_type=turbodbc.ORDERED_DICT)  # rows would be returned as OrderedDicts
conn = turbodbc.connect(dsn='...', row_type=turbodbc.NAMED_TUPLE)  # rows would be returned as NamedTuples

Then, any cursors generated from that connection would inherit the row type, but that too could be overridden:
conn = turbodbc.connect(dsn='...', row_type=turbodbc.LIST)
crsr1 = conn.cursor()  # rows from this cursor would be returned as lists
crsr2 = conn.cursor(row_type=turbodbc.ORDERED_DICT)  # rows from this cursor would be returned as OrderedDicts

Furthermore, perhaps the user could provide a class to the row type parameter that would do any custom transformation. The class would just have to have a constructor method, say make():
class MyClass():
    def make(seq):
        return list(seq)  # trivial example to always return a list

conn = turbodbc.connect(dsn='...', row_type=MyClass)


Maybe you have mistake in README

When I have tried to run playbook with example from README
- name: "Install java"
  hosts: all

  roles:
    - role: "lean-delivery.java"
      java_major_version: 8
      java_minor_version: 191
      java_arch: "x64"
      java_package: "jdk"

I have got error:
[zak@localhost lean_delivery.java]$ ansible-playbook -i host playbook.yml
ERROR! the role 'lean-delivery.java' was not found in /home/zak/.ansible/roles/lean_delivery.java/roles:/home/zak/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/home/zak/.ansible/roles/lean_delivery.java

The error appears to have been in '/home/zak/.ansible/roles/lean_delivery.java/playbook.yml': line 5, column 7, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

  roles:
    - role: "lean-delivery.java"
      ^ here

Because role name in playbook has name lean-delivery.java , but folder which was created galaxy have had lean_delivery.java (underscore).

I have seen necessary change in open pull  request.


BUG: Safe app window close

Follow-up to https://github.com/pyvista/pyvistaqt/pull/127 which should help with this:
E   pytest.PytestUnraisableExceptionWarning: Exception ignored in: <function BackgroundPlotter.__del__ at 0x7f869d7a9ab0>
E
E   Traceback (most recent call last):
E     File "/opt/hostedtoolcache/Python/3.10.9/x64/lib/python3.10/site-packages/pyvistaqt/plotting.py", line 741, in __del__
E       self.app_window.close()
E   RuntimeError: wrapped C/C++ object of type _MNEMainWindow has been deleted

Makes the code more DRY at the same time rather than duplicating the logic, as self.close() is already just:
        if not self._closed:
            # Can get:
            #
            #     RuntimeError: wrapped C/C++ object of type MainWindow has
            #     been deleted
            #
            # So let's be safe and try/except this in case of a problem.
            try:
                self.app_window.close()
            except Exception:  # pragma: no cover # pylint: disable=broad-except
                pass

This is a pretty straightforward fix and includes some CI fixes that should hopefully allow us to merge some of the dependabot PRs, so I'll mark this for merge-when-green


feat(integrations): add django signals_denylist to filter signals that are attached to by signals_span

This PR adds a way to exclude sentry-sdk from attaching to certain Django signals. This can be used to work around performance issues when sentry attaches to performance sensitive signals like pre_init and post_init.
You pass a list of Django signals that you don't want Sentry to attach to:
import django.db.models.signals
import sentry_sdk

sentry_sdk.init(
    ...
    integrations=[
        DjangoIntegration(
            ...
            signals_denylist=[
                django.db.models.signals.pre_init,
                django.db.models.signals.post_init,
            ],
        ),
    ],
)

This potentially fixes #1826 or #1739, and https://github.com/jazzband/django-model-utils/pull/556.

General Notes
Thank you for contributing to sentry-python!
Please add tests to validate your changes, and lint your code using tox -e linters.
Running the test suite on your PR might require maintainer approval. Some tests (AWS Lambda) additionally require a maintainer to add a special label to run and will fail if the label is not present.
For maintainers
Sensitive test suites require maintainer review to ensure that tests do not compromise our secrets. This review must be repeated after any code revisions.
Before running sensitive test suites, please carefully check the PR. Then, apply the Trigger: tests using secrets label. The label will be removed after any code changes to enforce our policy requiring maintainers to review all code revisions before running sensitive tests.

Hey @lieryan, thanks a lot for the PR and sorry for the wait! I'm looking at it now, will leave a review soon.


Swan Account Details>Receive>Wrong text

Remove "Checking Account" text

-Verified this issue on Dev app v1.7.0 (289)


BDI - Sending logs with Apache client

Sending logs with Apache client
Removed dependency in Bdi SDK
Removing dependency on javax.ws.rs.core

approved for test build

:white_check_mark: Build hp-application-automation-tools-plugin octane_latest.11-avuqvtyq completed (commit https://github.com/hpsa/hp-application-automation-tools-plugin/commit/9347c152f1 by @)

approved to merge


pull request for e2e test at 01/11/2017 12:26:11

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Newsela Split

Hi,
I would like to clarify regarding the Newsela data setup:

Am I right that the originally released data in 2015 (1,130 articles) was used in the paper? (That is, the text file in “newsela_data_share-20150302” in the Newsela release)
Following the description in Section 5 by having the first 1,070 articles for training, the next 30 for development, and the next 30 for testing, followed by filtering out sentence pairs corresponding to alignment levels 0-1, 1-2, and 2-3 gave me numbers of sentence pairs that are different from the paper (94,944 training, 2,531 development, and 2,462 test sentences). How can I come up with 94,208 training sentence pairs, 1,129 development sentence pairs, and 1,076 test sentence pairs as stipulated in the paper?

Thank you.
Regards,
Christian

Where will I find the newsela release?


Div

Learned today about div tag for an element in HTML. Need to change those tags with more semantic identifiers.

Finished changing tags


[Bug] Apparent goroutine and socket leak

Describe the bug
A clear and concise description of what the bug is.
A grafana operator pod running with no traffic exhibits continuously increasing network traffic, fs usage, and goroutine count until eventually crashing and restarting. The network traffic seems to be keepalives from an ever increasing number of open sockets.
The associated grafana pod exhibits increasing network traffic but doesn't crash.
To Reproduce
Steps to reproduce the behavior:

Run the prometheus operator in kubernetes
Export pod metrics to prometheus
Run the following prometheus queries:
container_fs_usage_bytes{pod=~"grafana-operator.*|grafana-deployment.*"} / 1024 / 1024
sum (rate(container_network_transmit_bytes_total{pod=~"grafana-operator.*|grafana-deployment.*", container!=""}[2m])) by (container, pod)
go_goroutines{pod=~"grafana-operator.*|grafana-deployment.*"}
Run the following shell command to show open sockets:
exec -it grafana-operator-58bc89f8f7-2xq4k -- ls -l /proc/1/fd | grep socket | wc -l

Expected behavior
A clear and concise description of what you expected to happen.
Steady-state network traffic. No pod restarts.
Suspect component/Location where the bug might be occuring
unknown
Screenshots

Runtime (please complete the following information):

OS: Linux
Grafana Operator Version v3.6.0
Environment: Kubernetes v1.16.15
Deployment type: Deployed
Other: N/A

Additional context
N/A

It seems this may have been fixed by https://github.com/integr8ly/grafana-operator/pull/308. I will verify tomorrow and close this issue if so.

This was indeed fixed by upgrading to a newer version. Closing.


[Dropdown] Multiselect Without Labels Does Not Clear

When using a multiselect dropdown (with useLabel:false option), the dropdown items do not clear properly.  When "get value" is called on the dropdown after "clear" is called, the dropdown returns an empty string (expected), but the selected menu items are not deselected in the ui (problem).  Here is a jsfiddle to demonstrate the issue http://jsfiddle.net/k8z7aqro/1/

I'm able to reproduce


Users/mg/xavs15 (#2754)

Migrate XamarinAndroid to PS3 implementation

XamarinAndroid support for MSBuild in VS 15

PR feedback

M1 approved.


Add SupportsKraus to cirq/__init__.py

Fixes: https://github.com/quantumlib/Cirq/issues/4425

I can't request @viathor as a reviewer.

Should I change the existing calls of SupportsChannel to SupportsKraus on here?

👍 . Oh just membered, we assign to pull requests if we can't assign to a reviewer.

Should I change the existing calls of SupportsChannel to SupportsKraus on here?

Sorry for having missed those and thanks for sending this PR. I'll do the rest.

I'll do the rest

Nah nah i'm on a roll. Will push the changes to PR.

Hehe, ok! :-)
Thank you, Victory!


findPagedList with @EmbeddedId broken - automatically adds orderby t0.null

It looks like #410 automatically added the  @Id field to the orderBy clause when findPagedList is used.  If the table has an @EmbeddedId field instead, invalid sql is generated.  The last column in the "order by" is null.
I have 2 tables set up in a M2M (users & locations). I am connecting them via a join table.  The join table (loc_user) has a compound primary key which is an EmbeddedId.
When I attempt to get a pagedList of users for a specific location, the following SQL is generated.
select t0.user_id c0, t0.location_id c1, t0.permission c2, t0.display c3  from loc_user t0 left outer join users t1 on t1.user_id = t0.user_id  where (t0.location_id = ?  and lower(t1.user_email) like ? escape'' )  order by t1.user_email, t0.user_id, t0.null limit 5
After reading #410, I assume "t0.null" is supposed to be the @Id field of the table.
I am in the process up upgrading from Play 2.3 to Play 2.4 which bumped the Ebean version for 3.x to 6.8.1.
Is there anyway to force the query not to append the @Id field to the "order by" clause?
Thanks
MikeS

Yes, the query should have an order by clause ... then Ebean will not try
to add one automatically using the @id property.
So add an order by and it should be good.
On 9 Jan 2016 9:51 am, "mshillinger"<EMAIL_ADDRESS>wrote:

It looks like #410
https://github.com/ebean-orm/avaje-ebeanorm/issues/410 automatically
added the @Id https://github.com/Id field to the orderBy clause when
findPagedList is used If the table has an @EmbeddedId field instead,
invalid sql is generated The last column in the "order by" is null
I have 2 tables set up in a M2M (users & locations) I am connecting them
via a join table The join table (loc_user) has a compound primary key which
is an EmbeddedId
When I attempt to get a pagedList of users for a specific location, the
following SQL is generated
select t0user_id c0, t0location_id c1, t0permission c2, t0display c3 from
loc_user t0 left outer join users t1 on t1user_id = t0user_id where
(t0location_id = ? and lower(t1user_email) like ? escape'' ) order by
t1user_email, t0user_id, t0null limit 5
After reading #410
https://github.com/ebean-orm/avaje-ebeanorm/issues/410, I assume
"t0null" is supposed to be the @Id https://github.com/Id field of the
table
I am in the process up upgrading from Play 23 to Play 24 which bumped the
Ebean version for 3x to 681
Is there anyway to force the query not to append the @Id
https://github.com/Id field to the "order by" clause?
Thanks
MikeS
—
Reply to this email directly or view it on GitHub
https://github.com/ebean-orm/avaje-ebeanorm/issues/526.

Can you include the entity beans and the orm query that produces this SQL and I will try and reproduce.
Thanks, Rob.

Rob,
I have tried executing the query several different ways.  Specifying a single order("colName") statement and using a single orderBy("colName1 ASC, colName2 ASC").  In both cases, a null column is automatically appended.  I will append a test case later today.
Thanks, Mike

Rob,
GitHub would not allow me to attach an example to this issue.  I uploaded a tarball containing a maven project to google drive.   The share link is:
https://drive.google.com/file/d/0B0XI1GCFgWJka1BhRDFrNkhVclU/view?usp=sharing
Thanks, Mike

Rob,
I pulled the 6.8.1 source and modified BeanDescriptor.appendOrderById() so it would not automatically append to orderBy if idProperty.isEmbedded().
  public void appendOrderById(SpiQuery<T> query) {
    if (idProperty != null && !idProperty.isEmbedded()) {
      OrderBy<T> orderBy = query.getOrderBy();
      if (orderBy == null || orderBy.isEmpty()) {
        query.order().asc(idProperty.getName());
      } else if (!orderBy.containsProperty(idProperty.getName())){
        query.order().asc(idProperty.getName());
      }
    }
  }

This resolved my issue. There don't seem to be any side effects, all Ebean unit tests passed.

Thanks.  I have reproduced and confirmed the fix.

Hi Mike, I have a couple of little things I can point out in the test code (places where there are alternatives that are a little nicer to the DB etc).
If you email me I can reply with those little observations/alternatives.  robin.bygrave at gmail dot com.
Cheers, Rob.


Issue when rendering HTML report

I'm running into an issue when generating the HTML report:
Writing results to outputs/benchmark_multi_task_lasso_benchopt_run_2021-12-22_15h42m48.html
Traceback (most recent call last):
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/bin/benchopt", line 33, in <module>
    sys.exit(load_entry_point('benchopt', 'console_scripts', 'benchopt')())
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/Users/pierre-antoine/Documents/benchopt/benchopt/cli/main.py", line 113, in run
    run_benchmark(
  File "/Users/pierre-antoine/Documents/benchopt/benchopt/runner.py", line 471, in run_benchmark
    plot_benchmark(save_file, benchmark, html=html)
  File "/Users/pierre-antoine/Documents/benchopt/benchopt/plotting/__init__.py", line 47, in plot_benchmark
    plot_benchmark_html(fname, benchmark, kinds, display)
  File "/Users/pierre-antoine/Documents/benchopt/benchopt/plotting/generate_html.py", line 435, in plot_benchmark_html
    rendered = render_benchmark(
  File "/Users/pierre-antoine/Documents/benchopt/benchopt/plotting/generate_html.py", line 310, in render_benchmark
    return Template(
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/mako/template.py", line 473, in render
    return runtime._render(self, self.callable_, args, data)
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/mako/runtime.py", line 878, in _render
    _render_context(
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/mako/runtime.py", line 920, in _render_context
    _exec_template(inherit, lclcontext, args=args, kwargs=kwargs)
  File "/Users/pierre-antoine/opt/miniconda3/envs/benchopt/lib/python3.8/site-packages/mako/runtime.py", line 947, in _exec_template
    callable_(context, *args, **kwargs)
  File "_Users_pierre_antoine_Documents_benchopt_benchopt_plotting_html_templates_benchmark_mako_html", line 43, in render_body
KeyError: 'sysinfo'

It seems to be related to the Mako package. I tried upgrading Mako to 1.1.6, downgrading it to versions 1.1.5 and 1.1.4.
I also tried creating a fresh environment with Python 3.8, but I still run into the same issue.
I have found no documented issue about a similar error on Mako.

Cleaning the outputs folder did the trick for me.

@qb3 encountered the problem a while ago, removing the outputs folder fixed the issue. It just worked for @PABannier  too.
Apparently the problem stemmed from upgrading benchopt

@PABannier should we close?

For the record, cleaning the outputs folder did the trick for me.
Closing because solved.


(Question) Should destination host for virtual service always be service??

Hi I'm trying to fix infinite loop on logout in kubeflow while using keycloak. (Which is already issued here https://github.com/kubeflow/kubeflow/issues/5704)
Here's what I'm trying to do.
I'm trying to make virtual serivce in kubeflow namespace.
When i press logout, it redirects to http://whateverdomain/logout and this causes infinite loop.
So I'm trying to make virtual service and change it to right redirect destination.
Here's my yaml file
apiVersion: networking.istio.io/v1alpha3
kind: VirtualService
metadata:
  name: oauth2-proxy-logout
  namespace: kubeflow
spec:
  gateways:
  - kubeflow/kubeflow-gateway
  hosts:
  - "*"
  http:
  - match:
    - uri:
        exact: /logout
    route:
    - destination:
        **host: http://localhost:8080/auth/realms/<my_realm>/protocol/openid-connect/logout** -> Is it possible??

I'm not sure host of destination should always be service.namespace.svc.cluster.local or not.

It needs to be Service or ServiceEntry host

@howardjohn Thx


Out of stock items

How do we want to show out of stock items?
Currently when you mark item as disabled due to out of stock, such items are not shown in the search. I think we should show that with out of stock label or something.
This will not confuse the buyer, otherwise he might not know why suddenly milk is not shown from 99store. or sometimes it is displayed sometimes not

We wanted this way so that buyer may ask seller . Seller may run out of balance also and we take them off the grid.
Right now we are showing facilities that don't have balance we need to stop that too. Or else buyer can order via new item.
Let's think. Showing out of stock is an option but maybe people done want to show it at all.


Denormalize takes extremely long on some datasets

Running
python ta2-search /nas/home/stan/dsbox/runs2/config-seed/32_wikiqa_config.json
doesn't get passed the denormalize step in 30 minutes.

solved on our own primitives after https://github.com/usc-isi-i2/dsbox-cleaning/commit/b3c725d16dfba1888c481353b366616dc133e767#diff-6181b424faea596dae3496597dd8b8b6


How to call WebUI API

I'd like to execute the Latent Couple Extension via the API for programmatic control.
I would appreciate any guidance on how to pass parameters, or any modifications needed to achieve this.

+1

We could also use an API integration.

It would be great to be able to pass masks through the API also

We could also use an API integration.

How do you integrate Latent Couple parameters using the API? Can I take a look?

It would be great to be able to pass masks through the API also

How do you integrate Latent Couple parameters using the API? Can I take a look?

+1

+1

Agreed on passing Mask images to the API, this would be absolutely crucial to some of my work.  In the meantime, a few things.

The current API on the officially linked extension installed by A1111 has the following args using always_on_scripts:

alwayson_scripts={
'latent couple extension': {
"args": [
{
"enabled ": False,
"divisions": "1:1,1:2,1:2",
"positions": "0:0,0:0,0:1",
"weights": "0.2,0.8,0.8",
"end_at_step": 20
}
]
}
}

There is a fork that appears to have implemented a mask input, but I don't see a color list input so I am confused at how the subprompts would be assigned to the mask if there is no way to order the mask regions by subprompt.  Unfortunately the repo fork doesn't have any documentation or issues enabled (@aria1th), so it can be difficult to understand what is in store for us there:

https://github.com/aria1th/stable-diffusion-webui-two-shot/commit/77f5fa80a8d5bb11f6b15fac47181daa70cb2e31

@marcsyp I enabled the issue (I'm not sure why it was disabled by default...)
The color is parsed from [0, 0, 0] to [255, 255, 255] in sorted order.
The behavior is described here : https://github.com/ashen-sensored/stable-diffusion-webui-two-shot/pull/4
    alwayson_scripts={
        'latent couple extension': {
            "args" : [ # enabled,
                'Mask',
                # raw_divisions, raw_positions, raw_weights, raw_end_at_step, alpha_blend, *cur_weight_sliders,
                '1:1,1:2,1:2','0:0,0:0,0:1', '0.2,0.8,0.8', 150, 0.2, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0
                , #sketch at last
                True, #denoise mask argument
                webuiapi.raw_b64_img(region_prompt_img) #base64 encoded image
            ]
        },
        },

For most cases, you would use black background so it will be first prompt, then maybe Blue, (0, 0, 255), then Green(0, 255, 0), Red (255, 0, 0).
But for safety and JPG types color degradation, there is mask denoising at default (and some image resizing for some optimization)

use this test:
`
{
"prompt": "A Man and A Woman AND A Man and A Woman (student),(1boy),(underage),(white skin),(short hair),(black hair/black eyes),(white school uniform) AND A Man and A Woman (student),(1girl),(underage),(white skin),(black straight hair),(flat chest),(school uniform),(fishnets),",
"negative_prompt": "",
"sampler_name": "Euler a",
"batch_size": 1,
"n_iter": 1,
"steps": 30,
"cfg_scale": 7,
"width": 512,
"height": 512,
"restore_faces": true,
"denoising_strength": 0,
"save_images": false,
"alwayson_scripts":{"Latent Couple extension":{"args":["True","1:1,1:2,1:2","0:0,0:0,0:1","0.2,0.8,0.8",30]}}
}
`
this ok


Additional Poloniex markets

Last supported market for Poloniex appears to be 239.  Need to add the new markets to the client's MARKET_IDS map.  Refer to https://docs.poloniex.com/#currency-pair-ids
240 | USDC_XRP
241 | USDC_XMR
242 | USDC_STR
243 | USDC_DOGE
244 | USDC_LTC
245 | USDC_ZEC
246 | BTC_FOAM
247 | USDC_FOAM
248 | BTC_NMR
249 | BTC_POLY
250 | BTC_LPT
251 | BTC_GRIN
252 | USDC_GRIN

Closed in eb24f82f9b82bf8d31160699b07035dbd235acba


Claim list TP enabled

Describe the bug
TITAN ONLY - you can TP to claims you make from /claimslist, this was suppose to be disabled. Seems to have been re-enabled on Titan server.
To Reproduce
Steps to reproduce the behavior:
Claim land
Run /claimslist
Select said claim
Click teleport
Pick a corner
See error

^ Titan server. It is disabled on Atlas and Orion

Should be fixed, thanks for the report! Closing


Update Roslyn package versions to match Microsoft.DotNet.ProjectModel

Addresses #190
cc @JunTaoLuo

The roslyn packages updates have already been checked in to dev.
Closing the PR.
Will migrate the other changes to another PR.


fix: add correct skipSSL property [gh-597]

I hereby confirm that I followed the code guidelines found at engineering guidelines
Affected Components

[x] CLI
[ ] Create CLI
[ ] Test
[ ] Docs
[x] Examples
[ ] Other

Notes for the Reviewer

add skipSSL request property for API Checks (the skipSsl has wrong case)
set skipSsl as to-be-deprecated
rename property in the example projects.
handle certificate issues in formatCheckResult().

Resolves #597

New Dependency Submission

@nahuelon did we have a regression in v0.4.8 or was this bug always there? It seems like this was always an issue, but Tim reported in Slack that earlier versions work fine.

@clample , I tested in v0.4.6 and v0.4.7 locally, the issue is present in those previous versions too.

Thanks for checking that out!


Remove deprecated --no-packages-dir flag from cli create

Fixes #729
Just removed a flag that was deprecated back in August 2018 that's used in the cli for creating new projects.

looks good to me. thanks. will merge once Appveyor flaky test passes


docs: fix simple typo, userame -> username

There is a small typo in docs/quickstart/index.rst.
Should read username rather than userame.
Semi-automated pull request generated by
https://github.com/timgates42/meticulous/blob/master/docs/NOTE.md

Coverage remained the same at 60.753% when pulling 7300ea1eb862859d8b2945f1b2e0f56fd7d48972 on timgates42:bugfix_typo_username into 1aa0e3dad6cf881bb48051fa498403941efcd61d on Netflix:master.

Coverage remained the same at 60.753% when pulling 7300ea1eb862859d8b2945f1b2e0f56fd7d48972 on timgates42:bugfix_typo_username into 1aa0e3dad6cf881bb48051fa498403941efcd61d on Netflix:master.

Hey @timgates42 thanks for the PR. merging shortly.

Hey @timgates42 thanks for the PR. merging shortly.


Grabber should only fetch website content if there are rules

Apparently the content grabber uses some built in default fetch logic if no rule is present. While this may seem like a DRY feature, some feeds are ridiculously broken and there is no other way around this   other than creating a rule file which is out of question for a standard user.
If no rule is present, no website content should be fetched at all, the standard RSS content should be used. Only if we have a rule for a website that works, we can reliably fetch its contents.

NACK!
At least from the miniflux point of view, the user has to enable the content grabber for each feed. If the content grabber doesn't work for a particular feed, it's up to the user to either disable the content grabber for this feed or add a rule file. Furthermore the user has the ability to get the full content of the article (s)he is currently viewing. This functionality can be used to check if the content of the website could be extracted successfully.
A lot of pages work fine with these "default" rules. Why should we remove working stuff and force the user to create a bunch of rule files with duplicate rules?
I guess you are using the content grabber in a different way. Can you describe how owncloud news uses the content grabber?

I see, makes sense if you can enable it on a per feed basis.
As for the News app: we try to create the best experience out of the box and try to avoid settings where possible because each setting increases the test and maintenance effort (this is especially true for settings which are exposed through an graphical interface). Also the grabber comes with a cost: it at least doubles the feed update time and traffic. We have to support installations with 1000+ users.
Most feeds are "good enough" and don't require any web scraping. What I want is the best of both worlds: feeds that give you enough content should be fast to update, whereas feeds that only give you a link or a small unreadable image should be scrapped from the website.
I think our usecase and approach here is quite different, therefore I'd vote for some sort of setting.

I think our usecase and approach here is quite different, therefore I'd vote for some sort of setting.

:+1:

Solved by #142


Create ogr.txt

A commit was made to recognize that the @ogr.iu.edu.tr extension belongs to Istanbul University.
https://ogr.iu.edu.tr

comfirmed


Make ApplyWorkflow.working_dir non optional

closes #1050
Checklist before merging

[ ] I added an appropriate entry to CHANGELOG.md
[ ] I merged main into the current branch.

Closing, see https://github.com/fractal-analytics-platform/fractal-server/issues/1050#issuecomment-1898507674.


ROM: ordering of PCRs and Data Vault Writes

On Cold Reset, Data Vault is written first then PCR logging is done from data vault.
On Update Reset, PCR logging is done first. Is this a bug? https://github.com/chipsalliance/caliptra-sw/blob/main/rom/dev/src/flow/update_reset.rs#L83

Not a bug in practice because the data vault updates on update reset are only related to RT and thus aren't logged to PCRs by ROM. So this is just a code clean up request, up to @mhatrevi on doing or closing as will not fix


Catch up with changes to env_logger in rust-lang-nursery/log

There were a few small changes to env_logger in rust-lang-nursery/log:

rust-lang-nursery/log#196
rust-lang-nursery/log#200

Without these changes, this crate does not compile.

@mjkillough thanks so much!
Could you please rebase against master again so we can merge it?
Regards,

@sebasmagri - Done! I haven't rebased #16, but that should merge cleanly.


YouTube annotations and subtitles handled separately

I would like YouTube annotations and closed captions/subtitles to be separate.

Use --write-annotations and --write-sub correspondingly.


parseq and vitstr_base model on PyTorch: getting "Invalid model URL, using default initialization error" on 0.7.0

Bug description
I'm using the latest public release and trying to load vitstr_base or parseq models on PyTorch.
While release notes clearly states Two new recognition models was added (ViTSTR and PARSeq) in both frameworks by @felixdittrich92 @nikokks seems that those will be added in 0.7.1. Any plans to release those, or should I use pip install from GitHub for now?
Code snippet to reproduce the bug
self.model = ocr_predictor(
            det_arch='db_resnet50',
            reco_arch='parseq',
            pretrained=True
        )

### Error traceback

Invalid model URL, using default initialization.

### Environment

python-doctr==0.7.0

### Deep Learning backend

Collecting environment information...
DocTR version: v0.7.0
TensorFlow version: N/A
PyTorch version: 2.1.1+cu121 (torchvision 0.16.1+cu121)
OpenCV version: 4.8.1
OS: Ubuntu 23.10
Python version: 3.9.18
Is CUDA available (TensorFlow): N/A
Is CUDA available (PyTorch): Yes
CUDA runtime version: Could not collect
GPU models and configuration: GPU 0: Tesla T4
Nvidia driver version: 525.147.05
cuDNN version: Could not collect

@felixdittrich92 no updates on 0.8.0 release yet?

Hey @dchaplinsky :wave:
Still waiting that some runs finish :)
If https://github.com/mindee/doctr/issues/1364 is finished we will do the release


How to add templates (.html) files in build

Repro steps.
ng new FooProject
ng g c  FooComponent -m app.module.ts
ng build
The log given by the failure.

Desired functionality.
I want to include templates files in the build folder

Why? Your templates become javascript, not html.

I use templatUrl In my components, in build step the main.bundle.js references to the html templates. The templates no become JavaScript
[Sorry if my english is bad]

No worries, your english is good.
I modified your example to be
foo-component.component.html
<p *ngIf="true">
  foo-component works!
</p>

Then after ng build search foo-component works in dist folder. Result found in main.bundle.js:
/***/ (function(module, exports) {

module.exports = "<p *ngIf=\"true\">\n  foo-component works!\n</p>\n"

/***/ }),

In other words your templates are included in the dist.

Are you using webpack?. My main.bundle.js is different.

My file looks similar. But search inside it for "foo-component works".
This __webpack_require__ does not request files from file-system, but it takes module from webpack modules registry.
This means that webpack already took you template and registered in under the name ./src/app/foo-component/foo-component.component.html

Note also that in production mode (which uses AOT by default) the templates will be compiled into actual JavaScript (instead of simply embedded) which greatly accelerates runtime performance.

I get it. Just i needed search a little bit more.

Thanks for your support !!


How to get the RMS Server address (such as:https://adrms.mobile.cn) when encrypting the files?

How to get the RMS Server address (such as:https://adrms.mobile.cn) when encrypting the files?
In ConsentList Consents(ConsentList& consents), we can use IConsent  to the RMS server address when decrypting the files.
In Windows, set dwPropID to IPC_LI_CONNECTION_INFO when calling
IpcGetSerializedLicenseProperty(https://msdn.microsoft.com/en-us/library/windows/desktop/hh995038(v=vs.85).aspx), to get the RMS server address.
Can you provide similar interfaces(IPC_LI_CONNECTION_INFO) in UserPolicy to get these information?

Please open this issue. You don't provide any suggestion for this

@Kammy6679 - Please re-open the issue (or) open a new issue. This is the only we can track effectively.

@Kammy6679 - Please go through the documentation @ https://technet.microsoft.com/en-us/library/dn673574(v=ws.11).aspx#BKMK_SRV  on how to create a DNS record - that should be sufficient to address the scenario at hand (for encryption and decryption).

@prvijay ,  We do not understand @ https://technet.microsoft.com/en-us/library/dn673574(v=ws.11).aspx#BKMK_SRV
Can you please provide a sample for how to get the Azure RMS server address and the ADFD RMS server address?

@prvijay, any update?


core: DOM changes cause page jumping

this is probably upstream, build reproducible case and post in react repository

You did remove merge/split, did you? Before that, I thought that merge/split is causing this issues because I merge multiple div's into one (and therefore replace old DOM nodes with a single new one) and I'm pretty sure that React can't understand this w/o providing the same key to those nodes.

ah, so keeping the same id's could solve this?

Yeah, maybe. We would also need to pass down the id as key

/close due to inactivity


memory leak related to task using join node

We are observing a consistent memory leak in Kapacitor.   We were running several different types of Tasks, but we isolated the problem down to a single task that uses a Join node.   Kapacitor's memory usage continues to grow until the OOM killer targets it and restarts the process (in our case, this restarts the docker container).  This pattern repeats itself continuously.   The following is a snapshot of the memory usage displayed in Grafana:

The following are two pprof snapshots showing the top 10 memory uses over a ~20 minute period.  During this period the number of data series is constant (there is no change in the number of measurements, tags or tag values).
legacy@XXX:~/$ go tool pprof http://localhost:9992/kapacitor/v1/debug/pprof/heap
Fetching profile over HTTP from http://localhost:9992/kapacitor/v1/debug/pprof/heap
Saved profile in /Users/legacy/pprof/pprof.kapacitord.alloc_objects.alloc_space.inuse_objects.inuse_space.032.pb.gz
File: kapacitord
Type: inuse_space
Time: May 22, 2020 at 8:18am (EDT)
Entering interactive mode (type "help" for commands, "o" for options)
(pprof) top
Showing nodes accounting for 36.55MB, 86.81% of 42.10MB total
Showing top 10 nodes out of 126
      flat  flat%   sum%        cum   cum%
    8.50MB 20.20% 20.20%     8.50MB 20.20%  github.com/influxdata/kapacitor/vendor/github.com/influxdata/influxdb/models.Tags.Map
    7.50MB 17.82% 38.01%     7.50MB 17.82%  github.com/influxdata/kapacitor.newJoinset
    6.50MB 15.44% 53.46%     6.50MB 15.44%  github.com/influxdata/kapacitor/vendor/github.com/influxdata/influxdb/models.(*point).unmarshalBinary
    4.50MB 10.69% 64.15%     4.50MB 10.69%  strings.(*Builder).WriteString
    2.50MB  5.94% 70.09%     2.50MB  5.94%  github.com/influxdata/kapacitor/edge.(*pointMessage).ShallowCopy
    2.01MB  4.78% 74.87%     9.51MB 22.60%  github.com/influxdata/kapacitor.(*joinGroup).Collect
    1.52MB  3.62% 78.49%     1.52MB  3.62%  github.com/influxdata/kapacitor/edge.NewChannelEdge
    1.50MB  3.56% 82.05%     2.50MB  5.94%  github.com/influxdata/kapacitor/edge.NewBeginBatchMessage
       1MB  2.39% 84.44%        1MB  2.39%  github.com/influxdata/kapacitor/tick/stateful.NewFunctions
       1MB  2.38% 86.81%        1MB  2.38%  github.com/influxdata/kapacitor/vendor/github.com/influxdata/influxdb/models.(*point).Name
(pprof) exit

legacy@XXX:~/$ go tool pprof http://localhost:9992/kapacitor/v1/debug/pprof/heap
Fetching profile over HTTP from http://localhost:9992/kapacitor/v1/debug/pprof/heap
Saved profile in /Users/legacy/pprof/pprof.kapacitord.alloc_objects.alloc_space.inuse_objects.inuse_space.033.pb.gz
File: kapacitord
Type: inuse_space
Time: May 22, 2020 at 8:39am (EDT)
Entering interactive mode (type "help" for commands, "o" for options)
(pprof) top
Showing nodes accounting for 60.55MB, 88.24% of 68.62MB total
Showing top 10 nodes out of 140
      flat  flat%   sum%        cum   cum%
   16.50MB 24.05% 24.05%    16.50MB 24.05%  github.com/influxdata/kapacitor/vendor/github.com/influxdata/influxdb/models.Tags.Map
      12MB 17.49% 41.54%       12MB 17.49%  github.com/influxdata/kapacitor/vendor/github.com/influxdata/influxdb/models.(*point).unmarshalBinary
      12MB 17.49% 59.03%       12MB 17.49%  github.com/influxdata/kapacitor.newJoinset
    8.50MB 12.39% 71.42%     8.50MB 12.39%  strings.(*Builder).WriteString
       4MB  5.83% 77.25%        4MB  5.83%  github.com/influxdata/kapacitor/edge.(*pointMessage).ShallowCopy
    2.50MB  3.64% 80.89%        5MB  7.29%  github.com/influxdata/kapacitor/edge.NewBeginBatchMessage
    1.52MB  2.22% 83.12%     1.52MB  2.22%  github.com/influxdata/kapacitor/edge.NewChannelEdge
    1.50MB  2.19% 85.30%     1.50MB  2.19%  github.com/influxdata/kapacitor/vendor/github.com/influxdata/influxdb/models.(*point).Name
    1.01MB  1.48% 86.78%    13.02MB 18.97%  github.com/influxdata/kapacitor.(*joinGroup).Collect
       1MB  1.46% 88.24%        1MB  1.46%  github.com/influxdata/kapacitor/tick/stateful.NewFunctions
(pprof)

This is the template that the tasks are based on that are causing the issue:
var database = 'XXX'
var target_measurement string
var actual_measurement string
var result_measurement string
var window_size = 15s

var target = stream
    |from()
        .measurement(target_measurement)
        .groupBy('*')

var actual = stream
    |from()
        .measurement(actual_measurement)
        .groupBy('*')

var data = actual
    |join(target)
        .as('actual', 'target')
        .tolerance(window_size)
	.fill('null')
    |default()
        .field('actual.value', 999.99)
	.field('target.value', 999.99)
    |where(lambda: "actual.value" != 999.99 AND "target.value" != 999.99)

data
    |eval(lambda: "target.value" - "actual.value")
        .as('value')
    |influxDBOut()
        .measurement(result_measurement)
        .database(database)
        .create()

This is the DOT graph portion of the "show" operation:
DOT:
digraph MyTask {
graph [throughput="0.00 points/s"];

stream0 [avg_exec_time_ns="0s" errors="0" working_cardinality="0" ];
stream0 -> from2 [processed="23380"];
stream0 -> from1 [processed="23380"];

from2 [avg_exec_time_ns="0s" errors="0" working_cardinality="0" ];
from2 -> join4 [processed="18240"];

from1 [avg_exec_time_ns="0s" errors="0" working_cardinality="0" ];
from1 -> join4 [processed="5140"];

join4 [avg_exec_time_ns="0s" errors="0" working_cardinality="59" ];
join4 -> default5 [processed="3198"];

default5 [avg_exec_time_ns="0s" errors="0" fields_defaulted="1356" tags_defaulted="0" working_cardinality="0" ];
default5 -> where6 [processed="3198"];

where6 [avg_exec_time_ns="0s" errors="0" working_cardinality="8" ];
where6 -> log7 [processed="1842"];

log7 [avg_exec_time_ns="0s" errors="0" working_cardinality="0" ];
log7 -> eval8 [processed="1842"];

eval8 [avg_exec_time_ns="0s" errors="0" working_cardinality="8" ];
eval8 -> influxdb_out9 [processed="1842"];

influxdb_out9 [avg_exec_time_ns="0s" errors="0" points_written="1842" working_cardinality="0" write_errors="0" ];

version: 1.5.4
Docker for Mac: <IP_ADDRESS>-mac81 (but also happens on CentOS 7.7 with Docker 18.09.8)

After looking at the code and examining our data streams more carefully I believe I have identified the cause and reproduced this on a pre-built image.   The JoinNode assumes that data arriving from each parent will always contain the same set of groups and any mismatched groups (groups that appear in one stream but not the other) will result in a memory leak.
Consider the sample task that I posted in the issue description.  Let's say that the data is arriving with the following tags and values:
"actual" stream:
mytag=abc, value=1
mytag=def, value=1
mytag=ghi, value=1

"target" stream:
mytag=def, value=1
mytag=ghi, value=1
mytag=jkl, value=1

The JoinNode will successfully join together the data points with mytag values of "def", and "ghi", but those with "abc" and "jkl" will consume memory and never be released.
I don't see any way of working around this given the current implementation.  I considered using a Barrier node, but those would only work for groups that existed at some point and then stopped.  Since it is not possible to send a Barrier message for a group(s) that does not exist.
Can someone comment on this behaviour?    How can a JoinNode be used if you have no control over the quality of the data arriving on any of the configured parent nodes?

Can someone comment on this behaviour? How can a JoinNode be used if you have no control over the quality of the data arriving on any of the configured parent nodes?

Have you tried using joinNode's On property method? https://docs.influxdata.com/kapacitor/v1.5/nodes/join_node/#on
As your task is grouping by all tags, you end up with a lot of series to be processed in the pipeline. If you don't define any tag(s) to join the streams on, I'm assuming you end up with a cross join which generates a huge amount of series.
Also, is .fill(null) necessary? https://docs.influxdata.com/kapacitor/v1.5/nodes/join_node/#fill

Thanks for your response.  I have tried GroupBy() with a static set of dimensions and the wildcard.  This does not change the behavior.
No, in this case the Fill() is not necessary.  I went thru many iterations because I thought that I wasn’t using the Join node properly.  I posted this version because it was the last one that I was using at the time I collected the pprof data.

Bumped into the same issue here. Join is leaking.

it seems like Kapacitor project is DEAD?


Enhanced Troubleshooting in Jupyter: Detailed messages why kernel restarts happened and continous information on memory/cpu usage.

When Jupyter is used in hosted cloud environments, in a lot of cases, CPU and Memory have certain limits. In these situation it essential that users understand certain characteristics when running their code.
One example is that right now, when the Jupyter Kernel gets an Out of Memory, the kernel is killed by Linux and Jupyter just shows a message that the kernel died with no indication of the root cause.
So better information would help to let the user understand what happened so that she can adjust her container settings. (For example increase memory)
On the other side, when the user uses to much memory, it would also be interesting to see how much percent of available memory is used. So when the user sees that only 20% from a 64GB environment is used, they can go down and save costs.
Perfect would be if after a notebook run, the peak usage could be measured.
Note: In most cases these system use container based approaches like Kubernetes. So it is essential that relative usage is computed with the container memory, not the node memory on which the container is running on.

Note: In most cases these system use container based approaches like Kubernetes. So it is essential that relative usage is computed with the container memory, not the node memory on which the container is running on.

We should also consider the case where the kernel is actually running in a remote/separate location, which then we should consider the remote system resources where the kernel is running, instead of the resources from where Jupyter is running.


Cleanup Update toc.yml

@j-martens : Thanks for your contribution! The author, @, has been notified to review your proposed change.


[Question] How to use the inject statics and methods

Following the docs: https://hasezoey.github.io/typegoose/docs/functions/addModelToTypegoose/
Jetbrains throws errors:

I am trying to use the build schema to then inject the methods and statics.
  "dependencies": {
    "@hasezoey/typegoose": "^6.0.0-28",

not an issue with typegoose, mongoose.model expect you to give a name first, and then the schema


Avoids redundant runs of tests during release upload

Testing this first with Brave as this is the next thing to cut. If the shell script works as expected, I'll weave it into the zipkin repo which is currently unreleasable because of timeouts  related to the redundant runs of integration tests on the version tag. cc @openzipkin/devops-tooling

lol the irony of a flakey run during this PR

oops forgot that the non-test thing already happens in travis.yml!
# Override default travis to use the maven wrapper; skip license on travis due to #1512
install: ./mvnw install -DskipTests=true -Dlicense.skip=true -Dmaven.javadoc.skip=true -B -V
script: ./travis/publish.sh

adjusted in 75855826 checking travis to make sure it is really correct now

verified.. verify ran

verified the upload/deploy job does not run verify https://travis-ci.org/openzipkin/brave/builds/554513173


Mechanism for differentiating server errors is needed

A bit of backstory to better explain what I mean by the title: I'm working on HTTP tests for source/:id route and one of the tests there is to check that the app returns an error on attempt to request a source of a non-existing brew.
Due to implementation details of the server, all IDs with length more than 12 are considered to be stored in Google Drive. So, even though the test is passing, console output contains the following:
console.log
      Error loading from Google

      at server/googleActions.js:264:12

    console.error
      GaxiosError: Daily Limit for Unauthenticated Use Exceeded. Continued use requires signup.

TENS OF LINES HERE WITH RESPONSE OBJECT DUMP

Apparently, we shouldn't be actually sending requests to external server in our tests, so I've implemented a mock googleActions module, which for now simply does nothing and returns null from each and every function there and the output from tests has changed (the test still passes):
  console.error
      Can not find brew

console.error
      TypeError: Cannot convert undefined or null to object
          at sanitizeBrew naturalcrit\homebrewery\server\app.js:41:2)
          at _callee$ naturalcrit\homebrewery\server\app.js:30:9)
          at tryCatch naturalcrit\homebrewery\node_modules\@babel\runtime\node_modules\regenerator-runtime\runtime.js:45:40)
          at Generator.invoke [as _invoke] naturalcrit\homebrewery\node_modules\@babel\runtime\node_modules\regenerator-runtime\runtime.js:274:22)
          at Generator.prototype.<computed> [as next] naturalcrit\homebrewery\node_modules\@babel\runtime\node_modules\regenerator-runtime\runtime.js:97:21)
          at asyncGeneratorStep naturalcrit\homebrewery\node_modules\@babel\runtime\helpers\asyncToGenerator.js:3:24)
          at _next naturalcrit\homebrewery\node_modules\@babel\runtime\helpers\asyncToGenerator.js:25:9)

Apparently, those messages are being printed by the generic error handler middleware we have:
https://github.com/naturalcrit/homebrewery/blob/179d5e63124b388ed9eaa67d9c4b4e405134412b/server/app.js#L289-L293
While this is certainly useful for some errors like error messages from Google Drive API to be able to quickly debug what went wrong on the server, it doesn't make sense to print an error message about each and every missing brew, because that is basically a user error.
I'm not 100% sure that it will always be clear which category an error belongs to, but at high-level, I think that there should be at least two categories:

An expected exception, when something goes wrong due to incorrect user inputs. For example, user mistyped share id or the corresponding brew was deleted - in that case we shouldn't print anything to logs (at least by default, we can implement different levels of logging), but should report an error in a user-friendly way
An unexpected exception, when something fundamental goes wrong like we wasn't able to connect to a database or we wasn't able to reach Google API, because our token has expired, etc. Additionally, this category will additionally be populated by improperly handled exceptions from the previous category. An example of such exception is that sanitizeBrew doesn't expect the first argument to be null - it could be a bad example, because my googleActions mock most likely doesn't follow the expected contract of communicating "no brew was found" error, but we still shouldn't report that in a way we report that now, see #1983

The motivation for reducing amount of logs printed on server side is the following:

In production environment, this will reduce the server load, because it won't have to print useless information
In test environment, this will reduce amount of "garbage" output intermixing with test results, producing cleaner reports

A local environment might suffer from this, because during development it could be useful to have more information printed by the app, but this can be fixed as well by implementing different logging levels for different environments. Note: I don't want to simply hide all errors in test environment, I would prefer to avoid them from appearing by properly handling them.

A bit of an update on this, i believe most errors mentioned are using our errorpage component now, at least 404 errors in source both chrome and hb's.
We still should catch better some errors, like version mismatch errors (that we don't know the cause of) and tell the user the brew has been saved in another device, even if there is no other device.

We do now have a method of differentiating server errors, via the "HBErrorCode" property in custom errors. This gives us more granularity between different status 500 errors for example, and which we already use for both page request errors (displays an error page), and API errors (displays a popup message on the client).
So this feature is in place, and already used. There can always be further breakdown of more specific errors if we want, and we can adjust what is logged for each error, but I think those can be their own issues as we become aware of new error cases to be added, or old error cases to be tweaked. I think this can be closed.
The version mismatch error then, can be examined further in its own issue.


APIChain loading fails

System Info
langchain==0.0.176
Who can help?
@hwchase17
Information

[X] The official example notebooks/scripts
[ ] My own modified scripts

Related Components

[ ] LLMs/Chat Models
[ ] Embedding Models
[ ] Prompts / Prompt Templates / Prompt Selectors
[ ] Output Parsers
[ ] Document Loaders
[ ] Vector Stores / Retrievers
[ ] Memory
[ ] Agents / Agent Executors
[ ] Tools / Toolkits
[X] Chains
[ ] Callbacks/Tracing
[ ] Async

Reproduction
Running the following code to load a saved APIChain fails.
from langchain.chains.api.prompt import API_RESPONSE_PROMPT
from langchain.chains import APIChain
from langchain.prompts.prompt import PromptTemplate
from langchain.llms import OpenAI

llm = OpenAI(temperature=0)

from langchain.chains.api import open_meteo_docs
chain_new = APIChain.from_llm_and_api_docs(llm, open_meteo_docs.OPEN_METEO_DOCS, verbose=True)

chain_new.save("/Users/liang.zhang/api.yaml")
chain = load_chain("/Users/liang.zhang/api.yaml")

Error:
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Input In [29], in <cell line: 1>()
----> 1 chain = load_chain("/Users/liang.zhang/api.yaml")

File ~/miniforge3/envs/mlflow-3.8/lib/python3.8/site-packages/langchain/chains/loading.py:449, in load_chain(path, **kwargs)
    447     return hub_result
    448 else:
--> 449     return _load_chain_from_file(path, **kwargs)

File ~/miniforge3/envs/mlflow-3.8/lib/python3.8/site-packages/langchain/chains/loading.py:476, in _load_chain_from_file(file, **kwargs)
    473     config["memory"] = kwargs.pop("memory")
    475 # Load the chain from the config now.
--> 476 return load_chain_from_config(config, **kwargs)

File ~/miniforge3/envs/mlflow-3.8/lib/python3.8/site-packages/langchain/chains/loading.py:439, in load_chain_from_config(config, **kwargs)
    436     raise ValueError(f"Loading {config_type} chain not supported")
    438 chain_loader = type_to_loader_dict[config_type]
--> 439 return chain_loader(config, **kwargs)

File ~/miniforge3/envs/mlflow-3.8/lib/python3.8/site-packages/langchain/chains/loading.py:383, in _load_api_chain(config, **kwargs)
    381     requests_wrapper = kwargs.pop("requests_wrapper")
    382 else:
--> 383     raise ValueError("`requests_wrapper` must be present.")
    384 return APIChain(
    385     api_request_chain=api_request_chain,
    386     api_answer_chain=api_answer_chain,
    387     requests_wrapper=requests_wrapper,
    388     **config,
    389 )

ValueError: `requests_wrapper` must be present.

Expected behavior
No error should occur.

@dev2049 Could you take a look at this failure (similar to #4977)? Thanks!

@liangz1 this is actually intentional - we purposefully do NOT serialize the RequestsWrapper, and instead it should be provided at run time

chain = load_chain("api.yaml", requests_wrapper = chain_new.requests_wrapper)

this is because we havent gotten around to adding proper serialization for requests objects. that is on our roadmap, but not sure high up to be honest

@hwchase17 Thanks for clarifying. Is there any documentation on this behavior? Also, it would be helpful if users can get more guidance in the error message and get an idea about how to resolve this error.