HADOOP-19189. ITestS3ACommitterFactory failing

parameterize the test run rather than do it from within the test suite.
log what the committer factory is up to (and improve its logging)
close all filesystems, then create the test filesystem with cache enabled.

The cache is critical, we want the fs from cache to be used when querying filesystem properties, rather than one created from the committer jobconf, which will have the same options as the task committer, so not actually validate the override logic.
The tests were therefore failing correctly, because the test environment wasn't being set up.
I have no idea why this worked before.
How was this patch tested?
Reworked ITestS3ACommitterFactory tested against s3 london.
rerunning full -Dscale test to make sure that none of the changes i made to the production code have problems
For code changes:

[X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[X] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 46s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
49m 40s

trunk passed

+1 :green_heart:
compile
0m 43s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
compile
0m 36s

trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
checkstyle
0m 32s

trunk passed

+1 :green_heart:
mvnsite
0m 42s

trunk passed

+1 :green_heart:
javadoc
0m 28s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
0m 34s

trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
spotbugs
1m  9s

trunk passed

+1 :green_heart:
shadedclient
38m 47s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 29s

the patch passed

+1 :green_heart:
compile
0m 35s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javac
0m 35s

the patch passed

+1 :green_heart:
compile
0m 28s

the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
javac
0m 28s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
0m 20s
/results-checkstyle-hadoop-tools_hadoop-aws.txt
hadoop-tools/hadoop-aws: The patch generated 2 new + 0 unchanged - 1 fixed = 2 total (was 1)

+1 :green_heart:
mvnsite
0m 31s

the patch passed

+1 :green_heart:
javadoc
0m 15s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
0m 25s

the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
spotbugs
1m  7s

the patch passed

+1 :green_heart:
shadedclient
39m  2s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 42s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 37s

The patch does not generate ASF License warnings.

145m 23s

Subsystem
Report/Notes

Docker
ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6857

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux c22c6958de01 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 0def4b55f8897a482885dcf6e170e9f4d308613a

Default Java
Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/1/testReport/

Max. process+thread count
586 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 55s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
50m 24s

trunk passed

+1 :green_heart:
compile
0m 43s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
compile
0m 35s

trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
checkstyle
0m 32s

trunk passed

+1 :green_heart:
mvnsite
0m 41s

trunk passed

+1 :green_heart:
javadoc
0m 28s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
0m 34s

trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
spotbugs
1m  8s

trunk passed

+1 :green_heart:
shadedclient
39m 19s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 30s

the patch passed

+1 :green_heart:
compile
0m 36s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javac
0m 36s

the patch passed

+1 :green_heart:
compile
0m 26s

the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
javac
0m 26s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 21s

hadoop-tools/hadoop-aws: The patch generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
mvnsite
0m 32s

the patch passed

+1 :green_heart:
javadoc
0m 16s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
0m 25s

the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
spotbugs
1m  8s

the patch passed

+1 :green_heart:
shadedclient
39m  2s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 42s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 37s

The patch does not generate ASF License warnings.

146m 53s

Subsystem
Report/Notes

Docker
ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6857

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 18cf2cd46cc1 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 165b8d2c1d3f3f7b9a9e6f39f041f0aaa288eaa4

Default Java
Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/2/testReport/

Max. process+thread count
526 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Seeking feedback from @mukund-thakur @ahmarsuhail @HarshitGupta11 @virajjasani
Fixes test failures, nothing else...

updated version; tested s3 london

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
17m 30s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
50m  6s

trunk passed

+1 :green_heart:
compile
0m 45s

trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
compile
0m 35s

trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
checkstyle
0m 32s

trunk passed

+1 :green_heart:
mvnsite
0m 42s

trunk passed

+1 :green_heart:
javadoc
0m 27s

trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
javadoc
0m 33s

trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
spotbugs
1m  9s

trunk passed

+1 :green_heart:
shadedclient
39m 17s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 30s

the patch passed

+1 :green_heart:
compile
0m 36s

the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
javac
0m 36s

the patch passed

+1 :green_heart:
compile
0m 26s

the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
javac
0m 26s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 21s

hadoop-tools/hadoop-aws: The patch generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
mvnsite
0m 31s

the patch passed

+1 :green_heart:
javadoc
0m 16s

the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
javadoc
0m 25s

the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
spotbugs
1m  8s

the patch passed

+1 :green_heart:
shadedclient
39m 20s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 44s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 37s

The patch does not generate ASF License warnings.

159m 41s

Subsystem
Report/Notes

Docker
ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6857

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux aff4408221f5 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 3b7e5ca1a734ed2c0d444b40f93559da10d8c6b3

Default Java
Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/3/testReport/

Max. process+thread count
527 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 46s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
49m 46s

trunk passed

+1 :green_heart:
compile
0m 44s

trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
compile
0m 35s

trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
checkstyle
0m 32s

trunk passed

+1 :green_heart:
mvnsite
0m 42s

trunk passed

+1 :green_heart:
javadoc
0m 28s

trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
javadoc
0m 34s

trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
spotbugs
1m  9s

trunk passed

+1 :green_heart:
shadedclient
39m 46s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 31s

the patch passed

+1 :green_heart:
compile
0m 37s

the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
javac
0m 37s

the patch passed

+1 :green_heart:
compile
0m 28s

the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
javac
0m 28s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 20s

hadoop-tools/hadoop-aws: The patch generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)

+1 :green_heart:
mvnsite
0m 32s

the patch passed

+1 :green_heart:
javadoc
0m 16s

the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2

+1 :green_heart:
javadoc
0m 25s

the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

+1 :green_heart:
spotbugs
1m  7s

the patch passed

+1 :green_heart:
shadedclient
39m 53s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
2m 45s

hadoop-aws in the patch passed.

+1 :green_heart:
asflicense
0m 37s

The patch does not generate ASF License warnings.

143m 47s

Subsystem
Report/Notes

Docker
ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6857

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 8678eb45fb8e 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 49d52abbecc3470a77e292680043c79250a03b61

Default Java
Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/4/testReport/

Max. process+thread count
533 (vs. ulimit of 5500)

modules
C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6857/4/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


Firefox problem

Firefox 8.0.1 on OS/X 10.10.2
When the width is reduced and the menu switches the the collapsed view, the "hamburger" is overlaid with the letters "Me".
I don't see this on any other browser that I have tried.

Does it help if you increase the padding-left of the .nav-button?
https://github.com/codezero-be/responsive-nav/blob/master/assets/sass/_layout-base.scss#L38
This should push the text "Menu" out of sight (overflow hidden).
I only have an older OSX virtual machine to test it, but I didn't get the issue there.

Ok, I noticed too late that you are using an old version of FF (current version is 37).
I installed that one and now I see it too.
It seems the trick with padding-left and overflow: hidden doesn't work here...
https://github.com/codezero-be/responsive-nav/blob/master/assets/sass/_layout-base.scss#L33-L57
If I delete this line from .nav-button:
padding-left: 2.4rem; // Hide "Menu" text

and these lines from the :before:
position: absolute;
top: 0;
left: 0;
right: 0;
bottom: 0;

... it seems to work everywhere, also on FF 8.
I'll make the changes and push it. :)

Guess what? As soon as I entered that problem, the symptom went away, and I can’t re-create it!
If I hadn’t taken a screen shot, I would think I imagined it.
Forget it for now. If it re-occurs I will let you now, and try incra=easing the padding.
Philip

On Apr 17, 2015, at 09:47, Ivan Vermeyen<EMAIL_ADDRESS>wrote:
Does it help if you increase the padding-left of the .nav-button?
https://github.com/codezero-be/responsive-nav/blob/master/assets/sass/_layout-base.scss#L38 https://github.com/codezero-be/responsive-nav/blob/master/assets/sass/_layout-base.scss#L38
This should push the text "Menu" out of sight (overflow hidden).
I only have an older OSX virtual machine to test it, but I didn't get the issue there.
—
Reply to this email directly or view it on GitHub https://github.com/codezero-be/responsive-nav/issues/1#issuecomment-94025081.

Hehe, you were'nt imagining it, I was able to reproduce it. ;)
I pushed the fix, so it should be ok now :)
Thanks for the feedback!


use BackendObjectReference to represent the ext auth service

Related: https://github.com/envoyproxy/gateway/issues/2551
This PR does the following:

Use BackendObjectReference to represent the ext auth service
Remove TLS configuration from ext auth API, EG can leverage Gateway API BackendPolicy to specify the TLS configuration for ext auth services

/retest

/retest

@zhaohuabing thoughts on  moving all fields ( even the common ones)  under either 'grpc'  or http  ?
That keeps the API consistent with other types like RateLimit

@zhaohuabing thoughts on moving all fields ( even the common ones) under either 'grpc' or http ? That keeps the API consistent with other types like RateLimit

I like this idea, but also a bit hesitate because there're a number of "common options" that could be added in the future. This could cause too many duplications.
{
  "grpc_service": {...},
  "http_service": {...},
  "transport_api_version": ...,
  "failure_mode_allow": ...,
  "failure_mode_allow_header_add": ...,
  "with_request_body": {...},
  "clear_route_cache": ...,
  "status_on_error": {...},
  "metadata_context_namespaces": [],
  "typed_metadata_context_namespaces": [],
  "route_metadata_context_namespaces": [],
  "route_typed_metadata_context_namespaces": [],
  "filter_enabled": {...},
  "filter_enabled_metadata": {...},
  "deny_at_disable": {...},
  "include_peer_certificate": ...,
  "stat_prefix": ...,
  "bootstrap_metadata_labels_key": ...,
  "allowed_headers": {...},
  "include_tls_session": ...,
  "charge_cluster_response_stats": {...}
}

Option 1
extAuth:

  type: GRPC # all GRPC knobs
  grpc:
    backendRef:
     ....
    headersToExtAuth

vs
Option 2
extAuth:
  headersToExtAuth:
  grpc: #grpc specific only
    backendRef:
     ........

lets go with 2, it maybe easier for the user to swap between http and grpc ext auth service with option 2


fix(model-server): handle empty MODELIX_SERVER_MODELQL_WARMUP_BRANCH

Don't fail the health check in case the user did not define the new env var MODELIX_SERVER_MODELQL_WARMUP_BRANCH. Before this fix, the health checked returned 500 due to a NullPointerException.

This needs clarifications whether the whole logic should only run when both variables are defined by the user or if we want to implicitly assume master if the branch is not specified in the environment.

I guess, that (!repositoriesManager.inMemoryModels.loadModelAsync(version!!.getTree())) throws a NPE when the repository or branch does not exist.
If the repository does not exist we could either fail to startup or create it and start tracking it.

However we specify the behavior to be, let us please add tests.

Here's the issue for the underlying problem when a repo does not yet exist: https://issues.modelix.org/issue/MODELIX-775/model-server-cannot-be-launched-if-warmup-is-requested-for-a-to-be-created-repository

I guess, that (!repositoriesManager.inMemoryModels.loadModelAsync(version!!.getTree())) throws a NPE when the repository or branch does not exist. If the repository does not exist we could either fail to startup or create it and start tracking it.

Failing startup is not an ideal option as that implies users have to change model-server configurations for bootstrapping a new repo, which is cumbersome.


troubleshooting disconnection

Hi,
I have been using pgweb for a year+ now and somehow I have an issue for the past few month i am not able to fix.
Basically when I run
pgweb --host=195.XXX.XX.XX --port=XXX --user=someuser  --pass=somepass --db=somedb  --auth-user=someauthuser --auth-pass=someauthcode --no-idle-timeout --listen=8086

it disconnects automatically after some time (I am unable to pin point any specific duration but between a few hours to 2~3 days).
I have had the problem since march this year when I moved it to docker. Before it was running as a standalone command line with nohup and it was working like a clock with no disconnections unless the server rebooted.
I took it off docker last week, because I was tired of restarting the container, and I have the same issue now outside of docker...
Was there a new feature introduced at some point to auto disconnect from the DB? Has anyone face a similar issue? How could I get this to stop disconnect from the db?
Thanks!

Which version are you using?
There's a idle connection cleanup helper in place https://github.com/sosedoff/pgweb/blob/360d7d87c5758cf071e5da68cff27d141fbb69af/pkg/api/session_cleanup.go#L25 but it should not get triggered if you set the no-idle-timeout flag or set timeout to 0.
Could you provide more debug information, like an error message when it disconnects?

I am using the latest version
Pgweb v0.11.8 (git: 4de356cb1d47d7407169d75a710520c6cd184fb7) (go: go1.16)

Regarding logs I wish there was anything significant but nothing I can seem to identify as an error. Here is a sample anyway : link (it's from the container log so pgweb is one version earlier, but now I have moved back to command line, logs look the same. I just don't have them available as my script erase the previous logs on restart, I have just fixed that...)

ok I have added --idle-timeout=0 extra to --no-idle-timeout let's see if this stabilize the connection

update - it didn't
trying now to change the timeout to an large number instead.

ok you'll need to also provide some repro instructions: which postgres version, os, envs, etc you're using so i can test it out and hopefully implement a fix

Please reopen if you have any extra info. Im just trying to clear out the issue tracker.


OCPBUGS-1328: fix incorrect link field setting

Signed-off-by: Mohamed Mahmoud<EMAIL_ADDRESS>

/jira refresh

/cherry-pick release-4.12

/lgtm


Stupid Question

How do i get the home page, ive tried so many things, and cant seem to just get the main page, i can get any subreddit though :)

this works. but is it the right way?
Submissions subms = new Submissions(mRestClient, null);
return subms.parse("/hot.json");

Yeah I think that's right.

I feel like that should be more obvious in the code or for an example.

added an example in #125 . Let me know if it's okay.

can I close this guy, @TomsOverBaghdad ?


write code to get random superhero name using superheroes dependencies.

I would like to work on this please assign


fix(project): remove codecov steps

Signed-off-by: James Hart<EMAIL_ADDRESS>PR summary
Removing unwanted steps from CI
Fixes: <! -- link to issue -->
PR Checklist
Please make sure that your PR fulfills the following requirements:

[x] The commit message follows the Angular Commit Message Guidelines.
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] New tests
[x] Build/CI related changes
[ ] Documentation content changes
[ ] Other (please describe)

What is the current behavior?

What is the new behavior?

Does this PR introduce a breaking change?

[ ] Yes
[x] No

Other information

:tada: This PR is included in version 0.0.7 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Broken dom update transaction

Hi, thanks for this great lib!
Digging around https://github.com/oliviertassinari/react-swipeable-views/issues/192, It seems that the root cause of this issue is right here.
Basically, the style updated is performed ASAP outside of the React render transaction leading the interface in an inconsistent state:
I have created a simple reproduction test case:
http://www.webpackbin.com/E1wl7yhMz

As you can see with the logs:
Initial state

[Log] interpolatedStyle.translate – 200 (sandbox.webpackbin.com, line 68)
[Log] this.state.children.length – 4 (sandbox.webpackbin.com, line 68)

Inconsitancy

[Log] interpolatedStyle.translate – 200 (sandbox.webpackbin.com, line 68)
[Log] this.state.children.length – 3 (sandbox.webpackbin.com, line 68)

End state

[Log] interpolatedStyle.translate – 100 (sandbox.webpackbin.com, line 68)
[Log] this.state.children.length – 3 (sandbox.webpackbin.com, line 68)

Is this expected? I'm not sure that the best work-around is.

Maybe i'm over simplifying this problem but from looking at the example you provided:

After the setState call a render() is initiated.
react motion gets a new style with the value of 100 (instead of the spring(200)
state has 3 children instead of 4
react motion has to render immediately and provides the initial 200 value but with the new state of 3 children
react motion called from an animation render (without react render) with the "final" value of this interpolation which is the immediate 100
the last render has 100 and 3 children as expected.

So, the react initiated render() after the setState() must produce a workable component tree and probably is called from the render call itself without the wait for the animation frame that is actually performing the "next step in the interpolation" - in this case setting the value directly to 100. In this "forced render" it must use the new state of 3 children.
I would probably look at using the <TransitionMotion /> component which also controls the entry and leave of children - in that case the first forced render would still see 4 children although the state changed to 3. On the first animation frame, the children and the translate value would change to their end value in sync.
What do you think?

I have created this modified example:
http://www.webpackbin.com/410YcRxXz
<TransitionMotion/> like to operate on the array of children - I had to hack around it so to not change the styles you applied in your example to the parent <div/> of the Slides. But of course this could be prettier. Point is, when react-motion knows that we removed Slide A - it would wait for the (instant) transition from spring(200) to 100 from actually removing it from the rendered children list.
Here is the modified log:
react render() // Initial load of the component
Motion - interpolatedStyle.translate 200
Motion - this.state.children.length 4
TransitionMotion - interpolatedStyle.translate 200
TransitionMotion - this.state.children.length 4
TransitionMotion - interpolatedStyles.length 4

react render() // setState() caused this render
Motion - interpolatedStyle.translate 200 // Uses "currentStyle" transition has not started
Motion - this.state.children.length 3 // It must render the existing state.. so 3 children
TransitionMotion - interpolatedStyle.translate 200
TransitionMotion - this.state.children.length 3
TransitionMotion - interpolatedStyles.length 4 // Still "remembers" the children from before

Motion - interpolatedStyle.translate 100 // This is a RAF render - back in sync.
Motion - this.state.children.length 3
TransitionMotion - interpolatedStyle.translate 100
TransitionMotion - this.state.children.length 3
TransitionMotion - interpolatedStyles.length 3

And checking on mobile safari the flicker is not visible on the TransitionMotion rendered component.

On safari browser flicker still present.


Cleanup & Refactor kClient generators code before migrating to devfile library

Repo devfile/parser is going to be the home for much of the generator's code that will be used odo, devworkspace operator and console.
The devfile/parser library should be able to generate basic Kubernetes objects from the devfile. The list of these functions and objects can be found documented at the design doc for the library and also the util funcs that can be found in the same doc.
Currently, Odo and Devworkspace operator repo generate their own Kube structs and objects, so there is a lot of redundant code and issue https://github.com/devfile/api/issues/181 will be solving that problem for all the consumers of the devfile/parser.

Discussed this with @kadel & @mik-dass and we figured this was the best approach for all the parties involved.

Some comments from @adisky on the doc https://docs.google.com/document/d/1ffLi37fM7LAjRK5SXAw-yVNwr9GchFYy_e_5VD-FOZc/edit#heading=h.v1ex47x85625
To summarize some of the early concerns:

kclient.GetContainers and GetVolumes should take devfile data obj as input and just return kube structs of accordingly
GeneratePodTemplateSpec() should take all the information and generate the spec rather than passing the object around and adding resources to it later
kube and common utils have generator functions that should essentially reside in kclient generators


Add config reset

#705  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @alanvardy and the rest of your teammates on  Graphite


[BUG] duplicate recipe

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
riptide and sweeping edge have the same recipe so you can only craft riptide
Expected Behavior
.
Steps To Reproduce

Environment
- OS:
- Java version:
- Minecraft version:1.20.1
- Version: 6.0.23
- Modpack: ATM9 0.2.35

Anything else?
No response

Know issue, we haven't found a good recipe to fix this


Is there some way of getting a fields tag from its name?

I'd like to be able to write something like
get_tag!(message_name, field_name)

Rather than writing the numbers directly into my code in places.

No, currently the mapping of fields to tag numbers isn’t exposed.   Can you expand on why you would want to do this?  I’ve never had a need to work with tags directly.

@danburkert It shouldn't be necessary to modify the proto file with any sort of annotation. All that is needed is to find out the field's tag number so that the field can be referred to over the wire. This is a simple operation in other protobuf libraries:

C++ https://stackoverflow.com/questions/35479900/getting-tag-number-of-a-field-in-google-protobuf

In python MessageName.DESCRIPTOR.fields gives a list of objects with info like the fields name and tag.

In Golang, protobuf tags are represented as struct tags which can be accessed via reflection: https://medium.com/golangspec/tags-in-golang-3e5db0b8ef3e

I expected that something similar to golang's reflection would exist in rust for just this kind of problem, but it seems that is not the case: https://stackoverflow.com/questions/54573185/how-do-i-read-attributes-programatically-in-rust/54578601?noredirect=1#comment95957359_54578601
Would you accept a PR which appended to the generated code output a simple traversable data-structure which would include this metadata?

Re-reading your comment it appears to me that you misunderstood what I meant by "Configured with protobuf". What I meant, is that a list or map of disallowed field tags is set over the wire to the broker in protobuf format. Not that the broker is configured in a .proto file.


add append_record_batch

Added append_record_batch support
close #184

Make sure fmt the code before push
https://github.com/wangfenjin/duckdb-rs#checklist

I have restored the default functionality

@web3creator could you allow me to push to your branch? I did some refactoring


Support aliases starting with @ (and, in general, aliases that cannot be distinguished from npm package names)

Description
As discussed here it seems that Nx expects monorepo package names to start with @.
There is a Vike internal issue with path aliases that cannot be distinguished from npm package names. I've tried a workaround but couldn't make it work so far (I'm optimistic it's possible to make it work).
A warning should still be shown as defining indistinguishable path aliases is asking for trouble (as attested by Vike's internal issue with it). It also makes code less readable. In general, breaking implicit assumptions should be avoided as much as possible.

Does this mean we can safely ignore the deprecation warning: defines an invalid resolve.alias which will be deprecated in the next major release: a path alias cannot start with @, see https://vike.dev/path-aliases#vite?

If you want to be optimistic then yes go ahead. If you want to be conservative then wait until I find the solution (I'm fairly optimistic I will but I cannot guarantee it).
If I'm successful, there'll still be a warning (you should avoid breaking implicit conventions as much as possible) but you'll be able to suppress the warning and Vike will work just fine.

Hi, i have a similar question about tilde. In my config I am using regex:
{
  resolve: {
    alias: [{ find: /^~(.*)$/, replacement: "$1" }],
  },
}

Although it would be possible to us string as pattern, I would like to ensure only aliases which begin with tilde should be processed.
So the question is what is the preferred way?
Thanks

Another +1, vike shouldn't dictate what a path alias starts with.

I am facing the similar problem.
In my case we have to use several vue libraries within a monorepo project, and bring them into one app. It may happen, that these packages have their own vue/vuex dependency and it is not preferable, to later have several vue/vuex instances on the same bundle. So normally the following alias solved this problem:
      {
        find: 'vue',
        replacement: fileURLToPath(new URL('node_modules/vue', import.meta.url)),
      },
      {
        find: 'vuex',
        replacement: fileURLToPath(new URL('node_modules/vuex', import.meta.url)),
      },

but now vike tells me that this syntax will soon be deprecated, although it looks like a valid case for its own need.
IMO as well, vike should not dictate how vite config should look like.

@dmytro-grablov I see, makes sense. FYI removing the warning (and resolving the issue beyond the warning) is high priority, which I'll implement as soon as all urgent tickets are implemented.

Vike now officially supports any path alias.
Pre-released in 0.4.166-commit-6a8acaa. Release ETA this week.
Note that a warning (that you'll be able to suppress) will still be shown after https://github.com/vikejs/vike/issues/1567 is implemented.

Btw. Vike is looking for sponsors, any amount is appreciated!


Correct, modernize and make more independent of user

The playbook had drifted away from the text of README.md, so I corrected what I could.
I eliminated literal user name.
I modified the instructions so the credentials_file name is constant.
I modified the instructions so that the current value of project in gce_vars/auth need not be
YOUR_PROJECT_ID. This is because it is too easy to forget to change this value from an
actual project ID to YOUR_PROJECT_ID before committing.
Replaced deprecated include with import_playbook.
There is no file clean-up.yml, so I corrected it to cleanup.yml. Although I did not say or do
anything about it, cleanup.yml is quite broken.

Closing in favor of #12.


ADLA Catalog updates

Generated from RestAPI PR: https://github.com/Azure/azure-rest-api-specs/pull/1119

@begoldsm I guess ou have a plan here?

@lmazuel yes. I will be making some updates to this PR today to get it passing and fix up the tests :)


Add Degree-Corrected functionality into the sbm method

Reference Issues/PRs
Closes Issue #116
What does this implement/fix? Explain your changes.
Added two additional optional parameters to the sbm method in the simulations set of functions. Specified correctly, they allow for a degree-corrected sbm to be simulated. Integrates with the current sbm simulation to allow for directed/undirected and loopy/loopless graphs. Unit tests are added to confirm functionality.

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@5e8b9c1). Click here to learn what that means.
The diff coverage is 90.56%.

@@            Coverage Diff            @@
##             master     #123   +/-   ##
=========================================
  Coverage          ?   96.16%
=========================================
  Files             ?       22
  Lines             ?     1070
  Branches          ?        0
=========================================
  Hits              ?     1029
  Misses            ?       41
  Partials          ?        0

Impacted Files
Coverage Δ

graspy/simulations/simulations.py
95.78% <90.56%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5e8b9c1...a903068. Read the comment docs.

Did you copy in Vikram's RDAD?

Removed the Vikram's RDAD implementation

Why is regularized laplacian back in this PR?

I thought the regularized laplacian code pull had been accepted into the master?

Let's talk today if you're around after class so we don't have to keep
going back and forth online
On Mon, Mar 11, 2019, 9:06 AM Ronan Perry<EMAIL_ADDRESS>wrote:

@rflperry commented on this pull request.
In tests/test_sims.py
https://github.com/neurodata/graspy/pull/123#discussion_r264221937:

@@ -575,6 +575,37 @@ def test_sbm_multiwt_undirected_loopy(self):
self.assertTrue(A.shape == (np.sum(self.n), np.sum(self.n)))
pass

def test_sbm_dc_dcargs_directed_loopy(self):

Yes, you can only pass in one function/set of kwargs. I was debating
modifying it so that you can also pass a function for the vertices in each
block?
I generate the dc weights outside of the function because if generated
internally, I don't know a priori know the theoretical degrees that I
should see for each vertex. But I can formulate an additional test that
passes the function.
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHub
https://github.com/neurodata/graspy/pull/123#discussion_r264221937, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AYheHxXgNIXPWClRAa5in6NdVCJGnS_pks5vVlTugaJpZM4bRUtO
.

@bdpedigo I edited a random typo but I approve of the docstring format. I'm not authorized to merge so I'll leave that to you.


Update link in the_double_entry_counting_method.md

Update link in the_double_entry_counting_method.md

Hello, this markdown document is generated from a Google Doc, you need to update the source
See https://github.com/beancount/docs/blob/master/CONTRIBUTING.md

ah ok will close it then


Update getting_started.rst

"vcs import < moveit2_tutorials.repos" can't be executed! Is this a typo?
Description
The line i removed seems to be a typo, because there is no moveit2_tutorials.repo directly under "src".
Checklist

[ ] Required by CI: Code is auto formatted using clang-format
[ ] While waiting for someone to review your request, please consider reviewing another open pull request to support the maintainers

Thanks for the contribution @toomuchcookies! That is definitely a typo from the latest PR. I will merge once the CI passes. Please let us know if you face any issues / errors while going over tutorials.


Implementing the Socks 5 proxy in the browser

I would like to know if there is anyway to use Socks 5 on the surf browser currently.
if not what steps to take to develop.

It should work like this.
https://github.com/headzoo/surf/issues/97


pxl script execution error when 'select' includes req_body for http_events

Describe the bug
A clear and concise description of what the bug is.
The pxl script I have should execute for and return all fields, however, when req_body is included in select or if select is left out entirely (defaulting to all values per documentation) an exception occurs in the pxapi library. When select is explicit all values are able to be included except req_body.
To Reproduce
Steps to reproduce the behavior:
have this pxl script:
import px # type: ignore # pylint: disable=import-error

def http_data(start_time: str, end_time: str):
    df = px.DataFrame(
        table='http_events',
        select=[
            'time_',
            'upid',
            'remote_addr',
            'remote_port',
            'trace_role',
            'major_version',
            'minor_version',
            'content_type',
            'req_headers',
            'req_method',
            'req_path',
            # 'req_body',
            'req_body_size',
            'resp_headers',
            'resp_status',
            'resp_message',
            'resp_body',
            'resp_body_size',
            'latency'
        ],
        start_time=start_time,
        end_time=end_time
    )

    df.namespace = df.ctx['namespace']
    df.node = df.ctx['node']
    df.svc = df.ctx['service']
    df.pod = df.ctx['pod']
    df = df.drop(columns=['upid'])

    return df

px.display(http_data(START_TIME,END_TIME), 'http_events') # type: ignore

call pxl script as such:
px_client = pxapi.Client(token=px_token)
clusters = px_client.list_healthy_clusters()
pixie_cluster_to_use = clusters[2]
px_conn = px_client.connect_to_cluster(cluster=pixie_cluster_to_use.id)

script = px_conn.prepare_script(time_segment_script)
# Add a callback function to the script
script.add_callback("http_events", update_logging_data)
# run the script which updates the global var for log data
script.run()

Expected behavior
A clear and concise description of what you expected to happen.
The pxl script should complete successfully with all fields.
Screenshots
If applicable, add screenshots to help explain your problem. Please make sure the screenshot does not contain any sensitive information such as API keys or access tokens.

Logs
Please attach the logs by running the following command:
./px collect-logs

App information (please complete the following information):

Pixie version

pxapi 0.4.1 python

K8s cluster version

v1.19.15-eks-9c63c4

Node Kernel version

currently unknown, working on access

Browser version

N/A

I am using M1 mac fwiw. Installed with the following notes/flags:
brew install rust
export GRPC_PYTHON_BUILD_SYSTEM_OPENSSL=1
export GRPC_PYTHON_BUILD_SYSTEM_ZLIB=1
export CFLAGS="-I<EMAIL_ADDRESS>export LDFLAGS="-L<EMAIL_ADDRESS>Additional context
Add any other context about the problem here.

Hi @jdix531 thanks for flagging this.
I'm having trouble reproducing this locally, maybe you can help me out.
First I noticed that you're using Python 3.10.1 , correct? I wasn't able to install pxapi using 3.10 without some modifications to the deps. Do you know which grpcio and grpcio-tools versions you are using?
Btw just tested and 3.8 definitely works if that's an option for you.
Second, are you completely sure the issue is related to req_body? We don't special case req_body. Are you able to get any results if you say include req_body but remove resp_body? Also is this something that intermittently happens or happens all the time?

Hi @philkuz, I have tried python 3.8 with the same results. I've been on macos darwin. I tried emulating an x64 docker container (python:3.8.9) which installs just fine and without the below settings but has the same error.
Switching to an x64 machine running manjaro the error still occurs, however, I get what looks like some useful console output to go with the errors - this happens every time:
[libprotobuf ERROR google/protobuf/wire_format_lite.cc:577] String field 'px.api.vizierpb.StringColumn.data' contains invalid UTF-8 data when parsing a protocol buffer. Use the 'bytes' type if you intend to send raw bytes.

Perhaps I need to upgrade our pixie deployment? I see this as a 2018/9 issue for protobuf https://github.com/protocolbuffers/protobuf/issues/4691. Let me know what you think of this!

Hi - some good news. I re-deployed pixie to this cluster and this error doesn't seem to occur anymore.
We have a separate issue (where pixie is crashing, recovering, but web-ui and api say the health checks are failing and it won't work) but that's a) a separate issue and b) I want to look more into it first before reaching out.
Closing for now, thanks for helping me look into this @philkuz.


Unexpected dataloader_idx_X added after log_dict.

🐛 Bug
Trainer is adding dataloader_idx_X to metrics, but it is not supposed to since the name of my metrics are data1/x and data2/x. It currently displays as data1/x/dataloader_idx_0=3.46e-14, data2/x/dataloader_idx_1=3.49e-14 in progress bar.
To Reproduce
https://colab.research.google.com/drive/1L_0LOl7pUeL7bzh6uZiRa3-WXYQQwirN?usp=sharing
Expected behavior
It should appear in progress bar the information as data1/x=3.46e-14, data2/x=3.49e-14 and ModelCheckpoint should find data1/x to save based on it.
Environment

CUDA:

GPU:

Tesla T4

available:         True
version:           10.1

Packages:

numpy:             1.19.5
pyTorch_debug:     True
pyTorch_version:   1.7.0+cu101
pytorch-lightning: 1.2.0
tqdm:              4.41.1

System:

OS:                Linux
architecture:

64bit

processor:         x86_64
python:            3.6.9
version:           #1 SMP Thu Jul 23 08:00:38 PDT 2020

Additional context
This was not happening before (I was using another version, but recently updated my pytorch lightning docker container), so I don't have working version information.

Looking for it in older versions, I just realized this bug always existed, it was me that was not logging the metrics for the progress bar.


Make the download alert compatible with screen readers-508 issue

Context

The message is not automatically announced to a screen reader, it needs to be in a live region.

This ticket is ready for 508 testing @aprematta

Testing complete, alert now has live region, closing ticket


Revert clamping scroll simulation changes

This reverts https://github.com/flutter/flutter/pull/77497 which sought to address https://github.com/flutter/flutter/issues/16371
The original change caused a regression in https://github.com/flutter/flutter/issues/83632
Fixes https://github.com/flutter/flutter/issues/83632
Pre-launch Checklist

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] I read the Tree Hygiene wiki page, which explains my responsibilities.
[x] I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
[x] I signed the CLA.
[x] I listed at least one issue that this PR fixes in the description above.
[x] I updated/added relevant documentation (doc comments with ///).
[x] I added new tests to check the change I am making or feature I am adding, or Hixie said the PR is test-exempt.
[x] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel on Discord.

We should probably cherry-pick this into the latest release.

I agree, I'll label the issue for cp once this lands


BIDS organizer fails to load all data

For a datatype with output files defined such that, one file is located inside another directory (like dti_trilin/dt6.mat and dti_trilin for dtiinit_output) not all files are staged for BIDS output. In dtiinit's case, dt6.mat is omitted inside the dti_trilin directory. I need to fix this.

The issue has been fixed


add binding to determine which method to use in relationship mixin

we're trying to remove genealogy. since the relationship adding logic lives in the rel mixin, we need a way of differentiating that logic from actual ancestry logic so classes can use both.
based on the value of relationship_type we need to either set an ancestry parent or a relationship parent
both parent= live on the ancestors that are proxies to each of the modules so you can call methods on any such ancestor with ruby magic wherein you can unbind a method and bind it to some other object.
@miq-bot assign @kbrock

@kbrock you were right about the args getting stomped, it's somewhere around https://github.com/matthewrudy/memoist/blob/v0.15.0/lib/memoist.rb#L213 which is the reason the cross repo tests on this will fail on depth and root and also why i have that gook

I'm confused...I thought adding ancestry to vm_or_template for genealogy would then remove the relationship_type of genealogy entirely? By extension, I think with_relationship_type and relationship_type only exists to support genealogy, and then I thought it would go away. (Or, more accurately, relationship_type exists to support an object appearing in multiple relationship trees, and with_relationhip_type is needed to distinguish, with Vms being the only type that apprears in multiple trees, namely, ems_metadata and genealogy)

Think about this a bit more and reflecting on my prior comment, I now am seeing this PR as more of a change in semantics of the with_relationship_type method.  Perhaps we should rename that method to be more accurate, and this way it won't be confusing to readers expecting it to work under-the-covers as it did previously? Maybe something like using_ancestry_relationships?  Then, you probably don't need that magic relationship_type == "geneaology" method

I'm closing this because while it is fantastic and solves part of the issue that Keenan's tackling at the moment, he and I are in agreement that it's an untenable solution simply due to the scale of the changes involved. We are marshaling, horrible pun not intended, other, more viable approaches.

these failures are infinite loops. That typically happens when we forget to override an ancestry call.
we need guard clauses on adding / removing children
def  add_children
    if use_ancestry
      return child_objs.each { |child| self.children << child }
    end

think the parent methods are ok.
also per jason's observations, double check the uses of [name,id] in this file. There are a few of them that did not get caught

marking once again as work in progress because we've two outstanding issues left:

we need to change miq_set to use a standard habtm polymorphic as evidenced by the 170 failures at the moment. relationship removal necessitates these changes having as small of a target as we can, and the miq_set refactor is going to prevent us from moving forward here.
i have yet to address the usage of [name,id] per https://github.com/ManageIQ/manageiq/pull/20274#issuecomment-700950328 that are changed here (root_id, ancestor_ids, path_ids, child_ids, sibling_ids, descendant_ids, subtree_ids are all using the Relationship.resource_pair call).

marking as work in progress because i'm concerned about the behavior of the class variables:
2.5.5 :001 > Dialog.hidden_attribute_names
 => []
2.5.5 :002 > Vm.hidden_attribute_names
 => []
2.5.5 :003 > ExtManagementSystem.hidden_attribute_names
 => ["aggregate_memory"]
2.5.5 :004 > Vm.hidden_attribute_names
 => ["aggregate_memory"]
2.5.5 :005 > Dialog.hidden_attribute_names
 => ["aggregate_memory"]

un-work in progressing because the cattr_accessor concern was resolved, see https://github.com/ManageIQ/manageiq/pull/20664/files#r513793189, thanks Jason

@kbrock could I please get one more review here? 🤞


not get only shorts of a channel

import scrapetube
videos = scrapetube.get_channel(channel_id="UCnLEX7PhefQFqJEvNNyeZqw",content_type='shorts',sort_by="newest")
for video in videos:
print(video)

Scrapetube is failing because YouTube updated the JSON tree for shorts

This should fix it

@vipul156 Before this PR is merged you can also achieve the same result with this hack
import scrapetube
scrapetube.scrapetube.type_property_map['shorts'] = 'reelWatchEndpoint'


Segmentation fault when running on powerpc64le-unknown-linux-gnu

https://doi-janky.infosiftr.net/job/multiarch/view/images/view/rust/job/ppc64le/job/rust/1/console
The binary seems to run fine in installer mode, but rustup --version then segfaults.

Is this any better now?


Many errors when attempting to truncate final runs of the same value

What's up?
Consider a table like:
id  val
1   a
2   b
3   a
4   a
5   b
6   b
7   a
8   b
9   b
10  b

There are "runs" of values in the "val" column, i.e. sequences like aa or bbb. What I want to do is remove the final "run", so that the result is like:
id  val
1   a
2   b
3   a
4   a
5   b
6   b
7   a

Also in scope is to include first row of the final run but nothing more:
id  val
1   a
2   b
3   a
4   a
5   b
6   b
7   a
8   b

I tried to do this in PRQL but everything I try seems to cause into some inscrutable error.
Here is what I have tried. Not all of these attempts may be correct, they just detail stuff I ran into in the process of trying to figure out what to do.
Attempt 1
let my_data = [
  {id=1, val="a"},
  {id=2, val="b"},
  {id=3, val="a"},
  {id=4, val="a"},
  {id=5, val="b"},
  {id=6, val="b"},
  {id=7, val="a"},
  {id=8, val="b"},
  {id=9, val="b"},
  {id=10, val="b"},
]

from my_data
sort id
derive {
  last_val = lag 1 val,
  changed = coalesce (val != last_val) true
}
filter changed
derive {run_id = row_number this}
select {id, run_id}
join side:left my_data (my_data.id == this.id) # fails here

Error:
    ╭─[:24:25]
    │
 24 │ join side:left my_data (my_data.id == this.id) # fails here
    │                         ─────┬────
    │                              ╰────── Ambiguous name
    │
    │ Help: could be any of: that.my_data.id, this.my_data.id
────╯
Error: Binder Error: Referenced table "table_2" not found!
Candidate tables: "table_1"
LINE 92:   table_2.id

For context, commenting out the join line gives this result:
id	run_id
1	1
2	2
3	3
5	4
7	5
8	6

I think this is a bug because the my_data name doesn't look ambiguous to me.
It also fails when I try to use join side:left my_data (==id):
Error: Binder Error: Referenced table "table_2" not found!
Candidate tables: "table_1"
LINE 92:   table_2.id

Attempt 2
I've omitted the let my_data = ... definition from subsequent fragments for brevity.
let my_data = [
  {id=1, val="a"},
  {id=2, val="b"},
  {id=3, val="a"},
  {id=4, val="a"},
  {id=5, val="b"},
  {id=6, val="b"},
  {id=7, val="a"},
  {id=8, val="b"},
  {id=9, val="b"},
  {id=10, val="b"},
]

let run_ids = (
  from my_data
  sort id
  derive {
    last_val = lag 1 val,
    changed = coalesce (val != last_val) true
  }
  filter changed
  derive {run_id = row_number this}
  select id
)

from my_data
sort id
join side:left run_ids (==id)
filter my_data.id < max(run_ids.id) # fails here

Error:
    ╭─[:29:25]
    │
 29 │ filter my_data.id < max(run_ids.id) # fails here
    │                         ─────┬────
    │                              ╰────── Unknown name
────╯

It can't resolve the run_ids name even though I defined it in a let statement just before.
Attempt 3
While troubleshooting the above I rewrote it into a trivial let binding and tried to print it:
let run_ids = (
  from my_data
  sort id
  derive {
    last_val = lag 1 val,
    changed = coalesce (val != last_val) true
  }
  filter changed
  derive {run_id = id}
  select run_id
)

from run_ids

Error: Binder Error: Referenced column "id" not found in FROM clause!
Candidate bindings: "run_ids.run_id"
LINE 91:   id

However when I remove the let block and have the same fragment in the top level scope, it works:
from my_data
sort id
derive {
  last_val = lag 1 val,
  changed = coalesce (val != last_val) true
}
filter changed
derive {run_id = id}
select run_id

Attempt 4
In this one I try to use aggregate and group but it doesn't work either:
from my_data
sort id
derive {
  last_val = lag 1 val,
  changed = coalesce (val != last_val) true
}
group changed (
  aggregate {
    max_id = max id
  }
)

Error: Binder Error: GROUP BY clause cannot contain window functions!

But it seems to me that this should be possible given that before the group function the data looks like this:
id	val	last_val	changed
1	a	null	true
2	b	a	true
3	a	b	true
4	a	a	false
5	b	a	true
6	b	b	false
7	a	b	true
8	b	a	true
9	b	b	false
10	b	b	false

Surely I should be able to group by the changed column and get the maximum of the id column for true and false?
Attempt 5
Next I simply tried to get the maximum id over the whole table, without any grouping, just as a sanity check, but this also fails:
from my_data
sort id
derive {
  last_val = lag 1 val,
  changed = coalesce (val != last_val) true
}
aggregate { max id }

Error: Binder Error: column "id" must appear in the GROUP BY clause or must be part of an aggregate function.
Either add it to the GROUP BY list, or use "ANY_VALUE(id)" if the exact value of "id" is not important.

Attempt 6
Next I tried doing it in the filter function, but I couldn't figure out how to get the expression I wanted. I don't know if this is a bug or that I'm just not understanding PRQL's syntax:
from my_data
sort id
derive {
  last_val = lag 1 val,
  changed = coalesce (val != last_val) true
}
filter id < (this | filter changed | aggregate { max id })

I'm basically trying to say "filter such that the id is less than the max id among the rows that changed". The docs say that this refers to the current relation so I thought something like this would work, but I'm not sure why it doesn't.
At this point nothing I've tried has worked, and I don't know how to proceed.

Thanks a lot for writing all this down.
I tried some of these — there are some bugs there. For example, Attempt 1 hits https://github.com/PRQL/prql/issues/3129.
Many of these happen because PRQL hasn't encoded what DuckDB can accept — anything that contains "Binder Error" is an error from DuckDB. Often we could write different SQL that wouldn't hit those errors (they're not bugs in DuckDB) — for example in Attempt 4, DuckDB can't accept window functions in a group by, but IIUC we could materialize the result in a CTE and then use that.

I appreciate the dedication in enumerating these, and sorry that PRQL wasn't helpful here. So this is a reminder for me & others that PRQL is still quite difficult to use for some intermediate queries.
That said, for the purposes of improving PRQL, we'd need a couple of things:

Minimal examples of the bugs
The SQL that should be generated

Some observations:

Attempt 1
The error in the join can be resolved by using that instead of my_data but then you hit a bug with a reference in the ORDER BY to table_2.id which is a duplicate of #3619 .
The following compiles and runs but I haven't checked whether semantically it gives you what you want @ckp95:
from my_data
#sort id
derive {
  last_val = lag 1 val,
  changed = (val != last_val) ?? true
}
filter changed
derive {run_id = row_number this}
select {id, run_id}
join side:left my_data (that.id == this.id) # works with `that`


Fix Sass beautification

What does this implement/fix? Explain your changes.

Add a new beautifier: SassConvert
Fix Sass beautification

Refer to #1088 for related discussions.
...
Does this close any currently open issues?
#1088
...
Any other comments?
This PR is ready for merge.
...
Checklist
Check all those that are applicable and complete.

[x] Merged with latest master branch
[x] Added examples for testing to examples/ directory
[x] Travis CI passes (Mac support)
[x] AppVeyor passes (Windows support)

This is great so far! Please take a look at my comments. Let's get this merged ASAP!!

I have replied your comments, amended one commit and added one new for document update.
Travis CI was broken due to "brew tap homebrew/homebrew-php" failing. Maybe a simple rebuild would fix it.

I just pushed a new release. Please resolve merge conflicts and hopefully then the tests will all pass! Thank you!

I have resolved the conflicts and Travis CI was still broken due to the same reason.

Can we merge this PR? Or is there something else blocking it?

Could you update the docs again? Looks like they are out of data with the options set to false (support Language, no supported options). I think that's all that's left! Thanks!

I had thought about it and tried, but got no difference.

Hmm. Try running:
npm run postinstall
npm run docs

I think the issue is that npm run docs was using an old options.json file. npm run postinstall should update it accordingly.

Got it. Done.

Awesome! Thank you for contributing!

Published to v0.29.12

@Glavin001
I've installed sass-convert for atom-beautify according to the instructions in README. However, atom-beautify seems still be unable to find the necessary files to beautify SASS. I've included a gif showing my setup here. Could you point out what might be wrong? Thanks
P/S: Should I start a new thread?


How I do cross compile using cmake

Hi avs team
How I do cross compile on openwrt platform.

Hi sundq, as long as you can get all the dependencies on openwrt platform, you should be able to compile the SDK. The SDK works for Linux based systems, we have built and tested it on MacOS, Linux(Ubuntu) and raspbian. We have not tried compiling it for openwrt platform but since it is linux based, you should be able to build and run on it. Also what is the architecture you are working on? PowerPC or Arm-based?

Dear mradulan，
Can i compile this SDK with ubuntu(x86)?
I compiled this SDK on Ubuntu (x86), and when I started AuthServer, it was always wrong.
The following error is reported：
zhx@ubuntu:~/share/avs_sdk_linux/tempfile/mengmeng$ python AuthServer/AuthServer.py
The refresh request failed with the response code 400. This might be due to a bad refresh token or bad client data. We will continue with getting a refresh token, discarding the one in the file.

Running on http://<IP_ADDRESS>:3000/ (Press CTRL+C to quit)
^Czhx@ubuntu:~/share/avs_sdk_linux/tempfile/mengmeng$

I'm sure client data is right，I tried a lot ,but failed. Since you mentioned the architecture in this issue,so i wonder if SDK doesn't support Ubuntu (x86)?
Looking forward to your reply, thank you！

Can you check in developer.amazon.com -> Security Profile -> Web Settings -> Allowed origin , Allowed return URL. Check if it is set to http://localhost:3000 and http://localhost:3000/authresponse

SDK supports Ubuntu.

Dear mradulan，
I set it just as you said，but report the same error.
Set as below
`

Allowed Origins
http://localhost:3000

Allowed Return URLs
http://localhost:3000/authresponse

`

It reported the same error

`zhx@ubuntu:~/share/avs_sdk_linux/tempfile/mengmeng$ python AuthServer/AuthServer.py
The refresh request failed with the response code 400. This might be due to a bad refresh token or bad client data. We will continue with getting a refresh token, discarding the one in the file.

Running on http://<IP_ADDRESS>:3000/ (Press CTRL+C to quit)
^Czhx@ubuntu:~/share/avs_sdk_linux/tempfile/mengmeng$ `

I had the same issue.  From what I see, Amazon doesn't allow http, it allows https only and I can only retrieve the refresh token if I use https as origin and return URL.  However the current AuthServer.py only support http.   I've to use other scripts from other avs projects to retrieve the refresh token and fill in the AlexaClientSDKConfig.json manually.
Can someone confirm this issue and fix the AuthServer.py to https?

Hi @rustihammer and @sundq,
Http can be used as the Allowed origin and Allowed return URL.  Can you try putting something in the deviceSerialNumber in AlexaClientSDKConfig.json and check again?
For example:
"deviceSerialNumber":"12345678"
Thanks,
Kenneth

Still no luck for me. I tried your suggestion but I couldn't get it right.  I even tried to modify the AuthServer.py to use https but it still return failed 400.  I tried another script using https but it was ok.  I guess it was something else causing the issue.

rustihammer@mba:~/BUILD$ python AuthServer/AuthServer.py
The refresh request failed with the response code 400. This might be due to a bad refresh token or bad client data. We will continue with getting a refresh token, discarding the one in the file.

Running on https://<IP_ADDRESS>:3000/ (Press CTRL+C to quit)
<IP_ADDRESS> - - [12/Oct/2017 00:44:20] "GET / HTTP/1.1" 302 -

AVS guys, I always want to say thank you for working hard on these project. Alexa is fun!

Hi @rustihammer,
Thanks!
Did you try opening the browser at  while the server is running?
Thanks,
Benny

Hi Bunny,
Sorry my issue was fixed at another thread, it was due to bad ProductID:
https://github.com/alexa/avs-device-sdk/issues/227

@rustihammer : Do you have a makefile recipe for the AVS device sdk that you can share? Thanks!

@thevamad I cross compiled it for ARM, if that's what you're looking for:
This is my cmake command using the toolchain.cmake toolchain file.  Just FYI.  Need clean up for re-use:
$ cmake -DCMAKE_TOOLCHAIN_FILE=~/toolchain.cmake $SDK_SRC -DSENSORY_KEY_WORD_DETECTOR=OFF -DKITTAI_KEY_WORD_DETECTOR=ON \
    -DKITTAI_KEY_WORD_DETECTOR_LIB_PATH=$LOCAL_BUILD_ARM/lib/libsnowboy-detect.a -DKITTAI_KEY_WORD_DETECTOR_INCLUDE_DIR=$LOCAL_BUILD_ARM/include \
    -DGSTREAMER_MEDIA_PLAYER=ON -DCMAKE_PREFIX_PATH=$LOCAL_BUILD_ARM -DPORTAUDIO=ON -DPORTAUDIO_LIB_PATH=$LOCAL_BUILD_ARM/lib/libportaudio.a \
    -DPORTAUDIO_INCLUDE_DIR=$LOCAL_BUILD_ARM/include -DCMAKE_PREFIX_PATH=$LOCAL_BUILD_ARM -DCMAKE_INSTALL_PREFIX=$LOCAL_BUILD_ARM \
    -DCMAKE_BUILD_TYPE=DEBUG -Wno-dev

The  toolchain.cmake toolchain file for ARM
set(CMAKE_SYSTEM_NAME Linux)
set(TOOLCHAIN_PREFIX armv7-a)

set(TOOLCHAIN_PREFIX $ENV{SYSROOTS}/x86_64-pokysdk-linux/usr/bin/arm-poky-linux-gnueabi/arm-poky-linux-gnueabi-)

INCLUDE(CMakeForceCompiler)
set(CMAKE_C_COMPILER ${TOOLCHAIN_PREFIX}gcc)
set(CMAKE_CXX_COMPILER ${TOOLCHAIN_PREFIX}g++)

set(CMAKE_SYSROOT $ENV{SYSROOTS}/cortexa7hf-neon-poky-linux-gnueabi)
set(CMAKE_PREFIX_PATH ${CMAKE_SYSROOT}/usr/lib/cmake)

set(CMAKE_FIND_ROOT_PATH ${CMAKE_SYSROOT})
set(CMAKE_FIND_ROOT_PATH_MODE_PROGRAM NEVER)
set(CMAKE_FIND_ROOT_PATH_MODE_LIBRARY ONLY)
set(CMAKE_FIND_ROOT_PATH_MODE_INCLUDE ONLY)

set(CMAKE_FIND_ROOT_PATH_MODE_PACKAGE ONLY)
set(COMPILER_FLAGS " -march=armv7ve -marm -mfpu=neon -mfloat-abi=hard -mcpu=cortex-a7")
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} ${COMPILER_FLAGS}" CACHE STRING "" FORCE)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} ${COMPILER_FLAGS}" CACHE STRING "" FORCE)

which makes uses of environments variables which I exports below:
    export SOURCE_FOLDER_ARM=$HOME/avs-deps-arm
    export LOCAL_BUILD_ARM=$HOME/local-builds-arm
    export LD_LIBRARY_PATH=$LOCAL_BUILD_ARM/lib:$LD_LIBRARY_PATH:/usr/lib/:/opt/fsl-imx-x11/4.1.15-2.1.0/sysroots/cortexa7hf-neon-poky-linux-gnueabi/lib/
    export SDK_SRC=${HOME}/avs-device-sdk
    export SYSROOTS=/opt/fsl-imx-x11/4.1.15-2.1.0/sysroots
    export SYSROOT=/opt/fsl-imx-x11/4.1.15-2.1.0/sysroots
    export CMAKE_SYSROOT=$SYSROOT

    ### ENABLE for CROSS COMPILE avs-device-sdk!!!
    export PKG_CONFIG_DIR=
    export PKG_CONFIG_LIBDIR=${SYSROOT}/usr/lib/pkgconfig:${SYSROOT}/usr/share/pkgconfig
    export PKG_CONFIG_SYSROOT_DIR=${SYSROOT}
    export PKG_CONFIG_PATH=${SYSROOT}/usr/lib/pkgconfig

hi @rustihammer ,do you work out this issue? I cross compile it on MIPS platform now，has any suggestions?
much thanks!

Hi @rustihammer Thank You for providing such information. With the help of your toolchain file and cmake command I am able to initiate corss compilation process of avs sdk for ARM but I get stuck later on when it tries to compile Kitt ai. Initially i was getting errors of cannot find -lblas. Below mentioned procedure was followed to resolve this error:

As I was not able to cross compile blas for ARM so using using yocto and bb file from openembedded I compiled blas for ARM.  Did you cross compile blas for ARM? Do you have any suggestions on this?
In CMakeLists.txt i replaced blas to openblas. Again configuring and compiling now throws me error in code.
For ref:
[ 93%] Built target CapabilitiesDelegateTest
[ 93%] Building CXX object CapabilityAgents/Alerts/test/CMakeFiles/ReminderAlertTest.dir/ReminderAlertTest.cpp.obj
../src/libKITTAI.a(KittAiKeyWordDetector.cpp.obj): In function alexaClientSDK::kwd::KittAiKeyWordDetector::KittAiKeyWordDetector(std::shared_ptr<alexaClientSDK::avsCommon::utils::sds::SharedDataStream<alexaClientSDK::avsCommon::utils::sds::InProcessSDSTraits> >, alexaClientSDK::avsCommon::utils::AudioFormat, std::unordered_set<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordObserverInterface>, std::hash<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordObserverInterface> >, std::equal_to<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordObserverInterface> >, std::allocator<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordObserverInterface> > >, std::unordered_set<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordDetectorStateObserverInterface>, std::hash<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordDetectorStateObserverInterface> >, std::equal_to<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordDetectorStateObserverInterface> >, std::allocator<std::shared_ptr<alexaClientSDK::avsCommon::sdkInterfaces::KeyWordDetectorStateObserverInterface> > >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<alexaClientSDK::kwd::KittAiKeyWordDetector::KittAiConfiguration, std::allocator<alexaClientSDK::kwd::KittAiKeyWordDetector::KittAiConfiguration> >, float, bool, std::chrono::duration<long, std::ratio<1l, 1000l> >)': /home/ap/Desktop/VVDN_AVS/alexa/avs-device-sdk/KWD/KittAi/src/KittAiKeyWordDetector.cpp:136: undefined reference to snowboy::SnowboyDetect::SetSensitivity(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&)'
../src/libKITTAI.a(KittAiKeyWordDetector.cpp.obj): In function std::unique_ptr<snowboy::SnowboyDetect, std::default_delete<snowboy::SnowboyDetect> > alexaClientSDK::avsCommon::utils::memory::make_unique<snowboy::SnowboyDetect, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&&)': /home/ap/Desktop/VVDN_AVS/alexa/avs-device-sdk/AVSCommon/Utils/include/AVSCommon/Utils/Memory/Memory.h:35: undefined reference to snowboy::SnowboyDetect::SnowboyDetect(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&)'
collect2: error: ld returned 1 exit status
KWD/KittAi/test/CMakeFiles/KittAiKeyWordDetectorTest.dir/build.make:100: recipe for target 'KWD/KittAi/test/KittAiKeyWordDetectorTest' failed
make[2]: *** [KWD/KittAi/test/KittAiKeyWordDetectorTest] Error 1
CMakeFiles/Makefile2:4678: recipe for target 'KWD/KittAi/test/CMakeFiles/KittAiKeyWordDetectorTest.dir/all' failed
make[1]: *** [KWD/KittAi/test/CMakeFiles/KittAiKeyWordDetectorTest.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....

Any suggestions to solve this error?
Thanks!

@rustihammer On executing SampleApp on ARM platform I get below error:
(SampleApp:25804): GStreamer-CRITICAL **: gst_object_unref: assertion 'object != NULL' failed
(SampleApp:25804): GLib-CRITICAL **: g_main_context_find_source_by_id: assertion 'source_id > 0' failed
1970-01-02 02:24:53.847 [  1] C SampleApplication:Failed to create media player for speech!
1970-01-02 02:24:53.847 [  1] C SampleApplication:Failed to initialize SampleApplication
Failed to create to SampleApplication!
How to solve this error?
Thanks!


956 UI updates

this should complete issue #963

@codymccoy I have one tiny request. when the checkbox is not marked, could the stage-damage combo box label be "Stage-Damage" while if the checkbox is marked, let the combo box label be "Failure Stage-Damage"

Otherwise, the UI edits look good to me. I've not yet run because we're not yet hooked up. @Brennan1994 would you mind taking a look at the code changes?

Sure, i can make that change.

I just pushed the requested label change. I also moved the red stars down a bit on the new stage damage row.


Fix unreachable RVM url

Hi,
The patch fixes the unreachable URL get.rvm.io for bash -s stable flag enabled. The stable url points elsewhere which is what I've updated below
Note: I've started working on this project, as a continuation of my bid for your job posted on freelancer.com. Here is my freelancer profile.
https://www.freelancer.com/u/srirammax.html?ref_project_id=14435302
Let me know if this is useful. I'll continue the work.
Signed-off-by: Sriram Raghunathan<EMAIL_ADDRESS>

Hi,
Sure. I'll look into this.

Hi,
I've two patches to fix the problems. Could you have a look? Was able to successfully deploy the container.
Pasting the log below:
Stopping redis-server: redis-server.
---> 50a7adbf1b31
Removing intermediate container 05f84e5356ac
Step 38/41 : EXPOSE 80
---> Running in 83bc138fe964
---> 6424dc6e59de
Removing intermediate container 83bc138fe964
Step 39/41 : ENV GDAL_DATA /usr/share/gdal/1.11
---> Running in 7e7eb8a0cd11
---> 3b7258dc0cba
Removing intermediate container 7e7eb8a0cd11
Step 40/41 : ADD ./startup.sh /opt/startup.sh
---> ba1daf75345e
Removing intermediate container 99bb085b09f6
Step 41/41 : CMD /bin/bash /opt/startup.sh
---> Running in b4b11bcd9b63
---> 146bcda1d426
Removing intermediate container b4b11bcd9b63
Note: This is my freelancer profile.
https://www.freelancer.com/u/srirammax.html?ref_project_id=14435302


ObjectDisposedException is throwing after closing Blazor WebView on Android

Hello! System.ObjectDisposedException is throwing in several seconds after I tap back button and moving to the previous page. Important that it only occurs when I tap back button during Blazor is doing some work. I guess it happens because Blazor tried to render the page, but WebView is already closed. What can I do in order to avoid this issue? Thanks a lot!

This definitely looks like a bug. You're using the "physical" back button (the triangle at the bottom) to go back?

Yes, I am.

After update some nuggets this error seems to be solved for me.
I can do a pull request if it could help.
https://github.com/Jon2G/MobileBlazorBindings

I'm getting the same error after the app goes to the background, resumes and someone tries to use a button, more specific to navigate to another page using the navigation manager.
Seems like xamarin can't restore the webview's previous state.
Any ideas? I was thinking of completely killing the process so it can create a new instance but i still can't put that to test... Not to mention that i understand iOS doesn't allow killing your own process.

@ezesil  Maybe we can try now with MAUI support for RazorWebView?
I mean I know it's on preview but I can give it a try and see how it works now.

@Jon2G I tried MAUI but for some reason i couldn't get the navigation manager to work unfortunately... Maybe i used an outdated template?
Anyways, I managed to find a workaround it by simply adding "return;" to an overrided OnSaveInstanceState on the android project --> MainActivity.cs instead of handling the bundle.
For some reason it works flawlessly... Could be that returning that event making it not call base.OnSaveInstanceState makes android handle the pause and background states properly? It's counter-intuitive haha.
As a side topic, is MBB capable of loading bootstrap's javascript to visually change the DOM once? I can't seem to find how honestly... MAUI does load them properly!


What port are needed for the panel?

The needed Ports depend on your setup, you can choose them as you want, but to give you examples.
Common WebServer Ports:

HTTP 80/tcp
HTTPS 443/tcp

Common Minecraft Ports:

25565/tcp (Default)
25577/tcp (BungeeCord)

Please make sure to read up security advice's for hosting web services to secure the Server.


Public IP resolved as client side and not server side

Environment
Self-Hosted (Docker)
System
docker on synology nas 20.10.23
Version
latest
Describe the problem
I added widget to get the Public IP but i found that the ip is resolved client side and not server side.
i'll try to explain:
when i'm connected from office , widget display the correct ip address , but when i'm connecting to dashy from home via vpn , widget display my home public ip address....
how to show the ip where dashy is installed? (office)
thank's
Additional info
No response
Please tick the boxes

[X] You have explained the issue clearly, and included all relevant info
[X] You are using a supported version of Dashy
[X] You've checked that this issue hasn't already been raised
[X] You've checked the docs and troubleshooting guide
[X] You agree to the code of conduct

@Lissy93 do you have any news?

Running into the same issue.
I would like Dashy to show the public ip of the machine its running on, not on the client i am viewing on.

I think that is expected as most of the workload happens client side, so the webpage can also run on devices like a raspberrypi.
@Lissy93 Could that be possible to get server side pub-ip?


Auto-resizable multiline input

I want to use input_text_multiline for a code editor but it only works if I init its string like ImString::with_capacity(1000).

I don't want to limit it. How can I make it grow automatically or at least get notified when it's reached its limit so that I can manually enlarge it?
Is there any way to get the current cursor char position inside an input_text or input_text_multiline?
Is there any way to do syntax highlighting or at least paren matching/highlighting?

I can't speak to the other questions here, but you may want to look at the Text Editors section of the Dear IMGUI wiki: https://github.com/ocornut/imgui/wiki
You may be able to wrap one of those other implementations to be used from imgui-rs, or at least see how they went about implementing various features you may need.

ImString is already growable. The with_capacity method simply creates an empty ImString with an initial capacity of 1000.
https://docs.rs/imgui/0.6.0/imgui/struct.ImString.html

Thanks for responding (I really need to go through this issue backlog...). What @db48x said is correct.

This is not really a great way to make Input robust as you need an upper bound on the user input size and/ or be very cautious and overallocate (and still possibly fail). I think the only way one might get around this currently is by reacting to each key press and resizing on demand although I’m not sure how this works for copy paste.
When I ran into this issue I just overallocated and did not look into it much further, maybe I’m missing something.

Hmm, I see, the issue description is a bit bad so I misunderstood. This is more about how we call the multiline input API.

I think you can use .resize_buffer(true) before building and it will resize as needed.
I made an example below. You can see the capacity go up as you enter stuff. Pasting works fine. I pasted in 20 million characters and it seemed to handle it fine.
use imgui::*;
mod support;
fn main() {
    let mut text = ImString::new("");
    let system = support::init(file!());
    system.main_loop(move |_, ui| {
        Window::new(im_str!("Hello world"))
            .size([400.0, 400.0], Condition::FirstUseEver)
            .build(ui, || {
                ui.label_text(
                    im_str!("Capacity"),
                    &ImString::new(format!("{}", text.capacity())),
                );
                ui.input_text_multiline(im_str!("##text"), &mut text, [300.0, 300.0])
                    .resize_buffer(true)
                    .build();
            });
    });
}

If anyone knows a better (shorter?) way to do ImString::new(format!("{}", text.capacity())) for the label, let me know haha.

Ah, this is all telling me that I need to spend more than a few minutes
looking into this (in my defense, it’s very late and I’m on vacation). I’ll
investigate more later, but that sounds right. Possibly should be the
default behavior. Thanks
On Tue, Dec 29, 2020 at 2:08 AM DGriffin91<EMAIL_ADDRESS>wrote:

I think you can use .resize_buffer(true) before building and it will
resize as needed.
I made an example below. You can see the capacity go up as you enter
stuff. Pasting works fine. I pasted in 20 million characters and it seemed
to handle it fine.
use imgui::*;mod support;fn main() {
let mut text = ImString::new("");
let system = support::init(file!());
system.main_loop(move |_, ui| {
Window::new(im_str!("Hello world"))
.size([400.0, 400.0], Condition::FirstUseEver)
.build(ui, || {
ui.label_text(
im_str!("Capacity"),
&ImString::new(format!("{}", text.capacity())),
);
ui.input_text_multiline(im_str!("##text"), &mut text, [300.0, 300.0])
.resize_buffer(true)
.build();
});
});
}
If anyone knows a better (shorter?) way to do ImString::new(format!("{}",
text.capacity())) for the label, let me know haha.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/imgui-rs/imgui-rs/issues/380#issuecomment-752021257,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAGSD6MIB2LZYMBSXKEI3YLSXGTBLANCNFSM4SRQJFIQ
.

I'm not sure if anyone would be currently depending on it not being the default behavior? I'm also not sure where this project is at currently on API stability. It could make sense if something like this is changed to highlight it in the changelog for the release so people can know to look for breaking changes. Obviously this is a pretty minor item, but I could see it being an issue if someone was expecting their ImString size to not be affected by a multiline text.
Have a good vacation :) Please don't feel like you can't take a break from working.

Hey all -- we talked this over briefly, and I think the current plan is the following:
first, resize_buffer(true) will be made default. It's not very Rust-y for it to not be, especially with the ImString song and dance we have to do.
Secondly, in the future, these inputs will get some rewrites to be simpler and nice to use (though this may end up being somewhat breaking) -- if you have any thoughts on that, drop em here https://github.com/imgui-rs/imgui-rs/issues/430.
I'll update this issue when I get around to pushing the change to the resizable buffer (tomorrow probably), which will hopefully be in time for the 0.7 release

With the rework for the text-input callbacks, I'm pretty sure this is now the default behaviour - possibly even the only currently available behaviour as do_not_resize is commented out, and there's not been huge(/any) complaints so far:
https://github.com/imgui-rs/imgui-rs/blob/v0.8.2/imgui/src/input_widget.rs#L384-L398


Sign off on the final QELP and QELAP

Probably we should tag these both as 0.9.4 for the one that release. @jlperla can close this issue once you've given them the OK.

OK closing since Jesse looked them over


Translate SocketTimeoutException to retryable service exception

This fixes #410 by translating SocketTimeoutException to retryable service-specific exceptions.

Fixed


Remove BTRFS

Because of a small change in the build script - the experimental BTRFS is to be tested again before release.
https://github.com/rootzoll/raspiblitz/pull/1854

Related note: I have recovered and running this image both on a EXT4 and a BTRFS RAID setup without issues: https://github.com/rootzoll/raspiblitz/issues/1199#issuecomment-737305510

I might have a problem:
admin@raspberrypi:~ $ sudo btrfs device stats /mnt/hdd/
[/dev/sda1].write_io_errs    16078
[/dev/sda1].read_io_errs     269
[/dev/sda1].flush_io_errs    6737
[/dev/sda1].corruption_errs  396
[/dev/sda1].generation_errs  715
[/dev/sdb].write_io_errs    0
[/dev/sdb].read_io_errs     0
[/dev/sdb].flush_io_errs    0
[/dev/sdb].corruption_errs  0

sda1 is my SSD
SDB is a USB SSD (Sandisk  Extreme Pro)
will run a scrub an see what is happening here

As part of the new Data Storage COncept for RaspiBlitz v1.12.0 I tend to remove BTRF:

Marking this for the next Teamdiscuss meeting.

TODO for v1.12.0
ON UPDATE --> Check if a former RaspiBlitz SSD was running BTRFS (like #3857) and then recommend using the older version and export a migration file.


[Enhancement] No link to mapview of rescue needed people from main page

No link to the mapview https://keralarescue.in/map/  from main page.Its very easy to find rescue needed people from mapview rather than scrolling the entire list.

We were using Gmaps API till now and it had a request limit, that's why we didn't make it public, now we have switched to free alternatives and will make it public after a short test

@ananthuma will fix that
@bobinson Thanks but we'll stay with the current Map since it actually performs better.

This is an instance of Ushahidi for flood mapping http://<IP_ADDRESS>/posts/create/2, it has csv import facility, if there is an data dump of the website, it is easy to import into it provided having geocoding API conversion on the non lat long entries. It is better to use tested and field deployed app than a custom developed one at present.
, visualization

Also add available or nearby camps in map view.

We can have existing data present in Ushahidi but updating it in real time would be hard, however, we can use this for mapping camps, supply posts and such.

Is there any dump of existing data, will work on geo referencing it

You can get the live map data from keralarescue.in/data as JSON

Hi, thanks for moving to leaflet/OSM!
There's clearly mis-located markers in the data. But people have typed in their locations.
Suggestions:

Add a "corrected_latlng" field to schema. Keep blank, have a trusted team fill that. On the map, use that field for location if not blank, and, put a different marker on it.
Add satellite imagery layer. (is there a latest-tiles-source for the Kerala region? Sat companies have released such imagery for other disasters)
Another field in schema, 1/0 flag for accurate/inaccurate and mark that too.

I can help code for all these if it's going to be on leaflet.

We have updated the map with some features now, we are looking into misentered data, we have added an option for users to enter lat and long by their own now.
I'll look into getting the satellite image data

@vigneshhari the points outside state boundary needs attention for correcting it, can be filtered by geometry intersect, is this data different from keralarescue.in/data, looking for the categories of points such as [Red: Needs Rescue,Green: Request Made For Other,Blue: Generic Request]

I'll ask the team to give a different color for pins outside the boundary.

Suggesting using Leaflet's L.divIcon. Reduces performance issues, enables much higher number of points on map (several thousands or more). Can assign it classes based on metadata and use CSS to give it any shape/color. Sharing a snippet. (If I can know where's the code that generates the markers, I can create a PR)
var stopmarker = L.marker([lat,lon], {
	icon: L.divIcon({
		className: `stop-divicon`,
		iconSize: [17, 17],
		html: labelShort
	})
});
stopmarker.addTo(stopsLayer);

@answerquest we use react-leaflet for adding those markers. You can find the code at https://github.com/aswinmohanme/kerala-flood-map

@aswinmohanme thanks, looking it up.
@nishadhka @vigneshhari the JSON data converts very easily into CSV here: https://konklone.io/json/ . One could also make a script to update latest id's at a place. Zapier is a possible tool for that. Suggesting: put on shared spreadsheet for location correction, or put into a CRM so each request can be tracked, etc. I'm focussing on map right now so just putting these ideas out there. Apologies, this digresses from this issue's subject.

Got 1391 rows of data from json file, after making a Kerala state boundary geomerty intersection, 783 rows stayed, imported into Ushahidi, the visualisation is as follows, all the points are not imported, it has issue in bulk import, have to do batch wise batch
, the Ushahidi has cool features of flagging the report as different levels of approval even as a csv column
, wishes people consider this option of Ushahidi that will be better for protecting the privacy, PS no one makes new pens while in examination hall


[0.6.2] nRF52840_xxAA: erase_sector fails with error code 1

Describe the bug
I get "erase_sector fails with error code 1" from both cargo-flash (tool) and probe_rs::flashing::download_file (library). I've tested with these combinations of probes: (CMSIS-DAP + nRF52840) and (J-Link + nRF52840).
To Reproduce
The ELF I'm using is basically what you get from compiling the snippet with opt-level = 'z':
#[cortex_m_rt::entry]
fn main() -> ! {
    loop { asm::nop() }
}

$ cargo flash --chip nrf52840
INFO probe_rs::flashing::download > Found 2 loadable sections:
INFO probe_rs::flashing::download >     .vector_table at 00000000 (1024 byte0)
INFO probe_rs::flashing::download >     .text at 00000400 (112 byte0)
INFO probe_rs::flashing::flasher  > Erasing sector at address 0x00000000
INFO probe_rs::flashing::flasher  > Done erasing sector. Result is 1. This took 20.939951ms
Error failed to flash app: The execution of 'erase_sector' failed with code 1

let probes = Probe::list_all();
let probe = probes[0].open()?;
let sess = probe.attach("nRF52840_xxAA")?;
let core = sess.attach_to_core(0)?;
flashing::download_file(&sess, path, Format::Elf)?;

Expected behavior
I expect both versions to be able to flash the device. OpenOCD is able to program the binary (tested both a nop loop and a blinky program):
$ openocd -f interface/cmsis-dap.cfg -f target/nrf52.cfg
(..)

$ telnet localhost 4444
> program path/to/elf
target halted due to debug-request, current mode: Thread
xPSR: 0x01000000 pc: 0x0000104c msp: 0x20040000
** Programming Started **
nRF52840-xxAA(build code: C0) 1024kB Flash, 256kB RAM
Flash protection of this nRF device is not supported
Adding extra erase range, 0x00000470 .. 0x00000fff
** Programming Finished **

Stacktrace
See logs in the STR section (I can provide trace logs as well)
Desktop

Arch Linux x86_64
cargo-flash 0.6.0
probe_rs 0.6.2

Additional context
AFAIK the device has no way to set write protection for Flash (it can set write protection for the "User Configuration" section but that's at a different address: 0x1000_1000). Both cargo flash and probe_rs::flashing also fail after OpenOCD flashed a binary (I tested this in case OpenOCD did remove write protection).
Any other info I can provide to help debug this?

Thanks for reporting this, I'll have a look into it right away. This definitely should work (I test stuff on my devkit with the 840 and the onboard JLink).
The binary is very simple too, so I'd definitely expect that to work!

@japaric so I just successfully flashed a blinky example onto my nRF52840 with
cargo flash --chip nrf52840 --release --example blinky

on the probe-rs master and 0.6.2.
Here is a complete log
yatekii@arcturo:~/repos/probe-rs/nrf-hal/boards/nRF52840-DK$ RUST_BACKTRACE=1 ~/repos/probe-rs/cargo-flash/target/debug/cargo-flash --chip nrf52840 --probe-selector 1366:1015:000683899362 --release --example blinky --log info
    Finished release [optimized + debuginfo] target(s) in 0.02s
    Flashing /home/yatekii/repos/probe-rs/nrf-hal/target/thumbv7em-none-eabihf/release/examples/blinky
        INFO cargo_flash > Protocol speed 0 kHz
        WARN probe_rs::config::registry > Found chip nRF52840_xxAA which matches given partial name nrf52840. Consider specifying its full name.
        INFO probe_rs::flashing::download > Found 3 loadable sections:
        INFO probe_rs::flashing::download >     .vector_table at 00000000 (256 byte0)
        INFO probe_rs::flashing::download >     .text at 00000100 (3272 byte0)
        INFO probe_rs::flashing::download >     .rodata at 00000DC8 (544 byte0)
        WARN probe_rs::architecture::arm::core::m4 > Reason for halt has changed, old reason was Halted(Request), new reason is Exception
        INFO probe_rs::flashing::flasher           > Erasing sector at address 0x00000000
        INFO probe_rs::flashing::flasher           > Done erasing sector. Result is 0. This took 95.986903ms
        WARN probe_rs::architecture::arm::core::m4 > Reason for halt has changed, old reason was Halted(Breakpoint), new reason is Request
        WARN probe_rs::architecture::arm::core::m4 > Reason for halt has changed, old reason was Halted(Request), new reason is Exception
        INFO probe_rs::flashing::flasher           > Flashing page at address 0x000000 with size: 4096
        INFO probe_rs::flashing::flasher           > Flashing took: 233.992089ms
     Erasing sectors ✔ [00:00:00] [###############################################################################]   4.00KB/  4.00KB @  10.72KB/s (eta 0s )
 Programming pages   ✔ [00:00:00] [###############################################################################]   4.00KB/  4.00KB @   4.52KB/s (eta 0s )

So I wonder what is broken for you.
First I thought that it could be the security feature the nRFs have but that would fail much earlier :/
(The nRFs can lock the MemoryAP which you can only unlock through a special commandsequence on a ControlAP, but as I said, this would explode way faster.).
The bad thing here is: The error code you are getting is the return code of the flash algorithm binary blob. And I have no clue what this specific blob means with a return value of 1.
Maybe we can look at the blob disassembly.
To be honest, I don't think a trace helps, but could you provide a trace with loglevel DEBUG please?

DEBUG log

probe-rs-cli info with the CMSIS-DAP probe (nRF52840 MDK)

After some digging, I most likely found the culprit here: http://openocd.zylin.com/#/c/5522/
@japaric could you try and erase the entire chip via OOCD/Segger tooling and then flash with cargo-flash afterwards to confirm that this is the culprit? :) At least for @jamesmunns this resolved the issue afaik (this is only a temporary solution ofc!).
For the real solution we need custom hooks on a per chip/manufacturer basis. I don't want this in the probe-rs core as this results in the crazy mess OOCD is.
@cbiffle is working on this right now (pdsc -> WASM with a probe-rs executor). I am not sure when it hits, but when it does, it should be straightforward to implement an unlocking routine in notime!

Okay, it is confirmed that a chip erase fixes the issue. This is most likely caused by accidentally written flash lock bytes.
The flash can be cleared with the nrf-recover tool.
We should step up our error game here and report properly that this is most likely because of a locked flash and that an erase would help.
@therealprof kindly started to clean up errors the last two days and we can use the same technique to improve erroring.

Maybe the cause is usage of the ACL peripheral?
The nRF52840 has 2 ways of blocking flash access:

APPROTECT in the UICR: entirely blocks the debug port (except for the "recover" operation), so this should've failed much earlier, so I don't think that's it.
ACL peripheral: this is intended for runtime protection (eg a bootloader write-protects itself before booting an application, so the application can't overwrite it). They get cleared on reset.

If it's the ACL, resetting before flashing should fix the issue.
Also, the docs on ACL say " debugger write access to a write-protected region will be Write-Ignored (WI). ", so maybe return value 1 from the flash algorithm means "verify failed"?

How do I get notified about this 7 days later? oO (sorry for offtopic but this is weird ...)
Hmm I agree with all theories. But since a full chip erase solves the problem, and otherwise it's seemingly permanent, I wouldn't expect it to be the runtime ACL? Or what do I miss here?

I will close this since an erase fixes this. Also, newer structures in probe-rs allow to unlock automatically with given permission :)


Order Ryobi One+ Trim Router Guide Rail

20-Nov-2021 Order Ryobi One+ Trim Router Guide Rail. Paid via MasterCard at time of ordering.

02-Dec-2021 Collected part ordered from Bunnings Airport Christchurch.


Update/dialog

The Dialog endpoint have an optional memory parameter and an optional log_level parameter.
The Dialog endpoint have a proxy option like the request.
The Audio endpoint is depreciated

Two more things to do defore being ok:

Modify the version in https://github.com/RecastAI/SDK-python/blob/master/setup.py#L15 to 4.0.0
In the README.md, change [2017] to [2018]

Good for me