Failed to parse CLI arguments; Failed to load sh: File not found

Hi,
thanks a lot for your work on the tflint image!
I am running the image on the latest version of gitlab-runner and do get:
Executing "step_script" stage of the job script
00:01
Using docker image sha256:7bb16013e6077cb34a49d4f93b07f0eff81301f094e3a21231ea64856d01c860 for ghcr.io/terraform-linters/tflint-bundle:v<IP_ADDRESS> with digest ghcr.io/terraform-linters/tflint-bundle@sha256:c1a9ab620e8d1473ee564a7b971a6fa02b7bc7a7d9842123c6fd0aac6548fe[18]...
Failed to parse CLI arguments; Failed to load `sh`: File not found

The logs of the container are empty.
This is how the gitlab pipeline stage looks like:
lint-modules:
  stage: tflint
  image: ghcr.io/terraform-linters/tflint-bundle:v<IP_ADDRESS>
  script:
    - tflint --init
    - tflint modules/xyz

I just face the issue with this image and as the 'Dockerfile' contains 'tflint' as entrypoint and my gitlab runner is configured to allow for entrypoint overrides, I am quiet puzzled, where this issue comes from. So the combination of gitlab runner and this image seems to result in this issue for me.

I also came across this issue which then led me to this issue. You can solve it by changing the entrypoint in your job:
tflint:
  image:
    name: ghcr.io/terraform-linters/tflint-bundle:v<IP_ADDRESS>
    entrypoint: [ '/bin/sh', '-c' ]
  script:
    - tflint

I am encountering this issue as well. @runningman suggestion to alter the entrypoint appears to have been deprecated as a valid option in Gitlab. If you try to use it gitlab-ci.yml file to fail validation. I noticed the tflint image also fails when simply launching it with >docker run -it ghcr.io/terraform-linters/tflint-bundle:v<IP_ADDRESS> sh or bash.

I don't think its deprecated, it is still documented https://docs.gitlab.com/ee/ci/docker/using_docker_images.html#override-the-entrypoint-of-an-image

That's odd. Here is my gitlab-ci.yml file.
`stages:

lint

variables:
TFLINT_VERSION: "v<IP_ADDRESS>"
TFLINT_CONFIG: ".tflint.hcl"
lint:
stage: lint
image: ghcr.io/terraform-linters/tflint-bundle:${TFLINT_VERSION}
script:
- tflint --version
- tflint --init
- tflint modules/aws
- tflint --config=${TFLINT_CONFIG} --format=json > gl-tf-lint.json
- find . -type f -name "*.tf" -exec dirname {} ; | sort -u | while read line; do (cd "$line" && tflint --config=${TFLINT_CONFIG}); done
artifacts:
paths:
- gl-tf-lint.json`
When I validate the file against the gitlab API it returns as valid.
http POST "https://gitlab.com/api/v4/ci/lint" "Content-Type:application/json" "PRIVATE-TOKEN:xxxxx" content="$(cat .gitlab-ci.yml)" ref=main options:='{"gitlab_version":"15.0"}'
{
"errors": [],
"includes": [],
"status": "valid",
"valid": true,
"warnings": []
}`
Then when I add the entrypoint entrypoint: [ '/bin/sh', '-c' ]
It returns ...
{
"errors": [
"jobs:lint config contains unknown keys: entrypoint"
],
"includes": [],
"status": "invalid",
"valid": false,
"warnings": []
}`

I finally got it to work. I restructured my gitlab-ci.yml like this.
`stages:

lint

variables:
TFLINT_VERSION: "v<IP_ADDRESS>"
TFLINT_CONFIG: ".tflint.hcl"
lint:
image:
name: ghcr.io/terraform-linters/tflint-bundle:${TFLINT_VERSION}
entrypoint: [""]
stage: lint
script:
- tflint --version
- tflint --init
- tflint --config=${TFLINT_CONFIG} --format=json > gl-tf-lint.json
- find . -type f -name "*.tf" -exec dirname {} ; | sort -u | while read line; do (cd "$line" && tflint --config=${TFLINT_CONFIG}); done
artifacts:
paths:
- gl-tf-lint.json`
Apparently the trick was to add the "name" key as a separate indented line under the "image" key. Then when I added the "entrypoint" line below that it returned as a valid file.


Fixing Tandem driver issues on Windows

Addresses the following issues:

Found an issue where it is assumed that a synchronization byte will always be at the beginning of the buffer, which is not always true. Fixed by discarding bytes correctly.
On a "serial timeout" or "serial pending" error, we now wait SEND_INC_MAX ms before sending again (replaces backoff algorithm)
Found an issue where sometimes if you send a request to the Tandem device, it just responds with a burst of 1s and 0s. This was fixed by retrying after a timeout, in which case it replies with the expected packet.
On a "system_error" error, we now disconnect and reconnect automatically and continue where we left off.
While recovering from a previous error, out-of-order packets were not re-requested. This was fixed by always re-requesting out-of-order packets.
During a recovery sequence, we were still requesting other packets, which made things slower. We now only request the packet we are trying to actually recover.
Binary search was using the wrong requester function.
We now increase the progress bar while searching for the newest event. This is useful for devices that haven't been used in a while.

 [uploader] Tandem Windows issues

In general LGTM @gniezen. A couple of cleanup suggestions but thats about it.
One question that I couldn't tell from the code - could we now get in the situation where we are trying to be clever recovering from errors that it just keeps trying and trying??

Thanks @jh-bate! I've addressed your comments and will build a new devel uploader off this branch for Nick and Howard to test.
With regards to retrying when something fails - we only do this once in each case. What I do think we may need to do is to add the abortTimers back in to throw an error, as we currently do nothing if it fails again after retrying (as in, we don't get stuck in a loop, but we also don't return a useful error).


Improved configuration for replication from shards

Restored old configuration
Added support for defaults in POJOs with ScalarWithDefault wrapper
Added shards sections under replication
Fixes for Eclipse compiler

Codecov Report

Merging #166 into devel will decrease coverage by 0.11%.
The diff coverage is 10.71%.

@@             Coverage Diff             @@
##             devel     #166      +/-   ##
===========================================
- Coverage     20.4%   20.28%   -0.12%
- Complexity    1909     1915       +6
===========================================
  Files          866      884      +18
  Lines        27721    27942     +221
  Branches      2406     2455      +49
===========================================
+ Hits          5656     5668      +12
- Misses       21647    21857     +210
+ Partials       418      417       -1

Impacted Files
Coverage Δ
Complexity Δ

.../standalone/config/model/protocol/mongo/Mongo.java
100% <ø> (ø)
7 <0> (ø)
:x:

.../config/model/protocol/mongo/ShardReplication.java
0% <0%> (ø)
0 <0> (?)

...validation/NotEmptySrtingWithDefaultValidator.java
0% <0%> (ø)
0 <0> (?)

.../config/jackson/StringWithDefaultDeserializer.java
0% <0%> (ø)
0 <0> (?)

.../RequiredParametersForAuthenticationValidator.java
0% <0%> (ø)
0 <0> (ø)
:x:

.../com/torodb/packaging/config/util/ConfigUtils.java
0% <0%> (ø)
0 <0> (ø)
:x:

.../config/jackson/ScalarWithDefaultDeserializer.java
0% <0%> (ø)
0 <0> (?)

...ackaging/util/MongoClientConfigurationFactory.java
0% <0%> (ø)
0 <0> (ø)
:x:

...nfig/validation/NoDuplicatedReplNameValidator.java
0% <0%> (ø)
0 <0> (ø)
:x:

...java/com/torodb/packaging/util/KeyStoreHelper.java
0% <0%> (ø)
0 <0> (ø)
:x:

... and 49 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update edf8a98...6039993. Read the comment docs.


fix spec syntax

It is for documentation

@blukat29 could you take a look for lint error?

@kjeom Try https://github.com/blukat29/web3klaytn/commit/f73fe3781e9c00b53575b9bc3b08f3a268bd6f79

After #587 merge, please rebase against dev. The fix is still not working.


Allow webpack configs to be authored in typescript (fixes #1241)

@SteveSandersonMS good to make your acquaintance again (a nod from my KnockoutJS days)
This fix is entirely untested and simply following your instructions so we can get the ball rolling. Is this really all that's needed for the typescript to get parsed on demand??
+    if (options.useTypescriptConfig) {
+      require('ts-node/register');
+    }
+

I'll try and see if I can build the solution, replace the DLL and node_modules in my project and confirm the fix.

@AdamWillden,
Thanks for your contribution.
To ensure that the project team has proper rights to use your work, please complete the Contribution License Agreement at https://cla2.dotnetfoundation.org.
It will cover your contributions to all .NET Foundation-managed open source projects.
Thanks,
.NET Foundation Pull Request Bot

@AdamWillden, thanks for signing the contribution license agreement. We will now validate the agreement and then the pull request.
Thanks, .NET Foundation Pull Request Bot

I can't seem to get the solution to build, are there any instructions I can follow? I'm using VS2017

Okay, so I can test the theory myself and am in the process of doing so.
Assuming the c# side works okay it's the TS we need to consider. Thus I'm using the following middleware options to mock the c# fix:
new WebpackDevMiddlewareOptions
{
    ConfigFile = "webpack.config.ts"
}

I have modified my node_modules copy of aspnet-webpack to mock the fix by sticking require('ts-node/register') in the same place.
By running this I've now found that using Typescript we define the config and use: export default which produces something different to the module.exports as such I need to 'detect' this.
A bit of logging has revealed that we receive the following object { default: [Function: config] }. I need to figure out the best way of detecting this...
Having come across this issue https://github.com/Microsoft/TypeScript/issues/2719 I have tested and found that console.log('Annnd'); console.log(webpackConfigExport.__esModule); results in
Microsoft.AspNetCore.NodeServices:Information: Annnd
Microsoft.AspNetCore.NodeServices:Information: true

So I can use that...

Right, yes, my imitation of this fix suggests it should work :-)

Can we please get this PR merged in? I really would like to jettison the javascript webpack config.

I saw an update but these changes were still missing

Why is getting user contributions in on this project so challenging?

@SteveSandersonMS I've resolved the conflicts created by the fix for #1378 - can you get this merged or reviewed so I don't have to maintain it please.

Thanks for this @AdamWillden. I'm planning to make a change to how this is implemented so that people can get the new functionality just from an updated NPM package without needing an updated NuGet package. This is because we can ship updates to the NPM package almost any time, whereas NuGet packages only ship when ASP.NET itself ships. So, please don't feel compelled to maintain this PR in any way in the meantime.

@SteveSandersonMS works for me considering we'll get the update sooner that way. Thanks for the response

I've been working around this using a file called webpack.dev.js:
require('ts-node/register')
module.exports = require("./webpack.config.ts");

And then using


column "variant_name" of relation "order_orderline" does not exist

What I'm trying to achieve
Complete checkout. Currently stuck at checkout/summary before exception is triggered.
Steps to reproduce the problem

setup saleor (no sample data)
add a few products
continue to checkout

What I expected to happen
…
Screenshots
traceback.txt
System information
Operating system: linux
Browser: chromium

Did you apply all migrations? This field was added few days ago.

Aye forgot this and I just got pull and merged. Thanks for reminder


Bug: StopIteration when there is a table with a Primary key, which also is a Foreign Key

Describe the bug
After the update to 0.13.0, I detected an issue that when there is a table that has a single primary key, which is a foreign key, stalette-admin throws out StopIteration error.
Before the update, there hasn't been such error.
To Reproduce
Create a table that has a Primary Key, which additionally is a Foreign key with SQLAlchemy, for example:
class Account(BaseABC):
    __tablename__ = "account"

    account_id = sa.Column(sa.Integer, primary_key=True, index=True)
    username = sa.Column(sa.String, unique=True, index=True)
    is_active = sa.Column(sa.Boolean, default=True)

class UserSettings(BaseABC):
    __tablename__ = "user_settings"

    account_id = sa.Column(
        sa.Integer, sa.ForeignKey("account.account_id"), primary_key=True
    )
    account = relationship(
        "Account",
        backref="settings",
        cascade="all, delete-orphan",
        single_parent=True,
    )

    theme = sa.Column(sa.String(40), server_default="light")

And when adding the view of UserSettings model with starlette-admin:
admin.add_view(ModelView(UserSettings, label="User Settings"))

It results in the StopIteration error.
Environment (please complete the following information):

Starlette-Admin version: 0.13.0
ORM/ODMs: SQLAlchemy
Python: 3.11

Track trace
  File "/home/abinba/PycharmProjects/funny-dolphine/src/app.py", line 9, in <module>
    app = create_app()
          ^^^^^^^^^^^^
  File "/home/abinba/PycharmProjects/funny-dolphine/src/web/factory.py", line 11, in create_app
    setup_admin(_app)
  File "/home/abinba/PycharmProjects/funny-dolphine/src/web/admin.py", line 50, in setup_admin
    admin.add_view(ModelView(UserSettings, label="User Settings"))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/abinba/PycharmProjects/funny-dolphine/venv/lib/python3.11/site-packages/starlette_admin/contrib/sqla/view.py", line 116, in __init__
    self.pk_field: BaseField = next(
                               ^^^^^
StopIteration

Additional context
I have been debugging it, and it seems that the problem is in this line:
starlette_admin/contrib/sqla/view.py (114-116)
self.pk_field: BaseField = next(
    f for f in self.fields if f.name == self.pk_attr
)

It iterates through the fields, but as convert_fields_list() function eliminates foreign key fields, it can't find the primary key.
In the previous version of stalette_admin, if I'm not mistaken, following was used to retrieve the primary key column:
self._pk_column: Column = next(iter(mapper.local_table.primary_key))

I can create a PR fixing the issue if you'd like.

I think that expected behavior can be divided into two cases in SQLAlchemy:
1. Table has a field, which is both PK and FK and there IS NO relationship SQLAlchemy construct.
class UserSettings(BaseABC):
    __tablename__ = "user_settings"

    account_id = sa.Column(
        sa.Integer, sa.ForeignKey("account.account_id"), primary_key=True
    )

    theme = sa.Column(sa.String(40), server_default="light")

2. Table has a field, which is both PK and FK and there IS a relationship construct.
class UserSettings(BaseABC):
    __tablename__ = "user_settings"

    account_id = sa.Column(
        sa.Integer, sa.ForeignKey("account.account_id"), primary_key=True
    )
    account = relationship(
        "Account",
        backref="settings",
        cascade="all, delete-orphan",
        single_parent=True,
    )

    theme = sa.Column(sa.String(40), server_default="light")

In the ideal case, pk_field should be assigned to be the RelationField in both cases, but I'm not yet sure if this is possible. I might still be misunderstanding something, please correct me if I'm wrong or if I'm thinking in the right direction.

The issue is related to the pk_field which is used to extract the primary key value from objects. The current implementation does not consider the possibility that the primary key may not be included in the fields list. To fix this, we can use a StringField for this special case since the value is only used to generate the edit, detail, ... URLs


bug in Dark mode

Description
On hovering over the card, we just cannot see elements that are present in the card except the comment section.
Steps to reproduce
Have to assign correct things to when ever dark mode option is selected.
Screenshots

Desktop (please complete the following information)
No response
Smartphone (please complete the following information)
No response
Additional information
No response

Thanks for finding/raising the issue, you can work on this!

@narayan954 Please assign this issue to me under GSSOC'23

@narayan954 Please assign this issue to me under GSSOC'23

go ahead!

Thanks


compile ignores the -j flag

Running DEBUG=1 rebar3 compile -j 1 outputs ===> Starting 3 compile worker(s) while building. Which might point out that rebar is actually ignoring the -j flag
Rebar3 wtf report
 version 3.0.0-alpha
 generated at 2015-03-12T14:12:40+00:00
=================
Please submit this along with your issue at https://github.com/rebar/rebar3/issues (and feel free to edit out private information, if any)
-----------------
Task:
Entered as:

-----------------
Operating System: x86_64-apple-darwin14.1.0
ERTS: Erlang/OTP 17 [erts-6.3.1] [source] [64-bit] [smp:4:4] [async-threads:0] [hipe] [kernel-poll:false] [dtrace]
Root Directory: /usr/local/Cellar/erlang/17.4.1/lib/erlang
Library directory: /usr/local/Cellar/erlang/17.4.1/lib/erlang/lib
-----------------
Loaded Applications:
[{inets,"INETS  CXC 138 49","5.10.5"},
 {ssl,"Erlang/OTP SSL application","5.3.8"},
 {public_key,"Public key infrastructure","0.22.1"},
 {asn1,"The Erlang ASN1 compiler version 3.0.3","3.0.3"},
 {crypto,"CRYPTO","3.4.2"},
 {stdlib,"ERTS  CXC 138 10","2.3"},
 {kernel,"ERTS  CXC 138 10","3.1"}]
-----------------
Escript path: XXXXXXXXXXXXXXXXXXXXXXXXXXXX
Providers:
  app_discovery as clean compile compile cover ct deps dialyzer do edoc escriptize eunit help install_deps lock new pkgs release shell tar update upgrade version wtf xref

Should be fixed in #262


LidarFollowLaunch needs maintenance

[ ] Change name to match other launch files
[ ] Call bringup.launch rather than separately launch all files
[ ] Document launch file in README.md
[ ] Update outdated calls (State.cpp, tractor pkg)

Pull Request #79 Fixes outdated calls and bringup.launch call.

Pull Request #79 now addresses entire issue.


Add score masking to seven atari environments

Fixes #61
Added score masking to the seven atari environments from the RLHF paper. I used a black background to cover the score, to cover enemy ship count for BeamRider, and cover the speedometer for Enduro.
Note that the number of lives is unmasked. This matches the original implementation in the RLHF paper. However, it seems that episode boundaries could be inferred from there. What do we think about this choice?

@Rocamonde, do you mind reviewing this PR?

However, it seems that episode boundaries could be inferred from there. What do we think about this choice?

It's an interesting question. I'd guess number of lives is often decision relevant for the agent -- e.g. it wants to be more risk averse when only one life left. So I lean against masking it, though I agree it introduces a confounder. Having an option to mask it (that we could leave off by default) is probably the best thing to do. But, masking the score is a definitive improvement over not masking it so this shouldn't hold up the PR.

Masking obs_from_state instead of environment interaction methods
Whether we should have wrappers always inherit from our base class for type safety.

These suggestions seem to be based on the assumption that the Atari environments implement the ResettablePOMDP interface, but they don't -- they're base gym.Env implementations. There's no obs_from_state method for us to mask.
I guess we could make the state be the non-masked observation, and mask it in the observation? That could work but I don't see the benefit.

Hi, I just incorporated some of the suggested changes!
I added the option of having unmasked atari environments. The naming convention is now seals/BeamRider-v5 for masked environments and seals/BeamRider-Unmasked-v5 for unmasked environments. The idea for the naming was to suggest that the masked environments are the standard ones. Let me know if you think I should include a warning when loading unmasked environments.

@Rocamonde stewy33 doesn't have permission to trigger them (our tests don't run on fork), I have done this now with git-push-fork-to-upstream-branch origin stewy33:master

Hi, I'm new to contributing to open-source projects, so I'm wondering if

I need to manually re-trigger the tests
Whether you guys prefer me to rebase or merge my changes and whether I should squash my commits (and if so, how much of this is automated).

@Rocamonde stewy33 doesn't have permission to trigger them (our tests don't run on fork), I have done this now with git-push-fork-to-upstream-branch origin stewy33:master

Thanks, just re-triggered this after the most recent changes.
@AdamGleave what's gonna happen when we do this for multiple open PRs? (apparently the way it works is by pushing to the trigger-integration branch.)
@stewy33:

I need to manually re-trigger the tests

Don't worry, I've just taken care of that. Normally it's automatic, but since your PR is from a fork, it's not.

2. Whether you guys prefer me to rebase or merge my changes and whether I should squash my commits (and if so, how much of this is automated).

IIRC the desirable option is the only one enabled when you press the merge button on the PR. AFAIK we always squash and merge (Adam correct me if this is wrong). Just click the button on the PR once the tests pass and GitHub should automatically do this and close the PR.

Seems like you have failing tests due to two small mistakes.
test_atari_unmasked_env_naming is failing because you mixed up two ways to check this and forgot to decide on one. SO currently you're doing
        noncompliant_envs = [
            (_get_score_region(name) is None and "Unmasked" not in name)
            for name in ATARI_ENVS
        ]
        assert len(noncompliant_envs) == 0

what you actually get is a list of bools with all elements False. So you can either
        noncompliant_envs = [
            name
            if (_get_score_region(name) is None and "Unmasked" not in name)
            for name in ATARI_ENVS
        ]

or
        is_each_env_noncompliant = [
            (_get_score_region(name) is None and "Unmasked" not in name)
            for name in ATARI_ENVS
        ]
        assert not any(is_each_env_noncompliant)

I probably prefer the first TBH.
Then for the second error, we manually hardcoded the names of some envs not to check because they take a while to show determinism. But since now we also have unmasked and masked versions, your unmasked envs are getting checked again and the tests are failing.
            # these environments take a while for their non-determinism to show.
            slow_random_envs = [
                "seals/Bowling-v5",
                "seals/Frogger-v5",
                "seals/KingKong-v5",
                "seals/Koolaid-v5",
                "seals/NameThisGame-v5",
            ]

I would just manually add the other tests to this list for now. Once you're at it, check that we have no hardcoded lists of environments anywhere else that are not being updated.

I would just manually add the other tests to this list for now.

Could also change the test to check if the prefix of the env name matches and skip accordingly.

Hi, I added another test to hopefully past code coverage. Could one of you re-trigger tests? If they pass, I think we're ready to merge.

@AdamGleave codecov is being annoying, I think it thinks the CI failed and is not reporting coverage, but I checked on the website and all looks good. Can you override this? the PR LGTM.

Hi, could someone trigger the tests one last time before merge? Just incorporated the desired minor changes.


Added http exceptions

Q
A

Is bugfix?
❌

New feature?
✔

Breaks BC?
❌

We're discussing it for while both internally and in chats. The main issue solved is that current approach isn't looking good:
$logger->log(...);
return $this->responseFactory
    ->createResponse(404)
    ->...;

It's similar to how redirects are made:
return $this->responseFactory
    ->createResponse(302)
    ->withHeader(
        'Location',
        $this->urlGenerator->generate('site/index')
    );

And I agree that both are quite verbose.
There are two approaches to the issue.
Exception as in this PR

Familiar Yii2-like syntax.
Good stacktraces.
May add logging to handler.
Developers will be able to throw these exceptions from domain layer and other non-controller/non-action places.
Won't solve a problem with redirects.

Response helpers
public function test1(Redirect $redirect): ResponseInterface
{
    return $redirect->to('https://www.yiiframework.com');
}

public function test2(HttpResponder $responder): ResponseInterface
{
     return $responder->notFound();
}

Solves not only errors but redirects and any possible responses.
Not the same as in Yii 2.
Do not allow usage outside of controller.
Stacktraces for logging will likely require some magic like debug_backtrace().

Related: https://github.com/yiisoft/yii-web/pull/332


Feature/27616 mappings extraction

https://hivemq.kanbanize.com/ctrl_board/57/cards/28013/details/

@cla-bot check


Fast sync downloader - allow max 5 trailing peers

PR description
Relax the no-tolerance restriction on trailing peers (peers that may be only 1 block behind head).
extracted from #6968
Thanks for sending a pull request! Have you done the following?

[ ] Checked out our contribution guidelines?
[ ] Considered documentation and added the doc-change-required label to this PR if updates are required.
[ ] Considered the changelog and included an update if required.
[ ] For database changes (e.g. KeyValueSegmentIdentifier) considered compatibility and performed forwards and backwards compatibility tests

Locally, you can run these tests to catch failures early:

[ ] unit tests: ./gradlew build
[ ] acceptance tests: ./gradlew acceptanceTest
[ ] integration tests: ./gradlew integrationTest
[ ] reference tests: ./gradlew ethereum:referenceTests:referenceTests

no longer relevant - we are using the safe block as the pivot block, which is usually about an epoch behind


External commit returns MlsGroup with pending commit

After joining a group externally, the caller always has to call merge_pending_commit before the group can be used. There is no reason (I can think of) why merge_pending_commit shouldn't be called in the external commit constructor of MlsGroup.

@kkohbrok when you'll do that you can also take some time to fix merge_pending_commit when joining through external commit. I fixed it in our fork with this commit.
The problem was that both commits (regular & external) were merged the same way and delete_previous_epoch_keypairs was called along the path which, of course is impossible for an external commit

Also, I think merging the commit should not be called in the constructor. The client should wait for its external commit to be accepted by the DS. Otherwise, another commit by another member could have arrived, invalidating the local GroupInfo the client is trying to join with. At this point, with the MlsGroup it'd have, the client would be unable to reconcile and would have to delete the Group, fetch another GroupInfo, retry etc..
This would shift some complexity to the caller, because while this external commit has not been accepted by the DS, it'd better not be used. One way to fix that would be by to introduce another group state. But to be honest I think that the current API is fine and should stay like that


build: Update Vulkan-Headers and Tools to 1.3.214

CI Vulkan-ExtensionLayer build queued with queue ID 16610.

CI Vulkan-ExtensionLayer build # 154 running.

CI Vulkan-ExtensionLayer build queued with queue ID 16622.

CI Vulkan-ExtensionLayer build # 155 running.

CI Vulkan-ExtensionLayer build # 155 passed.


Add MTU adjustment checks in remote VLAN examples

Signed-off-by: Laszlo Kiraly<EMAIL_ADDRESS>
Description
The MTU value of the interface in NSC can not be bigger than the MTU value set on base interface
Issue link
#7738
How Has This Been Tested?

[ ] Added unit testing to cover
[X] Tested manually
[X] Tested by integration testing
[ ] Have not tested

Types of changes

[X] Bug fix
[ ] New functionallity
[ ] Documentation
[ ] Refactoring
[ ] CI

LGTM


Feature request: Hide held packages when running sfsu status with an argument (e.g. -h)

Is your feature request related to a problem? Please describe
Not a problem.
Describe the solution you'd like
When the sfsu status command is invoked, it displays the statuses of all packages, including those that are on hold. While this behavior is intentional, I would like to hide the packages that are on hold for the sake of clarity.
And of course, when it is run with an additional argument, e.g. -h.
Describe alternatives you've considered
I've tried the following, but it doesn't work:
sfsu status | Where-Object { $_.Name -notlike '*Held package*' }

Additional context
I have several packages on hold, and it'd be nice just to see the ones that matter.
Thank you!

Sounds good.

sfsu status | Where-Object { $_.Name -notlike 'Held package' }

Just a note on this, passing sfsu output to PowerShell as an object won't work because of how PowerShell handles outputs. Scoop by default displays most results as PowerShell objects, which is where the pretty output comes from, but sfsu has custom tables and what not for this kind of stuff. I've tried mimicking PowerShell output to see if it can interpret it as an object but as far as I can tell PowerShell holds some metadata about command outputs, rather than just parsing a string.
What you can do is convert the json output from sfsu into a PowerShell object:
sfsu status --json | ConvertFrom-Json


offer onReset() hook

I am using 3rd party Tags Input component that is  bind to $form.rule.tags.
It  messing with Tainted state when form is reset using reset() function from superform.
It would be nice if there is a lifecycle event hook  e.g., onReset() that get triggered after reset, so  can add custom logic to untaint manually i.e.,  $tainted = undefined;

To reproduce: https://github.com/xmlking/svelte-starter-kit/tree/main/src/routes/(app)/dashboard/policies/[id]

Is it possible to apply the custom logic at the point where you call reset?

Yes I can. I did little over design componentizing Form reusable component  with builtin reset button :(
I was thing it might be useful  to offer  onReseted hook like you have onUpdated   in events docs.

Ok, good to hear that, I was asking because I'm not a big fan of arbitrary events, they work much like a 21:th century GOTO. In comparison, the submit events are all connected in a chain. So I'm hesitant to add any more events. There are two other events I'm considering in #137, but still, not certain, and nobody's asked for them, so they are in the icebox. :)

Agree custom reset functionality is app developer’s concern. They could hook custom logic pre/post from reset by superform provided reset() function


use tomli instead of deprecated toml

Hi, folks, thanks for robotframework-tidy!
This PR replaces use of the unmaintained toml with tomli, which is both maintained and supports the full 1.0 spec.
This should tide us over until PEP-680 tomllib  is widely distributed... but it's probably not worth adding a conditional until python 3.11 is actually released.

Sorry for the commit spam: was semi-surprised how picky the API is!


Missing file

Hi, thank you for your work.
While I was attempting to export the model via:
python tools/deployment/export_onnx.py --check -c configs/deim_dfine/deim_hgnetv2_s_coco.yml -r deim_dfine_hgnetv2_s_coco_120e.pth

It generated an error:
Traceback (most recent call last):
  File "DEIM/tools/deployment/export_onnx.py", line 16, in <module>
    from src.core import YAMLConfig
ModuleNotFoundError: No module named 'src'

Is it the case that some files are missing?

Hi! As a quick fix, you can change src.core to engine.core in the offending file, or, perhaps better, change the name of the engine folder to src. It seems that the engine folder was at some point called src, and when it was changed not all references to it were updated, but not sure.

I could fix this and create a pull request later today.

Thank you so much for your interest in our DEIM work! We hope it proves helpful to you.
We greatly appreciate @David-19940718  bringing up this issue. We have fixed it by addressing the path indexing problem in the files within the tools Thanks @AbelHutten for your kind and helpful feedback!

@ShihuaHuang95 Hi! Thank you for the fix.
However, I'm now encountering another issue: the process is being killed. My computer's 26GB of RAM gets filled up immediately. Could you please tell me how much resources this model conversion requires and why it needs so much memory?


Docker release version checker in Image

Is your feature request related to a problem? Please describe.
Create a check when the server is starting to see if the user is running the latest image (e.g. 0.31.0)
And let the user know when an upgrade is available, link to a doc that shows the user how to upgrade.

From some research I did yesterday it seems the only way to check what image a docker container is running from inside it is to install docker-cli inside the image and use that to check the docker sock.
Curl
cat /proc/self/cgroup | grep -o  -e "docker-..scope" | head -n 1 | sed "s/docker-(.).scope/\1/"
Using the /proc/self/cgroup file we could find information about the container's image and then curl docker.io to see if the current image has the same sha256 as the latest image.
This has the downside of course of adding extra bloat to the image.
The other option could be simply adding a file or a line inside a file with the current version and we could grep that file to determine the version and curl docker.io to see if there are tag versions with larger numbers than the version in the file, and if so pull latest. This file would have to be automatically updated with a GitHub action.
Which method would you prefer? @thijsvanloef
P.S. I may be missing something, but I could not find a way to check a container's image from within without root and without installing some sort of docker-cli or otherwise inside the image.

During release/build include a txt file in the container that has the version tag of that release.
At container start, compare the version from that file to the Github latest release tab using the github API

Okay, awesome. This was my preferred solution. I'll think about it for a minute and submit a draft PR


Translation interpolated twice, with and without [translateParams]

I'm submitting a ...
[x] bug report => check the FAQ and search github for a similar issue or PR before submitting
[ ] support request => check the FAQ and search github for a similar issue before submitting
[ ] feature request

Current behavior
With directive's translations <any translate="SOME_KEY" [translateParams]="someModel"></any> and with custom interpolation, TranslateMessageFormat for instance, the value interpolation is called twice: firstly without parameters (translate directive) and secondly with parameters (translateParams directive).
The problem is relative to the first call, without parameters. It fails every time a translation contains a param. The inherent cause comes from lambda functions generated by the custom interpolation compiler that do not support null or empty params...
Expected/desired behavior
... But, I think (but not sure) a better behavior should be restricting translation to only one call (with params) instead of two (one without then one with params).
Reproduction of the problem

use an interpolation compiler that generate lamba functions expecting interpolation params (without handling null or missing params)

translate using directives translate and translateParams

it should throw an exception

What is the expected behavior?
I should translate 😀
What is the motivation / use case for changing the behavior?
Three obvious solutions are possible : (i) make the external compiler compliant with missing interpolation params, (ii) try-catch interpolation on run-time or (iii) call only once the interpolation (with params).
I'm not in favor of (i) and (ii) solutions mainly to avoid side effects with "regular" exceptions (i.e. the developer doesn't provide the right object as parameter, ...).
Please tell us about your environment:

ngx-translate version: 9.1.1

ngx-translate-messageformat-compiler version: 3.0.0 (but not so important here)

Angular version: 5.2.6

Browser: all

Seems to be similar to #806

True, excepts that, here, it's not about the TranslateMessageFormat limitness, but it's about the first call made by the translate directive with partial data.

May be related to https://github.com/lephyrus/ngx-translate-messageformat-compiler/issues/35


new ES opendistro install on Ubuntu-18:  log is filled up with tons of errors java.nio.file.AccessDeniedException: /dev/shm/performanceanalyzer/XXX

It looks like Performance analyzer does not create its metrics-location directory
The log is filled with errors like
[2020-08-26T01:23:50,259][ERROR][c.a.o.e.p.r.EventLogFileHandler] [ip-10-120-0-200] Error writing entry 'NOT_INITIALIZED'. Cause: /dev/shm/performanceanalyzer/1598405025000.tmp
[2020-08-26T01:23:50,259][WARN ][stderr                   ] [ip-10-120-0-200] java.nio.file.AccessDeniedException: /dev/shm/performanceanalyzer/1598405030000.tmp

If I try to manually create  /dev/shm/performanceanalyze it seems to work for some time but then comes up with errors again
I'm not sure how to permanently fix this.
Environment:
root@ip-10-120-0-200:~# uname -a
Linux ip-10-120-0-200 5.3.0-1033-aws #35-Ubuntu SMP Wed Aug 5 15:47:17 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
root@ip-10-120-0-200:~# dpkg -l | grep elastic
ii  elasticsearch-oss                 7.8.0                               amd64        Distributed RESTful search engine built for the cloud
ii  opendistro-alerting               <IP_ADDRESS>-1                           amd64        Open Distro for Elasticsearch Alerting.      Reference documentation can be found at https://opendistro.github.io/elasticsearch/docs.
ii  opendistro-anomaly-detection      <IP_ADDRESS>-1                           amd64        Anomaly Detection plugin for OpenDistro for Elasticsearch.      Reference documentation can be found at https://opendistro.github.io/for-elasticsearch-docs/.
ii  opendistro-index-management       <IP_ADDRESS>-1                           amd64        Open Distro for Elasticsearch Index Management.      Reference documentation can be found at https://opendistro.github.io/elasticsearch/docs.
ii  opendistro-job-scheduler          <IP_ADDRESS>-1                           amd64        JobScheduler plugin for OpenDistro for Elasticsearch.      Reference documentation can be found at https://opendistro.github.io/elasticsearch/docs.
ii  opendistro-knn                    <IP_ADDRESS>-1                           amd64        KNN plugin for OpenDistro for Elasticsearch.      Reference documentation can be found at https://opendistro.github.io/for-elasticsearch-docs/.
ii  opendistro-knnlib                 <IP_ADDRESS>                             amd64        KNN JNI library built off of NMSLIB for OpenDistro for Elasticsearch. Reference documentation can be found at https://opendistro.github.io/for-elasticsearch-docs/.
ii  opendistro-performance-analyzer   <IP_ADDRESS>-1                           amd64        Performance Analyzer plugin for OpenDistro for Elasticsearch. Reference documentation can be found at https://opendistro.github.io/elasticsearch/docs.
ii  opendistro-security               <IP_ADDRESS>-0                           amd64        Security plugin for OpenDistro for Elasticsearch.  Reference documentation can be found at https://opendistro.github.io/elasticsearch/docs.
ii  opendistro-sql                    <IP_ADDRESS>-1                           amd64        SQL plugin for OpenDistro for Elasticsearch.      Reference documentation can be found at https://opendistro.github.io/for-elasticsearch-docs/.
ii  opendistroforelasticsearch        1.9.0-1                             amd64        OpenDistro for Elasticsearch.  Reference documentation can be found at https://opendistro.github.io/for-elasticsearch-docs/.
ii  opendistroforelasticsearch-kibana 1.9.0                               amd64        Explore and visualize your Elasticsearch data

Hi @akomlik,
What are the directory permissions of /dev/shm and /dev/shm/performanceanalyzer and  on your machine?
A quick fix for this issue is to modify the metrics-location property in your $ES_HOME/plugins/opendistro_performance_analyzer/pa_config/performance-analyzer.properties file to point to a directory that the elasticsearch user on your machine has access to.

Permissions are correct 1777
And elasticsearch user has write access to /dev/shm
My guess is PA assumes that directory specified in "metrics-location" already exists and there is no mechanism to guarantee that.
I even added creation of  /dev/shm/performanceanalyzer as part of machine boot-up procedure and still am seeing the issue.
It's as if something removes it prediodically.
I suppose I could point metrics-location directly to /dev/shm which is always there
root@ip-10-120-13-41:~# tail -1  /var/log/elasticsearch/elasticsearch.log
[2020-08-26T14:01:17,969][ERROR][c.a.o.e.p.r.EventLogFileHandler] [ip-10-120-13-41] Error writing entry 'NOT_INITIALIZED'. Cause: /dev/shm/performanceanalyzer/1598450475000.tmp

root@ip-10-120-13-41:~# ls -laF /dev/shm
total 0
drwxrwxrwt  2 root root   40 Aug 26 02:48 ./
drwxr-xr-x 14 root root 3220 Aug 26 02:47 ../

root@ip-10-120-13-41:~# su elasticsearch -c "mkdir /dev/shm/performanceanalyzer"

root@ip-10-120-13-41:~# ls -laF /dev/shm
total 0
drwxrwxrwt  3 root          root            60 Aug 26 14:01 ./
drwxr-xr-x 14 root          root          3220 Aug 26 02:47 ../
drwxrwxr-x  2 elasticsearch elasticsearch   80 Aug 26 14:01 performanceanalyzer/
root@ip-10-120-13-41:~# ls -laF /dev/shm/performanceanalyzer/
total 84
drwxrwxr-x 2 elasticsearch elasticsearch   120 Aug 26 14:01 ./
drwxrwxrwt 3 root          root             60 Aug 26 14:01 ../
-rw-r--r-- 1 elasticsearch elasticsearch     0 Aug 26 14:01<PHONE_NUMBER>000
-rw-r--r-- 1 elasticsearch elasticsearch 37811 Aug 26 14:01<PHONE_NUMBER>000
-rw-r--r-- 1 elasticsearch elasticsearch 39194 Aug 26 14:01<PHONE_NUMBER>000.tmp
-rw-r--r-- 1 elasticsearch elasticsearch  1106 Aug 26 14:01<PHONE_NUMBER>000.tmp


ImageDetRecordIter arbitrary image size

Hi, it seems that ImageDetRecordIter only supports fix image size now. Is there any way to support arbitrary image size for training SSD with keeping image ratios.  Thanks.

@caiqi The default code use a data_shape of 3 x 300 x 300 or 3 x 512 x 512. I've modified it to support arbitrary image size. Here are my modifications:

Add multi-scale support for argparse parameters in train.py, evaluate.py, deploy.py and demo.py.  Modify the "--data-shape" argument to:
parser.add_argument('--data-shape', 'data_shape', type=int, nargs='+', default=[300], help='set image size')

2.Modify the data-shape processing code in train_net.py. In function train_net, line 178:
if len(data_shape) ==1:
data_shape = (3, data_shape[0], data_shape[0])
elif len(data_shape) == 2:
data_shape = (3, data_shape[0], data_shape[1])
else:
data_shape = tuple(data_shape)

Assuming your input size is 3-channel image WxH, use "--data-shape 3 H W" or "--data-shape H W"; otherwise, if your input size is 1-channel grayscale WxH, use "--data-shape 1 H W".

@xioryu  Thank you very much. I originally thought of getting different size of images in different batches for batch size ==1 like that in Faster R-CNN to resize images with shorter size to 600.


test  add test

Proposed changes
Add regression test case for analyze
Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall


Documentation improvement: installation

Hi, I just now found out about way-cooler and wanted to try it out. I come from using XMonad and i3wm, so I was enticed into trying way-cooler.
Like any user would do, I headed to the projects homepage and went straight for the documentation. However, after skimming over the site, I didn't find an explicit section on installation. There are sections concerning the usage and operation (the D-Bus and Lua ones) of the window manager, but not installation.
Considering Rust and its tooling ecosystem are relatively new, I find that this could be a point of confusion or a stumbling block to anyone unfamiliar yet willing to try running tools that live in that ecosystem. I think it would be beneficial to describe correct or preferred manners of installing software written in Rust (in the context of way-cooler) that would alleviate new user entry. I believe this would also provide for better issue reporting and error troubleshooting if the installation path is somewhat predefined or at least commonly understood.

There is installation instructions in the README and we also have a download page on the website.
The website is currently a little slapped together, I'll probably clean it up in the future to make it more user friendly (e.g better download links). For now though I think there are sufficient links and instructions on how to download Way Cooler, they just may be slightly hidden.


Investigate options to apply MLEM models within Airflow DAGS

As discussed with @mnrozhkov and @tapadipti, it would be great if MLEM would somehow simplify model application within Airflow DAGs. Two questions to start with:

We can create something like MLEMOperator. What would be it's functionality? How it will help users?
We need to either build virtual environment or Docker image to apply the model in the required environment. Two options to provide those would be either do this in CI or as a task in the same DAG. We need to explore these options and find out how MLEM can simplify work for users here. Note: if you run multiple workers then it may be beneficial to build env in advance. If you have one worker, you may be ok with building it while running MLEMOperator.

Other notes:

Sometimes data is huge and you need to process it in chunks (it may or may not be the case with pyspark. Without pyspark it can be too hard to fit all data in RAM). We need some way to resolve this, e.g. iterate on batches and then compile answer containing predictions from all batches.
Usually, you DAG=processing+scoring. Roughly, in 25% you load data from disk; in other 50% you work with big data (pyspark, Hadoop); in last 25% you work with distributed computing (spark).

DAGs example https://gitlab.com/iterative.ai/cse/use_cases/home_credit_default/-/blob/airflow-dags/dags/scoring.py
Showcase of different options: https://gitlab.com/iterative.ai/cse/rnd/deploy-to-airflow
Summary from Mikhail https://iterativeai.slack.com/archives/C0249LW0HAQ/p1631885782026400

UPD: we can take a look at other orchestration tools (dagster, prefect, etc.)

Posting here a short discussion with @mike0sv:

mlem apply model hdfs://… should work already thanks to fsspec - need to check this though
if map-reduce saved many files that should be merged, the above command may not work. We may implement special Reader in MLEM that will receive many artifacts, will merge them in a single dataframe before apply (or will output each file as a batch)
to apply the models in spark, we can create a UDF for MLEM models
we can think about supporting sparkml in MLEM
we can implement export to spark UDF model that will start spark and run the data through it when you do mlem apply spark-udf-model … (could have a wow-effect)
with hadoop we can implement Readers as well, that will start spark and read data in batches

One issue I found: when you want to build a docker image for Batch Scoring scenario, you absolutely need to specify --server option. Why? Let's either specify fastapi as default so people won't need to confuse themselves about this, or allow to build without any server to skip installing extra dependencies like FastAPI people may not need.

For reference, a product similar to MLEM that does export to Airflow Pipelines. Need to take a deeper look at it https://docs.lineapy.org/en/latest/guide/build_pipelines/pipeline_basics.html

For now we are building docker images only for serving, so server option is required and run command is mlem serve.
That can be changed, but for that we first need to understand what it means to build docker for batch scoring


Allow the player to Pause the game

Pause the game when the player presses "Enter" during the GameScene execution.
The logic and strategy implemented for the "Game over" #10 feature should provide some guidance on this and possibly code to reuse.

I add the pause menu in the game, using "Caps Lock" to pause the game and "Backspace" to resume it


Remove -XX:+CMSClassUnloadingEnabled from .jvmopts

This causes JDK 17 to crash on my machine.

Thanks!


fix: pin build dependencies

Or else there is no guarantee what will be executed across different environments.
Also uses the same import convention as other projects
As discussed in https://github.com/nestoca/joy/pull/35#discussion_r1377915933
This is a no-op since joy doesn't use our other packages.

Side note, @davidmdm is there a reason why https://github.com/nestoca/joy/pull/35 got closed in favor of https://github.com/nestoca/joy/pull/38?

@j-martin , I closed the original PR, and created two pull requests:

the tooling change within the makefile
applying the automated changes

I made the 2nd PR point to the first, however it was approved and merged into the first, and then the first was merged into master. Ideally it should have been done the other way.

I see. In this case, I don't think we needed two PRs. Separating changes by commit is totally fine. 🙂


Add Missing QUnit Link

Added the missing link to the QUnit web page.

Hi @alarimer
Thanks for your contribution!
I will merge this PR as soon as the requested changes were fixed and the CLA was signed.
Thanks!

@Arkni I believe it should now be good.

I only one file updated and the only change I see on Github is the date. I think while doing the changes, somehow you forgot to update docs/qunit-overview.md.

Thanks a lot for your contribution!
And congrats on your first contribution :tada:

My apologies for the difficulties.  I thought it was a simple .md file change.  I am working on learning how to use GutHub in order to be a productive contributor.  Thanks again!

No worries! we all started somewhere.
There are some good tutorials about Git and contributing to OSS. Here are some:

Contributing to an open source project: https://egghead.io/courses/how-to-contribute-to-an-open-source-project-on-github
A Git tuto from Atlassian: https://www.atlassian.com/git/tutorials/

Good luck :)


Crossfade

Would be cool to have a crossfade between images.
Note: Glide only.

Closing in favour of #125


bug: ananke will always show recent posts on index

This seems to be a regression, either because of the recent ananke changes or because of changes in hugo.
Setting recent_posts_number = 0 will no longer disable showing recent posts on index.
I tested a little and I think this is because {{ $n_posts := $.Param "recent_posts_number" | default 3 }} will default to 3 if recent_posts_number is 0.
Expected Behavior
Ability to disable recent posts on index

Current Behavior
not possible to disable recent posts on index

Possible Solution
Add a parameter to toggle showing recent posts

Steps to Reproduce

set recent_posts_number = 0
observe recent posts are still being shown

The bigger picture (we need context)

Hugo Config

Ignore my comment ;) I did not look at the PR before commenting, and my comment was focused only on the $.Param issue, which is not related to the PR at all.


ordering typo in example?

Not sure if this is a typo or I'm just a bit lost and it's possible to nest the media type like that

It was a type.  Thanks for the PR.


Remove precommit GH Action

Remove precommit GH Action because Dependabot doesn't know how to run it before it opens PRs.

Hope I am not intruding, feel free to take a look at the NetBox DeviceType-Library GH Actions to see how we use pre-commit for PR's and such if you'd like.. Reach out if you have any questions as well.

@danner26 Long time no talk bud! No worries at all. Thanks for this. I will check it out.


”Devesel” is listed in the drop-down menu

Description:
"Devesel" is listed in the drop-down menu alongside its corresponding county and commune, according to the law.
Precondition:
The website is up an running.

Step 1
Type "Devesel" in the search bar.

Expected results
The location is listed in the drop-down menu as "Comuna Devesel, MEHEDINȚI".


Website structure mindmap

We decided to skip the mindmap, also to make sure we stay simple and accessible. But the structure is defined in this document:
https://secure.threefold.me/pad/#/2/pad/edit/64vtOgQDuyhhwQHALKJDZMLG/


有人吗 谁能告诉我How to find it  "peerMagic": "？？？？？？？？",

How to find it
"peerMagic": "？？？？？？？？",
I didn't find it in /dash/src/main.cpp.
谁能告诉我怎么样才能找到它
我在/dash/src/main.cpp 中没有找到它
<EMAIL_ADDRESS>

https://github.com/dashpay/dash/blob/master/src/chainparams.cpp#L123-L126

Thank you very much for your help.
"peerMagic": "bf0c6bbd",
"peerMagicTestnet": "？？？？？？"  how do find it
在 2016-12-17 20:26:54，"Holger Schinzel"<EMAIL_ADDRESS>写道：
https://github.com/dashpay/dash/blob/master/src/chainparams.cpp#L123-L126
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

https://github.com/dashpay/dash/blob/master/src/chainparams.cpp#L211-L214

谢谢  Thanks for your advice and encouragement.

谢谢 Thanks for your advice and encouragement.
在 2016-12-17 20:48:25，"Holger Schinzel"<EMAIL_ADDRESS>写道：
https://github.com/dashpay/dash/blob/master/src/chainparams.cpp#L211-L214
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.


RS D455 Cannot Be Detected

Before opening a new issue, we wanted to provide you with some useful suggestions (Click "Preview" above for a better view):

Consider checking out SDK examples.
Have you looked in our documentations?
Is you question a frequently asked one?
Try searching our GitHub Issues (open and closed) for a similar issue.

All users are welcomed to report bugs, ask questions, suggest or request enhancements and generally feel free to open new issue, even if they haven't followed any of the suggestions above :)

Required Info

Camera Model
D455

Firmware Version
latest

Operating System & Version
Linux(JetPack4.x)

Kernel Version (Linux Only)
(e.g. 4.14.13)

Platform
NVIDIA Jetson

SDK Version
2.50.0 }

Language
Cpp

Segment
others

Issue Description
Firstly, I have successfully compiled 2.50.0 SDK on the board.
I inserted the USB of D455 into the USB interface of Jetson Xavier, but Jetson could not detect the camera's access.When I use lsusb to view, no change before and after insertion.
Can you tell me about this situation? Thanks.
Note: When I insert it on the notebook, I can use Realsense normally. (on windows)

Add:
When I first connect to an ordinary USB camera on the board, Realsense can be successfully detected. But use the program of rs-viewer, it show the connection is 2.0 usb.

Hi @cjh3020889729  Which method did you use to install the librealsense SDK on your Jetson, please?

First of all thank you for your reply.
Sorry，I am not very clear，which the SDK compilation is done by my colleague. But it can be used well.
When I use the "Add" method mentioned above, the realsense camera can get deep images normally.
Do you mean, maybe some dependencies are missing before compiling SDK?

If you can add the camera using the Add Source option then this is a valid way of listing a RealSense camera in the Viewer if it is not appearing automatically when plugged in, as Add Source is the method by which more than one RealSense camera can be added to the camera list in the options side-panel.
When using Add Source, do you have the 'Intel RealSense D455' option available and select that?

Ok, I will to try and look at it.
After I test it, I will reply to you.
Thanks.

You are very welcome.  Thanks very much for your update and sharing the findings of your tests!

Case closed due to no further comments received.


Prompt theme

Hello,
I would love to know if by any chance you could share you prompt theme.
Love your work 😸

Same here.


add metrics support

size of batch
pipeline start and end timer
eventType ratio
other
cw, datadog, other
toPromise2 that returns metrics
trace - xray?
dynamodb capacity units?
enable/disable via global/local options ?

In addition to what you listed above:

Lambda Xray integration
New relic?
Memory cache hits / misses
Timing data - beyond just start and end timers for the pipeline, I'm thinking about enabling performance profiling. A utility you wrap pipeline steps in that adds additional timing data at a more granular level
Pipeline ratios for batch - More so than just eventTypes since in practice a single event type might get processed by multiple pipelines

defines a standard "metrics" field on uow
sinks/queries/steps/etc will add metrics as appropriate to the uow
a new toPromiseWithMetrics which will create histograms from uow.metrics per pipeline with min/avg/max/etc
and write the metrics as cloudwatch logs embedded metrics
https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format_Specification.html
return subset of metrics instead of Success

Can we call this issue resolved at this point?


hyperparameter tuning examples

@jameslamb that might be a @jsignell question, I'm not exactly sure. In this case the dataset itself is so small that sending it over the wire shouldn't be noticeable

Yeah I think James is right, but my understanding is that the slow part of the data is the initial read. I think once it's in memory it is fast to move it from worker to worker.


Service Worker: consider remove the restriction of the origin

@thangngoc89 currently you implemented the sw with restriction on the origin requestURL.origin == location.origin. What is the reason for that? For example if we have assets loaded from another domain (eg: an image) we won't have it cached.
What can be the issue about caching things not from our domain?!
Looks like a bug or not really useful restriction for me, but maybe you can enlighten me about the reason.

My website has stuff like video embed, music that come from others host. I think that should not be cache. Does it sound like a good reason to you ?

Why that should not be in cache, if that can be?

Well. You can remove the origin restriction but you must provide a way to customize the service worker template. We can't provide a template that fit for all. About the video, I think it's too large to cache a video.

There is currently no more restriction since we started to use webpack offline-plugin.


[Transformer] Add transformer for ordering tags

Add transformer for ordering tags in test cases and keywords, it should:

be non default
allow to sort case sensitively/insensitively, optionally in reverse order

Optional features to consider:

support custom sorters
configure keyword and test case order separately

It's actually really good idea to have consistent tagging. What about doing extra cleaning on tags - like removing duplicates, normalizing names.

It's actually really good idea to have consistent tagging! What about doing extra cleaning on tags - like removing duplicates, normalizing names?

Yeah, these would be useful as well, as a separate transformers or somewhere here?

Since it's "OrderTags" I think it's better to stick to just ordering them. We could add new transformer, ie "NormalizeTags" or whatever that would do above (and it would be default one). With extra option "common_to_force_tags" (temporary name) that would move tags that are repeated in every test case to Force Tags.
Regarding supporting custom orderers, do you have any idea on implementation? It's bit tricky. Simplest implementation would be evaluating passed string (but also dangerous)

I'll add this NormalizeTags transformer.
Regarding this custom sorter, here's some poc:
import sys
import importlib.machinery
path = sys.argv[1]
name = "sorter_module"
loader = importlib.machinery.SourceFileLoader(name, path)
sorter_module = loader.load_module()
print(sorted([1,2,3], key=sorter_module.sorter))

# run this scripty with like this: python example.py path_to_custom_sorter.py

# custom_sorter.py content:

# def sorter(item):
#     reversed = item * -1
#     return reversed

# stoudt from example.py:
# [3, 2, 1]

@adrszad I have merge the code and I will create release tommorow. Do you think we can close this issue? (we can create another one if we want to extend this transformer)


Lineage: add MetricTags to PipelineTag and ComponentTag

Once computed, MetricTags should probably be added to PipelineTag and ComponentTag records as they are expected to be an important part of how the run should be categorized.

@eledhwen Please can assign this task to me, thanks

Hello @ukeloveth!
Hi there.
Thank you for joining! We won't assign issues to non-maintainers however you are free to submit a MR!
Note that this is a "good first issue" as long as one has some grasp on what is actually being attempted, do you use this library in some capacity?


Replace Guava and ClassPathSearch with FastClasspathScanner round 2

Motivation:
FastClasspathScanner is an uber-fast, ultra-lightweight classpath scanner for Java, Scala and other JVM languages.
Modifications:
Replaced Guava and ClassPathSearch with FastClasspathScanner.
Result:
Less code to maintain.

@ShenSulake PTAL.


Xcode example project will not stop on breakpoints

Xcode project has incorrect product scheme settings; breakpoints in the project are ignored.

Product settings were incorrect for hosting the debugger; it was set to release mode instead of debug. Issue is resolved.


Results in parent TestClass affectes reports on nested ones

Following behavior is using require('neotest').run.run().
While cursor TestFalseNegative we get false positive on TestGroup:

Opening the summayr window on TestGroup reviews it failed:

Rerunning TestGroup, i.e. shows expected. behavior.
Similar effect when making outer fail, but intter pass:

Using nvim-0.8.0 and pytest-7.2.0
EDIT:
Missing any test in parent classes results in fail of nested one.

Thanks for the report! Should be working as expected now :smile:

Can confirm, thanks!


[FR] - Log reason when node switches tip to a fork

Internal/External
External:   Stake pool operator
Area
Other:   Logging
Describe the feature you'd like
Please log the reason why the node preferred another fork
Describe alternatives you've considered
The independent tool cncli provides logging of block data including the block VRF value into a sqlite database.  This database can be queried for insight into whether the likely reason the node preferred another fork was because the other fork terminal block had a lower block VRF and the tie break rule was applied.
Additional context / screenshots
The node knows the reason for switching tip to a competing fork but this reason isn't logged.  Rather the logs only confirm that the tip was switched.  But, was the reason due to the competing fork being longer?  Or was it due to the other fork's terminal block having a lower VRF causing the tie-break rule to be applied?  Or did the node prefer another fork some other reason?
This information would be really helpful when trying to identify what caused your own block to not be adopted.

Please stay as an open feature request.

Yes, please: if this is considered impractical to add I would like to hear why.  Our SPO operation believes this is important for quality assurance purposes.

@carbolymer what kind of engagement do the developers expect for this issue not to be "stale"?  There won't be anything new to report until someone the relevant team responds.
This log info has been long & vitally requested for diagnostic purposes and the need for it is never going to go away.  Those who need it most would be small stake pools with infrequent blocks... and therefore needed more in the near future if & when the K PoS parameter increases (as is constantly being discussed in governance conversations).
If this issue keeps being dismissed, the implication is that QA isn't very important for stake pools and/or chain density isn't that important for Cardano itself.  I don't think either of these things are true and I can state from SPO experience dating back to the beginning of the Shelley period that implementing this feature (which we arguably should have had from day 1) would be helpful for SPOs and node infrastructure operators at all levels of endeavour.

There was a slack discussion about this issue some time ago.
@jasagredo @amesgen would you mind sharing main takeaways here?


Create mbauspesalq.txt

Adds USP/ESALQ to the list of unis

@veller Please provide us with:

the school official full name (not an abbreviation; in Portuguese, please)
the school street address, including city and country
an URL of a page on the official website where the school offers an IT-related long-term (>1 year) course
a proof, which shows that the school recognizes the domain you are submitting as an official email domain for the students.

You can provide us with any of the following as the proof:

A copy of instruction (a hard-copy or electronic one) given to you by the school that tells you to use an email address in this email domain
An URL of a page at the official school website that says that students use this email domain
A reference to a recognized journal where an article was published by someone from the school, with explicit affiliation to the school, and e-mail address from the email domain
A WHOIS data that link the email domain to the school somehow
A copy of official letter from the school representative saying that the school provides e-mail addresses in this domain to the students
Anything else that can prove this fact in similar way, i.e. can be verified independently.

@veller You might miss my previous comment. Please react.

@veller I am sorry, this request remains unanswered for a while. I have to close it without merging. Please reopen and comment if you have an update regarding the aforementioned issue. Thank you for your understanding!

the school official full name (not an abbreviation; in Portuguese, please)
Universidade de São Paulo - Escola Superior de Agricultura Luiz de Queiroz
the school street address, including city and country
Av. Pádua Dias, 11 - Agronomia, Piracicaba - SP, 13418-900, Brazil
an URL of a page on the official website where the school offers an IT-related long-term (>1 year) course
https://mbauspesalq.com/cursos/mba-em-engenharia-de-software
a proof, which shows that the school recognizes the domain you are submitting as an official email domain for the students.
https://mbauspesalq.com/cursos/mba-em-engenharia-de-software


Documentation fix getting started

redirect only works if we're running the nextjs app as a server and not building a bunch of static pages (which is necessary with github pages). Changing the filename back to getting_started.mdx so it matches the current route

or we could do this https://docs.github.com/en/contributing/writing-for-github-docs/configuring-redirects


py_compile!/py_freeze! macros should emit call(s) to include_bytes! to force recompilation when input file(s) changes

Summary
I noticed that when using py_compile!, Cargo doesn't recompile my application when the referenced Python file changes. I think that py_compile! should emit a call to include_bytes! so that recompilation happens. py_freeze! could do the same.
Would you accept a PR to implement this? I have locally tested a fix for py_compile! already.

Hi! I am sorry for late response. I hadn't thought of using include_bytes! for this purpose before. That sounds reasonable to me. Could you please make a PR for it? Thank you!


Create a sled based repo in another repository

I'll be experimenting with a new design in another repository that implements the ipld store trait. The plan is to make it a drop in replacement for the ipld daemon located here https://github.com/ipfs-rust/ipld-daemon as discussed in #142
EDIT: in general I find design by comittee to be limiting. I prefer being able to explore ideas independently and once some experience has been gained, it can be shared, discussed and iterated on.

TBH, when I first took a look at this code a few months ago, I wanted to do exactly the same thing. I hope this goes well.


VPC SSH Module - Build Error

│ Error: Missing required argument
│
│   on stage1-resource-group.tf line 1, in module "resource_group":
│    1: module "resource_group" {
│
│ The argument "ibmcloud_api_key" is required, but no definition was found.
╵
╷
│ Error: Unsupported argument
│
│   on stage1-resource-group.tf line 5, in module "resource_group":
│    5:   provision           = false
│
│ An argument named "provision" is not expected here.
╵
╷
│ Warning: Value for undeclared variable
More Details
https://github.com/terraform-ibm-modules/terraform-ibm-toolkit-vpc-ssh/runs/8122601129?check_suite_focus=true

Addressed and build is success

Publication is failing
Run cloud-native-toolkit/action-repository-dispatch@main
Creating released respository dispatch for cloud-native-toolkit/garage-terraform-modules
client_payload: {"repo":"terraform-ibm-modules/terraform-ibm-toolkit-vpc-ssh","ref":"refs/tags/v1.7.2","sha":"3e45f45555af8d07f84c68a59b3b1c71b2d1dedc"}
Error: Repository not found OR token does not have sufficient permission


[CSL-1753] Hierarchical reports

What was done:

Report directory format changed to date </> reportType </> timestamp.
rLogs field was removed from ReportInfo -- it was redundant
rBuild changed type to Text in case we will want to put git revision there.
Changes do not break backward compatibility.

I will.
Yes, with old cardano-node.


Docs: usage of activate in the initial example

The initial example in the docs uses:
it->activate(arg);

This is a bit confusing, given that guards have a member function set_active, one starts to wonder if it points to a guard. Any other name, like start, would be better.
Anyway, is this a real life example? Wouldn't you rather create an automatic object, activate (or start) it there, and then move into the set? This way, you do not need a guard.

it is not pointing to a scope guard but a user's object. Here, activate is not supposed to mean something specific, it's just a placeholder to show that you do something on the inserted object that may potentially throw. I can rename the method, no problem.

Anyway, is this a real life example?

Yes, more or less. I've had code similar to this, where the object needed to be added to some sort of collection before it could be "activated", because it relied on the fact that it is present in the collection at that point.

Done. Thanks.


Rails 4.2 compatibility

This Pull Request aims to bring back compatibility with Rails 4.2/master since rails/rails@dc3f25c8a5aa64de9225f11498a389a2d31e880a has changed the @scope data structure from the router, without losing compatibility with existing versions of Rails where this object is a Hash.
In the matter of Rails 4.2, we also have this deprecation warning:
DEPRECATION WARNING: defining a route where `to` is a controller without an action is deprecated.  Please change "to: :users/omniauth_callbacks" to "controller: :users/omniauth_callbacks". (called from devise_omniauth_callback at /Users/lucas/code/ptec/devise/lib/devise/rails/routes.rb:436)

Changing the router code to use controller: controllers[:omniauth_callbacks] leads to the following error:
/opt/rubies/2.1.2/lib/ruby/gems/2.1.0/bundler/gems/rails-d5be08347fb7/actionpack/lib/action_dispatch/routing/mapper.rb:263:in `block (2 levels) in check_controller_and_action': 'users/auth/:action' is not a supported controller name. This can lead to potential routing problems. See http://guides.rubyonrails.org/routing.html#specifying-a-controller-to-use (ArgumentError)

[x] Fix router monkeypatch.
[x] Remove OmniAuth route warning.
[x] Deal with respond_with removal.
[x] Reorganize the project Gemfiles.
[ ] :shipit:

replace
gem 'devise'
to
gem 'devise', :git => 'https://github.com/plataformatec/devise.git'

I was still having errors. This SO answer fixed it for me - http://stackoverflow.com/questions/27611947/devise-raises-error-with-rails-4-2-upgrade

Use devise 3.4.1.


Refactor logic for scaling nodes

Nodes are scaled based on whether they are a multimer, or have state/infos.  Ideally these should act as functional transforms on the shape arguments instead of a sequence of if statements.
Cases that also need to be handled:

scale size based on the number of state/infos

Determine node width deterministically without using / reading / setting node.width()
Create a function in element.js:dimensions, that does the following:
w0 = Compute sum total width of all state vars based on length of each label
w1 = Computer sum total width of all units of information based on length of each label
wN = width of node = max(w0, w1)
This function will be used to deterministically compute how wide the node needs to be to accommodate each state var / unit of information and will set the node width before drawing any aux items.
Once width is set, draw each aux item without worrying about width overflow


Delete query issue

Hello Microsoft,
I need to delete the selected data. So, I am executing a delete query but it is not working.
I have faced the same issue in the past.on that time I had deleted data from another table then this query was working.
Now, I have faced the same issue again.
So, can you please send me a solution?
FYI, I have attached a Screen recording.
PFA,
Thanks & Regards,
Mahir Mansuri
mail<EMAIL_ADDRESS>deleteissue_23rd_sep_2020.zip

@MahirMansuri Please ask product support or in support forums.


buildah push can't handle ~ in local path

It's mostly a convenience thing, but buildah push can't handle  ~ in a local path.
sudo buildah push 82a6ded730f1 oci:~/glassfish.oci:latest
lstat /home/alex/work-docker/glassfish/~: no such file or directory

$ sudo buildah push 82a6ded730f1 oci-archive:~/glassfish.oci:latest
lstat /home/alex/work-docker/glassfish/~: no such file or directory

$ sudo buildah push 82a6ded730f1 docker-archive:~/glassfish.docker:latest
error pushing image "82a6ded730f1" to "docker-archive:~/glassfish.docker:latest": error copying layers and metadata: Error initializing destination docker-archive:~/glassfish.docker:docker.io/library/latest:latest: error opening file "~/glassfish.docker": open ~/glassfish.docker: no such file or directory

buildah version 1.0 (image-spec 1.0.0, runtime-spec 1.0.0)

@kallisti5 Well that's an interesting little bug.  Thanks for reporting it, will take a look.

@kallisti5, this is expected behaviour for tilde (~) expansion.
It is only expanded by the shell if the tilde is as the start of a word. Documented here:
https://www.gnu.org/software/libc/manual/html_node/Tilde-Expansion.html
Example showing this:
ls -l .~
ls: cannot access .~: No such file or directory

Alternatively you could use $HOME

@kallisti5 thanks for reporting this.  After a bunch of discussion we've decided to not make any changes in the code, but rather have added a note to or troubleshooting guide.


[Web][Docs] Implement search engine in v5 documentation page

[x] I have searched the issues of this repository and believe that this is not a duplicate.

Summary 💡

In chrome, after using stack overflow, an search engine (managed with uri chrome://settings/searchEngines) is added to chrome omnibar, so when user types stack then with [tab] key a search on stack overflow can start directly. (when I search abcdef it will open the page https://stackoverflow.com/search?q=abcdef)
I want to use this same function on https://mui.com/ maybe https://mui.com/search?q=abcdef can redirect to the homepage with the popup with abcdef typed in the pop-up.

Examples 🌈
Motivation 🔦
Usability

This is also about the search function although its not about the search bar component on the web. Linking it with #28415.
Also I'm thinking making an PR to solve this issue. So if there's no one doing this right now, maybe @mnajdova can assign this to me?

Hi @mnajdova. Recently I've been busy. I will try it next week on Christmas vacation.

@siriwatknp @hbjORbj before @PabloLION starts do you have some tips/doubts around this?

@siriwatknp @hbjORbj before @PabloLION starts do you have some tips/doubts around this?

From my understanding, the intention of @PabloLION is to improve the UX of the search. If there is no impact on the current behavior, I don't have any objection.

I confirm what @siriwatknp said, that my PR will not change any function of current function. I just took a look at the repo and it's so clean! I like it a lot! (although there's a typo in docs/pages/index.tsx, you'll see it in the PR)
However, I'm failing to locate where does the route happens:
I see in docs/pages/_app.js there's a findActivePage methods seems to do this job, yet it is in a JS file. Does the _app.js imply that it's outdated and needs updating to JS? or you are keeping it deliberately a JS file?

Should I change this docs/pages/_app.js file to add a new route?

My plan would be to first change https://mui.com/search to the homepage with the <DeferredAppSearch> opened.
Then add the query string to the search box. And do some exact match like when search keyword isbutton api.
Then add the search engine function of chrome (I've never used mozilla or other browsers, maybe you need to add it yourself, maybe it's a  tag which works cross-browser)

How does the plan sound to you?

Should I change this docs/pages/_app.js file to add a new route?

all pages are inside docs/src/pages.ts

How does the plan sound to you?

Sounds good, let's start and once we have something working we can polish it :)

Hi, @mnajdova about

Should I change this docs/pages/_app.js file to add a new route?

I noticed the file docs/src/pages.ts but it's for static routing to the pages. Not sure if I can use dynamic routes.

I added a `docs/pages/search.tsx` page (tl;dr reason)
The feature I want is like said in the summary, to parse URLs like `https://github.com/search?q=material-ui`. Lots of platforms use `/search` as the search page route but since we don't have a real search page, I want to use `Home` page with a property `{withSearchPopup: boolean}`.

- Adding a props to `docs/pages/index.tsx` like in `docs/pages/versions.js`
- Using Next Router Dynamic Routes

I didn't finish the part of automatic adding to search engine. It seems I need to create a new "OpenSearch description file". Yet I don't have the access to your netlify or other servers.
@siriwatknp, maybe you can consider doing this.

This seems to be a continuation of #16764.


Add NFRs to DG

closes #23

Great elaboration on some of the details! LGTM.

thanks mr tan u r the best @itsme-zeix


[BUG] Devices To Publish As Accessories Switch Switcher always switch back to Off

Hi
if i choose a dDevice from my Harmony hub in [] the device‘s name is on my Home App, everytime i hit the Switch on the App the Device starts, but the Switcher switches back to Status Off?! Any Solutions for that?

Hi, device switch are stateless since there is no way to know if a device is on or off through harmony hub. Only activities switch have a status retrieved from the hub.

wow thanks for the fast reply ;) okay this make sense :)


⚠ ClamAV has degraded performance

In c6937d0, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 435 ms

Resolved: ClamAV performance has improved in ad81541.


Add additional orientation option

Adds the option of having the object face the origin of the raycast.

/azp run

/azp run


Right stick autocentering seems to be broken again

You can guess what is happening again.

Fixed with new commits. Closing issue.


Converting sparse matrices directly to persistent zarr arrays

I'm trying to convert a huge scipy csc_matrix (27998 x 1306127, int32) to a persistent zarr array. Here is the code I'm using:
import tables
import scipy.sparse as sp_sparse
import zarr

f = tables.open_file('1M_neurons_filtered_gene_bc_matrices_h5.h5')
matrix = sp_sparse.csc_matrix((f.root.mm10.data[:],
                               f.root.mm10.indices[:],
                               f.root.mm10.indptr[:]),
                              shape=f.root.mm10.shape[:])
matrix = matrix.todense()
zarr.array(matrix, store='1m.zarr', overwrite=True)

However, this fails because scipy cannot convert sparse matrices with more than 2**31 non-zero elements to dense (https://github.com/scipy/scipy/issues/7230).
So I was wondering whether it would be possible to convert a sparse matrix to zarr without converting it first to dense array.
If I remove the dense conversion line (matrix = matrix.todense()), it fails with the following exception:
Traceback (most recent call last):
  File "convert.py", line 23, in <module>
    zarr.array(matrix, store='1m.zarr', overwrite=True)
  File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/creation.py", line 311, in array
    z[:] = data
  File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/core.py", line 619, in __setitem__
    value[value_selection])
  File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/core.py", line 693, in _chunk_setitem
    self._chunk_setitem_nosync(cidx, item, value)
  File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/core.py", line 735, in _chunk_setitem_nosync
    chunk = np.ascontiguousarray(value, dtype=self._dtype)
  File "/home/g/miniconda3/lib/python3.5/site-packages/numpy/core/numeric.py", line 620, in ascontiguousarray
    return array(a, dtype, copy=False, order='C', ndmin=1)
ValueError: setting an array element with a sequence.
Closing remaining open files:1M_neurons_filtered_gene_bc_matrices_h5.h5...done

Here is the URL to the HDF file for full reproducibility: https://s3-us-west-2.amazonaws.com/10x.files/samples/cell/1M_neurons/1M_neurons_filtered_gene_bc_matrices_h5.h5
This issue can also be reproduced easily via the following code:
import numpy as np
import scipy.sparse as sp
import zarr

x = sp.csc_matrix((3, 4), dtype=np.int8)
y = zarr.array(x)

Thank you for reporting. I'm sure there will be a way to do this without
converting the entire sparse array to dense format in one go. I'm away from
office at the moment but happy to look when back.
On Wed, 2 Aug 2017 at 16:10, Gökçen Eraslan<EMAIL_ADDRESS>wrote:

I'm trying to convert a huge scipy csc_matrix (27998 x 1306127, int32) to
a persistent zarr array. Here is the code I'm using:
import tablesimport scipy.sparse as sp_sparseimport zarr
f = tables.open_file('1M_neurons_filtered_gene_bc_matrices_h5.h5')
matrix = sp_sparse.csc_matrix((f.root.mm10.data[:],
f.root.mm10.indices[:],
f.root.mm10.indptr[:]),
shape=f.root.mm10.shape[:])
matrix = matrix.todense()
zarr.array(matrix, store='1m.zarr', overwrite=True)
However, this fails because scipy cannot convert sparse matrices with more
than 2**31 non-zero elements to dense (scipy/scipy#7230
https://github.com/scipy/scipy/issues/7230).
So I was wondering whether it would be possible to convert a sparse matrix
to zarr without converting it first to dense array.
If I remove the dense conversion line (matrix = matrix.todense()), it
fails with the following exception:
Traceback (most recent call last):
File "convert.py", line 23, in
zarr.array(matrix, store='1m.zarr', overwrite=True)
File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/creation.py", line 311, in array
z[:] = data
File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/core.py", line 619, in setitem
value[value_selection])
File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/core.py", line 693, in _chunk_setitem
self._chunk_setitem_nosync(cidx, item, value)
File "/home/g/miniconda3/lib/python3.5/site-packages/zarr/core.py", line 735, in _chunk_setitem_nosync
chunk = np.ascontiguousarray(value, dtype=self._dtype)
File "/home/g/miniconda3/lib/python3.5/site-packages/numpy/core/numeric.py", line 620, in ascontiguousarray
return array(a, dtype, copy=False, order='C', ndmin=1)
ValueError: setting an array element with a sequence.
Closing remaining open files:1M_neurons_filtered_gene_bc_matrices_h5.h5...done
Here is the URL to the HDF file for full reproducibility:
https://s3-us-west-2.amazonaws.com/10x.files/samples/cell/1M_neurons/1M_neurons_filtered_gene_bc_matrices_h5.h5
This issue can also be reproduced easily via the following code:
import numpy as npimport scipy.sparse as sp
x = sp.csc_matrix((3, 4), dtype=np.int8)
y = zarr.array(x)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/alimanfoo/zarr/issues/152, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAq8QsrYrHDJOQNLjtvauNFnRyUyAPiCks5sUJF6gaJpZM4OrPOV
.

--
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

In master, there are some new features that should help with this. Have included a simplistic example below to demonstrate this. It uses a coo_matrix array. That said, it is possible to convert from the csc_matrix to the coo_matrix using the tocoo method.
In [1]: import numpy as np

In [2]: import scipy.sparse as sparse

In [3]: import zarr

In [4]: row = np.array([0, 3, 1, 0])

In [5]: col = np.array([0, 3, 1, 2])

In [6]: data = np.array([4, 5, 7, 9])

In [7]: a = sparse.coo_matrix((data, (row, col)), shape=(4, 4))

In [8]: z = zarr.zeros(shape=a.shape, chunks=4, dtype=a.dtype)

In [9]: z.set_coordinate_selection((a.row, a.col), a.data)

In [10]: z[...]
Out[10]:
array([[4, 0, 9, 0],
       [0, 7, 0, 0],
       [0, 0, 0, 0],
       [0, 0, 0, 5]])

Going to close as Zarr 2.2.0rc3 supports the strategy outlined in the comment above. Guessing this solves your issue @gokceneraslan, so will close this out. However if that is not the case, please feel free to let us know and we can reopen and discuss further. Thanks for the report.

Nice application of coordinate indexing!
On Wed, 14 Feb 2018 at 05:17, jakirkham<EMAIL_ADDRESS>wrote:

Going to close as Zarr 2.2.0rc3 supports the strategy outlined in the
comment above. Guessing this solves your issue @gokceneraslan
https://github.com/gokceneraslan, so will close this out. However if
that is not the case, please feel free to let us know and we can reopen and
discuss further. Thanks for the report.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/zarr-developers/zarr/issues/152#issuecomment-365499097,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAq8QqWDePji_1rLcI_mkgtcTq6PzJwzks5tUmxggaJpZM4OrPOV
.

--
If I do not respond to an email within a few days and you need a response,
please feel free to resend your email and/or contact me by other means.
Alistair Miles
Head of Epidemiological Informatics
Centre for Genomics and Global Health http://cggh.org
Big Data Institute Building
Old Road Campus
Roosevelt Drive
Oxford
OX3 7LF
United Kingdom
Phone: +44 (0)1865 743596 or +44 (0)7866 541624
Skype: londonbonsaipurple
Email<EMAIL_ADDRESS>Web: http://a http://purl.org/net/alimanlimanfoo.github.io/
Twitter: https://twitter.com/alimanfoo

Just as an additional comment here, users can customize this approach as much as is needed. First users are able to disable compression. Second chunks can be set so as to each include a single value. For instance, based off of the example above, one can do the following.
In [1]: import zarr

In [2]: z = zarr.zeros(shape=(4, 4), chunks=(1, 1), dtype=int, compressor=None)

In [3]: z.set_coordinate_selection(([0, 3, 1, 0], [0, 3, 1, 2]), [4, 5, 7, 9])

In [4]: z.chunk_store
Out[4]:
{'.zarray': b'{\n    "chunks": [\n        1,\n        1\n    ],\n    "compressor": null,\n    "dtype": "<i8",\n    "fill_value": 0,\n    "filters": null,\n    "order": "C",\n    "shape": [\n        4,\n        4\n    ],\n    "zarr_format": 2\n}',
 '0.0': array([[4]]),
 '0.2': array([[9]]),
 '1.1': array([[7]]),
 '3.3': array([[5]])}

This amounts to an in-memory representation of a COO sparse array and can easily be used with other stores. Thus it can trivially be written to disk, stored in databases, and/or written to a cloud-based key-value store.
Sorry if this is all already obvious, just figured I'd point it out in case it wasn't. Happy to add an example like this to the docs if it helps. :)

Minor note: Currently the in-memory representation of the chunk_store may change a little bit in the next release (e.g. using bytes objects for values ( https://github.com/zarr-developers/zarr/pull/359 ) and possibly defaulting to a different store than dict ( https://github.com/zarr-developers/zarr/pull/351 )), but this won't affect the availability of this functionality or how any of the other stores work.

Should add this is also possible with the newer Sparse library, which is gaining traction. Here's the same example as before, but with Sparse instead. Have skipped inspecting the Zarr Array as it is no different from the previous examples.
In [1]: import numpy as np

In [2]: import sparse

In [3]: import zarr

In [4]: coords = [[0, 3, 1, 0], [0, 3, 1, 2]]

In [5]: data = np.array([4, 5, 7, 9])

In [6]: shape = (4, 4)

In [7]: a = sparse.COO(coords, data, shape=shape)

In [8]: z = zarr.zeros(shape=a.shape, chunks=a.ndim*(1,), dtype=a.dtype, compres
   ...: sor=None)

In [9]: z.set_coordinate_selection(tuple(a.coords), a.data)

FWIW I'm not sure there is much value in actually working with an in-memory Zarr array in this case as Sparse already has an in-memory representation and provides many computation operations that would be useful here. That said, I do think leveraging other Zarr stores to persist Sparse arrays to disk could be interesting.
It also may be interesting to take a look at what storage options make sense for these Sparse arrays. Perhaps single file storage like LMDBStore or ZipStore make more sense. Alternatively there may be other storage formats that people like to use. Would be interesting to hear a bit more about real world use cases.

cc @ryan-williams (in case this and/or the xrefs are of interest)

👍 following. I am currently using the sparse package for ocean model transport matrix diagnostics. I would love to be able to efficiently serialize these to zarr.


Enables ALB Controller readiness gates for exec unit deployments

Resolves #557
This PR enables the ALB Controller pod readiness gate for pods associated with an execution unit (docs) by implementing the following:

Adding a Transformations field to the HelmChart struct and resource factory
Adding a transformation to the ALB Controller Helm chart that modifies its mpod.elbv2.k8s.aws webhook to:

Remove its namespaceSelector field to allow us to use it in all namespaces
Add a matchLabels matcher to its objectSelector field, enabling the pod readiness gate for any pod with the elbv2.k8s.aws/pod-readiness-gate-inject: enabled label

Adding the elbv2.k8s.aws/pod-readiness-gate-inject: enabled label to the pod definition in our exec unit deployment template.

Standard checks

Unit tests: Any special considerations?
Docs: Do we need to update any docs, internal or public?
Backwards compatibility: Will this break existing apps? If so, what would be the extra work required to keep them working?

I don't have a review to add other than the links to docs are great - can you find a way to include them as godoc/comments in the code?


Conexant CX20755 not working on Sierra 10.12.6?

Good evening everybody,
I've successfully used AppleALC on 10.12.5 for this codec, but after the latest update, it doesn't detect any devices.
Essential logs:
Codec
Conexant CX20755 (from specification)
Device
$ ioreg -rxn IOHDACodecDevice
+-o IOHDACodecDevice@1B,0  <class IOHDACodecDevice, id 0x10000032d, !registered, !matched, active, busy 0, retain 5>
    {
    }

.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/ACPIBatteryManager.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/AppleALC.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/AppleBacklightInjector.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/AtherosE2200Ethernet.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/DirectHW.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/FakePCIID.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/FakePCIID_Intel_HD_Graphics.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/GenericUSBXHCI.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/Lilu.kext
/Volumes/EFI/EFI/CLOVER/kexts/10.12/VoodooPS2Controller.kext
/Volumes/EFI/EFI/CLOVER/kexts/Other/FakeSMC.kext
/Volumes/EFI/EFI/CLOVER/kexts/Other/FakeSMC_ACPISensors.kext
/Volumes/EFI/EFI/CLOVER/kexts/Other/FakeSMC_CPUSensors.kext
/Volumes/EFI/EFI/CLOVER/kexts/Other/FakeSMC_GPUSensors.kext
/Volumes/EFI/EFI/CLOVER/kexts/Other/FakeSMC_LPCSensors.kext

Clover's config
Attachment: clover.plist
Thank you for any kind help!

I am pretty sure this is possible, but I am afraid we cannot really help you. If you contact the developer of those resources, he might give you a hint.

I still think it might be issue with AppleALC, because after reinstalling I
observed, that sound works randomly, on about one of three boots. Also, I
want to add that I compiled Lilu and AppleALC from git, and it didn't
helped in my case. Anyways, I'll be trying to contact the developer of this
specific implementation.
23.07.2017 18:31 "vit9696"<EMAIL_ADDRESS>napisał(a):

I am pretty sure this is possible, but I am afraid we cannot really help
you. If you contact the developer of those resources, he might give you a
hint.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/vit9696/AppleALC/issues/186#issuecomment-317265043,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKH8NsxXPpVzmsoKUkgs9uv5PNUeDJ7oks5sQ3VegaJpZM4OdRnd
.

Are you sure you have AppleALC and Lilu installed in EFI and AppleHDA is ok?
There is a similar bug here: https://github.com/vit9696/AppleALC/issues/176.
Do you have AppleALC loaded when there is no sound?
I think I had a few other reports like that, and the issue was something confusing in ACPI.

I'm sure that AppleHDA is Vanilla and all kexts are in Efi partition. Before 10.12.6 there weren't any problems on the same configuration. Kextstat output is the same in both cases. AppleHDA is loaded after AppleALC and Lilu.

Well, mhm. I have AppleALC here on 10.12.6, as well as some other people, and it works just fine. So I am afraid the issue is very specific to your codec :(.
Could you try taking the AppleALC resources and manually patching AppleHDA to see if the issue is exists in this case as well?

On my desktop computer AppleALC works too. So, as 10.12.6 brought some changes in audio system, maybe it really means, that patches are incompatible? But, on the other side, it works from time to time…

I am unaware about any changes in 10.12.6, in fact you are the first one. Let me know if you get more details.


Techne CDN

Goal: Setup a CDN for the Techne
The CDN will contain all versions of Techne under a unique URL and it will be product independent.
Taks

[x] Get a proposed Solution from the Infra team
[ ] Talks with the Infra team to see their requirements

Define a stable endpoint and URL schema
Get access to S3
Define how the updating of S3 will go
Define the cache invalidation policy

[ ] Prepare all legacy Techne Versions, from v0.1.2 to v1.5.7. To deploy in the CDN
[ ] Incorporate process for adding new versions to S3 in the build toolchain
[ ] Incorporate the deploy to S3 into the deployment process

Proposed solution
Have all versions of the library in a AWS S3 Bucket.

Endpoint (to be agreed)
https://cdn.yaas.io/libraries/techne/vX.Y.Z/

We got the S3 buckets:

techne2.yaas.io for staging purposes
techne.yaas.io for the CDN

We have a temp solution for this one.


Introduce some test I/O types

We don't necessarily want to establish TCP connections for every single protocol test.
Also we want to be able to trivially test that parses don't blow up when you feed them 1 byte at a time, that sort of thing.

Codecov Report

Merging #18 (d91a26f) into main (aa25b6f) will decrease coverage by 0.20%.
The diff coverage is 82.20%.

:exclamation: Current head d91a26f differs from pull request most recent head 6ea6df7. Consider uploading reports for the commit 6ea6df7 to get more accurate results

@@            Coverage Diff             @@
##             main      #18      +/-   ##
==========================================
- Coverage   84.79%   84.58%   -0.21%
==========================================
  Files          11       11
  Lines        1394     1512     +118
==========================================
+ Hits         1182     1279      +97
- Misses        212      233      +21

Impacted Files
Coverage Δ

src/io.rs
84.17% <82.20%> (-11.07%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


cilium-cli: retry exec-in-pod requests in case of transient errors

In some cases, connectivity tests fail due to transient errors with the underlying SPDY stream during command execution in pods. This is especially prevalent on AKS. The source of these errors is unknown but according to https://github.com/cilium/cilium/issues/29845#issuecomment-1856143700 (and following discussion) there is not much that can be done to prevent them, except for treating the error as transient and retrying the respective request. Do that the known cases documented in #29845.
Fixes: #29845

/ci-aks

/test