Revaluate Sunny Test profile

The sunny test profile feel a little incomplete as it is currently only running 4 ITs (@Category(SunnyDayTests.class):

test/src/main/java/org/apache/accumulo/test/functional/NativeMapIT.java:@Category(SunnyDayTests.class)
test/src/main/java/org/apache/accumulo/test/rpc/ThriftBehaviorIT.java:@Category(SunnyDayTests.class)
test/src/main/java/org/apache/accumulo/test/InMemoryMapIT.java:@Category(SunnyDayTests.class)
test/src/main/java/org/apache/accumulo/test/start/KeywordStartIT.java:@Category(SunnyDayTests.class)

I think we could add a few ITs to make sure we have basic functionality covered. I think including ITs dealing with compactions, the metadata table, bulk import or write ahead logs would be good.

As long as it's limited to basic functionality. The idea is that these tests should be very limited, and be a very quick sanity check to make sure that core functionality isn't broken. They should be fast to run, highly reliable and never flaky, and be able to run on meager hardware.

I missed some when I opened this ticket. There are actually 7 Sunny day ITs. The 4 above plus these:

main/java/org/apache/accumulo/test/ShellIT.java:@Category({MiniClusterOnlyTests.class, SunnyDayTests.class})
main/java/org/apache/accumulo/test/functional/ReadWriteIT.java:@Category({StandaloneCapableClusterTests.class, SunnyDayTests.class})
main/java/org/apache/accumulo/test/ShellServerIT.java:@Category({MiniClusterOnlyTests.class, SunnyDayTests.class})

This is a lot better than what I initially thought. Maybe a bulk import and WAL test would be nice.


Allow overwrite on upload retry in remote uploader downloader

What does this PR do?
Allows overwrite on upload retries.
If an upload fails and results in a partial upload, we should allow overwriting.

What issue(s) does this change relate to?

Before submitting

[ ] Have you read the contributor guidelines?
[ ] Is this change a documentation change or typo fix? If so, skip the rest of this checklist.
[ ] Was this change discussed/approved in a GitHub issue first? It is much more likely to be merged if so.
[ ] Did you update any related docs and document your change?
[ ] Did you update any related tests and add any new tests related to your change? (see testing)
[ ] Did you run the tests locally to make sure they pass?
[ ] Did you run pre-commit on your change? (see the pre-commit section of prerequisites)

It looks reasonable to me, but will let @dakinggg  signoff


Path does not exist -- but it does

Hello beautiful people!
When trying to build a .pde (Processing) file using either build-processing package or my custom build command, I get an error: "C:\mypath" does not exist. But the path does exist and when I use the exact same command in cmd, it works.
Here's my custom build file and the command it's producing.
{
  "cmd": "processing-java",
  "name": "Run",
  "sh": true,
  "args": [
    "--sketch=\"{FILE_ACTIVE_PATH}\"",
    "--run"
  ]
}

cmd /C processing-java --sketch="C:\mypath" --run
Does it have something to do with atom-build cmd /C prefix?
I would be very grateful for some help.
Cheers!

Found a fix, simply don't use quotation marks around the file path. Here's my working build file if anybody needs it:
{
  "name": "Processing",
  "cmd": "processing-java",
  "sh": true,
  "args": [
    "--sketch={FILE_ACTIVE_PATH}",
    "--force",
    "--run"
  ]
}

Remember that the .pde file has to be in a folder with a name same as the file, i.e. processing/processing.pde.


openAPI (ticdc): add some unit tests

What problem does this PR solve?

Issue Number: close #2411
What is changed and how it works?
Check List
Tests

Unit test

Code changes

Has exported function/method change
Has exported variable/fields change
Has interface methods change

Side effects
Related changes
Release note
None

/run-integration-tests

Codecov Report

Merging #4387 (09ca4fd) into master (ab62e6b) will increase coverage by 0.1156%.
The diff coverage is 47.7848%.

Flag
Coverage Δ

cdc
59.8792% <59.8736%> (+0.2633%)
:arrow_up:

dm
52.0555% <41.7260%> (-0.0101%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.
@@               Coverage Diff                @@
##             master      #4387        +/-   ##
================================================
+ Coverage   55.5183%   55.6340%   +0.1156%
================================================
  Files           495        495
  Lines         61151      61191        +40
================================================
+ Hits          33950      34043        +93
+ Misses        23789      23716        -73
- Partials       3412       3432        +20

/run-integration-tests

/run-all-tests

/run-integration-tests

LGTM

/merge

/run-verify

/run-integration-tests /tidb=pr/30558
/run-kafka-integration-test /tidb=pr/30558

/run-verify


Update sbt to 1.10.2

About this PR
📦 Updates org.scala-sbt:sbt from 1.10.1 to 1.10.2
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-sbt", artifactId = "sbt" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scala-sbt", artifactId = "sbt" }
}]

labels: library-update, early-semver-patch, semver-spec-patch, version-scheme:early-semver, commit-count:1

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.8%) to 88.189%

Totals

Change from base Build<PHONE_NUMBER>5:
-0.8%

Covered Lines:
112

Relevant Lines:
127

💛  - Coveralls

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 88.976%

Totals

Change from base Build<PHONE_NUMBER>5:
0.0%

Covered Lines:
113

Relevant Lines:
127

💛  - Coveralls


statetrack_plugin implementation

Change Description

This PR is for reviewing the implementation of the statetrack_plugin and related code changes to chainbase.
This is an early version of the code and still required more testing. There are various open questions for which we wanted to request feedback from the Block.one developers.
The details on the plugin and motivation are explained in the plugin's readme file: https://github.com/mmcs85/eos/tree/master/plugins/statetrack_plugin
The associated pull request for the chainbase changes is here: https://github.com/EOSIO/chainbase/pull/28
The associated receiver for the operations sent by this plugin is here: https://github.com/andresberrios/statemirror
Consensus Changes

This plugin doesn't directly introduce changes to consensus but there might be some implications regarding transaction processing time limits that should be evaluated. The details are explained in the above referenced plugin readme file.
API Changes

No API changes are introduced, but new hooks would be available for plugins to utilize if the chainbase pull request is merged.
Documentation Additions

Most of the documentation related to the current implementation of the plugin is detailed in the above referenced readme file.

Hi there @wanderingbort. Thank you from giving a review to this cuz we really think that this projects needs validation from EOSIO devs to evaluate our expectation and understand is viability.
To be honest my ideia (I think Andrés as well) for this plugin at this phase was only to stream the database operations to a queue without any context like trx / block / fork that it belongs to. Same as the chain_plugin fetch's rows every API request and does not take that context in consideration.

I think for supporting this is always possible to subscribe other signals and construct on the plugin side the relation between db op and trx / blocks. For example is possible to add an event on applied action and since (I'm assuming this so need you advice) I can group ops by action by storing the ops that happen before and add them to the action that was applied. It only works on a single thread and if sequential order is guaranteed.
Other possible solution is to add that information in each index operation. could it impact performance?

It depends of the way you reduce it. If the reduce function you are applying for example Is a count of operations applied (leaving out undo's). Then it needs to take into account the undo and decrease the count.
Maybe I'm wrong but since I subscribe the undo and emit their reverse operations In theory I'm streaming forks operations and the reverse operations when they are removed / (orphaned?) as well.

Should I subscribe events on the reversible_blocks chainbase in controller and fork database push_block and pop_block ?

Indeed the price we pay for this features is that operations can be duplicated due to:

Action Multiple changes to same row
Forks applied and undo operations
Failed transaction with exceptions

But the thing is as long there is a use case for tracking this information is ok for me.
Also there is some mechanisms to reduce the impact of this:

Avoid using this plugin on a available public API
Get only previous validated and executed transactions from local nodes if possible.
Filter the tables you want to get information since contract developers mostly care for a small subset of contract - tables.

Thanks @wanderingbort for taking the time to review this. To expand on what @mmcs85 has mentioned:
It is true that we initially were looking to only stream the state DB operations, without them needing much associated context like the action/transaction that caused them. This is simply because we were pursuing the use cases where that would be enough, considering that after querying the state, the client could get notified of further modifications to the snapshot that was received via WebSockets or whatever other mechanism that the developer would like to implement or use in the receiver side, thus maintaining a consistent view of the state after any necessary undos are executed. This does not mean that there aren't more use cases that this system can cover very effectively, and that's also why we needed to get in touch with you guys and see what you consider important to support. On top of that, as @mmcs85 explained a bit, we already had some ideas for solutions to support further use cases.

As @mmcs85 mentioned, there are some straightforward potential ways to support more context in the operations:

Regarding action/transaction context: Assuming a single thread for action processing and consistent sequential order of events (both assumptions seem to be currently valid), one could use the applied action event to track the checkpoints of action start and finish, and consider all state DB operations in between to belong to that particular action. This could be done either on the plugin side or on the receiver side, avoiding putting more load on the nodeos instance for tracking this.
Regarding undo operations: In a way, we already had this functionality supported in a previous version of the implementation. We originally were sending the commit, squash, and undo operations as well, along with the chainbase revision they corresponded to. This gave us context in the receiver to keep track of revisions (which are just denoted by the block number) and allowed us to group "changesets" or groups of state DB operations according to what block they belonged to. We would also keep a set of reversed operations ready to be applied in case of an undo, and these reversed operations were discarded once we received a commit operation, which (as we deduced) should signal block finality by committing the specified revision, making it un-undoable. You can check this implementation here, in a previous version. We eventually discarded this implementation for the time being since we found a way to send the actual reversed operations directly from chainbase, saving a lot of extra queries on the receiver side. We did keep in mind that some context for block finality and undo operations should be reintroduced at some point.

Please correct me if I'm wrong, but I think this point is covered, since your reducer implementation would most likely gracefully handle the undos without any further complexity. For instance, if you would want to keep track fo the total sum of the numbers stored in column amount for each row in the table, you would need to do 3 things:
1. Handle the emplace operations by adding the amount of that row to the total.
2. Handle the erase operations by subtracting the amount of the row to be removed.
3. Handle the modify operations by subtracting the old amount and adding the new one.
This way, your reducer is agnostic of whether there was an undo or a fork, since it will always simply maintain consistency with whatever is actually stored in the table, as the undos will emit the reversed operations required to apply them. We rely on nodeos' own ability to keep it's own chainbase DBs in a consistent state when forks happen, and we just follow those DBs as the single source of truth. As @mmcs85 said:

Maybe I'm wrong but since I subscribe the undo and emit their reverse operations In theory I'm streaming forks operations and the reverse operations when they are removed / (orphaned?) as well.
Should I subscribe events on the reversible_blocks chainbase in controller and fork database push_block and pop_block ?

If this behaves as we believe it does, then we shouldn't need any further checks with reversible blocks or the fork database, as all of that would be handled by nodeos and applied to the state chainbase, which we hooked into.
Besides this, in some cases, the developer might find it more valuable to run a reducer based on actual applied actions and their parameters instead of state DB operations. In this case, using this plugin, they can simply use the actions DB table. Each applied action will be in this table (which has (code, scope, table) as (system, system, actions) in the current implementation), and they can apply a forward reduction step when there is an emplaced action, and a reversed reduction step when actions are erased from the table like in case there's a fork.

I'm glad to see you've thought so deeply about this and found this potential mis-incentive. I can only answer with my personal view, as I have no hard proof, but it seems to me that it's hard to come up with a use case where developers might want to write twice to the same DB row in the same action just to trigger two different side-effect handlers. In any case that I can think of, for side-effects (unlike reducers), it would make more sense to hook into applied actions (and maybe even irreversible ones) than to state DB changes. Even though this opens the possibility for hooking things in weird esoteric ways, I don't see it necessarily as an incentive to do so. The fine-grained (sub-atomic) nature of the state DB operation updates has more benefit for other things, like reducers, state DB mirroring (to support more complex queries and indexing), and frontend real-time updates.

There might be other use cases that we're not yet considering, but for most dapp development needs that we've thought of, this implementation fulfills all needs so far. It's also worth mentioning that we've had strong interest in this system from some of the biggest dapps out there, so there's definitely a demand.

in the time between this PR and now we've successfully created plumbing to allow plugins to exist out of repo.  I am going to close this PR as it is stale and should probably exist as a sibling repo that leverages this feature.  See #5026


Split the pod into subspecs

Split the entire repo into at least two subspecs - UI and non-UI (services, effectively). This helps resolves problems with code that isn't appropriate for app extensions in WPiOS.
cc: @koke

Umbrella issue here: https://github.com/wordpress-mobile/WordPress-iOS/issues/4434


Fix dependent menu view

when "do not change destination file time option" is selected and Target is SMB: disable time difference compare options
when Mode is Archive: DST settings and most time_diff dependent view could be still shown while time compare was off (Archive mode or when both "SizeDiff" and "source is larger" are set)
fix DST offset and Time_Diff are properly reset and applied in settings when disabled

This includes previous fix + adds fix to time_diff dependent view when Sync target or other options were set: time_diff was hidden while other dependent options were left
Still missing some parts: DST can be unchecked while offset is visible because missing setOnClickListener() in checkSyncTaskOkButtonEnabled()
Can you check that part so that settings are properly applied in memory + settings file instead of only hidden in options ?

see later patches for more commits and fixes + alternative

Thank you for your suggestion.
I haven't initialized the parameter to recreate the previous setting when it's turned on and off.
I'm sorry, but I don't merge the initializing part.

👍
I will look if there are some issues in some settings not being reset once task is saved
But I would at least look at the possibility to initialize when Ok button is pushed and task is saved definitely. You keep the idea of recreating the settings when it's turned on/off.


Upgraded to PureScript 0.14.3

Upgrade to PureScript 0.14.3. Split out of an old PR https://github.com/exercism/purescript/pull/212.

@icyrockcom I've requested a review from @aimorris, who is the maintainer of the purescript track. Should there not be a review within 5 days or so, ping me and we can get this merged.

Thanks @ErikSchierboom. @aimorris Just wanted to check if you had a chance to review. It'd be great to get a review before the merge, but it also would be good to not have this fall into oblivion again. :)


chore(package): update @kronos-integration/service to version 8.0.6

:tada: This PR is included in version 3.0.5 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Disable tls on token discovery with local token server.

We use swarm with local token discovery service (yes, we use undocumented feature):
swarm manage token://<host>/swarm_token_discovery/<clusterId>
But we need to setup TLS and import CA on each node with swarm, because 'https' is hardcoded. In local network it is an extra work.

Out of curiosity - why not using consul, etcd or zookeeper instead of reimplementing the token protocol?
As for the problem itself, why not using a properly signed TLS certificate on the token server?

... why not using consul ...

Our project already contains service discovery system, and in this case we can choice: reimplement token-based discovery, write plugin for swarm or port system to consul (etcd or zookeper). Of course we  chose most easy way.

why not using a properly signed TLS certificate on the token server?

Obtaining of a signed certificate is outside the scope of liability of developers. Now we use self signed certificate, but swarm distributed as docker image, and it does not allow us to install our CA in to swarm image. Therefore we forced to use swarm compiled from sources.

Closing as this issue is very old. Please reopen if you are still need help/want to propose an enhancement.


GEN3: receive unknown messages

after an OTA update we see unknown messages with ID: 0x76, 0x77, 0x78
we also see incomplete message...

The messages are used to encapsulate Modbus messages. The GEN3 and GEN3PLUS inverters support the message ID 0x77. This is now understood and evaluated by the proxy and also used for regular queries by a cron job.
Implemented with #67


3.0: Switch to (ReadOnly)Memory for passing vector embeddings

It's a good time to look at API again and decide how to integrate (ReadOnly)Memory<float> best.
Re-using existing unsafe accessor / private reflection based approach to RepeatedField<float>s used by gRPC, this can be changed to work in such a way that even mismatched sizes of arrays upon querying vectors will stop allocating.
However, attention must be paid to efficient and correct serialization for RestTransport.

Addressed by https://github.com/neon-sunset/Pinecone.NET/commit/d125d26d7663e2c6299a61f1a041074cea3d4713


[Backport] Creating cluster with multiple nodes, some of the nodes remain in Active until the other nodes provision

Backport https://github.com/rancher/rancher/issues/30346

Test report:

Tested on rancher/rancher:v2.5-head 12cd346
used DO driver for deployment of 3 worker nodes and 3 nodes with control plane and etcd roles from Ember UI
The deployment was successful and done at once - not in batches of 5 nodes as before

Closing.

Re-opened this because it needs to be tested for the v2.5.9 milestone.

https://github.com/rancher/rancher/pull/32870

available for testing in rancher v2.5.9-rc1

Test report:

Tested on rancher/rancher:v2.5.9-rc2
used DO driver for deployment of 3 worker nodes and 3 nodes with control plane and etcd roles from Ember UI
The deployment was successful and provisioning was done at once - not in batches of 5 nodes as before

Close.


alsa-utils: make aplay find pipewire's ALSA library

Description of changes
Without this, users of alsa-utils on non-NixOS systems using pipewire will get error messages such as:
ALSA lib dlmisc.c:337:(snd_dlobj_cache_get0) Cannot open shared library libasound_module_pcm_pipewire.so (/nix/store/4vp...ii-alsa-lib-1.2.9/lib/alsa-lib/libasound_module_pcm_pipewire.>Nov 09 16:22:12 luz5 safeeyes[1872081]: aplay: main:834: audio open error: No such device or address

This is related (and potentially fixes):

https://github.com/NixOS/nixpkgs/issues/187308
https://github.com/NixOS/nixpkgs/issues/212141
https://github.com/NixOS/nixpkgs/issues/6860

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 267069 run on x86_64-linux 1

1 package failed to build:

mikutter

29 packages built:

MMA
alsa-scarlett-gui
alsa-utils
deltachat-cursed
deltachat-cursed.dist
dwm-status
i3blocks-gaps
mpdevil
opencpn
python310Packages.notify-py
python310Packages.notify-py.dist
python310Packages.py3status
python310Packages.py3status.dist
python310Packages.toggl-cli
python310Packages.toggl-cli.dist
python311Packages.notify-py
python311Packages.notify-py.dist
python311Packages.py3status
python311Packages.py3status.dist
python311Packages.toggl-cli
python311Packages.toggl-cli.dist
rakarrack
roon-bridge
roon-server
safeeyes
safeeyes.dist
snis
solfege
teams-for-linux

Result of nixpkgs-review pr 267069 run on x86_64-linux 1

3 packages failed to build:

MMA
mikutter
solfege

27 packages built:

alsa-scarlett-gui
alsa-utils
deltachat-cursed
deltachat-cursed.dist
dwm-status
i3blocks-gaps
mpdevil
opencpn
python310Packages.notify-py
python310Packages.notify-py.dist
python310Packages.py3status
python310Packages.py3status.dist
python310Packages.toggl-cli
python310Packages.toggl-cli.dist
python311Packages.notify-py
python311Packages.notify-py.dist
python311Packages.py3status
python311Packages.py3status.dist
python311Packages.toggl-cli
python311Packages.toggl-cli.dist
rakarrack
roon-bridge
roon-server
safeeyes
safeeyes.dist
snis
teams-for-linux

Result of nixpkgs-review pr 267069 run on x86_64-linux 1

1 package failed to build:

mikutter

29 packages built:

MMA
alsa-scarlett-gui
alsa-utils
deltachat-cursed
deltachat-cursed.dist
dwm-status
i3blocks-gaps
mpdevil
opencpn
python310Packages.notify-py
python310Packages.notify-py.dist
python310Packages.py3status
python310Packages.py3status.dist
python310Packages.toggl-cli
python310Packages.toggl-cli.dist
python311Packages.notify-py
python311Packages.notify-py.dist
python311Packages.py3status
python311Packages.py3status.dist
python311Packages.toggl-cli
python311Packages.toggl-cli.dist
rakarrack
roon-bridge
roon-server
safeeyes
safeeyes.dist
snis
solfege
teams-for-linux

@AndersonTorres: I need some more information from you before I can do anything on my PR. Can you please answer my question?

Result of nixpkgs-review pr 267069 run on x86_64-linux 1

1 package failed to build:

mikutter

29 packages built:

MMA
alsa-scarlett-gui
alsa-utils
deltachat-cursed
deltachat-cursed.dist
dwm-status
i3blocks-gaps
mpdevil
opencpn
python310Packages.notify-py
python310Packages.notify-py.dist
python310Packages.py3status
python310Packages.py3status.dist
python310Packages.toggl-cli
python310Packages.toggl-cli.dist
python311Packages.notify-py
python311Packages.notify-py.dist
python311Packages.py3status
python311Packages.py3status.dist
python311Packages.toggl-cli
python311Packages.toggl-cli.dist
rakarrack
roon-bridge
roon-server
safeeyes
safeeyes.dist
snis
solfege
teams-for-linux

Waiting for ofBorg.

Oops, breaks eval on master...

Oh hell.

@wegank: I'm sorry about that. Can you please tell me:

what is broken exactly on master and how to find out myself?
how is it that nixpkgs-review and ofborg didn't detect anything?


Input scaling

Allows for setting an input scaling parameter to apply forces (default), impulses, or generally scaled inputs for numerical reasons

Codecov Report

Merging #70 (adbba2a) into main (d85469e) will decrease coverage by 39.37%.
The diff coverage is 60.00%.

@@             Coverage Diff             @@
##             main      #70       +/-   ##
===========================================
- Coverage   87.98%   48.60%   -39.38%
===========================================
  Files          95       94        -1
  Lines        5225     4962      -263
===========================================
- Hits         4597     2412     -2185
- Misses        628     2550     +1922

Impacted Files
Coverage Δ

src/joints/joint.jl
82.60% <0.00%> (-6.44%)
:arrow_down:

src/joints/rotational/constructor.jl
39.13% <ø> (-60.87%)
:arrow_down:

src/joints/translational/constructor.jl
41.66% <ø> (-58.34%)
:arrow_down:

src/mechanism/constructor.jl
77.77% <ø> (-19.45%)
:arrow_down:

src/joints/rotational/input.jl
21.42% <33.33%> (-23.81%)
:arrow_down:

src/joints/translational/input.jl
48.48% <50.00%> (-15.16%)
:arrow_down:

src/joints/constraints.jl
79.59% <100.00%> (-10.56%)
:arrow_down:

src/solver/options.jl
0.00% <0.00%> (-100.00%)
:arrow_down:

src/contacts/linear.jl
0.00% <0.00%> (-100.00%)
:arrow_down:

src/mechanics/energy.jl
0.00% <0.00%> (-100.00%)
:arrow_down:

... and 88 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


script: add VL53L0X lidar sensor library

Popular, easily available, high quality time-of-flight sensor.
This library is quite large and takes up a substantial amount of memory,
but leaves enough for debugging/interactive use.  Comes with a few examples.
VCSEL pulse period modification and GPIO interrupt range configuration
are unsupported. Note the GPIO /is/ live: you can register interrupts on
it in order to receive wakeups, in order to save battery for timed
continuous polling; but you cannot configure the thresholds for wakeups
to occur (e.g. "interrupt if no object is within 200mm to 500mm", a la
Indiana Jones).
Some notes on writing Helium Script are included in the accompanying
README.org file.
Small TODOs:

[ ] I think the calibration TODO FIXME can be deleted in the preface.
[ ] Maybe the module License section should be nuked.
[ ] The README.org is probably better split off into a separate "Tips" and "Using this module" files.
[ ] It's unclear if you want to keep the queuing code; it's from @beerriot. (I was using it to test further optimizations: there's some overhead to module loading, so fitting 2 modules into the example was a great stress test). It might be useful for other examples, however, and it does make the VL53L0X samples look nice and use less power.

I think that those are the main things I would just like to clean up, though point 4 -- y'all can make the call on that.

I cannot get the main-lp version of the script to work, I always get:
VL53L0X ok (single shot, low-power @ 10000ms )
helium-script: error: timeout on script execution

I have the lidar connected to VSW, any ideas?

Seems like the low power main consistently times out on the second sensor wakeup.


Update errors for missing property in union type involving index signature

When looking for what error to output in the reportNonexistentProperty function in the checker.ts file, the method did not take into account the fact that the subtype could be a Record<string, ...>. This meant that errors related to missing properties on types were outputting: Property 'foo' does not exist on type 'Record<string, ...>' instead of  Property 'foo' does not exist on type '{ prop: number; }' for example. The fix is simply to check the subtype with the getIndexInfoOfType method.
Fixes #31306

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: Domino9697 sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Thanks!


[android] Adding PAD File.

I am adding a PAD File because some App Directories ask for it in order to accept the app in their site.
Portable Application Description (PAD) is a machine-readable document format designed by the Association of Shareware Professionals.
It allows authors to provide product descriptions and specifications to online sources in a standard way, using a standard data format, a simplified subset of XML, that will allow webmasters and program librarians to automate program listings. PAD saves time for both authors and webmasters.
Each field in the specification has a regular expression (regex) associated with it. The regex acts as a constraint on the field: if the regex matches, the field value is legal and if it fails to match, the field and the PAD file as a whole are out of spec. Only files where all fields in the file pass validation are properly called PAD files.
The simplifications in PAD over XML are primarily PAD does not use name/value pairs in tags. All tags are attribute-free. This is less expressive than XML but easier to parse. The official PAD spec uses unique tags. To extract the fields in the official spec, it is not necessary to descend through the tag path. However, if multiple languages are represented in a single PAD file, then correct parsing does require descending though the tag path because leaf tags are duplicated for each language supported.

looks like the file you were adding was actually your work on portuguese, if you lose the file, the changes are here on this patch (just in case)


Pinchable/Rotatable/Draggable should not emit anchor point adjustment

Only DirectlyManipulable should.
Rationale being that if you are using any of Pinchable/Rotatable/Draggable then it is very unlikely that you will want to modify the anchor point each time the gesture recognizer begins. This type of behavior only makes sense if you have all three plans operating in tandem (i.e. with DirectlyManipulable).

[ ] Deprecate shouldAdjustAnchorPointOnGestureStart on all three APIs.
[ ] Emit an anchor point change from DirectlyManipulable on gesture start.

🎊 My diff is ready for review at http://codereview.cc/D1909


[EXAMPLE]: ArgoCD example missing proper README

Welcome to Amazon EKS Blueprints!

[X] Yes, I've searched similar issues on GitHub and didn't find any.

Amazon EKS Blueprints Release version
4.5.0
What is your environment, configuration and the example used?
N/A
What did you do and What did you see instead?
Currently, the ArgoCD example missing detailed README like the other examples.
Additional Information
No response

closed in #792


[Test Case Failure]: Fix Undefined Name Errors in QdrantVectorStore.py due to Missing Imports

Test Case
./swarmauri/community/vector_stores/QdrantVectorStore.py
Pytest Logs
./swarmauri/community/vector_stores/QdrantVectorStore.py:22:11: F821 undefined name 'Literal'
type: Literal['QdrantVectorStore'] = 'QdrantVectorStore'
^
./swarmauri/community/vector_stores/QdrantVectorStore.py:38:38: F821 undefined name 'IDocument'
def add_document(self, document: IDocument) -> None:
^
./swarmauri/community/vector_stores/QdrantVectorStore.py:67:45: F821 undefined name 'IDocument'
def add_documents(self, documents: List[IDocument]) -> None:
^
./swarmauri/community/vector_stores/QdrantVectorStore.py:84:46: F821 undefined name 'IDocument'
def get_document(self, id: str) -> Union[IDocument, None]:
^
./swarmauri/community/vector_stores/QdrantVectorStore.py:97:41: F821 undefined name 'IDocument'
def get_all_documents(self) -> List[IDocument]:
^
./swarmauri/community/vector_stores/QdrantVectorStore.py:115:58: F821 undefined name 'IDocument'
def update_document(self, id: str, updated_document: IDocument) -> None:
^
./swarmauri/community/vector_stores/QdrantVectorStore.py:144:60: F821 undefined name 'IDocument'
def retrieve(self, query: str, top_k: int = 5) -> List[IDocument]:
^
7     F821 undefined name 'Literal'
7
Error: Process completed with exit code 1.
Root Cause
The test case is likely failing due to missing imports for Literal and IDocument
Potential Solutions
Import Literal from the typing module to fix the error for the Literal type
Import IDocument from the appropriate module or define it within the project if it's a custom interface
Additional Context (optional)
No response
Type of Test Case
Unit

this was resolved


MINOR: <NuxtLayout /> component has not been used.

Version
"@nuxtjs/supabase": "^1.1.6",
"nuxt": "^3.9.3",
"vue": "^3.4.14",
"vue-router": "^4.2.5"
Reproduction Link
Reproduction
Steps to reproduce

Start new nuxt
Add @nuxtjs/supabase (Add .env with required variables and add module to .config)
Get [Vue Router warn]: No match found for location with path "/login"
Add /pages/index.vue, add <NuxtLayout> && <NuxtPage> to app.vue and add a /layouts/default.vue
Add '/login' from docs
Get [nuxt] Your project has layouts but the  component has not been used.

What is Expected?
I expect not to get an error when layouts and <NuxtLayout /> are being correctly used.
What is actually happening?
I get the [nuxt] Your project has layouts but the  component has not been used. error on the console. Still the layout gets applied

Hey there @Arbust908 , this issue is related to Nuxt and not the @nuxtjs/supabase module. The issue is currently being tracked here


[RAPIDS] Rapids Spark v0.4.0 Release

Update init script to use RAPIDS Spark v0.4.0
Note that cudf version is 0.18.1 to include a hot fix, this doesn't impact RAPIDS Dask
Also use NVIDIA provided driver as default as it works better with Tesla GPUs that is in GCP
@sameerz @viadea for Viz
Release note could be found here: https://nvidia.github.io/spark-rapids/docs/download.html#release-v040
New features:
* Decimal support up to 64 bit, including reading and writing decimal from Parquet (can be enabled by setting spark.rapids.sql.decimalType.enabled to True)
* Ability for users to provide GPU versions of Scala, Java or Hive UDFs
* Shuffle and sort support for struct data types
* array_contains for list operations
* collect_list and average for windowing operations
* Murmur3 hash operation
* Improved performance when reading from DataSource v2 when the source produces data in the Arrow format

@bradmiro @medb hope we can merge this asap for some joint customer POCs.

/gcbrun

Hi @medb, I revert one of your change in last commit, please see https://github.com/GoogleCloudDataproc/initialization-actions/pull/875

2.0 cluster creation fails w/ error:
2021-03-23 00:26:09 URL:https://repo1.maven.org/maven2/ai/rapids/cudf/0.18.1/cudf-0.18.1-cuda10-2.jar [331441105/331441105] -> "/usr/lib/spark/jars/cudf-0.18.1-cuda10-2.jar" [1]
+ configure_spark
+ [[ 3.0 == \3* ]]
+ cat
+ [[ Master == \M\a\s\t\e\r ]]
+ systemctl restart hadoop-yarn-resourcemanager.service
+ systemctl status hadoop-yarn-nodemanager
● hadoop-yarn-nodemanager.service - LSB: Hadoop nodemanager
   Loaded: loaded (/etc/init.d/hadoop-yarn-nodemanager; bad; vendor preset: enabled)
  Drop-In: /etc/systemd/system/hadoop-yarn-nodemanager.service.d
           └─worker-restart.conf
   Active: active (running) since Tue 2021-03-23 00:25:08 UTC; 1min 8s ago
     Docs: man:systemd-sysv-generator(8)
 Main PID: 5730 (java)
    Tasks: 0 (limit: 4915)
   CGroup: /system.slice/hadoop-yarn-nodemanager.service
           ‣ 5730 /usr/lib/jvm/adoptopenjdk-8-hotspot-amd64/bin/java -Dproc_nodemanager -Dyarn.log.dir=/var/log/hadoop-yarn -Dyarn.log.file=hadoop-yarn-nodemanager-test-rapids-single-2-0-20210323-002257-wj2j-m.log -Dyarn.home.dir=/usr/lib/hadoop-yarn -Dyarn.root.logger=INFO,console -Djava.library.path=/usr/lib/hadoop/lib/native -Xmx1536m -Dhadoop.log.dir=/var/log/hadoop-yarn -Dhadoop.log.file=hadoop-yarn-nodemanager-test-rapids-single-2-0-20210323-002257-wj2j-m.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=yarn -Dhadoop.root.logger=INFO,RFA -Dhadoop.policy.file=hadoop-policy.xml -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.yarn.server.nodemanager.NodeManager

Mar 23 00:25:00 test-rapids-single-2-0-20210323-002257-wj2j-m systemd[1]: Starting LSB: Hadoop nodemanager...
Mar 23 00:25:00 test-rapids-single-2-0-20210323-002257-wj2j-m su[5545]: Successful su for yarn by root
Mar 23 00:25:00 test-rapids-single-2-0-20210323-002257-wj2j-m su[5545]: + ??? root:yarn
Mar 23 00:25:00 test-rapids-single-2-0-20210323-002257-wj2j-m su[5545]: pam_unix(su:session): session opened for user yarn by (uid=0)
Mar 23 00:25:08 test-rapids-single-2-0-20210323-002257-wj2j-m hadoop-yarn-nodemanager[5517]:  * Started Hadoop nodemanager:
Mar 23 00:25:08 test-rapids-single-2-0-20210323-002257-wj2j-m systemd[1]: Started LSB: Hadoop nodemanager.
+ systemctl restart hadoop-yarn-nodemanager.service
Job for hadoop-yarn-nodemanager.service failed because the control process exited with error code.
See "systemctl status hadoop-yarn-nodemanager.service" and "journalctl -xe" for details.

I think that we need to send a separate PR for GPU init actions changes, because there are many tests run for both init actions and it's hard to debug them if they are in one PR.

Seems like the test only failed for a single node cluster? Is my understanding correct?

I think that we need to send a separate PR for GPU init actions changes, because there are many tests run for both init actions and it's hard to debug them if they are in one PR.

@medb  I think multi-node cluster works fine for me. Trying single node now.


Update Pipfile and pinned versions

This PR updates the Pipefile requirements and pinned versions documentation.
Removed the below packages as they are requested by other packages and dont need to be pinned:
removed - python-dateutil as it is required by Alembic, icalendar
removed - numpy as it is required by matplotlib and basemaps

Landed thanks @wolfthefallen


Exception when using quote_ident in psycopg2

Describe the bug:
If you make use of the function psycopg2.extensions.quote_ident docs, a TypeError exception is thrown. This is because the cursor object, when under instrumentation from ES-APM, is an instance of PGCursorProxy, not the actual cursor, and quote_ident does not allow this because the type is checked in the C code link. With the error message saying TypeError: argument 2 must be a connection or a cursor. Inspecting the cur object at a debug breakpoint we can see it is the proxy object:
>>> cur
<PGCursorProxy at 0x7fd7f70f9a88 for NamedTupleCursor at 0x7fd7f70f0148>
>>> type(cur)
<class 'elasticapm.instrumentation.packages.psycopg2.PGCursorProxy'>
>>> type(cur.__wrapped__)
<class 'psycopg2.extras.NamedTupleCursor'>

To Reproduce
from psycopg2.extensions import quote_ident
....
....
with psycopg2.connect(DSN) as conn:
    with conn.cursor() as curs:
        ident = quote_ident("column_name", cur)
        curs.execute(f"SELECT {column_name} FROM data.table;")
        data = curs.fetchall()

passing the underlying wrapped cursor works:
from psycopg2.extensions import quote_ident
....
....
with psycopg2.connect(DSN) as conn:
    with conn.cursor() as curs:
        ident = quote_ident("column_name", cur.__wrapped__)
        curs.execute(f"SELECT {column_name} FROM data.table;")
        data = curs.fetchall()

Environment (please complete the following information)

OS: Linux
Python version: 3.6.4
Agent version: 5.2.2

Additional context
Looks like the same problem was encountered here https://github.com/DataDog/dd-trace-py/issues/474, and was fixed by also patching quote_ident to pass the __wrapped__ object. Testing this out with a basic in-module proxy function worked, but obviously a patch right at the top level from the apm module would sort it out.
def quote_ident(string, cursor):
    return psycopg2.extensions.quote_ident(string, cursor.__wrapped__)

@HUSSTECH thanks for the very detailed bug report. I opened #621 to fix this (and also added handling for the encrypt_password extension while I'm at it). I will release this in the coming days.
If you have the time, it would be super cool if you could give the fix a quick test run in your development environment. You can install it like so:
pip install "https://github.com/beniwohli/apm-agent-python/archive/fix-620.zip#egg=elastic-apm==100"

Hey @beniwohli, thanks for the quick turnaround. I've been attempting to test out the fix, but I'm still getting the same error message. Not sure if you were ready for me to test now, but I tried both pip install "https://github.com/beniwohli/apm-agent-python/archive/fix-620.zip#egg=elastic-apm==100" and pip install "https://github.com/beniwohli/apm-agent-python/archive/fix-620.zip incase I wasn't getting the head of the branch.

Thanks for testing it! I'm not quite sure why this isn't working for you, but one possible option is that it might be that you import quote_ident before we can patch it, so you get the original, unpatched version.
Can you try to either

change the import from from psycopg2.extensions import quote_ident to import psycopg2.extensions and then use pyscopg2.extensions.quote_ident(my_string, cursor)
import quote_ident inside the function/method where you use it

Unfortunately, both options aren't really satisfactory, as it requires code changes on your side :(

Ok, that's super interesting. Both suggested workarounds work. They aren't major changes to my code, and option 1 is probably better of the two. So it just means doing a more broad import for psycopg2.extensions first. But wondering why there is a difference, is the patching done only x levels deep into the module?
I wanted to test as pure of a case as possible. So I set up a minimal single file Flask application.

This one does not work (Basically this one is replicating the issue I opened):

from elasticapm.contrib.flask import ElasticAPM
from flask import Flask, jsonify
import psycopg2
from psycopg2.extensions import quote_ident

app = Flask(__name__)

app.config['ELASTIC_APM'] = {
    'SERVICE_NAME': 'development',
    'SERVER_URL': 'xxxx',
    'ENVIRONMENT': 'development',
    'SECRET_TOKEN': 'xxxxx',
    'AUTO_LOG_STACKS': False,
    'COLLECT_LOCAL_VARIABLES': 'off',
    'SOURCE_LINES_ERROR_APP_FRAMES': 0,
    'SOURCE_LINES_ERROR_LIBRARY_FRAMES': 0,
    'SOURCE_LINES_SPAN_APP_FRAMES': 0,
    'SOURCE_LINES_SPAN_LIBRARY_FRAMES': 0
}

apm = ElasticAPM(app)

def connect_db():
    return psycopg2.connect("DSN")

@app.route('/test')
def test():
    conn = connect_db()
    cur = conn.cursor()
    ident = quote_ident("column", cur)
    cur.execute(f"SELECT {ident} FROM data.table;")
    data = cur.fetchall()
    cur.close()
    conn.close()
    return jsonify(data)

The following works (Using the more broad import of psycopg2):

from elasticapm.contrib.flask import ElasticAPM
from flask import Flask, jsonify
import psycopg2

app = Flask(__name__)

app.config['ELASTIC_APM'] = {
    'SERVICE_NAME': 'development',
    'SERVER_URL': 'xxxx',
    'ENVIRONMENT': 'development',
    'SECRET_TOKEN': 'xxxxx',
    'AUTO_LOG_STACKS': False,
    'COLLECT_LOCAL_VARIABLES': 'off',
    'SOURCE_LINES_ERROR_APP_FRAMES': 0,
    'SOURCE_LINES_ERROR_LIBRARY_FRAMES': 0,
    'SOURCE_LINES_SPAN_APP_FRAMES': 0,
    'SOURCE_LINES_SPAN_LIBRARY_FRAMES': 0
}

apm = ElasticAPM(app)

def connect_db():
    return psycopg2.connect("DSN")

@app.route('/test')
def test():
    conn = connect_db()
    cur = conn.cursor()
    ident = psycopg2.extensions.quote_ident("column", cur)
    cur.execute(f"SELECT {ident} FROM data.table;")
    data = cur.fetchall()
    cur.close()
    conn.close()
    return jsonify(data)

The following also works (By specifically importing quote_ident after the ElasticAPM(app)):

from elasticapm.contrib.flask import ElasticAPM
from flask import Flask, jsonify
import psycopg2

app = Flask(__name__)

app.config['ELASTIC_APM'] = {
    'SERVICE_NAME': 'development',
    'SERVER_URL': 'xxxx',
    'ENVIRONMENT': 'development',
    'SECRET_TOKEN': 'xxxxx',
    'AUTO_LOG_STACKS': False,
    'COLLECT_LOCAL_VARIABLES': 'off',
    'SOURCE_LINES_ERROR_APP_FRAMES': 0,
    'SOURCE_LINES_ERROR_LIBRARY_FRAMES': 0,
    'SOURCE_LINES_SPAN_APP_FRAMES': 0,
    'SOURCE_LINES_SPAN_LIBRARY_FRAMES': 0
}

apm = ElasticAPM(app)

from psycopg2.extensions import quote_ident

def connect_db():
    return psycopg2.connect("DSN")

@app.route('/test')
def test():
    conn = connect_db()
    cur = conn.cursor()
    ident = quote_ident("column", cur)
    cur.execute(f"SELECT {ident} FROM data.table;")
    data = cur.fetchall()
    cur.close()
    conn.close()
    return jsonify(data)

in particular for this third example, it just doesn't seem great to have this behaviour be so dependent on module import order, or the developer just so happening to use a more broad import.
Maybe this is just how it has to be for instrumentation libraries in Python.

The technical reason why from psycopg.extensions import quote_ident doesn't work and the other two approaches work has to do with the import cache (specifically, sys.modules.
When you import a module, Python first checks sys.modules to see if that module has already been imported, and if yes, uses that module. That basically makes Python modules singletons (you always get back the same "module" object when importing a certain module). Our patching mechanisms import a module (psycopg2.extensions in this case), and apply the patch to the given function (quote_ident).
This means that if you import a module, it doesn't matter if our patching happens before or after your import, since we both operate on the same object.
On the other hand, when you do from psycopg.extensions import quote_ident, you import the psycopg2.extensions module, then take the quote_ident function from that module and assign it to a variable in the local scope. If this happens before our patching, quote_ident in your local scope will not be affected by our patching. As far as I know, there is no way around this :(

ah ok, I thought "leaf" objects at the end of import chains would still resolve themselves (walking back up the call path) against a single version/instance of the entire library. So this fix for quote_ident, this fix now just makes it in line with the other instrumentation in the APM code.
The issue will come with quote_ident being used in a library. This is the case for us, but luckily it is one of our libraries, so not a problem to tweak the code to make it work with the instrumentation.
Anyway, with all that, guess we can say this issue has been pretty thoroughly tested then. I can confirm I see database traces in our test APM UI. Am I able to control the logging of the database statement anywhere? thanks for all the help.


update readme

https://github.com/PaddlePaddle/Fleet/tree/develop/examples/word2vec

https://github.com/PaddlePaddle/Fleet/tree/develop/examples/word2vec

Readme have been updated, please review the merge requests

https://github.com/PaddlePaddle/Fleet/pull/60


Mint tests

Before upcoming redesign minting and adding mass mint would be nice to have mint test, seems there are still some random errors here and there.
Would be nice to cover chains tests on

AHK
AHP
RMRK
BSX
RMRK2

Maybe this is something which would be wrapped in minting SDK to completely abstract this functionality out of main codebase of KodaDot?

https://github.com/kodadot/packages/issues/89

Ref

#4221
#4280
#4358
#4752
#4775
#4806
#4926
#4969
#5020

Hey @yangwao can i take this , in where can i make a pr on my test results like readme.md or somewhere else

I'm going to take this i'll also check using nova wallet


Using conn.params if they are not explicitly provided

@mitchellhenke

@alexjp this should fix the issue as described in irc :)

one small comment
:+1:


HADOOP-hdfs-native-client. Fix a typo in fuse options struct for compile

NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 28s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
21m 14s
trunk passed

+1 :green_heart:
compile
1m 55s
trunk passed

+1 :green_heart:
mvnsite
0m 20s
trunk passed

+1 :green_heart:
shadedclient
38m 45s
branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 14s
the patch passed

+1 :green_heart:
compile
1m 42s
the patch passed

+1 :green_heart:
cc
1m 42s
the patch passed

+1 :green_heart:
golang
1m 42s
the patch passed

+1 :green_heart:
javac
1m 42s
the patch passed

+1 :green_heart:
mvnsite
0m 14s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
15m  8s
patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
6m 42s
hadoop-hdfs-native-client in the patch passed.

+1 :green_heart:
asflicense
0m 27s
The patch does not generate ASF License warnings.

66m 12s

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2042/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2042

Optional Tests
dupname asflicense compile cc mvnsite javac unit golang

uname
Linux d8a7bcba7a57 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / ae13a5ccbea

Default Java
Private Build-1.8.0_252-8u252-b09-1~18.04-b09

Test Results
https://builds.apache.org/job/hadoop-multibranch/job/PR-2042/1/testReport/

Max. process+thread count
347 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client

Console output
https://builds.apache.org/job/hadoop-multibranch/job/PR-2042/1/console

versions
git=2.17.1 maven=3.6.0

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 38s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
20m 43s
trunk passed

+1 :green_heart:
compile
2m  8s
trunk passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
compile
2m 11s
trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09

+1 :green_heart:
mvnsite
0m 23s
trunk passed

+1 :green_heart:
shadedclient
40m  0s
branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 15s
the patch passed

+1 :green_heart:
compile
1m 57s
the patch passed with JDK Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1

+1 :green_heart:
cc
1m 57s
the patch passed

+1 :green_heart:
golang
1m 57s
the patch passed

+1 :green_heart:
javac
1m 57s
the patch passed

+1 :green_heart:
compile
1m 56s
the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09

+1 :green_heart:
cc
1m 56s
the patch passed

+1 :green_heart:
golang
1m 56s
the patch passed

+1 :green_heart:
javac
1m 56s
the patch passed

+1 :green_heart:
mvnsite
0m 15s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedclient
14m 26s
patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
7m 54s
hadoop-hdfs-native-client in the patch passed.

+1 :green_heart:
asflicense
0m 32s
The patch does not generate ASF License warnings.

70m 23s

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2042/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/2042

Optional Tests
dupname asflicense compile cc mvnsite javac unit golang

uname
Linux b09685b8b296 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
personality/hadoop.sh

git revision
trunk / e756fe35909

Default Java
Private Build-1.8.0_252-8u252-b09-1~18.04-b09

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2042/3/testReport/

Max. process+thread count
414 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2042/3/console

versions
git=2.17.1 maven=3.6.0

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.


Is it possible to download only reels?

Is there a way to ignore everything else and just download what's on the reels tab? As you can see below, instaloader goes through all posts one by one. There's only about 20 reels but over 900 posts, so I'd like to know if I could just grab them directly.
My command:

instaloader -l myacc --no-metadata-json --no-captions --no-video-thumbnails --no-pictures target

Loaded session from
/data/data/com.termux/files/home/.config/instaloader/session-myacc.
Logged in as myacc.
Stored ID xxxxxxxxx for profile target.
[1/1] Downloading profile target
target/2021-09-04_08-59-58_UTC_profile_pic.jpg
Retrieving posts from profile target.
[   1/1565]
[   2/1565] target/2021-12-04_16-26-11_UTC.mp4
[   3/1565]
[   4/1565] target/2021-12-02_13-09-51_UTC.mp4
[   5/1565] target/2021-12-02_08-54-33_UTC.mp4
[   6/1565]
[   7/1565]
[   8/1565]
[   9/1565]
[  10/1565] ^C
Saved resume information to target/iterator_3D84.json.xz.

In #812 a similar feature was suggested and discussed. However, unfortunately this has not yet been implemented although some ideas have been outlined.


Skip tasks that could not have possibly been effected

For example, updating files only in _goldens does not effect the other packages.
General rules:

[ ] _goldens only impacts _goldens
[ ] _tests_ only impacts _tests

It's possible to get more fine-grained than this, but probably not worth it.

Not a priority.


chore(cli): deregister cli attach command

I hereby agree to the terms of the GreptimeDB CLA
What's changed and what's your intention?
After region server refactoring, datanode is not captiable for processing non-logical plan query. Thus I deregister attach command from cli. We can add this functionality back in the future in others way, like require the frontend to only do partial query execution (to only include result from datanode, for example).
Checklist

[ ]  I have written the necessary rustdoc comments.
[ ]  I have added the necessary unit tests and integration tests.

Refer to a related PR or issue link (optional)

@evenyag is modifying related part


Add NoFinalizer variants for the direct buffer streams.

Following the pattern set by ZstdInputStreamNoFinalizer and ZstdOutputStreamNoFinalizer, add NoFinalizer variants for the direct buffer compressing and decompressing streams. The original classes with finalizers are reimplemented as simple wrappers over the NoFinalizer variants.
https://github.com/luben/zstd-jni/issues/83

Thanks for the contribution!

@luben Can we cut a new release with this fix in? Possibly v1.5.2-3?

sure, will do it later today or tomorrow

@luben sorry for pestering but did you have a chance to have a look at this?

Noticed some unrelated build errors yesterday but got side-tracked. I am on it today.

@islamismailov, v1.5.2-3 is on maven-central


Changing vlan to None since network offering being used has Specify Vlan set to False

issue:
ERROR:  Validate that Admin should be able to create network for himself
Traceback (most recent call last):
CloudstackAPIException: Execute cmd: createnetwork failed, due to: errorCode: 431, errorText:Can't specify vlan; corresponding offering says specifyVlan=false**
Reason:
Default isolated network offering with SourceNat service has "Specify Vlan" parameter set to No. When specify vlan is "No" we can't pass vlan number for network creation api. Three tests are passing vlan id. Hence setting it to None.
Test Result
Validate that Admin should not be able deploy VM for a user in a network that does not belong to the user ... === TestName: test_13_1_deployvm_admin_foruserinotherdomain_crossnetwork | Status : SUCCESS
ok
Validate that Admin should be able to deploy VM for users in his sub domain ... === TestName: test_13_deployvm_admin_foruserinotherdomain | Status : SUCCESS ===
ok
Validate that Domain admin should be able to deploy vm for himslef ... === TestName: test_14_deployvm_domaindmin | Status : SUCCESS ===
ok
Validate that Domain admin should be able to deploy vm for users in his domain ... === TestName: test_15_deployvm_domaindmin_foruserinsamedomain | Status : SUCCESS ===**
ok
Validate that Domain admin should be able to deploy vm for users in his sub domain ... === TestName: test_16_deployvm_domaindmin_foruserinsubdomain | Status : SUCCESS ===
ok
Validate that Domain admin should not be able deploy VM for a user in a network that does not belong to the user ... === TestName: test_17_1_deployvm_domainadmin_foruserinotherdomain_crossnetwork | Status : SUCCESS ===
ok
Validate that Domain admin should not be able allowed to deploy vm for users not in his sub domain ... === TestName: test_17_deployvm_domaindmin_forcrossdomainuser | Status : SUCCESS ===
ok
Validate that Regular should be able to deploy vm for himslef ... === TestName: test_18_deployvm_user | Status : SUCCESS ===
ok
Validate that Regular user should NOT be able to deploy vm for users in his domain ... === TestName: test_19_deployvm_user_foruserinsamedomain | Status : SUCCESS ===
ok
Validate that User should not be able deploy VM in a network that does not belong to him ... === TestName: test_20_1_deployvm_user_incrossnetwork | Status : SUCCESS ===
ok
Validate that Regular user should NOT be able to deploy vm for users in his domain ... === TestName: test_20_deployvm_user_foruserincrossdomain | Status : SUCCESS ===
ok
Validate that Admin should be able to restart network for networks he owns ... === TestName: test_21_restartNetwork_admin | Status : SUCCESS ===
ok
Validate that Admin should be able to restart network for users in his domain ... === TestName: test_22_restartNetwork_admin_foruserinsamedomain | Status : SUCCESS ===
ok
Validate that Admin should be able to restart network for users in his sub domain ... === TestName: test_23_restartNetwork_admin_foruserinotherdomain | Status : SUCCESS ===
ok
Validate that Domain admin should be able to restart network for himslef ... === TestName: test_24_restartNetwork_domaindmin | Status : SUCCESS ===
ok
Validate that Domain admin should be able to restart network for users in his domain ... === TestName: test_25_restartNetwork_domaindmin_foruserinsamedomain | Status : SUCCESS ===
ok
Validate that Domain admin should be able to restart network for users in his sub domain ... === TestName: test_26_restartNetwork_domaindmin_foruserinsubdomain | Status : SUCCESS ===
ok
Validate that Domain admin should be able to restart network for users in his sub domain ... === TestName: test_27_restartNetwork_domaindmin_forcrossdomainuser | Status : SUCCESS ===
ok
Validate that  Regular should be able to restart network for himslef ... === TestName: test_28_restartNetwork_user | Status : SUCCESS ===
ok
Validate that Regular user should NOT be able to restart network for users in his domain ... === TestName: test_29_restartNetwork_user_foruserinsamedomain | Status : SUCCESS ===
ok
Validate that Domain admin should be NOT be able to restart network for users in other domains ... === TestName: test_30_restartNetwork_user_foruserinotherdomain | Status : SUCCESS ===
ok

Ran 33 tests in 3005.410s**
this will close PR   https://github.com/apache/cloudstack/pull/1571

@xen_bvt

            ==============TEST RESULT START===============

    TOTAL:130;PASSED:99;FAILED:17,SKIPPED:14

    DETAILS:http://<IP_ADDRESS>:8080/job/github_xen_pr/25/testReport
    ==============TEST RESULT END=================

LGTM

test result

LGTM


Can we use soma_joinid as cell_id

Dear Authors,
The following code will give me the obs for all the cells. Each cell has a soma_joinid. Can I use this id as cell id? Will each time I query the database, the soma_joinid will be same for each cell? Can I query the census using soma_joinid to get the same specific cell each time? Thank you so much for the help.
human = census['census_data']['homo_sapiens']
obs_df = human.obs.read().concat().to_pandas()

It will as long as you use the same Census version when you open the handle to it. You can learn more about Census data releases and versioning here: Census data releases.
To open the last LTS version of Census as of today you can do the following:
import cellxgene_census
census = cellxgene_census.open_soma(census_version = "2023-12-15")

Unfortunately traceability across Census version is not possible at the moment. A partial solution to that may come in the future, see this ticket for more information.

Thank you so much, @pablo-gar .
I also noticed that the gene expression values from the cellxgene_census.get_anndata(), and the gene expression values from the h5ad downloaded from the cellxgene data portal are different. Which one would you recommend to use for building models?
adata_from_api = cellxgene_census.get_anndata(
census = census,
organism = "Homo sapiens",
obs_value_filter = "dataset_id == '983d5ec9-40e8-4512-9e65-a572a9c486cb' ",
)
adata_from_web_download: https://datasets.cellxgene.cziscience.com/c18b60ea-7dbc-4705-a3dc-e29da4e43c68.h5ad

Happy to assist you.
The data from web downloads is in the form as delivered by the original contributors, in some cases the contributors provide a normalized layer (optional) and the raw counts (required). When that's the case then adata.X has the normalized values and adata.raw.X has the raw counts.
In comparison, when you use the Census defaults of get_anndata() you will always get the raw counts in adata.X.That's why you are observing a difference, but when comparing adata_from_api.X vs adata_from_web_download.raw.X there should not be any differences.

Which one would you recommend to use for building models?

If you planning to do cross-dataset analysis I would recommend you use the Census API as that will always guarantee you consistency. Otherwise the web downloads suffice

should I normalize those two assays if I want to get the highly variable genes?

When it comes to best practices of single-cell analysis we are not in the best position to provide concrete guidance, I'd recommend you browser some review papers on this. For example some recent models out there do not strictly normalize/integrate the data, whereas other analysis do require normalization/integration.
For highly variable genes there a few methods that take into consideration batches see for example, our own Census method based on Scanpy's implementation of Seurat V3 algorithm
@Alex2975 it seems like you were able to use the API, if that's the case could we consider the following resolved #1174

@pablo-gar , thank you so much for the help. It is great to understand the differences of those datasets. I have updated #1174.


HTTPError: HTTP Error 404: Not Found

Seems to be a source error when calling nflfastpy.load_pbp_data and nflfastpy.load_roster_data

a

They've changed the source recently for nflfastR. I recommend using nfl-data-py now as it accomplishes the same thing this package used to and is just as straightforward to use. This package will be archived.


README.md typo fix

There's a typo in the README file. The code for adding rlgl is wrong, it links to raylib_math right now. This PR fixes that typo.

Why did you close this?


check if scv file is empty or has wrong headers

Resolves #702
Description
Checking if a scv file is empty or has wrong headers.

Type of change

New feature (non-breaking change which adds functionality)

How Has This Been Tested?
diaper/spec/support/csv_import_shared_example.rb

Screenshots

I think this is a little extreme/high-risk for the scope of this issue. My suspicion is we can accomplish this just by appending something like .reject { |row| row.all?(&:nil?) } to the .parse call. Thoughts?
I also think that, if possible, we should ignore empty rows instead of forcing an error for them.

Thank you for reviewing my pull request.
For example, if we have csv file like this:
name,,email,
Partner<EMAIL_ADDRESS>Partner<EMAIL_ADDRESS>Partner<EMAIL_ADDRESS>and skip empty row, then email wouldn't be loaded?
Maybe it's better to show that something is wrong with headers and user would fix his file?

I've replaced check_headers_csv with the conditional itself and also rejected rows that have any nill values.


windows fixes and proper UTF-8 conversion

Missed a couple MESSAGE enums in the macros, otherwise LGTM.

Went ahead and rebased with master and added those enum fixes, LGTM, ready to merge when you're ready Jack.


Feature request: Sequence similarity metric

Hi all, I was thinking that it would be useful to provide a sequence similarity metric to enable comparing protein or DNA sequences. The metric could compute all-by-all similarities or even employ some more sophisticated techniques to produce a sparse similarity matrix or the neighbourhood graph directly.
Is this something you would consider, or do you think this is out of scope?
The current way of solving it is to use some other tool to generate a distance matrix or a neighbourhood graph matrix and then embed it using UMAP precomputed or exact metric. But this is non-trivial and there are no relevant tutorials that would demonstrate this (at least not that I know of).

If you provide some pseudocode of how to compute the metric I could probably implement it.

Sounds great. First we need to think about the input sequences, which are strings of variable length. So to keep it aligned with the other metrics, do you think it would make sense to expect the sequences as a two-dimensional matrix, but with just a single column of strings (numpy object dtype)?
The first metric that comes to mind is the Levenshtein distance metric, which counts the number of insertions, deletions and substitutions needed to turn the first sequence into the second sequence. This produces an integer score that increases with the length of the sequence, which is not desirable since longer sequence pairs are favored. This can be solved by using a normalized metric (length_of_both_strings - Levenshtein_distance) / length_of_both_strings. Length of both strings is the maximum distance since you can always delete all characters of the first sequence and insert all characters of the second sequence. This is already implemented by the python-Levenshtein module: https://rawgit.com/ztane/python-Levenshtein/master/docs/Levenshtein.html which is written in C. Would it be possible to use it as an extra dependency (e.g. using umap-learn[seq]?
The standard algorithm for biological sequences is Needleman–Wunsch which finds the best global alignment of two sequences: https://en.wikipedia.org/wiki/Needleman–Wunsch_algorithm. Different insertions, deletions and substitution pairs (=mutations) are penalized differently based on biological information in the form of a substitution matrix. There are different commonly used substitution matrices for DNA and proteins, one of each could be chosen to start with. The algorithm produces an integer similarity score which corresponds to the best alignment. But again, this score increases with the length of the sequence and it can even be negative for dissimilar sequences. So there are no straightforward normalization methods (that I know of). So the two alternative solutions here are to use the fraction of identical pairs in the alignment (% identity) or the fraction of pairs with a positive substitution score (% similarity). So these could be called needlemanwunsch_dna_identity, needlemanwunsch_dna_similarity, needlemanwunsch_protein_identity, needlemanwunsch_protein_similarity.
My suggestion would be to start with the levenshtein metric, since it doesn't take any extra arguments and it can be applied to different domains (language, biology, chemistry). Then the NW metrics could be added later.
What do you think? Let me know how I can help.

Also it's worth to note that both of these algorithms have length1*length2 complexity, which can become very demanding. But it can still be very useful for small datasets. There are also methods which create a sparse distance matrix (with all distances under given threshold) such as USEARCH, but those are much more complex.

So I was thinking about USEARCH and I gave a shot at creating a package that connects USEARCH and UMAP: https://github.com/prihoda/usum
It enables creating a sequence similarity embedding using a fast method that creates a sparse distance matrix . The USEARCH tool needs to be downloaded manually, so it's not perfect. Therefore I still think a sequence similarity metric is relevant for UMAP as well.
BTW, while I have you on the line, can you check out this issue on the USEARCH tool? https://github.com/prihoda/usum/issues/2

There is a numba jitted levenshtein here https://gist.github.com/tuxedocat/fb024dfa36648797084d by @tuxedocat. It can be added to the distances in umap/pynndescent to calculate the distances between strings of unequal length, but the input needs to be a list of strings, so the check_array() calls which check if the input is a 2D array in various places need to be rearranged.

Regarding https://github.com/prihoda/usum/issues/2, @lmcinnes is there an easy way to use the output of an arbitrary kNN algorithm in the form of (knn_indices, knn_distances) or a sparse matrix (where only nearest neighbors have distances) in UMAP as a "precomputed" distance?

I don't believe there is a straightforward approach that would do the job, no. Sorry. I think it wouldn't be too hard to add such a possibility as extra input parameters to the fit call, or special handling of sparse precomputed distance matrices.
To get around the 2d array check you can rewrite the distance to check the string distance between the first element of each array and have a 2D array where each row is a length 1 array with a string. I'm not sure if that won't fall afoul of other processing elsewhere however (there may be a desire to convert things to floats buried in the code, for instance). This is something I would eventually like to fix -- allowing more interesting distances such as string based distances, normalized compression distance, etc. and thus allowing a lot more variety of input, but there are a lot of fiddly details to make everything play nice in what is now a rather large codebase. Hopefully this might be a 0.6 release feature.


Would it make sense to support hosting falcon apps via aiohttp?

We'll probably want to close this as Won't Fix in order to focus resources on ASGI.
But maybe we could wait a bit with closing until our ASGI support matures a bit more so we would get a better feeling what advantages/disadvantages aiohttp provides vs ASGI.

As we have now jumped on the ASGI bandwagon, I am going to close this for now.
aiohttp seems to have evolved into sort of a framework on its own, interestingly even bearing some similarities to Falcon. However, at the same time it does not look very suitable for layering another framework (such as Falcon atop) it. Indeed, one doesn't really find (m)any higher level frameworks in that vein: https://docs.aiohttp.org/en/stable/third_party.html
Maybe one day aiohttp gets ASGI support itself, even though that looked unlikely at the time it was being discussed.


Remove colibri/videobridge

Update jitsi-xmpp-extensions.
Remove CallConference.isJitsiVideobridge.
Remove MediaAwareCallPeer.isJitsiVideobridge.
Remove more videobridge references.
Remove more videobridge/colibri code.
Remove OperationSetVideoBridge.
Remove more videobridge references.
Remove ColibriStreamConnector and other colibri references.
Bring back default constructor used in jigasi.

My build against jitsi/jitsi-xmpp-extensions#86 succeeds, but I'm not able to run the unit tests.
Jigasi builds and tests pass against this PR plus jitsi/jitsi-xmpp-extensions#86

@damencho maybe you can run a quick jigasi test?

I will try that next week and will let you know.

I think I found one instance of a now wrong if/else that slipped because of the missing braces during cleanup. I can't comment on the transport changes or test Jigasi.

Thanks, that's fixed now.

I have tested jigasi inbound calls and transcriptions and everything seems to be working fine. I think we can merge both PRs

We jut need to update xmpp-extensions once there is an available build.


ng: command not found

Bug Report or Feature Request (mark with an x)
ng: command not found
Versions
node 10.6.0
npm 6.1.0
Angular 6.0.8
Repro steps
I have installed Node and Npm using Brew in macOS High Sierra.
I can see npm and node working because I can get the versions from them and start an Express application.
When I install npm install -g @angular/cli it says that it was installed satisfactorily.
But when I run ng serve or any ng operation it shows ng: command not found.
I followed some recommendations of cleaning the cache of npm but it doesn't work despite doing this. Also I tried npm link and despite executing  the commands on @angular when I enter ng serve the problem persists.
I can see that angular get's installed and if I uninstall it it happens too.
But no matter what the ng command can't be found.
Please help

I solved the problem by establishing an alias in my .bash_profile
For some reason @angular/cli wasn't creating the path.

I'm facing the same issue, did several ways of trouble shooting .. till it says ng command not found


Babel Esperanto has issues with character accents

When using 'pdflatex' to compile a file containing Esperanto accented letters, the accents are separated from the letters in the HTML generated (using ngPDF). This occurs for both the 'hat' accent (^) and the other accent (usually obtained in latex via '\u{u}'). The accents behave differently between lower-case letters, and upper-case letters. It doesn't matter if the accent is applied using '^{c}', the babel-esperanto active character ^c, or unicode letters.
For ngPDF-generated HTML when using 'lualatex', the accents remain in place for almost all cases - the babel-esperanto active ^h does not work. All other active ^ characters retain their accent. Unicode works, and accents remain. When using ^{h} type, the accent remains.

well yes, tough. pdflatex can not really produce correct ToUnicode for such accents. There is some code in the pdfx package imho that tries to place accents behind the base char, but I don't know how well it works.
Using an unicode engine is recommended here.
The problem with the ^h should be reported to the esperanto  maintainer. He should use (at least with the unicode engines) something like \declare@shorthand{esperanto}{^h}{ĥ} instead of an \llap.


onnxruntime.capi.onnxruntime_pybind11_state.NoSuchFile: [ONNXRuntimeError] : 3 : NO_SUCHFILE

I run into the following error on flashrank==0.2.4
onnxruntime.capi.onnxruntime_pybind11_state.NoSuchFile: [ONNXRuntimeError] : 3 : NO_SUCHFILE : Load model from /tmp/ms-marco-TinyBERT-L-2-v2/flashrank-TinyBERT-L-2-v2.onnx failed:Load model /tmp/ms-marco-TinyBERT-L-2-v2/flashrank-TinyBERT-L-2-v2.onnx failed. File doesn't exist

Manually changing the cache dir from /tmp to ./ fixes this.
Would love to be able to do this directly from langchain from langchain.retrievers.document_compressors import FlashrankRerank
Passing a client manually also doesn't work as it downloads the model correctly but still seems to be reading from the /tmp directory.
compressor = FlashrankRerank(
    model="ms-marco-TinyBERT-L-2-v2",
    top_n=5,
    client=Ranker(model_name="ms-marco-TinyBERT-L-2-v2",cache_dir='./')
)

I am facing the same issue

Temporary workaround: manually download the model files from https://huggingface.co/prithivida/flashrank/blob/main/ms-marco-MultiBERT-L-12.zip and extract into /tmp

@anudit - Thanks for reaching out. FlashRank exposes cache_dir as a init param. While '/tmp' is considered as a sensible default (as model files will be automatically cleaned upon restart), people running lambda like serverless cannot use /tmp hence cache_dir is exposed.
That being said I don't own the Langchain integration of FlashRank, so I neither can comment (on why it is not letting you use the parameters like cache_dir upon init) nor I can reproduce it at FlashRank end. It is a good idea to open an issue with Langchain to modify the integration so it allows devs to take advantage of the cache_dir init param.


Missing all but the executable on mise install - MacOS 14.6.1

Describe the bug
I installed mise via curl https://mise.run | sh. All I could find was the executable. There was no mise directory in any of the other locations.
To Reproduce
I added the appropriate environment variables to my .zshenv and sourced the shims directory in .zprofile. I then installed mise using the script (curl https://mise.run | sh). I ran mise doctor expecting everything to be in working order, but mise indicated that there was no shell integration. I double checked my zsh configuration, which was in order, so I tried to look in the share/mise/shims directory. There wasn't one.
My .zshenv is configured thusly:
export XDG_DATA_HOME=$HOME/.local/share
export XDG_CONFIG_HOME=$HOME/.config
export XDG_STATE_HOME=$HOME/.local/state
export XDG_CACHE_HOME=$HOME/.cache

# [[  Mise  ]] #
export MISE_DATA_DIR=XDG_DATA_HOME/mise
export MISE_CONFIG_DIR=XDG_CONFIG_HOME/mise
export MISE_STATE_DIR=XDG_STATE_HOME/mise
export MISE_CACHE_DIR=XDG_CACHE_DIR/mise

My .zprofile mise configuration:
# [[  Mise shims  ]] #
export PATH="$HOME/.local/share/mise/shims:$PATH"

There was no mise directory in my .cache, .config, .local/share, or .local/state directories. Just the executable in .local/bin.
Expected behavior
I expected a full installation.
mise doctor output

version: 2024.9.6 macos-arm64 (1c0bc95 2024-09-18)
activated: no
shims_on_path: no

build_info:
  Target: aarch64-apple-darwin
  Features: DEFAULT, NATIVE_TLS, OPENSSL
  Built: Wed, 18 Sep 2024 21:36:58 +0000
  Rust Version: rustc 1.81.0 (eeb90cda1 2024-09-04)
  Profile: release

shell:
  /opt/local/bin/zsh
  zsh 5.9 (arm-apple-darwin23.2.0)

dirs:
  data: XDG_DATA_HOME/mise
  config: XDG_CONFIG_HOME/mise
  cache: XDG_CACHE_DIR/mise
  state: XDG_STATE_HOME/mise
  shims: XDG_DATA_HOME/mise/shims

config_files:

backends:
  cargo
  core
  go
  npm
  pipx
  spm
  ubi
  vfox

plugins:

toolset:

env_vars:
  MISE_DATA_DIR=XDG_DATA_HOME/mise
  MISE_STATE_DIR=XDG_STATE_HOME/mise
  MISE_CONFIG_DIR=XDG_CONFIG_HOME/mise
  MISE_CACHE_DIR=XDG_CACHE_DIR/mise

settings:
  activate_aggressive = false
  all_compile = false
  always_keep_download = false
  always_keep_install = false
  asdf = true
  asdf_compat = false
  cache_prune_age = "30d"
  cargo_binstall = true
  color = true
  disable_default_shorthands = false
  disable_hints = []
  disable_tools = []
  experimental = false
  go_default_packages_file = "~/.default-go-packages"
  go_download_mirror = "https://dl.google.com/go"
  go_repo = "https://github.com/golang/go"
  go_set_gopath = false
  go_set_goroot = true
  go_skip_checksum = false
  http_timeout = 30
  jobs = 4
  legacy_version_file = true
  legacy_version_file_disable_tools = []
  libgit2 = true
  node_compile = false
  not_found_auto_install = true
  paranoid = false
  pipx_uvx = false
  plugin_autoupdate_last_check_duration = "7d"
  python_default_packages_file = "~/.default-python-packages"
  python_pyenv_repo = "https://github.com/pyenv/pyenv.git"
  raw = false
  trusted_config_paths = []
  quiet = false
  use_versions_host = true
  verbose = false
  vfox = false
  yes = false
  ci = false
  debug = false
  trace = false
  log_level = "info"
  python_venv_auto_create = false

  [ruby]
  default_packages_file = "~/.default-gems"
  ruby_build_repo = "https://github.com/rbenv/ruby-build.git"
  ruby_install = false
  ruby_install_repo = "https://github.com/postmodern/ruby-install.git"

  [status]
  missing_tools = "if_other_versions_installed"
  show_env = false
  show_tools = false

No warnings found
1 problem found:

1. mise is not activated, run mise help activate or
   read documentation at https://mise.jdx.dev for activation instructions.
   Alternatively, add the shims directory XDG_DATA_HOME/mise/shims to PATH.
   Using the shims directory is preferred for non-interactive setups.

Additional context
Output of mise --debug:

error: 'mise' requires a subcommand but one was not provided
  [subcommands: activate, alias, a, aliases, asdf, backends, b, backend, backend-list, bin-paths, cache, completion, complete, completions, config, cfg, current, deactivate, direnv, doctor, dr, env, e, exec, x, generate, gen, global, g, hook-env, hook-not-found, implode, install, i, latest, link, ln, local, l, ls, list, ls-remote, list-all, list-remote, outdated, plugins, p, plugin, plugin-list, prune, registry, reshim, run, r, self-update, set, ev, env-vars, settings, shell, sh, sync, tasks, t, task, trust, uninstall, remove, rm, unset, upgrade, up, usage, use, u, version, v, watch, w, where, which, help]

Usage: mise [OPTIONS] <COMMAND>

For more information, try '--help'.

Output of mise --trace:

error: 'mise' requires a subcommand but one was not provided
  [subcommands: activate, alias, a, aliases, asdf, backends, b, backend, backend-list, bin-paths, cache, completion, complete, completions, config, cfg, current, deactivate, direnv, doctor, dr, env, e, exec, x, generate, gen, global, g, hook-env, hook-not-found, implode, install, i, latest, link, ln, local, l, ls, list, ls-remote, list-all, list-remote, outdated, plugins, p, plugin, plugin-list, prune, registry, reshim, run, r, self-update, set, ev, env-vars, settings, shell, sh, sync, tasks, t, task, trust, uninstall, remove, rm, unset, upgrade, up, usage, use, u, version, v, watch, w, where, which, help]

Usage: mise [OPTIONS] <COMMAND>

For more information, try '--help'.

mise creates those directories when needed, not when the setup script is run. You shouldn't be defining the env vars since what you're intending is the default. You've made a mistake by not including the "$".

 Fixed.


No built-in support for 'internal/network' in Gentoo Linux

I have a problem. I use Gentoo. The package of Gentoo is named wireless-tools instead wireless_tools. And I have (reason: No built-in support for 'internal/network')...

My (now deleted) answer from #354:
polybar doesn't actually look for wireless_tools (or wireless_tools for that matter), it searches for libiw.so and iwlib.h, so make sure you have those files on your system and also that you built polybar after those files were installed.

Thanks Patrick. But I did not find libiw.so or iwlib.h in my gentoo, although wireless-tools and net-wireless/iw was installed. I will deal with this. In everything else Polybar is excellent!!!

I don't have a gentoo distro ready, so I pulled the sources from https://packages.gentoo.org/packages/net-wireless/wireless-tools and compiled it on my arch system and it generated the libiw.so. What files are installed by the wireless-tools package?

In which folder is the file libiw.so in your Arch?

/usr/lib64?

For me its at /usr/lib/libiw.so

I dont find libiw.so in /usr/lib or /usr/lib64

Well it should be part of the wireless-tools package, so if you print the list of files provided by that package, you should be able to find it.

Ok. I'll try to rebuild the wireless-tools package and polybar. Thank You!

You should be able to list all files by wireless-tools with equery f wireless-tools

I don't know how it works on gentoo, but on my system I use systemctl poweroff and because of polkit it doesn't prompt for a password.
Does that mean, you were able to compile polybar with network support?

I understood. You use systemd. I use openrc, they are different. I saw dotfiles with systemctl poweroff. In gentoo without systemd I use the command poweroff on admin and sudo poweroff, but with xfce on my other pc I dont have this problem on user profile.

Many thanks, I'll think how to solve these problems.

I'm on Gentoo as well and I have no problems with wireless-tools, internal/network is working fine.
$ eix wireless-tools
[I] net-wireless/wireless-tools
     Available versions:  30_pre9 {multicall}
     Installed versions:  30_pre9(07:11:25 PM 02/07/2018)(-multicall)
     Homepage:            http://www.hpl.hp.com/personal/Jean_Tourrilhes/Linux/Tools.html
     Description:         A collection of tools to configure IEEE 802.11 wireless LAN cards

$ locate libiw.so
/lib64/libiw.so
/lib64/libiw.so.30

Yes, in /lib, but not /usr/lib. I installed internal/network with module/eth and module/wlan in config. Its work. Thank You.

kajzersoze, what are You using: systemd or openrc?

openrc

What config You use for reboot and power off from user (not admin)? Please, see my message 5 days ago to Patrick.

I'm not using shutdown, but I guess you can google it how to do it via dbus (I think it's "stop" instead of "Restart", the rest of the line is the same as for reboot), anyway here's mine :
[module/powermenu]
type = custom/menu
format-spacing = 1
label-open = 
label-open-foreground = ${colors.secondary}
;label-close = cancel
label-close =  cancel
label-close-foreground = ${colors.secondary}
label-separator = |
label-separator-foreground = ${colors.foreground-alt}
format-padding = 1
menu-0-0 = log out
menu-0-0-exec = menu-open-1
menu-0-1 = reboot
menu-0-1-exec = menu-open-2
menu-1-0 = log out
menu-1-0-exec = i3-msg exit
menu-1-1 = cancel
menu-1-1-exec = menu-open-0
menu-2-0 = reboot
menu-2-0-exec = dbus-send --system --print-reply --dest="org.freedesktop.ConsoleKit" /org/freedesktop/ConsoleKit/Manager org.freedesktop.ConsoleKit.Manager.Restart
menu-2-1 = cancel
menu-2-2-exec = menu-open-0

Thank You. I'll try.

Closing as the issue has been resolved.

I am on Arch linux and there is no libiw.so by default not even in the lib64 i couln't figure out why i kept getting the "No built-in support for internal/network" message and while it worked flowlessly on my dekestop with i3status preinstalled installed. i3status requires wireless_tools which pulls libiw.so and header files. So do i have to install wireless_tools just to pull in the lib before rebuiling polybar?

Had the same issue on openSUSE. After installing libiw-devel polybar compiled with internal/network support !!
Maybe we should update the dependencies in the README ???

"wireless_tools required by internal/network"

@NBonaparte I had wireless-tools installed but I needed to install libiw-devel to get this working.
Anyway I added build instruction for openSUSE in the wiki so feel free to check them out if you are on the same distro facing the same problem !!!


Space mission

I created mission.js file.
I styled the missions component.
Added Api to Missions.

✅  🎆  STATUS APPROVED! ✅ 🎆

Hi @Becky449 💯,
Your project is complete!  There is nothing else to say other than... it's time to merge it :shipit:
Congratulations! 🎉

Highlights
✔  No linter errors.
✔  You used the correct GitHub-Flow.
✔  Good README
✔  Good Commit Messages
✔  All tests are passing
Optional suggestions
Every comment with the [OPTIONAL] prefix won't stop the approval of this PR. However, I strongly recommend you to take them into account as they can make your code better. Some of them were simply missed by the previous reviewer and addressing them will really improve your application.
Cheers and Happy coding!👏👏👏
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, remember to tag me in your question so I can receive the notification.

As described in the Code reviews limits policy  you have a limited number of reviews per project (check the exact number in your Dashboard). If you think that the code review was not fair, you can request a second opinion using this form.