export only public interface

Instead of exporting all symbols, we only export the public interface.
This has to benefits:

symbol handling is independent of Linux / Windows
makes it harder to accidentally use the non-exported interface (e.g. use the not-exported HTTP Transport)
no explicit __declspec(dllimport) required on Windows, as this is transparently handled by the export header macros.

By testing that, I also found missing symbols from pthread in static builds. Note: This is actually unrelated to the export header stuff.
Note: Technically, this PR is an ABI break, as it is no longer possible to use the HTTP transport directly. However, this was never supported as it was only in the public interface by accident (through a transitive include).

no explicit __declspec(dllimport) required on Windows, as this is transparently handled by the export header macros.

Unfortunately the macros make it look like a typical windows project.

By testing that, I also found missing symbols from pthread in static builds.

Nice catch!
I see two drawbacks though:
It introduces dependencies to generated files into the public interface, which aren't visible from the repository too. The main downside from my perspective – please correct me if I'm wrong: While clients should not use implementation details, it also complicates testing, especially of internal components.

no explicit __declspec(dllimport) required on Windows, as this is transparently handled by the export header macros.

Unfortunately the macros make it look like a typical windows project.

Yes, but that's how it is. Otherwise the library would have to be header-only. IMO this is the clean way to do it, and many other projects do so as well. Especially, if we later want to generate a Debian package, we do not want to spam with all internal symbols.

I see two drawbacks though:
It introduces dependencies to generated files into the public interface, which aren't visible from the repository too.

Well, yes but as this is a CMake project anyways, the user does not have to care about that. Also tools like Intellisense do not have any problems as they internally use the compilation database (compile_commands.json) which is generated in the configure stage of CMake - where also the header is generated.

The main downside from my perspective – please correct me if I'm wrong: While clients should not use implementation details, it also complicates testing, especially of internal components.

Yes, that is definitely a drawback. Our tests are currently a mixture of unit and integration tests. Ideally, we would split them and add explicit executables for unit tests (which then use the corresponding internal cxx files). For these tests, also the backend could be mocked.
For system tests, we just link against the influxdb lib and use it like a consumer of the API would. One benefit is then, that we would directly see if we use internals (by accident).

Yes, that is definitely a drawback. Our tests are currently a mixture of unit and integration tests. Ideally, we would split them and add explicit executables for unit tests (which then use the corresponding internal cxx files). For these tests, also the backend could be mocked.
For system tests, we just link against the influxdb lib and use it like a consumer of the API would. One benefit is then, that we would directly see if we use internals (by accident).

That's what I'm working on (currently having some Conan – CMake issue though). To make it short: All my requirements can be solved using cmake's object libraries. :+1:


Implement method to create Cloudant client from VCAP services environment variable

Add an additional method to parse a VCAP_SERVICES environment variable allowing easy binding of a service instance to a Cloud Foundry application.
Example VCAP_SERVICES variable is JSON:
{
    "cloudantNoSQLDB": [
        {
            "credentials": {
                "username": "example",
                "password": "xxxxxxx",
                "host": "example.cloudant.com",
                "port": 443,
                "url"<EMAIL_ADDRESS>            },
            "syslog_drain_url": null,
            "label": "cloudantNoSQLDB",
            "provider": null,
            "plan": "Lite",
            "name": "Cloudant NoSQL DB"
        }
    ]
}

I think that the method should take in the VCAP_SERVICES variable as an argument rather than pulling it from the environment itself. This allows the application to retrieve it from different sources and avoids the library dictating deployment policy to the consuming application.
See https://github.com/cloudant/python-cloudant/issues/254#issuecomment-267406439.


first abs build

Initial anaconda-recipes build, no apparent changes needed
Actions:

add several fields in the about section

going to close in favor of a new PR to reset the submodule


About the UniVTG License

Thanks for the excellent research!
Please let me know the license of this repository.

Hi @koshian2 , thanks for your interesting!
I will check and update the license later,
can you kindly tell me which purpose do you want to use?
thanks!

Hi, @QinghongLin ! Thanks for the reply.
I need to know if it can be used for commercial purposes.
If possible, I would be happy with a license like MIT or Apache 2.0
Thanks.

@koshian2 Hi, I have updated the license to MIT.
You can use it for commercial purposes, and I am happy it can be used to power more practice scenarios.
but please indicate our original GitHub repo and our paper if applicable.

@QinghongLin
Amazing!!! Thank you so much.
I would be happy to cite you. I'll be sure to feature your wonderful UniVTG on my blog in the future!


bump plugin, make spark provided

Coverage remained the same at 25.07% when pulling db6ba3af113dcd6e0f9de8a456e53423e94bf504 on ryan-williams:ug into 519a2158f66bd4b1fac2b6a2f5665cd7a07fb65a on hammerlab:master.


Nodetype check

Codecov Report

Merging #52 (ebbcd21) into master (cab90ac) will increase coverage by 0.14%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #52      +/-   ##
==========================================
+ Coverage   74.89%   75.03%   +0.14%
==========================================
  Files          17       17
  Lines         705      705
  Branches       14       14
==========================================
+ Hits          528      529       +1
+ Misses        165      163       -2
- Partials       12       13       +1

Impacted Files
Coverage Δ

packages/epanet-js/src/Workspace/Workspace.ts
96.00% <100.00%> (ø)

packages/epanet-js/src/Project/Project.ts
93.41% <0.00%> (+0.59%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cab90ac...ebbcd21. Read the comment docs.


Add platform info

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#208  👈
#207
#206
#205
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @ksharma-xyz and the rest of your teammates on  Graphite


Webmention/Indieweb support

It would be great if there was support for webmentions (e.g: https://webmention.io/) and the larger indieweb movement (e.g: https://indiewebify.me)

On my personal blog, I have modified the footer template to add various rel=me links for example (a footer-extra similar to head-extra would be great for this by the way).

On my personal blog, I have modified the footer template to add various rel=me links for example (a footer-extra similar to head-extra would be great for this by the way).

Here's the IndieWeb wiki's page on Hugo.
Of note is this guide for the first few steps of indiewebification.

Here's the IndieWeb wiki's page on Hugo.
Of note is this guide for the first few steps of indiewebification.

Add header-extra and footer-extra.
Also add support for webmentions via config:
params:
  webmentions:
    login: hugo-theme-anubis
    pingback: true

And finally add a note about "rel=me" to #6

Add header-extra and footer-extra.
Also add support for webmentions via config:
params:
  webmentions:
    login: hugo-theme-anubis
    pingback: true

And finally add a note about "rel=me" to #6

I think some way to display comments via ping back is possible during the build process by using the API. I found this thread which hinted at a possible solution.

I think some way to display comments via ping back is possible during the build process by using the API. I found this thread which hinted at a possible solution.

And of course, there's the missing support for microformats which I haven't seen mentionned yet.
Thank you for your work on this theme, I really like it!

And of course, there's the missing support for microformats which I haven't seen mentionned yet.
Thank you for your work on this theme, I really like it!

Added microformats support.
Pingback: I will check thread later.

Added microformats support.
Pingback: I will check thread later.

Maybe the config should not ask for a https://webmention.io/ login but for a webmention receive URL to support other webmention services then webmention.io . I think this could be done by changing the config variable from login to url and load the complete url in head.html. I have successfully tested it here:
https://github.com/NilsKempen/hugo-theme-anubis/commit/581827ee8ea87f5fd50620e627824370dfadb7ce


Update to new version of Emmett

Hi,
I created a pull request for Emmett. There is a bug with React JS and mixins, where emitting events causes unregistered handlers to be triggered.
Would be great to get that fixed :-)

Linked to jacomyal/emmett#8.


[Polymetis] Misc. Franka client features for debugging

Description
Changes:

Disable native low-pass filter for Franka control
Disable rate limiting for Franka control
Add boolean representing command packet success to robot state
Re-add our own configurable low-pass filter in the robot client (with a default value of 100, same as franka::kDefaultCutoffFrequency)

Type of change
Please check the options that are relevant.

[ ] Bug fix (non-breaking change that fixes an issue)
[ ] Proposes a change (non-breaking change that isn't necessarily a bug)
[ ] Refactor
[x] New feature (non-breaking change that adds a new functionality)
[ ] Breaking change (fix or feature that would break some existing functionality downstream)
[ ] This is a unit test
[ ] Documentation only change
[ ] Datasets Release
[ ] Models Release

Type of requested review

[ ] I want a thorough review of the implementation.
[ ] I want a high level review.
[ ] I want a deep design review.

Before and After
If this PR introduces a change or fixes a bug, please add before and after screenshots (if this is causes a UX change) or before and after examples(this could be plain text, videos etc ) to demonstrate the change.
If this PR introduces a new feature, please also add examples or screenshots demonstrating the feature.
Testing
Please describe the tests that you ran to verify your changes and how we can reproduce.
Checklist:

[ ] I have performed manual end-to-end testing of the feature in my environment.
[ ] I have added Docstrings and comments to the code.
[ ] I have made changes to existing documentation where needed.
[ ] I have added tests that show that the PR is functional.
[ ] New and existing unit tests pass locally with my changes.
[ ] I have added relevant collaborators to review the PR before merge.
[ ] [Polymetis only] I ran on hardware (1) all scripts in tests/scripts, (2) asv benchmarks.

Codecov Report

Merging #1016 (285180a) into main (f73e442) will decrease coverage by 0.09%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #1016      +/-   ##
==========================================
- Coverage   33.23%   33.14%   -0.10%
==========================================
  Files         347      346       -1
  Lines       34279    34034     -245
==========================================
- Hits        11393    11280     -113
+ Misses      22886    22754     -132

Impacted Files
Coverage Δ

lowlevel/minecraft/pyworld/physical_interfaces.py
78.98% <0.00%> (-1.92%)
:arrow_down:

interpreter/craftassist/tasks.py
74.63% <0.00%> (-0.37%)
:arrow_down:

agents/droidlet_agent.py


Add Ark Reading LOGO to Who's using ESLint section

The one in the middle of the first line. Thanks.

🆘 I've signed CLA and pushed the amended commit with matched git config, but there's still CLA: Error.

We've been having trouble with the bot. I trust you. :)


[Bug] Unexpected behavior with CondaActivate, not recognize conda binary inside built-in vim terminal

Step to reproduce:

create an file test.vim

if has('win32')
    call plug#begin(has('nvim') ? stdpath('data') . '/plugged' : '~/vimfiles/plugged')
else
    call plug#begin(has('nvim') ? stdpath('data') . '/plugged' : '~/.vim/plugged')
endif
Plug 'https://github.com/ubaldot/vim-conda-activate', {'for': ['python', 'julia']}
call plug#end()

run vim -u test.vim to load the setting
:PlugInstall to install vim-conda-activate
:vert term to open the terminal and check if conda exist then close terminal without leaving vim
:e /python/file to edit the python file
:CondaActivate an select a random env
:vert term to check conda will not exist.

Additional information:

OS: Windows 11
Terminal: Allacritty
vim-conda-activate --version: latest

My thought:
Activating the command in vim-conda-activate so $PATH will be changed that leads to not recognize conda binary.

Hum, I cannot test it now on Windows, but I did in MacOSX and there is not that problem, but it could be that problem in Windows. And your thoughts make sense.
conda binary is typically in some .../condabin folder, typically in ~/Miniconda3/condabin or something like that. You can check on your system.
Could you please verify if the output of echo $PATH from different places makes such a condabin folder to disappear?

I am looking into the issue and it seems that the issue appears when you start vim from cmd.exe. I tried and the problems does not seem to be if you start vim from Powershell. Do you confirm?

Yes it works. I tested on cmd.exe and cmd.exe is problem. But still need to check if it working on others terminal or not( gnome-term, kde-term..).

@hungpham3112  Any news on this issue? :)

I tested on Pop-OS (Ubuntu-based) 22.04 in allacritty  terminal with conda 23.5.0 and didn't see any error. I think the problem solved. Thanks for your hard work.


dev: remove PENDING status 🔨

In 0.12 Starknet will remove PENDING status for transactions.
We should also remove it, it was quite confusing anyway and can help simply a few different parts of the codebase.
Blockers
We need to wait for rpc specs + starknet-rs + starknet-js to remove it before.

can I take this issue and are we able to remove it ?

can I take this issue and are we able to remove it ?

Wait 1/2 weeks for 0.12, should be good

can I take this issue and are we able to remove it ?

Wait 1/2 weeks for 0.12, should be good

why ? we dont have to wait for 0.12, we can remove it now.

I'm on it

I'm on it

hey, when will it be ready ?

Can i pick this if @sparqet has not picked yet?

https://github.com/keep-starknet-strange/madara/pull/971

#971 https://github.com/keep-starknet-strange/madara/pull/971

I found was that we never consume or write logic dependent on the pending state of transaction in the codebase.
Closest we come to writing logic based on transaction status is here -https://github.com/keep-starknet-strange/madara/blob/main/crates/client/rpc/src/lib.rs#L865
No other occurences came close to consuming this value.
We show this value in RPC Spec here for reference but this is used for readme and has no impact on codebase - https://github.com/keep-starknet-strange/madara/blob/main/crates/client/rpc-core/starknet_openRPC.json#L1883
I think we can close this issue if this sounds good to everyone.


Feature - OmitIf

omitIf omits properties of an object if they fulfill a test too.
var obj = {a: 1, b: 2, c: 3, d: 4, e: 5};

it('copies an object omitting the listed properties fulfilling a test', function() {
    eq(R.omitIf(R.lt(2), ['a', 'c', 'e'], obj), {a: 1, b: 2, d: 4});
});

I'd like to know a little more about why you see this as important enough to include.  I don't think I personally have ever reached for a function like this.
Also, the use of both the names and the predicate seems strange to me.  I would imagine that if I wanted this, I would want something similar to filter:
const omitWith = useWith(filter, [complement, identity]);
omitWith(gt(__, 2), {a: 1, b: 2, c: 3, d: 1, e: 5}); //=> {"a": 1, "b": 2, "d": 1}

But I'd have to be convinced that it's a common enough use case to include in the library.

The identity is not necessary, right? useWith(filter, [complement])
I see all these methods as a utility belt where I reach whenever I need the code to be more descriptive, more declarative and shorter.
I would also find handy from time to time pickIf.
A use case can be:
R.map(item => {
    const result = {};

    if(!test(item.a)) result.a = item.a;
    if(!test(item.b)) result.b = item.b;

    return item;
});

// OR

R.map(R.omitIf(test, ['a', 'b']))

The identity is not necessary, right? useWith(filter, [complement])

It will function, but it will report the wrong arity.  Whether that's important or not to you is your call.

I would also find handy from time to time pickIf.

filter already plays that role, without the list of fields:
filter(isOdd, {a: 8, b: 6, c: 7, d: 5, e: 3, f: 0, g: 9}); //=> {"c": 7, "d": 5, "e": 3, "g": 9}

Your sample code doesn't match the implementation, I believe.  But even if it did, that seems to just be restating what it does.  What's it for?  When would you use it?

Yes, I am especially interested in the named fields. Below is the real example of what I'd like to achieve. Maybe omitIf is really not necessary..? I need to get rid of fields portsStorage and portsNetwork if they're empty or nil. The field locations is an array too. I want to keep it.
const hosts = [
    {hostname: 'h1', portsNetwork: [], portsStorage: [], locations: []},
    {hostname: 'h2', portsNetwork: [], portsStorage: [1], locations: []},
    {hostname: 'h3', portsNetwork: [1], portsStorage: [], locations: []},
    {hostname: 'h4', portsNetwork: [1], portsStorage: [1], locations: []}
];

const hostsMapped = R.map(...)(hosts);

expect(hostsMapped).to.deep.eql([
    {hostname: 'h1', locations: []},
    {hostname: 'h2', portsStorage: [1], locations: []},
    {hostname: 'h3', portsNetwork: [1], locations: []},
    {hostname: 'h4', portsNetwork: [1], portsStorage: [1], locations: []}
]);

I'm not convinced that there is a lot of use for this.  To my mind this would make more sense in the Cookbook.  Feel free to try to convince me, though.
Are there others who want to push for this?  @asaf-romano, @buzzdecafe, @davidchambers, @kedashoe, @paldepind, @raine, @scott-christopher, @TheLudd?

To my mind this would make more sense in the Cookbook.

:+1:

I'm in two minds because I can't think of a simple way to achieve this using the current functions in Ramda, but I'm also wary of how often this would be used.
If we were to go ahead with this, I'd prefer to see it introduced with some symmetry to existing functions, or do so by the inclusion of some more generic functions to make this possible.
e.g.
// pickWith   :: (a -> Boolean) -> [String] -> {a} -> {a}
pickWith = (f, ks, o) => // TODO

// unpickWith :: (a -> Boolean) -> [String] -> {a} -> {a}
unpickWith = (f, ks, o) =>
  pickWith(complement(f), ks, o)

pick   = pickWith(T)
unpick = unpickWith(T)

Alternatively, this could be simpler to implement if R.unpick existed:
omitIf = (f, ks, o) =>
  merge(unpick(ks, o), reject(f, pick(ks, o)))

@scott-christopher, isn't better to use omitWith than unpickWith? Or is unpick somehow different from omit?

I didn't actually realise R.omit already existed, hahaha. Sorry for the confusion. 🙈
In that case, I'd be inclined to keep this one for the cookbook as:
omitIf = curry((f, ks, o) =>
  merge(omit(ks, o), reject(f, pick(ks, o))));

:cookie: :book:
thanks

didn't actually realise R.omit already existed

Well, I did, and I still struggled to come up with a clean formulation!  Nice, @scott-christopher!

https://github.com/ramda/ramda/wiki/Cookbook#remove-a-subset-of-keys-from-an-object-whose-associated-values-satisfy-a-given-predicate


fix: refactor history module initialization to fix conflict with global state

Summary of Changes
The way history feature was initialized in the splash screen was causing a race condition on the PersistentStorage which causes some glitches. One of them was resetting the store even after store is initialized with proper values.
After revisiting the whole flow, I found no need to use the state for setting history feature flag and we can rely only on the injectable flag, more clean and hassle free approach. Also fixed a re-render loop on the history cards page
Screenshots, videos, or gifs
Replace this text with embedded media for UI changes if they are included in this PR. If there are none, simply enter N/A
Breaking change guide
Replace this text with any breaking changes included in this PR along with how to address them in downstream projects. If there are none, simply enter N/A
Related Issues
Replace this text with issue #'s that are relevant to this PR. If there are none, simply enter N/A
Pull Request Checklist
Tick all boxes below to demonstrate that you have completed the respective task. If the item does not apply to your this PR check it anyway to make it apparent that there's nothing to do.

[x] All commits contain a DCO Signed-off-by line (we use the DCO GitHub app to enforce this)
[x] If applicable, screenshots, gifs, or video are included for UI changes
[x] If applicable, breaking changes are described above along with how to address them
[x] Updated documentation as needed for changed code and new or modified features
[x] Added sufficient tests so that overall code coverage is not reduced

If you have any questions to any of the points above, just submit and ask! This checklist is here to help you, not to deter you from contributing!
Pro Tip 🤓

Read our contribution guide at least once; it will save you a few review cycles!
Your PR will likely not be reviewed until all the above boxes are checked and all automated checks have passed

Codecov Report
Attention: Patch coverage is 29.41176% with 12 lines in your changes missing coverage. Please review.

Project coverage is 55.63%. Comparing base (f475eed) to head (b9786f5).
Report is 38 commits behind head on main.

Files with missing lines
Patch %
Lines

...legacy/core/App/modules/history/ui/HistoryPage.tsx
0.00%
9 Missing :warning:

packages/legacy/core/App/navigators/HomeStack.tsx
0.00%
2 Missing :warning:

packages/legacy/core/App/screens/Splash.tsx
50.00%
1 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1333      +/-   ##
==========================================
- Coverage   57.12%   55.63%   -1.49%
==========================================
  Files         204      217      +13
  Lines        6980     7603     +623
  Branches     1978     2159     +181
==========================================
+ Hits         3987     4230     +243
- Misses       2971     3351     +380
  Partials       22       22

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Add Test for ComplexBean

i add test for ComplexClass Structure.
Found a problem with Tuple2 deserializer.
cc @ruslansennov

Current coverage is 100.00%

Merging #24 into master will not affect coverage as of 9227cb8

@@            master     #24   diff @@
======================================
  Files           14      14
  Stmts          187     187
  Branches        44      44
  Methods          0       0
======================================
  Hit            187     187
  Partial          0       0
  Missed           0       0

Review entire Coverage Diff as of 9227cb8

Powered by Codecov. Updated on successful CI builds.

Thank you.
Current deserializer loses Tuples generic info, I'll fix it asap.
So sad I haven't seen these tests before

We still in RC1 :D
Not Really a problem.


ci: docker image sync push to dockerhub

Description
This Will Fix the CI/CD Pipeline for the docker images push w/ new pushes to the dockerhub of metacall/core
Note
Before Merging this PR we will need to add these two Env Vars. in GitHub Secrets of this repo.
DOCKERHUB_USERNAME

DOCKERHUB_TOKEN

which we can create from here: https://docs.docker.com/docker-hub/access-tokens/
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[x] Documentation update

Checklist:

[x] I have performed a self-review of my own code.
[x] I have commented on my code, particularly in hard-to-understand areas.
[x] My changes generate no new warnings.

It will be cool to change branches: [develop] to master or even better, tags.
It also requires:
./docker-compose.sh build
./docker-compose.sh push

In order to work properly.

I think we are pushing for develop branch right?
Because master branch last push was on Jan 14

@viferga

✅  PR is Ready for Review & Push
⚠  Just make sure to add those two GitHub secrets before merging it.

DOCKERHUB_USERNAME & DOCKERHUB_TOKEN


No module named 'dotenv'

You can replicate on colab !pip install roboflow import roboflow
Should we have an install_requires for dependencies in setup.py?

What was the resolution to this? Getting it in a fresh Colab when trying to use the roboflow pip package.


Fix uniqeness

Currently pfsense enforces unique unqualified hostnames for static dhcp leases, which is not correct as only the fully qualified hostname (hostname + domainname) must be unique. With this commit the old validation logic for uniqeness is modified such that hostnames no longer need to be unique and at the same time the fully qualified hostname hast to be unique.
This change makes it possible to have host with identical hostnames in different (sub)domains. For example myhost.sales.acme.com and myhost.support.acme.com will now be possible.

Please respect style guide - https://doc.pfsense.org/index.php/Developer_Style_Guide
This commit broke indent

In order to get patches applied you must sign Individual or Corporate CLA as described at https://www.pfsense.org/about-pfsense/#legal

OK, I signed an ICLA.


Revamp app registry and add parameter to control file creation

My comment crossed Willy's (I had it there in the review and only now I clicked the button). Let's see then, how/if to resume the white listing.


Ex7 typo

(Btw, I'm filing this, but will try to fix it myself too to help out - just depends on my available time today. :)
Ex 7 typo:
"This challenges involes"
should be
"This challenge involves"

Thanks for fixing this!


.sol domain handles and possible bid list rendering fix

Solves:

Currently we only query twitter handles claimed with bonfida. Investigate how we can query and display .sol wallet domains. Give priority to the twitter handle if a wallet has both .sol and twitter handle.

Immediately after placing a bid, the bid history doesn't correctly update to the new domain/wallet address. It seems to mess up bid history, and shows the previous bidder’s handle on the newest bid. Currently only way to resolve this is to do a page refresh.

For this one I'm not 100% sure changing the key attribute will fix it, but it's hard to test locally and worth a try.

Closed this, and opened new https://github.com/holaplex/metaplex/pull/214


Add WebPubSub bindings/trigger type support to v4 model

I noticed that we have a webPubSubTrigger which could work in v3 model (by function.json).
However, v4 model doesn't support such feature right now.
Would you mind add this as new feature into roadmap?

You can still use WebPubSub in the v4 model with generics. We will add support for other bindings based on feedback like yours, although I use docs like these to add support and I'm not seeing one for WebPubSub. Do you by chance work on the WebPubSub extension or do you know who does? It'd be great to get those docs added first

Thanks for follow up.
For the document, I just follow the guide in Tutorial: Create a serverless real-time chat app with Azure Functions and Azure Web PubSub service. In the tutorial they create web pubsub binding in v3 model way.
I will take a look for the generics part.


appearance/textures+material are missing from root properties

so "appearance" should be added to each row on the city_object table.
The details of the texture/material are inside the geometry column, but the textures/materials those point to must be stored somewhere, and it's locally for v2.0 thus add a new column


1.9 update and libcamera problems

Hi, I've updated to the 1.9 and got reports thet the indi camera driver is failing. I tried diagnosing the libcamera, ran the libcamera-hello, and I got the error about the missing libavcodec.so.60.
Apparently the avcodec lib was bumped up to 6.1 in the archlinux update and now the libcamera-rpi breaks (and consequently the indi-pylibcamera, which depends on the libcamera-rpi).
Any help is much appreciated in getting the camera to work again! Many thanks for your continuous support!

thanks for the report! Having some rest at the moment after a small surgery, if I will find some time, I will recompile the driver in the upcoming week, thanks for the patience in advance!
Mattia

Best wishes for the recovery! Take your time!
I investigated a bit more and there seems to be another issue, the indi-pylibcamera depends on libcamera-rpi, which is identical (at least in version) to the installed libcamera, but it triggers the uninstall of libcamera and install of libcamera-rpi, and in the process an outdated python-libcamera is installed which breaks the indi driver. On top of that, the rpicam-apps does not seem to be installed by default with the stack, together with all dependencies. Just to add a bit to the problem :)
Grazie e buon recupero!

hi @ripkrizbi, I recompiled everything and it seems to be working, whenever you have time to update it woudl be great to get a feedback, thanks!

Thank you Mattia!
I did a quick test with a completely fresh install, followed by update-astroarch, then pacman -S indi-pylibcamera
This prompted me to remove libcamera-* in favour of libcamera-rpi-* and initially it misses to install the rpicam-apps and its dependency (you may wish to add it explicitely to PKGBUILD) libpisp, which I installed manually.
After that, a quick test with libcamera-hello seems to be working.
The INDI part does not work (indiserver -v indi_pylibcamera), as the python-* packages are all compiled for the version 3.11 and the current python version in the new arch is 3.12, so all the installed dependencies are not visible to indiserver's python.
While you were in recovery I tried to recompile the whole stack myself (Arch is not my home territory :) ) and have made it to work, except some of the python depndencies, which I had to brute-force install via pip (could not get the python stuff to compile :( via PKGBUILD :( ). I have saved this install on a separate SD card and I can look up all the dependencies if you want me to, I think I needed to install additional python packages on top of the ones you provide in the stack. If I remember correctly, the very new release of python-libcamera2 has additional stuff it requires.
Additional question - why do you maintain the separate libcamera-rpi set of packages? The ones that come with the libcamera available through extra repo are more up to date (and you can remove one level of complexity by just using the distro packages if I'm correct)...
Thank you for the great support in resolving this, let me know if I can be of any further help!

thanks @ripkrizbi you are absolutely right, I missed some deps in PKGBUILD, I packaged it only once (this week was the second) and the procedure is not perfect, thanks to your inputs it will be :)
I will recompile pylibcamera today against py3.12
to your main question, libcamera (https://git.libcamera.org/libcamera/libcamera.git/) officially supports v4l2 cameras but doesn't support specific rpi cameras, that's why the raspi folks mantain a fork (https://github.com/raspberrypi/libcamera) that adds a bunch of raspi camera specifics.
There was an idea (still on the table) to replace completely (and for good) the normal version of libcamera with the one for the raspi. In my mind it makes sense but I am unsure if this won't break other libcamera "normal" stuff and that's why it's not been done so far

Many many thanks!
All clear about the libcamera-rpi.
Please make sure you recompile all the python-* dependencies for the stack, as I mentioned there were quite a few, and some I was unable to compile as packages :(
Thank you once again for the great support, this really makes a difference!

@ripkrizbi installing now indi-pylibcamera should bring in anything needed.
I checked the python dependencies but as far as I can tell, the latest versions of the ones I have within my repo have all been compiled against 3.12

Thanks Mattia!
unfortunately, some of the deps you maintain are still compiled for 3.11: simplejpeg, av, exifread, 'kmsxx'
I compiled the simplejpeg and bumped it to the most recent version (1.7.4), attached is the PKGBUILD
PKGBUILD.simplejpeg.txt
(I had to compile it within the venv because there is no arch package for python-cmake, I'm sure there is a simple solution to this but I was unable to find it :) )
I'm struggling to compile the av at the moment as there seem to be some incompatibilities with the new ffmpeg. So I had to brute-force it (pip install av --break-system-packages). Same for kmsxx  (pip install rpi-kms --break-system-packages)
after these updates, I'm able to start the indiserver with the indi_pylibcamera module.

Hi !
any update ? yesterday i freshly installed EndeavousOS on a old laptop, added your repo and installed the ind-3rdparty-drivers.
i found no indi_libcamera driver for managing a remotely connected HQ pi camera from my PC. i do i fix that ?
thanks

i tried installing indi-pylibcamera, but it does not work
any idea ?
the README.MD files says "sudo pacman -S indi-pylibcamera", which results in conflicts whit the local libcamera package...
but how do we make it work ? could you at least give a useful link ?
i tested the HQ camera + PI4_4GB with an ASTROBERRY sdcard and it works with the rpicam driver
here's is what i get when i try to launch the server by hand.
i tried to fix that by installing the missing python packages one by one but i stumble on the missing "simplejpeg" one that i'm not able to fix.
PLEASE HELP
~ » indiserver indi_pylibcamera                                                                                astronaut@astroarch
2024-09-05T19:39:06: startup: indiserver indi_pylibcamera
2024-09-05T19:39:06: Driver indi_pylibcamera: Traceback (most recent call last):
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/bin/indi_pylibcamera", line 33, in
2024-09-05T19:39:06: Driver indi_pylibcamera:     sys.exit(load_entry_point('indi-pylibcamera==2.6.4', 'console_scripts', 'indi_pylibcamera')())
2024-09-05T19:39:06: Driver indi_pylibcamera:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/bin/indi_pylibcamera", line 25, in importlib_load_entry_point
2024-09-05T19:39:06: Driver indi_pylibcamera:     return next(matches).load()
2024-09-05T19:39:06: Driver indi_pylibcamera:            ^^^^^^^^^^^^^^^^^^^^
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/importlib/metadata/init.py", line 205, in load
2024-09-05T19:39:06: Driver indi_pylibcamera:     module = import_module(match.group('module'))
2024-09-05T19:39:06: Driver indi_pylibcamera:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/importlib/init.py", line 90, in import_module
2024-09-05T19:39:06: Driver indi_pylibcamera:     return _bootstrap._gcd_import(name[level:], package, level)
2024-09-05T19:39:06: Driver indi_pylibcamera:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "", line 1387, in _gcd_import
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "", line 1360, in _find_and_load
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "", line 1331, in _find_and_load_unlocked
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "", line 935, in _load_unlocked
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "", line 995, in exec_module
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "", line 488, in _call_with_frames_removed
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/indi_pylibcamera/indi_pylibcamera.py", line 12, in
2024-09-05T19:39:06: Driver indi_pylibcamera:     from picamera2 import Picamera2
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/init.py", line 9, in
2024-09-05T19:39:06: Driver indi_pylibcamera:     from .picamera2 import Picamera2, Preview
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/picamera2.py", line 26, in
2024-09-05T19:39:06: Driver indi_pylibcamera:     from picamera2.encoders import Encoder, H264Encoder, MJPEGEncoder, Quality
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/encoders/init.py", line 6, in
2024-09-05T19:39:06: Driver indi_pylibcamera:     from .jpeg_encoder import JpegEncoder
2024-09-05T19:39:06: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/encoders/jpeg_encoder.py", line 3, in
2024-09-05T19:39:06: Driver indi_pylibcamera:     import simplejpeg
2024-09-05T19:39:06: Driver indi_pylibcamera: ModuleNotFoundError: No module named 'simplejpeg'
2024-09-05T19:39:06: Driver indi_pylibcamera: read: Connection reset by peer

Hi
today i restarted with a fresh 1.9 && updated astroarch
installed libcamera-rpi and libcamera-tools-rpi
i tried to launch "cam" but there are missing libs.
here are the missing libs i tried to fix
libpisp -> pacman -S libpisp
libboost-log -> pacman -S boost-libs
then i'm able to launch cam but there are errors:
~ » cam -l                                                                                astronaut@astroarch
[0:01:22.451106369] [1641] ERROR IPAModule ipa_module.cpp:172 Symbol ipaModuleInfo not found
[0:01:22.451575680] [1641] ERROR IPAModule ipa_module.cpp:292 v4l2-compat.so: IPA module has no valid info
[0:01:22.451711753] [1641]  INFO Camera camera_manager.cpp:313 libcamera v0.3.0
[0:01:22.474326203] [1642] ERROR DmaBufAllocator dma_buf_allocator.cpp:116 Could not open any dma-buf provider
[0:01:22.488454454] [1642]  WARN RPiSdn sdn.cpp:40 Using legacy SDN tuning - please consider moving SDN inside rpi.denoise
[0:01:22.490073739] [1642] ERROR RPI vc4.cpp:215 Failed to register camera imx477 10-001a: -12
Available cameras:
my camera is not seen by cam/qcam, even if i put dtoverlay=imx477 in /boot/config.txt and the cam is detected by the kernel
did i something wrong ?
regards,

@albmef as @ripkrizbi made me noticing, there are some deps that are broken. Will try to fix them asap to have the package ready to be working with no additional steps

thanks !
Feel free to ask for any quick/extensive test if needed
i own a PI4_4GB fitted with an HQ cam i can't wait to take nice night sky pictures with ;)
regards,
bob

@ripkrizbi I got all but exif recompiled, are you able to tell me what package requires it and which version? I think we are using exifread but just noticed there is also an exif package and got confused

@MattBlack85 first of all, thank you for all the effort in maintaining the distro and the extra packages! I'm fully aware how much effort it takes to do such a thing, especially on a voluntary basis, and just want to tell you how much I appreciate it!
I quickly checked, and can confirm that the packages I needed to make the indi_pylibcamera driver work were the simplejpeg, av and kmsxx. As I was going through the packages you maintain I noticed that the exifread was still in 3.11 so I included it into the list, thinking that it may be a dependency for something else.
So, at least for my issue, exifread is not required.
On a side note, how frequent are your bleeding-edge libindi/drivers/kstars builds? Do you have an automated process for periodic rebuilds? I'm trying to do a fresh git-based recompile because there may be a fix for my mount in the indilib after the official 2.0.9...

Hi
thanks for your kind support
today i upgraded arch and the new boost lib version 1.86.0 broke rpicam-apps
(see my new issue)
currently i'm performing some test with HQ camera, for my astro setup, so i needed a quick and dirty fix
regards,
bob

@ripkrizbi thanks for your words 🙇
For bleeding edge, I don't push it very often, I don't have enough horse power with my building machine to have it running periodically. My build box is a pi4.
The best thing would be to have a github actions running daily and in theory, that could work but only for indi. Kstars is a beast and it takes hours to compile on github actions or a raspberrypi 4.
I workaround that when I package the new official versions by using distcc but that's it, no fancy automation😋
I am planning to replace my build box with 2/3 Raspi 5 2Gi, that would probably help since the cluster would run 24/7 and have 16 powerful arm cpu to use, but when it is gonna happen I really have no idea 🫠

hi @ripkrizbi
could you provide me a quick Howto guide for making the indi_pylibcamera to run ? i'm really looking forward this.
this morning i tried to compile simplejpeg but no luck. i'm lacking the knowledge and time for fixing that.
the pi HQ cam is part of my setup i plan to use it as guiding cam, so a quick and dirty hack is ok for me in the meantime.
regards,
bob

sorry but it does not work yet
2024-09-20T09:24:42: startup: indiserver indi_pylibcamera
2024-09-20T09:24:43: Driver indi_pylibcamera: Traceback (most recent call last):
2024-09-20T09:24:43: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/previews/drm_preview.py", line 9, in
2024-09-20T09:24:43: Driver indi_pylibcamera:     import kms as pykms
2024-09-20T09:24:43: Driver indi_pylibcamera: ModuleNotFoundError: No module named 'kms'

have you updated recently @albmef ?

yes system up to date. i do it everyday
i installed the dependencies by hand to be sure
sudo pacman -S python-av kmsxx-git python-pillow python-pycamera2 python-lxml python-astropy python-pidng python-v4l2 python-simplejpeg libcamera-rpi rpicam-apps
but no luck

Interesting thanks!, We got the camera working flawlessly on @FireNWater somehow, will have a look at what we did additionally

thanks
but there is no python-kmsxx package in the arch repos
bob

@albmef as I have clearly written, the said package is maintained by @MattBlack85 and it is located in the astromatto repo. Have you tried running the commands I gave?

i tried force pip install rpi-kms but this does not work either
2024-09-10T23:18:22: startup: indiserver indi_pylibcamera
2024-09-10T23:18:26: Driver indi_pylibcamera: Traceback (most recent call last):
2024-09-10T23:18:26: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/previews/drm_preview.py", line 9, in
2024-09-10T23:18:26: Driver indi_pylibcamera:     import kms as pykms
2024-09-10T23:18:26: Driver indi_pylibcamera: ModuleNotFoundError: No module named 'kms'

hope this helps
ldd /usr/lib/python3.12/site-packages/pykms/pykms.so                                                                                astronaut@astroarch
linux-vdso.so.1 (0x0000ffff83687000)
libkms++.so.0 => /usr/lib/libkms++.so.0 (0x0000ffff83520000)
libkms++util.so.0 => /usr/lib/libkms++util.so.0 (0x0000ffff834f0000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x0000ffff83240000)
libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x0000ffff83200000)
libc.so.6 => /usr/lib/libc.so.6 (0x0000ffff83040000)
/usr/lib/ld-linux-aarch64.so.1 (0x0000ffff8364a000)
libdrm.so.2 => /usr/lib/libdrm.so.2 (0x0000ffff83000000)
libfmt.so.10 => not found
libm.so.6 => /usr/lib/libm.so.6 (0x0000ffff82f50000)

the problem is that i doubt that "pip install rpi-kms --break-system-packages" actually worked
ls /usr/lib/python3.12/site-packages/rpi*
zsh: no matches found: /usr/lib/python3.12/site-packages/rpi*
how do i check if the files were installed properly ?

If you installed without sudo, then the library should be in your ~/.local/lib/python3.12/site-packages directory, check there.
also, start python, then
import pykms
and if you get no errors then it's there. Make sure you start indiserver with the same user privileges as the ones you used to do the pip install

pip with sudo
sudo pip install rpi-kms --break-system-packages
[sudo] password for astronaut:
DEPRECATION: Loading egg at /usr/lib/python3.12/site-packages/urjtag-2021.3-py3.12-linux-aarch64.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at https://github.com/pypa/pip/issues/12330
Collecting rpi-kms
Downloading rpi_kms-0.1a1.tar.gz (3.4 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: rpi-kms
Building wheel for rpi-kms (pyproject.toml) ... done
Created wheel for rpi-kms: filename=rpi_kms-0.1a1-cp312-cp312-linux_aarch64.whl size=227855 sha256=f69514854ae9775b487384492ceb2fac1fa70caa3a54402da17e2c89048a8c0b
Stored in directory: /root/.cache/pip/wheels/c7/a9/5b/1c7a9b1f26df2f341d80cdc0bef9a19bf7236f110565832d4c
Successfully built rpi-kms
Installing collected packages: rpi-kms
Successfully installed rpi-kms-0.1a1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
check if installed
~ » tree /usr/lib/python3.12/site-packages/ | grep kms
├── pykms
│   ├── pykms.cpython-312-aarch64-linux-gnu.so
│   └── pykms.so
├── rpi_kms-0.1a1.dist-info
test with python
~ » python
Python 3.12.6 (main, Sep 13 2024, 13:27:21) [GCC 14.1.1 20240507] on linux
Type "help", "copyright", "credits" or "license" for more information.

import kms
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'kms'
import pykms
Traceback (most recent call last):
File "", line 1, in
File "/home/astronaut/.local/lib/python3.12/site-packages/pykms/init.py", line 1, in
from .pykms import *
ImportError: libfmt.so.10: cannot open shared object file: No such file or directory

test indiserver with sudo
» sudo indiserver indi_pylibcamera                                                                                1
2024-09-20T11:14:38: startup: indiserver indi_pylibcamera
2024-09-20T11:14:39: Driver indi_pylibcamera: Traceback (most recent call last):
2024-09-20T11:14:39: Driver indi_pylibcamera:   File "/usr/lib/python3.12/site-packages/picamera2/previews/drm_preview.py", line 9, in
2024-09-20T11:14:39: Driver indi_pylibcamera:     import kms as pykms
2024-09-20T11:14:39: Driver indi_pylibcamera: ModuleNotFoundError: No module named 'kms'

It appears you have installed the rpi-kms package twice, and now you have confused python somehow. In your error when importing pykms within python, you can see that the path is a LOCAL path (ie rpi-kms installed without sudo, File "**/home/astronaut/.local/lib**/python3.12/site-packages/pykms...).
remove both packages through pip (both local and system), then install only local (as I have written, please read the suggestions thoroughly). Then try again.

as you said i removed both local and system using pip uninstall
so only kmsxx-git remains on the system
~ » tree /usr/lib/python3.12/site-packages/ | grep kms                                                                                astronaut@astroarch
├── pykms
│   └── pykms.so
~ » tree .local/lib/python3.12/site-packages | grep kms
~ »
i cannot remove the kmsxx-git package because it break the dependency of indi-pylibcamera
~ » sudo pacman -R kmsxx-git                                                                                1
[sudo] password for astronaut:
checking dependencies...
error: failed to prepare transaction (could not satisfy dependencies)
:: removing kmsxx-git breaks dependency 'kmsxx-git' required by indi-pylibcamera
so i leave it installed.
i test with python
~ » python
Python 3.12.6 (main, Sep 13 2024, 13:27:21) [GCC 14.1.1 20240507] on linux
Type "help", "copyright", "credits" or "license" for more information.

import pykms
import kms
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'kms'

pykms is found but still no kms module
now i reinstall rpi-kms system wide with SUDO
~ » sudo pip install rpi-kms --break-system-packages
DEPRECATION: Loading egg at /usr/lib/python3.12/site-packages/urjtag-2021.3-py3.12-linux-aarch64.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at https://github.com/pypa/pip/issues/12330
Collecting rpi-kms
Using cached rpi_kms-0.1a1-cp312-cp312-linux_aarch64.whl
Installing collected packages: rpi-kms
Successfully installed rpi-kms-0.1a1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
i check it
~ » tree /usr/lib/python3.12/site-packages/ | grep kms
├── pykms
│   ├── pykms.cpython-312-aarch64-linux-gnu.so
│   └── pykms.so
├── rpi_kms-0.1a1.dist-info
~ » python
Python 3.12.6 (main, Sep 13 2024, 13:27:21) [GCC 14.1.1 20240507] on linux
Type "help", "copyright", "credits" or "license" for more information.

import pykms
Traceback (most recent call last):
File "", line 1, in
File "/usr/lib/python3.12/site-packages/pykms/init.py", line 1, in
from .pykms import *
ImportError: libfmt.so.10: cannot open shared object file: No such file or directory
import kms
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'kms'

it seems that there is still a conflict
but i'm not able to resolve it because indi-pylibcamera depends on kmsxx-git and i cannot remove it without removing indi-pylibcamera.
sorry but i don't really understand the ins and outs of forcing rpi-kms with pip, and second, which package actually provides the expected kms module (not pykms which is provided by kmsxx-git)
any idea ?

okay i renamed the pykms module for removing the conflict
~ » sudo mv /usr/lib/python3.12/site-packages/pykms/pykms.so /usr/lib/python3.12/site-packages/pykms/pykms.so.bak                                                                       astronaut@astroarch
~ » tree /usr/lib/python3.12/site-packages/ | grep kms
├── pykms
│   ├── pykms.cpython-312-aarch64-linux-gnu.so
│   └── pykms.so.bak
├── rpi_kms-0.1a1.dist-info
now it seems that there is a runtime lib dependency issue with the rpi-kms package
indiserver throws me this error
2024-09-20T12:47:40: Driver indi_pylibcamera:     from .pykms import *
2024-09-20T12:47:40: Driver indi_pylibcamera: ImportError: libfmt.so.10: cannot open shared object file: No such file or directory
~ » ldd /usr/lib/python3.12/site-packages/pykms/pykms.cpython-312-aarch64-linux-gnu.so
linux-vdso.so.1 (0x0000ffff9a043000)
libkms++.so.0 => /usr/lib/libkms++.so.0 (0x0000ffff99ef0000)
libkms++util.so.0 => /usr/lib/libkms++util.so.0 (0x0000ffff99ec0000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x0000ffff99c10000)
libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x0000ffff99bd0000)
libc.so.6 => /usr/lib/libc.so.6 (0x0000ffff99a10000)
/usr/lib/ld-linux-aarch64.so.1 (0x0000ffff9a006000)
libdrm.so.2 => /usr/lib/libdrm.so.2 (0x0000ffff999d0000)
libfmt.so.10 => not found
libm.so.6 => /usr/lib/libm.so.6 (0x0000ffff99920000)
please let me know when you have access to real hardware for doing actual tests. in the meantime i will try with a fresh install. please excuse my lack of knowledge with PKGBUILD. i'm an seasoned hardware guy, not software
as i said i can do tests at my side if needed.
thanks for your support
bob

@albmef I have the real hardware and was able to set the camera up no problem, so:
Start from fresh installation, then run the following commands in the exact order and without running or installing anything else:

update-astroarch
sudo pacman -S indi-pylibcamera
pip install rpi-kms --break-system-packages (without sudo!)

after that, indiserver -v indi_pylibcamera should not complain about anything and the camera should be ready to use. Report back if this is not the case, but please do not install or run anything else other than the above.

hi
i did exactly what you said today from a fresh 2.0.9 image and i still get this missing kms error
im' sorry

did it  !
i rebuilt the package from here
https://gitlab.archlinux.org/archlinux/packaging/packages/fmt/-/tree/10.2.0-1?ref_type=tags
installed the deps (doxygen,...)
i changed to aarch64 in the PKGBUILD file, makepkg,
then removed doxygen and spdlog (depend both on fmt v11)
then sudo pacman -U fmt-10.2.0-2-aarch64.pkg.tar.xz
added IgnorePkg = fmt in /etc/pacman.conf
now indiserver starts and i'm able to use the pi camera HQ !
hope this helps, thanks for your kind support and patience.
bob

The recent update of the doxygen and fmt packages breaks the kmsxx-git and libcamera packages. Packages will be updated soon. Be careful of your modifications which could break your systems. For Arch, it is preferable to use a PKGBUILD that can be uninstalled or updated properly and avoid 'pip install'

hi @MattBlack85 @ripkrizbi
i managed to get it work with fmt v11 so far
here's what i did:

upgrade fmt to v11  (removed exception in pacman.conf then sudo pacman -Su)

pip uninstall --break-system-packages rpi-kms    (removed broken local pykms)

sudo pacman -R kmsxx-git indi-pylibcamera     (removed broken system libkms++ libkms++-utils and pykms)

clone and rebuild kmsxx-git from https://aur.archlinux.org/packages/kmsxx-git   (changed to pkgrel=3)

sudo pacman -U kmsxx-git-r668.9ae90ce-3-aarch64.pkg.tar.xz   (installed the built package)

sudo pacman -S indi-pylibcamera

test pykms lib deps
ldd /usr/lib/python3.12/site-packages/pykms/pykms.so
linux-vdso.so.1 (0x0000ffff85b06000)
libkms++.so.0 => /usr/lib/libkms++.so.0 (0x0000ffff85990000)
libkms++util.so.0 => /usr/lib/libkms++util.so.0 (0x0000ffff85950000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x0000ffff856a0000)
libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x0000ffff85660000)
libc.so.6 => /usr/lib/libc.so.6 (0x0000ffff854a0000)
/usr/lib/ld-linux-aarch64.so.1 (0x0000ffff85ac9000)
libdrm.so.2 => /usr/lib/libdrm.so.2 (0x0000ffff85460000)
libfmt.so.11 => /usr/lib/libfmt.so.11 (0x0000ffff85410000)
libm.so.6 => /usr/lib/libm.so.6 (0x0000ffff85360000)

tested in kstar/EKOS -> ok
hope this helps, regards
bob

cool, let me rebuild kmsxxx then, should be ready in a few

this is done now, kmsxxx rel3 is officially available from my repo now

please be careful @MattBlack85 , as if you performed the build without having done the pacman -R kmsxx-git before, the libkms++-utils lib will not have been built with the right version of fmt (i did the mistake myself), so:
please do the test in your clone dir after the makepkg

cd pkg/kmsxx-git

/pkg/kmsxx-git (master*) » ldd pkg/kmsxx-git/usr/lib/libkms++util.so
linux-vdso.so.1 (0x0000ffffba7c7000)
libkms++.so.0 => /usr/lib/libkms++.so.0 (0x0000ffffba6d0000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x0000ffffba420000)
libm.so.6 => /usr/lib/libm.so.6 (0x0000ffffba370000)
libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x0000ffffba330000)
libc.so.6 => /usr/lib/libc.so.6 (0x0000ffffba170000)
/usr/lib/ld-linux-aarch64.so.1 (0x0000ffffba78a000)
libdrm.so.2 => /usr/lib/libdrm.so.2 (0x0000ffffba130000)
libfmt.so.11 => /usr/lib/libfmt.so.11 (0x0000ffffba0e0000)

/pkg/kmsxx-git (master*) » ldd pkg/kmsxx-git/usr/lib/libkms++.so
linux-vdso.so.1 (0x0000ffffaf344000)
libdrm.so.2 => /usr/lib/libdrm.so.2 (0x0000ffffaf250000)
libfmt.so.11 => /usr/lib/libfmt.so.11 (0x0000ffffaf200000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x0000ffffaef50000)
libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x0000ffffaef10000)
libc.so.6 => /usr/lib/libc.so.6 (0x0000ffffaed50000)
/usr/lib/ld-linux-aarch64.so.1 (0x0000ffffaf307000)
libm.so.6 => /usr/lib/libm.so.6 (0x0000ffffaeca0000)

/pkg/kmsxx-git (master*) » ldd pkg/kmsxx-git/usr/lib/python3.12/site-packages/pykms/pykms.so
linux-vdso.so.1 (0x0000ffff80c0b000)
libkms++.so.0 => /usr/lib/libkms++.so.0 (0x0000ffff80a90000)
libkms++util.so.0 => /usr/lib/libkms++util.so.0 (0x0000ffff80a50000)
libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x0000ffff807a0000)
libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x0000ffff80760000)
libc.so.6 => /usr/lib/libc.so.6 (0x0000ffff805a0000)
/usr/lib/ld-linux-aarch64.so.1 (0x0000ffff80bce000)
libdrm.so.2 => /usr/lib/libdrm.so.2 (0x0000ffff80560000)
libfmt.so.11 => /usr/lib/libfmt.so.11 (0x0000ffff80510000)
libm.so.6 => /usr/lib/libm.so.6 (0x0000ffff80460000)
bob

Bob, the rel3 just shipped is dynamically linked to libfmt.so.11

yes but with the old one still on my system, the built did performed as expected so i had to completely remove any occurence of libkms++ and pykms

correct, after that bump you should have nothing installed additionally by hand or they may conflict with the actual paths used by our stuff

tested ok after pacman -Suy and reboot
capture with EKOS : OK
rpicam-hello : OK
@ripkrizbi that solved my issue with HQ camera and indi
note that i'm now able to set the shutter time from 1ms to 600s, and read sensor temperature
YAY !!!!
astroberry cannot do that with the HQ camera because it's so old... the shutter speed is limited to few seconds or so, and old raspistill app sucks ! XD
thanks all for your support
best regards,
bob

thanks everyone involved into fixing this issue! It bugged us heavily in this month but I am super happy we solved it as a community, I really appreciate all you did folks.
Thanks @ripkrizbi @albmef @sc74 @FireNWater

yes it definitely worth having a reliable and FOSS solution for astro

closing this as solved :)


Add "Repport Errors" option when upgrade failed

Questions
Answers

Description?
Added an option to send an error report if a store upgrade failed

Type?
improvement

BC breaks?
no

Deprecations?
no

Fixed ticket?
-

Sponsor company
-

How to test?
-

This will not send JS errors, but the content of the "error" panel that occurred during an upgrade
Adding the tool will allow us to better understand errors only if the user wants to send a report.
Also users of the modules will not pay anything.

Hi @Hlavtox,
Now that we have a team dedicated to tackling all issues about the upgrade, we are indeed adding some error feedback form on the project. By providing a simple way to send the details to us with a click instead of a whole Github form, this should increase the number of feedback we receive, and then help prioritize the issues to work on.
As Morgan said this is a voluntary action, the error is sent to us only when the user confirms the modal. The visible inputs are optional, sending it as-is will provide basic but hopefully useful details about the error.

@Quetzacoalt91 @M0rgan01 Oh, okay, I thought that it will be an user implementation and the sentry ID will be configurable.
But that raises another questions:

Why should a reporting to Prestashop SA be implemented in open source native module? The project was finally decoupled from SA things and now you want to add another?
Who will have access to the data and errors reported? Will it be open to maintainer team?

This tool has been proven useful on many other projects of the company, it makes sense to bring it on this project so we don't depend only on reports made on GitHub. Although I understand your point, our decisions must be cost efficient. That's why we use the existing workspace instead of creating a new one specifically for the upgrade module.
At the moment only a few people can reach the project and permissions can be customized in the future. I'm not the one who will able to say if someone may access the data or not, but it may an good occasion to try the export feature if we want to share some data about the module health.

I filtered "sensitive" data, like the admin path or the token. Also anonymization work was done on the logs in the PR https://github.com/PrestaShop/autoupgrade/pull/725. I also remove the WIP statue and the PR block, the one concerned questions about data collection, subject moved here https://github.com/PrestaShop/PrestaShop/discussions/36432

@Quetzacoalt91 I understand what you are trying to achieve, but implementing in this in this way is breaking project neutrality.
It's the same as when I would want to implement reporting to my own custom server, from a native module.

That's why we use the existing workspace instead of creating a new one specifically for the upgrade module.

Yes, but when your company goes bankrupt, what will happen with this account on Sentry? All data will be lost.

If I understand what you mean, "implementing in this way" is related to the choice of Sentry.
When you think about it, the services currently powering the open-source repositories are already provided by PrestaShop SA. When it's not a Saas product directly, it would be the hosting for instance. We tend to reuse existing processes and solutions as they allow us to focus our knowledge on a minimal number of tools.
There are options on the Sentry interface to create GitHub issues when reports of the same problem are sent N times.

With this proxy that can merge similar events to the same issue, we have an opportunity to ease the reporting of problem without spamming our GitHub issues. Unfortunately we've been unable to try it out so far, because the autoupgrade module would be the first project with issues on GitHub and the feature obviously needs to be used.
This should answer your last question as well, but I'd add this wouldn't be our main issue if this happens.


Basemaps: remove custom baselayer context menu

CR @nobuti
- added remove basemap context menu

tests not added yet, to confirm implementation, will be added

Take into account while removing the custom basemap, it will still remain as a baselayer (they are different things) until the baselayer changes. This behaviour is consistent with current editor.

@CartoDB/design I just made the implementation, but expect the context menu cue (in the bottom right of the mosaics) to change accordingly to the last designs, feel free to followup discussion here and I'll update then
also, now this context menu opens from bottom left corner, as opening from bottom right corner will make the menu to crop in the left border of the screen
/cc @xavijam

ping!

I'm making the changes but kept with the context menu boilerplate, as using the factory wasn't that straightforward, some of the drawbacks I found (see attached animation):

I'd still need to use a template for the .js- child classes
need to stop propagation of events
the styles are not flexible enough

so for this time, I'm using the views and collections but that could be something to take into account for future improvements over that component

pong!

styles updated, changes applied /cc @nobuti @arianaescobar


Need to figure out how to populate species filter dropdown for "All species" query

Look, no species filters!

It should look like this (produciton gramene site):

When an "All species" search is run, there is a third query. It's the same as the count query with an additional facetcount=1000 query parameter. In the response, the facets array is populated as follows:
  "facets": [
        {
            "id": "TAXONOMY",
            "label": "Organisms",
            "total": 11,
            "facetValues": [
                {
                    "label": "Brassica rapa subsp. pekinensis",
                    "value": "51351",
                    "count": 5
                },
                {
                    "label": "Zea mays",
                    "value": "4577",
                    "count": 2
                },
                {
                    "label": "Theobroma cacao",
                    "value": "3641",
                    "count": 2
                },
                {
                    "label": "Oryza sativa Japonica Group",
                    "value": "39947",
                    "count": 2
                },
                {
                    "label": "Medicago truncatula",
                    "value": "3880",
                    "count": 2
                },
                {
                    "label": "Arabidopsis thaliana",
                    "value": "3702",
                    "count": 2
                },
                {
                    "label": "Triticum aestivum",
                    "value": "4565",
                    "count": 1
                },
                {
                    "label": "Oryza punctata",
                    "value": "4537",
                    "count": 1
                },
                {
                    "label": "Oryza glaberrima",
                    "value": "4538",
                    "count": 1
                },
                {
                    "label": "Hordeum vulgare subsp. vulgare",
                    "value": "112509",
                    "count": 1
                },
                {
                    "label": "Aegilops tauschii",
                    "value": "37682",
                    "count": 1
                }
            ]
        },
        {
            "id": "domain_source",
            "label": "Source",
            "total": 1,
            "facetValues": [
                {
                    "label": "Ensembl Genomes Gene",
                    "value": "ensemblGenomes_gene",
                    "count": 20
                }
            ]
        }
    ]

We can probably ignore the second domain_source facet and focus on the species facet.
Proposal: if facetcount is in the query string, add the following solr parameters:
{
   facet.field: '{!facet.limit='<facetcount value>' facet.mincount='0' key='system_name'}system_name'
}

It mostly works.
There are still some species name discrepancies, which may be harder to overcome:

Ensembl uses "Oryza sativa Japonica", we use "Oryza sativa Japonica group". This may be a bug on our end or related to an NCBI taxonomy vs Ensembl taxonomy (are they different?) issue.
Can't filter to Zea mays4m. It seems that the taxon_id is used to look up the name, and so it's set to the v3 "Zea mays".

Propose closing this issue and opening two more. I'll do it tomorrow morning

And another thing. There's no endpoint (other than genes, which is hardly appropriate) where there's a mapping between system_name, species (aka name) and taxon_id.
You can go system_name <=> taxon_id in /maps and taxon_id <=> species in /taxonomy.
There should be only one request necessary.


Add new tiny stack id

In preparation for renaming the tiny stack to io.paketo.stacks.tiny, we first want all Go language family CNB's to support the current tiny stack id as well as the new one. This way we will not break anyone during the transition. This PR adds the new stack id to the buildpack.toml.
Releng tracker story for reference: https://www.pivotaltracker.com/story/show/172902979

I noticed that the tiny stack id is used directly in the code here. I'm not sure if this will need to be changed once the stack id change is complete, but wanted to point it out.

@martyspiewak what is the timeline for removing the old stack ID?


GGUF models not utilising GPU on Windows

As discussed in this issue it appears the GGUF models are not utilising the GPU.
Environment setup:
GPU
RTX 3090TI
Driver Version (Nvidia Contol Panel) - 551.76
Driver Version (Device Manager) - <IP_ADDRESS>76
CUDA version:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Wed_Feb__8_05:53:42_Coordinated_Universal_Time_2023
Cuda compilation tools, release 12.1, V12.1.66
Build cuda_12.1.r12.1/compiler.32415258_0

OS
Windows 10 Pro
Version - 22H2
Build version - 19045.4046
Windows Feature Experience Pack - 1000.19053.1000.0
Python - 3.11.0
I was actually looking through the improving gguf cuda exception handling pull request and noticed the mention of using nvidia-smi to get the version info. I nearly went down a rabbit hole thinking I had some old 12.4 versions lying around but this seems to be for what compatibility version it supports:
Wed Mar 13 19:47:55 2024
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 551.76                 Driver Version: 551.76         CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                     TCC/WDDM  | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3090 Ti   WDDM  |   00000000:0A:00.0  On |                  Off |
|  0%   45C    P0            100W /  450W |    2434MiB /  24564MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

I then noticed:
        #   (4) cuda found via:  torch.cuda.is_available() -> note: torch not used in GGUF processing, but is used
        #       here as a safety check to confirm that CUDA is found and linked correctly to Python - over time,
        #       we may identify a better way to make this check outside of Torch

This was the smoking gun I needed. Checking torch.cuda.is_available() returned False, I needed to run the following command (got from here):
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
As soon as I did this I was full steam ahead:
(.venv) PS C:\Users\USER\Documents\projects\MYPROJECT> python ..\llmware\examples\SLIM-Agents\agent-multistep-analysis.py
update: Starting example - agent-multistep-analysis
update: Loading sample files
update: attempting to create source input folder at path:  C:\Users\USER\llmware_data\tmp\example_microsoft
update: creating library and parsing source document
update: executing query to filter to key passages - ibm - results found - 20
update: Launching LLMfx process
step -  1 -     creating object - ready to start processing.
step -  2 -     loading tool - sentiment
update: confirmed CUDA drivers recognized- will load model on CUDA - 12.1
ggml_init_cublas: GGML_CUDA_FORCE_MMQ:   no
ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes
ggml_init_cublas: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 3090 Ti, compute capability 8.6, VMM: yes
step -  3 -     loading tool - emotions
update: confirmed CUDA drivers recognized- will load model on CUDA - 12.1
step -  4 -     loading tool - tags
update: confirmed CUDA drivers recognized- will load model on CUDA - 12.1
step -  5 -     loading tool - ner
update: confirmed CUDA drivers recognized- will load model on CUDA - 12.1
step -  6 -     loading tool - answer
update: confirmed CUDA drivers recognized- will load model on CUDA - 12.1
step -  7 -     loading new processing text - 20 new entries
step -  8 -     executing function call - deploying - sentiment
step -  9 -     executing function call - getting response - sentiment
                                 -- llm_response - {'sentiment': ['positive']}

You weren't lying about that speed difference, it's seriously quick!
It may be worth having something in the README about installing torch via this method for other Windows users.
Thanks again for your help @doberst. Very much appreciated!
I'm happy for you to close this issue straight away (user error after all) but thought you may like to know the root cause.

@shneeba- thrilled that it is up and running (and FAST!)  .... I had to use the exact same line to install torch -pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 - will add to the README ...  (BTW, if you know a better way to validate that the local Python interpreter is connected to the CUDA drivers, we can switch from the pytorch check - but that was the best way that I could find ...)

Thanks for getting that added in! I think using the pytorch check for now is a good enough validation but I'll have a think. I'll close this issue now.


Add ServerSideSort control integration tests

Using the apacheds image, https://github.com/ldapjs/docker-test-apacheds/pkgs/container/docker-test-apacheds/apacheds, we should add proper integration tests for the ServerSideSort control. These tests will verify that we are sending the sort control request correctly, and verify that we are parsing the returned sort control response correctly.
See https://github.com/ldapjs/docker-test-apacheds/tree/b5b4c6b3807674fa3490b37946bdb388e0cdc073#testing-the-vlv-control for an example.

👋
On February 22, 2023, we released version 3 of this library. As a result, we are closing this issue/pull request.
Please see issue #839 for more information, including how to proceed if you feel this closure is in error.


Can I get the complete code？

Hello, I have read your paper, and I think your paper is very enlightening. So I want to reproduce your code. Can you calculate when the code will be uploaded? If you allow me to get the complete code, I would be very grateful. Please contact<EMAIL_ADDRESS>

Hi,
what are you missing from this repository?

Hello, I saw you add args_dict.pt under the models folder last week, does
this mean that there are still many codes that have not been submitted? In
addition, I haven't found the location to store the dataset and can't use
the dataset to train the model by myself. Can you help me?
MartinPernus @.***> 于2023年2月6日周一 16:22写道：

Hi,
what are you missing from this repository?
—
Reply to this email directly, view it on GitHub
https://github.com/MartinPernus/FICE/issues/2#issuecomment-1418686594,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AWV27EXWZKZOJBBDU4IZX2DWWCYFJANCNFSM6AAAAAAUSLCESA
.
You are receiving this because you authored the thread.Message ID:
@.***>

Hi,
the exclusion of args_dict.pt was a bug from my side, which is now solved. The repository contains the entire code that was used to obtain the results with the exception of prototype-based initialization method (which only works better in some cases).
I suppose you are referring to the dataset for training the GAN model? You can already use the GAN checkpoint provided by the download.sh script. Alternatively, you can download VITON dataset from various websites, such as kaggle, then train StyleGAN2 from any of the official GitHub repositories, such as this one.

Hello, I'm using download.sh script found that it could not be downloaded
when downloading the pre-training model. Could you check Dropbox or send me
the pre-training model directly? Thank you very much for your help.
MartinPernus @.***> 于2023年2月7日周二 18:39写道：

Closed #2 https://github.com/MartinPernus/FICE/issues/2 as completed.
—
Reply to this email directly, view it on GitHub
https://github.com/MartinPernus/FICE/issues/2#event-8456596470, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AWV27EX3LP4O4Y4PKMZP7C3WWIQ75ANCNFSM6AAAAAAUSLCESA
.
You are receiving this because you authored the thread.Message ID:
@.***>

I just tried to run download.sh it myself and experienced no problems with checkpoint download. Can you describe the error in more detail?

MartinPernus @.***>于2023年2月17日 周五15:23写道：

I just tried to run download.sh it myself and experienced no problems
with checkpoint download. Can you describe the error in more detail?
—
Reply to this email directly, view it on GitHub
https://github.com/MartinPernus/FICE/issues/2#issuecomment-1434220122,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AWV27EQXPDUPCCADJEC7BQDWX4RP3ANCNFSM6AAAAAAUSLCESA
.
You are receiving this because you authored the thread.Message ID:
@.***>

I think it is because I am in Chinese Mainland and my access to dropbox
will be interfered by GFW. Even though I use the proxy software, I still
cannot download the complete pre training model smoothly. Is there any
other scheme to obtain your model？

I will contact you directly and try to provide the checkpoint file in some way.


feat: add more guidelines for new deployments

continuing on https://github.com/yearn/yearn-devdocs/pull/261


Fixed broken link to bulk export content in the HL7 spec.

Description
Fixed broken url link to bulk export content in the HL7 spec. Documentation change only.
AB#125467
Testing
New url works in browser. Copied and pasted to prevent typing errors.

/azp run

/azp run


ROSE: Update the documentation

Readme is updated (this ticket can be closed), should the next ticket be created for the extended version of a documentation?

That sounds good I am closing this Ticket


https://github.com/Victoria129/Javascript-Group-Capstone/projects/1

There are two people on this team.

Hi team,
Your project is complete!  There is nothing else to say other than... it's time to merge it :shipit:
Congratulations! 🎉

Highlights

Good implementations  ✔

Optional suggestions
Every comment with the [OPTIONAL] prefix won't stop the approval of this PR. However, I strongly recommend you to take them into account as they can make your code better. Some of them were simply missed by the previous reviewer and addressing them will really improve your application.
Cheers and Happy coding!👏👏👏
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, remember to tag me in your question so I can receive the notification.

As described in the Code reviews limits policy  you have a limited number of reviews per project (check the exact number in your Dashboard). If you think that the code review was not fair, you can request a second opinion using this form.


How to visualize an overview of the diode traces array?

In the original PhotoZ, it is useful to visualize the mere hundreds of diode traces as explicitly-drawn traces laid out in tiles.
When we have hundreds of thousands of diode traces, this visualization is no longer useful.
One easy enhancement is a heat-map of max amplitudes.
A more difficult enhancement is a performance zoom-in inspection tool that allows us to present the explicitly-drawn out traces when there are only on the order of hundreds of traces on the screen.
Creating branch "visual" to explore these ideas.

Added automatic binning, zoom and pan, and render only diode subarray that is in line of sight. This improves performance considerably, but there are still ways to make the visualization more useful.
From Meyer, 12/13:
" please tell me if changing the code for display allows the high resolution configuration to run without crashing.
As for the ways to visualize the window with all the traces, this is a challenging problem with the high resolution configurations. Digital binning is probably a good start. Photoz-lilJoe can do that. The area of view corresponding to one pixel is very small when a high-res config has been selected and we almost certainly do not need it during data acquisition. The high-res will be useful later in trying to identify the pixels receiving light where something biologically interesting is going on. The process of identifying those pixels is challenging and two of my students are making headway with that problem with our 80x80 camera (lilJoe).
Your other suggestions for enhancement are very interesting but I think we should revisit them later.
For now it might be best to focus on a default binning process for high-res configs and expanding the display window."


Layout issue when recyclerview dependency is higher than 23.1.1 !

I spent a long time figuring out which dependency version has causing me this trouble.
I use the version 1.0.8, because the layout changed since this version in my use case.
Recently, I upgraded other libs, and a strange behavior happened:

I do not see the RecyclerViewPager items (like they get size of 0 or sometimes very small)
The first items is bigger than other (instrinsec size are the same for every items). If I update the adapter, then it come back as it should.

I had to force the dependency to 23.1.1 to ensure the expected behavior.
In my app build.gradle (for other who may be interested)
configurations.all {
resolutionStrategy.force 'com.android.support:recyclerview-v7:' 23.1.1
}
Do you have any "idea" or "change done" in mind that would be linked to this ?

May be you should update to latest veision.


[DOC] Visualization types - Pie charts new page and content

What do you want to do?

[ ] Request a change to existing documentation
[ X] Add new documentation
[ ] Report a technical problem with the documentation
[ ] Other

Tell us about your request. Provide a summary of the request and all versions that are affected.
Create new doc page and content for pie chart viz type
What other resources are available? Provide links to related issues, POCs, steps for testing, etc.
https://github.com/opensearch-project/documentation-website/pull/1402
https://github.com/opensearch-project/documentation-website/issues/2216

@vagimeli and @carolxob met with @joshuarrrr to update on dev status and documentation objectives; @carolxob to lead writing this topic


Update lttng-ust installation instructions

Using the message flow branch doesn't work on Ubuntu 22.04.  Update the instructions to capture using the correct lttng-ust version.

Closed by #10


Please clarify state of code injection vulnerability CVE-2020-13756

I got a warning from a security scan about CVE-2020-13756 in PHP-CSS-Parser.
According to this advisory
https://packetstormsecurity.com/files/cve/CVE-2020-13756
it affects "Sabberworm PHP CSS Parser before 8.3.1", but the latest version is 8.3.0.
Is this an unfixed vulnerability?

There are fixes available for every major release, as this list from https://packagist.org/packages/sabberworm/php-css-parser shows:

I hope this answers your question.


database creation using databaseadminclient

We are getting the below exception when giving "-" in the dbnamen. Documentation states its supported
ava.lang.AssertionError: Exception while running createDB : com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").
at com.homedepot.loyalty.integration.IntegrationTestRunner.beforeSuite(IntegrationTestRunner.java:16)
Caused by: java.util.concurrent.ExecutionException: com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").
at com.homedepot.loyalty.integration.IntegrationTestRunner.beforeSuite(IntegrationTestRunner.java:16)
Caused by: com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").
Caused by: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").

This looks like it's coming straight from the client library. I'll make an issue with them.

Actually @vineela-gampa our own integration test actually uses a DB name that has a "-" in it
https://github.com/spring-cloud/spring-cloud-gcp/blob/master/spring-cloud-gcp-data-spanner/src/test/resources/application-test.properties
Could you share more of your config or code?

@ChengyuanZhao thsi is the error we are getting
ava.lang.AssertionError: Exception while running createDB : com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").
at com.homedepot.loyalty.integration.IntegrationTestRunner.beforeSuite(IntegrationTestRunner.java:16)
Caused by: java.util.concurrent.ExecutionException: com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").
at com.homedepot.loyalty.integration.IntegrationTestRunner.beforeSuite(IntegrationTestRunner.java:16)
Caused by: com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").
Caused by: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Error parsing Spanner DDL statement: CREATE DATABASE integrationtest-db : Syntax error on line 1, column 32: Expecting 'EOF' but found an unknown character ("-").

Yes we are submitting DDL directly.

@vineela-gampa If you are sending DDL directly then you probably need to escape the special characters correctly. Spring Data Spanner doesn't seem to be related to the issue in this case, so I will be closing the issue.


Portable AC - Missing fan speed, gui does not update

First issue is gui thinks AC is always OFF. Changes/settings are applied/sent to AC but home assistant ac panel thinks it is always off.
Second issue: I have no way to change fan speed.

home-assistant.log

Check this https://github.com/tuya/tuya-home-assistant/discussions/113

Check this #113

Ok, thank you. First issue is solved.
I still have no way to change fan speed.
It has more functions missing like "horizontal swing" but fan speed is more important.


Bug : The faq link in services section is not redirecting to the faq section.

The FAQ link in the services section of the website is currently not redirecting users to the FAQ section. This issue can significantly impact user experience and accessibility, as visitors may find it challenging to locate essential information quickly.
Reasons to Solve this Bug:

Enhanced User Experience:

Users expect links to work correctly and take them to the specified section of the website. A non-functioning link can lead to frustration and a poor user experience.

Accessibility:

Ensuring that links work correctly is a critical aspect of web accessibility. Users, especially those who may rely on assistive technologies, need functional navigation to access all parts of the website.

Trust and Credibility:

A website with broken links can appear unprofessional and may diminish users' trust in the site’s reliability and credibility.

Hello @khushi-joshi-05 and @sunny0625
Please assign me this issue under GSSOC'24.
Thank You!

@shraddhha i have assigned u this issue.


How to make stages

uhhhhh How to make stagesHow to make stages?

It’s on their website https://codename-engine.com/wiki/modding/stages/

ty

why did you repoen this


Possible data corruption in "Skipping partial aggregation" change

Describe the bug
When we upgrade DataFusion Comet to use a version of DataFusion that inclues https://github.com/apache/datafusion/pull/11627, we see incorrect results for an aggregation in TPC-DS q97.
- q97 *** FAILED *** (11 seconds, 703 milliseconds)
  java.lang.Exception: Expected "53[7833        285408] 200", but got "53[8024  285422] 200" Result did not match

To Reproduce
Start with https://github.com/apache/datafusion-comet/pull/783 and then upgrade DataFusion to include https://github.com/apache/datafusion/pull/11627. I do not have a repro for DataFusion yet.
Expected behavior
No response
Additional context
No response

@korowa @alamb fyi - I am not sure how to reproduce this in a DataFusion example yet, but will try and do that

Thanks @andygrove  -- if you can get a repro we'll get it fixed asap
One bug I know that was present that we have fixed is https://github.com/apache/datafusion/pull/11833 / https://github.com/apache/datafusion/commit/1c98e6e640090600d36ce51f87919fea7b6eeed2 -- not sure if you tried with that one

The query is
WITH ssci AS (
  SELECT
    ss_customer_sk customer_sk,
    ss_item_sk item_sk
  FROM store_sales, date_dim
  WHERE ss_sold_date_sk = d_date_sk
    AND d_month_seq BETWEEN 1200 AND 1200 + 11
  GROUP BY ss_customer_sk, ss_item_sk),
    csci AS (
    SELECT
      cs_bill_customer_sk customer_sk,
      cs_item_sk item_sk
    FROM catalog_sales, date_dim
    WHERE cs_sold_date_sk = d_date_sk
      AND d_month_seq BETWEEN 1200 AND 1200 + 11
    GROUP BY cs_bill_customer_sk, cs_item_sk)
SELECT
  sum(CASE WHEN ssci.customer_sk IS NOT NULL AND csci.customer_sk IS NULL THEN 1 ELSE 0 END) store_only,
  sum(CASE WHEN ssci.customer_sk IS NULL AND csci.customer_sk IS NOT NULL THEN 1 ELSE 0 END) catalog_only,
  sum(CASE WHEN ssci.customer_sk IS NOT NULL AND csci.customer_sk IS NOT NULL THEN 1 ELSE 0 END) store_and_catalog
FROM ssci
  FULL OUTER JOIN csci ON (ssci.customer_sk = csci.customer_sk
    AND ssci.item_sk = csci.item_sk)
LIMIT 100

The last aggregation with SUM(CASE WHEN ...) is not a row hash aggregate and should not trigger this feature, and the other two don't use any accumulators, so, probably, the issue is not related to accumulator expressions (I'll recheck it anyway).
@andygrove is there a chance that Comet may use datafusion Partial aggregation results without finalizing the aggregation? In this case partial-aggs in both CTEs may produce duplicates, which should result in increased count values in the resultset.

This query works fine in DataFusion, but not in Comet. Comet does use both Partial and Final aggregates. I am working on debugging this to better understand where this is going wrong.
Perhaps there could be an option to disable this functionality?

Perhaps there could be an option to disable this functionality?

Yes you can set the datafusion.execution.skip_partial_aggregation_probe_ratio_threshold to zero
Config setting: https://datafusion.apache.org/user-guide/configs.html
BTW (🎣  for reviews) I have some PRs that make it easier to see what is going on:

https://github.com/apache/datafusion/pull/11820
https://github.com/apache/datafusion/pull/11706

@korowa @alamb I have now confirmed that we need to disable this feature in Comet because this is not compatible with how Spark handles partial aggregates and the duplicated cause issues. Thanks for the guidance. I'll close this issue once I have confirmed that I can disable the feature.

@andygrove  if you have additional details about how spark handles partial aggregates, I would love to read about them

@alamb Sure, here is one of the query stages after we have translated it to a DataFusion plan. Note that we are performing a join on the output of two partial aggregates and then applying the final aggregate after the join. Having duplicates on either input to the join causes extra rows to be generated in the join output.
Perhaps we'll need to start thinking about having a physical optimizer phase in Comet so that we can leverage the "skip partial aggregates" feature in some cases.
 ProjectionExec: expr=[sum@0 as col_0, sum@1 as col_1, sum@2 as col_2]
  AggregateExec: mode=Final, gby=[], aggr=[sum, sum, sum]
    AggregateExec: mode=Partial, gby=[], aggr=[sum, sum, sum]
      ProjectionExec: expr=[col_0@0 as col_0, col_0@2 as col_1]
        SortMergeJoin: join_type=Full, on=[(col_0@0, col_0@0), (col_1@1, col_1@1)]
          SortExec: expr=[col_0@0 ASC,col_1@1 ASC], preserve_partitioning=[false]
            CopyExec
              ProjectionExec: expr=[col_0@0 as col_0, col_1@1 as col_1]
                AggregateExec: mode=Partial, gby=[col_0@0 as col_0, col_1@1 as col_1], aggr=[]
                  ScanExec: schema=[col_0: Int32, col_1: Int32]
          SortExec: expr=[col_0@0 ASC,col_1@1 ASC], preserve_partitioning=[false]
            CopyExec
              ProjectionExec: expr=[col_0@0 as col_0, col_1@1 as col_1]
                AggregateExec: mode=Partial, gby=[col_0@0 as col_0, col_1@1 as col_1], aggr=[]
                  ScanExec: schema=[col_0: Int32, col_1: Int32]

Also worth noting that in this case, the partial aggregates in the join input have no aggregate expressions, just the group by. The output of the join goes through a partial/final aggregate pair, and we could potentially benefit from the "skip partial aggregate" feature in this case.

This is starting to feel like a bug again. I will try and create a repro today based on this join example.

I cannot repro in DataFusion via SQL because DataFusion creates a very different plan, so I will close this issue and explore implementing optimizer rules in Comet to handle this (but in the short term we will just set the threshold high to disable the feature)


Fix package name in docs

Coverage remained the same at 100.0% when pulling 782548cffdddce537dfdc64c9fce8b4f29086289 on fix-docs-package-name into 856625e1d3f13f8e8a2033440894d2922bdfc4b4 on master.


investigate using the trader role for subordinates instead of defence

It would be super convenient for users if mules that are subordinates used the trader role instead of the defence role.

Perhaps my mod Civilian Fleets would be of some help:
https://github.com/Vectorial1024/v1024_civilian_fleets
Once the Mules' parameters are finalized, I can add support to the Mules on my side.

@Vectorial1024 what needs to be finalized on our side? The list of params?

Yes, the list of parameters of each of the Mules need to be finalized.
Then, by referring to the list of parameters, I can tell my mod to correctly copy Mules' commands between ships.
Still, my mod only handles cases where ships are to be assigned under the Mules. To handle cases where Mules are to be assigned to stations, some extra script is needed.

Added as of https://github.com/Misunderstood-Wookiee/Mules-and-Warehosues-Extended/commit/8d7abd7994868a2babf3dce3735b446d4c0271be


Update balena-io/deploy-to-balena-action action to 0.13.0

This PR contains the following updates:

Package
Type
Update
Change

balena-io/deploy-to-balena-action
action
minor
v0.12.1 -> v0.13.0

Release Notes

balena-io/deploy-to-balena-action
v0.13.0
Compare Source

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Enabled.
♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, click this checkbox.

This PR has been generated by Renovate Bot.

@balena-ci I self-certify!


Rebuild with OpenSSL 3

Rebuild with OpenSSL 3. It required updating curl, which shouldn't be a problem.

Linter check found the following problems:
The following problems have been found:
ERROR: /tmp/abs_e38ukc5o_2/clone/recipe/meta.yaml:55: http_url: http://pycurl.io/ is not https
ERROR: /tmp/abs_e38ukc5o_2/clone/recipe/meta.yaml:55: http_url: http://pycurl.io/docs/latest/index.html is not https
Errors were found

Oh indeed, thanks @skupr-anaconda. I'm starting to think that the linter or another mechanism should be used to flag when we forget to bump the build number.


RuntimeError when seting a field to virtual

Python code to reproduce:
import awkward1 as ak
a = ak.Array({"x": [1]})
a["y"] = ak.virtual(lambda: [2], cache={}, length=1)
print(a)

The last line raises the following error:
RuntimeError: PyArrayCache has lost its weak reference to mapping
The error only appears if the length and cache parameters are supplied.
Tested on awkward1 0.4.5

Thanks! The way we've kept track of these caches has changed a few times to avoid circular references and lost references—this fix was a lost reference because we remembered to add them in __init__ but not __setitem__.


Service creation failed error handling

It was observed that when a service is created with InactiveTimeout more than Allowed Timeout Value(24*3600) then loxilb returns error but kube-loxilb shows success.

kube-loxilb used to check http status code, which is usually 200 (OK) . The return code is passed as a "Success" or "Error" string in the body.  Parsing code as expected has been implemented and verified.


Phi-3 models not supported

Today, whenever I attempt to load "unsloth/Phi-3-mini-4k-instruct" or "unsloth/Phi-3-medium-4k-instruct", I get a NotImplementedError. This was working fine yesterday.
You can reproduce this issue using the Phi-3 example notebook from the README: https://colab.research.google.com/drive/1lN6hPQveB_mHSnTOYifygFcrO8C1bxq4?usp=sharing

Oh yep - whoops - working on a fix - so sorry!!

Just fixed - try again

The issue is fixed. Thank you!