libxar.so not found

Version: 1.19.5
failed to build for darwin_arm64

/usr/local/go/pkg/tool/linux_amd64/link: running oa64-clang++ failed: exit status 255
[263](https://github.com/ledgerwatch/erigon/actions/runs/4120944114/jobs/7116173623#step:6:264)
/osxcross/bin/arm64-apple-darwin21.1-ld: error while loading shared libraries: libxar.so.1: cannot open shared object file: No such file or directory
[264](https://github.com/ledgerwatch/erigon/actions/runs/4120944114/jobs/7116173623#step:6:265)
clang: error: unable to execute command: No such file or directory

https://github.com/ledgerwatch/erigon/actions/runs/4121190447/jobs/7116640008#step:6:75
https://github.com/ledgerwatch/erigon/blob/devel/.goreleaser.yml

thanks, checking

retagged 1.19.5. please retry

Retry failed: https://github.com/ledgerwatch/erigon/actions/runs/4130391548/jobs/7137027883#step:7:258
   error=failed to build for darwin_arm64

/usr/local/go/pkg/tool/linux_amd64/link: running oa64-clang++ failed: exit status 255
[258](https://github.com/ledgerwatch/erigon/actions/runs/4130391548/jobs/7137027883#step:7:259)
/osxcross/bin/arm64-apple-darwin21.1-ld: error while loading shared libraries: libxar.so.1: cannot open shared object file: No such file or directory

yes. this way works. thank you.

I'm still experiencing this in both 1.20 and 1.19.

v1.20 is not the same image as v1.20.0
v1.19 is not the same image as v1.19.5

For anyone pulling v1.20 or v1.19 are going to get non-working versions of the image.

you can set LD_LIBRARY_PATH manually

The tags v1.20 need to be updated to reference v1.20.0.

thanks, i'll update

i've completely retagged 1.20.x 1.20. there was a fail during release.


Context menu in prerel branch for .fsx file does not have a Send to interactive option

Context menu in prerel branch for .fsx file does not have a Send to interactive option

@KevinRansom  I think it is a duplicate of #1633?

So it is.

yep
From: Omar Tawfik<EMAIL_ADDRESS>Sent: Friday, October 28, 2016 10:31 AM
To: Microsoft/visualfsharp<EMAIL_ADDRESS>Cc: Kevin Ransom<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Microsoft/visualfsharp] Context menu in prerel branch for .fsx file does not have a Send to interactive option (#1676)
@KevinRansomhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FKevinRansom&data=02|01|Kevin.Ransom%40microsoft.com|86391ce8555949d1fe4f08d3ff582c8c|72f988bf86f141af91ab2d7cd011db47|1|0|636132726575944268&sdata=YmoF3uafUuMUpj%2Fnro4ayT3OhI8ylZ%2BetqDsGYiAId0%3D&reserved=0 I think it is a duplicate of #1633https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoft%2Fvisualfsharp%2Fissues%2F1633&data=02|01|Kevin.Ransom%40microsoft.com|86391ce8555949d1fe4f08d3ff582c8c|72f988bf86f141af91ab2d7cd011db47|1|0|636132726575944268&sdata=TIi%2Bl3jmxbeDbHt9UrG2I2O2AtKBsAdFVPtENGb75YQ%3D&reserved=0?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoft%2Fvisualfsharp%2Fissues%2F1676%23issuecomment-256980307&data=02|01|Kevin.Ransom%40microsoft.com|86391ce8555949d1fe4f08d3ff582c8c|72f988bf86f141af91ab2d7cd011db47|1|0|636132726575944268&sdata=1Qjc2z%2B7hTsn2FRyk7IcDi6ZZEy4aQ5%2BlB22wOeg2bo%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAE76FhPDidQ3F1tZnGi9qz7DsYGmECfUks5q4jE_gaJpZM4KjEsX&data=02|01|Kevin.Ransom%40microsoft.com|86391ce8555949d1fe4f08d3ff582c8c|72f988bf86f141af91ab2d7cd011db47|1|0|636132726575944268&sdata=fttBERlt%2BJlwxfzcgmi4ZergsLQfu9D1kclqpoT4Iq4%3D&reserved=0.


AGE System Character Sheet

Changes / Comments

Fixed bug in roll display
Fixed display of spell descriptions
Added support for Fear and Horror sections

Roll20 Requests
Comments are very helpful for reviewing the code changes. Please answer the relevant questions below in your comment.

[x] Does the pull request title have the sheet name(s)? Include each sheet name.
[x] Is this a bug fix?
[x] Does this add functional enhancements (new features or extending existing features) ?
[ ] Does this add or change functional aesthetics (such as layout or color scheme) ?
[ ] If changing or removing attributes, what steps have you taken, if any, to preserve player data ?
[ ] If this is a new sheet, did you follow Building Character Sheets standards ?

If you do not know English. Please leave a comment in your native language.

Fixed two bugs and added two small sections (fear, horror)


Tune predownload default from 100K to 20K.

Abandoning this PR.
100K samples/worker is a lot of slack, but text shards can be large enough that we should go this far out to ensure the next shard is in flight, worst case. Need to do more testing.


DifferencedNormalizedBurnRatio.py

Delta NBR function

plz contact me via<EMAIL_ADDRESS>for any questions. Thank you.


Rename Effects to Routines

Routines seems to be a better term than Effects as per our discussion with Mr. Asher.

Index page handled in commit e7c97ce

The source code's done.  I also combed through the Issues list, Wiki and Readme.


purge: add remove_docker tag

This can help to skip docker removal tasks
Signed-off-by: Seena Fallah<EMAIL_ADDRESS>

ping @dsavineau @guits

@guits Should it retest all failed stages?

jenkins test centos-non_container-purge

failures are unrelated to this patch


need pixel image

**Is your feature request related to a problem? Please describe.**no
**Describe the solution you'd like*The function to turn a random image into a pixel style one.
Describe alternatives you've consideredNothing else

Use filters, there is a separate tab for pixelation


Error 52100 Unable to connect to Wi-Fi

after attempting all of the listed troubleshooting, and following the quick start instructions, i continue to get error code 52100 before reaching the point of tucking in a pokemon. I am a novice when it comes to computers, and am not sure what to try from here

I have the same issue

I also have a similiar issue and I've tried everything I can and nothigs working, feels very odd when I've seen others use it

52100 occurs when the game can't connect to the DNS server.
It's kinda difficult to pinpoint the cause of issues like this, and if none of the solutions listed in the troubleshooting guide worked then I'm not entirely sure what else the problem could be.
I don't recommend doing this but if you're feeling brave then you could completely turn off Windows Defender for a bit and try to connect while it's off. If it still doesn't work then it's most likely not that.
Some similar cases have occurred in the past (#32 and #33) where it turned out to be a separate antivirus causing issues, so that might be worth looking into as well.

Okay. So I've done a lot of messing around with settings and I've looked back at the similar cases.
I've shut off antivirus firewalls and Windows Defender, and tried every other troubleshooting method (i'm pretty sure)
The last thing I could think to do was check the active ports on my computer through a command prompt.
Upon doing so, I found that ports 80, 443, and 29900 are all listed as listening.
However, port 53, which entralinked says the DNS server is supposedly listening through, is not listed anywhere I can see.
Is this a possible issue with my computer, or do you have any other ideas as to what could be preventing me from making that connection to the DNS server? Apologies if this is possibly a basic question, i really don't know computers >.<

It should be listed if you run netstat -aof -p udp | findstr :53 in a command prompt.
If you're absolutely certain that it's not a firewall or antivirus problem then maybe the DNS itself is incorrect.
Make sure that the DNS it tells you to use matches your PC's IPv4 address.

I've been trying this all connected to a public network on my router. As a last-ditch attempt, before i saw your response, i reconfigured my dsi's internet settings, and switched over to the non-5G private network on my home's router. Reconfiguring to the set DNS and performing a connection test succeeded, and upon attempting to connect to game sync, i finally got error code 60000!
So somehow the switch from public network to private network fixed it and im really not sure how?
Following the troubleshooting guide and updating the PID allowed me to pass that error and generate a Game Sync ID.
Incidentally, upon checking the PC's IPv4 address, it did match what entralinked was telling me. also listed there was a separate "IPv4 DNS servers" address? I don't know if that has anything to do with it.

oddly enough i'm still unable to but i'll see what I can do to fix it for me, my ipv4 matches and everything but its not working out for me but i'll keep trying

update 2: tried turning off or disabling things in the firewall, that did nothing, i can't connect to my router so that's just not an option and my phone's hotspot works but that ultimately does nothing. I have to just understand this program doesn't work at all since it doesn't seem to do anything idk if my debug log will help but here:
debug.log

Yeah it looks like it's unable to connect to the DNS server.
If none of the listed solutions worked for you then I'm not entirely sure either, sorry.


FIX better display of object columns with multi-line repr in tablereport

fixes #1195

using the example from the issue, on main branch:

with the proposed changes:


Handle manga with same title

The idea
Right now I think the program assumes that a manga title (for generating the destination path) is unique, but that is not true.
Two example:
https://mangadex.org/title/5a691c66-3e67-424b-b361-a56ea71ee9bc/amber
https://mangadex.org/title/fc83c3d7-9501-4403-92f9-d41f8767b327/amber
https://mangadex.org/title/04528b4c-bcc5-48b4-9af4-096060ad278d/wonderful-days
https://mangadex.org/title/d7492c2b-e15d-4e7c-95fb-f5f1d84fd8c6/wonderful-days
The problem is that those two manga ends up in the same folder, sharing the same database download.db and overwriting the cover.
Why this feature should be added to the app ?
I don't know an elegant way to check for duplicates titles, but a workaround could be to add an option to include the manga uuid in the folder name.

Currently, it is planned to change --path behaviour in v3.0.0, so the path will be absolute.
Before
{CustomDirectory}/{MangaTitle}/{AllChaptersAndVolumes}

# Example
# --path "/home/myuser/mymanga/reading
"/home/myser/mymanga/reading/Tamamo no koi"

After
{CustomDirectory}/{AllChaptersAndVolumes}

# Example
# --path "/home/myuser/mymanga/reading
"/home/myser/mymanga/reading"

Of course, if you still like the old way, you can use placeholders such as %(manga.title)s to --path option.
Again, this feature is currently planned. So i don't have any ETA when v3.0.0 is out.

Awesome, thank you.

Hello, sorry for taking so long, i got too busy in real life things.
Anyways, this feature has been added in v3.0.0 branch (commit https://github.com/mansuf/mangadex-downloader/commit/3e257fb5264c6e46ecb23ac1e45eb8f269d257f1)
You can start trying it now by installing development version (v3.0.0 branch)
Installation with git + pip:
pip uninstall mangadex-downloader
pip install git+https://github.com/mansuf/mangadex-downloader.git@3e257fb5264c6e46ecb23ac1e45eb8f269d257f1

If you're installing mangadex-downloader from github releases, you can download the development version in here:
The download files are available in "artifacts" section
https://github.com/mansuf/mangadex-downloader/actions/runs/7248099641

--path option are now absolute and you can use placeholders so you can avoid that conflict issue like that
Example usage:
# This will download to directory "/home/sussyuser/manga/Some manga title - some_random_id/English"
mangadex-dl "URL" --path "/home/sussyuser/manga/{manga.title} - {manga.id}/{language.full}" -lang English

For more information about path placeholders, you can read the documentation here -> https://mangadex-dl.mansuf.link/en/v3.0.0/cli_ref/path_placeholders.html
If you have a problem, issue or bug, you can re-open and comment in this issue tracker here.


Multi Tag Auctions Support in Fledge (B & A in Particular)

Background
SSP clients will often send a single request to the SSP server with multiple slots for ads available. In our case, this allows us to save significant time and resources on various upfront phases of the auction (traffic filtering, consent, deal eligibility) and has proven empirically important with several important clients. The way this works in our system is that the tech on page collects all of the tags, sends in a single request, generates a request_id that covers the entire request, the SSP server side does the common processing, and then auctions with their own auction_ids are spawned and run in parallel. OpenRTB has support for multi tag as well, although makes no comment on how it should work.
Initial thoughts for B & A flow were that we'd continue to generate the request_id, run the traffic filtering, consent, deal eligibility, etc, in our SSP server, and then coordinate multiple requests to the seller front end.
Concern
After some internal discussion today we're curious how this will work in the Fledge B & A flow. We see that there is a UUID generated client side and the idea is to prevent replay attacks, and are now wondering if that would stop us from invoking auctions with the same interest groups for multiple slots.
Thoughts
If that is currently the case we'd strongly ask that multi-tag support within a single request be made possible via these APIs. Since the thing we want from a privacy perspective is to prevent replay attacks, I think this could be accomplished by having the SFE's return errors on the UUID in a more nuanced way. The client could generate the UUID and the number of tags on the page, generate a UUID for each auction, or some such, and allow them to be run in parallel within some fairly short amount of time.

Hi,
Thanks for the issue.
Great questions and I totally agree with your concern.
Please note, multi slot ads are non impacted and will work fine with Bidding and Auction services. We do not plan to enforce anti-abuse  / replay attack mitigations until sometime in 2024. Before we enforce those mitigations, we will discuss with adtechs for viable solutions and incorporate those well ahead of time so that the feature is not broken.
Your solution seems viable, however it would be great if we can discuss this in more depth.
One other solution, is if the seller's ad server joins the requests from all ad slots and makes a single request to Bidding and Auction services with ProtectedAudienceInput and other required data for all ad slots. This may help B&A generate ads such that they are different per slot. However, this may require substantial amount of work in seller's ad server and in B&A.
Happy to brainstorm more. Feel free to share more suggestions / feedback. Thanks!

Thanks! 2024? Isn't that when everything is going out :)

RE the SFE handling the split, that is interesting indeed...I guess from the perspective of an API/System developer, who is trying to support different approaches within a coherent framework, my initial thinking out loud responses are:

Flexibility is likely important here as the ad tech will need to compare the N contextual bids to the N opaque bids, so the ability to link the relevant bids together for final ranking is important. I could see that happening on an auction_id or just happening within the Worklet...auction_id is pprrrrobbbbbaly more flexible b/c it would support the contextual/opaque running either in parallel or sequentially, which different techs may choose differently on to tradeoff performance and logic sharing.
This would be worth discussing in tandem with my colleagues question in https://github.com/WICG/turtledove/issues/739. If the final choice has to be made in the ranking functions as discussed here then that may box us in a bit.
Yeahhh...interesting.

@chatterjee-priyanka has there been any additional thinking on the multi-tag support? It's come up again as we've gone through some of our ranking cases, and your idea of trying to run it through SFE/BFE as one request and let things kind of get coordinated with as few requests as possible, was discussed as well.

Hey,
Sorry about the delay.

Overall Multi Tag auctions are supported with B&A (we recently tested that). As I confirmed before, we will not enforce anti-abuse mitigation and break this feature (or find other workarounds for anti-abuse mitigation after additional review with Security experts).  If we plan to enforce anti-abuse mitigation with generation_id (request id), we would work well in advance with all SSPs engaged with B&A.

Regarding my earlier suggestion "seller's ad server joins the requests from all ad slots and makes a single request to Bidding and Auction services with ProtectedAudienceInput and other required data for all ad slots."
There may be a few reasons why this can be interesting / good to support. However, this would be an option for SSPs who may want to pursue this; we can possibly accommodate both this option and multi request multi tag option currently supported, at least for a while.
Reason 1: This can optimize number of calls from seller's ad server to B&A to one and therefore seller won't have to send same contextual signals and other data in AuctionConfig over the wire in different requests (possibly optimize latency even further and save on network cost).
Reason 2: This can potentially lead to a solution where different Protected Auction / Audience ad can be selected for different ad slots on the page.
Reason 3: This can allow enforcing anti-abuse mitigations with generation_id.

I see the above as an enhancement and optimization to existing multi tag auctions capability with B&A. We should definitely brainstorm the enhancements with SSPs and try to come up with requirements and design for supporting this in B&A. However, support for this may take a while. Let us know if think this should be higher priority. Thanks.

Thanks and NP, we're all super busy.
On the multi tag, am I correct in saying it's supported in the sense that the Seller Ad Service can kick off multiple auctions (which will allow for reduced latency) but they will all be separate auctions and not have any ability to coordinate as described here?

@chatterjee-priyanka  thinking about it more, the unification above, or something like it, would open up huge opportunity for parity with current First Party Ad Server functionality for things like Competitive Exclusion, Page Caps, and Roadblocks (see same ticket from above).
By making multiple auctions a "first class citizen" in the design, we get to a place where we could allow state to be shared during bid ranking, but still constrained by the DP/K output gate. I suspect the lack of Competitive Exclusion and Page Caps (less so Roadblocks) will be a big problem for many 1PAS's.

This issue has been migrated to the new WICG/protected-auction-services-discussion repository.
Please continue the discussion in the migrated issue here: https://github.com/WICG/protected-auction-services-discussion/issues/16


Add table aws_securitylake_log_source

References
https://github.com/aws/aws-sdk-go-v2/blob/main/service/securitylake/api_op_ListLogSources.go#L16

The data is bit tricky to represent it as a table and  it appears that the log source is only a configuration, so we'll skip it for now.


Remove radard

Add model that predicts lead trajectory, not just lead position and velocity. This allows longitudinal MPC to anticipate the future more and be more smooth
Remove radar
Replace handcoded cruise control logic with MPC
Replace handcoded FCW logic with a simple threshold check
Simplify overall architecture
Make velocity + acceleration API with controls explicit
Increase thresholds for cruise accel and deccel
Remove controlsd from longitudinal tests

Will we add a configurable longitudinal actuators delay per car?

Will we add a configurable longitudinal actuators delay per car?

Yes, but not needed for this PR

added todo

Replaced by https://github.com/commaai/openpilot/pull/22380


(BOLT-258) Configure pcp transport

This is #196 re-opened. I messed up branch names, and cannot seem to fix deleting a branch

Waiting for CLA signature by @lucywyman
@lucywyman - We require a Contributor License Agreement (CLA) for people who contribute to Puppet, but we have an easy click-through license with instructions, which is available at https://cla.puppet.com/
Note: if your contribution is trivial and you think it may be exempt from the CLA, please post a short reply to this comment with details. http://docs.puppet.com/community/trivial_patch_exemption.html


Completely missing the point of the Load Balancers if can't specify IP address

Rancher Version:
any
Docker Version:
1.12.3
OS and where are the hosts located? (cloud, bare metal, etc):
Ubuntu 16.04
Setup Details: (single node rancher vs. HA rancher, internal DB vs. external DB)
any
Environment Type: (Cattle/Kubernetes/Swarm/Mesos)
any
Steps to Reproduce:
Have server with multiple public IP addresses on single network card.
<IP_ADDRESS> managed by the host itself and multiple long-running services use it (ie. SSH, MySql, nginx (for LDAP auth)
<IP_ADDRESS> \   These IPs are for use with rancher
<IP_ADDRESS> /   and can contain services on same ports as <IP_ADDRESS> (ie nginx, etc)
Add Load Balancer service in Rancher - but you cannot specify which IP to bind load balancer to.
Results:
This results in weird UFW overload, where it defines a UFW rule to take over http and https ports and renders all host-based services unusable.
Expected:
expected behavior would be to be able to specify which IP address the LB should bind to
When trying to specify IP address in the Load Balancing UI, getting this error:

Source Port is required on each rule
Choose one or more port rules to listen on

I almost don't really see how load balancer can be used on a multi-IP host, or I'm sure I am completely misunderstanding how load balancers are supposed to be used. Can someone elaborate / explain ?

This works nicely if you are in the cloud and your host features a LB service (Google, Amazon, Rackspace, Azure).
I deploy a public service on a group of machines. I also deploy a LB on this same group. I then point my Google loadbalancer at the group of instances. Voila. Double HA.

it used to work beautifully up until 1.2.0 update where you can no longer specify BIND IP address on the service / load balancer. Now it looks like I cannot use rancher in all of our infrastructure since most of our hosts are multi-IP systems and often will host services on same port but on different IPs.
Since rancher does not allow to specify IP address anymore - is it possible to give it at least some default (or list of host IPs) that it should limit all port binding on? as of current version - it just blindly removes IP address limitation and changes UFW rules to send traffic to docker, and kills access to all of our host-driven long-running services that use same port on different IP addresses.
I honestly don't understand the point of this change, it really messes up our entire flow, we've been waiting for 1.2.x for so long and kept on overlooking all the minor issues that we had, just to end up with the release of the system that we can no longer use.
This is not our main limitation but just to clarify our problem as an example. For example, on one of our installations - we use rancher on our dev environment:
MYSQL running on HOST to manage common databases that are periodically synchronized with production environment DB. This allows us to have real data in dev and testing environments. Many of our projects require different mysql server settings, so we have a couple of mysql servers running on different IP addresses. Same goes for mongodb replicasets, elasticsearch (different versions for kibana, for search engines, etc.), and many more services.
We have GIT running on the hosts themselves and gitlab instances, that all use standard ports (22 for ssh)
We have management platforms that need to be highly available and were not yet converted to docker, for most part because we have too many of said systems and didn't have time to re-deploy all of it through docker.
we have approximately 20 sites running on host, and many more sites including our CI test/dev branches running through docker.
I understand that we could adapt the use of "different" ports for all services and then start changing all of our development and management tools, but that would just take us forever, probably good 4-6 months project, and even that would result in unforeseen issues as well as potentially poorly tested things, since environments and published ports are different in qa/staging/production environments.
And all of this is only because IP address option is now forcefully removed from load balancer support as a part of 1.2.0 design, for apparently a completely unknown reason, unless I really am not understanding how to use it. Seems like all the benefits of rancher (reasons that we used rancher) are gone with this single option. Super unfortunate.
Granted everything can still be achieved through use of extra layer of abstraction (ie add another haproxy docker flow, or something of that sort) but it complicates things even further, and with all the instabilities that we experience with rancher server on a weekly basis - this is just an extra reason to stop using rancher. Super unfortunate.
I honestly wish that I could at least get a confirmation that our use-case is not common and rancher team doesn't like the way we utilize rancher or if this is just an oversight that is causing issues for many of the rancher users and rancher will give us IP address option back?
Thank you for the hard work on the rancher, it's a great product, although seems like we won't be able to use it anymore.

I swear I responded to this yesterday but can find no evidence of it now... must have never hit Comment.
FWIW the backend still works exactly the same, so you can still do what you were doing before with the API or compose.
I think it's fair to say this is not a very common use-case.  But it's really more of a problem because it makes people think they can use it when they really can't.  Putting in a specific IP only works in a very specific situation:

You create a service of scale=1
You set scheduling to put the container on exactly the right host that has the desired IP
You put that IP into the listener ports
That IP is actually bound to an interface on the host, and not just routed there.  Most of the common cloud VM providers do not actually do this, you have one interface with one IP and other IPs routed to you.

(and I found my old reply in a buried tab, grr... Anyway)
Hmm... in 1.2 we tell the Docker daemon to make the networkMode: none for managed network containers.  So the IP no longer physically has to be bound to a real interface on that host.
So we could insert the iptables rule to send a request to <IP_ADDRESS>:80 to the 10.42.x.y IP of the balancer container on ALL the hosts; It would work on whichever host(s) really get packets for <IP_ADDRESS>, and be ignored on ones that don't.
This would cut down my "very specific situation" list to:

SOME host in the environment has to respond to that IP if you want things to work

Which is much more reasonable.  Still not something I think is common, but I could see it as another option at the bottom like "Show custom backend names" to allow you to input IPs.

@vincent99 thank you very much for trying to clear this up, that's exactly my use-case and I intentionally want this LB to sit on a specific host, because other hosts have ports 80 and 443 taken by other web services that i cannot override. I actually assigned a label to a specific HOST and have only that host act as an HTTP(s)/TCP proxy for all incoming traffic, it also serves a bunch of stateful services (like gitlab) with storage across local raid.
Either way - if this LB was setup to freely deploy on any of the nodes - it would inevitably end up on this particular host at some point anyway, and would render everything else on other IPs on port 80 to be inaccessible just the same way.
I guess a couple of questions:

you mention that API still works the same, but I believe that I already tried spinning up LB using rancher up but to the same avail
is there a way to limit whatever rancher does with ports and networkMode to IPs that rancher manages (ie - exclude some of the system IP addresses from rancher control, so that there's never a collision?)
what you are describing sounds a little similar to the MESH networking that docker swarm introduced, does it mean that rancher now creates its own mesh network? And if it does - when in swarm mode - does it ignore Docker Swarm's mesh and uses it's own or is it going to use MESH of the docker and won't do any of the rancher's mesh-magic?

Thank you.

you mention that API still works the same, but I believe that I already tried spinning up LB using rancher up but to the same avail

-A CATTLE_PREROUTING -d <IP_ADDRESS>/32 ! -i docker0 -p tcp -m tcp --dport 90 -j MARK --set-xmark 0x1068/0xffffffff
-A CATTLE_PREROUTING -d <IP_ADDRESS>/32 ! -i docker0 -p tcp -m tcp --dport 90 -j DNAT --to-destination <IP_ADDRESS>:90

is there a way to limit whatever rancher does with ports and networkMode to IPs that rancher manages

The main difference is that the networkMode is set to none on the container and the port mapping isn't given to Docker anymore.  We manage the mapping of [ip:]port to target container through iptables.  But are not aware of ports that are used by things on the host outside of Docker.
Most users treat the hosts as mostly disposable (except maybe storage) compute and run things only through Docker.  Not really additional random daemons running outside of Docker, other than things like ssh that are unlikely to clash with something a container would want to open.  (Incidentally this is literally the origin of the name, servers are interchangeable "cattle" and the "rancher" manages them).
But anyway, we can add checking for ports bound outside of Docker.

what you are describing sounds a little similar to the MESH networking that docker swarm introduced, does it mean that rancher now creates its own mesh network? And if it does - when in swarm mode - does it ignore Docker Swarm's mesh and uses it's own or is it going to use MESH of the docker and won't do any of the rancher's mesh-magic?

Not really, the Swarm routing mesh publishes a single port on every host.  So only one service can be using that port.  And I don't think they have any good way to handle multiple IPs per host either.
What I said earlier would just allow a container to "listen" on a particular public ip+port, even if the container does not physically run on the host that happens to receive packets for that IP.  So you wouldn't have to schedule the containers to the right host anymore, though it is less hops if you do.

in the example with the iptables rule - would it be able to handle it automatically when LB re-deploys and will re-create rule based on the IP address if the container with LB restarts under different IP?

The 10.42.x.y container IPs don't change when they're restarted.  But yes, the rules are kept in sync.

How is LB intended to be used in rancher? ...

The balancer just balances what it's told, we don't really get involved in how you want to use it.  The cases where you actually need separate public IPs for each HTTP service are pretty slim these days.. SSL on old version of IE on old version of Windows that don't support SNI. (And arbitrary TCP services, but you seem to be talking mostly about HTTP)
If you can assume SNI is available (or are doing plain HTTP) then what you describe would typically be done with a single balancer service (probably in it's own stack, though it can be anywhere) that has a set of rules to send traffic to all different services based on the Hostname.
Most users are using hosts basically dedicated to Docker, with one public IP each, as you get from all the public cloud providers.  So they do not get involved in mapping IPs at all, services are just bound to <IP_ADDRESS>.  You can use a label to schedule the balancer onto a particular set of hosts to put into a DNS entry manually, or use the external-dns catalog items to publish a record to a compatible provider automatically, or use a hardware or cloud balancer (like ELB) and let that manage sending requests to the balancer containers that are up.
We do not really magically do anything.  You can setup a situation where services "auto join" a balancer by having a selector rule on the balancer to look for a label and then putting that label on the services.  The services can then define their own port rules to do hostname/path routing (this part did not make it into the 1.2 UI, but is in compose/API).

Is the design of rancher to fully rely on automated DNS external engines? Meaning that - since the LBs can be deployed wherever it finds available IP - is it no longer at all possible to use traditional single-ip address dns entries (for example with DNS providers that don't have any API-like access to update DNS entry when a container is re-scheduled)?

Nothing has changed here, you can still use host labels and service scheduling rules to make the balancer containers go onto the hosts that have the right IPs to match your manually maintained DNS record.
But if you don't have something managing the DNS record you don't really have fault tolerance in the first place.  When a host dies users are going to continue to get DNS answers that point them to a dead host.  You need either something like another balancer (i.e. ELB or hardware) or something to remove bad entries from DNS to keep users going only to healthy hosts.

Is it possible to auto-merge LBs into single LB deployed across all publicly accessible hosts that would MESH all traffic across containers, despite where containers are running?

As above, you control how things are arranged.  A similar arrangement is possible with a single balancer with a selector rule, and additional rules on the selected services.

Is it at all possible to specify DNS entry for a single service that is scheduled on a host? I'm super confused with having no ability to control where DNS entry is supposed to point, ie:

As above, you need to use labels and scheduling rules to make the containers go where you configured DNS to point if you're going to manage the record yourself. (And you don't really have fault tolerance, so you almost might as well just run scale=1)

Scenario 1 - seems pretty straight forward and how things used to work:

I'm not sure what the question is here, but yes, those things are true?  Note that there is no need to type <IP_ADDRESS> anywhere in the balancer (if there is a balancer here?) or service config in the case where the host only has one public IP.  It will just be bound to <IP_ADDRESS> by default and there's only one possible IP for it to be bound to anyway so there's no reason to specify it.  You just know the host with <IP_ADDRESS> has that label and Jenkins and create the DNS entry appropriately.

Scenario 2:
my understanding is that traffic to jenkins.domain.com will not be restored until DNS is manually updated or hostA is back online and container with jenkins is forcefully moved back to hostA

Yes, clearly with hostA down and the manually managed DNS entry pointed at it the service is DOA until the host is back or the entry is changed.  If there's a balancer involved then it doesn't matter where the actual container for the Jenkins service is now residing.

Scenario 3 - and I think that this is what rancher is only supporting from this point on only:

Again, nothing has changed as far as the things supported by the backend.  One field in the definition of a balancer rule was removed from the UI, and it affects only the situation where you have multiple IPs on a single host and want them pointed at different services for a particular port.  That has nothing to do with any of these 3 scenarios, where you're asking about how things are updated on hosts and in DNS when a host fails.  And using the IP binding in 1.1 made it impossible for that service to be rescheduled to another host anyway.

Dynamic Automated DNS service is running through rancher (ie Amazon ELB, etc.)
Dynamic DNS handling updates entries in DNS (might take a few minutes to replicate - during which time service might end up being completely unavailable, until DNS propagates)
Container or host crashes - rancher reschedules this container to another Host, DynamicDNS gets updates, service is down until DNS propagates, and then service becomes available again

This was in 1.1 and remains in 1.2 the only way to have real fault tolerance.
 (I'll say ELB for simplicity...)

You put load balancer service containers on a set of hosts (with a label, or just on every host with global scheduling)
ELB is configured to send requests to those hosts (if you're actually using Amazon, the easy way is to make an AutoScaling Group for the hosts, point ELB to the entire ASG, and run the balancer service with global scale)
jenkins.domain.com CNAMEs to your-elb.amazonaws.com
ELB keeps track of which hosts are healthy and sends traffic only to them
The request goes to the host ELB picked.  The port rules for the Rancher balancer determine which service the request should go to.
Rancher balancer keeps track of which target service containers are healthy and sends the request to one of them (which might be on the same host or a different one).

The external-dns catalog entries are sort of the "poor man's" alternative to the ELB/hardware balancer part if you're running somewhere where one isn't available.  They have degraded response for the length of the entry's TTL, which is still a lot better than $until_someone_notices+TTL for manually managed.
In various clouds there are also the concept of floating IPs that can be moved to a different host when one dies, but this isn't something that can be generically implemented, you have to talk to their specific API.  And if you're running your own hardware you can potentially do similar on your own with VRRP/keepalived to create a floating IP.

Version - master 11/13
Verified fixed


Extensions should declare what device features they require/prefer to be enabled

Description
Here are some classes that function differently based on which device features are enabled:
ICullingLoDSelectionSystem => multiDrawIndirect, drawIndirectCount
CDrawIndirectAllocator => drawIndirectCount
CSubpassKiln => multiDrawIndirect, drawIndirectCount
Each of these classes should have static methods with similar signature:
static void enablePreferredFeautres(const SPhysicalDeviceFeatures& availableFeatures, SPhysicalDeviceFeatures& features) const override
{
    features.multiDrawIndirect = availableFeatures.multiDrawIndirect;
    features.drawIndirectCount = availableFeatures.drawIndirectCount;
}
static void enableRequiredFeautres(SPhysicalDeviceFeatures& features) const override
{
    features.somethingElse = true;
}

this function is static and can't be virtual and inherited from a base class.
Currently 99% of examples use common api and don't have access to "availableFeatures" that gets retrieved from PhysicalDevice
TODO: Implement solution in CommonAPI that considers the need of extension/utilities for device feature.
Solution1: PhysicalDeviceSelector "select" function also takes the SPhysicalDeviceFeatures& featuresToEnable and edits that when selecting a physical device, then the user can override that function and request "more" extensions based on the physical device it chose, or a new function in class PhysicalDeviceSelector
Solution2: CommonAPI takes optionalFeaturesToEnable as another SPhysicalDeviceFeatures and somehow merges them into DeviceCreateParams::featuresToEnable if they are available

Define a C++20 concept called nbl::ext::Extension at the end of nabla.h that requires these static methods to be present.
Then use a variadic template function in CommonAPI
template<ext::Extension... extensions_t>

and somewhere inside apply a parameter pack expression to apply the features
(extensions_t::enableRequiredFeatures(features), ...);
(extensions_t::enablePreferredFeautres(availableFeatures,features), ...);

Give up on automagically selecting the "best" device, unless there's a way to take a user supplied lambda for comparing two devices and there's a compile-time way to ensure the operator yields a strict ordering.

Define a C++20 concept called nbl::ext::Extension at the end of nabla.h that requires these static methods to be present.
Then declare a variadic template function in CommonAPI
template<ext::Extension... extensions_t>

and somewhere inside apply a parameter pack expression to apply the features
(extensions_t::enableRequiredFeatures(features), ...);
(extensions_t::enablePreferredFeautres(availableFeatures,features), ...);

Why in nabla.h?

Define a C++20 concept called nbl::ext::Extension at the end of nabla.h that requires these static methods to be present.
Then declare a variadic template function in CommonAPI
template<ext::Extension... extensions_t>

and somewhere inside apply a parameter pack expression to apply the features
(extensions_t::enableRequiredFeatures(features), ...);
(extensions_t::enablePreferredFeautres(availableFeatures,features), ...);

Why in nabla.h? And why is it a c++20 thing?

Ok, if you call it nbl::video::Extension and only make it concern itself with video stuff (and create new ones for core,system,asset,ui,scene when needed), then you can stick it in nbl/video/Extension.h
C++20 because it would be a concept and those are a C++20 feature.


Nonexistent element issue on XmlBodyMatcher

The XmlBodyMatcher doesn’t complain if you configure a matcher which is looking for an XML element that doesn’t exist.
For example: "$.note.address.nonexistentelement: { "matchers": [ { "match": "equality" } ], "combine": "AND" }
This should fail because nonexistentelement is not part of the actual response.

That matcher will never fire. Matchers only get applied to existing elements as they are parsed.

That's a real shame - is there any scope for checking that all defined matchers have fired at the end of the test, or would that be hard to implement (or likely to introduce breaking changes elsewhere)?
The problem is that as there's no DSL for XML requests/responses, the response has to be defined separately from the matchers, which leads to less confidence in the test.
(Alternatively, are there any plans for an XML DSL?)

That's not really how it has been designed. The comparison runs though all the expected and actual elements, and once it has one to compare, it checks if there is a matcher defined to compare it with. So non-existent elements will be picked up because they are defined in the expected body.
To date there has not been enough demand for an XML DSL. In fact, most of the other implementations (Ruby. .Net, Python etc.) do not support XML at all.


Data Prepper & Fluent Bit Webinar

Description
Adding a webinar co-hosted by Kevin Falls and Anurag Gupta to the event calendar.
Issues Resolved
N/A
Check List

[ X] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the BSD-3-Clause License.

@krisfreedain for your review. Thanks!


Add Toggle for Auto Import

seems i misunderstood the animated on / hover effect, don´t even know why i thought that to be related to the auto import. anyway a toggle to enable and disable auto polling / import from image folders would be appreciated.

solved / added


✨ Expose reporting config to consumers of javaagent-core so that Filter implementation authors can access them

Description
Allow the HypertraceConfig APIs around reporting and OPA configuration to be exposed to clients following a similar pattern as done with the InstrumentationConfig.  PR #322 moved the config implementation out of the javaagent-core package, but some implementations of the Hypertrace Filter API need to access config properties that are not accessible via the InstrumentationConfig object. As this is a public API, I wanted to make it well known that the ReportingConfig.Opa object isn't going to live forever in this repo, as we'd like to eventually remove configuraton options that are intended for use by Traceable to not be included in the Hypertrace repo.
Testing
Please describe the tests that you ran to verify your changes. Please summarize what did you test and what needs to be tested e.g. deployed and tested helm chart locally.
Checklist:

[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] Any dependent changes have been merged and published in downstream modules

Documentation
Make sure that you have documented corresponding changes in this repository or hypertrace docs repo if required.
N/A

@pavolloffay  I know you have lots of context and perspective on this (re: #322 ) let me know if you have any concerns/feedback!

Yeah this PR should not be needed as the https://github.com/hypertrace/javaagent/blob/main/otel-extensions/src/main/java/org/hypertrace/agent/otel/extensions/config/HypertraceConfig.java is available when the filter is created.


Upload final wire dataset to Azure

The 'wire' dataset was pruned one last time. We need to upload the final version of this dataset to Azure. The final wire dataset is here.

Also - is it necessary to include the $logs storage container? If not, can we remove and update the image in the README_AZURE.md


Performance issue?

I recently completed porting my application from the layer shell library used by the pop_os team to this project.
In the process, I noticed an increase in CPU usage, both in an idle state and especially in some circumstances. I know that I'm a bit too general and also I moved from Iced12 to Iced13 in the process so it could be a regression (even if it's a major one so it seems strange to me).
Anyway, I will try to find more details, in the meantime three major things that I noticed are:
Scrollable
The scrollable widget has major issues during scrolling (both with the mouse and trackpad). It's almost impossible to scroll and the scroll freezes on the top and after a while reach instantly the bottom, so it's not a smooth experience.
In this case, I notice a huge increase in CPU usage.
The "old" version goes from 0.0%/0.2% to 1.0% during the scroll. Now goes from 0.2%/0.4% to 3.8%.
Slider
In this case, the situation is similar. I notice more or less the same CPU usage increment. The experience is smooth but the value changes during the user interaction with values that are not what are currently selected. (it's difficult to explain).
The problem here could be caused by me. On the audio slider on_change I call my PulseAudio using an iced Task, after setting the audio the pulseaudio subscription sends a Message with the new audio value.
If the interaction is too slow could happen:

the slider has a 15 value
the user moves the slider causing an on_change(30) message,
I send the on_change to pulse audio,
the user continues its interaction causing an on_change(50)
the pulse audio subscription sends the message with the new audio value (30)
the slider value is updated to 30 from 50 causing the graphical glitch

In this case, I could handle better the interaction but before this issue didn't appear. Could be related to the iced update from 12 to 13, the performance issue, or both. The spike in CPU usage remains strange.
Moving the mouse
Moving the mouse over a button caused an increase in CPU usage from 0.2% to 2.2% before it was 0.1% to 0.6%. If I open a submenu (so another wayland layer shell) it's even more evident because I trigger the submenu closing when I click in a specific zone of the layer and the close event lags quite a bit. Sometimes, I have to click multiple times to close the submenu.
Conclusion
I know that's a lot of stuff. I have no hurry and I don't expect to see everything resolved. I'm here only to give you feedback on a "real-world example" in case you want something to work on.
I will try my best to find the root cause of these problems but for me, it's difficult because first I have to study the codebase :sweat_smile:

Sometimes, I have to click multiple times to close the submenu.
I already know this issue.. I think maybe it is because that time, the events are too many... I do not very know how to fix it..

Ok. seems I have fixed some problems...

One problem is here
https://github.com/waycrate/exwlshelleventloop/blob/master/layershellev/src/lib.rs#L2220-L2256
when you forword the iced event, it will try to send messages through channel, but the receiver here only accept new message once a time, this sucks all the actions, I think maybe you can try to move the logic to a new thread?

https://github.com/waycrate/exwlshelleventloop/pulls
will this fix the issue? at least it fix some of mime case

I will try. Recently, the pop_os team synced their iced fork with the upstream one, so I was able to test my program with Iced 13 with their version.
Some performance degradation is also present there. In particular, moving the mouse over a button and some other things. The scroll problem and the slider problem are not present.

I find out what happened with scroll, lol, I will fix it

That's way way way better!
With that version both the slider and the scroll problem are gone.
It remains a high CPU usage with the mouse over a button but could be related to the iced 13 version because it's present also in the pop_os fork (maybe it's just a little bit less)
I think that this issue could be closed with these changes

Seems the last one is not my problem... my plugin does nothing when hover on the button.. seems it will be better to submit an issue to iced...

I think the same, the issue it's more iced related


Notch is not visible on the lockscreen

The notch does not display on the lockscreen .

I have read the FAQ and have seen the answer regarding the issue , I just wonder how the competing apps made it work ?
This may require additional permission which could be masked as accessibility application.

One workaround for users could be just adding the notch using the photoshop to the lockscreen wallpapers

Accessibility overlays show above all system layers, including the status bar. Blacking it out would cover the status bar entirely.


Fix props on search toggle

This PR fixes an error in the Search component when clicking the site toggle.
cc @colleenmcginnis

@colleenmcginnis Thanks for catching this! I pushed this beta release to /account staging and the Search toggle is working as expected.


close tab on middle click

On electron, the middle click behavior on a tab is random (opens base.html on patchbay).
This change would allow a user to close the tab on middle click, which is the default behavior on most tabbed browsers at-least.

I didn't know middle click did that, but firefox agrees! merging!

you also taught me about auxclick.
I merged into 5.0.1, but with a small change.
I put the closing code into a function that is reused, so that it's clear that it's the same thing happening twice, (and so some future maintainer doesn't change one but not the other)

awesome! thanks for the de-duplication as well, it makes sense.
true story : I also learned about auxclick some hours back :D


Providing templates via light dom

One thing that might be useful for Polymer is an easy way to declare element templates in light dom. In general Templatizer requires substantial amount of additional code and is often an overkill when we just want to tweak the element a bit depending on where or how it's being used.
As you can see some PaperElements are currently trying to define different templates for when they are used with Polymer 1 or 2 and are not relying on Templatizer and instead creating their own boilerplate code to swap templates at run-time and embedding it into the elements.
A more common use case would be declaring element template similar how we declare contents to be distributed into its slot(s):
<my-element>
<template id="part-1">
...
</template>
<template id="part-2">
...
</template>
</my-element>
This is more of a question to explore some possibilities in this regard. Thanks

We've significantly improved the template system to allow runtime-binding and stamping of templates.  this._stampTemplate(template) will return a dom fragment with nodes bound to the element it is called on.  Check out the tests here and API docs here (the latest API docs haven't been rendered to the website yet, but you can read them in the code for now).
Can you try the new API's out and see if they meet your needs?

Thank you for your response - the new improvements look good and I think that you are on the right track with making basic templating functionality intrinsic to an element.
My use case is slightly different. I have an element with a dom-repeat. I'd like to be able to supply a different template for the dom-repeat when I use the element. Ideally I'd like to have a template property with some default content that I'd bind to the dom-repeat's template and then provide alternative templates as required. Having a couple of lines of code to read the new template contents and push it into the dom-repeat or any other template inside the element would work too.
In this specific case I don't need to stamp it , but simply pass it to the dom-depeat, but I totally see how ease of stamping is likely to come in handy as well. Unfortunately I am having difficulty getting the new template from within the element, this.querySelector('#templateId') gives me null - I think that template of the element itself might be getting in the way somehow. Thanks.
Here's an example of what I'm trying to do:
http://jsbin.com/xozaxetayu/edit?html,output

This Stack Overflow answer https://stackoverflow.com/a/44235946/3750066 implements a solution similar to what you are looking for.

Thanks a lot @aaronanderson - that's pretty much what I was looking for, glad you were able to figure it out. Takes a bit more then a couple of lines of code but at least it's doable.
This seems like a common use case, so hopefully they will streamline template handling in future versions. Looks like they've also just been fixing template content cashing in #4597 - something you might have dealt with as well.

this._stampTemplate(template) seems to be an internal API. Can the same effect be somehow reproduced using the documented Polymer.Templatize.templatize(template) API function? The latter uses the former but it references a __dataHost property set to the template itself and I have not found a documented way to override it.

In Polymer 2.0, we're following a convention across the board that non-underscored methods (denoted with @public) are API for element end-user use, and single-underscored methods (denoted with @protected) are "protected", i.e. for subclasser use.  We intend to maintain both API sets (public & protected) per semver rules.   It's only private (aka double-underscored members that should be avoided).
So yes, _stampTemplate and _contentForTemplate can be safely used in element code.
Note there's an issue open on the API doc viewer to update the API filtering checkboxes to reflect this (currently what says "Show Private" is actually hiding/showing protected members): https://github.com/PolymerElements/iron-doc-viewer/issues/117


Translation Feature for Bluesky

Describe the Feature
Overview
I would llike to request the addition of a translation feature within Bluesky to enhance user experience and accessibility.
Benefits

Enhanced Communication: Users can easily interact with posts/comments/Account Bios/etc. in different languages, fostering a more inclusive community.
Global Reach: Attract more users from diverse linguistic backgrounds, expanding the platform's user base.
Real-Time Translation: Allow users to read and engage with content without language barriers, making conversations more fluid.

Suggested Functionality

Auto-Translate Option: Enable users to automatically translate posts/comments/Account Bios/etc. in different languages with a simple toggle.
Language Selection: Allow users to select their preferred language for translation.
Manual Translation: Provide a feature to manually translate specific posts or comments when desired.

Conclusion
Implementing a translation feature would significantly enhance user engagement and make Bluesky a more global platform.
Thank you for considering this request.
Attachments
No response
Describe Alternatives
No response
Additional Context
No response

Maybe some partnership with Kagi Translate would be possible? I am really with the quality of translation here: https://blog.kagi.com/kagi-translate


Is it possible to implement a filter or search functionality for the source feeds? This would save time spent navigating through multiple pages to find specific one for a country. Even a simple alphabetical sorting feature could be helpful.

Looks good. Just one question. When you say search source by name, do you mean by name of the source or the name of the country? or does either one work? i searched by country and it worked since i didn't know the names. i think it might be okay to just say "search sources" if anything could work so it is open ended.

@nnjemie
We are searching by name. Lucky the name also includes country's name in it :D
Makes sense to rename to just Search


RMF with 2 linked buildings

Hi
Is there a way that RMF can be loaded with 2 buildings .yaml files? As the robot is requested to travel between 2 buildings (which consist of L2 of 2 buildings linked with a bridge. Any suggestions / guidance on this??
Best,
Samuel

Hi Morgan
There're several buildings in Singapore that are inter-linked with a bridge at L2, such as newly launched NorthShorePlaza 1&2 (hasn't updated in Google Map) and also inter-linked buildings that next to Jurong East MRT area. It seems like the inter-linked buildings are the trend in Mall construction.
Yes, you understand the question correctly.
Thanks for the suggested methods, will try out above methods and see which one suits the best.
Another question, are there any 2D map_server / 3D maps localization -like packages that support latitude/longitude defining? that can be used for the 2nd method you suggested.
This is because we're currently using 2D map for navigation while 3D map for localizing, but merging of 3D maps create issue. We have been thinking of if this concept is correct for deploying? Having 2 buildings linked in RMF as below image.

Best,
Samuel

Hi @codebot
Thanks for the suggested method (1), i am able to try it out on gazebo simulation successfully. Here i attached the video link of how it run with RMF.
Interlink buildings with RMF on Gazebo - 8x speedup video
Best,
Samuel


Change the thread pool for CompletableFuture.runAsync

Redo of PR #14553 by @lilyzhoupeijie.
Change the thread pool used by CompletableFuture.runAsync from the
common pool to a separate ForkJoinPool. This is because of the
concerns raised in this
article
about the common pool.
pr-link: Alluxio/alluxio#14559
change-id: cid-deffcf1dae7c6bf74b3d9363d83b5c3a4c009d0b

Codecov Report

Merging #14660 (327b6d1) into branch-2.7 (1a3b3a6) will decrease coverage by 12.20%.
The diff coverage is 16.95%.

@@                Coverage Diff                @@
##             branch-2.7   #14660       +/-   ##
=================================================
- Coverage         41.83%   29.63%   -12.21%
+ Complexity         9316     6205     -3111
=================================================
  Files              1493     1494        +1
  Lines             87480    87670      +190
  Branches          10427    10446       +19
=================================================
- Hits              36599    25981    -10618
- Misses            47900    59535    +11635
+ Partials           2981     2154      -827

Impacted Files
Coverage Δ

...luxio/master/journal/raft/JournalStateMachine.java
0.00% <0.00%> (-39.45%)
:arrow_down:

.../master/journal/raft/RaftJournalConfiguration.java
0.00% <0.00%> (-81.82%)
:arrow_down:

...alluxio/master/journal/raft/RaftJournalSystem.java
0.00% <0.00%> (-54.87%)
:arrow_down:

...uxio/master/FaultTolerantAlluxioMasterProcess.java
0.00% <0.00%> (-50.49%)
:arrow_down:

...c/main/java/alluxio/proxy/s3/ListBucketResult.java
0.00% <0.00%> (ø)

.../java/alluxio/proxy/s3/MultipartUploadCleaner.java
0.00% <0.00%> (ø)

...xy/src/main/java/alluxio/proxy/s3/S3ErrorCode.java
0.00% <0.00%> (ø)

...in/java/alluxio/proxy/s3/S3RestServiceHandler.java
2.51% <0.00%> (-0.13%)
:arrow_down:

...er/block/management/BlockManagementTaskResult.java
86.36% <ø> (ø)

...o/worker/grpc/DataMessageServerStreamObserver.java
0.00% <0.00%> (ø)

... and 285 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 99a7a28...327b6d1. Read the comment docs.

alluxio-bot, merge this please


Cannot build wheel

Hi,
I am running Windows 11, Python 3.11.9, and comfyui in a venv environment.
I tried installing the latest llama-cpp-python for Cuda 1.24 in the below manner and received a string of errors. Can anyone assist please?
(venv) D:\ComfyUI>pip install llama-cpp-python --verbose --extra-index-url https://abetlen.github.io/llama-cpp-python/wh
l/cu124
Using pip 24.0 from D:\ComfyUI\venv\Lib\site-packages\pip (python 3.11)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com, https://abetlen.github.io/llama-cpp-python/whl/cu124
Collecting llama-cpp-python
  Downloading llama_cpp_python-0.2.78.tar.gz (50.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.2/50.2 MB 32.7 MB/s eta 0:00:00
  Running command pip subprocess to install build dependencies
  Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com, https://pypi.ngc.nvidia.com, https://abetlen.github.io/llama-cpp-python/whl/cu124
  Collecting scikit-build-core>=0.9.2 (from scikit-build-core[pyproject]>=0.9.2)
    Downloading scikit_build_core-0.9.6-py3-none-any.whl.metadata (19 kB)
  Collecting packaging>=21.3 (from scikit-build-core>=0.9.2->scikit-build-core[pyproject]>=0.9.2)
    Downloading packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
  Collecting pathspec>=0.10.1 (from scikit-build-core>=0.9.2->scikit-build-core[pyproject]>=0.9.2)
    Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB)
  Downloading scikit_build_core-0.9.6-py3-none-any.whl (152 kB)
     ---------------------------------------- 152.3/152.3 kB 4.6 MB/s eta 0:00:00
  Downloading packaging-24.1-py3-none-any.whl (53 kB)
     ---------------------------------------- 54.0/54.0 kB ? eta 0:00:00
  Downloading pathspec-0.12.1-py3-none-any.whl (31 kB)
  Installing collected packages: pathspec, packaging, scikit-build-core
  Successfully installed packaging-24.1 pathspec-0.12.1 scikit-build-core-0.9.6
  Installing build dependencies ... done
  Running command Getting requirements to build wheel
  Could not determine CMake version via --version, got '' 'Traceback (most recent call last):\n  File "<frozen runpy>", line 198, in _run_module_as_main\n  File "<frozen runpy>", line 88, in _run_code\n  File "D:\\ComfyUI\\venv\\Scripts\\cmake.EXE\\__main__.py", line 4, in <module>\nModuleNotFoundError: No module named \'cmake\'\n'
  Getting requirements to build wheel ... done
  Running command pip subprocess to install backend dependencies
  Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com, https://pypi.ngc.nvidia.com, https://abetlen.github.io/llama-cpp-python/whl/cu124
  Collecting cmake>=3.21
    Downloading cmake-<IP_ADDRESS>-py3-none-win_amd64.whl.metadata (6.1 kB)
  Downloading cmake-<IP_ADDRESS>-py3-none-win_amd64.whl (36.2 MB)
     ---------------------------------------- 36.2/36.2 MB 65.2 MB/s eta 0:00:00
  Installing collected packages: cmake
  Successfully installed cmake-<IP_ADDRESS>
  Installing backend dependencies ... done
  Running command Preparing metadata (pyproject.toml)
  *** scikit-build-core 0.9.6 using CMake 3.29.5 (metadata_wheel)
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: typing-extensions>=4.5.0 in d:\comfyui\venv\lib\site-packages (from llama-cpp-python) (4.12.2)
Requirement already satisfied: numpy>=1.20.0 in d:\comfyui\venv\lib\site-packages (from llama-cpp-python) (1.26.4)
Requirement already satisfied: diskcache>=5.6.1 in d:\comfyui\venv\lib\site-packages (from llama-cpp-python) (5.6.3)
Requirement already satisfied: jinja2>=2.11.3 in d:\comfyui\venv\lib\site-packages (from llama-cpp-python) (3.1.4)
Requirement already satisfied: MarkupSafe>=2.0 in d:\comfyui\venv\lib\site-packages (from jinja2>=2.11.3->llama-cpp-python) (2.1.5)
Building wheels for collected packages: llama-cpp-python
  Running command Building wheel for llama-cpp-python (pyproject.toml)
  *** scikit-build-core 0.9.6 using CMake 3.29.5 (wheel)
  *** Configuring CMake...
  2024-06-17 12:05:30,337 - scikit_build_core - WARNING - Can't find a Python library, got libdir=None, ldlibrary=None, multiarch=None, masd=None
  loading initial cache file C:\Users\DEFAUL~1.LIV\AppData\Local\Temp\tmpy2u4tmwa\build\CMakeInit.txt
  -- Building for: Visual Studio 17 2022
  -- Selecting Windows SDK version 10.0.22621.0 to target Windows 10.0.22631.
  -- The C compiler identification is MSVC 19.39.33520.0
  -- The CXX compiler identification is MSVC 19.39.33520.0
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.39.33519/bin/Hostx64/x64/cl.exe - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2022/BuildTools/VC/Tools/MSVC/14.39.33519/bin/Hostx64/x64/cl.exe - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- Found Git: C:/Program Files/Git/cmd/git.exe (found version "2.45.2.windows.1")
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
  -- Looking for pthread_create in pthreads
  -- Looking for pthread_create in pthreads - not found
  -- Looking for pthread_create in pthread
  -- Looking for pthread_create in pthread - not found
  -- Found Threads: TRUE
  -- Found OpenMP_C: -openmp (found version "2.0")
  -- Found OpenMP_CXX: -openmp (found version "2.0")
  -- Found OpenMP: TRUE (found version "2.0")
  -- OpenMP found
  -- Found CUDAToolkit: C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.4/include (found version "12.4.131")
  -- CUDA found
  CMake Error at C:/Users/Default.LivingRoomPC/AppData/Local/Temp/pip-build-env-9sqow3ao/normal/Lib/site-packages/cmake/data/share/cmake-3.29/Modules/CMakeDetermineCompilerId.cmake:563 (message):
    No CUDA toolset found.
  Call Stack (most recent call first):
    C:/Users/Default.LivingRoomPC/AppData/Local/Temp/pip-build-env-9sqow3ao/normal/Lib/site-packages/cmake/data/share/cmake-3.29/Modules/CMakeDetermineCompilerId.cmake:8 (CMAKE_DETERMINE_COMPILER_ID_BUILD)
    C:/Users/Default.LivingRoomPC/AppData/Local/Temp/pip-build-env-9sqow3ao/normal/Lib/site-packages/cmake/data/share/cmake-3.29/Modules/CMakeDetermineCompilerId.cmake:53 (__determine_compiler_id_test)
    C:/Users/Default.LivingRoomPC/AppData/Local/Temp/pip-build-env-9sqow3ao/normal/Lib/site-packages/cmake/data/share/cmake-3.29/Modules/CMakeDetermineCUDACompiler.cmake:131 (CMAKE_DETERMINE_COMPILER_ID)
    vendor/llama.cpp/CMakeLists.txt:411 (enable_language)

  -- Configuring incomplete, errors occurred!

  *** CMake configuration failed
  error: subprocess-exited-with-error

  × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: 'D:\ComfyUI\venv\Scripts\python.exe' 'D:\ComfyUI\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py' build_wheel 'C:\Users\DEFAUL~1.LIV\AppData\Local\Temp\tmpa1tcm9ca'
  cwd: C:\Users\Default.LivingRoomPC\AppData\Local\Temp\pip-install-gn5_hb5u\llama-cpp-python_11e565ea5e874456a27660546fbad291
  Building wheel for llama-cpp-python (pyproject.toml) ... error
  ERROR: Failed building wheel for llama-cpp-python
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects

Yes, same issue. Using a python 3.10.6 virtual environment

check this reply
https://github.com/abetlen/llama-cpp-python/issues/1535#issuecomment-2175924951

check this reply
#1535 (comment)

Thank you. Not a bad workaround to get going, but I agree with you, I am really hoping we keep seeing updated CUDA builds. New models come out constantly so it's important to stay up on llama.cpp versions.

This is how i got it to work. Took me a day to figure out.

Uninstall build tools (standalone version)
From Visual Studio, install the Desktop Development with C++.
Reinstall CUDA
run the pip install

https://github.com/abetlen/llama-cpp-python/issues/1352#issuecomment-2189890596

For me it was copying all the files from CUDA VS Integrations
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\extras\visual_studio_integration\MSBuildExtensions
To all the folders
"BuildCustomizations" on the drive where I have my Visual Studio installed.
I had folders in both Program Files and in Program Files (x86)
Note that the build process can take like 20 minutes.


New format for defaults file

This removes an avenue of attack mentioned in Issue #129.

Nice, this branch has been working pretty well for me so far. I'll try to test the defaults converter soon.

Let me know what you think of the updater code.  I think it is a fairly simple idea that can be expanded in the future without junking up the Makefile, mscs or msctl scripts

It's a nice approach and a good idea. Keeps the scripts clean.

I should go back and add comments for: the ascii codes (\x23 is ", \x27 is ', and \x23 is #), and the what the regex are doing in the update script.

I created a new v4 branch with pull request #134. Closing.


Site search functionality?

Can't find anything about this, is it possible to search through the website on the frontend? Or do I've to build this with filters on multiple collections and use pagination for this?

Any info about that?

There's not a build-in feature for search, you'll have to do it either by accessing the search function from the backend. on the frontend. Which is possible, everything in Cockpit backend is accessible on frontend. But if you don't want to mess with that, then you'll have to make it with filters when you get the content


rapidast scan execution as kuttl testsuite

deferred until final version of the equivalent code is reviewed and integrated for fence-agents-remediation operator.


Exceed the quota exception

Exceed the quota

The swrv cache, specifically localStorage, in all browsers has limits. It’s typically the responsibility of the host app to manage what it stores in the cache.
We could add some error handling here around the setItem logic; however, this would likely suppress the error to the host application.

The swrv cache, specifically localStorage, in all browsers has limits. It’s typically the responsibility of the host app to manage what it stores in the cache.
We could add some error handling here around the setItem logic; however, this would likely suppress the error to the host application.

This is the PR. It does not aim to fix the bug, just ignore it to prevent application breaks:
https://github.com/Kong/swrv/pull/351

This is now released in 1.0.4


implement ipc for reverse communication with hardware. (toggle led state+color)

closing this branch, i want a new branch with the current state from main for working on


special-case errors

Hey! We're working with some folks who want to bring seamless-immutable into their stack, and as part of setting things up we found that Error objects come out the other side of Immutable() as empty objects. Error properties are exposed as getters on the prototype so the standard method of copying objects doesn't work out.
Thanks Richard!

Seems reasonable!

@lukewestby published as 7.1.2


Apollo 2.5 support Pwrpack7-E1 ???

System information

OS Platform and Distribution (Linux Ubuntu 18.04):
Apollo installed from (source or binary):
Apollo version (1.0,1.5,2.0,2.5):

Hello
I would like to know is it possible to use a Pwrpack7D-E1 in apollo 2.5? if so what are the configurations to integrate?
Apollo 2.5 was released before the Pwrpack7 modules were manufactured, so the base architecture does not include the driver for this module, so I'm wondering if we want to use the Pwrpack7-E1 instead of the Propack6 in apollo 2.5 how I should m 'take it?
I saw the installation guide here but don't know how to integrate it into Apollo 2.5.
Thank you in advance.
Link for Pwrpack7D-E1: https://novatel.com/products/receivers/enclosures/pwrpak7d

Closed due to inactivity. If the problem persists, pls feel free to reopen it or create a new one and refer to it.


Pay button and owe message not showing for requested IOU on Safari

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Login with 2 accounts in different devices. Account A is in Safari, Account B is in other browser except Safari (i.e. Chrome)
In account B, request any amount of money to account A
In account A, the IOU message  has the Pay button, and the message saying You owe [Account B]…
In account A, decline all the payment request from account B
Now, in account A, request any amount of money to account B
Notice in account A the IOU message has the Pay button, and the message saying You owe [Account A]... . Also notice there is no Pay button and the owe message in account B

Expected Result:
Pay button and owe message should only be displayed in the requested account
Actual Result:
Pay button display inconsistently, in both requesting and requested account
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[x] MacOS / Safari
[ ] MacOS / Desktop

Version Number: 1.2.90-6
Reproducible in staging?: Need reproduction
Reproducible in production?: Need reproduction
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://user-images.githubusercontent.com/43996225/228666900-62d731e4-f3d9-4599-a9ca-71fba5bd07ef.mov
Expensify/Expensify Issue URL:
Issue reported by: @tienifr
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1679987904831019
View all open jobs on GitHub

Triggered auto assignment to @bfitzexpensify (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

Bug0 Triage Checklist (Main S/O)

[ ] This "bug" occurs on a supported platform (ensure Platforms in OP are ✅)
[ ] This bug is not a duplicate report (check E/App issues and #expensify-bugs)

If it is, comment with a link to the original report, close the issue and add any novel details to the original issue instead

[ ] This bug is reproducible using the reproduction steps in the OP. S/O

If the reproduction steps are clear and you're unable to reproduce the bug, check with the reporter and QA first, then close the issue.
If the reproduction steps aren't clear and you determine the correct steps, please update the OP.

[ ] This issue is filled out as thoroughly and clearly as possible

Pay special attention to the title, results, platforms where the bug occurs, and if the bug happens on staging/production.

[ ] I have reviewed and subscribed to the linked Slack conversation to ensure Slack/Github stay in sync

@tienifr can you still reproduce? I followed the flow and it is working correctly for me - the second request from account A (in Safari) to account B (in Chrome) is behaving as I would expect

@bfitzexpensify On my side, now it's occuring on Chrome. Could you try the other way around (request from account B in Chrome to account A in Safari)
It seems like we need to have a previous request in the chat which has been canceled in order to reproduce this.
The expected behavior is that the pay button should appear on the requested account. Current behavior is that it is appearing in the requesting account.
Here is the recording on staging that I've just tried
https://user-images.githubusercontent.com/113963320/229675474-0a49c16d-e8ea-46ce-9e35-415ed29d443d.mov

@bfitzexpensify
After some trial, I figure out this way to reliably reproduce the issue. It turns out that it occurs in every browsers. Can you try with these following steps?

Login to 2 different accounts with no prior chat history between them
Request money from account A
Decline from account B
Request money from account B
Notice the Pay button appear on account B (it should appear on account A)

@bfitzexpensify Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

@bfitzexpensify Whoops! This issue is 2 days overdue. Let's get this updated quick!

Hm, I still can't reproduce 😅
I created two new accounts to ensure no prior chat history and followed the process you listed. This was the result:

I think the general flow here (account A requests from account B as a mistake, account B declines and sends an identical request instead) is a flow that will definitely occur as users join the platform, but it is strange that I still can't reproduce 🤔

@bfitzexpensify
Here is the latest flow that I tried on 2 fresh account on staging with no prior chat history. It seems like it's occurring for a small amount of money. Could you try switching to VND, or change the requested amount of GEL to 0.01?
Record: https://drive.google.com/file/d/1aQHRIANuoQqyzJEKLh3BJYSsQc2J3RIE/view?usp=share_link

@bfitzexpensify this issue was created 2 weeks ago. Are we close to a solution? Let's make sure we're treating this as a top priority. Don't hesitate to create a thread in #expensify-open-source to align faster in real time. Thanks!

I tested with 0.25 GEL (which is $0.1 USD) and the flow was OK. I imagine anything under $0.01 USD has the issue here. Given that it only happens under specific conditions of non-history in chat and decline -> request, and is for incredibly tiny amounts, I don't think this is worth fixing. Going to close it out.

@bfitzexpensify
Regarding the newest version of the app, I am encountering this once again. This time, it should be clearer.
Step to reproduce:

From account A on Chrome, request $1000 from account B on Safari
From account B, request $2000 from account A
Notice that the amount is negative, and the pay button appear on account B (while it should be on account A)

Thoughts?

@bfitzexpensify
Regarding the newest version of the app, I am encountering this once again. This time, it should be clearer.
Step to reproduce:

From account A on Chrome, request $1000 from account B on Safari
From account B, request $2000 from account A
Notice that the amount is negative, and the pay button appear on account B (while it should be on account A)

Thoughts?


Introduce sensitiveKeyNamesAllowed parameter

Overview
Currently only values could be excluded from control-inputs by specifying sensitiveValuesAllowed variable. At the same time it should be possible to exclude key names that act as secret references but not as secrets themselves.
For example, an env variable called VAULT_SECRET_PATH would be flagged as an issue, while in reality it may contain only a path to the actual secret in Vault.
Modifying sensitiveKeyNames list is not an option because I'd still want to see other improper uses of keyword secret
Solution
Introduce a new parameter called sensitiveKeyNamesAllowed that would act as sensitiveValuesAllowed but for key names
Workaround
I couldn't find this in the code, but seems like sensitiveKeyNames is using regexp for string matching, so maybe it would be possible just to use escape characters to narrow the scope for certain keywords? For example, secret$ for looking for secret keyword only at the end of variable name?

Assign me this issue, I'm working on this.

This issue was resolved in this PR in regolibrary. We now have sensitiveValuesAllowed and sensitiveKeyNamesAllowed that allow excluding values and key names from failing, respectively.
In the example above of VAULT_SECRET_PATH one would be able to configure sensitiveKeyNamesAllowed to include VAULT_SECRET_PATH or even _PATH therby preventing false positives.


Additional rebuild logic

Completely forgot about the list of same name metadata. Fix part 2 in response to #17

Merging and tagging a release.


Dev 7.0

lv_dropdown_add_option() stopped working when default static options were assigned in lv_dropdown_create()

What do you think about allocating the options from the static text in this case?

Adding static options?  You'd need a list of pointers.

I think @kisvegabor means that the existing set of static options should be converted to dynamic options.

I think @kisvegabor means that the existing set of static options should be converted to dynamic options.

Yes, I meant this, Sorry, if I was unclear.
So if an option is added to a static text, allocate the static text as if it was set with lv_dropdown_set_text.

Ok, makes sense.  I think I can do that.

Assuming that you wish to convert the static options (not text) to dynamic when lv_dropdown_add_option is called and static options exist.
This requires the addition of a function to clear the options otherwise you always will have the default Option 1\n Option 2\nOption 3 preceding any other options you add.
I'll redo the pull request and you can see.

Thank you!


Mock API endpoint wrong?

The mock API endpoint is described to be the same as the production one. So does this mean it's the same API endpoint just without authentication?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d9862992-905d-6343-d921-11d0cc117fa9
Version Independent ID: 47437574-5c46-b88b-aee3-4ebf52efe4bf
Content: SaaS Fulfillment API V2
Content Source: articles/marketplace/cloud-partner-portal/saas-app/cpp-saas-fulfillment-api-v2.md
Service: marketplace
GitHub Login: @v-miclar
Microsoft Alias: pabutler

@dtPaTh Thanks for the question. We are investigating and will get back to you soon.

@v-miclar any input on this?

@qianw211 , @v-miclar can you confirm the MOCK api endpoint referenced in the doc  is correct?

@mattwojo Hi Matt, could you please look into this issue?  Thanks!

Received this from Aditya Desai:
"The API endpoint paths are the same across both Mock and Real APIs, but the API versions are different.  The version is 2018-09-15 for Mock and  2018-08-31 for the production version. "
@femsulu: Please unassign me as I don't work on this API ref.  It sounds like  @addesai and @qianw211 will be able to make any necessary updates.

thanks for confirming @mattwojo.
@dtPaTh  - hope this answers your question. We will now close the issue but don't hesitate to reply if needed.

Thanks for confirmation!


[3.2.x] Updated source translation catalogs.

@claudep Thanks :+1: Do we have any changes in JS catalogs?

@claudep Thanks :+1: Do we have any changes in JS catalogs?

What do you mean? (djangojs.po in admin did change)

What do you mean? (djangojs.po in admin did change)

What do you mean? (djangojs.po in admin did change)

Ahh, sorry, I missed it.

What do you mean? (djangojs.po in admin did change)

Ahh, sorry, I missed it.

Thanks for this @claudep! 🥇

Thanks for this @claudep! 🥇


scanpy.pp.log1p with backed h5ad produces copy error

I am fairly new with using scanpy, and so I may be performing this incorrectly.  I encountered an error when trying to create a backed AnnData object from an h5ad file, and then logarithmizing the data matrix within the object using scanpy.pp.log1p.  However I get an error within the AnnData object code because the preprocessing/_simple.py script is not passing a filename in the copy() function.
Right now my current workaround is to create the AnnData object as non-backed, do the log1p, and then create a "filename" property to the AnnData object afterwards to make it backed for other scanpy functions.
Example
import scanpy as sc

dataset_path = "/path/to/test/data.h5ad"   # Subbing out actual filenames for data
adata = sc.read_h5ad(dataset_path, backed='r')
print(adata)   # To ensure there is a backed filepath

adata.raw = sc.pp.log1p(adata, copy=True)    # Error is here

Error output
# I printed the AnnData object to ensure it was backed
AnnData object with n_obs × n_vars = 4166 × 16852 backed at '/tmp/1b12dde9-1762-7564-8fbd-1b07b750505f.h5ad'
    obs: 'cell_type', 'barcode', 'tSNE_1', 'tSNE_2', 'replicate', 'louvain', 'n_genes', 'percent_mito', 'n_counts'
    var: 'gene_symbol', 'n_cells'
    obsm: 'X_tsne'

# Actual error after calling log1p
Traceback (most recent call last):
  File "log1p_test.cgi", line 129, in <module>
    main()
  File "log1p_test.cgi", line 81, in main
    adata.raw = sc.pp.log1p(adata, copy=True)
  File "/opt/Python-3.7.3/lib/python3.7/site-packages/scanpy/preprocessing/_simple.py", line 292, in log1p
    data = data.copy()
  File "/opt/Python-3.7.3/lib/python3.7/site-packages/anndata/_core/anndata.py", line 1457, in copy
    "To copy an AnnData object in backed mode, "
ValueError: To copy an AnnData object in backed mode, pass a filename: `.copy(filename='myfilename.h5ad')`.

Versions:
scanpy==1.4.6 anndata==0.7.1 umap==0.3.10 numpy==1.16.3 scipy==1.4.1 pandas==0.24.2 scikit-learn==0.22.2.post1 statsmodels==0.11.1 python-igraph==0.8.0 louvain==0.6.1

Thanks for the report!
As a heads up, at the moment, backed mode works best for read only workflows like plotting.


Duplicate Avoidance does not account for body

[x] I have verified there are no duplicate active or recent bugs, questions, or requests

[x] I have verified that I am using the latest version of this library.

[x] I have given my issue a non-generic title.

Library version: 3.2.4 (3.2.5 not working for me somehow)

Device OS version: 6.0.1

Device Manufacturer: OnePlus

Device Name: 3

Reproduction Steps
Do two or more Requests with everything the same except the body:
Bridge.post("https://example.com").body(new Form().add("parameter1", "value1"))
      .request(new Callback() {
    @Override
    public void response(@NonNull Request request, @Nullable Response response,
                         @Nullable BridgeException e) {
        //As expected
    }
});

Bridge.post("https://example.com").body(new Form().add("parameter2", "value2"))
      .request(new Callback() {
    @Override
    public void response(@NonNull Request request, @Nullable Response response,
                         @Nullable BridgeException e) {
        //Same as above, even though something different is expected
    }
});

Expected Result
Different results for both callbacks, based on the body.
Actual Result
Same results for both callbacks.
Thoughts
I haven't looked at the code and I am not sure if it would be easy to add this. If not, an option for turning duplicate avoidance off would be great.
Thanks in advance!

That's a good idea for enhancement!
I'll include that in the next release.

Great! :+1:

Finally in the latest release.
It uses MD5 hashes on bodies for duplicate avoidance. It's automatic everywhere except the TransferPipe (Pipe.forStream()) where you have to provide an ID, since reading the entire stream to generate a hash is impractical and inefficient.


Zenodo license options dropdown

Describe the feature you'd like and what it will do
zenodo.org has a dropdown for license choices.  The license options are from https://opendefinition.org/.  Data Submission Portal should allow license choices in the same way.  This will require a component to be developed that can use their API.
https://opendefinition.org/licenses/api/
Why is this feature important?
It is a lot easier to find and correctly identify a license
Is your feature request related to a problem? Please describe.
It is difficult to correctly find and set a license identifier with just a string.
Additional context

@sblack-usu - I'm curious how you got that screen shot. When I go to production Zenodo, I can only choose from a list of Creative Commons Attribution licenses:

Given this, I'm not sure it's worth building something in instead of just using the Creative Commons Attribution 4.0 International license.
This is also weird because their guidance text below the license picker states:

If you cannot find the license you're looking for, include a relevant LICENSE file in your record and choose one of the Other licenses available (Other (Open), Other (Attribution), etc.). The supported licenses in the list are harvested from opendefinition.org  and spdx.org . If you think that a license is missing from the list, please contact us.

There are no "Other" licenses available in their drop down list.

There is a much longer list of licenses that you can search for Start typing a license name and other options will be listed.

Huh. OK, I missed the whole "Start Typing" thing because when I clicked on the box it was a drop down with only a few options available and I assumed that I could only choose from the items in the list. Shannon also made the same assumption. Also, the drop down is slow to respond, you have to wait long enough for something different to pop up. In any case, the way this box works in Zenodo isn't ideal because it presumes that a user knows what's in the list and can start typing it in.
I see why the API call is important now, but let's make it easier for users to figure out which licenses they can choose from.

What's left to do from this issue is an update of the labels so that they are more descriptive.

Descriptive license titles have been added to the current items in our schema. Pending implementation of renderer that can read from the api as described.

We are going to grab a snapshot of the json file and serve it as part of our schema. This way we keep a schema driven approach. We will update these data as needed.


Consider building a browser devtools extension

I stumbled upon your tool today and found it really useful.
It's always frustrating to work with the different mime-types and the data in a dataTransfer object. Your tool is super helpful for this.
It would also be very useful inside DevTools. Would you consider building a DevTools extension for it?
In case this helps:
Create an extension that customizes the DevTools UI on learn.microsoft.com.
Extending DevTools on developer.chrome.com.
Extending the developer tools on MDN.
Adding a web development tool to Safari Web Inspector on developer.apple.com.

Hi Patrick, thank you for the kind words!
A DevTools extension is a great idea, and on a first skimming of the docs it doesn't seem too complicated to get one going across platforms. Maybe it's worth dropping the React dependency while we're at it.
Not sure I have the bandwidth to tackle this for the time being, but it's something I look forward to.


Update dictionary_prediction_aggregator.cc

The "ngram/neg_log_prob.h" header listed in src/prediction/dictionary_prediction_aggregator.cc does not exist.
Description
The "ngram/neg_log_prob.h" header listed in src/prediction/dictionary_prediction_aggregator.cc does not exist.
Issue IDs
Steps to test new behaviors (if any)
bazel build --config oss_linux --compilation_mode opt package
Additional context

Hi phoepsilonix,
We happened to be fixing the issue at the same time.
https://github.com/google/mozc/commit/8eddfbaaeb2ff64512f17e32eadef5c7cbac9457
We appreciate your contribution.
Best,


Document how to prevent accidental downgrade of Besu

Document how to prevent accidental downgrade of Besu, which can permanently corrupt the database. Also, document the validation process to ensure the preventative steps are effective.
See PR: https://github.com/hyperledger/besu/pull/6307
Note: Originating PR is not yet merged. Ensure this PR is merged before publishing doc update.

Issue was supposed to be open in the besu-docs repository.


feat(frontend): add/display peers and assets liquidity

Changes proposed in this pull request

Display liquidity for peers and assets
Ability to add liquidity
Adds Remix's v2 route convention
Put back setMessage function and create a wrapper around it

Context

closes #1490
in a previous PR, Max had a suggestion to keep the setMessage function and to create a wrapper around redirect

Checklist

[x] Related issues linked using fixes #number
[ ] Tests added/updated
[ ] Documentation added
[ ] Make sure that all checks pass

Did I accidentally mess up the lock file?


Server is not getting syncronized files during the same run

Bug description
Server is not taking new files state after the syncronizing files.
To Reproduce
Steps to reproduce the behavior:

Setup server and client
Make syncronization
Try to make it again
See error

Expected behavior
The program has to not be syncronizing files, because it's already syncronized.
Screenshots
None
Desktop (please complete the following information)

Algorithm problems.

Additional context
The server activity has to be reworked.

Fixed. #19


Elasticsearch: preserve vector store tests

Description
When migrating to an integration package, the vector store tests had been lost. This PR

copies the tests from the legacy directory
copies the docker-compose.yml
fixes the user agent header test

Version Bump?
Did I bump the version in the pyproject.toml file of the package I am updating? (Except for the llama-index-core package)

[ ] Yes
[x] No

Type of Change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?
See comment in test file on how to run.

[x] Added new unit/integration tests

Suggested Checklist:

[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added Google Colab support for the newly added notebooks.
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[ ] I ran make format; make lint to appease the lint gods

Good catch, thanks!

Thanks for approving @logan-markewich!
There were a silly debug output error and a linting error that I now fixes.
Do CI runs require a maintainer to trigger them explicitly?

super nice! thanks!


[#157205103] Store org and space name from historic data

What
We are going to start using historical org and space name data from the CF API to fill in names where a billed tenant would otherwise see just a GUID. This pull request just makes the data available, but doesn't yet affect visibility of the org/space names.
How to review
The usual: code review and make sure all tests pass.
Because we are not doing the tenant-visible side yet it will be hard to test whether this really provides what is required, but I suggest we defer such judgement until we actually start work on the front end side.
Who can review
Anyone but me or @jpluscplusm

Tested this by deploying billing to my local dev env (with cf push) and curling the events. I can also see the nice org_name and space_name fields.
Merging, then I'll bump it in to paas-cf.


Show join/parts/quits

The support for join/part/quits can maybe be toggleable?

Kicks should also be supported


rasa x (local) connect to github gets 404 error

Rasa version: 2.3.0
Rasa SDK version (if used & relevant):2.3.1
Rasa X version (if used & relevant): 0.36.0
Python version:3.6.8
Operating system (windows, osx, ...): Linux-5.4.78-2-pve-x86_64-with-centos-7.6.1810-Core
Issue: following the instruction for connecting rasa x to my github repo. When I run the curl command I get a 404 error.
Error (including full traceback):
About to connect() to ovzve25-68.appstate.edu port 5002 (#0) *> Trying <IP_ADDRESS>…
Connected to ovzve25-68.appstate.edu (<IP_ADDRESS>) port 5002 (#0) POST /api/projects/default/git_repositories?api_token=***************************** HTTP/1.1
User-Agent: curl/7.29.0
Host: ovzve25-68.appstate.edu:5002
Accept: /
Content-Type: application/json
Content-Length: 3611
Expect: 100-continue
< HTTP/1.1 100 Continue
< HTTP/1.1 404 Not Found
< Content-Length: 10
< Content-Type: text/plain; charset=utf-8
< Connection: keep-alive
< Keep-Alive: 5
HTTP error before end of send, stop sending
Closing connection 0
Not found.

Command or request that led to error:
curl --request POST \
–url http://ovzve25-68.appstate.edu:5002/api/projects/default/git_repositories?api_tokenxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx2 \
–header ‘Content-Type: application/json’
–data-binary @repository.json
–verbose

Content of repository.json
{
“repository_url”: “git@github.com:randywreed/rasa_kritik_check.git”,
“target_branch”: “main”,
“ssh_key”: "-----BEGIN RSA PRIVATE KEY-----
MIIJKQIBA…
QkEqzYBT
-----END RSA PRIVATE KEY----- ",
“is_target_branch_protected”: false
}

Content of configuration file (config.yml) (if relevant):
see attached

Content of domain file (domain.yml) (if relevant):
see attached
[config_and_domain_files.zip](https://github.com/RasaHQ/rasa/files/6026824/config_and_domain_files.zip)

Thanks for the issue, @mvielkind will get back to you about it soon!
You may find help in the docs and the forum, too 🤗

Integrated version control not supported in RasaX local. https://rasa.com/docs/rasa-x/installation-and-setup/deploy/

submitting feature request https://github.com/RasaHQ/rasa/issues/8076


Review backlog video meeting - Ingestion API, Code Org, Flask, Config Files

Review the Ingestion API, Code org, Flask, & Config Files discussion meeting video and add/refine items to the backlog.
Note - Refer cQube Internal Notes document page-1 for video meeting link and passcode

Meeting notes and video


Refactor processList

The ApiListCommand@processList() method is very long and not very testable. Refactor this, and make sure it is covered by tests.

This mostly partially fixed in #28

Since we've merged the related PR we should discuss following steps in a standalone issue.