[SPARK-8998][MLlib] Collect enough frequent prefixes before local processing in PrefixSpan (new)

Collect enough frequent prefixes before projection in PrefixSpan

Merged build triggered.

Merged build started.

Test build #37309 has started for   PR 7412 at commit 6560c69.

@mengxr This is new PR, please review it. TKS.

cc @feynmanliang

Test build #37309 has finished for   PR 7412 at commit 6560c69.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

PR title is off; should be  "before local processing" instead of "before projection"
Instead of terminating on minPatternsBeforeShuffle, should the termination condition be some maximum size of a projected database? The current condition doesn't handle the case when we have minPatternsBeforeShuffle prefixes but some have very large projected databases (e.g. if the sequences are very long there may be many prefixes receiving most of the dataset even if minPatternsBeforeShuffle prefixes are generated)

That's all for now!

Merged build triggered.

Merged build started.

Test build #37344 has started for   PR 7412 at commit baa2885.

Test build #37344 has finished for   PR 7412 at commit baa2885.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

@feynmanliang If we want get the size of projected database, we must group by the prefix and suffix pairs. When the prefix length is small, and sequences are very long, and the size of items is small, the size of projected database equals the size of patterns. Otherwise, the size of projected database is small than the size of patterns.

My concern is not projected database > # patterns, rather it is that the groupByKey on L103 will overload an executor if some key (prefix) has many values (suffixes) associated to it.
For example, if you had minPatternsBeforeShuffle frequent length-one items and a single length-two item (call it AB) which appeared in every transaction, then L93-99 would terminate and L103 would try to send the suffix of every sequence which contained AB to the executor assigned to AB. Since AB appears in every transaction, the entire dataset will be sent to a single executor.
To get around this, you can use aggregateByKey with a counter accumulator to count the number of suffixes associated with each prefix (this will take a single pass over prefixSuffixPairs) and begin local processing when accumulator.values.max is less than some threshold the executor is capable of handling.

Build triggered.

Build started.

Test build #37452 has started for   PR 7412 at commit 095aa3a.

Test build #37452 has finished for   PR 7412 at commit 095aa3a.

This patch fails Spark unit tests.
This patch does not merge cleanly.
This patch adds no public classes.

Build finished. Test FAILed.

Merged build triggered.

Merged build started.

Test build #37466 has started for   PR 7412 at commit b07e20c.

Test build #37466 has finished for   PR 7412 at commit b07e20c.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
case class Length(child: Expression) extends UnaryExpression with ExpectsInputTypes
case class FormatNumber(x: Expression, d: Expression)

Merged build finished. Test PASSed.

@feynmanliang  This assumes that all the values (suffixes) associated to a key (prefix) will fit on an executor, but I don't think that patternsCount > minPatternsBeforeShuffle will guarantee that. Better to count the suffixes for each prefix using aggregateByKey before doing local processing.
The minPatternsBeforeLocalProcessing is related to the executors. The suffixes threshold (call it maxSuffixesThreshold) is related with the input sequences size. How to set the default value of maxSuffixesThreshold ?
You worry about a exector will overload. If an executor has multiple prefix maybe reduce the influence of this problem. For example, the number of executors is 4, the minPatternsBeforeLocalProcessing is 20, means one executor have 5 random prefixes and its suffixes.
The following diagram show the two methods' different:

The example you've given doesn't rule out my concern; if any one of those 5 prefixes assigned to an executor has too many suffixes then the executor will be overloaded.
For example, assume number of length-1 frequent items is >= minPatternsBeforeShuffle, and one of those frequent items (call it item A) appears in every transaction. After the groupByKey, the executor assigned to item A will receive a suffix from every transaction in the dataset. Since we don't assume the dataset fits on a single machine, this executor will be overloaded.
I don't really understand the diagram you've drawn. As the prefix length increases, the number of suffixes associated with that prefix will always decrease (Lemma 3.2 and 3.2
"Projected databases keep shrinking" in PrefixSpan paper), so the graph should be monotonically decreasing.
numPatterns >= minPatternsBeforeLocalProcessing is a heuristic; if there are more patterns then we expect each pattern to be longer and since the pattern length (== prefix length) is longer by Lemma 3.2 we expect less suffixes associated with that prefix. However, this is only a heuristic whereas checking if maxNumSuffixesForAnyPrefix <= threshold will guarantee that the algorithm will terminate without crashing.

I'm confused, the groupBy just reorganize data, not generate new data, why does excutor overload after shuffling ?
The following diagrams are from paper "Mining Sequential Patterns by Pattern-Growth: The PrefixSpan Approach":

Because the data may not be balanced across executors after shuffling. In
the worst case, imagine if all the data had a common key; then groupByKey
would try to collect the entire dataset onto one machine.
The diagrams you've cited show the number of frequent sequences (y-axis) of
length-k (x-axis) for various minSupports (legend), which is different than
the number of candidate suffixes associated to any given prefix.
On Thu, Jul 16, 2015 at 6:24 PM zhang jiajin<EMAIL_ADDRESS>wrote:

I'm confused, the groupBy just reorganize data, not generate new data, why
does excutor overload after shuffling ?
The following diagrams are from paper "Mining Sequential Patterns by
Pattern-Growth: The PrefixSpan Approach":
[image: image]
https://cloud.githubusercontent.com/assets/13159256/8738656/262676ec-2c65-11e5-9c7e-5e79e5a03b38.png
—
Reply to this email directly or view it on GitHub
https://github.com/apache/spark/pull/7412#issuecomment-122143351.

@feynmanliang
In the file "LocalPrefixSpan.scala", I have a question:
L48:       val newPrefixes = item :: prefixes
The elements in newPrefixes is reversed.
Why not :  val newPrefixes = prefixes :+ item
What's the different ?

List is singly-linked so :+ takes O(N) while :: takes O(1)

@feynmanliang  If the original prefix is "ABC" before calling LocalPrefixSpan.run. After calling LocalPrefixSpan.run, the prefix is "EDABC", reverse it, the prefix is "CBADE", but the correct prefix is "ABCDE", it's wrong.

This can be fixed by reversing the prefix before calling LocalPrefixSpan.run i.e.
      LocalPrefixSpan.run(minCount, maxPatternLength, prefix.toList.reverse, projDB)

Merged build triggered.

Merged build started.

Test build #37710 has started for   PR 7412 at commit d2250b7.

Test build #37710 has finished for   PR 7412 at commit d2250b7.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

@feynmanliang @mengxr I'm working on performance test, I compared the my first version, the performance has greatly improved. But the most recent update (add maxSuffixesBeforeLocalProcessing), the performance decrease very badly, please help me take a look at the code for the current, see how to optimize? Thank you!

Made some suggestions; see how perf changes after them. Unfortunately, scanning the dataset to ensure suffixes are bounded will introduce a performance hit. I still think it's worth it though since it's certainly better than just failin.
It may be worthwhile to test that these changes prevent executor failure due to overload. One way to do that would be to use a large enough dataset and set spark.akka.maxFrameSize small enough s.t. the first method fails but the latter method passes.

@feynmanliang About splitPrefixSuffixPairs,  I compared these two methods. I find your method's running time more than mine. And the result is not correct. I don't know why it was so, please check it, thank you.

@feynmanliang You are right, it is worth to prevent executor failure. I very much agree with it. And I tested it according to your suggestion.
The results of the performance test are not stable, I try to find out the reason, perhaps due to the environment, I will post it after solving this problem.

Merged build triggered.

Merged build started.

Test build #38502 has started for   PR 7412 at commit 64271b3.

Test build #38502 has finished for   PR 7412 at commit 64271b3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Merged build triggered.

Merged build started.

Test build #38791 has started for   PR 7412 at commit ad23aa9.

Test build #38791 has finished for   PR 7412 at commit ad23aa9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

@zhangjiajin @feynmanliang I made some minor comments. We can address the default value of maxLocalProjDBSize in a follow-up PR. To generate the final RDD, I would recommend using sc.parallel(localSmall, 1) ++ getPatternsInLocal instead of chaining multiple RDDs. Let's fix those and merge this PR, so we can unblock related PRs. Thanks!


Create Security-Guidance-and-Feedback-in-IDE.md

@Ambg05 if it is just copy and paste you can merge them. It is only for the cases when you make significant content changes that we should ask the original authors for comment


Raylib v5.5

Any news on supporting raylib v5.5?

Update this page if already ready:  https://github.com/raysan5/raylib/blob/master/BINDINGS.md

thanks for the heads up!

Thanks for xmas present!
John
On Wed, Dec 25, 2024 at 2:53 PM Antonis Geralis @.***>
wrote:

thanks for the heads up!
—
Reply to this email directly, view it on GitHub
https://github.com/planetis-m/naylib/issues/158#issuecomment-2561997730,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAFMJ55UWO42J47ZQM45M632HMLMRAVCNFSM6AAAAABUCGJPFCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNRRHE4TONZTGA
.
You are receiving this because you authored the thread.Message ID:
@.***>


Admin: Show error and retry for granting access to the wrong Github repo

Currently, if you call rill connect and grant access to the wrong repo in Github, the CLI will continue polling until it times out. We want to provide a better experience when granting access to the wrong repo.

[ ] Add a ?remote=https://github.com/... query parameter on /github/connect, and the store the result in the state parameter passed when redirecting to Github.
[ ] After Github redirects back, handle various cases

If granted access to the wrong repository, redirect to /github/connect/retry?remote=... and show a status message and button to retry. Example message: “It looks like you did not grant access the the desired repository at  https://github.com/account/repo. Click the button below to retry. (If this was intentional, press ctrl+c in the CLI to cancel the connect request)“. The CLI can continue polling until the user quits it.
If setup_action=request, we don't have access yet. Redirect to /github/connect/request?remote=... and show a status message

partially closed by #2003

We might need to rethink our current design of associating installation with a specific user to handle request action of app installation. The current design has following challenges:

On request of installation no installation ID is generated from github.
The actual installation ID is only generated when admin accepts the request and installs the app.
The installation callback can be from an unauthorised user as well if admin is not logged-in on rill. It may not be correct to redirect admin to login page as well.
Because of the limitations above it may not be possible to connect the user who requested the app installation with the final approved installation without doing some more bookkeeping.
Currently we assume that only the user who authorised the app installation is connecting the project to rill. This may not be the case always. Imagine a user just installs the app and doesn't complete the connect but another user wants to complete the rill connect. There could be also be cases when a user deletes the project but doesn't remove the app installation and some other user agains connects repo to a rill project.
The app could be installed on all the repositories as well.

The github doesn't seem to be handling the cases when app is already installed very well. The github page just shows a label signifying app is already installed and the update access button throws error if user doesn't have admin access essentially blocking the user.

Closed by https://github.com/rilldata/rill-developer/pull/2003


Geocoder returns incorrect location on Geocoder.search()

Hi.
My IP address is <IP_ADDRESS>.
Upon visiting http://whatismyipaddress.com/, I see that it CORRECTLY resolves my location to Austin, TX.
However, when I perform Geocoder.search("<IP_ADDRESS>"), it tells me that that IP address is in Kansas.
Why the discrepancy? Obviously, that is a quite a wrong location.
My code is as vanilla as could be:
Geocoder.search("<IP_ADDRESS>") is all I'm doing, and here is the full result:
[#<Geocoder::Result::Freegeoip:0x007fd5f976aa08 @data={"ip"=>"<IP_ADDRESS>", "country_code"=>"US", "country_name"=>"United States", "region_code"=>"", "region_name"=>"", "city"=>"", "zip_code"=>"", "time_zone"=>"", "latitude"=>38, "longitude"=>-97, "metro_code"=>0}, @cache_hit=nil>]
My actual IP addres coordinates are [30.2414 , -97.7687]

Note this: http://whatismyipaddress.com/geolocation-accuracy
Every geolocation service has different degrees of accuracy. The default IP geolocation service for Geocoder is FreeGeoIp which, as the name suggests, is free. If you want more accurate results you might need to use one of the non-free services.


Bug: markerStart and markerEnd are not picked up

Currently, there seems to be no way to add a marker symbol to edges. This is supported by React Flow, as can be seen here.
Tests conducted:
StreamlitFlowEdge(
                "4-5",
                "4",
                "5",
                animated=False,
                label="testlabel",
                marker_end={
                    "type": "MarkerType.Arrow",
                    "stroke": "#FFFF72",
                },
                markerEnd={
                    "type": "MarkerType.Arrow",
                    "stroke": "#FFFF72",
                },
)

Expected behavior:
The kwargs parameter should be passed correctly, which does not seem to be the case currently.
Observed behavior:
The markers do not appear in the UI
Explanation:
Potentially this is not accepted as a string?
Alternative Option:
Either marker_end (python style) or markerEnd could be added to support the marker symbols explicitly.

Hi @JonnyDaenen. Will include this in the next version!

anyway to make to make it fixed?


the bot stop playing the song after 1 minute

where u host the bot ?
replit / VPS ?

i host the bot in my pc
im using visual studio code

i host the bot in my pc
im using visual studio code

Please Contract In Our Support Server :- discord.gg/tbd


GithubRepositoryReader tests and minor fixes

Added test for GithubRepositoryReader and other parts of the code that GithubRepositoryReader uses additional to the GithubClient.
Also, there was a minor fix for directory file extension filter where it wasn't filtering properly.
I also tested in an isolated environment and I wasn't able to download the GithubRepositoryReader but it should be fixed by this PR https://github.com/jerryjliu/gpt_index/pull/574

@ahmetkca thanks for PR, will review soon!

@jerryjliu ca we revert this. The filter logic was not working properly. I think I fixed and added a better test for it.

@jerryjliu ca we revert this. The filter logic was not working properly. I think I fixed and added a better test for it.

sure! np

@ahmetkca  https://github.com/emptycrown/llama-hub/pull/100
let me know when you have the updated PR out, can add that in


Upgrade Salesforce API version to 53.0

Jira - https://cdap.atlassian.net/browse/PLUGIN-1002
This is to enable EndDate in Event table

Please cherrypick the fix to release/1.3 branch.


WebRTC connection fails

OS/Platform
macOS
Installed
OS/Platform's package manager
Version
117.0.5938.62
Have you tested that this is not an upstream issue or an issue with your configuration?

[X] I have tried reproducing this issue in Chrome and it could not be reproduced there
[X] I have tried reproducing this issue in vanilla Chromium and it could not be reproduced there
[ ] I have tried reproducing this issue in ungoogled-chromium with a new and empty profile using --user-data-dir command line argument and it could not be reproduced there

Description
Webrtc connection fails to connect
How to Reproduce?

Install Ungoogled Chromium by brew install --cask eloston-chromium
Try connecting with this webrtc example

click on start
click on call

Actual behaviour
It didnt get connect.
Expected behaviour
It should get connected
Relevant log output

Additional context
No response

2. Try connecting with any webrtc connection

Please provide more info on how to reproduce this issue.

Try connecting with any webrtc connection

Please provide more info on how to reproduce this issue.

Hey thanks for response, i have updated the issue let me know if you need more information.

Maybe we should mention this on the first run page.

Or in FAQ?

FAQ updated.


README Example Error

    RSAPublicKey publicKey = //Get the key instance
    RSAPrivateKey privateKey = //Get the key instance
    try {
        Algorithm algorithm = Algorithm.RSA256(publicKey, privateKey);
        String token = JWT.create()
            .withIssuer("auth0")
            .sign(algorithm);
    } catch (JWTCreationException exception){
        //Invalid Signing configuration / Couldn't convert Claims.
    }

The code snippet in Readme file has an error: The Algorithm contains just only one factory method, which is  public static Algorithm RSA256(RSAKey key) throws IllegalArgumentException ,to generate REA256 Algorithm

I use the 3.1.0 version
        <!-- Web Auth-->
        <dependency>
            <groupId>com.auth0</groupId>
            <artifactId>java-jwt</artifactId>
            <version>3.1.0</version>
        </dependency>
        <!-- end -->

In master we're preparing a release. Meanwhile, check https://github.com/auth0/java-jwt/tree/3.1.0


Add device handler for REST methods/status checking for devices

Opening PR for review now while I finish up documentation/json schema/minor tests.


Ajax request every minute

How I can make ajax request with user position every minute?

Android has been refactored.

plugin no longer handles http; calls js callback (just like ios)
much improved battery efficiency.
no more foreground service

http://christocracy.github.io/cordova-background-geolocation/


4k video processing dialog box - interupts upload

After this box is opened and when the code tries to navigate to publish next video, an alert is given by the browser and the whole process is getting interupted.

For now, I am doing this,
https://github.com/fawazahmed0/youtube-uploader/blob/e601c7f44a312d56be81a456ed0131c050342780/src/upload.ts#L99
I added a delay of 60 seconds before going back to the upload Url.
const delay = ms => new Promise(res => setTimeout(res, ms));
await delay(60000);
await page.goto(uploadURL);

The proper way should be to find out if the upload completes and navigate.


Login by name

I don't know if this has already been discussed anywhere here, but is there a reason why one has to login by email and not by name? Many tools use the same form field ("put in your name or your email address") which is much more convenient.

Yeah, There are a few reasons:

Having one system is easier to maintain (Especially since I bet people would then want this to be togglable).
Names in BookStack are non-unique, for display, whereas email addresses are unique.
Although convenient for some, multiple options can cause confusion for others.
Using email to login reinforces the fact that the account is tied to that email, in the event of needing to reset the password.

To be honest, I can't think of any platforms I use where you can use name to login. Many allow login via username or email but BookStack does not really store a username (Unless LDAP is in use).

I understand the reasoning here. But I'm a teacher and want to publish materials for them om my wiki. Just for them, not public, protected by a password. So I want to create a "student" account and have them login with the name "student" with a password.

I would like to bump this feature request.  For the home-user it would be very helpful, so I don't have to have the family have to remember multiple login methods for the local network services I have going, and they could just remember their one user-pass.

+1 for a simple username + password login.

Names in BookStack are non-unique

I hope display name can be unique. Some feature will need unique name.
For example, somebody need to notify the page editor JohnDoe, they might type @JohnDoe in comment. But if display name is not unique, notification can not be done. More then one person will be notified.

Names in BookStack are non-unique

I hope display name can be unique. Some feature will need unique name.
For example, somebody need to notify the page editor JohnDoe, they might type @JohnDoe in comment. But if display name is not unique, notification can not be done. More then one person will be notified.

I dont know @ssddanbrown `s plans here, but there are solutions in other tools, where you can have a unique username and a display name and you can use both to @mention someone

I dont know @ssddanbrown `s plans here, but there are solutions in other tools, where you can have a unique username and a display name and you can use both to @mention someone

I‘d like to see this, too.
Are there any workarounds to achieve that? I just want to host a simple wiki with predefined usernames and passwords which I give to my users, so there is no mail validity needed at all.
When using ldap there still is a need of an email address I guess?

I've published a hack to add this kind of functionality within the hacks site:
https://www.bookstackapp.com/hacks/username-login/
This can be used to essentially get what's been asked for here. The logic is quite simple so could be tweaked to your own requirements.
Otherwise, I'm going to close this off since it's not something I'd look to support an option for (And it would really need to be an option for forward-compatibility reasons), while being something I'm personally not fond of in terms of UX (At least when talking about dual-purpose email/username inputs), and since this has relatively low demand for a change to auth while having a possible workaround.


Updated ORDS docker image?

The highest version of ORDS that can be used to build the ORDS docker image is 18.3.0, while the latest available is 20.4.3. Will it be available an update of this image?

I have been trying for a few days to implement oracle/restdataservices:20.4.3 container with my database container oracle/database:18.4.0-xe.
These connect but what I get is:

URL
ERROR CODE
ERROR MESSAGE

http://localhost:8888/ords/    or   http://localhost:8888/ords/sql-developer/
404
The request could not be assigned to any database. Check if the request URL is correct and if the URLs to the database mappings have been configured correctly.

Same as @jfarcode is happening here, and ORDS 18.4 is no longer available for download, the oldest version available is 19.4.6, so unless I'm missing something there is no way we can make use of this container.
FYI I tried do use v20.4.3 by creating the Checksum.20.4.3 file with the checksum line, and as said it does return error 404 all the time:
b3855a4e68120d7eb49a2f7c8334a540  ords-<IP_ADDRESS>.1904.zip

I am facing the same problem with ORDS 21.1.1
a6afba1b823ee77a10c365f240a67812  ords-<IP_ADDRESS>.2032.zip

=> 404 Not Found
Please fix this or provide a download link for the last supported ORDS version (18.4.0)

any news when we can expect a update to a recent ORDS version?

I'll check with the team. We modified the build script that it would build any ORDS version when skipping the checksum check (via the -i option) but it sounds like other things have changed in ORDS that make the container no longer work.


Unable to read zone

Hello,
I've built Caddy with the dns cloudflare module, but when setup with the DNS challenge, I get the following issue:
caddy caddy[366]: {"level":"error","ts":1597289488.5149934,"logger":"tls.obtain","msg":"will retry","error":"[subdomain.example.com] Obtain: [subdomain.example.com] solving challenges: presenting for challenge: adding temporary record for zone co.: got error status: HTTP 403: [{Code:0 Message:Actor 'com.cloudflare.api.token.xxxxxxxxxxxxxxxxxxxxxx' requires permission 'com.cloudflare.api.account.zone.read' to list zones}] (ca=https://acme-v02.api.letsencrypt.org/directory)","attempt":1,"retrying_in":60,"elapsed":2.603871005,"max_duration":2592000}
I've tried all sorts of api token config and finally just made a token with access to all resources, but still getting this error. When Googling I can't find anything referencing the specific "com.cloudflare.api.account.zone.read".
I checked Cloudflares API resources and they note there is a 'Zone.Read' under 'Accounts' but it doesn't appear available in my Cloudflare API settings.
I'm not sure where to go from here?

Is this still happening with the latest version of Caddy (build from master) + certmagic + libdns/cloudflare?

I'm not very proficient with building like this, but I tried:
./xcaddy build \
	--with github.com/caddyserver/certmagic
	--with github.com/caddy-dns/cloudflare

Which I did previously but without certmagic.  I am getting a very similar error as above.
Renew: [xxxxxxxxxxxxxxxxxx.com] solving challenges: presenting for challenge: adding temporary record for zone xxxxxxxxxxxxxxxxxx.com.: got error status: HTTP 403: [{Code:0 Message:Actor 'com.cloudflare.api.token.xxxxxxxxxxxxxxxxxxx' requires permission 'com.cloudflare.api.account.zone.read' to list zones}] (order=https://acme-staging-v02.api.letsencrypt.org/acme/order/14871439/163013089) (ca=https://acme-staging-v02.api.letsencrypt.org/directory)", "attempt": 2, "retrying_in": 120, "elapsed": 61.82477189, "max_duration": 2592000}
FROM caddy:2.2.0-builder AS builder

RUN xcaddy build v2.2.0 \
	--with github.com/caddyserver/certmagic@latest \
    --with github.com/caddy-dns/cloudflare@latest

FROM caddy:2.2.0

COPY --from=builder /usr/bin/caddy /usr/bin/caddy

I've done some more tests using curl and have determined that it may be related to my usage of a subdomain which results in these issues.
This will fail
curl -X GET "https://api.cloudflare.com/client/v4/zones?name=SUBDOMAIN.DOMAIN.COM" -H "Content-Type:application/json" -H "Authorization: Bearer CLOUDFLARE_AUTH_TOKEN"
However, this passes.
curl -X GET "https://api.cloudflare.com/client/v4/zones?name=DOMAIN.COM" -H "Content-Type:application/json" -H "Authorization: Bearer CLOUDFLARE_AUTH_TOKEN"
Does the plugin send the request in the form of the first request? If it does, I would assume that is what causes it, and it should be listed as a potential bug.

Sorry about cluttering this issue. My issue here was definitely related to #3 / #13 caused by split brain dns which should have been resolved in caddyserver/caddy#2476. Removing the zone in my dns server resolved the issue, however, I also tried using the new resolvers directive in my caddyfile without any luck.
	tls {
		issuer acme {
			dns cloudflare {env.CLOUDFLARE_AUTH_TOKEN}
			resolvers <IP_ADDRESS>
		}
	}

@alexyao2015 So things are working for you, except if you specify the DNS resolvers in the Caddyfile? Does it adapt to JSON correctly? (run caddy adapt and verify output) -- would you be able to dig down and find out where the resolver logic is wrong?

This is what I get from caddy adapt, so it definitely does seem to be working. I'll do some further testing to see if I can figure out anything.
"tls": {
  "automation": {
    "policies": [
      {
        "subjects": [
          "SUBDOMAIN.example.com"
        ],
        "issuer": {
          "challenges": {
            "dns": {
              "provider": {
                "api_token": "TOKEN_HERE",
                "name": "cloudflare"
              },
              "resolvers": [
                "<IP_ADDRESS>"
              ]
            }
          },
          "module": "acme"
        }
      }
    ]
  }
}

@mholt
I've just simply decided to fix my dns configuration now that I understand what the problem is.
For future users, my issue was related to adding subdomain.example.com as a primary zone instead of using example.com as the primary zone in my dns configuration. It appears the plugin uses the primary zone when sending data to the api. Changing that configuration will allow split-brain dns to function properly with this plugin.

Thanks for the follow-up. Indeed, CertMagic's DNS utilities will look up the primary zone. Is there a better way to figure this out automatically? Here's the code: https://github.com/caddyserver/certmagic/blob/master/dnsutil.go
Improvements welcomed!

Is there a reason why it is not able to just able to simply split the string by . and get the last two values? Maybe I might be missing something, but I assume there are no root domains with two ..

@alexyao2015 You mean like .co.uk?

@mholt
I appear to be running into this same issue again... I now have my primary zone for my split DNS server as example.com, meaning that I have to replicate my entire DNS configuration in both my internal DNS and Cloudflare. This wouldn't an issue, however it seems that the plugin also uses the internal DNS server to check if the TXT record has been propagated, which it will never find because the internal DNS is separate from Cloudflare.
The only solution I can think of for this would be specify a different, external DNS resolver to be used for certificate issuance. It would still require the internal DNS to be used for the rest of the Caddy configuration, so simply changing the global resolver would not be of help.
Is there any chance you would consider this feature or does this feature already exist?

@alexyao2015 You can customize the resolvers here:

JSON ("resolvers" field): https://caddyserver.com/docs/json/apps/tls/automation/policies/issuer/acme/#challenges/dns/resolvers

Or, with the Caddyfile: https://caddyserver.com/docs/caddyfile/directives/tls#acme

is it possible to define the DNS directive in global options? it's very inconvenient to define it at every domain level

Not yet; the JSON config probably gives you greater flexibility there. But I think global DNS resolver settings has been discussed before.


tf.keras.applications.EfficientNetV2B0 does not work in channels_first mode

tf.keras.applications.EfficientNetV2B0 will not work in channels first because there are layers with a hardcoded data format in keras/applications/efficientnet_v2.py
Pull request for fix is here:
https://github.com/keras-team/keras/pull/18484

Fixed by https://github.com/keras-team/keras/pull/18484


Buffer Read/Writes to Stream

RSR currently uses a streaming interface to read and write data to the socket. This data is not buffered in any way. Each read or write request is an independent system call. This is problematic as it means that for most objects, there is a sequence of write commands which write 8 bytes on each call.
Instead, RSR should buffer these reads and writes. The #flush message is already sent once no additional data is available to write to the wire.

[At the risk of being Captain Obvious] ...
You probably should send intermediate flushes if the data is large enough.
e.g.
generate large response --- transmit large response --- process large response
yields a long delay before everything is done. Overlapping smaller chunks of generate/transmit/process will reduce the overall time needed for large enough messages.
I have no idea whether 16K, 64K, 256K, 1M, 16M or what makes for the best performance.

[At the risk of being Captain Obvious] ...
You probably should send intermediate flushes if the data is large enough.
e.g.
generate large response --- transmit large response --- process large response
yields a long delay before everything is done. Overlapping smaller chunks of generate/transmit/process will reduce the overall time needed for large enough messages.
I have no idea whether 16K, 64K, 256K, 1M, 16M or what makes for the best performance.

If data is beyond the size of the buffer, I suspect it will be written directly w/o buffering.

If data is beyond the size of the buffer, I suspect it will be written directly w/o buffering.

Refactored RsrStream hierarchy to remove previous experiments and to make SocketStream a subclass of (Rsr)Stream.
See 99d2ac732f115efb1f82c0bf52627860d88aeca7

Refactored RsrStream hierarchy to remove previous experiments and to make SocketStream a subclass of (Rsr)Stream.
See 99d2ac732f115efb1f82c0bf52627860d88aeca7

As of 41c9495191c44d9fdf176e929eb411ec8efcf688, writes are now buffered.
This does not use the implementation from martin-bufferedSockets. Instead, it uses the strategy of wrapping the SocketStream with an RsrBufferedStream. Past conversations with Martin suggest he would prefer this method.


#132912913 Fix conflict in head.jade

What does this PR do?
Fix conflict in jade file
Description of Task to be completed?
Remove conflicting code in jade.head file

wasn't this implemented in another branch? do we still need to merge this in @demiladebamgbose?


Policy processor refactoring + properly remove ACLs for removed pods

Coverage increased (+0.07%) to 76.889% when pulling a4d255c5fc35095568a2ec7db62a091b5e6f7fca on milanlenco:master into f104b8b8a74b49dd423a3a97bfb3d82424f10e09 on contiv:master.

Fixes dangling ACLs + 09-allow-traffic-only-to-a-port-number.md
Will re-check every test once again.


haproxy: 2.9.7 -> 3.0.1

Description of changes
Changelog: https://www.haproxy.org/download/3.0/src/CHANGELOG
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

There seems to be an issue with the tests, which succeed on hydra

How so? Tests pass just fine for me locally.
If my system is heavily loaded, they time out.

@ofborg build haproxy
@ofborg test haproxy

I'm getting the same error as in https://logs.ofborg.org/?key=nixos/nixpkgs.318848&attempt_id=77671499-f448-4233-a327-acbec774c521 locally. Possible relevant part of log:
vm-test-run-haproxy> client: must succeed: curl -f http://server/metrics
vm-test-run-haproxy> client #   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
vm-test-run-haproxy> client #                                  Dload  Upload   Total   Spent    Left  Speed
vm-test-run-haproxy> server # [    7.149350] haproxy[1035]: <IP_ADDRESS>:35780 [10/Jun/2024:23:10:47.073] http http/<PROMEX> 0/0/0/0/+0 200 +14761 - - LR-- 1/1/0/0/0 0/0 "GET /metrics HTTP/1.1" 0/-/-/-/0 -/-/-
vm-test-run-haproxy> server # [    7.243285] haproxy[1035]: segfault at 98 ip<PHONE_NUMBER>5b79a1 sp 00007ffd1704abf0 error 4 in haproxy[432000+284000] likely on CPU 0 (core 0, socket 0)
vm-test-run-haproxy> server # [    7.244545] Code: 81 ec 38 01 00 00 89 54 24 0c 64 48 8b 04 25 28 00 00 00 48 89 84 24 28 01 00 00 48 8b 46 08 48 89 0b 48 c7 43 08 08 00 00 00 <4c> 8b a8 98 00 00 00 31 c0 4d 85 ed 74 08 4c 89 ef e8 d9 ae e7 ff
vm-test-run-haproxy> server # [    7.176078] systemd[1]: Created slice Slice /system/systemd-coredump.
vm-test-run-haproxy> server # [    7.183208] systemd[1]: Started Process Core Dump (PID 1085/UID 0).
vm-test-run-haproxy> server # [    7.373852] systemd-coredump[1086]: Process 1035 (haproxy) of user 998 dumped core.

@pbsds I'm having a hard time trying to reproduce this - it just doesn't happen on my device and I cannot explain why!
The test suite runs in a loop and it has been working for more than 50 iterations!
I ran the build without the VMs and hammered the metrics endpoint yet no crash!
I've filed this as an issue on HAProxy itself as I doubt it is just a NixOS thing.
Feel free to chime in, especially if you can reproduce this repeatedly.

I'd love if the darwin builders could ignore nixos vm tests
@ofborg build hapoxy

https://github.com/ofborg build haproxy

@ofborg build haproxy


Tracking coords across grid operations

This is related to but an extension of issue #150.
I have upgraded and tried the new keep_coords=True option discussed in #150 but it appears to only work for 1D coords. I am using ROMS and have 1D, 2D, 3D, or 4D coords associated with variables depending on the variable. Is it in the purview of xgcm to consider tracking coords like xarray does? I consider this to be a big advantage of using xarray. I don't know the guts of xgcm, but I would guess that since the grid object tracks where variables are located on the staggered C grid, coords could similarly be tracked along grid operations like derivative.
Here is a screenshot of the xarray DataArray temp of temperature straight from the Dataset vs. after taking grid.derivative on it. Dimensions are appropriately updated after the operation, and 1D coordinates ocean_time and s_rho are preserved, but none of the other coordinates that are more than 1D. What I would ideally like is for the coordinates (lon/lat/z, etc) to be updated with their eta_v/xi_rho equivalents that are appropriate after the derivative is taken, which are available in the Dataset but would be tracked in the grid object like metrics, etc.

I can work up a min working example if this is something that is of interest for xgcm. Otherwise I will work on it in a package specifically for ROMS output. Thanks!

IMO we should fix this in xgcm and deprecate the keep_coords option. This code is working around an xarray inefficiency that I fixed a while ago.

@jbusecke I see, yes, adding the derived DataArray to the original Dataset does indeed so what I want. I have been returning DataArrays that are not aware of their Datasets, so this would present a problem. However, I just learned that the xgcm grid object secretly stores the dataset it is derived from (grid._ds)?! This is so handy! I have already committed to passing around the grid object in dataset attributes, so this means that I could indeed use the dataset from the grid object to pass off the coordinates to the new DataArray. Does there happen to be a function that you know of to do this?
I'm still interested in @dcherian's thoughts too...

Ooops, I totally misunderstood this issue. Sorry!
I was going off @rabernat's comment https://github.com/xgcm/xgcm/issues/150#issuecomment-532457417

Yes: for now this is intentional. Xgcm drops all non-dimension coords from the inputs immediately. This makes alignment of slices less error prone and expensive.

which should be fixed.
re your actual question: I don't see any better solution. What you want requires stored state (all non-dim coord variables), since xarray won't associate those lat_v, lon_u, ... coordinates with the original temp DataArray on lat_rho, lon_rho when you pull it out of the original Dataset. So we need to associate the Grid object with the DataArray somehow; either in attrs as in xroms; or some other accessor-with-state magic.

First I want to clarify that I did not at all mean to dismiss @dcherian s input previously (my wording did not quite reflect that, apologies). I just wanted to separate these two realated issues as clearly as possible.
@kthyng

I have already committed to passing around the grid object in dataset attributes, so this means that I could indeed use the dataset from the grid object to pass off the coordinates to the new DataArray. Does there happen to be a function that you know of to do this?

I do not think that this is part of xgcms current functionality, but I think this could be relatively easily achieved from xarray (possibly with xr.align? - @dcherian would know more about the xarray side of things). Since this has been requested multiple times I would be open to implement this.
@dcherian

What you want requires stored state (all non-dim coord variables), since xarray won't associate those lat_v, lon_u, ... coordinates with the original temp DataArray on lat_rho, lon_rho when you pull it out of the original Dataset

As @kthyng pointed out correctly, we do store the full dataset in the grid object as grid._ds. Does that make it easier to get this working? I am thinking we could just do an optional xr.align(output_da, grid._ds), or is that too naive?
I would really like to get @rabernat s take on this as well.

This isn't alignment (which is "getting things on the same grid").
Ah I see a solution on the xgcm side (sorry very dense this morning!):
for name, da in grid._ds.items():  # really self._ds.items()?
    if set(da.dims) <= set(result.dims):
        result.coords[name] = da

where result is the DataArray after diff operation for example:

@dcherian It certainly would be handy from my perspective to have xgcm manage the coords for me. It seems like xarray might have a function for doing this that it uses to decide which coordinates match DataArrays when added to a Dataset?

There isn't a function but this is the logic in xarray (the same as I typed up above)
https://github.com/pydata/xarray/blob/23dc2fc9f2785c348ff821bf2da61dfa2206d283/xarray/core/dataset.py#L1165-L1177
        needed_dims = set(variable.dims)

        coords: Dict[Hashable, Variable] = {}
        for k in self.coords:
            if set(self.variables[k].dims) <= needed_dims:
                coords[k] = self.variables[k]

        ...

        return DataArray(variable, coords, name=name, indexes=indexes, fastpath=True)

IMO this is a simple and easy fix in xgcm that should be done (@rabernat, @jbusecke  WDYT)

I think we should do it. I would prefer to have it enabled by a kwarg in the axis method (False by default to not break things for legacy applications).


docs: improve android things build documentation

Signed-off-by: Nicolas Oliver<EMAIL_ADDRESS>

Merged in https://github.com/intel-iot-devkit/mraa/commit/e7b51f3b668cfcb39a732daae8247a9bc34a135e


Implement use case number 4 for gRPC stdlib

Description:
$title

Planned to implement this example - https://github.com/grpc/grpc/tree/v1.43.2/examples/python/async_streaming

The gRPC side is completed in https://github.com/ballerina-platform/module-ballerina-grpc/pull/706. The exact implementation is blocked due to this issue - https://github.com/ballerina-platform/ballerina-lang/issues/35058


Add monthly_deaths_slovenia.csv to API

We would like to add CSV/JSON to API server:
https://github.com/sledilnik/data/blob/master/csv/monthly_deaths_slovenia.csv

@lukarenko you mind adding a timestamp as well?


Fixes issues with spaces et al. in $(PWD) during installation

I ran into some issues with my nvim share-folder being inside something like "$HOME/Dropbox (Personal)".
#99 might be related and if so should be fixed with this.

@zerok Thanks fir pull request🙌
Yeah, it might be failed build if your vimrc path has space.
I don’t tested yet, but it seems to LGTM. I’ll merge it.

Thank you :)


Block-scoped declarations (let, const, function, class) not yet supported outside strict mode

node -v
v4.4.7

should i use node v6 ?
let babelConfig = require('../package').babelConfig.server;
^^^
SyntaxError: Block-scoped declarations (let, const, function, class) not yet supported outside strict mode
at exports.runInThisContext (vm.js:53:16)
at Module._compile (module.js:373:25)
at Object.Module._extensions..js (module.js:416:10)
at Module.load (module.js:343:32)
at Function.Module._load (module.js:300:12)
at Function.Module.runMain (module.js:441:10)
at startup (node.js:139:18)
at node.js:968:3
[nodemon] app crashed - waiting for file changes before starting...

Just update node to the latest version (v6.3.1 is the current one), or maybe use "strict mode".

yes strict mode is better
most people are stay with 4

@crapthings why?

at lease work with 4
just clone and npm install

@crapthings I meant why "most people are stay with 4"?

maybe because it's LTS right now?

why not use just let or var ???
var path = require('path');

// To resolve shared folder during server development transpling
var sharedFolder = require('babel-resolver')(
  path.resolve(process.cwd(), 'app/shared')
);

let babelConfig = require('../package').babelConfig.server;
babelConfig = Object.assign(babelConfig, { resolveModuleSource: sharedFolder });

@crapthings ok, I will fix that.

@crapthings ok, you may try it.

great job
this boilerplate help me learn mobx better
+100

@crapthings thank you.


font family is different on index + sub pages

@tinabeans can you help clarify which one is correct?

It should be Open Sans regular everywhere.
On Sat, Apr 25, 2020 at 1:28 PM Nathanael Burt<EMAIL_ADDRESS>wrote:

@tinabeans https://github.com/tinabeans can you help clarify which one
is correct?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/findthemasks/findthemasks/issues/708, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAGBY3YWWKUOEZOLWN6YBSDROMMVPANCNFSM4MQ2V7QQ
.

--
Warmly,
Tina


remember zero point

Hello everybody, I've broken my head for days
I have a Pi3 with HX711
Meanwhile, I've got the balance as a service and loads the values sent via UDP.
Now I have only one problem the balance reset after each restart and that must not be.
Bottles are measured by weight. These bottles can not be taken off the balance every time the machine is restarted but must remain permanently on it.
#!/usr/bin/env python
import time
import sys
import os
import socket
from hx711 import HX711

def cleanAndExit():
    client.disconnect();
    print "Cleaning..."
    GPIO.cleanup()
    print "Bye!"
    sys.exit()

hx = HX711(27, 17)
hx.set_reading_format("LSB",)

hx.set_reference_unit(92)

hx.reset()
hx.tare()

UDP_IP = "<IP_ADDRESS>"
UDP_PORT = 1234

while True:
    try:
        val = hx.get_weight(5)
        print val

   val2 = str(val)
        MESSAGE = "GewichtGas="+ val2
   sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
   sock.sendto(MESSAGE, (UDP_IP, UDP_PORT))

        hx.power_down()
        hx.power_up()
        time.sleep(0.5)
    except (KeyboardInterrupt, SystemExit):
        cleanAndExit()

So, looks like you need your program to remember the tare, as far as I understand. I guess the hx.tare() method could both, return the tare value so you can store it in persistent memory and support a "manual" value such as hx.tare(value).
Let me know if that's what you're looking for. The code is context agnostic, so it won't persist the value for you if power is lost, that's up to you. However, with this modification, the code would support preset tare value.
Let me know!

Yes thats I looking for

I've just commited the change. I did not test it cause I don't have my stuff here with me. Let me know if you encounter any issues.

thank you so much I test it now

German and you?
i will try it I think maybe and then f.read?
val2 = str(val)
f = open('data.txt', 'w')
f.write(val2)
#f.close()

Spanish. Sorry, can't help you there, haha.
Saving information in a plain text file is not the most traditional approach but it should get the job done. You should probably do something similar to this:
Define a function to handle it:
def handle_tare():
    offset = None
    f = Path("./data.txt")
    if f.exists():
        try:
            offset = float(f.read())
            hx.set_offset(offset)
        except:
            offset = hx.tare()
            f.write(offset)

Then run your code normally, except you'll use handle_tare() where you had hx.tare(). I didn't test this at all and I simply don't know any Python. Sorry about that.

thank you
I did add it in hx711 and change hx.tare() to handle_tare()
but I get this error
Traceback (most recent call last):
File "./skl.py", line 8, in
from hx711 import HX711
File "/eseg/hx711.py", line 187
offset = None
^
IndentationError: expected an indented block
``

Can't help you from here. I just wanted to point you on the right path. Try checking the indentations but remember that the code I posted needs some work with the file handling.

ok that
have a nice day

Same to you and sorry for not being able to help you anymore.

every 15 min I get one Gramm lost.
I explain you
i startet the python script and get data 0 after 30 min without change anything is it -2 after some hours -68 .. .. .. ..

The same happens to me. I'm still not sure which one is being affected by temperature, the load cell or the HX711. In both cases, resistors play a role in the high sensitivity analog circuits, and resistors are pretty much heat dissipators. My guess is that the load cell is being affected the most.
After a while, it ends up reaching a relatively stable point.

i will let it run a few days and look how much it will get dow

What's the scale of your load cell?

in 1 till 20000 gramm

Does is look like this?

it that one https://www.amazon.de/gp/product/B0768CN3T9/ref=oh_aui_detailpage_o02_s00?ie=UTF8&psc=1

The error on those cells, which I also have, is in the order of +/- 0,05%. In 20.000 grams, that would be 10 grams. However, that's only the load cell's error. You need to add the HX711 error, which is quite more complicated to analyze and certainly increases the error margin.
If you want 1gr precision in 20kg, you'll need to buy a much much more expensive load cell and Amplified ADC (the green board with the HX711 microchip is an amplified ADC).

good to know about. the load cell
but I have the green one (board)

i will gone tomorrow snd let you know
thx

did you chance the code I can't find hx.tare()

now I got it I write to he file but aber restart it bin by 0 again
` import time
import RPi.GPIO as GPIO
import sys
import os
import socket
#import paho.mqtt.client as mqtt
from hx711 import HX711
def cleanAndExit():
print "Cleaning..."
GPIO.cleanup()
print "Bye!"
sys.exit()
def handle_tare():
offset = None
f = Path("data.txt")
if f.exists():
try:
offset = float(f.read())
hx.set_offset(offset)
except:
offset = hx.tare()
f.write(offset)
hx = HX711(27, 17)
hx.set_reading_format("LSB",)
hx.set_reference_unit(92)
hx.reset()
hx.tare()
hx.set_offset
UDP_IP = "<IP_ADDRESS>"
UDP_PORT = 1234
while True:
try:
val = hx.get_weight(5)
print val
val2 = str(val)
    MESSAGE = "GewichtGas="+ val2
sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
sock.sendto(MESSAGE, (UDP_IP, UDP_PORT))

val2 = str(val)
f = open('data.txt', 'w')
f.write(val2)
f.close()

    hx.power_down()
    hx.power_up()
    time.sleep(0.5)
except (KeyboardInterrupt, SystemExit):
    cleanAndExit() `

Hey man, two things.

The function "handle_tare()" which I've shared with you needs some work. It's wrong. It won't work.
You're not calling the function. According to your code you're doing:

hx.reset()
hx.tare()
hx.set_offset

Which should be:
hx.reset()
hx.handle_tare()

I can't properly program the function handle_tare() right now. Try asking for some help to a friend.

I'm closing the issue because it's not related to hx711py.


engine: allow to override opts at query time

This PR allows to override engine settings at query time by providing a custom QueryOption struct that implements the promql.QueryOpts interface and can be provided at runtime.
This prepares eventually overriding more options through this to allow controlling more behavior at query time ( i.e. optimizers, fallback; etc).

Maybe we should first create our own interface, and an adapter for the Prometheus engine. It looks like we are struggling to add features because we are coupled to the Prometheus interface.

Maybe we should first create our own interface, and an adapter for the Prometheus engine. It looks like we are struggling to add features because we are coupled to the Prometheus interface.

Will do


How to call Function by streaming？

I want to Use Streaming to Reduce zhe Response Time，But I don't see any examples about how to call Function by Streaming, Could you provide an example please？
### Tasks

@AdrianWangs Hello, do you have succesfull implemented Assistant Streaming with Beta Thread Run NewStream?? (I read Your code and found only Completion method implement)


Comparison Modularity

Allow  for comparisons other than correlation comparisons by creating an interface my modifying the CorrelateData util

This has been accomplished by the project https://github.com/WayScience/pairwise_compare


Docker version failing in Sonoma

I'm using:
ghcr.io/threeplanetssoftware/apple_cloud_notes_parser   latest    fe50bbef4d04   3 days ago      288MB

I'm getting:
/app/lib/AppleNotesEmbeddedDrawing.rb:102:in `get_media_filepath': undefined method `length' for nil:NilClass (NoMethodError)

    zgeneration = "#{@uuid}/#{zgeneration}/" if zgeneration.length > 0
                                                           ^^^^^^^
	from /app/lib/AppleNotesEmbeddedDrawing.rb:23:in `initialize'
	from /app/lib/AppleNotesEmbeddedObject.rb:420:in `new'
	from /app/lib/AppleNotesEmbeddedObject.rb:420:in `block (2 levels) in generate_embedded_objects'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:200:in `block (2 levels) in execute'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/resultset.rb:126:in `each'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:199:in `block in execute'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:154:in `prepare'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:194:in `execute'
	from /app/lib/AppleNotesEmbeddedObject.rb:308:in `block in generate_embedded_objects'
	from /app/lib/AppleNotesEmbeddedObject.rb:288:in `each'
	from /app/lib/AppleNotesEmbeddedObject.rb:288:in `generate_embedded_objects'
	from /app/lib/AppleNote.rb:181:in `replace_embedded_objects'
	from /app/lib/AppleNote.rb:141:in `initialize'
	from /app/lib/AppleNoteStore.rb:766:in `new'
	from /app/lib/AppleNoteStore.rb:766:in `block in rip_note'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:200:in `block (2 levels) in execute'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/resultset.rb:126:in `each'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:199:in `block in execute'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:154:in `prepare'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:194:in `execute'
	from /app/lib/AppleNoteStore.rb:756:in `rip_note'
	from /app/lib/AppleNoteStore.rb:650:in `block in rip_notes'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:200:in `block (2 levels) in execute'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/resultset.rb:126:in `each'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:199:in `block in execute'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:154:in `prepare'
	from /usr/local/bundle/gems/sqlite3-1.6.6/lib/sqlite3/database.rb:194:in `execute'
	from /app/lib/AppleNoteStore.rb:649:in `rip_notes'
	from /app/lib/AppleNoteStore.rb:216:in `rip_all_objects'
	from /app/lib/AppleBackup.rb:203:in `block in rip_notes'
	from /app/lib/AppleBackup.rb:200:in `each'
	from /app/lib/AppleBackup.rb:200:in `rip_notes'
	from notes_cloud_ripper.rb:194:in `<main>'

Thanks for flagging! I wish the release tag of "beta" would carry through to the images.
I just pushed a potential fix, can you try it from the repo itself before I cut a fresh release? It takes ~45 minutes for Github to build the new images.

I've pushed a fresh release as 0.14.1-beta. It should be available as the latest Docker image in about an hour.

Fixed, thank you!


Use 'Create File From Template' KW in 'Compile Inference Service YAML'

Replace the SED commands in 'Compile Inference Service YAML',
with the Common keyword 'Create File From Template'.
This removes the multiple call to external SED commands (i.e. multiple processes),
by invoking a single keyword to replace variables in the template: caikit_isvc.yaml

lgtm. Could we hold on merging this, though? It's an improvement we can have after the release.

lgtm. Could we hold on merging this, though? It's an improvement we can have after the release.

@bdattoma I guess we merge now,  1.32 release is out

lgtm. Could we hold on merging this, though? It's an improvement we can have after the release.

@bdattoma I guess we can merge now, 1.32 release is out

Could you please fix the conflicts and re-test? Because more test cases were added after this PR.

Verified after rebase.
The Yaml created for example on test Verify User Can Set Requests And Limits For A Model:
rhods-smoke/3403/artifact/ods-ci/ods_ci/tests/Resources/Files/llm/caikit_isvc_filled.yaml:

Verified after rebase. The Yaml created for example on test Verify User Can Set Requests And Limits For A Model: rhods-smoke/3403/artifact/ods-ci/ods_ci/tests/Resources/Files/llm/caikit_isvc_filled.yaml:

it doesn't look right, because the requests and limits are missing


Better tests

The tests in tests.py have not been changed for about 6 months and codecov depressingly says 41% coverage. One problem with testing is that on headless servers, window testing is not the easiest but the new EGL window provider should fix that (if I can make it find libEGL.so). Another problem is how to test if the rendering is correct, but I think that won't need to be included.

Gui submodule tests written
Scene tests fully written


chore: redo typo PR by stayweek

Thanks stayweek for https://github.com/AztecProtocol/aztec-packages/pull/6074. Our policy is to redo typo changes to dissuade metric farming. This is an automated script.

Benchmark results
No metrics with a significant change found.

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
772
772
772

l1_rollup_calldata_gas
6,832
6,832
6,784

l1_rollup_execution_gas
587,313
587,313
587,265

l2_block_processing_time_in_ms
1,486
5,458 (-1%)
10,325 (-1%)

l2_block_building_time_in_ms
19,597
76,300 (-1%)
152,095 (-1%)

l2_block_rollup_simulation_time_in_ms
19,387
75,538 (-1%)
150,614 (-1%)

l2_block_public_tx_process_time_in_ms
8,949
34,973 (-1%)
69,722 (-1%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
16,439 (-3%)
30,618 (-3%)

node_database_size_in_bytes
20,742,224
37,400,656 (-1%)

pxe_database_size_in_bytes
29,868
59,425

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
163 (-1%)
47,763
32,254

private-kernel-inner
186
81,070
32,254

private-kernel-ordering
174
58,008
49,589

base-parity
9.09 (-2%)
128
64.0

root-parity
101 (-3%)
27,064
64.0

base-rollup
11,982 (-1%)
111,202
957

root-rollup
60.1
11,518
821

public-kernel-app-logic
1,589 (-1%)
62,569
26,341

public-kernel-tail
4,480
168,842
3,953

merge-rollup
3,205 (+1%)
2,760
957

public-kernel-teardown
131 (-3%)
62,569
34,895

public-kernel-setup
147 (+4%)
62,569
34,895

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.9
17.7
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.7
31.8
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.637
0.546
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
52.0
79.9
260
499
981
1,933
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
95.9
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.533
0.494
0.474
0.467
0.466 (-1%)
0.463
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
60.4
120
377
735
1,474
2,923
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
105
208
692
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.533
0.539
0.514
0.506
0.510
0.510
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
66.7

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
108

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.587

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
51,687
537,196

Transaction size based on fee payment method

Metric
native fee payment method
fpc_public fee payment method
fpc_private fee payment method

tx_with_fee_size_in_bytes
897
1,145
1,345

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes
2 new note hashes

tx_pxe_processing_time_ms
1,283 (-1%)
918 (-1%)
3,554 (-1%)

Metric
1 public data writes
2 public data writes
3 public data writes
4 public data writes
5 public data writes
8 public data writes

tx_sequencer_processing_time_ms
884
789 (-1%)
1,429 (-1%)
928 (-1%)
2,203 (-1%)
1,109 (-1%)


zjobs: misc combine fixes

Fix compile issue when calling combine (at least for 0.10.0-dev.4249+11dce7894)
Add test for combine
Simplify combine implementation

Thanks for the PR. @garettbass could you please help with review?

Thanks for looking at this. Ille fix the pr tomorrow after work. The init is there to fix a bug in xog that triggers a compile error on the original inline initialization

I merged your changes into my repo, and made the changes I had suggested.  I will create a new PR from my repo with your commits and my additional changes

Superceded by PR-136

Superceded by PR-136

Should we close this one?

Yes!


Use encodeURIComponent() so that it supports the following characte…

Use encodeURIComponent() so that it supports the following characters: , / ? : @ & = + $ #
Tested and working
https://www.w3schools.com/jsref/jsref_encodeURIComponent.asp

Great, this works, please pull this request and update the plugin!

@jbcorreia Thanks


Detect both per-User & per-machine installations

By default Microsoft's OneDrive is installed per-user into folders like below:

C:\Users\{user-name}\AppData\Local\Microsoft\OneDrive\{version}\OneDriveSetup.exe

We want to detect and replace these with per-machine installations.
This is possible using arguments /silent /allusers which installs into a single folder like below:

C:\Program Files\Microsoft OneDrive\{version}\OneDriveSetup.exe

I have tried using FileExists with wildcards in the path as the "Is Installable" rules but it did not work:
<lar:And>
  <bar:Processor Architecture="9"/>
  <lar:Or>
    <lar:And>
      <bar:RegSzToVersion Key="HKEY_LOCAL_MACHINE" Subkey="SOFTWARE\Microsoft\OneDrive" Value="Version" Comparison="GreaterThan" Data="<IP_ADDRESS>"/>
      <bar:RegSzToVersion Key="HKEY_LOCAL_MACHINE" Subkey="SOFTWARE\Microsoft\OneDrive" Value="Version" Comparison="LessThan" Data="21.119.613.1"/>
    </lar:And>
    <bar:FileExists Path="C:\users\*\AppData\Local\Microsoft\OneDrive\*\OneDriveSetup.exe"/>
  </lar:Or>
</lar:And>

It does detect if previous per-machine versions are installed, but is does not detect per-user installations.
So my questions are:

Is there any way to detect if something has been installed per-user rather than per-machine?

When using the FileExists rule, can wildcards be used as shown like below?

C:\users\*\Admin\AppData\Local\Microsoft\OneDrive\

Hi tb-mtg, to my knowledge, the FileExists element doesn’t support wildcard characters. Managing per-user applications can be tough, especially since Windows 10.

In short (to answer your question):

as Wildcard is not supported.
Using "username" or anything else will not help either, as the install is run per system

In long (i dont understand your requirement to detect something in a user folder):
a)
In standard settings OneDrive installs in the users folders. But the install file is on  %progamFilesx86%\Microsoft OneDrive
So there is no need to detect something (file or version number) in any user folder, as OneDrive has an autoinstall to keep the software up to date as required. You should not overwrite the autoinstaller, as this will cause problems on a long run, if you dont update OneDrive on a regular basis.
If you want to make sure the computer is "ready" to have OneDrive for the next user setup use the path above to detect.
Beside this, the solution doesnt make sense as more user profile live on that computer. Think about certain TS.
Expections for very specific szenarios may apply.
b)
If you want to make sure a certain version is installed, join the corresponding update ring, using GPO:
https://support.microsoft.com/en-us/office/onedrive-release-notes-845dcf18-f921-435e-bf28-4e24b95e5fc0
c)
I would suggest to install as per machine. Using /silent /allusers (as stated above) will replace the user installtion.
For me, there is no reason to not do it so.
Taking about expections: Using a machine installer, will solve that problem, as it is easy to detect a file & version very easily. Keep in mind, that x64 and x32 installed as required per machine....

@johnripper1

In long (i dont understand your requirement to detect something in a user folder):

We want to replace per-user with per-machine installations, but only on machines that have installations in any user's folder.
So if a machine has no per-user installations detected at all - we do not need to install it per-machine on that device.

So if a machine has no per-user installations detected at all - we do not need to install it per-machine on that device.
Can I ask why?

@johnripper1 We only want replace the per-user installations with per-machine installations - not introduce new installations on machines where it is not used/required.

Sorry, this doesnt make sense to me.
Normally you should know the computer MS Teams should run on (either has been or could be). Then create a GPO and target it to these computer.
BTW: For me it seams to be more compliacted to seperate those computer MS Teams is installed from those not installed, instead of just rolling this out to all.

@johnripper1 I never mentioned MS Teams, I mentioned OneDrive.
Regardless of which application, OneDrive was just used as an example to see if it were possible to detect per-user installations.

As you said, the app doesnt make a difference.
I you cant achive this with WSUS out of the box. But maybe some script could make it. Detect all %user% folders and then search for the resp. exe/msi.


Trouble adding repository

Have clients sending data and everything's going into the data base there.
Thanks to the project members who've helped me, I now have OVAL definitions streaming into my database as well.
Having a bit of trouble getting my local repository added.
Tried using the same interface I used for adding OVAL data, system tried to add it as a source for CVE data. So, not quite what I was trying to accomplish.  Tried adding a repository definition to Repositories.xml and restarted my web server, just in case.  No change there.
From the command line I get:
php /var/www/pakiti3/lib/modules/cli/vds.php -c addSubSourceDef --sourceId 2 --subSourceId 1 --subSourceDefId 1 --defName RedHat --defUri http://server.example.com/yum/RedHat/
PHP Fatal error:  Call to a member function getName() on a non-object in /var/www/pakiti3/lib/modules/cli/vds.php on line 117
Line 117 looks like a fairly standard print statement, so I'm sort of stuck.

Hi tjones136,
Unfortunately there is no implemented support for repositories yet. Pakiti3 is now supporting just OVAL definitions from RH and DSA definitions from Debian.
Cheers,
Michal P.


Add AzCopy MacOS ARM64 Preview

#assign: @normesta
@normesta

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

#sign-off

commit

#110266


TrendMicro V1 Data Connector Filter Aggressive and Custom WB

Change(s):

filter aggressive and custom workbench
upgrade python to 3.9
add column_ifexists to sample query

Reason for Change(s):

filter aggressive and custom workbench
upgrade python to 3.9
Some column may not exists in Workbench, add column_ifexists for sample query (Solutions/Trend Micro Vision One/Analytic Rules/Create Incident for XDR Alerts.yaml)

Version Updated:

Yes. Analytic Rule template version: 1.0.4

Testing Completed:

Yes

Checked that the validations are passing and have addressed any issues that are present:

Yes

Hi @v-shukore, could you please let me know if you have any comments or updates?
Thanks.

Hi @V1ManagedServices,
Thanks for your patience as I was on emergency leave so not able to check on this.
Will check and update.

Hi @V1ManagedServices as you shared data connector logs could you please share the success function app invocations logs for the same so basis on that we can approve the changes mentioned in this PR.
Thanks..!!

Hi @v-shukore,
We have add a new filter to filter out new aggressive Workbench model and update new Zip file.
Here are the working images:
Data connector

Invocations & logs for each function:

Config

Digested Logs

Thanks.

Hi @V1ManagedServices Thanks for sharing the invocation logs with us its looks great. As we can see there is change analytic rule as well so need to repackage this solution.
Please repackage the solution to commit the changes using V3 tool please find below link.
https://github.com/Azure/Azure-Sentinel/blob/master/Tools/Create-Azure-Sentinel-Solution/V3/README.md
Thanks..!!

Hi @V1ManagedServices please update on above comment.
Thanks..!!

Hi @V1ManagedServices please update on above comment.
Thanks..!!

Hi, we have encounter some error during repackaging the solution.
I'll update once we have done, thanks!

Hi @V1ManagedServices please update on above comment.
Thanks..!!

Hi @v-shukore,
We have repackaged the solution by createSolutionV3.ps1.
Thanks!

Hi @V1ManagedServices
Thanks for the update will check it.

Hi @V1ManagedServices
Could you please resolve validations checks fails.
Thanks..!!

Hi @V1ManagedServices Could you please resolve validations checks fails. Thanks..!!

Hi @v-shukore,
We have encountered "IDs Should Be Derived From ResourceIDs" error.
The invalid Properties was generated by the script "createSolutionV3.ps1"
We'd like to ask should we modify the file "Package/mainTemplate.json" which is generated by executing the createSolutionV3.ps1?

Thanks.

Hi @V1ManagedServices Could you please resolve validations checks fails. Thanks..!!

Hi @v-shukore,
In addition, we would like to ask if there is a pre-release build for testing purposes in case the release has any errors?
Thanks.

Hi @V1ManagedServices,
You can upload the Package in partner center and publish
But don't push the solution to live
Below go live button, you will find preview links
You can use those links to test the content
Thanks..!!

Hi @V1ManagedServices, Hope this message finds you well.
Just want to check, did you get a chance to push the 3.0.0 solution live to get new release available in a Content Hub. I can still see the older version of solution which is 2.0.2 is available.
Please let us know if you have any question for us. Thanks!

Hi @V1ManagedServices, Hope this message finds you well. Just want to check, did you get a chance to push the 3.0.0 solution live to get new release available in a Content Hub. I can still see the older version of solution which is 2.0.2 is available. Please let us know if you have any question for us. Thanks!

Hi @v-shukore,
According to the document (https://github.com/Azure/Azure-Sentinel/blob/master/Tools/Create-Azure-Sentinel-Solution/V3/README.md), we've updated the Analytic Rule template version to 1.0.4 and generated the solution package using the createSolutionV3.ps1 script. This created a ZIP file named "3.0.0.zip" under the folder "Solutions/Trend Micro Vision One/Package". The validation for the package was also successful.
Our question is: Should we delete the older solutions or are there any additional steps required for publishing a solution?
Thanks.

Hii @V1ManagedServices, as you packaged this solution using V3 tool to 3.0.0 please publish this solution live to partner center. Please refer below steps to publish solution live which is version of 3.0.0.
https://github.com/Azure/Azure-Sentinel/blob/master/Solutions/README.md#step-3--publish-your-solution.
If you have any question, feel free to contact/reach to us.
Thanks...!!


Index Validation

Should this plugin prevent using negative values to be sent to the toIndex as well as values larger than the size of the array?
I'm not familiar enough with lodash to know if they put on data validations for this.

My initial reaction is that passing in bad values is a code smell outside this function.  But I'm up for discussion.


Error: "features": required field is not set

Need to update the document as we get error as
Error: "features": required field is not set
For new learners, we have tough time to follow this document as we are not able to create resource in Azure via Visual Studio code

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 14080c3b-027f-93e1-fd0f-4bea971f51b0
Version Independent ID: 5894d6ec-4347-153c-fa9a-203d41275153
Content: Configure the Azure Terraform Visual Studio Code extension
Content Source: articles/terraform/configure-vs-code-extension-for-terraform.md
Service: terraform
GitHub Login: @TomArcherMsft
Microsoft Alias: tarcher

@abhijeetuk Thank you for your feedback. I believe you're referring to steps to install/configure Terraform, right? If so, this content has been rewritten and published yesterday. Please let me know if you continue to encounter problems and I will investigate.


InvalidDataException while retrieving a list of saved searches for the specific app

I'm experiencing a problem using SDK v2.2.5 while retrieving a list of saved searches for the specific app. I've gone through your code and seems like this is happening right here.  A problematic name is different for different apps (for example: "action.customsearchbuilder.enabled", "action.slack.param.channel").
It is hard to say something about server version right now, but it should be quite old. But seems like on SDK v1.x everything was fine.
I'm not sure that this is your problem, but could you give any advice or workaround for such case?
Stack trace is always the same:
   at Splunk.Client.AtomEntry.<ParseDictionaryAsync>d__32.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()
at Splunk.Client.AtomEntry.d__34.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()    at Splunk.Client.AtomEntry.<ReadXmlAsync>d__29.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at Splunk.Client.AtomFeed.<ReadXmlAsync>d__40.MoveNext() --- End of stack trace from previous location where exception was thrown ---    at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)    at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)    at Splunk.Client.BaseEntity1.d__25.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult()    at Splunk.Client.EntityCollection2.d__12.MoveNext()`

I am also experiencing this exact bug. I have asked for a solution on answers.Splunk.
https://answers.splunk.com/answers/543752/why-does-savedsearchesgetornullasync-throw-excepti.html

This SDK is deprecated and no longer under active development.


Change 'Settings' to 'Settings file'

Since a lot of people have issues with what does the "Settings" button, maybe it's better to clarify it by temporarily changing it to "Settings file" or "Open settings file".

Or even better a settings window which provides the same options as editing the settings file. I disagree with changing the name though. "Settings file" or "Open settings file" is too wordy. Settings on its own keeps it simple

@theterminator3000, Yes of course, there will eventually be a settings window, such as users expect. But for a time it is not, it might be better to call the button after what it is actually doing i.e. opening settings file ( what apparently isn't what users expect, see issues like #1580 or #1664).

Hey guys \ girls,
This all sounds great, however I would like to add a request to Keep the "Settings File" in the long run too, even if you can't edit it from here.
I manage over 1000 machine and it would be very useful to be able to deploy setting to all of these so they terminals are reconfigured as required.
So for this reason long term I would like to request the ability to configure it by file or through the settings window.
Maybe the there could be an Import \ Export settings option too for those who aren't scripting everything but do want to be able to have a standard set of settings.
Probably already on your list but just in case.
*Keep up the good work, massive improvement on the current MS Terminal Already! :)
Thanks
Stuart.

I'm sure you're talking about #1567

No actuallky.
Personally the location does not fuss me as it would be scripted anyway, I just want to ensure that the settings remain in a fil we can easily edit and copy between machines in the long run.
As nice as a GUI is having both options is always better. :)

Then you probably mean #1564

We're not changing the name of the button right now for the interim state. It's an alpha product.
Our intent is to have a Settings UI and we will certainly make the file still accessible or more accessible than it is now per the linked issues by @JushBJJ.
Resolving.


Remember debug settings

Hi.
I was looking at ways to contibute on the browser extension since it such a nice tool and I have some experience with working on extensions. On the wish list is an item called "Remember debug settings across refreshes/closing". I thought this might be an easy way to get into working on the extension and a quality of life improvement for users.
I was thinking that a simple way to implement this would be to use the storage API for extensions. Have there been any other thoughts on this?

Awesome, this sounds like a great idea. I haven't attempted to save
settings yet so poking at the storage api seems like a good start.
On Sat, Dec 28, 2024, 6:49 PM Adam Due Hansen @.***>
wrote:

Hi.
I was looking at ways to contibute on the browser extension since it such
a nice tool and I have some experience with working on extensions. On the
wish list is an item called "Remember debug settings across
refreshes/closing". I thought this might be an easy way to get into working
on the extension and a quality of life improvement for users.
I was thinking that a simple way to implement this would be to use the
storage API for extensions. Have there been any other thoughts on this?
—
Reply to this email directly, view it on GitHub
https://github.com/excaliburjs/excalibur-extension/issues/8, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAEVNZYRZLKLOGEK3UVQTAL2H5BKHAVCNFSM6AAAAABUKIV7EWVHI2DSMVQWIX3LMV43ASLTON2WKOZSG43DEMBVGU4TGMY
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

All right. I will take a look at an implementation.

@eonarheim Is the default settings object declared like this
export const DefaultSettings: Settings = {
    showNames: true,
    showIds: false,
    showPos: false,
    showPosLabel: false,
    posColor: {r: 0, g: 0, b: 0, a: 1},
    showGraphicsBounds: false,
    graphicsBoundsColor: {r: 0, g: 0, b: 0, a: 1},
    showColliderBounds: false,
    colliderBoundsColor: {r: 0, g: 0, b: 0, a: 1},
    showGeometryBounds: false,
    geometryBoundsColor: {r: 0, g: 0, b: 0, a: 1}
}

because it is the default debug settings for Excalibur? And changing a boolean on the DefaultSettings object will have no effect on what values are actually used?
As I understand it the actual settings is read from the window.___EXCALIBUR_DEVTOOL.game.debug property during the "heartbeat" event? 🙂

@eonarheim Is the default settings object declared like this
export const DefaultSettings: Settings = {
    showNames: true,
    showIds: false,
    showPos: false,
    showPosLabel: false,
    posColor: {r: 0, g: 0, b: 0, a: 1},
    showGraphicsBounds: false,
    graphicsBoundsColor: {r: 0, g: 0, b: 0, a: 1},
    showColliderBounds: false,
    colliderBoundsColor: {r: 0, g: 0, b: 0, a: 1},
    showGeometryBounds: false,
    geometryBoundsColor: {r: 0, g: 0, b: 0, a: 1}
}

because it is the default debug settings for Excalibur? And changing a boolean on the DefaultSettings object will have no effect on what values are actually used?
As I understand it the actual settings is read from the window.___EXCALIBUR_DEVTOOL.game.debug property during the "heartbeat" event? 🙂

Good question, I needed to do a little research! You are correct I think the initial setting is actually hydrated from the running game https://github.com/excaliburjs/excalibur-extension/blob/main/src/background.js#L63
I think the only purpose of the DefaultSettings is to give the component defaults in cause of error so it renderers


Suggested (minor) changes to get firefly to compile on arm64 linux

Description
Some small changes are required to get firefly to successfully compile on arm64 linux. The solution is provided below for two files.
Motivation
This will enable firefly to work on arm64 linux machines like Raspberry Pi4, Jetson Nano and others.
Requirements
This fix will allow the wallet to compile without code modifications from the user or manual json commands.
Are you planning to do it yourself in a pull request?
No, there is already an open branch for it at ci-arm64. However here are all the changes required:
File: packages/desktop/package.json
+add one line below line 15:
"compile:linux-arm64": "electron-builder --linux --arm64",
File: packages/desktop/README.md
+edit line 56 to become:
Change win to your operating system - mac, win, linux or linux-arm64.

Thanks for this @ElrinV! We'll have a look into it.

Hey @ElrinV Are you still interested on adding support for arm64 Linux ? :v:

It has been quite some time since I have tried to compile it for the arm64 machine (AMD nano), and by now the proprietary AMD drivers for the machine is badly out of date. I'll have to check first if I can update the ubuntu install to something less ancient.


APEXMALHAR-2003 NPE in blockMetaDataIterator after recovery

https://github.com/apache/incubator-apex-malhar/pull/198


NTR symbiont-mediated host ribosome inactivation

For GO-PATHGO alignment PATHGO:0000030  mediates ribosome inactivation in another organism
@genegodbold  to provide references
Noting that we have 'related' viral terms: GO:0039604 suppression by virus of host translation

Bacterial

Shiga toxin subunit A (StxA) from Escherichia coli:  The catalytic Stx1 A subunit is noncovalently associated with 5 Stx1 B subunits [PMID:14638419]. The catalytic A subunit of Stx1 is an N-glycosidase and enzymatically inactivates ribosomes, preventing protein synthesis (translation) which eventually kills the cell. This is accomplished by depurination of an adenine residue at position 4324 on the 28S RNA of the 60S subunit [PMID:1324134]. The sole difference between Stx and Stx1 is a single amino acid in the A subunit of the protein [PMID:14638419]. The median lethal dose for the Shigatoxin in monkeys is about 1 ng/kg when administered intravenously. Guinea pigs and mice are approximately 1000 fold more resistant to the toxin [PMID:6806598].
Shiga toxin subunit A (StxA) from Shigella (multiple species): (same information)

Plants (obviously, these are not in a symbiont-host relationship)

Abrin from Abrus precatorius: The abrin B chain of 33 kDa is linked to the catalytic A chain of 30 kDa by a disulfide bond. The abrin B polypeptide is a lectin that binds to cell surface carbohydrates. This binding leads to internalization of the abrin complex through receptor-mediated endocytosis [PMID:29027937]. Abrin is a type II ribosome-inactivating protein. Abrin is an N-glycosidase that cuts the C-N bond of adenine at position 4324 on the 28S ribosomal RNA thereby disallowing elongation factors 1 and 2 from binding to the ribosome [PMID:29027937]. The median lethal dose (LD50) for abrin in humans is between 10 and 1000 micrograms per kg via ingestion and is 3.3 micrograms per kg if injected intravenously [PMID:19239732].
Volkensin from Adenia volkensii: Volkensin is taken up into HeLa cells though at lower levels than nigrin b and ricin [PMID:15289938]. The B chain of volkensin preferentially binds to sugars containing galactose. Volkensin is translated as a 523 residue protein that is later split into A and B chains. It is a type II ribosome-inactivating protein. The A chain consists of 250 residues, two cysteines, and inactivates yeast ribosomes via its RNA N-glycosidase activity. The B chain is 258 residues in length, contains 12 cysteines, and is nearly 50% identical to the B chain of ricin D. Based on the similarity to ricin, it is hypothesized that Cys245 of the A chain is linked to Cys4 of the B chain. The catalytic residues of the A chain appear conserved in volkensin relative to ricin with Tyr74, Tyr113, Glu162, and Arg165 involved in catalysis [PMID:14686924].
Diocin-2 from Phytolacca dioica: Diocin-2 is a type 1 ribosome-inactivating protein. It knicks dsDNA and has adenine polynucleotide glycosidase activity vs herring sperm ssDNA [PMID:18704492]. If it were able to get into eukaryotic cells it might be lethal, but it lacks the means of crossing the plasma membrane.
Ricin from Ricinus communis (Castor bean plant): Ricin is a type II ribosomal inhibitor protein (RIP). The toxin targets the 28S ribosomal RNA of eukaryotic cells. By cleaving an adenosine residue in an exposed loop it prevents the binding of elongation factor and inactivates the ribosome. The ricin A chain is catalytic and can completely inactivate 1500 ribosomes per minute, thereby disabling translation and killing the cell. The B chain of the ricin protein associates with the catalytic A chain through a disulfide bond. The B chain adheres to carbohydrate residues on eukaryotic cells. Following binding to a cell, ricin can enter via both receptor-mediated and adsorptive-mediated endocytosis. Ricin moves from early endosomes to the trans-Golgi network then undergoes retrograde vesicular transport through the Golgi. Ricin is then carried to the ER by calreticulin where the disulfide bond is reduced and the catalytic chain enters the cytosol via the Sec61p translocon. The unfolded A chain avoids ubiquitination because of its low lysine content and it refolds into its biologically active conformation [PMID:28722977].
Nigrin b (Sambucus nigra agglutinin V; SNAV) from Sambucus nigra (European elder): Nigrin b is a type II ribosome-inactivating protein consisting of two peptide chains linked by a disulfide bond. The B chain of nigrin b binds to GalNAc ligands and mediates endocytosis into mammalian cells [PMID:8647092].
Trichosanthin from Trichosanthes kirilowii: TCS is an RNA N-glycosidase, a type I ribosome-inactivating protein (RIP) that depurinates adenine-4324 of mammalian 28S rRNA. TCS can be cytotoxic at high levels but it cannot easily enter cells because it lacks a lectin entry domain like ricin. However it can apparently enter cells at a low level, perhaps through electrostatic interactions with cell membranes followed by endocytosis via clathrin-coated vesicles [PMID:30127254].
Mistletoe Lectin 1 (and 2 and 3 and 4) from Viscum album: The ribosomal inhibitor protein (type II), viscumin is cleaved into an A chain and a larger B chain linked by disulfide bonds. The A chain of viscumin inhibits translation by catalytically inactivating the ribosome [PMID:7142144]. The A chain of the mistletoe lectin inactivates the ribosomes by cleaving a N-glycosidic bond at A-4324 of 28 S rRNA in the ribosomes (similar to the A chain of ricin) [PMID:3360143]. The B chain lectin binds preferentially to galactose-containing glycolipids or glycoproteins on the surface of cells [PMID:16508080]. The median lethal dose (LD50) of purified viscumin for mice following intraperitoneal administration is ~5 micrograms/kg. Up to 40 mg of purified viscumin can be obtained from 100 grams of mistletoe leaves [PMID:6130311].

+[Term]
+id: GO:0141130
+name: symbiont-mediated inactivation of host ribosome
+namespace: biological_process
+def: "A process by which a symbiont inhibits or disrupts the normal execution of translation by the host cell by inactivating its ribosomes." [PMID:1324134]
+synonym: "symbiont-mediated host ribosome inactivation" EXACT []
+is_a: GO:0044074 ! negative regulation by symbiont of host translation
+property_value: term_tracker_item "https://github.com/geneontology/go-ontology/issues/26184" xsd:anyURI
+created_by: pg
+creation_date: 2023-12-14T12:22:56Z

How do you want to handle the plant toxins? 'ribosome inactivation in another organism?

Yes, I think that would be appropriate.


[daos] support DAOS

This change adds support of DAOS (https://docs.daos.io/) KV store to YCSB.

@busbey Any chance to merge this contribution upstream please? Thanks in advance.


Update @fingerprintjs/fingerprintjs-pro-spa Dependency

Updates @fingerprintjs/fingerprintjs-pro-spa dependency version identifier to ^1.3.2. It also updates the underlying @fingerprintjs/fingerprintjs-pro dependency to ^3.11.0.

Documentation changes (a940369 52bb0c1) will also be released along with this. Is this something we were expecting @TheUnderScorer @ilfa?


allow newer httpoison

@wrn14897 this is important. I'm getting this error.
Because hyperdx >= 0.1.5 depends on httpoison ~> 1.8 and your app depends on httpoison ~> 2.0, hyperdx >= 0.1.5 is forbidden.
So, because your app depends on hyperdx ~> 0.1.6, version solving failed.


if statements not working

Version Information:

uname -a :
Linux FrameWork 5.16.12-arch1-1 #1 SMP PREEMPT Wed, 02 Mar 2022 12:22:51 +0000 x86_64 GNU/Linux
swhkd -V :
swhkd 1.1.2

Describe the bug:
Commands with if statements don't run.
Expected behavior:
Command with if statements to work, like with sxhkd.
Actual behavior:
Commands don't run.
To Reproduce:
super+u
    dest="0";\
    [ "$dest" = "0" ] && notify-send "yay";
super+i
    dest="0";\
    if [ "$dest" = "0" ]; then; notify-send "yay"; fi;

With the above swhkd, super + u works but super + i doesn't. Both work with sxhkd.

Temporarily as a work around maybe you could try putting that in a she script and calling it

super+u
    dest="0";\
    [ "$dest" = "0" ] && notify-send "yay";
super+i
    dest="0";\
    if [ "$dest" = "0" ]; then; notify-send "yay"; fi;

I've tried executing the two of these commands in swhkd and the first one works, but the second one doesn't.
However, this one works:
super+i
    dest="0";\
    if [ "$dest" = "0" ]; then notify-send "yay"; fi;

@loiccoyle Seems like you added an unecessary semicolon after then in swhkdrc by accident, but didn't include it in sxhkdrc. Does the fixed command work now?


transcode: improve low-bitrate profiles bitrate slightly for better playback

When the input video's height or bitrate combo is too low to meet the ABR ladder, the low-bitrate profile is used in addition to the input video's profile to have some ABR during playback. The low-bitrate profile 1/3's the input video profile resulting in pretty low quality video. Increase this to be 75% of the input video's resolution so that playback still feels good without experiencing artifacts.
#fix https://github.com/livepeer/catalyst-api/issues/215

75% feels a little pointless if the video is already low quality though, maybe 50%?


Adding a splash screen

Type
I would like to add a splash screen to the web application.
Description
I know the Front end part is still left for the web app but i found this really cool GIF and wanted to use this for our
web application as a loading screen to give an end user immediate feedback that an application is starting and loading in the background.
Tools
Javascript
CSS
HTML
Have you read the Contributing Guidelines on Pull Requests?
yes

Please assign me this issue so that i can start working on it.
also we can change the color of the magnifying glass in the GIF above.

Looks good, you can change the color according to the approved UI

Closing this issue as it has been resolved for now.


Add a Preview composable function for ShareableCard

It is becoming an important component now. Therefore, we want to have the Preview, and we want to check it when we make changes.

I tried to do it :raised_hand_with_fingers_splayed:
If above pr is subtle, please close it :pray: :pray:


Injected version footer config

don't need a plugin to define, and can also access env vars without plugin. contains example of both

Bringing some feedback into the original PR, thanks though!


issue for az aks use-dev-spaces

i also meet the issue for i run '

[ ] az aks use-dev-spaces

-g mygroup -n mycluster' and it responds with '[K - Searching ..' what's the solution for it?

@JerryWang20, Thanks for the question! Could you please share the Azure doc URL on which the above document feedback requested was created?
In the interim, take a look at this sample:
https://docs.microsoft.com/en-us/cli/azure/aks?view=azure-cli-latest#examples
az aks use-dev-spaces --name
--resource-group
[--space]
[--subscription]
[--update]
[--yes]

i found the original issue come from the Azure-CLI, then i upgrade the Azure Cli to the lastest version of 2.0.63. But it still does not work but return a different error:
Downloaded to C:\Users\u587212\AppData\Local\Temp\tmpenn_0583\dev_spaces-1.0.0-py2.py3-none-any.whl
Validating the extension C:\Users\u587212\AppData\Local\Temp\tmpenn_0583\dev_spaces-1.0.0-py2.py3-none-any.whl
Invalid checksum for C:\Users\u587212\AppData\Local\Temp\tmpenn_0583\dev_spaces-1.0.0-py2.py3-none-any.whl. Expected 'd6
336308305746718893d4e88089b083ebb0f7f82e74f71c98bf40acbc804ccb', computed '2ddeb251c45d022f8bf5bb86a18fa69587cc759cbe623
c18067ba20da75cb6ce'.

@JerryWang20,  Thanks for the update! Could you please share a screenshot of the cmdlet and the error after concealing any private details?

@JerryWang20, Since we have not heard back from you we will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly reopen the issue and continue the discussion.


implement SQS QueueDoesNotExist error

Fixes #1251

Coverage decreased (-0.009%) to 92.469% when pulling 229d6a1b82778cd54522fae5d128bd7fbaf96d68 on JackDanger:jack/implement-sqs-queuedoesnotexist-error into 371bb2b824a7ace9d7a5d57689396ce500834613 on spulec:master.

Coverage decreased (-0.009%) to 92.48% when pulling dc40fce146d8bf22db4d68f4eb6bc655a58c9197 on JackDanger:jack/implement-sqs-queuedoesnotexist-error into de57abf63fdd34aebfc3af1443444a74afa3f1ea on spulec:master.