legends-of-equestria: init at 2024.01.02

Description of changes
Added the game Legends of Equestria, a free-to-play MMORPG. I only packaged it for linux-x86_64. The developer distributed the game for darwin-x86_64 and darwin-aarch64 as well, but I do not have a macOS device to test.
Closes #289692.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 296316 run on x86_64-darwin 1

@hugolgst I did not add darwin to supported platforms because the build process would be totally different from that on linux.

sorry mb didn't pay enough attention before running review

Result of nixpkgs-review pr 296316 run on x86_64-linux 1

1 package built:

legends-of-equestria

It seems to work but I'm not sure what our precedent for having packages downloaded from MEGA is, even more so considering their bandwidth limits.
I'd be more comfortable with a webarchive link or some other source.

I can upload the file to archive.org and use that link instead, but that would make it difficult to have a working update script because uploading files to archive.org requires credentials.

I can upload the file to archive.org and use that link instead, but that would make it difficult to have a working update script because uploading files to archive.org requires credentials.

Yes, however downloading from mega makes it unfeasible for a lot of people to use if they've already hit the MEGA bandwidth limit, which in turn would prevent them from using this package.
Uploading the file to a web archive is usually the standard procedure from what I know.
An update script is nice, but that isn't very helpful if a lot of people are unable to use the package.

I see the problem here. It is indeed correct that people that hit the free download quota will be unable to download the file (MEGA checks the quota based on the client's public IP address). However, I don't think the problem would appear on the end users' side. For people that are unable to download files from MEGA, they would not be able to download the software anyway with nixpkgs or not. This is because MEGA is the only official source of the software. For those who have a paid plan of MEGA and cannot download the file without their credentials, I think I may add somewhere for them to enter their MEGA credentials via override. Also, the free download quota of MEGA counts on a daily basis anyway, so they can just try downloading it again on the next day.
Where the problems may really appear is on continuous integration systems such as those of nixpkgs. The problem is currently unimportant because this is the first package that uses MEGA as a source. In the future, if there are many packages that require files from MEGA, a continuous integration system can easily hit the free download quota if it tries to download many large files from MEGA behind the same IP address. I think this issue needs more discussing.
Now, on using archive.org. I don't know whether it is appropriate to distribute an unfree software using a download link that is totally irrelevant to the official source. Most of the existing usage of archive.org in nixpkgs, as I see, is just a web archive for the official download link. This could be considered still an almost-official source because people generally agree that web archives on archive.org reliably save the same thing as what the web contents were originally. However, this consensus does not exist for user-uploaded contents on archive.org. A more acceptable alternative that I can think of is that I can put an archive.org link in the comment of the package for those who cannot download the necessary file from MEGA. They can manually download and extract the file and use a nix-store command to manually add it to nix store so that nix would not try to download from MEGA when building the package.
Then, on the update script. I admit that, for most cases, having an update script is not better than having a bunch of people not being able to use the package. However, I think this package can be considered a special case because it is an online game. It is important to keep an online game up-to-date because people cannot log in the game without an up-to-date client (at least this is the case for LoE). If they cannot log in, the package is just not different from being unusable. On the other hand, as I already argued, being unable to download files from MEGA is not quite a big problem for end users, so this does not make it preferable to sacrifice the update script.
Upon some additional thoughts, though, I think it is still possible to have an update script if I finally decide to use an archive.org link as the source. I may develop a GitHub action that periodically checks for updates. If there is an update, download the file using my MEGA credentials and upload the files to archive.org using my credentials. In the update script, read the result of the GitHub action. There are two issues that I may have to look up for this approach to work. The first is how large files can a GitHub action download and upload. The second is what is the appropriate way of reading GitHub action results in the update script (almost all the GitHub REST APIs require a token, but I surely cannot put my token in the update script).

I am trying to package for darwin, but the problem is that megacmd is not packaged for darwin. I tried to package that, but I failed with strange problems. I requested for its darwin support in #297586.


feat(Overview): refactor Rsdoctor Overview UI

Summary
Rsdoctor Overview UI refactor
Before:

After:

new pull request here https://github.com/web-infra-dev/rsdoctor/pull/650


Add cpdNamespace as a configuration parameter that must be set

Add cpdNamespace as a configuration parameter that must be set
Bump image to 0.5.2

Before this PR

After this PR

==COMMIT_MSG==
==COMMIT_MSG==
Possible downsides?

👍


Click to goto decleration

(Feature request!)  It would be wonderful if you could click on something with the cmd key held down and VSCode would navigate to the declaration of the symbol (just like it does for Typescript).

I am verbally +1 oning this one.
And if somebody can point me how to help to implement it, I would dedicate effort do it.
[never worked on VS Exts]

@popara I found an example that might help: https://github.com/Microsoft/vscode-go/blob/master/src/goDeclaration.ts#L156

Nice, now I get the idea where to start from! :)
Give me weekend or two and shall be done :)
On Mon, Nov 21, 2016 at 7:06 PM Gerald Kaszuba<EMAIL_ADDRESS>wrote:

@popara https://github.com/popara I found an example that might help:
https://github.com/Microsoft/vscode-go/blob/master/src/goDeclaration.ts#L156
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/sbrink/vscode-elm/issues/45#issuecomment-262018341,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAVBhmYdZEdO4q4W8wcULBBtUz3lEo85ks5rAd2QgaJpZM4H2bnv
.

Implemented in 0.13.0

Amd works like charm.
U rock!
<3


Join TDV

ThunderDataVerify is truly a honest email verification company.
I want to get you paid for work you do. I’m not greedy.
2 man project you and https://github.com/vodolaz095
https://thunderdataverify.com
Got 100k usd in servers I think you can use and I know passion is everything that’s what I have aswell. I don’t do it for $
You need a few dns servers etc.

I'm really not interested in joining or working with anyone right now. I have a full time job and like I've told you this is a just a side project


[PYTHON][WIP] pyspark schema.toDDL() and DataType.fromDDL(ddl)

What changes were proposed in this pull request?
Add a pyspark equivalent to schema.toDDL
Why are the changes needed?
Spark in Scala has a schema.toDDL method, but pyspark lacks an analog.
Does this PR introduce any user-facing change?
Yes.  This change adds DataType.toDDL and DataType.fromDDL to pyspark, matching
the equivalent methods in core Spark.
How was this patch tested?
pyspark/sql/tests/test_types.py now has test_to_ddl()

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Can you file a JIRA please?
Also, please show examples of this new APIs in "Does this PR introduce any user-facing change?".

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Closing this due to inactivity here.


Forking an empty repo results in 500 error

Gogs:  <IP_ADDRESS>5 Beta
Steps to reproduce:

Create new repo in an organization
Fork said empty repo
Bam, 500 error.

Error in gog.log:
2015/04/15 01:14:14 [repo.go:330 funcÂ·008()] [E] GetBranches:
Was preparing a repo, wanted to push my code to my fork then pull request into the org. Not sure if this workflow makes sense, but either way should be handled better than a 500 error. I can see the empty repo fine on the organization though.

I have the issue too.

+1

how i delete my forked repo with this error 500 ?

+1. I have same question!

Hmm... hi @StrangeWill by

Create new repo in an organization

Is this repository is empty when creation?
Because bare seems no button/UI lets you fork on it?

@Unknwon Click on "settings", the UI element to fork will be rendered and you can fork from there.

@StrangeWill this helps, thanks!

Right now Gogs disallow you fork a bare repo. You can test on https://try.gogs.io

Attempted to hard-fork by going to https://try.gogs.io/repo/fork/[Repo ID] and I get a 404, awesome.

Thanks your confirmation!


Create postman tests coverage: International payment funds confirmation

Description

[x] Add the proper requests on postman collections to tests the get international payment funds confirmation

Acceptance criteria

[x] All current postman tests pass.
[x] The International payment funds confirmation request tests pass.

Hey team! Please add your planning poker estimate with ZenHub @andra-racovita @mariantiris

Reopened because the route for funds confirmation doesn't intercept the proper request because the pattern of payment consent match first in the Ig sequence.

Te international payment consent route 45 is executed instead of the funds confirmation route 48.

Add to route 45 condition the pattern .*(?<!/funds-confirmation)$ at the end to ignore the request for funds-confirmation API


📋 [TASK] - Gen-Plugin Leverages Multiple Definition Sources Correctly

Parent Feature
#433
Task Description
As an AaC Developer, I want Gen-Plugin to leverage multiple definition sources, so that all contributed definitions are properly exposed within the Active Context.
Acceptance Criteria

[ ] Confirm definition sources in the plugin model are used to generate definition boilerplate contribution points to expose those additional definitions via Active Context
[ ] Update unit test for Gen-Plugin to ensure definitions from all definition sources are included
[ ] Update documentation to explain multiple definition source contribution

Unresolved questions
No response

Reshuffled tasking around, so this issue is no longer needed.

This was covered in the #714 effort, so can be closed out.


Error when genrating music

I tryed to run it a few times but it keeps saying error. i did install pytorch with cuda

OS Name	Microsoft Windows 11 Pro
Version	10.0.22621 Build 22621
Processor	AMD Ryzen 9 5900X 12-Core Processor, 4301 Mhz, 12 Core(s), 24 Logical Processor(s)
Installed Physical Memory (RAM)	64.0 GB
Name	NVIDIA GeForce RTX 3090 Ti
Adapter RAM	(1,048,576) bytes
Driver Version	<IP_ADDRESS>42

What repo are you using? because it does not look like AudioCraft Plus

ah i think i know i didn't turn on dev mode  in windows

yeah no it didn't work im worried my GPU isn't good enough

i found out that my gpu wasnt used at all but my cpu went up to 50%


Get path of original file

When requesting a page in the browser, I get an error that looks like this:
/var/folders/9g/ty77r71s6c7g7lbcry0qhg700000gn/T/typescript-node20150528-50625-3fwnnp.ts(108,102): error TS2094: The property 'pss' does not exist on value of type 'Window'.

Is there any way to set this up so that the path of the error is the actual source file (that is, the my_code.ts file)?
Thanks!

@bdrazhzhov In compile.rb, if you could pass ts_path to the Node Compiler, you could then append the filepath to the end of the error message. I don't know if this is the best way, thats why I didn't make a pull request, but thats how I have it going right now

I changed output for typescript-node gem when TS compilation error occurs. This output has more information about errors (including original file path). Try it please, it may help.

Strange, I'm running 1.4.1 of that gem and I see
/var/folders/yg/6_7zwgh545xgcz2qd6lpzlyw0000gn/T/typescript-node20150714-5421-14e3265.ts(25,13): error TS1005: ',' expected.

I've added this feature in v0.6.1. Now it prints something like following:
Compilation error in file '/path/to/file_with_error.ts':
/var/folders/yg/6_7zwgh545xgcz2qd6lpzlyw0000gn/T/typescript-node20150714-5421-14e3265.ts(14,14): error TS1005: ':' expected.
Please try it.

 Thanks


Automated cherry pick of #2087: aliyun&huawei redis sync support

Cherry pick of #2087 on release/2.11.
#2087: aliyun&huawei redis sync support

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.11@a99a38a). Click here to learn what that means.
The diff coverage is 8.06%.

@@              Coverage Diff               @@
##             release/2.11   #2088   +/-   ##
==============================================
  Coverage                ?   7.19%
==============================================
  Files                   ?     451
  Lines                   ?   69934
  Branches                ?       0
==============================================
  Hits                    ?    5030
  Misses                  ?   64492
  Partials                ?     412

Flag
Coverage Δ

#aFlag
7.19% <8.06%> (?)

Impacted Files
Coverage Δ

pkg/cloudcommon/db/opslog.go
2.66% <ø> (ø)

pkg/compute/models/cloudsyncelasticcache.go
0% <0%> (ø)

pkg/compute/models/cloudsync.go
0% <0%> (ø)

pkg/compute/models/loadbalanceracls.go
3.94% <0%> (ø)

pkg/compute/models/skus.go
1.4% <0%> (ø)

pkg/compute/models/cloudregions.go
2.11% <0%> (ø)

pkg/compute/models/elasticcache_parameters.go
11.39% <11.39%> (ø)

pkg/compute/models/elasticcache_backups.go
11.39% <11.39%> (ø)

pkg/compute/models/elasticcache_accounts.go
12% <12%> (ø)

pkg/compute/models/elasticcache_acls.go
12.67% <12.67%> (ø)

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a99a38a...b134593. Read the comment docs.

/lgtm

/approve


Sql Metric Expression which uses % has % duped in tableView query

I created a sql metric with the expression:
CAST(strftime("%s", max("timestamp")) AS INT)

When I used this metric to create a table view the values were not being populated. Looking into the JSON I found the query had duplicated the %:
query: "SELECT "serviceName" AS "serviceName", CAST(strftime("%%s", max("timestamp")) AS INT)
 AS latest_date FROM "testResults" WHERE timestamp >= '2016-03-29 15:57:43.000000' AND timestamp <= '2016-04-05 15:57:43.000000' GROUP BY "serviceName" ORDER BY
CAST(strftime("%%s", max("timestamp")) AS INT) DESC LIMIT 50000 OFFSET 0"

Current end result is this column ends up displaying a 0 for each entry

Does it need escaping? It's weird it's returning the quote marks unescaped too.

I did try escaping around the % and the " characters surrounding the %s but I'm still getting the % duplicated.
query: "SELECT CAST(strftime("/_%%s", max("timestamp")) AS INT) AS latest_date FROM "testResults" WHERE timestamp >= '2016-03-30 08:36:01.000000' AND timestamp <= '2016-04-06 08:36:01.000000' LIMIT 50000 OFFSET 0"

query: "SELECT CAST(strftime("\%%s", max("timestamp")) AS INT) AS latest_date FROM "testResults" WHERE timestamp >= '2016-03-30 08:36:01.000000' AND timestamp <= '2016-04-06 08:36:01.000000' LIMIT 50000 OFFSET 0"

Have you tried doubling the % as in %%? I think we had this bug before but forgot about the details/workaround.

Also which DB / sqlalchemy dialect are you using?

Have you tried doubling the % as in %%? I think we had this bug before but forgot about the details/workaround.

I'll give that a shot.

Also which DB / sqlalchemy dialect are you using?

I'm using sqllite3.

Have you tried doubling the % as in %%? I think we had this bug before but forgot about the details/workaround.

I'll give that a shot.

It appears to make more % characters
query: "SELECT "serviceName" AS "serviceName", CAST(strftime("%%%%s", max("timestamp")) AS INT) AS latest_date FROM "testResults" WHERE timestamp >= '2016-03-31 11:20:59.000000' AND timestamp <= '2016-04-07 11:20:59.000000' GROUP BY "serviceName" ORDER BY CAST(strftime("%%%%s", max("timestamp")) AS INT) DESC LIMIT 50000 OFFSET 0"

Is there a workaround for this problem?

This seems refers to a SQLAlchemy bug, which should be fixed in v1.2. It's patched for DateTimes in models.py :Patch for sqlalchemy bug
Bug ref: https://bitbucket.org/zzzeek/sqlalchemy/issues/3740/clean-up-doubling-of-percent-signs-base-on

in #2330 I started doubling the % in the WHERE clause and in the new LIKE clause of filters.


Fix --help

This PR fixes the --help command per @sebmck's comment on #214 (It seems like https://github.com/facebookexperimental/rome/pull/214 might be stuck, given it hasn't been updated in 15 days)
This fixes the command both for global help (e.g. rome --help) and command-specific help (e.g. rome ci --help)

Thank you!


tailwindcss ignored from Trunk.toml

The variable tailwindcss is ignored from [tools] section in Trunk.toml
I will open a PR for that

Any update ?


conglobing, delthyria (logical-conflict)

This pull request was generated by the 'mq' tool

/trunk merge


Support APPROX_PERCENTILE

APPROX_PERCENTILE is supported in Presto, SingleStore, Redis, Snowflake, Vertica, Databricks, TiDB ........
It is supposed to run much faster than its exact equivalents, i.e. PERCENTILE_CONT and PERCENTILE_DISC, which RW has supported. So it is suggested to be used when the dataset is large.
It is typically implemented by the t-digest algorithm.
There is an existing implementation at: https://github.com/MnO2/t-digest
And also a modified version in https://github.com/apache/arrow-datafusion/blob/main/datafusion/physical-expr/src/aggregate/tdigest.rs.
In essence, by quoting the results from its paper :

The new algorithm described here, the t-digest, provides constant memory bounds and constant relative accuracy while operating in a strictly on-line fashion.

This is used in one user's PoC. PERCENTILE_CONT and PERCENTILE_DISC can be the workaround, but the data size is said to be really large.

Is it possible to maintain it incrementally? We have approx_count_distinct() but it seems a little bit heavy to maintain the state

Is it possible to maintain it incrementally? We have approx_count_distinct() but it seems a little bit heavy to maintain the state

Per my understanding, it is cheap to maintain.
The main logic is this part: https://github.com/MnO2/t-digest/blob/master/src/lib.rs#L226-L306
Correct me if I am wrong, try to summarize:

we have a t-digest already (from the last computation). The size of the t-digest can be freely configured, the larger, the more accurate. For example, we set the size to 100. Then a t-digest contains 100 centroids. The major task of this algorithm is to do data clustering to find such 100 centroids.
we have N new values coming from upstream. We need to first sort N values. And then it is a merge-sort-like procedure. aka O(NlogN + N + 100) to find the new 100 centroids. The details are complicated in terms of how centroids are found.

And for the streaming version, I think we can additionally provide a function interface without specifying the percentile number because the maintenance of 100 centroids is irrelevant to the percentile in the query.
e.g. create materialized view mv as select approx_percentile(column1) as p1 from t
And only when we use the batch query, we specify it as select approx_percentile(p1, 0.95) from mv to get it.
This way, it is more general and I think there is no extra cost.

e.g. create materialized view mv as select approx_percentile(column1) as p1 from t
And only when we use the batch query, we specify it as select approx_percentile(p1, 0.95) from mv to get it.
This way, it is more general and I think there is no extra cost.

I think it also applies to the two exact equivalents, isn't it?
PERCENTILE_CONT and PERCENTILE_DISC are going to keep all the data anyway, so which percentile, e.g. 90% or 99% can be determined when we use the batch query.

There is another way of doing approximated percentile: https://materialize.com/docs/transform-data/patterns/percentiles/
it can be computed without adding specific statistics functions.
But it requires cross self-join

This is a prerequisite for the streaming version: https://github.com/risingwavelabs/risingwave/issues/11909.
Additionally we have the following constraints:

The tdigest algorithm used for streaming approx_percentile supports only incremental updates to it. Which means:

Either the stream has to be append only
Or we can ignore deletes and updates.

Alternatively, we can also support it being computed ad-hoc in batch mode.

Do we consider the HDR version?

Do we consider the HDR version?

It has potential to be pretty fast if we sacrifice precision.
Let me just recap on the HDR version:

HDR basically drops precision of the input.
The lower the precision, the less buckets we have to maintain.
We have to do streaming nested loop join for each record which comes in, but it is bounded by the number of buckets we have.

With a precision of 2, I have ingested 1M rows in under 3minutes.
But anymore then that it drops to a crawl. We probably have to manage large states as well.
Perhaps we can let user try it first, see if it satisfies their requirements.

Much faster approach is demonstrated here: https://github.com/risingwavelabs/risingwave/pull/11931.
What's left is to wrap it as a series of sql functions / a single sql function for usability.

Much faster approach is demonstrated here: #11931.
What's left is to wrap it as a series of sql functions / a single sql function for usability.

3 options in decreasing generality are stated here, each with different trade-offs: https://github.com/risingwavelabs/risingwave/blob/729ed66ff01acf0b93960ad2e5db3b78f3494175/hdr_approx_in_one.sql

Not urgently required anymore. But the functionality is described above: https://github.com/risingwavelabs/risingwave/blob/729ed66ff01acf0b93960ad2e5db3b78f3494175/hdr_approx_in_one.sql

Sorry if offtopic, just wanted to also reference UDDSketch (Paper) here.
Based on DDSketch (Paper)
More on UDDSketch vs t-digest at https://docs.timescale.com/use-timescale/latest/hyperfunctions/percentile-approx/advanced-agg/ (no affiliation with me).
I don't have experience using any of those, but I would be interested consumer.

I also take a look at timescale. I found that the UDDSketch can support two-phase aggregation. Do our current implementation support that?

Do our current implementation support that?

I think so, our current hdr_approx (https://github.com/risingwavelabs/risingwave/blob/729ed66ff01acf0b93960ad2e5db3b78f3494175/hdr_approx_in_one.sql)  version does not require any new/special functions. Only max, sum, and count are used.
Therefore, any aggregation in it can be done by two-phase aggregation,
but whether it brings better performance is another story.

Something to add is we use HDR (High Dynamic Range) for the approx percentile rather than t-digest currently.
Reason being the t-digest algorithm works for append-only streams, whereas HDR supports updatable streams, and we can already use that approach (albeit with some user-facing complexity, since user needs to compose various queries together to achieve it).
t-digest and UDDSketch could indeed be supported as well, as an optimization.

I just learned the HDR Histogram algorithm from https://github.com/risingwavelabs/risingwave/pull/11931/files, and I think this method doesn't seem to be more brilliant than the naive histogram algorithm built with exponential buckets.
The key of making it "HDR" (or high-precision) is using more buckets. In the example of #11931, it uses 6 (exponent) * 100 (mantissa) = 600 buckets in total. With these many buckets, exponential buckets will achieve better results. Why better? Because exponential is a better division of the whole sample space than HDR's approach.
Illustration of HDR Histogram's bucket:

||||||  |  |  |  |         |         |         |         |
----------------------------------------------------------->
0    10          100                                    1000

Illustration of naive histogram's bucket:
||| | |  |  |   |   |    |    |     |      |       |      |
----------------------------------------------------------->
0    10          100                                    1000

The principal idea is a mix of the exponential and linear histograms to support a dynamic range precision that is appropriate to the time unit scale.

setting the precision to 0 and then the naive histogram becomes a special case of HDR histogram, i.e. getting rid of the linear histograms part

it uses 6 (exponent) * 100 (mantissa) = 600 buckets in total.

if it is referring to the numbers here: https://github.com/risingwavelabs/risingwave/pull/11931/files#diff-518c64863b11adf8976a4d4cd78cc3b4129650a2990530526fb21d9e9e55f98cR66-R75,
it seems that
4 (4 ranges inserted)
*
10 (each range takes 10 buckets e.g 1100/1000-1=0.1 and then 0.1*10^2 (2 as the precision) =10)
= 40 buckets are used, i.e. have a non-zero count.
Both can be offered, e.g. with different names.
I saw Datadog created a new proprietary algorithm DDSketch to replace HDR histogram, and compared the new one only with HDR histogram in its blog: https://www.datadoghq.com/blog/engineering/computing-accurate-percentiles-with-ddsketch/. I assume Datadog knows better in this aspect and treated HDR histogram as SOTA before coming up with DDSketch.

@lmatz Today a user asked this in community channel. IIRC, this requirement has already been requested by users for multiple times. Shall we work it out? cc. @kwannoel We can reassign to another one if you don't have bandwidth.

@lmatz Today a user asked this in community channel. IIRC, this requirement has already been requested by users for multiple times. Shall we work it out? cc. @kwannoel We can reassign to another one if you don't have bandwidth.

Hi Eric, could you find someone else to work on it first if it's urgent? I don't have bandwidth for this at the moment.

Related: https://github.com/risingwavelabs/risingwave/issues/12857

https://github.com/risingwavelabs/risingwave/issues/17531


Workarounds for Websites Discouraging Automation - depends on website

I've been following the thread #660  with some interest. Although #660 is specific to Google (Gmail?), I was wondering how common it was for websites to implement features to prevent/discourage browser automation?
In one flow that I use, I noticed that (a click step) on a button on the website recently stopped working when using the default (PhantomJS) mode. It works however when using the visible Chrome option. I've not tried Headless mode yet.
I'm unable to show this here as the website is a closed members only site... but it "feels" as though the website is determining the browser type (via user agent) and modifying its behaviour. (Then again I can't rule out the possibility that there are other reasons.)
If this (prevention of automated browsers) is a common occurrence, I was wondering whether it would be helpful to have a list of similar issues, possible causes, and workarounds.
In my particular case, switching to visible Chrome mode was a workaround of sorts but it slowed down the operation of the flow significantly. (I would imagine the Visual Automation method would slow it down even more.) As frequent and automated checking of the information on the website is one of the requirements being addressed in this particular flow, this is somewhat undesirable.

Some automations not working in default PhantomJS mode may be due to the fact it doesn't read the most modern javascript. It may not be due to user agents/headers/etc.
You can try using the headless option which runs chrome headlessly to see if those same automations work.

Thank you for your ultra fast response!!
Trying it in headless mode brought up the same error. My step is as follows:
TagUI step
click .menuItem.recentItem.recentProject .recentItemText:nth-child(1)
Error
ERROR - cannot find .menuItem.recentItem.recentProject .recentItemText:nth-child(1)
In both Phantom.JS and Headless Chrome, I get the same error in the log. The step works without a problem in visible Chrome mode.

Thanks for your report. We are monitoring this issue as well.

Adding on, websites are mostly developed and tested to work on Chrome. Thus running using PhantomJS or headless Chrome can lead to unintended effects that sometimes is not due to the website trying to prevent automated browsing.
There are some stuffs that websites do to prevent automated browsing, for eg checking UserAgent which denotes to the webserver what browser user is using, using randomly generated element attributes so that user can't code in the same XPath or CSS which will fail on each new run, and others like Captcha. All these have solutions, but most solutions are not permanent because once users start to find a loophole, the website will also add new logic to block in other ways.
You can try headless Chrome and use the live step to try live debugging. You can do something like below to see the HTML code or save it somewhere to troubleshoot why in headless mode it is not showing up - html_content = chrome.getHTML()
Can you tell more details why using visible Chrome slow down operation of the flow significantly? There should be negligible impact on the total execution time for visible Chrome and PhantomJS. If there is datatable iteration, using speed option will speed things up without restarting Chrome. Or maybe the flow has many small steps with negligible lag time from the webserver, then it might be much slower on Chrome. Otherwise normal bottleneck in automation is the delay in the website responding to an action.
Lastly, in tagui\src\tagui_chrome.php there is $scan_period = 100000; which means a polling time of 0.1 seconds from TagUI to Chrome. You can try reducing this to 10000 or 1000 or lesser to speed up the communications between TagUI and Chrome to see if that helps. Usually lag time is website responding, so I set it as 0.1 sec for a good balance between being responsive and wasting too much CPU cycles on checking Chrome response.

Once again, thank you for your informative responses.
Something rather curious is happening.
For the last few days, our production flow had been  using the visible Chrome mode since the Phantom and Headless Chrome had stopped working.
This morning however, we found that the visible Chrome no longer works, but Phantom and Headless modes are working again.
It does feel as though the website devs are tweaking their site in response our robotic efforts.

As for differences in speed between Phantom.JS and visible Chrome modes, we're finding that when running in visible mode, more wait steps are required for certain activities.
Am not sure about the exact cause/effect  but wait steps are necessary when the elements that need clicking are always available on the page but will behave different depending on the (table) data being displayed which takes a while to refresh after the previous step.
I cannot explain why this is not the case when in invisible modes., but our tests have shown that in visible modes, more wait steps in between helps to make the flow more robust.

Oh yes, that sounds like some active tweaking (manual or automated) from the website to reject automated activities.
I see.. Yes that sounds strange, visible mode consumes more CPU time and uses the graphics card, but I don't think it slow down a normal computer significantly.
Lastly, as TagUI has auto-wait build in, if the selector you use are uniquely present in the updated page or the website, then it will wait until the element identifier appears before continuing the next step. Default timeout is 10 seconds but can be changed to longer or shorter with timeout step. The key will be looking out for what is it that will appear when the webpage is ready, and use that with hover step for example, to wait until that signal element before continuing.

Re web dev tweaking...  Is it possible for the website to determine that automation is in use when its running in visible Chrome mode?
Your comment about the Hover step use to wait/test for the appearance of an element was helpful. I've been able to replace most of the wait steps in favour of hover.

Yes it's possible, website could also run JS code to detect mouse movements. In automated browsers there isn't the human-like mouse movements around a page. Thanks for feedback!
@siowyisheng it looks like hover step to 'wait' for something to appear is not intuitive. Do you think this should be addressed from samples and tutorials, or we could look at something enhancement to wait step?
Eg now it's wait 3 seconds, wait 12.3 but it might be able to modify to support wait identifier until the default timeout of 10 seconds happens.


[chainerx] add a/sinh,a/cosh

Add sinh, cosh, arcsinh, arccosh.
Reference : #6423

Could you resolve conflicts?

Yeah will resolve the conflicts and merge hyperbolic with trignometric.
Also will revert to standard way for NativeImpl

@asi1024 Have merged hyperbolic to trignometric.
Also, reverted to standard NativeImpl style.
Actually now, I am curious whether you have checked that the functions are getting inlined in assembly as I have heard that inline is just a hint for the compiler and it may choose to skip it.
Thank You.

Yes, inline is just a hint for the compiler, but my comment didn't mean that.
If UnaryOpImpl takes a function as void* type, The function which should be called is determined at runtime.

Jenkins, test this please.

Jenkins CI test (for commit a74f1941f7fb128d81cb9d998e566d6328886007, target branch master) failed with status FAILURE.

@asi1024 The compilation is failing, will look into it in the evening.

Yes, inline is just a hint for the compiler, but my comment didn't mean that.
If UnaryOpImpl takes a function as void* type, The function which should be called is determined at runtime.

Umm, I didn't exactly understand the second bit. Also, isn't the function type, T(*)(T), sorry if my doubt seems to amateur.
Thank You

Could you resolve conflicts again?

Jenkins, test this please.

Jenkins CI test (for commit fb5eac5958e0b251446357884668f96a0b116844, target branch master) failed with status FAILURE.

I can't reproduce this CI failure locally, but std::asinh and std::acosh may not be defined as a device function in this CUDA version (=9.2). How about try rewriting with std::exp as temporary support?

Just a heads up,
Maybe this may or may not help.
The system that I have also has Cuda-9.2
$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2018 NVIDIA Corporation
Built on Tue_Jun_12_23:07:04_CDT_2018
Cuda compilation tools, release 9.2, V9.2.148

And the code compiles on it.
However, the gcc version is 6.5.0
$gcc --version
gcc (Ubuntu 6.5.0-2ubuntu1~16.04) 6.5.0 20181026
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Could you resolve conflict again?

Your several changes in numeric.h and cuda/numeric.cuh seems to have gone when you resolve conflicts.

Oh. Right. Thanks. Will do it locally in few mins.

Jenkins, test this please.

Jenkins CI test (for commit 27d816b5cb28792fd6005cff43f8b2581c5ae1a1, target branch master) succeeded!

Could you resolve conflict?

Jenkins, test this please.

Jenkins CI test (for commit ec9bd121398fffedbd3ca4100da33f30a0365827, target branch master) failed with status FAILURE.

Jenkins failure seems unrelated to this PR.

LGTM! Thank you very much!


Trainable, Non-trainable parameters

Is it possible to perform the inner loop of MAML on only a subset of the parameters?
haiku in JAX makes this possible  by allowing one to split the parameters into trainable and nontrainable subsets.

The short answer is yes. The long answer is, it's a little difficult to do so but it can definitely be done. We (functorch) should invest in a better API to actually express this (and we'd love your feedback on what that API should look like).
Here's how to perform the inner loop of MAML on only a subset of the parameters. Using one of our MAML examples as an example, the idea is to manually partition the set of params into trainable and non-trainable:
    def get_loss_for_task(x1, y1, x2, y2):
        def inner_loss(trainable_params, nontrainable_params, x1, y1):
            params = merge_params(trainable_params, nontrainable_params)
            f = net(params, x1)
            loss = mse_loss(f, y1)
            return loss

        grads = grad(inner_loss)(trainable_params, non_trainable_params, x1, y1)
        new_trainable_params = [(trainable_params[i] - alpha*grads[i]) for i in range(len(trainable_params))]

        new_params = merge_params(new_trainable_params, nontrainable_params)
        v_f = net(new_params, x2)
        return mse_loss(v_f, y2)

the user can define partition_params(List) -> Tuple[List, List] and merge_params:
def partition_params(params):
        trainable_params = [params[0], params[2], ...]
        nontrainable_params = [params[1], ...]

def merge_params(trainable_params, non_trainable_params):
        params = [trainable_params[0], nontrainable_params[1], trainable_params[1], ...]

Obviously this isn't very nice and can be tedious so we are planning on figuring out a better way to do this.

Just an update, in Flax, it seems that the preferred solution is to actually zero out the gradients for the parameters that we don't want to update.
The question was initially asked here and I believe that the correct answer was actually addressed in an issue in Optax


webgl1-image-processing file translation

file translated to pt-br, i'll start sending more constantly.

thanks!


UI: Quick view option is not available for newly create resources

It's slightly annoying when a new VM or systemvm/VR is started, the quick view options may not be available:

ISSUE TYPE

Bug Report

COMPONENT NAME

UI

CLOUDSTACK VERSION

4.15

@rhtyd cc @davidjumani  I tried creating a new zone and checking the system VM but the Quick view still shows up. Can you specify how to reproduce the error?

@utchoang Try to deploy a zone and open the systemvms tab, at that point when the VM is starting it'll have no quickview, and after refreshing a couple of times the vms will come up but the quickview will still not appear

Merged in https://github.com/apache/cloudstack/pull/5137


(NBS) Consider allowing sequential chunk reads to be streamed

Right now, if a table reader does a single logical read to fetch a sequence of chunks, we wait until the entire data is loaded before beginning to decode and send results.
S3TableReader could benefit by starting to send chunks back to the client as data is read out of s3.
The concrete gain is unclear since single threaded bandwidth to s3 tends to be 10s of MB/s.

From where we are, the benefit of this seems minuscule, so I'm gonna close this.


uBit.serial.readUntil with newline delimiter sees regular extra blank lines

serial-echo-readline.zip
The zip has a C++ sample with compiled hex files, an equivalent MakeCode project, and a python client to send lines and check the echo. The micro:bit stores the first line it receives after reset to compare with subsequent lines. It displays E if it sees an empty line and X if a line is different from the first.
Extra blank lines occur regularly, with frequency depending on the micro:bit buffer size and the length of the lines. Every 255 lines with the samples in the zip (about 14s). More often with shorter text.
The problem occurs in the default SYNC_SLEEP mode, but not in SYNC_SPINWAIT mode. It is also present with V1 + DAL. It seemed exactly the same when I used redirection to P0/P1 with a USB to serial cable.
NB: Having a paired MakeCode window open interferes with the communication between micro:bit and the python program.

I think this is fixed in https://github.com/lancaster-university/codal-core/commit/4fa8275e2069434f83cdf967098ddd53644abf03
Can you please confirm @martinwork ?

Fixed in v0.2.25


Crash with Discord v80

Hi all :D
First of all thank you for your application which is great and fills a gap on iOS.
I'm here to report a bug that causes volume mixer, indeed when I updated Discord v80 it crashes instantly during a call, namely that on the version of Discord v47 there is no conflict with volume mixer.
I don't know if you can or want to fix this problem, but if you could fix it I would be very grateful :)
(I am running iOS 14.0.1)
Regard,
Smaïn,

Just pushed a new version 0.0.5~beta1 to my repo. It should fix the crash issue. But I'm not sure if there is other issue because I'm not using audio in Discord.

It works with version 80 now, thanks a lot for your help :)


Build ChakraCore shared library

For easier reviewing, I've split up this PR into five different commits. Each commit has a more detailed description of its changes.
With this change, ChakraCore builds on debug builds in Linux and can run hello world (have not tried release builds yet)

@LouisLaf @curtisman please review 7453224
@jianchun please review the rest

@digitalinfinity can we make ch using ChakraCore as a static library instead? Having ChakraCore as a shared library for ch will be a headache. i.e. osx problem with shared library from same folder. OR, ch is referencing wrong shared binary by mistake etc..

@obastemur ch is a thin driver for testing the ChakraCore dynamic library through static entry points. The problems that you describe are applicable on Windows as well, and in practice, at least on Windows, it hasn't mattered. We should continue to use ChakraCore as a dynamic library with ch to simulate how ChakraCore would be used by its consumers, but if you feel strongly about switching ch to be statically linked with ChakraCore, please open a separate issue and we can have that discussion there.

Thanks @obastemur. Added new commits to address your comments. Let me know if its good to merge (cc @Jianchun)

@digitalinfinity :+1:

👍


resource_control: reset the resource statistics when limiter is recreated

What is changed and how it works?

Issue Number: ref #14900
What's Changed:

Add a auto-increment version for resource limiter to track the resource limiter changes and reset the statistics data when version is changed.

Related changes

PR to update pingcap/docs/pingcap/docs-cn:
Need to cherry-pick to the release branch

Check List
Tests

Unit test
Integration test
Manual test (add detailed scripts or steps below)
No code

Side effects

Performance regression

Consumes more CPU
Consumes more MEM

Breaking backward compatibility

Release note
None

/merge


Got invalid dimensions for input: input for the following indices  index: 3 Got: 1 Expected: 3 Please fix either the inputs or the model

Hi
I'm trying to start my own AllSkyAI to relieve allskyai.com server, that I'm using to classify cloud cobver for my AllSky. But unfortunately I can't run it with downloaded onnx model from allskyai.com from my profile page. This exception occurs after trying to run classification:
info: AllSkyAI_ASPNetCore.Controllers.ClassifyController[0]
Downloading AllSkyImage: https://allsky.groch.cloud/image.jpg
Download done in 0.457s, classifying image...
fail: Microsoft.AspNetCore.Server.Kestrel[13]
      Connection id "0HMVL3NOKRHE9", Request id "0HMVL3NOKRHE9:00000004": An unhandled exception was thrown by the application.
      System.AggregateException: One or more errors occurred. ([ErrorCode:InvalidArgument] Got invalid dimensions for input: input for the following indices
       index: 3 Got: 1 Expected: 3
       Please fix either the inputs or the model.)
       ---> Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:InvalidArgument] Got invalid dimensions for input: input for the following indices
       index: 3 Got: 1 Expected: 3
       Please fix either the inputs or the model.
         at Microsoft.ML.OnnxRuntime.NativeApiStatus.VerifySuccess(IntPtr nativeStatus)
         at Microsoft.ML.OnnxRuntime.InferenceSession.RunImpl(RunOptions options, IntPtr[] inputNames, IntPtr[] inputValues, IntPtr[] outputNames, DisposableList`1 cleanupList)
         at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection`1 inputs, IReadOnlyCollection`1 outputNames, RunOptions options)
         at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection`1 inputs, IReadOnlyCollection`1 outputNames)
         at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection`1 inputs)
         at AllSkyAI_ASPNetCore.OnnxClassify.ClassifyImage(String url) in /source/AllSkyAI-ASPNetCore/OnnxClassify.cs:line 101
         at AllSkyAI_ASPNetCore.Controllers.ClassifyController.<Get>b__4_0() in /source/AllSkyAI-ASPNetCore/Controllers/ClassifyController.cs:line 25
         at System.Threading.Tasks.Task`1.InnerInvoke()
         at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
      --- End of stack trace from previous location ---
         at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
         at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
         --- End of inner exception stack trace ---
         at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
         at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
         at AllSkyAI_ASPNetCore.Controllers.ClassifyController.Get() in /source/AllSkyAI-ASPNetCore/Controllers/ClassifyController.cs:line 29
         at lambda_method12(Closure, Object, Object[])
         at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync()
         at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync()
      --- End of stack trace from previous location ---
         at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync()
      --- End of stack trace from previous location ---
         at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeNextResourceFilter>g__Awaited|25_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Rethrow(ResourceExecutedContextSealed context)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.InvokeFilterPipelineAsync()
      --- End of stack trace from previous location ---
         at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
         at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
         at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
         at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
         at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
         at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)

Hi!
Oh, it’s been a while since I tested that one myself and the image input
changed a bit. Let me have a look and get back to you, sounds like a simple
thing to fix!
Kind regards,
Chris
On Tue, 5 Dec 2023 at 07:46, Mr-Groch @.***> wrote:

Hi
I'm trying to start my own AllSkyAI to relieve allskyai.com server, that
I'm using to classify cloud cobver for my AllSky. But unfortunately I can't
run it with downloaded onnx model from allskyai.com from my profile page.
This exception occurs after trying to run classification:
info: AllSkyAI_ASPNetCore.Controllers.ClassifyController[0]
Downloading AllSkyImage: https://allsky.groch.cloud/image.jpg
Download done in 0.457s, classifying image...
fail: Microsoft.AspNetCore.Server.Kestrel[13]
Connection id "0HMVL3NOKRHE9", Request id "0HMVL3NOKRHE9:00000004": An unhandled exception was thrown by the application.
System.AggregateException: One or more errors occurred. ([ErrorCode:InvalidArgument] Got invalid dimensions for input: input for the following indices
index: 3 Got: 1 Expected: 3
Please fix either the inputs or the model.)
---> Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:InvalidArgument] Got invalid dimensions for input: input for the following indices
index: 3 Got: 1 Expected: 3
Please fix either the inputs or the model.
at Microsoft.ML.OnnxRuntime.NativeApiStatus.VerifySuccess(IntPtr nativeStatus)
at Microsoft.ML.OnnxRuntime.InferenceSession.RunImpl(RunOptions options, IntPtr[] inputNames, IntPtr[] inputValues, IntPtr[] outputNames, DisposableList1 cleanupList)          at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection1 inputs, IReadOnlyCollection1 outputNames, RunOptions options)          at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection1 inputs, IReadOnlyCollection1 outputNames)          at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection1 inputs)
at AllSkyAI_ASPNetCore.OnnxClassify.ClassifyImage(String url) in /source/AllSkyAI-ASPNetCore/OnnxClassify.cs:line 101
at AllSkyAI_ASPNetCore.Controllers.ClassifyController.b__4_0() in /source/AllSkyAI-ASPNetCore/Controllers/ClassifyController.cs:line 25
at System.Threading.Tasks.Task1.InnerInvoke()          at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)       --- End of stack trace from previous location ---          at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)          at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)          --- End of inner exception stack trace ---          at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)          at System.Threading.Tasks.Task1.GetResultCore(Boolean waitCompletionNotification)
at AllSkyAI_ASPNetCore.Controllers.ClassifyController.Get() in /source/AllSkyAI-ASPNetCore/Controllers/ClassifyController.cs:line 29
at lambda_method12(Closure, Object, Object[])
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync()
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|25_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Rethrow(ResourceExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.InvokeFilterPipelineAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)
—
Reply to this email directly, view it on GitHub
https://github.com/christian-kardach/AllSkyAI-ASPNetCore/issues/1, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABV2PLSD6ZF7QF37PA52WC3YH27LPAVCNFSM6AAAAABAHFEJDWVHI2DSMVQWIX3LMV43ASLTON2WKOZSGAZDKMZZHEYDKOA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Yes, found the issues. I will fix tonight and push these fixes.
Thanks for reaching out!
Kind regards,
Chris
On Tue, 5 Dec 2023 at 07:46, Mr-Groch @.***> wrote:

Hi
I'm trying to start my own AllSkyAI to relieve allskyai.com server, that
I'm using to classify cloud cobver for my AllSky. But unfortunately I can't
run it with downloaded onnx model from allskyai.com from my profile page.
This exception occurs after trying to run classification:
info: AllSkyAI_ASPNetCore.Controllers.ClassifyController[0]
Downloading AllSkyImage: https://allsky.groch.cloud/image.jpg
Download done in 0.457s, classifying image...
fail: Microsoft.AspNetCore.Server.Kestrel[13]
Connection id "0HMVL3NOKRHE9", Request id "0HMVL3NOKRHE9:00000004": An unhandled exception was thrown by the application.
System.AggregateException: One or more errors occurred. ([ErrorCode:InvalidArgument] Got invalid dimensions for input: input for the following indices
index: 3 Got: 1 Expected: 3
Please fix either the inputs or the model.)
---> Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:InvalidArgument] Got invalid dimensions for input: input for the following indices
index: 3 Got: 1 Expected: 3
Please fix either the inputs or the model.
at Microsoft.ML.OnnxRuntime.NativeApiStatus.VerifySuccess(IntPtr nativeStatus)
at Microsoft.ML.OnnxRuntime.InferenceSession.RunImpl(RunOptions options, IntPtr[] inputNames, IntPtr[] inputValues, IntPtr[] outputNames, DisposableList1 cleanupList)          at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection1 inputs, IReadOnlyCollection1 outputNames, RunOptions options)          at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection1 inputs, IReadOnlyCollection1 outputNames)          at Microsoft.ML.OnnxRuntime.InferenceSession.Run(IReadOnlyCollection1 inputs)
at AllSkyAI_ASPNetCore.OnnxClassify.ClassifyImage(String url) in /source/AllSkyAI-ASPNetCore/OnnxClassify.cs:line 101
at AllSkyAI_ASPNetCore.Controllers.ClassifyController.b__4_0() in /source/AllSkyAI-ASPNetCore/Controllers/ClassifyController.cs:line 25
at System.Threading.Tasks.Task1.InnerInvoke()          at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)       --- End of stack trace from previous location ---          at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)          at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)          --- End of inner exception stack trace ---          at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)          at System.Threading.Tasks.Task1.GetResultCore(Boolean waitCompletionNotification)
at AllSkyAI_ASPNetCore.Controllers.ClassifyController.Get() in /source/AllSkyAI-ASPNetCore/Controllers/ClassifyController.cs:line 29
at lambda_method12(Closure, Object, Object[])
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.SyncObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeActionMethodAsync()
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeNextActionFilterAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|25_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Rethrow(ResourceExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.InvokeFilterPipelineAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)
—
Reply to this email directly, view it on GitHub
https://github.com/christian-kardach/AllSkyAI-ASPNetCore/issues/1, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABV2PLSD6ZF7QF37PA52WC3YH27LPAVCNFSM6AAAAABAHFEJDWVHI2DSMVQWIX3LMV43ASLTON2WKOZSGAZDKMZZHEYDKOA
.

Also, you need to download the labels file from the site and place it in the same directory as the model and update the config.cfg file!
Kind regards,
Chris

It is working now, thanks!
One more remark - I have linux server, and it was necessary to change all \\ in paths to / in Configuration.cs and OnnxClassify.cs. Don't know if that can be also changed for windows dotnet sdk so it can be multiplatform

Hi, glad it worked! I've fixed the paths so they should work as expected.
Also note, I will move all the AllSkyAI to a separate account, you can get the latest here: https://github.com/AllSkyAI/AllSkyAI-ASPNetCore
Regards,
Chris


[Question]: On startup I get an ECONNREFUSED <IP_ADDRESS>:443

Ask your question
Hi, try to start de container with the specified command and get this error:
2023-12-12 17:03:54.533  ERROR Register FID - Generic Error
{
error: {
cause: undefined,
message: 'RequestError: connect ECONNREFUSED <IP_ADDRESS>:443',
context: undefined,
stacktrace: 'RequestError: connect ECONNREFUSED <IP_ADDRESS>:443\n' +
'    at ClientRequest. (/usr/src/app/node_modules/got/dist/source/core/index.js:970:111)\n' +
'    at Object.onceWrapper (node:events:632:26)\n' +
'    at ClientRequest.emit (node:events:529:35)\n' +
'    at ClientRequest.emit (node:domain:489:12)\n' +
'    at origin.emit (/usr/src/app/node_modules/@szmarczak/http-timer/dist/source/index.js:43:20)\n' +
'    at TLSSocket.socketErrorListener (node:_http_client:501:9)\n' +
'    at TLSSocket.emit (node:events:517:28)\n' +
'    at TLSSocket.emit (node:domain:489:12)\n' +
'    at emitErrorNT (node:internal/streams/destroy:151:8)\n' +
'    at emitErrorCloseNT (node:internal/streams/destroy:116:3)\n' +
'    at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1555:16)'
}
}
Any clue what is going wrong?
Thanks!

ECONNREFUSED is a faulty configuration on your side, such as a firewall that blocks or a software solution that blocks ads (pi-hole or ad-aware). In this case, the DNS resolution returns <IP_ADDRESS> instead of the correct IP address. This results in the error ECONNREFUSED.

Hello @bropat I have the same issue and have pi-hole running on the network.
I understand this is linked, but can you please explain what is called so I can allow it in pi-hole, then have the correct ip returned and the WS running ?
And I didn't find this in the log or documentation
Thanks !


Remove the lightning prefix from the lnInvoice

Removing the lightning prefix from the commands file and the validation
Fixes #542

Yes, you are right, I comitted the missed file

I already moved it to the folder util and changed its name to camelcase format names

Hi  @danfercf1 let's wait for @grunch to review and decides

Hi @danfercf1 let's wait for @grunch to review and decides

I think after move the new file to .ts we can merge

I updated the new file to Typescript

Hi @danfercf1 thank you for your contribution, before we merge it we need to have the conflict solved

Hi @danfercf1 thank you for your contribution, before we merge it we need to have the conflict solved, validation.js file has just been moved to validation.ts

I will take a look

I updated the file validation.ts

Hey @danfercf1 because we have a buggy PR merged (#557) we need to revert this one, your code is ok I will include in a new version, thanks again


Generic template configs not being refreshed/fetched on targets from controller

Bug Report
System Information

Any
<IP_ADDRESS>
Mainline

I confirm:

[x] that I have searched for an existing bug report for this issue.
[x] that I am using the latest available version of AMP.
[x] that my operating system is up-to-date.

Symptoms

What are you trying to do?
Either:

Refresh Configuration from the controller on an instance that is installed on a target, to update the instance to the latest generic template config; or
Fetch Latest on the controller to create a new instance on a target (from the controller) based on the latest generic template config.

What are you expecting to happen?
The existing instance will be updated to the latest generic template config, or the new instance will be created based on the latest generic template config.

What is actually happening? ('Nothing' is not an acceptable answer!)
The target ADS is not updated to the latest generic template configs. Only the controller ADS is. As a result, the existing instance is not updated correctly, and a new instance is not created with the latest config. This causes breakages and/or unexpected behaviour of the instance.
What should happen is that if a Fetch Latest or Refresh Configuration happens on a controller, that should automatically also be done on the target(s), so that any instances are updated/created correctly on the target(s).

Reproduction

See above.

Putting a note here to check into this. The latest version should sync the fetching, but I had one case where the settings file and kvp weren't matched up properly when using a duplicated game that existed in the main repo and Greelan's dev repo. Need to verify further it wasn't an unrelated fluke.

Turns out, adding a repo on the controller does indeed add it/refresh it on the targets... It just doesn't refresh on the controller.

O.M.G.


Licensing nightmare

CivDocker is a licensing nightmare since it's redistrubuting binary forms of other projects. CivDocker should follow the example of PaperMC paperclip process and download the needed binaries on-demand.

I fully agree with this!

Ultimately we gave up work on it due to more pressing issues / server closure.
Example: https://github.com/DevotedMC/devoted-vm

Relevant #3


Fix string conversion under Clang

Explicit conversion to std::string by static_cast<> causes compilation error when using Clang (3.5).
(Casting to const std::string doesn't work either.)
This PR fixed it by removing const from the casting operator.
And I think it also makes casting operator more consistent with get<>() method.

Coverage remained the same when pulling 36f61998986d9cdb0449c8f19138e1ac8a97c172 on wancw:fix_clang_string_casting into bd05c7a18a6eee48d683ce47a079c05826c35d86 on nlohmann:master.

Thanks a lot for fixing that!


Generate code from Firestore testing proto

@jba has defined a great set of conformance tests for Firestore.  Parsing them requires generating code from his .proto file, which doesn't work for me:
$ /opt/protobuf3/bin/protoc --python_out="$(pwd)/proto" --proto_path="$(pwd)/proto" --proto_path="/home/tseaver/projects/agendaless/Google/src/googleapis" $(pwd)/proto/test.proto
google/firestore/v1beta1/common.proto:28:8: Option "php_namespace" unknown.
google/firestore/v1beta1/document.proto:30:8: Option "php_namespace" unknown.
google/firestore/v1beta1/query.proto: Import "google/firestore/v1beta1/document.proto" was not found or had errors.
google/firestore/v1beta1/query.proto:111:5: "Value" is not defined.
google/firestore/v1beta1/query.proto:227:12: "Value" is not defined.
google/firestore/v1beta1/write.proto: Import "google/firestore/v1beta1/common.proto" was not found or had errors.
google/firestore/v1beta1/write.proto: Import "google/firestore/v1beta1/document.proto" was not found or had errors.
google/firestore/v1beta1/write.proto:38:5: "Document" is not defined.
google/firestore/v1beta1/write.proto:60:3: "DocumentMask" is not defined.
google/firestore/v1beta1/write.proto:65:3: "Precondition" is not defined.
google/firestore/v1beta1/write.proto:113:12: "Value" is not defined.
google/firestore/v1beta1/write.proto:127:3: "Document" is not defined.
google/firestore/v1beta1/firestore.proto: Import "google/firestore/v1beta1/common.proto" was not found or had errors.
google/firestore/v1beta1/firestore.proto: Import "google/firestore/v1beta1/document.proto" was not found or had errors.
google/firestore/v1beta1/firestore.proto: Import "google/firestore/v1beta1/query.proto" was not found or had errors.
google/firestore/v1beta1/firestore.proto: Import "google/firestore/v1beta1/write.proto" was not found or had errors.
google/firestore/v1beta1/firestore.proto:136:3: "DocumentMask" is not defined.
google/firestore/v1beta1/firestore.proto:177:3: "DocumentMask" is not defined.
google/firestore/v1beta1/firestore.proto:203:12: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:225:3: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:231:3: "DocumentMask" is not defined.
google/firestore/v1beta1/firestore.proto:238:3: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:247:3: "DocumentMask" is not defined.
google/firestore/v1beta1/firestore.proto:253:3: "DocumentMask" is not defined.
google/firestore/v1beta1/firestore.proto:257:3: "Precondition" is not defined.
google/firestore/v1beta1/firestore.proto:268:3: "Precondition" is not defined.
google/firestore/v1beta1/firestore.proto:287:3: "DocumentMask" is not defined.
google/firestore/v1beta1/firestore.proto:299:5: "TransactionOptions" is not defined.
google/firestore/v1beta1/firestore.proto:313:5: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:340:3: "TransactionOptions" is not defined.
google/firestore/v1beta1/firestore.proto:358:12: "Write" is not defined.
google/firestore/v1beta1/firestore.proto:370:12: "WriteResult" is not defined.
google/firestore/v1beta1/firestore.proto:399:5: "StructuredQuery" is not defined.
google/firestore/v1beta1/firestore.proto:412:5: "TransactionOptions" is not defined.
google/firestore/v1beta1/firestore.proto:430:3: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:473:12: "Write" is not defined.
google/firestore/v1beta1/firestore.proto:511:12: "WriteResult" is not defined.
google/firestore/v1beta1/firestore.proto:544:5: "DocumentChange" is not defined.
google/firestore/v1beta1/firestore.proto:547:5: "DocumentDelete" is not defined.
google/firestore/v1beta1/firestore.proto:551:5: "DocumentRemove" is not defined.
google/firestore/v1beta1/firestore.proto:558:5: "ExistenceFilter" is not defined.
google/firestore/v1beta1/firestore.proto:586:7: "StructuredQuery" is not defined.
google/firestore/v1beta1/firestore.proto:58:48: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:68:54: "Document" is not defined.
google/firestore/v1beta1/firestore.proto:73:54: "Document" is not defined.
test.proto: Import "google/firestore/v1beta1/common.proto" was not found or had errors.
test.proto: Import "google/firestore/v1beta1/document.proto" was not found or had errors.
test.proto: Import "google/firestore/v1beta1/firestore.proto" was not found or had errors.
test.proto: Import "google/firestore/v1beta1/query.proto" was not found or had errors.
test.proto:44:3: "google.firestore.v1beta1.GetDocumentRequest" is not defined.
test.proto:58:3: "google.firestore.v1beta1.CommitRequest" is not defined.
test.proto:70:3: "google.firestore.v1beta1.CommitRequest" is not defined.
test.proto:78:3: "google.firestore.v1beta1.Precondition" is not defined.
test.proto:80:3: "google.firestore.v1beta1.CommitRequest" is not defined.
test.proto:88:3: "google.firestore.v1beta1.Precondition" is not defined.
test.proto:92:3: "google.firestore.v1beta1.CommitRequest" is not defined.
test.proto:99:3: "google.firestore.v1beta1.Precondition" is not defined.
test.proto:100:3: "google.firestore.v1beta1.CommitRequest" is not defined.
test.proto:113:3: "google.firestore.v1beta1.StructuredQuery" is not defined.
test.proto:173:12: "google.firestore.v1beta1.ListenResponse" is not defined.
test.proto:179:12: "google.firestore.v1beta1.Document" is not defined.
test.proto:193:3: "google.firestore.v1beta1.Document" is not defined.

After switching to use protoc-3.5.1 (which has the php_namespace support), the code generation itself completes without errors.  However, imports within it fail:
==================================== ERRORS ====================================
__________ ERROR collecting firestore/tests/unit/test_conformance.py ___________
ImportError while importing test module '/home/tseaver/projects/agendaless/Google/src/google-cloud-python/firestore/tests/unit/test_conformance.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
tests/unit/test_conformance.py:6: in <module>
    from .proto import test_pb2
tests/unit/proto/test_pb2.py:16: in <module>
    from google.firestore.v1beta1 import common_pb2 as google_dot_firestore_dot_v1beta1_dot_common__pb2
E   ModuleNotFoundError: No module named 'google.firestore'
___________ ERROR collecting firestore/tests/unit/proto/test_pb2.py ____________
ImportError while importing test module '/home/tseaver/projects/agendaless/Google/src/google-cloud-python/firestore/tests/unit/proto/test_pb2.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
tests/unit/proto/test_pb2.py:16: in <module>
    from google.firestore.v1beta1 import common_pb2 as google_dot_firestore_dot_v1beta1_dot_common__pb2
E   ModuleNotFoundError: No module named 'google.firestore'

@lukesneeringer @jba can you take a look?

Are you using the Makefile?

@jba I didn't realize it was in this repo.  It is a little specific to your machine, though. :)

That was enough hint to get a new version generated, after hacking around a bit on the Makefile and then discarding my changes.


pointermgr: ensure compositor exist on destroy

on exit of hyprland the CMonitor destroy signal comes after the compositor has been destructed, causing a heap use after free. add if check to ensure compositor exist and isnt shutting down when its triggered.
Describe your PR, what does it fix/add?
fixes #6180

hmm seems clang format wanted to reformat line 194 too, i can revert that if you want,

hmm seems clang format wanted to reformat line 194 too, i can revert that if you want,

okay the CI seems to want it reverted, yet locally it wants it like that heh is there some clang version mismatch going on

hmm seems clang format wanted to reformat line 194 too, i can revert that if you want,

okay the CI seems to want it reverted, yet locally it wants it like that heh is there some clang version mismatch going on

reverted to make CI happy.

okay the CI seems to want it reverted, yet locally it wants it like that heh is there some clang version mismatch going on

yea iirc new version wants some changes but its not in arch yet


Fix Tabstrip crashes when setting activeTabIndex to null

Fixes #1676

Tested by MCP team, to address clicking active tab not firing 'fake' inactive tab before having the PR change

I'm not too sure about this... I understand that some teams might want to do this but we've previously spoken about this being a hard requirement of tabs

We have to do something for MCP right now, given no other option will be available.
Either we officially support in TS, or something like #1683

I'm not too sure about this... I understand that some teams might want to do this but we've previously spoken about this being a hard requirement of tabs

Why a hard requirement? It will obviously be used with no selection in some scenarios.

I'm not too sure about this... I understand that some teams might want to do this but we've previously spoken about this being a hard requirement of tabs

Why a hard requirement? It will obviously be used with no selection in some scenarios.

Technically we don't support those scenarios. A requirement for Tabs is that it always has an active item. I think it's worth merging this anyway and relying on documentation to convey this.

Why a hard requirement? It will obviously be used with no selection in some scenarios.

When Homepage (being not a part of tab) is active, none of the view tabs should be active. If they override css pure visually, then onActiveChange won't fire when clicking back.


port recent changes from bleve

Especially this security bug fix for HTML highlighting: https://github.com/blevesearch/bleve/commit/b9b775998330bf9efdc8748021a80e38fc1e250c

[x] d6a3fe28 (HEAD -> master, tag: v1.0.14, origin/master, origin/HEAD) prepare for blevex go.mod (#1519)
[x] c3457bb7 (tag: v1.0.13) prepare to support zap v15.0.2 (#1499)
[x] 4b6bddf7 fix analyzer lookup when field name contains dot (#1496)
[ ] e24b3afc Remove default from text description (#1489)
[x] c67bc71f Fix DocValuesDynamic's json-ability within IndexMappingImpl (#1485)
[x] 7e8fd30c (tag: v1.0.12) prepare bleve v1.0.12 (#1483)
[x] 7efdbbb6 (tag: v1.0.11) add support for zap v15 and update zap version (#1482)
[ ] b9b77599 escape the input text in HTML highlighter when adding  tags, fixes #1464 (#1465)
[ ] cc29456f Fixed ASCII folding of \u24A2 (#1434)
[x] 3bb3c7b4 Shutdown analysis queue (#1414)
[ ] bffe7ea0 add go 1.15.x to the testing matrix (#1468)
[x] 7a377b75 Index is always left closed when opening process failed (#1479)
[x] 0197e8dd an optimization fix test was no longer helping (#1459)
[ ] 99e9e901 New stats for reclaimable disk space from scorch index (#1470)
[ ] c997b4a5 fix tests on go 1.15 (#1466)

While reviewing bleve SHA b9b77599 for porting to bluge, I discovered that a part of that fix had been omitted by mistake.
The details of that mistake are here: https://github.com/blevesearch/bleve/issues/1529
The proposed fix (under review) for that mistake is here: https://github.com/blevesearch/bleve/pull/1530

I'm opting to not port the reclaimable disk space stat at this time (ref 99e9e901)


Add Push Docker Manifest action

Adds action that will create a push a Docker manifest for one or many multi-architecture images.
Manifests are tagged with SHA by default. An additional tag can be provided via the tag input.
If the branch is main, a manifest with main will also be created/pushed.

Also reminds me we should probably enable actions for this repository and run shellcheck in CI. I think this is installed by default on GitHub hosted runners.

Also reminds me we should probably enable actions for this repository and run shellcheck in CI. I think this is installed by default on GitHub hosted runners.

Sounds good (I did run it locally.)


Llama FSDP training with FP8

@KeitaW thanks for the review! I was thinking about adding FP8 support to FSDP example, but there are two aspects why I decided to create a separate example for this:

Transformer Engine requires Nvidia's container to run(or as alternative relatively complicated process of building from source with CUDA headers, CUDNN etc). And I don't want to complicate FSDP example with it.
This example is bound to Llama model(taken from TE examples), but FSDP example supports multiple models that I don't want to rewrite with FP8.

So, in terms of importance this example is about LLama with FP8. FSDP training here is just kind of scaffolding.

@pbelevich FYI the AWS DLC for PyTorch also includes TE


Maybe should use outer MaybeBase for better type checking

Describe the bug
Currently, Maybe builds a model based on the locally-defined MaybeBase:
https://github.com/jxnl/instructor/blob/8ac5518b1098363ccc0dc77bfdc89be2c0d3a0db/instructor/dsl/maybe.py#L77
This works as expected, but it means any type hints that constrain objects to the outer MaybeBase fail because the Maybe model class has the locally-defined MaybeBase as its base.
To Reproduce
from typing import Optional

from instructor import Maybe
from instructor.dsl.maybe import MaybeBase
from pydantic import BaseModel, Field

class UserDetail(BaseModel):
    age: int
    name: str
    role: Optional[str] = Field(default=None)

MaybeUserDetail = Maybe(UserDetail)

issubclass(MaybeUserDetail, MaybeBase)  # False

Expected behavior
issubclass(MaybeUserDetail, MaybeBase)  # True

Screenshots
N/A

ah thanks for catching this, i'd take a PR for this to fix, i figured most people would just implement it themselves

Addressed in https://github.com/jxnl/instructor/pull/325, let me know what you think!


otelgorm query limitation

Sometimes the SQL queries are huge and above 4k characters. It should be nice to create an option to limit the SQL query on the trace. I also opened a PR to resolve this issue. The idea is that if we want to limit the query to lets say 400 chars, we keep the first 200 chars and the last 200 chars of the query.

(this is resolved by the WithQueryFormatter otelgorm config option added in the PR linked above)


scrollBehaviour can't be connected as external module in<EMAIL_ADDRESS>

Version
v2.4.0
Reproduction link
https://github.com/DreaMinder/nuxt-scrollbehaviour-reproduction
Steps to reproduce

npm i
npm run dev

What is expected ?
To work as expected
What is actually happening?
error:in ./.nuxt/router.js

Vue.use(Router)

> const scrollBehavior = functionfunction (to, from){
                                                 ^
let position = 0

Additional comments?
2.3.4 was working ok with
scrollBehavior: require('./scroll')

2.4.0 works only with inlined function:
 scrollBehavior: function(to, from){

This bug report is available on Nuxt community (#c8563)

I have updated to nuxt 2.4.3 and continue to receive errors when attempting to import my scrollBehavior function from an external module.
I tried a yarn upgrade nuxt, tried manually incrementing the version in package.json, verified the newest Nuxt is installed, and even deleted my node_modules folder & reinstalled. No dice.
Errors and snippets below:
nuxt.config.js
import { scrollBehavior, extendRoutes } from './lib/route-utils'

module.exports = {
  // ...
  router: {
    extendRoutes,
    scrollBehavior
  }
  // ...
}

lib/route-utils.js
export function scrollBehavior(to, from, savedPos) {
  // ...
}

When running nuxt dev
ERROR  Failed to compile with 1 errors
ERROR  in ./.nuxt/router.js  friendly-errors 22:51:54
Syntax Error: Unexpected token, expected "(" (34:32)
  32 | Vue.use(Router)
  33 |
> 34 | const scrollBehavior = function function (to, from, savedPos) {
     |                                 ^
  35 |   const isEqual = require('lodash').isEqual
  36 |   let scrollTo = { x: 0, y: 0 }
  37 |


Separating getting parameters from the DB and exporting files

Fixing #109.
The function exportModelParameters was added to DatabaseHandler and it is supposed to be used externally, like getModelParameters.
getSiteParameters only returns the parameters but it does not write them anymore.
I also did some refactoring of db_handler and test_db_handler.

I will merge it, but we can continue the discussions.


My firefox can't see your google search bar

I can't see the google site search bar on (http://groovy-lang.org/search.html) when using Firefox 64.0 on Ubuntu.
It says:
Loading failed for the <script> with source “http://www.google.com/cse/cse.js?cx=013939896723962546743:hbhn__olhii”
This isn't an issue particular to your website, as I can see the google site search bar in Chromium. This is probably because I have the "block trackers" option on (that also blocks all Google Captcha). However, I thought it might be an accessibility concern if you want to make sure your site functionality doesn't rely on a third-party tracking your users through your website. Just in case you're concerned about that.

Please reopen at apache/groovy-website if still a problem.


[DNM] raftstore: add transfer leader admin command

more tests should be add, but in the following PR

How etcd uses this feature? Any example?

this is not port from etcd.
our raftstore is not port from etcd, isn't it?
I'll take a look how etcd use the feature...

We have not started using this feature. But our use case is pretty simple: if the leader receives sigterm or sigint, it will transfer leadership to a random follower before existing.

cool @xiang90

if we have this PR, we can make the code https://github.com/pingcap/tikv/pull/502/files simpler

LGTM. PTAL @siddontang @BusyJay

rest LGTM, and maybe we should also test with network isolation cases later.

And we may transfer leader to a random qualified follower when it's removed as leader. Maybe another PR.

LGTM


Knowing when results are back? question

I'm writing a socket.io message system, and I need to have a way to know when the results are back so I can emit the message with results.
I just seem to be missing something.
I do something like
if (err) { .... }
else if (results) { emit.info(results) }

but the results are null, so I'm guessing they haven't returned yet.
Am I off?  What am I missing?

With such a tiny bit of code, it's not possible to answer. Can you show a bit more code? Perhaps how this library is being used?

  I was trying to do
results.message

instead of
results[0].message

and thus my issue is resolved.  I see now that results is the callback, and it won't move into the sql return function until there is either an error, or there are results to be used.
Sorry for the trouble.


Put IISExpress tests into a separate test group

Latest test run on CI hit an execution timeout, my gut says it has something to do with the ServerTests conflicting with IIS tests.

Do we have test groups for other functional test projects that use IIS?

The only one that isn't right now is ServerTests, which has a mix of IIS and non IIS tests.

Do we still need this ?

Nope.


Incorrect syntax in Linux prerequisites script

Product and Version: VSCode
OS Version: Linux Mint 18.3 4.13.0-39-generic
APT Version: apt 1.2.26 (amd64)
Steps to Reproduce / Scenario:

Follow instructions to install Linux prerequisites -> wget -O ~/vsls-reqs https://aka.ms/vsls-linux-prereq-script && bash ~/vsls-reqs
output as follows:

. . .
Visual Studio Live Share requires a number of prerequisites that this script
will attempt to install for you. Note you may be prompted for your admin (sudo)
password during the installation process.

(*) Detected Debian / Ubuntu

apt
Usage: apt command [options]
       apt help command [options]
. . .
(!) Installation failed! Press enter to dismiss this message.

sudo apt -yq install libunwind8 liblttng-ust0 libcurl3 libssl1.0.? libicu?? libuuid1 libkrb5-3 zlib1g gnome-keyring libsecret-1-0 desktop-file-utils gettext apt-transport-https
should be
sudo apt install -yq libunwind8 liblttng-ust0 libcurl3 libssl1.0.? libicu?? libuuid1 libkrb5-3 zlib1g gnome-keyring libsecret-1-0 desktop-file-utils gettext apt-transport-https

Thanks for the PR! Not sure why this worked on other distros but not Mint.

Just tried it on Ubuntu 17.10 as well, same issue there but a different error message. Cant explain it :smile:


Using PinotFS interface instead of local file to download a segment f…

#3847
When using low level realtime data consumer, a slow server now may download the segments from controller. The controller's segment download api uses FileUploadPathProvider. Its getBaseDataDir() method now assume all segments are stored locally and requires the data dir path scheme being "file" -- thus deep storage scheme can not work.

This refactoring uses PinotFS interface instead.
I am not sure the reason why the original test created segment files with suffix ' %'. This kind of filenames are good for local filesystem but not valid as an URI path used by the PinotFS. I deleted such segment file names.

@mcvsubbu @npawar @jamesyfshao

Codecov Report

Merging #3849 into master will increase coverage by 0.13%.
The diff coverage is 84.61%.

@@             Coverage Diff              @@
##             master    #3849      +/-   ##
============================================
+ Coverage     67.06%   67.19%   +0.13%
  Complexity        4        4
============================================
  Files          1029     1029
  Lines         50785    50798      +13
  Branches       7095     7096       +1
============================================
+ Hits          34060    34135      +75
+ Misses        14402    14331      -71
- Partials       2323     2332       +9

Impacted Files
Coverage Δ
Complexity Δ

...i/resources/PinotSegmentUploadRestletResource.java
66.66% <84.61%> (+0.82%)
0 <0> (ø)
:arrow_down:

...he/pinot/core/query/pruner/ValidSegmentPruner.java
57.14% <0%> (-28.58%)
0% <0%> (ø)

...egation/function/customobject/MinMaxRangePair.java
75.86% <0%> (-24.14%)
0% <0%> (ø)

...lix/EmptyBrokerOnlineOfflineStateModelFactory.java
86.66% <0%> (-13.34%)
0% <0%> (ø)

...elix/core/minion/generator/TaskGeneratorUtils.java
72.22% <0%> (-12.4%)
0% <0%> (ø)

...pache/pinot/core/util/SortedRangeIntersection.java
83.82% <0%> (-7.36%)
0% <0%> (ø)

...impl/dictionary/DoubleOnHeapMutableDictionary.java
68.88% <0%> (-6.67%)
0% <0%> (ø)

...impl/dictionary/FloatOffHeapMutableDictionary.java
83.63% <0%> (-3.64%)
0% <0%> (ø)

...e/operator/dociditerators/SortedDocIdIterator.java
58.33% <0%> (-2.78%)
0% <0%> (ø)

...manager/realtime/HLRealtimeSegmentDataManager.java
78.35% <0%> (-2.58%)
0% <0%> (ø)

... and 25 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a3dd11b...a3e619b. Read the comment docs.

Also, the servers should pull from the URI that is there in the metadata. The way we should solve this is to change the URI in the metadata to point to a remote store for completed realtime segments

Also, the servers should pull from the URI that is there in the metadata. The way we should solve this is to change the URI in the metadata to point to a remote store for completed realtime segments

Are you suggesting in case of non-local storage, Pinot servers by-pass Pinot controllers to download the segment from remote directly. I think that is a good idea (and we in fact talked out this during last meeting) but it is out of scope of this PR in my opinion because:
(1) PinotSegmentUploadRestletResource right now does not work with Pinot FS -- so it is a bug we should fix unless we want to delete this resource.
(2) Currently in LLC, in the common path the commit servers anyway need to pass segments to Pinot controller during commit. The download segment path is in fact a less common code path. So I do not see the point of doing the less common path optimization before we solve the whole problem of by-passing Pinot controller for segment data transfer.

Let's avoid the extra copy in the localFS case. Like you suggested, adding an isLocal check should be an okay approach for now.
One thing we could do is  push the entire logic of fetching file and building Response into the PinotFS interface. But that wouldn't be very clean either, as it is too specific a task for an FS to perform.

Let's avoid the extra copy in the localFS case. Like you suggested, adding an isLocal check should be an okay approach for now.
One thing we could do is push the entire logic of fetching file and building Response into the PinotFS interface. But that wouldn't be very clean either, as it is too specific a task for an FS to perform.

Ok. I filed a new PR #4757 to replace this one which is too old to update.

No longer need as fixed by #4808


[WIP] Messaging status

Description

Type of change

[ ] Docs change / dependency upgrade
[ ] Configuration / tooling changes
[ ] Refactoring
[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Requires changes in customer code

High-level change(s) description - from the user's perspective

Related Issue(s)
Fixes
Related pull request(s)

Looks good I will add to ops.


Allow users to search for a trait AND an author at same time

Enhance to enable a search for a trait AND an author at the same time. E.g. neale height returns nothing.
Examples where search doesn't fit our needs:
TNF gives a list of genes matching TNF prefix but not TNF itself
neale height returns no data

@edm1 exact match properly works right now. I will deploy it later


Fit view on graph load but when dragging it goes back to (0, 0)

https://user-images.githubusercontent.com/16015833/120658453-bddcf100-c485-11eb-988c-0b42027727fd.mp4
It's happening when the Flow component is unmounted and mounted back. Here is a codesandbox reproduction.
Click on "Another view" then click back to "Flow view" and try to drag the Graph

I'm encountering the same. I've tried setting reactFlowInstance to a React state variable in onLoad, and calling fitView when clicking a button, but it had the same effect.

Hey @baptisteArno
could you try to wrap the ReactFlow component with a ReactFlowProvider?

Yup! It seems to do the trick 👍


Fix skeleton issues

Fixes yaw reset condition, head length condition, and replaces String.format with inline string format from Kotlin.
Needs to be tested before being merged.

Tested myself and found the neck still wasn't being updated, so I made it update all the nodes since this code isn't run often and doing so will just prevent any future bugs like that
Other than that, it seems to work for me, though I haven't tested thoroughly


TNBC Subscriptions

How would you describe your project?
TNBC Subscriptions - A method for SaaS owners to enable subscription of their product using TNBC coins directly.
What problem does it solve?
Even it is fast but at the time of recurring payment user has to click the button again and pay using TNBC on checkout, if this is possible, then user can just set the subscription with TNBC based on the product value and it will convert to TNBC coins and charge user TNBC coins based on the converted value.
Who is the target market?
SaaS Products, Digital E-Commerce
What do you think is the opportunity of this project?
It will be a great thing, As it will reduce the pain of user to pay again at the time of recurring payment so it will just automate the flow.
Are there any competitors?
No One
What are your goals and objectives?
To setup Recurring payments in TNBC and reduce the subscription pain
How will you evaluate project success?
on a scale of 1-10, i think this will be a 10 (great product).
By posting this issue, I (author of this issue) allow my project idea to be used by other people for any commercial as well as non-commercial purposes and I'll not be liable for misuse of my idea.

https://www.reddit.com/r/thenewboston/comments/q34q42/decentralized_subscriptions_payments_with_keysign/