chore: replace gh-pages output with index.html redirect

Relates to #12211
Motivation
Clear gh-pages and setup redirect to ReadTheDocs so users can easily find the new versioned docs
Modifications

[x] setup redirect to readthedocs

Verification

I'm up for an auto-redirect solution also (javascript or .htaccess).  This solutio is SEO friendly but not automated. wdyt?

Although "ugh", this is probably the nicer way to do things for the long term rather than throwing an automated solution in.

I'm up for an auto-redirect solution also (javascript or .htaccess). This solution is SEO friendly but not automated. wdyt?

If I'm reading the changes correctly, this change just makes all GH pages 404 and redirect to the RTD index page? As in, they do not redirect to the same page in RTD?
Per my comment in the original issue, redirects are incredibly important, especially for docs, as they should be reliable (semi-)permalinks. Otherwise I would reference versioned permalinks of the raw markdown on GitHub.
Breaking all existing docs links is simply not an option in my book and is a very, very bad UX that nullifies benefits of a change. The last 6+ years of docs links will just no longer be useful.
We should have proper back-end redirects for all the current docs pages.

Although "ugh", this is probably the nicer way to do things for the long term rather than throwing an automated solution in.

Redirects are one-offs. Once we create all the redirects of the existing docs pages, we would not add any more. New links would only be added to RTD

https://github.com/lionello/lionello.github.io/commit/c175f6524a53e29aea1890c8a758afd0e8944852 shows a way of doing a 404 style redirect which honors the original path. This isn't exactly what @agilgur5 is after, as it will work for currently non-existent pages, but is probably a decent workaround rather than having hundreds of individual redirects.

This isn't exactly what @agilgur5 is after

It's also not a proper back-end redirect. That's the front-end sending you to a new URL, which has different semantics than a redirect (in a handful of ways).
The meta elements attempt to replicate the semantics, and so are closer. They also make more sense for SEO.
We would also want some styling and a message on screen for users (including the standard "click this link if you are not redirected automatically") for the best UX, as the page will be at least temporarily visible.

but is probably a decent workaround rather than having hundreds of individual redirects.

They will all be identical pages except for the link itself, so I do think we can generate those fairly straightforwardly once we have a good base page.
This is a one-time effort, and so I think it is well worth the extra effort given the 6+ years of links that will be impacted.

@agilgur5 @terrytangyuan I agree the redirects are absolutely required.  Going to try the GitHub pages external-sites.json file and see if that results in what we want.  It will most likely result in meta tags and that helps SEO, like @agilgur5 said, but isn't a backend redirect.  Will test.

Will fix conflicts also

Going to try the GitHub pages external-sites.json file and see if that results in what we want.

Oh that's not for GH Pages, that's for the GH Docs themselves (which have been open-source the past few years). Their own contributing docs are also hosted on GH's Docs, which is a little confusing since. It pops up on some searches for GH Pages things unfortunately which does not help

Closing temporarily to prevent workflows from firing.  Testing in my fork.  Will reopen once satisfied.

Replaced by #12362


Swaggo generates SwaggerInfo var in Mac, but it generates SwaggerInfo_swagger var in Windows 10

Describe the bug
In mac, when I execute swag init, it generates docs/docs.go as it should.
I can also define in the runtime the host as described in the guideline
For example: docs.SwaggerInfo.Host = "petstore.swagger.io"
However, when I tried it in windows 10, it generates a different variable name, which is SwaggerInfo_swagger in docs/docs.go.
As a consequence, I have to update my runtime code to something like docs.SwaggerInfo_swagger.Host = "petstore.swagger.io"
To Reproduce
Steps to reproduce the behavior:

Use Windows 10 OS
Go to your Golang project that has Swaggo installed
Execute swag init
Try to set the host during run time (docs.SwaggerInfo.Host="petstore.swagger.io")
It will complain that it cannot find SwaggerInfo, where in Mac environment, it works just fine.
Then, you have to fix the one in windows by changing it to SwaggerInfo_swagger

Expected behavior
When generating in Windows 10, the variable name should be SwaggerInfo instead of SwaggerInfo_swagger.
This difference makes working in a team where we have different PCs (Windows and Mac) a bit more tricky since every time one of us generates the spec, we have to also update the runtime code.
Screenshots
In Mac, where it works perfect

In Windows 10, where it somehow adds this _swagger

Your swag version
v1.7.9
Your go version
1.17
Desktop (please complete the following information):

OS: Windows 10
Browser: irrelevant
Version: irrelevant

Please use swag 1.7.9-p1 so SwaggerInfo won't have the _swagger prefix.
see https://github.com/swaggo/swag/issues/1126
install via cmd line or download the binary from the release page.
go install<EMAIL_ADDRESS>

I just tested it and it works. Thanks!
Anw, thanks for the awesome library!


WIP: vtol pusher for mc cruise

first attempt at standard vtol using pusher for forward flight in MC mode

Currently facing SITL issues

I didn't review the patch line by line, but the general architecture is looking great!

@sanderux I fixed this up and tested it in SITL. It works really well. You can also test it in manual mode with a game pad, flies great! I assume the problems you had were related to timing, I don't have any issues so far.

@AndreasAntener @SimonWilks Please add to test flight queue

Outside tested, flies fantastic!
Manual flight
Log: http://logs.uaventure.com/view/ZRcMKLShRphYSju4DcC2cN
Video:  https://drive.google.com/file/d/0B27AvDmVit4KOVJtcjMtTk9SdzA/view?usp=sharing
/cc @AndreasAntener @LorenzMeier

And a mission mode, it seemed to overshoot the waypoint a little bit
Log: http://logs.uaventure.com/view/WTgKa7RtKGBEnBwBJXWSR3
Video: https://drive.google.com/file/d/0B27AvDmVit4KQkNHTlhfc002Wms/view?usp=sharing

Nice! I presume we are sure that the back pitch / braking motion is not affected by this patch?
The other question I have is on the control accuracy: do we maybe always need to provide a reasonable amount of forward pitch with the quad motors to ensure attitude authority and only add some additional force with the pusher?
My apologies if that's already done, just from the ground track it looks like the dynamics changed considerably.

The back pitch was all me, it was to see if it would not engage the pusher: http://logs.uaventure.com/view/ZRcMKLShRphYSju4DcC2cN#RC_Raw_PLOT
The setpoint is updated to 5 degrees max (param), so it is indeed adding a little forward pitch while flying with pusher: https://github.com/PX4/Firmware/pull/3848/files#diff-e77eee61c15714b4d081bdf856470e46R292.
From a flight perspective it was perfect in manual flight.
in mission it felt like it overshot the waypoints a little bit.

What is the transfer function for the pusher? We likely need to reduce its influence quite a bit to match the other axis.

The influence seemed quite low when flying. Maybe we could go even less, tomorrow there will be some wind for me to test in.

A mission on this branch shows a very big overshoot on the back transition.
There was 23kph (6.3m/s) wind, the forward and back transition where done nose in wind.
Log: http://logs.uaventure.com/view/EJHhFbmVrkJ3S9cJuwYdmB
Video: https://drive.google.com/file/d/0B27AvDmVit4KRF9rRGFFVjNaTkE/view

This is a manual flight in high wind conditions. In loiter the pusher was not used:
Log: http://logs.uaventure.com/view/yeabxkikE26QMKyCPxrbGQ
Video: https://drive.google.com/file/d/0B27AvDmVit4KLVVyazdqTWNRZkE/view?usp=sharing

@sanderux I'll look at the logs and see if we can improve something.

This could also be related to my 4 sec back trans. I'll try 3 next time

@sanderux Generally, I don't see how this PR could influence the overshooting of the waypoints. The backtransition is done open loop (position controller not active) and as soon as it kicks in it will try to brake rather than to use the pusher to fly forward. I think we could address the overshooting in a different issue and bring this one in. What do you think? @AndreasAntener

What about the comment from Lorenz?

What is the transfer function for the pusher? We likely need to reduce its influence quite a bit to match the other axis.

This was also the reason why I asked you if the velocity controller might have difficulties, because it will react differently in one direction compared to the others.

@AndreasAntener It depends on your pusher motor. If it's thrust characteristics are very different to the quad motors then we might need a parameter to scale it down or up.

@AndreasAntener So let me add a parameter which we set to 1 as default. The log files should show if the parameter needs to be adjusted.

@tumbili cool
@sanderux I quickly checked your logs for the overshoot. It still had quite some speed after the 4 sec back transition so it traveled even further. The problem is not the pusher (it's not active during the back transition) but the actually the position controller who doesn't know you were still floating off path after the transition. I have an idea how we can resolve this, hoping to have something soon.

The overshoot is not the back transition (it overshoots there too but that was not what i meant). The overshoot is noticeable when it travels to the final land waypoint.
What i think is happening is that the efficiency with which the pusher moves the vehicle through the air is much higher so it holds more kinetic energy. I have limited the max horizontal velocity to improve backtrans performance but this seems to cause a little overshoot, that overshoot is bigger with pusher engaged.

I forgot to mention i see this overshoot happening in normal MC navigation too:
have a look here: http://logs.uaventure.com/view/WTgKa7RtKGBEnBwBJXWSR3
There is no transition, only manual flight and massive overshoot

@sanderux @AndreasAntener I added a parameter "VT_FWD_THRUST_SC" to allow scaling of the pusher thrust used to accelerate forward. This is rebased on master.

Nice, sounds like we can move to test flights!
On Tue, Mar 29, 2016 at 10:40 AM, Roman Bapst<EMAIL_ADDRESS>wrote:

@sanderux https://github.com/sanderux @AndreasAntener
https://github.com/AndreasAntener I added a parameter
"VT_FWD_THRUST_SC" to allow scaling of the pusher thrust used to accelerate
forward. This is rebased on master.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/PX4/Firmware/pull/3848#issuecomment-202779568

Hey, great stuff, did a manual and a mission flight today:
http://logs.uaventure.com/view/vfaf9nL4JEBc45Rau5UzV7
http://logs.uaventure.com/view/4ECff5bcpDosoX8JzF2TDo

Nice! Good to merge then?

I have one question after looking at my logs: do we have an issue in the attitude controller because it now never actually meets the pitch setpoint?

@AndreasAntener Hehe, I think flight performance is ok because the vehicle should not be pitching forward because we instead are using the pusher to move forward. However, you are right in the sense that we should correct the desired pitch angle in the attitude setpoint topic. I'll do that quickly!

@LorenzMeier @AndreasAntener @sanderux Fixed, can be merge after check pass!

Oh, now that I see your fix I of course I got this wrong. Thanks for the log fix, will prevent further confusion on my side ;)

@sanderux @AndreasAntener @LorenzMeier One more thing. Do you think we should disable this when the throttle scale parameter is set to 0?

I mean do we want to give a user the chance to fly old school?

That reminds me, although it would be very cool to have this enabled by default, there is a problem for VTOLs like ours where we don't have any FW prop clearance on the ground. Depending on the takeoff or landing it could spin it up. ?

@AndreasAntener I should have never said anything :-D

Could you enable it depending on ground offset at boot from a range finder please? ;)

I think the final approach could also be based on baro then the offset is high enough.
even my delta ing is able to hold attitude when not moving. and descend doesnt really take a high toll on the quad drive

Merged!


Pretty printed files, updated some styles and added validation

I had to pretty print some files to understand logic. Updated Login page and Signup page style and added basic validation. Updated Login and signup button.
Related to issue #7

i will check this code
@aryan31200

i have find only a change in the login page then why did you change a lot of files
change only the files you needed
not some broiler codes

Okay let me update my pr


how could i use i in my terminal

i install i succeed.
but i don't know what to do next.
i enter "wast2wasm" in my terminal ,but "commond not found"

hope for helping,sorry for bothering you.

i seem like a problem on 'yarn'

I surrender,decide to use "npm"


⚠ Bofrost.de has degraded performance

In 98ad0bc, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 715 ms

Resolved: Bofrost.de performance has improved in a1ff50a after 7 minutes.


ASP.NET Migration TOC issue

[ ] Remove MVC 3 Music Sore or maybe move under Older version 1, 2 and 3 and don’t surface any of the tutorials

@Rick-Anderson There are only two Music store tutorials in the TOC and one is clearly marked MVC 3 and the other is clearly marked MVC 2 -- why do these need to be removed?

They don't need t be remove but they are so old they are of little value.  Probably close this issue now.


FileSystemException: Cannot delete file, path..... when adding data to DB

Cant seem to add data to my DB. I get the error
`FileSystemException: Cannot delete file, path = '/data/user/0/com.thePlay/app_flutter/expenses.data.bak' (OS Error: No such file or directory, errno = 2)
File._delete. (dart:io/file_impl.dart:295:9)
RootZone.runUnary (dart:async/zone.dart:1379:54)
FutureListener.handleValue (dart:async/future_impl.dart:129:18)
Future._propagateToListeners.handleValueCallback (dart:async/future_impl.dart:642:45)
Future._propagateToListeners (dart:async/future_impl.dart:671:32)
Future._completeWithValue (dart:async/future_impl.dart:486:5)
Future._asyncComplete. (dart:async/future_impl.dart:516:7)
_microtaskLoop (dart:async/schedule_microtask.dart:41:21) _startMicrotaskLoop (dart:async/schedule_microtask.dart:50:5)`

same issue :(

@alaindixon I stopped using the library and started using Sembast DB which offers better performance and no read and write errors.

I have moved for Sembast, it's far better, thank you ;)

Can you show me the code which leads to this error?

 Future deleteCapturedData(String projectId) async {
     Directory appDocDir = await getApplicationDocumentsDirectory();
    String dbFilePath = appDocDir.path + "/op_" + projectId + ".data";
    var db = ObjectDB(dbFilePath);
    db.open();
    await db.remove({});
    await db.close();
  }

@marioreggiori
I think the issue is found at objectdb_base.dart around line 95. It tries to remove the .bak file but for some reason (I guess a separate bug) it doesn't exist. A quick workaround this is to check weather or not the backup file exist before removing it:
if (await backupFile.exists()) await backupFile.delete();

@marioreggiori
I think the issue is found at objectdb_base.dart around line 95. It tries to remove the .bak file but for some reason (I guess a separate bug) it doesn't exist. A quick workaround this is to check weather or not the backup file exist before removing it:
if (await backupFile.exists()) await backupFile.delete();

Never mind, the issue still persist after the change above ;(

Put false inside db.open(). Like this:
db.open(false);
It's the parameter "tidy up".
Should resolve.


add mandatory annotation

add mandatory annotation for extension to be compliant with Rancher 2.10 systems and above

2.0.2 is only for Rancher pre-2.10(Vue2). For Rancher 2.10 +, we made 2.1.0 branch


Query attribute order should not matter

Describe the bug
Currently when attribute decorating a query the order of the attributes must be in this order or it does not apply the filters
[UsePaging]
[UseFiltering]
[UseSorting]
public IQueryable<Person> GetPeople([Service] DataContext dataContext) =>
            dataContext.People;

If you move [UseSorting] to the middle then sorting won't apply. If [UseFiltering] is the last option then it won't apply filters.
Based on the iQueryable they should probably be able to be applied dynamically in any order I believe without causing any problems

This is actually a main feature and helps to bring in middleware semantic... what you can do with the attributes is form a pluggable pipeline.
We have described the resolver pipeline in this blog post:
https://dev.to/michaelstaib/get-started-with-hot-chocolate-and-entity-framework-e9i
I will close this issue since this is a fundamental of Hot Chocolate.


[Style] Make Basic Calculator responsive

What's the style idea?
In desktop view, we have the access to switch to dark/light mode. but it is  not accessible in mobile view. Also the contents fill the whole screen, I would like to add some margin.
Mobile view:

Desktop view:

Checklist

[X] I have checked the existing issues.
[X] I follow Contributing Guidelines of this project.
[X] I am a GSSOC'24 contributor.
[ ] I am a IWOC'24 contributor.
[ ] I am a JWOC'24 contributor.
[ ] I am a SWOC'24 contributor.

Code of Conduct

[X] I agree to follow this project's "Code of Conduct".

Pls complete your previous issues @m3kvt

Pls complete your previous issues @m3kvt

I have completed my previous issues. Can you assign me this now?


ConnectionKeepAliveStrategy didn't use a keepAlive value from HttpClientConfiguration

Since default value of connectionKeepAlive value in RequestConfig is 3 minutes, the following logic will always have 3 minutes for TimeValue duration if server didn't return keep-alive in HTTP response.
public TimeValue getKeepAliveDuration(HttpResponse response, HttpContext context) {
                    final TimeValue duration = super.getKeepAliveDuration(response, context);
                    return (duration.getDuration() == -1) ? TimeValue.ofMilliseconds(keepAlive) : duration;
                }

RequestConfig in Apache HTTP client.
https://github.com/apache/httpcomponents-client/blob/master/httpclient5/src/main/java/org/apache/hc/client5/http/config/RequestConfig.java#L46
It may miss this logic .setConnectionKeepAlive(keepAlive > 0 ? TimeValue. ofMilliseconds(keepAlive) : null) in below code?
https://github.com/dropwizard/dropwizard/blob/release/4.0.x/dropwizard-client/src/main/java/io/dropwizard/client/HttpClientBuilder.java#L370
        final long keepAlive = configuration.getKeepAlive().toMilliseconds();

        final RequestConfig requestConfig
                = RequestConfig.custom().setCookieSpec(cookiePolicy)
                .setResponseTimeout(timeout, TimeUnit.MILLISECONDS)
                .setConnectionKeepAlive(keepAlive > 0 ? TimeValue. ofMilliseconds(keepAlive) : null)
                .setConnectTimeout(connectionTimeout, TimeUnit.MILLISECONDS)
                .setConnectionRequestTimeout(connectionRequestTimeout, TimeUnit.MILLISECONDS)
                .build();

This is causing a HTTP call error when Dropwizard HTTP client is trying to communicate with Dropwizard HTTP server since Dropwizard HTTP server's default idle timeout is 30 seconds. After 30 seconds, subsequent HTTP requests will fail from Drowizard HTTP client.

Hi @nsclass. When looking where the result of this call is used, setting this value only for the DefaultConnectionKeepAliveStrategy feels like a duplication. Maybe we can emulate the behavior of HttpClient 4.5.x and always set the value to -1 to use the user-provided value through our custom DefaultConnectionKeepAliveStrategy instead.

applied changes as suggested in PR. Please have a look.
https://github.com/dropwizard/dropwizard/pull/7027/files


Add configuration for healthchecks that use https

The datagovuk_publish app's host uses https and is on the Paas,
the rest of our gov.uk apps use http and is served internally.
The check_json_healthcheck now has an additional parameter to
accept a protocol, if one isn't specified it defaults to http.

I think you'll also need to add protocol to https://github.com/alphagov/govuk-puppet/blob/852d805025f36b14be67e8e994b902084e28f86c/modules/monitoring/manifests/checks/datagovuk_publish.pp#L16 and then include it in the Icinga block below check_app_health!check_json_healthcheck!${port} ${health_check_path} ${host} ${protocol}.

Thanks @cbaines @thomasleese I've made those changes now


Type System.Lazy`1 is not found in compilation.

I got the following error in generator on Windows (on OS X everything is fine):
warning CS8785: Generator 'MemoryPackGenerator' failed to generate source. It will not contribute to the output and compilation errors may occur as a result. Exception was of type 'InvalidOperationException' with message 'Type System.Lazy`1 is not found in compilation.'

The problem place is Compilation.GetTypeByMetadata method invoke. I'm not sure, but I'm guessing Lazy is defined in mscorlib and nunit.framework at the same time. Generator without System_Lazy_T (or similar name) works on Windows fine.

Thanks, but is this just a legacy NUnit issue?
https://github.com/nunit/nunit/issues/1644


As an admin, I should only be able to delete items that have been suppressed so that I can't leave the pairtree data in an inconsistent state.

dev notes

[ ] extend delete method on  DigitizedWork and only allow if status is suppressed
[ ] extend queryset delete method and only allow if all items in the queryset have status suppressed
[ ] in django admin, if user tries to delete an unsuppressed record they should see an error message explaining why it failed

Where are we on this? Is this for the next milestone?

yes, let's create a v3.10 and move it there


Change return type of CircuitRepeatBlock.name to str

The correct return type for this method should be str as the documentation guarantees that this specific method returns "REPEAT".
Fixes #776

Good idea, but you edited the generated docs instead of the source. I finished this in https://github.com/quantumlib/Stim/pull/783


feat: Add JSON schema, adjust documentation and defaults

Adjust error messages
Add documented defaults for FlushBytes
Reason for This PR
Following my work in the roadrunner org where I've been moving all JSON schemas to the repos they belong to, here is that same change for temporal.
Description of Changes
Added JSON schema.
Adjusted some error messages (syntax, grammar) and added default values according to documentation.
License Acceptance
By submitting this pull request, I confirm that my contribution is made under
the terms of the MIT license.
PR Checklist
[Author TODO: Meet these criteria.]
[Reviewer TODO: Verify that these criteria are met. Request changes if not]

[ ] All commits in this PR are signed (git commit -s).
[ ] The reason for this PR is clearly provided (issue no. or explanation).
[ ] The description of changes is clear and encompassing.
[ ] Any required documentation changes (code and docs) are included in this PR.
[ ] Any user-facing changes are mentioned in CHANGELOG.md.
[ ] All added/changed functionality is tested.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 40.06%. Comparing base (c8e0bcf) to head (c5a93ee).
Report is 299 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff             @@
##           master     #570       +/-   ##
===========================================
+ Coverage   22.67%   40.06%   +17.38%
===========================================
  Files           4       14       +10
  Lines         269      936      +667
===========================================
+ Hits           61      375      +314
- Misses        206      518      +312
- Partials        2       43       +41

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


ODK-X Survey - Set Contrast For Accessibility

The background colour and text colour needs to be adjusted on the warning toast. https://docs.odk-x.org/survey-sample-app/

I would like to be assigned to this task.

Hi @damiadejoro,
I'll refer this issue to @elmps2018, who has done a lot of work on docs.
And please note that this issue won't count towards an Outreach application. Although it is user experience related, Outreachy scope is focussed on the mobile applications.
Thanks

Hello @maprehensive, please I need more clarity on what you mean.
I hope this means we can go ahead with the interface designs and UI components of the mobile applications on a design tool

Hi @damiadejoro, here's the link to each of the ODK-X apps. Click the link to see the releases and check the assets to download the apks to your device.

Survey
Services
Tables

If it isn't clear, let me know

I understand there are three apps, yeah. What I don't understand is what I am meant to do when I haven't been assigned a task.

Hi @damiadejoro, please go ahead and comment on other tasks you might want. This one is going to need PMC review before we decide to implement it so it will be some time before we can make a decision if it should be implemented. Sorry about that!


Add missing application grant types in the new Console

Is your suggestion related to an experience ? Please describe.

We need to bring in the missing application grant type in the new Console. We need to discuss what grant types should be essentially included.

The following grant types are already available in the unified console, displayed to the end user depending on the application template.

Code
Implicit
Password
Client credentials
Refresh token
Device code
Token exchange
Organization switch

The following shows the missing grant types, and whether they should be included in the unified console along with the reasons.

grant type
included in the unified console
reasoning

SAML2
-
-

IWA-NLTM
YES
This will be required for the windows app template

account_switch
NO
due to https://github.com/wso2/product-is/issues/8806

jwt-bearer
-
-


CUDA_ERROR_OUT_OF_MEMORY: out of memory

Hi StarDist team,
After installing StarDist on our cluster and adjusting it to the requirements, there is this error appearing in the terminal while training the model:

2019-07-05 15:26:03.689271: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at cwise_ops_common.cc:70 : Resource exhausted: OOM when allocating tensor with shape[64] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
2019-07-05 15:26:03.691201: E tensorflow/stream_executor/cuda/cuda_driver.cc:806] failed to allocate 7.67M (8041216 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory"

So far I have tried to modify the notebook to set the GPU memory grows up to 90%:
config = tf.ConfigProto()
config.gpu_options.per_process_gpu_memory_fraction = 0.9
session = tf.Session(config=config, ...)

which results to other error.
It is highly appreciated if you help me to find a solution.

Hi, thank you for trying things out.
Without more details, it's difficult for me to know why you're getting this error. First candidates to check are too large batch and/or patch sizes.
Also, if no other process needs the GPU it's best to not set any memory limits.
In case you do need to do that, I suggest to use the function limit_gpu_memory (from csbdeep.utils.tf import limit_gpu_memory).
Best,
Uwe

Hi, sorry for responding late. I was out of office for more than a week.
Actually I am trying to overwrite a limitation on the GPU memory. My aim is to use the 90% or more capacity of the GPU memory
I am trying to run the code to train the model on a cluster which is equipped with GPU. Unfortunately I do not have access to the specifications so far.
However, I will try also lowering the batch sizes

Closing for now (as it seems to not be related with the code specifically)


Deployment to Managed endpoint is crashing

Describe the bug
A clear and concise description of what the bug is.
I have tried to deploy model to managed endpoint using SDK V2 I have given all the required configuration settings i.e. Docker Image, Model pickle file and Scoring file but while provisioning deployment it crashing. Please help me fix it. thank you.
Exception or Stack Trace
Add the exception log and stack trace if available
To Reproduce
Steps to reproduce the behavior:
Code Snippet
Add the code snippet that causes the issue.
model = Model(path="./Data-Science/Trained_Model/model.pkl")
env = Environment(
conda_file="./Data-Science/Trained_Model/conda.yaml",
image="mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04:20220616.v1",
)
blue_deployment = ManagedOnlineDeployment(
name="d-one",
endpoint_name=online_endpoint_name,
model=model,
environment=env,
code_configuration=CodeConfiguration(
code="./Data-Science/scoring", scoring_script="score.py"
),
instance_type="Standard_F4s_v2",
instance_count=1,
)
ml_client.online_deployments.begin_create_or_update(deployment=blue_deployment)
Expected behavior
A clear and concise description of what you expected to happen.
Deployment Successful.
Screenshots
If applicable, add screenshots to help explain your problem.
Instance status:
SystemSetup: Succeeded
UserContainerImagePull: Succeeded
ModelDownload: Succeeded
UserContainerStart: InProgress
Container events:
Kind: Pod, Name: Pulling, Type: Normal, Time: 2022-09-21T13:12:04.810312Z, Message: Start pulling container image
Kind: Pod, Name: Downloading, Type: Normal, Time: 2022-09-21T13:12:04.857318Z, Message: Start downloading models
Kind: Pod, Name: Pulled, Type: Normal, Time: 2022-09-21T13:13:46.824143Z, Message: Container image is pulled successfully
Kind: Pod, Name: Downloaded, Type: Normal, Time: 2022-09-21T13:13:46.824143Z, Message: Models are downloaded successfully
Kind: Pod, Name: Created, Type: Normal, Time: 2022-09-21T13:13:46.973159Z, Message: Created container inference-server
Kind: Pod, Name: Started, Type: Normal, Time: 2022-09-21T13:13:47.06337Z, Message: Started container inference-server
Container logs:
/bin/bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by /bin/bash)
/bin/bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by /bin/bash)
2022-09-21T13:13:47,058798056+00:00 - gunicorn/run
2022-09-21T13:13:47,060153990+00:00 - rsyslog/run
2022-09-21T13:13:47,060869707+00:00 | gunicorn/run |
bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by bash)
2022-09-21T13:13:47,062360944+00:00 | gunicorn/run | ###############################################
2022-09-21T13:13:47,062846656+00:00 - iot-server/run
2022-09-21T13:13:47,064079287+00:00 | gunicorn/run | AzureML Container Runtime Information
2022-09-21T13:13:47,064829705+00:00 - nginx/run
2022-09-21T13:13:47,065537123+00:00 | gunicorn/run | ###############################################
2022-09-21T13:13:47,066757553+00:00 | gunicorn/run |
2022-09-21T13:13:47,068248890+00:00 | gunicorn/run |
2022-09-21T13:13:47,070585448+00:00 | gunicorn/run | AzureML image information: openmpi4.1.0-ubuntu20.04, Materializaton Build:20220616.v11
2022-09-21T13:13:47,072696200+00:00 | gunicorn/run |
2022-09-21T13:13:47,075219262+00:00 | gunicorn/run |
rsyslogd: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libuuid.so.1: no version information available (required by rsyslogd)
2022-09-21T13:13:47,079050357+00:00 | gunicorn/run | PATH environment variable: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/bin:/opt/miniconda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2022-09-21T13:13:47,087153358+00:00 | gunicorn/run | PYTHONPATH environment variable:
2022-09-21T13:13:47,091169057+00:00 | gunicorn/run |
2022-09-21T13:13:47,092708895+00:00 | gunicorn/run | Pip Dependencies (before dynamic installation)
EdgeHubConnectionString and IOTEDGE_IOTHUBHOSTNAME are not set. Exiting...
/bin/bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by /bin/bash)
2022-09-21T13:13:47,135979965+00:00 - iot-server/finish 1 0
2022-09-21T13:13:47,137118693+00:00 - Exit code 1 is normal. Not restarting iot-server.
adal==1.2.7
alembic==1.8.1
applicationinsights==0.11.10
argcomplete==2.0.0
arviz==0.11.2
attrs==22.1.0
azure-common==1.1.28
azure-core==1.24.2
azure-graphrbac==0.61.1
azure-identity==1.10.0
azure-mgmt-authorization==2.0.0
azure-mgmt-containerregistry==10.0.0
azure-mgmt-core==1.3.1
azure-mgmt-keyvault==10.0.0
azure-mgmt-resource==21.1.0
azure-mgmt-storage==20.0.0
azure-storage-blob==12.9.0
azure-storage-queue==12.4.0
azureml-automl-core==1.44.0
azureml-automl-runtime==1.44.0
azureml-core==1.44.0
azureml-dataprep==4.2.2
azureml-dataprep-native==38.0.0
azureml-dataprep-rslex==2.8.1
azureml-dataset-runtime==1.44.0
azureml-defaults==1.44.0
azureml-inference-server-http==0.7.4
azureml-interpret==1.44.0
azureml-mlflow==1.44.0
azureml-pipeline-core==1.44.0
azureml-responsibleai==1.44.0
azureml-telemetry==1.44.0
azureml-train-automl-client==1.44.0
azureml-train-automl-runtime==1.44.0
azureml-train-core==1.44.0
azureml-train-restclients-hyperdrive==1.44.0
azureml-training-tabular==1.44.0
backcall==0.2.0
backports.tempfile==1.0
backports.weakref==1.0.post1
bcrypt==3.2.2
bokeh==2.4.3
boto==2.49.0
boto3==1.15.18
botocore==1.18.18
cachetools==5.2.0
certifi @ file:///opt/conda/conda-bld/certifi_1655968806487/work/certifi
cffi==1.15.1
cftime==<IP_ADDRESS>
charset-normalizer==2.1.0
click==7.1.2
cloudpickle==1.6.0
cmdstanpy==0.9.5
configparser==3.7.4
contextlib2==21.6.0
convertdate @ file:///tmp/build/80754af9/convertdate_1634070773133/work
cryptography==37.0.4
cycler @ file:///tmp/build/80754af9/cycler_1637851556182/work
Cython==0.29.28
dask==2.30.0
databricks-cli==0.17.0
dataclasses==0.6
debugpy==1.6.2
decorator==5.1.1
dice-ml==0.8
dill==<IP_ADDRESS>
distributed==2.30.1
distro==1.7.0
docker==5.0.3
dotnetcore2==3.1.23
dowhy==0.8
econml==0.12.0
entrypoints==0.4
ephem @ file:///tmp/build/80754af9/ephem_1638960312619/work
erroranalysis==0.3.6
fairlearn==0.7.0
fbprophet @ file:///home/conda/feedstock_root/build_artifacts/fbprophet_1599365534439/work
fire==0.4.0
Flask==2.1.3
Flask-Cors==3.0.10
flatbuffers==2.0
fonttools==4.25.0
fsspec==2022.7.1
gensim==3.8.3
gitdb==4.0.9
GitPython==3.1.27
google-api-core==2.8.2
google-auth==2.9.1
googleapis-common-protos==1.56.4
greenlet==1.1.3
gunicorn==20.1.0
h5py==3.7.0
HeapDict==1.0.1
holidays @ file:///home/conda/feedstock_root/build_artifacts/holidays_1595448845196/work
humanfriendly==10.0
idna==3.3
importlib-metadata==4.12.0
importlib-resources==5.9.0
inference-schema==<IP_ADDRESS>
interpret-community==0.26.0
interpret-core==0.2.7
ipykernel==6.6.0
ipython==7.34.0
isodate==0.6.1
itsdangerous==2.1.2
jedi==0.18.1
jeepney==0.8.0
Jinja2==2.11.2
jmespath==1.0.0
joblib==0.14.1
json-logging-py==0.2
jsonpickle==2.2.0
jsonschema==4.9.1
jupyter-client==7.3.4
jupyter-core==4.11.1
keras2onnx==1.6.0
kiwisolver @ file:///opt/conda/conda-bld/kiwisolver_1653292039266/work
knack==0.9.0
korean-lunar-calendar @ file:///tmp/build/80754af9/korean_lunar_calendar_1634063020401/work
lightgbm==3.2.1
llvmlite==0.38.1
locket==1.0.0
LunarCalendar @ file:///tmp/build/80754af9/lunarcalendar_1646383991234/work
Mako==1.2.2
MarkupSafe==2.0.1
matplotlib @ file:///tmp/build/80754af9/matplotlib-suite_1634667019719/work
matplotlib-inline==0.1.3
mkl-fft==1.3.0
mkl-random==1.1.0
mkl-service==2.3.0
ml-wrappers==0.2.0
mlflow==1.29.0
mlflow-skinny==1.27.0
mpi4py==3.1.3
mpmath==1.2.1
msal==1.18.0
msal-extensions==1.0.0
msgpack==1.0.4
msrest==0.7.1
msrestazure==0.6.4
munkres==1.1.4
ndg-httpsclient==0.5.1
nest-asyncio==1.5.5
netCDF4==1.5.7
networkx==2.5
nimbusml==1.8.0
numba==0.55.2
numpy==1.18.5
oauthlib==3.2.0
onnx==1.12.0
onnxconverter-common==1.6.0
onnxmltools==1.4.1
onnxruntime==1.11.1
opencensus==0.10.0
opencensus-context==0.1.2
opencensus-ext-azure==1.1.5
packaging @ file:///tmp/build/80754af9/packaging_1637314298585/work
pandas==1.1.5
paramiko==2.11.0
parso==0.8.3
partd==1.2.0
pathspec==0.9.0
patsy==0.5.2
pexpect==4.8.0
pickleshare==0.7.5
Pillow==9.0.1
pkginfo==1.8.3
pkgutil-resolve-name==1.3.10
ply==3.11
pmdarima==1.7.1
portalocker==2.5.1
prometheus-client==0.14.1
prometheus-flask-exporter==0.20.3
prompt-toolkit==3.0.30
protobuf==3.20.1
psutil @ file:///tmp/build/80754af9/psutil_1612298016854/work
ptyprocess==0.7.0
py-cpuinfo==5.0.0
pyarrow==6.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
Pygments==2.12.0
PyJWT==2.4.0
PyMeeus @ file:///tmp/build/80754af9/pymeeus_1634069098549/work
PyNaCl==1.5.0
pyOpenSSL==22.0.0
pyparsing @ file:///tmp/build/80754af9/pyparsing_1635766073266/work
PyQt5-sip==12.11.0
pyrsistent==0.18.1
PySocks==1.7.1
pystan==<IP_ADDRESS>
python-dateutil @ file:///tmp/build/80754af9/python-dateutil_1626374649649/work
pytz @ file:///opt/conda/conda-bld/pytz_1654762638606/work
PyYAML==6.0
pyzmq==23.2.0
querystring-parser==1.2.4
raiutils==0.2.0
requests==2.28.1
requests-oauthlib==1.3.1
responsibleai==0.19.0
rsa==4.9
s3transfer==0.3.7
scikit-learn==0.22.1
scipy==1.5.3
SecretStorage==3.3.2
semver==2.13.0
setuptools-git==1.2
shap==0.39.0
sip @ file:///tmp/abs_44cd77b_pu/croots/recipe/sip_1659012365470/work
six @ file:///tmp/build/80754af9/six_1644875935023/work
skl2onnx==1.4.9
sklearn-pandas==1.7.0
slicer==0.0.7
smart-open==1.9.0
smmap==5.0.0
sortedcontainers==2.4.0
sparse==0.13.0
SQLAlchemy==1.4.41
sqlparse==0.4.2
statsmodels==0.11.1
sympy==1.10.1
tabulate==0.8.10
tblib==1.7.0
termcolor==1.1.0
toml @ file:///tmp/build/80754af9/toml_1616166611790/work
toolz==0.12.0
tornado @ file:///tmp/build/80754af9/tornado_1606942283357/work
tqdm @ file:///opt/conda/conda-bld/tqdm_1650891076910/work
traitlets==5.3.0
typing-extensions==4.1.1
urllib3==1.26.9
wcwidth==0.2.5
websocket-client==1.3.3
Werkzeug==2.2.1
wrapt==1.12.1
xarray==0.20.1
xgboost==1.3.3
zict==2.2.0
zipp==3.8.1
2022-09-21T13:13:47,482009924+00:00 | gunicorn/run |
2022-09-21T13:13:47,483196753+00:00 | gunicorn/run | ###############################################
2022-09-21T13:13:47,484262079+00:00 | gunicorn/run | AzureML Inference Server
2022-09-21T13:13:47,485307705+00:00 | gunicorn/run | ###############################################
2022-09-21T13:13:47,486356731+00:00 | gunicorn/run |
2022-09-21T13:13:47,487760366+00:00 | gunicorn/run |
2022-09-21T13:13:47,488771491+00:00 | gunicorn/run | Starting HTTP server
2022-09-21T13:13:47,489786616+00:00 | gunicorn/run |
Starting gunicorn 20.1.0
Listening at: http://<IP_ADDRESS>:31311 (13)
Using worker: sync
worker timeout is set to 300
Booting worker with pid: 64
SPARK_HOME not set. Skipping PySpark Initialization.
Initializing logger
2022-09-21 13:13:48,238 | root | INFO | Starting up app insights client
logging socket was found. logging is available.
logging socket was found. logging is available.
2022-09-21 13:13:48,238 | root | INFO | Starting up request id generator
2022-09-21 13:13:48,238 | root | INFO | Starting up app insight hooks
2022-09-21 13:13:48,238 | root | INFO | Invoking user's init function
2022-09-21 13:13:50,198 | azureml.core | WARNING | Failure while loading azureml_run_type_providers. Failed to load entrypoint automl = azureml.train.automl.run:AutoMLRun._from_run_dto with exception (azure-identity 1.10.0 (/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages), Requirement.parse('azure-identity==1.7.0'), {'azureml-dataprep'}).
Failure while loading azureml_run_type_providers. Failed to load entrypoint automl = azureml.train.automl.run:AutoMLRun._from_run_dto with exception (azure-identity 1.10.0 (/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages), Requirement.parse('azure-identity==1.7.0'), {'azureml-dataprep'}).
00000000-0000-0000-0000-000000000000,RuntimeError
00000000-0000-0000-0000-000000000000,:
00000000-0000-0000-0000-000000000000,module compiled against API version 0xe but this version of numpy is 0xd
00000000-0000-0000-0000-000000000000,ImportError
00000000-0000-0000-0000-000000000000,:
00000000-0000-0000-0000-000000000000,numpy.core.multiarray failed to import
00000000-0000-0000-0000-000000000000,
The above exception was the direct cause of the following exception:
00000000-0000-0000-0000-000000000000,SystemError
00000000-0000-0000-0000-000000000000,:
00000000-0000-0000-0000-000000000000, returned a result with an error set
2022-09-21 13:13:50,861 | root | INFO | Users's init has completed successfully
2022-09-21 13:13:50,863 | root | INFO | Skipping middleware: dbg_model_info as it's not enabled.
2022-09-21 13:13:50,863 | root | INFO | Skipping middleware: dbg_resource_usage as it's not enabled.
Generating swagger file: /tmp/tmp71mgbspf
2022-09-21 13:13:50,865 | root | INFO | Scoring timeout setting is not found. Use default timeout: 3600000 ms
Exception in worker process
Traceback (most recent call last):
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
worker.init_process()
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/workers/base.py", line 134, in init_process
self.load_wsgi()
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi
self.wsgi = self.app.wsgi()
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/app/base.py", line 67, in wsgi
self.callable = self.load()
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 58, in load
return self.load_wsgiapp()
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
return util.import_app(self.app_uri)
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/gunicorn/util.py", line 359, in import_app
mod = importlib.import_module(module)
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1006, in _gcd_import
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 677, in _load_unlocked
File "", line 728, in exec_module
File "", line 219, in _call_with_frames_removed
File "/var/azureml-server/entry.py", line 3, in
app = create_app.create()
File "/var/azureml-server/create_app.py", line 29, in create
app.register_blueprint(main)
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/flask/scaffold.py", line 50, in wrapper_func
return f(self, *args, **kwargs)
File "/azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/python3.7/site-packages/flask/app.py", line 1022, in register_blueprint
blueprint.register(self, options)
File "/var/azureml-server/aml_blueprint.py", line 287, in register
super(AMLBlueprint, self).register(app, options, first_registration)
TypeError: register() takes 3 positional arguments but 4 were given
Worker exiting (pid: 64)
Shutting down: Master
Reason: Worker failed to boot.
/bin/bash: /azureml-envs/azureml_c8c00a9938a621a73a96bb638c5bb085/lib/libtinfo.so.6: no version information available (required by /bin/bash)
2022-09-21T13:13:51,352103193+00:00 - gunicorn/finish 3 0
2022-09-21T13:13:51,353207918+00:00 - Exit code 3 is not normal. Killing image.
Setup (please complete the following information):

Python Version:  Python 3.8
SDK Version: V2

Additional context
Add any other context about the problem here.
Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

[ ] Bug Description Added
[ ] Repro Steps Added
[ ] Setup information Added

Hi @sujithaleshwaram99 thank you for the feedback, I will forward this to @azureml-github for answers.

Hi @l0lawrence thanks for chasing it up. Any updates on this?

Hello,
Thanks for reaching out. At first glance, it seems like your scoring script is using AzureML SDK v1. Could you clarify why you need that and/or share your script?
For your reference, this a sample scoring script used with SDK v2. https://github.com/Azure/azureml-examples/blob/main/cli/endpoints/online/model-1/onlinescoring/score.py
Thanks,
Hugo

Hi @hugoaponte,
I have below script in  score.py.
code snippet:
from azureml.core.model import Model
import os
import joblib
import json
import logging
import numpy
import pandas as pd
def init():
"""
This function is called when the container is initialized/started, typically after create/update of the deployment.
You can write the logic here to perform init operations like caching the model in memory
"""
global model
# AZUREML_MODEL_DIR is an environment variable created during deployment.
# It is the path to the model folder (./azureml-models/$MODEL_NAME/$VERSION)
# Please provide your model's folder name if there is one
model_path = Model.get_model_path(model_name="credit-ci")
model_path = os.path.join(model_path, "model.pkl")
model = joblib.load(model_path)
logging.info("Init complete")
def run(raw_data):
"""
This function is called for every invocation of the endpoint to perform the actual scoring/prediction.
In the example we extract the data from the json input and call the scikit-learn model's predict()
method and return the result back
"""
logging.info("model 1: request received")
#data = json.loads(raw_data)
# data = numpy.array(data)
# result = model.predict(data)
with open(raw_data, 'r', encoding='utf-8') as f:
data = json.load(f)
df = pd.DataFrame.from_dict(data)
sno = df["Sno"]
df = df.drop("Sno", axis=1)
proba = model.predict_proba(df)
proba = pd.DataFrame(data=proba, columns=["ProbaGoodCredit", "ProbaBadCredit"])
result=proba.to_json(orient="records")
logging.info("Request processed")
return result

Thanks, To deploy with SDK V2, you don't need SDK v1 in your scoring script anymore. The example I shared shows the way to load the model:
    global model
    # AZUREML_MODEL_DIR is an environment variable created during deployment.
    # It is the path to the model folder (./azureml-models/$MODEL_NAME/$VERSION)
    # Please provide your model's folder name if there is one
    model_path = os.path.join(
        os.getenv("AZUREML_MODEL_DIR"), "model.pkl"
    )
    # deserialize the model file back into a sklearn model
    model = joblib.load(model_path)

Could you try using this approach?
Thanks,
Hugo


Remove some unused UiConstants

These UI constants are completely unused.
It's technically not every single constant which is unused - but the other ones are 'logical' in that they belong with other like-constants, such as _FOLDER. These ones are very obviously just taking up space.

@miq-bot add_label ui, technical debt

r? @dclarizio


elemental upgrade fails to remount/umount the RW state partition to RO after the upgrade is done

I noted sometimes the elemental upgrade ... call fails just at the cleanup phase (upgrade is done and it just fails to umount/remount state partition, busy device error).
This is a tricky place to fail as then the upgrade is not considered to be applied, but in fact it is already done and the active and passive images are there already updated, hence if the upgrade is retriggered automatically it will apply it again moving the updated active to passive again, hence the old and actually functional OS will be lost.
I noted this behavior sporadically in upgrades executed from rancher and elemental-operator.

Looks similar to this old issue: https://github.com/rancher/elemental-toolkit/issues/1524

Indeed, I have a feeling this might be an sporadic race issue of trying to umount too quickly... as I haven't seen it in consistent basis. I was wondering if it would make sense having some sort of umount retry logic, like try to umount at least N times with one second of sleep in between before actually failing.


loadTode.stone fails with “ERROR message: /usr/bin/env: ‘bash’: No such file or directory”  when using 3.6.5 superDoit:v3.1 [ee6aab0ab3]

Have not determined root cause, as there are other fish that need frying ... see createStone.solo at this commit d3a771f for test case ... that code will probably disappear in a subsequent commit

Here's the contents of the project list window:
aTDMetacelloProjectBrowser
--------------------
|+ FileTree|            28ab532 ^ /tmp/performOnServerInJ9oRfq: 1: git: not found [/tmp/performOnServerInNGVdtp: 1: git: not found]    filetree:///export/bosch1/users/dhenrich/_issue_4/projects/filetree/repository
|+ GLASS1|              35636eb5 ^ /tmp/performOnServerInhIzrls: 1: git: not found [/tmp/performOnServerInWOwH1r: 1: git: not found]   filetree:///export/bosch1/users/dhenrich/_issue_4/projects/glass/repository
|+ Grease|              fbb749f ^ /tmp/performOnServerInn5yO6o: 1: git: not found [/tmp/performOnServerInvD5Tit: 1: git: not found]    filetree:///export/bosch1/users/dhenrich/_issue_4/projects/Grease/repository
|+ Metacello|           b688ffb3 ^ /tmp/performOnServerIn5lbD9q: 1: git: not found [/tmp/performOnServerInRMt4Xp: 1: git: not found]   filetree:///export/bosch1/users/dhenrich/_issue_4/projects/metacello-work/repository
|+ Ston|                733b886 ^ /tmp/performOnServerIn4uiF0o: 1: git: not found [/tmp/performOnServerIneTs6xq: 1: git: not found]    filetree:///export/bosch1/users/dhenrich/_issue_4/projects/ston/repository
|+ Tode|                188d3db71 ^ /tmp/performOnServerIn0r9Cts: 1: git: not found [/tmp/performOnServerInVvTVjs: 1: git: not found]  filetree:///export/bosch1/users/dhenrich/_issue_4/projects/tode/repository
|+ Zodiac|              1ead981 ^ /tmp/performOnServerInL9761r: 1: git: not found [/tmp/performOnServerInTti87o: 1: git: not found]    filetree:///export/bosch1/users/dhenrich/_issue_4/projects/zodiac/repository
|+ PharoCompatibility|                                                                                filetree:///export/bosch1/users/dhenrich/_issue_4/projects/PharoCompatibility/repository
|+ RB|                  e8db8fa ^ /tmp/performOnServerInWkVl7o: 1: git: not found [/tmp/performOnServerInffUWys: 1: git: not found]    filetree:///export/bosch1/users/dhenrich/_issue_4/projects/rb/repository
|+ ZincHTTPComponents|  a459c510 ^ /tmp/performOnServerInIecN3o: 1: git: not found [/tmp/performOnServerInp5PF4q: 1: git: not found]   filetree:///export/bosch1/users/dhenrich/_issue_4/projects/zinc/repository
Gofer                   <IP_ADDRESS> [release]                                                                                http://seaside.gemtalksystems.com/ss/metacello

PharoCompatibility project is not loaded ... but it seems to be connected to a repository.
The repository paths are valid, but the extraction of the git information fails


GetCompositeGlyph Result?

in the function "TFontReader.GetCompositeGlyph" nothing seems to be done with the Result var.
and thus:
if Result <> nil then
AffineTransform(a,b,c,d,e,f, result);
seems to me as a statement that is never executed.
Is this indeed "wrong" or do I overlook something?

Hi Eric.

or do I overlook something?

I think so 😁.
GetCompositeGlyph is called in and returned by GetGlyphPaths, and that result is used by several methods.


Windows平台下HEVC with Alpha的解码实现？+同步相关的编码器的更新

过去HEVC with Alpha的生产和消费都限定在Apple的设备上
最近，在另外一位开源作者rigaya的努力下，一个基于NV硬件的命令行工具NVEncC也具备了HEVC with Alpha的编码能力
我们初步测试了一下，这个编码器的输出在macOS的Chrome下和苹果编码器输出的结果一致
在最近的x265 commit中，也出现了Alpha通道相关的代码更新，后续ffmpeg更新合进来应该只是时间问题。
上游编码器在今年都开始逐渐支持在Windows平台下的HEVC with Alpha生产，但windows下仍然缺少HEVC with Alpha的消费能力，而最有价值的应用场景就是浏览器。
在提供以上信息的基础上，想询问一下Windows平台下HEVC with Alpha的解码实现是否还在计划中。

Thanks, we are still discussing the availability of HEVC with Alpha's implementation on Windows, for now, due to the lack of native NV12A OS support. If it is possible, I still need to further debugging and investigating.

@taste1981 is working in this recently FYI.
https://issues.chromium.org/issues/370423037

@qwe7989199 https://github.com/rigaya/NVEnc/issues/571#issuecomment-2285974127
Does this issue still reproducible on Chrome Canary 131? Do you mind share some more detail and sample on the issue? So we can take a further look on it.

@qwe7989199 rigaya/NVEnc#571 (comment)
Does this issue still reproducible on Chrome Canary 131? Do you mind share some more detail and sample on the issue? So we can take a further look on it.

Chrome Canary 131 rendering result vs Safari. It seems the problem still exists.

Following archive contains the sample files I used.
sample.zip

I think the video is not premultipled, and I guess the wrong result is because of that.


Cherry-pick "Do not hardcode specific testTopicName" into release-1.8

Cherry-picking 15f99b0b61e5338c69eec99e1287d883b44abc4a into the release-1.8 branch. This is just an infra change and doesn't impact code in any way.

@berndverst  already cherry-picked it. no need for this


Issues

When your developing projects for any reason either tutorial or demo project you should always follow best practices of the language and framework.
This project does not follow these at all, as pointed out by other users there are no foreign key constraints, you also have a list of loopholes in your readme...
Please fix these and the database structure. Other users will use this project thinking it meets requirements and it does not.
Thanks ✌

Got your point sir

Its solved by @pydanny
Closing it now...
You can reopen it...if u find any bug/error


Enable Python bindings in conda-forge CI and fix Python bindings compilation and tests on MSVC

Fixed compilation of Python bindings on Windows on MSVC. The problem was that the pybind11 bindings for LeggedOdometry references some LeggedOdometry::resetEstimator overloads that actually belonged to the parent class  FloatingBaseEstimator.
Fixed loading of tests on MSVC by copying the BLF dll to the directory in which the Python binding dll is found, to avoid problem in loading blf dll as on Windows there is no RPATH
Switch GitHub Actions conda CI to use Ninja as a generator on Windows, to workaround  https://github.com/dic-iit/bipedal-locomotion-framework/issues/382 . As the ninja MSVC generator only works on Command Prompt, we also switched the relevant steps to run on Command Prompt as well.

MSVC is failing with this error:
2021-07-27T12:21:47.9708534Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(61,18): error C2672: 'operator __surrogate_func': no matching overloaded function found [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:47.9999984Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2784: 'unknown-type pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()(Return (__cdecl *)(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &)) noexcept const': could not deduce template argument for 'Return (__cdecl *)(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &)' from 'overloaded-function' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0036473Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(812): message : see declaration of 'pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0053597Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2782: 'unknown-type pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()(Return (__cdecl Class::* )(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &),std::false_type) noexcept const': template parameter 'Class' is ambiguous [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0064292Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(816): message : see declaration of 'pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0067774Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): message : could be 'BipedalLocomotion::Estimators::FloatingBaseEstimator' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0330314Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): message : or       'BipedalLocomotion::Estimators::LeggedOdometry' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0347197Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2784: 'unknown-type pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()(Return (__cdecl Class::* )(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &),std::false_type) noexcept const': could not deduce template argument for 'Return (__cdecl Class::* )(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &)' from 'bool (__cdecl BipedalLocomotion::Estimators::LeggedOdometry::* )(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &)' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0353054Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(816): message : see declaration of 'pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0357780Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2780: 'unknown-type pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()(Return (__cdecl Class::* )(const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &) const,std::true_type) noexcept const': expects 2 arguments - 1 provided [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0362263Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(820): message : see declaration of 'pybind11::detail::overload_cast_impl<const BipedalLocomotion::Estimators::FloatingBaseEstimators::InternalState &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0365942Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(64,18): error C2672: 'operator __surrogate_func': no matching overloaded function found [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0370616Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2784: 'unknown-type pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()(Return (__cdecl *)(const Eigen::Quaterniond &,const Eigen::Vector3d &)) noexcept const': could not deduce template argument for 'Return (__cdecl *)(const Eigen::Quaterniond &,const Eigen::Vector3d &)' from 'overloaded-function' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0374759Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(812): message : see declaration of 'pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0378663Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2782: 'unknown-type pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()(Return (__cdecl Class::* )(const Eigen::Quaterniond &,const Eigen::Vector3d &),std::false_type) noexcept const': template parameter 'Class' is ambiguous [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0382588Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(816): message : see declaration of 'pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0386024Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): message : could be 'BipedalLocomotion::Estimators::FloatingBaseEstimator' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0389874Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): message : or       'BipedalLocomotion::Estimators::LeggedOdometry' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0394895Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2784: 'unknown-type pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()(Return (__cdecl Class::* )(const Eigen::Quaterniond &,const Eigen::Vector3d &),std::false_type) noexcept const': could not deduce template argument for 'Return (__cdecl Class::* )(const Eigen::Quaterniond &,const Eigen::Vector3d &)' from 'bool (__cdecl BipedalLocomotion::Estimators::LeggedOdometry::* )(const Eigen::Quaterniond &,const Eigen::Vector3d &)' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0399442Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(816): message : see declaration of 'pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0403280Z D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\bindings\python\FloatingBaseEstimators\src\LeggedOdometry.cpp(34,54): error C2780: 'unknown-type pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()(Return (__cdecl Class::* )(const Eigen::Quaterniond &,const Eigen::Vector3d &) const,std::true_type) noexcept const': expects 2 arguments - 1 provided [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]
2021-07-27T12:21:48.0407395Z C:\Miniconda\envs\test\Library\include\pybind11\detail/common.h(820): message : see declaration of 'pybind11::detail::overload_cast_impl<const Eigen::Quaterniond &,const Eigen::Vector3d &>::operator ()' [D:\a\bipedal-locomotion-framework\bipedal-locomotion-framework\build\bindings\python\pybind11_blf.vcxproj]

MSVC is failing with this error:

The problem seems that the pybind11 bindings for LeggedOdometry references some LeggedOdometry::resetEstimator overloads that actually belonged to the parent class  FloatingBaseEstimator.

Now that tests are compiling, they were not running correctly. The problem was that in Windows there is no RPATH. This is tipically workarounded by placing all the .dll in the same directory, so dependent dll are found easily, but in this case the python bindings are placed in a different directory, so this created problem. After searching for ways for tweaking the PATH, the easiest solution was just to copy the blf .dll in the build directory of the bindings.

Due to https://github.com/dic-iit/bipedal-locomotion-framework/issues/382, I switched the Windows Conda CI from VS generator to Ninja.

Due to #382, I switched the Windows Conda CI from VS generator to Ninja.

After this, the CI is finally green. This is now ready for review, if necessary I can rework the commit to match the three main changes summarized in first post, otherwise we can just merge with squash.

@prashanthr05 your review was mainly for the commit https://github.com/dic-iit/bipedal-locomotion-framework/pull/380/commits/9ddee6f250cc3e3ba55de82416a0f43a6369a3cb .

I'm just wondering, would the tests succeed against the installed tree (inside the active site-packages folder) instead of the build tree stored in the build folder? Maybe in this case the PATH is already configured system-wide.

Yep, in that case everything would work fine also for Multi-Config generators, and the copy of dll will be not necessary, but also not problematic.

I'm just wondering, would the tests succeed against the installed tree (inside the active site-packages folder) instead of the build tree stored in the build folder? Maybe in this case the PATH is already configured system-wide.

Yep, in that case everything would work fine also for Multi-Config generators, and the copy of dll will be not necessary, but also not problematic.

Ok clear, thanks! In Python ⩾ 3.8 I guess an alternative workaround would be using os.add_dll_directory pointing to the lib dir within the build folder.

Ok clear, thanks! In Python ⩾ 3.8 I guess an alternative workaround would be using os.add_dll_directory pointing to the lib dir within the build folder.

I tried to use that, but it appeared not to work, not sure why (something related to conda builds?) or if I did something wrong. Tweaking the os.environ['PATH'] seems to work fine instead, but I did not found any easy way to inject such Python code easily in all the tests

Could you please reorganise  the commits has you wrote here https://github.com/dic-iit/bipedal-locomotion-framework/pull/380#issuecomment-888403381

Could you please reorganise the commits has you wrote here #380 (comment) ?

Done!

Ok clear, thanks! In Python ⩾ 3.8 I guess an alternative workaround would be using os.add_dll_directory pointing to the lib dir within the build folder.

I tried to use that, but it appeared not to work, not sure why (something related to conda builds?) or if I did something wrong. Tweaking the os.environ['PATH'] seems to work fine instead, but I did not found any easy way to inject such Python code easily in all the tests

Since the need of using this workaround for importing modules on Windows has been kind of reverted in conda, I would not be surprised that the usage of the function does not behave as it should. Thanks for the additional details!

The macos failure shouldn't be related to this PR. Am I correct?

Pcl version in brew updated 14 hours ago https://github.com/Homebrew/homebrew-core/commit/b2e4d3b073be7e79b625b29e8f04b4b67a434919

The macos failure shouldn't be related to this PR. Am I correct?

Exactly, the same failure is in the scheduled job: https://github.com/dic-iit/bipedal-locomotion-framework/actions/runs/1077070309 .

Since this PR is not related to the failure we decided to merge the PR


refactor: QdrantRM

Description

This refactor allows users to query Qdrant with any implementation for BaseVectorizer, the default being the new FastEmbedVectorizer.

The field containing the document content in the Qdrant payload can be specified. It doesn't necessarily have to be "document" anymore.

Currently, the implementation relies on qdrant_client's query_batch() abstraction, which uses FastEmbed internally.
Breaking?
The default values to the new params ensure backward compatibility.

Hi @Anush008
Will this refactor also support SparseVectors?

Not this one.
If we can have a sparse vectors providers interface in DSPy, in the BaseVectorizer maybe, we could support it in QdrantRM.

I was thinking in these lines. Please correct me if i am missing something.
qdrant_client.search expects same parameter query_vector in dense as well as sparse search.  It can be
query_vector = models.NamedSparseVector(
        name="text",
        vector=models.SparseVector(
            indices=[1, 7],
            values=[2.0, 1.0],
        ),
    ),
``` for sparse embedding.

and

query_vector=[0.2, 0.1, 0.9, 0.7],

So if we can generalize the `vectorizer` function and let user return the vector consistent with collection, it should work for dense, sparse as well as sparse-embed alike.

vectorizer is of type BaseVectorizer, which has methods to generate dense vectors.
If it can support sparse vectors, we can have them here.

Hey @arnavsinghvi11. Just bumping this PR. Please take a look when possible.

LGTM. thanks @Anush008 !


[feat] Is there a way to allow window.open() on the front end?

Describe the problem
The front end of my app is an external domain and contains a lot of code that opens a new window with window.open, but it doesn't work on the Tauri app.
I've seen this issue.
However, it's a difficult situation to fix this window.open to webviewWindow.  😭
Is there any way to fix it on the Tauri app? thanks.
Describe the solution you'd like
Disable file download handler for Tauri (ex: disable_drag_drop_handler)
Alternatives considered
No response
Additional context
[✔] Environment
    - OS: Mac OS 13.5.2 X64
    ✔ Xcode Command Line Tools: installed
    ✔ rustc: 1.79.0 (129f3b996 2024-06-10)
    ✔ cargo: 1.79.0 (ffa9cf99a 2024-06-03)
    ✔ rustup: 1.27.1 (54dd3d00f 2024-04-24)
    ✔ Rust toolchain: stable-aarch64-apple-darwin (default)
    - node: 18.17.0
    - yarn: 1.22.21
    - npm: 9.6.7

[-] Packages
    - tauri [RUST]: 2.0.0-beta.22
    - tauri-build [RUST]: 2.0.0-beta.17
    - wry [RUST]: 0.40.1
    - tao [RUST]: 0.28.1
    - tauri-cli [RUST]: 2.0.0-alpha.18
    - @tauri-apps/api [NPM]: 2.0.0-beta.13
    - @tauri-apps/cli [NPM]: 2.0.0-beta.10

[-] App
    - build-type: bundle
    - CSP: unset
    - frontendDist: ../dist
    - devUrl: http://localhost:1420/
    - framework: React
    - bundler: Vite

I'm too having problem with permissions not working on runtime windows/webviews. I created a tauri command as a workaround
`#[command]
pub fn open_shell(app: tauri::AppHandle, url: String) {
let aid: String = generate_random_string(5);
// app.shell().open(url, Some(Program::Chrome)).unwrap();

}`


fix(kona-derive): Towards Derivation

fix: fetch tip state
set starting l1 traversal block to genesis

#243  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @refcell and the rest of your teammates on  Graphite

Codecov Report
Attention: Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.

Project coverage is 74.3%. Comparing base (5d327d2) to head (0a73aa0).

Files
Patch %
Lines

crates/derive/src/pipeline/builder.rs
0.0%
2 Missing :warning:

Additional details and impacted files

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Fix ::Gentoo QA warnings

Closes: #35
@thesamesam looks fine to me, I decided to call this 0.6.0 and do some other housekeeping. There doesn't seem to be any unit tests but the output against real ebuild targets looks good.
If you'd sanity check, tag, and update ::gentoo I'd appreciate it!
Edit: target/debug/cargo-ebuild ebuild --manifest-path ./Cargo.toml looks really good

@gyakovlev ping?

Any chance this PR could be merged?
I just hit the issue of cargo-ebuild not being able to deal with the new CRATES syntax. i.e. @ instead of -.

I don't have commit access to cargo-ebuild although I could give it to myself given gyak is AWOL. FWIW, we recommend using pycargoebuild now if yo ucan.

@thesamesam Thank you for the info.
pycargoebuild seem to work well in my Gentoo VM. However, that tool relies on Gentoo specific paths.
Ideally I would like to generate ebuild files on both Gentoo and non-Gentoo systems. cargo-ebuild is perfect for the purpose. But it is too bad not being actively maintained.


As a user I want to find a task by name

so that I can locate details of tasks without having to go through the entire list

Case-insensitive


refactor(test): refactor scaling tests for arrangement backfill

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
Only tests on no_shuffle opt-in to use no_shuffle_backfill. For the other tests, we can let them remain as-is.
We also add in a new test to test compatibility of arrangement backfill with auto parallelism and low-level scaling interface.

Checklist

[ ] I have written necessary rustdoc comments
[ ] I have added necessary unit tests and integration tests
[ ] I have added test labels as necessary. See details.
[ ] I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934).
[ ] My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
[ ] All checks passed in ./risedev check (or alias, ./risedev c)
[ ] My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)

[ ] My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

[ ] My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note
If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

Tested with arrangement backfill here https://github.com/risingwavelabs/risingwave/pull/14577/commits/03ba6bfc94476608612457dd15f9080de608ce81


How to change default width percentage in split view?

Currently the width percentage is 50% - 50% in diff editor with split view by default, how can I change the default width percentage? I want the left view is narrower than the right, is it feasible?

@alexdima Could you share some information for this issue? I want to change the width percentage by code instead of by dragging the split line by user.

@alexdima Looks like there is no api to achieve this. Apart from waiting, is there any other workaround to implement this at this period?

@TerryChan The only option is to use editor internals in JS like e.g. diffEditor._strategy._onSashDrag({ currentX: 20, startX: 100 });.


is it true that state transition can be triggered in two ways, one is to use transition keyword, another is to use event?

for example, here is the state definition:

I have two questions:

is it true that there are two ways to transition to state b
1.1 state a is complete
1.2 event OrderCreatedEvent is triggered
either one will trigger state b to happen?

is it true that if state b is triggered by events, it will trigger function b2Event, if not, it will trigger b1Event?

ACK 2:

You don't define type of state b, if it's event, it can't have action property.

ACK 1:

no, if the state b is not the starting state, when state a is completed and transition to state b, we must wait the Event is triggered before action is execute.

ACK 2:

You don't define type of state b, if it's event, it can't have action property.

Is this understanding correct?
if state type is event, it can only be triggered by certain event
it state type is operation, it can only be triggered by state transition from another state

curently a non-starting event state is blocking meaning when reached is awaiting one of the onevents defs to start executing associate actions. so the transition is taken from a to b as soon as a completes

ACK 2:

You don't define type of state b, if it's event, it can't have action property.

Is this understanding correct? if state type is event, it can only be triggered by certain event it state type is operation, it can only be triggered by state transition from another state

I think so.

ACK 2:

You don't define type of state b, if it's event, it can't have action property.

Is this understanding correct? if state type is event, it can only be triggered by certain event it state type is operation, it can only be triggered by state transition from another state

I think so.

@lsytj0413 ，can serverlessworkflow define transiting to a state if certain event is triggered no matter what current state is? for example,
if OrderCreatedEvent is triggered, workflow will transit to state b no matter what current state is?

@lsytj0413 ，can serverlessworkflow define transiting to a state if certain event is triggered no matter what current state is?
for example, current this workflow define need to reach state c first, then it will check if OrderCreatedEvent is triggered and transit to b, but if current state is not c, it won't work. Is it possible if OrderCreatedEvent is triggered, workflow will transit to state b no matter what current state is?

As far as i known, there is no way to cancel a state executing (expect timeout), so serverlessworkflow can't archieve your scenario. (It's like an Intermediate Event in bpmn)


Parquet format for storing predictions

Feature
Currently, slide-, patient-, and tile-level predictions are exported in CSV format. This involves more overhead and storage space requirements than should be necessary. An option should be given to the user to export the serialize pandas DataFrames using parquet.
Associated Jira issue is SLID-8.

Implemented in 1.2.0 (commit baf893c)


CodeMaid on Integration Tests

Signed-off-by: RemakingEden<EMAIL_ADDRESS>Description
I noticed in the Contributing.md doc we are supposed to be standardising our code with CodeMaid, I have therefore used it on all integration test code. @jackschofield23 @lillie-dae this may also be worth doing with the dev code.
Status
Ready

Will run on the dev code once this is merged


Doesn't sync extensions when downloading

🐛 Describe the bug
I'm trying to sync my settings into a new machine running Solus Linux, and it doesn't install extensions
🌴 Visual Studio Code Version : 1.26.1
🌴 Code Settings Sync Version : 3.1.1
🌴 Operating System : Solus Linux 3.999999
🌴 Occurs On: Download
🌴 Proxy Enabled: No
🌴 Gist Id: 7a12c5b24bac1bd8b819763382969963
📰 To Reproduce
Do everything according to the guide. Try to download and sync settings.
💪 Expected behavior
All extensions should download and update. You can see them in the gist, but I get No extensions installed.
📺 Console Error Log
No console errors
📺  Additional context
the user settings are synced! it's only the extensions that don't.
Files Downloaded:
  extensions.json > extensions.json
  keybindings.json > keybindings.json
  locale.json > locale.json
  settings.json > settings.json

Extensions Ignored:
  No extensions ignored.

Extensions Removed:
  No extensions removed.

Extensions Added:
  No extensions installed.
--------------------
Done.

what is the console log while downloading.
Open developer log from help menu from code.
Clear console, hit sync download and paste the screen shot

oss isnt supported
Any PR would be welcome


cmd/server: add routes and persistence for disclaimers

Issue: https://github.com/moov-io/customers/issues/32

Codecov Report

Merging #42 into master will decrease coverage by 3.58%.
The diff coverage is 72.72%.

@@            Coverage Diff             @@
##           master      #42      +/-   ##
==========================================
- Coverage   60.63%   57.05%   -3.59%
==========================================
  Files          14       15       +1
  Lines        1438     1537      +99
==========================================
+ Hits          872      877       +5
- Misses        448      545      +97
+ Partials      118      115       -3


enh: Better CJK language support when downloading pdf

Is your feature request related to a problem? Please describe.
When I try to download the conversation as pdf, Chinese (traditional or simplified) charactors are missing glyphs. Examples below

Got WARNI [fpdf.output] Font MPDFAA+NotoSans is missing the following glyphs: 啟, 鸠 when downloading the pdf.

Got WARNI [fpdf.output] Font MPDFAA+NotoSans is missing the following glyphs: 谁, 这, 话, 时, 议, 颁, 夺, 财, 产, 为, 发, 许, 宪, 现 when downloading the pdf.
Describe the solution you'd like
I workarounded by hacking codes near https://github.com/open-webui/open-webui/blob/99d10d1189452ad49fcace219e9c90ae65906cd1/backend/apps/webui/routers/utils.py#L83 to something like:
    pdf.add_font("NotoSans", "", f"{FONTS_DIR}/NotoSans-Regular.ttf")
    pdf.add_font("NotoSans", "b", f"{FONTS_DIR}/NotoSans-Bold.ttf")
    pdf.add_font("NotoSans", "i", f"{FONTS_DIR}/NotoSans-Italic.ttf")
    pdf.add_font("NotoSansSC", "", f"{FONTS_DIR}/NotoSansSC-Regular.ttf")
    pdf.add_font("NotoSansKR", "", f"{FONTS_DIR}/NotoSansKR-Regular.ttf")
    pdf.add_font("NotoSansJP", "", f"{FONTS_DIR}/NotoSansJP-Regular.ttf")

    pdf.set_font("NotoSans", size=12)
    # TODO select the best fallback sequence by determining the user's locale
    pdf.set_fallback_fonts(["NotoSansSC", "NotoSansKR", "NotoSansJP"])

And I have put NotoSansSC-Regular.ttf from https://fonts.google.com/noto into backend/static/fonts.
This might not be accepted as the general solution however, as it probably breaks displays of  some Japanese chars (门、入、内 for example)
Describe alternatives you've considered
Determine the user's locale before executing pdf.set_fallback_fonts(["NotoSansSC", "NotoSansKR", "NotoSansJP"]) to make sure the fallback sequence is correct.
Additional context
No additionall context

PR welcome!

I did't propose a pull request in the first place because I cannot come to a conclusion on what is the most suitable approach to fetch the locale.

The locale of backend is the easy to get, but it does not make sense if it is a public server with plain en_US or C locale .
Inferring locale from the text fed to to the FPDF module might work, but inferring itself sounds tedious.
Inferring from the WebUI language setting is a good idea, but I haven't found related code to this point.
Inferring from the request header is also a good idea, but download_chat_as_pdf does not seem to have access to request headers at all.

what would be the issue of setting it to ["NotoSansKR", "NotoSansJP", "NotoSansSC"] in this order?


Component library

I know we’ve had Riot component repos in the past but I think there’s room for a slightly more robust component library. Maybe unthink-components?
Perhaps there could be an integration with the CLI. It could be pretty cool to add a standardized component to your project, say a date-picker, with just a cli command.
Additionally, we could have a documentation site - could definitely just be a simple static site on GitHub Pages or something similar. It could serve as a showcase of all the components as well as basic documentation for each component (props list with descriptions). Thinking a simplified version of something like this: https://material.io/develop/web/components/buttons/
Any thoughts?

I am currently evaluating a new version of how we would do a component library. A couple of concerns I've been mulling over:

What is the best workflow for getting a component from the library into a project (making it part of the CLI might be a good way to do this)
Should components be stored in a single repo or should they be separated out
Should our internal components be public and open source

Integrations with the CLI would require some serious thought, depending on how we end up doing things. For one, I don't want the components to be a built-in part of the CLI; they would have to be plugins. Making them plugins means we could easily have public or private components.

Additionally, we could have a documentation site

The documentation has been something we've looked at doing internally for a long time, and have tried a few different frameworks to accomplish it. Still evaluating where the most value is. Now that we have the stack, I think we can start seriously looking at this again.

Yeah I was thinking about the best workflow for getting a component from library to project and the CLI is an obvious solution but outside of that, I'm not sure. I don't think the approach of importing from a package is ideal because I'd think we'll want to have the component in our source code so we can make adjustments for project-specific styles or requirements. I guess you could just copy/paste from a repo or maybe the documentation site, but that doesn't seem super elegant.
What type of components do you think we'd want to be private? I'm assuming components like generic form elements or buttons would be fine to be open source


providers: Incompatibility Between WithCachedCode() and ethers.JsonRpcProvider

The provider parameter passed to providers.WithCachedCode() appears to be incompatible with ethers.JsonRpcProvider.
Type error
Provider is not assignable to parameter of type
Type 'Provider' is missing the following properties from type 'Provider': getStorageAt, getAddress

Reproducible example
import { ethers } from "ethers";

function invokeAutoload(bytecode: string) {
    const provider = new ethers.JsonRpcProvider(config.rpc);
    const cachedCodeProvider = whatsabi.providers.WithCachedCode(
      provider, // Type error
      {
        [address]: bytecode,
      }
    );
    // ...
}

Proposed Fix
- export function WithCachedCode(provider: Provider, codeCache: Record<string, string>): Provider {
+ export function WithCachedCode(provider: Provider, codeCache: Record<string, string>): AnyProvider {
    return {
        ...provider,
        async getCode(address: string): Promise<string> {
            if (codeCache[address]) {
                return codeCache[address];
            }
            return await provider.getCode(address);
        }
    };
}

If this solution seems appropriate, I’d be happy to go ahead and create a pull request.

Good call, let's do that. Thank you!

Actually, the provider argument is the issue I think, not the return value. I think we'll need to accept AnyProvider and convert it using CompatibleProvider if it's not already converted.
I'll do the change.

Pushed the change here, will do a quick merge and release once CI completes, but please let me know if you have any feedback/suggestions for improvements even after it's merged. :) https://github.com/shazow/whatsabi/pull/134


Converts some PEM test data to Unix line endings

This makes them consistent with the other PEM files.

LGTM


Blockchain hard fork testing

The Issue
With the blockchain upstream and normalization changes in the upcoming hard fork,
as spee.ch developer,
I want to identify as many automated and manual tests as possible so that the hard fork does not break spee.ch.
DOD/Acceptance Criteria
Identify all interactions with the blockchain and document
Identify and document possible testing scenarios for those interactions
As a goal, we should build a test environment for repeatable testing of future changes

The regular expressions here will become invalid: https://github.com/lbryio/spee.ch/blob/master/utils/lbryUri.js
Please look at where the associated functions are used for clues as to what the fork might affect.
Please file separate tickets for any spee.ch changes that will need to happen after the fork.

Will be following up:
https://github.com/lbryio/lbrycrd/issues/208#issuecomment-444212905
Currently I don't see many breaking changes unless characters we treat as reserved will cause issues.
We may need to normalize the local claims table for pending claims.


Error during application startup - UnknownHostException: None

This fixes handling of cluster ips with value none.
This fixes issue #40

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Oops, seems like we both tackled the issue.
Please try the latest snapshot once the build finishes. If it works, I'll close this PR. Otherwise I'll merge it.
Thanks anyway!

It works. Thank you


[Improvement] change forge build sizes report to Bytes

Component
Forge
Have you ensured that all of these are up to date?

[X] Foundry
[X] Foundryup

What version of Foundry are you on?
forge 0.2.0 (dbc48ea 2024-04-03T00:17:03.697365187Z)
What command(s) is the bug in?
forge build
Operating System
Linux
Describe the bug
forge build --sizes lists values for size and margin in kB. It is unclear whether 1000x or 1024x
It would be more clear if listed in Bytes right aligned as the sizes are up to 5 digits anyway.

To become :
Compiler run successful!
| Contract                       | Size (B)  | Margin (B)  |
|--------------------------------|-----------|-------------|
| Address                        |        86 |      24 490 |
| SomeHugeContract               |    17 906 |       6 670 |

If anybody wants to do this,
here are code snippets that needs to be changed.
https://github.com/foundry-rs/foundry/blob/5b0dc8c7fa99e4e4fd1fd6f1a4b6535fdc075555/crates/common/src/compile.rs#L405-L407
https://github.com/foundry-rs/foundry/blob/5b0dc8c7fa99e4e4fd1fd6f1a4b6535fdc075555/crates/common/src/compile.rs#L422
you can remove the / 1000 and change kB to B

Wow, that was a quick response. You guys are awesome.
Yet I proposed to right aligned the values (for easy comparison).


feat(destinations): implement destination_info property

Towards #751
Implements item 2

@rudolfix, made a draft for the item 2 (you said we have to talk about it first) to see if it's close to what was requested.

@rudolfix, oh, so in dlt repo there are no secrets for destinations? Hm-m. This test is supposed to be moved to verified-sources then?!


[Catalogs] [Delta Lake] Add support for updating an existing Delta Lake table (overwrite, append, upsert, delete).

In addition to creating new Delta Lake tables, we should add support for updating existing Delta Lake tables. We should support overwrites, appends, upserts, and deletes.

https://delta-io.github.io/delta-rs/api/delta_table/#deltalake.DeltaTable.update
https://delta-io.github.io/delta-rs/api/delta_table/#deltalake.DeltaTable.merge
https://delta-io.github.io/delta-rs/api/delta_table/#deltalake.DeltaTable.delete
https://docs.delta.io/latest/delta-update.html#table-deletes-updates-and-merges
https://github.com/delta-io/delta/blob/master/PROTOCOL.md

Are we planning this supports sometimes next 3 months?

@sujiplr yes we are, once we do our integration with delta-kernel-rs.
cc: @kevinzwang

Hi @sujiplr! Glad to hear that there's demand for these features. We currently have support for overwrite and append with the DataFrame.write_deltalake method, and upserts and deletes are part of our delta lake roadmap (#2457) and we hope to support them soon

In the meantime, if your data can fit on one machine, you can call DataFrame.to_arrow to convert your dataframe into a PyArrow table, and then use it with the deltalake python library

I think I'll also close this issue since each of these features are either done or being tracked by another issue already


fix device for get_ppl

Motivation
fix device for get_ppl
Modification
Please briefly describe what modification is made in this PR.
BC-breaking (Optional)
None
Use cases (Optional)
If this PR introduces a new feature, it is better to list some use cases here, and update the documentation.
Checklist

Pre-commit or other linting tools are used to fix the potential lint issues.
The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness.
If the modification has a dependency on downstream projects of a newer version, this PR should be tested with all supported versions of downstream projects.
The documentation has been modified accordingly, like docstring or example tutorials.

concat logits. Shape is [bsz, seq_len, vocab_size]
logits = torch.cat(logits, dim=1)
这里用cuda存挺危险的。src里面的logits也得改成cpu的


System.import() v0.17.x

On version 0.16.x, following this doc page - production workflow (https://github.com/ModuleLoader/es6-module-loader/blob/master/docs/production-workflows.md).
If I include a js file transpiled using Babel with modules=system on my page, then call System.import, systemjs will not make an ajax request to load my js file - because it's already included on my page - works fine.
For example, lets say:
System.register('boot.js', [], function (_export) {
   ...
});

And on my page:
System.import('boot.js')

But, on version 0.17.x I include the same file and systemjs always make an ajax request to load my file. How can I avoid this? like version 0.16

It's best to always use anonymous System.register output of the form:
System.register([], function (_export) {
   ...
});

Named System.register is only for bundles where there are multiple modules in a single bundle file.
It can work with named register statements, but then it requires deep knowledge of the normalize system to ensure that the names perfectly match up.

Let me know if you need further help here.

@guybedford I am running into the same issue. The nice thing about having it named is I could load up everything in one file and then import my application.js which would start the importing process for all my other system registers. How would I import a specific register that is anonymous? I am using an angular 1 build and here is a sample gulp task:
gulp.task('combined-js-slim', ['js','slim'], function() {
  return gulp.src(['public/assets/dependencies.js',
                   'public/assets/templates.js',
<EMAIL_ADDRESS><EMAIL_ADDRESS>                   'jspm_packages/system.js',
                   'config.js',
                   'public/assets/application.js'])
    .pipe(concat('app.js'))
    .pipe(insert.append("System.import('application.js')"))
    .pipe(gulp.dest('public/assets'));

I first load in my dependencies using an sfx bundle. My templates are then loaded using ngHtmlToJs. the application.js is my actual app. I concat them all into one file and then at the end import my app. There doesn't seem to be a way to do this with the latest versions. I'm using babel transpiling in a gulp task:
gulp.task('js', function () {
  return gulp.src('app/assets/javascripts/**/*.js')
    .pipe(plumber())
    .pipe(cache('scripts'))
    .pipe(babel({
      modules: 'system',
      moduleIds: false,
      getModuleId: function (name) {
        return name + '.js';
      }
    }))
    .pipe(remember('scripts'))
    .pipe(concat('application.js'))
    .pipe(gulp.dest('public/assets'));
});

When I load the page, I get this error: Uncaught TypeError: Invalid anonymous System.register module load. If loading a single module, ensure anonymous System.register is loaded via System.import. If loading a bundle, ensure all the System.register calls are named.
When I change moduleIds:true, it tries to make an ajax call. So the questions is, how would I make it import a specific register like it used to do using anonymous registers?
Thanks! Also @dbabaioff was wondering what you ended up doing? It seems like this should be documented somewhere.

@jonricaurte when concatenating multiple modules in the same file, you need to use names certainly. It's only when compiling files and leaving them as separate files that it is best to keep modules anonymous. That is because as soon as you include names, you are reducing portability and making the code environment specific as it is including linking information.

@guybedford Thanks for the update. Was wondering why it is not possible to use System.import in the same file as the registered name. An example would be after the files are concatenated into one file, the file looks like this:
System.register('application.js',[], function(){
    //code
});
System.import('application.js');

With older versions, I was able to import the register even if it was in the same file and there would be now ajax call made, however, with newer versions it actually tries an ajax request to localhost:3000/application.js. Is there a way to make it so System.import does not make an ajax request if the name is already registered within the same file?
Thanks!

@jonricaurte is the above with the register extension only? The way to check is to see that System.normalize('application.js').then(console.log.bind(console)) matches the exact URL name string as the one registered at Object.keys(System.defined).

@guybedford Thanks for the update!