MCS-944 MCS-1186 Tool Prefab

Please note -- you may need the new metal materials I just added to the UnityAssetStore folder and pushed on the mcs-private master branch!

@ThomasSchellenbergNextCentury all of the new object actions works with these tools too. Are there integration tests using these actions with these tools. I think there only needs to be one for rotate and move

Why do we use multiple prefabs instead of scaling a single tool?

@kdrumm

Why do we use multiple prefabs instead of scaling a single tool?

Scaling the entire object would not only scale the cubes, but also the cylinders and spheres, which we don't want.

I've created a bunch of integration tests for the tools (109-116), as well as the soccer ball. https://github.com/NextCenturyCorporation/MCS/pull/521
I've worked with Jacob to adjust the TorqueObject action to be more powerful, so that torquing even the largest of the tools will rotate it by at least a few degrees. This means torquing some smaller/lighter objects at "max power" will cause them to rotate more than 360 degrees, but I think that's still OK, since the main use case is torquing the tools. I've updated the TorqueObject integration test (095) accordingly (in the same PR).


PACT training taking too long

The quantization aware training with PACT quantizer is taking an unreasonably long time compared to training with full precision or with other quantizers. Any clue on why is this happening? In PACT, there is an extra parameter that we have to learn. But that is also taken care of by resending the whole model to CUDA after the compression scheduling.
Any kind of suggestions on how to speed up the training with PACT will be highly appreciated. TIA

Comparing PACT to DoReFa, it is about 1.8x-2x slower on my setup. Does that match what you're seeing?
As to why this is happening - while it's true that there's "only" one new parameter per layer, if you  compare the backward functions of LinearQuantizeSTE (here - which is used by DoReFa) and ClippedLinearQuantizeSTE (here - which is used by PACT), you can see that the latter does a non-trivial additional amount of tensor-arithmetic. My guess is that there are inefficiencies hiding in there. I'd have to dig in a bit more to give concrete advice and/or fix it.

Yes, for cifar, its almost 2x slower. But for ImageNet, I would say its much slower than that. Any tweaks around it would certainly be great! Thanks

hi, @kocchop and @guyjacob  Did you already get some result on small datasets such as cifar10/100 of the PACT or Dorefa-net?  Would you mind to share the accuracy?

Hi, @guyjacob, @nzmora did you have a chance to look at the issue? It's taking days to train on Imagenet using pact. Any advice/suggestions are very much appreciated. Thanks

Not yet, unfortunately. I'll try to take a look at it next week. Can you give more details on what you're seeing? Which model, what's the HW setup?

Hi @guyjacob , yes definitely. I was trying to train resnet50 on ImageNet dataset. I am using 4 NVIDIA Tesla V100 GPUs each having 32GBs as GPU memory. Also, the physical memory of the system is around ~336GB. The model is wrapped using the DataParallel, so I guess parallelization is not the issue. Typical training with 256 batch size for ~100 epochs takes around 2/2.5 days in current settings. After including PACT to it, it looks like training would take 10-11 days at least. Please let me know if I can help you out with any other details. Thanks a lot!

@guyjacob @nzmora sorry to bother again. Did you get a chance to look at the issue?
Thanks a lot!

Hi @kocchop. So sorry it took me so long to look into this!.
I opened a PR - #336. Please check it out, see if it improves things on your side. I did limited experiments on my side and it's ~2x faster now. There's a more detailed explanation in the PR.
And again, sorry for the very delayed response.

Hi @guyjacob, thanks a lot!! It has actually improved significantly! Just to be sure that I have similar performance compared to your implementation, could you please share your training logs for cifar and ImageNet if possible?
Also, a slightly out of context question. If you could kindly answer to that, it'd be a great help. During the quantization aware training, we use "the simulated quantization" effect. In code, we actually quantize and then dequantize for that. Assume that, I have a trained model with it and I want to map it to a hardware like fpga with integer arithmatic. What could be a good way to do that? I am slightly worried about the scaling factor that we dequantize with. If could kindly shed some light in this regard, it'd be a great help.
Thanks a lot, again for making the implementation more efficient!


android  libscrypt.dylib

java.util.concurrent.ExecutionException: com.android.tools.build.bundletool.exceptions.BundleFileTypesException$FileUsesReservedNameException: File 'root/lib/x86_64/darwin/libscrypt.dylib' uses reserved file or directory name 'lib'.

have your found any solution?

have your found any solution?

packagingOptions {
exclude 'lib/x86_64/darwin/libscrypt.dylib'
exclude 'lib/x86_64/freebsd/libscrypt.so'
exclude 'lib/x86_64/linux/libscrypt.so'
}

@zakaio That threw another error after making the suggested change.
Unrecognized native architecture for directory 'lib/arm64'.

Its interesting that I can easily create APK and get this error on creating AAB only

any solution for this problem


Fix handling duplicates

closes #290
With this PR -

the method _remove_duplicate_entries will be called for each of the generate_<simtype>_permutations(*) so that any duplicate entries are dropped.
the methods generate_<simtype>_permutations(*) will now return an int specifying the number of permutations that were added to the parametric study.
the assumption taken into account is that if simulations are added to any existing parametric study, the study does not contain any duplicate simulations to begin with.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 97.94%. Comparing base (d44ee45) to head (b4fca05).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #294   +/-   ##
=======================================
  Coverage   97.93%   97.94%
=======================================
  Files          30       30
  Lines        3001     3010    +9
=======================================
+ Hits         2939     2948    +9
  Misses         62       62

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Run Docker container as non-root user

Fixes #131.

@itamarst There appears to be something weird going on in the Travis builds. Have you done something today that could have changed or removed the environment variables used to decrypt the service key?

This is expected, if you set secure env variables they won't work on PRs from forks. I'll look at this Monday - thanks for the PR!

Merging into non-master branch so we can do PR that will actually run tests correctly.


Tooltip not showing after updating from v3.4.0

Tooltip does not show anymore on graphs when data in NULL.
One-line summary [问题简述]
When I was using ecahrts 3.4.0 and I had a graph that was filled with null or undefined. it would show me a tooltip and I used the formatter to make it say N/A when the value is null or undefined.
Today I updated to the latest version (3.7.1) and realized that tooltips dont show anymore so I downgraded to 3.4.0, it was working again. I went up 1 version (3.5.0) and it was broke so its from that version that this happened.
I looked at the documentation again now to see if something is changed but I couldn't find anything.
Version & Environment [版本及环境]

ECharts version [ECharts 版本]: 3.5.0
Browser version [浏览器类型和版本]: Chrome 60
OS Version [操作系统类型和版本]: Window 10

Expected behaviour [期望结果]
ECharts option [ECharts配置项]

option = {
title: {
        text: '',
        subtext: ''
    },
    tooltip: {
        show: true,
        trigger: 'axis',
        axisPointer: {
            show: true,
            type: 'cross',
            label: {
                show: true
            }
        },
        formatter: function (params) {
            console.log('value is ' + params); //THIS LINE DOES NOT RUN..
            let value = '';
            if(params[0].data === undefined || params[0].data === null) {
                value = 'N/A';
            } else {
                value = (params[0].data).toFixed(2);
            }
            let text = "\u25CF " + params[0].seriesName + ": " + value;
            return params[0].name + "
" + text;
        }
    },
    axisPointer: {
        show: true,
        type: 'line'
    },
    legend: {
        show: false
    },
    toolbox: {
        show: true,
        feature: {
            magicType: {
                show: true,
                title: {
                    line: 'Line',
                    bar: 'Bar'
                },
                type: ['line', 'bar']
            },
            restore: {
                show: true,
                title: "Restore"
            },
            saveAsImage: {
                show: true,
                title: "Save Image"
            }
        }
    },
    calculable: true,
    xAxis: [{
        type: 'category',
        boundaryGap: false,
        data: []
    }],
    yAxis: [{
        type: 'value',
        min: 0,
        max: 20
    }],
    series: [{
        name: 'TPS',
        type: 'line',
        smooth: true,
        itemStyle: {
            normal: {
                areaStyle: {
                    type: 'default'
                }
            }
        },
        data: []
    }]
}

Other comments [其他信息]

What the graph tooltip should look like:

What it looks like now:

It behaves like this as I test your code with v3.7.1.

This makes sense since you set the axisPoint.
So is this what you want?

No I want to tooltip to show as well. If you look at my options, I have a formatter that if the params[0].data is NULL or undefined the tooltip should show "N/A" like in the photo that I provided.

Did you forget to copy the data of xAxis here?

The data is loaded after the page loads. It is not static.
This is how the data for x and y axis are loaded.

I did some more testing on this issue and I am almost certain that it is a bug.
When the graph is completely full of null or undefined the tooltip does not show. But when the graph has at least 1 value the tooltips show for the null area. Look at my screenshot below.
~
The parts that say N/A is my formatter code above.

I have the same problem with the graph visualisation. Copied the structure of the graph (options) from another project, the first shows the tooltip while the second does not. I could not find a solution for displaying it.

I had the same issue with the tooltip not showing up using echarts within a Vue project. After a while I realized that I have to import different components I make use of in the chart. Amongst these is the tooltip component. The following resolved the issue for me:
import ECharts from "vue-echarts";
import "echarts/lib/chart/scatter";
import "echarts/lib/component/dataZoom";
import "echarts/lib/component/tooltip"; // you need to import the tooltip component


SDL1.2 : SDL_AddTimer not working

I was compiling POWDER for PSP again based on the files provided on its latest build, with current toolchain from  pspdev's page and with pspdev sdl 1.2.15-5 [installed] latest sdl.
For some reason, the timer thread doesnt do anything, yet the game works fine on Linux SDL with almost no changes, so the Callback function (or the thread) might be not getting called.
I might update this once I test the threads issue more deeply, maybe with a simpler app.

Interesting, the code for the SDL 1.2 port which we host can be found here: https://github.com/pspdev/SDL/tree/psp-v.1.2.15
It has been a while since anyone touched it.

Nope, the schrodinger bug keeps happening. I even updated the game to SDL2 (and now it works), but SDL1.2 still doesnt. It seems that SDL_PumpEvents or SDL_WaitEvents might be involved, I will keep this open JUST in case someone else has this bug.

Do you have a code example that shows the bug by any chance?

SDL1.2 testtimer.c works in Linux but not on PSP. I provided a makefile (run make all for psp, else compile normally with command on PC) and the modified test.
testtimer.zip

SDL2 version runs as expected (modified from the same test!):
testtimer_SDL2.zip

Thank for the example. I'm glad it works on SDL2 at least. That probably means it works on SDL3 as well. My guess right now is that this fix never arrived in SDL 1.2: https://github.com/libsdl-org/SDL/pull/9340
But there could also be other causes. SDL 1.2 is not so commonly used and there have been some changes in the API in the SDK.


No remote notification on android when app is running/in foreground.

I don't receive any notification when app is running/in foreground
when app is in background I can see a notification in tray.
What I am missing please help.

did you just passed notification field in payload?
check example project

I also face a similar issue. When in the background, I am getting a notification, but when an app is in the foreground I am not getting a notification. I have sent push notification from firebase console.
Please help.

@cdbhimani try use custom_notification. default notification doesn't show up in some cases. Try reproduce with Firebase's native example


Support ethermint

Closes #145
Add a cargo feature to switch to ethermint mode:

address derivation method
EthAccount decoding
default coin type change to 60
change message hashing in signing

deep_space PR: https://github.com/iqlusioninc/deep_space/pull/1

fixed conflicts and squashed.

can be close https://github.com/crypto-org-chain/gravity-bridge/pull/31


Tab UI size is abnormal

IntelliJ IDEA 2019.2.3 (Community Edition)
Build #IC-192.6817.14, built on September 24, 2019
Runtime version: 13+33 amd64
VM: OpenJDK 64-Bit Client VM by AdoptOpenJDK
Windows 10 10.0
GC: Shenandoah Pauses, Shenandoah Cycles
Memory: 2048M
Cores: 4
Registry: compiler.automake.allow.when.app.running=true, ide.tooltip.initialDelay=143, ide.tree.ui.experimental=false, ide.balloon.shadow.size=0
Non-Bundled Plugins: GsonFormat, Lombook Plugin, Statistic, mobi.hsz.idea.gitignore, net.vektah.codeglance, io.acari.DDLCTheme

Hello Friend!
I am having trouble replicating the issue on Windows 10.
Could you find your configurations file (in the option directory in the config) , see: https://intellij-support.jetbrains.com/hc/en-us/articles/206544519-Directories-used-by-the-IDE-to-store-settings-caches-plugins-and-logs.

Thank You! However, I am still not able to replicate the issue. 😞
Would you be opposed to moving to the 2019.3 EAP version of Intellij?
If not, you will have to follow some steps:

Uninstall the plugin from your IDE
Update Intellij to 2019.3 EAP
Install the 4.4.0-beta version of this plugin.

You have to do it in that order, because I messed stuff up. Otherwise, Intellij will just crash and never start up.
I also have not tested this release as thoroughly, so there may be some quirks. I will find them as I use the plugin more on the 2019.3 build.
Invalidate Caches should not affect the plugins behaviour.
There is also a new 2019.2.4 version out (maybe that helps too?)

The IDEA 2019.3 EAP & DDLC 4.4.0 beta I am using now looks normal.
If I encounter this problem again, I will open this issue again.

Great! Thank you for your patience.
I have a tested and fully functioning v4.4.0. It can be found here
I have submitted v4.4.0 to the JetBrains market place as well. It is not available yet.  So you can also just update once that happens as well :)

Unfortunately, this problem has reappeared.

Maybe I know why this is the case, I need to do a controlled trial.

 You are using a different java run time. I think I know how to address that issue.

Ah! You are using a different java run time. I think I know how to address that issue.

That's great, is it because UIReplacer doesn't work?

I thought at first that com.intellij.ui.tabs.TabsUtil::getTabsHeight had a value inlining, and I added
-XX:CompileCommand=exclude,com.intellij.ui.tabs.TabsUtil::getTabsHeight But it doesn't work haha.

As for why I use JDK13, because my plugin is based on this. By the way, the Shenandoah GC that appeared in JDK12 is great.

Very close!
For some silly reason, tab height is negative in the JetBrains JDK and not negative in other JDKs
https://github.com/cyclic-reference/ddlc-jetbrains-theme/blob/master/src/main/java/com/chrisrm/ideaddlc/UIReplacer.java#L405
So the fix is to not make tab height negative if not using JetBrains JDK.
Is the fix dumb? Yes. Does it work? Yes!
:)

I can get you a version that works only with your JDK for the time being (if you want). I only have time on the weekend at the moment to do the full fix.

I can get you a version that works only with your JDK for the time being (if you want). I only have time on the weekend at the moment to do the full fix.

I am happy to try a specific version.

For some silly reason, tab height is negative in the JetBrains JDK and not negative in other JDKs

This is really a laugh. Haha.

Here is the plugin that will work on your java runtime. Thanks for your patience!

Is there any missing step?

Darn! I thought that would have been it. Well I know how to replicate the issue now, I'll eventually get it.

It's ok, I will wait for the next build. :)

Alright! I got the issue solved!
Here is the new release
Let me know if it works!

Ok, I will try it now.

Great, it works.

It seems that only the title bar is inconsistent.
The issue in the title bar is not very important, you can give a lower priority.

I can look at the title bar while I am at it, I'll see what I can do today.

This thing, right?
.

If I am awake, I should be able to test it at any time.
:)

Okay, I'll see what I can do about that.
I'll get to it next weekend. I'll see if I can find time earlier though.

It doesn't matter, you can continue this at any time.

Hey!
 First thing you will probably notice is that it is less "OMG Pink". I am quite happy as to how it turned out.
I wanted a cleaner more consistent look, and I also had an excuse to do it to.
I have attached the latest and greatest on the newest release, and also you can see more of the noted changes
https://github.com/cyclic-reference/ddlc-jetbrains-theme/releases/tag/v5.0.0
If you have more issues with the title bar please open another issue
Thanks!


03/31/2018 14:50 : Create Pull Request for branch master -> prTesting1_2018033114

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestRef1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add support for Stack Overflow

What's this PR do?
Adds support for StackOverflow suggestions for the following activities:

Asking a question
Answering a question

Where should the reviewer start?
Feel free to test on stack overflow. I'll send an invite to a private team instance for testing.
Any background context you want to provide?
This extension uses a timestamp in an HTML attribute to determine when new activities have happened.
I am unsure of what document type we should use. If anything, this item feels like a conversation which is not a document type we currently support. But there are other tools (Intercom, Email) that would use the type conversation as well.
What gif best describes this PR or how it makes you feel?

Definition of Done:

[ ] Code is easy to understand and conforms with Prettier & eslint configs
[ ] Incomplete code is marked with TODOs
[ ] Code is suitably instrumented with logging and metrics
[ ] Documentation has been updated as appropriate
[ ] Manifest has been updated and version incremented correctly
[ ] OWASP Top 10 have been considered

Oh no, sorry... there was a weird formatting thing that happened when I tried to make the code change via a GitHub suggestion. Just fixed it with that last PR.

@chrisforrette - I think I need another review on this PR. Something about the commit I added dismissed your review.

@chrisforrette since this is an open source repository where external contributors can send PRs I wanted to make sure that followup commits required a review.

@dpup Ah, that makes sense.


[FRAAS-992] Add SMTP Server REST Calls

Ready for review
Since not all reviewers are on the Postman Prod group, I've shared the relevant section of REST calls here: https://documenter.getpostman.com/view/2524838/SVmpYhfn?version=latest#14a0c260-f941-440e-a98f-7e0dc1f2e29f

As you can see from the section, I've included REST calls to GET, PUT (configure/modify), and DELETE an SMTP server, with (I hope) appropriate doc for each.
I've included the following SMTP-related variables:

smtpUsername
smtpPassword
smtpHost
smtpPort

I've included example output for each REST call, with explanations.

A bit of scope creep: I've done two additional things:

I've added a tenantName variable, so users can fill in this variable once (and not three times)
I've set up a "GET Access Token" call, based on the sign-in credentials of a Team Member (requires teamMemberName and teamMemberPassword -- but I use the authId output to fill in the value of accessToken for subsequent REST calls.
2a) I've organized that GET Access Token call with the existing GET app and GET apps call, in a new folder called "Apps and Tokens".

**** Before Merging ********
I'll need to update the titles of the Collection and the Environment. I propose that we include v2 in the names (and file names)
*** Variables ****
We need to doc the different variables, especially those that users need to "fill in" before the collection is useful. I've planned this in FRAAS-23, tentatively scheduled for sprint 2019.13.

A few notes...
1. `Delete Configured SMTP Server` contains a JSON body.  The body should be empty.

2. In order to use the /v1/email-server API, you must have the following credential grants: `email-server-config.read` `email-server-config.update` `email-server-config.delete`.  I'm not sure where to best note this or document it, but the REST calls won't work without it.

3. Should mandatoryTLS be a variable?  I imagine a user could modify it directly in the postman request body if they like, so maybe it's OK hard coded to true in `Configure/Modify SMTP Server`.

I think item 1 is the only one that really needs to be changed.

Thanks Erik. I think I also need to address item 2 at least in the dev docs (will push into the other PR). And as for item 3, given the tenor of our previous meeting, I think mandatoryTLS should be hard coded to true.

Previously approved. Removed references to PR. Added git commit hash to Postman repo doc for tracking purposes.


chore(main): release 0.1.2

:robot: I have created a release beep boop
0.1.2 (2023-08-28)
Bug Fixes

use correct token for publishing to pypi (#11) (13a17e6)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/momentohq/momento-python-redis-client/releases/tag/v0.1.2 :sunflower:


Refine credentials example

Why
Add examples of how to use credentials in document.
What

update readme
update examples

I have updated the code, please review. @rui1234


loss of protections when updating

Version before updating protections: lwc 1.9.4 Spigot version 1.12.2 (last version 1.12.2)
Version used to update the database: lwc 2.1.0-dev Spigot 1.13.1 (last version)
Good afternoon
As you can see in the photo, all the existing protections of the user mar9 appear when writing / lwc admin find mar9 and if I look at their protections 233 appear occupied (the same as in 1.12.2) In that example photo id 11966 exists and with / lwc admin view 11966 shows the content of the chest, but when doing the same with the id (year 2016) 903 does not allow to see the content indicating that there is no such protection. And if I move to the coordinate the chest is unprotected. With the id 11966 all right and protected box. In short, the old protections appear with / lwc admin view but in practice they do not exist, with which they are newer everything is correct.
Greetings and thanks.
EDIT: I add that I have continued looking at protections and I am not sure that it is a problem with old protections. Since the indicated ID11966 is from 1-1-2017 and there are protections from 20-1-2017 that are in the same state as the ID903 of 10-12-2016.

I think you might have not read the updates section on the spigot resource page. Database upgrade from LWC 1.9.4 (1.12.2) to 2.x.x (1.13.x) is not supported yet. We don't recommend downloading or using dev builds unless you know what you are doing. They are unsafe to use and unintended for use in production.

sorry I read it wrong, now I see that you have not yet allowed the conversion of 1.12.2. I'm using it on a test server.
Greetings and thanks for the plugin.

Ah, good to know that it was only a test server. Some people have lost their databases and protections permanently due to not backing it up before loading in 1.13. There will be another update  when the initial (experimental) version with a database migrator for 1.12 -> 1.13 becomes available.
Thank you for your understanding. This update has been a lot of work for us, especially considering the previous author has left us.

buff is that not making a copy of the database and putting in a production server the current versions is crazy. This week I'm starting to see plugins already quite stable.
I respect the LWC, all right the database works perfectly. He has respected all the protections.
Very good work, thank you very much.


1212

Q
A

Is bugfix?
✔/❌

New feature?
✔/❌

Breaks BC?
✔/❌

Fixed issues
comma-separated list of tickets # fixed by the PR, if any

qweqw

dfgdfgfdg


Adds createMovie function to generate movie

closes #63

Why the _add_docstring decorator is not working? Interesting.

Codecov Report
Base: 99.53% // Head: 99.26% // Decreases project coverage by -0.27% :warning:

Coverage data is based on head (263badd) compared to base (ccc80c3).
Patch coverage: 93.93% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #73      +/-   ##
==========================================
- Coverage   99.53%   99.26%   -0.28%
==========================================
  Files          24       25       +1
  Lines         647      679      +32
==========================================
+ Hits          644      674      +30
- Misses          3        5       +2

Impacted Files
Coverage Δ

hvpy/helper.py
93.75% <93.75%> (ø)

hvpy/utils.py
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

2022-08-20T11:42:06.641586_2022-08-20T11:47:06.641586.mp4 is also too verbose of a filename. We need to work out something better.

2022-08-20T11:42:06.641586_2022-08-20T11:47:06.641586.mp4 is also too verbose of a filename. We need to work out something better.

Also, what should I do to fix the failing test?

2022-08-20T11:42:06.641586_2022-08-20T11:47:06.641586.mp4 is also too verbose of a filename. We need to work out something better.

Is only the date reasonable? eg: 2022-08-20_2022-08-21.mp4

2022-08-20T11:42:06.641586_2022-08-20T11:47:06.641586.mp4 is also too verbose of a filename. We need to work out something better.

Is only the date reasonable? eg: 2022-08-20_2022-08-21.mp4

I think there needs to be more information.

So in theory the screenshot version will look like this PR.


az vm run-command is not working with script files as stated

The az vm run-command is not working with script files as stated in this page. Nor are they working from a yml pipeline (AzDo) in the same manner as from the commandline.
From the commandline, to be able to use a script, you sometimes need to put single quotes around the script name (not alway, which seems inconsistent. Using this command with a deployment pipeline to run certain scripts at once (dcs is too slow), you need to put quotes around the scriptname, because it will report an error if you don't. And when you do, the pipeline complains the following: "\nThe splatting operator '@' cannot be used to reference variables in an expression." And if that isn't happening, then a powershell script is created with quotes around the scriptname, instead of the script.
And lastely, the command does strange things when you use more than 2 parameters.
Unfortunately the Powershell cmdlet is having it's own quircks, although moslty similar results as with az.
We are running Az CLI 2.22.0.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f04b196d-7d11-7213-f037-f12b85b19c52
Version Independent ID: adc05d8e-b13b-134b-5f61-42aaf23666df
Content: az vm run-command
Content Source: latest/docs-ref-autogen/vm/run-command.yml
Service: virtual-machines
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

add @qwordy to have a look

@bj-tukker Quotes are error-prone in Azure CLI.
You can refer to https://docs.microsoft.com/en-us/cli/azure/use-cli-effectively#using-quotation-marks-in-values
"\nThe splatting operator '@' cannot be used to reference variables in an expression."
This sentence indicates that '@' is a special character in pipeline language. It is used to reference a variable. But we want to pass it as a normal character to Azure CLI.


Pseudo selectors not applying when app resumes

Did you verify this is a real problem by searching Stack Overflow and the other open issues in this repo?
I didn't search Stackoverflow but the android-runtime issues.
This is a real problem and easily reproducible with a sample app.
Tell us about the problem
I created a sample app to play around with the Button:highlighted { ... } selector. So it's the X taps left sample without any styling other than Button:highlighted { background-color: red; } in the app.css.
Additional information: If you navigate to another page the selector works again. So it just doesn't work on the resumed page anymore until you navigate away from it
Please provide the following version numbers that your issue occurs with:

CLI: 2.4.0
Cross-platform modules: 2.4.0
Runtime(s): 2.4.0
Plugin(s): Do not matter for this issue

Did the error happen while the app was being constructed? (buildtime error)
No
Did the error happen while the app was executing? (runtime error)
Yes, but it's not an error, just not working on Android :)
Please tell us how to recreate the issue in as much detail as possible.
How to reproduce:

Create a sample app (tns create myButtonHightlightSampleApp --ng) and open app.css and delete the import statement, we don't want anything to interfere with our styling
Add Button:highlighted { background-color: red; } to the app.css as last line (pseudo selector needs to be at the bottom as other selectors overwrite their rule)
Start the sample app on iOS first (it works there) and tap the button: it will turn red
Now turn off the screen and turn it on again (iOS), tap the button: it will still turn red
Start the sample app on Android and tap the button: it will turn red
Now turn off the screen and on again (or exit the app and resume it again), tap the button: it will NOT turn red

This issue was moved to NativeScript/NativeScript#3172


November Binary Update

Added new binaries.

Built by this run: https://github.com/SciSharp/LLamaSharp/actions/runs/6921572568
llama.cpp commit: e937066420b79a757bf80e9836eb12b88420a218
Rearranged paths of binaries
Added all the various AVX binaries (successfully autodetects and loads AVX2 on my PC)
Added new symbols from llama.h (although no high level bindings)

@AsakusaRinne I've updated the nuspec files and I think they build correct. I haven't really worked with nuspec much before though so please look at those closely in your review!

It looks good, I'll double-check the nuget package generation before next release. :)

@martindevans It looks good, and I pass all test locally with the binaries.


doc: update python-sdk example in README to v1.0.0 api

Thanks @ryn9 for pointing this out / apologies for the trouble!
Fixes #28, #27

Thank you @chrisdickinson and @nilslice


Fix panics due to bad offsets when calling rowan token_at_offset

Currently only see this behavior in Zed, but pretty often can get errors like
stderr: server: initializing state and starting event loop
stderr: server: determining workspace output_base
stderr: server: running "bazel info build-language"
stderr: thread '<unnamed>' panicked at external/crates__rowan-0.15.15/src/cursor.rs:751:9:
stderr: Bad offset: range 0..43 offset 47
stderr: note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
stderr: Rayon: detected unexpected panic; aborting

Haven't seen this at all in VSCode, so I'm thinking it's maybe something Zed specific about the order in which it delivers textDocument/didChange notifications and positional requests like goto def

@zaucy FYI, addressing this here in case you've seen this with Zed

I actually haven't ran into this! Or I just haven't noticed. Could be platform dependent? I'm mainly running on Windows right now.

Hmm, potentially, not familiar enough with how Zed does LSP to be sure tho.. either way it should be fixed across platforms now!


Refactor generated builder set methods to always take Option

This is a breaking change: All set_* methods on builders and clients will take an Option<T> where they sometimes used to take a T.
This is a refactor that will make it possible to simplify the code in #498. It also simplifies some existing code, such as the parsing of HTTP headers into non-optional values. Now the error handling for that lives in the builder rather than in the header parsing.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

After examining it, I think I'm going to hold off on creating a common BuilderGenerator.callSetter. It would definitely benefit the SerdeJsonSerializerGenerator, but that's not going to be sticking around. I'll keep it in mind though as it may also benefit the new JsonSerializerGenerator in my other PR.


test: Need to add tests which verify NotificationServiceImpl's lifecycle / state management

Describe the bug
While implementing #824 I identified and fixed some edge case bugs related to the isMonitorPaused state, and the _connectivityListener instance variable. There are currently no tests which exercise these edge cases to prevent regression.
Steps to reproduce
n/a
Expected behavior
Need tests to

verify that isMonitorPaused is left in correct state (false) by _startMonitor even if Monitor fails to start. Previously, the code was not setting isMonitorPaused to false unless the Monitor actually started. In turn, NotificationServiceImpl.monitorRetry (which the Monitor will call if it fails to start) would have not actually retried, because, intentionally, it will not actually retry starting the monitor if isMonitorPaused is true
verify that isMonitorPaused is left in correct state after repeated executions of subscribe and stopAllSubscriptions
verify that _connectivityListener is null after a call tostopAllSubscriptions
verify that _connectivityListener is not null after a 'real' call to subscribe, and that a connectivity listener subscription has been set up

Screenshots
No response
Smartphones
No response
Were you using an atApplication when the bug was found?
No response
Additional context
No response

Moved to Backlog as there is more important work to do right now


docs: recommend CYPRESS_INSTALL_BINARY=0 for cypress/included Docker image

related to https://github.com/cypress-io/cypress-docker-images/issues/1119

Issue
If cypress-io/github-action is used to run a Cypress Docker image cypress/included as a container with --user 1001 (as recommended), then GitHub actions may report a caching error:

Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2

Background
cypress/included Docker images include the Cypress binary installed in /root/.cache/Cypress with owner root (see environment variable CYPRESS_CACHE_FOLDER of Docker image).
By default cypress-io/github-action attempts to cache and restore the Cypress binary. Any such restore action fails if the user has been set to a non-root value, since the owner of $CYPRESS_CACHE_FOLDER is root.
Caching the Cypress binary is superfluous when the Docker image already includes the binary.
If the environment variable CYPRESS_INSTALL_BINARY=0 is set (see Skipping installation) then isCypressBinarySkipped is set internally in the action and no CYPRESS_BINARY_CACHE is saved. If no cache is saved, then restoreCachedCypressBinary will not be able to restore a cache and will not provoke any error condition.
Note that this is not quite error proof because if a workflow has run without CYPRESS_INSTALL_BINARY=0 and has stored a cache, then this will be picked up and provoke an error message. This is mitigated by the fact that the error is cosmetic, in that it does not cause the workflow to fail. It is also self-correcting since cache entries which have not been accessed in over 7 days are removed (see User limits and eviction policy).
Change
Add advice to README > Docker image to set CYPRESS_INSTALL_BINARY=0 with cypress/included Docker images.

Preview
https://github.com/MikeMcC399/github-action/blob/cypress-included-setup/README.md#docker-image


Add volume/volumeMounts and config.path property to yaml-section of values.yaml

Fixes #14

Example config (using empty-dir instead of config-map):
## Default values for Traefik
image:
  name: traefik
  tag: 2.0.2
#
deployment:
  replicas: 1
#
ports:
  web:
    port: 8000
  websecure:
    port: 8443
  traefik:
    port: 9000
#
logs:
  loglevel: INFO
#
yaml:
  resources:
    requests:
      cpu: "100m"
      memory: "50Mi"
    limits:
      cpu: "300m"
      memory: "150Mi"
  volumes:
  - name: config
    emptyDir: {}
  volumeMounts:
  - name: config
    mountPath: /config
#
config:
  path: /config/traefik-config.toml

Would this also work if one wanted to create a file provider?

Sure, as long as the file is in the config-map one could reference it from the main config-file.

Hi @frelon
Thanks for your contribution.
I will close your PR in favor of #84
Duplicate of #84


Add praqma automation user to dr-memory plugin for new release

Description
Repo with plugin code is located here: https://github.com/praqma/drmemory-plugin
Submitter checklist for changing permissions
Always

[x] Add link to plugin/component Git repository in description above

When adding new uploaders (this includes newly created permissions files)

[x] Make sure to @mention an existing maintainer to confirm the permissions request, if applicable
[x] Use the Jenkins community (LDAP) account name in the YAML file, not the GitHub account name
[x] All newly added users have logged in to Artifactory at least once

This is for our automation user @ReleasePraqma (Automation user)


Support multiple position options for popover

Thanks very much, guys, for your jobs. Very useful module.
i have suggestions relatively popover component. Be nice if, maybe in future, popover component have following position settings: top-left, top-right, bottom-left, bottom-right. Something like this:

Thanks.

There are already multiple tickets on this - see my PR at #3900 for a preliminary implementation that would allow support of this feature.

+1 to this and for #3900.
One concern I want to raise here is that we may need to put the directions in different order to mean different things. For instance, the popover in the issue comment screenshot is to the right of the button and aligned with the bottom edge. I've mostly worked with popovers that are above or below the button and align with the sides. For example, this is what I would call a bottom-left popover.

Since it is below the target element and aligned with the left edge. By this scheme, the popover in the issue screenshot would be a right-bottom popover, not a bottom-right.

Please don't +1 issues - rest of the commentary is fine, just adding that to educate since it alone adds no valuable signal or information :) .
Thanks for that particular use case though - that is useful information for when we tackle this on full.

Understood. BTW @wesleycho - is there anything I can do to help move the needle on this? My day job is stuck on an ancient forked version of ui-bootstrap and this is something we desperately need. I'd be glad to help out in whatever capacity.

If you're willing to put in the legwork to implement it properly based on master with proper test coverage, we'd gladly accept pull requests.

Closing in favor of #4762.


Only build the default doc target for windows-sys

Fixes #1507

@kennykerr yep, that's it, thanks!


Centralize the OpenIdConfiguration related logic

Describe the bug
There are multiple places where Open ID configuration is fetched (AadSmartOnFhirProxyController,
CapabilityStatementExtensions). We should move them to a centralized location and initialize it at proper place (e.g., not inside constructor).

No enhancements will be made to SMART on FHIR proxy and hence closing


Proposal: Add example build setups & use cases for reference and smoke testing.

Recently, an issue came up that only occurs when loading @mux/videojs-kit in a node environment. It would be good to have some ready to use examples to do basic smoke testing for build setups and app use cases, whether they get added to this project or some other well-known one. A couple of potential references:

example apps similar to https://github.com/muxinc/elements/tree/main/examples (with whatever set would be appropriate)
example build setups a la https://github.com/videojs/videojs-bundler-sample (thanks @gkatsev for putting this on my radar)

Video.js also has require tests that run node, webpack, and browserify builds as part of tests to verify that there aren't any regressions https://github.com/videojs/video.js/tree/main/test/require


Avoid recursing over the same items in enforceWithDependencies

Fix for issue https://issues.gradle.org/browse/GRADLE-3283
To reproduce the bug, create a build.gradle with the following task and run actualTask.  With the fix, the task finishes within a minute.  Without the change the task will finish when the universe implodes:
defaultTasks "actualTask"
1000.times { index ->
def testTask = task "testTask$index" << {}
index.times
{ testTask.dependsOn tasks.findByName("testTask$it") }
}
println "Done setting up"
task finalizerTask
finalizerTask.dependsOn testTask333
task actualTask
actualTask.finalizedBy finalizerTask

@ashoykh Thank you for the pull request. Could you sign the CLA and provide a test case?

Not sure if this is helpful but I tried this patch and it worked on the test-case provided. It fixed my issue I was having - I would love to see this merged.

@dzan That's helpful, thank you for confirming. The pull request looks good. I was thinking about adding an automated test case but it may not be needed in this case. I'll check with the team and merge soon.
@ashoykh We've got your CLA. Thanks.

Thank you for the pull request. This change will be available in Gradle 2.10.

My pleasure. Thank you for completing the request.
On Nov 20, 2015 02:01, "Piotr Jagielski"<EMAIL_ADDRESS>wrote:

Thank you for the pull request. This change will be available in Gradle
2.10.
—
Reply to this email directly or view it on GitHub
https://github.com/gradle/gradle/pull/525#issuecomment-158344742.

This commit might be related: https://github.com/gradle/gradle/commit/9c1f69f0


Parallelfuture

The future objects remain in state pending. At the same time as using multiple mpi parallel tasks next to mpi4py requires the protocols to be submitted using mpiexec -n 1 this is presumably not possible with flux. Unless this can be controlled in terms of the number of threads per task.


I can't download the video with maximum resolution in bilibili.

Checklist

[x] I'm asking a question
[x] I've looked through the README and FAQ for similar questions
[x] I've searched the bugtracker for similar questions including closed ones

Question

When I use youtube-dl to download videos on bilibili (https://www.bilibili.com/video/BV1Hg411B7iR/), and I also logged in(the command is youtube-dl -u <my username> -p <my password> "https://www.bilibili.com/video/BV1Hg411B7iR/"), but it still download in 360P . How to solve it?

The yt-dlp extractor finds the avc, av01 and aac formats at video including 480p and possibly 1080p if you're logged in. Here's a quick back-port of that extractor doing the same in yt-dl:
$ python -m youtube_dl -v -F 'https://www.bilibili.com/video/BV1Hg411B7iR/'
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'https://www.bilibili.com/video/BV1Hg411B7iR/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Git HEAD: fdb16c0d6
[debug] Python version 2.7.17 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[BiliBili] 1Hg411B7iR: Downloading webpage
[BiliBili] BV1Hg411B7iR: Extracting videos in anthology
[BiliBili] Formats 1080P 高清, 720P 高清 are missing; you have to login or become premium member to download them
[BiliBili] 517297060: Extracting chapters
[info] Available formats for BV1Hg411B7iR:
format code  extension  resolution note
0            m4a        audio only   67k , mp4a.40.2
1            m4a        audio only  129k , mp4a.40.2
2            m4a        audio only  129k , mp4a.40.2
3            mp4        640x360      42k , avc1.64001E, 25.0fps, video only
4            mp4        640x360      53k , av01.0.08M.<IP_ADDRESS>.01.01.0, 25.039fps, video only
5            mp4        852x480      68k , avc1.64001F, 25.0fps, video only
6            mp4        852x480      74k , av01.0.08M.<IP_ADDRESS>.01.01.0, 25.039fps, video only (best)
$

However I can't push this without a few changes to the underlying framework that would need to be properly implemented and validated.

Why I don't have the same output as you?
% python -m youtube_dl -v -F 'https://www.bilibili.com/video/BV1Hg411B7iR/'
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-F', 'https://www.bilibili.com/video/BV1Hg411B7iR/']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.8.11 (CPython) - macOS-12.6-arm64-arm-64bit
[debug] exe versions: ffmpeg 5.1.2, ffprobe 5.1.2, phantomjs 2.1.1
[debug] Proxy map: {}
[BiliBili] 1Hg411B7iR: Downloading webpage
[BiliBili] 1Hg411B7iR: Downloading video info page
[info] Available formats for 1Hg411B7iR:
format code  extension  resolution note
0            mp4        unknown    18.24MiB

You aren't using my modified extractor code, since I didn't publish it!

@dirkf
Just for curiosity, do you happen to know the key difference in yt-dlp and youtube-dl's way of extraction?
Did it get the info via another protocol or API?

Fundamentally, yt-dl used different (presumably historic) API URLs and did a lot less around them. yt-dlp gets JSON from the page and then uses https://api.bilibili.com/x/player/pagelist. yt-dl relies on http://bangumi.bilibili.com/web_api/get_source and http://interface.bilibili.com/v2/playurl.

According to https://github.com/yt-dlp/yt-dlp/issues/5655, 1080p formats may be available in a browser session but not found by yt-dlp from the browser cookies. We also need to include whatever is the resolution of that issue.

https://github.com/yt-dlp/yt-dlp/issues/5655#issuecomment-1329898952.

Apparently this will be the result after back-porting from yt-dlp: https://github.com/yt-dlp/yt-dlp/issues/5655#issuecomment-1329942574.
The yt-dlp extraction doesn't appear to find the low res combined mp4 that the yt-dl extractor finds.


Non-Git Native Spring Cloud Config | How to use label?

As we all know, we can access environment specific properties from the Spring Cloud Config using
{application}, which maps to spring.application.name on the client side.
{profile}, which maps to spring.profiles.active on the client (comma-separated list).
{label}, which is a server side feature labelling a "versioned" set of config files.
This works with both Git repo as well File system[Native] in the backend. However for native how we can make use of label? Any suggestions? Any link or document reference would be helpful.
Opened SO question here as well
https://stackoverflow.com/questions/50210525/non-git-native-spring-cloud-config-how-to-use-label

Closing the issue as this doesn't belong to Cloud bus


[add-resource] New Skeleton

I would like to add my new skeleton to the Grav Repository: tranduyhung/grav-skeleton-mache
Thanks!

Added for next update


DBZ-926 Adding flushed LSN to log message

https://issues.jboss.org/projects/DBZ/issues/DBZ-926
Just a minor fallout of DBZ-926. Still unclear whether it's actually an issue or not. If not, let's repurpose it to solely improving this log message.

@gunnarmorling Thanks, useful improvement for diagnosis


Bug Report: it says it couldnt find visual studio 2017, and its missing HXCPP_VARS

Please check for duplicates, similar issues or closed issues with the same problem, as well performing simple troubleshooting steps (such as deleting the export folder if it's an issue with compiling, reinstalling Kade Engine) before submitting an issue.
If you are playing a downloaded version of the game, what operating system are you using?
Windows (x86), Windows (x86_64), Linux, or macOS? Specify below.
What version of the game are you using? Look in the bottom left corner of the main menu. 1.17 and im trying to build this game. to mod (duh)
Have you identified any steps to reproduce the bug? If so, please describe them below. Use images if possible.
Please describe your issue. Provide extensive detail and images if possible.

You need to install Visual Studio 2017 in order to build the game on Windows:
https://github.com/KadeDev/Kade-Engine/blob/stable/docs/building.md#windows-only-dependencies-only-for-building-to-windows-building-html5-on-windows-does-not-require-this

You need to install Visual Studio 2017 in order to build the game on Windows:
https://github.com/KadeDev/Kade-Engine/blob/stable/docs/building.md#windows-only-dependencies-only-for-building-to-windows-building-html5-on-windows-does-not-require-this

If this worked, please close this.
Please read building.md before trying to compile


Loading current level is broken in packaged builds

When loading a game in the same level as the current one, the engine loads the default map in packaged builds. The reason seems to be  that the current world gets unloaded from its package, which results in engine not finding it during travel and browsing to the default map as a fallback. A workaround is to load a temporary level first and then perform game loading.

I thought that #101 dealt with this?

Maybe it fixed some of the cases, but not everything. I simply do a quick save/quick load combo and it's 100% reproducible. @YeNov can you take a look?

After some debugging, it looks like even when keeping a hard reference to the world, as introduced in that fix, it still gets GC'd.

Found the cause of GC - UEngine::LoadMap() calls UWorld::MarkObjectsPendingKill() which marks the world as garbage. Using a property won't help.

This must have changed at some point because I never used to have this problem in packaged builds for the game I wrote SPUD for (I don't currently use it because we don't have level save state in our new game)

Hello @krojew . Sorry for not answering for that long, got a bit busy. What you say totally makes sense - world and levels are marked as garbage logically (RF_MirroredGarbage). Though it doesn't fire in my current use-cases, it could've potentially. I tried to do several fast loads from the same level, but it never crashed on the Dev build. I want to try it in shipment, but it will take some time. What is your build config?
Also I remember having similar-ish issue, when trying to load an object which was marked for GC (dialogue scene) and there's a pretty specific way of triggering it - simulating a scarce of resources (or just run the game on any console dev kit). May I ask what is your memory load (RAM) in the moment of loading the game?

@YeNov we should not rely on GC not triggering to be able to load the map. This will sometimes work, other times not, as in my tests. I'm wondering if this can be an engine bug, because it's now impossible to reload current level reliably, regardless of using SPUD or not. If you have access to UDN, can you ask Epic directly?

@krojew never meant to say we can rely on it, just an observation. I can do the UDN post. It would also help if I included your answers to the questions I posted above. It could be helpful to gather more information to question Epics

Hey @krojew , I brought you some news from UDN
The quickest fix would be usin "GDelayTrimMemoryDuringMapLoadMode 2" . The var  controls whether a full garbage collection pass is done in-between the current map being unloaded and the new map being loaded (this would allow the map to be loaded cleanly. Also they mentioned using hard reference to the packages one want to keep from being GCd. The hard references should be kept in something that survives map travel lifecycle ofc (like spud subsystem, which is game instance subsystem).
Also they question to provide some additional info so they could investigate it thoroughly.

I also want to investigate in how far 'failing to reload current map' affects projects with default settings. Can you provide the following info?
What's your current value for GDelayTrimMemoryDuringMapLoadMode?
What's your level setup - using world partition? Level Instances? Sub levels?
Are you using the experimental Incremental Garbage Collection feature?
Have you been able to reproduce the bug in a fresh project, like ThirdPersonTemplate? Just making sure if your repro steps will lead to a repro or are theoretical, because project settings may be important to repro.
Do your log files show any warnings/errors that may hint at what exactly goes wrong?

@YeNov I tried setting GDelayTrimMemoryDuringMapLoadModeCVar to 2, but then it crashes GameplayDebuggerModule on map load, unfortunately. Looks like this is another engine bug:
[2024.11.06-14.31.41:619][539]LogWindows: Error: Assertion failed: ManagerOb [File:D:\build\++UE5\Sync\Engine\Source\Runtime\GameplayDebugger\Private\GameplayDebuggerModule.cpp] [Line: 136]
[2024.11.06-14.31.41:619][539]LogWindows: Error:
[2024.11.06-14.31.41:619][539]LogWindows: Error:
[2024.11.06-14.31.41:619][539]LogWindows: Error:
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614a31961 xxx.exe!FGameplayDebuggerModule::GetPlayerManager() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614a3c3a8 xxx.exe!FGameplayDebuggerModule::OnWorldInitialized() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614a30011 xxx.exe!TBaseRawMethodDelegateInstance<0,FGameplayDebuggerModule,void __cdecl(UWorld * __ptr64,FWorldInitializationValues),FDefaultDelegateUserPolicy>::ExecuteIfSafe() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614679f0d xxx.exe!TMulticastDelegateBase<FDefaultDelegateUserPolicy>::Broadcast<IBaseDelegateInstance<void __cdecl(UWorld * __ptr64,FWorldInitializationValues),FDefaultDelegateUserPolicy>,UWorld * __ptr64,FWorldInitializationValues>() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff6146af496 xxx.exe!UWorld::InitWorld() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff61454c762 xxx.exe!UEngine::LoadMap() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff6144cf225 xxx.exe!UEngine::Browse() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff6145892cf xxx.exe!UEngine::TickWorldTravel() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff6136fec60 xxx.exe!UGameEngine::Tick() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614d5f9ca xxx.exe!FEngineLoop::Tick() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614d77d1c xxx.exe!GuardedMain() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614d77dea xxx.exe!GuardedMainWrapper() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614d7a9b5 xxx.exe!LaunchWindowsStartup() []
[2024.11.06-14.31.41:619][539]LogWindows: Error: [Callstack] 0x00007ff614d8ac94 xxx.exe!WinMain() []

To answer the questions:

What's your current value for GDelayTrimMemoryDuringMapLoadMode?

0

What's your level setup - using world partition? Level Instances? Sub levels?

World partition; nothing else.

Are you using the experimental Incremental Garbage Collection feature?

No.

Do your log files show any warnings/errors that may hint at what exactly goes wrong?

There's no error and I don't think this should be treated as such - it's a normal flow in the engine. The world is marked as garbage explicitly, GC runs, and then the problem occurs.

@YeNov I don't know if it's important, but I'm using the CommonLoadingScreen plugin.

Hey @krojew , coming back to you. I have no knowledge about CommonLoadingScreen plugin, have you tried without it? Do you have reproducibility only on your PC or other computers also have it? We have like 5 different computers and no crashes since my fix (hard reference property + long path name) is provided. I want to speculate that maybe having hard reference to a pending kill object blocks GC, even though the object is removed from the root set. Maybe you have something else that could break GC on your side?
Also epics asked me to provide some info which I cannot, as my version doesn't crash, so maybe you could help with that:

You haven't shared errors or warnings, but I'd expect something in the logs that hints to why the map fails to load. Is there anything? Otherwise can you investigate and share back with us the following info.
Which code branch in UEngine::Browse is it returning the EBrowseReturnVal::Failure value? Alternatively what is the failure message returned by Browse? This should be printed if you enable the log category LogGlobalStatus.
Enabling log category LogUObjectGlobals may also reveal some relevant information, if the root cause is related to occupied UObject path names. If some objects are alive that the map reload are trying to create as well, that could be causing failures.

Thx, I'll forward it to them

@krojew update from Epics:

I agree the error message 'Failed to load package' won't provide much help. Can you ask your engineer to either:
Try and reproduce this in a clean project and share it with us so that we can debug locally, or
Modify engine code to place more debug logging code inside UEngine::LoadMap(). This is what I added on my end to see what should happen:

// See if the level is already in memory
WorldPackage = FindPackage(nullptr, *URL.Map);
UE_LOG(LogTemp, Warning, TEXT("Found world package: %s"), WorldPackage ? *WorldPackage->GetPathName() : TEXT("null"));

bool bPackageAlreadyLoaded = (WorldPackage != nullptr);

// If the level isn't already in memory, load level from disk
if (WorldPackage == nullptr)
{
	WorldPackage = LoadPackage(nullptr, *URL.Map, (WorldContext.WorldType == EWorldType::PIE ? LOAD_PackageForPIE : LOAD_None));
	UE_LOG(LogTemp, Warning, TEXT("Loaded world package: %s"), WorldPackage ? *WorldPackage->GetPathName() : TEXT("null"));
}

// Clean up the world type list now that PostLoad has occurred
UWorld::WorldTypePreLoadMap.Remove( URLMapFName );

if (WorldPackage == nullptr)
{
	// it is now the responsibility of the caller to deal with a NULL return value and alert the user if necessary
	Error = FString::Printf(TEXT("Failed to load package '%s'"), *URL.Map);
	return false;
}

// Find the newly loaded world.
NewWorld = UWorld::FindWorldInPackage(WorldPackage);
UE_LOG(LogTemp, Warning, TEXT("World in package: %s"), NewWorld ? *NewWorld->GetPathName() : TEXT("null"));
ForEachObjectWithPackage(WorldPackage, [](UObject* Object)
	{
		UE_LOG(LogTemp, Warning, TEXT("Object in package: %s"), *Object->GetPathName());
		return true;
	}, false);

And for reference, this is the output in my clean UE 5.4.4 packaged build when reloading the map (which is not the game startup map):

[2024.11.13-16.23.08:090][  0]LogTemp: Warning: Found world package: null
[2024.11.13-16.23.08:092][  0]LogTemp: Warning: Loaded world package: /Game/ThirdPerson/Maps/ReloadTest
[2024.11.13-16.23.08:092][  0]LogTemp: Warning: World in package: /Game/ThirdPerson/Maps/ReloadTest.ReloadTest
[2024.11.13-16.23.08:092][  0]LogTemp: Warning: Object in package: /Game/ThirdPerson/Maps/ReloadTest.ReloadTest
[2024.11.13-16.23.08:092][  0]LogTemp: Warning: Object in package: /Game/ThirdPerson/Maps/ReloadTest.ReloadTest_C
[2024.11.13-16.23.08:092][  0]LogTemp: Warning: Object in package: /Game/ThirdPerson/Maps/ReloadTest.Default__ReloadTest_C

Using this as a ground truth, I do believe when reloading the world the package should be unloaded, reloaded and the world findable. Perhaps something in your project is causing the package to still be loaded, which we can then investigate why that's the case.

It makes sense for me that the map is reloaded actually. I don't have capacity to test it all on my side unfortunately, but maybe you can get use out of it

Is it clean project or the working one?

The working one. It's not really clear how to replicate this in a clean project, since for proper replication, SPUD is needed, which already makes it "not clean". If I just call load map in a blank project and the open map template, everything works, but that only proves loading the current map works by default.

Well if it crashes because of SPUD - that's also a proof. I'd say the ideal tests should be like that:

Create clean project, make a WP level with some actors in it, but pretty empty
Call the same thing that SPUD does
UGameplayStatics::OpenLevel(GetWorld(), FName(State->GetPersistentLevel()), true, TravelOptions);
But ofc instead of FName(State->GetPersistentLevel() it could be just a long path to the level
Do the package and test. Write down the results
Add SPUD, call the SPUD load function in package, write down the results
Add the plugin you mentioned, call the SPUD load function, write down the results
This should be enough to track down what causes the issue.

@YeNov I tried experimenting with third person template on open world map with SPUD and common loading screen, and I cannot replicate the issue. It would be great to know if there's a way to debug it and track down the problem.

@krojew Not sure if I can show you any specific way of debugging it, but I'd say one should look into package (map) loading process and check what's going on there, why is it blocked maybe. Good luck


CONTRIBUTING and GOVERNANCE links broken in README

The links to GOVERNANCE and CONTRIBUTING are both broken (send you to a 404) in the README.md.
Took a look, and this is because of the file extension on both files - the actual extensions are .MD and the linked extensions are .md. What you typically see is .md, but not sure if changing the file extension at this point would be destructive to the commit history.

Thanks for the catch! Looking at the other repos, we consistently use .md, so I agree let's rename the link in README.md like you did in your fork (want to submit a PR?)

@nebrius Submitted - was planning on submitting yesterday, but did it through GitHub's interface and it didn't appear in my repos list or in this issue (like it does now, apparently).
Anyway, the PR has been submitted 😊

Thanks for the PR! I noticed that the links are still broken, so I submitted another PR to clean up the remaining issues: https://github.com/nodejs/community-committee/pull/10

Links are now fixed and working, thanks again for the issue! Please feel free to reopen if you still notice anything weird.


Can't creat filter error when running on a different windows machine than what I developed on.

Thank you for this sample and project. I have it working in Visual Studio 2022, but when I build it and take the executable andthe debug folder to another machine I get an immediate error: "Can't create filter" in usbCamera.
Any ideas on how to remedy this? What am I missing on the other Windows machine?
Thanks!
Don

Also, this is a Win Forms application. Visual Studio 2022, DotNet 8, CPU x86


fix: added business tag for private embed ramp

added business tag for private embed ramp

PR fixes following issue(s)
Fixes https://github.com/appsmithorg/cloud-services/issues/1030

Media

A video or a GIF is preferred. when using Loom, don’t embed because it looks like it’s a GIF. instead, just link to the video

Type of change

Please delete options that are not relevant.

Bug fix (non-breaking change which fixes an issue)

Testing

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Also list any relevant details for your test configuration.
Delete anything that is not relevant

[ ] Manual
[ ] Jest
[ ] Cypress

Test Plan

Add Testsmith test cases links that relate to this PR

Issues raised during DP testing

Link issues raised during DP testing for better visiblity and tracking (copy link from comments dropped on this PR)

Checklist:
Dev activity

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[ ] PR is being merged under a feature flag

QA activity:

[ ] Speedbreak features have been covered
[ ] Test plan covers all impacted features and areas of interest
[ ] Test plan has been peer reviewed by project stakeholders and other QA members
[ ] Manually tested functionality on DP
[ ] We had an implementation alignment call with stakeholders post QA Round 2
[ ] Cypress test cases have been added and approved by SDET/manual QA
[ ] Added Test Plan Approved label after Cypress tests were reviewed
[ ] Added Test Plan Approved label after JUnit tests were reviewed

/ok-to-test


Update app.php

Description
Hi, I made some gramatic changes to this translation. Could you please add hacktoberfest-accepted label?
I would be very grateful :)

@KaminskiDaniell
Thanks for your contribution.

Could you please add hacktoberfest-accepted label? I would be very gratefull :)


Update CQD-Power-BI-query-templates.md

Udated URL for template file download.

@JohanFreelancer9 Copy editing is needed for this PR. Thanks.

@SerdarSoysal PR has been copyedited and is ready for final review, could you please check and merge? Thanks!

Updated the three URLs and merged.


runtime: upgrade nodejs runtime from v12 to v16

Node 12 has an end of life on April 30, 2022.
This PR updates the default runtime to node16, rather then node12.
This is supported on all Actions Runners v2.285.0 or later.

Should be a version bump after the PR merge. Thanks!

Thanks @mxschmitt !


[WIP] Fix compilation of spacewalk client

I think the version conflict preventing the spacewalk client from compiling is due to the subxt version we are using.
The polkadot-v0.9.18 version of interlays subxt fork  does not have a subxt-client implementation anymore. I noticed that in the latest interbtc-clients implementation they use a local implementation for that so I copied that to our clients as well.
Closes #69.

Oh okay, this is some weird news. Can this be already reviewed?

Not yet, there now is a new error when compiling:
  error[E0277]: the trait bound `H256: TypeInfo` is not satisfied
     --> /home/marcel/.cargo/git/checkouts/substrate-7e08433d4c370a21/fc3fd07/primitives/runtime/src/traits.rs:511:16
      |
  511 |     type Output = sp_core::H256;
      |                   ^^^^^^^^^^^^^ the trait `TypeInfo` is not implemented for `H256`
      |
      = help: the following other types implement trait `TypeInfo`:
                &T
                &mut T
                ()
                (A, B)
                (A, B, C)
                (A, B, C, D)
                (A, B, C, D, E)
                (A, B, C, D, E, F)
              and 97 others
  note: required by a bound in `traits::Hash::Output`

I was pretty lost trying to solve this on friday.  In sp_core 0.9.18, H256 derives TypeInfo:
construct_fixed_hash! {
    // Fixed-size uninterpreted hash type with 32 bytes (256 bits) size.
    #[cfg_attr(feature = "scale-info", derive(TypeInfo))]
    pub struct H256(32);
}
That macro applies the meta attributes properly and I'm at loss for where to look.

So the vault client is compiling now, if you run
cargo run --bin vault --features standalone-metadata -- --keyring alice --stellar-vault-secret-key <vault-secret>
it should work fine.
Tests are still broken though, so cargo test will still output some errors. This is because we don't have a working version of the whole setup. This will come after this is merged.


"No pages found" issue for ReadComicOnline extension

Source information
ReadComicOnline 1.4.20
Source language
English
Steps to reproduce

Add a comic using the extension to the Mihon library.
Open a chapter/issue to read.

Expected behavior
The issue/chapter should open and be available for reading.
Actual behavior
After briefly loading, "No pages found" error displayed.

Mihon/Tachiyomi version
0.16.5
Android version
Android 14
Other details
No response
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] I have updated the app to version 0.15.3.
[X] I have updated all installed extensions.
[X] I have tried the troubleshooting guide.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I will fill out all of the requested information in this form.

Duplicate of #4028


0.0.2

Codecov Report

Merging #7 (271be36) into main (8504ac1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main       #7   +/-   ##
=======================================
  Coverage   96.87%   96.87%
=======================================
  Files           4        4
  Lines         128      128
=======================================
  Hits          124      124
  Misses          4        4

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8504ac1...271be36. Read the comment docs.


Allow reading values from sources other than CLI flags

This PR adds support for reading values from

Environmental variables
Trunk.toml file

In addition to that, I also switched from structopt to clap 3 beta

Hey there @hamza1311 just wanted to follow-up with you on this one. I decided to take a bit of a different approach with implementing these config layers. It is all on master now, and I am about to cut a release for it. Thanks for hacking on this! I am planning on building the proxy layer for which you opened an issue a few weeks back. Cheers


debug/elf: Incorrectly double-decompressing ELF section

What version of Go are you using (go version)?

$ go version
go version go1.20.1 darwin/arm64

Does this issue reproduce with the latest release?
Yes.

Downloaded the debuginfo for liblzma5:
curl https://debuginfod.ubuntu.com/buildid/0e13b0f27b3bc79a2828c11199ce4336a348af37/debuginfo > liblzma5.debuginfo

Tried to look at the DWARF entries:
package main

import (
	"bytes"
	"debug/elf"
	"fmt"
	"io"
	"net/http"
)

func main() {
	resp, err := http.Get("https://debuginfod.ubuntu.com/buildid/0e13b0f27b3bc79a2828c11199ce4336a348af37/debuginfo")
	if err != nil {
		panic(err)
	}

	if resp.StatusCode != 200 {
		panic("unexpected status code")
	}

	content, err := io.ReadAll(resp.Body)
	if err != nil {
		panic(err)
	}

	f, err := elf.NewFile(bytes.NewReader(content))
	if err != nil {
		panic(err)
	}

	_, err = f.DWARF()
	fmt.Println("DWARF ERROR:", err)
}

And running that returns an error:
$ go run main.go
DWARF ERROR: zlib: invalid header

What did you expect to see?
No error.
What did you see instead?
An error, and I suspect I know why: debug/elf in extremely rare cases attempts to double-decompress an ELF section.
First the call to .Data() returns the decompressed section:
https://github.com/golang/go/blob/0aa14fca8c639c9ceba264dbf0d82bd53306aeaa/src/debug/elf/file.go#L1308
And if by pure chance the first 4 bytes of the decompressed bytes also happen to be what trigger a decompression, then the .DWARF() function will attempt to decompress the section a second time:
https://github.com/golang/go/blob/0aa14fca8c639c9ceba264dbf0d82bd53306aeaa/src/debug/elf/file.go#L1317-L1319
cc @mengzhuo since you recently added this case

A suggestion of how to fix this: I think all the decompression code should live in the (*section).Open function. Then there is no risk of double-decompressing.

I'll send a CL for this issue, thanks.

@brancz Just to be sure, can you confirm that the problem you originally reported is fixed on HEAD?  Thanks.

Sorry for the very late reply, but I can confirm that this has been fixed since the linked change landed.

For future reference, this was the amd64 debuginfo for Ubuntu xz-utils 5.2.4-1ubuntu1.1 (launchpad entry).
Auto-built as part of liblzma5-dbgsym_5.2.4-1ubuntu1.1_amd64.ddeb in https://launchpad.net/~ubuntu-security-proposed/+archive/ubuntu/ppa/+build/23531947.


MathJax can't find its script tag in XHTML if XHTML tags use an explicit prefix

If I create an xhtml page that uses explicit prefixes on the html tags, MathJax's code for finding its <script> tag fails. There also seems to be a similar issue with the <head> tag.
Test case:
<html:html xmlns:html="http://www.w3.org/1999/xhtml" xmlns="http://www.w3.org/1999/xhtml">
  <html:head>
    <html:script type="text/javascript" src="MathJax/MathJax.js?config=default"/>
    <html:title>test</html:title>
  </html:head>
  <html:body>
    <html:h1>This is a test</html:h1>
    <html:div>
      Here is an equation: \( x=5 \)
    </html:div>
  </html:body>

</html:html>

Expected results: Correctly render the equation x=5
Actual results: No rendering  (tested with Firefox 35)
The issue can be worked around by

removing the namespace prefix from the <head> and <script> tags, or
Modifying MathJax.js to use getElementsByTagName("html:script") instead of getElementsByTagName("script"), and similarly getElementsByTagName("html:head") in place of getElementsByTagName("head")

I cannot reproduce this. Are you serving the xhtml file with the correct mimetype?

I can reproduce it (on a local document with extension .xhtml) in Firefox, though it works as expected in Safari and Chrome.  I haven't tried IE.  Yes, having namespaces on those element can be problematic.
It's not actually the script tags that are the problem (since these are created without namespaces by the tex2jax preprocessor, and so will be found by getElementsByTagName()), it is the document head that is the problem (MathJax isn't even getting to the place where it looks for the script tags).  I guess MathJax could use document.head when available and look it up otherwise (conveniently, document.head is set in Firefox even with the namespaces).

OK, I see, finding its own script tag is what you mean.  Yes, that is also a problem.  I'll think about that further.

The issue1016 branch of my fork of MathJax includes the work-arounds that I suggest above.

This is not quite yet solving it for me, at least not on files served through the web server.
My server, or the various transformations therein, put a <!DOCTYPE html> at the top of the document. So when document.getElementsByTagName("head")[0] on line 3041 gives a null, the fall-through creates HEAD from document.childNodes[0]. Unfortunately, document.childNodes[0] is the <!DOCTYPE html>, not the actual HEAD tag or any other meaningful tag, so namespaceURI is null and the problem is not solved.
Possible fixes:

hardwire the namespaceuri to the xhtml namespace "http://www.w3.org/1999/xhtml", and/or
Use the routine from line 644 to find the head

Oops, I thought I had caught them all.  See if the change I just made to the issue1016 branch takes care of it for you.

Glad it worked.  Thanks for helping diagnose the problem, and checking the fixes.  I'll merge into the v2.5 candidate soon.

==> Merged.

It turns out the test suite can't be used to test this issue, due to the way that MathJax is injected into the page.


Safari CORs issue with static assets.

Describe the bug
I'm using web containers api and unable to do an NPM install command on Safari because the t.staticblitz.com domain does not include proper CORs headers, and so Safari errors with:
Failed to load resource: Origin https://stackblitz.com is not allowed by Access-Control-Allow-Origin. Status code: 200

Example failed request:
https://t.staticblitz.com/w/v13/h/e/react-dom@18.2.0?o=https://stackblitz.com

Link to the blitz that caused the error
n/a
Steps to reproduce
Try to start a basic @webcontainers/api project using the latest safari browser.
Expected behavior
I expect the static resources to include cors headers.
Parity with Local

[X] I have run the project in my local machine and I could not reproduce the issue.

Screenshots
No response
Platform

OS: macOS
Browser: Safari
Version: Latest (and technical preview)

Additional context
No response

Hi @nicksrandall 👋 ! Thanks for reaching out!
The headers should be working correctly though, so not sure what's going wrong. For example, SvelteLab works perfectly fine in Safari, and our own documentation website webcontainers.io works correctly with installing dependencies.
Can you post screenshots of the request and response you see in Safari? That might help to see what's going on here.

Closing this issue as it got stale. Feel free to create a new issue if you are still running into this.


Uploads getting stuck at finishing

Seeing an issue where file uploads are getting stuck at finishing and when canceling the upload  it gives an error EOF in the logs and shows the file as completed but is corrupted when trying to use/expand. Using 1.8.5 client, 0.8.0 Server with PreserveResourceForks: false.

Thanks for pointing this out.  Should be fixed now in v0.8.1.

Seems to be fixed for me now, thanks again for the turn around.


Renaming symbol does not update other files with gopls

When renaming a symbol with gopls, the new name is not reflected in other files. The language server will report undeclared name: bar until you open the file with the definition, at which time it will update and the errors will resolve.
I tested the same thing in vscode and it worked fine.
Reproduction:

Install gopls
Set up kak-lsp to use gopls:

[language.go]
filetypes = ["go"]
roots = ["go.mod", ".git", ".hg"]
command = "gopls"

mkdir gopls-test; cd gopls-test; go mod init gopls-test
Create main.go:

package main

func main() {
	foo()
}

Create foo.go:

package main

import "fmt"

func foo() {
	fmt.Println("bar!")
 Thanks for the succinct reproducer.
This issues occurs whether or not the file foo.go is open in kakoune after renaming is done.

This issues occurs whether or not the file foo.go is open in kakoune after renaming is done.

I can't reproduce a problem when both files are opened

Should be fixed, thanks!

I can't reproduce a problem when both files are opened

As @raiguard writes:

Go to foo.go and then back to main.go
Error is gone

Just the act of shifting and shifting back seems to fix the problem. The change you made does not seem to made a difference to that behavior...

when both files are open and I rename from main.go then I get this log:
May 03 17:55:36.478 DEBG To editor `91260`: evaluate-commands -client client0 -verbatim -- evaluate-commands -client client0 -draft -save-regs ^ 'edit -existing -- ''/home/johannes/git/kak-lsp/t/gopls-test/main.go''
select 4.2,4.5
execute-keys -save-regs "" Z
execute-keys "z<space><esc>,<esc>cbar8<esc>"', module: kak_lsp::editor_transport:91
May 03 17:55:36.489 DEBG From editor:
session  = "91260"
buffile  = "/home/johannes/git/kak-lsp/t/gopls-test/foo.go"
filetype = "go"
version  = 11
method   = "textDocument/didChange"
hook     = true
[params]
draft    = """
package main

import \"fmt\"

func bar8() {
\tfmt.Println(\"BAR\")
}
"""
, module: kak_lsp::editor_transport:138

I think the first evaluate-commands triggers the didChange hook. I'm not sure why that doesn't work for you.

sorry my bad, I can reproduce with
HOME=$(mktemp -d) kak -e '
    eval %sh{kak-lsp --kakoune -s $kak_session}
    set global lsp_cmd "kak-lsp -s %val{session} -vvvv --log /tmp/kak-lsp.log"
    lsp-enable' main.go foo.go

I can confirm it's fixed! Thank you.


Get rid of findFunctionEnd

This is another instance of multiple passes over opcodes where I think we can do it in a single pass.
Just removing the calls to that function breaks some of our test suite so we need to be careful to still error the correct errors at the correct times

Closed by https://github.com/malcolmstill/zware/pull/157


Error: NoteSequence undefined is not quantized (missing quantizationInfo)

Hi, I've been attempting to understand && test "magenta-js" project.
I've tested the code in "Making music with magenta.js" page.
Whenever I click the play button("Interpolating between two sequences"),
I've got Error : "Error: NoteSequence undefined is not quantized (missing quantizationInfo)".
Even though I created my own project with the same codebase with 1.5.0(latest version), the error still occurred. I have no idea what is wrong with it.
Seemingly, music_vae.interpolate() function needs quantized variable.
Could you fix this  or Could you show me how to run "Interpolating" play?

Yup, you're totally right. Good catch!
I've updated the code sample to quantize the note sequences first, and then interpolate: https://glitch.com/edit/#!/hello-magenta?path=script.js:183:5


Format felt package

Description
Ran make format from the root project directory to properly format the felt package.
Types of changes

Code style update (formatting, renaming)

Testing
Requires testing: No

Closing in favor of #476


Add accepted format type to  load_seq function

Put format type in the help section so people know what's available

add basic usage

The supported file suffixes are the keys to cogent3.parse.sequence.PARSERS. Including these in the docstring is either done:

manually: which is bad because that can get out-of-date
automagically: requires a decorator that operates like "cogent3.util.misc.extend_docstring_from"

Potentially modify the latter decorator so it can be used like
import textwrap

_text_to_add = textwrap.wrap(", ".join(PARSERS), width=80, break_long_words=False, break_on_hyphens=False)

@extend_docstring_from(replace="KNOWN", with=_text_to_add)
def some_func():
    """my summary line

    Notes
    ------
    support suffixes are: KNOWN
    """

which results in
>>> help(some_func)
Help on function some_func in module __main__:

some_func()
    my summary line

    Notes
    ------
    support suffixes are: fa, fasta, ...


[WIP] Push docker images after a successful test run

Closing this. It looks like TravisCI runs deploy targets per job rather than per build. This is problematic because:

it'll push buggy pachd images that pass some but not all jobs (which is true for most buggy pachd images)
it'll redundantly push images to docker hub


packet: fix issues when downloading rkt images

Let's fix hidden issues discovered during tests for ARM support.

rkt image name should have a prefix docker://
rkt run should be running with stage1-fly
rkt run/fetch should have an option --insecure-options=image to
avoid intermittent cert errors.

Hm, I think fetching directly from quay.io (without docker://) should work, can you try again with your ARM images?
If we don't use docker:// we should not pass --insecure-options=image. I'm a bit weary of turning off image signature checking, can you elaborate on what those intermittent cert errors are?

Yeah, I would agree in general.
I cannot remember the error message.
Next week I'll test it again, and see if it really does not work.

It turns out, the rkt fetch issue was regression from Upstream Go 1.12.9.
See also https://github.com/coreos/coreos-overlay/pull/3742
To make rkt fetch work again, Container Linux reverted the commit.
Flatcar stable - alpha should already include the bug fix. Edge will be soon released with the bug fix.


remove_task function does not work properly

After multiple invalid inputs, rm command works with values higher than the number of tasks.

Fixed!


Ensure vendor app's sqlalchemy code will not break when Airflow upgrades to sqlalchemy 2.0

Sqlalchemy 1.4 (current version) has 2.0 query styles and features available, and it doesn't look like we're using 1.4-style select statements, but to make sure we don't introduce anything that might break in an Airflow upgrade, consider:

Monitoring https://github.com/apache/airflow/issues/28723
Turning on deprecation warnings by adding SQLALCHEMY_WARN_20=1 to docker-compose.yaml environment variables (not in prod). I think we'd see deprecation warnings in the DAG logs and/or docker logs.

More docs: https://docs.sqlalchemy.org/en/20/changelog/migration_20.html#the-1-4-2-0-migration-path

per standup discussion, i also added this to the prod docker compose config, see #528.
per the suggestion for the airflow project itself in the linked airflow ticket, i also added the env var to our CI test config.
i spun up airflow locally with the new env var, and clicked around the UI, hitting the tabs in various DAGs, and clicking around in the vendor app.  looking at my local log output, all the deprecation warnings seemed to be from airflow itself, and not from the vendor app:
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1768 RemovedIn20Warning: The connection.execute() method in SQLAlchemy 2.0 will accept parameters as a single dictionary or a single sequence of dictionaries only. Parameters passed as keyword arguments, tuples or positionally oriented dictionaries and/or tuples will no longer be accepted. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1769 RemovedIn20Warning: The connection.execute() method in SQLAlchemy 2.0 will accept parameters as a single dictionary or a single sequence of dictionaries only. Parameters passed as keyword arguments, tuples or positionally oriented dictionaries and/or tuples will no longer be accepted. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1779 RemovedIn20Warning: Passing a string to Connection.execute() is deprecated and will be removed in version 2.0.  Use the text() construct, or the Connection.exec_driver_sql() method to invoke a driver-level SQL string. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1780 RemovedIn20Warning: The connection.execute() method in SQLAlchemy 2.0 will accept parameters as a single dictionary or a single sequence of dictionaries only. Parameters passed as keyword arguments, tuples or positionally oriented dictionaries and/or tuples will no longer be accepted. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1768 RemovedIn20Warning: The connection.execute() method in SQLAlchemy 2.0 will accept parameters as a single dictionary or a single sequence of dictionaries only. Parameters passed as keyword arguments, tuples or positionally oriented dictionaries and/or tuples will no longer be accepted. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1769 RemovedIn20Warning: The connection.execute() method in SQLAlchemy 2.0 will accept parameters as a single dictionary or a single sequence of dictionaries only. Parameters passed as keyword arguments, tuples or positionally oriented dictionaries and/or tuples will no longer be accepted. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1779 RemovedIn20Warning: Passing a string to Connection.execute() is deprecated and will be removed in version 2.0.  Use the text() construct, or the Connection.exec_driver_sql() method to invoke a driver-level SQL string. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1780 RemovedIn20Warning: The connection.execute() method in SQLAlchemy 2.0 will accept parameters as a single dictionary or a single sequence of dictionaries only. Parameters passed as keyword arguments, tuples or positionally oriented dictionaries and/or tuples will no longer be accepted. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-init-1       | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-webserver-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-webserver-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-triggerer-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-triggerer-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-worker-1     | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-worker-1     | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-scheduler-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:992 RemovedIn20Warning: The MetaData.bind argument is deprecated and will be removed in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-scheduler-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/utils/db.py:1000 RemovedIn20Warning: The ``bind`` argument for schema methods that invoke SQL against an engine or connection will be required in SQLAlchemy 2.0. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-triggerer-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/models/trigger.py:109 RemovedIn20Warning: Using strings to indicate column or relationship paths in loader options is deprecated and will be removed in SQLAlchemy 2.0.  Please use the class-bound attribute directly. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
libsys-airflow-airflow-scheduler-1  | /home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job_runner.py:424 RemovedIn20Warning: Using strings to indicate column or relationship paths in loader options is deprecated and will be removed in SQLAlchemy 2.0.  Please use the class-bound attribute directly. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)

i also ran the tests with the deprecation warning flag, and didn't see any SQLAlchemy 2.0 related deprecation warnings, though i did see some other SQLAlchemy related warnings, also entirely from airflow itself and not the vendor app:
Library/Caches/pypoetry/virtualenvs/libsys-airflow-wuyX_Bf1-py3.10/lib/python3.10/site-packages/airflow/www/app.py:86: DeprecationWarning: The sql_alchemy_conn option in [core] has been moved to the sql_alchemy_conn option in [database] - the old setting has been used, but please update your config.
.pyenv/versions/3.10.7/lib/python3.10/configparser.py:408: DeprecationWarning: The sql_alchemy_conn option in [core] has been moved to the sql_alchemy_conn option in [database] - the old setting has been used, but please update your config.
Library/Caches/pypoetry/virtualenvs/libsys-airflow-wuyX_Bf1-py3.10/lib/python3.10/site-packages/airflow/settings.py:280: DeprecationWarning: The sql_alchemy_pool_enabled option in [core] has been moved to the sql_alchemy_pool_enabled option in [database] - the old setting has been used, but please update your config.
.pyenv/versions/3.10.7/lib/python3.10/configparser.py:408: DeprecationWarning: The sql_alchemy_pool_enabled option in [core] has been moved to the sql_alchemy_pool_enabled option in [database] - the old setting has been used, but please update your config.
Library/Caches/pypoetry/virtualenvs/libsys-airflow-wuyX_Bf1-py3.10/lib/python3.10/site-packages/airflow/settings.py:343: DeprecationWarning: The sql_engine_encoding option in [core] has been moved to the sql_engine_encoding option in [database] - the old setting has been used, but please update your config.
.pyenv/versions/3.10.7/lib/python3.10/configparser.py:408: DeprecationWarning: The sql_engine_encoding option in [core] has been moved to the sql_engine_encoding option in [database] - the old setting has been used, but please update your config.