Overridden method for Playwright request to original=POST new=GET

Hello, i'm facing an issue concerning this method.
I don't understand why you do so, and it causes an error regarding my script.
I've replaced
overrides["method"] = method with overrides["method"] = playwright_request.method.upper() and it works fine, i've seen some issues that might be related but not sure about the solution / answer you provide them.
scrapy_playwright/handler.py -> line n°598.
The issue caused when i do not replace your code:
DEBUG    [14:02:00]    DEBUG     [Context=unblocked] Overridden method for Playwright request to https://www.example.com/: original=POST new=GET  handler.py:611
ERROR    [14:02:00]    ERROR     Error downloading <GET https://www.example.com>                                                                  scraper.py:328
         Traceback (most recent call last):
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/twisted/internet/defer.py", line 1693, in _inlineCallbacks
             result = context.run(
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/twisted/python/failure.py", line 518, in
         throwExceptionIntoGenerator
             return g.throw(self.type, self.value, self.tb)
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 54, in
         process_request
             return (yield download_func(request=request, spider=spider))
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/twisted/internet/defer.py", line 1065, in adapt
             extracted = result.result()
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 324, in
         _download_request
             return await self._download_request_with_page(request, page, spider)
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 376, in
         _download_request_with_page
             await self._apply_page_methods(page, request, spider)
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/scrapy_playwright/handler.py", line 490, in
         _apply_page_methods
             pm.result = await _maybe_await(method(*pm.args, **pm.kwargs))
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/scrapy_playwright/_utils.py", line 16, in _maybe_await
             return await obj
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 9408, in
         wait_for_url
             await self._impl_obj.wait_for_url(
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/playwright/_impl/_page.py", line 498, in wait_for_url
             return await self._main_frame.wait_for_url(**locals_to_params(locals()))
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 226, in wait_for_url
             async with self.expect_navigation(
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/playwright/_impl/_event_context_manager.py", line 33, in
         __aexit__
             await self._future
           File "/Users/x/Desktop/driver_tester/.venv/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 203, in continuation
             raise Error(event["error"])
         playwright._impl._api_types.Error: resource exceeds maximum size

My script:
class TestSpider(scrapy.Spider):
    name = "test"

    def __init__(self, url: str, wait_url: str | None, *args, **kwargs) -> None:
        self.url = url
        self.wait_url = wait_url

        if not self.url:
            raise Exception('Missing url in spider.')

        super().__init__(*args, **kwargs)

    def start_requests(self):
        yield scrapy.Request(url=self.url, meta={
            'playwright': True,
            'playwright_include_page': True,
            'playwright_context': 'custom',
            'playwright_page_goto_kwargs': {
                'wait_until': 'load',
            },
            'playwright_page_methods': (
                PageMethod('wait_for_url', self.wait_url),
            ),
        })

    def parse(self, response: Response, **kwargs):
        LOGGER.info(f'[Spider] Parsing page: {response.url}')

My settings related:
PLAYWRIGHT_PROCESS_REQUEST_HEADERS = None

Possible related issues: https://github.com/scrapy-plugins/scrapy-playwright/issues/176

See this comment for an explanation on why it's necessary to override the method for certain requests. There's a number of things that need to happen for this to occur, make sure you're using the latest version of this package because this was modified not so long ago (#177).


tvdb api now needs key

Hi, I use tvnamer 2.5 under FreeBSD. Until recently it worked perfectly until TheTVDB changed the access and now requires a (paid) key. So I paid a 1 year subscription and received a legacy API key. I edited the config_defaults.py file according to the sample config file here on github and added the line
# Custom API key from www.thetvdb.com - if None, uses tvnamer's default key     'tvdb_api_key': '5c59********f46a4db97196e61f',
But I do get the followien error:
ValueError: apikey argument is now required - an API key can be easily registered at https://thetvdb.com/api-information
If I do not use the ' ' I get another error:
File "/usr/local/lib/python3.7/site-packages/tvnamer/config_defaults.py", line 8     'tvdb_api_key': 5c59d824********6a4db97196e61f,
I suspect it is something with the Syntax, as I really have no idea what I am doing in Python (sorry).
Do you have any clue, what I do wrong?
Many thanks again (I am a returning customer).
Georg
I attach the config.defaults.py file
config_defaults.zip

Huh, that is the first I've heard of TheTVDB access becoming paid only 😕 Seems to be remarkably little announcement of this, not even their blog mentions it currently.. but anyway:
The config in the first example is most likely correct, I think the issue is the version of tvnamer packaged for FreeBSD is outdated (2.5) while the tvdb_api module has been updated to 3.0.1. These two versions are not compatible (tvnamer 3.0.1 requires tvdb_api 3.0.2)
To use your API key, you'd need to install the latest 3.x version of tvnamer. Installing the older tvdb_api would use the old bundled key which, I assume, will stop working at some point (if it's not already)?

Hi the maintainer just updated the port, many thanks for your input, so I could post it on FreeBSD bugzilla.
it seems that the tvnamer key ('tvdb_api_key': None,) still works btw, but now that I have a custom key, I'll be using this one :-) (works!)
One last question: when I verbose, I get this warning:
WARNING: you have a config at deprecated ~/.tvnamer.json location. This must be moved to new location: ~/.config/tvnamer/tvnamer.json
I have no "~/.config/tvnamer" directory. Do I need to create one or can I just stay where I am (~/)?
Best, Georg

it seems that the tvnamer key ('tvdb_api_key': None,) still works btw, but now that I have a custom key, I'll be using this one :-) (works!)

Excellent, thanks for getting the port updated! Yep there is a default key for tvnamer, with the option to override to a custom one
Regarding the config location, ~/.config/tvnamer/tvnamer.json is the new preferred location as per #166 - so I'd recommend moving your config to there (in some future version the old location will stop working)


Update vscodeVersion

Theres another spot you should update...let me find it..

nvm its already been updated.

@anthonydresser  Where is this other place? I'm not seeing it in the repo anywhere that I can find.
I'm also thinking this isn't worth porting to April release - you agree? It's a pretty small edge case that someone would actually need this updated to the latest (basically only a VS Code extension that was updated to require that engine version) so I think it's fine to just wait until next release.

https://github.com/microsoft/azuredatastudio/blob/master/src/vs/platform/product/common/product.ts#L24 but this gets updated by vscode so we don't need to worry. If we don't plan on porting, does it make more sense to just bump it straight to 1.45?

We could do that - but I was planning on just adding this to the release process in the short term and then looking at making it so this wasn't hardcoded (pulling from the vscodeVersion defined there might be a valid option)
How feasible is it to add something to the merge bot such that when it merges in changes it also reads the package.json of vscode and updates the value in our product.json?

We could but I think there are probably better ways to automate it than tying it to the merge process. I'll have a think.


Batch norm or Layer norm

https://github.com/bio-ontology-research-group/deepgozero/blob/a850e336856bf8030f8ffb121c8c00f237040ff6/deepgozero.py#L251
batch norm in paper but found Layer norm in code.

Hi,
It should be BatchNorm in the code, but LayerNorm also gives the same results.


Flake8 rule 'E231' reported an invalid point

Flake8 reported an invalid point for the rule E231, with the messge missing whitespace after ','.

Debug information:
Atom version: 1.17.0
Flake8 version: 3.3.0 (flake8-docstrings: 1.0.3, pydocstyle: 1.1.1, mccabe: 0.6.1, pycodestyle: 2.3.1, pyflakes: 1.5.0) CPython 2.7.13 on Windows

Do you have any unicode characters in your file? There is currently a known bug with how those are handled (pycqa/flake8#306). It's fixed in their master branch and is just waiting on a release.

Probably, I erased all the carry return white spaces and entered them again
by hitting enter and it fixed the problem.
El 18 may. 2017 6:48 PM, "Landon Abney"<EMAIL_ADDRESS>escribió:

Do you have any unicode characters in your file? There is currently a
known bug with how those are handled (pycqa/flake8#306
https://gitlab.com/pycqa/flake8/issues/306). It's fixed in their master
branch and is just waiting on a release.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/AtomLinter/linter-flake8/issues/443#issuecomment-302468210,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AVyRnplxIEgkhtnxeFkuXkjxeAbsjOwbks5r7HZZgaJpZM4NfaHP
.


chore(package): update @types/node to version 10.9.1

Follow up of #45.

Closed in favour of #48.


Implement BatchNorm in triton

batchnorm(bn) is very popular in CV, almost every conv op will be followed by bn. I see layernorm in triton achieved best HBM bandwidth. So I'm curious about implement batchnorm in triton.
My questions:

is there any chance that triton implemented bn faster than pytorch?
may you guys give more details on layernorm's triton implementation? about why it achieved so amazing bandwidth

For layer norm, you reduce along the contiguous dimension, so it's possible to fuse everything. For batch norm, things get a little tricky. Have never looked into it, so I can't tell if it's possible to beat pytorch. But it should be possible to at least match it.

ok, thanks! I will look at it, will update here if I have some conclusion.

In case anyone is interested in this issue, I have written a Triton implementation of batch normalization here. It supports activation fusion as well as residual addition and can be substantially faster than its PyTorch counterpart (minus torch.compile, that is).

In case anyone is still interested in this issue, I have written a Triton implementation of batch normalization here. It supports activation fusion as well as residual addition and can be substantially faster than its PyTorch counterpart (minus torch.compile, that is).

Hi, thanks for your amazing work, but in my environment(Tesla V100), the kernel, batch_norm_forward_kernel, seems to be much slower than PyTorch's interface (avg 25x, autotune time has been removed) . Ex for input shape like: B, C, N=(32, 128, 16384). I just copy the test function of batch_norm and revise the shape parameter, did I do something wrong?

@0Addicted0 Let's continue this discussion here.


Client Crash with the Sync mod in Multiplayer

Using SanLib 1.6.3 with Sync 7.1.0 performs normally in Singleplayer. However, in a Multiplayer session, when a Client loads a chunk containing the Constructor Shell of another Player whose copy is inside of it, their game will crash. The one who injected their copy into the Constructor isn't affected.
I believe this is because their custom skin is loaded there, but SanLib and Sync are probably conflicting with such a concept. Since the Client can't render the custom skin set by the other user who used the Constructor, the game crashes.

Just cleaning up :)
The 1.12.2 version is not maintained anymore and the current iteration for 1.16 (unreleased, as of writing this) has this problem fixed.


Clean checkout path if versionbot branch is not found

If versionbot is not enabled we see several errors in the summary.
Annotations
2 errors and 1 warning
Flowzone / Version draft
The process '/usr/bin/git' failed with exit code 1
Flowzone / Version draft
ambiguous argument 'HEAD': unknown revision or path not in the working tree.
Flowzone / Version draft
Unable to clean or reset the repository. The repository will be recreated instead.
One error is expected since the versionbot branch checkout failed and we ignore the failure, but we could clean this up better.

No longer required after https://github.com/product-os/flowzone/pull/88


Change runEmpty to mean that the specified parallelism is always resp…

…ected, even if a pod might have empty input; it used to mean that the pipeline is triggered even if the input commit is empty.

This has been done by another PR.


After one of the TiFlash nodes was upgraded from 5.2 to 5.3, the results of the MPP query were inconsistent.

Bug Report
Please answer these questions before submitting your issue. Thanks!
1. Minimal reproduce step (Required)
2 TiFlash nodes in 5.2.3, TPCH-100 with 2 TiFlash replicas, upgrade one TiFlash node to 5.3.1,  and execute q1 query:
 select l_returnflag, l_linestatus, sum(l_quantity) as sum_qty, sum(l_extendedprice) as sum_base_price, sum(l_extendedprice * (1 - l_discount)) as sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge, avg(l_quantity) as avg_qty, avg(l_extendedprice) as avg_price, avg(l_discount) as avg_disc, count(*) as count_order from lineitem where l_shipdate <= date_sub('1998-12-01', interval 108 day) group by l_returnflag, l_linestatus order by l_returnflag, l_linestatus;
Execute multiple times and see if the results are consistent.
2. What did you expect to see? (Required)
The results are always consistent and correct.
3. What did you see instead (Required)
The results are inconsistent and wrong sometimes.

4. What is your TiFlash version? (Required)
5.2.3 upgrade to 5.3.1

/assign @fuzhe1989

This issue can't be fixed in code. We put a warning about how to avoid this problem in our doc: https://docs.pingcap.com/zh/tidb/v5.3/upgrade-tidb-using-tiup#不停机升级
Closing.


Remove addr.AppAddr

Instead, use net.UDPAddr whenever possible. For code needing to move SVC addresses around, consider using net.Addr instead and have the address cast to the type at the point of use.
Probably the easiest way to implement this is to create multiple PRs that remove AppAddr a few packages at a time.

After the snet write/read refactor, there are the following references

15:46 $ ag addr.appaddr
go/lib/snet/svcaddr.go
40:             Host:    &addr.AppAddr{L3: a.SVC},

go/lib/snet/addr.go
37:     Host    *addr.AppAddr
184:    return &Addr{IA: ia, Host: &addr.AppAddr{L3: l3, L4: l4}}, nil

go/lib/snet/addr_test.go
30:     host4 := &addr.AppAddr{
34:     host6 := &addr.AppAddr{

go/lib/snet/udpaddr.go
43:             Host: &addr.AppAddr{

Which would be removed once the snet.Addr is removed (different stories)


Allow passing message array into say()

For now if we need to send multiple messages, we have to do this:
chat.say('hello').then(() => {
    chat.say('world').then(() => {
        chat.say('from bootbot');
    });
});

This is tedious, especially when you when to pass in options.
In this PR, I modified the say() method so that it can also take a message array:
chat.say(['hello', 'world', 'from bootbot']);

or with options:
chat.say(['hello', 'world', 'from bootbot'], {typing: true});

@Charca Will this be merged?

This is a really good idea, thanks @hkalexling!
This weekend I'll spend some time merging PRs. I'll test it, write some documentation for it, update the changelog and will release a new version probably tomorrow.

One thing to note here is to make sure that all individual messages respect the typing options in case it is true.

Looks like the options param is being passed to the chained .say() call so I don't think we'll have a problem with that. I'll write some tests to make sure.


PiT 24.2: theming errors in production

# download the starter app
git clone https://github.com/vaadin/business-app-starter-flow.git
cd business-app-starter-flow
# compile and run for production
mvn clean install -Pproduction,it
mvn -Pproduction jetty:run-war
# see the error in browser console

Could not find style data in module named vaadin-chart-default-theme - http://localhost:8080/VAADIN/build/generated-flow-imports-8c3f5c56.js

Seems that the problem comes from the include in this line
@CssImport(value = "./styles/components/charts.css", themeFor = "vaadin-chart", include = "vaadin-chart-default-theme")

The ./styles/components/charts.css but the vaadin-chart-default-theme either does not exist or has not been loaded at this point.


Empty Array as Output

When I try the sample code, no data is outputted. What setup step am I missing?
I have done the obvious npm install but when I try a sample e.g "shoe" I no an empty array.
Please help.

This project seems to be broken, because PowerThesaurus keeps changing their website: https://github.com/words/powerthesaurus-api/issues/3

Bummer :[
Sorry about that!

confirmed that there are no results when tested with runkit

Yep. It's busted.
I would suggest reaching out to the PowerThesaurus folks to see if they have plans to support an API: https://www.powerthesaurus.org/_feedback

This should be fixed, y'all. Give it a try: https://github.com/words/powerthesaurus-api/pull/5#issuecomment-690532508


(WIP) Bridge: Add webhook test button

User Story
AS a user, I would like to test my Webhook configuration.

Technical details
After the configuration is saved, a test button shall be made available. When a user presses the test button, the webhook is exercised using a test event (❓ TBD).
If the test event was successful, (status=success and result=pass) a green checkmark is displayed, otherwise a red cross is shown and the error message is displayed.
The feature shall hide behind the feature flag keptn.webhookconfig.testbutton.
DoD

[ ] The Webhook can be tested
[ ] UI Tests
[ ] Unit tests

Dependencies

[ ] Backend implementation (❓ TBD)
[ ] https://github.com/keptn/keptn/issues/5211

Closing in favor of #5261


feature/iris new message notification

Checklist
General

[ ] I tested all changes and their related features with all corresponding user types on a test server.
[ ] This is a small issue that I tested locally and was confirmed by another developer on a test server.
[ ] Language: I followed the guidelines for inclusive, diversity-sensitive, and appreciative language.
[ ] I chose a title conforming to the naming conventions for pull requests.

Server

[ ] Important: I implemented the changes with a very good performance and prevented too many (unnecessary) database calls.
[ ] I followed the coding and design guidelines.
[ ] I added multiple integration tests (Spring) related to the features (with a high test coverage).
[ ] I added pre-authorization annotations according to the guidelines and checked the course groups for all new REST Calls (security).
[ ] I documented the Java code using JavaDoc style.

Client

[ ] Important: I implemented the changes with a very good performance, prevented too many (unnecessary) REST calls and made sure the UI is responsive, even with large data.
[ ] I followed the coding and design guidelines.
[ ] Following the theming guidelines, I specified colors only in the theming variable files and checked that the changes look consistent in both the light and the dark theme.
[ ] I added multiple integration tests (Jest) related to the features (with a high test coverage), while following the test guidelines.
[ ] I added authorities to all new routes and checked the course groups for displaying navigation elements (links, buttons).
[ ] I documented the TypeScript code using JSDoc style.
[ ] I added multiple screenshots/screencasts of my UI changes.
[ ] I translated all newly inserted strings into English and German.

Changes affecting Programming Exercises

[ ] I tested all changes and their related features with all corresponding user types on Test Server 1 (Atlassian Suite).
[ ] I tested all changes and their related features with all corresponding user types on Test Server 2 (Jenkins and Gitlab).

Motivation and Context

Description

Steps for Testing

Prerequisites:

1 Instructor
2 Students
1 Programming Exercise with Complaints enabled

Log in to Artemis
Navigate to Course Administration
...

Exam Mode Testing

Prerequisites:

1 Instructor
2 Students
1 Exam with a Programming Exercise

Log in to Artemis
Participate in the exam as a student
Make sure that the UI of the programming exercise in the exam mode stays unchanged. You can use the exam mode documentation as reference.
...

Review Progress

Performance Review

[ ] I confirm that the client changes (in particular related to REST calls and UI responsiveness) are implemented with a very good performance
[ ] I confirm that the server changes (in particular related to database calls) are implemented with a very good performance

Code Review

[ ] Code Review 1
[ ] Code Review 2

Manual Tests

[ ] Test 1
[ ] Test 2

Exam Mode Test

[ ] Test 1
[ ] Test 2

Test Coverage

Screenshots

Codecov Report

Merging #6646 (4d5464c) into feature/develop-iris-frontend (7292011) will decrease coverage by 0.01%.
The diff coverage is 69.04%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@                         Coverage Diff                         @@
##             feature/develop-iris-frontend    #6646      +/-   ##
===================================================================
- Coverage                            80.46%   80.45%   -0.01%
+ Complexity                           13686    13678       -8
===================================================================
  Files                                 2432     2432
  Lines                                92324    92338      +14
  Branches                             12924    12927       +3
===================================================================
+ Hits                                 74289    74293       +4
- Misses                                9904     9912       +8
- Partials                              8131     8133       +2

Impacted Files
Coverage Δ

src/main/webapp/app/iris/state-store.model.ts
85.71% <50.00%> (-8.23%)
:arrow_down:

...rcise-chatwidget/exercise-chat-widget.component.ts
84.90% <69.23%> (-6.01%)
:arrow_down:

src/main/webapp/app/iris/state-store.service.ts
75.00% <70.00%> (+0.71%)
:arrow_up:

...ris/exercise-chatbot/exercise-chatbot.component.ts
84.31% <88.88%> (+0.22%)
:arrow_up:

... and 9 files with indirect coverage changes

Flag
Coverage Δ

client
76.18% <69.04%> (-0.01%)
:arrow_down:

server
85.12% <ø> (-0.01%)
:arrow_down:

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7292011...4d5464c. Read the comment docs.


Read Json

Hi @igorborgest,
I am reading json from S3 in below code.
dfJson = wr.s3.read_json(path=jsonFile)
jsonFile is a json format file got from Glue.
But with above code it is not able to read it, because it has square bracket at start and end of json. Do we have a builtin solution to this, please suggest.
Reagrads,
Prashan

Yes, there is an argument orient  inherited from pandas.read_json().
Probably for you case it will be: orient="records".

Closing by inactivity.


Rebuild for Ledger Nano S Firmware 1.4.2?

Hello,
recently 1.4.2 has been released for the Nano S.
The OpenPGP app doesn't seem to have been added to its repos (even in developer mode).
Is a rebuild in the near future planned?
Regards

Yes near future
Le lun. 23 avr. 2018 à 14:26, Khorne<EMAIL_ADDRESS>a écrit :

Hello,
recently 1.4.2 has been released for the Nano S.
The OpenPGP app doesn't seem to have been added to its repos (even in
developer mode).
Is a rebuild in the near future planned?
Regards
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/LedgerHQ/blue-app-openpgp-card/issues/23, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFOX87CwjXsq_ZUGlCujLGp-uQ-quo10ks5trchigaJpZM4Tfy1p
.

@cslashm That's a disappointment. I was expecting and waiting for it. When is a rebuild expected?

@omarabid according to this reddit thread it was supposed to be functional again by the end of this week.
Again, this was also supposed to be functional again in March 11th accordingto issue #19

There has been some extra delays due to unforeseen circumstances, but the general idea is that we're working on it and it'll be fixed soon

@btchip can you provide a hard date as to when this will be functional?

@thibaultamartin #19 is about Ledger Nano S Firmware version 1.4.1, this issue is about compatibility with Firmware version 1.4.2, #19 did get a new branch/dev release in the mentioned timeframe.

Is this why the app looks empty? When I go into the app on the ledger nano s, there's no menu at all. Only exit on the left and the title?

@CMCDragonkai Are you by chance looking at the SSH/PGP Agent app?

Yes
On 5 May 2018 19:02:29 GMT+10:00, Khorne<EMAIL_ADDRESS>wrote:

@CMCDragonkai Are you by chance looking at the SSH/PGP Agent app?
--
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub:
https://github.com/LedgerHQ/blue-app-openpgp-card/issues/23#issuecomment-386791345

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

@CMCDragonkai That's a different application.
https://github.com/LedgerHQ/blue-app-ssh-agent

The app on ledger nano s is both SSH + GPG (presented by the Ledger Manager). Isn't this repository for the GPG app?

There are two apps, both working implementing SSH and GPG, but having different approaches to how things work.
To make the distinction simple: this one has an icon (the on-device one) that looks like a lock with a Ledger logo inside. The other one (blue-app-ssh-agent, linked above) has an icon that looks like a console window with a >_ prompt.

Ah, so that is the second one then.
How come this app isn't available on the Ledger Manager?

Also the page for using GPG on Ledger Nano S (https://support.ledgerwallet.com/hc/en-us/articles/115005200649-How-to-install-and-use-OpenPGP-with-Ledger-) redirects to https://github.com/LedgerHQ/blue-app-openpgp-card/blob/master/doc/user/blue-app-openpgp-card.pdf
Which app is better? The second app doesn't seem to work for me, since I just open the app and nothing happens.

Crickey mate..
@CMCDragonkai This app isn't available yet because it hasn't updated yet (what this thread is about btw, not your issue with not being able to discern two entirely different apps and their purpose.)
THIS app, https://github.com/LedgerHQ/blue-app-openpgp-card, is used to store GPG keys on the Ledger Nano S and having it work as a SmartCard. THIS app you currently can't install.
THE OTHER APP (the one you have installed) is https://github.com/LedgerHQ/blue-app-ssh-agent.
It is used to manage access to GPG/SSH keys stored in your GPG/SSH agent.
The other app, entirely unrelated to this repository and code has usage instructions in their repository:

This agent is compatible with the third party SSH/PGP host client from Roman Zeyde available at https://github.com/romanz/trezor-agent - it is recommended to use it for extra functionalities

Please take any issues you have with the other app to the other repository where they belong.

Any progress?

Any progress?

I believe this is resolved by 281ea42c.
The applet (v1.2.0) is now available in Ledger Manager store.

There is still an issue with ssh authentication with Ed25519. It works with NIST-P256, Brainpool256 curves

Exactly what issue? Does it not work at all? If so, that still leaves my nano and my blue both useless to me :(

@akatrevorjay I believe it's this one: https://github.com/LedgerHQ/blue-app-openpgp-card/issues/16

signature/encryption work with Ed22519, but not authentication.
I 'm tweaking opennssh code to get log on this weird specific problem but Ed25519 support is not documented in the g10code OpenPGPCard application specification.

ssh with ed25519 fixed in 1.2.1

Great news, but store shows 1.2.0 as a latest version available. Please release :)

Thanks Cedric, you're the man!
On Tue, Jun 5, 2018, 4:18 AM Aleksei Zhukov<EMAIL_ADDRESS>wrote:

Great news, but store shows 1.2.0 as a latest version available. Please
release :)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/LedgerHQ/blue-app-openpgp-card/issues/23#issuecomment-394672519,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABQGIgm_ECi0an3kyCSgzLmeF9UtAmzxks5t5mj1gaJpZM4Tfy1p
.

--
Ty,
Trevor


Provide a way to get the geometry of route relations

The geometry of multipolygon relations can be read with a MultipolygonCollector but no such utility exists for route relations.

Guessing this would be implemented by exposing the (osmium::relations::Collector)[https://github.com/osmcode/libosmium/blob/master/include/osmium/relations/collector.hpp] class to JS

Unfortunately exposing the C++ classes to Javascript is hard and will probably not work in this case, because of the heavily templated code. Solution would probably be to write a RouteCollector class in C++ and expose its result to Javascript. Or do the whole route collection in Javascript.

Closing as non-actionable since it would be a good amount of work. @lucaswoj - re-open if this is a priority of blocking you.


Spring Storage - [Enhance Spring integration for storage] Enable authentication via app id and secret

Close in favor of #21486.


[WIP][devops #1764044] unify dependency management for azure-maven-plugins

Task 1769084: manage dependencies in root project's pom.

Codecov Report

Merging #1140 into develop will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             develop    #1140   +/-   ##
==========================================
  Coverage      35.32%   35.32%
  Complexity       548      548
==========================================
  Files            103      103
  Lines           4654     4654
  Branches         716      716
==========================================
  Hits            1644     1644
  Misses          2860     2860
  Partials         150      150

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 40f1208...bfd179b. Read the comment docs.


fix: again with a test to trigger release again

Summary by CodeRabbit

Chores

Enhanced workflow for updating Unity SDK version references.
Improved commit messages for better traceability and clarity.
Standardized branch naming conventions for version updates.

:tada: This PR is included in version 1.6.12 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


main window and side bar not working

only playing view is working

The snapshot doesn't show anything from this theme. Altso your bug report doesn't provide any useful information


Add branch as optional key to reported versions

This should provide the branch a release was built from as
part of the reported version data, allowing to access it from
within the application embedding versioneer and at least
displaying it somewhere.
I've been using something like that for over a year now with
OctoPrint, just thought it might be time to try to port it
to the current versioneer version and share it while in the
process ;)
Note: I did adjust (and run) the test suite. I had two errors
with test_invocations.py, however I had the very same
two errors on the master branch without my changes as
well so I don't think I caused them:
======================================================================
ERROR: test_build (__main__.DistutilsRepo)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test/git/test_invocations.py", line 273, in test_build
    data = versions_from_file(fn)
  File "src/from_file.py", line 30, in versions_from_file
    raise NotThisMethod("unable to read _version.py")
NotThisMethod: unable to read _version.py

======================================================================
ERROR: test_build (__main__.DistutilsUnpacked)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "test/git/test_invocations.py", line 475, in test_build
    data = versions_from_file(fn)
  File "src/from_file.py", line 30, in versions_from_file
    raise NotThisMethod("unable to read _version.py")
NotThisMethod: unable to read _version.py

----------------------------------------------------------------------
Ran 34 tests in 56.129s

Also see #49 (which I wasn't aware of before preparing this)

Ran the tests... but forgot the linter... sorry for that, fixing...

Is there an interest in this? If not just tell me, no harm done, but it would safe me some trouble/allow me to just maintain my own fork with the stuff I need without having to polish it for general consumption :)

@foosel - I did something similar in #90. I'm ok with either approach, but believe that the branch is paramount to determining an appropriate version.

@pelson I agree. Funny enough I've been doing something similar to your #90 also, see here. Based on a lookup file with which I can define "virtual" tags per branch regex and also override the version renderer. Didn't want to submit it though before the branch stuff was clarified, since without that it doesn't make sense since - as you say - the branch is paramount.


Make cron times consistent in setup and skd

Default cron is set as 0 1 in setup file and 30 0 in skd file
Change cron in skd file to 0 1 to be consistent with setup.sh
https://github.com/loblab/noip-renew/blob/master/setup.sh#L23
Also incorporates fix from https://github.com/loblab/noip-renew/pull/77

Also incorporates fix from https://github.com/loblab/noip-renew/pull/77

@loblab bump


thread 'main' panicked at 'slice index starts at 8092 but ends at 7507'

Hi,
I was running yacrd with the following commands:
${SINGULARITYdir}minimap2.simg minimap2 -x ava-ont -t $SLURM_CPUS_PER_TASK -g 500 ${TMPdir}filtered_reads.fq.gz ${TMPdir}filtered_reads.fq.gz >${TMPdir}overlap.paf

yacrd -i ${TMPdir}overlap.paf -o ${TMPdir}report.yacrd -c 4 -n 0.4 scrubb -i ${TMPdir}filtered_reads.fq -o ${TMPdir}reads.scrubb.fasta

and got the following error:
\thread 'main' panicked at 'slice index starts at 8092 but ends at 7507', src/libcore/slice/mod.rs:2670:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace.

I am rerunning it now with backtrace enabled.
All the best and thank you, Dominik

Aja, I use the head of the GIT repository.

now with backtrace enabled:
thread 'main' panicked at 'slice index starts at 8092 but ends at 7507', src/libcore/slice/mod.rs:2670:5
stack backtrace:
   0: backtrace::backtrace::libunwind::trace
             at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/libunwind.rs:88
   1: backtrace::backtrace::trace_unsynchronized
             at /cargo/registry/src/github.com-1ecc6299db9ec823/backtrace-0.3.40/src/backtrace/mod.rs:66
   2: std::sys_common::backtrace::_print_fmt
             at src/libstd/sys_common/backtrace.rs:77
   3: <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt
             at src/libstd/sys_common/backtrace.rs:61
   4: core::fmt::write
             at src/libcore/fmt/mod.rs:1028
   5: std::io::Write::write_fmt
             at src/libstd/io/mod.rs:1412
   6: std::sys_common::backtrace::_print
             at src/libstd/sys_common/backtrace.rs:65
   7: std::sys_common::backtrace::print
             at src/libstd/sys_common/backtrace.rs:50
   8: std::panicking::default_hook::{{closure}}
             at src/libstd/panicking.rs:188
   9: std::panicking::default_hook
             at src/libstd/panicking.rs:205
  10: std::panicking::rust_panic_with_hook
             at src/libstd/panicking.rs:464
  11: std::panicking::continue_panic_fmt
             at src/libstd/panicking.rs:373
  12: rust_begin_unwind
             at src/libstd/panicking.rs:302
  13: core::panicking::panic_fmt
             at src/libcore/panicking.rs:139
  14: core::slice::slice_index_order_fail
             at src/libcore/slice/mod.rs:2670
  15: <core::ops::range::Range<usize> as core::slice::SliceIndex<[T]>>::index
             at /rustc/73528e339aae0f17a15ffa49a8ac608f50c6cf14/src/libcore/slice/mod.rs:2845
  16: core::slice::<impl core::ops::index::Index<I> for [T]>::index
             at /rustc/73528e339aae0f17a15ffa49a8ac608f50c6cf14/src/libcore/slice/mod.rs:2647
  17: yacrd::editor::scrubbing::fastq
             at src/editor/scrubbing.rs:188
  18: yacrd::editor::scrubbing::scrubbing
             at src/editor/scrubbing.rs:45
  19: yacrd::main
             at src/main.rs:93
  20: std::rt::lang_start::{{closure}}
             at /rustc/73528e339aae0f17a15ffa49a8ac608f50c6cf14/src/libstd/rt.rs:61
  21: std::rt::lang_start_internal::{{closure}}
             at src/libstd/rt.rs:48
  22: std::panicking::try::do_call
             at src/libstd/panicking.rs:287
  23: __rust_maybe_catch_panic
             at src/libpanic_abort/lib.rs:28
  24: std::panicking::try
             at src/libstd/panicking.rs:265
  25: std::panic::catch_unwind
             at src/libstd/panic.rs:396
  26: std::rt::lang_start_internal
             at src/libstd/rt.rs:47
  27: main
  28: __libc_start_main
  29: _start
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
SIGABRT: abort
PC=0x47cdab m=0 sigcode=0

goroutine 1 [running, locked to thread]:
syscall.RawSyscall(0x3e, 0x1112a, 0x6, 0x0, 0x0, 0xc000062000, 0xc000062000)
	/usr/lib/golang/src/syscall/asm_linux_amd64.s:78 +0x2b fp=0xc000171e70 sp=0xc000171e68 pc=0x47cdab
syscall.Kill(0x1112a, 0x6, 0x0, 0x0)
	/usr/lib/golang/src/syscall/zsyscall_linux_amd64.go:597 +0x4b fp=0xc000171eb8 sp=0xc000171e70 pc=0x479bcb
github.com/sylabs/singularity/internal/app/starter.Master.func2()
	internal/app/starter/master_linux.go:152 +0x61 fp=0xc000171f00 sp=0xc000171eb8 pc=0x7928f1
github.com/sylabs/singularity/internal/pkg/util/mainthread.Execute.func1()
	internal/pkg/util/mainthread/mainthread.go:21 +0x2f fp=0xc000171f28 sp=0xc000171f00 pc=0x790f4f
main.main()
	cmd/starter/main_linux.go:102 +0x5f fp=0xc000171f60 sp=0xc000171f28 pc=0x972bbf
runtime.main()
	/usr/lib/golang/src/runtime/proc.go:203 +0x21e fp=0xc000171fe0 sp=0xc000171f60 pc=0x433b4e
runtime.goexit()
	/usr/lib/golang/src/runtime/asm_amd64.s:1357 +0x1 fp=0xc000171fe8 sp=0xc000171fe0 pc=0x45f7c1

goroutine 6 [syscall]:
os/signal.signal_recv(0xb9da80)
	/usr/lib/golang/src/runtime/sigqueue.go:147 +0x9c
os/signal.loop()
	/usr/lib/golang/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
	/usr/lib/golang/src/os/signal/signal_unix.go:29 +0x41

goroutine 8 [chan receive]:
github.com/sylabs/singularity/internal/pkg/util/mainthread.Execute(0xc00031e3b0)
	internal/pkg/util/mainthread/mainthread.go:24 +0xb4
github.com/sylabs/singularity/internal/app/starter.Master(0x7, 0x4, 0x11139, 0xc00000f240)
	internal/app/starter/master_linux.go:151 +0x44c
main.startup()
	cmd/starter/main_linux.go:75 +0x53e
created by main.main
	cmd/starter/main_linux.go:98 +0x35

rax    0x0
rbx    0x0
rcx    0xffffffffffffffff
rdx    0x0
rdi    0x1112a
rsi    0x6
rbp    0xc000171ea8
rsp    0xc000171e68
r8     0x0
r9     0x0
r10    0x0
r11    0x202
r12    0xf3
r13    0x0
r14    0xb83e88
r15    0x0
rip    0x47cdab
rflags 0x202
cs     0x33
fs     0x0
gs     0x0

Hi @dominik-handler,
Thanks for finding this bug. Last master commit (3a87920) "solve" this bug, if yacrd try to scrubb read shorter than scrubb position yacrd now generate a warning and skip next scrubbing position for this read.
I see you didn't use the same file between overlap search and scrubbing (filtered_reads.fq.gz and filtered_reads.fq), I think this change generate this bug, maybe a read with same id have different length between this two file, or two reads have the same id.
yacrd accept compressed file as input .

Hi,
Thank you for the quick fix.
These 2 files are completely the same. Once compressed and once not. I did not try to use the compressed version with yacrd. Good to know that this also works.
One additional question, what is the exact difference between split and scrub? I guess split splits the read into 2 or more pieces if there is a not-covered region in the read. Is scrub doing the same and in addition remove uncovered ends?
Also, is it normal that my reads have multiple regions that overlap or do I read it wrong:
Chimeric        b582ec56-ba2a-47bd-b170-e1591b3aebf5::sampleid=unknown::read=31::length=44705::QUAL=11.9715::ch=297::runid=cb3f3806869ec0ebc650f8bfb7858f0247e5f647_2-44688     44687   119,0,119;978,40911,41889;1156,40911,42067;1156,40911,42067;1156,40911,42067;1156,40911,42067;1,44686,44687
Dominik
From: Pierre Marijon<EMAIL_ADDRESS>Reply to: natir/yacrd<EMAIL_ADDRESS>Date: Thursday, 9. January 2020 at 17:46
To: natir/yacrd<EMAIL_ADDRESS>Cc: "Handler,Dominik"<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [natir/yacrd] thread 'main' panicked at 'slice index starts at 8092 but ends at 7507' (#37)
Hi @dominik-handlerhttps://github.com/dominik-handler,
Thanks for finding this bug. Last master commit (3a87920https://github.com/natir/yacrd/commit/3a879203d1b01ec0c940077c71217f75a54c9b09) "solve" this bug, if yacrd try to scrubb read shorter than scrubb position yacrd now generate a warning and skip next scrubbing position for this read.
I see you didn't use the same file between overlap search and scrubbing (filtered_reads.fq.gz and filtered_reads.fq), I think this change generate this bug, maybe a read with same id have different length between this two file, or two reads have the same id.
yacrd accept compressed file as input .
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/natir/yacrd/issues/37?email_source=notifications&email_token=AC7JZONP4LG46X44BSZ4KZLQ45IHFA5CNFSM4KEXD3KKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEIQ675Y#issuecomment-572649463, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AC7JZON3TQBIMEMR4K3OVM3Q45IHFANCNFSM4KEXD3KA.

Also there is a bug in the documentation. Once the middle number indicates the start and once the first number.

While trying to build yacrd I got the following error:
17:59:02     Compiling yacrd v0.6.0 (/yacrd)
17:59:02  error: unknown character escape: `
17:59:02    --> src/cli.rs:83:203
17:59:02     |
17:59:02  83 |         help = "if it set yacrd create tempory file, with value of this parameter as prefix, to reduce memory usage but increase the runtime, warning if prefix contain path separator (`/` for unix or `\` for windows) directory is delete"
17:59:02     |                                                                                ^ unknown character escape
17:59:02
17:59:02  error: unknown character escape: `
17:59:02   --> src/main.rs:5:47
17:59:02    |
17:59:02  5 | of this software and associated documentation files (the "Software"), to deal
17:59:02    |                                               ^ unknown character escape
17:59:02
17:59:02  error: proc-macro derive panicked
17:59:02    --> src/cli.rs:23:10
17:59:02     |
17:59:02  23 | #[derive(StructOpt, Debug)]
17:59:02     |          ^^^^^^^^^
17:59:02     |
17:59:02     = help: message: unexpected byte 96 after \ character in byte literal
17:59:02
17:59:02  error: aborting due to 3 previous errors
17:59:02
17:59:02  error: could not compile `yacrd`.
17:59:02

I probably fix this bug to quickly, last commit solve this compilation error sorry.
Difference between scrubb and split task:

scrubb remove all not covered region
split remove not covered region they are only in middle of read

It's not an important technical difference, but it's more usage difference, split is design to remove chimeric position, scrubb is design to remove positions all that can't be trusted (even if it's not chimeric position).
Your result for read b582ec56-ba2a-47bd-b170-e1591b3aebf5 is very strange can you send to me all overlaps in which this read contributes.
I fix this error in readme sorry, it's:
Extent,Start,Stop

I found how to reproduce bug with read b582ec56-ba2a-47bd-b170-e1591b3aebf5, you didn't need to send to my is overlap.

I am currently building the new version. I will test it later.
I also looked for more weird reads and I have plenty of them. I used minimap2 v2.17-r954-dirty to align the reads.  The commands are in my first post. Below you find the yacrd report for another 2 reads and the overlaps for all three reads.
overlaps-selected.txt
NotCovered      3b9c9197-5909-437d-8c76-667357bb20a0::sampleid=unknown::read=2084::length=67867::QUAL=18.3666::ch=2::runid=8d8451d3ceb17d2cf1ed956ce674b9c163fc1ff0     67867   2944,0,2944;1468,3182,4650;1468,3182,4650;1769,3182,4951;1769,3182,4951;4378,3182,7560;6512,3182,9694;7244,3182,10426;7864,3182,11046;7864,3182,11046;8354,3182,11536;10691,3182,13873;10691,3182,13873;10693,3182,13875;10842,3182,14024;13744,3182,16926;13891,3182,17073;14031,3182,17213;14050,3182,17232;14050,3182,17232;3351,18375,21726;3789,18375,22164;3789,18375,22164;5189,18375,23564;5290,18375,23665;5290,18375,23665;5290,18375,23665;5290,18375,23665;3157,25257,28414;3462,25257,28719;3495,25257,28752;3557,25257,28814;3621,25257,28878;1753,30906,32659;1753,30906,32659;1753,30906,32659;1753,30906,32659;1989,30906,32895;523,34562,35085;700,34562,35262;777,34562,35339;777,34562,35339;1367,34562,35929;1804,36685,38489;1804,36685,38489;2022,36685,38707;2426,36685,39111;2426,36685,39111;1225,40324,41549;1965,40324,42289;2088,40324,42412;2088,40324,42412;2088,40324,42412;219,43688,43907;239,43688,43927;98,44044,44142;1567,45420,46987;1590,45420,47010;1785,45420,47205;1846,45420,47266;1846,45420,47266;392,47976,48368;392,47976,48368;392,47976,48368;30,48387,48417;2234,52239,54473;2234,52239,54473;2234,52239,54473;2259,52239,54498;2352,52239,54591;7646,56450,64096;7807,56450,64257;7917,56450,64367;7917,56450,64367;7917,56450,64367;1,67866,67867
Chimeric        1aa0e6eb-62a0-49a0-947d-32d57fc81025::sampleid=R94_LSK108_wtOSC_CelegansIsolation_BP9-15h::read=6867::length=46609::QUAL=11.7753::ch=425::runid=89d2a090238a2b2e41650c0c1dff2615f3b613cb_10-46578       46569   28,0,28;438,17417,17855;17,46552,46569
Dominik

Thanks for all this stuff.
The commit 08271fd8c5e07 solve my test, but I can't repoduce your result with overlap you give to me. Can you say if result look better.
Thanks again for your help.

I take a look on some of my real datasets I observe this trouble and the last commit seems to solve it.
If you can confirm please close this issue.

It seems the problem is indeed solved, thank you.
One more question. I looked into the very first chimeric read and looked up the uncovered region in the genome browser.

You can see the upstream and downstream fragment labelled with 1 and 2 and the full read sequence blatted against the genome. Below you can see my nanopore reads aligned with minimap2 to the genome. Curiously there is no gap in these mappings. Still in the read vs read overlapping there is this 505 nt long uncovered region. Do you have any idea why this happens? Can it be that the minimizers are lost because they are too common in the genome and therefore minimap stops chain elongation after 500nt without valid minimizer?


Change benchmark ingest took metric to total time

Signed-off-by: John Mazanec<EMAIL_ADDRESS>Description
Measuring total ingest time as opposed to took time per bulk index request will give a better picture of how long it will take to make a particular set of documents searchable.
For a document to become searchable, the index request needs to be processed and then the segment needs to be refreshed. During refresh is when the k-NN data structure is built. So, during indexing, refreshing typically takes up the majority of the time.
If we are just measuring the time it takes to process the bulk request, the metrics will not include the refresh time it takes before refresh is explicitly called.
This change will produce a result set that could look like the following:
  "results": {
    "test_took":<PHONE_NUMBER>3798454,
    "create_index_took_total": 67.68574402667582,
    "ingest_took_total": 95617.42494395003,
    "refresh_index_store_kb_total": 1528246.6162109375,
    "refresh_index_took_total": 15305.556511040777,
    "force_merge_took_total": 4803.185038967058,
    "query_took_total": 59678.0,
    "query_took_p50": 6.0,
    "query_took_p90": 6.0,
    "query_took_p99": 7.0,
    "query_memory_kb_total": 653051.0,
    "query_recall@K_total": 0.985015,
    "query_recall@1_total": 1.0
  }

In order to calculate the time it took for the documents to become searchable, we would add refresh_index_took_total and ingest_took_total (110,000 ms).
Check List

[X] Commits are signed as per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Is it possible to  add sample of the result before the change?

@martin-gaievski sure
    {
      "test_took":<PHONE_NUMBER>8900214,
      "create_index_took_total": 51.29950100672431,
      "ingest_took_total": 6576.0,
      "ingest_took_p50": 54.0,
      "ingest_took_p90": 56.0,
      "ingest_took_p99": 81.0,
      "refresh_index_store_kb_total":<PHONE_NUMBER>5625,
      "refresh_index_took_total":<PHONE_NUMBER>0899,
      "force_merge_took_total":<PHONE_NUMBER>054176,
      "query_took_total": 172376.0,
      "query_took_p50": 17.0,
      "query_took_p90": 19.0,
      "query_took_p99": 21.0,
      "query_memory_kb_total": 192671.0,
      "query_recall@K_total": 0.999981,
      "query_recall@1_total": 1.0
    }


mkpr

Applied mkpr on package.json
sed s/"@kronos-integration\/endpoint": "^.*"/"@kronos-integration\/endpoint": "^9.2.8"/

Codecov Report

Merging #898 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #898   +/-   ##
=======================================
  Coverage   96.22%   96.22%
=======================================
  Files           2        2
  Lines          53       53
  Branches        2        2
=======================================
  Hits           51       51
  Misses          2        2

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d6fec08...cb1f422. Read the comment docs.


lncli: Add support for trusted TLS certificates

This PR adds in functionality to lncli to use the system's certificate pool in addition to the tlscertpath. If the file in tlscertpath doesn't exist we assume the node has a certificate from a trusted Certificate Authority. With this functionality users don't have to provide a TLS certificate if their node's certificate is trusted by their system
This was pulled from https://github.com/lightningnetwork/lnd/pull/2428, but only the lncli capabilities to use the system's cert pool. As trusted certificates become more widely used this support will be important to include.
If the file doesn't exist at --tlscertpath and the node's certificate isn't trusted by their system they will receive a x509: certificate signed by unknown authority error.

@guggero Thanks for the review! I originally just pulled this over from Joost's Let's Encrypt PR. Looks like we both rebased and did it a little differently. How would you recommend we proceed? I can either copy over Joost's changes or I can just close this is we think the Let's Encrypt PR is coming soon.

Yes, I wanted to comment about that. I wasn't aware that Joost's PR was that close to being merged when I reviewed yours (nor that it also included those changes). But I think we'll probably merge #2428 tomorrow or so. Therefore it would probably be best to close yours.
Thanks for your effort and sorry you got overtaken by the original PR :-/

Haha, no problem! Happy to see the original PR being so close. I originally thought that the PR was a ways off from merging so I wanted to get this piece in at least. Glad to see more trusted certificates being used!


Labels in the Dataset cannot be displayed normally in the Gauge Chart.

superset version: [1.4.1](https://pypi.org/project/apache-superset/1.4.1/)

Always show column names:

The same problem is in PivotTable v2.

Yes we have the same lissue on superset v2.0.0

Is anyone facing this in 3.x?

Closing as stale, but happy to revisit/reopen if anyone is facing this in 4.x


[refactor] use a "proper" config api or lib

https://www.curseforge.com/minecraft/mc-mods/cloth-config
https://www.curseforge.com/minecraft/mc-mods/modmenu
?

implemented in version 1.0.0 using owo-lib <3


chore(master): release 1.2.21

:robot: I have created a release beep boop
1.2.21 (2023-06-27)
Bug Fixes

deps: update dependency friendsofphp/php-cs-fixer to v3.20.0 (ed4d12b)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/wayofdev/php-cs-fixer-config/releases/tag/v1.2.21 :sunflower:


Wrong dtype for array in audio features

Describe the bug
When concatenating/interleaving different datasets, I stumble into an error because the features can't be aligned. After some investigation, I understood that the audio arrays had different dtypes, namely float32 and float64. Consequently, the datasets cannot be merged.
Steps to reproduce the bug
For example, for facebook/voxpopuli and mozilla-foundation/common_voice_11_0:
from datasets import load_dataset, interleave_datasets

covost = load_dataset("mozilla-foundation/common_voice_11_0", "en", split="train", streaming=True)
voxpopuli = datasets.load_dataset("facebook/voxpopuli", "nl", split="train", streaming=True)

sample_cv, = covost.take(1)
sample_vp, = voxpopuli.take(1)

assert sample_cv["audio"]["array"].dtype == sample_vp["audio"]["array"].dtype
# Fails

dataset = interleave_datasets([covost, voxpopuli])

# ValueError: The features can't be aligned because the key audio of features {'audio_id': Value(dtype='string', id=None), 'language': Value(dtype='int64', id=None), 'audio': {'array': Sequence(feature=Value(dtype='float64', id=None), length=-1, id=None), 'path': Value(dtype='string', id=None), 'sampling_rate': Value(dtype='int64', id=None)}, 'normalized_text': Value(dtype='string', id=None), 'gender': Value(dtype='string', id=None), 'speaker_id': Value(dtype='string', id=None), 'is_gold_transcript': Value(dtype='bool', id=None), 'accent': Value(dtype='string', id=None), 'sentence': Value(dtype='string', id=None)} has unexpected type - {'array': Sequence(feature=Value(dtype='float64', id=None), length=-1, id=None), 'path': Value(dtype='string', id=None), 'sampling_rate': Value(dtype='int64', id=None)} (expected either Audio(sampling_rate=16000, mono=True, decode=True, id=None) or Value("null").

Expected behavior
The audio should be loaded to arrays with a unique dtype (I guess float32)
Environment info
- `datasets` version: 2.7.1.dev0
- Platform: Linux-4.18.0-425.3.1.el8.x86_64-x86_64-with-glibc2.28
- Python version: 3.9.15
- PyArrow version: 10.0.1
- Pandas version: 1.5.2

After some more investigation, this is due to this line of code. The function sf.read(file) should be updated to sf.read(file, dtype="float32")
Indeed, the default value in soundfile is float64 (see here).

@qmeeus I agree, decoding of different audio formats should return the same dtypes indeed!
But note that here you are concatenating datasets with different sampling rates: 48000 for CommonVoice and 16000 for Voxpopuli. So you should cast them to the same sampling rate value before interleaving, for example:
cv = cv.cast_column("audio", Audio(sampling_rate=16000))

otherwise you would get the same error because features of the same column ("audio") are not the same.
Also, the error you get is unexpected. Could you please confirm that you use the latest main version of the datasets?  We had an issue that could lead to an error like this after using rename_column method but it was fixed in https://github.com/huggingface/datasets/pull/5287

Hi Polina,
Sorry for the late answer
It is possible that the issue was due to a bug that is now fixed. I installed an editable version of datasets from github, but I don't recall whether I had updated it at the time of the issue. My research led me to other directions so I did not follow through on the interleave datasets.


Right approach for disabling auto-increment in EF Core 2.0

Hello all,
I have been trying to disable auto-increment feature on EF Core 2.0 for an Id column in my OnModelCreating() method by trying different approaches such as;
modelBuilder.Entity<LD.Licenses.RelatedProduct>()
                   .Property(c => c.Id)
                   .ValueGeneratedNever();

and .Annotation("DatabaseGenerated", DatabaseGeneratedOption.None); however, nothing seem to work while I have
modelBuilder.Entity<LD.Licenses.RelatedProduct>()
                   .HasKey(c => c.Id);

property in my OnModelCreating() method.
At the end, I got it working with following setup with no HasKey included,
modelBuilder.Entity<LD.Licenses.RelatedProduct>()
                   .Property(c => c.Id)
                   .ValueGeneratedNever()
                   .HasAnnotation("DatabaseGenerated", DatabaseGeneratedOption.None);

So, my question here, is this an expected behavior or some kind of bug? Why EF does not let me set Id column as key but modify its properties such as auto-increment?
I would appreciate your thoughts!
Further technical details
EF Core version: netcoreapp2.0
Database Provider: Microsoft.EntityFrameworkCore.SqlServer
IDE: Visual Studio 2017

Just an update on this.
It turns out it is a flaw on many to many relationship situation.
I had tables such as License, Products and ProductLicenses. These are two entities with many to many relationship and a shared table which is called ProductLicenses.
In OnModelCreating() table, I have placed ProductLicense properties before Product properties which caused no affect for Product properties as ProductLicense depends on it.
Here problem is that migration runs without any error but cause these properties not to take affect.
After I put Product properties before ProductLicense all worked just fine.

@alktly I am not able to reproduce what you are seeing. Can you look at the repro code below and see if there is something I am missing? No matter which combination of calls to HasKey I make in which order, if I also call ValuGeneratedNever, then the property is marked is not marked as ValueGenerated.OnAdd, which means it will not use store generated values.
Also, the annotation for "DatabaseGenerated" is somewhat confusing since I don't believe that EF Core ever generates or uses such an annotation.
public class RelatedProduct
{
    public int Id { get; set; }
}

public class TestContext : DbContext
{
    public DbSet<RelatedProduct> Products { get; set; }

    protected override void OnConfiguring(DbContextOptionsBuilder optionsBuilder)
        => optionsBuilder.UseSqlServer(
            @"Server=(localdb)\mssqllocaldb;Database=Test;Trusted_Connection=True;ConnectRetryCount=0");

    protected override void OnModelCreating(ModelBuilder modelBuilder)
    {
        modelBuilder.Entity<RelatedProduct>()
            .HasKey(c => c.Id);

        modelBuilder.Entity<RelatedProduct>()
            .Property(c => c.Id)
            .ValueGeneratedNever();
    }
}

public class Program
{
    public static void Main()
    {
        using (var context = new TestContext())
        {
            var model = context.Model; // Look at this model to see if has OnAdd or not.
        }
    }
}

EF Team Triage: Closing this issue as the requested additional details have not been provided and we have been unable to reproduce it.
BTW this is a canned response and may have info or details that do not directly apply to this particular issue. While we'd like to spend the time to uniquely address every incoming issue, we get a lot traffic on the EF projects and that is not practical. To ensure we maximize the time we have to work on fixing bugs, implementing new features, etc. we use canned responses for common triage decisions.


tollbooth_in_cpp

tollbooth management project in C++.

Description 📜
this program helps to manage tollbooths.
Fixes #7961

Type of change 📝

[ ] Au#dio (Should be in mp3 format Includes speech clarity, Concise ,Low distortion)
[ ] Vi#deo (Animations, screen-recordings, presentations and regular explanatory films are all possibilties etc)
[x] Doc#umentation (Content Creation in the form of codes or tutorials)
[ ] Other (If you choose other, Please mention changes below)

Domain of Contribution 📊

[ ] Android Dev #(Flutter)
[ ] Android Dev #(Java)
[ ] Android Dev #(Kotlin)
[ ] Backend Dev #(Java)
[ ] Backend Dev #(.NET)
[ ] Backend Dev #(PHP)
[ ] Backend Dev #(Python)
[x] C/#CPP
[ ] Competitive #Programming
[ ] Cyber #Security
[ ] DS#A
[ ] Data#base
[ ] Datascience with #Python
[ ] Datascience with #R
[ ] Frontend Dev #HTML/CSS/JS
[ ] Frontend Dev #React/Angular/Vue
[ ] Go#lang
[ ] Interview #Prep
[ ] Java_#Domain
[ ] JavaScript_#Domain
[ ] ME#RN
[ ] Machine #Learning
[ ] Open #Source
[ ] Python_#Domain
[ ] Ru#st
[ ] Statis#tics
[ ] UI/#UX

Checklist ✅

[x] I follow Contributing Guidelines & Code of conduct of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I'm GWOC'21 contributor

Screenshots / Gif (Optional) 📸

Okay

Hey @deeqakkk , I have added an output image with i/p at last but  I'm unable to find the proper directory for this. cause this PR comes under the minor management project in CPP. can you plz suggest in which directory this PR comes under?

Okay

hey @apeksha235 & @deeqakkk , now it is correct or not?

@Sharayu1071  LGTM ❤  Nice work
Btw we've moved all projects to a new separate directory
So, this is where your contribution resides :
https://github.com/girlscript/winter-of-contributing/tree/C_CPP/C_CPP/Projects in C_C%2B%2B

Okay


question/doubts about substitution principle

It should be possible to substitute the derived class with base class.

this should be the other around?

👍


How do 4.27 carsim plugins work with unreal engine 4.26

How do 4.27 carsim plugins work with unreal engine 4.26?
This problem occurs when I compile：

If you use a plugin, you should use the right unreal version of the plugin.
For example, if you use UE 4.26 and you have plugins for UE 4.27, it goes in the direction of "maybe it works, maybe it doesn't"
From the error message "built with a different engine", I guess you don't use Carla UE4?
https://carla.readthedocs.io/en/latest/build_linux/#unreal-engine
The normal Unreal engine doesn't work with Carla

As @PatrickPromitzer said, it is not recommended to use plugins made for one UE version into another version. Even if it compiles, it may give issues that were not expected.
@DesayHiL, we can't help you anymore because UE plugins are not backwards compatible. Please, try to use the modified version of UE 4.26 for CARLA as they have been tested for this one. Are you ok with closing this issue?

As there has been no response I close the issue. Feel free to reopen it.


Release 0.36.0

Description
Please summarise the changes.
Related issues
Please mention any github issues addressed by this PR.
Checklist

[ ] I have performed a self-review of my code.
[ ] I have commented hard-to-understand parts of my code.
[ ] I have made corresponding changes to the public API documentation.
[ ] I have added tests that prove my fix is effective or that my feature works.
[ ] I have updated the changelog with any user-facing changes.

One test timed out, would like to do the release without it working.


moreMenu does not work with macOS 10.15.3

I had the same issue with cleanHud.  The menubar remains unchanged.  Other plugins work.

Same issue.


Does the websocket connection timeout?

I'm curious to know if the websocket connection times-out if there is no message exchange? If yes, what is the default timeout; and is there any way to change it?

By default, if you're using Laravel Echo with the pusher driver, the pusher driver will send pings to the websocket server every 10s-120s. See here: https://github.com/pusher/pusher-js#activitytimeout-integer This should typically get around inactivity timeouts. The user's browser might cull it eventually though, if the browser tab isn't actively used by the user.


Github actions: auto format json: create prettier.yml

taken from https://blog.pradumnasaraf.dev/code-formatting-github-actions
uses npx prettier
changed .js to json

this approach seems to execute the "Prettier" on all files in the repo. Whereas it should only "pretty" the added/changed files in the pr.


interfaces: add VlanDeviceField and proper population of text field

This allows to add "labels" to internal values for text fields. In this case VLAN device names can be associated with their assigned interface since when these are assigned one cannot rename them. Which is not obvious while trying to do so.
Small issue remains that "option not in list" is returned for selecting a value not yet known to the configuration.

@fichtner how about https://github.com/opnsense/core/commit/a31a21bd93b04bf1917ee8e976bbadf0370b4268 ?

@AdSchellevis I'll take it, thanks! ❤


Fixing retries of Storage.create

For Blob create(BlobInfo blobInfo, InputStream content, BlobWriteOption... options): Turning off retries and marking @Deprecated, because once the InputStream has been consumed, it can't be consumed again.
For Blob create(BlobInfo blobInfo, byte[] content, BlobTargetOption... options): Re-creating the InputStream on every call, so that the same data is resent to the server.

So for now we're not supposed to use it and are required to either load everything into RAM or write a lot of boilerplate?

Ping @garrettjonesgoogle and @andreamlin for user feedback on this PR. Is there a plan to introduce RestartableInputStream as stated?

I have filed https://github.com/GoogleCloudPlatform/google-cloud-java/issues/2620 to track the work of introducing RestartableInputStream.


feat(webui): device discovery in cfm webui

All discovered devices are added when cfm is initialized, but the user can discover new available devices without restarting the whole cfm by using the Click to discover new devices button on the dashboard page.

Don't forget to update the webui wiki with this new feature

Can we prevent the user from manually adding blades to the CMA_Discovered_Blades appliance.

Don't forget to update the webui wiki with this new feature

Yes, will do in another task

Can we prevent the user from manually adding blades to the CMA_Discovered_Blades appliance.

I have added this, thanks


Allow usage of any field as detail key in API

This PR makes it so that you can set an alternative identifier for the detail view, like it usually works in django restframework (as far as I know).
So by settings the lookup_field and possibly the lookup_value_regex attribute on the endpoints, you can for instance query pages by their slug instead of the id.
Example:
class MyPagesAPIEndpoint(PagesAPIEndpoint):
    lookup_field = 'slug'
    lookup_value_regex = '\w+'

Allows you to get a page like so (assuming the slug is "home"
/api/v2/pages/home/

Thanks @lohmander!

you can for instance query pages by their slug instead of the id.

This may be a problem as slugs are not unique across the site. If a user created pages at /foo/about and /bar/about it would be impossible to retieve either of them with the API as they both have the same slug.
I think the best way to query pages by slug is to use the listing view. For example:
GET /api/v2/pages/?slug=foo&fields=*

{
    "meta": {
        "total_count": 1
    },
    items: [
        {
            <page here>
        }
    ]
}

Wagtail currently lacks the ability to find a page in the API by it's public URL. It would be really great to see something that does this added into Wagtail. The idea I have at the moment is something like:

Add a view to the API, that takes a url path as a GET parameter (For example: /api/v2/pages/route/?url_path=/about/)
When a client calls this view, they are either 302 redirected to the detail view or given a 404 response if it doesn't exist

I can't think of another use-case for this as there aren't any unique fields apart from the id. I'm going to close this PR but thanks for the contribution!


Error opening floating window and mapping issues

Hi @rmagatti,
Just tested this out as I was curious about this functionality, looks quite cool. I ran into an issue which is that I get Error executing vim.schedule lua callback: ...site/pack/packer/start/goto-preview/lua/goto-preview.lua:78: Invalid window id: 1003 when trying to open the floating window i.e. using gpd the go to definition preview mapping.
Also the plugin has a dependency on vimp which isn't documented but tbh I think also not really needed since you could export the functions and use them in the mapping which the plugin creates
e.g.
function M.goto_preview_definition()
-- do stuff
end

vim.api.nvim_set_keymap("n", "gpd", "<Cmd>lua require('goto-preview').goto_preview_definition()<CR>")
-- OR if you need to do it based on some logic in setup then
_G.__goto_preview_definition = M.lsp_request(true)
vim.api.nvim_set_keymap("n", "gpd", "<Cmd>lua _G.__goto_preview_definition()<CR>")

Yeah the hidden dependency on vimp for mappings isn't great, I do plan on cleaning that up. Thanks for the submission @akinsho always a pleasure to have you around 😊
I've only seen that error you mentioned when it fails to create the new window, it's then trying to position the cursor on a window it was ultimately unable to create.
I can fix the error up by not trying to use the new_window value if it doesn't exist but the root of the issue of it being unable to create the window (assumed) is still unknown to me 🤔. Do you see anything else in messages at all? Also does the float even show up?

@rmagatti I wonder if it might be due to how I've tried to work around the mapping issue since I can't see any other way to access this plugins functions without using vimp which I haven't/would rather not install 😅 . Maybe calling the lsp_request function at this point causes some weird issue.
    use {
      "rmagatti/goto-preview",
      config = function()
        local preview = require("goto-preview")
        preview.setup {}
		-- home grown copy of functionality from vimp etc.
        as.nnoremap("gpd", preview.lsp_request(true))
      end
    }

In terms of what else I see, it seems to cause a buffer to be created with the name of the file appended with some characters.

Hey @akinsho the PR should address the mapping issues.

In terms of what else I see, it seems to cause a buffer to be created with the name of the file appended with some characters.

Now this one I'm not really sure what it is. Mind trying out the new mapping and letting me know if this new weirdly named buffer still happens?

@rmagatti I just tried the PR which is helpful thanks, I'm still seeing the bug though so I'm trying to whittle it down to a minimal init.lua and see what might be triggering it

@rmagatti done a bit of debugging with quite a minimal init.lua and it seems the underlying error I'm seeing is Error executing vim.schedule lua callback: ...site/pack/packer/start/goto-preview/lua/goto-preview.lua:79: Cursor position outside buffer. Seems setting the cursor is what is failing but I'm not sure why

Created that new issue to track what you're describing, let's continue there so I can merge the PR and close this one. 😊


[qt5] angle dynamic for arm64-osx-dynamic build failure

Host Environment

OS: OSX Monterey
Compiler: Apple clang version 13.1.6

To Reproduce
Steps to reproduce the behavior:
./vcpkg  "qt5[webengine]":arm64-osx-dynamic
I get the following error as part of the dependencies for qt5[webengine].
Failure logs
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:158 (message):
    Command failed: /opt/homebrew/Cellar/cmake/3.22.2/bin/cmake --build . --config Debug --target install -- -v -j9
    Working Directory: /Users/amir/projects/github/vcpkg/buildtrees/angle/arm64-osx-dynamic-dbg
    See logs for more information:
      /Users/amir/projects/github/vcpkg/buildtrees/angle/install-arm64-osx-dynamic-dbg-out.log

Call Stack (most recent call first):
  scripts/cmake/vcpkg_build_cmake.cmake:106 (vcpkg_execute_build_process)
  scripts/cmake/vcpkg_install_cmake.cmake:44 (vcpkg_build_cmake)
  ports/angle/portfile.cmake:64 (vcpkg_install_cmake)
  scripts/ports.cmake:145 (include)

The error is as follows:
arm64-osx-dynamic/debug/lib/libz.dylib  -framework  IOKit  -framework  CoreFoundation  -framework  CoreGraphics && :
Undefined symbols for architecture arm64:
  "rx::CreateDisplayCGLOrEAGL(egl::DisplayState const&)", referenced from:
      egl::(anonymous namespace)::CreateDisplayFromAttribs(long, long, long, egl::DisplayState const&) in libANGLE.a(Display.cpp.o)
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
ninja: build stopped: subcommand failed.

Additional context
Add any other context about the problem here, such as what you have already tried to resolve the issue.
stdout-arm64-osx-dynamic.log
install-arm64-osx-dynamic-dbg-out.log

I got the same issue when using ANGLE with glfw on macos.
It seems that the src/libANGLE/renderer/gl/apple/DisplayApple_api.cpp file did not compile so there was no DisplayApple_api.cpp.o obj file.
src/libGLESv2.gni
libangle_mac_sources = [
  "src/libANGLE/renderer/driver_utils_mac.mm",
  "src/libANGLE/renderer/gl/apple/DisplayApple_api.cpp",
  "src/libANGLE/renderer/gl/apple/DisplayApple_api.h",
]

BUILD.gn
  if (is_apple) {
    sources += libangle_mac_sources
  }


docker completion arguments for a command

Hi guys.
I started to learn Docker and decided to enable docker plugin to see all commands and options.
But I noticed that completion for arguments of a particular command works very strange.
So my steps (and steps to reproduce ) are:

write docker[space] or select it from completion and press tab

the output would be a list of all commands 👍

select a command (e.g. image), so it would be docker images[space]

press tab to see arguments for the command. It complete command with only one dash so it would be docker images -

press tab again  and here comes strange things like

So the output is not formatted. But I noticed that if it would be two dashes at the end i.e. docker images -- and press tab the output would be pretty and clear (as expected).
I don't know much how zsh completion works so I don't know how to fix it (or should be fixed whether). But if you give some advice I would try to do my best.
Thanks.

It seems like with docker ps command everything is fine (no matter one or two dashes at the end).
Maybe it is because images completion call __docker_images at the end and ps doesn't?
It is the only difference I can see.

The docker completion in OMZ was outdated. #5354 should solve this problem.
Also, please check if you have docker zsh completion installed by posting the output of running the following:
for d ($fpath); do [[ -f "$d/_docker" ]] && print -l "$d/_docker"; done

Thanks Marc. I also noticed that it was outdated because some arguments was deprecated and now are not supported.
Tha command gives
/Users/aivanov/.oh-my-zsh/plugins/docker/_docker

Ok, I see your docker completion wasn't automatically installed with docker. I won't delete the docker completion from OMZ because some of you won't have an alternative. How did you install docker, if I may ask?

On this particular machine is running on MacOS so I install docker with dmg package from here.
I could easily remove it and install with the way you provide because I didn't do anything yet.

I was asking because in the Debian and Ubuntu installers the official docker completion is installed in /usr/share/zsh/vendor-completions/_docker.
I see the official installer for Mac doesn't install a completion, so it's better I don't delete the completion from OMZ even if it may become outdated. I'll see if I can find a better solution because OMZ forces to use the plugins completion, regardless of whether there is a more updated completion...
Thanks for your information!

Not at all Marc.
Thanks for the explanation and help!


Purescript CST/AST - Support list comprehension

A list comprehension consists of four types of elements: generators, guards, local bindings, and targets:
squares = [x * x | x <- [1..10]]

-- multiple generators
[(x,y) | x <- [1,2,3], y <- [4,5]]

-- dependent generators
[(x,y) | x <- [1..3], y <- [x..3]]

-- guards
[x | x <- [1..10], even x]

Implemented in 0.0.2 release


Streaming gzipped files on S3

Smart_open works very well for local gzipped fields, and for files on S3, is it not possible to stream gzipped files on S3?
I tried and it doesn't seem to decompress while streaming, is there a reason for it not to work or is it just not implemented?
thanks

Ah sorry just noticed this is a duplicate of #12 can close it..


head pose estimation interpretation

Hi Massimiliano,
looking at prima dataset image https://ibb.co/ia5pB5 these are its labels (tilt:pitch:-90 , pan:yaw:0), when trying the same image on deepgaze (https://github.com/mpatacchiola/deepgaze/blob/master/examples/ex_cnn_headp_pose_estimation_images/ex_cnn_head_pose_estimation_images.py) the results are Estimated [roll, pitch, yaw] ..... [-1.32919,-5.41702,-9.20919] could you kindly mention the reason this representation is quite different from prima dataset.
Thanks in advance :)

Hi Massimiliano,
Thanks for your fast reply.
just to confirm, would a CelebA-unaligned image like so https://ibb.co/dFMPuQ is considered "correct square frame" to be passed to deepgaze-head pose estimation ? also any more specifications to consider when using deepgaze head pose estimation ?
Thanks in advance :)

In that image the cropping may be correct (would be better to be close to the chin on the bottom).
But I notice that there is a distorsion in the face proportion. Probably because it was a rectangular frame which has been squashed in a square frame without an appropriate crop. This kind of aberrattions may negatevely effect the performance of the classifier. When the frame is rectangular (let's say of size R x C) would be better to take the longest side (let's suppose it is R) and use it to crop a squared frame (in this example of size R x R) centered on the face.
Another thing to take into account is the image format. Deepgaze uses BGR convention like in OpenCV, if you are reading the image with another library it is possible that you get an image in RGB format which can cause trouble to the CNN. I suggest you to use the OpenCV imread() function to read the images.
The head pose estimator module does not require any other particular pre-processing operation. An internal normalisation is performed at pixel level and appropriate resize is applied to images larger than 64x64 pixels.
Massimiliano

Hi Massimiliano,
Thanks alot for your detailed feedback. I appreciate your help.
To follow your instructions i tried with (http://conradsanderson.id.au/lfwcrop/) and random pic from that db would like this (https://ibb.co/dFz3M5) i guess this fits the description, however deepgaze produces Estimated [roll, pitch, yaw] ..... [-1.51543,7.9395,49.6683], i just visually compare it to (https://ibb.co/njF4Tk) and wouldn't this should be a yaw of (+90) ? or what do you think is wrong in addressing this interpretation from my side?
Thanks in advance :)

Hi,
The last image you sent looks good. The type of cropping I generally use is similar to the one in this image.
The output of the network should be quite accurate for yaw angles in the range [+60, -60] degrees.
Unfortunately the performances slightly degradate when the face is completely turned. This is due to the fact that the images used for training have a low number of faces for those positions.
Massimiliano

Hi Massimiliano,
Thank you for the quick feedback and reply.
Any other "performance know about", regarding the other two angles (pitch and roll) like you mention deepgaze works perfect for  yaw angles in the range [+60, -60] degrees. what about (pitch and roll) ranges ?
Many thanks to you.

Regarding pitch and roll there are some limitations as well. The roll estimator has been trained in the range [-25, +25] degrees, whereas the pitch span from -45 to +45 degrees. Also in this case when you move to the end of the range the performance deteriorate. These limits are due to the AFLW dataset which is the one used for the training. In this moment there is not another dataset in-the-wild having the same amount of images. The positive thing is that the aferementioned ranges allow estimating the pose of most of the images released in social networks and media.
Massimiliano

Thanks a lot Massimiliano for your help.

You are welcome.


(fix) rocksdb-compression-on-windows

Seems like the rocksdb jni for Windows doesn't come linked with any of the compression type

@killme2008 再看下是否有其他意见？


PgCat holds more idle connections than PgBouncer

Describe the bug
A clear and concise description of what the bug is.
We've migrated several databases to PgCat from PgBouncer and found that with the same connection limits and timeouts configured PgCat ends up creating more connections

To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Idle connections aren't great to have on the DB and it would be good to figure out why PgCat doesn't evict connections and/or requires more connections
Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

I think this is because bb8 asynchronously spawns new connections when multiple clients request one and the pool doesn't have any idle ones available: https://github.com/djc/bb8/blob/main/bb8/src/inner.rs#L102-L147. I believe Pgb is doing the same thing synchronously, but I don't recall.


A bug in mutter is causing issues with window previews in some extensions

Describe the bug
I'm running my system on Unstable right now as one does on occasion, and I've run into a bug with an extension that I use called dash to panel. I tracked down the bug on their tracker, and found that it's a bug in Mutter itself, that was fixed in these two commits.
I am writing to request that these two commits be added to mutter, basically, and I'll admit I'm not even sure this is the place to do it, or the way to do it. If it's not, point me where to/how to, please and thank you!
Steps To Reproduce
Steps to reproduce the behavior:

Use Gnome 42
Install Dash to Dock
Window Previews don't close due to a bug in Mutter

Expected behavior
Window Previews should close
Additional context
More information can be found at the issue I linked previously
Notify maintainers
Basically the @gnome group which appears to be made up of
@bobby285271
@hedning
@jtojnar
@dasj19
@maxeaubrey
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
 - system: `"x86_64-linux"`
 - host os: `Linux 5.17.2-zen3, NixOS, 22.05 (Quokka)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.8.0pre20220411_f7276bc`
 - channels(krutonium): `""`
 - channels(root): `"nixos-21.11.335665.0f316e4d72d, nixos-hardware"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

If it bothers you enough, you can open a PR against mutter, adding the commits using fetchpatch:
https://github.com/NixOS/nixpkgs/blob/1ffba9f2f683063c2b14c9f4d12c55ad5f4ed887/pkgs/desktops/gnome/core/mutter/default.nix#L66
https://github.com/NixOS/nixpkgs/blob/1ffba9f2f683063c2b14c9f4d12c55ad5f4ed887/pkgs/desktops/gnome/core/gnome-shell/default.nix#L96
Hopefully, the patch will apply without any changes.
Otherwise, you can wait for 42.1 release, for which tarballs should be available on Saturday, April 23:
https://wiki.gnome.org/FortyTwo

When is 42.1 coming to unstable out of curiosity?

Unfortunately, it still have not been released yet: https://gitlab.gnome.org/GNOME/mutter/-/tags

Opened https://github.com/NixOS/nixpkgs/pull/171904

This seems to be fixed! Thanks :)


[CI/Build] re-add codespell to CI

A previous PR, #9928, did some refactoring to run certain things only
when relevant files have changed. One change was to move codespell
into its own workflow since it applies to both code and docs.
Unfortunately, that commit removed it from the ruff workflow, but
then I forgot to git add the new workflow file. It's included here.
Signed-off-by: Russell Bryant<EMAIL_ADDRESS>

@DarkLight1337 @khluu follow-up for a small mistake I made in a previous PR you reviewed, #9928


fix(notify-pipeline-complete): no longer set deployment status

:pencil: Description
In the notify-pipeline-complete helper, we never needed to be setting the deployment status to success for the latest deployment, and it is not documented as such. So this cleans up that bit of oversight.

:tada: This PR is included in version 1.21.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


eos failed to build on macOS 10.13.4 - stuck in mongo c driver

MacOs failed to build on macOS 10.13.4
I followed:
https://github.com/EOSIO/eos#manualdepmacos
one step is to install mongo-c-driver-1.9.3
the make got stuck in
dyld: Library not loaded: /opt/local/lib/libreadline.6.dylib
Referenced from: /opt/local/bin/gawk
Reason: image not found
./config.status: line 1310: 30626 Done(141)               eval sed "$ac_sed_extra" "$ac_file_inputs"
30627 Abort trap: 6           | $AWK -f "$ac_tmp/subs.awk" > $ac_tmp/out
Error message suggested mongo 1.9.3 demanded for readline library version 6....
However, homebrew only offers version >=7
brew list readline
output:
/usr/local/Cellar/readline/7.0.3_1/include/readline/ (8 files)
/usr/local/Cellar/readline/7.0.3_1/lib/libhistory.7.0.dylib
/usr/local/Cellar/readline/7.0.3_1/lib/libreadline.7.0.dylib
/usr/local/Cellar/readline/7.0.3_1/lib/ (6 other files)
/usr/local/Cellar/readline/7.0.3_1/share/doc/ (3 files)
/usr/local/Cellar/readline/7.0.3_1/share/info/ (3 files)
/usr/local/Cellar/readline/7.0.3_1/share/man/ (2 files)
/usr/local/Cellar/readline/7.0.3_1/share/readline/ (15 files)
There is NO version 6 or below!!!

after reinstallation of gawk
sudo port -f deactivate gawk
sudo port upgrade gawk
https://trac.macports.org/ticket/54895
It works.
Reason: After upgrade from MacOS 10.12 to MacOS 10.13, I haven't rebuilt all mac port applications.
gawk was crashed after the upgrade back in SEP17.


Flav/improve page modal layout

Description
This PR improves the Page component to improve the rendering with the modal variant.
Before:

After:

Risk

Deploy Plan

PMRW.


Add test for valid artist data on save.

Also cleanup of all the various test fixtures data was done during this commit.


gnome3.gnome-taquin: 3.36.3 -> 3.36.4

Semi-automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/gnome-taquin/versions.
meta.description for gnome3.gnome-taquin is: "Move tiles so that they reach their places"
meta.homepage for gnome3.gnome-taquin is: "https://wiki.gnome.org/Apps/Taquin"
meta.changelog for gnome3.gnome-taquin is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 3.36.4 with grep in /nix/store/hgdgkj1xdgmpy272dpjv1xhdrdz1azsg-gnome-taquin-3.36.4

directory tree listing: https://gist.github.com/2a5ad271a12a366d7000843054a74df3

du listing: https://gist.github.com/c580a6f445b0041813642a2f27253106

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)

1 package rebuild(s)

1 x86_64-linux rebuild(s)
1 i686-linux rebuild(s)
0 x86_64-darwin rebuild(s)
1 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
gnome3.gnome-taquin

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/hgdgkj1xdgmpy272dpjv1xhdrdz1azsg-gnome-taquin-3.36.4 \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A gnome3.gnome-taquin https://github.com/r-ryantm/nixpkgs/archive/412c75d4732577dcd3a4209da71fa220f2bced5e.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/hgdgkj1xdgmpy272dpjv1xhdrdz1azsg-gnome-taquin-3.36.4
ls -la /nix/store/hgdgkj1xdgmpy272dpjv1xhdrdz1azsg-gnome-taquin-3.36.4/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review 1

1 package built:
- gnome3.gnome-taquin

Maintainer pings
cc @hedning @jtojnar @worldofpeace for testing.

Tested with nix-shell -p nixpkgs-review --run "nixpkgs-review pr 92776" and the game runs fine.

Changes look okay:

3.36.4 – July 5, 2020
Just a translation release.
Translation updated:
Greek: Efstathios Iosifidis


Issue #2306 - null value fix in tables

URL of the original issue:
https://github.com/OpenRefine/OpenRefine/issues/2306
Description of the original issue:
"I'm trying to export with « Custom tabular exporter… » and choosing « Upload to -> A new Google spreadsheet », and in some rows, if a value is missing, then the cell value disapear and the cell on the right shift left."

@linderbarbara Hi and thanks for your first PR !   It looks like you accidentally deleted our .gitignore file.  Please add that back in.  Also I noticed that our .gitignore is missing the exclusion for Eclipse .metadata folder so I just issued a PR #2556 to fix that.  If you could please cleanup this PR (add our .gitignore back in place, and ensure this PR does not include pushing the .metadata Eclipse folder) then we should be ready for further review!

New version of this PR is in #2560.


Custom imports support

Any chance we could get custom import support like wgsl-analyzer has?
https://github.com/wgsl-analyzer/wgsl-analyzer/tree/main/editors/code#custom-imports
See here for how it's used with Bevy: https://github.com/bevyengine/bevy/issues/5561
Regardless, the work you have done with this plugin has been very appreciated!

I imagine I could make the plugin ignore any line that starts with # at the very least.

The plugin already ignores any line starting with #, so what is it you want the plugin to do?

Sorry I should have tried to clarify. Thanks for asking.
Bevy has a simple preprocessor that basically inserts the file it imports at the location of the import at compile time. If this plugin could support auto completion of the imported variables, function names etc. that would be super helpful. wgsl-analyzer for vscode does this by having the user provide a map of import names and the file name to use for the import.
I totally get that if you aren't using bevy you aren't going to be very motivated to add this so feel free to close this if it isn't something you are interested in supporting. It isn't part of the WGSL spec so that's an understandable stance.
Lmk if you don't want to but would be willing to consider a PR to add support and I might attempt it, I'm not familiar with jetbrains plugin dev yet and just started a new job so it would probably be a ways down the road.

AH, I see what you're after. It might be easier to integrate with wgsl-analyzer in some way to get the full benefits of code completion and so on.
I'm more than happy to accept a PR with any changes you make.


feat: add swc polyfill checker

PR Details

Description
加入 swc polyfill 检查插件

Related Issue

Motivation and Context

How Has This Been Tested

Types of changes

[ ] Docs change / refactoring / dependency upgrade
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist

[x] My code follows the code style of this project.
[x] I have updated changeset
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

已更新


Some pods in microk8s cluster can not be created due to network errors

we have a 6 nodes cluster with ha enabled. Recently we've noticed that some pods can not be created with the following error in description:
Warning  FailedCreatePodSandBox  8m6s (x15 over 23m)  kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "407ac47ba14cac4f31303222f8e69a77057a9fb2a646cf1104fc485c423bea5a": error getting ClusterInformation: Get https://[<IP_ADDRESS>]:443/apis/crd.projectcalico.org/v1/clusterinformations/default: dial tcp <IP_ADDRESS>:443: i/o timeout

It can happen on each node. More over, after some time these pods are getting successfully created. The error can persist either fore a couple of minutes or for more than 24h.
Here are microk8s inspect results:
inspection-report-20210730_090438.tar.gz
mikrok8s version is v1.21.3
OS:
NAME="Ubuntu"
VERSION="20.04.2 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.2 LTS"
VERSION_ID="20.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal

It looks like there is some problem with calico or with iptables configuration.  Any help would be appreciated. Thanks in advance

Fixed by setting --advertise-address for each node's apiserver


End tokens visible on wandb when resuming the model

I'm not entirely sure this is a bug, just wondering. I get the output below on wandb on my current run, which is my first run resuming from a previous checkpoint.
Is there something wrong, did I brake something and I'm training on the text visible? Or is this something on wandb side somehow?

Best,
Theodore.

@TheodoreGalanos yess, i added the  token so that the last text token is actually trained to predict something (if it predicts padding, it gets no loss) if you update to 0.8.3, it should remove the endoftext for you!