Docs (readthedocs) ?

Planar had some nice HTML docs
https://pythonhosted.org/planar/transforms.html
I'm not sure how the above docs are generated, if they are something standard it may be worth moving docs to readthedocs.
It would be good to get these for Affine, it may be a matter of contacting Casey, I know a number of years ago he was pretty keen for someone to pick up Planar, so don't imagine this would be a problem.

Created a PR to build a single site documentation.
Result looks like this:
https://rotzbua.github.io/affine/

From a quick scan that looks nice :)
Where would these be hosted, on github pages ?

Where would these be hosted, on github pages ?

Right. Hosted on github pages. The actions build the html and uploads the documentation html artifact to pages.

From a quick scan that looks nice :)

Thanks :)
I know that it is just an 80% solution e.g. versioned documentation is missing but I think it is the simplest solution without additional external services at the moment.

Having messed with docs gen, I know it's a pain, and I never got as far as versioned docs - if you crack it I should probably see how + maybe do the same for the (non RTD) docs for the shoebot project.

@Rotzbua my first impression is very positive. I would also prefer sphinx over, say, mkdocs, because of familiarity with sphinx. I have two questions:

Did you approach this differently from what is described at https://bylr.info/articles/2022/05/10/api-doc-with-sphinx-autoapi/? Don't dive into that unless you want to, I'm only asking if you've already read that post.
My thought would be to host at Read the Docs. Are you okay with that?

Here we go: https://affine.readthedocs.io/en/latest/.
Thank you @Rotzbua !

Fantastic work, thanks all!


ci(e2e): improved e2e snapshotting

Motivation
Our E2E Tests often fail due to flakiness or instability of snapshots. With these added features we will ensure better stability for snapshots.
Changes
added functionality to snapshotting
Tests
ran workflows successfully

superseded by https://github.com/dfinity/oisy-wallet/pull/4019


Postgres is fully supported; update docs?

Currently the Config doc has the following to say:

Ghost can also be used with PostGreSQL. Support for Postgres is currently second class compared to SQLite & MySQL – there is a build run against it, but very minimal manual testing. At present we are considering downgrading support to ‘community’ ...

Ghost works fine with PostgreSQL, 100% of functionality works, and all tests pass.  I run two sites on Ghost/Postgres, so I'll notice pretty quickly if it breaks.  Can we update the documentation?

This was discussed very recently in slack, and the docs were updated to clarify our position as a result of that discussion, just a few weeks ago.
No member of the core team, or aspect of Ghost's infrastructure depends on postgres in production, meaning it is not tested or even understood to the same level. This is particularly a problem given that postgres has a different interface to that of sqlite3 & mysql, meaning familiarity with its differences and quirks are necessary to provide support and fixes.
In addition, providing support for postgres is time-consuming and gets in the way of us shipping new things, as it adds an order of magnitude to the amount of testing we have to do for data-related features.
At the moment, we don't have enough community involvement or engagement around postgres to make up for the lack inside the core team (or to bring someone new into the core team who has the necessary knowledge). E.g. whenever anyone in Slack gets stuck with a postgres issue, there is no response from any community member. There do seem to be edge-case bugs, but they'e not understood well nor fixed.
As it says in the docs, I'm strongly considering classifying postgres support as 'community' and allowing the build to fail. It will then be up to the community to ensure that postgres failures are fixed.

Well, what can I do?  I'm happy to look at GH issues and answer questions, but I don't generally log into Slack on a daily basis, so I can't promise to field questions there.

I'm happy to look at GH issues and answer questions

That would be great :) The more the merrier always.

Feh, looks like logging into Slack is a PITA because of conflicting Slack accounts I have with clients.  I don't suppose you could open up the Slack-to-IRC gateway?
Regardless, searching issues now ...

I use slack with multiple teams - once you have them logged in it should be straightforward to switch between them. We would love to turn on the IRC gateway, but slack doesn't allow us to do that with guest accounts - dropping them an email and adding your voice to the list of many people who have asked for that may be a good idea.

The problem isn't multiple teams, it's multiple accounts.  That's unsupported, except via the IRC gateway.

Anyway, in the meantime, please tag me on any PostgreSQL issues which I might miss.

Oh, I suppose this isn't open for the time being.


Demo Monster incl. git hook now working.

I'll merge it but leave a mental note to check if replacing tab by a blank does have an impact on named


fastlane supply fails with Google Api Error: editDeleted: This Edit has been deleted.

I have a lane that runs bundle exec fastlane supply. Unfortunately sometimes it fails with Google Api Error: editDeleted: This Edit has been deleted.. Any ideas?
Full output:
2018-11-15T15:42:33.7515950Z +-------------------------+-----------------------------------------------------------+
2018-11-15T15:42:33.7516540Z |                             Summary for supply 2.108.0                              |
2018-11-15T15:42:33.7517160Z +-------------------------+-----------------------------------------------------------+
2018-11-15T15:42:33.7517280Z | package_name            | tools.fastlane.androidapp                                 |
2018-11-15T15:42:33.7517360Z | track                   | production                                                |
2018-11-15T15:42:33.7517440Z | metadata_path           | ./fastlane/metadata/android                               |
2018-11-15T15:42:33.7517510Z | json_key                | /Users/vsts/agent/2.141.1/work/_temp/google_play_key.json |
2018-11-15T15:42:33.7517590Z | skip_upload_apk         | false                                                     |
2018-11-15T15:42:33.7517660Z | skip_upload_aab         | false                                                     |
2018-11-15T15:42:33.7517750Z | skip_upload_metadata    | false                                                     |
2018-11-15T15:42:33.7517820Z | skip_upload_images      | false                                                     |
2018-11-15T15:42:33.7517890Z | skip_upload_screenshots | false                                                     |
2018-11-15T15:42:33.7517970Z | validate_only           | false                                                     |
2018-11-15T15:42:33.7518050Z | check_superseded_tracks | false                                                     |
2018-11-15T15:42:33.7518120Z | timeout                 | 300                                                       |
2018-11-15T15:42:33.7518200Z | deactivate_on_promote   | true                                                      |
2018-11-15T15:42:33.7518750Z +-------------------------+-----------------------------------------------------------+
2018-11-15T15:42:33.7518820Z
2018-11-15T15:42:33.7519330Z [15:42:33]: Preparing to upload for language 'de-DE'...
2018-11-15T15:42:33.7520030Z
2018-11-15T15:42:33.7520570Z [!] Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T15:42:33.7521040Z
...

Similar thing also happens on download with bundle exec fastlane supply init ...:
...
2018-11-15T16:33:47.8302150Z [16:33:47]: ----------------------------------------------------
2018-11-15T16:33:47.8303000Z [16:33:47]: --- Step: Switch to android run_supply_init lane ---
2018-11-15T16:33:47.8304970Z [16:33:47]: ----------------------------------------------------
2018-11-15T16:33:47.8306010Z [16:33:47]: Cruising over to lane 'android run_supply_init' 🚖
2018-11-15T16:33:47.8351880Z [16:33:47]: --------------------------------------------------------------------
2018-11-15T16:33:47.8364180Z [16:33:47]: Step: bundle exec fastlane supply init --package_name tools.fastlane.androidapp --json_key /Users/vsts/agent/2.141.1/work/_temp/google_play_key.json
2018-11-15T16:33:47.8370050Z [16:33:47]: --------------------------------------------------------------------
2018-11-15T16:33:47.8371420Z [16:33:47]: $ bundle exec fastlane supply init --package_name tools.fastlane.androidapp --json_key /Users/vsts/agent/2.141.1/work/_temp/google_play_key.json
2018-11-15T16:33:49.5455390Z [16:33:49]: ▸ [16:33:49]: 🕗  Downloading metadata, images, screenshots...
2018-11-15T16:33:51.2781150Z [16:33:51]: ▸ [16:33:51]: 📝  Downloading metadata (de-DE)
2018-11-15T16:33:51.2785810Z [16:33:51]: ▸ [16:33:51]: Writing to fastlane/metadata/android/de-DE/title.txt...
2018-11-15T16:33:51.2796620Z [16:33:51]: ▸ [16:33:51]: Writing to fastlane/metadata/android/de-DE/short_description.txt...
2018-11-15T16:33:51.2801020Z [16:33:51]: ▸ [16:33:51]: Writing to fastlane/metadata/android/de-DE/full_description.txt...
2018-11-15T16:33:51.2805180Z [16:33:51]: ▸ [16:33:51]: Writing to fastlane/metadata/android/de-DE/video.txt...
2018-11-15T16:33:51.2806320Z [16:33:51]: ▸ [16:33:51]: 📱  Downloading screenshots (de-DE)
2018-11-15T16:33:51.2824190Z [16:33:51]: ▸ [16:33:51]: 📵  Due to a limitation of the Google Play API, there is no way for `supply` to download your existing screenshots. Please copy your screenshots into `metadata/android/de-DE/images/`
2018-11-15T16:33:51.2825320Z [16:33:51]: ▸ [16:33:51]: 🖼  Downloading images (de-DE)
2018-11-15T16:33:51.2826580Z [16:33:51]: ▸ [16:33:51]: 📵  Due to a limitation of the Google Play API, there is no way for `supply` to download your existing feature graphic. Please copy your feature graphic to `metadata/android/de-DE/images/featureGraphic.png`
2018-11-15T16:33:51.2827880Z [16:33:51]: ▸ [16:33:51]: Downloading `icon` for de-DE...
...
2018-11-15T16:33:52.6724890Z [16:33:52]: ▸ [16:33:52]: 📵  Due to a limitation of the Google Play API, there is no way for `supply` to download your existing feature graphic. Please copy your feature graphic to `metadata/android/fr-FR/images/featureGraphic.png`
2018-11-15T16:33:52.6725760Z [16:33:52]: ▸ [16:33:52]: Downloading `icon` for fr-FR...
2018-11-15T16:33:52.8490230Z [16:33:52]: ▸ [16:33:52]: Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T16:33:52.8492290Z [16:33:52]: ▸ [16:33:52]: Error downloading 'icon' for fr-FR...
2018-11-15T16:33:52.8492990Z [16:33:52]: ▸ [16:33:52]: Downloading `promoGraphic` for fr-FR...
2018-11-15T16:33:53.3899470Z [16:33:53]: ▸ [16:33:53]: Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T16:33:53.3900220Z [16:33:53]: ▸ [16:33:53]: Error downloading 'promoGraphic' for fr-FR...
2018-11-15T16:33:53.3902170Z [16:33:53]: ▸ [16:33:53]: Downloading `tvBanner` for fr-FR...
2018-11-15T16:33:53.5494370Z [16:33:53]: ▸ [16:33:53]: Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T16:33:53.5496950Z [16:33:53]: ▸ [16:33:53]: Error downloading 'tvBanner' for fr-FR...
2018-11-15T16:33:53.5498090Z [16:33:53]: ▸ [16:33:53]: 📝  Downloading metadata (it-IT)
2018-11-15T16:33:53.5500110Z [16:33:53]: ▸ [16:33:53]: Writing to fastlane/metadata/android/it-IT/title.txt...
2018-11-15T16:33:53.5501960Z [16:33:53]: ▸ [16:33:53]: Writing to fastlane/metadata/android/it-IT/short_description.txt...
2018-11-15T16:33:53.5503950Z [16:33:53]: ▸ [16:33:53]: Writing to fastlane/metadata/android/it-IT/full_description.txt...
2018-11-15T16:33:53.5505840Z [16:33:53]: ▸ [16:33:53]: Writing to fastlane/metadata/android/it-IT/video.txt...
2018-11-15T16:33:53.5508400Z [16:33:53]: ▸ [16:33:53]: 📱  Downloading screenshots (it-IT)
2018-11-15T16:33:53.5513060Z [16:33:53]: ▸ [16:33:53]: 📵  Due to a limitation of the Google Play API, there is no way for `supply` to download your existing screenshots. Please copy your screenshots into `metadata/android/it-IT/images/`
2018-11-15T16:33:53.5515010Z [16:33:53]: ▸ [16:33:53]: 🖼  Downloading images (it-IT)
2018-11-15T16:33:53.5517100Z [16:33:53]: ▸ [16:33:53]: 📵  Due to a limitation of the Google Play API, there is no way for `supply` to download your existing feature graphic. Please copy your feature graphic to `metadata/android/it-IT/images/featureGraphic.png`
2018-11-15T16:33:53.5518770Z [16:33:53]: ▸ [16:33:53]: Downloading `icon` for it-IT...
2018-11-15T16:33:53.7288690Z [16:33:53]: ▸ [16:33:53]: Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T16:33:53.7290950Z [16:33:53]: ▸ [16:33:53]: Error downloading 'icon' for it-IT...
2018-11-15T16:33:53.7292130Z [16:33:53]: ▸ [16:33:53]: Downloading `promoGraphic` for it-IT...
2018-11-15T16:33:53.9179450Z [16:33:53]: ▸ [16:33:53]: Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T16:33:53.9180410Z [16:33:53]: ▸ [16:33:53]: Error downloading 'promoGraphic' for it-IT...
2018-11-15T16:33:53.9181860Z [16:33:53]: ▸ [16:33:53]: Downloading `tvBanner` for it-IT...
2018-11-15T16:33:54.1323440Z [16:33:54]: ▸ [16:33:54]: Google Api Error: editDeleted: This Edit has been deleted.
2018-11-15T16:33:54.1324890Z [16:33:54]: ▸ [16:33:54]: Error downloading 'tvBanner' for it-IT...
2018-11-15T16:33:54.3316200Z [16:33:54]: ▸
2018-11-15T16:33:54.3318390Z [16:33:54]: ▸ [!] Google Api Error: editDeleted: This Edit has been deleted.
...

An issue at bitrise points to the problem being duplicate executions at the same time: https://github.com/bitrise-steplib/steps-google-play-deploy/issues/45 This matches, currently each CI run is triggered twice (branch and PR/merge).


Filter "non-UGent" does not work

Bug
Filter "non-UGent" does not work. We get irrelevant results
Steps to reproduce

Go to biblio, publications
Use the filter "UGent", check "non UGent"

Apply filter and click open the first result
https://backoffice.biblio.ugent.be/publication/01GMNAQC9425TKCGS784GNATPC?redirect-url=%2Fpublication%3Fq%3D%26f%255Bextern%255D%3Dfalse
See the checkbox has not been checked on the details page

See UGent authors in the people & affiliations tab

Expected behaviour

When "non UGent" is checked, we expect to see only records that have the checkbox "Published while none of the authors and editors were employed at UGent" checked.

When "UGent" is checked, we expect to see only records that do not have the checkbox "Published while none of the authors and editors were employed at UGent" checked.

That facet is currently based on the field extern, also known as Published while none of the authors and editors were employed at UGent. So the meaning needs to be swapped, or just derived from the authors/editors (we cannot support both)

See https://github.com/ugent-library/biblio-backoffice/pull/964.


Make PPS/workers authorize as the person that created the pipeline

One question, other than that LGTM


Job counter does not reflect actual job status

A user (Philippe Chlenski) reports the following:
"When I look at the jobs page, the top right bar displays something like the
following:
1 queued; 0 running; 149 completed; 0 failed.
In reality, I have 5 failed jobs. These display if I click on '0 failed'."
I have seen this as well, and it has been reported by other users.

#2235 duplicate.


Move "docker-for-windows" and "docker-for-mac" inside the "desktop" directory

This brings all desktop-related content into a single directory;

/docker-for-windows/ -> /desktop/windows/
/docker-for-mac/ -> /desktop/mac/

This makes the URLs more consistent/predictable, and easier to navigate.

This will likely conflict with https://github.com/docker/docker.github.io/pull/13352 and https://github.com/docker/docker.github.io/pull/13351, but I can rebase after those are merged
@usha-mandya @StefanScherer ptal (probably best to keep this one for after the weekend in case fix-ups are needed)

Overall a good idea. But I remember we had problems with redirects with anchors.
When we do this we should also adjust links from DD to the docs accordingly as we did eg. in https://github.com/docker/pinata/pull/16021
Currently I can find these links with anchors that are used in DD:

https://docs.docker.com/docker-for-mac/#file-sharing
https://docs.docker.com/docker-for-mac/troubleshoot/#incompatible-cpu-detected
https://docs.docker.com/docker-for-windows/#file-sharing
https://docs.docker.com/docker-for-windows/troubleshoot/#virtualization
https://docs.docker.com/docker-for-windows/wsl/#develop-with-docker-and-wsl-2

Yes, I already opened a PR to update the links; https://github.com/docker/pinata/pull/16249, but ideally we should change all links in DD itself to use https://docs.docker.com/go/... "permalinks" / redirects (https://github.com/docker/docker.github.io/pull/11460), that way we can update them to different locations (and anchors) in the documentation without changing the links in Desktop.

Thanks that you already thought about the changes in pinata, the PR looks good!
Regarding the /go/ permalinks/redirects, this wouldn't resolve the missing anchors, right?
For this PR I think it's the best what we can do for older DD versions (anchors not working), but with 4.0.0 we have it corrected again. So I'm fine with merging this PR anytime before 4.0.0.

Regarding the /go/ permalinks/redirects, this wouldn't resolve the missing anchors, right?

The redirect_to actually works with anchors (e.g. /go/foobar/ can redirect to /some/page/#some-anchor), which is nice

Thank you @thaJeztah. LGTM

@thaJeztah Are we good to merge this, or should we wait until the Pinata PR is ready to go live?

@thaJeztah Are we good to merge this, or should we wait until the Pinata PR is ready to go live?

Yup! Checked internally, and all links from Docker Desktop open in a browser, so should redirect as usual


CPAN tester run older versions of dependencies

Test do fail at some smoke testing environments. This is due to a outdated version of Test::MockObject. Our mocked Test::Mock::Redis::NoOp Redis client uses a feature to mock several methods with one single mock call.
We can approach this two ways:

set the dependency minimal version
change the code to do multiple calls

My personal preference is changing the code to allow it to run on platforms with older dependencies, unless there are buck in one of those (like we had with some releases of OpenTracing)

fixed with v0.1.0


Support deep linking to crates in rust demo

Getting the crate into the URL was the easy part thanks to use-query-params, but this introduced a race condition as we would attempt to load the crate before the worker was ready.  I updated the worker to fire a ready event so that we only send the load request after the worker was ready.

This is great! 💯 Can we easily associate queries with particular crates as well, so that when the user selects an example query (or on initial load of /rustdoc), the correct crate is auto-selected as well?


Route specific middleware

I've managed to use the request-handler  combined with aura-router with a single router handler.
Am trying to implement route specific middleware, as opposed to the 'global' application middleware.
$routerContainer = new RouterContainer();
$map = $routerContainer->getMap();

// Works fine...
$map->get('index', '/', 'App\Http\Controllers\HomeController::index');

// Error: Invalid request handler: array
$map->get('index', '/', [
    new SampleRouteMiddleware(),
    'App\Http\Controllers\HomeController::index'
]);

$request = ServerRequestFactory::fromGlobals($_SERVER, $_GET, $_POST, $_COOKIE, $_FILES);

$requestContainer = new RequestHandlerContainer();

$dispatcher = new Dispatcher([
    new SampleAppMiddleware(),
    new AuraRouter($routerContainer),
    new RequestHandler($requestContainer),
]);

$response = $dispatcher->dispatch($request);

The array you're providing is not callable. A way to use an array of routes as a single callable is as the following:
$map->get('index', '/', new Dispatcher([
    new SampleRouteMiddleware(),
    'App\Http\Controllers\HomeController::index'
]));

As you can see, Dispatcher implements also RequestHandlerInterface so you can use it to group a list of callables in a single request handler instance.


removing empty line

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Removing empty line


请问不支持ng反向代理吗？

ng配置如下：
upstream zentao_xxx {
    server xxx.xxx.xxx.xxx:12345;
}

server
{
    listen 443 ssl;

    server_name zentao.xxxxx.com;

    ssl_certificate      /xxxxx/fullchain.pem;
    ssl_certificate_key  /xxxxx/privkey.pem;

    location / {
        proxy_pass http://zentao_xxx/;
    }
}

始终会报：
Bad Request
Your browser sent a request that this server could not understand.
Additionally, a 400 Bad Request error was encountered while trying to use an ErrorDocument to handle the request.

有点奇怪，其他upstream都没有问题，zentao这个试了好多配置都会说下面这样：
Bad Request
Your browser sent a request that this server could not understand.
Additionally, a 400 Bad Request error was encountered while trying to use an ErrorDocument to handle the request.

@jinlongchen 请确定nginx所在的服务可以访问到zentao容器.

容器内部时间默认时区为UTC，你试试调整一致。如果有其他问题，请重开issue。我先关了这个issue。


Remove WorkHistoryBreak#application_form_id

Context
Currently the application_work_history_break is linked to an application_form through the breakable polymorphic column
This commit removes the old link, through the application_form_id, the column will be dropped in a future PR.
We also need to touch the application_form and application_choices like the old relation did, to replicate the old behaviour
The backfill_application_work_history_breaks
data migration needs to be removed as well, no longer needed
Changes proposed in this pull request
Remove application_form_id link between application_work_history_breaks and application_form
Guidance to review
Create/edit a work history break on local or review
https://github.com/user-attachments/assets/54d79f80-9c30-413b-8f35-1a4de6246585
Things to check

[ ] If the code removes any existing feature flags, a data migration has also been added to delete the entry from the database
[ ] This code does not rely on migrations in the same Pull Request
[ ] If this code includes a migration adding or changing columns, it also backfills existing records for consistency
[ ] If this code adds a column to the DB, decide whether it needs to be in analytics yml file or analytics blocklist
[ ] API release notes have been updated if necessary
[ ] If it adds a significant user-facing change, is it documented in the CHANGELOG?
[ ] Required environment variables have been updated added to the Azure KeyVault
[x] Inform data insights team due to database changes
[x] Make sure all information from the Trello card is in here
[x] Rebased main
[x] Cleaned commit history
[x] Tested by running locally
[x] Add PR link to Trello card

 Edit work experiences - Change db structure to accommodate work experience edits


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-k8s-26-main" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1993

Questions ?
Please refer to the Backport tool documentation


LinkedIn callback results in a 404

i've setup my LinkedIn app (in their developer site) using the required callback (oauth 2.0) URL of: http://localhost/callback
however, when i execute the linkedin function in $cordovaOauth the inapp browser simply gives me a 404. I know it's an issue with the callback URL because when i go back to LinkedIn's developer site, and change the callback URL to another URL, i get the LinkedIn error saying the URL i configured doesn't match.
screenshot of my linkedin app:

yes i've confirmed the api key/secret combo are correct (in that when i change the callback URLs i get different results)
i've been testing this in the latest version of xcode using the simulator (iphone 6 using ios 9.2)
not sure if this is something i'm doing wrong, or if linkedin's changed anything or if there's just a bug in the library.

just wanted to provide the 404 error screenshot (from the simulator)

i'm closing this in that i simply used an options parameter to set my own redirect_uri:
var options = { redirect_uri : 'http://my.callback.host.co' };
and fed that in as the last parameter.


Adding survey link for 1% of visitors

This adds a little survey to the site based on MDN's. Only 1% of visitors will see it, and it will help us do better :)

Hi @rachelnabors, I was able to fix the build and deploy, but I'm not sure if survey will work correctly.
SMCX is available now on window, but maybe an additional call need to be added after my refactor.
Please test and let me know if survey loads now (if you have an ability to enforce survey display or debug it in any other way).

I put the percentage of participants for the form from 1% of traffic to 100% of traffic, and it showed up and linked out correctly. Great job on figuring out how to implement this correctly for Docusaurus!


Task dependancies running slowly

I am running a task with >100000 dependency tasks (each of which has one dependency). It appears that when the scheduler is informed about all these dependencies in the requires method, the dependencies are generated very slowly. The log line DEBUG: Asking scheduler for work sits there for ~2 minutes before a worker starts running the next dependency. However, when dependencies are dynamically called for in the run method, the script moves much faster. Any idea what might be causing this slowdown?
This runs fast:
class MyTask(luigi.Task):
    def requires(self):
        return
    def run(self):
        task_ids = # select tasks that need running from other source
        yield OtherTask(id=task_ids[0])

This runs slow:
class MyTask(luigi.Task):
    def requires(self):
        return list_of_100000_OtherTasks
    def run(self);
        pass

Luigi gets pretty slow with lots of tasks, that's a known issue. Would love it if you can debug a bit and figure out what part of the code is slow and why dynamic requirements are much faster!

Thanks! I'll take a look.

I can partially explain this. The time complexity for get_work is O(#pendingtasks). It you use dynamic requirements there will only be at most 1 pending task at any moment.

@Tarrasch That makes sense. Any way to improve the scheduler's scaling?

The easiest way is probably to just limit the number of tasks that you require. Maybe you can limit 1'000 tasks at a time and have the program conned to run every minute (it will not run simultaneously thanks to client-side lock). The luigi.tools.range kind of does something like this already. You have a task-limit and it can do the complete checks quite efficiently by using globs or a user-provided bulk complete method.

The number of tasks is provided by the data (each item in the data is processed as a task). Are you suggesting to block the tasks somehow?
But it seems like you're also saying that we won't get parallelization in which case we can stick to the yield method.

I'm suggesting something like:
def requires(self):
    yield take_first(100, [dependency for dependencies if not dependency.complete()])

And in many realistic cases you can use the existing Range module. This parallelizes very good actually. If you have 10 luigi-client machines with 15  --workers each, you'll get 150 simultaneously running tasks. Spotify used this strategy for backfilling data.

But it seems like you're also saying that we won't get parallelization in which case we can stick to the yield method.

Actually it's the other way around.  Yielding 1 task at a time will. You can yield 100 tasks at a time though.

That's very helpful, thanks!

I'm closing this. Many viable workarounds are presented so. Please let us know how it worked out for you @twiecki @a-campbell

Confirmed form @a-campbell that it's working well. Thanks again.


assign_boxes (ypred, ytrue )

Just wanted to check if I am missing anything!
Assign boxes seems to add 2 to num classes for gt while m2det seems to add only 1
https://github.com/tadax/m2det/blob/ed2181e1897a58812755eee2f1da774fa6296121/utils/assign_boxes.py#L31
https://github.com/tadax/m2det/blob/ed2181e1897a58812755eee2f1da774fa6296121/m2det.py#L7

Never mind its being used to update box loss
https://github.com/tadax/m2det/blob/ed2181e1897a58812755eee2f1da774fa6296121/utils/loss.py#L66


FAILURE: Build completed with 2 failures. after installation of module

Your Environment

Plugin version: 0.6.3
Platform: iOS or Android
OS version: 10
Device manufacturer and model: Samsung

Running in Simulator:
React Native version: 0.66.3
Plugin configuration options:
Link to your project:

Context

I want to install the module but I have 2 error when I run android after installation.
Expected Behavior

Actual Behavior

Possible Fix

Steps to Reproduce

 yarn add @mauron85/react-native-background-geolocation
node<EMAIL_ADDRESS>add googlePlayServicesVersion = "17.6.0" in ext of android/build.gradle
npm run android

Context

I tryed the manual setup but there are some errors similar to this.
Debug logs

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script<EMAIL_ADDRESS>line: 27

* What went wrong:
A problem occurred evaluating project ':@mauron85_react-native-background-geolocation-common'.
> Could not get unknown property 'android' for project ':app' of type org.gradle.api.Project.

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
A problem occurred configuring project ':@mauron85_react-native-background-geolocation-common'.
> com.android.builder.errors.EvalIssueException: compileSdkVersion is not specified. Please add it to build.gradle

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

BUILD FAILED in 10s

Same issue

https://github.com/mauron85/react-native-background-geolocation/issues/500#issuecomment-663829795

add this to your android/settings.gradle
include ':@mauron85_react-native-background-geolocation-common'
project(':@mauron85_react-native-background-geolocation-common').projectDir = new File(rootProject.projectDir, '../node_modules/@mauron85/react-native-background-geolocation/android/common')
include ':@mauron85_react-native-background-geolocation'
project(':@mauron85_react-native-background-geolocation').projectDir = new File(rootProject.projectDir, '../node_modules/@mauron85/react-native-background-geolocation/android/lib')


Bug: Mass crashes or leaving the session lead to faulty replays

As mentioned in another issue, we had a mass crash, which caused some drivers to leave the race immediately.
As a result, we had a mess of replays in the app. Unfortunately, we don't know whether it was due to the mass crash (too many contacts in a very short time) or the driver leaving the session.

Sorry for the bad description
When we clicked on a vehicle number, the wrong scenes sometimes came up or scenes ended too early, which is why we had no contact or only until shortly before the contact

When there are a lot of crashes happening at the same time it is very difficult to process the game data correctly.
This will cause the replay button to show the wrong cars in that moment. There really isnt anything i can do about this until the game outputs better data.


Blurred text and icons on Windows

Why are text and icons so blurred on Windows 10?

Do you have a high DPI screen ?
Davo

OK, so this is seriously embarrassing ! I can fix that "blurred" with a very simple compiler switch.  Sorry, this just shows how bad my Windows knowledge is !

But that lovely sharp text and images just highlights another issue, everything (in tomboy-ng) in Windows is too large.  The little speed buttons are twice the size they should be, you can see how the bitmap images just fill the center section of each button.
Now I really have to fix that !
Thanks (seriously, thanks) for highlighting an issue I have been ignoring ....
Davo

No, while my fix for the Blurring is OK, I cannot adjust the sizing.
I will make a 0.32b release shortly that cleans up all that Windows Blurring ....
(Sorry WFreude, some notes for myself).
On my laptop, in Windows at 150% scaling, things look too big. But any attempt to adjust that makes either the Desktop 100% scaling all wrong or my beloved's Windows Laptop at 250% scaling all crowded into a thumbnail.
If I am going to do anything about scaling, its going to have to involve a couple of setting that the the end user selects to suit themselves. Right now, Lazarus's automatic scaling is a reasonable (but not good) compromise. Hmm....
Davo

OK, this issue is fixed in version 0.32b, will close.
Thanks for the report.
Davo


MediaPipe instance creation is taking too much time on some Android devices.

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)
No
OS Platform and Distribution
Android
Mobile device if the issue happens on mobile device
Infinix Hot 9 Play
Browser and version if the issue happens on browser
No response
Programming Language and version
Java
MediaPipe version
Latest (0.9.1)
Bazel version
No response
Solution
FaceMesh
Android Studio, NDK, SDK versions (if issue is related to building in Android environment)
No response
Xcode & Tulsi version (if issue is related to building for iOS)
No response
Describe the actual behavior
To use MediaPipe in Android app, I am using these dependencies:
    implementation 'com.google.mediapipe:solution-core:latest.release'
    implementation 'com.google.mediapipe:facemesh:latest.release'

To get MediPipe Instance for Face Mesh:
                     new FaceMesh(
                        context,
                        FaceMeshOptions.builder()
                                .setStaticImageMode(true)
                                .setRefineLandmarks(true)
                                .setMinDetectionConfidence(0.8f)
                                .setRunOnGpu(true)
                                .build());

On average, it is taking 2 to 3 seconds to return instance of MediaPipe.
But on some other devices (e.g: Infinix Hot 9 play (Android version:10)) It is taking about 1 minute to return the instance.
Even to demo app for the face mesh (provided on this link: https://github.com/google/mediapipe/tree/master/mediapipe/examples/android/solutions) is also taking about 1 minute to create the instance.

Describe the expected behaviour
It should provide instance for face mesh within (max) 2 to 3 seconds on each device.

Standalone code/steps you may have used to try to get what you need
new FaceMesh(
                        context,
                        FaceMeshOptions.builder()
                                .setStaticImageMode(true)
                                .setRefineLandmarks(true)
                                .setMinDetectionConfidence(0.8f)
                                .setRunOnGpu(true)
                                .build());

Other info / Complete Logs
No response

@FaizanAhmadPF,
Would you please let us know the complete details and exact steps followed to reproduce the issue from our end? Thank you!

As I attached your Demo app link, please have a look on that, that app is taking too much time on some devices to open camera.
new FaceMesh(
context,
FaceMeshOptions.builder()
.setStaticImageMode(true)
.setRefineLandmarks(true)
.setMinDetectionConfidence(0.8f)
.setRunOnGpu(true)
.build());
This step is taking time too much on some devices & 2 to 3 seconds average on each device.

@FaizanAhmadPF,
This behaviour is expected. MediaPipe model takes significant times several 8-10 seconds to load up and start up the camera. Scenario depends on the device to device if more powerful the device is the time to pop up the camera will be minimal. (Refer: #3384) Thank you!

Okay, can you please tell me that what is difference bwteen runOnGPU and runOnCPU (setRunOnGpu(true/false))?

@FaizanAhmadPF,
This parameter setRunOnGpu(true/false) defines that solution will run/inference on the GPU/CPU. You can check out the code here.

I know it will decide whether to run on GPU or CPU, but what will be effected, what will be changes occue in both cases on android devices? (e.g: speed, accuracy, smoothness etc etc.)

@FaizanAhmadPF,
Please raise a new issue with another query raised and Feel free to close if actual issue has been resolved. Thank you!


Bottom navigation like NowInAndroid(Google example app)

Hi, i'm investigating this library for bottom navigation use and looked into #307 .
I want to make bottom navigation like Google's example app_Now in Android.

I'm not sure Spotlight is similar to above example app.
For NowInAndroid, there are 3 tabs-bottom navigation and when bottom navigation item is selected, code below is executed.

navController.navigate("some-route") {
    // Pop up to the start destination of the graph to
    // avoid building up a large stack of destinations
    // on the back stack as users select items
    popUpTo(
        navController.graph.findStartDestination().id
    ) {
        saveState = true
    }
    // Avoid multiple copies of the same destination when
    // reselecting the same item
    launchSingleTop = true
    // Restore state when reselecting a previously selected item
    restoreState = true
}

I know that document said

"Implements a mechanism analogous to a view pager; has a single active element ("it's in the spotlight", hence the name), but unlike the back stack, it does not remove other elements.".

I'm afraid that it would take up a lot of memory when each tab's screen has many contents with Spotlight.
Also, I wonder that Spotlight would consider all lifecycle-things properly such as kotlin flow, coroutines in each screen's ViewModel(per tab). Would it pause and collect the flow properly?

Plus, Spotlight.previous() or next() is not desired usually for bottom navigation, I think.

Am I right in thinking? Should I make my own navModel class with BackStack?
I saw this project(which you mentioned in doc) also made bottom navigation with BackStack.(This project was different in back button handling with Now In Android)
Because I don't have much experience in Android dev, I apologize in advance.

Hey @jeddchoi, thanks for the issue!

A Spotlight instance can be used for displaying different tabs, yes.
As for memory, the related views are removed from the composition when off-screen. If you have additional objects living in the associated Node instance, they are kept alive for your convenience. This should be alright for most cases, however if you have heavy objects and wish, then yes, you could go for a BackStack. In this case you could use the replace operation to kill all nodes but the currently active one.
You could use the activate operation instead: https://bumble-tech.github.io/appyx/navmodel/spotlight/#activate

Thank you for kind explanation! I will check it out.


References

Here are some references for us.
Original context of the e-mail.
Hi,
In case you missed it, Daisie Huang wrote a very insightful article
about the differences between scientific coding and software engineering
for the Software Sustainability Institute's blog at
http://www.software.ac.uk/blog/2015-02-06-scientific-coding-and-software-engineering-whats-difference.
I think short pieces like this that we can link to when we're talking to
colleagues (and writing proposals) are really useful, so I would be
grateful if a few of our newer instructors would like to volunteer to
summarize three recent discussions we've been having about:

where scientists should store their data:
https://github.com/swcarpentry/site/issues/797

Guide to submitting a 10 simple rules
http://journals.plos.org/ploscollections/article?id=10.1371/journal.pcbi.1003858

Related but distinct: Ten Simple Rules for the Care and Feeding of Scientific Data

Also in the astronomy theme, Reimplementing the Hierarchical Data System using HDF5 has some interesting comments on using different formats for processing, strage, and transport. I can translate jargon if necessary..

Hi everyone! This paper from our group may be of interest here: http://arxiv.org/abs/1502.06900

New from PLOS one that might have some relevance (I have only looked at abstract):
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0118053

Blog post from NatureJobs on how to publish a data paper: http://blogs.nature.com/naturejobs/2014/12/04/how-to-publish-your-data-in-a-data-journal

Nice webpage from USGS that covers some of the same topics http://www.usgs.gov/datamanagement/plan/dataformats.php

Closing because paper is now in productios.


#multipart: added multipart body funcionality to Sylph API Driver

Please update the version in setup.py to 0.8.2 as discussed


Add BodyKeySanitizers

Let's add an issue to track some test coverage for this.

Created https://github.com/Azure/azure-sdk-for-net/issues/27834


add TravisBuddy.com

Sounds pretty neat
https://www.travisbuddy.com/

Yep, But I don't see the actual need in one.
Because you can see if it fails anyway.


Support clear system context menus,then customize the menu,thanks.

Yes, I will add it

New version 3.3.0 released! To hide the default system context menu items, you can set to true the hideDefaultSystemContextMenuItems option using the ContextMenu.option attribute.


Are Retry and Delay strategies possible ?

Retry in case of failure, and Delay to wait before putting a message to a queue, are possible strategies with Swarrot / Rabbitmq.
I'm considering a Messenger / PubSub migration.
Are those features also available ?
Is there something particular or a difference to take into consideration ?

PubSub subscription has retry policy built-in. See https://cloud.google.com/pubsub/docs/subscription-properties#retry_policies


Add discussions implementation

Implementation of discussions methods

Thank you very much for this PR @steperdin! Unfortunately it was created about 4 days too late 😞 4 days before you created this PR, another PR was opened for adding the exact same endpoints: #481
So I worked with the contributor to get that PR up to spec and merged it earlier today. I'm very sorry that these PR's were created so close together causing one of them not to be merged.
Still very much appreciate that you took the efforts to create the PR! But as its now no longer applicable, I'm going to close it. Sorry!


cAdvisor queries missing containers over and over

Looking at /var/log/syslog I see that kontena appears to query for lots of containers on a given node that don't exist..
$ grep "No such container" /var/log/syslog | wc -l
5352

Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.442105724-05:00" level=error msg="Handler for GET /containers/fa1b34574dafe559c51ff6e3e671b84e3bbb376239459baf107b689e0c6bf5ff/json returned error: No such container: fa1b34574dafe559c51ff6e3e671b84e3bbb376239459baf107b689e0c6bf5ff"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.442652229-05:00" level=error msg="Handler for GET /containers/2681561988a1c3c969186a716d577c54aa878e86e5456bc838e5750cfbfe48ed/json returned error: No such container:<PHONE_NUMBER>a1c3c969186a716d577c54aa878e86e5456bc838e5750cfbfe48ed"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.443318034-05:00" level=error msg="Handler for GET /containers/59bd9ac2c0dd3a84b23b432f39a67cf7292a08901217e213d8966bee9c5f6658/json returned error: No such container: 59bd9ac2c0dd3a84b23b432f39a67cf7292a08901217e213d8966bee9c5f6658"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.443906785-05:00" level=error msg="Handler for GET /containers/526397d73bad5757d3bac410928be5b29aca9445335d2e0041f8e0f9260ec984/json returned error: No such container: 526397d73bad5757d3bac410928be5b29aca9445335d2e0041f8e0f9260ec984"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.444309715-05:00" level=error msg="Handler for GET /containers/e30281e00c1c6c8042b97857c1a3bbd7bac160ae154bdf06af9efb515bbbd14a/json returned error: No such container: e30281e00c1c6c8042b97857c1a3bbd7bac160ae154bdf06af9efb515bbbd14a"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.444965583-05:00" level=error msg="Handler for GET /containers/5948f01fc12c7b4169ed6a164953bb4f27d3cf6e651dd792c2994512bf5c6130/json returned error: No such container: 5948f01fc12c7b4169ed6a164953bb4f27d3cf6e651dd792c2994512bf5c6130"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.445661768-05:00" level=error msg="Handler for GET /containers/94fb2e4e818de7155033760c28c59ec4a2143de92c885dd73d4c3d7a766a485f/json returned error: No such container: 94fb2e4e818de7155033760c28c59ec4a2143de92c885dd73d4c3d7a766a485f"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.446246579-05:00" level=error msg="Handler for GET /containers/abaee58ffe23f96703a9bab1d5c87ea961c6206abc5bb2d9d09479f4293a758f/json returned error: No such container: abaee58ffe23f96703a9bab1d5c87ea961c6206abc5bb2d9d09479f4293a758f"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.446844069-05:00" level=error msg="Handler for GET /containers/c0e30249844ddfb3c249f8a998d7b9f36144b6b81ed860061c8d57bb4edb02d7/json returned error: No such container: c0e30249844ddfb3c249f8a998d7b9f36144b6b81ed860061c8d57bb4edb02d7"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.447698456-05:00" level=error msg="Handler for GET /containers/30b661db129d2cbc889392ec8a5b6bc1c1d68c7805a8f4139941048acb94ec17/json returned error: No such container: 30b661db129d2cbc889392ec8a5b6bc1c1d68c7805a8f4139941048acb94ec17"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.448471852-05:00" level=error msg="Handler for GET /containers/d66c6eb5cace4ac660a6db7482f6999cc5a08007c3996cae0632f06b5f846c96/json returned error: No such container: d66c6eb5cace4ac660a6db7482f6999cc5a08007c3996cae0632f06b5f846c96"
Aug 16 06:25:07 admin1 dockerd[27499]: time="2017-08-16T06:25:07.448909607-05:00" level=error msg="Handler for GET /containers/51921edef6a3ebeaa7e57be4106dbf67dee5751017a58bba366845e2bbddee5f/json returned error: No such container: 51921edef6a3ebeaa7e57be4106dbf67dee5751017a58bba366845e2bbddee5f"

I finally started just dropping these via syslog config but it seems like this could indicate a good opportunity for improving Kontena's resource efficiency.. My kontena server burns 50% CPU pretty much constantly even if I haven't updated a single image or service for months.

I recall running into these while debugging the cadvisor issues (https://github.com/google/cadvisor/issues/1572), and my guess is that these spurious container gets are actually from cadvisor: https://github.com/google/cadvisor/issues/1443 https://github.com/kubernetes/kubernetes/issues/38979#issuecomment-268340625

The docker handler in cadvisor notices that there are at least 64 alphanumeric characters in a row, so technically maybe there's a docker id in there (spoiler there's not).
cAdvisor inspects the ID it captured to see if docker agrees it's a container
docker doesn't recognize it and logs an error

We should probably try the newer cadvisor releases, v0.25.0 contains a fix for the .mount cgroups, and that might also help with this.

Should be fixed in 1.4.2 by #3115
Re-open if not.


Consider Korlibs for multiplatform

Hello again!
I saw you made some progress using Okio to support multiplatform use cases but got poor performance results.
Consider Korlibs set of libraries for developing multiplatform features. They have pretty big amount of elementary functionality chunked by small multiplatform libraries. For example bytes, arrays, buffers utilities gathered in Kmem   library. They have some gaps in documentation but really broad number of utilities. Their main page with all libs described is here .
I don't know about pros and cons of specific features performance comparing to other multiplatform libs like Okio, but I think it can be a helpful for your work at least to know about it.
Thanks.

Hello @yaroslavkulinich.
Thank for sharing this, it looks pretty good. I did not know about this. Kmem should fit the requirement well. Okio is pretty good and I am still using for the byte stream reading and writing. But mavlink-kotlin requires a lot of encoding from and decoding to ByteArray where I feel Okio is not optimised.
For the time being, I abstracted the encoding and decoding with MavDataDecoder and  MavDataEncoder. I was planning to use the expect-actual kotlin feature to implement if for multiplatform in the future.
For the time being I am working on this branch to restructure the library to support more connections than just TCP. I'm planning to get this thing done first for the JVM and release the v1 of the library.
In a few weeks/months I'll be starting the work on multiplatform.

It is an excellent plan.
My other 5 cents - please make the data class MavRawFrame not internal but public, because it blocks developers from creating their own implementations of low-level connection logic. For example, I have implemented my own TCP and UDP connections based on different stacks (Java sockets and Ktor sockets) with custom filtering logic to prevent redundant deserialization of packets that my system never uses (to decrease processing load). But I'm forced to use an old version of the library to keep it working because MavRawFrame is public there and internal in a newer versions.

Okay great, I will make the MavRawFrame and MavRawFrameReader public when I create a PR. I'll also try to add documentation for that.
If you want, you can track the related changes in the branch and let me know if there's anything else to be changed. I'll try to finish the PR either by this weekend or the next one.

Great!
Thank you again for the library.

Thanks for the support and ideas.

@yaroslavkulinich please refer #34. I have tested most things and will try to create a release today.

@yaroslavkulinich please refer #34. I have tested most things and will try to create a release today.

Thank you!


arch/armv7-a/r: unify switch context from software interrupt

Summary
arch/arm: unify switch context from software interrupt
arch/armv7-r: unify switch context from software interrupt
arch/armv7-a: unify switch context from software interrupt
Impact
N/A
Testing
complete the ostest on armv7-a platform(UP and SMP)
CONFIG_SMP=y
CONFIG_SMP_NCPUS=2
ci check

@anchao
Let me confirm the intention of this PR.
I know that Cortex-M uses a software interrupt-based context switch.
So, are you going to apply the same approach to arm/armv7-a/r as well?

====================================================================================
Configuration/Tool: sama5d2-xult/nsh,CONFIG_ARMV7M_TOOLCHAIN_GNU_EABIL
------------------------------------------------------------------------------------
  Cleaning...
  Configuring...
  Disabling CONFIG_ARMV7A_TOOLCHAIN_GNU_EABIL
  Enabling CONFIG_ARMV7M_TOOLCHAIN_GNU_EABIL
  Building NuttX...
make[1]: *** No rule to make target 'arm_savefpu.S', needed by '.depend'.
make[1]: *** No rule to make target 'arm_copyarmstate.c', needed by '.depend'.
make[1]: Target 'depend' not remade because of errors.
make: *** [tools/Unix.mk:584: pass2dep] Error 2
make: Target 'all' not remade because of errors.
/github/workspace/sources/nuttx/tools/testbuild.sh: line 252: /github/workspace/sources/nuttx/../nuttx/nuttx.manifest: No such file or directory
  Normalize sama5d2-xult/nsh

@anchao Let me confirm the intention of this PR. I know that Cortex-M uses a software interrupt-based context switch. So, are you going to apply the same approach to arm/armv7-a/r as well?

Yes, This PR unify the context switch strategy same as Cortex-M, we plan to optimize the context switch and interrupt handing performance in next stage.

@anchao
I tried this PR with sabre-6quad:netnsh_smp (QEMU) and sabre-6quad:smp (Dev board) and confirmed both works.
However, sabre-6quad:netknsh (QEMU) which is not merged and under testing for ADDRENV=y does not work.
[    4.020000] exec_module: Executing /mnt/nfs/bin/init
[    4.020000] up_addrenv_select: addrenv=0x10863ee4 oldenv=0x10868ac8
[    4.020000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.020000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.030000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)
[    4.030000] exec_module: initialize the user heap (heapsize=1048576)
[    4.030000] up_addrenv_kstackalloc: tcb=0x10866820 stacksize=3072
[    4.030000] up_addrenv_clone: src=0x10863ee4 dest=0x10863f58
[    4.030000] up_addrenv_restore: oldenv=0x10868ac8
[    4.040000] up_addrenv_select: addrenv=0x10863f58 oldenv=0
[    4.040000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.040000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.040000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)
[    4.050000] arm_prefetchabort: Prefetch abort. PC: 80202800 IFAR: 00000000 IFSR: 00000002
[    4.050000] up_assert: Assertion failed at file:armv7-a/arm_prefetchabort.c line: 134 task: /mnt/nfs/bin/init
[    4.050000] arm_registerdump: R0: 00000019 R1: deadbeef R2: 00000000  R3: 802027cc
[    4.050000] arm_registerdump: R4: 00000018 R5: 80202018 R6: 00000001  R7: deadbeef
[    4.050000] arm_registerdump: R8: deadbeef SB: 802027e4 SL: 10818140  FP: 80202018
[    4.050000] arm_registerdump: IP: 00000001 SP: 80001a34 LR: 00000003  PC: 80202800

I tried this PR with sabre-6quad:netnsh_smp (QEMU) and sabre-6quad:smp (Dev board) and confirmed both works.
However, sabre-6quad:netknsh (QEMU) which is not merged and under testing for ADDRENV=y does not work.

@masayuki2009 san,
Thanks a lot for your verification! could you please upstream the defconfig ? I think this PR broken the kernel mode

Thanks a lot for your verification! could you please upstream the defconfig ? I think this PR broken the kernel mode

@anchao
I need more refactoring a lot.
For the moment, you can refer to my branches
https://github.com/masayuki2009/incubator-nuttx/tree/imx6-netknsh
https://github.com/masayuki2009/incubator-nuttx-apps/tree/imx6-netknsh

@anchao I need more refactoring a lot. For the moment, you can refer to my branches
https://github.com/masayuki2009/incubator-nuttx/tree/imx6-netknsh https://github.com/masayuki2009/incubator-nuttx-apps/tree/imx6-netknsh

@masayuki2009 ,
Could you please share the command line of QEMU? I am not sure which machine for sama5d4-ek board

I think this PR broken the kernel mode

@anchao
Hmm, the latest patch causes assertion.
[    4.330000] load_absmodule: Successfully loaded module /mnt/nfs/bin/init
[    4.330000] binfmt_dumpmodule: Module:
[    4.330000] binfmt_dumpmodule:   entrypt:   0x80001a34
[    4.330000] binfmt_dumpmodule:   mapped:    0 size=0
[    4.330000] binfmt_dumpmodule:   alloc:     0 0 0
[    4.330000] binfmt_dumpmodule:   addrenv:   0x18000000
[    4.330000] binfmt_dumpmodule:   stacksize: 2048
[    4.330000] binfmt_dumpmodule:   unload:    0
[    4.330000] exec_module: Executing /mnt/nfs/bin/init
[    4.340000] up_addrenv_select: addrenv=0x10863f04 oldenv=0x10868ac8
[    4.340000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.340000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.340000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)
[    4.340000] exec_module: initialize the user heap (heapsize=1048576)
[    4.340000] up_addrenv_kstackalloc: tcb=0x10866820 stacksize=3072
[    4.340000] up_addrenv_clone: src=0x10863f04 dest=0x10863f78
[    4.340000] up_addrenv_restore: oldenv=0x10868ac8
[    4.350000] up_addrenv_select: addrenv=0x10863f78 oldenv=0
[    4.350000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.350000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.350000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)
[    4.360000] up_assert: Assertion failed at file:armv7-a/arm_syscall.c line: 242 task: /mnt/nfs/bin/init
[    4.360000] arm_registerdump: R0: 00000001 R1: 00000000 R2: 00000000  R3: 00000000
[    4.360000] arm_registerdump: R4: 108675b8 R5: 00000000 R6: 00000000  R7: 00000000
[    4.360000] arm_registerdump: R8: 00000000 SB: 00000000 SL: 00000000  FP: 1086755c
[    4.360000] arm_registerdump: IP: 00000001 SP: 10867548 LR: 1081783c  PC: 10819d58
[    4.360000] arm_registerdump: CPSR: 600000d3

Could you please share the command line of QEMU? I am not sure which machine for sama5d4-ek board

@anchao
You need to use sabre-6quad:netknsh instead of sama5d4-ek.
$ ~/opensource/QEMU/qemu-5.2/build/arm-softmmu/qemu-system-arm -M sabrelite -m 1024 -smp 4 -kernel ./nuttx -nographic

Also, please note that you need to set up an NFS server where applications such as init are stored.

@anchao please resolve merge conflicts

Let me do more tests in kernel mode, mark this PR as draft first

@anchao
Please add -m 1024 option.

@anchao
Please add -m 1024 option.

Thanks, it works fine with -m 1024，I will investigate further based on this PR!

[    2.170000] up_assert: Assertion failed at file:armv7-a/arm_addrenv.c line: 181 task: nfsroot

@masayuki2009 san,
I have fix this issue caused by SYS_syscall_return mismatch with new syscall definition:
https://github.com/apache/incubator-nuttx/pull/5506/commits/765e5bc52fdf135dc0b0456c58d094a839519178
please review, thank you!

@masayuki2009 san,
I have fix this issue caused by SYS_syscall_return mismatch with new syscall definition:
https://github.com/apache/incubator-nuttx/commit/765e5bc52fdf135dc0b0456c58d094a839519178
please review, thank you!

@anchao
Could you create a separate PR for the above commit?

@anchao Could you create a separate PR for the above commit?

@masayuki2009 ,
Ok, new PR for SYS_syscall_return mismatch issue:
https://github.com/apache/incubator-nuttx/pull/5582

@masayuki2009 could you try this patch with the latest mainline?

@anchao
I tried this PR with my branch (imx6-netknsh) but the nsh prompt did not appear.
How about your situation?
[    4.140000] load_absmodule: Successfully loaded module /mnt/nfs/bin/init
[    4.140000] binfmt_dumpmodule: Module:
[    4.140000] binfmt_dumpmodule:   entrypt:   0x80001a34
[    4.140000] binfmt_dumpmodule:   mapped:    0 size=0
[    4.140000] binfmt_dumpmodule:   alloc:     0 0 0
[    4.140000] binfmt_dumpmodule:   addrenv:   0x18000000
[    4.140000] binfmt_dumpmodule:   stacksize: 2048
[    4.140000] binfmt_dumpmodule:   unload:    0
[    4.140000] exec_module: Executing /mnt/nfs/bin/init
[    4.140000] up_addrenv_select: addrenv=0x10863fc4 oldenv=0x10868ac8
[    4.140000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.140000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.150000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)
[    4.150000] exec_module: Initialize the user heap (heapsize=1048576)
[    4.150000] up_addrenv_kstackalloc: tcb=0x10864960 stacksize=3072
[    4.150000] up_addrenv_clone: src=0x10863fc4 dest=0x10864b38
[    4.150000] up_addrenv_restore: oldenv=0x10868ac8
[    4.160000] up_addrenv_select: addrenv=0x10864b38 oldenv=0
[    4.160000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.160000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.160000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)

I tried this PR with my branch (imx6-netknsh) but the nsh prompt did not appear. How about your situation?

@masayuki2009 san,
please rebase your branch since this PR based on syscall mismatch fix:
https://github.com/apache/incubator-nuttx/pull/5582
git log:
incubator-nuttx$ git log --oneline -7
ca1cda8fec (HEAD) boards/sama5: update the reserved syscall count
4ea1121d87 arch/arm: unify switch context from software interrupt
4481e7ec88 arch/armv7-r: unify switch context from software interrupt
fc68f677c8 arch/armv7-a: unify switch context from software interrupt
3d5b40e2c9 arch/armv7-a: replace SYS_signal_handler_return hardcode
1415c79ae8 arch/arm: replace SYS_syscall_return hardcode from syscall
0b0cab62cf [DO NOT MERGE] sched: group: Defer to call up_addrenv_destroy() for pthread

startup log:
incubator-nuttx$ qemu-system-arm -net nic -net user,hostfwd=tcp:<IP_ADDRESS>:10023-<IP_ADDRESS>:23,hostfwd=tcp:<IP_ADDRESS>:10021-<IP_ADDRESS>:21,hostfwd=tcp:<IP_ADDRESS>:15001-<IP_ADDRESS>:5001 -M sabrelite -smp 4 -kernel ./nuttx -nographic -m 1024

ABDGHIJKNOPQ
[    0.000000] elf_initialize: Registering ELF
....
[    4.510000] load_absmodule: Successfully loaded module /mnt/nfs/bin/init
[    4.510000] binfmt_dumpmodule: Module:
[    4.510000] binfmt_dumpmodule:   entrypt:   0x80001a2c
[    4.510000] binfmt_dumpmodule:   mapped:    0 size=0
[    4.510000] binfmt_dumpmodule:   alloc:     0 0 0
[    4.510000] binfmt_dumpmodule:   addrenv:   0x18000000
[    4.510000] binfmt_dumpmodule:   stacksize: 2048
[    4.510000] binfmt_dumpmodule:   unload:    0
[    4.510000] exec_module: Executing /mnt/nfs/bin/init
[    4.510000] up_addrenv_select: addrenv=0x10864d44 oldenv=0x10868ac8
[    4.510000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.510000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.510000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)
[    4.520000] exec_module: Initialize the user heap (heapsize=1048576)
[    4.520000] up_addrenv_kstackalloc: tcb=0x10864d70 stacksize=3072
[    4.520000] up_addrenv_clone: src=0x10864d44 dest=0x10864f48
[    4.520000] up_addrenv_restore: oldenv=0x10868ac8
[    4.520000] up_addrenv_select: addrenv=0x10864f48 oldenv=0
[    4.520000] up_addrenv_select: text: set l1 entry (paddr=18000000 vaddr=80000000)
[    4.520000] up_addrenv_select: data: set l1 entry (paddr=18028000 vaddr=80100000)
[    4.520000] up_addrenv_select: heap: set l1 entry (paddr=1802a000 vaddr=80200000)

NuttShell (NSH) NuttX-10.2.0
nsh>

please rebase your branch since this PR based on syscall mismatch fix:

I thought I rebased the branch to the latest master.
Perhaps, something was wrong with my branch.
Now the PR works with my branch, thanks.


Polls does not redirect user back to index page on bad URL

The application does not redirect the user back to the index page on an invalid question such as http://<IP_ADDRESS>:8000/polls/99/
same with the results page

FIXED The application does not redirect the user back to the index page on an invalid question such as http://<IP_ADDRESS>:8000/polls/99/
same with the results page


Any resume mechanism in FluentFTP?

Hi, I want to know is there any resume mechanism in uploading/downloading progress?
Thanks!

No, there is no way to pause or resume at the moment.
You can cancel using the cancellation token but that's it.
On Fri, 15 Jun 2018, 9:14 am Kamil<EMAIL_ADDRESS>wrote:

Hi, I want to know is there any resume mechanism in uploading/downloading
progress?
Thanks!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/robinrodricks/FluentFTP/issues/307, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AGe6KnwhR5IGjgRUehK9xv6rNcyytMzIks5t8y2wgaJpZM4Uo-aa
.

Some functions take a resumeLocation parameter, maybe try those. (DownloadFile and UploadFile, I think)

@robinrodricks Will the resume functionality be included? This is standard functionality for any FTP server and would bring real value to FluentFtp.

@alhami Yes we now support resume for downloads and uploads. See the FAQ for more info.


Incorrect Instructions

Step 2 of "Create the device registration software" is incorrect. The folder "Provision_Samples" is missing.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1eee2ad9-8af7-8781-cbaa-c0d7987a4528
Version Independent ID: 81c16b29-772f-e407-3798-10b735a587db
Content: Set up device for the Azure IoT Hub Device Provisioning Service
Content Source: articles/iot-dps/tutorial-set-up-device.md
Service: iot-dps
GitHub Login: @wesmc7777
Microsoft Alias: wesmc

@unstephenk Thanks for the feedback! We are currently investigating and will update you shortly.

@unstephenk Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

@wesmc7777 Could you please check this and provide an update?

#reassign JimacoMS3

Hi @unstephenk,
Did you follow the instructions in Build a platform-specific version of the SDK -- specifically, did you use the -Duse_prov_client:BOOL=ON flag? If not, you will not see the Provision_Samples folder in your solution. You must use this flag. If you do, you should see the folder in your solution:

@unstephenk Have you had a chance to see the above suggestions? Do let us know if that solves your issue.

Hi @unstephenk -- thanks again for your feedback! At this time, I'm going to close this issue. If the comments above don't help you, please feel free to @comment me, and we can take another look.
-Jimaco

#please-close


feat: support tls alert key for project monitors

Support tls alert key
heartbeat.monitors:
- type: http
  name: Todos Lightweight
  id: todos-lightweight
  enabled: true
  urls: "https://elastic.github.io/synthetics-demo/"
  schedule: '@every 3m'
  timeout: 16s
  alert.status.enabled: true
  alert.tls.enabled: true

LGTM!
--
To test this I also checked out the branch of the Kibana's PR locally.

Pushing a lightweight monitor setting alert.status.enabled: true and alert.tls.enabled: true in the .yaml file results in:

Pushing a lightweight monitor setting alert.status.enabled: false and alert.tls.enabled: false in the .yaml file results in:

Pushing a lightweight monitor without setting alert.status.enabled and alert.tls.enabled in the .yaml file results in:

There is support for configuring all of the monitors via global config synthetics.config.ts, is this intentional?
Blocking this PR, before we agree on this as we have seen quite a few occasions lately that some options are not covered for all monitors.

Yes, it should be possible to configure this globally as well.


Setup the React template

Don't place the files on a dir called cgl-website keep it in root.
Add some. Docs on how to build a static site from it.


Ray serve with Llama.cpp for CPU inference on Graviton

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?
You can run CPU inference on EKS with Graviton, ray serve with llama.cpp can help with that
Describe the solution you would like

Describe alternatives you have considered

Additional context

Ray on EKS will help with scalable and distributed inference jobs, Graviton will help with cost efficiency


React Router for pages

For this to be able to worked on we need to have the design + React completed for all the pages


⚠ Bofrost.fr has degraded performance

In 0bf8bda, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1001 ms

Resolved: Bofrost.fr performance has improved in b7a0e62.


DCOS-14091: Apply flex workaround for service create modal in IE11

This PR implements a flex workaround to force the service form to fill its parent in IE11.
The workaround is described here: https://github.com/philipwalton/flexbugs#3-min-height-on-a-flex-container-wont-apply-to-its-flex-items
Before:

After:

Checklist

[x] Did you add a JIRA issue in a commit message or as part of the branch name?
[ ] Did you add new unit tests?
[ ] Did you add new integration tests?
[ ] If this is a regression, did you write a test to catch this in the future?

LGTM! 💯  💖


[Help][BUG] KeyError: 'lm_head.weight' on loading llama 3.2

Trying to load llama-3.2 on TPU VM v3-8 via this:
device_mesh = keras.distribution.DeviceMesh((1, 8), ["batch", "model"], devices=keras.distribution.list_devices())
layout_map = keras.distribution.LayoutMap(device_mesh)
layout_map["token_embedding/embeddings"] = ("model", None)
layout_map["decoder_block.*attention.*(query|key|value)/kernel"] = ("model", None, None)
layout_map["decoder_block.*attention_output/kernel"] = ("model", None, None)
layout_map["decoder_block.*ffw_gating.*/kernel"] = (None, "model")
layout_map["decoder_block.*ffw_linear/kernel"] = ("model", None)
model_parallel = keras.distribution.ModelParallel(layout_map=layout_map, batch_dim_name="batch")
keras.distribution.set_distribution(model_parallel)

model = keras_nlp.models.Llama3CausalLM.from_preset("meta-llama/Llama-3.2-3B-Instruct")

but it throws this Error:

KeyError: 'lm_head.weight'

note: i get layout_map code from This Example. i don't know if problem is from layout_map or Llama3CausalLM

Hi @steveepreston,
I able to execute the code using the Gemma model, and it worked without any issues. For the Llama model, however, could you please reach out to the Llama team for further assistance? Please refer to the Gist file for more details.
Thank you.

Thank you for attention @Gopi-Uppari
Yes, gemma successfully executed in my test too. (although gemma-2-9b-it thrown OOM on TPU).
Problem is about llama model.
ok, i will try to create another issue there also.

Could you please confirm if this issue is resolved for you with the above comment ? Please feel free to close the issue if it is resolved ?
Thank you.

Problem not resolved and I've moved to PyTorch.
Maybe I'll back to follow and solve this in future. There is still no example for Llama3CausalLM+XLA in the web.

Hi @steveepreston
Variable paths in Llama are different from Gemma so the layout map that works for Gemma doesn't work for Llama (see here).
Recently, get_layout_map is added for Llama here. So instead of specifying the layout map manually, you can use this function: layout_map = keras_nlp.models.LlamaBackbone.get_layout_map(device_mesh).
We haven't added get_layout_map for Llama3 yet but if it has the same architecture as Llama, you can copy the layout map from here.

@SamanehSaadat Thanks for the explanation. it sounds fine.
just to confirm: is get_layout_map() currently available only for LlamaBackbone and GemmaBackbone?
What should we do for other models, such as distil_bert and phi3 and so on?

@steveepreston That's correct, it's only available for Llama and Gemma right now but we're planning to add support for all other models soon. Here is the tracking issue: https://github.com/keras-team/keras-hub/issues/1689

@SamanehSaadat Got it, thanks.


Add developer guide

Situation
Add developer guide, with short description related to the develops.

Add notice on using provided scope for the Spark dependencies

Acceptance Criteria

Developer guide is added

Hi @morazow I set the PR to "approved" and left a comment for an optional change.
If you want to apply this change then just ping me for final approval.

Great, I added them, please have another look.


Burst Android NDK problem

Bug description
I'm using the ubuntu-2021.3.2f1-android-1.0.1 image to build the project. However the build fails with the message
Burst requires the android NDK to be correctly installed (it can be installed via the unity installer add component) in order to build a standalone player for Android with ARMV7A_NEON32
The environment variable ANDROID_NDK_ROOT is undefined or empty, is the Android NDK correctly installed?

This problem arised when I updated from ubuntu-2020.3.30f1-android-0.15.0 to ubuntu-2021.3.2f1-android-1.0.1. If I disable Burst compilation for Android, then the build seems to work.
How to reproduce

Building project with batch mode unity-editor -quit -batchmode -executeMethod Build.AndroidBuild -apkName "$APK_NAME" -logFile - on Bitbucket Pipelines.

Expected behavior

Build succeeds

Additional details
The packages I have installed are
Registered 54 packages:
  Packages from [https://packages.unity.com]:
<EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS>  Built-in packages:
<EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS><EMAIL_ADDRESS>(location<EMAIL_ADDRESS>

facing the same issue

I had the same issue but was able to get around it by applying some EditorPrefs settings in my build script:
EditorPrefs.SetBool("JdkUseEmbedded", true);
EditorPrefs.SetBool("NdkUseEmbedded", true);
EditorPrefs.SetBool("SdkUseEmbedded", true);
EditorPrefs.SetBool("GradleUseEmbedded", true);
EditorPrefs.SetBool("AndroidGradleStopDaemonsOnExit", true);

(all of these are probably not related with the current issue - but at least "NdkUseEmbedded")

@JakobAnarkyLabs thanks for saving me from tearing out the last few hair strands I have left.

Hi,
I was checking the official documentation of Unity related with Burst. And I've read the next:
If compiling for a non desktop platform, or you have disabled cross compilation support, then Burst compilation requires specific platform compilation tools (similar to IL2CPP), the below table can be used to determine the current level of support for AOT compilation.

If a host/target combination is not listed, it is at present not supported for Burst compilation.
If a target is not valid (missing tools/unsupported), Burst compilation will not be used (may fail), but the target will still be built without Burst optimisations.
So my question is: How are you be able to compile Burst (linux + android)? According with that table that combination is not possible.
The unity documentation can be found here<EMAIL_ADDRESS>Thanks!

Hi @lordaku
Yes, you are probably right about Burst (that it can't currently be compiled for Android on a Linux machine) - at least, that is what the documentation seems to suggest.
I didn't notice that @jjaine was having this issue on a Linux machine - I just saw that the error message was the same as the one I got (on my Windows machine). So I guess that it is not really correct that I had the same issue as @jjaine (though maybe the same as @r4ravi2008 ...) but rather a related on Windows. Sorry about that.

Android images on windows are now released with v3 images! This should allow burst compilation


Reorder Sections

⚠ This is built on top of #12. Do not merge first.
This moves conceptual guides below references and promotes use-case specific guides. This follows the convention we established for Stackbit, which is motivated by Gatsby's docs and Divio's documentation system.

With this one, let's do this:

Getting Started
Concepts
Guides
Reference
Recipes (name TBD)
Other


Security tightening

Hey,
About a week ago, I contributed some code here. A while after, I wanted to add some features, some that would break backward compatibility and that would require me to rewrite a big portion of the tests. So I decided I will fork sanic_session and write my own lib.
While writing the library, I saw 2 minor security issues that I think should be addressed:

Possibility for a user assigning an SID instead of strictly being generated server-side.

It would be nice to provide an easy interface for refreshing an sid of a session_dict for authentication libraries to easily avoid session fixation attacks.
(Unprivileged user having the same SID as a privileged user)

Before writing sanic_cookies I made some commits to my fork of sanic_session, however the changes weren't complete and not properly tested, so I wouldn't recommend blindly copying from them. I think what's better is that the 2 repos can somehow merge for a version 2.0? (this and sanic_cookies https://github.com/omarryhan/sanic-cookies)
Unfortunately, I'm very busy these days so I can't push quick fixes to sanic_session. I'll be more than happy to do code reviews if you want me to. I'll be even happier if someone can review my code @ sanic_cookies
Cheers :)

There is an easy way for refreshing an sid:

request.ctx.session = SessionDict(sid=request.ctx.session.sid)  # clear session
request.ctx.session.modified = True  # mark as modified to update cookies


A round of CI updates

See commits for details — this includes fixing a test broken due to over-sensitive baselines, git now being sensitive to directory permissions, complications of Github actions running in containers, fixing pre-commit dependencies, and adding a nightly job so we notice problem more quickly next time.

Prior results here, for reference: https://github.com/zeek/package-template/actions/runs/4190374363

I made another pass, it looks like there are still two issues open. I would really like to get to the bottom of the CI notification issue.
I added a couple patches on top of your branch, notably a bump of the pre-commit hooks, pre-commit formatters for YAML and Python (using Black like we now do elsewhere), and a bump of the sources to python-3.7 syntax. Bumping the Python requirement might break people still using this template with older versions (unsure if we also bumped it for the zeek-5.0 series), so I put it into the last two commits for easy removal.

I think this PR shifted somewhere from simply getting CI to work again to a huge pass over the whole thing. Let's turn this around, since you're already adding commits anyway — please open your own PR when you're happy with it all. Thank you!

Reopening after discussion :-)

No overstepping happened, all good! Let's get it in and iterate in subsequent PRs. :+1:


Slowmovie Service Failing

I previously had no issues setting up my frame and got through an entire film without a single issue or hang. I had to change my wifi and just decided to do a clean reinstall for the frame. But now whenever I try to run the Slowmovie service and check the status, I get this message:
set mark: ...skipping...
● slowmovie.service - Slow Movie Player Service
Loaded: loaded (/etc/systemd/system/slowmovie.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Sun 2022-04-03 17:52:26 BST; 43s ago
Process: 1346 ExecStart=/usr/bin/python3 /home/pi/SlowMovie/slowmovie.py (code=exited, status=217/USER)
Main PID: 1346 (code=exited, status=217/USER)
CPU: 11ms
Apr 03 17:52:26 frame systemd[1]: Started Slow Movie Player Service.
Apr 03 17:52:26 frame systemd[1346]: slowmovie.service: Failed to determine user credentials: No such process
Apr 03 17:52:26 frame systemd[1346]: slowmovie.service: Failed at step USER spawning /usr/bin/python3: No such process
Apr 03 17:52:26 frame systemd[1]: slowmovie.service: Main process exited, code=exited, status=217/USER
Apr 03 17:52:26 frame systemd[1]: slowmovie.service: Failed with result 'exit-code'.
~
I didn't have this issue before and followed the manual installation steps. This project is the entire extent of my programming knowledge so I would appreciate any help I can get.

From googling, it looks like a problem with systemd's interaction with users on the system. Are you doing something different than before with users, using sudo, or anything like that?

From googling, it looks like a problem with systemd's interaction with users on the system. Are you doing something different than before with users, using sudo, or anything like that?

The only systemd thing I think I'm doing is changing to the SlowMovie  directory and inputting:
sudo cp slowmovie.service /etc/systemd/system
sudo systemctl daemon-reload

Can you run the program manually? Just to confirm Python and all the deps are functioning normally?

Hi,
I know this is an old thread but I was just looking at this code to make a change. If you've manually copied the slowmovie.service.template file you will need to modify it as there are some templates used by the installer to set the user and path that would otherwise not be populated correctly. I suspect this is the case based on the error above as systemd is unable to determine what user ID on the system to run as.
You would want edit this line: User=${USER} and replace ${USER} with a vaild user ID such as pi for example.
You also would need to replace any instances of ${HOME} with the actual path to that users home directory. Or more plainly you want the paths to be correct for where you have installed SlowMovie.
Hope this helps.

Going to close this as I think the above is probably the right answer here. The manual instructions do state that the template file should be run with envsubst <slowmovie.service.template > slowmovie.service to resolve the variables prior to copying the file to the systemd folder.


omekasy: 1.2.3 -> 1.3.1

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/ikanago/omekasy/releases.
meta.description for omekasy is: Command line application that converts alphanumeric characters to various styles defined in Unicode
meta.homepage for omekasy is: https://github.com/ikanago/omekasy
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.3.1 with grep in /nix/store/ba2xhhhggi2lw7kib770ryivgqbq106i-omekasy-1.3.1
found 1.3.1 in filename of file in /nix/store/ba2xhhhggi2lw7kib770ryivgqbq106i-omekasy-1.3.1

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

omekasy

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/ba2xhhhggi2lw7kib770ryivgqbq106i-omekasy-1.3.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A omekasy https://github.com/r-ryantm/nixpkgs/archive/14ff33bde2a7b3d187b0f40314b45b04371070d7.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/14ff33bde2a7b3d187b0f40314b45b04371070d7#omekasy

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/ba2xhhhggi2lw7kib770ryivgqbq106i-omekasy-1.3.1
ls -la /nix/store/ba2xhhhggi2lw7kib770ryivgqbq106i-omekasy-1.3.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

omekasy

Maintainer pings
cc @jcaesar for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

@NixOS/nixpkgs-merge-bot merge
(tested, werks.)


Poii QnA

enter the Podii questions and answers:

https://github.com/sFractal-Podii/quizquadaminos/blob/main/qna/sponsors/002.md
https://github.com/sFractal-Podii/quizquadaminos/blob/main/qna/sponsors/006.md
https://github.com/sFractal-Podii/quizquadaminos/blob/main/qna/sponsors/010.md
more if desired

@TraceyOnim :  This is in code review without any commits? Shouldn't it be linked to a PR?


Bug: clean_url fails on apostrophe in urls

The clean_url function fails when a URL contains an apostrophe. I tried to quote/encode the URL, but it wouldn't parse & clean it correctly.
The clean_url function should accept escaped/encoded URLs or better handle characters such as an apostrophe.

Thanks for your feedback, there seems to be a problem indeed, the cleaning component stops at an apostrophe and returns what was before.


ModuleNotFoundError: No module named 'dream'

ModuleNotFoundError                       Traceback (most recent call last)
 in ()
1 # @title Select a model to load
----> 2 from dream import Dream
3 from os.path import exists
4 get_ipython().system('mkdir checkpoints')
5 ckpt_dir = "/content/checkpoints/"
ModuleNotFoundError: No module named 'dream'

I believe this was a cloning issue from notebook itself, should work properly now.


VXLAN not working when tunnel address is borrowed

Expected Behavior

the IP of the vxlan.calico should not be assigned from the  blocks of other nodes.
Current Behavior

I understand that each node should have at least one block, but in the case of insufficient ip or a large number of nodes, it may not be possible to assign a full block to a newly joined node, which may result in the ip of the newly joined node's vxlan possibly assigning addresses from other nodes' blocks, which will result in failure to access the new node's vxlan IP and timeout for pod query dns on newly joined nodes.
Possible Solution

Steps to Reproduce (for bugs)

create a four-node cluster

[root@dce-10-29-12-122 ~]# kubectl get nodes -o wide
NAME               STATUS   ROLES             AGE   VERSION    INTERNAL-IP    EXTERNAL-IP   OS-IMAGE                KERNEL-VERSION           CONTAINER-RUNTIME
dce-10-29-12-122   Ready    master,registry   8h    v1.18.20   <IP_ADDRESS>   <none>        CentOS Linux 7 (Core)   3.10.0-1160.el7.x86_64   docker://20.10.7
dce-10-29-12-123   Ready    infrastructure    8h    v1.18.20   <IP_ADDRESS>   <none>        CentOS Linux 7 (Core)   3.10.0-1160.el7.x86_64   docker://20.10.7
dce-10-29-12-124   Ready    infrastructure    8h    v1.18.20   <IP_ADDRESS>   <none>        CentOS Linux 7 (Core)   3.10.0-1160.el7.x86_64   docker://20.10.7
dce-10-29-12-125   Ready    <none>            8h    v1.18.20   <IP_ADDRESS>   <none>        CentOS Linux 7 (Core)   3.10.0-1160.el7.x86_64   docker://20.10.7

create default-ipv4-ippool:

apiVersion: projectcalico.org/v3
kind: IPPool
metadata:
  name: default-ipv4-ippool
spec:
  blockSize: 28
  cidr: <IP_ADDRESS>/26
  ipipMode: Never
  natOutgoing: true
  nodeSelector: all()
  vxlanMode: Always

This means that there are at most four blocks, and now I have four nodes, everything is fine now.

Now, I join a new node(dce-10-29-12-112), Since there are no extra blocks, so the vxlanIP of a new node will be allocated from the block of a node

[root@dce-10-29-12-122 ~]# kubectl get nodes -w
NAME               STATUS     ROLES             AGE   VERSION
dce-10-29-12-112   NotReady   <none>            42s   v1.18.20
dce-10-29-12-122   Ready      master,registry   9h    v1.18.20
dce-10-29-12-123   Ready      infrastructure    8h    v1.18.20
dce-10-29-12-124   Ready      infrastructure    8h    v1.18.20
dce-10-29-12-125   Ready      <none>            8h    v1.18.20

dce-10-29-12-112   Ready      master,registry   9h    v1.18.20

[root@dce-10-29-12-112 ~]# ip a show vxlan.calico
56: vxlan.calico: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN group default
    link/ether 66:ec:93:99:93:da brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/32 brd <IP_ADDRESS> scope global vxlan.calico
       valid_lft forever preferred_lft forever
    inet6 fe80::64ec:93ff:fe99:93da/64 scope link
       valid_lft forever preferred_lft forever

[root@dce-10-29-12-122 ~]# calicoctl ipam show --show-blocks
+----------+---------------------------------------+-----------+------------+------------------+
| GROUPING |                 CIDR                  | IPS TOTAL | IPS IN USE |     IPS FREE     |
+----------+---------------------------------------+-----------+------------+------------------+
| IP Pool  | <IP_ADDRESS>/26                         |        64 | 10 (16%)   | 54 (84%)         |
| Block    | <IP_ADDRESS>/28                         |        16 | 1 (6%)     | 15 (94%)         |
| Block    | <IP_ADDRESS>/28                        |        16 | 1 (6%)     | 15 (94%)         |
| Block    | <IP_ADDRESS>/28                        |        16 | 2 (12%)    | 14 (88%)         |
| Block    | <IP_ADDRESS>/28                        |        16 | 6 (38%)    | 10 (62%)         |
| IP Pool  | fdff:ffff:ffff:ffff::/96              | 4.295e+09 | 6 (0%)     | 4.295e+09 (100%) |

<IP_ADDRESS> is belong to block <IP_ADDRESS>/28

Ping the vxlan ip of the new node on the old node and it fails

[root@dce-10-29-12-122 ~]# ping <IP_ADDRESS>
PING <IP_ADDRESS> (<IP_ADDRESS>) 56(84) bytes of data.
^C
--- <IP_ADDRESS> ping statistics ---
6 packets transmitted, 0 received, 100% packet loss, time 5001ms

DNS query failed in pod:

test-112  is the test pod created on the newly joined node(dce-10-29-12-112)
test-125  is the test pod created on the old node(dce-10-29-12-125)
[root@dce-10-29-12-122 ~]# kubectl get po -o wide
NAME             READY   STATUS              RESTARTS   AGE     IP              NODE               NOMINATED NODE   READINESS GATES
test-112         1/1     Running             0          2d17h   <IP_ADDRESS>     dce-10-29-12-112   <none>           <none>
test-125         1/1     Running             0          2d17h   <IP_ADDRESS>     dce-10-29-12-125   <none>           <none>
[root@dce-10-29-12-122 ~]# kubectl exec -it test-125 sh
kubectl exec [POD] [COMMAND] is DEPRECATED and will be removed in a future version. Use kubectl kubectl exec [POD] -- [COMMAND] instead.
/ # nslookup kubernetes.default.svc.cluster.local
Server:		<IP_ADDRESS>
Address:	<IP_ADDRESS>:53

Name:	kubernetes.default.svc.cluster.local
Address: <IP_ADDRESS>

/ # exit
[root@dce-10-29-12-122 ~]# kubectl exec -it test2-112 sh
kubectl exec [POD] [COMMAND] is DEPRECATED and will be removed in a future version. Use kubectl kubectl exec [POD] -- [COMMAND] instead.
/ # nslookup kubernetes.default.svc.cluster.local
;; connection timed out; no servers could be reached

/ #

Context

Your Environment

Calico version
Orchestrator version (e.g. kubernetes, mesos, rkt):
Operating System and version:
Link to your project (optional):

/kind bug

friendly ping :) @caseydavenport

Hey sorry for the delay, have been out of the office for a bit.

which may result in the ip of the newly joined node's vxlan possibly assigning addresses from other nodes' blocks, which will result in failure to access the new node's vxlan IP and timeout for pod query dns on newly joined nodes.

I think this is a bug - there's no reason at a networking level that the IP needs to be from within the block on that node.

Same symptom being described here: https://github.com/projectcalico/calico/issues/5595

Thank your reply! @caseydavenport
Our users uses a cidr mask of 20 and a blockSize of 26, which means that there are at most 64 blocks,  and the number of nodes in the cluster exceeds 64, so for new nodes added after the 64th node, they will not have a full block to allocate. This will result in the newly added nodes vxlan will not work. I think this is a more serious problem. This will have a big impact on the scalability of the k8s-cluster. Now we can only resize the blocksize to 28 (because of the user's environment, cidr is not adjustable)
I have the following two suggestions for this problem:

When assigning IPs to vxlan.calico, if there are no extra blocks, an error should be returned

We should emphasize this point in the official documentation

There shouldn't be a reason that Calico can't use a borrowed IP for the tunnel address. There is likely another fix that needs to be made rather than limiting the tunnel address in the way you described. That wouldn't fix the ultimate problem of limiting the cluster size to 64 nodes (any nodes past the number of blocks in the cluster would result in non-functional nodes without a tunnel address)

When there are not enough blocks, a 31-masked MicoBlock is assigned from another block, and the tunnel IP is split from that MicoBlock, because the problem only affects Pods using HostNetwork on the new node to communicate with non-HostNetwork Pods on other nodes, and does not affect other communication scenarios. We just need to solve the tunnel IP routing problem. Also add a route like "x.xx.xx.xx/31 via tunlIP dev ifcfg-tunl". More nodes can be supported with relatively small changes.

he problem only affects Pods using HostNetwork on the new node to communicate with non-HostNetwork Pods on other nodes, and does not affect other communication scenarios. We just need to solve the tunnel IP routing problem. Also add a route like "x.xx.xx.xx/31 via tunlIP dev ifcfg-tunl"

Ah, yes this makes sense. We're not programming a return route that tells pods where the tunnel address is (normally that is handled by the route for the block itself).

he problem only affects Pods using HostNetwork on the new node to communicate with non-HostNetwork Pods on other nodes, and does not affect other communication scenarios. We just need to solve the tunnel IP routing problem. Also add a route like "x.xx.xx.xx/31 via tunlIP dev ifcfg-tunl"

Ah, yes this makes sense. We're not programming a return route that tells pods where the tunnel address is (normally that is handled by the route for the block itself).

OK,Then I'll start modifying it according to this

I'm facing exactly the same issue, ie, the network connectivity of pods using the host network on nodes to communicate with non host network pods on other nodes, and does not affect different communication scenarios"
Link to details of one of the ipam blocks: https://gist.github.com/sedflix/95bc34ee4a4fcde98ae93993708c864e
Setup:

EKS 1.21
Calico 3.20.3 ( and now 3.23.3)
Using VXLAN
CALICO_IPV4POOL_BLOCK_SIZE is 26
We have several node sizes. Max Pod varies from 48 to 100s.
We are using k8s as the data store.

Within 15 minutes, we added approximately 130 nodes while using Calico 3.20. Within 30 minutes we removed those 130 nodes. This was done twice.
Our pod CIDR is <IP_ADDRESS>/18 which allows 16,384 IP ranges. Our block size is 26, which has 64 IPs. We can have at max 256 blocks at a time. We reached that stage twice, ie, the number of blocks allocated reached 256. Currently, we have more than 200 borrowed IPs. The block owner is a node that doesn't exist anymore and the IPs are borrowed by live/present node.

By the way, why should we assign an IP to vxlan.calico?

I think this is a candidate fix: https://github.com/projectcalico/calico/pull/9662/


pylint fix

@leixiaoning
please care about the pylint

@leixiaoning
please care about the pylint

sorry, i will  be careful.


Message should not raise a KeyError is Payload is missing.

It must raise ValueError, TypeError, or AssertionError, (per this) so that pydantic sees that reports the missing Payload as a ValidationError

_header_from_kwargs() should be the validator of Header.


Separate Docker image for elemental-cli

Having a separate docker image for the elemental-cli helps in the context of installing from 3rd party (https://rancher-sandbox.github.io/cos-toolkit-docs/docs/getting-started/install/#installation-from-3rd-party-livecd-or-rescue-mediums ) and to test locally.
This requires also to have a look at all the binaries required by elemental to be functional

@Itxaka I guess the only remaining bit here is to use it for 3rd party installs?

ouch, didnt knew there was a card for this. Indeed this should be completed as we now have a docker image with elemental and the required tools inside and its pushed to quay.
So only the docs and maybe a test is required for this. I would like to have a small test that only triggers when the dockerfile is changed to make sure we are not breaking it, maybe just an elemental install loop or something like that.

ah I guess, I didnt found it cause this is on cos-toolkit instead of elemental....

missing docs: https://github.com/rancher-sandbox/cos-toolkit-docs