Hobbits test suite

Hobbits is a network protocol for distributed systems meant for simple interactions between peers. Hobbits is used to explore and test interactions between Ethereum 2.0 clients as they firm up network requirements.
This bounty will be awarded to the team or individual implementing a conformance test suite for hobbits defined by the specification of the wire protocol and the specification of the gossip protocol as part of the Whiteblock Genesis development framework.
Acceptance criteria:

The test suite is contributed to the genesis sandbox.
The test suite runs against the Hobbits test client defined in a different bounty.
The test suite interprets logs to understand if the desired behaviors are met.
The test suite reports results in a human-readable format.

Hobbits specifications: https://github.com/deltap2p/hobbits
Genesis sandbox: https://github.com/deltap2p/genesis

@atoulme decided to let someone else work this bounty.

@jrhea  i've gone through the code and i believe I can get this issue done in the next few days, thanks

@jrhea just to clarify is this bounty still open? thanks

Bounty Canceled


Best pratice for disabling animations at certain breakpoints

Hallo Lukas,
how would you suggest to disable animations for responsive design?
My animations and CSS3 slow down most smartphones.. I hope to improve this by disabling the animations without disabling scrollify or using instantMove.
What's the best solution? What would you suggest?

The disable() method is what you're looking for.


Add link to public HANA Client tools

Add link to publicly available HANA drivers.
HANA Client tools can be downloaded from https://tools.hana.ondemand.com/#hanatools

@maxnuf : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@davidiseminger : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Support for video player version 10.0+

I don't know exactly why this plugin cannot work with video player 10+. I had upgraded my android versions to Android X and they required video player to be 10.0+, but I have Chewie player in many parts of the project, and hence I am stumbled upon this hurdle.
Is there any immediate availability of new Chewie supporting video player 10.0+?

Oh dang, that looks like it was a regression we meant to ship. The dependency constraints have been lifted, and you can use 0.9.6 which supports 10+


fix: correctly validate on submit for fields with concat display values

Issue #, if available:
Description of changes:
When fields have concatenated display values, we were incorrectly passing validation for undefined values on submit.
Integ test modified to cover this case. Made sure it fails before this change.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Codecov Report

Merging #903 (7fea843) into main (1eb9541) will not change coverage.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

@@           Coverage Diff           @@
##             main     #903   +/-   ##
=======================================
  Coverage   92.95%   92.95%
=======================================
  Files         118      118
  Lines        5064     5064
  Branches     1483     1483
=======================================
  Hits         4707     4707
  Misses        336      336
  Partials       21       21

Impacted Files
Coverage Δ

...react/lib/forms/form-renderer-helper/validation.ts
92.85% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1eb9541...7fea843. Read the comment docs.


⚠ Bofrost.lu has degraded performance

In 836052e, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 2089 ms

Resolved: Bofrost.lu performance has improved in 1334b36 after 6 minutes.


Brackets's screen becomes white

Description
It seems that if I open Brackets a long time and don't use it. Its screen will become white. Only the navigation bar will show, but couldn't make a response to my operations.
Versions

Windows 8.1
Bracktes: sprint 6 发布版(released version) 1.6.0-16680 (release 3df0ac6fa)

Hi @HuangZhenyang,
could you try updating Brackets to the latest version (1.9)?
This has something to do with large code bases IIRC, as seen in https://github.com/adobe/brackets/issues/12617, https://github.com/adobe/brackets/issues/12959, https://github.com/adobe/brackets/issues/12192 and others. Ignoring some larger folders (of third party code, built code etc.) might be helpful, see https://github.com/zaggino/brackets-file-tree-exclude for more information.

OK! I'm so sorry to disturb u that I didn't  try to look for such problem carefully.
Thank you so much!

No problem @HuangZhenyang, do report if the problem persists! 👍


ValloxMV 1.2.0

@hacki11 The version is NOT yet on npm!!!

Yep,that's why this is just a draft pr

@hacki11 update?


Overmorgen csv dump

As requested by @MartLubben. Create a csv report based on a yml file containing queries (should be in config/saved_scenario_reports). The report can be found only through url, because it's only valid for Over Morgen.
In the future, more types of reports based on different queries can be created by simply adding a yml file to the config/saved_scenario_reports folder.

@antw Is it ok if I merge this?


Added @blockstack/connect lib to react package.json

Steps to reproduce

Run npx generator-blockstack --react
Run npm run start
Server fails to compile as Module not found: Can't resolve '@blockstack/connect' in src/App.js

Changes

Just added the latest @blockstack/connect to package.json which should fix this issue.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

thanks for your contribution @cdadityang

@diwakergupta to help with access, so I can merge this


Cannot set DATABASE_HOST to in-memory database for sqlite

My application uses a transient in-memory database for records (https://www.sqlite.org/inmemorydb.html), so there is no fixed database to connect to. I tried setting DATABASE_HOST=sqlite://:memory, but that gives an error:
error: empty host
  --> src/main.rs:36:5
   |
36 |     query!("CREATE TABLE log('x', int);").execute(connection).await?;
   |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   |
   = note: this error originates in the macro `$crate::sqlx_macros::expand_query` (in Nightly builds, run with -Z macro-backtrace for more info)

I think this is a parse error from reqwest? I don't think sqlx should be interpreting this as a network url.
Admittedly sqlx doesn't give me much benefit because the database is transient, I might just switch to raw sql.

You should use sqlite://:memory: or sqlite::memory:.
See https://github.com/launchbadge/sqlx/blob/master/sqlx-core/src/sqlite/options/parse.rs#L28


[full-ci] Backport Sessions Command

Backport of https://github.com/owncloud/ocis/pull/9041
Fixes https://github.com/owncloud/ocis/issues/9003

Note, when merged, this will go into the upcoming 5.0.7
Therefore I am asking if we need a changelog so we can reference that in the 5.0.7 release notes.
It is also docs relevant.
@tbsbdr fyi, release notes relevant


Release 0.2.106 to incorporate build fix for #2484

r? @Amanieu
(rust-highfive has picked a reviewer for you, use r? to override)

(already tagged and uploaded, since the previous version broke CI on macOS)

@bors r+

:pushpin: Commit 3d544321448773c04984fb29e92d6c2c2e130622 has been approved by Amanieu

:hourglass: Testing commit 3d544321448773c04984fb29e92d6c2c2e130622 with merge eae7b489ef297f6d71c34cbf55b2eb6e48ccdb12...

:sunny: Test successful - checks-actions, checks-cirrus-freebsd-11, checks-cirrus-freebsd-12, checks-cirrus-freebsd-13
Approved by: Amanieu
Pushing eae7b489ef297f6d71c34cbf55b2eb6e48ccdb12 to master...


Create a proof of concept for Custom CSS table styling in recordset

We can use catalog ../#2/Gene_Expression:Specimen as an example. It has a column that displays thumbnails that we want to specify min width, etc.
Edited body (by Josh):
With the current HTML structure, it is possible to apply different styles to the table part of the recordset directive. There are a few key HTML ids/classes to be aware of:

recordset identifier (#recordset)

identifies (scopes) the HTML used only for the recordset application
should be specified when CSS rules are to be applied ONLY to recordset app

recordset-container class (.recordset-container)

identifies the recordset directive container
should be specified when CSS rules are to be applied anywhere the recordset directive is used
this would be applied to all popups in record and recordedit as well

rs-<table.displayname> identifier (#rs-<table.displayname>)

identifies the record table directive
should be specified when CSS rules are to be applied anywhere a that named table appears
NOTE: currently will apply cross schemas if multiple tables with the same displayname exist in different schemas (the described enhancement below addresses this issue)

For the #catalog/schema:table defined above, the following rule can be used to apply styling to specific columns:
#recordset #rs-Specimen thead>tr>th:nth-child(3) {
  ...
}

This scopes the defined styling to the recordset application (#recordset)

without this, the rule would also apply to the related tables whenever they may appear in the record
or to the search popups in recordedit or record

This scopes it to only the Specimen table (#rs-Specimen)
adds the styling to the table header's 3rd child (thead>tr>th:nth-child(3))

nth-child(#) allows any heading to be manipulated based on the order defined in the visible-columns annotation
we are using thead here because the HTML column element sizing for <table> relies on the properties of thead>tr>th before those defined for tbody>tr>td

Some enhancements can be made to make this more specific (and easier to use).

[ ] change the identifier for the table from "rs-<table.displayname>" to "rs-<schema.displayname>:<table.displayname>"

or the rs- can be removed completely
this should remove the concern that a rule would apply to the same named table in different schemas

[ ] each column should have a class attached to them based on the column displayname

thead>tr>th should have ng-class="<column.displayname>" attached to it
this prevents having to change the Custom CSS if the visible columns list is reshuffled (or not defined at all)

These changes would change the above example to:
#recordset #rs-Specimen .Images {
  ...
}

@hongsudt  I updated the body of the issue with an outline that should go over the use case that we discussed the other day. Let me know if any of this is confusing or if you think of more common scenarios that should be added.

Names should be raw values instead of display values to ensure uniqueness.
What about a space in the name (maybe have to replace with _ or -)?


IntelliJ/AndroidStudio language plugin

please add plugin support for IntelliJ, it will be useful for those who develop in Android Studio or IntelliJ IDEA instead of VS Code

I will try to solve the issues of this project if any one find any. But sorry I do not have energy anymore for any new feature request for this project. I have not touched it almost for a year now.
The development of language plugin is very complex, I do not own any version of IntelliJ and I am not familliar with this IDE. From the little understanding I have right now, to make language plugin for it require one to write a parser in Java. This is clearly not easy. So anyway, I am sorry but I cannot help you.


RuleHelper & local only installs

RuleHelper's "max" function is broken;

the callback's variable-name is incorrect

Docs do not mention the need for the validationserviceprovider

Make the default serviceprovider register it when it has not been registered

Released in v2.4.x


MSID: 96798 Version: 1 DOI: 10.1101/2<IP_ADDRESS>3302

MSID: 96798
Version: 1
Preprint DOI: https://doi.org/10.1101/2<IP_ADDRESS>3302
Step 1. Awaiting reviews
Editorial to post reviews via hypothesis
Useful links:

DocMap: https://data-hub-api.elifesciences.org/enhanced-preprints/docmaps/v2/by-publisher/elife/get-by-manuscript-id?manuscript_id=96798
New model tracking: https://docs.google.com/spreadsheets/d/1_fHaoOy7hjyocptKtVJRijeNpUY4hBS7Ck_aVmx6ZJk/
Reviews on sciety: https://sciety.org/articles/activity/10.1101/2<IP_ADDRESS>3302

For trouble shooting (e.g. no Docmaps available):

DocMap issue addressing: https://miro.com/app/board/uXjVNCwK6EI=/
Explore DataHub DocMaps API: https://lookerstudio.google.com/reporting/4c2f0368-babb-4beb-b5b3-497e7e7b0f08/page/ejphD
Unmatched submissions and preprints: https://lookerstudio.google.com/u/0/reporting/9f86204f-3bf7-477c-9b18-5c5ef141bf69/page/p_gxi57ha93c
Unmatched manuscripts spreadsheet: https://docs.google.com/spreadsheets/d/15QcK8w-ssB7109RQEDtFpJPZ0J5HTGxoHa_2TtpMBbg/edit#gid=1336081641

Step 2. Preview reviewed preprint
Production QC content ahead of publication
Instructions:

QC preview: https://prod--epp.elifesciences.org/previews/96798v1
Update ticket with any problems (add blocked label)
When QC OK, add QC OK label to ticket and add publication date and time to https://docs.google.com/spreadsheets/d/1amAlKvdLcaDp5W8Z8g77NmkwbMF5n_u89ArSqPMO8jg
Move card to next column
(At end of the day post link in #enhanced-preprint and ask for PDF to be generated)

Useful links:

Preprint DOI :  https://doi.org/10.1101/2<IP_ADDRESS>3302
Confirm reviews returned by EPP: https://prod--epp.elifesciences.org/api/reviewed-preprints/96798/v1/reviews
To update the MECA path in the docmap: https://docs.google.com/spreadsheets/d/1mctCQuNFBjSn97Lihy7_vBO6z7-N-oqyLv4clyi6zHg

Step 3: Awaiting search reindex
This step adds the reviewed preprint to the homepage: https://elifesciences.org
The search reindex is triggered once an hour. We need the reviewed preprint to be indexed as the search application serves the journal homepage.
Useful links:

Jenkins pipeline to reindex search can be triggered sooner or monitored here: https://alfred.elifesciences.org/job/process/job/process-reindex-reviewed-preprints/

Step 4: Published! PDF requested
Waiting for PDF to be generated
Useful links:

PDF tracking: https://docs.google.com/spreadsheets/d/106_XeDjmuBae7gexOTNzg60lapeqjl2aRn9DzupGyS8/

Step 5: Introduce PDF to data folder and git repo
Upload PDF to relevent folder in git repo https://github.com/elifesciences/enhanced-preprints-data/
Step 6: Done!

[ ] Kettle is on!

Removing labels from refs and discussion


Add new feature string and tests

#5

:tada: This PR is included in version 1.3.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


main.php when clientid is typed in add ajax to show div on bottom with all tickets from that cleint

Recent tickets changes to client tickets dynamically when a client number is entered


chore: jsonfmt recoveryservicessiterecovery

Ran jsonfmt -w "specification/recoveryservicessiterecovery/**/*.json"

Can one of the admins verify this patch?

Automation for azure-sdk-for-python

Automation for azure-sdk-for-java

Automation for azure-sdk-for-ruby

Automation for azure-sdk-for-go

Fixed a few minor model validation issues that looked like they were from examples copied between version while the types changed

Automation for azure-sdk-for-js

@jhendrixMSFT, Could you help me merging this?


Added high level MQTT client support.

Updated error code log from what() to code().

Codecov Report
Attention: Patch coverage is 89.76378% with 26 lines in your changes are missing coverage. Please review.

Project coverage is 89.84%. Comparing base (eb4f8ff) to head (fcabec9).

Additional details and impacted files

@@           Coverage Diff            @@
##             main     #178    +/-   ##
========================================
  Coverage   89.83%   89.84%
========================================
  Files          96       97     +1
  Lines       10541    10800   +259
========================================
+ Hits         9470     9703   +233
- Misses       1071     1097    +26

Files
Coverage Δ

include/async_mqtt/endpoint.hpp
87.67% <100.00%> (+0.04%)
:arrow_up:

include/async_mqtt/client.hpp
89.72% <89.72%> (ø)


Bump version 0.1.2

Check list

[x] I wrote CHANGELOG.md if the pull request adds/modifies features.

Summary
Loosen the version restriction of PyGObject and release 0.1.2.

@kenoss The approve was automatically dismissed by new commit. Could you re-approve this PR?

:pray:


reworked displaying the available services

we're now showing tables not only for the available services, but also additional services, package types and other attributes

We support advance_notice for DHL now - should be updated in the additional services table.
apart from that: ready to merge


New dependent: JokeApi Webapp

Link to the project:

https://github.com/HemantSachdeva/JokeApi

Link to my personal website / GitHub page (optional):

HemantSachdeva.GitHub.io

Is your project explicit or unsafe for minors to view?

No, it doesn't contain explicit material

Notes:

I will be adding README soon mentioning the complete description, aim of my project, inspiration, contributors and your API repo as well fosure!

Checklist:

[x] I have added my project's name to the title of this issue
[x] I have filled out at least the first URL (second one is optional)
[x] I have specified whether or not my project is explicit

Thanks for submitting your project, I'll make sure to either include it in the v2.3.2 or v2.4.0 update.

Added to v2.4.0

Thanks!
On Mon, 8 Nov, 2021, 3:34 pm Sven Fehler, @.***> wrote:

Added to v2.4.0
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Sv443/JokeAPI/issues/342#issuecomment-962992008, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/APXZ6KKCOECESVDURIYGSU3UK6OC5ANCNFSM5GJ6ZRZQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

This is what it looks like. Is it alright?

This is what it looks like. Is it alright? edit: I like your page eyes

Yes link to the source of my web app is correct.
Thanks XD
I still have to improve it, currently having a busy schedule. :'(


ErrorException in Youtube.php line 296

HI,
When I use your script I get this error:
"ErrorException in Youtube.php line 296: call_user_func_array() expects parameter 1 to be a valid callback, class 'Google_Client' does not have a method 'save'"
It update video to youtube(I get email when it finished) but didn't get video ID on my web application. Did you maybe know what is the problem?
This is my code in my controller in laravel:
                        $video = Youtube::upload( $destinationPath . $video->file_name, [
				'title'       => $request->get( 'title' ),
				'description' => $request->get( 'title' ),
				'category_id' => $this->user->organization_id
			] );

			$video->youtube_id = $video->getVideoId();

Hey @stojankukrika,
The video ID is returned when you call the getVideoId() method as you're already doing.
So changing what you currently have;
$video = Youtube::upload( $destinationPath . $video->file_name, [
	'title'       => $request->get( 'title' ),
	'description' => $request->get( 'title' ),
	'category_id' => $this->user->organization_id
] );

$id = $video->getVideoId();

$id is now the ID of the video on YouTube.

Sorry, but, what I didn't do right? $video->getVideoId() is not id of videos of my table, it's only youtube_id that have as column in database and show it to client with prev. image of video and know which youtube video id need to get from youtube.
I see that I get that error if internet slows down. Can you tell me how to fix it?

You're trying to set a youtube_id property on the $video object - why are you trying to do this?

Because I want to have other data with that video object, like: title, description, date from and date to to shows, user who upload that video in my system, time when it he do it...

But the $video object in this case would not be your model in Laravel. The $video object is the uploaded video to YouTube (in the code you provided)
You would do something like this...
$upload= Youtube::upload($destinationPath . $video->file_name, [
	'title'       => $request->get( 'title' ),
	'description' => $request->get( 'title' ),
	'category_id' => $this->user->organization_id
]);

// This is not the upload, this is your Laravel model
$video = Video::create([
  'title' => 'My Video on YouTube',
  'description' => 'Dummy description',
  'youtube_id' => $upload->getVideoId() // this is the upload above...
]);

Yes. That is the mine code. But I get this error if internet slows down:
"ErrorException in Youtube.php line 296: call_user_func_array() expects parameter 1 to be a valid callback, class 'Google_Client' does not have a method 'save'"

Can you show me your full code please? You're using the wrong variable somewhere.

Sure. Here it is:
$video = new Video($request->except('video_file'));
		$destinationPath = public_path() . $this->video_url.'/';
		if ($request->hasFile('video_file')) {
			$file = $request->file('video_file');
			$extension = $file->getClientOriginalExtension();
			$video_file = str_random(15) . '.' . $extension;
			$video->file_name = $video_file;
			$video->mime = $file->getMimeType();
			$video->original_filename = $file->getClientOriginalName();
			$request->file('video_file')->move($destinationPath, $video_file);
			$youtube = Youtube::upload( $destinationPath . $video_file, [
				'title'       => $request->get( 'title' ),
				'description' => $request->get( 'title' )
			] );
			$video->youtube_id = $youtube->getVideoId();
		}
		$video->save();

What happens if you dd($upload) after an upload?
$upload= Youtube::upload($destinationPath . $video->file_name, [
	'title'       => $request->get( 'title' ),
	'description' => $request->get( 'title' )
]);

dd($upload);

Hmmm, now it's OK. I will try when internet slows down to see what it back and paste it here, if it's OK?


Relocate name and description portions of ListItem constructor to ListDescriptor

Forgot to move the name and description setting portions of the ListItem constructor to the ListDescriptor class. Moving now to prevent redundancy when implementing #7 .

There is a redundancy in the ListItem destructor. Base class destructor is automatically called when destroying the ListItem.

Must obey the Rule of 3. Add a copy constructor and copy assignment operator to ListDescriptor class.


Form control heights

Somehow I missed that #18842 and #18843 were still open. In my testing of the macOS Mojave beta, Safari has fixed their issue with the sizing, but Chrome still has the issue. It also apparently is a bug marked as won't fix. Thus, the only sensible solution to consistent .form-control heights across all supported input types in a single browser is to specify heights. I've been resisting this thinking it'd be resolved by browsers, but that's no longer the case.
Here's what's changed:

Applies the already present $input-height to .form-control.
Consolidates the <select> size and multiple overrides into just the .form-control base class instead of -sm/-lg modifiers.
Removes the Sass @extends from input groups since it picks up too many selectors, namely our <select> overrides.

Seen this demo of the changed CSS and inputs/selects.
Related test JS Bin example.
Closes #18843, fixes #18842, fixes #25923, fixes #26648, and fixes #26209.

@mdo
There should be also textarea height auto when rows attribute is applied.

I think this might need to be reopened?
After the fix now the .input-group is now broken if you have change the height of an input group .input-group:
Comparism of v4.0 and the current v4.1, when you set height: 5em to .input-group:

I think this might need to be reopened?
After the fix now the .input-group is now broken if you have change the height of an input group .input-group:
Comparism of v4.0 and the current v4.1, when you set height: 5em to .input-group:

@hrvojegolcic
You can add h-auto to from-control.

@danijelGombac Thanks, I did figure the workaround but the thing is still broken now in comparison to v4.0, because .input-group-text is taking advantage of flexbox property align-items:stretch and .form-control has a fixed height. It's inconsistent. If you ask me, either both have to have hardcoded widths or none of them.

1px padding on Windows, latest Chrome with height property on v4.4.1


Make plantuml server url configurable

In case I would like to use a private instance of a plantuml server, I would like to be able to configure the markdown plugin to use a custom URL.

Hi! Thanks your using this plugin =)
It should be possible to do what you want using the generateSource option:
function customSrcGenerator (umlCode) {
    return `https://your.server/plant-uml/${yourEncodeFunction(umlCode)}`;
}

var md = require('markdown-it')()
    .use(require('markdown-it-plantuml'), { generateSource: customSrcGenerator });

Let me know how it goes!

I wanted to suggest this feature to the Boostnote IO developers and now I posted your example to the corresponding issue.
https://github.com/BoostIO/Boostnote/issues/1592

Great! I have updated the docs to include the example.


Error in show menu

If cellTextStyle doesn't contains color, the menu in column is not show, due to the "!" in the code. If it is changed to "?" works.
https://github.com/bosskmk/pluto_grid/blob/c0c2fb0e1e91582ee0e7f675e404953078253435/lib/src/helper/show_column_menu.dart#L29

When does configuration.cellTextStyle.color have no value?
cellTextStyle must be the default or set.
Can you give me the code where the error occurs?


Vega gas

Put together a very simple calculator and it seems like with current suggested parameters we very quickly end up with a tiny number of orders allowed per block (and are always quite low even to start with). So if the weight formulae are reasonably representative of growth we probably want to bump up the minimum/default maxgas numbers?

calculator

The calculator is very handy indeed; we the cost factors and default max gas will be up to @peterbarrow / engineering to decide.

@Vegaklaus currently Tendermint does: keep adding stuff into block as long as gas fits, if the next transaction is too big, that's it, nothing more goes in.
Other than that, spoke with @jeremyletang - we're not adding transactions that call for signing: WithdrawSubmission IssueSignatures, EthereumKeyRotateSubmission, KeyRotateSubmission.
So it's ready for review. And also already implemented 🤣 .


JSON dir storage not working correctly

Describe the bug
I am using the latest stable version of label-studio(0.8.1) and I am experimenting with dir-jsons as tasks storage and found out that it's not well supported or properly documented.
If I follow the documentation at https://labelstud.io/guide/tasks.html#Directory-with-JSON-files I get the following:
$ mkdir tmp && label-studio init --input-path=$PWD/tmp --input-format=json-dir test
$ grep source -A 3 test/config.json
  "source": {
    "name": "Tasks",
    "type": "tasks-json", #  <----
    "path": "<REDACTED>/test/tasks.json"

But I am expecting the output to be:
  "source": {
    "name": "Tasks",
    "type": "dir-jsons", # <-----
    "path": "<REDACTED>/test/tasks.json"

Anyway after manually fixing the config.json file I see that there is an error in the Tasks view:
Project loading error
object of type 'generator' has no len()
Traceback

Traceback (most recent call last):
  File ".../lib/python3.8/site-packages/label_studio/utils/misc.py", line 91, in exception_f
    return f(*args, **kwargs)
  File ".../lib/python3.8/site-packages/label_studio/blueprint.py", line 317, in tasks_page
    serialized_project = g.project.serialize()
  File ".../lib/python3.8/site-packages/label_studio/project.py", line 940, in serialize
    'task_count': len(self.source_storage.ids()),
TypeError: object of type 'generator' has no len()

Hi, @nopper !
The "source" key in config.json points to the storage from where your tasks are taken during the runtime (for the local file system it is tasks.json by default. This storage could be different from where you import your data (directory $PWD/tmp with JSON files in your particular case). So "type": "tasks-json" is expected, and is not intended to be modified (that's why you probably get an error).
I've tried to import data from directory with JSON files (structured as {"text": "one two three"} in each tmp/file.json) with the following command:
label-studio start my_project --input-path tmp/ --input-format json-dir --label-config label_studio/examples/text_classification/config.xml --init

and it works fine. Please reopen this issue if you'll encounter any runtime problems with your import.

Hi @niklub,
Thanks for the fast turn around. I am a little bit confused then.
Maybe it's easier if I explain to you my use case: I have another program that say daily, creates a series of tasks to for label-studio. For the moment I was writing them down as json files in a directory.
How can I get label-studio to detect these new tasks and load them? Before that I was merging all the tasks in a single json file but it's less convenient and error prone.


Addition of Augmented Reality (AR) / Virtual Reality (VR) Development Roadmap

@rishicds GSSOC is coming to an end . I just thought of making one last issue before the event ends today at 7 p.m . Kindly , assign this issue to me and accept the PR before 7 p.m .
I genuinely appreciate your support and responsiveness throughout the program, as it’s made the process incredibly rewarding. Thank you for being so actively involved and for facilitating each contribution. It’s been an amazing experience, and I’m grateful for everything.
Thank you :)

Hi, it was a great experience working with you too! Thank you for adding so many helpful roadmaps and in such great detail!

Hi @pratheekv39  , i think the AR/VR roadmap is already present:

So you change to something other.


Fix installation instructions

According to comment README contains wrong installation instructions.
Two stages:

add usage via submodules
add installation via build.zig

Added description for submodules Fix installation instructions - submodules](https://github.com/g41797/mailbox/commit/d72ad1e1a344d0cc5987704423aeae3e5b5a2ef5)


log in info

how do i create a login?

Hi, you need to create an VIP account at webshare.cz for this to for (VIP costs about 60CZK/2.5$ per month).
with that account you log in. For non Czech users and also for people who really want free movies we are working on implementation for soap2day.

Since there was no response I am closing this.


Post-RC1 Training data format items

[x] rasa train nlu and Domain #6635
[x] make StoryReader::read_from_file synchronous #6641
[x] Converter tool not working for E2E stories #6716
[x] Test stories don't work if they aren't in the end-to-end format #6732
[x] StoryMarkdownToYamlConverter fails to convert entity annotation in e2e story #6867

I close this @degiz as all todos are done


PC MAP - Blue Line route

Bus stops missing along the following roads,

Main north Rd between Marshland Rd and Smith St Kaiapoi
Main north Rd between Harewood Rd and Redwood Library
All bus stops heading north from the city
Victoria St
Salisbury St
Victoria St
Kilmore St
Manchester St
Colombo St - outside South City

Closing and resolving to a single issue:
https://github.com/CanterburyRegionalCouncil/MetroInfoMaps/issues/34


SD3 training error

When I try to train SD3, it returns this error:
File "/kaggle/working/./sd-scripts/sd3_train.py", line 64, in train
   not args.train_text_encoder or not args.cache_text_encoder_outputs
AttributeError: 'Namespace' object has no attribute 'train_text_encoder'

Kohya forgot to comment out some code. In sd3_train.py, comment out lines 63-65
assert (
not args.train_text_encoder or not args.cache_text_encoder_outputs
), "cache_text_encoder_outputs is not supported when training text encoder / cache_text_encoder_outputs are supported even if you learn with text encoder"
@kohya-ss

Sorry I fixed again. Not it should work.

Sorry to bother you, but could you please also check #1390 . I have observed the problem that SD3 cannot fit on larger datasets in all script projects (OneTrainer, Diffuser, SimpleTuner, SD-scripts). Do you have any idea about this? Is it a problem with the SD3 model itself, or are all the training methods currently used not suitable for SD3?


Add static site generator Cryogen

I'm not the owner of this generator but I'm submitting it for inclusion

Thanks for contributing! Pulled in :)


Why u hate me 😭.

it's just a joke

That person isn't made to take command's from freaks like you

That person isn't made to take command's from freaks like you

ok first I was just joking with the title, second he asked for me too make the pull for the crash handler and still hasn't merged it (even tho he asked for it)

K


Support raise_signal_exceptions

https://github.com/Betterment/delayed#migrating-from-delayedjob states "that some configurations, like queue_attributes, exit_on_complete, backend, and raise_signal_exceptions have been removed entirely." I think the lack of raise_signal_exceptions (and the reliance on the behaviour described in https://github.com/Betterment/delayed#running-a-worker-process) could prevent me from suggesting switching over from delayed_job to delayed. Would it be difficult to support raise_signal_exceptions and are there any concerns with the idea of supporting it?

Can you say more about what your concerns are with the delayed behavior? Delayed's behavior prioritizes finishing jobs that have begun to the extent possible before worker shutdown in an attempt not to waste work and minimize job latency. It also leans into the assumption that not every job payload will have been implemented with ideal semantic idempotency. In our view having a more opinionated and curated worker drain/deployment process is an advantage, but would love to learn more about your context.

We currently use Delayed::Worker.raise_signal_exceptions = :term with delayed_job. I'm hoping that we can switch over to delayed with minimal work/changes needed, and thereby benefit from the performance enhancements it has, as a quick win.
We restart the job servers whenever we deploy (every few days), and we have jobs that take many hours to run. I'm concerned that without this configuration option, after a deployment we'd have jobs that would take a very long time before they can retry.
Thanks for asking @jmileham . Is there more information I should try provide to better speak to your question?

So you're looking to switch to delayed but would need to extend the job timeout, and aren't looking to implement a long-lived draining period in your infra coordination right away? Makes sense. I'll tag out now because @smudge will have smarter thoughts about where to go from here.

Right! Thanks


Update Readme

The readme file seems to be outdated. Specifically the what's the future of the project section.
🐞 Problem

💡 Possible solutions

📋  Steps to solve the problem

Comment below about what you've started working on.
Add, commit, push your changes
Submit a pull request and add this in comments - Addresses #<put issue number here>
Ask for a review in comments section of pull request
Celebrate your contribution to this project 🎉

True, I think I wrote that when the future of the project was unclear :) I assign this to myself!


Setting up the marble demo on my custom blockhcain from hyperledger fabric dev-net

is it possible to run this marble demo on the hyperledger/fabric local network?

https://github.com/IBM-Blockchain/marbles/blob/master/local_blockchain.md

yes you can, https://github.com/IBM-Blockchain/marbles/blob/master/tutorial_part1.md


ItemsRepeater inside a ScrollViewer with odd behaviour when it changes size

Describe the bug
So I encountered some odd behavior when modifying the visibility of items in a ItemsRepeater that was inside a ScrollViewer: When the number of items exceeded a certain threshold I could no longer scroll properly without the ScrollViewer becoming jittery after I had collapsed an item.
Example:

After some investigation I observed that after an item had been collapsed the SizeChanged event on the ItemsRepeater kept being called whenever I scrolled. I expected that SizeChanged would be called once when I collapsed the item, but it kept being called and the Scrollbar on the ScrollViewer kept changing size. Also, in some cases I could no longer scroll to the end of the ScrollViewer.
So the workaround I used was to increase the HorizontalCacheLength of the ItemsRepeater. For the purposes of my application that should work out fine.
More Generally I don't think this an issue specifically with collapsing an item, but rather the change in size of the ItemRepeater's items or when items have a non-uniform size. I guess there is a cache limit at play here given increasing the cache length helps, but I still think that having a too low cache limit should not result in scrolling leading to the ItemRepeater resizing over and over again.
Edit:  After fiddling some more with this I noticed that it is enough that one of Items have initially a different size to make it trigger resizes for ItemsRepeater.
Steps to reproduce the bug
There are probably easier ways of reproducing this, but here's what I did:

Create an empty C++/winrt WinUI3 project
Add a frame to the MainWindow and navigate to the page below
Create a new page with the following content: A ScrollViewer with an ItemsRepeater inside it. The source of the ItemsRepeater is just a list of strings, there should be at least 20 items in the list. The full extent of ItemsRepeater should be significantly larger than the width of the ScrollViewer.
Add a Tapped event to the DataTemplate for the items that collapses the item when tapped.
Tap an item then Scroll the ScrollViewer and observe the behavior the Scrollbar.

Here's the full code for the page I used to test it and generated the gifs underneath with:
MainPage.xaml
<?xml version="1.0" encoding="utf-8"?>
<Page
    x:Class="ScrollViewerAndItemsRepeaterIssue.MainPage"
    xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
    xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
    xmlns:local="using:ScrollViewerAndItemsRepeaterIssue"
    xmlns:d="http://schemas.microsoft.com/expression/blend/2008"
    xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006"
    mc:Ignorable="d" Background="Aquamarine">

    <Page.Resources>
        <ResourceDictionary>
            <StackLayout x:Name="HorizontalStackLayout" Orientation="Horizontal" Spacing="0"/>
            <NonVirtualizingLayout x:Name="nvl" ></NonVirtualizingLayout>

            <DataTemplate x:Key="ItemTemplate" x:DataType="x:String">
                <Border Background="Red" BorderBrush="Black" BorderThickness="1" Width="64" Height="64" Tapped="ItemTapped">
                    <TextBlock FontSize="38" HorizontalAlignment="Center" VerticalAlignment="Center" Text="{x:Bind}"></TextBlock>
                </Border>
            </DataTemplate>

        </ResourceDictionary>
    </Page.Resources>

    <StackPanel HorizontalAlignment="Center" VerticalAlignment="Center">
        <ScrollViewer Height="64" Width="300" Background="Green" HorizontalScrollMode="Enabled" HorizontalScrollBarVisibility="Visible">
            <ItemsRepeater x:Name="Repeater" Layout="{StaticResource HorizontalStackLayout}" SizeChanged="RepeaterSizeChanged" ItemsSource="{x:Bind Items}" ItemTemplate="{StaticResource ItemTemplate}"/>
        </ScrollViewer>
        <StackPanel Orientation="Horizontal" HorizontalAlignment="Center">
            <TextBlock Text="ItemRepeater SizeChanged event count: "/>
            <TextBlock x:Name="RepaterSizeChangeCounter"/>
        </StackPanel>

    </StackPanel>
</Page>

MainPage.idl
namespace ScrollViewerAndItemsRepeaterIssue
{
    [default_interface]
    runtimeclass MainPage : Microsoft.UI.Xaml.Controls.Page
    {
        MainPage();
        Windows.Foundation.Collections.IObservableVector<String> Items{ get; };
    }
}

MainPage.h
#pragma once

#include "MainPage.g.h"

namespace winrt::ScrollViewerAndItemsRepeaterIssue::implementation
{
    struct MainPage : MainPageT<MainPage>
    {
        MainPage();

        void ItemTapped(winrt::Windows::Foundation::IInspectable const& sender, winrt::Microsoft::UI::Xaml::Input::TappedRoutedEventArgs const& e);

        winrt::Windows::Foundation::Collections::IObservableVector<hstring> Items();

        winrt::Windows::Foundation::Collections::IObservableVector<hstring> m_Items;
        void RepeaterSizeChanged(winrt::Windows::Foundation::IInspectable const& sender, winrt::Microsoft::UI::Xaml::SizeChangedEventArgs const& e);
    };
}

namespace winrt::ScrollViewerAndItemsRepeaterIssue::factory_implementation
{
    struct MainPage : MainPageT<MainPage, implementation::MainPage>{};
}

MainPage.cpp
#include "pch.h"
#include "MainPage.xaml.h"
#if __has_include("MainPage.g.cpp")
#include "MainPage.g.cpp"
#endif

using namespace winrt;
using namespace Microsoft::UI::Xaml;

namespace winrt::ScrollViewerAndItemsRepeaterIssue::implementation
{
    MainPage::MainPage()
    {
        m_Items = winrt::single_threaded_observable_vector<hstring>();
        for (int i = 0; i < 20; i++)
        {
            m_Items.Append(L"☺");
        }
    }

    winrt::Windows::Foundation::Collections::IObservableVector<hstring> MainPage::Items()
    {
        return m_Items;
    }

    void MainPage::ItemTapped(winrt::Windows::Foundation::IInspectable const& sender, winrt::Microsoft::UI::Xaml::Input::TappedRoutedEventArgs const& e)
    {
        auto item = sender.as<winrt::Microsoft::UI::Xaml::Controls::Border>();
        item.Visibility(winrt::Microsoft::UI::Xaml::Visibility::Collapsed);
    }

    void MainPage::RepeaterSizeChanged(winrt::Windows::Foundation::IInspectable const& sender, winrt::Microsoft::UI::Xaml::SizeChangedEventArgs const& e)
    {
        static int32_t SizeCounter = 1;
        RepaterSizeChangeCounter().Text(std::to_wstring(SizeCounter++).c_str());
    }
}

Expected behavior
That the ScrollViewer would be able to figure out how much it can scroll.
Screenshots
Some gifs of the behavior that I am seeing (note the SizeChanged counter under the ItemsRepeater that increments each time it is called).
Here is normal behavior, no items having been collapsed

Here I collapse one of the items. Notice how the Scrollbar's size fluctuates:

Here I try to drag quickly to the end of the ScrollView, but it is struggling to reach the end.

Here it is completely stuck and cannot scroll to the end.

NuGet package version
WinUI 3 - Windows App SDK 1.5.2: 1.5.240404000
Windows version
Windows 11 (22H2): Build 22621
Additional context
No response

Some of this looks like a duplicate of #9308, but that might not cover all of the odd behaviors reported here.

Yeah I think it's probably related. But I thought the way the scrolling after the ItemsRepeater has changed size once results in more SizeChanged calls was curious enough to warrant a report.

I have the same issue here and can't scroll to the end. Are there any possible workarounds on this issue?
scrollviewer_bug1.mp4

So the work-around we used was increasing the HorizontalCacheLength property of the ItemsRepeater. So you can try increase that. There's possibly some performance hit there, but for our application it was an acceptable tradeoff.

@torleifat, my comments in https://github.com/microsoft/microsoft-ui-xaml/issues/9775 apply here too.
"When the number of items exceeded a certain threshold I could no longer scroll properly without the ScrollViewer becoming jittery after I had collapsed an item."
That's expected because you're using the virtualizing StackLayout. It looks at the realized items sizes and extrapolates to figure the total extent of the ItemsRepeater. As you scroll, the average realized item size changes, and the approximated ItemsRepeater size changes too. Thus the ScrollBar has to jump.
"After some investigation I observed that after an item had been collapsed the SizeChanged event on the ItemsRepeater kept being called whenever I scrolled. I expected that SizeChanged would be called once when I collapsed the item, but it kept being called and the Scrollbar on the ScrollViewer kept changing size."
Yes - my comments above should explain this now.
"Also, in some cases I could no longer scroll to the end of the ScrollViewer."
I'd suggest you apply my recommendations in issue #9775. You should then no longer run into these problems.
"So the workaround I used was to increase the HorizontalCacheLength of the ItemsRepeater. For the purposes of my application that should work out fine."
Correct - by increasing the HorizontalCacheLength value you get rid of the virtualization aspect of the StackLayout. So all items become realized and there's no more guessing about what the total extent is.
"More Generally I don't think this an issue specifically with collapsing an item, but rather the change in size of the ItemRepeater's items or when items have a non-uniform size. I guess there is a cache limit at play here given increasing the cache length helps,"
You are correct. The item size variability and item virtualization combined result in your observations.
But remember that using the ItemsRepeater.ElementPrepared (as shown in #9775) addresses is a strict minimum, and modifying the ItemsSource is the best approach.
" but I still think that having a too low cache limit should not result in scrolling leading to the ItemRepeater resizing over and over again."
That's by design for the StackLayout, as explained above.
Hope this helps. Thanks, -Régis.


Refactor codecs

This has support for

Codecs that encode / decode specific Clickhouse response formats
Handling binary responses from clickhouse
Support for native clickhouse types, including dates and lists
Breaking queries into the part that goes in the query string and the part that goes into the post body

It also makes use of the Query to do the work of encoding / decoding the requests and responses from Clickhouse.

Cool! We will see it soon


Fix paper reference in init_functions.py

I think this is supposed to be referencing "Transformers without Tears: Improving the Normalization of Self-Attention" ( https://arxiv.org/abs/1910.05895) which was published in 2019 not 2010

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Great catch. Thank you!


[0.8.2] Error: CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/RoadLines/St_Road_XCross_LaneMarking.St_Road_XCross_LaneMarking'

i use Carla 0.8.2 and UE4.18.3. And i download content 0.8.2 by myself. i extract it in /Unreal/CarlaUE4/content . And use ./Setup.sh -s and the ROOT_UE4=(my UE4 folderr) ./Rebuild.sh. It report errors as shown below.
[2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: === Handled ensure: === [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error:  [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: Ensure condition failed: !FPackageName::IsShortPackageName(Path) [File:/home/chrish/carla/UnrealEngine-4.18.3-release/Engine/Source/Runtime/CoreUObject/Private/UObject/SoftObjectPath.cpp] [Line: 45] [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: Cannot create SoftObjectPath with short package name '~'! You must pass in fully qualified package names [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: Stack:  [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2b4168cf FLinuxPlatformStackWalk::CaptureStackBackTrace(unsigned long long*, unsigned int, void*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2b2bccd5 FGenericPlatformStackWalk::StackWalkAndDump(char*, unsigned long, int, void*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2b41686c FLinuxPlatformStackWalk::StackWalkAndDumpEx(char*, unsigned long, int, unsigned int, void*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2b45e202 FDebug::EnsureFailed(char const*, char const*, int, wchar_t const*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2b45ed9f FDebug::OptionallyLogFormattedEnsureMessageReturningFalse(bool, char const*, char const*, int, wchar_t const*, ...) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2abfb688 FSoftObjectPath::SetPath(FString) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2abfc55c FSoftObjectPath::ImportTextItem(wchar_t const*&, int, UObject*, FOutputDevice*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2aa0cf9c UScriptStruct::ImportText(wchar_t const*, void*, UObject*, int, FOutputDevice*, FString const&, bool) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2ab6e124 UStructProperty::ImportText_Internal(wchar_t const*, void*, int, UObject*, FOutputDevice*) const [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2aae1832 UObject::LoadConfig(UClass*, wchar_t const*, unsigned int, UProperty*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2ac25529 FObjectInitializer::PostConstructInit() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2ac24aed FObjectInitializer::~FObjectInitializer() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2aa108a0 UClass::CreateDefaultObject() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d1ca433bc UGameMapsSettings::GetGameDefaultMap() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d28603b08 FURL::FURL(wchar_t const*) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d27eea6f7 UNetConnection::UNetConnection(FObjectInitializer const&) [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2aa10896 UClass::CreateDefaultObject() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2aa105df UClass::CreateDefaultObject() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d2ac0ad67 ProcessNewlyLoadedUObjects() [2019.01.30-05.56.22:887][  0]LogOutputDevice: Error: [Callstack] 0x0000000000419f48 FEngineLoop::PreInit(wchar_t const*) [2019.01.30-05.56.22:888][  0]LogOutputDevice: Error: [Callstack] 0x0000000000429be8 GuardedMain(wchar_t const*) [2019.01.30-05.56.22:888][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d20172e34 CommonLinuxMain(int, char**, int (*)(wchar_t const*)) [2019.01.30-05.56.22:888][  0]LogOutputDevice: Error: [Callstack] 0x00007f2d1fbbe830 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f2d1fbbe830] [2019.01.30-05.56.22:888][  0]LogOutputDevice: Error: [Callstack] 0x0000000000416a69 /home/chrish/carla/UnrealEngine-4.18.3-release/Engine/Binaries/Linux/UE4Editor(_start+0x29) [0x416a69] [2019.01.30-05.56.22:888][  0]LogOutputDevice: Error:
[2019.01.30-05.56.30:235][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png' error. [2019.01.30-05.56.30:235][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png [2019.01.30-05.56.30:236][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:236][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:237][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:237][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:238][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png' error. [2019.01.30-05.56.30:238][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png [2019.01.30-05.56.30:239][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:239][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:239][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:240][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:240][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png' error. [2019.01.30-05.56.30:240][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png [2019.01.30-05.56.30:241][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:241][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:242][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:242][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:243][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png' error. [2019.01.30-05.56.30:243][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_24x.png [2019.01.30-05.56.30:244][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:244][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:244][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png' error. [2019.01.30-05.56.30:245][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Mac/Platform_Mac_128x.png [2019.01.30-05.56.30:254][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_24x.png' error. [2019.01.30-05.56.30:254][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_24x.png [2019.01.30-05.56.30:255][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:255][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:256][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:256][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:257][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_24x.png' error. [2019.01.30-05.56.30:257][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_24x.png [2019.01.30-05.56.30:258][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:258][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:259][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:259][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:260][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ATC_24x.png' error. [2019.01.30-05.56.30:260][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ATC_24x.png [2019.01.30-05.56.30:260][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:260][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:261][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:261][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:262][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_DXT_24x.png' error. [2019.01.30-05.56.30:262][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_DXT_24x.png [2019.01.30-05.56.30:263][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:263][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:263][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:263][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:264][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ETC1_24x.png' error. [2019.01.30-05.56.30:264][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ETC1_24x.png [2019.01.30-05.56.30:265][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:265][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:266][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:266][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:266][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ETC2_24x.png' error. [2019.01.30-05.56.30:267][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ETC2_24x.png [2019.01.30-05.56.30:268][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:268][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:268][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:269][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:269][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_PVRTC_24x.png' error. [2019.01.30-05.56.30:269][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_PVRTC_24x.png [2019.01.30-05.56.30:270][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:270][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:271][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:271][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:272][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ASTC_24x.png' error. [2019.01.30-05.56.30:272][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_ASTC_24x.png [2019.01.30-05.56.30:273][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error. [2019.01.30-05.56.30:273][  0]LogSlate: Could not find file for Slate resource: ../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png [2019.01.30-05.56.30:274][  0]LogStreaming: Warning: Failed to read file '../../../Engine/Content/Editor/Slate/Launcher/Android/Platform_Android_128x.png' error.
`
1001[2019.01.30-05.56.40:401][  0]LogLinker: Warning: 无法寻找到文件'/Game/Static/SideWalk/St_Road_XCross_Sidewalk1'
1001[2019.01.30-05.56.40:402][  0]LogLinker: Warning: 无法寻找到文件'/Game/Static/SideWalk/St_Road_XCross_Sidewalk1'
[2019.01.30-05.56.40:402][  0]LogUObjectGlobals: Warning: 寻找对象'StaticMesh /Game/Static/SideWalk/St_Road_XCross_Sidewalk1.St_Road_XCross_Sidewalk1'失败
CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/SideWalk/St_Road_XCross_Sidewalk1.St_Road_XCross_Sidewalk1'
[2019.01.30-05.56.40:402][  0]Error: CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/SideWalk/St_Road_XCross_Sidewalk1.St_Road_XCross_Sidewalk1'
[2019.01.30-05.56.40:402][  0]Error: CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/SideWalk/St_Road_XCross_Sidewalk1.St_Road_XCross_Sidewalk1'
1001[2019.01.30-05.56.40:403][  0]LogLinker: Warning: 无法寻找到文件'/Game/Static/SideWalk/St_Road_XCross_Sidewalk2'
1001[2019.01.30-05.56.40:405][  0]LogLinker: Warning: 无法寻找到文件'/Game/Static/SideWalk/St_Road_XCross_Sidewalk2'
[2019.01.30-05.56.40:405][  0]LogUObjectGlobals: Warning: 寻找对象'StaticMesh /Game/Static/SideWalk/St_Road_XCross_Sidewalk2.St_Road_XCross_Sidewalk2'失败
CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/SideWalk/St_Road_XCross_Sidewalk2.St_Road_XCross_Sidewalk2'
[2019.01.30-05.56.40:405][  0]Error: CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/SideWalk/St_Road_XCross_Sidewalk2.St_Road_XCross_Sidewalk2'
[2019.01.30-05.56.40:415][  0]LogUObjectBase: Warning: Error: CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/SideWalk/St_Road_XCross_Sidewalk4.St_Road_XCross_Sidewalk4'
[2019.01.30-05.56.40:415][  0]LogUObjectBase: Warning: Error: CDO Constructor (CarlaMapGenerator): Failed to find StaticMesh'/Game/Static/RoadLines/St_Road_XCross_LaneMarking.St_Road_XCross_LaneMarking'
[2019.01.30-05.57.24:828][  0]LogHttp: Warning: 0x7f0419e75380: request failed, libcurl error: 52 (Server returned nothing (no headers, no data))
[2019.01.30-05.57.24:828][  0]CrashReportClientLog: OnProcessRequestComplete(), State=SendingFiles bSucceeded=0
[2019.01.30-05.57.24:828][  0]CrashReportClientLog: Warning: File upload failed to data router
[2019.01.30-05.57.24:828][  0]CrashReportClientLog: State change from SendingFiles to Cancelled
[2019.01.30-05.57.25:463][  0]LogLinux: FLinuxPlatformMisc::RequestExit(0)
[2019.01.30-05.57.25:463][  0]LogGenericPlatformMisc: FPlatformMisc::RequestExit(0)
[2019.01.30-05.57.25:496][  0]CrashReportClientLog: Final state (Receiver) = Cancelled
[2019.01.30-05.57.25:496][  0]CrashReportClientLog: Final state (Receiver) = Unknown UploadState value
[2019.01.30-05.57.25:496][  0]LogExit: Preparing to exit.
[2019.01.30-05.57.25:497][  0]LogExit: Object subsystem successfully closed.
[2019.01.30-05.57.25:503][  0]LogModuleManager: Shutting down and abandoning module HTTP (8)
[2019.01.30-05.57.25:509][  0]LogModuleManager: Shutting down and abandoning module SSL (7)
[2019.01.30-05.57.25:511][  0]LogModuleManager: Shutting down and abandoning module CrashDebugHelper (4)
[2019.01.30-05.57.25:511][  0]LogModuleManager: Shutting down and abandoning module CoreUObject (2)
[2019.01.30-05.57.25:511][  0]LogExit: Exiting.
`
And it stop here. i wonder how can i fix it?
The Chinese "无法寻找到文件" means 'can't find the file'.
I compile Carla with Clang-3.9 and compile UE4 with Clang-5.0. Is that the cause of the problem?

This is probably caused because there was an error downloading the asset content. Try deleting the folder Unreal/CarlaUE4/Content and running
./Update.sh

Why is the path /Game/Carla/.. and not 'Unreal/CarlaUE4/Content'? Where are these files are being copied?

I've met this too

I've met this too

I've met this too with Carla 0.8.2 and UE4.18

I've met this too with Carla 0.8.2 and UE4.18

Content.tar.gz    99%[==================> ]   6.01G  5.15MB/s  ,  1 second left .  ./Update.sh：54: 21796  Segment error , Core dumped , wget ${CONTENT_LINK} -O Content.tar.gz  (carla 0.9.5, UE4.21)
please help me!!!

Content.tar.gz 99%[==================> ] 6.01G 5.15MB/s , 1 second left . ./Update.sh：54: 21796 Segment error , Core dumped , wget ${CONTENT_LINK} -O Content.tar.gz (carla 0.9.5, UE4.21)
please help me!!!

I am stuck here as well. Can anyone point me in the right direction?


Issue deploying with docker-compose

Hi, I've read all the documentation and this project seems really nice; I tried to set it up mon my computer but I got some errors during the docker build (about 5 min after it started building). But actually, I'm not sure I am doing it the right way :

I am using a windows 11 computer with visual studio + docker desktop and WSL
I first make the git clone on my computer
I then copy and set up the .env file in the ./docker/ folder (because that's where I found the docker-compose.yaml file so I thought it was the right place to put it).
and then, still in the docker folder, I run the cli :  docker-compose up --build  -> it pulls a lot of file, but crashes after 5 min (strange message about VM crashing)
I do not have the opportunity to run the "make" command lines in the backend (and to be honnest, I was wondering where I should run those CLI anyway : in the docker Inguess ?)

Any help would be appreciated.
Thanks

hi @djuillard ,
Thank you for picking up the project; I don't have the Window environment, so I haven't tested it yet. I assume the WSL is a Linux-like environment, so I assume it should be similar to any Linux (correct me if I'm wrong).
From your above statement, the .env needs to put into build/ but it's not the reason for the docker compose build, since docker compose build does not require it.
I think to narrow down the crash reason, we need to further understand the detailed VM crashing reason, maybe due to OOM or disk full or others. Maybe you want to another try and catch the reasons to see.
Last, for the make command, sorry for the confusion. To run it, we basically stay at the root of the auto-news folder. I will enhance the wiki to point this out :+1:

thank you for your reply. Indeed the VM crash may be linked to something else. I freed up some space, and did not have the same issue.... but another one :
PS C:\Users\damien\Documents\3. DEV\auto-news\auto-news\docker> docker-compose up --build
time="2024-04-30T12:33:10+02:00" level=warning msg="The "MYSQL_PROJ_DIR" variable is not set. Defaulting to a blank string."
time="2024-04-30T12:33:10+02:00" level=warning msg="The "POSTGRES_PROJ_DIR" variable is not set. Defaulting to a blank string."
time="2024-04-30T12:33:10+02:00" level=warning msg="The "REDIS_PROJ_DIR" variable is not set. Defaulting to a blank string."
time="2024-04-30T12:33:10+02:00" level=warning msg="The "AIRFLOW_UID" variable is not set. Defaulting to a blank string."
time="2024-04-30T12:33:10+02:00" level=warning msg="The "AIRFLOW_UID" variable is not set. Defaulting to a blank string."
[+] Building 512.4s (17/17)                                                                                docker:default
[+] Building 512.5s (17/17)                                                                                docker:default
=> [airflow-init internal] load build definition from Dockerfile                                                                                0.0s
[+] Building 515.5s (42/48)                                                                                docker:default
=> [airflow-init internal] load build definition from Dockerfile                                                                                0.0s
=> => transferring dockerfile: 1.75kB                                                                                0.0s
=> [airflow-init-user internal] load metadata for docker.io/apache/airflow:2.7.3-python3.11                                                                                2.7s
=> [airflow-init auth] apache/airflow:pull token for registry-1.docker.io                                                                                0.0s
=> [airflow-init internal] load .dockerignore                                                                                0.0s
=> => transferring context: 2B                                                                                0.0s
=> [airflow-init-user  1/11] FROM docker.io/apache/airflow:2.7.3-python3.11@sha256:a8c67ae095c03868e56c2d95c9a57a1b9a47e87247d923e329cb7c15e6d47ee5                                                                                0.0s
=> [airflow-init internal] load build context                                                                                0.0s
=> => transferring context: 38B                                                                                0.0s
=> CACHED [airflow-init-user  2/11] WORKDIR /opt/airflow                                                                                0.0s
=> CACHED [airflow-init-user  3/11] RUN set -ex;   deps='     make     g++     vim     net-tools     curl     wget     lsof     less     iputils-ping     telnet     procps     git     libgomp1     jq     ffmpeg   ';   apt-get update && apt-get install -y --no-install-recomm  0.0s
=> CACHED [airflow-init-user  4/11] RUN set -ex;   git config --global --add safe.directory /opt/airflow/run/auto-news   && git config --global pull.ff only                                                                                0.0s
=> CACHED [airflow-init-user  5/11] RUN set -ex;   echo "vm.overcommit_memory = 1" >> /etc/sysctl.conf                                                                                0.0s
=> CACHED [airflow-init-user  6/11] RUN set -ex;   mkdir -p ~/.ssh && echo "StrictHostKeyChecking=no" > ~/.ssh/config                                                                                0.0s
=> CACHED [airflow-init-user  7/11] RUN set -ex;   ln -snf /opt/airflow ~/airflow                                                                                0.0s
=> CACHED [airflow-init-user  8/11] RUN set -ex;   git config --global --add safe.directory /opt/airflow/run/auto-news   && git config --global pull.ff only                                                                                0.0s
=> CACHED [airflow-init-user  9/11] RUN set -ex;   ln -snf /opt/airflow ~/airflow                                                                                0.0s
=> CACHED [airflow-init 10/11] ADD requirements.txt .                                                                                0.0s
=> [airflow-init 11/11] RUN set -ex;   pip install --no-cache-dir -r requirements.txt   && rm -rf ~/.cache/pip                                                                                465.2s
=> [airflow-init] exporting to image                                                                                45.7s
=> => exporting layers                                                                                45.6s
=> => writing image sha256:09618fd1c31621df93d956d9bbb6aec427092c0f5469a63e8d5e7869b3e1251d                                                                                0.0s
=> => naming to docker.io/library/docker-airflow-init                                                                                0.0s
=> [airflow-scheduler internal] load build definition from Dockerfile                                                                                0.1s
=> => transferring dockerfile: 1.75kB                                                                                0.0s
=> [airflow-worker internal] load build definition from Dockerfile                                                                                0.2s
=> => transferring dockerfile: 1.75kB                                                                                0.0s
=> [airflow-webserver internal] load build definition from Dockerfile                                                                                0.2s
=> => transferring dockerfile: 1.75kB                                                                                0.0s
=> [airflow-triggerer internal] load build definition from Dockerfile                                                                                0.2s
=> => transferring dockerfile: 1.75kB                                                                                0.0s
=> [airflow-scheduler auth] apache/airflow:pull token for registry-1.docker.io                                                                                0.0s
=> [airflow-worker internal] load .dockerignore                                                                                0.1s
=> => transferring context: 2B                                                                                0.0s
=> [airflow-triggerer internal] load .dockerignore                                                                                0.1s
=> => transferring context: 2B                                                                                0.0s
=> [airflow-webserver internal] load .dockerignore                                                                                0.0s
=> => transferring context: 2B                                                                                0.0s
=> [airflow-scheduler internal] load .dockerignore                                                                                0.1s
=> => transferring context: 2B                                                                                0.0s
=> [airflow-webserver internal] load build context                                                                                0.1s
=> => transferring context: 38B                                                                                0.0s
=> [airflow-worker internal] load build context                                                                                0.1s
=> => transferring context: 719B                                                                                0.0s
=> [airflow-scheduler internal] load build context                                                                                0.1s
=> => transferring context: 719B                                                                                0.0s
=> CACHED [airflow-webserver 10/11] ADD requirements.txt .                                                                                0.0s
=> CACHED [airflow-webserver 11/11] RUN set -ex;   pip install --no-cache-dir -r requirements.txt   && rm -rf ~/.cache/pip                                                                                0.0s
=> [airflow-triggerer internal] load build context                                                                                0.1s
=> => transferring context: 719B                                                                                0.0s
=> [airflow-webserver] exporting to image                                                                                0.0s
=> => exporting layers                                                                                0.0s
=> => writing image sha256:741feb25559205c565e915cacfada8a67768cbce5db915984b120d11acba69f5                                                                                0.0s
=> => naming to docker.io/library/docker-airflow-webserver                                                                                0.0s
=> [airflow-worker] exporting to image                                                                                0.0s
=> => exporting layers                                                                                0.0s
=> => writing image sha256:570b30efe7338b39410146191a0b66c6856ec7b733cc4c2be51dd742c262683c                                                                                0.0s
=> => naming to docker.io/library/docker-airflow-worker                                                                                0.0s
=> [airflow-triggerer] exporting to image                                                                                0.0s
=> => exporting layers                                                                                0.0s
=> => writing image sha256:5551fba784629af820b763b91a161efc10c59c3a237a3d74fdba3f63b35e5a06                                                                                0.0s
=> => naming to docker.io/library/docker-airflow-triggerer                                                                                0.0s
=> [airflow-scheduler] exporting to image                                                                                0.0s
=> => exporting layers                                                                                0.0s
=> => writing image sha256:bb28df26a9ac680806d4049b2b5523e3f38c85fcedf4f3cdb6218d4291821128                                                                                0.0s
=> => naming to docker.io/library/docker-airflow-scheduler                                                                                0.0s
=> [airflow-init-user internal] load build definition from Dockerfile                                                                                0.0s
=> => transferring dockerfile: 1.75kB                                                                                0.0s
=> [airflow-init-user internal] load .dockerignore                                                                                0.0s
=> => transferring context: 2B                                                                                0.0s
=> [airflow-init-user internal] load build context                                                                                0.0s
=> => transferring context: 38B                                                                                0.0s
=> CACHED [airflow-init-user 10/11] ADD requirements.txt .                                                                                0.0s
=> CACHED [airflow-init-user 11/11] RUN set -ex;   pip install --no-cache-dir -r requirements.txt   && rm -rf ~/.cache/pip                                                                                0.0s
=> [airflow-init-user] exporting to image                                                                                0.0s
=> => exporting layers                                                                                0.0s
=> => writing image sha256:23b0dbf882a09b719a1a868c04ddf49c20a600b459a5ab58507c5b6b1e38558b                                                                                0.0s
=> => naming to docker.io/library/docker-airflow-init-user                                                                                0.0s
Error response from daemon: network bot_network not found
PS C:\Users\damien\Documents\3. DEV\auto-news\auto-news\docker>

I see, thank you for the detailed logs, which give us the direct clue, the reason is missing the preparation step before building the image, from the wiki, the command to build the backend is:
make deps && make build && make deploy && make init

The first make command will finish the preparation step, aka create necessary folders and create "docker network", it's recommended to run above make command for the building (install it before actual building), in case not, we can manually run the commands line by line here: https://github.com/finaldie/auto-news/blob/main/Makefile#L49-L71
And, last, similar for make deploy and make init, require some manual fix if not using make. Hope that helps a little.

hi @djuillard ,
Can I assume that the issue has been solved? close it for now, and reopen it if need further discussion, thanks a lot.


Feature: expose optimize_indices method in both Python and Node APIs

SDK
Python, Node
Description
https://lancedb.github.io/lance/api/python/lance.html#lance.dataset.DatasetOptimizer.optimize_indices
And add docs to use this functionality.

we do have table.optimize() which optimizes everything..
instead of exposing a new method, what if we exposed some options on there to only optimize the indices, skipping compaction and pruning

we have added optimize_indices to python and node


Bug: wrong splitter constant

Dear William,
Recently I discovered a bug (wrong Splitter constant for doubles), please see the issue for more info:
https://github.com/artem-ogre/CDT/issues/100
Would you be interested in fixing it or accepting a PR?

Here's the commit with a fix: https://github.com/artem-ogre/CDT/commit/02a655bd9e0a61dc12756bc4473a9b9e3d152d05


Gas Repricing EIP Adoption

Required for upcoming hardfork. Ideally, understand the contract changes needed by end of sprint.
https://celo-org.slack.com/archives/CP5V8KF51/p1628693424048700

discuss on governance call

check optics contracts? cc @pranaymohan


Version 0.1.1 doesn't have a Git 4_1 client

0.1.0b1 had a git/v4_1/git_client.py module. When I upgraded to 0.1.1, that file no longer exists. v4_0 still has git_client.py, so I think this is a codegen bug.

@vtbassmatt Thanks for pointing this out.  I'll try and get a fix published today.

0.1.2 has been published with the fix.


Code samples don't expect Response?

The code samples do not compile, as the Azure SDK returns Response<T>.
e.g. code sample says:
// List all blobs in the container
await foreach (BlobItem blobItem in containerClient.GetBlobsAsync())
{
    Console.WriteLine("\t" + blobItem.Name);
}

Which doesn't compile. Working version is:
// List all blobs in the container
await foreach (BlobItem blobItem in containerClient.Value.GetBlobsAsync())
{
    Console.WriteLine("\t" + blobItem.Name);
}

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 60e56e69-1c44-2056-ad5f-319535e4b525
Version Independent ID: 49fa6098-0b8e-ebf5-efe7-f50f3604e325
Content: Quickstart: Azure Blob storage library v12 - .NET
Content Source: articles/storage/blobs/storage-quickstart-blobs-dotnet.md
Service: storage
Sub-service: blobs
GitHub Login: @mhopkins-msft
Microsoft Alias: mhopkins

@mattfrear Thanks for the question! We are investigating and will update you shortly.

Are using using the latest version of the Storage client library, which is version 12.5.1.
Checking the source code for GetBlobsAsync. It is defined as follows:
public virtual AsyncPageable GetBlobsAsync(
BlobTraits traits = BlobTraits.None,
BlobStates states = BlobStates.None,
string prefix = default,
CancellationToken cancellationToken = default) =>
new GetBlobsAsyncCollection(this, traits, states, prefix).ToAsyncCollection(cancellationToken);
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

Are using using the latest version of the Storage client library, which is version 12.5.1.
Checking the source code for GetBlobsAsync. It is defined as follows:
public virtual AsyncPageable GetBlobsAsync(
BlobTraits traits = BlobTraits.None,
BlobStates states = BlobStates.None,
string prefix = default,
CancellationToken cancellationToken = default) =>
new GetBlobsAsyncCollection(this, traits, states, prefix).ToAsyncCollection(cancellationToken);

Hi @SumanthMarigowda-MSFT
I am using NuGet package Azure.Storage.Blobs, 12.5.0.
The source code at the GitHub link which you have posted above, is different to the code sample you have posted. Please check the GitHub link you posted. The source code is:
public virtual AsyncPageable<BlobItem> GetBlobsAsync(
            BlobTraits traits = BlobTraits.None,
            BlobStates states = BlobStates.None,
            string prefix = default,
            CancellationToken cancellationToken = default) =>
            new GetBlobsAsyncCollection(this, traits, states, prefix).ToAsyncCollection(cancellationToken);

23 months later and this still not fixed, @SumanthMarigowda-MSFT-zz


Rework MARSConnection state machine

The MARSConnection class uses a confusing implicit state machine in HandleRecieveComplete to demux incoming packets and dispatch them to the correct MARSHandle instances. This PR reworks that state machine to be explicit allowing easier visualization of exactly what is happening as packets travel through it. It also allows a small optimization to be added which is where a packet header is decoded and the rest of the packet contents is exactly the payload it will be forwarded rather than reconstructed, this cuts down on copies allowing faster running.

For coverage I'm relying on the standard tests. I rewrote and then ran all the functional and manual tests with forced managed mode. The first few times I found some problems and resolved them so it's certainly being used. I also had to track individual packet lifetimes as you can tell from the code I needed to add into Packet.Debug.cs and for that i used a version of the repro from 659 (which was where @cheenamalhotra noticed that there were packets being dropped to the GC) so I have run that for a while while exercises the single packet passthrough because they're small packets.
I haven't tried to benchmark this because the main purpose was correctness and code clarity but it's a good point, I should see if anything interesting has changed. We should gain some memory back from recycling and a tiny amount of cpu on single packet reads.

I tried to get some numbers and it looked like there might be a slight regression but I've found that there's also a very subtle locking issue as well that only seems to show under high load. I'm going to see what I can do to track it down but until I do please consider this too dangerous to merge.

Incidentally eiriktsarpalis posted a really good example of why I choose to use inline typeof(T) instead of put it into a variable https://github.com/dotnet/runtime/pull/46414#discussion_r589728897

Also, can you make some changes and push them back to the pipelines to rerun the the tests? I could not do it from our side.

Here are my understanding(feel free to verify it or replace it with a better version):

I spent some time thinking through and trying to draw out a diagram and I couldn't produce anything better.
I think that the code has to be the final expression of what is going on. My hope was/is that there are enough comments and assertions to explain that is happening and guard against any harmful changes that might be introduced. I also hope that it's clear enough and fast enough that no-one needs to change or rewrite it any time soon.


Import prismaClient in lucia.ts

Thank you for Lucia and the stellar documentation! The prismaClient import might be missing in the SvelteKit lucia.ts example, unless I'm misunderstanding.

I've intentionally left it out since it's not a Prisma specific page, but I guess it doesn't work for Prisma and non-Prisma users in the current state, which is the worst option.

Can you update all the /start-here/getting-started.md files?

Sure, I've updated the other getting-starteds in the same way.

Thanks!

I have an addition here.. I could not figure out why my instance would not work, the problem was I needed to instantiate PrismaClient first (logically). But therefore, the example code is not correct. It should be something like:
import { PrismaClient } from '@prisma/client';

const client = new PrismaClient();

export const auth = lucia({
	adapter: prisma(client),
..

Making that client is very important. Right now, when just copy+pasting the examples, it won't work, and that's a bummer.

@rogiervandenberg You're right, I had to make the same addition. Feel free to write the PR, or let me know and I'll write it.


Add new rebus

Associated Issue: #121
Summary of Changes
Added Nosepin, which is the 'Nose' emoji and a pin.

Pull Request Test Coverage Report for Build 1027

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 87.143%

Totals

Change from base Build 937:
0.0%

Covered Lines:
158

Relevant Lines:
180

💛  - Coveralls


Release for swift 3?

Release for swift 3?

Just replace the public static fun colorFromHexCode with this piece of code:
var cString:String = hex.stringByTrimmingCharactersInSet(NSCharacterSet.whitespaceAndNewlineCharacterSet() as NSCharacterSet).uppercaseString

if (cString.hasPrefix("#")) {
  cString = cString.substringFromIndex(cString.startIndex.advancedBy(1))
}

if ((cString.characters.count) != 6) {
  return UIColor.grayColor()
}

var rgbValue:UInt32 = 0
NSScanner(string: cString).scanHexInt(&rgbValue)

(until the declaration of the red, green, blue, if you don't want to mess up with the return.
In short the whole function became:
    public static func colorFromHexCode(_ hex:String) -> OSColor!
    {
        var cString:String = hex.stringByTrimmingCharactersInSet(NSCharacterSet.whitespaceAndNewlineCharacterSet() as NSCharacterSet).uppercaseString

        if (cString.hasPrefix("#")) {
            cString = cString.substringFromIndex(cString.startIndex.advancedBy(1))
        }

        if ((cString.characters.count) != 6) {
            return UIColor.grayColor()
        }

        var rgbValue:UInt32 = 0
        NSScanner(string: cString).scanHexInt(&rgbValue)

        let red     = CGFloat(r) / 255.0
        let green   = CGFloat(g) / 255.0
        let blue    = CGFloat(b) / 255.0
        let alpha   = CGFloat(a) / 255.0
        return OSColor(red:red, green:green, blue:blue, alpha:alpha)
    }

it should work (at least it works for me).

Any update on this?

There is a pull request to fix this from @Jauzee @brynbellomy

Merged, thanks!


[SUPPORT] Not able to submit the spark-submit code into AWS EMR step execution

SPARK-SUBMIT failure in AWS EMR step execution

Have you gone through our FAQs? No

Join the mailing list to engage in conversations and get faster support at<EMAIL_ADDRESS>

If you have triaged this as a bug, then file an issue directly.

SPARK-SUBMIT failure in AWS EMR step execution
I am using the below SPARK-SUBMIT code in AWS EMR console. It's working fine without having any issues. But when we are planning to submit the code in AWS EMR step execution, it 's getting failed due to file does not exist.
Code -
spark-submit --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer
--packages org.apache.hudi:hudi-utilities-bundle_2.11:0.5.2-incubating,org.apache.spark:spark-avro_2.11:2.4.5
--master yarn --deploy-mode cluster
--conf spark.serializer=org.apache.spark.serializer.KryoSerializer
--conf spark.sql.hive.convertMetastoreParquet=false
/usr/lib/hudi/org.apache.hudi_hudi-utilities-bundle_2.11-0.5.2-incubating.jar
--table-type MERGE_ON_READ
--source-ordering-field empid
--props s3://apache-hudi-source-bkt/properties/dfs-source.properties
--source-class org.apache.hudi.utilities.sources.ParquetDFSSource
--target-base-path s3://apache-hudi-target-bkt/employee/hudi_employee --target-table aws-glue-clm-db.hudi_employee
--transformer-class org.apache.hudi.utilities.transform.AWSDmsTransformer
--payload-class org.apache.hudi.payload.AWSDmsAvroPayload
--enable-hive-sync
Error -

Our main objective is to automate the incremental data load process, as of now, we are manually executing the SPARK-SUBMIT code in EMR console.
Wants to know how to automate the hudi incremental load data process
A clear and concise description of what you expected to happen.
Environment Description

Hudi version : hudi-cli-0.7.0-amzn-1

Spark version :2.4.7-amzn-1

Hive version : 2.3.7-amzn-4

Hadoop version : 2.10.1-amzn-1

Storage (HDFS/S3/GCS..) : S3

Running on Docker? (yes/no) : No

Can any one please help us to rectify the above mentioned issue.

Can anybody help on the above issue

@tamil-balaiah This looks like a deployment problem with AWS EMR and not specifically a Hudi issue. Have you tried reaching out to the AWS support team ?
cc @umehrot2

@umehrot2 @zhedoubushishi : can you folks help out here. or loop in someone.

@umehrot2 @zhedoubushishi : gentle ping.

Sorry for the late reply. I also think this is not a Hudi specific issue, it's more like an EMR implementation issue. You can just open a customer support ticket to EMR.

Closing this for direct follow up with EMR support