[SPARK-28612][SQL] Add DataFrameWriterV2 API

What changes were proposed in this pull request?
This adds a new write API as proposed in the SPIP to standardize logical plans. This new API:

Uses clear verbs to execute writes, like append, overwrite, create, and replace that correspond to the new logical plans.
Only creates v2 logical plans so the behavior is always consistent.
Does not allow table configuration options for operations that cannot change table configuration. For example, partitionedBy can only be called when the writer executes create or replace.

Here are a few example uses of the new API:
df.writeTo("catalog.db.table").append()
df.writeTo("catalog.db.table").overwrite($"date" === "2019-06-01")
df.writeTo("catalog.db.table").overwritePartitions()
df.writeTo("catalog.db.table").asParquet.create()
df.writeTo("catalog.db.table").partitionedBy(days($"ts")).createOrReplace()
df.writeTo("catalog.db.table").using("abc").replace()

How was this patch tested?
Added DataFrameWriterV2Suite that tests the new write API. Existing tests for v2 plans.

@cloud-fan, please take a look at this PR with the new DSv2 write API, as discussed on the InsertInto thread.
@brkyvz, @mccheah, @jzhuge, and @dongjoon-hyun, you may also be interested in reviewing. Thanks!

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/13717/
Test PASSed.

Test build #108630 has started for PR 25354 at commit 10c7b8f.

Test build #108630 has finished for PR 25354 at commit 10c7b8f.

This patch fails to build.
This patch merges cleanly.
This patch adds the following public classes (experimental):
abstract class PartitionTransformExpression extends Expression with Unevaluable
case class Years(child: Expression) extends PartitionTransformExpression
case class Months(child: Expression) extends PartitionTransformExpression
case class Days(child: Expression) extends PartitionTransformExpression
case class Hours(child: Expression) extends PartitionTransformExpression
case class Bucket(numBuckets: Literal, child: Expression) extends PartitionTransformExpression
 implicit class OptionsHelper(options: Map[String, String])
trait WriteConfigMethods[R]
trait CreateTableWriter[T] extends WriteConfigMethods[CreateTableWriter[T]]

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108630/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/13719/
Test PASSed.

Test build #108632 has started for PR 25354 at commit 23a1188.

Test build #108632 has finished for PR 25354 at commit 23a1188.

This patch fails to generate documentation.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108632/
Test FAILed.

Thank you for pinging me, @rdblue . Could you fix the doc generation issue in order to pass the Jenkins?

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/13757/
Test PASSed.

Test build #108674 has started for PR 25354 at commit 33dde6d.

Test build #108674 has finished for PR 25354 at commit 33dde6d.

This patch fails to generate documentation.
This patch does not merge cleanly.
This patch adds no public classes.

Build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108674/
Test FAILed.

How do convert DSW.jdbc(url: String, table: String, connectionProperties: Properties) to DSWv2?
Maybe writeTo(table).asJdbc(url, connectionProperties).<DSWv2_Action>? Or set url and connectionProperties in options with a simple asJdbc()`?
BTW, a new JdbcCatalog CatalogPlugin type may store url and connectionProperties in catalog properties, thus easier for users to access Jdbc tables.

@jzhuge, options like connection properties and JDBC URL belong at the catalog level, not at the table level. Those are table-level configuration in v1 because there is no catalog that holds common options like the database connection URL.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/13761/
Test PASSed.

Test build #108676 has started for PR 25354 at commit 409a0bc.

@rdblue Catalog level properties sounds good to me.
Also realized that JdbcCatalog plugin type is not needed if the only things we want are the provider common options. Each provider can pick up common options from catalog properties automatically, e.g.:
spark.sql.catalog.<name>.<provider>.<provider_common_options>

Test build #108676 has finished for PR 25354 at commit 409a0bc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108676/
Test PASSed.

Is it possible to use this API with paths or URIs instead of table names?

Yes, it is. Instead of passing names to writeTo, you would pass a path or URI:
df.writeTo("s3://bucket/path/to/table").append()

The v2 identifiers SPIP includes how to represent a path-based table: PathIdentifier(path, name) that extends Identifier. The namespace of a PathIdentifier is a single level and contains a fully qualified path.
When we have a spec for how path-based tables behave, we can update writeTo to catch paths and pass PathIdentifier.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/13869/
Test PASSed.

Test build #108788 has started for PR 25354 at commit 4538721.

Test build #108788 has finished for PR 25354 at commit 4538721.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108788/
Test PASSed.

Test build #108947 has started for PR 25354 at commit 4538721.

Test build #108947 has finished for PR 25354 at commit 4538721.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108947/
Test FAILed.

Retest this please.

Test build #108986 has started for PR 25354 at commit 4538721.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14054/
Test PASSed.

Test build #108986 has finished for PR 25354 at commit 4538721.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/108986/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14492/
Test PASSed.

Test build #109429 has started for PR 25354 at commit 17fe1fd.

Test build #109429 has finished for PR 25354 at commit 17fe1fd.

This patch fails to build.
This patch merges cleanly.
This patch adds the following public classes (experimental):
  case class WorkerExecutorStateResponse(
  case class WorkerDriverStateResponse(
  case class WorkerSchedulerStateResponse(
  case class LaunchDriver(
 case class StandaloneResourceAllocation(pid: Int, allocations: Seq[ResourceAllocation])
abstract class FileCommitProtocol extends Logging
class ResourceAllocator(name: String, addresses: Seq[String]) extends Serializable
class RpcAbortException(message: String) extends Exception(message)
case class CatalystDataToAvro(
class BindingParquetOutputCommitter(
class PathOutputCommitProtocol(
class DecisionTreeParams(Params):
case class UnresolvedTable(v1Table: CatalogTable) extends Table
 implicit class IdentifierHelper(identifier: TableIdentifier)
class CatalogManager(conf: SQLConf) extends Logging
sealed trait RewritableTransform extends Transform
case class Milliseconds(child: Expression, timeZoneId: Option[String] = None)
case class Microseconds(child: Expression, timeZoneId: Option[String] = None)
case class IsoYear(child: Expression) extends UnaryExpression with ImplicitCastInputTypes
case class Millennium(child: Expression) extends UnaryExpression with ImplicitCastInputTypes
case class Century(child: Expression) extends UnaryExpression with ImplicitCastInputTypes
case class Decade(child: Expression) extends UnaryExpression with ImplicitCastInputTypes
case class Epoch(child: Expression, timeZoneId: Option[String] = None)
case class ArrayForAll(
case class DescribeTable(table: NamedRelation, isExtended: Boolean) extends Command
case class DeleteFromTable(
trait V2CreateTablePlan extends LogicalPlan
case class DeleteFromStatement(
case class DescribeColumnStatement(
case class DescribeTableStatement(
case class ColumnarToRowExec(child: SparkPlan) extends UnaryExecNode with CodegenSupport
case class InputAdapter(child: SparkPlan) extends UnaryExecNode with InputRDDCodegen
case class InsertAdaptiveSparkPlan(
case class ReuseAdaptiveSubquery(
class DetectAmbiguousSelfJoin(conf: SQLConf) extends Rule[LogicalPlan]
case class DeleteFromTableExec(
case class DescribeTableExec(table: Table, isExtended: Boolean) extends LeafExecNode

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109429/
Test FAILed.

Test build #109446 has started for PR 25354 at commit fb0fafc.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14505/
Test PASSed.

Test build #109446 has finished for PR 25354 at commit fb0fafc.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class DataFrameWriterV2Suite extends QueryTest with SharedSparkSession with BeforeAndAfter

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109446/
Test PASSed.

Test build #109505 has started for PR 25354 at commit 12097ec.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14562/
Test PASSed.

Test build #109506 has started for PR 25354 at commit 6950650.

Test build #109505 has finished for PR 25354 at commit 12097ec.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class DataFrameWriterV2Suite extends QueryTest with SharedSparkSession with BeforeAndAfter

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109505/
Test PASSed.

Test build #109506 has finished for PR 25354 at commit 6950650.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109506/
Test PASSed.

Test build #109591 has started for PR 25354 at commit eff659a.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14646/
Test PASSed.

Test build #109591 has finished for PR 25354 at commit eff659a.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109591/
Test FAILed.

@brkyvz, I've removed the asParquet etc. methods and rebased on the current master.

Test build #109963 has started for PR 25354 at commit e424c2c.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14986/
Test PASSed.

Test build #109963 has finished for PR 25354 at commit e424c2c.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109963/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14988/
Test PASSed.

Test build #109967 has started for PR 25354 at commit 57e6c5b.

Test build #109967 has finished for PR 25354 at commit 57e6c5b.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109967/
Test FAILed.

Test build #109982 has started for PR 25354 at commit 9864d42.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/15001/
Test PASSed.

Test build #109982 has finished for PR 25354 at commit 9864d42.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109982/
Test PASSed.

LGTM. Merging to master. Thanks @rdblue

Let me revert this due to the build failure for now (had a quick chat with @brkyvz as well)

Uh oh, can you please revert?
On Sun, Sep 1, 2019, 8:44 PM Hyukjin Kwon<EMAIL_ADDRESS>wrote:

@HyukjinKwon commented on this pull request.
In sql/core/src/main/scala/org/apache/spark/sql/functions.scala
https://github.com/apache/spark/pull/25354#discussion_r319798708:

@@ -3942,6 +3943,69 @@ object functions {
*/
def to_csv(e: Column): Column = to_csv(e, Map.empty[String, String].asJava)

// turn off style check that object names must start with a capital letter
// scalastyle:off
object partitioning {

Does this has a Java corresponding test? This file should be compatible
with Java side as well. I doubt if nested object works in Java API.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/spark/pull/25354?email_source=notifications&email_token=ABIAE642NNEDPJVMA35RHTTQHSDZZA5CNFSM4IJGHPQKYY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOCDKPHLI#pullrequestreview-282391469,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABIAE63KX52GQJWGWSFB3ODQHSDZZANCNFSM4IJGHPQA
.

Sure, thanks @brkyvz for confirmation officially!

Sure, thanks @brkyvz for confirmation quickly!

Also, locally verified that the Maven build now works fine after reverting this one.

@rdblue sorry I had to revert this. Can you open a PR again with some fixes?

@HyukjinKwon

@rdblue sorry I had to revert this. Can you open a PR again with some fixes?

Did we revert this ? I am seeing a compilation error in my local env while compiling the hive module  like the following :
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:32: cannot access org.apache.spark.sql.functions.1
  class file for org.apache.spark.sql.functions$1 not found
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:70: cannot find symbol
  symbol:   method avg(java.lang.String)
  location: class org.apache.spark.sql.hive.JavaDataFrameSuite
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:81: cannot find symbol
  symbol:   method col(java.lang.String)
  location: class org.apache.spark.sql.hive.JavaDataFrameSuite
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:89: cannot find symbol
  symbol:   method col(java.lang.String)
  location: class org.apache.spark.sql.hive.JavaDataFrameSuite
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:90: cannot find symbol
  symbol:   method col(java.lang.String)
  location: class org.apache.spark.sql.hive.JavaDataFrameSuite
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:91: cannot find symbol
  symbol:   method col(java.lang.String)
  location: class org.apache.spark.sql.hive.JavaDataFrameSuite
[ERROR] [Error] /Users/dbiswal/mygit/apache/spark/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java:92: cannot find symbol

Yes. We reverted this 15 hours ago. Did you try to update your local environment?

@dongjoon-hyun My bad.. sorry.. yeah.. i see the revert when i  updated the local env.


Result browser not able to show the response for requests with long names

When opening the Response Content tab for a request with a very long name, the result browser might show an error screen:

When creating the result browser for a test run, XLT stores the content of a server response to a file named like <result_browser_dir>/responses/0000-Homepage-index.html. The file name is composed of a counter, the current action name, and the last path segment of the request URL. Sometimes the last path segment is very long as parameters or other information is encoded into it. If the OS limit for the maximum length of a path is exceeded, the result browser will not be able to load the content of the server response and will show the error screen instead.
XLT already limits the maximum length of the file name to 240 characters, however, this is obviously not enough. Remember that the full path to the file including any directory must be below the OS limit.
Suggestion: Shorten the file name even more, to 80 characters, for example. This way, the file name might still be significant enough while the path part can be much longer now.


Apply optional parameters to children

Version
4.0.12
Reproduction link
codesandbox.io
Steps to reproduce
Click '/users/3/4', then 'Show'
What is expected?
I would expect the optional parameter info to be applied to the user-show route the same way id is applied.
What is actually happening?
Instead it vanishes when I navigate using the named path.

If I use named paths to navigate, my params are automatically applied to any child routes, which is a very nice feature. But optional parameters are somehow ignored. I wonder if that is a bug or the expected behavior.
Will I need to explicitly add the params to all my router-links like so?
<router-link :to="{ name: 'user-show', params: $route.params }">Show</router-link>

In my opinion that is a little verbose and gets even messier when trying to actually change a parameter:
<router-link :to="{ name: 'user-show', params: { ...$route.params, id: 17 }">Show</router-link>

This is intended. Optional parameters must be explicitely set because that way you can omit them when navigating to a location that also accepts that param and they won't be kept. It was discussed in previous issues in vue-router repo where you will be able to find the full rationale.


Add workaround for switching from kube-proxy mode IPVS to IPTables.

How to categorize this PR?

/area networking
/kind bug
What this PR does / why we need it:
Add workaround for switching from kube-proxy mode IPVS to IPTables.
The cleanup of kube-proxy seems to be broken since v1.21 when started in IPVS mode.
This workaround flushes the iptables chain KUBE-NODE-PORT in the filter table so that
the cleanup does not fail hard, but continues as desired.
Which issue(s) this PR fixes:
Fixes #4599
Special notes for your reviewer:
Release note:

Fix kube-proxy switch from IPVS to IPTables mode.

/test pull-gardener-apidiff

Updated tests.

/cherrypick release-v1.44

/cherrypick release-v1.43

/cherrypick release-v1.42


Rename underfill.css as unique.css - so that this can be leveraged for other pages

@meejain , I think this can be closed now.


Code to parse all latest scrapes and save locally

Description
This PR adds code to run the parser with the latest scraped files in one go.
I add a description of how to do this in the README, and add to new files:
utils/export_env which exports the latest file names as environment variables, and
parse_latest.py which parses the latest scraped files, and outputs the parsed references and matches locally.
Type of change

[x] :sparkles: New feature

How Has This Been Tested?
I have manually checked that the latest file names in S3 are the same as my environmental variables.
I have started to run the code and it does start to save the outputs as I expected it to, however I didn't run it until it was complete.
Checklist:

[x] My code follows the style guidelines of this project (pep8 AND pyflakes)
[x] I have commented my code, particularly in hard-to-understand areas
[x] If needed, I changed related parts of the documentation
[ ] I included tests in my PR
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
[ ] If my PR aims to fix an issue, I referenced it using #(issue)

@hblanks I get a NameError: name 'pool_map' is not defined error when I run the latest code, but not sure why, any ideas?

I'm not sure why offhand, but can take a look tomorrow if you like.

@hblanks @nsorros this is working now without errors 🎉

@nsorros I've made the discussed changes :)

@nsorros latest commit with the changes we did together


[Bug]: Slack invite link in README is broken

What happened?
Slack link in README here is no longer working.
Also the link in the issue template for bazel slack doesn't work either.
Version
N/A
How to reproduce
No response
Any other information?
No response

Thanks for the issue! Aspect don't own the link or the community Slack, however I've pinged the Google folks that can manage it they say it should be working again now. As far as I can see, there is nothing else actionable here, so going to close this.


nuitka cannot find black.cache when packaging black

"""
Created by: xiaoyu
Date: 2024/8/18
File: black_test
"""
import black

print(black.cache.CACHE_DIR)

nuitka --msvc=latest --standalone --onefile --show-progress --output-dir=builder_release_black --include-package=black --include-package=black.cache --include-package=black.files --include-package=black.mode --include-package=black.output black_test.py
builder_release_black>black_test.exe
Traceback (most recent call last):
File "C:\Users\Lenvo\AppData\Local\Temp\ONEFIL~1\black_test.py", line 6, in
File "src\black_init_.py", line 38, in
ModuleNotFoundError: No module named 'black.cache'; 'black' is not a package
it seems that only black packaging failed

In the template, we have made it clear, that not filling out the issue template is not acceptable. I am closing this kind of report as invalid. The main reason is that we do not want to be left guessing. For you it's easy to erase the issue template and expect us to ask you questions only as necessary, but we cannot do that. We would much rather wait for you to create a new report, fill out the template, or wait for somebody with the necessary skill to do it.
In short: No issue template, no fun. Therefore we are  likely just deleting the issue, as it serves as a bad example and detraction for searches.  And even worse, it might keep good reporters from reporting as is this "already known."


ARTEMIS-1297 Load balance or redistribution of AMQP Messages

@mtaylor @jbertram  don't merge this yet...
there's an issue if someone used messate-type=7 for a custom user's message type... it would fail...
I doubt it is an issue.. but I can fix it easily.

I have fixed that issue


Failed to build libquickjs on Windows

   Compiling libquickjs-sys v0.4.0
error: failed to run custom build command for `libquickjs-sys v0.4.0`

Caused by:
  process didn't exit successfully: `D:\Rust\katex-rs\target\debug\build\libquickjs-sys-41555e9664b161d9\build-script-build` (exit code: 101)
--- stderr
Applying patches...
Applying "js-tobigint64-overflow.patch"...
thread 'main' panicked at 'Could not apply patches: Os { code: 2, kind: NotFound, message: "The system cannot find the file specified." }', C:\Users\Aster\.cargo\registry\src\github.com-1ecc6299db9ec823\libquickjs-sys-0.4.0\build.rs:100:22
stack backtrace:
   0: backtrace::backtrace::trace_unsynchronized
             at C:\Users\VssAdministrator\.cargo\registry\src\github.com-1ecc6299db9ec823\backtrace-0.3.44\src\backtrace\mod.rs:66
   1: std::sys_common::backtrace::_print_fmt
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\sys_common\backtrace.rs:78
   2: std::sys_common::backtrace::_print::{{impl}}::fmt
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\sys_common\backtrace.rs:59
   3: core::fmt::write
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libcore\fmt\mod.rs:1052
   4: std::io::Write::write_fmt<std::sys::windows::stdio::Stderr>
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\io\mod.rs:1428
   5: std::sys_common::backtrace::_print
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\sys_common\backtrace.rs:62
   6: std::sys_common::backtrace::print
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\sys_common\backtrace.rs:49
   7: std::panicking::default_hook::{{closure}}
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panicking.rs:204
   8: std::panicking::default_hook
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panicking.rs:224
   9: std::panicking::rust_panic_with_hook
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panicking.rs:470
  10: std::panicking::begin_panic_handler
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panicking.rs:378
  11: core::panicking::panic_fmt
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libcore\panicking.rs:85
  12: core::option::expect_none_failed
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libcore\option.rs:1211
  13: core::result::Result<std::process::Child, std::io::error::Error>::expect<std::process::Child,std::io::error::Error>
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\src\libcore\result.rs:961
  14: build_script_build::apply_patches
             at .\build.rs:100
  15: build_script_build::main
             at .\build.rs:70
  16: std::rt::lang_start::{{closure}}<()>
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\src\libstd\rt.rs:67
  17: std::rt::lang_start_internal::{{closure}}
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\rt.rs:52
  18: std::panicking::try::do_call<closure-0,i32>
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panicking.rs:303
  19: panic_unwind::__rust_maybe_catch_panic
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libpanic_unwind\lib.rs:86
  20: std::panicking::try
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panicking.rs:281
  21: std::panic::catch_unwind
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\panic.rs:394
  22: std::rt::lang_start_internal
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\/src\libstd\rt.rs:51
  23: std::rt::lang_start<()>
             at /rustc/433aae93e4ef866a1fdfefad136b32ed89acd3e7\src\libstd\rt.rs:67
  24: main
  25: invoke_main
             at d:\agent\_work\3\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:78
  26: __scrt_common_main_seh
             at d:\agent\_work\3\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288
  27: BaseThreadInitThunk
  28: RtlUserThreadStart
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Process finished with exit code 101

This is an upstream issue. See https://github.com/theduke/quickjs-rs/issues/18 for details.
It is possible to build quickjs in x86_64-pc-windows-gnu target through cross-compilation with the following patch https://github.com/theduke/quickjs-rs/pull/57

Update on this bug since quickjs-rs#57 was merged?

@krisradio, you need to wait quickjs-rs to upload a new release to crates.io. After which, it should be possible to build this library in x86_64-pc-windows-gnu target through cross-compilation.

@xu-cheng awesome, thank you!

Close this issue for now as it is fixed in upstream.
To build for Windows target using cross-complication, you can do the following on Ubuntu:
sudo apt-get install mingw-w64 -y
cargo build --target x86_64-pc-windows-gnu

See https://github.com/xu-cheng/pandoc-katex for a complete example.
You should be able to do the similar things on Windows using MSYS2/MingGW.


pack ConstantLit down to 16 bytes

Motivation

This is an extension of #4954, which removed 8 bytes from ConstantLit...but unfortunately didn't change very much as far as memory usage goes because 24 bytes and 32 bytes all go into the 32-byte bucket in jemalloc.  To see savings, we need to reduce ConstantLit down to 16 bytes.
We can do that by observing that ConstantLit's loc is exactly the same as the original UnresolvedConstantLit's loc.  And in cases where we don't have an original, we're synthesizing a constant literal from something that didn't appear in the user's source code, and therefore we probably shouldn't be giving it a loc anyway.  So we can redirect all requests for the loc of a ConstantLit to its original unresolved constant literal, and just say the ConstantLit doesn't have a loc if the original doesn't exist.
Test plan

See included automated tests.

We have a policy of testing changes to Sorbet against Stripe's codebase before
merging them. I've kicked off a test run for the current PR.  When the build
finishes, I'll share with you whether or how it failed. Thanks!
Stripe employees can see the build results here:
→ https://go/builds/bui_LuzODqIiriIaX3
→ https://go/builds/bui_LuzOlvDjOgESSZ

just say the ConstantLit doesn't have a loc if the original doesn't exist.

Can't we just reach inside the UnresolvedConstantLit (that would still be there, even if it were synthetic) and set the loc there?
I think that everything, even synthetic things, should have locs, otherwise it's too easy to accidentally have bad error messages. lmk if there's something that prevents this though


chore: update deps and test on node v7

Checklist

[ ] npm test passes
[ ] tests and/or benchmarks are included
[ ] documentation is changed or added
[ ] commit message follows commit guidelines

Affected core subsystem(s)

Description of change

Current coverage is 100% (diff: 100%)

Merging #2 into master will not change coverage

@@           master    #2   diff @@
===================================
  Files           2     2
  Lines           8     8
  Methods         0     0
  Messages        0     0
  Branches        0     0
===================================
  Hits            8     8
  Misses          0     0
  Partials        0     0

Powered by Codecov. Last update 99a3b63...7b3c446

@popomore 没啥问题的话就合了吧

1.0.0


Can I find the answer of the practising problems in somewhere?

Can I find the answer of the practising problems in somewhere?

Unfortunately, there is no single repository for all the answers. I'll suggest you to google stuff and find out answers or start a thread in the MXNet Forums / PyTorch Forums. You may open up issues in the original GitHub repository or here of it is PyTorch specific.


varnish_install resource should only enable service, not restart

The resource currently restarts the varnish service on every Chef run.
Recipe version of this only enables: https://github.com/rackspace-cookbooks/varnish/blob/master/recipes/default.rb

how about enable, start ?

In theory yes I'd agree but I notice that enable, start was reverted from the recipe version: https://github.com/rackspace-cookbooks/varnish/commit/534e8561d9db789b932816fde78890c781df960b
Take the distro_install/vendor_install example recipes... If varnish_install does enable, start the service then it will be started with a default configuration, only to be restarted with your own configuration at the end of the run? Does that matter to anyone?
The template resources in the default_vcl, default_config providers notifies :restart, 'service[varnish]', :delayed so in the example recipes where those resources are used the service would be started anyway even with just action %w(enable). Except of course if someone only used the varnish_install resource but none of the other resources then the service wouldn't be started... Up for discussion I guess?

fixed in #60 thanks for the notice though

:+1:


US-1889327: Header fixes

Summary
Describe your changes here.
Fixes #Issue_Number (if available)

Hello @adegeo!
The 6th PR with 20 file edits is ready for technical review. Could you please review this PR?
Thank you!

Hello @adegeo,
Thank you for your feedback! I have updated the content for the same. Could you please have a look and approve the changes?
Thank you!


openssl_1_0_2: 1.0.2o -> 1.0.2p

Motivation for this change
this addresses:

Client DoS due to large DH parameter (CVE-2018-0732)
Cache timing vulnerability in RSA Key Generation (CVE-2018-0737)

These issues have been known for longer. We could have picked those patches. We didn't so there is probably no need to rush them in faster then staging...
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[X] Fits CONTRIBUTING.md.

Success on x86_64-linux (full log)
Attempted: openssl_1_0_2
Partial log (click to expand)
patching script interpreter paths in /nix/store/pm5v2vr0fa3jpw6gsxpg2airs1saggnc-openssl-1.0.2p
checking for references to /build in /nix/store/pm5v2vr0fa3jpw6gsxpg2airs1saggnc-openssl-1.0.2p...
shrinking RPATHs of ELF executables and libraries in /nix/store/470xyksxb03aljsj1ika6f9s2d2r2ayq-openssl-1.0.2p-man
gzipping man pages under /nix/store/470xyksxb03aljsj1ika6f9s2d2r2ayq-openssl-1.0.2p-man/share/man/
patching script interpreter paths in /nix/store/470xyksxb03aljsj1ika6f9s2d2r2ayq-openssl-1.0.2p-man
checking for references to /build in /nix/store/470xyksxb03aljsj1ika6f9s2d2r2ayq-openssl-1.0.2p-man...
shrinking RPATHs of ELF executables and libraries in /nix/store/qiwk42szdy6ipb3qm1vjnaaqlhr56bvw-openssl-1.0.2p-debug
patching script interpreter paths in /nix/store/qiwk42szdy6ipb3qm1vjnaaqlhr56bvw-openssl-1.0.2p-debug
checking for references to /build in /nix/store/qiwk42szdy6ipb3qm1vjnaaqlhr56bvw-openssl-1.0.2p-debug...
/nix/store/xv7r9yxcmxi3n2bqbwzdi0hp0dv1jd7c-openssl-1.0.2p-bin

Timed out, unknown build status on x86_64-darwin (full log)
Attempted: openssl_1_0_2
Partial log (click to expand)
cannot build derivation '/nix/store/fb2zycmpk3b3rpbmk56jypsm8cr8lmps-ICU-osx-10.10.5.drv': 3 dependencies couldn't be built
cannot build derivation '/nix/store/cvsqcfqwh0jpfvhd36r9jvv0l0k62q1z-cctools-binutils-darwin.drv': 4 dependencies couldn't be built
cannot build derivation '/nix/store/l0iskv5rj77qv26gyxpwlhxcihqbpfxb-gnutar-1.30.drv': 3 dependencies couldn't be built
cannot build derivation '/nix/store/y02pdjg2ix51kz8f14d730kik46rkm47-CF-osx-10.10.5.drv': 7 dependencies couldn't be built
cannot build derivation '/nix/store/phxliv9fbqlgn3p86lmqia0hgm119wdk-cctools-binutils-darwin-wrapper.drv': 7 dependencies couldn't be built
cannot build derivation '/nix/store/jxm98nypaghmbk66pciyj38j63r3ffax-clang-wrapper-5.0.2.drv': 11 dependencies couldn't be built
cannot build derivation '/nix/store/785lvdx0jnvbrkqnd43bkacsb6k237wk-stdenv-darwin.drv': 36 dependencies couldn't be built
cannot build derivation '/nix/store/knmlbgw61k9wg8bvycv82yb8gn6j6968-perl-5.28.0.drv': 4 dependencies couldn't be built
cannot build derivation '/nix/store/p72y2nc47pd2khm41h9x8vgv6122hdib-openssl-1.0.2p.drv': 3 dependencies couldn't be built
error: build of '/nix/store/p72y2nc47pd2khm41h9x8vgv6122hdib-openssl-1.0.2p.drv' failed

Success on aarch64-linux (full log)
Attempted: openssl_1_0_2
Partial log (click to expand)
patching script interpreter paths in /nix/store/d7gx2j7qipi7zx2a8d988xm1420z29qv-openssl-1.0.2p
checking for references to /build in /nix/store/d7gx2j7qipi7zx2a8d988xm1420z29qv-openssl-1.0.2p...
shrinking RPATHs of ELF executables and libraries in /nix/store/kcx372qjviph1lczc7wvy8xya6jz0vkn-openssl-1.0.2p-man
gzipping man pages under /nix/store/kcx372qjviph1lczc7wvy8xya6jz0vkn-openssl-1.0.2p-man/share/man/
patching script interpreter paths in /nix/store/kcx372qjviph1lczc7wvy8xya6jz0vkn-openssl-1.0.2p-man
checking for references to /build in /nix/store/kcx372qjviph1lczc7wvy8xya6jz0vkn-openssl-1.0.2p-man...
shrinking RPATHs of ELF executables and libraries in /nix/store/dgmvxvl31r306k07019r4ixf0ffww8vn-openssl-1.0.2p-debug
patching script interpreter paths in /nix/store/dgmvxvl31r306k07019r4ixf0ffww8vn-openssl-1.0.2p-debug
checking for references to /build in /nix/store/dgmvxvl31r306k07019r4ixf0ffww8vn-openssl-1.0.2p-debug...
/nix/store/nakk7lh96wbi2j1fammmvirhs6ii7k9q-openssl-1.0.2p-bin


Append note about content and format of /etc/kubernetes/cloud-config.

Related to discussion in kubernetes/kubernetes#39029

This change is

Thanks for review @devin-donnelly, updated.


fix basestring error

I guess running unit tests in a python environment is very different from running the code inside sublime. My last PR introduced an error when I test if the value is a basestring instance.
Sorry about that guys. Here is the fix.

@abnerpc btw, AFAIK Sublime Text 3 uses Python 3.3 instead of 2.7, but we are testing on Python 2.7

yeah, apparently this is the problem...  I will look into it and change the tests to run on 3.3...
thanks :)

Ok. Let's not release a new version before we test it on Python 3.3


Fix conflict between expected changed files and git dirty files

For a Flutter project, specifying gradle_file_folder as "app" in the
lane config would lead to the following expected changed files
"app/build.gradle" whereas the git dirty file would actually be
"android/app/build.gradle".
This happens because the git root is not the android directory but the
flutter project folder which contains the android project in the
"android" directory.

Hi,
the default value for parameter 'gradle_file_folder' is 'app', which will work for the default project structure of a 'normal' Android project. You can however change the value and pass 'android/app' which should then work, without changing the code of this plugin.
But I will have a closer look into this


Update standalone.md

There is no '@vue/devtools' in my 'node_modules' folder so I had to change this to '@vue/devtools-kit' in order to make it work.

I WAS taking about the standalone app (the title is literally standalone.md), and DID follow your documentation and this DIDN'T work for me, hence my comment/patch.

 I WAS taking about the standalone app (the title is literally standalone.md), and DID follow your documentation and this DIDN'T work for me, hence my comment/patch.

The standalone app's documentation begins with instructions for installing it. Did the standalone app still not work after you tried to install it?


Implement frontend for queue feature

Instructor side (not editing and editing):

Student side:

Update mobile responsiveness.
Desktop:

Desktop split screen:

Mobile:


Can't group triggers into folders

Describe the bug
On the Triggers window, after creating a Group, it is not possible to drag triggers into the Group folder. Nothing happens if you do that and the dragged trigger doesn't move into the folder.
To Reproduce
Steps to reproduce the behavior:

Go to Triggers
Click on + in the bottom left and create a new Group
Drag a Trigger onto the icon of the new Group folder
See that the Trigger hasn't been added to the folder which remains empty.

Expected behavior
It is expected that the Trigger be listed inside the Group folder after dragging it there
Screenshots
n/a
What version of macOS?
10.14.6
What version of Quicksilver?
1.6.1 (4026)

This is a known issue. See #135


Notifications paging

Only showing the first page of notifications content. Should add paging.

Almost done

Done w/ a sort of weird UI. B/c I filter read and unread notifications w/ unread being the first selected (segmented control), there is a possibility where the next page of notifications only contains unread stuff, thus not updating the UI.
So instead of infinite scroll, I'm adding a cell at the bottom that shows the current page number. Then you tap it and can get UI feedback when a new page has loaded, but no new notifications show up.
I'm actually really happy about this design. Avoids any confusion.


Update brains to actual package version

          1 Warning

:warning:
Please provide a linked tracker story for this PR in the description

          1 Message

:book:
Nice, more deletions than insertions :red_circle:

  Generated by :no_entry_sign: danger


(Repository) Adding PR and Issue templates

Description
The following changes in this PR adds templates for when people are opening issues as well as pull requests, which hopefully will make our life easier.
Motivation and Context

The motivation came from being tired of not having a template to follow, usually ending up with a empty description.
How Has this Been Tested?
Not applicable
Screenshot (if appropriate, usually isn't needed):
Not needed
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Migrated package (a package have been migrated from another repository)
[x] Other

Checklist:

[x] My code follows the code style of this repository.
[ ] My change requires a change to documentation (this mean usually the notes in the description of a package).
[ ] I have updated the documentation accordingly (this mean usually the notes in the description of a package).
[x] All files is up to date with the latest Contributing Guidelines
[ ] The added/modified package passed install/uninstall in the chocolatey test environment.
[ ] The changes only affect a single package (not including meta package).

// cc @majkinetor @gep13 @ferventcoder

The poblem with github checkboxes is that history isn't monitored.

While that is true, I personally see that as a lesser evil for now.

I have a 'wall of text' feeling in 100% of cases with issue templates. As long as it isn't mandated I am fine with having it.

I do agree with that, but it should still be encouraged to be used.

Will changing the location of contributing doc invalidate the link that is presented by github when you push PR / issue ?

As long as it's inside the .github folder it shouldn't, if I read the docs correctly.
https://github.com/blog/2111-issue-and-pull-request-templates

Let's not move CONTRIBUTING down to a subfolder. There are many folks who look for tgis file at top level - I'm not going to guess to look in the .github folder and neither will they. They should have the opportunity to read over CONTRIBUTING loooong before they are at the point of issuing a PR, in some cases it is going to save folks rework and being upset about not having found that file early on before they made their commits.

Good point, I just moved it to keep the root directory as free of clutter as possible.
I'll move it back.

@ferventcoder does everything look good now?

Yes


saved model

Hey Piyush !
can you provide me with your saved model file?

Hey,
Sorry for the late reply.
You can now find the models in save_models.


MINOR: Fix broken standalone ReplicationQuotasTestRig test

Fix ZkUtils. getReassignmentJson to return valid  json string
Allow new file creation in ReplicationQuotasTestRig test

Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@ijuma  Please take a look when you get a chance

Merged to trunk and 2.1.


Sonoff RFBridge433 - SONOFF PIR3-RF - state does not change on motion

I have noticed that the Sonoff bridge, when paired with the Sonoff PIR3-RF and set as an alarm, the state of the sensor is always set to clear, even after motion is triggered.  The state works well in the ewelink app, however, home assistant is not recognising the state change when motion triggered.

I have tried with button class and motion class but no state change is detected. I find sensors wiht the old naming convention still work fine e.g. binary_sensor.big_store_pir but if I update the automation to the new naming convention binary_sensor.1000cdecf5_0 then it no longer works.

same  since the plugin updated.

I have the same problem with Dual R3.
I use them for 2 level fan control.
When calling service - they react and fun is running but status is not changed.
When I reload addon it looks like then is status updated once and than is not working again.
This is happening ~ month since some updates.
My system is 100% up to date and running official hassio.

You need provide component debug logs in moment sensor triggered.

Any updates on this? Is it now fixed?

I haven't seen any useful information about the bug, so it's not fixed.

I confirm that PIR3-RF works as intended in home assistant. No bug at all so I guess if it was something at the time, now is fixed.

Please reopen the issue if it is still relevant


LRA 945 room status for rooms with no access

That was too easy! Should we add something like "Checked 100% - no access" to show_status? It would be nice to see the difference between "100% checked" and "100% no access" What do you think?

Yeah sounds good. I'll do that


bazarr: 1.1.2 -> 1.1.3

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/morpheus65535/bazarr/releases.
meta.description for bazarr is: "Subtitle manager for Sonarr and Radarr"
meta.homepage for bazarr is: "https://www.bazarr.media/"
meta.changelog for bazarr is: ""
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.1.3 with grep in /nix/store/ychpqvm4hhv74jdflf7ah71pcdhc4dv6-bazarr-1.1.3
found 1.1.3 in filename of file in /nix/store/ychpqvm4hhv74jdflf7ah71pcdhc4dv6-bazarr-1.1.3

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
bazarr

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/ychpqvm4hhv74jdflf7ah71pcdhc4dv6-bazarr-1.1.3 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A bazarr https://github.com/r-ryantm/nixpkgs/archive/73735027b310d0b719815a89aba6d1ea9d3ddc93.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/ychpqvm4hhv74jdflf7ah71pcdhc4dv6-bazarr-1.1.3
ls -la /nix/store/ychpqvm4hhv74jdflf7ah71pcdhc4dv6-bazarr-1.1.3/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

bazarr

Maintainer pings
cc @d-xo for testing.

Can not be tested with nix-review.

Hints can be found in the NixOS module: try ./results/bazarr/bin/bazarr --config $PWD/bazarr-state-dir

Result of nixpkgs-review pr 204634 run on x86_64-linux 1

1 package built:

bazarr


document Dockerfile build

Refer to comment for context - https://github.com/dagger/dagger/pull/3438#issuecomment-1284516414

Seems like this is already covered in https://docs.dagger.io/429462/quickstart-build-dockerfile so I propose to close it unless others have a different opinion @mircubed @d3rp3tt3


How to run 'mvn clean install' from gruntfile?

I have a Javascript project that uses Grunt to build. As part of the grunt tasks, I need to build and package a Java project which uses Maven. Here's the folder structure of my project
*javascript-project
**js-src(contains js files)
**external
***agents(contains java mvn project)
****src
****pom.xml(this needs to be built)
**Gruntfile.js
**package.json
**pom.xml(dummy placeholder for javascript project)
To build this javascript project we use grunt install. Now as part of this grunt install, I need to build the mvn project under external folder. I do not need to deploy or release it to any remote repository. I just need to build it locally. Here's the sample of Gruntfile.js
// Project configuration.
grunt.initConfig({
...(normal tasks to build js files)
maven: {
options: {
debug: 'true',
goal: 'install',
groupId: 'org.example',
url: ''
},
src: [ 'external/agents/**', '' ]
}
});
grunt.loadNpmTasks('grunt-maven-tasks');
grunt.registerTask('install', ['maven']);
Can you help me to run 'mvn clean install' on the external agent folder when 'grunt install' is run on the Javascript project?

@sthang : I suggest an alternative solution to your issue; invoke the Grunt build as part of your Maven build. We have been using this Maven plugin to achieve exactly that: https://github.com/eirslett/frontend-maven-plugin. There are other alternatives too...


Fix BigRNN table on website

Description
@eric-haibin-lin
Checklist
Essentials

[X] Changes are complete (i.e. I finished coding on this PR)
[X] All changes have test coverage
[X] Code is well-documented

Changes

[X] Fix BigRNN table on website

Job PR-257/1 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-257/1/index.html

Job PR-257/2 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-257/2/index.html

Job PR-257/3 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-257/3/index.html


Event externalisation with AMQP fails to complete

I observes traces with externalisation with AMQP
java.util.concurrent.CompletionException: java.lang.IllegalStateException: Delegate must not return null!
	at org.springframework.util.concurrent.FutureUtils.lambda$toSupplier$0(FutureUtils.java:78)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run$$$capture(CompletableFuture.java:1768)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.IllegalStateException: Delegate must not return null!
	at org.springframework.modulith.events.support.DelegatingEventExternalizer.externalize(DelegatingEventExternalizer.java:80)
	at org.springframework.modulith.events.support.EventExternalizationSupport.externalize(EventExternalizationSupport.java:87)

After debugging, I see that DelegatingEventExternalizer does not accept its delegate to return null. However, RabbitEventExternalizerConfiguration  instanciates one with a delegate returning null
Then externalization fails and remains uncomplete even if message is successfully posted.

I can confirm seeing the same issue and I would appreciate 1.1.2 release with this bug fix if possible.

It'll definitely be backported. We just create separate tickets for those. Rest assured, it'll be fixed in 1.1.2.

@odrotbohm I proposed a PR for this subject

I've seen that, thanks.

That's fixed and backported.


Update to Zeebe0.23.1 & Operate 0.23.0 & Simple Monitor 0.18.0

Update to Zeebe Release: 0.23.1
(camunda-operate-0.23.0 / zeebe-distribution-0.23.1 / zbctl0.23.1)
Update to Zeebe Simple Monitor Release: 0.18.0
(zeebe-simple-monitor-0.18.0 /  zeebe-hazelcast-connector 0.8.0)

Hey, thanks for this PR @guang384. I had a branch that I just pushed where I did the 0.23.1 update, so I'm going to merge that. If there is anything in this PR that should go into there, let me know and I'll manually pull it across.


[template] remove extra leading slash

@ewandennis whoops, had an extra leading slash, which led Sparkpost to return 404s. FWIW, would be cool if the API could handle double slashes, though I understand why it doesn't.

Coverage remained the same at 100.0% when pulling 00f21d87bb1da7b1a551485cdd151db79beb3898 on asgoel:minor_template_fix into c79c8d1c302f54c3c60b11361b54c8085cf09746 on SparkPost:master.

Good catch, thanks @asgoel. The double slash thing is recent - we're looking into that now.


ERROR: ERROR Error: StaticInjectorError(AppModule)[UserService -> Http]:

Did you search for the problem in other open issues in this repo?
yes, I haven't found any
Tell us about the problem
Please, ensure your title is less than 63 characters long and starts with a capital
letter.
Did you try it outside of {N} Playground?

No

Which browser are you using?

Chrome

Are there any errors/warnings logged in your browser console?
Uncaught DOMException: Blocked a frame with origin "https://vars.hotjar.com" from accessing a cross-origin frame.
at :1:16
modules-b066b9284a37554a89aa159d084bf7c9.js:162 WebSocket is already in CLOSING or CLOSED state.
Which platform(s) does your issue occur on?

iOS

Are there any entries logged in the Device Logs tab?
[Mikus]: ERROR: bootstrap: ERROR BOOTSTRAPPING ANGULAR
[Mikus]: ERROR: bootstrap: StaticInjectorError(AppModule)[UserService -> Http]:
[Mikus]: ERROR: ERROR Error: StaticInjectorError(AppModule)[UserService -> Http]:
Please provide the following information shown in devices tab in the playground:
iPhone 5s
iOS 11.3.1
1.12.0
4.0.1
Please tell us how to recreate the issue with as much detail as possible.
The best approach would be to get your code running in the {N} Playground and share the link with us, along with any additional details or steps to reproduce needed for examining the issue there.
please solve the problem as soon as possible, because your tutorial in the playground has awaken my love to coding and I don't want it to fall asleep too soon :)
you can see it here - https://play.nativescript.org/?template=groceries-ng&tutorial=groceries-ng&id=5UhfMA
the app in iphone is only full of red text starting with StaticInjectorError
it happens in step 11, after updating app/shared/user/user.service.ts with this code:
import { Injectable } from "@angular/core";
import { Http, Headers, Response } from "@angular/http";
import { Observable } from "rxjs/Observable";
import "rxjs/add/operator/catch";
import "rxjs/add/operator/do";
import "rxjs/add/operator/map";
import "rxjs/add/observable/throw";
import { User } from "./user.model";
import { Config } from "../config";
@Injectable()
export class UserService {
constructor(private http: Http) {}
register(user: User) {
return this.http.post(
Config.apiUrl + "user/" + Config.appKey,
JSON.stringify({
username: user.email,
email: user.email,
password: user.password
}),
{ headers: this.getCommonHeaders() }
)
.catch(this.handleErrors);
}
getCommonHeaders() {
let headers = new Headers();
headers.append("Content-Type", "application/json");
headers.append("Authorization", Config.authHeader);
return headers;
}
handleErrors(error: Response) {
console.log(JSON.stringify(error.json()));
return Observable.throw(error);
}
}

ok, the problem disappears when you modify app/app.module.ts with the below code, so the solution would be to change the steps order in the tutorial
import { NgModule } from "@angular/core";
import { NativeScriptFormsModule } from "nativescript-angular/forms";
import { NativeScriptHttpModule } from "nativescript-angular/http";
import { NativeScriptModule } from "nativescript-angular/nativescript.module";
import { AppComponent } from "./app.component";
@NgModule({
imports: [
NativeScriptModule,
NativeScriptFormsModule,
NativeScriptHttpModule
],
declarations: [AppComponent],
bootstrap: [AppComponent]
})
export class AppModule {}


Generic error unless change to use HTTPS

Using index.js as-is causes this error:
$ node index.js
{ id: null, result: null, error: 'Error decoding JSON' }

If I change OtaHost to use the HTTPS endpoint (vs. HTTP) it works:
    OtaHost = 'https://download.cyanogenmod.org'; // Place here you OTA Server Url

Thank you very much for the issue but it is in the wrong repository. Although the URL is there, it's mainly meant to be replaced :)
I'll anyway fix it, just for the good of all. Best regards.


rio: 0.1.10 -> 0.1.11

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

@otavio you could also update this directly to 0.1.12

@TornaxO7 I have sent it.

Result of nixpkgs-review pr 340344 run on x86_64-linux 1

:white_check_mark: 2 packages built:

rio
rio.terminfo

The aarch64-linux build failed.

The aarch64-linux build failed.

@adamcstephens  Is it something that you can help with?

Probably not, I have no knowledge of this package.

Please try bumping to 0.1.13, should be fixed by https://github.com/raphamorim/rio/commit/ff3afb7f28ee427590547cc260a7d78c5ae59140

I have just sent it.


[Bug]: dbt seed fails if Dremio space does not exist

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
Executing dbt seed fails if the Dremio space does not exist already. This is because it tries to create the seed view before creating the Dremio space.
Creating the Dremio space manually and re-running dbt seed succeeds.
Expected Behavior
Executing dbt seed should succeed even if the Dremio space does not already exist.
Steps To Reproduce

Create a new project with a seed targeting a Dremio space that does not already exist.
Execute dbt seed.

Environment
- OS: Ubuntu
- dbt-dremio: 1.5.0
- Dremio Software: 24.0.2 Enterprise

Relevant log output
No response

It's related to #194 and to the twin_strategy :
by default twin_strategy = clone : for a materialization leading to a table Relation, a proxy view selecting from the table is (re)created in the corresponding custom folder based on the default and custom database+schema confs and the possibly overriden custom macros. But this is a 'light' view created by the adapter, not a regular dbt model. So dbt does not know at startup that it has to check if the view's path exists and create it overwise.
For time being, you can try to :

set the twin_strategy to prevent or allow (not the default clone)
create a real model materialized as a view ontop.

The only problem is for tables not in standard parquet/iceberg format. Indeed, the 'light' view reuse the write formating configuration of the underlying table to build the select with the good read formating options.

Is it possible that dbt-dremio automatically create the dremio space folder for us?
That would be quite useful for automation.


Add James Webb For Kerbal from SpaceDock

This pull request was automatically generated by SpaceDock on behalf of bcink, to add James Webb For Kerbal to CKAN.
Mod details:
name = /mod/1588/James%20Webb%20For%20Kerbal
author = bcink
abstract = The James Webb For Kerbal (With Space Telescope Functionality brought to you by Tarsier Space Technologies)
license = CC-BY-4.0
Homepage = https://forum.kerbalspaceprogram.com/index.php?/topic/167494-131-james-webb-for-kerbal/
description =
James Webb For Kerbal Update 1.2 for Kerbal Space Program 1.3.1
Required Dependencies:
Tarsier Space Technologies by JPLRepo
https://forum.kerbalspaceprogram.com/index.php?/topic/154853-131-tarsier-space-technology-with-galaxies-v72-5th-nov-2017/
Textures Unlimited by Shadowmage  (Included in update 1.2)
https://forum.kerbalspaceprogram.com/index.php?/topic/167450-131-textures-unlimited-pbr-shader-texture-and-model-api-11-11-17/
Please direct questions about this pull request to bcink.

The TexturesUnlimited dependency should probably be set up as a separate netkan rather than installed from this zip. If I'm wrong about that, then this is ready to merge.

#rebuild


[Staking] Skip last epoch rewards not properly handled

When a service update is occurs before the liveness period has passed, the script finishes silently. In fact, the following error message is not displayed because of how the staking.py script is called within perform_staking_operations (so the user sees nothing):
The liveness period has not passed. If you want to unstake anyway, run the script by running with SKIP_LAST_EPOCH_REWARDS=true.

Addressed in #100


LCM support

Hi! Are there any plans to extend WebViz to support LCM? (https://lcm-proj.github.io/). If not, do you have any advice on how to adapt the app to LCM? It works in a very similar way as ROS, and has the equivalent of ROSbags as well.

Currently not, and internally we're pretty tied to the binary format of ROS bags. Are there any conversion tools from their data format to ROS bags? That might be the easiest approach.

They don't have a native one, but it's probably not that big a challenge, so thank you for the advice! What about the live feed (not from rosbags)? Do you think it would be possible to adapt it to LCM? LCM works using UDP multicast, with no master node.

That might be a bit harder, but once you have some code to convert from LCM to the ROS message format it shouldn't be too hard. You could write a ROS node that subscribes to the LCM messages, converts them to ROS messages, and publishes them to a ROS master (ideally on different topics). Then you'd only have to boot that ROS node, a ROS master, and the rosbridge, and it should hopefully all work?
So yeah, the biggest step would probably be doing that initial conversion to the bag format.

Thank you! That is a very good idea.

Cool, keep us posted on how it goes! Would be cool if we can link future people with the same problem to whatever you come up with. 😃


Rename the repo?

This has been discussed before, but I wanted to make something more visible so we could collect more ideas/feedback.
I think the biggest problem with the name "notebooks" is that there are many repositories with this name (in other orgs), and when you try to fork a repository and GitHub detects a name conflict, it automatically starts appending numbers to the end of the fork. This requires manual intervention to fix - and even then can get very confusing because if you look at other users' forks they may all have different names. If we were going to stick with "notebooks" generally, we could solve this problem by getting cute with the name, e.g. notebookx.
NumPy has gone with numpy-tutorials for a similar project, but networkx-tutorials isn't a great fit because "tutorial" doesn't really describe the full range of material we envision having here. IIRC some other ideas that have been mentioned:

networkx-guides
networkx-handbook

nx-guides
nx-case-studies
nx-compendium
networkx-compendium

I like nx-guides  at the moment... but want to hear other options... :}

How about,
•   nx-exemplar
•   nx-heuristics
•   nx-interactive heuristics
•   networkx-heuristics
•   networkx-interactive heuristics

Other ideas:
• networkx-collection
• networkx-guidebook
• networkx-manual
• networkx-starter
• nx-graphbook

The switch has been flipped - the new repository name is nx-guides based on the above feedback. Thanks all for sharing your ideas & opinions. All forks should be unaffected by the name change and still point to the correct place, but if there are any questions or issues related to this please to hesitate to ping here or open a new issue.


[microTVM] Add wrapper for creating project using a MLF

Currently there is already a wrapper function for creating a new project
directory based on an ExportableModule, but there isn't one for creating
a new project directory based on an existing MLF archive, which is also
handy. Hence that commit adds a new wrapper for creating a project using
an existing model compiled and kept in a MLF archive.
Signed-off-by: Gustavo Romero<EMAIL_ADDRESS>

cc @areusch

@Mousius Thank for the review! All changes done in https://github.com/apache/tvm/pull/9090/commits/7bdd26ca5b2e2dcd69136a8107f0ccf2245a1cb3
Cheers

@gromero thanks, please fix the CI issue

@areusch @Mousius Thanks for the reviews. Sorry for the respin delay. I've fixed the offending line to satisfy the linter and also fixed the type hints for the added function (s/typing.Union/Union/) I think CI haven't caught it because the code is not being used currently -- I found that when using the code on my tvmc micro work. Hopefully https://github.com/apache/tvm/pull/9090/commits/7f6da2c167c053ad11c32464c48515595d0a4bec will be all right for the CI. Cheers.

Thanks @gromero @Mousius and @areusch - this is merged now.

@leandron thanks!


Fix eslint errors.

When I was opening the jest config files in VSCode, eslint was complaining about a few errors. This PR tries to fix these errors.
✅ Pull Request Checklist:

[ ] Included link to corresponding React Spectrum GitHub Issue.
[ ] Added/updated unit tests and storybook for this change (for new code or code which already has tests).
[ ] Filled out test instructions.
[ ] Updated documentation (if it already exists for this component).
[ ] Looked at the Accessibility Practices for this feature - Aria Practices

📝 Test Instructions:

🧢 Your Project:

@snowystinger VSCode automatically runs eslint when you open files inside a folder that contains a eslint configuration.


Incorrect dark-mode style for optiongroup

I'll open a PR for this.

Darkened slate900 since there is no slate1000.
Indented sub-options


Adding contributing doc, renaming COC doc

Changes

Adding Contribution doc, renaming COC doc to ALLCAPS as part of GA

/kind documentation
(using the COC from the community repo, which substitutes the TOC for project maintainers in several spots)
/assign @markusthoemmes @omerbensaadon

/lgtm

/lgtm


Script stops working today.

Script stops working today.  Firefox 55.0.3. Youtube with old loock (not this new witch round icons) Yesterday works normaly.

This script no longer supports the old YouTube. You'll need to enable the new YouTube look. Visit youtube.com/new and opt-in.

*But YouTubeCenter and Better Full Dark Theme 2017 (ARC) don't support new
look 😕 Any solution? Yesterday version of Hide Watched? Something? *
2017-08-31 0:12 GMT+02:00 Ev Haus<EMAIL_ADDRESS>
This script no longer supports the old YouTube. You'll need to enable the
new YouTube look. Visit youtube.com/new and opt-in.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/EvHaus/youtube-hide-watched/issues/9#issuecomment-326134093,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AQKvGBALaVIkoQcd6mT0oSCb7JFZEJk9ks5sdd46gaJpZM4PIB4s
.

OK Never mind. I had an old version in backoop (1.2 february 20 2017 works
great)
2017-08-31 0:12 GMT+02:00 Ev Haus<EMAIL_ADDRESS>
This script no longer supports the old YouTube. You'll need to enable the
new YouTube look. Visit youtube.com/new and opt-in.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/EvHaus/youtube-hide-watched/issues/9#issuecomment-326134093,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AQKvGBALaVIkoQcd6mT0oSCb7JFZEJk9ks5sdd46gaJpZM4PIB4s
.


"NULL" values not handled in postgres and mysql

Describe the bug
Spice runtime fails to load postgres and mysql datasets (probably other data sources as well) with null values
Expected behavior
Spice should properly load data with null values
Screenshots

Fixed in: https://github.com/spiceai/spiceai/pull/1067


Update channel code with segwit

Segregated witness is now locked into the bitcoin protocol. This pull request updates our Payment Channel code to integrate segwit transactions (WitnessTransaction) instead of using BaseTransaction

Coverage decreased (-0.4%) to 90.444% when pulling c3a33001067d3a9ca3bbb402eccd538ccb3445ae on Christewart:update_channel_code_with_segwit into 4419b3a5054ddf2611cec5cf4a7dbade740b0ef5 on bitcoin-s:master.

Coverage decreased (-0.4%) to 90.466% when pulling a6abaadfacdef78e896c195abd4a5076f41c33b5 on Christewart:update_channel_code_with_segwit into 4419b3a5054ddf2611cec5cf4a7dbade740b0ef5 on bitcoin-s:master.

Coverage decreased (-0.3%) to 90.538% when pulling 28976a4b49453dfe9700a34b98fff9531dcc8fc7 on Christewart:update_channel_code_with_segwit into 4419b3a5054ddf2611cec5cf4a7dbade740b0ef5 on bitcoin-s:master.


Implement giant (chunked) DMA transfers

There is a breaking change in the Channel trait in the method remaining_transfers(), this method however hasn't been used anywhere in the codebase and the return type changed from u16 to u32, so all of the previous use cases should work.

@matoushybl LGTM, except could you not feature-gate it? There's no downside in always having it, it causes no bloat if it's not used.

Thanks for all the help with this!


Aggregating KZG single-point openings

Efficient batch verification
Single-point KZG verification is actually computing a product of 2 pairings. In the single point case, each pairing has one side fixed that allows to exploit a common batching technique: taking a linear combination with random coefficients. It is an extension of Bellare et al., section 3.3 Small Exponent Test to pairings. @daira gives a clear explanation of the technique as applied to Groth16 in appendix B.2 of zcash spec. There's also a direct application of  Schwartz–Zippel lemma written down as a proof in some texts like, section 3.1. Also the same technique is used in plonk, p. 12, to batch-verify 2 (aggregated) openings in different points.
KZG counterpart of Halo2 PC accumulation scheme
PCD from accumulation paper, section 8, describes the same computation as an accumulation scheme for KZG. The only difference is that there are 2 parties in Halo: one executing the aggregation, and the other -- verifying the aggregation by re-executing.
What is the difference to Halo Infinity private aggregation scheme? In this scheme proofs of each opening are also aggregated to produce a valid proof of the aggregate opening, while In Halo Infinity the proof for the aggregate is computed from scratch, that at least means that someone should keep track of the aggregate polynomial behind the aggregate commitment.

Done in #17


OpenNeuro feedback

Hi folks, the query tool is up and running here.
We would like for you to give us feedback on the tool from the perspective
of an openneuro user, who would use it to search for sample level cohorts of openneuro data (see roadmap: https://github.com/OpenNeuroOrg/openneuro/issues/2807).
In its current state the query tool:

has access to some but not all open neuro datasets (~170 datasets)
has up-to-date options for diagnosis, imaging modality, etc
has two output tsv files available for download

dataset-level contains: dataset portal uri, dataset file path, dataset name, number of matching subjects, and available imaging modalities
participant level contains: dataset file path, subject id, age, sex, diagnosis, session id, session file path, number of sessions, and imaging modality

doesn't have options for assessment

We'd love to get your feedback on:

overall functionality
content and format of the output tsv files
UI experience
anything else you notice or have thoughts on

Please add your feedback as comments on this issue or if it is very extensive, a GDoc/Hackpad could also work.

A small list of observations:

More info about result datasets in general

Long dataset names are cut off (ellipses) without any way to view the full name
Dataset names could link to corresponding URI
How many total subjects are in the dataset?

Need ability to select multiple diagnosis/assessments/modalities (#112)
Purple feedback button obscures dataset results download button

@kimsin98 Thanks for the feedback!


Dependency failed for Serial Getty on ttyS0 with Ubuntu Focal Build

I have been trying to create a ubuntu focal console image and setting up the networking using the netplan approach with systemd-networkd.service.  It looks like the repo is being worked on for Debian Bullseye and Buster, but possibly not tested lately for focal.  I have seen that you are also restructuring some of the rcn-ee/repos for BBB specific setup.  I have looked at where repo changes were made and tried to add patches to be similar to the steps taken for the versions being worked (i.e. adding eth0.network).  I also have a patch that I add for our systems (included below).
But, at this point, the serial port output stops at failure for Serial Getty on ttyS0 and at the moment I am not able to ssh into the BBB.   I did get an image version to boot (somewhere around 9/21) so that I could ssh into the BBB, but the serial port was still showing this issue.
A slightly different question, but related ... I have also seen that the repos/bb-usb-gadgets requires the dnsmasq package, but that conflicts with systemd-resolved.service (sharing port 53).  So, I assume I need to disable systemd-resolve.service, but I wonder if the dnsmasq functionality is still needed when using systemd-networkd.service approach.  Since this is in a referenced repo, it seems harder to configure.
I would appreciate  any suggestions on where to look for the serial port issue and any suggestions on possible conflicting packages for the networking setup.  Let me know if you need any other information.
Using repo commit (9/21): 2d57ac44b83e28ff377bdfebc557ea33c14f9826

Here is the serial output:

U-Boot SPL 2019.04-00002-gbb4af0f50f (Jul 08 2019 - 11:44:39 -0500)
Trying to boot from MMC2
Loading Environment from EXT4... ** File not found /boot/uboot.env **

** Unable to read "/boot/uboot.env" from mmc0:1 **

U-Boot 2019.04-00002-gbb4af0f50f (Jul 08 2019 - 11:44:39 -0500), Build: jenkins-github_Bootloader-Builder-128

CPU  : AM335X-GP rev 2.1
I2C:   ready
DRAM:  512 MiB
No match for driver 'omap_hsmmc'
No match for driver 'omap_hsmmc'
Some drivers were not found
Reset Source: Power-on reset has occurred.
RTC 32KCLK Source: External.
MMC:   OMAP SD/MMC: 0, OMAP SD/MMC: 1
Loading Environment from EXT4... ** File not found /boot/uboot.env **

** Unable to read "/boot/uboot.env" from mmc0:1 **
Board: BeagleBone Black
<ethaddr> not set. Validating first E-fuse MAC
BeagleBone Black:
BeagleBone: cape eeprom: i2c_probe: 0x54:
BeagleBone: cape eeprom: i2c_probe: 0x55:
BeagleBone: cape eeprom: i2c_probe: 0x56:
BeagleBone: cape eeprom: i2c_probe: 0x57:
Net:   eth0: MII MODE
cpsw, usb_ether
Press SPACE to abort autoboot in 2 seconds
board_name=[A335BNLT] ...
board_rev=[00C0] ...
switch to partitions #0, OK
mmc0 is current device
SD/MMC found on device 0
gpio: pin 56 (gpio 56) value is 0
gpio: pin 55 (gpio 55) value is 0
gpio: pin 54 (gpio 54) value is 0
gpio: pin 53 (gpio 53) value is 1
starting USB...
USB0:   Port not available.
gpio: pin 54 (gpio 54) value is 1
Checking for: /boot/uEnv.txt ...
switch to partitions #0, OK
mmc0 is current device
gpio: pin 56 (gpio 56) value is 0
gpio: pin 55 (gpio 55) value is 0
gpio: pin 54 (gpio 54) value is 0
gpio: pin 53 (gpio 53) value is 1
switch to partitions #0, OK
mmc0 is current device
gpio: pin 54 (gpio 54) value is 1
Checking for: /uEnv.txt ...
Checking for: /boot.scr ...
Checking for: /boot/boot.scr ...
Checking for: /boot/uEnv.txt ...
gpio: pin 55 (gpio 55) value is 1
2138 bytes read in 39 ms (52.7 KiB/s)
Loaded environment from /boot/uEnv.txt
Checking if uname_r is set in /boot/uEnv.txt...
gpio: pin 56 (gpio 56) value is 1
Running uname_boot ...
loading /boot/vmlinuz-5.4.106-ti-rt-r35 ...
10306048 bytes read in 677 ms (14.5 MiB/s)
debug: [enable_uboot_overlays=1] ...
debug: [enable_uboot_cape_universal=] ...
debug: [uboot_base_dtb_univ=am335x-boneblack-uboot.dtb] ...
uboot_overlays: [uboot_base_dtb=am335x-boneblack-uboot.dtb] ...
uboot_overlays: Switching too: dtb=am335x-boneblack-uboot.dtb ...
loading /boot/dtbs/5.4.106-ti-rt-r35/am335x-boneblack-uboot.dtb ...
92818 bytes read in 89 ms (1017.6 KiB/s)
uboot_overlays: [fdt_buffer=0x60000] ...
uboot_overlays: loading /lib/firmware/BB-BONE-eMMC1-01-00A0.dtbo ...
1614 bytes read in 821 ms (1000 Bytes/s)
uboot_overlays: loading /lib/firmware/BB-HDMI-TDA998x-00A0.dtbo ...
5330 bytes read in 385 ms (12.7 KiB/s)
uboot_overlays: loading /lib/firmware/BB-ADC-00A0.dtbo ...
654 bytes read in 2108 ms (0 Bytes/s)
uboot_overlays: unable to find [mmc 0:1 AM335X-PRU-UIO-00A0.dtbo]...
uboot_overlays: add [enable_uboot_cape_universal=1] to /boot/uEnv.txt to enable...
loading /boot/initrd.img-5.4.106-ti-rt-r35 ...
9112944 bytes read in 599 ms (14.5 MiB/s)
debug: [console=ttyS0,115200n8 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M net.ifnames=0 security=apparmor lpj=1990656 rng_core.default_quality=100 quiet] ...
debug: [bootz 0x82000000 0x88080000:8b0d70 88000000] ...
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Ramdisk to 8f74f000, end 8ffffd70 ... OK
   Loading Device Tree to 8f6d4000, end 8f74efff ... OK

Starting kernel ...

[    0.001169] 000: timer_probe: no matching timers found
[    0.108059] 000: l3-aon-clkctrl:0000:0: failed to disable
[    0.189394] 000: debugfs: Directory '49000000.edma' with parent 'dmaengine' already present!
[    1.636579] 000: wkup_m3_ipc 44e11324.wkup_m3_ipc: could not get rproc handle
[    1.711789] 000: omap_hsmmc 47810000.mmc: RX DMA channel request failed
[    2.011784] 000: davinci-mcasp 48038000.mcasp: IRQ common not found
[    2.085318] 000: omap_voltage_late_init: Voltage driver support not added
[    2.085772] 000: PM: Cannot get wkup_m3_ipc handle
[.[0;1;31mFAILED.[0m] Failed to start .[0;1;39mEnable File System Quotas.[0m.
[.[0;1;31m TIME .[0m] Timed out waiting for device .[0;1;39m/dev/ttyS0.[0m.
[.[0;1;38;5;185mDEPEND.[0m] Dependency failed for .[0;1;39mSerial Getty on ttyS0.[0m.

The patch I am using is:

diff --git a/scripts/chroot.sh b/scripts/chroot.sh
index a96b6e61..711c9432 100755
--- a/scripts/chroot.sh
+++ b/scripts/chroot.sh
@@ -444,6 +444,11 @@ bookworm|sid)
 	echo "##deb-src http://deb.debian.org/debian ${deb_codename}-updates ${deb_components}" >> ${wfile}
 	echo "" >> ${wfile}
 	;;
+focal)
+	echo "deb http://${deb_mirror} ${deb_codename}-updates ${deb_components}" >> ${wfile}
+	echo "#deb-src http://${deb_mirror} ${deb_codename}-updates ${deb_components}" >> ${wfile}
+	echo "" >> ${wfile}
+	;;
 esac

 #https://wiki.debian.org/Backports
@@ -1100,9 +1105,19 @@ cat > "${DIR}/chroot_script.sh" <<-__EOF__
 		fi

 		if [ ! "x${rfs_use_systemdnetworkd}" = "x" ] ; then
-			if [ -f /etc/bbb.io/templates/eth0-DHCP.network ] ; then
-				cp -v /etc/bbb.io/templates/eth0-DHCP.network /etc/systemd/network/eth0.network
-			fi
+			echo "[Match]" > /etc/systemd/network/eth0.network
+			echo "Name=eth0" >> /etc/systemd/network/eth0.network
+			echo "Type=ether" >> /etc/systemd/network/eth0.network
+			echo "" >>  /etc/systemd/network/eth0.network
+			echo "[Link]" > /etc/systemd/network/eth0.network
+			echo "RequiredForOnline=no" >> /etc/systemd/network/eth0.network
+			echo "" >>  /etc/systemd/network/eth0.network
+			echo "[Network]" >>  /etc/systemd/network/eth0.network
+			echo "DHCP=ipv4" >>  /etc/systemd/network/eth0.network
+
+			#if [ -f /lib/systemd/system/systemd-resolved.service ] ; then
+			#	systemctl disable systemd-resolved.service || true
+			#fi

 			if [ -f /lib/systemd/system/systemd-networkd.service ] ; then
 				systemctl enable systemd-networkd.service || true
@@ -1523,7 +1538,8 @@ if [ -f "${tempdir}/etc/dogtag" ] ; then
 fi

 #Add Google IPv4 nameservers
-if [ -f "${tempdir}/etc/resolv.conf" ] ; then
+if [ ! -f "${tempdir}/etc/resolv.conf" ] ; then
+	sudo rm ${tempdir}/etc/resolv.conf || true
 	wfile="${tempdir}/etc/resolv.conf"
 	sudo sh -c "echo 'nameserver <IP_ADDRESS>' > ${wfile}"
 	sudo sh -c "echo 'nameserver <IP_ADDRESS>' >> ${wfile}"
diff --git a/tools/setup_sdcard.sh b/tools/setup_sdcard.sh
index ce2724c1..0e0f3ebf 100755
--- a/tools/setup_sdcard.sh
+++ b/tools/setup_sdcard.sh
@@ -1227,7 +1227,7 @@ populate_rootfs () {
 			echo "console=${extlinux_console}" >> ${wfile}
 		fi

-		cmdline="coherent_pool=1M net.ifnames=0"
+		cmdline="coherent_pool=1M net.ifnames=0 security=apparmor"

 		if [ ! "x${loops_per_jiffy}" = "x" ] ; then
 			cmdline="${cmdline} ${loops_per_jiffy}"
@@ -1371,7 +1371,7 @@ populate_rootfs () {
 		if [ "${BTRFS_FSTAB}" ] ; then
 			echo "${rootfs_drive}  /  btrfs  defaults,noatime  0  1" >> ${wfile}
 		else
-			echo "${rootfs_drive}  /  ${ROOTFS_TYPE}  noatime,errors=remount-ro  0  1" >> ${wfile}
+			echo "${rootfs_drive}  /  ${ROOTFS_TYPE}  noatime,errors=remount-ro,usrquota,grpquota  0  1" >> ${wfile}
 		fi

 		if [ "x${uboot_efi_mode}" = "xenable" ] ; then

omap-image

Key entries in the my-focal.conf used in the build (items not related to this question removed to shorten listing):

release="20.04.2"
image_type="console"
##
##Debootstrap: https://wiki.debian.org/Debootstrap
##
##debootstrap --arch=${deb_arch} --include=${deb_include} --exclude=${deb_exclude} \
##--components=${deb_components} --foreign ${deb_codename} /tmp/tmp.dir/ http://${deb_mirror}
##
deb_distribution="ubuntu"
deb_codename="focal"
deb_arch="armhf"
#
# includes in RobertCNelson version, but not used here:  cloud-guest-utils, alsa-utils, avahi-utils, bluetooth, connman, dnsmasq
deb_include="	\
	acpid	\
	bash-completion	\
	bc	\
	bsdmainutils	\
	build-essential	\
	ca-certificates	\
	can-utils	\
	cpufrequtils	\
	crda	\
	device-tree-compiler	\
	dosfstools	\
	fake-hwclock	\
	fbset	\
	file	\
	git	\
	gnupg	\
	haveged	\
	hexedit	\
	hostapd	\
	htop	\
	i2c-tools	\
	initramfs-tools	\
	iw	\
	linux-base	\
	linux-firmware	\
	locales	\
	lsb-release	\
	make	\
	nano	\
	nethogs	\
	net-tools	\
	nginx	\
	openssh-server	\
	pastebinit	\
	patch	\
	pkg-config	\
	ppp	\
	pps-tools	\
	read-edid	\
	rfkill	\
	rsync	\
	sudo	\
	systemd	\
	systemd-sysv	\
	tio	\
	u-boot-tools	\
	usb-modeswitch	\
	usbutils	\
	wget	\
	wireless-regdb	\
	wireless-tools	\
	wpasupplicant	\
"

#
deb_exclude=""
#
deb_components="main universe multiverse"
deb_mirror=""
##
##Some packages fail to install via debootstrap: deb_additional_pkgs="<comma|space>"
##
deb_additional_pkgs="	\
	gpsd	\
	grub-efi-arm	\
	ifupdown	\
	iptables	\
	libnss-mdns	\
	libnss-systemd	\
	libpam-systemd	\
	libsystemd-dev	\
	net-tools	\
	quota	\
"

##
rfs_default_locale="en_US.UTF-8"
rfs_etc_dogtag="rcn-ee.net Ubuntu 20.04.2 Console Image"
rfs_console_banner="Support: http://elinux.org/BeagleBoardUbuntu"
rfs_console_user_pass="enable"
rfs_ssh_banner="Support: http://elinux.org/BeagleBoardUbuntu"
rfs_ssh_user_pass="enable"
rfs_use_systemdnetworkd="enable"
##
##enable kernel repo: http://repos.rcn-ee.com/(debian|ubuntu)
##Beaglebone Black uses am335x, while Beagleboard-x15 and Beaglebone-AI use am57xx
##configuring for Beaglebone Black only at this time, so removing bb-u-boot-am57xx-evm
repo_rcnee="enable"
repo_rcnee_arch="armhf"
repo_rcnee_pkg_list="	\
	bb-bbai-firmware	\
	bb-cape-overlays	\
	bb-customizations	\
	bb-usb-gadgets	\
	bb-u-boot-am335x-evm	\
	bb-wl18xx-firmware	\
	gpiod	\
	ipumm-dra7xx-installer	\
	linux-image-5.4.106-ti-rt-r35	\
	moreutils
	vpdma-dra7xx-installer	\
	xauth	\
"

repo_rcnee_pkg_version="5.4.106-ti-rt-r35"
repo_rcnee_cmem_version="<IP_ADDRESS>"
include_firmware="enable"

@MMetelko yeah sorry!  I'm pretty happy with how Bullseye is being configured now, i'll be working on backporting this to Buster and Ubuntu LTS..
correct, systemd-network removes our need for dnsmasq!!!
the udev rules for wifi really cleanup the out of box tether stack..
We just need gadget support in systemd:
voodoo@x6-am57xx-beagle-x15-2gb:/lib/systemd$ find . | grep gadget
./system/usb-gadget.target

@RobertCNelson
Given your constant activity in updating this and the rcn-ee/repos/, I can tell you probably have a substantial list of priorities you are working through daily.  Is it possible to provide a possible time frame when you might get to a stable point where backporting makes sense?  I do understand that things happen and desired deadlines can even get delayed, so I am looking for a general timeframe so that I can set expectations on the project I am using this repo to create BBB images.
It is far down the road, can you help me understand where to find the setup for the usb-gadget.target?  Doing the find does show that it is not setup in the builds I have created.

Nah, wpa is still blocking... as long as you have a wifi adapter.. it's fast..

I am still missing something.  Here is what I am running after ./RootStock-NG:
IMG=$(\ls deploy)
cd deploy/$IMG
sudo ./setup_sdcard.sh --img-4gb $IMG --dtb beaglebone --distro-bootloader

Here is what I am seeing:
Log: copying setup_sdcard.sh related files
Log: packaging rootfs: [armhf-rootfs-ubuntu-focal.tar]
-rw-r--r-- 1 root root 964M Oct  8 22:53 /var/lib/jenkins/workspace/ld_dev-5.4-rt-kernel-image-build/omap-image-builder/deploy/ubuntu-20.04.3-console-armhf-2021-10-08/armhf-rootfs-ubuntu-focal.tar
Log: USER:jenkins
syncing media...
0+0 records in
0+0 records out
0 bytes copied, 0.000293332 s, 0.0 kB/s
-----------------------------
U-Boot Overlays Enabled...
Debug: ARM rootfs: armhf-rootfs-ubuntu-focal.tar

Using Distro Bootloader
-----------------------------
cp: cannot stat './u-boot/bb-u-boot-am335x-evm/MLO': No such file or directory

Yes, I followed the pattern of rcn-ee.net-console-ubuntu-focal-v5.10-ti-armhf.conf since I want to use the netplan systemd approach to networking.
Here are the packages I included in the repo_rcnee_pkg_list:
	bb-bbai-firmware	\
	bb-beagle-config	\
	bb-beagle-version	\
	bb-cape-overlays	\
	bb-usb-gadgets	\
	bb-u-boot-am335x-evm	\
	bb-wl18xx-firmware	\
	bb-wlan0-defaults	\
	generic-sys-mods	\
	gt	\
	libusbgx	\
	linux-image-5.4.106-ti-rt-r35	\
	overlayroot	\

I also included u-boot-tools in the deb_include list


Opening Gallery By default

I am clicking on the notification and it is opening Gallery by default but i want to my app. Let me know if there is anything for this.

@puneetkansal04, make sure you are setting up correctly the deep linking URL.


add logging, sync remove/read operations and handle exceptions

Add logging
Sync remove/adding and getting messages
Handle exceptions at Forward service to ensure that forward thread doesn't die when any exception occur.

I abstain.

reviewed

👍


v1.2.0 Deployment Error

Hey there! I am trying to deploy the landing zone accelerator to manage Commercial AWS accounts.
While deploying the stack set, CodeDeploy fails to generate a pipeline with the following build error.
Build failed to start
Build failed to start. The following error occurred: ArtifactsOverride must be set when using artifacts type CodePipelines

In the stackset, the resource GitHubPipeline7B79E906 failed to deploy with the error Internal Failure.

For the next doofus, rtfm and add in the GitHub Personal Access Token 😶🌫


Delivery modes are loaded as soon as application starts

See this image:

We shouldn't try to fetch delivery modes when a user is not on that checkout step
There's undefined in the URL, after /carts: http://localhost:4300/rest/v2//users/anonymous/carts/undefined/deliverymodes?lang=en&curr=USD

On refresh the action LANGUAGE_CHANGE is dispatched. In checkout.effect.ts there is an effect clearCheckoutMiscsDataOnLanguageChange$ that listen's to it and will dispatch CheckoutClearMiscsData() (CHECKOUT_CLEAR_MISCS_DATA).
This action is listened to by reloadSupportedDeliveryModesOnSiteContextChange$ which will in term fire an even to Load Supported Delivery Modes.

Most likely caused by this ticket: https://github.com/SAP/cloud-commerce-spartacus-storefront/issues/3016

This was fixed in #3288


Could not run command wkhtmltopdf on centos 7

On ubuntu its working fine but on centos 7 its not working. My Settings are
        'no-outline',         // Make Chrome not complain
        'orientation' => 'Landscape',
        //'binary' => '/usr/bin/wkhtmltopdf', AND //'binary' => '/usr/local/bin/wkhtmltopdf',
        //'zoom'=>1.5,
        'title'=>$title,
        'page-size' => 'A4',
        'margin-top' => '5',
        'margin-left' => '10',
        'margin-right' => '10',
        'margin-bottom' => '10',
        'footer-html'=>$footer_html,
        //'dpi'=>500,
        // Default page options
        'disable-smart-shrinking',
        'user-style-sheet' => 'css/table-report.css',
        'commandOptions' => array(
          'useExec' => true or false //no luck
        ),
      ));

Version info: wkhtmltopdf 0.12.6 (with patched qt)
Please help me to resolve the issue.

Do you get an error message from getError()? The most likely cause is a permission problem. I can not really help you much as this is specific to your OS, but PHP needs permissions to write to the temp directory and to execute commands with proc_open().
Also search for "centos" in the closed issues. Maybe you find some hints what configuration you need to change.

I remove the proc_open() from disable_function. now the other error
Command unexpectedly terminated without error message


changed to work with API r1.4

changed tf.concat parameters to work with API r1.4, and changed the deprecated tf.initialize_all_variables to the new tf.global_variables_initializer

Thanks a lot @AlyShmahell. Looks good. Can you update the requirements.txt too?

Welcome, I am currently building my own implementation for my thesis, I thought to first go through previous work to avoid obstacles. anyhow, I changed the requirements, tested on my system (Ubuntu 16.04 running on an amd64 architecture), all is swell.

That's great, I have merged the PR. Good luck with your thesis!

Thanks and Cheers!


Autoscaling does not run

Hi,
First of all, thank you for providing such a great solution to a demanding issue with Trino and EMR.
Our EMR cluster contains one primary node (r6g.4xlarge), 2 core nodes (m6g.2xlarge), and 2 task nodes (m6g.2xlarge). I installed and configured the code from this repository as mentioned in the README file. While monitoring the queries for an hour, I noticed that the code does not add new nodes to the cluster.
I added so debugging points to the code. I noticed that in the file TrinoAutoscaler.scala, you are running three classes: Workers, ScalingManager, and TrinoMetricStore. The Workers class is running. The daemon is also running on the master node. However, all the debugging loggers inside the ScalingManager and TrinoMetricStores do not write anything to the logs.
Could you please elaborate on what can be the reason for that?
Regards,
Gamal

Hi Gamal, thank you for reporting this issue. Can you share the configuration that you used in the application.conf for the autoscaling? Besides, have you noticed if this was a sporadic issue or if the problem can constantly be reproduced also on a new cluster? In the meantime I'll try to launch a cluster using the same topology you used to see if I can reproduce the problem in my environment

Hi Gamal, I've performed several tests in past few days but I don't see any problem starting the autoscaling. Everything seems working as expected. I also tried different Java versions to build the package but this didn't trigger any problem. Do you still have problems running the autoscaling? If you want, we can have a call to see what's the problem in your environment. If this is the case let me know a mail where I can reach out to you and I'll contact you from my internal amazon mail.

closed due to inactivity


Greyscale color clothing

About the PR
Greyscales jumpsuits, the prisoner jumpsuit, shoes, and most color gloves.
Instead of each piece of colored clothing having its own RSI, they all just use the same RSI, but with a color modifier passed through the layers that we want to recolor.
Additionally, some clothing (mainly shoes) now have different shades of color that are hopefully more fitting for their set then the ones before. The jumpsuits are all the same primary color as their previous counterparts though (as far as I can remember.)
Of note: there are some minor issues related to the spawn icon that I cannot fix (seemingly.)
Also deletes the IHS combat gloves RSI because I am like 90% sure it is completely unused.
Why / Balance
Color clothes were (apparently) pretty infamous for being really weird and inconsistent. Basically every piece of color clothing had a different shade of color, which tends to look really bad, especially if you're wearing the full set. Most color clothing was also littered with weird-ass palette choices (both bad ramps and bad color choices,) which this hopefully eliminates fully.
This also eliminates a lot of minor sprite inconsistencies within them (did you know yellow shoes had a good shade in the item sprite, but were piss yellow in the worn sprite?) but that's not really important.
Media

[X] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes
This renames & deletes a few pretty common RSI paths, but they shouldn't be too hard to fix.
Changelog
:cl:

tweak: Colored jumpsuits, shoes, and (most) colored gloves are now colorized off of one set of greyscale sprites. They should now be more consistent & significantly less ugly.

where is the black jumpsuit photo

finally, the power ~rangers~ tiders

where is the black jumpsuit photo

Updated the image to include every jumpsuit.

fart director rejoice

Snoozer party