[SPARK-49760][YARN] Correct handling of SPARK_USER env variable ove…

…rride in app master
What changes were proposed in this pull request?
This patch corrects handling of a user-supplied SPARK_USER environment variable in the YARN app master. Currently, the user-supplied value gets appended to the default, like a classpath entry. The patch fixes it by using only the user-supplied value.
Why are the changes needed?
Overriding the SPARK_USER environment variable in the YARN app master with configuration property spark.yarn.appMasterEnv.SPARK_USER currently results in an incorrect value. Client#setupLaunchEnv first sets a default in the environment map using the Hadoop user. After that, YarnSparkHadoopUtil.addPathToEnvironment sees the existing value in the map and interprets the user-supplied value as needing to be appended like a classpath entry. The end result is the Hadoop user appended with the classpath delimiter and user-supplied value, e.g. cnauroth:overrideuser.
Does this PR introduce any user-facing change?
Yes, the app master now uses the user-supplied SPARK_USER if specified. (The default is still the Hadoop user.)
How was this patch tested?

Existing unit tests pass.
Added new unit tests covering default and overridden SPARK_USER for the app master. The override test fails without this patch, and then passes after the patch is applied.
Manually tested in a live YARN cluster as shown below.

Manual testing used the DFSReadWriteTest job with overrides of SPARK_USER:
spark-submit \
    --deploy-mode cluster \
    --files all-lines.txt \
    --class org.apache.spark.examples.DFSReadWriteTest \
    --conf spark.yarn.appMasterEnv.SPARK_USER=sparkuser_appMaster \
    --conf spark.driverEnv.SPARK_USER=sparkuser_driver \
    --conf spark.executorEnv.SPARK_USER=sparkuser_executor \
    /usr/lib/spark/examples/jars/spark-examples.jar \
    all-lines.txt /tmp/DFSReadWriteTest

Before the patch, we can see the app master's SPARK_USER mishandled by looking at the _SUCCESS file in HDFS:
hdfs dfs -ls -R /tmp/DFSReadWriteTest

drwxr-xr-x   - cnauroth:sparkuser_appMaster hadoop          0 2024-09-20 23:35 /tmp/DFSReadWriteTest/dfs_read_write_test
-rw-r--r--   1 cnauroth:sparkuser_appMaster hadoop          0 2024-09-20 23:35 /tmp/DFSReadWriteTest/dfs_read_write_test/_SUCCESS
-rw-r--r--   1 sparkuser_executor                      hadoop    2295080 2024-09-20 23:35 /tmp/DFSReadWriteTest/dfs_read_write_test/part-00000
-rw-r--r--   1 sparkuser_executor                      hadoop    2288718 2024-09-20 23:35 /tmp/DFSReadWriteTest/dfs_read_write_test/part-00001

After the patch, we can see it working correctly:
hdfs dfs -ls -R /tmp/DFSReadWriteTest
drwxr-xr-x   - sparkuser_appMaster hadoop          0 2024-09-23 17:13 /tmp/DFSReadWriteTest/dfs_read_write_test
-rw-r--r--   1 sparkuser_appMaster hadoop          0 2024-09-23 17:13 /tmp/DFSReadWriteTest/dfs_read_write_test/_SUCCESS
-rw-r--r--   1 sparkuser_executor  hadoop    2295080 2024-09-23 17:13 /tmp/DFSReadWriteTest/dfs_read_write_test/part-00000
-rw-r--r--   1 sparkuser_executor  hadoop    2288718 2024-09-23 17:13 /tmp/DFSReadWriteTest/dfs_read_write_test/part-00001

Was this patch authored or co-authored using generative AI tooling?
No.

This pull request is intended for branch-3.5 and cherry-pick to branch-3.4. #48214 is the corresponding master branch pull request.

I've confirmed that this patch can apply to branch-3.4 too, and the tests pass.


Fix connman patches split

This PR will fail to build on qemu boards until https://github.com/resin-os/meta-resin/pull/784 is merged


img button inserts empty tag

I have the editor integrated with Rails-4 and bootstrap-3.
I use the editor in few places. I have a couple of places where everything works fine, including the link button which inserts the link correctly.
However, the image button inserts the following code:
<img alt="">

I can insert an image directly activating the html edit button, but then I lose the whole idea of the editor.
Some ideas?

Same for me, with version 0.3.3

Same for me too.

+1 for this issue

Please open this issue at https://github.com/bootstrap-wysiwyg/bootstrap3-wysiwyg
This repo is deprecated in favor of the above.


fix

fix:The query block configuration failed due to the abnormal shutdown of the node, but it still keeps retrying

请直接在QQ上联系我,谢谢!


Error handling and progress reporting with providers

I am either missing something or it seems to be overly complicated with providers. With pure redux and its single store I would just dispatch an action with error/progress information and some reducer would update appropriate part of a state based on that. Then component would get rerender and I would just display value from a state.
Now with providers I am failing to see a simple way how to do it. Considering following provider. I tried to do something similar as described above, but then I realized that store is isolated I cannot handle those actions in a different provider.
import { actionValidator } from 'validator';
import { createSchema } from 'redux-action-schema';

const schema = createSchema([
	['locatingUser'],
	['userLocated', actionValidator.userLocation],
	['userNotLocated'],
]);

const types = schema.actions;

const actions = schema.actionCreators;

const reducers = {
	location: (state = null) => state,
};

function UserLocationProvider({ request }) {
	async function getInitialState(_, setState, store) {
		try {
			const location = await request.findUserLocation();
			actionValidator.userLocation(location);
			setState(location);
			store.dispatch(actions.userLocated(location));
		} catch (err) {
			store.dispatch(actions.userNotLocated(err));
		}
	}

	return {
		types, actions, reducers,
		replication: {
			replicator: { getInitialState },
		},
	};
}

export default UserLocationProvider;

I certainly don't want to end up with storing progress/error message in this provider because there will be a bunch of other providers with same problem. Just imagining I would have a component with propTypes for each separate error/progress message from state and displaying them conditionally makes me feel rather sick.
I am thinking if subscribeTo can be somehow used for this? I would have a provider for all error/progress states which would subscribe to other relevant providers. Then I would probably had to use store.subscribe to listen for action. But once again considering how easy it is with pure redux, this feels like total hell :(

In most cases, you don't need to explicitly use progress/error states, since you can simply check the prop, and display some progress/error indicator where the component uses that state/prop.
But if you really want to have a separate area in your UI for displaying progress/error messages for multiple providers, you could indeed use subscribeTo and it would be really simple:
// src/providers/status.js

status.subscribeTo = {};

['location', 'poi'].forEach(key => {
  status.subscribeTo[key] = ({ store }, { actionCreators }) => {
    const state = store.getState();

    actionCreators.setProgressStatus(key, state[`${key}Progress`]);
    actionCreators.setErrorStatus(key, state[`${key}Error`]);
  }
});

There isn't really a way around this because providers are meant separate your concerns, which of course means they have no knowledge of each other.  So connecting them in some way requires "glue" like this.  The only reason it's easier to do this with vanilla Redux is because it uses a single store, but there's a huge tradeoff there, and that is less separation of concerns and composability/reusability suffers as a result.  There are always tradeoffs in software engineering.  😉
That said, improving error handling within replication is definitely near the top of my todo list.

I think you've misunderstood me here a little. I don't want to store that progress in each provider separately. That means I cannot read those from store. Instead I am imagining I would be listening for action dispatch on the store of those target providers and update store for status component based on that. But yea, thanks for example, I think this should help me enough. I will just call store.subscribe there and watch for particular actions that are changing progress or yielding errors.


Only returning characters and not numbers (mix)

Hey i just tried this package on Laravel 5.2 but its giving me back just characters and not numbers and characters.
Config File:
<?php
return [

    'default' => 'main',

    'connections' => [

        'main' => [
            'salt' => env('APP_KEY'),
            'length' => 8,
            'alphabet' => 'abcdefghijklmnopqrstuvwxyz',
        ],

        'alternative' => [
            'salt' => 'your-salt-string',
            'length' => 'your-length-integer',
            'alphabet' => 'your-alphabet-string',
        ],

    ],

];

Route File:
<?php

use App\User;

Route::get('/test', function () {

	return Hashids::encode(12);
});

Output
reazwdkw

Please share more of your code.

Did you remember to run php artisan config:cache?

@vinkla
Hey,
Ive added a little more to my initial comment. But theres nothing else to show. Im just trying to encode a integer in my route file and return. It's being returned but im only receiving characters and not numbers.

Then it is working as expected. You've to add numbers to your alphabet in order to display numbers. Try replacing abcdefghijklmnopqrstuvwxyz with abcdefghijklmnopqrstuvwxyz0123456789.

@vinkla
I just tried that and im still only getting letters


Add explanation of Gradle Enterprise implications to JUnit XML config

@bot-gradle test RFM

OK, I've already triggered ReadyForMerge build for you.

This was effectively reviewed out of band.


added keyboard buttons feature to show sequence of buttons

Hello, I am using this nextjs starter for my blog and I added the possibility to use graphic buttons sequences on posts depending on a frontmatter attribute. Would you consider accepting my pull request for this small feature?

The code looks a little strange to me as you are highjacking the SEO component to render the link tag. In any case, I think it would be best if you implement it on your blog and add the example to the demo blog list since it is a niche feature (in my opinion). Other users that might want to emulate it could check out your blog.

The code looks a little strange to me as you are highjacking the SEO component to render the link tag. In any case, I think it would be best if you implement it on your blog and add the example to the demo blog list since it is a niche feature (in my opinion). Other users that might want to emulate it could check out your blog.

That's also a nice idea, thanks! Also, keep up the great work!


amplifyPush ignores SourceDir and puts aws-exports.js to a wrong path

Describe the bug
I have the following  amplify/.config/project-config.json
{
    "projectName": "zzz",
    "version": "2.0",
    "frontend": "javascript",
    "javascript": {
        "framework": "react",
        "config": {
            "SourceDir": "frontend/src",
            "DistributionDir": "frontend/build",
            "BuildCommand": "npm run-script build",
            "StartCommand": "npm run-script start"
        }
    },
    "providers": [
        "awscloudformation"
    ]
}

When I do amplify push on my machine it works fine, the aws-exports.js is created where SourceDir points to. When amplifyPush is executed during the build in the console it generates the file in ./src, ignoring SourceDir setting.
Amplify CLI Version
4.6.0

I am running into the same issue. I can confirm amplifyPush --simple places the file into ./src

Hello guys.
I'm sorry to comment in this old thread, but the issue is still happening. I can confirm that it places the file in the wrong or default directory (./src) and ignores the SourceDir configuration.
In  my specific case is a monorepo setup, and maybe that needs to be checked as well somewhere.
Also there is a lot of people with the same pain on this issue in the docs: 503


Why sparse_categorical_crossentropy is used?

Why sparse_categorical_crossentropy is used?
Looks like here is softmax is used:
https://github.com/nicolov/segmentation_keras/blob/master/model.py#L60
Also I don't understand why our mask batch is:
mask_batch = np.zeros((batch_size, mask_target_size[0] * mask_target_size[1], 1)
and not
mask_batch = np.zeros((batch_size, mask_target_size[0] * mask_target_size[1], 21)
?
https://github.com/nicolov/segmentation_keras/blob/master/utils/image_reader.py#L194

sparse_categorical_crossentropy does the 1-hot encoding internally. This is also the reason why the mask is 1-dimensional, rather than 21-dimensional (where 21 is the number of classes).


OGA BE 1.1 After latest update (1.6 04032021) EmulationStation prompts to configure controls upon booting

Followed the Wiki instructions for a fresh 1.5 image but after I run the updater to 1.6 I get prompted to set up the controls.
Unfortunately it asks to configure more buttons than the OGA 1.1 has (like a right analog stick) so I get stuck and can't complete the process. I tried to plug in a USB keyboard to hit "f4" to close the prompt but I don't think USB keyboards work.
I may be doing something wrong but I've tried this a few times with the same result.

Hmmm....you can bypass the unassignabled keys in ES by holding any face down button until it skips to the next section.  My concern beyond this though is that many of the other emulators may not have working buttons.  I'd like to know what name the control pad comes up as when you go into ssh and type evtest.

  Does it have the built in wifi and USB-C charging port?

Thanks for the tip about bypassing the unassigned keys. After I bypassed the configuration I wasn't able to use WiFi any longer so there is something funny going on.
I just re-imaged to 1.5 and ran the updater again to see if I can tell what controller ES is detecting. The ES controller configuration says '1 Gamepad detected" and then when I do input something it's called:
ODROIDGO2_JOYPAD
Maybe it's not an issue with the gamepad but the update failing somewhere along the way. I might record the update to a video and see if I can go back and see if there is an error.
It's definitely a 1.1 but I do have a 1.0 available and can test both out.

Hmm....it's not called odroidgo2_joypad_v11?

As a 1.1 unit, it should have been ODROIDGO2_JOYPAD_V11.  Try the rk2020/oga 1.0 image and update that.  Does that work?

Yeah it doesn't have the "_V11" distinction.
I'll download the rk2020/oga image and let you know what happens. Might be later on this evening.

OK update!
For whatever reason my old OGA 1.0 that I have was able to successfully run the update. I actually tried updating using both images for the RK2020/OGA1.0 and RGB10/OGA1.1 on my OGA 1.0 and immediately noticed the update took a lot longer to install. I moved the SD card with the OGA1.1 fully updated over to my OGA1.1 and it works just fine. Controls and wifi are working correctly for all the emulators.
I was able to run the update just fine on the OGA 1.1 prior to the 04032021 version so I'm not sure what's going on but I'm glad to have it running. I think I will try running the update on another SD card on the 1.1 just to make sure I'm not crazy.

Weird but ok.


Config changes to reflect the default branch from master to main. Please merge to complete the default branch renaming job.

Auto branch renaming content.

Docs Build status updates of commit e504f8d:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.publish.config.json
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Finding the Numbers

🚀 Feature
You are given an array arr containing 2N+2 positive numbers, out of which 2N numbers exist in pairs whereas the other two number occur exactly once and are distinct. You need to find the other two numbers and print them in ascending order.
Input:
2 (N)
1 2 3 2 1 4  (Array Elements)
Output:
3 4
Have you read the Contributing Guidelines on Pull Requests?
Yes
Motivation
This helps in better understanding of arrays
Pitch
This problem helps in brainstorming for various methods of solving it which makes it really interesting!
Happy Coding!

@SKAUL05 @Abhijit2505 I would like to work on this issue in CPP. Please assign me this issue!

I also would like to work on this issue in C

I would like to work on this in Java

@SKAUL05 @Abhijit2505 @siddharth25pandey, I would like to do this in python

@HarshCasper please also add the CH20 label and difficulty level label.

Kindly label the difficulty level of this issue @iamrajiv

@iamrajiv I would like to take this in Python

@iamrajiv @atarax665 @plazzy99 I have added the Python Code


feat(build-infrastructure): Add default implementations for core interfaces

[!NOTE]
This PR is one of several and builds on previous PRs. Please see previous PRs for more background.

[x] #22853
[ ] Part 2 (this PR): #22865
[ ] Part 3: #22866

This change adds default implementations of the IFluidRepo, IWorkspace, IReleaseGroup, and IPackage interfaces. These implementations are sufficient for most uses in build-tools and build-cli. They may be further extended for specific scenarios in future changes.
Tips for reviewers
I suggest looking primarily at the tests first, then the implementations.
Note that for ease of review, the documentation has been omitted, so this PR will fail CI. Once review is complete, I'll build the docs and update this PR.

Tangent: have we tried updating to type-fest 4.x? Opaque is deprecated now in favor of tagged. Not necessarily to address in this PR, but seems like we'd want to be on their latest.

It went ESM-only, and some packages in build-tools are CJS or dual-emit. While build-cli is ESM only, we try to use the same versions of deps everywhere, hence the lower version.


Project classes for IServiceMetadata is not generated when building Dapr samples

Did you update to preview 3?

This doesn't reproduce locally after updating to preview.4 so closing out.


issue running, app.py file missing

hello it seems that the app.py file was not included in the download and thus i am unable to run the program . Do you think that the file goes under a different name?

Well, you should use the following command to launch the webui.
python infer-web.py

hello, thank you for the awnser. the program now attepmts to run but  the language setting in the infer-web.py is set to swedish insted of one of the existig languges in locale. How would i solve this because i attempted to fin the language code in infer-web.py but was not sucessful.

That's a bug😂We will fix it later.

ok

fixed.


Add ProjectIsolation integration test executer

Fixes #25178

@bot-gradle test this

I've triggered the following builds for you:

PullRequestFeedback build

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

I've triggered a build for you. Click here to see all failures if there's any.


[WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

What changes were proposed in this pull request?
As show in issue SPARK-29015
In hadoop 3.2 & jdk11, when we use 'add jar' to add a jar, then use it's class as serde class.
we can create table successfully but when select data throw ClassNotFound exception.
When we call HiveClientImpl#createTable(), it's called withHiveState(), it will get serde class's constructor with HiveClientImpl's clientLoader's classLoader. When we use 'ADD JAR' sql,  jar will be added to this ClassLoader.
In jdk11, when we call
select * from addJar

In  sql analyze process, it will call HiveClientImpl#withHiveState()
In jdk11, this thread's ThreadLocal SessionState will be attached with HiveClientImpl's state.
When check serde class in HiveTableScanExec, this SessionState  will be used in TableDesc.getDeserializerClass, but doesn't in control of HiveClientImpl#withHiveState
Means it won't replace SessionState's conf's ClassLoader as clientLoader's class loader.
So it can't found class with SessionState's origin ClassLoader.
So we should detach SessionState after we have use it already.
Then   TaskDesc.getDeserializerClass will use classLoader of currentThread.
Since we have se sharedState.jarClassLoader to current thread when we call  execute() in SparkExecuteStatement .
then here will use sharedState.jarClassLoader.
In this Jar ClassLoader, it will contain jars :
-- jar
HIVEAUXCONF SPARK-28954 SPARK-28840
SQL 'ADD JAR'
Why are the changes needed?
support for jdk11
Does this PR introduce any user-facing change?
NO
How was this patch tested?
UT

Test build #110561 has finished for PR 25775 at commit fb39a53.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110561/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/15563/
Test PASSed.

Test build #110587 has started for PR 25775 at commit a510a23.

Test build #110587 has finished for PR 25775 at commit a510a23.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110587/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/15564/
Test PASSed.

Test build #110588 has started for PR 25775 at commit bc73663.

Test build #110588 has finished for PR 25775 at commit bc73663.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110588/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/15595/
Test PASSed.

Test build #110619 has started for PR 25775 at commit f772e49.

Test build #110619 has finished for PR 25775 at commit f772e49.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110619/
Test PASSed.

Test build #110624 has started for PR 25775 at commit 6e70b74.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/15601/
Test PASSed.

Test build #110625 has started for PR 25775 at commit a02d0b6.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/15602/
Test PASSed.

Test build #110626 has started for PR 25775 at commit 01122e3.

Test build #110626 has finished for PR 25775 at commit 01122e3.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110626/
Test FAILed.

Test build #110627 has started for PR 25775 at commit 340e0b6.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/15603/
Test PASSed.

Test build #110624 has finished for PR 25775 at commit 6e70b74.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110624/
Test FAILed.

Test build #110625 has finished for PR 25775 at commit a02d0b6.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110625/
Test PASSed.

Test build #110627 has finished for PR 25775 at commit 340e0b6.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110627/
Test PASSed.

gentle ping @dongjoon-hyun  can you help yo trigger again for jdk8

Can one of the admins verify this patch?

Test build #110640 has started for PR 25775 at commit 35c961f.

Test build #110640 has finished for PR 25775 at commit 35c961f.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110640/
Test FAILed.

This PR tested by HiveThriftBinaryServerSuite#test add jar?

Test build #110771 has started for PR 25775 at commit f30d001.

Test build #110771 has finished for PR 25775 at commit f30d001.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110771/
Test PASSed.

Test build #110805 has started for PR 25775 at commit 4db3b54.

Test build #110805 has finished for PR 25775 at commit 4db3b54.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110805/
Test PASSed.

@AngersZhuuuu Could you add these to How was this patch tested?:
export JAVA_HOME=/usr/lib/jdk-11.0.3
export PATH=$JAVA_HOME/bin:$PATH

build/sbt -Phive-thriftserver -Phadoop-3.2

hive/test-only *HiveSparkSubmitSuite -- -z "SPARK-8368: includes jars passed in through --jars"
hive-thriftserver/test-only *HiveThriftBinaryServerSuite -- -z "test add jar"

@wangyum per your comment at https://github.com/apache/spark/pull/25690 let's merge this first. It looks like it has passed a few times, but I see a number of failures too; since you have been following this more closely, they were due to previous versions of the change? the comment and change sound plausible.
You an also edit the description directly if it's faster. I will make your last change to the description.

I see. Thank you @srowen

Test build #111360 has started for PR 25775 at commit f37335c.

Test build #111360 has finished for PR 25775 at commit f37335c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/111360/
Test PASSed.

Could we revise the PR title more specifically, @AngersZhuuuu and @wangyum ?

Merged to master


Remove unnecessary semicolons

Noticed a bunch of java-like semicolons in the scala code.  This is a trivial PR to tidy up a bit.

Thanks for fixing those, that is much appreciated!


PhantomJS status 'fail' for CSS file

I am getting Status=fail when requesting this CSS file
PhantomJS version = 2.0.0
Link : http://www.nfm.com/Content/MainMasterCss_C4BA203F2F5805AA4E787B1466B7F298.css
Even debugging not helping much.
console.log('Loading a web page');
var page = require('webpage').create();
var url = 'http://www.nfm.com/Content/MainMasterCss_C4BA203F2F5805AA4E787B1466B7F298.css';
page.open(url, function (status) {
   console.log(status);
   page.render('sample.jpg');
   phantom.exit();
});

PhantomJS doesn't support any content except HTML (XML). You can't open non-HTML page directly.
Duplicate. Please see #11501 #10695

I am trying to load an HTML and generate JPG from it.
This CSS file is not loading in PhantomJS and thus i am getting distorted JPG.
But same html source loads correct in brower.

@yogeshugam you can get the reason why your CSS file didn't load by using onResourceError callback

no resourceError.id  is generated


Let declarations

Implements #217
I was going to update the book but I think it was already outdated since it uses my foo = bar instead of foo: my = bar. ¿Should updating the book be a separate PR?.
Also I didn't find any test for atomic local variable declarations, ¿should one be added?

Mm, I see now that : our alone is not valid syntax, and the type is required. So it seems that there's no equivalent for what class Value(our n) meant before, is there?
I didn't catch it before because it seems the playground is not showing all diagnostics.

bors r+
No, there is no equivalent to our x from before. I'll go over the book edits later I think, it needs to be reworked anyhow.


Reset / Clear method

Is there a method in the plugin that allows you to clear the field (analogous to clicking on the Reset button)

From what I can tell so far there is not an outright 'clear'  method you can use the 'set' method and pass an empty string, or the string 'clear'
$("#color-picker").spectrum("set", "");
$("#color-picker").spectrum("set", "clear");
hope this helps


Empty ps-lite directory

Hello,
I downloaded the latest release (.tar.gz) to try installing on a Cray.  When I went to build, I received these messages:
[rsheppar@h4 mxnet-20160309]$ make
Makefile:23: mshadow/make/mshadow.mk: No such file or directory
Makefile:24: dmlc-core/make/dmlc.mk: No such file or directory
Makefile:86: ps-lite/make/ps.mk: No such file or directory
make: *** No rule to make target `ps-lite/make/ps.mk'.  Stop.
When I look, the ps-lite directory is empty after untarring:
rsheppar@login1:/N/dc2/projects/ray/br2/mxnet/mxnet-20160309> ls -l ps-lite
total 0
That doesn't look right.  What did I do wrong?
Thanks in advance,
Ray

You want to do a git clone with --recursive, because of the submodules , see http://mxnet.readthedocs.org/en/latest/build.html

Thanks.  Just a suggestion though, if you list a gzipped tar file under "Releases" for download, most all major installations will expect that file to be complete.  If it doesn't work, maybe it should not be posted to be downloaded.

hmm, The source code zip in the release is automatically generated by github, so we get no control over that.. Anyway, thanks for the suggestion


Publish for multiple targets

Currently, $SupportedTargetFrameworks only contains net6.0 - some other files do however contain logic that points to this libs having been available for other framework version too, like net5 or net472 (there are checks failing the build for net46x).
So to offer this lib for older applications but also be able to use compiler features of newer versions like source generation (see e.g. https://github.com/dotnet/runtime/issues/81709), can we add other targets to the $SupportedTargetFrameworks, or would that jeopardize other features?

@Regenhardt .NET5.0 is out of service and the library dropped support for the .NET Framework in the 3.0 release cycle. Since since, the library has utilized many features to improve the security, performance, and maintainability of the codebase from .NET CORE (.NET).
Are there any specific files reference .NET Framework? These should be removed or updated.

fido2.targets seems to only exist to tell netstandard users that the lib doesn't work with net46x, as is this doc: https://github.com/passwordless-lib/fido2-net-lib/blob/master/Documentation/NET46X.md .
There was an issue asking how to use this in .net48 so I thought it would be nice.
Should i make a PR deleting those two files then?

Also what about adding net7 to the targets to get those new source generation features for people already using net7?

When the frontend lib is merged, it includes a serializer context that works in a net7 frontend too. I just tried setting the applications (Blazor server + client) to net7 keeping the libs at net6 and it worked without any other modifications. You can see the frontend serializer used here, initialized in line 18 and used e.g. in line 78.


Add sortname tag to gamelist.xml

This is essentially the same change as seen here https://github.com/RetroPie/EmulationStation/pull/240 for the RetroPie fork of EmulationStation.
It allows you to sort games under a different name other than the name tag.
This is useful for games that can't be ordered chronologically in alphabetical order like for example the Spyro series for PSX.
It's also useful to order games that begin with "The" under a different letter.
Usage:
<game>
<name>Spyro the Dragon</name>
<sortname>Spyro 1</name>
...
</game>
<game>
<name>Spyro: Year of the Dragon</name>
<sortname>Spyro 3</name>
..
</game>

Thanks!


KeyVault references to secured KV

Is this statement..
"Key Vault references are not presently able to resolve secrets stored in a key vault with network restrictions unless the app is hosted within an App Service Environment."
still accurate, considering regional VNet integration etc.
I have projects where this works and ones where it doesn't, so would appreciate a definitive answer.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7feaa3d0-7233-a3cb-cb9b-a9a55b1f0d7a
Version Independent ID: f41f9d51-52f8-1f45-1043-1344a3b74458
Content: Use Key Vault references - Azure App Service
Content Source: articles/app-service/app-service-key-vault-references.md
Service: app-service
GitHub Login: @mattchenderson
Microsoft Alias: mahender

@phatcher, Thanks for taking time to raise this question!
@mattchenderson, Requesting your comments on this feedback.

The documentation accurately reflects our current statement of support. We hope to have this resolved soon.

As Matthew mentioned, once it's resolved we will also update our doc appropriately. We will close this for now. Thanks for taking time to share your feedback.


[Feature] Generate basic config.toml file via graphman

Description
Would be great if graphman command could generate a basic config file by using a template. This way ever new starter could easily get the config.toml created and just change the capslocked configurations inside it that works for him.
Are you aware of any blockers that must be resolved before implementing this feature? If so, which? Link to any relevant GitHub issues.
No response
Some information to help us out

[ ] Tick this box if you plan on implementing this feature yourself.
[X] I have searched the issue tracker to make sure this issue is not a duplicate.

@YassinEldeeb proposes that we could use the @maoueh example from https://github.com/streamingfast/graph-node-dev/blob/master/config/eth-mainnet-rpc.toml

What's the advantage here in generating it via graphman as opposed to having some example .toml's in some public repo?

Closing in favour of examples & documentation


Extract CSS to sub-folder "dist/assets/css" with correct asset paths

Bug Report or Feature Request (mark with an x)
- [ ] bug report -> please search issues before submitting
- [x] feature request

Area
- [x] devkit
- [ ] schematics

Versions
Devkit 0.6.8
Desired functionality
As currently implemented one can only specify "extractCss: true" - it would be nice to specify the output filename to extract to e.g. an "dist/assets/" folder.
The usecase is to have a clean, structured dist package.
Mention any other details that might be useful
In order to implement this feature, the "postcss-cli-resources" plugin has to be modified.
As currently implemented it can't handle the asset paths relative to the "to-be-extracted" css file, so I think there's a need to tell the plugin where the css file will later be outputted to so it can modify the paths accordingly.

Does this really make sense? In production mode mostly we use outputHashing: true which generates random hash names for all files. This ensures updated files are not cached by the browser. Also files that did not change don't have to be uploaded(file upload can skip exisiting file names).
Is it really more clean to have a styles.css in assets folder? Personally i would leave generation / naming of automatically generated files to webpack/angular-cli.

Depends, my current customer wants it that way and I try to implement what's desired.
Personally I'm also a big fan of clean structures so I don't have to scroll through huge directory listings of images, HTML, whatever to find a specific file.

You can move the extracted CSS to any location desired as long as the index.html is updated to reflect the new location.
Also please note that clean is a highly opinionated topic.  Some would argue a flat directory structure to be cleaner than a large amount of nested directories.  It can also be useful to consider the output (dist) directory to be an opaque object that is transferred directly to the deployment server; wherein the structure is largely irrelevant.


JDK 8 updated

8u162-b12 is no longer available.
Please update to 8u172-b11.
JAVA_UPDATE=172
JAVA_BUILD=11
JAVA_PATH=a58eab1ec242421181065cdc37240b08
Please verify before including these:
JAVA_SHA256_SUM=f08f25aec2bdc86138ccba8fd5b904451e3afa1d24a88c85f28c2d84bfd45bad
JCE_SHA256_SUM=f3020a3922efd6626c2fff45695d527f34a8020e938a49292561f18ad1320b59
Also, FYI to others, on OSX you can use shasum -a 256 in lieu of sha256sum to generate/check sum's.

I've just solved this, in roughly one hour the images should be updated on Docker Hub as well.


[internal] Add support for globals

Globals are precomputed variables which can be reused inside multicolumn blocks. Thanks to them expensive operations can be avoided on row level.
Changes are backwards compatible.
Example:
Before:
comma do
  id "id"
  first_name "first_name"

  multicolumn :site do |result, record, site|
    if site.expensive_operation?
      result << { name: "verified", value: record.verified }
    end
  end
end

# ...

ar_relation.to_comma

After:
comma do
  id "id"
  first_name "first_name"

  multicolumn :site do |result, record, site, globals|
    if globals.fetch(:expensive_operation) { site.expensive_operation? }
      result << { name: "verified", value:  record.verified }
    end
  end
end

# ...

ar_relation.to_comma(globals: { expensive_operation: site.expensive_operation? })

This is wiki is for the public gem to which we're not going to port our changes - they're sort of duplicating some functionalities and are not tested well enough.


Screenshot Colorscheme

Hey,
Great work on the plugin. I was wondering if you still happen to have the name of the colorscheme, or if it's a custom one, if you would mind sharing?
Thanks in advance!

I moved away from using Vim themes. I just set the 16 colors shown in iTerm. In Vim I sue 'cterm' colors, not 'gui' colors. Very basic. I don't remember that theme from screenshot but you can easily reproduce it:

Font is "CMU Typewriter Text"
To get that dark line set fillchars+=stl:―,stlnc:—
bg is f6e9e7 and fg color is black. you adjust other colors by eyeballing.

You could look at some syntax adjustments I made: https://github.com/girishji/declutter.vim
Sometime ago I did experiment with fancy color themes. I don't use it anymore but you can take inspiration:
https://github.com/girishji/declutter.nvim


Developers: Requested Rippers up-for-grabs (meta-issue)

If you would like to develop a ripper which has been requested, please open an issue (to function as a work item) indicating that you've claimed a ripper and you're working on an implementation. Please link back to this issue (and #502 as an FYI) so that GitHub makes a link to the issue (work item) appear in this thread and #502.
I'm locking this conversation to ensure requests and general comments stay on #502. (It looks like link-backs won't appear on a locked issue, so I won't be able to lock this issue.)
To keep this issue focused, I will delete requests and non-dev-related comments (please use #502 for these).
Below is a list of rippers and functionality requested via #502 and #8 (this list is a work in progress -- I'm posting a thumbs-up reaction on any requests I have added to this list). Please assume all links are NSFW.
High priority (existing rippers: broken or missing functionality)

[ ] Fix DeviantART: #496 #425 #272 #112 #63
[ ] DeviantART favorites galleries e.g. http://philosophyfetish.deviantart.com/favourites/ (Request)
[ ] Tumblr liked by {User}: https://www.tumblr.com/liked/by/hacky-gif (Request)

Everything else:

[ ] PurplePort: https://purpleport.com/ e.g. https://purpleport.com/portfolio/bluethealienteafairy/ (Request)
[ ] CFake: http://cfake.com/ e.g. http://cfake.com/picture/Olivia-Munn/969 (Request, Comment, Comment)
[ ] VSCO: http://www.vsco.co e.g. https://vsco.co/lukept/images/1 (Request, Comment, Comment)
[ ] zenfolio https://en.zenfolio.com (Request)
[ ] smugmug https://www.smugmug.com/ (Request)
[ ] sex.com: (Request: https://github.com/4pr0n/ripme/issues/274)

Pending sites + examples (from #8)

getgonewild - http://www.getgonewild.com/profile/rollmeup
blogspot - http://marcherryfashion.blogspot.com/
pixiv - http://www.pixiv.net/member.php?id=2136123
facebook - https://www.facebook.com/EmanueleFerrariPhotographer/photos_stream
pinterest - http://www.pinterest.com/
lookbook - http://lookbook.nu/mayowo
4shared - http://www.4shared.com/folder/pTUpT6wG/Heather.html
behance - https://www.behance.net/HS-nj
dribbble - https://dribbble.com/studioMUTI
fetlife - https://fetlife.com/users/2089769
diverxity - http://www.diverxity.com/users/953
studio-g - http://studio-g.tistory.com/535
fg-site - http://www.fg-site.net/members/umeume/
gelbooru - http://gelbooru.com/index.php?page=post&s=list&tags=futa
thefappening.sexy - http://thefappening.sexy/albums/index.php?/category/126
ipernity - http://www.ipernity.com/doc/kimcums/album/676241
punterplanet - http://guide.punterplanet.com/escorts/featured/frontpage/amber-green_200.html
rule34 - rule34.paheal.net
photoblog.pl - http://www.photoblog.pl/colordust/170020651/typical-girl.html
megamodels.pl - http://www.megamodels.pl/a-ya
maxmodels.pl - http://www.maxmodels.pl/modelka-agnes-z-garbledville.html
flog.pl - http://www.flog.pl/szukaj/akt

Enhancement requests (list from #8):

flickr - login support (see #32)
vk - Video ripper rename files (https://github.com/4pr0n/ripme/issues/8#issuecomment-41349715)
twitter - Search ripping (https://github.com/4pr0n/ripme/issues/8#issuecomment-41471274)
gifyo - Don't skip some images
*chan rippers - Handle external links (vocaroo), store comments
tumblr - Rip by date (/archive/year/month) (https://github.com/4pr0n/ripme/issues/8#issuecomment-41395317)

Acknowledged but defunct requests:

kinkyshare.com (now redirects to sex.com, old content seems to be gone) (Request)
artician - http://zionenciel.artician.com/

I've made a working implementation and submitted a pull request, but I think it could be done better when someone has the time if they use org.json. Should I still make an issue even if I'm not likely to be able to  continue to devote much time to it?

@Wiiplay123 I think there are plenty of issues already open to track the various DeviantArt problems. If you have a patch, please open a PR. If you don't think it's good enough, it won't work, or whatever, please make that clear in the pull request description. Maybe someone else will be able to pick up the work.

I opened a PR, turns out the modified ripper is even better than the original ripper, since it accounts for those annoying download redirects that redirect you back to the gallery page.


This PR resolves []
Description

Unfortunately we can't remove these as is, the bundled js is created as a side effect of these jobs. That probably shouldn't be the case we can separate out that step from these jobs and remove the tests. Reverting until we do so we can get betas working again.
PR Checklist

[ ] I tested my changes on iOS / Android.
[ ] I added screenshots or videos to illustrate my changes.
[ ] I added Tests and Stories for my changes.
[ ] I added an app state migration.
[ ] I hid my changes behind a feature flag.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

iOS user-facing changes

Android user-facing changes

Dev changes

Revert removing test js step from betas, to get bundled js working again - Brian

Need help with something? Have a look on our docs, or get in touch with us.

thanks for fixing this @brainbicycle I apologize I didn't test this thoroughly


OSError: [Errno 101] Network is unreachable

🔍 Before submitting the issue

[X] I have searched among the existing issues
[X] I am using a Python virtual environment

🐞 Description of the bug
`f = examples.download_file("mixing_elbow.pmdb", "pyfluent/mixing_elbow")
Traceback (most recent call last):
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/urllib/request.py", line 1348, in do_open
h.request(req.get_method(), req.selector, req.data, headers,
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 1282, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 1328, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 1277, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 1037, in _send_output
self.send(msg)
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 975, in send
self.connect()
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 1447, in connect
super().connect()
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/http/client.py", line 941, in connect
self.sock = self._create_connection(
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/socket.py", line 845, in create_connection
raise err
File "/home/aus1n19/.conda/envs/pyfluentenv/lib/python3.10/socket.py", line 833, in create_connection
sock.connect(sa)
OSError: [Errno 101] Network is unreachable`
Mind well the above occured, just after the imports, given in the example page for mixing_elbow.py. And I am not sure, why it would not pick up the examples directory?
Anything I could do to correct this?
📝 Steps to reproduce
`import ansys.fluent.core as pyfluent
from ansys.fluent.core import examples
#import_filename = "elbow.pmdb' # This gave a an error "Import Geometry is not found at path /TaskObject" at
# meshing.workflow.TaskObject["Import Geometry"].Arguments = {
import_filename = examples.download_file("mixing_elbow.pmdb", "pyfluent/mixing_elbow")` # This gave the Network error described above.
💻 Which operating system are you using?
Linux
📀 Which ANSYS version are you using?
23.1
🐍 Which Python version are you using?
3.10
📦 Installed packages
ansys-api-fluent==0.3.5
ansys-api-platform-instancemanagement==1.0.0b3
ansys-fluent-core==0.12.5
ansys-fluent-parametric==0.6.1
ansys-fluent-visualization==0.6.0
ansys-platform-instancemanagement==1.0.3
appdirs==1.4.4
certifi @ file:///croot/certifi_1671487769961/work/certifi
charset-normalizer==3.1.0
contourpy==1.0.7
cycler==0.11.0
fonttools==4.39.2
googleapis-common-protos==1.58.0
grpcio==1.51.3
h5py==3.8.0
idna==3.4
imageio==2.26.0
importlib-metadata==6.0.0
kiwisolver==1.4.4
matplotlib==3.7.1
numpy==1.24.2
packaging==23.0
pandas==1.5.3
Pillow==9.4.0
platformdirs==3.1.1
pooch==1.7.0
protobuf==3.20.3
protoc-gen-swagger==0.1.0
pyparsing==3.0.9
PySide6==6.2.4
python-dateutil==2.8.2
pytz==2022.7.1
pyvista==0.38.4
pyvistaqt==0.9.1
QtPy==2.3.0
requests==2.28.2
scooby==0.7.1
shiboken6==6.2.4
six==1.16.0
urllib3==1.26.15
vtk==9.2.6
zipp==3.15.0

import urllib.request
response = urllib.request.urlopen("https://raw.githubusercontent.com/pyansys/example-data/master/pyfluent/mixing_elbow/mixing_elbow.pmdb")
print(response.status)

Could you please provide the output of the above code outside pyfluent?

It seems your cluster node doesn't have access to github network to download the geometry file. Perhaps, you can download it outside the cluster and submit it with your job.
import_filename = examples.download_file("mixing_elbow.pmdb", "pyfluent/mixing_elbow")

import_filename is the downloaded location of the .pmdb file which you need to copy to your cluster.

I think you just pass the cad file name to the location where it's stored on your cluster right.

So that is infact my question @dnwillia-work , if I have a pmdb file, how do I assign to a variable name?
Also, in my slurm script, I also have a cd $SLURM_SUBMIT_DIR which basically goes to the place where .py, .pmdb and .slurm file exists. So I'd argue this command is indeed correct. But correct me if I am wrong, that "/myfolder/elbow.pmdb" should be best practice instead? or perhaps something else?

Sorry about that, I thought it was clear what was wrong.  Regarding my previous post you would want to change it by a single character right:
 import_filename = "elbow.pmdb"
i.e. use double quotes on both ends or single quotes but don't combine them.  For your second issue you will have to get the files downloaded ahead of time and deploy them to a location where the compute nodes can see them.  eg: somewhere on the file system.

Sufficient information provided. Hopefully, this is working for you now.


Errors when running in mujoco robotics envrionment, due to the obs dimensionality.

Hi, thanks for your elegant and clear implementations of SAC and TD3. Your algorithms work quite well in all experiments except the robotics environment.
When I run your algorithm in robotics env, it will return error:
  File "/home/rfa-xw/spinningup/spinup/algos/sac/sac.py", line 139, in sac
    obs_dim = env.observation_space.shape[0]
TypeError: 'NoneType' object is not subscriptable

That's because in robotics environment, the observation is a 10 dimensional dict containing 'observation', 'desired_goal' and 'achieved_goal'. So I changed following in sac.py line 140:
    #obs_dim = env.observation_space.shape[0]
    obs_dim = env.observation_space.spaces['observation'].shape[0]

And also in line 258 for the replay buffer:
        # Store experience to replay buffer
        replay_buffer.store(o['observation'], a, r, o2['observation'], d)

In line 218 for session:
        return sess.run(act_op, feed_dict={x_ph: o['observation'].reshape(1,-1)})[0]

For the full script: the modified sac.py
I hope this could help anyone who wants to play in robotics environment!

This is really brilliant work. I ran into the same problem, but I still cannot resolve the issue. How were you able to run the modified sac.py file in the CarRacing-v0 environment? I posted my question in late December here. Would appreciate any help!

I'm getting the same error for text environments .. how has this not been changed?

@pringithub As far as I know the problem hasn't been fixed.


chore: restart schema registry on upgrade

Should fix issue where sasl has been turned on but schema-registry needs to restart.

Do we need to do this restart even when we're turning off sasl?

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


⚠ Bofrost.at has degraded performance

In dcf1f96, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2733 ms

Resolved: Bofrost.at performance has improved in 001b9ea.


chore: add alpine as allowed base image

Description

add 'alpine' as allowed base-image

updates https://github.com/eclipse-tractusx/sig-infra/issues/259
Pre-review checks
Please ensure to do as many of the following checks as possible, before asking for committer review:

[x] DEPENDENCIES are up-to-date. Dash license tool. Committers can open IP issues for restricted libs.
[x] Copyright and license header are present on all affected files

I think it is ok to merge it, but I'm missing some examples in our unit-tests.
The check is currently just doing a lazy contains. This would allow too many images in my opinion.
So what do we want to allow as base image here? is it plain alpine, or is it every image, that is based on alpine like a postgres alpine image for example?
We should add proper unit-tests with allowed and unallowed examples and enhance the isAllowedBaseImage function
/ping @FaGru3n @almadigabor


Mission clean up and reset on abort or estop

Clean up and reset after mission abort or emergency stop.
The current system does not reliably land the vehicle and clear the previous mission after the mission is aborted or the estop pressed (and even possibly after the mission is completed).
When flying on a real drone there were multiple cases where the estop or abort was pressed to kill the drone. Once the drone was grounded the estop was released, then around 30 seconds to a minute later, the drone decided to spin up and continue with its mission.
A mechanisim is needed to interrupt the blocking on initial takeoff as well. waiting for navigate messages still get printed regardless of estop or abort.

Verified repeatable test:

Send navigate command {z: 1, auto_arm: true}, drone flies into the air successfully
Send Emergency stop, drone falls to ground
Send another navigate command, drone successfully arms but fails to takeoff
Send another navigate command, (a) simple_offboard errors with TF NAN_INPUT as vehicle_1/setpoint contains nan positions. (b) Mavros instance fails to connect to fcu as both SITL and parameter bridge appears to die..

SITL:
opic":"~/heartbeat","msg":{"alive":1}} from http://localhost:8080 ::ffff:<IP_ADDRESS>
mavros_1   | [run_ros1.sh-1] [ERROR] [1637340325.291763772]: TM : Time jump detected. Resetting time synchroniser.
simhost_1  | [gzweb_entrypoint.sh-2] Fri Nov 19 2021 16:45:25 GMT+0000 (Coordinated Universal Time) Received Message: {"op":"publish","id":"publish:~/heartbeat:55","topic":"~/heartbeat","msg":{"alive":1}} from http://localhost:8080 ::ffff:<IP_ADDRESS>
sitl_1     | ERROR: Floating point exception - aborting
sitl_1     | Running: sh dumpstack.sh 1 >dumpstack_arducopter.1.out 2>&1
sitl_1     | Failed
sitl_1     | ERROR: segmentation fault - aborting
sitl_1     | Running: sh dumpstack.sh 1 >dumpstack_arducopter.1.out 2>&1
sitl_1     | Failed
mavros_1   | [run_ros1.sh-1] [ERROR] [1637340327.094053452]: tcp0: receive: Connection reset by peer
mavros_1   | [run_ros1.sh-1] terminate called after throwing an instance of 'boost::wrapexcept<boost::system::system_error>'
mavros_1   | [run_ros1.sh-1]   what():  shutdown: Transport endpoint is not connected
projectstarling_sitl_1 exited with code 127
simhost_1  | [gzserver-1] [Wrn] [ArduPilotPlugin.cc:1019] [iris_demo] Broken ArduPilot connection, count [0/5]

Param bridge (after death of sitl)
mavros_1   | [run_ros1.sh-1] [ INFO] [1637340328.454266037]: tcp0: Server address: <IP_ADDRESS>:5760
mavros_1   | [parameter_bridge-2] /bridge_ws/install/ros1_bridge/lib/ros1_bridge/parameter_bridge: line 1:   125 Aborted                 (core dumped) $0 $@
mavros_1   | [ERROR] [parameter_bridge-2]: process has died [pid 66, exit code 134, cmd 'bash -c sleep 2.0; $0 $@ /bridge_ws/install/ros1_bridge/lib/ros1_bridge/parameter_bridge /vehicle_1/topics /vehicle_1/services_1to2 /vehicle_1/services_2to1 --ros-args -r __ns:=/vehicle_1'].
mavros_1   | [INFO] [parameter_bridge-2]: process started with pid [158]
simhost_1  | [gzserver-1] [Wrn] [ArduPilotPlugin.cc:1019] [iris_demo] Broken ArduPilot connection, count [1/5]
mavros_1   | [run_ros1.sh-1] [FATAL] [1637340329.134484316]: FCU: DeviceError:tcp:connect: Connection refused


Copyright Update

Minor update needed to document: the copyright dates should be set to 2023 as the availability via Freeze would make it a product of 2023, not 2022.

Hey, @bcstrongx, we should clean this up before Freeze.  So, please let me know when you've made this change.
Other than this, the Spec Policy signoff is done.

Thanks, @bcstrongx!!!