python310Packages.jaxopt: 0.5.5 -> 0.8.1

python310Packages.bambi: 0.10.0 -> 0.12.0
python310Packages.blackjax: 0.9.6 -> 1.0.0
python310Packages.chex: 0.1.82 -> 0.1.83
Description of changes
Update some packages; unbreaks python310Packages.bambi.
Supersedes #240692.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[NA] (Module updates) Added a release notes entry if the change is significant
[NA] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Removed extraneous fetchpatch from blackjax.
Unclear why Hydra is terminating some of the builds.

nixpkgs-review succeeds for me, unclear why some builds are being terminated for @anthonyroussel.

nixpkgs-review succeeds for me, unclear why some builds are being terminated for @anthonyroussel.

Looks like bambi, blackjax and jaxopt builds are failing on my laptop because of out-of-memory errors. I will run the nixpkgs-review-checks again


How does Fractal submit slurm jobs from the correct user?

Now that the server setup is progressing and different users can submit jobs: How do we make sure that Fractal submits jobs from the correct user?
The correct user needs to be selected, because read & write rights on our servers are user specific (on the Pelkmans side: broad read rights, but write rights limited to the personal drive). Also important on the FMI side for accounting on who uses the cluster.
As discussed with @tcompa today, the SlurmProvider does take an account string. But can we just set that to the correct user? How is this authenticated? (see here: https://parsl.readthedocs.io/en/stable/stubs/parsl.providers.SlurmProvider.html) Can we have a generic Fractal server to which users authenticate or do there need to be user-specific servers running?

We tried a submission script submit.sh including the account field (*)
#!/bin/bash

#SBATCH --partition=main
#SBATCH --account=ACCOUNT

echo $USER

When ACCOUNT matches with the account of our fractal user, then sbatch submit.sh is successful and outputs fractal. When we set ACCOUNT to be the one of another user, we get an error message
sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified

This confirms what is most logical: if fractal is run by a standard (i.e. without special permissions) user, it cannot submit jobs for other users. At the same time, we know that running fractal from a slurm-admin user is not safe.
More discussions needed on this point.

(*) Note that the account is different from the user. You can find accounts for all users via sacctmgr list User

I discussed this with Enrico at FMI today. Here's the main response:

There are mainly two possible ways of implementing the execution with the proper UNIX user ID. The simplest is probably simply using sudo, the same way jupyter hub does. Jupyter hub use the Linux PAM services to check for the user password, if the password is correct it has permission to sudo to any Liberali group member unix user without a password (note: it cannot sudo to root for example).
The other way would be to use the SLURM REST API: https://slurm.schedmd.com/rest.html . For this to work I think that every user need to start her / his own slurmrestd process. Since it's the user that starts the process it's already running as the correct UNIX user. We can probably also automate the start of the process, but we need to figure out how. Slurmrestd also supports authentication, so fractal can present the correct token to authenticate to the process. The user can generate the token and input it as a parameter in the web interface https://slurm.schedmd.com/jwt.html . The token can have a relatively long life (even a month or up to 3 months, which is the lifetime of our passwords), so the user doesn't have to refresh this often.
The latter is a bit more secure for the general use case as it doesn't require extensive sudo privileges, but for a single group sudo can also be an acceptable option.

After some discussion, it sounds like both approaches seem reasonable, let's see what can be implemented through Parsl.
If we go the sudo root, we will need a Fractal user on the cluster with sudo rights to the relevant users (e.g. to the Liberali group at FMI). We would then need to make sure there is a specific command that needs to be called to start processing a project for a user and only apply sudo to that command (=> to the parsl command that will trigger the apply function?)
Not fully sure whether the slurm REST API auth approach would work with parsl/SBATCH, but worth checking out.
Another consideration: The sudo approach is potentially a bit less secure, but may be more generalizable (not slurm specific).
On the UZH cluster, I guess we can easily set up the relevant users. On the FMI side, we'll have the virtual machine 1016 that already has a cluster like the main FMI cluster. It has a single node and only CPU cores (80 or so). We'll need to talk to Enrico to get a sudo user for Fractal on there.
As long as the Fractal sudo user only writes locally and then uses sudo to change to user accounts for jobs, a local sudo user should be fine. If we need a Fractal user that can also write to the shares etc, then we'll need to start the process to get an actual full user (which will be possible, will just take some days to have up & running).

As discussed with @tcompa today, the SlurmProvider does take an account string. But can we just set that to the correct user? How is this authenticated? (see here: https://parsl.readthedocs.io/en/stable/stubs/parsl.providers.SlurmProvider.html) Can we have a generic Fractal server to which users authenticate or do there need to be user-specific servers running?

The general idea is that if the auth exposes the same username as the one used by slurm, then fractal server becomes a proxy and acts on behalf of that user and with that user's privileges. Of course, this requires the right privileges being set on the user that runs fractal
server, i.e., more similar to the sudo way per above.
In any case, the way in which everything is structured foresees one and only one server process serving many users.

Next step: we should get some test users with required privileges, to test (at least at the SLURM level, without parsl) that we can submit jobs "as the correct user".

Also, let's make sure it's not just recorded as that user, but that we also have the read & write privileges. e.g. can this privileged user submit jobs as jluethi to the pelkmanslab cluster and write things to my share? And can I still use those files normally afterwards (i.e. are permissions set correctly).

Useful reference from https://slurm.schedmd.com/sbatch.html:
--uid=
Attempt to submit and/or run a job as user instead of the invoking user id. The invoking user's credentials will be used to check access permissions for the target partition. User root may use this option to run jobs as a normal user in a RootOnly partition for example. If run as root, sbatch will drop its permissions to the uid specified after node allocation is successful. user may be the user name or numerical user ID.

Something @mfranzon also suggested to think about:
We could use SSH channels within parsl (https://parsl.readthedocs.io/en/stable/stubs/parsl.channels.SSHChannel.html) and then each user would use their own keys.
(this is just food for thought)


--hdfs-download-source and spark-download-source {v} formatting requires --hdfs-version/--spark-version to be specified earlier

It's very convenient that we can use {v} to template the sparh/hdfs version in --hdfs-download-source http://path.to/hadoop_{v}.tgz or --spark-download-source http://path.to/spark_{v}.tgz. However, the only case where this works, is if the --hdfs-version or --spark-version has been set earlier on the command line (i.e. order of arguments matter).
More importantly, the values in the config files are not using for {v} templating.
I know the {v} templating is is an undocumented feature, but it'd be nice if it played well with all config sources, as it's an incredibly useful way to provide our own mirrors to our data scientist, who only have to specify --hdfs-version or --spark-version that way.
Before taking a stab at a PR, i'd like just like to briefly discuss if all of this is even the intended behavior, or if something else is in the works wrt to mirrors etc.

Hi @jkgeyti. Please provide the information requested in the issue template.
Please also provide some example invocations of Filntrock with example config files to better illustrate the issue you are experiencing. I am not clear on what you are seeing.

Any update here on the information I requested in my previous comment, @jkgeyti?

Closing this issue because I don't have enough information to act on it. Feel free to reopen it @jkgeyti with the information I requested.


Refactor common validation logic into a new method on the expr.Validator interface

And swap config validation to use it.

This change is

Jenkins job mixer/presubmit passed

Jenkins job istio/mixer-pr-master passed


Not working preselected from collapsible

After the page is loaded class active removed from collapsible-header.
If I'm not mistaken, the site in the examples section of the accordion with a pre-open sections, too not work.
http://materializecss.com/collapsible.html

Duplicate of #4375


Sprint 2 favorite screen implementation

merge conflic on favorite screen implementation

we have reviewed the changes, you can merge it.

Review done.


[FEA] Make LZ4_CHUNK_SIZE configurable

Currently LZ4_CHUNK_SIZE is hardcoded to 64KB, but we'd like to be able to configure this to try out different chunk sizes.
This is to create an internal config that makes it possible to change, keeping a 64KB default.

Handled by @jbrennan333 https://github.com/NVIDIA/spark-rapids/pull/3757


They updated the .json again

@glouel Yesterday was update day and I guess they updated Hawaii again and New York👎🏻

Thanks for the heads up, I'll have a look.

It really is just annoying

Updated here : https://github.com/JohnCoates/Aerial/issues/630#issuecomment-446372861


feat: support reservedENIs for vpc cni custom networking

Fixes #
https://github.com/aws/karpenter/issues/2273
Description

Support aws.reservedENIs in global settings to allow for proper max-pods and kube-reserved calculations when using the VPC CNI Custom Networking mode (primary CIDR for nodes; secondary CIDR for pods).

How was this change tested?

Does this change impact docs?

[ ] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[ ] No

Release Note

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

can some design page be written about this ?
we separate our network in this manner, by having having the nodes in one set of subnets and pods on much bigger CGNat subnets.
So having some documentation and design around this feature would be appreciated so we could best configure things on our side.
thanks

can some design page be written about this ? we separate our network in this manner, by having having the nodes in one set of subnets and pods on much bigger CGNat subnets. So having some documentation and design around this feature would be appreciated so we could best configure things on our side. thanks

I added some docs in the latest update to the PR @FernandoMiguel. Do these docs seem sufficient? I think the best reference (which I liked to in the docs) is the EKS Best Practices guide for Custom Networking https://aws.github.io/aws-eks-best-practices/networking/custom-networking

much better and clear @bwagner5 .
thanks
is there anyway this could be discoverable so a manual config is not required?

much better and clear @bwagner5 . thanks is there anyway this could be discoverable so a manual config is not required?

Looked into an auto-discovery for a while, and there's simply not a great way to do it. If you have multiple subnets in an AZ, it's not clear if that should be used for Custom Networking or you're just scaling out your IPs in different subnets, or you have special routing on the subnets. Looked into discovering the VPC CNI configuration, but it's hard to detect VPC CNI from a permissions perspective and if you rename the VPC CNI or some other change to the deployment, it may not work. The pro of a manual configuration is that other CNIs or strategies can use this to tune Karpenter to the general approach without having to rely on a specific component's configuration (i..e VPC CNI vs Calico)

The maximum number of LTs that we could create for an instance launch is ~10 for c, m, and r instance types. This would be for small provisioning where we include the smallest instance types and all larger ones across amd64 and arm64.
$ for it in $(aws ec2 describe-instance-types | jq -r '.InstanceTypes[] .InstanceType' | grep -i '^[cmr]'); do ./max-pods-calculator.sh --cni-version 1.7.4 --instance-type $it >> /tmp/maxpods; done
$ cat /tmp/maxpods | sort | uniq -c | wc -l
       7

So there are 7 unique max-pods buckets for c,m,and r instance types. Adding in arm64 instance types gives us not quite double that number.
In the average case, we're only creating 3 - 5 LTs (up from our 1 - 2 LTs created today).

:white_check_mark: utilization-pr-3516-px6lg tests passed
:white_check_mark: ipv6-pr-3516-t5nbq tests passed
:white_check_mark: drift-pr-3516-dvbm7 tests passed
:white_check_mark: interruption-pr-3516-c4j8t tests passed
:white_check_mark: chaos-pr-3516-5glms tests passed
:white_check_mark: consolidation-pr-3516-kh298 tests passed
:white_check_mark: machine-pr-3516-jvv9h tests passed
:white_check_mark: integration-pr-3516-slvsz tests passed

As per above fix we are seeing limited number of pods since it is not considering IP address delegation . example
for c5.large it is only showing max pods as 20 even though we could attach 3 enis and we can use around 60+ IPs


fix installation compatibility of ubuntu 20.04

Coverage remained the same at 33.933% when pulling 60cc6733e6e094241ca5df956b44ab21fe779654 on zhiyuhe/fix_u2004_squashed into 3800494a48f7b96fbe856fdf9ccb11a5767f2690 on master.

Coverage remained the same at 33.933% when pulling 60cc6733e6e094241ca5df956b44ab21fe779654 on zhiyuhe/fix_u2004_squashed into 3800494a48f7b96fbe856fdf9ccb11a5767f2690 on master.


Allow ranged attacks beyond max range

Chain Infusion allows a Kineticist to make ranged attacks outside of the normal range by having them originate from the enemy that was previously hit. The system will prevent you from making a ranged attack if the target is outside of the normal range, so in order to roll a proper ranged attack you have to move your token to make sure the target is within the normal range.
A temporary workaround is that you can just do melee attacks since nothing prevents you from doing one against a target outside of melee range, but than that attack is considered melee and probably bypass any special rule elements like a target getting bonuses from ranged attacks.

My immediate thought on how this would be handled would be a message in the striking warning that its beyond the maximum range, and either a prompt (standalone if dialogs disabled, part of the attack roll dialog if enabled) asking if you want to attack anyways or sheet styling on the strike button to indicate its beyond max range.


Added support to export annotations

The backend command supports sparse / dense annotations (as requested in #132) as and writes results in standard BeaverDam JSON format. Dense annotations are created between first and last keyframe using interpolation. Since BeaverDam uses html5 currentTime as timestamping mechanism, the command will need to know the fps of the video files. If not specified via command line, video files will automatically be probed using ffmpeg. This command should support local, remote video files and image lists.
Type python manage.py export_annotations --help for usage help.
A simple annotation viewer using OpenCV can be found here
https://gist.github.com/cheind/9850e35bb08cfe12500942fb8b55531f
Dense annotations will be stored in a new JSON field ('frames' per default) that follows this structure
{
    "frameid": 854,                     # Frame number with respect to start of video
    "frame": 68.32000000000001,         # Time measured in seconds from start computed as frameid * 1/FPS
    "state": "Red",                     # State copied from previous keyframe, or matching keyframe if refid is set
    "x": 1647.905947318195,             # interpolated x coordinate of bounds
    "y": 1142.1628561977332,            # interpolated y coordinate of bounds
    "w":<PHONE_NUMBER>7459997,            # interpolated width of bounds
    "h":<PHONE_NUMBER>529337,             # interpolated height of bounds
    "continueInterpolation": true,      # -
    "refid": 17                         # Matched keyframe ID if any
}

Note that BeaverDam uses HTML5 currentTime to store keyframe times. These times vary between browsers and some browsers might even reduce the resolution of this field on purpose.  See
https://stackoverflow.com/questions/32318333/html-5-currenttime-accuracy
https://bugs.chromium.org/p/chromium/issues/detail?id=555376
Therefore, the video probed FPS and hence computed frame times might not exactly match up the timestamps stored during browser annotation (except for image-lists where FPS is set to exactly 1).

Thanks!

You're welcome. What I also wanted to mention is that I'm not really doing anyhting with the field continueInterpolation. What relevance does it have?


[MAS2.4.3]Focus is landing on non-interactive elements after activating the 'Show a simple' Adaptive cards button.

Actual Result:
Focus is landing on non-interactive elements after activating the 'Show a simple' Adaptive cards button.
Expected Result:
Focus should not land on non-interactive elements after activating the 'Show a simple' Adaptive cards button.
Repro Steps:

Open URL https://microsoft.github.io/BotFramework-WebChat/full-bundle/ in Edge browser.
Notice 'Upload File' and 'Send' button icons present in bottom of screen.
Type 'Help' in the input control at the bottom of the screen and hit enter (or click on send button).
Content will upload, Navigate to any "Show a simple  Adaptive cards " button by using Tab key and press Enter on it.
New data will appear.
Navigate to the new uploaded content by using Tab key.
Observe that focus is landing on the non-interactive element.

User Impact:
If focus lands on the non-interactive elements then user will get confuse and not able to understand that what action will do.
MAS Reference:
MAS 2.4.3 - Focus Order (05)
Test Environment:
OS: Windows 10
OS Build: 17134.345
OS Version: 1803
Browser: Edge
****Attachment:
MAS2.4.3_Focus is landing on non-interactive element.zip
**

Adaptive Cards is setting tabIndex="0" to the root container, regardless whether the card is clickable or not. Some cards do support clicking on, but the "simple card" mentioned in this issue should not be clickable.
If you visit https://adaptivecards.io/samples/, you will see the DOM tree looks like the following screenshot.

This is a bug on Adaptive Cards. Please file a bug on their repo.

Reopening so we can confirm from the accessibility team.

Confirmed with accessibility team as external

I have been looking at this today and here are my findings:

The apparently desired behavior calls for removing the tab stop on the root card container
That would indeed be a better for anyone that has no disability and is able read and see the card
But removing that tab stop makes narrator not stop on the card, and thus not read it. That seems really bad to me when it comes to actual accessibility

So my conclusion:

"Fixing" this issue would favor power users over people with disabilities who use narration
I do not believe there is a fix; we need to keep the root card as a tab stop

I think we'll need to look into other ways to solve this if it is critical (is it?)
Thoughts and comments welcome.

@dclaux That's a really good point.
@awalia13, would you have time to look at this? Please let us know if we can close the issue on the AC repo as no-op, or if you have suggestions on another way to fix.

Agreed with @dclaux. hence closing this bug.

@awalia13 - you might consider reopening this issue, as we've made a fix over on the AdaptiveCards side (see microsoft/adaptivecards#4019). Narrator is indeed able to read cards correctly without a tabstop. To adopt this fix in your codebase, you'll need to make a small change to enable the desired behavior.

@corinagum As we checked, the bug still repro's at our side.
Still our focus lands on the non interactive card which doesn't have any functionality. Please refer the attached video "focus lands on non interactive card.zip"
Uploading focus lands on non interactive card.zip…
Correct URL: https://microsoft.github.io/BotFramework-WebChat/01.getting-started/a.full-bundle/

#HCL;#Accessibility;#HCL_BotFramework_WebChat;A11yMAS;WCAG2.4.3


nbdev_build_lib: UnicodeDecodeError

Hi,
I've just installed nbdev on Windows 10 and was following the tutorial as the first steps.
nbdev_build_lib command was raising the following error: UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 489: character maps to
That was easily corrected adding the encoding to the read_config_file() in imports.py.
def read_config_file(file):
    config = ConfigParser()
    config.read(file, encoding='utf-8')
    return config

Don't know if that is the only place to fix. Should I make a Pull request for it?

Yes please do.


[SPARK-30434][PYTHON][SQL] Move pandas related functionalities into pandas sub-package

What changes were proposed in this pull request?
This PR proposes to move pandas related functionalities into pandas package. Namely:
pyspark/sql/pandas
├── __init__.py
├── conversion.py  # Conversion between pandas and PySpark DataFrames
├── functions.py   # pandas_udf
├── group_ops.py   # Grouped UDF / Cogrouped UDF + groupby.apply, groupby.cogroup.apply
├── map_ops.py     # Map Iter UDF + mapInPandas
├── serializers.py # pandas <> PyArrow serializers
└── types.py       # Type utils between pandas PyArrow

In order to separately locate groupby.apply, groupby.cogroup.apply, mapInPandas, toPandas, and createDataFrame(pdf) under pandas sub-package, I had to use a mix-in approach which Scala side uses often by trait, and also pandas itself uses this approach (see IndexOpsMixin as an example) to group related functionalities. Currently, you can think it's like Scala's self typed trait.
Yes, This is a big PR but they are mostly just moving around except one case createDataFrame which I had to split the methods.
Why are the changes needed?
There are pandas functionalities here and there and I myself lose where it was. Also, when you have to make a change commonly for all of pandas related features, it's almost impossible now.
Also, after this change, DataFrame and SparkSession become more consistent with Scala side since pandas is specific to Python, and this change separate pandas-specific APIs.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Existing tests should cover.

@BryanCutler and @ueshin, I think we talked about this once before .. this PR targets to move everything related to pandas and pyarrow to one package pandas. Mostly it's just moving around the codes although the changes are big.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20961/
Test PASSed.

Test build #116169 has started for PR 27109 at commit c89e5d5.

Test build #116169 has finished for PR 27109 at commit c89e5d5.

This patch fails Python style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116169/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20962/
Test PASSed.

Test build #116170 has started for PR 27109 at commit e2a3bc0.

cc @cloud-fan and @viirya for better visibility - it's also related with pandas revisit one

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20963/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20965/
Test PASSed.

Test build #116174 has started for PR 27109 at commit cfd7839.

Test build #116174 has finished for PR 27109 at commit cfd7839.

This patch fails build dependency tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116174/
Test FAILed.

retest this please

Test build #116178 has started for PR 27109 at commit cfd7839.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20971/
Test PASSed.

Test build #116170 has finished for PR 27109 at commit e2a3bc0.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116170/
Test FAILed.

Test build #116178 has finished for PR 27109 at commit cfd7839.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116178/
Test FAILed.

retest this please

Test build #116196 has started for PR 27109 at commit cfd7839.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20989/
Test PASSed.

Test build #116196 has finished for PR 27109 at commit cfd7839.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116196/
Test FAILed.

retest this please

Retest this please.

Test build #116208 has started for PR 27109 at commit cfd7839.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21000/
Test PASSed.

Test build #116208 has finished for PR 27109 at commit cfd7839.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116208/
Test FAILed.

Test build #116217 has started for PR 27109 at commit fdaf0b3.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21009/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116217/
Test FAILed.

Test build #116220 has started for PR 27109 at commit ec66cbd.

Test build #116220 has finished for PR 27109 at commit ec66cbd.

This patch fails some tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116220/
Test FAILed.

retest this please

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21012/
Test PASSed.

Test build #116221 has started for PR 27109 at commit 3354d90.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21013/
Test PASSed.

Test build #116221 has finished for PR 27109 at commit 3354d90.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116221/
Test FAILed.

retest this please

Test build #116226 has started for PR 27109 at commit 3354d90.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21018/
Test PASSed.

Test build #116226 has finished for PR 27109 at commit 3354d90.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116226/
Test FAILed.

retest this please

Test build #116237 has started for PR 27109 at commit 3354d90.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21029/
Test PASSed.

Test build #116237 has finished for PR 27109 at commit 3354d90.

This patch fails PySpark pip packaging tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116237/
Test FAILed.

Test build #116240 has started for PR 27109 at commit c63c271.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21032/
Test PASSed.

Test build #116240 has finished for PR 27109 at commit c63c271.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116240/
Test PASSed.

Thanks all. I will merge this tomorrow if I don't see any major concerns.

Merged to master.


Adhar verification for workers

Lack of verified workers
The nationality, credibility of a worker can't be gauged without adhar verification[...]
what can we do about it
After worker login, the worker can land upto a page where he/she'd require to upload their adhar card image.
**Alternative **
This is a really hard method, but if you can send an OTP to the adhar card verified no., it'd be great. If you can't, opt for 1st method.
Any other simpler way?
You can think of a simpler way to do this.

@KaizenGirl1111  maam, please assign me in this issue under gssoc 22

@mayank-del could you please confirm if you got my request on discord?

@mayank-del could you please confirm if you got my request on discord?

@KaizenGirl1111  , can we meet on discord at 9pm

@KaizenGirl1111  maam, just tell me , should I work on adhar verification with or without previos PR's code???

Yes @mayank-del , please.

@mayank-del
I would like to request you to "fetch and merge" and the "git pull" to your repo..
I think your repo is lagging behind with commits

@mayank-del I would like to request you to "fetch and merge" and the "git pull" to your repo.. I think your repo is lagging behind with commits

It means the problem is not due to my code ,ok thank god.
@KaizenGirl1111  maam, So it would be better, if  I add adhaar verification between Login and client request page .

@mayank-del I would like to request you to "fetch and merge" and the "git pull" to your repo.. I think your repo is lagging behind with commits

It means the problem is not due to my code ,ok thank god.
@KaizenGirl1111 maam, So it would be better, if I add adhaar verification between Login and client request page .

Means , I am saying that user will login ,then he will verify aadhar , then he will get access to view client's request.

Yes the otp option is good.
Also of service is paid, I need to get it in 1-2 days right?

@mayank-del

Yes the otp option is good. Also of service is paid, I need to get it in 1-2 days right?

Yes maam, It takes 1-2 days to those companies to contact you, then the further process happens.

Hey @mayank-del 👋
It is 1 day to go for GSSoC to end, it's okay if we can't add this funtionality in ideal way, we can add a portal for people to upload the adhar image.
If even that is not possible in this short span, it is alright we'll close the issue
Great working with you, :)

@KaizenGirl1111  ,No maam, It's mayank here, I found an awsome api

@KaizenGirl1111 ,No maam, It's mayank here,I never left any work unfinished.
Actually, I found an awsome api,

it's policy is also very awesome ,I will just add the code to call that api and entire code how to make verify otp and everything today itself.
Only UI would left


[SMALLFIX] Use static imports for standard test utilities

Use static imports for standard test utilities in /alluxio/core/common/src/test/java/alluxio/retry/CountingRetryTest.java

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/2732/
Test FAILed.


Add menu link target to config

I dont want the menu links to open a new tab.
Would be nice to have the target in the config next to url and text.

Added support for a :target entry in a link (see updated README). Will be included in the next release.

Thanks! The new top menu design is fancy too :P


docs: fix minor typos in commands.md

@steveeJ The skip-ci-on-docs check isn't working

Semaphore: ~/rkt $ git diff-tree --no-commit-id --name-only -r HEAD..origin/master
CHANGELOG.md
Documentation/commands.md
Documentation/devel/pod-lifecycle.md
Documentation/getting-started-ubuntu.md
Documentation/hacking.md
Documentation/running-lkvm-stage1.md
Documentation/subcommands/image.md
Documentation/subcommands/prepare.md
Documentation/using-rkt-with-systemd.md
Makefile
README.md
ROADMAP.md
common/common.go
configure.ac
makelib/build_go_bin.mk
makelib/build_static_c_bin.mk
makelib/file-ops-epilog.mk
makelib/git-refresh.mk
makelib/git.mk
makelib/misc.mk
makelib/variables.mk.in
makelib/verbosity.mk
pkg/aci/aci.go
pkg/fileutil/fileutil.go
pkg/fileutil/fileutil_test.go
pkg/tar/chroot.go
pkg/tar/tar.go
pkg/uid/uid.go
rkt/api_service.go
rkt/enter.go
rkt/gc.go
rkt/image_gc.go
rkt/image_list.go
rkt/image_rm.go
rkt/images.go
rkt/list.go
rkt/pods.go
rkt/prepare.go
rkt/run.go
scripts/vagrant/install-rkt.sh
stage1/aci/aci-install.mk
stage1/find-so-deps.mk
stage1/init/common/mount.go
stage1/init/init.go
stage1/init/kvm/mount.go
stage1/init/pod.go
stage1/init/pod_test.go
stage1/makelib/aci_install_bin.mk
stage1/makelib/aci_simple_go_bin.mk
stage1/stage1.mk
stage1/usr_from_coreos/build-usr.mk
stage1/usr_from_coreos/cache.sh
stage1/usr_from_coreos/coreos-common.mk
stage1/usr_from_host/usr_from_host.mk
stage1/usr_from_kvm/kernel.mk
stage1/usr_from_kvm/lkvm.mk
stage1/usr_from_src/usr_from_src.mk
store/aciinfo.go
store/migrate.go
store/schema.go
store/store.go
store/store_test.go
store/tree.go
tests/README.md
tests/functional.mk
tests/rkt_ace_validator_test.go
tests/rkt_app_isolator_test.go
tests/rkt_auth_test.go
tests/rkt_caps_test.go
tests/rkt_cat_manifest_test.go
tests/rkt_env_test.go
tests/rkt_etc_hosts_test.go
tests/rkt_exec_test.go
tests/rkt_exit_test.go
tests/rkt_fetch_test.go
tests/rkt_image_export_test.go
tests/rkt_image_extract_test.go
tests/rkt_image_gc_test.go
tests/rkt_image_list_test.go
tests/rkt_image_render_test.go
tests/rkt_image_rm_test.go
tests/rkt_interactive_test.go
tests/rkt_list_test.go
tests/rkt_net_test.go
tests/rkt_non_root_test.go
tests/rkt_os_arch_test.go
tests/rkt_pid_file_test.go
tests/rkt_run_pod_manifest_test.go
tests/rkt_service_file_test.go
tests/rkt_socket_activation_test.go
tests/rkt_supplementary_gids_test.go
tests/rkt_tests.go
tests/rkt_trust_test.go
tests/rkt_userns_test.go
tests/rkt_volume_test.go
tests/run-build.sh
tests/tests.mk
tests/testutils/ctx.go
tests/testutils/utils.go
Semaphore: ~/rkt $ git status origin/master
On branch master
Your branch is ahead of 'origin/master' by 98 commits.
  (use "git push" to publish your local commits)
nothing to commit, working directory clean
Semaphore: ~/rkt $ git fetch
Warning: Permanently added 'github.com,<IP_ADDRESS>' (RSA) to the list of known hosts.
remote: Counting objects: 1, done.
remote: Total 1 (delta 0), reused 0 (delta 0), pack-reused 0
Unpacking objects: 100% (1/1), done.
From github.com:coreos/rkt
   5084bb5..84d26f9  master     -> origin/master
 * [new tag]         v0.11.0    -> v0.11.0
Semaphore: ~/rkt $ git diff-tree --no-commit-id --name-only -r HEAD..origin/master
Documentation/commands.md
Semaphore: ~/rkt $

#1747


vs code not showing accept incoming/current changes

VSCode Version: vs 1.48.2 (downloaded from vs)
OS Version: windows 10

Steps to Reproduce:

did a git pull origin master
opened vs code from cmd with "code ." from root level git folder.

I tried multiple solutions relating to this issue but none of them are fixing the issue.
I referred this one https://github.com/eamodio/vscode-gitlens/issues/319
I ensured that under userpreferences the diffEditor option is set true (toggled and checked)
I checked in output logs. nothing there.

strangely, I'm not able see extensions from market place. it's just empty.

I believe the complete installation is messed up in my machine. I uninstalled and installed the vs code twice. (did windows restart also :P)  Still the same issue.
Please help fix this issue. The diff editor was helping me big time.
Does this issue occur when all extensions are disabled?: No

you say the issue goes away when extensions are disabled?

No. The extensions are not even loading in the market place. It's just empty when I move to the extensions section. As a result, I couldn't install any extensions.

can you try running with a fresh user data dir? code --user-data-dir <pathToNewEmptyDirectory> .


Unable to integrate ibm dot com footer component into our react application

Detailed description
We are using the following versions of carbon coponents:
"carbon-components": "^10.7.4",
"carbon-components-react": "^7.7.4",
Inorder to use the ibm-dotcom-library we have imported the<EMAIL_ADDRESS>into our scss file. Below is the error we are getting in the console:
./src/style/app.scss (./node_modules/css-loader/dist/cjs.js??ref--6-oneOf-5-1!./node_modules/postcss-loader/src??postcss!./node_modules/resolve-url-loader??ref--6-oneOf-5-3!./node_modules/sass-loader/dist/cjs.js??ref--6-oneOf-5-4!./src/style/app.scss)
SassError: File to import not found or unreadable: carbon-components/scss/globals/scss/vars.
on line 18 of<EMAIL_ADDRESS>from line 8 of<EMAIL_ADDRESS>from line 6 of D:\IBM DBG\UI_Shell\dynamic-loading-component-features-redux\ui\src\style\app.scss

@import 'carbon-components/scss/globals/scss/vars';

Can someone help in fixing this bug?

Describe in detail the issue you're having.

Is this a feature request (new component, new icon), a bug, or a general
issue?

Is this issue related to a specific component?

What did you expect to happen? What happened instead? What would you like to
see changed?

What browser are you working in?

What version of the IBM.com Library are you using?

What offering/product do you work on? Any pressing ship or release dates we
should be aware of?

Steps to reproduce the issue

Step one
Step two
Step three
etc.

Additional information

Screenshots or code
Notes

@RaphaelAmadeu would you be able to assist?
cc: @ljcarot @RobertaJHahn

@tanvi-sambari ,
Could you please attach your package.json file to the issue? So we can have a better idea of the issue.
Thanks!

@RobertaJHahn: Here it is-
{
"name": "ui",
"version": "0.1.0",
"private": true,
"dependencies": {
"@carbon/ibmdotcom-react": "^1.4.1",
"@carbon/icons-react": "^10.6.1",
"@testing-library/jest-dom": "^4.2.4",
"@testing-library/react": "^9.3.2",
"@testing-library/user-event": "^7.1.2",
"carbon-components": "^10.7.4",
"carbon-components-react": "^7.7.4",
"js-cookie": "^2.2.1",
"jwt-decode": "^2.2.0",
"node-sass-chokidar": "^1.4.0",
"query-string": "^6.10.1",
"react": "^16.12.0",
"react-dom": "^16.12.0",
"react-redux": "^7.1.3",
"react-router-dom": "^5.1.2",
"react-scripts": "3.4.0",
"redux": "^4.0.5",
"redux-thunk": "^2.3.0"
},
"devDependencies": {
"concurrently": "^5.0.2",
"node-sass": "^4.13.0"
},
"scripts": {
"start": "npm run dev-server --verbose",
"dev-server": "react-scripts start",
"build": "react-scripts build --verbose",
"test": "react-scripts test",
"eject": "react-scripts eject",
"build-css": "node-sass-chokidar --include-path ./src --include-path ./node_modules src/ -o src/"
},
"eslintConfig": {
"extends": "react-app"
},
"browserslist": {
"production": [
">0.2%",
"not dead",
"not op_mini all"
],
"development": [
"last 1 chrome version",
"last 1 firefox version",
"last 1 safari version"
]
}
}

@tanvi-sambari ,
In order to use our footer and styling you have to install the following packages on your application:
@carbon/ibmdotcom-styles
@carbon/ibmdotcom-react
Then import the footer component from @carbon/ibmdotcom-react.
The import at your scss should be @import '@carbon/ibmdotcom-styles'
This should solve your issue, let us know if this worked,
Thanks!

Thanks. Got it. Had to import {styles} from  '@carbon/ibmdotcom-styles'.

@RaphaelAmadeu : Importing {styles} from  '@carbon/ibmdotcom-styles' does solve the error but it distorts the other styles on my page. I need to import only @carbon/ibmdotcom-styles/scss/components/footer/index.scss and that is still giving me the error -<EMAIL_ADDRESS><EMAIL_ADDRESS>SassError: File to import not found or unreadable: carbon-components/scss/globals/scss/vars.
on line 18 of<EMAIL_ADDRESS>from line 8 of D:\IBM<EMAIL_ADDRESS>

@import 'carbon-components/scss/globals/scss/vars';


HTTP Error 404.

I installed letsencrypt SSL on exchange 2016 and windows server 2016, I successfully installed the SSL using this command wacs.exe --target manual --host mail.example.com,webmail.example.com,autodiscover.example.com --certificatestore My --installation iis,script --installationsiteid 1 --script "./Scripts/ImportExchange.ps1" --scriptparameters "'{CertThumbprint}' 'IIS,SMTP,IMAP' 1 '{CacheFile}' '{CachePassword}' '{CertFriendlyName}'"
but after that i can't access to exchange managment console https://localhost/ecp/ and also OWA , always give me HTTP Error 404.
I also tried to access through the internet using https://mail.example.com/owa also the same problem not found 404 .

It's sounds like the binding in IIS was not created, but I can't tell for sure unless you post the full output of the program.

Yes you are right the problem was from IIS binding in Default Web site, For some reason, I found  2 sites binding for port 443 and I delete one of them and restart IIS , it solves 404 Error but now when I try to access to ecp or owa I just get an empty page after login in local and through the internet !!

Thanks for your help I solved my problem by changing the https binding site in Exchange back end.

Hmm, I hope that the duplicate binding was not created by this program. Which version did you run? And do you mind to repeat the process from the beginning to see if it happens again?

Did some testing with both 0 and 1 pre-existing :443 bindings on the default website and was not able to get a duplicate binding to appear.

Hi sorry for the late response, I used v2.0.4 version, I think maybe this problem appear because I already did the process two times, one by the code which I mentioned before and one by double click on the wacs.exe file and follow the wizard ...


ARROW-1134: [C++] Support for C++/CLI compilation, add NULLPTR define to avoid using nullptr in public headers

cc @tobyshaw. Can you test this?
Close #1098

We should probably have some kind of linting script to check that nullptr or <mutex> does not creep into a public header. I could write some kind of Python script for this if

@xhochy @cpcloud I would suggest we should merge this and wait for more feedback from C++/CLI users

In the meantime we'll need to add a linting script so that this work does not get undone by a future patch

+1 LGTM


Add setting for the template dir (allow overrides)

With this setting, it doesn't matter where you put wagtailtrans in your INSTALLED_APPS, wagtail templates will be overridden by wagtailtrans.
from wagtailtrans import WAGTAILTRANS_TEMPLATE_DIR

TEMPLATES = {
    # ....
    'DIRS': [
        WAGTAILTRANS_TEMPLATE_DIR,
    ]
    # ....
}

Coverage increased (+0.1%) to 78.876% when pulling 5d679075efcbefc8216eac12e55f7358e8dbbf87 on template-dir-setting into 91830fa8daef802fafc1cda94d1ff0e6ef41a640 on master.


Bind tmpnb and proxy to explicit interfaces.

These were binding to all interfaces before when we only needed them on explicit interfaces:

tmpnb's orchestrate belongs only on localhost for the proxy to be able to reach
proxy should only be serviceable via the interface nginx reaches it from. In this case its service net but we should allow localhost too.

Running a deployment now to see how this shakes out.

:shipit:


[Compatibility issue] between EMI and Gates to eternity in modpack.

Hi i play LL7 (TNP Limitless) modpack and found recently that when using EMI content from Gateways to eternity mod does not show up when i search it, some other mods like iron jetpacks seems to beheve strange aswell.
Gateways mod with EMI:

With only JEI:

Iron Jetspacks with EMI:

With only JEI:

Reported to pack dev team but I was also advised to report it here just in case.
Some additional info
Pack version: Limitless 7 v0.33.0
Forge version: 47.2.0
EMI version: 1.0.28
JEI version: <IP_ADDRESS>
Log files:
latest.log
And Crash (it sometimes crashes when world is loaded and i try to open inventory):
crash-2023-12-20_12.34.28-client.txt

I think I left this open to take a better look, EMI and JEI should both be pulling sidebar stacks from the creative tabs, there have been many mods in the past that have broken this vanilla system and caused EMI to use the fallback registry items, which seems to be present in your screenshot here. There's not much EMI can do to fix this, you'd have to remove the problem mods breaking vanilla creative tabs.


Fix quote policy

Auto parse mr_enclave and mr_signer from libenclave-ehsm-core.signed.so
Support null policyid.

Signed-off-by: wanghouqi<EMAIL_ADDRESS>

commit msg改一下
Fix quote policy -> Auto generate self mrenclave/mrsigner for Quote test


Expire goals

Attach datetimes to goals, and expire them after a configurable amount of time.

Added 4 hour expiration, not yet configurable


iOS Marker with no popup issue

I have a marker on the map and I have no title set, so I do not want a popup window (I am having the tap trigger something else). That works just fine, the issue is when I try to interact with the map after that. On iOS (to me) it seems it thinks a popup is active and it takes 1 click to "dismiss" it and then the 2nd click will be a normal tap on the map.
So if I tap a marker that has no popup then try to listen on OnMapClickListener, it will only trigger on the 2nd tap.

Same for me (issue with the selected state of the marker). Found a quick fix (bad fix), adding and removing marker by id.

Same for me (issue with the selected state of the marker). Found a quick fix (bad fix), adding and removing marker by id.


Add domentation for startPrivateConversation()

Also make it known that you must pass a text property to all message objects, even if it's only empty string

Thanks!!


host-lb: unexpected rev NAT xlation for non-service connections

It has been observed that a connection from host netns to a Pod via PodIP can be unexpectedly rev-NAT translated. For example (<IP_ADDRESS> is IP addr of kube-dns Pod, <IP_ADDRESS> is kube-dns ClusterIP):
host # nslookup google.com <IP_ADDRESS>
;; reply from unexpected source: <IP_ADDRESS>#53, expected <IP_ADDRESS>#53

This can happen when a socket cookie + PodIP + port combination is not unique in LB{4,6}_REVERSE_NAT_SK_MAP, which can happen due a guarantee that the cookie is unique only within netns.
Unfortunately, src IP / port is not available in the relevant CGROUPS hooks used by host-lb. So, to fix this, we should either make a cookie globally unique in the kernel or add a BPF helper to retrieve a netns ID (?) which could be used in the map key.

Submitted<EMAIL_ADDRESS>


declare open method

python open file with default open method 'r', which will failed to read on binary files.

Thanks for the fix, can you close this one and make pull request to the dev branch?


Update gulp, gulp-sass and gulp-autoprefixed

Proposed Changes

Update gulp-sass with sass (dart-sass) and remove Node Sass is deprecated with recomendation gulp-sass

Tests

Lint ok :heavy_check_mark:
Build ok :heavy_check_mark:
Test unit ok :heavy_check_mark:

dont working with node version 10x


Switch to latest VS Code test package.

Tests are currently failing due to the bug outlined here https://github.com/microsoft/vscode-azure-account/pull/603

I did this in #3275


[ECS] Resources not tested

In ECS category a lots of resources as been not tested :
https://github.com/FrangipaneTeam/provider-flexibleengine/blob/f3eec10fd0fc33d78c62f3e1898c6d0efe20eaea/list-tested.md?plain=1#L100
https://github.com/FrangipaneTeam/provider-flexibleengine/blob/f3eec10fd0fc33d78c62f3e1898c6d0efe20eaea/list-tested.md?plain=1#L102
https://github.com/FrangipaneTeam/provider-flexibleengine/blob/f3eec10fd0fc33d78c62f3e1898c6d0efe20eaea/list-tested.md?plain=1#L104

VolumeAttach.ecs.flexibleengine.upbound.io/v1beta1 require flexibleengine_blockstorage_volume_v2 in category EVS


update

yes i know have 2 open issues
https://github.com/dnschneid/crouton/issues/4884
https://github.com/chromeos/chromeos.dev/issues/559
Crouton and test1 are now working as they should


fix: resolving FPs with compressed response body

As we decided on last monthy chat, we are going to trust Content-Encoding response header. This fix was supposed to deal only with rule 953120 but i think there no sense searching for any patterns in compressed data at all, so we should skip all rules dealing with RESPONSE_BODY. Current PR fixes this for 953* rules but i suggest to add similar skipping rule into all response rules (i can update this PR).
Fixes #2751.

Is SecDisableBackendCompression also updating/removing Content-Encoding header?

Just to be sure, i tested usage of Content-Encoding on Apache (should be also tested at least on nginx):

when a compression is activated on Apache level, RESPONSE_BODY is not compressed and header Content-Encoding is added after modsecurity (so modsec don't see it)
when a compression is activated on PHP level, RESPONSE_BODY is compressed and header Content-Encoding is visible to modsecurity

I can't test SecDisableBackendCompression though.

What SecDisableBackendCompression does is just removing the Accept-Encoding and TE headers. See https://github.com/owasp-modsecurity/ModSecurity/blob/v2/master/apache2/mod_security2.c#L1114-L1117

Note: because of howlibmodsecurity3 works, the exact same thing can be achieved by the connector itself. Meaning you can remove those headers in nginx for example before passing it to modsec3, and it should have the same effect.


run time spawning problem

(using git  cortex-m-rtic#2354845 )
I am getting a run time error with task scheduling. The code further below, modified from example/schedule.rs, should print
init ending
foo
bar
foo
foo
baz
bar
cdr
bar
baz
foo

but only prints
init ending
foo
bar
cdr
baz

The problem seems to be that a task function can only be spawned once. I've tested with bluepill and blackpill stm32f411.

Click to expand code
// from  /cortex-m-rtic/examples/schedule.rs

#![deny(unsafe_code)]
#![deny(warnings)]
#![no_main]
#![no_std]

use panic_semihosting as _;

use rtic::app;

// NOTE: does NOT work on QEMU!

// see <pac>::Interrupt for dispatchers,  e.g. stm32l4::stm32l4x1::Interrupt

#[cfg_attr(feature = "stm32f1xx", app(device = stm32f1xx_hal::pac,   dispatchers = [TIM2, TIM3]))]
#[cfg_attr(feature = "stm32f3xx", app(device = stm32f3xx_hal::pac,   dispatchers = [TIM2, TIM3]))]
#[cfg_attr(feature = "stm32f4xx", app(device = stm32f4xx_hal::pac,   dispatchers = [TIM2, TIM3]))]
#[cfg_attr(feature = "stm32f7xx", app(device = stm32f7xx_hal::pac,   dispatchers = [TIM2, TIM3]))]
#[cfg_attr(feature = "stm32h7xx", app(device = stm32h7xx_hal::pac,   dispatchers = [TIM2, TIM3]))]
#[cfg_attr(feature = "stm32l1xx", app(device = stm32l1xx_hal::stm32, dispatchers = [TIM2, TIM3]))] //fails
#[cfg_attr(feature = "stm32l4xx", app(device = stm32l4xx_hal::pac,   dispatchers = [TIM2, TIM3]))]

//#[rtic::app(device = lm3s6965, dispatchers = [SSI0])]

mod app {
    use cortex_m_semihosting::{hprintln};
    use systick_monotonic::*;

    const MONO_HZ: u32 = 8_000_000; // 8 MHz

    #[monotonic(binds = SysTick, default = true)]
    type MyMono = Systick<100>;

    #[shared]
    struct Shared {}

    #[local]
    struct Local {}

    #[init]
    fn init(cx: init::Context) -> (Shared, Local, init::Monotonics) {
        let systick = cx.core.SYST;

        let mono = Systick::new(systick, MONO_HZ);

        //hprintln!("init").ok();

        //hprintln!("init spawn").ok();
        foo::spawn().ok();
        bar::spawn().ok();
        foo::spawn().ok();

        //hprintln!("init spawn_at").ok();
        bar::spawn_at(monotonics::now() + 10.secs()).ok();
        baz::spawn_at(monotonics::now() + 11.secs()).ok();
        foo::spawn_at(monotonics::now() + 12.secs()).ok();

        //hprintln!("init spawn_after").ok();
        foo::spawn_after(5.secs()).ok();
        baz::spawn_after(6.secs()).ok();
        bar::spawn_after(7.secs()).ok();
        cdr::spawn_after(8.secs()).ok();

        hprintln!("init ending").ok();

        (Shared {}, Local {}, init::Monotonics(mono))
    }

    #[task]
    fn foo(_: foo::Context) {
        hprintln!("foo").ok();
    }

    #[task]
    fn bar(_: bar::Context) {
        hprintln!("bar").ok();
    }

    #[task]
    fn baz(_: baz::Context) {
        hprintln!("baz").ok();
    }

    #[task]
    fn cdr(_: cdr::Context) {
        hprintln!("cdr").ok();
    }
}

Hi,
Your tasks only have s capacity of one so ah ö only the first spawns will work. Replace the ok with unwrape and you'll see it fail.
If you want to queue multiple you need to increase the tasks' capacity :)

Thanks @korken89. That solves this problem and after some more head banging I have also got my more interesting blink_rtic example working again. I guess simple examples to isolate problems also are good for isolating newbie incompetence.


blog - code cleanup (mvc)

There appears to be a lot of html where it shouldn't be. Is it possible to clean this sort of stuff up in blog at all?

https://github.com/eflip/Blog/pull/14


cmd/shellenv: set XDG_DATA_DIRS on Linux

Some programs like vapigen might not work correctly, when XDG_DATA_DIRS does not include $HOMEBREW_PREFIX/share. Instead of requiring the user to manually adjust the shell environment, we can set XDG_DATA_DIRS as part of cmd/shellenv, so that it is sufficient to run brew shellenv on any particular system.

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[x] Have you successfully run brew typecheck with your changes locally?
[ ] Have you successfully run brew tests with your changes locally?

Fixes #18317

Also wondering if we should just set this unconditionally on Linux.

I think that should be fine. Although we should consider the following from the  XDG Base Directory Specification.

If $XDG_DATA_DIRS is either not set or empty, a value equal to /usr/local/share/:/usr/share/ should be used.

Therefore we might want to do something like this:
export XDG_DATA_DIRS="${HOMEBREW_PREFIX}/share:${XDG_DATA_DIRS:-/usr/local/share:/usr/share}"

I think that should be fine. Although we should consider the following from the XDG Base Directory Specification.

Yes, we should follow that if we set it, but that doesn't seem to be much simpler than what we're already doing now. Fine with leaving it as is if it's enough to silence the warning from brew doctor.

Thanks again @notfirefox!


Apply Oxide hotfix

Hotfix for issues found in #232

how do i see what patches went into the release zip? did you upload a new tarball manually to v2.1 release on github?

how do i see what patches went into the release zip? did you upload a new tarball manually to v2.1 release on github?

I did, you can see the changes here: https://github.com/Eeems/oxide/compare/support/v2.1

I did, you can see the changes here: https://github.com/Eeems/oxide/compare/support/v2.1

Tested on my rM1 and this fixes the issues around event registration. Thanks!

Tested on my rM1 and this fixes the issues around event registration. Thanks!

i think if its an issue that applies to both, it should be fine to test+accept with rM1 unless there is a reason to think rM2 won't work or has a different code path

i think if its an issue that applies to both, it should be fine to test+accept with rM1 unless there is a reason to think rM2 won't work or has a different code path

i think if its an issue that applies to both, it should be fine to test+accept with rM1 unless there is a reason to think rM2 won't work or has a different code path

I expect them both to work the same. I'm just waiting on an approval to merge.

i think if its an issue that applies to both, it should be fine to test+accept with rM1 unless there is a reason to think rM2 won't work or has a different code path

I expect them both to work the same. I'm just waiting on an approval to merge.


HADOOP-19164. Hadoop CLI MiniCluster is broken

Description of PR
Fix Hadoop CLI MiniCluster
How was this patch tested?
Tested Manually

Log on Console

2024-09-18 11:00:50,989 INFO mapreduce.MiniHadoopClusterManager: Started MiniDFSCluster -- namenode on port 62569

Tried CLI commands on the cluster

ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -mkdir hdfs://<IP_ADDRESS>:62569/ayush
2024-09-18 11:01:55,405 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -ls hdfs://<IP_ADDRESS>:62569/
2024-09-18 11:01:58,113 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 3 items
drwxrwxrwx   - ayushsaxena supergroup          0 2024-09-18 11:00 hdfs://<IP_ADDRESS>:62569/Users
drwxr-xr-x   - ayushsaxena supergroup          0 2024-09-18 11:01 hdfs://<IP_ADDRESS>:62569/ayush
drwxr-xr-x   - ayushsaxena supergroup          0 2024-09-18 11:00 hdfs://<IP_ADDRESS>:62569/user
ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -copyFromLocal bin/hdfs hdfs://<IP_ADDRESS>:62569/ayush
2024-09-18 11:02:16,333 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ayushsaxena@ayushsaxena hadoop-3.5.0-SNAPSHOT % bin/hdfs dfs -ls  hdfs://<IP_ADDRESS>:62569/ayush
2024-09-18 11:02:28,387 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 1 items
-rw-r--r--   3 ayushsaxena supergroup      11730 2024-09-18 11:02 hdfs://<IP_ADDRESS>:62569/ayush/hdfs

Namenode UI

Cat the config dump file

ayushsaxena@ayushsaxena incubator % cat abc.xml
<?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration>
<property><name>mapreduce.jobhistory.jhist.format</name><value>binary</value><final>false</final><source>mapred-default.xml</source></property>
<property><name>dfs.namenode.available-space-rack-fault-tolerant-block-placement-policy.balanced-space-tolerance</name><value>5</value><final>false</final><source>hdfs-default.xml</source></property>
<property><name>fs.s3a.retry.interval</name><value>500ms</value><final>false</final><source>core-default.xml</source></property>
<property><name>dfs.block.access.token.lifetime</name><value>600</value><final>false</final><source>hdfs-default.xml</source></property>
<property><name>mapreduce.job.heap.memory-mb.ratio</name><value>0.8</value><final>false</final><source>mapred-default.xml</source></property>
<property><name>mapreduce.map.log.level</name><value>INFO</value><final>false</final><source>mapred-default.xml</source></property>
<property><name>dfs.namenode.lazypersist.file.scrub.interval.sec</name><value>300</value><final>false</final><source>hdfs-default.xml</source></property>
<property><name>file.bytes-per-checksum</name><value>512</value><final>false</final><source>core-default.xml</source></property>
<property><name>mapreduce.client.completion.pollinterval</name><value>5000</value><final>false</final><source>mapred-default.xml</source></property>

For code changes:

[x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 29s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 12 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
14m 51s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
36m 32s

trunk passed

+1 :green_heart:
compile
19m 42s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
compile
18m 31s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
checkstyle
4m 40s

trunk passed

+1 :green_heart:
mvnsite
4m 13s

trunk passed

+1 :green_heart:
javadoc
3m 18s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 26s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m 21s

trunk passed

+1 :green_heart:
shadedclient
40m  6s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 31s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 51s

the patch passed

+1 :green_heart:
compile
19m  7s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javac
19m  7s

the patch passed

+1 :green_heart:
compile
18m 22s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
javac
18m 22s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
5m 15s
/results-checkstyle-root.txt
root: The patch generated 5 new + 265 unchanged - 0 fixed = 270 total (was 265)

+1 :green_heart:
mvnsite
4m  4s

the patch passed

+1 :green_heart:
javadoc
3m  7s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 22s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m 13s

the patch passed

+1 :green_heart:
shadedclient
38m  3s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 46s

hadoop-common in the patch passed.

+1 :green_heart:
unit
227m 57s

hadoop-hdfs in the patch passed.

+1 :green_heart:
unit
128m 29s

hadoop-mapreduce-client-jobclient in the patch passed.

+1 :green_heart:
asflicense
1m 12s

The patch does not generate ASF License warnings.

637m 28s

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7050

Optional Tests
dupname asflicense mvnsite codespell detsecrets compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux 4754faf02da5 5.15.0-117-generic #127-Ubuntu SMP Fri Jul 5 20:13:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 7d1c21cf7747ec1dec9a1d5e59d13187c9a2a582

Default Java
Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/1/testReport/

Max. process+thread count
4231 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
12m  9s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 12 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 46s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
33m 42s

trunk passed

+1 :green_heart:
compile
17m 23s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
compile
16m 28s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
checkstyle
4m 23s

trunk passed

+1 :green_heart:
mvnsite
4m 19s

trunk passed

+1 :green_heart:
javadoc
3m 29s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 39s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m  9s

trunk passed

+1 :green_heart:
shadedclient
35m 19s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 34s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 41s

the patch passed

+1 :green_heart:
compile
16m 55s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javac
16m 55s

the patch passed

+1 :green_heart:
compile
19m  0s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
javac
19m  0s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
5m 13s
/results-checkstyle-root.txt
root: The patch generated 1 new + 265 unchanged - 0 fixed = 266 total (was 265)

+1 :green_heart:
mvnsite
4m 27s

the patch passed

-1 :x:
javadoc
0m 50s
/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.txt
hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04.

+1 :green_heart:
javadoc
3m 48s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
9m 20s

the patch passed

-1 :x:
shadedclient
2m 49s

patch has errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
0m 30s
/patch-unit-hadoop-common-project_hadoop-common.txt
hadoop-common in the patch failed.

-1 :x:
unit
37m 36s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

-1 :x:
unit
0m 42s
/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
hadoop-mapreduce-client-jobclient in the patch failed.

+0 :ok:
asflicense
0m 43s

ASF License check generated no output?

265m 45s

Reason
Tests

Failed junit tests
hadoop.hdfs.server.blockmanagement.TestStorageBlockPoolUsageStdDev

hadoop.hdfs.server.diskbalancer.TestPlanner

hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade

hadoop.hdfs.server.blockmanagement.TestBlockPlacementPolicyDebugLoggingBuilder

hadoop.hdfs.server.datanode.TestDataNodeUUID

hadoop.hdfs.server.diskbalancer.TestDiskBalancer

hadoop.hdfs.server.datanode.TestTriggerBlockReport

hadoop.hdfs.server.namenode.TestFSNamesystem

hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy

hadoop.hdfs.server.diskbalancer.TestConnectors

hadoop.hdfs.server.namenode.ha.TestHAAppend

hadoop.hdfs.server.datanode.TestDataNodeFSDataSetSink

hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery

hadoop.hdfs.server.namenode.sps.TestBlockStorageMovementAttemptedItems

hadoop.hdfs.server.datanode.TestBPOfferService

hadoop.hdfs.server.datanode.TestReadOnlySharedStorage

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7050

Optional Tests
dupname asflicense mvnsite codespell detsecrets compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux 55fc8578563b 5.15.0-117-generic #127-Ubuntu SMP Fri Jul 5 20:13:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / eed3706f3d61ad21bb98ce968519f8b1a21e0994

Default Java
Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/2/testReport/

Max. process+thread count
961 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 31s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 12 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
17m  6s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
33m 39s

trunk passed

+1 :green_heart:
compile
17m 36s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
compile
16m 17s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
checkstyle
4m 27s

trunk passed

+1 :green_heart:
mvnsite
4m 22s

trunk passed

+1 :green_heart:
javadoc
3m 30s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 40s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m 16s

trunk passed

+1 :green_heart:
shadedclient
35m 17s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 34s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 40s

the patch passed

+1 :green_heart:
compile
17m  4s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javac
17m  4s

the patch passed

+1 :green_heart:
compile
16m 19s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
javac
16m 19s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
4m 21s

the patch passed

+1 :green_heart:
mvnsite
4m 14s

the patch passed

+1 :green_heart:
javadoc
3m 25s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 37s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m 45s

the patch passed

+1 :green_heart:
shadedclient
35m 52s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 44s

hadoop-common in the patch passed.

+1 :green_heart:
unit
220m 29s

hadoop-hdfs in the patch passed.

+1 :green_heart:
unit
127m 19s

hadoop-mapreduce-client-jobclient in the patch passed.

+1 :green_heart:
asflicense
1m 24s

The patch does not generate ASF License warnings.

613m 14s

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7050

Optional Tests
dupname asflicense mvnsite codespell detsecrets compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux cbf626ae8383 5.15.0-117-generic #127-Ubuntu SMP Fri Jul 5 20:13:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / ea08cae5af8c78f78ae6b88f1166e0d42eccd9ab

Default Java
Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/4/testReport/

Max. process+thread count
3733 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/4/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 32s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  1s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 12 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 49s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
34m 12s

trunk passed

+1 :green_heart:
compile
18m 15s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
compile
16m 25s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
checkstyle
4m 22s

trunk passed

+1 :green_heart:
mvnsite
4m 23s

trunk passed

+1 :green_heart:
javadoc
3m 31s

trunk passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 40s

trunk passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m 11s

trunk passed

+1 :green_heart:
shadedclient
35m 32s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 33s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 41s

the patch passed

+1 :green_heart:
compile
16m 58s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javac
16m 58s

the patch passed

+1 :green_heart:
compile
16m 34s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
javac
16m 34s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
4m 17s

the patch passed

+1 :green_heart:
mvnsite
4m 13s

the patch passed

+1 :green_heart:
javadoc
3m 20s

the patch passed with JDK Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04

+1 :green_heart:
javadoc
3m 36s

the patch passed with JDK Private Build-1.8.0_422-8u422-b05-1~20.04-b05

+1 :green_heart:
spotbugs
7m 42s

the patch passed

+1 :green_heart:
shadedclient
35m 18s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
19m 42s

hadoop-common in the patch passed.

+1 :green_heart:
unit
221m 48s

hadoop-hdfs in the patch passed.

+1 :green_heart:
unit
126m 57s

hadoop-mapreduce-client-jobclient in the patch passed.

+1 :green_heart:
asflicense
1m 23s

The patch does not generate ASF License warnings.

613m 43s

Subsystem
Report/Notes

Docker
ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/5/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/7050

Optional Tests
dupname asflicense mvnsite codespell detsecrets compile javac javadoc mvninstall unit shadedclient spotbugs checkstyle

uname
Linux 82e87a7271f7 5.15.0-117-generic #127-Ubuntu SMP Fri Jul 5 20:13:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / ed19d62d44ad86484a737c59d3a6cf0ac944b9c1

Default Java
Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.24+8-post-Ubuntu-1ubuntu320.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_422-8u422-b05-1~20.04-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/5/testReport/

Max. process+thread count
3313 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7050/5/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


no more ConfigureServices

the "Configuring EF Core" text at https://learn.microsoft.com/en-us/dotnet/architecture/modern-web-apps-azure/work-with-data-in-asp-net-core-apps#configuring-ef-core makes explicit reference to ConfigureServices (i.e. the old Startup way of achieving ConfigureServices and Configure) whereas latest code condenses this  into the main code instead. Likewise the subsequent para again explicitly notes ConfigureServices [there are currently 5 refs to "ConfigureServices "]. Better if these docs are less [or more!] specific.
Incidentally the "a connection string defined in Configuration" text is also erroneous as that Configuration is not itself a string but a container and requires the GCS method call to lookup the stated DefaultConnection key to find the actual connectionstring. Again that old-style may have previously captured that container in a ctor but the docs here merely invent it as magic.
The simplistic "Eager=good, lazy=bad" guidance makes no mention of the "Cartesian Explosion" downside (cf. https://www.thinktecture.com/en/entity-framework-core/cartesian-explosion-problem-in-3-1/), nor the .AsSplitQuery() consideration. I accept this may be too deep for an intro doc, but it does mention the Dev vs Prod perf issues.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 8e1a443c-c3dd-b865-58b2-0ff0902308ce
Version Independent ID: d974261f-2544-dee9-f401-e02d715012cb
Content: Work with data in ASP.NET Core Apps
Content Source: docs/architecture/modern-web-apps-azure/work-with-data-in-asp-net-core-apps.md
Product: dotnet-architecture
Technology: modern-web-apps-azure
GitHub Login: @ardalis
Microsoft Alias: wiwagn

Adding @ardalis to this.

Thanks for the feedback @DickBaker. I'm updating the content to be more clear. Note that nowhere did it say that Configuration was a string, so I'm not sure about that comment. Also Eager/Lazy are separate concerns from query splitting and cartesian explosion problems, correct? I agree it's probably worth a mention but not in any related fashion.


Update Text.module.css

Fix typo

Hey there! Thank you for your contribution. We have decided to take Next.js Commerce in a new direction and will be closing out current PRs and issues due to this change. Please see this PR for more details: https://github.com/vercel/commerce/pull/966