Provide a way to install/update the package within terminal

Summary of the new feature / enhancement
From time to time, I get the message when I open terminal. I would need to open github release page, find the matched version and install an MSI. The process is super inconvenient.

Really appreciate it if I can install/update the package within terminal directly. Maybe we can add a command in the update message to inform user how to update PSCore within terminal.
Proposed technical implementation details (optional)
No response

https://github.com/PowerShell/PowerShell/blob/master/tools/install-powershell.ps1  will do the job.
I think there's a case to include it with the PowerShell installation.  Probably time to page @doctordns  because I know this is something he's been taking an interest in, and there multiple variations on the "this message isn't helpful" theme.

iex "& { $(irm https://aka.ms/install-powershell.ps1) } -UseMSI"

It would be convenient to have this as a built-in function.  Or for more flexibility, maybe this:
 iex "& { $(irm https://aka.ms/install-powershell.ps1) } $args"

You can enable Windows Update when installing the MSI package, and then pwsh will be automatically updated within 2 weeks of a new release.

Thanks @jhoneill ! Love the solution. And I agree with @dwtaber to have it as built-in function.
@daxian-dbw Do you mean this option in windows update settings?

yes - I have long been a fan of doing rather better than just saying "there's an update'''".
IF the team wanted to ship install-powershell.ps1 as part of the installation, that would solve my problem (well, that and updating the message to say "run install-powershell to install newest version".
Should I raise another issue to get this idea debated and discussed?

@doctordns  Not sure what the best way is but if you've seen this https://github.com/PowerShell/PowerShell-RFC/pull/324/files
Jason is trying to get an "install current PowerShell" included with Windows PowerShell 5 to get round the "Windows life > .net life" issue which prevents PowerShell 7 going in the box with windows and sends people round the houses to get it.
That proposal is trying to avoid scope creep but the same command should be runnable in any version of PowerShell and get the latest.

Indeed - I have added some comments. I am not sure we need a NEW command - the install-powershell.ps1 script handles all the key scenarios. Admittedly no support for installation from the store - but that is probably not relevant as there is no app store on Server.
My personal preference is an Install-PowerShell.,ps1 shipped inside BOTH WIndows PowerShell and PowerShell 7. Those updated versions should also have an updated message to run this new command. That woudl handle both the "I just have 5 and want 7" and the "I have 7, but need an update faster than Windows Update can provide" scenairos.

@doctordns  best if the substantive comments are on the RFC, but I agree - if the existing script went into PS7, and a future windows update dropped it into PS5 (and possibly older OSes with PS4)  that would do >90% of what's needed.

@TisnKu It's 2 checkboxes when running the MSI installer. Once you check them and install, it will be automatically updated as long as your Windows Update is on.

Does install-powershell.ps1 script support those two options so we can do a silent install and specify MU updating?


#773 fixed FAQ in Homepage

🛠 Fixes Issue
Closes #773

👨💻 Changes proposed

Created an "id" for faq section.
FAQ Anchor link in footer is targeted to that Id.

✔ Check List (Check all the applicable boxes)

[x] My code follows the code style of this project.
[x] This PR does not contain plagiarized content.
[x] The title of my pull request is a short description of the requested changes.

📄 Note to reviewers

📷 Screenshots

I have completed it and created the pull request.


XenServer pause?

XenServer does support suspending VMs but we disabled that a few months ago because shutting down a Kubernetes cluster wasn't really working.  Now that shutdown seems to be working much better with 1.24.0, let's revisit this.  It would be a cool feature and it's just one method call.

DUPLICATE: #1488
We did implement this but ran into this issue which we still need to address: #1488


Reassigned and updated font/font material on some interactable prefabs.

Overview
Some of the Interactable (button) prefabs had missing font or default font material. Updated/Re-assigned font and material.
Changes

Fixes: #5122

/azp run mrtk_pr

There are some other issues referenced in #5122 that this PR doesn't fix. See further comments there.

@cre8tivepark, can you resolve the prefab conflict? We can then trigger CI and get this in.
We can fix the other latent issues in a separate PR as well.

/azp run mrtk_pr

/azp run


Fix to sentence structure

Thanks for the pull request, and welcome! The Rust team is excited to review your changes, and you should hear from @andre-richter (or someone else) soon.
Please see the contribution instructions for more information.


Possibility to turn off warnings (as they are redundant due to Exceptions being thrown)

I'm wondering whether it would make sense to be able to turn off warnings coming from SoapClient as I would assume that most people are relying on Exceptions for error-handling?
For example, we use it like this:
<?php
try {
    $client = new \Zend\Soap\Client('https://example.org/?wsdl', [
        'soap_version' => SOAP_1_1,
        'location'     => 'https://example.org/'
    ]);
    $client->myCommand([
        'arg' => 'value'
    ]);
} catch (SoapFault $exception) {
    // Error handling code
}

Occasionally if there's a communication error with the remote endpoint a PHP warning will be logged like this:
[Tue Jun 19 02:14:31 2018] [error] [client x.x.x.x] PHP Warning: SoapClient::__doRequest(): SSL: Connection reset by peer in /xx/vendor/zendframework/zend-soap/src/Client.php on line 1039
At the same time a SoapFaul exception is thrown which is what we use for error-handling so the warning just clogs up our error logs unnecessarily as we're already handling the situation properly.
We're using version 2.7.0 meaning this line points to https://github.com/zendframework/zend-soap/blob/release-2.7.0/src/Client.php#L1032 where SoapClient::__doRequest is called.
I notice that the PHP manual doesn't actually mention that __doRequest can emit warnings, that might in itself be a glitch to file a bug report for regarding the ext-soap documentation?
Anyhow, even if it would be documented we would still need to silence the warnings in zend-soap if they are not wanted.
Would it make sense to switch to return @call_user_func() or introduce a toggle that disables PHP warnings in zend-soap?
Many thanks!

Silencing is not an option: explicit suppression with an error handler that is restored immediately after the call is a better solution, but the error handler must only take warnings and convert them to exceptions

Well, in this particular case as I stated a SoapFault Exception is already being thrown as that's what I successfully use for my error handling. That's why the warning is meaningless to me, hence my suggestion that simply silencing might be an alternative.
Maybe something like this would do the trick?
// Catch warnings (to prevent them from being logged)
set_error_handler(function ($errno, $errstr) {
    // Intentional no-op
}, E_WARNING);

$response = call_user_func(
    [$client, 'SoapClient::__doRequest'],
    $request,
    $location,
    $action,
    $version,
    $oneWay
);

// Restore previous error handler again
restore_error_handler();

return $response;

This repository has been closed and moved to laminas/laminas-soap; a new issue has been opened at https://github.com/laminas/laminas-soap/issues/6.


refactor(client): use generic comp for multiple choice

Checklist:

[x] I have read and followed the contribution guidelines.
[x] I have read and followed the how to open a pull request guide.
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

Followup to https://github.com/freeCodeCamp/freeCodeCamp/pull/56752, this time extending the generic component to handle multiple choice questions.
The only other thing I did was remove extra css imports. Since css is bundled together and used everywhere, there's no need to import a given file more than once.

Blocked while I investigate the test failures.

I gave this a rebase and fixed the conflicts - added one minor change and some more info in the PR description.


Downloading the Data in the Tables

Description

I can't extract all the rows in my table that has over 1,400,000 rows. I tried segmenting the data, so that I can get multiple output files, but at times I'll either get 1 file or 2 files with one file having the max amount of rows for a microsoft excel file while the other file would only have about 100,000 + rows. I know the total amount of rows I'm supposed to have all together, but the output files all together aren't reflective of that. If I'm getting a random number of output files each time I proceed with downloading, then I don't even trust that I have the correct even within the files.
DBeaver Version
Community Edition 22.2.0
Operating System
Microsoft Windows 10 Enterprise
Database and driver

Database Name and Version: PostgreSQL 8.0.2 on i686-pc-linux-gnu, compiled by GCC gcc (GCC) 3.4.2 20041017 (Red Hat 3.4.2-6.fc3), Redshift 1.0.41881
Driver Name: RedshiftJDBC 42-<IP_ADDRESS>7

Steps to reproduce

I right click on the table I want to download.
Click the export selector, then I clicked on the CSV and hit "Next"

Extract type: By segments
Segment size: 400,000
Check select row count
Fetch size: 10,000
Then click "Next"

formatting: <Connection's default>
Binaries: inline, Encoding: binary
Value format: Display (default)
Then click "Next"

Set my directory to my specific folder
Check "Show finished message"
Then click "Next"

Click "Proceed"

Additional context
No response

Hello @nosequins
If I understood you correctly, you need to use this export setting:

There have been no updates on the issue for a long time.
If it is still actual for you - feel free to reopen it with additional info.


Inconsistency behavior of the EncryptionClient wrt the regular client with range queries past the file length

Problem:
I have found an inconsistency between the regular client and the encryption client.
With the regular client, a ranged query past the size of the files raises and exception (software.amazon.awssdk.services.s3.model.S3Exception: The requested range is not satisfiable), while the encryption client does not.
The encryption client actually blocks when performing the call the to ResponseInputStream<GetObjectResponse>.read()
package com.test.aws;

import java.io.InputStream;
import java.nio.ByteBuffer;
import java.security.KeyFactory;
import java.security.KeyPair;
import java.security.PrivateKey;
import java.security.PublicKey;
import java.security.spec.PKCS8EncodedKeySpec;
import java.security.spec.X509EncodedKeySpec;
import java.time.Duration;
import java.util.Base64;
import org.junit.jupiter.api.Test;
import software.amazon.awssdk.auth.credentials.DefaultCredentialsProvider;
import software.amazon.awssdk.core.ResponseInputStream;
import software.amazon.awssdk.core.sync.RequestBody;
import software.amazon.awssdk.http.apache.ApacheHttpClient;
import software.amazon.awssdk.http.async.SdkAsyncHttpClient;
import software.amazon.awssdk.http.nio.netty.NettyNioAsyncHttpClient;
import software.amazon.awssdk.regions.Region;
import software.amazon.awssdk.services.s3.S3AsyncClient;
import software.amazon.awssdk.services.s3.S3Client;
import software.amazon.awssdk.services.s3.model.DeleteObjectRequest;
import software.amazon.awssdk.services.s3.model.GetObjectRequest;
import software.amazon.awssdk.services.s3.model.GetObjectResponse;
import software.amazon.awssdk.services.s3.model.PutObjectRequest;
import software.amazon.encryption.s3.S3EncryptionClient;

public class TestEndOfStreamBehavior {
	private static final Region DEFAULT_REGION = AwsTestUtil.DEFAULT_REGION;
	private static final String BUCKET = AwsTestUtil.AWS_TEST_BUCKET;
	private static final String KEY = "filename.txt";
	private static final byte[] CONTENT = "abcdefghijklmnopqrstuvwxyz0123456789".repeat(4).getBytes();

	/** The encryption key to use in client-side encryption tests. */
	protected static final KeyPair KEY_PAIR;

	static {
		final String publicKeyString = "yourPublicKey";
		final String privateKeyString = "yourPrivateKey";
		try {
			final KeyFactory factory = KeyFactory.getInstance("RSA");
			final PublicKey publicKey =
					factory.generatePublic(
							new X509EncodedKeySpec(Base64.getDecoder().decode(publicKeyString.getBytes())));
			final PrivateKey privateKey =
					factory.generatePrivate(
							new PKCS8EncodedKeySpec(Base64.getDecoder().decode(privateKeyString.getBytes())));
			KEY_PAIR = new KeyPair(publicKey, privateKey);
		} catch (Exception e) {
			throw new RuntimeException(e);
		}
	}

	@Test
	void testEndOfStreamBehavior() throws Exception {

		// Pick the client to use, inconsistent behavior between the two
		final S3Client client = getClient(DEFAULT_REGION);
		// final S3Client client = getEncryptionClient(KEY_PAIR, DEFAULT_REGION);

		// Delete the data if it exists
		final DeleteObjectRequest deleteRequest = DeleteObjectRequest.builder()
				.bucket(BUCKET)
				.key(KEY)
				.build();

		client.deleteObject(deleteRequest);

		// Upload the data
		final PutObjectRequest uploadRequest =
				PutObjectRequest.builder().bucket(BUCKET).key(KEY).build();
		client.putObject(uploadRequest, RequestBody.fromBytes(CONTENT));
		// wait for the data to be uploaded
		Thread.sleep(Duration.ofSeconds(5));

		// Actual test

		final GetObjectRequest downloadRequest =
				GetObjectRequest.builder()
						.bucket(BUCKET)
						.key(KEY)
						.range("bytes=144-160") // files ends at 143
						.build();

                // this throws with the regular client (expected behavior), it does not with the encryption client
		final InputStream stream = client.getObject(downloadRequest);

		final ByteBuffer buffer = ByteBuffer.allocate(16);
		final byte[] underlyingBuffer = buffer.array();
		final int capacity = buffer.capacity();

		stream.read(underlyingBuffer, 0, capacity);
	}

	public static S3Client getEncryptionClient(final KeyPair keyPair, final Region region) {

		return S3EncryptionClient.builder()
				.rsaKeyPair(keyPair)
				.enableLegacyUnauthenticatedModes(true)
				.wrappedClient(getClient(region))
				.wrappedAsyncClient(getAsyncClient(region))
				.build();
	}

	public static S3Client getClient(final Region region) {

		return S3Client.builder()
				.region(region)
				.credentialsProvider(DefaultCredentialsProvider.create())
				.httpClientBuilder(
						ApacheHttpClient.builder().maxConnections(128) // Default is 50
				)
				.build();
	}

	public static S3AsyncClient getAsyncClient(final Region region) {

		final SdkAsyncHttpClient nettyHttpClient =
				NettyNioAsyncHttpClient.builder().maxConcurrency(100).build();

		return S3AsyncClient.builder()
				.region(region)
				.credentialsProvider(DefaultCredentialsProvider.create())
				.httpClient(nettyHttpClient)
				.build();
	}
}

Workaround
I am not blocked by this issue, as i can check my range beforehand. I just wanted to signal it as it was a change of behavior with regards to the AWS SDK v1

This is the same issue as #200

Thanks for sharing. As you have already noted, #200 describes this issue.
Closing as duplicate.


Drop givenName if not needed

This may break some other workflows if givenname is just deleted vs set to null.

Thanks, merging, will release a new asfpy sometime in the next month or three


Support multiple test buckets

Add a unit, integration and an end_to_end test bucket.  All existing tests are put in the unit test bucket.
Currently, Travis and run_tests.py will still run all tests by default, regardless of what bucket they are in.  When someone adds a test that they do not want run by Travis because of its expensiveness, perhaps we can revisit this policy.
Issue #106

To see where each file moved, you need to click the "Showing  12 changed files  with 15 additions and 19 deletions." link under the files changed tab.

+1

+1

Github won't let me merge this - rebase maybe @dcolligan?

Just rebased... you can merge after the CI passes

It passed... ready to merge!


Weather tags translation improvements

After playing around with Strautomator I did notice that the weather tags seem to be a little weird when I try to use it for me (in Dutch).

For example kph would for us be better translated to km/u
Also looking at the code it would be similar with the wind directions: https://github.com/strautomator/core/blob/f95953f5c7fe92b8807450d213b5817b4035f094/src/weather/utils.ts#L409
S (South) -> Z (Zuid)
E (East) -> O (Oost)
These are little details but it does bring the result to a higher level 😅
If I understood the translations/index.ts function correctly you wouldn't need to add the translations for each language as it would fall back to returning the id/key. The behaviour would remain the same for other users (until they have provided/requested translations).
Let me know what you think.

Makes sense. I'll add directions and units to the translations as well.

I would like to add that I did find Omit tag suffixes (initially the description wasn't clear to me, until I used the weather tags) in the settings so a workaround would be to disable it and hardcode km/u. But that wouldn't fix the wind directions of course.

https://github.com/strautomator/core/commit/95cdd9d4a02576548e59a456b2c3fc3f4ef312c4
https://github.com/strautomator/core/commit/36f3b5a6cc6c565bd0e4d797fd9ef724735f8326
https://github.com/strautomator/core/commit/a39bf76cb153b453f0e0ed3bcfcad2f8751858a1

Awesome! Will see if I can try it out later today.

Released: https://github.com/strautomator/web/releases/tag/v23.276.11230


DOC: add simplified version

#230

@earthjasonlin,
thanks for your constructive proposal, I've added a few comments, can you review them before I can merge it.

I'm sorry but where are your comments...

Can you see comments now?

Is that ok now


Added logging configuration

This PR contains a few changes necessary to get the live-updating logs working:

A logging configuration submodule has been added that performs some Elasticsearch setup at launch.
Default ports have been updated in the Binder config files.
Some Logstash output plugins have been added.

Going to take a shot at making all these changes now :)


Reverting macos change

Platforms Impacted

[x] iOS
[x] macOS

Description of changes
Reverting #679 to prevent broken pipeline; going back to supporting minimum macOS 10.15 to allow consumption across a wider audience.
Pull request checklist
This PR has considered:

[ ] Light and Dark appearances
[ ] VoiceOver and Keyboard Accessibility
[ ] Internationalization and Right to Left layouts
[ ] Different resolutions (1x, 2x, 3x)
[ ] Size classes and window sizes (iPhone vs iPad, notched devices, multitasking, different window sizes, etc)

Microsoft Reviewers: Open in CodeFlow

why is the pipeline broken when office main environment has moved to xcode 12.5?

why is the pipeline broken when office main environment has moved to xcode 12.5?

minimum OS version seems to still be 10.15 on main


[WEB] new color palette!

Bringing the new color palette @lil-kim has been working on to the website. Removed old color palette designations and added an explanatory blurb.

Closes #768
Signed-off-by: Scott Mathis<EMAIL_ADDRESS>

I'll update that. Thanks, @lil-kim

@lil-kim
I've increased size of #fafafa. please review.


Implement the Welcome Page and News Articles Features

This major pull request adds a new welcome page to the CSXL site that displays news articles and personalized information for users. The article feature enables the CSXL to post and edit articles, create announcements, and connect authors to articles. All pages are responsive and work on mobile.
The Welcome Page

From the new welcome page, users are able to see any announcements that are active, as well as the most recent news articles. Users can also see the XL's operating hours, as well as any reservations or event registrations they have coming up. In the future, this page will be further customized to include user friendships and office hours information.
Article Page

The article page renders markdown as shown in the Lorem Ipsum text, so article authors do not have to worry about custom HTML for every article page.
Admin Features
This PR also includes full admin features, including creating / editing / deleting articles. At the moment, only the admin user or people with the article permission are able to add articles. This will be fine for our use-case.
Backend
This pull request creates a new database table called article and an association table between article and user to keep track of authors. Due to this setup, an article can have many authors attached to it. This PR also creates new services, models, and API routes.
Future Goals

Enable organization leaders to submit articles for review.
Create categories and tags for articles for filtering purposes.
Allow users to access an article archive. Currently, only the top 10 articles are shown.

@KrisJordan added an alternative view for people not signed in - the "For you" tile has been replaced by the about tile (also slightly improved!):

1. On the latest news pane.

Can we drop the modified date (or only show it if different from created)

✅  The test data example is a bit poor here, but yes that is how it is currently set up! Modified should only show when it is different than created (in the test data, they are the same). But, also perfectly good with removing entirely to prevent it from being too messy. Completed in this commit!

Let's remove the Read button and make the card clickable? Or make elements of the card clickable (title/icon/text) and take you to details view.

I would be fine with this, although it causes problems with the interactivity of the organization chip (it is unclear that the chip is clickable). Making the title be clickable would work to solve this problem, although it would be unclear that it is clickable without an underline text decoration (which seems anti-Material)

I think we could lose the author line from home page and leave it just to the details page

✅ Works with me, will keep organization though.

When a student org is listed, hovering should show hand click icon

✅
2. Announcement.

Reading an announcement details should not open a new tab

✅

The heading text feels too small relative to the heading text of a news post. Should we just use the same template as a news post but use the different highlighted color scheme?

Redesigned to better match the template below while also hiding unnecessary data, since there is only one announcement returned by the API and it aims to serve as a banner!
3. Seeing some horizontal scrolling on the page at all widths
✅ Fixed, there was some leftover padding!
4. Scrolling
I can see if there is a way to fix this! Currently, all of our pages use this scroll bar. In terms of having the left half free-scrolling, I originally tried this idea, however making the right sidebar sticky, grow to the correct size, scrollable, and responsive did not seem to work that well in CSS. Material's website uses the same scroll bar, but we can look towards a better site-wide solution to customize this.
5. Open XL
If you agree, we can use a lighter shade than primary so it does not appear to match the same color as the buttons used throughout the site! I would be open to primary-container for Open and tertiary-container for Closed, if you agree.

6. Clickable Cards
I agree - right now, both panes and outlined cards use the surface color scheme as recommended by material. Outlined cards use outline (nv-50) for outlines, and this is standard for M3.

One solution, although I am not sure how difficult this would be to pull off in Angular Material, is shown below. Material seems to recommend adding a shadow on-hover to clickable cards, basically turning them into elevated cards:

Right now, though, the site has standardized on having all elements wrapped in panes rather than directly floating on the background (for example, event cards are inside of an event pane, which is on the background).
There is some precedent for this, although Material is not entirely consistent on how it prefers layouts:
https://m3.material.io/foundations/layout/applying-layout/large-extra-large
For our purposes, I decided it would make the most sense to stick with the pane convention, however this does raise complications on layering. If we want to try one shade different for cards placed on top of panes and standardize on that, I would be for trying it!
7. Sidebar for Upcoming for You
Do you mind clarifying a bit, are you mentioning adding buttons here to take users to these different pages?
8. Gear
✅  Yes - done!

Re-requesting with applicable changes made!


#5137 isPeriphalAvailable HardwareKeyboard on GWT

At this point of time, it is not possible to detect if a hardware keyboard is connected on GWT. So we assume that a mobile device has a soft keyboard while a desktop device has a hardware keyboard.

Seems like a reasonable default.


Bundler v0.16.1 fails to locate bundle executable on Travis with Ruby 2.0.0 & Ruby 2.1.10

My tty works on top of bundler to provide scaffolding behaviour. My recent deployments on Ruby 2.0.0 and 2.1.10 failed on Travis CI due to failure to locate bundle executable. This failure occurred when bundler was upgraded from v0.16.0 to the latest v0.16.1. An example of failure backtrace:
/home/travis/.rvm/gems/ruby-2.0.0-p648/bin/bundle:23:in `load': cannot load such file --
/home/travis/.rvm/rubies/ruby-2.0.0-p648/lib/ruby/gems/2.0.0/gems/bundler-1.16.1/exe/bundle (LoadError)
	from /home/travis/.rvm/gems/ruby-2.0.0-p648/bin/bundle:23:in `<main>'
	from /home/travis/.rvm/gems/ruby-2.0.0-p648/bin/ruby_executable_hooks:15:in `eval'
	from /home/travis/.rvm/gems/ruby-2.0.0-p648/bin/ruby_executable_hooks:15:in `<main>'

Downgrading fixes the issue.

This issue was fixed in #6689 which was released in Bundler 1.16.5


Optimization of recommendations sorting

adding filter_sort function instead of udf sorter function for optimization purposes

please update the code from main branch

code updated


Added a new To Do view sample

Q
A

Bug fix?
no

New sample?
yes

What's in this Pull Request?
Added a new To Do View sample

Thank you again @joaoferreira! Rock Star Status sample! 🌟🌟🤩🤩
I see you are already registered for the PnP Recognition program, so keep an eye out for you badge! 💜🧡


[PROPOSAL] Method to define queue name for executing chunk() jobs

I intend to prepare a PR for this but want to put it past you first...
I see a pretty straightforward solution to do this per the subject, except that the Job object used to handle the chunk() call does not extend Laravel's "Job" class itself. Is there a good reason for this that is not apparent? If not, I wish to extend it to make use of the onQueue() chain method.
Don't worry, I'll submit a PR for all this unless you say "don't bother because..."

I looked in to it more...
Above, I meant the "Queuable" trait. That's the only thing which makes sense.
And I think you didn't include it because it wasn't useful to you. ;-) So that's okay, I will prepare a PR.

@SirLamer Did you ever find a solution to chain events together using withChain() and chunk()? I'm running into a similar situation where I need to use the two together.


ModuleNotFoundError: No module named 'openai_agent.agent_utils'

I'm getting this error when running python3 -m app.webapp
Am i missing something? thank you!

Hey. The error you are having is because of an import error. The web server part of the application has been deprecated and is no longer supported (I need to update the README). For the perceivable future, I only intend to support the part that works with Whatsapp.


Restore ability to set window title from commandline

Summary of the Pull Request
I regressed being able to set the window title with title foo in #3540. This restores that bit.
References
PR Checklist

[x] Closes #3674
[x] I work here
[ ] Tests added/passed
[n/a] Requires documentation to be updated

Detailed Description of the Pull Request / Additional comments
Validation Steps Performed

@carlos-zamora doesn't matter if it does, this code was there originally and s/a/t should have checked whether it worked with this ;)


Add a missing stdlib.h -> malloc.h change for mallinfo

Summary
build fix after https://github.com/apache/incubator-nuttx/pull/1236
Impact
Testing
CI

Thanks for the fix.  I suspect that the big SocketCAN PR will also introduce problems.  This is why it was good to wait for the 9.1 branch.  We have plenty of time to recover before the next release.

You will need to merge PR #1242 to fix this.  But there is a chicken'n'egg problem:  PR #1242 will fail because it needs this change.
This only solution is to merge this PR as is.


Laboratory work #3, Alyona Gosteva - 21FPL2

Looks like the PR contains implementations of two labs - 2 and 3. You have to split it to 2 PRs - one for the 2 and another for the 3 lab


What's the effect of the rectifications flags?

I can't find much documentation about the EnableRectificationDistanceImage and EnableRectificationAmplitudeImage flags in the application options. I can see some differences in the distance readings when I set EnableRectificationDistanceImage to true, for example. What exactly do they do and why are they false by default? Thanks.

The rectification is some kind of image correction. Due to the optics the distance data does not form a perfect rectangle. The image looks more like a pillow. In case of the camera the rectification is disabled by default. For the sensor the rectification is activated.
It is deactivated to provide the unmodified point cloud   to the user

So if I understand correctly,

rectification should be off to compute an accurate pointcloud from the depth
rectification should be on if we want the depth (or amplitude) 2d image to look good on the screen (i.e., to be a correct flat projection)
Is that right?

The guys at IFM are obviously the authority on this, however, my understanding of the rectification parameters are that they apply the camera's intrinsic calibration (e.g., correction for lens distortion and other systemic errors) to the data prior to serializing and returning them over the wire.  I believe they are off by default on the camera because doing the image warps are not computationally cheap and will affect frame rate. Again, this is just my understanding, @graugans would know the details better.

Thanks @graugans and @tpanzarella for the feedback. I have checked that the unit vectors change when the rectification flag changes (or at least when both rectification flags change, I'm changing both together; I don't know what the behavior is supposed to be when you rectify only depth or only amplitude, should the unit vectors change in that case?). So it looks like rectification is meant to correct not just the depth for display but also the pointcloud. I have the camera mounted together with a lidar and I was looking at the correspondence between them; it seems (I'm merely eyeballing) that with rectification the correspondence is slightly better. I have also checked that the frame rate drops a bit (about 3%) when rectification is on.
It would be useful if you can confirm that rectification is intended to make the pointcloud more accurate, and if the reason for it being off by default is to increase the frame rate.

Yes framerate will be lower because of the additional calculation. In the end we need a default value for this parameter the decision was to turn it off in case of the camera. I can not remember the arguments but can ask if it is important for you or @cfreundl can explain.
The unit vectors will change when rectification is turned on. Because the optical model changes.

@bibarz related to accuracy I'll ask the algo team on Monday. Those are the guys with deep knowledge on the 3D data. I am the firmware guy not the algorithm expert.

Thanks, @graugans, confirmation about the accuracy would be great, that's all I really want.

So after a quick chat with the algorithm team the arguments why rectification is disabled by default are the following:

Performance
The field of view gets smaller with rectification turned on
The image is based on interpolated pixels

Regarding the accuracy, it will not improve because of the interpolation step.
You can turn on/off amplitude and distance image rectification separately to spare some CPU cycles if you do not need amplitude data.

Ok, thanks


CI: Enable mypy type check

Is your feature request related to a problem? Please describe.
We have test cases with good coverage, and the code has good type hinting.
Now we can enable mypy type check on CI process
Describe the solution you'd like
Add tox mypy config on pyproject.toml and enable it on github actions check
#615 implement it.

#615 looks like a welcome improvement. Mypy shows a lot of errors in metadata.py; I’ll open a separate PR to address these, if that helps.
The errors in installer.py look like they’re related to the ArgumentParser. This stackoverflow question suggests several ways to handle this problem, liked NamedTuples and the TAP library: https://stackoverflow.com/questions/42279063/python-typehints-for-argparse-namespace-objects. It’s not clear to me which would be the best solution for us.

We can control how strict we check typing
You can find a pyproject.toml change to configure mypy.
[tool.mypy]
check_untyped_defs = false
disallow_incomplete_defs = false
disallow_untyped_calls = false
disallow_untyped_defs = false
disallow_untyped_decorators = false
ignore_missing_imports = true
namespace_packages = false
no_implicit_optional = true
pretty = false
sqlite_cache = true
show_error_context = false
show_column_numbers = true
strict_optional = true
warn_no_return = false
warn_redundant_casts = true
warn_return_any = true
warn_unreachable = true
warn_unused_ignores = true

I disables some checks and make it relaxed.
I set low warning verbosity , such as pretty, and show_error_context to be false.

The errors in installer.py look like they’re related to the ArgumentParser. This stackoverflow question suggests several ways to handle this problem, liked NamedTuples and the TAP library: https://stackoverflow.com/questions/42279063/python-typehints-for-argparse-namespace-objects. It’s not clear to me which would be the best solution for us.

I try TAP and know that it asks big changes.
I think it is better to suppress mypy warnings for argparse. We can update Cli class when we remove deprecated old command syntax.

There is alternative solution typed-argparse that takes similar way with our approach to define CustomArgParse class. I've tried and satisfied with it.
Let's take it for our solution.

Since #620 was merged, does this need to stay open? Is there anything else to do for this one?

Yes now it has been checked on CI.


chore Bump the version of hadoop_libs

Proposed changes
Issue Number: close #xxx
Bump the version of hadoop_libs to build HDFS related libraries only.
Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT

Vybs
I am trying to build the code using following set of commands.
git clone https://github.com/vybs/sqoop-on-spark
cd sqoop-on-spark
mvn compile -e

This generates following exception
mvn compile
[INFO] Scanning for projects...
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project org.apache.sqoop.spark:spark-job:[unknown-version] (/Users/abhinavchawade/srcrepo/sqoop-on-spark/spark-job/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT and 'parent.relativePath' points at wrong local POM @ line 23, column 11 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
10:17 AM [abhinavchawade@achawade-rmbp15 sqoop-on-spark]$ mvn compile -e
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[ERROR] The build could not read 1 project -> [Help 1]
org.apache.maven.project.ProjectBuildingException: Some problems were encountered while processing the POMs:
[WARNING] 'parent.relativePath' points at org.apache:sqoop instead of org.apache.sqoop:connector, please verify your project structure @ line 23, column 11
[FATAL] Non-resolvable parent POM: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT and 'parent.relativePath' points at wrong local POM @ line 23, column 11

    at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:416)
    at org.apache.maven.DefaultMaven.collectProjects(DefaultMaven.java:672)
    at org.apache.maven.DefaultMaven.getProjectsForMavenReactor(DefaultMaven.java:663)
    at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:253)
    at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
    at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
    at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
    at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:497)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
[ERROR]
[ERROR]   The project org.apache.sqoop.spark:spark-job:[unknown-version] (/Users/abhinavchawade/srcrepo/sqoop-on-spark/spark-job/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT and 'parent.relativePath' points at wrong local POM @ line 23, column 11 -> [Help 2]
org.apache.maven.model.resolution.UnresolvableModelException: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT
    at org.apache.maven.project.ProjectModelResolver.resolveModel(ProjectModelResolver.java:195)
    at org.apache.maven.project.ProjectModelResolver.resolveModel(ProjectModelResolver.java:244)
    at org.apache.maven.model.building.DefaultModelBuilder.readParentExternally(DefaultModelBuilder.java:899)
    at org.apache.maven.model.building.DefaultModelBuilder.readParent(DefaultModelBuilder.java:751)
    at org.apache.maven.model.building.DefaultModelBuilder.build(DefaultModelBuilder.java:309)
    at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:463)
    at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:432)
    at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:549)
    at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:432)
    at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:396)
    at org.apache.maven.DefaultMaven.collectProjects(DefaultMaven.java:672)
    at org.apache.maven.DefaultMaven.getProjectsForMavenReactor(DefaultMaven.java:663)
    at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:253)
    at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
    at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
    at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
    at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:497)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT
    at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:444)
    at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246)
    at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifact(DefaultArtifactResolver.java:223)
    at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveArtifact(DefaultRepositorySystem.java:294)
    at org.apache.maven.project.ProjectModelResolver.resolveModel(ProjectModelResolver.java:191)
    ... 24 more
Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT
    at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:434)
    ... 28 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

To find the difference, I followed the steps to build Sqoop2 mentioned http://sqoop.apache.org/docs/1.99.6/BuildingSqoop2.html. Is there anything I am missing?

I am having the same issue:
[ERROR] Failed to execute goal on project connector-sdk: Could not resolve dependencies for project org.apache.sqoop:connector-sdk:jar:2.0.0-SNAPSHOT: Failed to collect dependencies at org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT: Failed to read artifact descriptor for org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT: Could not find artifact org.apache:sqoop:pom:2.0.0-SNAPSHOT in Nexus (http://punk:8081/nexus/content/groups/public) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project connector-sdk: Could not resolve dependencies for project org.apache.sqoop:connector-sdk:jar:2.0.0-SNAPSHOT: Failed to collect dependencies at org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT
	at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:220)
	at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127)
	at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:257)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:200)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project org.apache.sqoop:connector-sdk:jar:2.0.0-SNAPSHOT: Failed to collect dependencies at org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT
	at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:180)
	at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195)
	... 22 more
Caused by: org.eclipse.aether.collection.DependencyCollectionException: Failed to collect dependencies at org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:291)
	at org.eclipse.aether.internal.impl.DefaultRepositorySystem.collectDependencies(DefaultRepositorySystem.java:316)
	at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:172)
	... 23 more
Caused by: org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read artifact descriptor for org.apache.sqoop:sqoop-common:jar:2.0.0-SNAPSHOT
	at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:337)
	at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:217)
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.resolveCachedArtifactDescriptor(DefaultDependencyCollector.java:525)
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.getArtifactDescriptorResult(DefaultDependencyCollector.java:509)
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.processDependency(DefaultDependencyCollector.java:409)
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.processDependency(DefaultDependencyCollector.java:363)
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.process(DefaultDependencyCollector.java:351)
	at org.eclipse.aether.internal.impl.DefaultDependencyCollector.collectDependencies(DefaultDependencyCollector.java:254)
	... 25 more
Caused by: org.apache.maven.model.resolution.UnresolvableModelException: Could not find artifact org.apache:sqoop:pom:2.0.0-SNAPSHOT in Nexus (http://punk:8081/nexus/content/groups/public)
	at org.apache.maven.repository.internal.DefaultModelResolver.resolveModel(DefaultModelResolver.java:177)
	at org.apache.maven.repository.internal.DefaultModelResolver.resolveModel(DefaultModelResolver.java:226)
	at org.apache.maven.model.building.DefaultModelBuilder.readParentExternally(DefaultModelBuilder.java:899)
	at org.apache.maven.model.building.DefaultModelBuilder.readParent(DefaultModelBuilder.java:751)
	at org.apache.maven.model.building.DefaultModelBuilder.build(DefaultModelBuilder.java:309)
	at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:328)
	... 32 more
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could not find artifact org.apache:sqoop:pom:2.0.0-SNAPSHOT in Nexus (http://punk:8081/nexus/content/groups/public)
	at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:444)
	at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246)
	at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifact(DefaultArtifactResolver.java:223)
	at org.apache.maven.repository.internal.DefaultModelResolver.resolveModel(DefaultModelResolver.java:173)
	... 37 more
Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find artifact org.apache:sqoop:pom:2.0.0-SNAPSHOT in Nexus (http://punk:8081/nexus/content/groups/public)
	at org.eclipse.aether.connector.basic.ArtifactTransportListener.transferFailed(ArtifactTransportListener.java:39)
	at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:355)
	at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
	at org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:581)
	at org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:249)
	at org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:520)
	at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:421)
	... 40 more
[ERROR]

Checking the URL's in the error, I find that [1] does not host 'sqoop' (ie. there is no 'sqoop' directory found). I wonder if this is why it is failing.
However, going directly into ../sqoop-on-spark/common I am able to do:
$ mvn install
$ mvn package
$ mvn package -Pbinary'

[1] http://punk:8081/nexus/content/groups/public/org/apache/

I found a workaround.

Download and install sqoop2 following [1] on a separate directory. That will get all required downloads into .m2/repository.
Manually compile and package 'spark-job':

$ cd ../spark-job
$ mvn compile
$ mvn package
$ mvn package -Pbinary

Manually compile and package 'sqoop-spark-jar':

$ cd ../sqoop-spark-jar
$ mvn compile
$ mvn package
$ mvn package -Pbinary

Run as instructed in [2].
[1] http://sqoop.apache.org/docs/1.99.6/BuildingSqoop2.html
[2] https://github.com/vybs/sqoop-on-spark

nice!

@oscarcastaneda I tried the workaround and it worked for me only when I ran mvn compile in sqoop-spark-job. Seems like the poms don't refer to snapshots which have 2.0.0 build. Let me see if I can fix the pom.

@vybs that's right. First one needs to mvn compile on sqoop2 as instructed in [1] and then mvn compile on sqoop-spark-job. I agree the poms don't refer to snapshots on 2.0.0 build. In fact, checking URL's used I found that there is no 'sqoop' directory found on [2].
[1] http://sqoop.apache.org/docs/1.99.6/BuildingSqoop2.html
[2] http://punk:8081/nexus/content/groups/public/org/apache/

Gurus,
I did a git checkout for this project, then a git checkout for sqoop2 from within the folder, compiled sqoop.
If I try mvn compile from the sqoop-on-spark/spark-job folder or sqoop-on-spark folder, it errors out.
What additional step do I need to take?
Thanks!

@vinayakthatte could you please post your mvn compile output for sqoop-on-spark?

@oscarcastaneda I i have the same problem as @vinayakthatte. I completed sqoop2 build and check out.
now If I try mvn compile from the sqoop-on-spark/spark-job folder or sqoop-on-spark folder, it errors out.
the details of error:
mvn compile -e
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[WARNING] 'parent.relativePath' of POM org.apache.sqoop.spark:spark-job:[unknown-version] (/home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml) points at org.apache:sqoop instead of org.apache.sqoop:connector, please verify your project structure @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 23, column 11
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.execution:sqoop-execution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 41, column 17
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.submission:sqoop-submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 46, column 18
[ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-core_2.10:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 51, column 18
 @
[ERROR] The build could not read 1 project -> [Help 1]
org.apache.maven.project.ProjectBuildingException: Some problems were encountered while processing the POMs:
[WARNING] 'parent.relativePath' of POM org.apache.sqoop.spark:spark-job:[unknown-version] (/home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml) points at org.apache:sqoop instead of org.apache.sqoop:connector, please verify your project structure @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 23, column 11
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.execution:sqoop-execution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 41, column 17
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.submission:sqoop-submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 46, column 18
[ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-core_2.10:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 51, column 18

	at org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:422)
	at org.apache.maven.graph.DefaultGraphBuilder.collectProjects(DefaultGraphBuilder.java:419)
	at org.apache.maven.graph.DefaultGraphBuilder.getProjectsForMavenReactor(DefaultGraphBuilder.java:410)
	at org.apache.maven.graph.DefaultGraphBuilder.build(DefaultGraphBuilder.java:83)
	at org.apache.maven.DefaultMaven.buildGraph(DefaultMaven.java:491)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:219)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
[ERROR]
[ERROR]   The project org.apache.sqoop.spark:spark-job:2.0.0-SNAPSHOT (/home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml) has 3 errors
[ERROR]     'dependencies.dependency.version' for org.apache.sqoop.execution:sqoop-execution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 41, column 17
[ERROR]     'dependencies.dependency.version' for org.apache.sqoop.submission:sqoop-submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 46, column 18
[ERROR]     'dependencies.dependency.version' for org.apache.spark:spark-core_2.10:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/vasanth/Pictures/test_project/sqoop-on-spark/spark-job/pom.xml, line 51, column 18
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
```

@oscarcastaneda I tried following the steps you mentioned by building sqoop2 as per [1] http://sqoop.apache.org/docs/1.99.6/BuildingSqoop2.html and then cloning sqoop-on-spark and trying to manually compile spark-job, But I the following error:
[mapr@dev-mapr-1c-110 spark-job]$ pwd
/home/mapr/sqoop-on-spark/spark-job
[mapr@dev-mapr-1c-110 spark-job]$ mvn compile
[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[WARNING] 'parent.relativePath' of POM org.apache.sqoop.spark:spark-job:[unknown-version] (/home/mapr/sqoop-on-spark/spark-job/pom.xml) points at org.apache:sqoop instead of org.apache.sqoop:connector, please verify your project structure @ line 23, column 11
[FATAL] Non-resolvable parent POM for org.apache.sqoop.spark:spark-job:[unknown-version]: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT and 'parent.relativePath' points at wrong local POM @ line 23, column 11
@
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project org.apache.sqoop.spark:spark-job:[unknown-version] (/home/mapr/sqoop-on-spark/spark-job/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM for org.apache.sqoop.spark:spark-job:[unknown-version]: Could not find artifact org.apache.sqoop:connector:pom:2.0.0-SNAPSHOT and 'parent.relativePath' points at wrong local POM @ line 23, column 11 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
Could you please help?

@oscarcastaneda @vybs @drnushooz Could you please advise on the below error:
when i try to compile spark-job (../sqoop-on-spark/spark-job)
[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[WARNING] 'parent.relativePath' of POM org.apache.sqoop.spark:spark-job:[unknown-version] (/home/mapr/sqoop-on-spark/spark-job/pom.xml) points at org.apache:sqoop instead of org.apache.sqoop:connector, please verify your project structure @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 23, column 11
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.execution:sqoop-execution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 41, column 17
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.submission:sqoop-submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 46, column 18
[ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-core_2.10:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 51, column 18
@
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project org.apache.sqoop.spark:spark-job:2.0.0-SNAPSHOT (/home/mapr/sqoop-on-spark/spark-job/pom.xml) has 3 errors
[ERROR]     'dependencies.dependency.version' for org.apache.sqoop.execution:sqoop-execution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 41, column 17
[ERROR]     'dependencies.dependency.version' for org.apache.sqoop.submission:sqoop-submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 46, column 18
[ERROR]     'dependencies.dependency.version' for org.apache.spark:spark-core_2.10:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], /home/mapr/sqoop-on-spark/spark-job/pom.xml, line 51, column 18
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
for sqoop-spark-jar:
[mapr@dev-mapr-1c-110 spark-job]$ cd ../sqoop-spark-jar/
[mapr@dev-mapr-1c-110 sqoop-spark-jar]$ mvn compile
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building sqoop-spark-jar 2.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for org.apache.sqoop.submission:sqoop-submission-spark:jar:2.0.0-SNAPSHOT is missing, no dependency information available
[WARNING] The POM for org.apache.sqoop.execution:sqoop-execution-spark:jar:2.0.0-SNAPSHOT is missing, no dependency information available
[WARNING] The POM for org.apache.sqoop.spark:spark-job:jar:2.0.0-SNAPSHOT is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1.115 s
[INFO] Finished at: 2016-11-02T19:23:29+00:00
[INFO] Final Memory: 17M/920M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project sqoop-spark-jar: Could not resolve dependencies for project org.apache:sqoop-spark-jar:jar:2.0.0-SNAPSHOT: The following artifacts could not be resolved: org.apache.sqoop.submission:sqoop-submission-spark:jar:2.0.0-SNAPSHOT, org.apache.sqoop.execution:sqoop-execution-spark:jar:2.0.0-SNAPSHOT, org.apache.sqoop.spark:spark-job:jar:2.0.0-SNAPSHOT: Failure to find org.apache.sqoop.submission:sqoop-submission-spark:jar:2.0.0-SNAPSHOT in http://repository.apache.org/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

Hi @vasanthkumarm @manmeetkaur , sorry it took some time for me to reply.
As I understand you are both experiencing the same issue. Namely that it errors out when:
$ cd ../sqoop-on-spark/spark-job
$ mvn compile

After the work around I posted on July 27th, 2015 I changed to a new laptop and recently I needed to build Sqoop on Spark again. I basically followed the same workaround and got it working again.
The workaround is apparently needed to get all required downloads into .m2/repository. That is the reason why I advise to first mvn compile on sqoop2 as instructed in [1].
Just to be sure, I cloned sqoop-on-spark from scratch in a new directory. And when I do:
$ cd ../sqoop-on-spark/spark-job
$ mvn compile

I get a BUILD SUCCESS without any problems. I think this is because I previously mvn compiled sqoop2 and that got all required downloads in place.
Let me know if you need any of my pom.xml files, maybe that'll help? I'll be checking back in case you have further questions.
[1] http://sqoop.apache.org/docs/1.99.6/BuildingSqoop2.html

Hi @oscarcastaneda @vybs
I am getting following error while compiling using mvn.
$ cd sqoop-on-spark/spark-job
$ mvn compile

```[INFO] Scanning for projects...
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[WARNING] 'parent.relativePath' of POM org.apache.sqoop.spark:spark-job:[unknown
-version] (C:\Users\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml) poin
ts at org.apache:sqoop instead of org.apache.sqoop:connector, please verify your
 project structure @ org.apache.sqoop.spark:spark-job:[unknown-version], C:\User
s\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line 23, column 11
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.execution:sqoop-e
xecution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-versi
on], C:\Users\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line 41, c
olumn 17
[ERROR] 'dependencies.dependency.version' for org.apache.sqoop.submission:sqoop-
submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-ver
sion], C:\Users\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line 46,
 column 18
[ERROR] 'dependencies.dependency.version' for org.apache.spark:spark-core_2.10:j
ar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], C:\Users\He
mant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line 51, column 18
 @
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project org.apache.sqoop.spark:spark-job:2.0.0-SNAPSHOT (C:\Users\
Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml) has 3 errors
[ERROR]     'dependencies.dependency.version' for org.apache.sqoop.execution:sqo
op-execution-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-v
ersion], C:\Users\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line 4
1, column 17
[ERROR]     'dependencies.dependency.version' for org.apache.sqoop.submission:sq
oop-submission-spark:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown
-version], C:\Users\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line
 46, column 18
[ERROR]     'dependencies.dependency.version' for org.apache.spark:spark-core_2.
10:jar is missing. @ org.apache.sqoop.spark:spark-job:[unknown-version], C:\User
s\Hemant\Sqoop-On-Spark\sqoop-on-spark\spark-job\pom.xml, line 51, column 18
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e swit
ch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please rea
d the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildin
gException

Hi @oscarcastaneda  @vybs  @vinayakthatte @hemant-rout
Question: just curious, As it seems there might not be big support on Sqoop2, do you guys advice using sqooponspark or it's completely based on Sqoop1?
ISSUE: I tried the same steps ...even after downloading sqoop2 and doing "maven compile" ? . I got the following error when I did "mvn install" from sqoop2 directory.
[INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) on project sqoop-shell: There are test failures. [ERROR]  [ERROR] Please refer to /Users/naveen.arumugam/Downloads/sqoop2/shell/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR]  [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR]  [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR]  [ERROR] After correcting the problems, you can resume the build with the command [ERROR]   mvn <goals> -rf :sqoop-shell

Just change the "connector" to "sqoop" in master pom.xml file and directly compile from parent directory. No need to go to spark-job/ directory.

Just change the "connector" to "sqoop" in master pom.xml file and directly compile from parent directory. No need to go to spark-job/ directory.
This is how parent tag should look like -

org.apache
sqoop
2.0.0-SNAPSHOT

Just change the "connector" to "sqoop" in master pom.xml file and directly compile from parent directory. No need to go to spark-job/ directory.
This is how parent tag should look like -

org.apache
sqoop
2.0.0-SNAPSHOT

And you can do " $ mvn compile -DskipTests "to bypass any test failures for debug.


amplify push modify backend-config.json removing "parameters"

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
v20.10.0
Amplify CLI Version
12.10.1
What operating system are you using?
Mac
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No manual changes made
Describe the bug

I cloned a fully working repository to my new Mac,
Pulled dev environment with: amplify pull
Pulled test environment.
All fine up to here.

Trying to re-publish web app manually:

amplify env checkout dev
amplify publish -y

At this point amplify modify amplify/backend-config.json removing "parameters".
I tryied to do it in my preview Mac and It works fine.
New mac requires to run amplify pull before publish. but we have "prod" environment where we need to deploy dev backend updates.

Expected behavior

amplify env checkout test
amplify publish -y
deploy it to host correctly

Reproduction steps

clone app repo
amplify pull
amplify pull --appId XXXXXX --envName test
amplify env checkout dev
amplify publish -y

Project Identifier
41de347992480064a5878862a835ef5e
Log output

# Put your logs below this line

Additional information
No response
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

Hey @gzimbron, the issue appears to be similar to https://github.com/aws-amplify/amplify-cli/issues/13467. Does the repository also track the team-provider-info.json file and does it contain the function environment variables similar to https://github.com/aws-amplify/amplify-cli/issues/13467#issuecomment-1874581172?

Hi @ykethan , repository is ignoring this file.
Btw team-provider-info.json functions doesn't have "deploymentBucketName" and "s3Key"
team-provider-info.json must be tracked by git ?


Do you want to close this window?

OS X terminal asks "Do you want to close this window?" on CMD + W. Can't find how to disable it.
In settings > profiles > [my profile] > Shell I set the following settings.

Anyone know how to resolve this? Thanks a lot for your suggestions!

Remove all the bash lines from that setting?
The setting will prompt on closing if any of the programs listed are currently running.

That's not how I understand this menu. Either way the default is without all of these entries (just tmux and screen). I just tried it again. Doesn't work.
AFAIK Terminal will prompt if any process is running, other than the ones listed.

Oops. I misread. You're right, sorry.

Closing as it’s not related to this repository. (I use iTerm 2, FWIW.)


Correction for raw affiliation Montpellier Interdisciplinary Center on Sustainable Agri-Food Systems (MoISA), Univ Montpellier, CIHEAM-IAMM, CIRAD, INRAE, Institut Agro, IRD, 34060 Montpellier, France

Correction needed for raw affiliation Montpellier Interdisciplinary Center on Sustainable Agri-Food Systems (MoISA), Univ Montpellier, CIHEAM-IAMM, CIRAD, INRAE, Institut Agro, IRD, 34060 Montpellier, France
raw_affiliation_name: Montpellier Interdisciplinary Center on Sustainable Agri-Food Systems (MoISA), Univ Montpellier, CIHEAM-IAMM, CIRAD, INRAE, Institut Agro, IRD, 34060 Montpellier, France
new_rors: 003vg9w96;05kpkpg04;051escj72;05q3vnk25;03rnk6m14;0005r2j17;04abkkz03;011xg1225
previous_rors: 003vg9w96;05kpkpg04;051escj72;05q3vnk25;03rnk6m14;0005r2j17;04abkkz03
works_examples: W4391110314
contact: 7c2230dc11d73ee34701744e5b5ba2a9:a93f963691dff880 @ supagro.fr

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.


Investigate .tiff files not loading in preview or full screen

No content

Issue created by BlueBubbles Bot in the BlueBubbles commnity on behalf of @tneot01 in #support.

Don't think this is fixable as Android itself doesn't have native support for .tif files, you have to use a 3rd party library

I think it's safe to just display this using the unsupported attachment widget. Then we can use android's OpenIntents to try and find and open it in a supported app


cannot download input_datasets.zip

batch response: This repository is over its data quota. Account responsible for LFS bandwidth should purchase more data packs to restore access.
error: failed to fetch some objects from 'https://github.com/casperboone/dltpy.git/info/lfs'
I use git command git lfs clone https://github.com/casperboone/dltpy.git to download but failed, could you give me a copy of
'input_datasets.zip', thanks

I also cannot download input_datasets.zip , do you find the solution @sdubachelor


Cleanup custom ci to build compose app targets

Basic cleanup and readability changes. Of note:

fixed numbering
example for user GitHub URL changed, replacing "foundriesio" with ""
broken reference to top of page removed, not needed.
added ci:read-update to list of required token scopes.

QA Steps: Ran linter, linkcheck, and checked rendered output in browser.
No related tasks, quick fix/cleanup.
PR Template and Checklist
Please complete as much as possible to speed up the reviewing process.
Readiness and adding reviewers as appropriate is required.
All PRs should be reviewed by a technical writer/documentation team and a peer.
If effecting customers—which is a majority of content changes—a member of Customer Success must also review.
Readiness

[x] Merge (pending reviews)
[ ] Merge after date or event
[ ] Draft

Overview
Why merge this PR? What does it solve?
Checklist

[x] Run spelling and grammar check, preferably with linter.
[x] Avoid changing any header associated with a link/reference.
[x] Step through instructions (or ask someone to do so).
[x] Review for wordiness
[x] Match tone and style of page/section.
[x] Run make linkcheck.
[x] View HTML in a browser to check rendering.
[x] Use semantic newlines.
[x] follow best practices for commits.

[x] Descriptive title written in the imperative.
[x] Include brief overview of QA steps taken.
[x] Mention any related issues numbers.
[x] End message with sign off/DCO line (-s, --signoff).
[x] Sign commit with your gpg key (-S, --gpg-sign).
[x] Squash commits if needed.

[x] Request PR review by a technical writer and at least one peer.

Comments
Any thing else that a maintainer/reviewer should know.
This could include potential issues, rational for approach, etc.

Docs for b2e1a2ac2c98a199c333b1aa73060ee98309ceaf are browsable at: https://ci.foundries.io/projects/fio-docs/builds/2702/docs/artifacts/html/index.html

Docs for e882da734e9cc75751c58ab5100bb7ab276c7ac2 are browsable at: https://ci.foundries.io/projects/fio-docs/builds/2703/docs/artifacts/html/index.html

Docs for cd72cdabf297e18eb63b45e73a73d0362844cd1c are browsable at: https://ci.foundries.io/projects/fio-docs/builds/2704/docs/artifacts/html/index.html

Docs for 5dea302d56ab74ddc3dde538e338eb0aa1942fb1 are browsable at: https://ci.foundries.io/projects/fio-docs/builds/2705/docs/artifacts/html/index.html


pip packages should be case insensitive and _ vs - are the same

There is a minor bug/corner case where the package name's case setting affects if it gets picked up.
From https://peps.python.org/pep-0426/#name

All comparisons of distribution names MUST be case insensitive, and MUST consider hyphens and underscores to be equivalent.

Example:

Numpy == numpy == NuMPy
My-package == my_package

@ak-gupta or @NikhilJArora would you have time/interest to work on a fix for this?

I'd be interested in taking a look at this!

I'd be interested in taking a look at this!

Thanks @NikhilJArora that would be fantastic


Solve Round D

Solve Questions of Round D
Languages accepted:

C
C++
Java
Python

Questions to view: https://github.com/BlankCoders/GoogleKickStart2020_Solutions/blob/master/Round D/QuestionsList.md
Important: Comment below to let us know what you want to solve & in which language. 😄
Assignees:

Record Breaker ✅

C - @adhi-2311
C++ - @ayerhs7
Java - @kpx3
Python - @paslucena

Alien Piano

C - @Krish03na
C++ - @imsushant12 - Completed
Java - @imsushant12 - Completed
Python - NA

Beauty of tree

C - NA
C++ - @ayerhs7 - Completed
Java - NA
Python - NA

Locked Doors

C - NA
C++ - NA
Java - NA
Python - NA

NA  - Not Assigned
🚀 Happy Coding 🚀

Hey! I would like to solve the first three problems Record Breaker, Alien piano and beauty of tree. All three in C++. Please reply asap!

@ayerhs7 yeah assigning you.

Hey, I'm going to try the Record Breaker in python, if it's ok!

Pls assign this task to me. I would love to slove as many problems as I can

@AnshMishra2001 sorry i can't assign you entire issue you've to mention the language & problem for which you would like to solve.

hello i would like to contribute to record breaker in java

@kpx3 assigned

Hi @lostgirljourney I would love to add my C solution to Record Breaker Problem.

@adhi-2311 assigned!

Hi! can i work on Alien Piano in C.

@lostgirljourney @adhi-2311  Please assign me solving the question Locked Doors using CPP language.

@Devolious Is #5 done?

@lostgirljourney I have made a pull request for #5 please review and merge it.

@Devolious assigned 🤖

Hi @lostgirljourney, could you please assign me alien piano in C? Thanks

ohkay @Krish03na :)

@lostgirljourney I would like to solve Round-D Locked Doors using Java. Please assign it to me.

@sleepyboyskm assigned. 🚀

@lostgirljourney I have made pull request for Locked doors java solution please merge it and please assign me the C++ solution to Locked Doors too. :)

@sleepyboyskm okay. go ahead.

@lostgirljourney Please merge the previous pull request :)

@lostgirljourney I have made a pull request for Locked Doors CPP solution adhering to guidelines. Please merge my pull request :)

Hi @lostgirljourney
I'd like to solve Alien Piano and Beauty of Tree both in Python and Locked Doors in both C++ and Python
Kindly assign the problems to me.
Thanks :)


Create minimum number of moves to make a palindrone.cpp

commit for hacktoberfest2023. Added code for minimum number of operations to make a palindrone

Hey there thanks for the contribution. Would be great if you could star the repo so that it will be helpful for future contributors also. Thanks!


Add more fill modes to ProgressBar

Add more fill modes to ProgressBar, as TextureProgressBar already has many. Currently, only FILL_RIGHT_TO_LEFT, FILL_TOP_TO_BOTTOM, and FILL_BOTTOM_TO_TOP were implemented besides the default FILL_LEFT_TO_RIGHT mode.

Bugsquad edit: This closes https://github.com/godotengine/godot-proposals/issues/4514.

I have a question though. What does is_layout_rtl() do in progress_bar.cpp? Since I don't know when the function returns true, I haven't tested the fill modes in those situations yet.

I have a question though. What does is_layout_rtl() do in progress_bar.cpp? Since I don't know when the function returns true, I haven't tested the fill modes in those situations yet.

It's to do with right-to-left UI layouts, typically used for languages which read R-T-L. It checks if the setting is set which makes it RLT... that's about all I know, @bruvzg could explain more.

I changed the editor language to Arabic and now is_layout_rtl() returns true. But I don't see the reason for ProgressBar to behave differently for different language layouts. Also TextureProgressBar doesn't do this check at all.

I changed the editor language to Arabic and now is_layout_rtl() returns true. But I don't see the reason for ProgressBar to behave differently for different language layouts. Also TextureProgressBar doesn't do this check at all.

Well, it makes sense that Right-to-Left languages have progress bars filling from the right to the left. If @bruvzg implemented it, it means that likely how things happen with right-to-left languages. Please keep this behavior.
However it is not needed for top-to-bottom and bottom-to-top, so your PR needs an edit there.

@groud But considering it's now possible to manually select from left-to-right and right-to-left fill modes, isn't it more reasonable to discard this check. Otherwise, when the left-to-right is selected by default, the progress actually goes from right to left. Instead, we could do this check when setting the initial fill mode, i.e. left-to-right for usual languages and right-to-left for rtl languages.

@groud But considering it's now possible to manually select from left-to-right and right-to-left fill modes, isn't it more reasonable to discard this check. Otherwise, when the left-to-right is selected by default, the progress actually goes from right to left. Instead, we could do this check when setting the initial fill mode, i.e. left-to-right for usual languages and right-to-left for rtl languages.

No, this has to be automatic, that's the point of what @bruvzg implemented.
I don't know much about the details, but if I record correctly, you can override this behavior at the node level.
Worst case, it could eventually be renamed to "Begin to end" or something like that. But for now, it's better to keep compatibility.

@groud Alright. But it might need some fix as it behaves like this with original code:

In addition, it seems it goes from left to right by default in the first place (I moved original code inside left_to_right case block, so it should behave exactly the same way as before when left_to_right fill mode is selected).

@groud Alright. But it might need some fix as it behaves like this with original code

Ah, It might indeed need a bugfix I don't know.

Made changes to fix fill direction for RTL layout.

@Calinou Rebasing done.

I think this might not respect the UI mirroring convention for RTL. I see there's a switch in the constructor but that's only valid for the default mode.
It would likely be better to use BEGIN_TO_END instead of LEFT_TO_RIGHT and do the mirroring there.

@akien-mga Makes sense.

@akien-mga Might be good to go now.

What was the problem with just rotating the whole Node?

What was the problem with just rotating the whole Node?

You mean why different modes instead of just rotating the Node? Rotating the Node will rotate all of its contents, including percent text or children of that Node. And this might be not wanted.

Also rotating won't work in a container.


Add text into video

@gre When rendering video, it would be nice if you could add text in the playing video, do you know if there is a way how to achieve this? Do you plan to implement this functionality?

It's not built-in in diaporama right now,
but you could use another DOM element on top of the Diaporama and listen to diaporama "render" event to put the text you want based on the current time.
function createDivAndPositionItOnTopOfDiaporama(){} // TODO
function getTextForTime(time) { return "HELLO WORLD"; } // TODO

var absoluteDiv = createDivAndPositionItOnTopOfDiaporama(), currentText = "";

function syncTextForTime (time) {
  var text = getTextForTime(time);
  if (currentText !== text) { // optim to not set `textContent` if nothing changes
    currentText = text;
    absoluteDiv.textContent = text;
  }
}

diaporama.on("render", function (time) {
  syncTextForTime(time);
});

As for implementing in diaporama, i'm not yet sure, I'm trying to keep diaporama minimal, and this one is tricky.
In diaporama paradigm, everything is rendered into a canvas (that allows experiments like https://github.com/glslio/diaporama-recorder that snapshot all frames and convert a diaporama to a video )
To be rendered into WebGL, I need to use a Canvas2D (the only way to get text in) inject it as a texture (like already done for "content" slides) and blend it with the video. It's not impossible but requires a bit more work.

still, let's keep this issue opened because I'm not closing this door. I think this feature is interesting.

Providing timeline hooks to support a workflow that overlays existing HTML presentation frameworks like RevealJS (https://github.com/hakimel/reveal.js) would be great.
(We have an in-house tool that renders text via Canvas2D and it's been very disappointing. Wish we'd focused on supporting HTML/CSS from the beginning. There must be a way to render document elements to canvas for the purpose of capturing?)

what do you mean by timeline hooks? There are these events https://gre.gitbooks.io/diaporama/content/docs/events.html

I believe Diaporama now uses WebGL, and hence the original request is more likely possible now.


[Chef-16] Fix bundle install failures for chefstyle check under github actions

Signed-off-by: Neha Pansare<EMAIL_ADDRESS>
Description
The chefstyle step in action actions has started failing due to it pulling in gem semverse 3.0.2 which is ruby 27 compatible whereas the step is setup for ruby 2.6 (https://github.com/chef/chef/blob/chef-16/.github/workflows/lint.yml)
NOTE: If force it to use ruby27, it somehow starts checking chefstyle for all the gems (https://github.com/chef/chef/pull/13289)
It used to pull in version 3.0.0 (e.g https://github.com/chef/chef/actions/runs/3281024063/jobs/5402520515)
Turns out this started happening because this expediator pr to bump versions  was merged which contains gems which are ruby27 compatible, which can be seen in it's own chefstyle failures https://github.com/chef/chef/actions/runs/3283043466/jobs/5407254598#step:3:24
It is not only the gem semverse, but many more. Hence reverting version bump pr https://github.com/chef/chef/pull/13294. Once that is merged, rebasing rest of PRs will fix the issues.
Related Issue

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Chore (non-breaking change that does not add functionality or fix an issue)

Checklist:

[ ] I have read the CONTRIBUTING document.
[ ] I have run the pre-merge tests locally and they pass.
[ ] I have updated the documentation accordingly.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.
[ ] All commits have been signed-off for the Developer Certificate of Origin.

Closing this since https://github.com/chef/chef/pull/13294 is merged.
Refer PR description for more details.


Mongo sync guide

@kroegerk could you do a proofread ?

@kroegerk I have updated this sentence https://github.com/micronaut-projects/micronaut-guides/pull/528/commits/126b1b32e5002b727f7433c8fdc06d360e9681a6


Pulldown cmark to cmark 17.0.0 upgrade

Upgrades pulldown-cmark-to-cmark
Adjust tests for new way reference links are handled

This supersedes https://github.com/google/mdbook-i18n-helpers/pull/233.
Tests had to be adjusted because new version of the library retains more info from reference links. Reference links are no longer replaced with full URLs. We can probably make some manual adjustments to reference link handling in order to retain the old behavior but I think the new way should work better.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 84.89%. Comparing base (035e16b) to head (2362e44).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #234   +/-   ##
=======================================
  Coverage   84.89%   84.89%
=======================================
  Files          15       15
  Lines        3369     3369
  Branches     3369     3369
=======================================
  Hits         2860     2860
  Misses        422      422
  Partials       87       87

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Tests had to be adjusted because new version of the library retains more info from reference links. Reference links are no longer replaced with full URLs.

Oh, that's interesting!
In some sense, having the links expanded is good since it makes the translation completely self-contained. Each msgid field is a complete unit. If you change either the text or the link, the whole msgid field is invalidated.
However, it has the bad effect of making the text harder to work with for the translators. So I would actually like to see the reference links stay as they are.
I think we need to think about if we can/should keep link definitions together with the msgid field that uses them?
What I'm afraid of is a situation where we start with this:
Please [click here]!

[click here]: here.html

This is translated as:
msgid "Please [click here]!"
msgstr "Venligst [klik her]!"

msgid "[click here]: here.html"
msgstr "[klik her]: her.html"

The original text is changed to:
Don't [click here]!

[click here]: here.html

Because the text changed, msgmerge will revert the translation to the English text. The link definition is not changed, so the translation is reused. The translated Markdown document becomes
Don't [click here]!

[klik her]: her.html

We now have a link without the corresponding link definition!

@mgeisler ok, given this I updated the PR to retain the old behavior. I had to edit expand_shortcut_link in order to support more link types.


indy-node and indy-plenum restrict endpoint to ip-address:port

Signed-off-by: Axel Nennker<EMAIL_ADDRESS>

There are tests in indy-node and in indy-plenum restricting endpoint to ip address and port
https://github.com/hyperledger/indy-node/blob/master/indy_common/types.py#L193
https://github.com/hyperledger/indy-plenum/blob/master/plenum/common/util.py#L557


Shouldn't be bound to a view

The usage of the toast is like:

self.view.makeToast("This is a piece of toast")

But it must be independent of the view. So that we can call it from any where in the application even when there's no view associated with it. May be from singleton classes, api call managers etc as well.

There’s always a view. Present the toast in the window if you want something globally available.


Remove moot version property from bower.json

Per bower/bower.json-spec@a325da3

Thanks but sorry, i will keep it because it is used in Gulp source builder, also it is harmless and may be required in future

Also their maintainer says they probably won't ever use it: http://stackoverflow.com/questions/24844901/bowers-bower-json-file-version-property


Column name Autocompletion does not work with join queries on mssql

System information:

Windows 2010 64 bits
DBeaver version 21.0.4
Additional extensions

Connection specification:

Database Microsoft SQL Server 2014 (SP3-GDR) (KB4583463) - 12.0.6164.21 (X64)
Nov  1 2020 04:25:14
Copyright (c) Microsoft Corporation
Enterprise Edition: Core-based Licensing (64-bit) on Windows NT 6.3  (Build 9600: ) (Hypervisor)
Driver name Microsoft JDBC Driver for SQL Server
Do you use tunnels or proxies (SSH, SOCKS, etc)? NO

I can not use autocomplete for tables columns after write the table name and a dot and press CTRL+SPACE, on queries which use joins.
It happens since version 21.0.3, on 21.0.2 It works fine
Steps to reproduce, if exist:
Create the example database that I attach
create a new script for this database and paste this:

USE test_database;
select * from regions;
SELECT
countries.country_name, regions.             --put your cursor after the dot and press CTRL+SPACE the columns that It suggests are from countries table, no from regions
FROM
countries
JOIN regions ON
countries.region_id = regions.region_id
WHERE
country_id = 'DE';

exampleDB.zip

Thank you for the report. Unfortunately I couldn't reproduce this issue. Can you try this on version 21.0.5 ?

It seems to be fixed in 21.0.5 version. Thanks!


Some assets don't utilize asset pipeline, cause 404s

I've noticed many refinery-related assets 404 when I'm in my admin panel outside of a development environment. The difference between the ones that work and the ones that don't seem to be that the ones that do not work are not utilizing the asset pipeline properly.
These do not work:
https://admin.tera.qa.enmasse.com/assets/refinery/carousel-right.png
https://admin.tera.qa.enmasse.com/assets/refinery/carousel-left.png
https://admin.tera.qa.enmasse.com/assets/refinery/ajax-loader.gif
https://admin.tera.qa.enmasse.com/assets/wymeditor/skins/refinery/wymiframe.css?5282651692112581
https://admin.tera.qa.enmasse.com/assets/formatting.css?18938815493726824
https://admin.tera.qa.enmasse.com/assets/theme.css?11953640834117985
https://admin.tera.qa.enmasse.com/assets/wymeditor/skins/refinery/wymiframe.css?17024000154518804
https://admin.tera.qa.enmasse.com/assets/formatting.css?8155823824584488
https://admin.tera.qa.enmasse.com/assets/theme.css?9678781410283206
https://admin.tera.qa.enmasse.com/assets/refinery/tooltip-nib.png
These assets, however, work fine:
http://tera-0.qa.enmasse-game.com/assets/c49bae9ab79da7a0b8a03b875c467a5c03baed2a/refinery/page-image-picker-b6b1f35ba383c32932afc0b0562c300b.js
http://tera-1.qa.enmasse-game.com/assets/c49bae9ab79da7a0b8a03b875c467a5c03baed2a/wymeditor/skins/refinery/text_heading_1-9f5c2dd7f2ec54d8afc0d2650b549d06.png
http://tera-0.qa.enmasse-game.com/assets/c49bae9ab79da7a0b8a03b875c467a5c03baed2a/wymeditor/skins/refinery/text_paragraph-a430a01e918a05f5a8a25c9bab624c1a.png
I poked around some code and what I found seem to corroborate the idea that these are failing due to lack of use of the asset pipeline. A few examples:
Core:
https://github.com/resolve/refinerycms/blob/master/core/app/assets/javascripts/refinery/boot_wym.js.erb#L256
https://github.com/resolve/refinerycms/blob/master/core/app/assets/javascripts/refinery/admin.js.erb#L197
https://github.com/resolve/refinerycms/blob/master/core/app/assets/javascripts/refinery/interface.js.coffee#L37
Blog Engine (I can make a separate issue if you want one on that project as well):
https://github.com/resolve/refinerycms-blog/blob/rails-3-1/app/assets/javascripts/refinery/blog/backend.js#L11

We need just convert it to use asset pipeline, not hardcoded url.

I tried to replace hardcoded images with <%= asset_path(...) %> but it still used regular assets like carousel-right.png instead of carousel-right.png-asdaasasdas9d90asd98 ones.
Btw, there was no 404's...

@syelle can you try replacing one of the failing assets with <%= asset_path("...") %> and see if it resolves your issue.

@ugisozols I'll give it a try (hopefully soon). We actually removed the git hash from our asset path (and thus no longer need that config variable). I'll have to make changes to a branch to revert these changes, make your suggested changes, and test.

Would like to get this issue resolved in the next few days so that we can include it in 2.0

Totally about to pwn this issue!

HEADSHOT!


Toolbox doesn't roll when scrolling cursor mouse in JavaScript mode

Describe the bug
Tutorial picture in "Community" is empty when switching language to "Chinese"
Steps to reproduce the behavior

Navigate to https://arcade.makecode.com/beta#editor
Scroll down to "Blocks Games" -> open the game I editor
Click "{}JavaScript" to switch to JavaScript mode
Click "Sprites" and scroll the cursor mouse

Expect behavior
The toolbox should roll when scrolling cursor mouse

Actual behavior
Toolbox doesn't roll when scrolling cursor mouse in JavaScript mode

Additional context

OS: Windows(this bug repro on each browser)
Machine build: 17763.1.amd64fre.rs5_release.180914-1434
arcade version: 0.11.4
Microsoft MakeCode version: 5.11.7

Duplicate of https://github.com/Microsoft/pxt-arcade/issues/205

Duplicate


Integrate sort options, set default sort

Changes in this PR

Integrate sort options to consignment view
Add tests

JIRA ticket
https://national-archives.atlassian.net/browse/AYR-667
Screenshots of UI changes
Before
After

[ ] Requires env variable(s) to be updated

Currently review the chain of filter and sort PRs Pavan created. Once those are all merged in, I will review this one as I think there will be a shared build sort function